2024-09-21T06:07:06.034 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T06:07:06.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T06:07:06.182 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913538 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/fsx}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913538' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL31+xpzlPSvzuPDc9mziAhlkAnkQpYwTq5w5HZLztTnnbZJTsBOl8Cq9BVYLB7mrmnwihxNQgqA+dudpEbJM5A= smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE59jjIuM9ynYusrQdwl+pF81dQJuD/D3Q155cxXKp9uqlHG6tRTFgIZ/D5z9//TUDlgvzg76ZSqa9utktFHqiY= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAon+IXXMT/zRkEQxQdaoZJTJEjzUjpVY/GldDdA9H44VaCh54D+NGw0Q9u0MbablQIIfUm5N3JfMKrqonnX/00= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/fsx.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T06:07:06.183 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T06:07:06.183 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T06:07:06.183 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T06:07:06.185 INFO:teuthology.task.internal:Checking packages... 2024-09-21T06:07:06.206 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T06:07:06.206 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T06:07:06.207 INFO:teuthology.packaging:ref: None 2024-09-21T06:07:06.207 INFO:teuthology.packaging:tag: None 2024-09-21T06:07:06.207 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:07:06.207 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:07:06.207 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:07:06.349 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T06:07:06.350 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T06:07:06.357 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T06:07:06.357 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T06:07:06.417 INFO:teuthology.task.internal:Saving configuration 2024-09-21T06:07:06.438 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T06:07:06.474 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T06:07:06.496 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913538', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:02:07.153750', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL31+xpzlPSvzuPDc9mziAhlkAnkQpYwTq5w5HZLztTnnbZJTsBOl8Cq9BVYLB7mrmnwihxNQgqA+dudpEbJM5A='} 2024-09-21T06:07:06.517 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913538', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:02:07.151940', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE59jjIuM9ynYusrQdwl+pF81dQJuD/D3Q155cxXKp9uqlHG6tRTFgIZ/D5z9//TUDlgvzg76ZSqa9utktFHqiY='} 2024-09-21T06:07:06.540 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913538', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:02:07.155482', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAon+IXXMT/zRkEQxQdaoZJTJEjzUjpVY/GldDdA9H44VaCh54D+NGw0Q9u0MbablQIIfUm5N3JfMKrqonnX/00='} 2024-09-21T06:07:06.540 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T06:07:06.551 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T06:07:06.552 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T06:07:06.552 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T06:07:06.552 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T06:07:06.657 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0076700160>, signals=[15]) 2024-09-21T06:07:06.657 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T06:07:06.663 INFO:teuthology.task.internal:Opening connections... 2024-09-21T06:07:06.663 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T06:07:06.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:07:06.744 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2024-09-21T06:07:06.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:07:06.821 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2024-09-21T06:07:06.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:07:06.896 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T06:07:06.905 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2024-09-21T06:07:06.924 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2024-09-21T06:07:06.924 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-09-21T06:07:06.981 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream" 2024-09-21T06:07:06.981 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="9" 2024-09-21T06:07:06.981 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos" 2024-09-21T06:07:06.981 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:07:06.981 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="9" 2024-09-21T06:07:06.982 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:07:06.982 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:07:06.982 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2024-09-21T06:07:06.982 INFO:teuthology.orchestra.run.smithi063.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:07:06.982 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:07:06.982 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:07:06.982 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:07:06.982 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:07:06.982 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:07:06.983 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-09-21T06:07:07.007 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-09-21T06:07:07.025 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-09-21T06:07:07.026 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-09-21T06:07:07.084 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-09-21T06:07:07.084 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2024-09-21T06:07:07.084 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-09-21T06:07:07.084 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:07:07.084 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2024-09-21T06:07:07.084 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:07:07.084 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:07:07.084 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-09-21T06:07:07.085 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:07:07.085 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:07:07.085 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:07:07.085 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:07:07.085 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:07:07.085 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:07:07.085 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-09-21T06:07:07.124 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-09-21T06:07:07.142 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-09-21T06:07:07.142 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-09-21T06:07:07.200 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-09-21T06:07:07.200 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-09-21T06:07:07.200 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-09-21T06:07:07.200 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:07:07.200 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-09-21T06:07:07.200 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:07:07.200 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:07:07.201 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-09-21T06:07:07.201 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:07:07.201 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:07:07.201 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:07:07.201 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:07:07.201 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:07:07.201 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:07:07.201 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-09-21T06:07:07.223 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T06:07:07.237 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T06:07:07.317 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T06:07:07.317 DEBUG:teuthology.orchestra.run.smithi063:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:07:07.320 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:07:07.322 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:07:07.339 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T06:07:07.377 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T06:07:07.377 DEBUG:teuthology.orchestra.run.smithi063:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:07:07.379 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:07:07.382 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:07:07.495 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T06:07:07.568 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T06:07:07.584 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T06:07:07.584 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-21T06:07:07.584 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-21T06:07:07.584 DEBUG:teuthology.orchestra.run.smithi063:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:07:07.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:07:07.601 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-09-21T06:07:07.659 INFO:teuthology.orchestra.run.smithi063.stdout:5.14.0-503.el9.x86_64 2024-09-21T06:07:07.659 INFO:teuthology.task.kernel:Running kernel on smithi063: 5.14.0-503.el9.x86_64 2024-09-21T06:07:07.659 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum install -y kernel 2024-09-21T06:07:11.170 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.3 MB 00:01 2024-09-21T06:07:15.412 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 6.6 MB/s | 20 MB 00:03 2024-09-21T06:07:20.329 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-21T06:07:22.155 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 19 kB 00:00 2024-09-21T06:07:22.959 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-21T06:07:28.715 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-21T06:07:30.713 INFO:teuthology.orchestra.run.smithi063.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T06:07:30.713 INFO:teuthology.orchestra.run.smithi063.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T06:07:30.827 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-21T06:07:30.833 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-21T06:07:30.833 INFO:teuthology.orchestra.run.smithi063.stdout: Package Architecture Version Repository Size 2024-09-21T06:07:30.833 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-21T06:07:30.833 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-21T06:07:30.833 INFO:teuthology.orchestra.run.smithi063.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T06:07:30.834 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-21T06:07:30.834 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T06:07:30.834 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T06:07:30.834 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T06:07:30.834 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:07:30.834 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-21T06:07:30.834 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-21T06:07:30.834 INFO:teuthology.orchestra.run.smithi063.stdout:Install 4 Packages 2024-09-21T06:07:30.834 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:07:30.835 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 79 M 2024-09-21T06:07:30.835 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 126 M 2024-09-21T06:07:30.835 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-21T06:07:31.016 INFO:teuthology.orchestra.run.smithi063.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 299 kB/s | 36 kB 00:00 2024-09-21T06:07:33.741 INFO:teuthology.orchestra.run.smithi063.stdout:(2/4): kernel-modules-core-5.14.0-508.el9.x86_6 10 MB/s | 29 MB 00:02 2024-09-21T06:07:36.316 INFO:teuthology.orchestra.run.smithi063.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 2.9 MB/s | 16 MB 00:05 2024-09-21T06:07:38.125 INFO:teuthology.orchestra.run.smithi063.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 4.8 MB/s | 35 MB 00:07 2024-09-21T06:07:38.125 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:07:38.125 INFO:teuthology.orchestra.run.smithi063.stdout:Total 11 MB/s | 79 MB 00:07 2024-09-21T06:07:38.833 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-21T06:07:39.233 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-21T06:07:39.233 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-21T06:07:40.219 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-21T06:07:40.219 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-21T06:07:42.775 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-21T06:07:43.453 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:07:43.601 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:07:46.340 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:07:46.463 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:07:51.581 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:07:51.622 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:07:56.763 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:08:35.660 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:08:35.701 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:08:36.027 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:08:36.027 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:08:36.028 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:08:36.028 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:08:37.011 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:08:37.011 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:08:37.011 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-21T06:08:37.011 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T06:08:37.011 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T06:08:37.011 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T06:08:37.011 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T06:08:37.011 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:08:37.011 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-21T06:08:37.334 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:08:37.462 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:08:37.463 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:08:37.463 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T06:08:37.463 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T06:08:37.463 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T06:08:37.463 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T06:08:37.463 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi063.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T06:08:37.463 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:08:37.522 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:08:37.522 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:08:37.522 DEBUG:teuthology.orchestra.run.smithi063:> sudo rpm -qi grub2-tools 2024-09-21T06:08:37.554 INFO:teuthology.orchestra.run.smithi063.stdout:Name : grub2-tools 2024-09-21T06:08:37.554 INFO:teuthology.orchestra.run.smithi063.stdout:Epoch : 1 2024-09-21T06:08:37.554 INFO:teuthology.orchestra.run.smithi063.stdout:Version : 2.06 2024-09-21T06:08:37.554 INFO:teuthology.orchestra.run.smithi063.stdout:Release : 82.el9 2024-09-21T06:08:37.554 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: x86_64 2024-09-21T06:08:37.554 INFO:teuthology.orchestra.run.smithi063.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T06:08:37.554 INFO:teuthology.orchestra.run.smithi063.stdout:Group : Unspecified 2024-09-21T06:08:37.554 INFO:teuthology.orchestra.run.smithi063.stdout:Size : 8274670 2024-09-21T06:08:37.554 INFO:teuthology.orchestra.run.smithi063.stdout:License : GPLv3+ 2024-09-21T06:08:37.554 INFO:teuthology.orchestra.run.smithi063.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T06:08:37.554 INFO:teuthology.orchestra.run.smithi063.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T06:08:37.555 INFO:teuthology.orchestra.run.smithi063.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T06:08:37.555 INFO:teuthology.orchestra.run.smithi063.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T06:08:37.555 INFO:teuthology.orchestra.run.smithi063.stdout:Packager : builder@centos.org 2024-09-21T06:08:37.555 INFO:teuthology.orchestra.run.smithi063.stdout:Vendor : CentOS 2024-09-21T06:08:37.555 INFO:teuthology.orchestra.run.smithi063.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T06:08:37.555 INFO:teuthology.orchestra.run.smithi063.stdout:Summary : Support tools for GRUB. 2024-09-21T06:08:37.555 INFO:teuthology.orchestra.run.smithi063.stdout:Description : 2024-09-21T06:08:37.555 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:08:37.555 INFO:teuthology.orchestra.run.smithi063.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T06:08:37.555 INFO:teuthology.orchestra.run.smithi063.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T06:08:37.555 INFO:teuthology.orchestra.run.smithi063.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T06:08:37.555 INFO:teuthology.orchestra.run.smithi063.stdout:hardware devices. 2024-09-21T06:08:37.555 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:08:37.555 INFO:teuthology.orchestra.run.smithi063.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T06:08:37.556 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T06:08:37.556 INFO:teuthology.task.kernel:Updating grub on smithi063 to boot 5.14.0-508.el9.x86_64 2024-09-21T06:08:37.556 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T06:08:38.219 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2024-09-21T06:08:39.593 INFO:teuthology.orchestra.run.smithi063.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T06:08:39.627 INFO:teuthology.orchestra.run.smithi063.stderr:done 2024-09-21T06:08:39.629 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-09-21T06:08:39.645 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.Oct5WsozZd 2024-09-21T06:08:39.645 DEBUG:teuthology.orchestra.run.smithi063:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Oct5WsozZd 2024-09-21T06:08:39.711 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.Oct5WsozZd 2024-09-21T06:08:39.842 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.Oct5WsozZd is 6KB 2024-09-21T06:08:39.890 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.Oct5WsozZd 2024-09-21T06:08:39.904 DEBUG:teuthology.orchestra.run.smithi063:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T06:08:39.967 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T06:08:39.967 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T06:08:39.967 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T06:08:39.967 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T06:08:39.968 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T06:08:40.124 DEBUG:teuthology.orchestra.run.smithi063:> sudo shutdown -r now 2024-09-21T06:09:10.127 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T06:09:10.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-21T06:09:10.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:09:28.559 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-21T06:09:37.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-21T06:09:37.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:09:40.622 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-21T06:09:52.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-21T06:09:52.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:10:11.055 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-21T06:10:26.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-21T06:10:26.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:10:26.467 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-09-21T06:10:26.829 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-21T06:10:26.829 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T06:10:26.830 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-09-21T06:10:26.844 INFO:teuthology.orchestra.run.smithi063.stdout:5.14.0-508.el9.x86_64 2024-09-21T06:10:26.844 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T06:10:26.845 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T06:10:26.845 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T06:10:27.846 DEBUG:teuthology.parallel:result is None 2024-09-21T06:10:27.846 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T06:10:27.852 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T06:10:27.853 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:10:27.855 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:10:27.858 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:10:27.877 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T06:10:27.915 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T06:10:27.954 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T06:10:27.954 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:10:27.956 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:10:27.958 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:10:28.189 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T06:10:28.196 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T06:10:28.196 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:10:28.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:10:28.213 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:10:28.230 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:10:28.230 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:10:28.232 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:10:28.255 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:10:28.318 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:10:28.329 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:10:28.337 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:10:28.342 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:10:28.365 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:10:28.377 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:10:28.379 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T06:10:28.385 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T06:10:28.386 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:10:28.388 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:10:28.390 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:10:28.418 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T06:10:28.450 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T06:10:28.450 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:10:28.454 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:10:28.457 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:10:28.475 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:10:28.551 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:10:28.597 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:10:28.680 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:10:28.721 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:10:28.722 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:10:28.787 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:10:28.834 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:10:28.881 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:10:28.966 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:10:29.010 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:10:29.011 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:10:29.080 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:10:29.124 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:10:29.182 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:10:29.266 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:10:29.311 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T06:10:29.311 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:10:29.381 DEBUG:teuthology.orchestra.run.smithi063:> sudo service rsyslog restart 2024-09-21T06:10:29.392 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2024-09-21T06:10:29.395 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2024-09-21T06:10:29.432 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:10:29.464 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:10:29.471 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:10:29.890 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T06:10:29.898 INFO:teuthology.task.internal:Starting timer... 2024-09-21T06:10:29.898 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T06:10:29.994 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T06:10:30.032 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T06:10:30.033 DEBUG:teuthology.orchestra.run.smithi063:> sudo service auditd rotate 2024-09-21T06:10:30.182 INFO:teuthology.orchestra.run.smithi063.stdout:Rotating logs: 2024-09-21T06:10:30.184 DEBUG:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2024-09-21T06:10:30.241 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: 2024-09-21T06:10:30.243 DEBUG:teuthology.orchestra.run.smithi175:> sudo service auditd rotate 2024-09-21T06:10:30.307 INFO:teuthology.orchestra.run.smithi175.stdout:Rotating logs: 2024-09-21T06:10:30.309 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T06:10:30.309 DEBUG:teuthology.orchestra.run.smithi063:> /usr/sbin/getenforce 2024-09-21T06:10:30.344 INFO:teuthology.orchestra.run.smithi063.stdout:Permissive 2024-09-21T06:10:30.344 DEBUG:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2024-09-21T06:10:30.371 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2024-09-21T06:10:30.371 DEBUG:teuthology.orchestra.run.smithi175:> /usr/sbin/getenforce 2024-09-21T06:10:30.392 INFO:teuthology.orchestra.run.smithi175.stdout:Permissive 2024-09-21T06:10:30.393 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi063.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi071.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi175.front.sepia.ceph.com': 'permissive'} 2024-09-21T06:10:30.393 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:10:30.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:10:30.419 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:10:30.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:10:30.446 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:10:30.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:10:30.474 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T06:10:30.474 DEBUG:teuthology.orchestra.run.smithi063:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:10:30.613 DEBUG:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:10:30.649 DEBUG:teuthology.orchestra.run.smithi175:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:10:30.683 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T06:10:30.695 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T06:10:30.706 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T06:10:30.706 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi063.front.sepia.ceph.com,smithi071.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T06:14:26.429 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi063.front.sepia.ceph.com'), Remote(name='ubuntu@smithi071.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2024-09-21T06:14:26.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-21T06:14:26.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:14:26.508 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-09-21T06:14:26.586 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-21T06:14:26.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-21T06:14:26.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:14:26.663 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-09-21T06:14:26.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-21T06:14:26.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-21T06:14:26.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:14:26.820 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-09-21T06:14:26.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-21T06:14:26.900 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T06:14:26.910 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T06:14:26.911 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:14:26.911 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:14:26.913 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:14:26.913 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:14:26.916 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:14:26.916 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:14:26.943 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:14:26.944 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:14:26.958 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:14:26.960 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:14:26.969 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:14:26.983 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: ntpd: command not found 2024-09-21T06:14:26.984 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:14:26.987 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: ntpd: command not found 2024-09-21T06:14:26.994 INFO:teuthology.orchestra.run.smithi071.stdout:506 Cannot talk to daemon 2024-09-21T06:14:26.999 INFO:teuthology.orchestra.run.smithi063.stdout:506 Cannot talk to daemon 2024-09-21T06:14:27.008 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:14:27.009 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: ntpd: command not found 2024-09-21T06:14:27.014 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:14:27.021 INFO:teuthology.orchestra.run.smithi175.stdout:506 Cannot talk to daemon 2024-09-21T06:14:27.022 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:14:27.029 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:14:27.035 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:14:27.049 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:14:27.077 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:14:27.080 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:14:27.080 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-21T06:14:27.080 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:14:27.080 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:14:27.080 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:14:27.080 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:14:27.087 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:14:27.090 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:14:27.090 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-09-21T06:14:27.090 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:14:27.090 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:14:27.090 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:14:27.090 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:14:27.108 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:14:27.111 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:14:27.111 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-09-21T06:14:27.111 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:14:27.111 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:14:27.111 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:14:27.111 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:14:27.112 INFO:teuthology.run_tasks:Running task install... 2024-09-21T06:14:27.128 DEBUG:teuthology.task.install:project ceph 2024-09-21T06:14:27.128 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T06:14:27.128 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T06:14:27.128 INFO:teuthology.task.install:Using flavor: default 2024-09-21T06:14:27.133 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T06:14:27.133 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T06:14:27.133 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:14:27.134 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:14:27.135 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:14:27.136 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:14:27.136 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:14:27.137 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:14:27.280 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:14:27.281 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:14:27.291 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:14:27.291 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:14:27.297 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:14:27.297 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:14:27.388 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:14:27.388 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:14:27.388 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:14:27.398 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:14:27.399 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T06:14:27.399 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:14:27.406 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:14:27.406 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:14:27.406 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:14:27.415 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:14:27.415 DEBUG:teuthology.orchestra.run.smithi063:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:14:27.425 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:14:27.425 DEBUG:teuthology.orchestra.run.smithi175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:14:27.431 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:14:27.431 DEBUG:teuthology.orchestra.run.smithi071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:14:27.483 DEBUG:teuthology.orchestra.run.smithi063:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:14:27.491 DEBUG:teuthology.orchestra.run.smithi175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:14:27.497 DEBUG:teuthology.orchestra.run.smithi071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:14:27.559 DEBUG:teuthology.orchestra.run.smithi063:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:14:27.566 DEBUG:teuthology.orchestra.run.smithi175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:14:27.572 DEBUG:teuthology.orchestra.run.smithi071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:14:27.624 INFO:teuthology.orchestra.run.smithi063.stdout:check_obsoletes = 1 2024-09-21T06:14:27.626 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum clean all 2024-09-21T06:14:27.630 INFO:teuthology.orchestra.run.smithi175.stdout:check_obsoletes = 1 2024-09-21T06:14:27.632 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum clean all 2024-09-21T06:14:27.636 INFO:teuthology.orchestra.run.smithi071.stdout:check_obsoletes = 1 2024-09-21T06:14:27.638 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum clean all 2024-09-21T06:14:27.858 INFO:teuthology.orchestra.run.smithi175.stdout:45 files removed 2024-09-21T06:14:27.865 INFO:teuthology.orchestra.run.smithi071.stdout:45 files removed 2024-09-21T06:14:27.874 INFO:teuthology.orchestra.run.smithi063.stdout:45 files removed 2024-09-21T06:14:27.886 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:14:27.891 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:14:27.903 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:14:28.432 INFO:teuthology.orchestra.run.smithi175.stdout:ceph packages for x86_64 313 kB/s | 84 kB 00:00 2024-09-21T06:14:28.440 INFO:teuthology.orchestra.run.smithi071.stdout:ceph packages for x86_64 309 kB/s | 84 kB 00:00 2024-09-21T06:14:28.468 INFO:teuthology.orchestra.run.smithi063.stdout:ceph packages for x86_64 320 kB/s | 84 kB 00:00 2024-09-21T06:14:28.716 INFO:teuthology.orchestra.run.smithi071.stdout:ceph noarch packages 104 kB/s | 24 kB 00:00 2024-09-21T06:14:28.716 INFO:teuthology.orchestra.run.smithi175.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-21T06:14:28.760 INFO:teuthology.orchestra.run.smithi063.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-21T06:14:28.983 INFO:teuthology.orchestra.run.smithi071.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-21T06:14:28.983 INFO:teuthology.orchestra.run.smithi175.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-21T06:14:29.035 INFO:teuthology.orchestra.run.smithi063.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-21T06:14:30.649 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.3 MB 00:01 2024-09-21T06:14:31.627 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.3 MB 00:02 2024-09-21T06:14:34.792 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 6.6 MB/s | 20 MB 00:03 2024-09-21T06:14:37.489 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 4.3 MB/s | 20 MB 00:04 2024-09-21T06:14:38.332 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 908 kB/s | 8.3 MB 00:09 2024-09-21T06:14:40.043 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-21T06:14:40.192 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-21T06:14:41.926 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 19 kB 00:00 2024-09-21T06:14:42.813 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-21T06:14:44.029 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.5 MB 00:02 2024-09-21T06:14:45.513 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 102 kB/s | 19 kB 00:00 2024-09-21T06:14:46.084 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.5 MB 00:02 2024-09-21T06:14:46.309 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-21T06:14:48.169 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-21T06:14:48.392 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-21T06:14:49.180 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-21T06:14:50.296 INFO:teuthology.orchestra.run.smithi071.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:14:50.296 INFO:teuthology.orchestra.run.smithi071.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:14:50.308 INFO:teuthology.orchestra.run.smithi071.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:14:50.309 INFO:teuthology.orchestra.run.smithi071.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:14:50.309 INFO:teuthology.orchestra.run.smithi071.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:14:50.310 INFO:teuthology.orchestra.run.smithi071.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:14:50.312 INFO:teuthology.orchestra.run.smithi071.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:14:50.314 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:14:50.315 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:14:50.378 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-21T06:14:50.396 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-21T06:14:50.396 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-21T06:14:50.397 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-21T06:14:50.397 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-21T06:14:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:14:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:14:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:14:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:14:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:14:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:14:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:14:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:14:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:14:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:14:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:14:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:14:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:14:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:14:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:14:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:14:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:14:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:14:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:14:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:14:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:14:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:14:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:14:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:14:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:14:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:14:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:14:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:14:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:14:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:14:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:14:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:14:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:14:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:14:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:14:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:14:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:14:50.400 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrading: 2024-09-21T06:14:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:14:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:14:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:14:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:14:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:14:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:14:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:14:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:14:50.400 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-21T06:14:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:14:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:14:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:14:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:14:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:14:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:14:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:14:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:14:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:14:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:14:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:14:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:14:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:14:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:14:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:14:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:14:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:14:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:14:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:14:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:14:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:14:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:14:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:14:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:14:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:14:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:14:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:14:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:14:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:14:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:14:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:14:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:14:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:14:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:14:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:14:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:14:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:14:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:14:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:14:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:14:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:14:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:14:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:14:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:14:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:14:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:14:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:14:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:14:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:14:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:14:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:14:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:14:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:14:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:14:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:14:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:14:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:14:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:14:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:14:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:14:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:14:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:14:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:14:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:14:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:14:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:14:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:14:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:14:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:14:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:14:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:14:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:14:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:14:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:14:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:14:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:14:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:14:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:14:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:14:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:14:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:14:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:14:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:14:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:14:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:14:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:14:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:14:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:14:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:14:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:14:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:14:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:14:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:14:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:14:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:14:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:14:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:14:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:14:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:14:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:14:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:14:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:14:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:14:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:14:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:14:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:14:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:14:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:14:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:14:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:14:50.410 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:14:50.410 INFO:teuthology.orchestra.run.smithi071.stdout:Installing weak dependencies: 2024-09-21T06:14:50.410 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:14:50.410 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:14:50.410 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-21T06:14:50.410 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-21T06:14:50.410 INFO:teuthology.orchestra.run.smithi071.stdout:Install 149 Packages 2024-09-21T06:14:50.410 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade 8 Packages 2024-09-21T06:14:50.410 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:14:50.411 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 228 M 2024-09-21T06:14:50.411 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-21T06:14:50.979 INFO:teuthology.orchestra.run.smithi071.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 48 kB/s | 6.6 kB 00:00 2024-09-21T06:14:51.254 INFO:teuthology.orchestra.run.smithi071.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.1 MB/s | 873 kB 00:00 2024-09-21T06:14:51.337 INFO:teuthology.orchestra.run.smithi071.stdout:(3/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T06:14:51.363 INFO:teuthology.orchestra.run.smithi071.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 1.3 MB/s | 148 kB 00:00 2024-09-21T06:14:51.438 INFO:teuthology.orchestra.run.smithi071.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 23 MB/s | 2.3 MB 00:00 2024-09-21T06:14:51.705 INFO:teuthology.orchestra.run.smithi071.stdout:(6/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 19 MB/s | 5.0 MB 00:00 2024-09-21T06:14:51.905 INFO:teuthology.orchestra.run.smithi071.stdout:(7/157): ceph-common-19.3.0-5120.g18432218.el9. 19 MB/s | 20 MB 00:01 2024-09-21T06:14:51.947 INFO:teuthology.orchestra.run.smithi071.stdout:(8/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 2.6 MB/s | 1.5 MB 00:00 2024-09-21T06:14:52.006 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T06:14:52.014 INFO:teuthology.orchestra.run.smithi071.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 377 kB/s | 25 kB 00:00 2024-09-21T06:14:52.331 INFO:teuthology.orchestra.run.smithi071.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 24 MB/s | 10 MB 00:00 2024-09-21T06:14:52.381 INFO:teuthology.orchestra.run.smithi071.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T06:14:52.440 INFO:teuthology.orchestra.run.smithi071.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 465 kB/s | 27 kB 00:00 2024-09-21T06:14:52.623 INFO:teuthology.orchestra.run.smithi071.stdout:(13/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 19 MB/s | 18 MB 00:00 2024-09-21T06:14:52.649 INFO:teuthology.orchestra.run.smithi071.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 152 kB/s | 32 kB 00:00 2024-09-21T06:14:52.682 INFO:teuthology.orchestra.run.smithi071.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 13 MB/s | 766 kB 00:00 2024-09-21T06:14:52.707 INFO:teuthology.orchestra.run.smithi071.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.6 MB/s | 158 kB 00:00 2024-09-21T06:14:52.741 INFO:teuthology.orchestra.run.smithi071.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.1 MB/s | 127 kB 00:00 2024-09-21T06:14:52.775 INFO:teuthology.orchestra.run.smithi071.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 7.4 MB/s | 507 kB 00:00 2024-09-21T06:14:52.842 INFO:teuthology.orchestra.run.smithi071.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 677 kB/s | 45 kB 00:00 2024-09-21T06:14:52.950 INFO:teuthology.orchestra.run.smithi071.stdout:(20/157): librgw2-19.3.0-5120.g18432218.el9.x86 25 MB/s | 5.3 MB 00:00 2024-09-21T06:14:52.976 INFO:teuthology.orchestra.run.smithi071.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 1.1 MB/s | 148 kB 00:00 2024-09-21T06:14:53.001 INFO:teuthology.orchestra.run.smithi071.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 3.2 MB/s | 161 kB 00:00 2024-09-21T06:14:53.026 INFO:teuthology.orchestra.run.smithi071.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 6.3 MB/s | 321 kB 00:00 2024-09-21T06:14:53.052 INFO:teuthology.orchestra.run.smithi071.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.9 MB/s | 307 kB 00:00 2024-09-21T06:14:53.077 INFO:teuthology.orchestra.run.smithi071.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T06:14:53.102 INFO:teuthology.orchestra.run.smithi071.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T06:14:53.169 INFO:teuthology.orchestra.run.smithi071.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-21T06:14:53.228 INFO:teuthology.orchestra.run.smithi071.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 21 MB/s | 3.1 MB 00:00 2024-09-21T06:14:53.252 INFO:teuthology.orchestra.run.smithi071.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 414 kB/s | 34 kB 00:00 2024-09-21T06:14:53.277 INFO:teuthology.orchestra.run.smithi071.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.1 MB/s | 154 kB 00:00 2024-09-21T06:14:53.653 INFO:teuthology.orchestra.run.smithi071.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 20 MB/s | 7.4 MB 00:00 2024-09-21T06:14:53.703 INFO:teuthology.orchestra.run.smithi071.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 5.7 MB/s | 292 kB 00:00 2024-09-21T06:14:53.941 INFO:teuthology.orchestra.run.smithi071.stdout:(33/157): ceph-mgr-dashboard-19.3.0-5120.g18432 21 MB/s | 14 MB 00:00 2024-09-21T06:14:54.070 INFO:teuthology.orchestra.run.smithi071.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 134 kB/s | 49 kB 00:00 2024-09-21T06:14:54.087 INFO:teuthology.orchestra.run.smithi071.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 113 kB/s | 16 kB 00:00 2024-09-21T06:14:54.121 INFO:teuthology.orchestra.run.smithi071.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T06:14:54.163 INFO:teuthology.orchestra.run.smithi071.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 10 MB/s | 784 kB 00:00 2024-09-21T06:14:54.188 INFO:teuthology.orchestra.run.smithi071.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 276 kB/s | 18 kB 00:00 2024-09-21T06:14:54.285 INFO:teuthology.orchestra.run.smithi063.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:14:54.286 INFO:teuthology.orchestra.run.smithi063.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:14:54.298 INFO:teuthology.orchestra.run.smithi063.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:14:54.299 INFO:teuthology.orchestra.run.smithi063.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:14:54.300 INFO:teuthology.orchestra.run.smithi063.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:14:54.301 INFO:teuthology.orchestra.run.smithi063.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:14:54.302 INFO:teuthology.orchestra.run.smithi063.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:14:54.305 INFO:teuthology.orchestra.run.smithi063.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:14:54.306 INFO:teuthology.orchestra.run.smithi063.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:14:54.373 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-21T06:14:54.389 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================= 2024-09-21T06:14:54.389 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-09-21T06:14:54.389 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================= 2024-09-21T06:14:54.389 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-21T06:14:54.389 INFO:teuthology.orchestra.run.smithi063.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:14:54.390 INFO:teuthology.orchestra.run.smithi063.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:14:54.390 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:14:54.390 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:14:54.390 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:14:54.390 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:14:54.390 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:14:54.390 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:14:54.390 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:14:54.391 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:14:54.391 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:14:54.391 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:14:54.391 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:14:54.391 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:14:54.391 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:14:54.391 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:14:54.391 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:14:54.391 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:14:54.391 INFO:teuthology.orchestra.run.smithi063.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:14:54.391 INFO:teuthology.orchestra.run.smithi063.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:14:54.391 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:14:54.392 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:14:54.392 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:14:54.392 INFO:teuthology.orchestra.run.smithi063.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:14:54.392 INFO:teuthology.orchestra.run.smithi063.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:14:54.392 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:14:54.392 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:14:54.392 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:14:54.392 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:14:54.392 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:14:54.392 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:14:54.392 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:14:54.392 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:14:54.393 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:14:54.393 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:14:54.393 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:14:54.393 INFO:teuthology.orchestra.run.smithi063.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:14:54.393 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrading: 2024-09-21T06:14:54.393 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:14:54.393 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:14:54.393 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:14:54.393 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:14:54.393 INFO:teuthology.orchestra.run.smithi063.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:14:54.393 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:14:54.393 INFO:teuthology.orchestra.run.smithi063.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:14:54.394 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:14:54.394 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-21T06:14:54.394 INFO:teuthology.orchestra.run.smithi063.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:14:54.394 INFO:teuthology.orchestra.run.smithi063.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:14:54.394 INFO:teuthology.orchestra.run.smithi063.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:14:54.394 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:14:54.394 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:14:54.394 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:14:54.394 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:14:54.394 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:14:54.394 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:14:54.394 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:14:54.395 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:14:54.395 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:14:54.395 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:14:54.395 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:14:54.395 INFO:teuthology.orchestra.run.smithi063.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:14:54.395 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:14:54.395 INFO:teuthology.orchestra.run.smithi063.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:14:54.395 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:14:54.395 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:14:54.395 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:14:54.395 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:14:54.395 INFO:teuthology.orchestra.run.smithi063.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:14:54.396 INFO:teuthology.orchestra.run.smithi063.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:14:54.396 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:14:54.396 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:14:54.396 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:14:54.396 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:14:54.396 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:14:54.396 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:14:54.396 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:14:54.396 INFO:teuthology.orchestra.run.smithi063.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:14:54.396 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:14:54.396 INFO:teuthology.orchestra.run.smithi063.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:14:54.396 INFO:teuthology.orchestra.run.smithi063.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:14:54.396 INFO:teuthology.orchestra.run.smithi063.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:14:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:14:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:14:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:14:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:14:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:14:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:14:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:14:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:14:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:14:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:14:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:14:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:14:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:14:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:14:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:14:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:14:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:14:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:14:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:14:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:14:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:14:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:14:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:14:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:14:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:14:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:14:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:14:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:14:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:14:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:14:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:14:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:14:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:14:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:14:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:14:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:14:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:14:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:14:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:14:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:14:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:14:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:14:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:14:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:14:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:14:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:14:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:14:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:14:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:14:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:14:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:14:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:14:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:14:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:14:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:14:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:14:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:14:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:14:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:14:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:14:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:14:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:14:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:14:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:14:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:14:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:14:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:14:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:14:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:14:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:14:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:14:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:14:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:14:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:14:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:14:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:14:54.403 INFO:teuthology.orchestra.run.smithi063.stdout:Installing weak dependencies: 2024-09-21T06:14:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:14:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:14:54.404 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-21T06:14:54.404 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================= 2024-09-21T06:14:54.404 INFO:teuthology.orchestra.run.smithi063.stdout:Install 149 Packages 2024-09-21T06:14:54.404 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrade 8 Packages 2024-09-21T06:14:54.404 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:14:54.405 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 228 M 2024-09-21T06:14:54.405 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-21T06:14:54.602 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T06:14:54.655 INFO:teuthology.orchestra.run.smithi071.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 162 kB/s | 80 kB 00:00 2024-09-21T06:14:54.947 INFO:teuthology.orchestra.run.smithi071.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 656 kB/s | 191 kB 00:00 2024-09-21T06:14:55.014 INFO:teuthology.orchestra.run.smithi071.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 971 kB/s | 801 kB 00:00 2024-09-21T06:14:55.100 INFO:teuthology.orchestra.run.smithi063.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 47 kB/s | 6.6 kB 00:00 2024-09-21T06:14:55.397 INFO:teuthology.orchestra.run.smithi071.stdout:(42/157): ceph-test-19.3.0-5120.g18432218.el9.x 12 MB/s | 40 MB 00:03 2024-09-21T06:14:55.423 INFO:teuthology.orchestra.run.smithi071.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 533 kB/s | 253 kB 00:00 2024-09-21T06:14:55.441 INFO:teuthology.orchestra.run.smithi063.stdout:(2/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T06:14:55.456 INFO:teuthology.orchestra.run.smithi071.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 2.8 MB/s | 1.2 MB 00:00 2024-09-21T06:14:55.475 INFO:teuthology.orchestra.run.smithi063.stdout:(3/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 2.3 MB/s | 873 kB 00:00 2024-09-21T06:14:55.501 INFO:teuthology.orchestra.run.smithi063.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 2.5 MB/s | 148 kB 00:00 2024-09-21T06:14:55.540 INFO:teuthology.orchestra.run.smithi071.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-21T06:14:55.582 INFO:teuthology.orchestra.run.smithi071.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 995 kB/s | 125 kB 00:00 2024-09-21T06:14:55.584 INFO:teuthology.orchestra.run.smithi063.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 18 MB/s | 1.5 MB 00:00 2024-09-21T06:14:55.674 INFO:teuthology.orchestra.run.smithi071.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.6 MB/s | 215 kB 00:00 2024-09-21T06:14:55.783 INFO:teuthology.orchestra.run.smithi071.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-09-21T06:14:55.841 INFO:teuthology.orchestra.run.smithi071.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-21T06:14:55.859 INFO:teuthology.orchestra.run.smithi063.stdout:(6/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 18 MB/s | 5.0 MB 00:00 2024-09-21T06:14:55.866 INFO:teuthology.orchestra.run.smithi071.stdout:(50/157): python3-ply-3.11-14.el9.noarch.rpm 227 kB/s | 106 kB 00:00 2024-09-21T06:14:55.891 INFO:teuthology.orchestra.run.smithi071.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-09-21T06:14:55.925 INFO:teuthology.orchestra.run.smithi071.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-09-21T06:14:55.951 INFO:teuthology.orchestra.run.smithi071.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 557 kB/s | 33 kB 00:00 2024-09-21T06:14:55.992 INFO:teuthology.orchestra.run.smithi071.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 438 kB/s | 18 kB 00:00 2024-09-21T06:14:56.026 INFO:teuthology.orchestra.run.smithi071.stdout:(55/157): flex-2.6.4-9.el9.x86_64.rpm 1.9 MB/s | 313 kB 00:00 2024-09-21T06:14:56.051 INFO:teuthology.orchestra.run.smithi071.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-09-21T06:14:56.059 INFO:teuthology.orchestra.run.smithi063.stdout:(7/157): ceph-common-19.3.0-5120.g18432218.el9. 18 MB/s | 20 MB 00:01 2024-09-21T06:14:56.093 INFO:teuthology.orchestra.run.smithi071.stdout:(57/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2024-09-21T06:14:56.118 INFO:teuthology.orchestra.run.smithi071.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.8 MB/s | 171 kB 00:00 2024-09-21T06:14:56.134 INFO:teuthology.orchestra.run.smithi063.stdout:(8/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 3.5 MB/s | 2.3 MB 00:00 2024-09-21T06:14:56.144 INFO:teuthology.orchestra.run.smithi071.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-09-21T06:14:56.186 INFO:teuthology.orchestra.run.smithi071.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-21T06:14:56.202 INFO:teuthology.orchestra.run.smithi063.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 378 kB/s | 25 kB 00:00 2024-09-21T06:14:56.227 INFO:teuthology.orchestra.run.smithi071.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 589 kB/s | 24 kB 00:00 2024-09-21T06:14:56.261 INFO:teuthology.orchestra.run.smithi071.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 4.8 MB/s | 581 kB 00:00 2024-09-21T06:14:56.286 INFO:teuthology.orchestra.run.smithi071.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-09-21T06:14:56.362 INFO:teuthology.orchestra.run.smithi071.stdout:(64/157): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-09-21T06:14:56.387 INFO:teuthology.orchestra.run.smithi071.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-21T06:14:56.404 INFO:teuthology.orchestra.run.smithi071.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 917 kB/s | 38 kB 00:00 2024-09-21T06:14:56.527 INFO:teuthology.orchestra.run.smithi063.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 22 MB/s | 10 MB 00:00 2024-09-21T06:14:56.594 INFO:teuthology.orchestra.run.smithi063.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.3 MB/s | 226 kB 00:00 2024-09-21T06:14:56.737 INFO:teuthology.orchestra.run.smithi175.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:14:56.738 INFO:teuthology.orchestra.run.smithi175.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:14:56.749 INFO:teuthology.orchestra.run.smithi175.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:14:56.750 INFO:teuthology.orchestra.run.smithi175.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:14:56.751 INFO:teuthology.orchestra.run.smithi175.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:14:56.752 INFO:teuthology.orchestra.run.smithi175.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:14:56.753 INFO:teuthology.orchestra.run.smithi175.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:14:56.755 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:14:56.756 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:14:56.787 INFO:teuthology.orchestra.run.smithi071.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.5 MB/s | 3.0 MB 00:00 2024-09-21T06:14:56.794 INFO:teuthology.orchestra.run.smithi063.stdout:(12/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 19 MB/s | 18 MB 00:00 2024-09-21T06:14:56.819 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-21T06:14:56.819 INFO:teuthology.orchestra.run.smithi063.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 120 kB/s | 27 kB 00:00 2024-09-21T06:14:56.839 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-09-21T06:14:56.840 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-09-21T06:14:56.840 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-09-21T06:14:56.840 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-21T06:14:56.840 INFO:teuthology.orchestra.run.smithi175.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:14:56.840 INFO:teuthology.orchestra.run.smithi175.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:14:56.840 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:14:56.840 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:14:56.840 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:14:56.840 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:14:56.840 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:14:56.840 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:14:56.840 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:14:56.840 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:14:56.840 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:14:56.841 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:14:56.841 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:14:56.841 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:14:56.841 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:14:56.841 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:14:56.841 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:14:56.841 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:14:56.841 INFO:teuthology.orchestra.run.smithi175.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:14:56.841 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:14:56.841 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:14:56.841 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:14:56.841 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:14:56.841 INFO:teuthology.orchestra.run.smithi175.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:14:56.841 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:14:56.842 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:14:56.842 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:14:56.842 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:14:56.842 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:14:56.842 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:14:56.842 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:14:56.842 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:14:56.842 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:14:56.842 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:14:56.842 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:14:56.842 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:14:56.842 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:14:56.842 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2024-09-21T06:14:56.843 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:14:56.843 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:14:56.843 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:14:56.843 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:14:56.843 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:14:56.843 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:14:56.843 INFO:teuthology.orchestra.run.smithi175.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:14:56.843 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:14:56.843 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-09-21T06:14:56.843 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:14:56.843 INFO:teuthology.orchestra.run.smithi175.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:14:56.843 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:14:56.843 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:14:56.843 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:14:56.844 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:14:56.844 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:14:56.844 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:14:56.844 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:14:56.844 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:14:56.844 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:14:56.844 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:14:56.844 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:14:56.844 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:14:56.844 INFO:teuthology.orchestra.run.smithi175.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:14:56.844 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:14:56.844 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:14:56.844 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:14:56.844 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:14:56.845 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:14:56.845 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:14:56.845 INFO:teuthology.orchestra.run.smithi175.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:14:56.845 INFO:teuthology.orchestra.run.smithi175.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:14:56.845 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:14:56.845 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:14:56.845 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:14:56.845 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:14:56.845 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:14:56.845 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:14:56.845 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:14:56.845 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:14:56.845 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:14:56.845 INFO:teuthology.orchestra.run.smithi175.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:14:56.846 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:14:56.846 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:14:56.846 INFO:teuthology.orchestra.run.smithi175.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:14:56.846 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:14:56.846 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:14:56.846 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:14:56.846 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:14:56.846 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:14:56.846 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:14:56.846 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:14:56.846 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:14:56.846 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:14:56.846 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:14:56.847 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:14:56.847 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:14:56.847 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:14:56.847 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:14:56.847 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:14:56.847 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:14:56.847 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:14:56.847 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:14:56.847 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:14:56.847 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:14:56.847 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:14:56.847 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:14:56.847 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:14:56.847 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:14:56.848 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:14:56.848 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:14:56.848 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:14:56.848 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:14:56.848 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:14:56.848 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:14:56.848 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:14:56.848 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:14:56.848 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:14:56.848 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:14:56.848 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:14:56.848 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:14:56.848 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:14:56.849 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:14:56.849 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:14:56.849 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:14:56.849 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:14:56.849 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:14:56.849 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:14:56.849 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:14:56.849 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:14:56.849 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:14:56.849 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:14:56.849 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:14:56.849 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:14:56.849 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:14:56.850 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:14:56.850 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:14:56.850 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:14:56.850 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:14:56.850 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:14:56.850 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:14:56.850 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:14:56.850 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:14:56.850 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:14:56.850 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:14:56.850 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:14:56.850 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:14:56.850 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:14:56.850 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:14:56.851 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:14:56.851 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:14:56.851 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:14:56.851 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:14:56.851 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:14:56.851 INFO:teuthology.orchestra.run.smithi175.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:14:56.851 INFO:teuthology.orchestra.run.smithi175.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:14:56.851 INFO:teuthology.orchestra.run.smithi175.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:14:56.851 INFO:teuthology.orchestra.run.smithi175.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:14:56.851 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:14:56.851 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:14:56.851 INFO:teuthology.orchestra.run.smithi175.stdout:Installing weak dependencies: 2024-09-21T06:14:56.851 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:14:56.851 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:14:56.852 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-21T06:14:56.852 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-09-21T06:14:56.852 INFO:teuthology.orchestra.run.smithi175.stdout:Install 149 Packages 2024-09-21T06:14:56.852 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 8 Packages 2024-09-21T06:14:56.852 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:14:56.852 INFO:teuthology.orchestra.run.smithi063.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 635 kB/s | 32 kB 00:00 2024-09-21T06:14:56.853 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 228 M 2024-09-21T06:14:56.853 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-21T06:14:56.887 INFO:teuthology.orchestra.run.smithi063.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 11 MB/s | 766 kB 00:00 2024-09-21T06:14:56.912 INFO:teuthology.orchestra.run.smithi063.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T06:14:56.937 INFO:teuthology.orchestra.run.smithi063.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T06:14:56.971 INFO:teuthology.orchestra.run.smithi063.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 8.5 MB/s | 507 kB 00:00 2024-09-21T06:14:57.030 INFO:teuthology.orchestra.run.smithi063.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 773 kB/s | 45 kB 00:00 2024-09-21T06:14:57.088 INFO:teuthology.orchestra.run.smithi063.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.5 MB/s | 148 kB 00:00 2024-09-21T06:14:57.246 INFO:teuthology.orchestra.run.smithi071.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 3.5 MB/s | 1.6 MB 00:00 2024-09-21T06:14:57.272 INFO:teuthology.orchestra.run.smithi063.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 16 MB/s | 5.3 MB 00:00 2024-09-21T06:14:57.297 INFO:teuthology.orchestra.run.smithi063.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 774 kB/s | 161 kB 00:00 2024-09-21T06:14:57.322 INFO:teuthology.orchestra.run.smithi063.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 6.2 MB/s | 321 kB 00:00 2024-09-21T06:14:57.348 INFO:teuthology.orchestra.run.smithi063.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 6.0 MB/s | 307 kB 00:00 2024-09-21T06:14:57.373 INFO:teuthology.orchestra.run.smithi063.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T06:14:57.398 INFO:teuthology.orchestra.run.smithi063.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T06:14:57.465 INFO:teuthology.orchestra.run.smithi063.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-21T06:14:57.521 INFO:teuthology.orchestra.run.smithi071.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 3.2 MB/s | 910 kB 00:00 2024-09-21T06:14:57.532 INFO:teuthology.orchestra.run.smithi063.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 20 MB/s | 3.1 MB 00:00 2024-09-21T06:14:57.557 INFO:teuthology.orchestra.run.smithi063.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 373 kB/s | 34 kB 00:00 2024-09-21T06:14:57.579 INFO:teuthology.orchestra.run.smithi175.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-09-21T06:14:57.582 INFO:teuthology.orchestra.run.smithi063.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T06:14:57.596 INFO:teuthology.orchestra.run.smithi071.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-21T06:14:57.713 INFO:teuthology.orchestra.run.smithi071.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.4 MB/s | 4.4 MB 00:01 2024-09-21T06:14:57.805 INFO:teuthology.orchestra.run.smithi071.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 3.5 MB/s | 4.9 MB 00:01 2024-09-21T06:14:57.864 INFO:teuthology.orchestra.run.smithi071.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-21T06:14:57.975 INFO:teuthology.orchestra.run.smithi063.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 19 MB/s | 7.4 MB 00:00 2024-09-21T06:14:58.012 INFO:teuthology.orchestra.run.smithi175.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 2.0 MB/s | 873 kB 00:00 2024-09-21T06:14:58.025 INFO:teuthology.orchestra.run.smithi063.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 5.7 MB/s | 292 kB 00:00 2024-09-21T06:14:58.072 INFO:teuthology.orchestra.run.smithi071.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 2.8 MB/s | 1.0 MB 00:00 2024-09-21T06:14:58.087 INFO:teuthology.orchestra.run.smithi175.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.9 MB/s | 148 kB 00:00 2024-09-21T06:14:58.114 INFO:teuthology.orchestra.run.smithi071.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-21T06:14:58.206 INFO:teuthology.orchestra.run.smithi071.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-21T06:14:58.208 INFO:teuthology.orchestra.run.smithi063.stdout:(33/157): ceph-mgr-dashboard-19.3.0-5120.g18432 22 MB/s | 14 MB 00:00 2024-09-21T06:14:58.234 INFO:teuthology.orchestra.run.smithi063.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 237 kB/s | 49 kB 00:00 2024-09-21T06:14:58.259 INFO:teuthology.orchestra.run.smithi063.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 329 kB/s | 16 kB 00:00 2024-09-21T06:14:58.284 INFO:teuthology.orchestra.run.smithi063.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.5 MB/s | 285 kB 00:00 2024-09-21T06:14:58.307 INFO:teuthology.orchestra.run.smithi071.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-21T06:14:58.326 INFO:teuthology.orchestra.run.smithi063.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 11 MB/s | 784 kB 00:00 2024-09-21T06:14:58.349 INFO:teuthology.orchestra.run.smithi071.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 615 kB/s | 26 kB 00:00 2024-09-21T06:14:58.351 INFO:teuthology.orchestra.run.smithi063.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 275 kB/s | 18 kB 00:00 2024-09-21T06:14:58.390 INFO:teuthology.orchestra.run.smithi071.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 461 kB/s | 19 kB 00:00 2024-09-21T06:14:58.396 INFO:teuthology.orchestra.run.smithi175.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 7.4 MB/s | 2.3 MB 00:00 2024-09-21T06:14:58.474 INFO:teuthology.orchestra.run.smithi071.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-21T06:14:58.505 INFO:teuthology.orchestra.run.smithi175.stdout:(5/157): ceph-base-19.3.0-5120.g18432218.el9.x8 5.2 MB/s | 5.5 MB 00:01 2024-09-21T06:14:58.516 INFO:teuthology.orchestra.run.smithi071.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 838 kB/s | 35 kB 00:00 2024-09-21T06:14:58.613 INFO:teuthology.orchestra.run.smithi175.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 7.0 MB/s | 1.5 MB 00:00 2024-09-21T06:14:58.930 INFO:teuthology.orchestra.run.smithi175.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 12 MB/s | 5.0 MB 00:00 2024-09-21T06:14:59.200 INFO:teuthology.orchestra.run.smithi071.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 3.6 MB/s | 5.8 MB 00:01 2024-09-21T06:14:59.255 INFO:teuthology.orchestra.run.smithi175.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 11 MB/s | 20 MB 00:01 2024-09-21T06:14:59.305 INFO:teuthology.orchestra.run.smithi175.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 506 kB/s | 25 kB 00:00 2024-09-21T06:14:59.308 INFO:teuthology.orchestra.run.smithi071.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-21T06:14:59.400 INFO:teuthology.orchestra.run.smithi071.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-21T06:14:59.459 INFO:teuthology.orchestra.run.smithi071.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-21T06:14:59.559 INFO:teuthology.orchestra.run.smithi071.stdout:(86/157): python3-babel-2.9.1-2.el9.noarch.rpm 3.5 MB/s | 6.0 MB 00:01 2024-09-21T06:14:59.584 INFO:teuthology.orchestra.run.smithi071.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 337 kB/s | 42 kB 00:00 2024-09-21T06:14:59.651 INFO:teuthology.orchestra.run.smithi071.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-21T06:14:59.672 INFO:teuthology.orchestra.run.smithi175.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 14 MB/s | 10 MB 00:00 2024-09-21T06:14:59.701 INFO:teuthology.orchestra.run.smithi071.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 1.9 MB/s | 269 kB 00:00 2024-09-21T06:14:59.731 INFO:teuthology.orchestra.run.smithi175.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.8 MB/s | 226 kB 00:00 2024-09-21T06:14:59.743 INFO:teuthology.orchestra.run.smithi071.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-21T06:14:59.785 INFO:teuthology.orchestra.run.smithi071.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-09-21T06:14:59.810 INFO:teuthology.orchestra.run.smithi071.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 804 kB/s | 54 kB 00:00 2024-09-21T06:14:59.852 INFO:teuthology.orchestra.run.smithi071.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-21T06:14:59.895 INFO:teuthology.orchestra.run.smithi071.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-21T06:14:59.953 INFO:teuthology.orchestra.run.smithi175.stdout:(12/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 13 MB/s | 18 MB 00:01 2024-09-21T06:14:59.986 INFO:teuthology.orchestra.run.smithi071.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.4 MB/s | 221 kB 00:00 2024-09-21T06:14:59.990 INFO:teuthology.orchestra.run.smithi175.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 104 kB/s | 27 kB 00:00 2024-09-21T06:15:00.015 INFO:teuthology.orchestra.run.smithi175.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 516 kB/s | 32 kB 00:00 2024-09-21T06:15:00.028 INFO:teuthology.orchestra.run.smithi071.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 866 kB/s | 36 kB 00:00 2024-09-21T06:15:00.048 INFO:teuthology.orchestra.run.smithi175.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 13 MB/s | 766 kB 00:00 2024-09-21T06:15:00.070 INFO:teuthology.orchestra.run.smithi071.stdout:(97/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-21T06:15:00.107 INFO:teuthology.orchestra.run.smithi175.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 1.7 MB/s | 158 kB 00:00 2024-09-21T06:15:00.140 INFO:teuthology.orchestra.run.smithi175.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 1.4 MB/s | 127 kB 00:00 2024-09-21T06:15:00.154 INFO:teuthology.orchestra.run.smithi071.stdout:(98/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.1 MB/s | 5.1 MB 00:01 2024-09-21T06:15:00.174 INFO:teuthology.orchestra.run.smithi175.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 7.4 MB/s | 507 kB 00:00 2024-09-21T06:15:00.195 INFO:teuthology.orchestra.run.smithi071.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-21T06:15:00.232 INFO:teuthology.orchestra.run.smithi175.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 776 kB/s | 45 kB 00:00 2024-09-21T06:15:00.238 INFO:teuthology.orchestra.run.smithi071.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 1.8 MB/s | 304 kB 00:00 2024-09-21T06:15:00.263 INFO:teuthology.orchestra.run.smithi071.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-21T06:15:00.305 INFO:teuthology.orchestra.run.smithi071.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 954 kB/s | 64 kB 00:00 2024-09-21T06:15:00.324 INFO:teuthology.orchestra.run.smithi175.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.6 MB/s | 148 kB 00:00 2024-09-21T06:15:00.330 INFO:teuthology.orchestra.run.smithi071.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 672 kB/s | 45 kB 00:00 2024-09-21T06:15:00.356 INFO:teuthology.orchestra.run.smithi071.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 444 kB/s | 22 kB 00:00 2024-09-21T06:15:00.414 INFO:teuthology.orchestra.run.smithi071.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T06:15:00.439 INFO:teuthology.orchestra.run.smithi071.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-21T06:15:00.450 INFO:teuthology.orchestra.run.smithi175.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 17 MB/s | 5.3 MB 00:00 2024-09-21T06:15:00.456 INFO:teuthology.orchestra.run.smithi071.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-21T06:15:00.475 INFO:teuthology.orchestra.run.smithi175.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.1 MB/s | 161 kB 00:00 2024-09-21T06:15:00.509 INFO:teuthology.orchestra.run.smithi175.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 5.4 MB/s | 321 kB 00:00 2024-09-21T06:15:00.542 INFO:teuthology.orchestra.run.smithi175.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 4.5 MB/s | 307 kB 00:00 2024-09-21T06:15:00.567 INFO:teuthology.orchestra.run.smithi175.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T06:15:00.573 INFO:teuthology.orchestra.run.smithi071.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-21T06:15:00.590 INFO:teuthology.orchestra.run.smithi071.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-21T06:15:00.593 INFO:teuthology.orchestra.run.smithi175.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T06:15:00.607 INFO:teuthology.orchestra.run.smithi071.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-21T06:15:00.633 INFO:teuthology.orchestra.run.smithi071.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-21T06:15:00.652 INFO:teuthology.orchestra.run.smithi175.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.9 MB/s | 170 kB 00:00 2024-09-21T06:15:00.658 INFO:teuthology.orchestra.run.smithi071.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-21T06:15:00.683 INFO:teuthology.orchestra.run.smithi071.stdout:(113/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-09-21T06:15:00.734 INFO:teuthology.orchestra.run.smithi071.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-21T06:15:00.735 INFO:teuthology.orchestra.run.smithi175.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 19 MB/s | 3.1 MB 00:00 2024-09-21T06:15:00.752 INFO:teuthology.orchestra.run.smithi175.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 342 kB/s | 34 kB 00:00 2024-09-21T06:15:00.758 INFO:teuthology.orchestra.run.smithi071.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.9 MB/s | 43 kB 00:00 2024-09-21T06:15:00.784 INFO:teuthology.orchestra.run.smithi071.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T06:15:00.785 INFO:teuthology.orchestra.run.smithi175.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T06:15:00.809 INFO:teuthology.orchestra.run.smithi071.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 571 kB/s | 14 kB 00:00 2024-09-21T06:15:00.834 INFO:teuthology.orchestra.run.smithi071.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-21T06:15:00.868 INFO:teuthology.orchestra.run.smithi071.stdout:(119/157): python3-asyncssh-2.13.2-5.el9.noarch 2.9 MB/s | 548 kB 00:00 2024-09-21T06:15:00.869 INFO:teuthology.orchestra.run.smithi063.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 31 kB/s | 80 kB 00:02 2024-09-21T06:15:00.893 INFO:teuthology.orchestra.run.smithi071.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-21T06:15:00.919 INFO:teuthology.orchestra.run.smithi071.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T06:15:00.944 INFO:teuthology.orchestra.run.smithi071.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T06:15:00.969 INFO:teuthology.orchestra.run.smithi071.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T06:15:00.994 INFO:teuthology.orchestra.run.smithi071.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-21T06:15:01.020 INFO:teuthology.orchestra.run.smithi071.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-21T06:15:01.045 INFO:teuthology.orchestra.run.smithi071.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 931 kB/s | 23 kB 00:00 2024-09-21T06:15:01.071 INFO:teuthology.orchestra.run.smithi071.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 776 kB/s | 19 kB 00:00 2024-09-21T06:15:01.096 INFO:teuthology.orchestra.run.smithi071.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-09-21T06:15:01.146 INFO:teuthology.orchestra.run.smithi071.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-09-21T06:15:01.171 INFO:teuthology.orchestra.run.smithi071.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T06:15:01.197 INFO:teuthology.orchestra.run.smithi071.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T06:15:01.222 INFO:teuthology.orchestra.run.smithi071.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T06:15:01.255 INFO:teuthology.orchestra.run.smithi071.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-21T06:15:01.281 INFO:teuthology.orchestra.run.smithi071.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-09-21T06:15:01.306 INFO:teuthology.orchestra.run.smithi071.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-21T06:15:01.333 INFO:teuthology.orchestra.run.smithi071.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T06:15:01.357 INFO:teuthology.orchestra.run.smithi071.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-21T06:15:01.382 INFO:teuthology.orchestra.run.smithi071.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-21T06:15:01.407 INFO:teuthology.orchestra.run.smithi071.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T06:15:01.432 INFO:teuthology.orchestra.run.smithi071.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T06:15:01.458 INFO:teuthology.orchestra.run.smithi071.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-21T06:15:01.483 INFO:teuthology.orchestra.run.smithi071.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T06:15:01.495 INFO:teuthology.orchestra.run.smithi175.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 18 MB/s | 40 MB 00:02 2024-09-21T06:15:01.508 INFO:teuthology.orchestra.run.smithi071.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T06:15:01.519 INFO:teuthology.orchestra.run.smithi063.stdout:(40/157): libgfortran-11.5.0-2.el9.x86_64.rpm 253 kB/s | 801 kB 00:03 2024-09-21T06:15:01.534 INFO:teuthology.orchestra.run.smithi071.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T06:15:01.575 INFO:teuthology.orchestra.run.smithi071.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 494 kB/s | 20 kB 00:00 2024-09-21T06:15:01.595 INFO:teuthology.orchestra.run.smithi175.stdout:(32/157): ceph-mgr-diskprediction-local-19.3.0- 9.1 MB/s | 7.4 MB 00:00 2024-09-21T06:15:01.609 INFO:teuthology.orchestra.run.smithi071.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-09-21T06:15:01.620 INFO:teuthology.orchestra.run.smithi175.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 2.3 MB/s | 292 kB 00:00 2024-09-21T06:15:01.634 INFO:teuthology.orchestra.run.smithi071.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.1 MB/s | 191 kB 00:00 2024-09-21T06:15:01.637 INFO:teuthology.orchestra.run.smithi175.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 1.2 MB/s | 49 kB 00:00 2024-09-21T06:15:01.654 INFO:teuthology.orchestra.run.smithi175.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 492 kB/s | 16 kB 00:00 2024-09-21T06:15:01.685 INFO:teuthology.orchestra.run.smithi071.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-21T06:15:01.687 INFO:teuthology.orchestra.run.smithi175.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T06:15:01.721 INFO:teuthology.orchestra.run.smithi175.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 11 MB/s | 784 kB 00:00 2024-09-21T06:15:01.746 INFO:teuthology.orchestra.run.smithi175.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 315 kB/s | 18 kB 00:00 2024-09-21T06:15:01.905 INFO:teuthology.orchestra.run.smithi175.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 12 MB/s | 14 MB 00:01 2024-09-21T06:15:01.935 INFO:teuthology.orchestra.run.smithi071.stdout:(149/157): librbd1-19.3.0-5120.g18432218.el9.x8 13 MB/s | 3.2 MB 00:00 2024-09-21T06:15:01.994 INFO:teuthology.orchestra.run.smithi071.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 9.4 MB/s | 3.4 MB 00:00 2024-09-21T06:15:02.013 INFO:teuthology.orchestra.run.smithi175.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 273 kB/s | 80 kB 00:00 2024-09-21T06:15:02.106 INFO:teuthology.orchestra.run.smithi175.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 956 kB/s | 191 kB 00:00 2024-09-21T06:15:02.131 INFO:teuthology.orchestra.run.smithi175.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-21T06:15:02.165 INFO:teuthology.orchestra.run.smithi175.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 801 kB 00:00 2024-09-21T06:15:02.190 INFO:teuthology.orchestra.run.smithi175.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-21T06:15:02.194 INFO:teuthology.orchestra.run.smithi063.stdout:(41/157): ceph-test-19.3.0-5120.g18432218.el9.x 6.7 MB/s | 40 MB 00:05 2024-09-21T06:15:02.223 INFO:teuthology.orchestra.run.smithi175.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-21T06:15:02.248 INFO:teuthology.orchestra.run.smithi175.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-21T06:15:02.282 INFO:teuthology.orchestra.run.smithi175.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-21T06:15:02.399 INFO:teuthology.orchestra.run.smithi175.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 4.2 MB/s | 1.2 MB 00:00 2024-09-21T06:15:02.466 INFO:teuthology.orchestra.run.smithi175.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-09-21T06:15:02.508 INFO:teuthology.orchestra.run.smithi175.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-09-21T06:15:02.533 INFO:teuthology.orchestra.run.smithi175.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 324 kB/s | 22 kB 00:00 2024-09-21T06:15:02.559 INFO:teuthology.orchestra.run.smithi175.stdout:(52/157): boost-program-options-1.75.0-8.el9.x8 672 kB/s | 107 kB 00:00 2024-09-21T06:15:02.584 INFO:teuthology.orchestra.run.smithi175.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-09-21T06:15:02.609 INFO:teuthology.orchestra.run.smithi175.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-09-21T06:15:02.634 INFO:teuthology.orchestra.run.smithi175.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-09-21T06:15:02.659 INFO:teuthology.orchestra.run.smithi175.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-21T06:15:02.685 INFO:teuthology.orchestra.run.smithi175.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T06:15:02.710 INFO:teuthology.orchestra.run.smithi175.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-21T06:15:02.727 INFO:teuthology.orchestra.run.smithi175.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-21T06:15:02.769 INFO:teuthology.orchestra.run.smithi175.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-21T06:15:02.802 INFO:teuthology.orchestra.run.smithi175.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-09-21T06:15:02.828 INFO:teuthology.orchestra.run.smithi175.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-21T06:15:02.845 INFO:teuthology.orchestra.run.smithi175.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-21T06:15:02.895 INFO:teuthology.orchestra.run.smithi175.stdout:(64/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.9 MB/s | 3.0 MB 00:00 2024-09-21T06:15:02.921 INFO:teuthology.orchestra.run.smithi175.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-21T06:15:02.944 INFO:teuthology.orchestra.run.smithi071.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 2.3 MB/s | 2.3 MB 00:01 2024-09-21T06:15:02.946 INFO:teuthology.orchestra.run.smithi175.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-21T06:15:02.963 INFO:teuthology.orchestra.run.smithi175.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 573 kB/s | 38 kB 00:00 2024-09-21T06:15:03.011 INFO:teuthology.orchestra.run.smithi071.stdout:(152/157): NetworkManager-libnm-1.51.0-1.el9.x8 1.8 MB/s | 1.8 MB 00:01 2024-09-21T06:15:03.029 INFO:teuthology.orchestra.run.smithi175.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-21T06:15:03.044 INFO:teuthology.orchestra.run.smithi071.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 408 kB/s | 41 kB 00:00 2024-09-21T06:15:03.105 INFO:teuthology.orchestra.run.smithi175.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 27 MB/s | 4.9 MB 00:00 2024-09-21T06:15:03.128 INFO:teuthology.orchestra.run.smithi071.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.1 MB/s | 249 kB 00:00 2024-09-21T06:15:03.138 INFO:teuthology.orchestra.run.smithi175.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-21T06:15:03.163 INFO:teuthology.orchestra.run.smithi175.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-21T06:15:03.222 INFO:teuthology.orchestra.run.smithi175.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-09-21T06:15:03.264 INFO:teuthology.orchestra.run.smithi175.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-21T06:15:03.278 INFO:teuthology.orchestra.run.smithi071.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 5.8 MB/s | 1.4 MB 00:00 2024-09-21T06:15:03.289 INFO:teuthology.orchestra.run.smithi175.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T06:15:03.359 INFO:teuthology.orchestra.run.smithi175.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 884 kB/s | 61 kB 00:00 2024-09-21T06:15:03.362 INFO:teuthology.orchestra.run.smithi071.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 10 MB/s | 2.4 MB 00:00 2024-09-21T06:15:03.432 INFO:teuthology.orchestra.run.smithi175.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-21T06:15:03.457 INFO:teuthology.orchestra.run.smithi175.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.5 MB/s | 245 kB 00:00 2024-09-21T06:15:03.482 INFO:teuthology.orchestra.run.smithi175.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-21T06:15:03.507 INFO:teuthology.orchestra.run.smithi175.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-21T06:15:03.533 INFO:teuthology.orchestra.run.smithi175.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-21T06:15:03.558 INFO:teuthology.orchestra.run.smithi175.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-21T06:15:03.583 INFO:teuthology.orchestra.run.smithi175.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-21T06:15:03.659 INFO:teuthology.orchestra.run.smithi175.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-21T06:15:03.684 INFO:teuthology.orchestra.run.smithi175.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-21T06:15:03.709 INFO:teuthology.orchestra.run.smithi175.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-09-21T06:15:03.734 INFO:teuthology.orchestra.run.smithi175.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T06:15:03.760 INFO:teuthology.orchestra.run.smithi175.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-09-21T06:15:03.785 INFO:teuthology.orchestra.run.smithi175.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-21T06:15:03.810 INFO:teuthology.orchestra.run.smithi175.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T06:15:03.835 INFO:teuthology.orchestra.run.smithi175.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-21T06:15:03.861 INFO:teuthology.orchestra.run.smithi175.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T06:15:03.886 INFO:teuthology.orchestra.run.smithi175.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T06:15:03.978 INFO:teuthology.orchestra.run.smithi175.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-21T06:15:03.995 INFO:teuthology.orchestra.run.smithi175.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 382 kB/s | 42 kB 00:00 2024-09-21T06:15:04.012 INFO:teuthology.orchestra.run.smithi175.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-21T06:15:04.037 INFO:teuthology.orchestra.run.smithi175.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-09-21T06:15:04.063 INFO:teuthology.orchestra.run.smithi175.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-09-21T06:15:04.088 INFO:teuthology.orchestra.run.smithi175.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-21T06:15:04.113 INFO:teuthology.orchestra.run.smithi175.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-21T06:15:04.138 INFO:teuthology.orchestra.run.smithi175.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T06:15:04.164 INFO:teuthology.orchestra.run.smithi175.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T06:15:04.189 INFO:teuthology.orchestra.run.smithi175.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T06:15:04.214 INFO:teuthology.orchestra.run.smithi175.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-21T06:15:04.273 INFO:teuthology.orchestra.run.smithi175.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-09-21T06:15:04.323 INFO:teuthology.orchestra.run.smithi175.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T06:15:04.357 INFO:teuthology.orchestra.run.smithi175.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-21T06:15:04.382 INFO:teuthology.orchestra.run.smithi175.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 788 kB/s | 19 kB 00:00 2024-09-21T06:15:04.541 INFO:teuthology.orchestra.run.smithi175.stdout:(108/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-21T06:15:04.582 INFO:teuthology.orchestra.run.smithi175.stdout:(109/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.3 MB/s | 863 kB 00:00 2024-09-21T06:15:04.616 INFO:teuthology.orchestra.run.smithi175.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 347 kB/s | 26 kB 00:00 2024-09-21T06:15:04.650 INFO:teuthology.orchestra.run.smithi175.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 747 kB/s | 49 kB 00:00 2024-09-21T06:15:04.691 INFO:teuthology.orchestra.run.smithi175.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 919 kB/s | 67 kB 00:00 2024-09-21T06:15:04.858 INFO:teuthology.orchestra.run.smithi175.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 910 kB/s | 151 kB 00:00 2024-09-21T06:15:04.910 INFO:teuthology.orchestra.run.smithi063.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 47 kB/s | 191 kB 00:04 2024-09-21T06:15:04.917 INFO:teuthology.orchestra.run.smithi175.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.6 MB/s | 839 kB 00:00 2024-09-21T06:15:04.942 INFO:teuthology.orchestra.run.smithi175.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T06:15:04.968 INFO:teuthology.orchestra.run.smithi175.stdout:(116/157): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-09-21T06:15:04.978 INFO:teuthology.orchestra.run.smithi071.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.1 MB/s | 16 MB 00:05 2024-09-21T06:15:04.983 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:15:04.984 INFO:teuthology.orchestra.run.smithi071.stdout:Total 16 MB/s | 228 MB 00:14 2024-09-21T06:15:04.993 INFO:teuthology.orchestra.run.smithi175.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-21T06:15:05.018 INFO:teuthology.orchestra.run.smithi175.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-21T06:15:05.043 INFO:teuthology.orchestra.run.smithi175.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T06:15:05.077 INFO:teuthology.orchestra.run.smithi175.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-21T06:15:05.102 INFO:teuthology.orchestra.run.smithi175.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-21T06:15:05.127 INFO:teuthology.orchestra.run.smithi175.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T06:15:05.153 INFO:teuthology.orchestra.run.smithi175.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-21T06:15:05.186 INFO:teuthology.orchestra.run.smithi175.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 321 kB/s | 11 kB 00:00 2024-09-21T06:15:05.212 INFO:teuthology.orchestra.run.smithi175.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-21T06:15:05.237 INFO:teuthology.orchestra.run.smithi175.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-09-21T06:15:05.296 INFO:teuthology.orchestra.run.smithi175.stdout:(127/157): libarrow-9.0.0-11.el9.x86_64.rpm 4.8 MB/s | 4.4 MB 00:00 2024-09-21T06:15:05.321 INFO:teuthology.orchestra.run.smithi175.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 232 kB/s | 19 kB 00:00 2024-09-21T06:15:05.346 INFO:teuthology.orchestra.run.smithi175.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 394 kB/s | 20 kB 00:00 2024-09-21T06:15:05.372 INFO:teuthology.orchestra.run.smithi175.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T06:15:05.397 INFO:teuthology.orchestra.run.smithi175.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T06:15:05.422 INFO:teuthology.orchestra.run.smithi175.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T06:15:05.464 INFO:teuthology.orchestra.run.smithi175.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 6.4 MB/s | 272 kB 00:00 2024-09-21T06:15:05.477 INFO:teuthology.orchestra.run.smithi063.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 64 kB/s | 253 kB 00:03 2024-09-21T06:15:05.489 INFO:teuthology.orchestra.run.smithi175.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-21T06:15:05.515 INFO:teuthology.orchestra.run.smithi175.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T06:15:05.565 INFO:teuthology.orchestra.run.smithi175.stdout:(136/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.4 MB/s | 2.0 MB 00:00 2024-09-21T06:15:05.590 INFO:teuthology.orchestra.run.smithi175.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 376 kB/s | 28 kB 00:00 2024-09-21T06:15:05.632 INFO:teuthology.orchestra.run.smithi175.stdout:(138/157): python3-kubernetes-26.1.0-2.el9.noar 3.3 MB/s | 1.0 MB 00:00 2024-09-21T06:15:05.657 INFO:teuthology.orchestra.run.smithi175.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-09-21T06:15:05.683 INFO:teuthology.orchestra.run.smithi175.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-21T06:15:05.708 INFO:teuthology.orchestra.run.smithi175.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-21T06:15:05.733 INFO:teuthology.orchestra.run.smithi175.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-21T06:15:05.758 INFO:teuthology.orchestra.run.smithi175.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-09-21T06:15:05.784 INFO:teuthology.orchestra.run.smithi175.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-21T06:15:05.809 INFO:teuthology.orchestra.run.smithi175.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-21T06:15:05.834 INFO:teuthology.orchestra.run.smithi175.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 400 kB/s | 20 kB 00:00 2024-09-21T06:15:05.860 INFO:teuthology.orchestra.run.smithi175.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T06:15:05.885 INFO:teuthology.orchestra.run.smithi175.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-21T06:15:05.935 INFO:teuthology.orchestra.run.smithi175.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T06:15:06.102 INFO:teuthology.orchestra.run.smithi175.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 14 MB/s | 3.4 MB 00:00 2024-09-21T06:15:06.194 INFO:teuthology.orchestra.run.smithi175.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 10 MB/s | 3.2 MB 00:00 2024-09-21T06:15:06.222 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-21T06:15:06.311 INFO:teuthology.orchestra.run.smithi175.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 350 kB/s | 41 kB 00:00 2024-09-21T06:15:06.376 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-21T06:15:06.376 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-21T06:15:06.412 INFO:teuthology.orchestra.run.smithi175.stdout:(153/157): NetworkManager-libnm-1.51.0-1.el9.x8 5.8 MB/s | 1.8 MB 00:00 2024-09-21T06:15:06.437 INFO:teuthology.orchestra.run.smithi175.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.9 MB/s | 249 kB 00:00 2024-09-21T06:15:06.495 INFO:teuthology.orchestra.run.smithi175.stdout:(155/157): NetworkManager-1.51.0-1.el9.x86_64.r 4.1 MB/s | 2.3 MB 00:00 2024-09-21T06:15:06.961 INFO:teuthology.orchestra.run.smithi063.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 52 kB/s | 106 kB 00:02 2024-09-21T06:15:07.112 INFO:teuthology.orchestra.run.smithi175.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 1.9 MB/s | 1.4 MB 00:00 2024-09-21T06:15:07.246 INFO:teuthology.orchestra.run.smithi175.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.0 MB/s | 2.4 MB 00:00 2024-09-21T06:15:07.252 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:15:07.252 INFO:teuthology.orchestra.run.smithi175.stdout:Total 22 MB/s | 228 MB 00:10 2024-09-21T06:15:07.411 INFO:teuthology.orchestra.run.smithi063.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 70 kB/s | 135 kB 00:01 2024-09-21T06:15:08.206 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-21T06:15:08.207 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-21T06:15:08.510 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-21T06:15:08.664 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-21T06:15:08.664 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-21T06:15:08.911 INFO:teuthology.orchestra.run.smithi063.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 64 kB/s | 125 kB 00:01 2024-09-21T06:15:09.520 INFO:teuthology.orchestra.run.smithi063.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 102 kB/s | 215 kB 00:02 2024-09-21T06:15:09.770 INFO:teuthology.orchestra.run.smithi063.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 803 kB/s | 689 kB 00:00 2024-09-21T06:15:09.879 INFO:teuthology.orchestra.run.smithi063.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 987 kB/s | 107 kB 00:00 2024-09-21T06:15:09.987 INFO:teuthology.orchestra.run.smithi063.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-21T06:15:10.104 INFO:teuthology.orchestra.run.smithi063.stdout:(51/157): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-21T06:15:10.213 INFO:teuthology.orchestra.run.smithi063.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-09-21T06:15:10.338 INFO:teuthology.orchestra.run.smithi063.stdout:(53/157): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-09-21T06:15:10.455 INFO:teuthology.orchestra.run.smithi063.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 156 kB/s | 18 kB 00:00 2024-09-21T06:15:10.476 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-21T06:15:10.476 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-21T06:15:10.563 INFO:teuthology.orchestra.run.smithi063.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 11 kB 00:00 2024-09-21T06:15:10.680 INFO:teuthology.orchestra.run.smithi063.stdout:(56/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2024-09-21T06:15:10.831 INFO:teuthology.orchestra.run.smithi063.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.8 MB/s | 3.0 MB 00:00 2024-09-21T06:15:10.856 INFO:teuthology.orchestra.run.smithi063.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 914 kB/s | 160 kB 00:00 2024-09-21T06:15:10.948 INFO:teuthology.orchestra.run.smithi063.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 388 kB/s | 45 kB 00:00 2024-09-21T06:15:10.990 INFO:teuthology.orchestra.run.smithi063.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-21T06:15:11.065 INFO:teuthology.orchestra.run.smithi063.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 4.8 MB/s | 581 kB 00:00 2024-09-21T06:15:11.099 INFO:teuthology.orchestra.run.smithi063.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 225 kB/s | 24 kB 00:00 2024-09-21T06:15:11.174 INFO:teuthology.orchestra.run.smithi063.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-21T06:15:11.224 INFO:teuthology.orchestra.run.smithi063.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-21T06:15:11.283 INFO:teuthology.orchestra.run.smithi063.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-21T06:15:11.333 INFO:teuthology.orchestra.run.smithi063.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 354 kB/s | 38 kB 00:00 2024-09-21T06:15:13.150 INFO:teuthology.orchestra.run.smithi063.stdout:(67/157): openblas-openmp-0.3.26-2.el9.x86_64.r 2.6 MB/s | 4.9 MB 00:01 2024-09-21T06:15:13.292 INFO:teuthology.orchestra.run.smithi063.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-21T06:15:13.417 INFO:teuthology.orchestra.run.smithi063.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-09-21T06:15:13.609 INFO:teuthology.orchestra.run.smithi063.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.9 MB/s | 4.4 MB 00:02 2024-09-21T06:15:13.634 INFO:teuthology.orchestra.run.smithi063.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 633 kB/s | 137 kB 00:00 2024-09-21T06:15:13.768 INFO:teuthology.orchestra.run.smithi063.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-09-21T06:15:13.885 INFO:teuthology.orchestra.run.smithi063.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 748 kB/s | 87 kB 00:00 2024-09-21T06:15:14.310 INFO:teuthology.orchestra.run.smithi063.stdout:(74/157): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-21T06:15:14.419 INFO:teuthology.orchestra.run.smithi063.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 567 kB/s | 61 kB 00:00 2024-09-21T06:15:14.535 INFO:teuthology.orchestra.run.smithi063.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-21T06:15:14.653 INFO:teuthology.orchestra.run.smithi063.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-21T06:15:14.737 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-21T06:15:14.761 INFO:teuthology.orchestra.run.smithi063.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 237 kB/s | 26 kB 00:00 2024-09-21T06:15:14.831 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:15:14.861 INFO:teuthology.orchestra.run.smithi063.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 191 kB/s | 19 kB 00:00 2024-09-21T06:15:14.879 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:15:14.940 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:15:14.979 INFO:teuthology.orchestra.run.smithi063.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-21T06:15:14.982 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:15:15.008 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:15:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:15:15.078 INFO:teuthology.orchestra.run.smithi063.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 348 kB/s | 35 kB 00:00 2024-09-21T06:15:15.390 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:15:15.429 INFO:teuthology.orchestra.run.smithi063.stdout:(82/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-09-21T06:15:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:15:15.596 INFO:teuthology.orchestra.run.smithi063.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-09-21T06:15:15.635 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:15:15.659 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:15:15.713 INFO:teuthology.orchestra.run.smithi063.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-21T06:15:15.734 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:15:15.772 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:15:15.801 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:15:15.830 INFO:teuthology.orchestra.run.smithi063.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 663 kB/s | 77 kB 00:00 2024-09-21T06:15:15.947 INFO:teuthology.orchestra.run.smithi063.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 362 kB/s | 42 kB 00:00 2024-09-21T06:15:15.966 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:15:16.020 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:15:16.048 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:15:16.063 INFO:teuthology.orchestra.run.smithi063.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-09-21T06:15:16.153 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:15:16.180 INFO:teuthology.orchestra.run.smithi063.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-21T06:15:16.182 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:15:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:15:16.266 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:15:16.292 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:15:16.297 INFO:teuthology.orchestra.run.smithi063.stdout:(89/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-21T06:15:16.406 INFO:teuthology.orchestra.run.smithi063.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-09-21T06:15:16.468 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:15:16.515 INFO:teuthology.orchestra.run.smithi063.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 495 kB/s | 54 kB 00:00 2024-09-21T06:15:16.607 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:15:16.702 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-21T06:15:16.731 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:15:16.816 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:15:16.830 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:15:16.910 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:15:16.937 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:15:17.074 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:15:17.116 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:15:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:15:17.142 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:15:17.193 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:15:17.230 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:15:17.264 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:15:17.309 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:15:17.382 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:15:17.398 INFO:teuthology.orchestra.run.smithi063.stdout:(92/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-21T06:15:17.425 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:15:17.466 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:15:17.507 INFO:teuthology.orchestra.run.smithi063.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 385 kB/s | 42 kB 00:00 2024-09-21T06:15:17.509 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:15:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:15:17.542 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:15:17.569 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:15:17.615 INFO:teuthology.orchestra.run.smithi063.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 408 kB/s | 44 kB 00:00 2024-09-21T06:15:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:15:17.667 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:15:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:15:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:15:17.732 INFO:teuthology.orchestra.run.smithi063.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-21T06:15:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:15:17.794 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:15:17.827 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:15:17.841 INFO:teuthology.orchestra.run.smithi063.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 331 kB/s | 36 kB 00:00 2024-09-21T06:15:17.846 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:15:17.918 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:15:17.933 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:15:17.948 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:15:17.949 INFO:teuthology.orchestra.run.smithi063.stdout:(97/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-21T06:15:17.977 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:15:18.075 INFO:teuthology.orchestra.run.smithi063.stdout:(98/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-21T06:15:18.084 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:15:18.128 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:15:18.178 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:15:18.183 INFO:teuthology.orchestra.run.smithi063.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 534 kB/s | 58 kB 00:00 2024-09-21T06:15:18.207 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:15:18.240 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:15:18.292 INFO:teuthology.orchestra.run.smithi063.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 884 kB/s | 96 kB 00:00 2024-09-21T06:15:18.304 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:15:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:15:18.333 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:15:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:15:18.395 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:15:18.401 INFO:teuthology.orchestra.run.smithi063.stdout:(101/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 588 kB/s | 64 kB 00:00 2024-09-21T06:15:18.425 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:15:18.446 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:15:18.447 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:15:18.509 INFO:teuthology.orchestra.run.smithi063.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 413 kB/s | 45 kB 00:00 2024-09-21T06:15:18.582 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:15:18.633 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:15:18.644 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:15:18.666 INFO:teuthology.orchestra.run.smithi063.stdout:(103/157): lua-devel-5.4.4-4.el9.x86_64.rpm 142 kB/s | 22 kB 00:00 2024-09-21T06:15:18.785 INFO:teuthology.orchestra.run.smithi063.stdout:(104/157): protobuf-compiler-3.14.0-13.el9.x86_ 7.1 MB/s | 863 kB 00:00 2024-09-21T06:15:18.801 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:15:18.835 INFO:teuthology.orchestra.run.smithi063.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T06:15:18.869 INFO:teuthology.orchestra.run.smithi063.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-21T06:15:18.910 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:15:18.911 INFO:teuthology.orchestra.run.smithi063.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 468 kB/s | 19 kB 00:00 2024-09-21T06:15:19.006 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:15:19.028 INFO:teuthology.orchestra.run.smithi063.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-21T06:15:19.053 INFO:teuthology.orchestra.run.smithi063.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T06:15:19.078 INFO:teuthology.orchestra.run.smithi063.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T06:15:19.103 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:15:19.104 INFO:teuthology.orchestra.run.smithi063.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T06:15:19.129 INFO:teuthology.orchestra.run.smithi063.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-21T06:15:19.172 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:15:19.179 INFO:teuthology.orchestra.run.smithi063.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-21T06:15:19.213 INFO:teuthology.orchestra.run.smithi063.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-21T06:15:19.238 INFO:teuthology.orchestra.run.smithi063.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T06:15:19.253 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:15:19.263 INFO:teuthology.orchestra.run.smithi063.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T06:15:19.282 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:15:19.288 INFO:teuthology.orchestra.run.smithi063.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 568 kB/s | 14 kB 00:00 2024-09-21T06:15:19.314 INFO:teuthology.orchestra.run.smithi063.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-21T06:15:19.324 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:15:19.335 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:15:19.348 INFO:teuthology.orchestra.run.smithi063.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-21T06:15:19.379 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:15:19.420 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:15:19.423 INFO:teuthology.orchestra.run.smithi063.stdout:(120/157): postgresql-server-13.16-1.el9.x86_64 1.0 MB/s | 5.8 MB 00:05 2024-09-21T06:15:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:15:19.456 INFO:teuthology.orchestra.run.smithi063.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-09-21T06:15:19.474 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:15:19.498 INFO:teuthology.orchestra.run.smithi063.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-09-21T06:15:19.509 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:15:19.524 INFO:teuthology.orchestra.run.smithi063.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T06:15:19.549 INFO:teuthology.orchestra.run.smithi063.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-21T06:15:19.574 INFO:teuthology.orchestra.run.smithi063.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-21T06:15:19.576 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:15:19.583 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:15:19.599 INFO:teuthology.orchestra.run.smithi063.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 935 kB/s | 23 kB 00:00 2024-09-21T06:15:19.625 INFO:teuthology.orchestra.run.smithi063.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 776 kB/s | 19 kB 00:00 2024-09-21T06:15:19.635 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:15:19.640 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:15:19.650 INFO:teuthology.orchestra.run.smithi063.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 795 kB/s | 20 kB 00:00 2024-09-21T06:15:19.675 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:15:19.719 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:15:19.732 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:15:19.760 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:15:19.787 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:15:19.796 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:15:19.808 INFO:teuthology.orchestra.run.smithi063.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.8 MB/s | 2.0 MB 00:00 2024-09-21T06:15:19.834 INFO:teuthology.orchestra.run.smithi063.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T06:15:19.857 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:15:19.867 INFO:teuthology.orchestra.run.smithi063.stdout:(131/157): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-09-21T06:15:19.870 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:15:19.893 INFO:teuthology.orchestra.run.smithi063.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-09-21T06:15:19.908 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:15:19.919 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:15:19.926 INFO:teuthology.orchestra.run.smithi063.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 980 kB/s | 58 kB 00:00 2024-09-21T06:15:19.944 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:15:19.948 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:15:19.951 INFO:teuthology.orchestra.run.smithi063.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-21T06:15:19.977 INFO:teuthology.orchestra.run.smithi063.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T06:15:19.984 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:15:19.991 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:15:20.002 INFO:teuthology.orchestra.run.smithi063.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-21T06:15:20.027 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:15:20.034 INFO:teuthology.orchestra.run.smithi063.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 496 kB/s | 28 kB 00:00 2024-09-21T06:15:20.060 INFO:teuthology.orchestra.run.smithi063.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 538 kB/s | 31 kB 00:00 2024-09-21T06:15:20.066 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:15:20.070 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:15:20.085 INFO:teuthology.orchestra.run.smithi063.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T06:15:20.103 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:15:20.112 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:15:20.118 INFO:teuthology.orchestra.run.smithi063.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-21T06:15:20.144 INFO:teuthology.orchestra.run.smithi063.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 612 kB/s | 36 kB 00:00 2024-09-21T06:15:20.154 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:15:20.169 INFO:teuthology.orchestra.run.smithi063.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T06:15:20.191 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:15:20.194 INFO:teuthology.orchestra.run.smithi063.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T06:15:20.220 INFO:teuthology.orchestra.run.smithi063.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T06:15:20.245 INFO:teuthology.orchestra.run.smithi063.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-09-21T06:15:20.249 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:15:20.262 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:15:20.278 INFO:teuthology.orchestra.run.smithi063.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-21T06:15:20.289 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:15:20.304 INFO:teuthology.orchestra.run.smithi063.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-21T06:15:20.306 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:15:20.330 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:15:20.362 INFO:teuthology.orchestra.run.smithi063.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-21T06:15:20.380 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:15:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:15:20.540 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:15:20.592 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:15:20.604 INFO:teuthology.orchestra.run.smithi063.stdout:(149/157): librbd1-19.3.0-5120.g18432218.el9.x8 13 MB/s | 3.2 MB 00:00 2024-09-21T06:15:20.656 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:15:20.713 INFO:teuthology.orchestra.run.smithi063.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 8.3 MB/s | 3.4 MB 00:00 2024-09-21T06:15:20.772 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:15:20.805 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:15:20.829 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:15:20.909 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:15:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:15:21.097 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:15:21.131 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:15:21.136 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:15:21.165 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:15:21.204 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:15:21.220 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:15:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:15:21.249 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:15:21.282 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:15:21.292 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:15:21.317 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:15:21.339 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:15:21.350 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:15:21.389 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:15:21.392 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:15:21.426 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:15:21.521 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:15:21.555 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:15:21.565 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:15:21.604 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:15:21.617 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:15:21.708 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:15:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:15:21.764 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:15:21.773 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:15:21.837 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:15:21.877 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:15:21.880 INFO:teuthology.orchestra.run.smithi063.stdout:(151/157): python3-cryptography-36.0.1-4.el9.x8 64 kB/s | 1.2 MB 00:19 2024-09-21T06:15:21.912 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:15:21.960 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:15:21.995 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:15:22.038 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:15:22.081 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:15:22.285 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:15:22.324 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:15:22.374 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:15:22.486 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:15:22.503 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:15:22.524 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:15:22.552 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:15:22.564 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:15:22.585 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:15:22.614 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:15:22.687 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:15:22.731 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:15:22.741 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:15:22.786 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:15:22.875 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:15:22.922 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:15:22.928 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:15:23.104 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:15:23.117 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:15:23.144 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:15:23.163 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:15:23.188 INFO:teuthology.orchestra.run.smithi063.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 31 kB/s | 41 kB 00:01 2024-09-21T06:15:23.199 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:15:23.221 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:15:23.241 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:15:23.281 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:15:23.322 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:15:23.360 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:15:23.364 INFO:teuthology.orchestra.run.smithi063.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.4 MB/s | 249 kB 00:00 2024-09-21T06:15:23.394 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:15:23.427 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:15:23.469 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:15:23.503 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:15:23.590 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:15:23.650 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:15:23.681 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:15:23.784 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:15:23.858 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:15:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:15:23.987 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:15:24.586 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:15:24.630 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:15:24.663 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:15:24.763 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:15:24.810 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:15:24.855 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:15:24.951 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:15:24.990 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:15:25.178 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:15:25.213 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:15:25.224 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:15:25.290 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:15:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:15:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:15:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:15:25.692 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:15:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:15:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:15:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:15:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:15:25.936 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:15:26.053 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:15:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:15:26.409 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:15:26.480 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:15:26.511 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:15:27.284 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:15:27.485 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:15:27.513 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:15:27.547 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:15:27.872 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:15:27.917 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:15:28.017 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:15:28.047 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:15:28.083 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:15:28.589 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:15:28.620 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:15:28.683 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:15:28.713 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:15:28.731 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:15:28.940 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:15:29.506 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:15:29.552 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:15:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:15:29.649 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:15:29.650 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:15:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:15:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:15:30.997 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:15:31.026 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:15:31.598 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:15:31.637 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:15:31.728 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:15:31.728 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:15:31.728 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:15:31.728 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:15:31.755 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:15:32.905 INFO:teuthology.orchestra.run.smithi063.stdout:(154/157): NetworkManager-1.51.0-1.el9.x86_64.r 193 kB/s | 2.3 MB 00:12 2024-09-21T06:15:35.430 INFO:teuthology.orchestra.run.smithi063.stdout:(155/157): NetworkManager-libnm-1.51.0-1.el9.x8 126 kB/s | 1.8 MB 00:14 2024-09-21T06:15:35.488 INFO:teuthology.orchestra.run.smithi063.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 114 kB/s | 1.4 MB 00:12 2024-09-21T06:15:37.846 INFO:teuthology.orchestra.run.smithi063.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 496 kB/s | 2.4 MB 00:04 2024-09-21T06:15:37.850 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:15:37.850 INFO:teuthology.orchestra.run.smithi063.stdout:Total 5.2 MB/s | 228 MB 00:43 2024-09-21T06:15:39.127 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-21T06:15:39.299 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-21T06:15:39.299 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-21T06:15:41.557 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:15:41.557 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /sys 2024-09-21T06:15:41.557 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /proc 2024-09-21T06:15:41.558 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /mnt 2024-09-21T06:15:41.558 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /var/tmp 2024-09-21T06:15:41.558 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /home 2024-09-21T06:15:41.558 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /root 2024-09-21T06:15:41.558 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /tmp 2024-09-21T06:15:41.558 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:15:41.689 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-21T06:15:41.689 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-21T06:15:41.737 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:15:41.753 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:15:41.753 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:15:41.754 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:15:41.754 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:15:43.348 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:15:43.374 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:15:43.375 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:15:43.375 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:15:43.375 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:15:43.375 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:15:43.375 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:15:43.546 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:15:43.546 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /sys 2024-09-21T06:15:43.546 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /proc 2024-09-21T06:15:43.546 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /mnt 2024-09-21T06:15:43.546 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /var/tmp 2024-09-21T06:15:43.546 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /home 2024-09-21T06:15:43.546 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /root 2024-09-21T06:15:43.546 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /tmp 2024-09-21T06:15:43.546 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:15:43.598 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:15:43.622 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:15:43.622 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:15:43.623 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:15:43.623 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:15:43.623 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:15:43.623 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:15:43.723 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:15:43.740 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:15:43.740 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:15:43.740 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:15:43.740 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:15:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:15:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:15:44.106 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:15:44.107 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:15:44.107 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:15:44.107 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:15:44.107 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:15:44.221 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:15:44.278 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:15:44.333 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:15:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:15:44.566 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:15:44.644 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:15:44.734 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:15:44.911 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:15:44.958 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:15:44.990 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:15:45.018 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:15:45.334 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:15:45.361 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:15:45.362 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:15:45.362 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:15:45.362 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:15:45.362 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:15:45.362 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:15:45.385 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:15:45.416 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:15:45.457 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:15:45.523 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:15:45.548 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:15:45.585 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:15:45.609 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:15:45.609 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:15:45.609 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:15:45.609 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:15:45.609 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:15:45.609 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:15:46.077 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:15:46.101 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:15:46.101 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:15:46.102 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:15:46.102 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:15:46.102 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:15:46.102 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:15:46.207 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:15:46.258 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:15:46.311 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:15:46.496 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:15:46.544 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:15:46.613 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:15:46.703 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:15:46.840 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:15:46.886 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:15:46.918 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:15:46.946 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:15:47.389 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:15:47.427 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:15:47.459 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:15:47.525 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:15:47.550 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:15:48.285 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-21T06:15:48.542 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:15:48.582 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:15:48.636 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:15:48.677 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:15:48.702 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:15:48.760 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:15:48.765 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:15:48.828 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:15:49.126 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:15:49.244 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:15:49.373 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:15:49.411 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:15:49.504 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:15:49.533 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:15:49.563 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:15:49.741 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:15:49.786 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:15:49.797 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:15:49.820 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:15:49.825 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:15:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:15:49.939 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:15:49.968 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:15:50.056 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:15:50.085 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:15:50.110 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:15:50.112 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:15:50.147 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:15:50.171 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:15:50.171 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:15:50.171 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:15:50.171 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:15:50.172 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:15:50.172 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:15:50.223 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:15:50.234 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:15:50.265 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:15:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:15:50.396 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:15:50.463 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:15:50.566 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:15:50.726 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:15:50.766 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:15:50.790 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:15:50.843 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:15:51.084 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:15:51.193 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:15:51.222 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:15:51.257 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:15:51.332 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:15:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:15:51.383 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:15:51.391 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:15:51.415 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:15:51.415 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:15:51.415 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:15:51.415 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:15:51.415 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:15:51.415 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:15:51.432 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:15:51.459 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:15:51.475 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:15:51.481 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:15:51.482 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:15:51.482 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:15:51.482 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:15:51.508 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:15:51.526 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:15:51.535 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:15:51.549 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:15:51.549 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:15:51.549 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:15:51.549 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:15:51.549 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:15:51.550 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:15:51.606 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:15:51.658 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:15:51.688 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:15:51.724 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:15:51.746 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:15:51.774 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:15:51.807 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:15:51.868 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:15:51.888 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:15:51.892 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:15:51.892 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:15:51.892 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:15:51.892 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:15:51.892 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:15:51.892 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:15:51.967 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:15:52.011 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:15:52.039 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:15:52.056 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:15:52.092 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:15:52.111 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:15:52.116 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:15:52.116 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:15:52.116 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:15:52.116 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:15:52.116 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:15:52.116 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:15:52.162 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:15:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:15:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:15:52.239 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:15:52.277 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:15:52.323 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:15:52.393 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:15:52.449 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:15:53.007 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:15:53.087 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:15:53.122 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:15:53.165 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:15:53.203 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:15:53.246 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:15:53.286 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:15:53.320 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:15:53.344 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:15:53.344 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:15:53.345 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:15:53.345 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:15:53.345 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:15:53.345 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:15:53.387 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:15:53.410 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:15:53.410 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:15:53.411 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:15:53.411 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:15:53.421 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:15:53.463 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:15:53.487 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:15:53.487 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:15:53.487 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:15:53.487 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:15:53.487 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:15:53.487 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:15:53.489 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:15:53.592 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:15:53.654 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:15:53.728 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:15:53.766 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:15:53.802 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:15:53.805 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:15:53.828 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:15:53.829 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:15:53.829 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:15:53.829 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:15:53.829 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:15:53.829 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:15:53.858 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:15:53.901 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:15:53.945 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:15:53.987 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:15:54.130 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:15:54.180 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:15:54.221 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:15:54.334 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:15:54.366 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:15:54.407 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:15:54.439 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:15:54.464 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:15:54.566 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:15:54.696 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:15:54.738 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:15:54.767 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:15:54.800 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:15:54.840 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:15:54.879 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:15:54.909 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:15:54.952 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:15:54.985 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:15:55.027 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:15:55.061 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:15:55.160 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:15:55.209 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:15:55.239 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:15:55.348 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:15:55.400 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:15:55.847 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:15:55.897 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:15:55.946 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:15:55.978 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:15:56.005 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:15:56.171 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:15:56.192 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:15:56.269 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:15:56.298 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:15:56.311 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:15:56.328 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:15:56.344 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:15:56.374 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:15:56.448 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:15:56.500 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:15:56.545 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:15:56.636 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:15:56.796 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:15:56.990 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:15:57.018 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:15:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:15:57.055 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:15:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:15:57.099 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:15:57.784 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:15:57.792 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:15:57.825 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:15:57.866 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:15:57.898 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:15:57.918 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:15:57.924 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:15:57.957 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:15:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:15:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:15:58.140 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:15:58.146 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:15:58.195 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:15:58.197 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:15:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:15:58.227 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:15:58.246 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:15:58.247 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:15:58.257 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:15:58.303 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:15:58.339 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:15:58.340 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:15:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:15:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:15:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:15:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:15:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:15:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:15:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:15:58.790 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:15:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:15:58.967 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:15:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:15:59.258 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:15:59.356 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:15:59.385 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:15:59.418 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:15:59.761 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:15:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:15:59.829 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:15:59.911 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:15:59.922 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:15:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:15:59.962 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:15:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:16:00.043 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:16:00.075 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:16:00.108 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:16:00.143 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:16:00.143 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:16:00.218 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:16:00.218 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:16:00.286 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:16:00.310 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:16:00.316 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:16:00.316 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:16:00.496 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:16:00.496 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:16:00.507 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:16:00.533 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:16:00.588 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:16:00.605 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:16:00.643 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:16:00.652 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:16:03.047 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:16:03.082 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:16:03.686 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:16:03.727 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:16:03.802 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:16:03.802 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:16:03.802 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:16:03.802 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:16:03.861 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:16:05.043 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:16:05.043 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:16:05.043 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:16:05.043 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:16:05.043 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:16:05.043 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:16:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:16:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:16:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:16:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:16:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:16:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:16:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:16:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:16:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:16:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:16:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:16:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:16:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:16:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:16:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:16:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:16:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:16:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:16:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:16:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:16:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:16:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:16:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:16:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:16:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:16:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:16:05.046 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:16:05.046 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:16:05.046 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:16:05.046 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:16:05.046 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:16:05.046 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:16:05.046 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:16:05.047 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:16:05.047 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:16:05.047 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:16:05.047 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:16:05.047 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:16:05.047 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:16:05.047 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:16:05.047 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:16:05.047 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:16:05.047 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:16:05.047 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:16:05.047 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:16:05.048 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:16:05.048 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:16:05.048 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:16:05.048 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:16:05.048 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:16:05.048 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:16:05.048 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:16:05.048 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:16:05.048 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:16:05.048 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:16:05.048 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:16:05.048 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:16:05.048 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:16:05.048 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:16:05.049 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:16:05.049 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:16:05.049 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:16:05.049 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:16:05.049 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:16:05.049 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:16:05.049 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:16:05.049 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:16:05.049 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:16:05.049 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:16:05.049 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:16:05.049 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:16:05.049 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:16:05.050 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:16:05.050 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:16:05.050 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:16:05.050 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:16:05.050 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:16:05.050 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:16:05.050 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:16:05.050 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:16:05.050 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:16:05.050 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:16:05.050 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:16:05.050 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:16:05.050 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:16:05.050 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:16:05.051 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:16:05.051 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:16:05.051 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:16:05.051 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:16:05.051 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:16:05.051 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:16:05.051 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:16:05.051 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:16:05.051 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:16:05.051 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:16:05.051 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:16:05.051 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:16:05.051 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:16:05.051 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:16:05.052 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:16:05.052 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:16:05.052 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:16:05.052 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:16:05.052 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:16:05.052 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:16:05.052 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:16:05.052 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:16:05.052 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:16:05.052 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:16:05.052 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:16:05.052 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:16:05.052 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:16:05.052 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:16:05.053 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:16:05.053 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:16:05.053 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:16:05.053 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:16:05.053 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:16:05.053 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:16:05.053 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:16:05.053 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:16:05.053 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:16:05.053 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:16:05.053 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:16:05.053 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:16:05.053 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:16:05.053 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:16:05.054 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:16:05.054 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:16:05.054 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:16:05.054 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:16:05.054 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:16:05.054 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:16:05.054 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:16:05.054 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:16:05.054 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:16:05.054 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:16:05.054 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:16:05.054 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:16:05.054 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:16:05.055 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:16:05.055 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:16:05.055 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:16:05.055 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:16:05.055 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:16:05.055 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:16:05.055 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:16:05.055 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:16:05.055 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:16:05.055 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:16:05.055 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:16:05.055 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:16:05.055 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:16:05.055 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:16:05.056 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:16:05.056 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:16:05.056 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:16:05.056 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:16:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:16:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:16:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:16:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:16:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:16:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:16:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:16:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:16:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:16:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:16:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:16:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:16:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:16:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:16:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:16:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:16:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:16:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:16:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:16:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:16:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:16:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:16:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:16:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:16:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:16:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:16:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:16:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:16:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:16:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:16:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:16:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:16:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:16:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:16:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:16:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:16:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:16:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:16:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:16:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:16:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:16:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:16:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:16:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:16:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:16:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:16:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:16:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:16:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:16:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:16:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:16:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:16:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:16:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:16:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:16:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:16:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:16:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:16:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:16:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:16:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:16:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:16:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:16:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:16:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:16:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:16:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:16:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:16:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:16:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:16:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:16:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:16:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:16:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:16:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:16:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:16:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:16:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:16:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:16:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:16:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:16:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:16:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:16:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:16:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:16:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:16:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:16:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:16:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:16:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:16:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:16:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:16:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:16:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:16:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:16:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:16:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:16:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:16:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:16:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:16:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:16:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:16:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:16:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:16:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:16:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:16:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:16:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:16:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:16:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:16:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:16:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:16:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:16:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:16:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:16:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:16:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:16:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:16:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:16:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:16:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:16:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:16:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:16:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:16:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:16:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:16:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:16:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:16:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:16:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:16:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:16:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:16:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:16:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:16:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:16:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:16:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:16:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:16:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:16:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:16:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:16:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:16:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:16:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:16:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:16:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:16:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:16:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:16:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:16:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:16:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:16:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:16:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:16:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:16:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:16:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:16:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:16:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:16:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:16:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:16:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:16:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:16:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:16:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:16:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:16:07.323 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:16:07.323 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:16:07.324 INFO:teuthology.orchestra.run.smithi071.stdout:Upgraded: 2024-09-21T06:16:07.324 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:16:07.324 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:16:07.324 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:16:07.324 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:16:07.324 INFO:teuthology.orchestra.run.smithi071.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.324 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.324 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:16:07.324 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:16:07.324 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-21T06:16:07.324 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:16:07.324 INFO:teuthology.orchestra.run.smithi071.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:16:07.324 INFO:teuthology.orchestra.run.smithi071.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:16:07.325 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:16:07.325 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.325 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.325 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.325 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.325 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:07.325 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.325 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.325 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.325 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:07.325 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:07.325 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:07.325 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:07.326 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:07.326 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.326 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.326 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:07.326 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.326 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.326 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.326 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:07.326 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:07.326 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.326 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.326 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:07.326 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:16:07.327 INFO:teuthology.orchestra.run.smithi071.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:16:07.327 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:16:07.327 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:16:07.327 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:16:07.327 INFO:teuthology.orchestra.run.smithi071.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:16:07.327 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:16:07.327 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:16:07.327 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:16:07.327 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:16:07.327 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:16:07.327 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.327 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.327 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.327 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:16:07.328 INFO:teuthology.orchestra.run.smithi071.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:16:07.328 INFO:teuthology.orchestra.run.smithi071.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:16:07.328 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:16:07.328 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:16:07.328 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:16:07.328 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.328 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.328 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:16:07.328 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.328 INFO:teuthology.orchestra.run.smithi071.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:16:07.328 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:16:07.328 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:16:07.328 INFO:teuthology.orchestra.run.smithi071.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:16:07.328 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:16:07.329 INFO:teuthology.orchestra.run.smithi071.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:16:07.329 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:16:07.329 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:16:07.329 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:16:07.329 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:16:07.329 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:16:07.329 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:16:07.329 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:16:07.329 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:16:07.329 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:16:07.329 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:16:07.329 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:16:07.329 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:16:07.329 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:16:07.329 INFO:teuthology.orchestra.run.smithi071.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:16:07.330 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:16:07.330 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:16:07.330 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:16:07.330 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.330 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.330 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.330 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:16:07.330 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:16:07.330 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:16:07.330 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:16:07.330 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:16:07.330 INFO:teuthology.orchestra.run.smithi071.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:16:07.330 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:16:07.330 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:16:07.331 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:16:07.331 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:16:07.331 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:16:07.331 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:16:07.331 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:16:07.331 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:16:07.331 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:16:07.331 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:16:07.331 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:16:07.331 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:16:07.331 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:16:07.331 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:16:07.331 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:16:07.331 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:16:07.332 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:16:07.332 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:16:07.332 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:16:07.332 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:16:07.332 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:16:07.332 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:16:07.332 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:16:07.332 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:16:07.332 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:16:07.332 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:16:07.332 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:16:07.332 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:16:07.332 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:16:07.332 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:16:07.332 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:16:07.333 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:16:07.333 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:16:07.333 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:16:07.333 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.333 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.333 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:16:07.333 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:16:07.333 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:16:07.333 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.333 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:16:07.333 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:16:07.333 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:16:07.333 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:16:07.333 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:16:07.333 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:16:07.334 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:16:07.334 INFO:teuthology.orchestra.run.smithi071.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:16:07.334 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:16:07.334 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:16:07.334 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:16:07.334 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:16:07.334 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:16:07.334 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:16:07.334 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:16:07.334 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.334 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.334 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:07.334 INFO:teuthology.orchestra.run.smithi071.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:16:07.334 INFO:teuthology.orchestra.run.smithi071.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:16:07.335 INFO:teuthology.orchestra.run.smithi071.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:16:07.335 INFO:teuthology.orchestra.run.smithi071.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:16:07.335 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:16:07.335 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:16:07.335 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:16:07.335 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:16:07.335 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-21T06:16:07.753 DEBUG:teuthology.parallel:result is None 2024-09-21T06:16:09.271 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:16:09.271 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:16:09.271 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2024-09-21T06:16:09.271 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:16:09.271 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:16:09.271 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:16:09.271 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:16:09.271 INFO:teuthology.orchestra.run.smithi175.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:16:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:16:09.272 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-21T06:16:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:16:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:16:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:16:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:16:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.272 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.273 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:16:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:16:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:16:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:16:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:16:09.274 INFO:teuthology.orchestra.run.smithi175.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:16:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:16:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:16:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:16:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:16:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:16:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:16:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:16:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:16:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:16:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:16:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:16:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:16:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:16:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:16:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:16:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:16:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:16:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:16:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:16:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:16:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:16:09.276 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:16:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:16:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:16:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:16:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:16:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:16:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:16:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:16:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:16:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:16:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:16:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:16:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:16:09.277 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:16:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:16:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:16:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:16:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:16:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:16:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:16:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:16:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:16:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:16:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:16:09.278 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:16:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:16:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:16:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:16:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:16:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:16:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:16:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:16:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:16:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:16:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:16:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:16:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:16:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:16:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:16:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:16:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:16:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:16:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:16:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:16:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:16:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:16:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:16:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:16:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:16:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:16:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:16:09.280 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:16:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:16:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:16:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:16:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:16:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:16:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:16:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:16:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:16:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:16:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:16:09.281 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:16:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:16:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:16:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:16:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:16:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:16:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:16:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:16:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:16:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:16:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:16:09.282 INFO:teuthology.orchestra.run.smithi175.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:16:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:16:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:16:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:16:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:16:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:16:09.283 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:16:09.283 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-21T06:16:09.700 DEBUG:teuthology.parallel:result is None 2024-09-21T06:16:16.361 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:16:16.362 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /sys 2024-09-21T06:16:16.362 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /proc 2024-09-21T06:16:16.362 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /mnt 2024-09-21T06:16:16.362 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /var/tmp 2024-09-21T06:16:16.362 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /home 2024-09-21T06:16:16.362 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /root 2024-09-21T06:16:16.362 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /tmp 2024-09-21T06:16:16.362 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:16:16.545 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:16:16.563 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:16:16.563 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:16:16.563 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:16:16.563 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:16:18.223 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:16:18.251 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:16:18.251 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:16:18.252 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:16:18.252 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:16:18.252 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:16:18.252 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:16:18.565 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:16:18.590 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:16:18.590 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:16:18.590 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:16:18.590 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:16:18.590 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:16:18.591 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:16:19.082 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:16:19.107 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:16:19.107 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:16:19.107 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:16:19.107 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:16:19.107 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:16:19.107 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:16:19.213 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:16:19.271 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:16:19.335 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:16:19.538 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:16:19.592 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:16:19.673 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:16:19.761 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:16:19.913 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:16:19.967 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:16:19.999 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:16:20.026 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:16:20.480 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:16:20.508 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:16:20.541 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:16:20.609 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:16:20.639 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:16:24.007 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:16:24.070 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:16:25.088 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:16:25.112 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:16:25.234 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:16:25.412 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:16:25.439 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:16:25.464 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:16:25.464 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:16:25.464 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:16:25.465 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:16:25.465 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:16:25.465 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:16:25.515 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:16:25.527 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:16:25.630 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:16:25.694 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:16:26.718 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:16:26.742 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:16:26.766 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:16:26.767 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:16:26.767 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:16:26.767 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:16:26.767 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:16:26.767 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:16:26.817 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:16:26.841 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:16:26.842 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:16:26.842 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:16:26.842 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:16:26.901 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:16:26.926 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:16:26.926 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:16:26.926 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:16:26.926 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:16:26.926 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:16:26.926 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:16:27.269 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:16:27.293 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:16:27.294 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:16:27.294 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:16:27.294 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:16:27.294 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:16:27.294 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:16:31.578 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:16:31.623 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:16:31.664 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:16:31.695 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:16:31.722 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:16:31.954 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:16:32.002 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:16:32.032 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:16:32.062 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:16:32.100 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:16:32.744 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:16:32.780 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:16:32.803 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:16:33.718 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:16:33.802 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:16:33.855 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:16:33.962 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:16:34.006 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:16:34.030 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:16:34.073 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:16:34.073 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:16:34.165 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:16:34.166 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:16:34.249 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:16:34.274 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:16:34.281 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:16:34.281 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:16:34.476 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:16:34.476 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:16:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:16:34.637 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:16:41.104 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:16:41.105 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:16:41.105 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:16:41.105 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:16:41.105 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:16:41.105 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:16:41.105 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:16:41.105 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:16:41.105 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:16:41.105 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:16:41.105 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:16:41.105 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:16:41.105 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:16:41.106 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:16:41.106 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:16:41.106 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:16:41.106 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:16:41.106 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:16:41.106 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:16:41.106 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:16:41.106 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:16:41.106 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:16:41.106 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:16:41.106 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:16:41.106 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:16:41.106 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:16:41.106 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:16:41.107 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:16:41.107 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:16:41.107 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:16:41.118 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:16:41.118 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:16:41.118 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:16:41.118 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:16:41.118 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:16:41.118 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:16:41.118 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:16:41.118 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:16:41.118 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:16:41.118 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:16:41.118 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:16:41.119 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:16:41.119 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:16:41.119 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:16:41.119 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:16:41.119 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:16:41.119 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:16:41.119 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:16:41.119 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:16:41.119 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:16:41.119 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:16:41.119 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:16:41.119 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:16:41.119 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:16:41.119 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:16:41.120 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:16:41.120 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:16:41.120 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:16:41.120 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:16:41.120 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:16:41.120 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:16:41.120 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:16:41.120 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:16:41.120 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:16:41.120 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:16:41.120 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:16:41.120 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:16:41.120 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:16:41.120 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:16:41.121 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:16:41.121 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:16:41.121 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:16:41.121 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:16:41.121 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:16:41.121 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:16:41.121 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:16:41.121 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:16:41.121 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:16:41.121 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:16:41.121 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:16:41.121 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:16:41.121 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:16:41.121 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:16:41.122 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:16:41.122 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:16:41.122 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:16:41.122 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:16:41.122 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:16:41.122 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:16:41.122 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:16:41.122 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:16:41.122 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:16:41.122 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:16:41.122 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:16:41.122 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:16:41.122 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:16:41.123 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:16:41.123 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:16:41.123 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:16:41.123 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:16:41.123 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:16:41.123 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:16:41.123 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:16:41.123 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:16:41.123 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:16:41.123 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:16:41.123 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:16:41.123 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:16:41.123 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:16:41.123 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:16:41.124 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:16:41.124 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:16:41.124 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:16:41.124 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:16:41.124 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:16:41.124 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:16:41.124 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:16:41.124 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:16:41.124 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:16:41.124 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:16:41.124 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:16:41.125 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:16:41.125 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:16:41.125 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:16:41.125 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:16:41.125 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:16:41.125 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:16:41.125 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:16:41.125 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:16:41.125 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:16:41.125 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:16:41.125 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:16:41.125 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:16:41.125 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:16:41.125 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:16:41.126 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:16:41.126 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:16:41.126 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:16:41.126 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:16:41.126 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:16:41.126 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:16:41.126 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:16:41.126 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:16:41.126 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:16:41.126 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:16:41.126 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:16:41.126 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:16:41.126 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:16:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:16:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:16:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:16:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:16:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:16:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:16:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:16:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:16:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:16:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:16:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:16:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:16:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:16:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:16:41.127 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:16:41.128 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:16:41.128 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:16:43.933 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:16:43.933 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:16:43.933 INFO:teuthology.orchestra.run.smithi063.stdout:Upgraded: 2024-09-21T06:16:43.933 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:16:43.933 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:16:43.934 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:16:43.934 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:16:43.934 INFO:teuthology.orchestra.run.smithi063.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.934 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.934 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:16:43.934 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:16:43.934 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-21T06:16:43.934 INFO:teuthology.orchestra.run.smithi063.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:16:43.934 INFO:teuthology.orchestra.run.smithi063.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:16:43.934 INFO:teuthology.orchestra.run.smithi063.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:16:43.934 INFO:teuthology.orchestra.run.smithi063.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:16:43.934 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.935 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.935 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.935 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.935 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:43.935 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.935 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.935 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.935 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:43.935 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:43.935 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:43.935 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:43.935 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:43.935 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.936 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.936 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:43.936 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.936 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.936 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.936 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:43.936 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:43.936 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.936 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.936 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:16:43.936 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:16:43.936 INFO:teuthology.orchestra.run.smithi063.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:16:43.936 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:16:43.937 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:16:43.937 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:16:43.937 INFO:teuthology.orchestra.run.smithi063.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:16:43.937 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:16:43.937 INFO:teuthology.orchestra.run.smithi063.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:16:43.937 INFO:teuthology.orchestra.run.smithi063.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:16:43.937 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:16:43.937 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:16:43.937 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.937 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.937 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.937 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:16:43.937 INFO:teuthology.orchestra.run.smithi063.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:16:43.937 INFO:teuthology.orchestra.run.smithi063.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:16:43.938 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:16:43.938 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:16:43.938 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:16:43.938 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.938 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.938 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:16:43.938 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.938 INFO:teuthology.orchestra.run.smithi063.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:16:43.938 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:16:43.938 INFO:teuthology.orchestra.run.smithi063.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:16:43.938 INFO:teuthology.orchestra.run.smithi063.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:16:43.938 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:16:43.938 INFO:teuthology.orchestra.run.smithi063.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:16:43.939 INFO:teuthology.orchestra.run.smithi063.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:16:43.939 INFO:teuthology.orchestra.run.smithi063.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:16:43.939 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:16:43.939 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:16:43.939 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:16:43.939 INFO:teuthology.orchestra.run.smithi063.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:16:43.939 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:16:43.939 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:16:43.939 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:16:43.939 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:16:43.939 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:16:43.939 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:16:43.939 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:16:43.940 INFO:teuthology.orchestra.run.smithi063.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:16:43.940 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:16:43.940 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:16:43.940 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:16:43.940 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.940 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.940 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.940 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:16:43.940 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:16:43.940 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:16:43.940 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:16:43.940 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:16:43.940 INFO:teuthology.orchestra.run.smithi063.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:16:43.940 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:16:43.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:16:43.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:16:43.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:16:43.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:16:43.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:16:43.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:16:43.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:16:43.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:16:43.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:16:43.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:16:43.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:16:43.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:16:43.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:16:43.941 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:16:43.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:16:43.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:16:43.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:16:43.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:16:43.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:16:43.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:16:43.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:16:43.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:16:43.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:16:43.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:16:43.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:16:43.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:16:43.942 INFO:teuthology.orchestra.run.smithi063.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:16:43.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:16:43.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:16:43.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:16:43.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:16:43.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:16:43.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:16:43.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:16:43.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:16:43.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:16:43.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:16:43.943 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:16:43.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:16:43.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:16:43.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:16:43.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:16:43.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:16:43.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:16:43.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:16:43.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:16:43.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:16:43.944 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:16:43.944 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:16:43.944 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:16:43.944 INFO:teuthology.orchestra.run.smithi063.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:16:43.944 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.945 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.945 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:16:43.945 INFO:teuthology.orchestra.run.smithi063.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:16:43.945 INFO:teuthology.orchestra.run.smithi063.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:16:43.945 INFO:teuthology.orchestra.run.smithi063.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:16:43.945 INFO:teuthology.orchestra.run.smithi063.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:16:43.945 INFO:teuthology.orchestra.run.smithi063.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:16:43.945 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:16:43.945 INFO:teuthology.orchestra.run.smithi063.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:16:43.945 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:16:43.945 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-21T06:16:44.381 DEBUG:teuthology.parallel:result is None 2024-09-21T06:16:44.382 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:16:44.532 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:16:44.556 INFO:teuthology.orchestra.run.smithi063.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:16:44.556 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:16:44.556 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:16:44.558 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:16:44.706 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:16:44.732 INFO:teuthology.orchestra.run.smithi071.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:16:44.732 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:16:44.732 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:16:44.734 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:16:44.874 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:16:44.901 INFO:teuthology.orchestra.run.smithi175.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:16:44.902 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:16:44.902 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:16:44.904 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T06:16:44.904 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:16:44.904 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:16:44.935 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:16:44.935 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:16:44.968 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T06:16:44.968 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:16:45.000 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T06:16:45.000 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:16:45.001 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:16:45.027 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:16:45.093 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:16:45.093 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:16:45.123 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:16:45.190 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T06:16:45.190 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:16:45.220 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:16:45.290 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T06:16:45.290 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:16:45.290 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:16:45.316 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:16:45.382 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:16:45.382 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:16:45.407 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:16:45.471 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T06:16:45.471 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:16:45.496 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:16:45.561 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T06:16:45.561 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:16:45.562 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:16:45.587 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:16:45.653 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:16:45.653 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:16:45.678 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:16:45.743 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T06:16:45.743 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:16:45.768 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:16:45.833 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T06:16:45.922 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug', 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-21T06:16:45.922 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:16:45.923 INFO:tasks.cephadm:Cluster fsid is 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:16:45.923 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T06:16:45.923 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.63', 'mon.b': '172.21.15.71', 'mon.c': '172.21.15.175'} 2024-09-21T06:16:45.923 INFO:tasks.cephadm:First mon is mon.a on smithi063 2024-09-21T06:16:45.923 INFO:tasks.cephadm:First mgr is x 2024-09-21T06:16:45.923 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T06:16:45.923 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname $(hostname -s) 2024-09-21T06:16:45.950 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname $(hostname -s) 2024-09-21T06:16:45.974 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname $(hostname -s) 2024-09-21T06:16:45.999 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T06:16:45.999 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:16:46.142 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T06:16:46.280 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:16:46.283 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T06:16:46.283 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T06:16:46.283 DEBUG:teuthology.orchestra.run.smithi063:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:16:46.821 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:16 /home/ubuntu/cephtest/cephadm 2024-09-21T06:16:46.822 DEBUG:teuthology.orchestra.run.smithi071:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:16:47.353 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:16 /home/ubuntu/cephtest/cephadm 2024-09-21T06:16:47.353 DEBUG:teuthology.orchestra.run.smithi175:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:16:47.866 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:16 /home/ubuntu/cephtest/cephadm 2024-09-21T06:16:47.867 DEBUG:teuthology.orchestra.run.smithi063:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:16:47.887 DEBUG:teuthology.orchestra.run.smithi071:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:16:47.907 DEBUG:teuthology.orchestra.run.smithi175:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:16:47.941 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T06:16:47.941 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:16:47.943 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:16:47.949 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:16:49.516 INFO:teuthology.orchestra.run.smithi175.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:16:49.560 INFO:teuthology.orchestra.run.smithi063.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:16:49.567 INFO:teuthology.orchestra.run.smithi071.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:17:20.892 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:17:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:17:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:17:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: "repo_digests": [ 2024-09-21T06:17:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:17:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-21T06:17:20.893 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:17:22.286 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-21T06:17:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:17:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:17:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "repo_digests": [ 2024-09-21T06:17:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:17:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-21T06:17:22.286 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-21T06:17:26.255 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-21T06:17:26.255 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:17:26.255 INFO:teuthology.orchestra.run.smithi175.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:17:26.255 INFO:teuthology.orchestra.run.smithi175.stdout: "repo_digests": [ 2024-09-21T06:17:26.255 INFO:teuthology.orchestra.run.smithi175.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:17:26.255 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-09-21T06:17:26.255 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-21T06:17:26.282 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph 2024-09-21T06:17:26.318 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph 2024-09-21T06:17:26.351 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph 2024-09-21T06:17:26.379 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 777 /etc/ceph 2024-09-21T06:17:26.408 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /etc/ceph 2024-09-21T06:17:26.437 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /etc/ceph 2024-09-21T06:17:26.462 INFO:tasks.cephadm:Writing seed config... 2024-09-21T06:17:26.463 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-21T06:17:26.463 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T06:17:26.463 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T06:17:26.463 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T06:17:26.463 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T06:17:26.463 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T06:17:26.463 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T06:17:26.463 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T06:17:26.463 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T06:17:26.464 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-21T06:17:26.464 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T06:17:26.464 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-21T06:17:26.464 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-21T06:17:26.464 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T06:17:26.464 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T06:17:26.464 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-21T06:17:26.464 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T06:17:26.464 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T06:17:26.464 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T06:17:26.464 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T06:17:26.464 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T06:17:26.464 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T06:17:26.465 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-21T06:17:26.465 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:17:26.465 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T06:17:26.484 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 140899c8-77e1-11ef-baf5-efdc52797490 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-21T06:17:26.484 DEBUG:teuthology.orchestra.run.smithi063:mon.a> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T06:17:26.527 DEBUG:teuthology.orchestra.run.smithi063:mgr.x> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T06:17:26.569 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T06:17:26.569 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid 140899c8-77e1-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.63 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:17:26.785 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:17:26.786 INFO:teuthology.orchestra.run.smithi063.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.63', '--skip-admin-label'] 2024-09-21T06:17:26.786 INFO:teuthology.orchestra.run.smithi063.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T06:17:26.786 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying podman|docker is present... 2024-09-21T06:17:26.812 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stdout 5.2.2 2024-09-21T06:17:26.812 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying lvm2 is present... 2024-09-21T06:17:26.812 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying time synchronization is in place... 2024-09-21T06:17:26.820 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T06:17:26.820 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T06:17:26.826 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T06:17:26.827 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2024-09-21T06:17:26.833 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout enabled 2024-09-21T06:17:26.840 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout active 2024-09-21T06:17:26.840 INFO:teuthology.orchestra.run.smithi063.stdout:Unit chronyd.service is enabled and running 2024-09-21T06:17:26.840 INFO:teuthology.orchestra.run.smithi063.stdout:Repeating the final host check... 2024-09-21T06:17:26.863 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stdout 5.2.2 2024-09-21T06:17:26.863 INFO:teuthology.orchestra.run.smithi063.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T06:17:26.863 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl is present 2024-09-21T06:17:26.863 INFO:teuthology.orchestra.run.smithi063.stdout:lvcreate is present 2024-09-21T06:17:26.870 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T06:17:26.870 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T06:17:26.876 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T06:17:26.876 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2024-09-21T06:17:26.883 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout enabled 2024-09-21T06:17:26.890 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout active 2024-09-21T06:17:26.890 INFO:teuthology.orchestra.run.smithi063.stdout:Unit chronyd.service is enabled and running 2024-09-21T06:17:26.890 INFO:teuthology.orchestra.run.smithi063.stdout:Host looks OK 2024-09-21T06:17:26.890 INFO:teuthology.orchestra.run.smithi063.stdout:Cluster fsid: 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:17:26.890 INFO:teuthology.orchestra.run.smithi063.stdout:Acquiring lock 140690527852912 on /run/cephadm/140899c8-77e1-11ef-baf5-efdc52797490.lock 2024-09-21T06:17:26.890 INFO:teuthology.orchestra.run.smithi063.stdout:Lock 140690527852912 acquired on /run/cephadm/140899c8-77e1-11ef-baf5-efdc52797490.lock 2024-09-21T06:17:26.891 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying IP 172.21.15.63 port 3300 ... 2024-09-21T06:17:26.891 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying IP 172.21.15.63 port 6789 ... 2024-09-21T06:17:26.891 INFO:teuthology.orchestra.run.smithi063.stdout:Base mon IP(s) is [172.21.15.63:3300, 172.21.15.63:6789], mon addrv is [v2:172.21.15.63:3300,v1:172.21.15.63:6789] 2024-09-21T06:17:26.894 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.63 metric 100 2024-09-21T06:17:26.894 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.63 metric 100 2024-09-21T06:17:26.897 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T06:17:26.897 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-21T06:17:26.897 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-21T06:17:26.899 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T06:17:26.900 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T06:17:26.900 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T06:17:26.900 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-21T06:17:26.900 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link noprefixroute 2024-09-21T06:17:26.900 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T06:17:26.900 INFO:teuthology.orchestra.run.smithi063.stdout:Mon IP `172.21.15.63` is in CIDR network `172.21.0.0/20` 2024-09-21T06:17:26.901 INFO:teuthology.orchestra.run.smithi063.stdout:Mon IP `172.21.15.63` is in CIDR network `172.21.0.0/20` 2024-09-21T06:17:26.901 INFO:teuthology.orchestra.run.smithi063.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T06:17:26.901 INFO:teuthology.orchestra.run.smithi063.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T06:17:26.901 INFO:teuthology.orchestra.run.smithi063.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:17:27.379 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T06:17:27.379 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:17:27.379 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T06:17:27.379 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T06:17:27.379 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T06:17:27.379 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T06:17:27.379 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T06:17:35.052 INFO:teuthology.orchestra.run.smithi063.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T06:17:35.052 INFO:teuthology.orchestra.run.smithi063.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T06:17:35.053 INFO:teuthology.orchestra.run.smithi063.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T06:17:40.155 INFO:teuthology.orchestra.run.smithi063.stdout:stat: stdout 167 167 2024-09-21T06:17:40.156 INFO:teuthology.orchestra.run.smithi063.stdout:Creating initial keys... 2024-09-21T06:17:41.512 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph-authtool: stdout AQAEZe5mnypVNxAA8FKw7cvS1d7M/ZQFG90Q8A== 2024-09-21T06:17:42.400 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph-authtool: stdout AQAFZe5mYnAtMRAAr0txkRI+GMCcKi3SpNpakw== 2024-09-21T06:17:43.273 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph-authtool: stdout AQAGZe5mH5RyLBAA/FHKDCA3Yv5p70k6sPuPzw== 2024-09-21T06:17:43.275 INFO:teuthology.orchestra.run.smithi063.stdout:Creating initial monmap... 2024-09-21T06:17:44.138 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T06:17:44.139 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T06:17:44.139 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:17:44.139 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T06:17:44.139 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool for a [v2:172.21.15.63:3300,v1:172.21.15.63:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T06:17:44.139 INFO:teuthology.orchestra.run.smithi063.stdout:setting min_mon_release = quincy 2024-09-21T06:17:44.139 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: set fsid to 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:17:44.139 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T06:17:44.139 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:17:44.139 INFO:teuthology.orchestra.run.smithi063.stdout:Creating mon... 2024-09-21T06:17:45.934 INFO:teuthology.orchestra.run.smithi063.stdout:create mon.a on 2024-09-21T06:17:46.210 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T06:17:46.466 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T06:17:46.980 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-140899c8-77e1-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-140899c8-77e1-11ef-baf5-efdc52797490.target. 2024-09-21T06:17:46.980 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-140899c8-77e1-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-140899c8-77e1-11ef-baf5-efdc52797490.target. 2024-09-21T06:17:47.403 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-140899c8-77e1-11ef-baf5-efdc52797490@mon.a 2024-09-21T06:17:47.403 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Failed to reset failed state of unit ceph-140899c8-77e1-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-140899c8-77e1-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T06:17:47.571 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-140899c8-77e1-11ef-baf5-efdc52797490.target.wants/ceph-140899c8-77e1-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-140899c8-77e1-11ef-baf5-efdc52797490@.service. 2024-09-21T06:17:47.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:47 smithi063 podman[30763]: 2024-09-21 06:17:47.816943438 +0000 UTC m=+0.126438413 container create 325992acdf90753624b0332335453b58569fcc545bdc7384fa0153a7e5219eaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:17:48.126 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:17:48.126 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout disabled 2024-09-21T06:17:48.133 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:17:48.134 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2024-09-21T06:17:48.134 INFO:teuthology.orchestra.run.smithi063.stdout:firewalld.service is not enabled 2024-09-21T06:17:48.134 INFO:teuthology.orchestra.run.smithi063.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T06:17:48.134 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mon to start... 2024-09-21T06:17:48.134 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mon... 2024-09-21T06:17:48.258 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:48 smithi063 podman[30763]: 2024-09-21 06:17:48.035939859 +0000 UTC m=+0.345434782 container init 325992acdf90753624b0332335453b58569fcc545bdc7384fa0153a7e5219eaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T06:17:48.259 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:48 smithi063 podman[30763]: 2024-09-21 06:17:48.039212031 +0000 UTC m=+0.348706952 container start 325992acdf90753624b0332335453b58569fcc545bdc7384fa0153a7e5219eaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T06:17:48.259 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:48 smithi063 ceph-mon[30782]: mkfs 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:17:48.259 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:48 smithi063 ceph-mon[30782]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T06:17:48.259 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:48 smithi063 bash[30763]: 325992acdf90753624b0332335453b58569fcc545bdc7384fa0153a7e5219eaa 2024-09-21T06:17:48.259 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:48 smithi063 systemd[1]: Started Ceph mon.a for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:17:49.198 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T06:17:49.198 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout id: 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:17:49.198 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T06:17:49.198 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-21T06:17:49.198 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout services: 2024-09-21T06:17:49.198 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.566206s) 2024-09-21T06:17:49.198 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T06:17:49.198 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T06:17:49.198 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-21T06:17:49.198 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout data: 2024-09-21T06:17:49.198 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T06:17:49.199 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T06:17:49.199 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T06:17:49.199 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T06:17:49.199 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-21T06:17:49.199 INFO:teuthology.orchestra.run.smithi063.stdout:mon is available 2024-09-21T06:17:49.199 INFO:teuthology.orchestra.run.smithi063.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T06:17:49.319 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:49 smithi063 ceph-mon[30782]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T06:17:49.319 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:49 smithi063 ceph-mon[30782]: monmap epoch 1 2024-09-21T06:17:49.319 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:49 smithi063 ceph-mon[30782]: fsid 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:17:49.319 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:49 smithi063 ceph-mon[30782]: last_changed 2024-09-21T06:17:43.635151+0000 2024-09-21T06:17:49.319 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:49 smithi063 ceph-mon[30782]: created 2024-09-21T06:17:43.635151+0000 2024-09-21T06:17:49.319 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:49 smithi063 ceph-mon[30782]: min_mon_release 19 (squid) 2024-09-21T06:17:49.319 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:49 smithi063 ceph-mon[30782]: election_strategy: 1 2024-09-21T06:17:49.319 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:49 smithi063 ceph-mon[30782]: 0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-21T06:17:49.319 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:49 smithi063 ceph-mon[30782]: fsmap 2024-09-21T06:17:49.319 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:49 smithi063 ceph-mon[30782]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T06:17:49.320 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:49 smithi063 ceph-mon[30782]: mgrmap e1: no daemons active 2024-09-21T06:17:49.320 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:49 smithi063 ceph-mon[30782]: from='client.? 172.21.15.63:0/2468271812' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T06:17:50.251 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:50 smithi063 ceph-mon[30782]: from='client.? 172.21.15.63:0/219956220' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T06:17:50.251 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:50 smithi063 ceph-mon[30782]: from='client.? 172.21.15.63:0/219956220' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T06:17:50.253 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-21T06:17:50.255 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T06:17:50.255 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout fsid = 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:17:50.255 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T06:17:50.255 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.63:3300,v1:172.21.15.63:6789] 2024-09-21T06:17:50.256 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T06:17:50.256 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T06:17:50.256 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T06:17:50.256 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T06:17:50.256 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-21T06:17:50.256 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T06:17:50.256 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T06:17:50.256 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-21T06:17:50.256 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T06:17:50.256 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T06:17:50.256 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T06:17:50.256 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T06:17:50.256 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T06:17:50.256 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T06:17:50.257 INFO:teuthology.orchestra.run.smithi063.stdout:Generating new minimal ceph.conf... 2024-09-21T06:17:51.543 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:51 smithi063 ceph-mon[30782]: from='client.? 172.21.15.63:0/2038079831' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:52.028 INFO:teuthology.orchestra.run.smithi063.stdout:Restarting the monitor... 2024-09-21T06:17:52.320 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:52 smithi063 systemd[1]: Stopping Ceph mon.a for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:17:52.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:52 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-a[30778]: 2024-09-21T06:17:52.318+0000 7f8245668640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:17:52.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:52 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-a[30778]: 2024-09-21T06:17:52.318+0000 7f8245668640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T06:17:52.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:52 smithi063 podman[31024]: 2024-09-21 06:17:52.462514702 +0000 UTC m=+0.249678440 container died 325992acdf90753624b0332335453b58569fcc545bdc7384fa0153a7e5219eaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T06:17:53.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:52 smithi063 podman[31024]: 2024-09-21 06:17:52.784949983 +0000 UTC m=+0.572113713 container cleanup 325992acdf90753624b0332335453b58569fcc545bdc7384fa0153a7e5219eaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:17:53.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:52 smithi063 bash[31024]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-a 2024-09-21T06:17:53.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:52 smithi063 podman[31036]: 2024-09-21 06:17:52.952700756 +0000 UTC m=+0.482657980 container remove 325992acdf90753624b0332335453b58569fcc545bdc7384fa0153a7e5219eaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:17:53.486 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 systemd[1]: ceph-140899c8-77e1-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T06:17:53.486 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 systemd[1]: Stopped Ceph mon.a for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:17:53.486 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 systemd[1]: Starting Ceph mon.a for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:17:53.486 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 podman[31130]: 2024-09-21 06:17:53.378628214 +0000 UTC m=+0.101492653 container create 13f6aeac32a8fd76aa761015ae596974397ec340d9150b813fd1c3a7dd5cf185 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:17:53.486 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 podman[31130]: 2024-09-21 06:17:53.29315559 +0000 UTC m=+0.016020000 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:17:53.678 INFO:teuthology.orchestra.run.smithi063.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T06:17:53.801 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 podman[31130]: 2024-09-21 06:17:53.589558448 +0000 UTC m=+0.312422859 container init 13f6aeac32a8fd76aa761015ae596974397ec340d9150b813fd1c3a7dd5cf185 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T06:17:53.801 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 podman[31130]: 2024-09-21 06:17:53.592727482 +0000 UTC m=+0.315591879 container start 13f6aeac32a8fd76aa761015ae596974397ec340d9150b813fd1c3a7dd5cf185 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T06:17:53.801 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T06:17:53.801 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T06:17:53.801 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: pidfile_write: ignore empty --pid-file 2024-09-21T06:17:53.801 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: load: jerasure load: lrc 2024-09-21T06:17:53.801 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: RocksDB version: 7.9.2 2024-09-21T06:17:53.802 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Git sha 0 2024-09-21T06:17:53.802 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T06:17:53.802 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: DB SUMMARY 2024-09-21T06:17:53.802 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: DB Session ID: D5HHFZLVDTP4FZ194P9M 2024-09-21T06:17:53.802 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: CURRENT file: CURRENT 2024-09-21T06:17:53.802 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T06:17:53.802 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T06:17:53.802 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T06:17:53.802 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 94244 ; 2024-09-21T06:17:53.802 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.error_if_exists: 0 2024-09-21T06:17:53.802 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.create_if_missing: 0 2024-09-21T06:17:53.802 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.paranoid_checks: 1 2024-09-21T06:17:53.802 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T06:17:53.802 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T06:17:53.803 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T06:17:53.803 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.env: 0x5652b52e4d60 2024-09-21T06:17:53.803 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T06:17:53.803 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.info_log: 0x5652b9fc1360 2024-09-21T06:17:53.803 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T06:17:53.804 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.statistics: (nil) 2024-09-21T06:17:53.804 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.use_fsync: 0 2024-09-21T06:17:53.804 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_log_file_size: 0 2024-09-21T06:17:53.804 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T06:17:53.804 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T06:17:53.804 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T06:17:53.804 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T06:17:53.805 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.allow_fallocate: 1 2024-09-21T06:17:53.805 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T06:17:53.805 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T06:17:53.805 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.use_direct_reads: 0 2024-09-21T06:17:53.805 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T06:17:53.805 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T06:17:53.805 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.db_log_dir: 2024-09-21T06:17:53.805 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.wal_dir: 2024-09-21T06:17:53.805 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T06:17:53.805 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T06:17:53.805 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T06:17:53.805 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T06:17:53.805 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T06:17:53.805 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T06:17:53.805 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T06:17:53.805 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T06:17:53.806 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.write_buffer_manager: 0x5652b9fc5d60 2024-09-21T06:17:53.806 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T06:17:53.806 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T06:17:53.806 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T06:17:53.806 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T06:17:53.806 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T06:17:53.806 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T06:17:53.806 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T06:17:53.806 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T06:17:53.806 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.unordered_write: 0 2024-09-21T06:17:53.806 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T06:17:53.806 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T06:17:53.806 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T06:17:53.806 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T06:17:53.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.row_cache: None 2024-09-21T06:17:53.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.wal_filter: None 2024-09-21T06:17:53.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T06:17:53.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T06:17:53.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.two_write_queues: 0 2024-09-21T06:17:53.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T06:17:53.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.wal_compression: 0 2024-09-21T06:17:53.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.atomic_flush: 0 2024-09-21T06:17:53.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T06:17:53.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T06:17:53.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T06:17:53.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.log_readahead_size: 0 2024-09-21T06:17:53.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T06:17:53.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T06:17:53.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T06:17:53.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T06:17:53.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T06:17:53.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T06:17:53.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T06:17:53.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_background_jobs: 2 2024-09-21T06:17:53.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_background_compactions: -1 2024-09-21T06:17:53.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_subcompactions: 1 2024-09-21T06:17:53.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T06:17:53.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T06:17:53.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T06:17:53.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T06:17:53.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T06:17:53.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T06:17:53.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T06:17:53.809 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T06:17:53.809 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_open_files: -1 2024-09-21T06:17:53.809 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T06:17:53.809 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T06:17:53.809 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T06:17:53.809 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T06:17:53.809 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_background_flushes: -1 2024-09-21T06:17:53.809 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Compression algorithms supported: 2024-09-21T06:17:53.809 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: kZSTD supported: 0 2024-09-21T06:17:53.809 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: kXpressCompression supported: 0 2024-09-21T06:17:53.809 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: kBZip2Compression supported: 0 2024-09-21T06:17:53.809 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T06:17:53.809 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: kLZ4Compression supported: 1 2024-09-21T06:17:53.809 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: kZlibCompression supported: 1 2024-09-21T06:17:53.809 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T06:17:53.810 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: kSnappyCompression supported: 1 2024-09-21T06:17:53.810 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T06:17:53.810 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T06:17:53.810 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T06:17:53.810 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T06:17:53.810 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T06:17:53.810 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.merge_operator: 2024-09-21T06:17:53.810 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compaction_filter: None 2024-09-21T06:17:53.810 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T06:17:53.810 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T06:17:53.810 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T06:17:53.810 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T06:17:53.810 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5652b9fc0fa0) 2024-09-21T06:17:53.810 INFO:journalctl@ceph.mon.a.smithi063.stdout: cache_index_and_filter_blocks: 1 2024-09-21T06:17:53.810 INFO:journalctl@ceph.mon.a.smithi063.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T06:17:53.811 INFO:journalctl@ceph.mon.a.smithi063.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T06:17:53.811 INFO:journalctl@ceph.mon.a.smithi063.stdout: pin_top_level_index_and_filter: 1 2024-09-21T06:17:53.811 INFO:journalctl@ceph.mon.a.smithi063.stdout: index_type: 0 2024-09-21T06:17:53.811 INFO:journalctl@ceph.mon.a.smithi063.stdout: data_block_index_type: 0 2024-09-21T06:17:53.811 INFO:journalctl@ceph.mon.a.smithi063.stdout: index_shortening: 1 2024-09-21T06:17:53.811 INFO:journalctl@ceph.mon.a.smithi063.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T06:17:53.811 INFO:journalctl@ceph.mon.a.smithi063.stdout: checksum: 4 2024-09-21T06:17:53.811 INFO:journalctl@ceph.mon.a.smithi063.stdout: no_block_cache: 0 2024-09-21T06:17:53.811 INFO:journalctl@ceph.mon.a.smithi063.stdout: block_cache: 0x5652b5f85610 2024-09-21T06:17:53.811 INFO:journalctl@ceph.mon.a.smithi063.stdout: block_cache_name: BinnedLRUCache 2024-09-21T06:17:53.811 INFO:journalctl@ceph.mon.a.smithi063.stdout: block_cache_options: 2024-09-21T06:17:53.811 INFO:journalctl@ceph.mon.a.smithi063.stdout: capacity : 536870912 2024-09-21T06:17:53.811 INFO:journalctl@ceph.mon.a.smithi063.stdout: num_shard_bits : 4 2024-09-21T06:17:53.811 INFO:journalctl@ceph.mon.a.smithi063.stdout: strict_capacity_limit : 0 2024-09-21T06:17:53.812 INFO:journalctl@ceph.mon.a.smithi063.stdout: high_pri_pool_ratio: 0.000 2024-09-21T06:17:53.812 INFO:journalctl@ceph.mon.a.smithi063.stdout: block_cache_compressed: (nil) 2024-09-21T06:17:53.812 INFO:journalctl@ceph.mon.a.smithi063.stdout: persistent_cache: (nil) 2024-09-21T06:17:53.812 INFO:journalctl@ceph.mon.a.smithi063.stdout: block_size: 4096 2024-09-21T06:17:53.812 INFO:journalctl@ceph.mon.a.smithi063.stdout: block_size_deviation: 10 2024-09-21T06:17:53.812 INFO:journalctl@ceph.mon.a.smithi063.stdout: block_restart_interval: 16 2024-09-21T06:17:53.812 INFO:journalctl@ceph.mon.a.smithi063.stdout: index_block_restart_interval: 1 2024-09-21T06:17:53.812 INFO:journalctl@ceph.mon.a.smithi063.stdout: metadata_block_size: 4096 2024-09-21T06:17:53.812 INFO:journalctl@ceph.mon.a.smithi063.stdout: partition_filters: 0 2024-09-21T06:17:53.812 INFO:journalctl@ceph.mon.a.smithi063.stdout: use_delta_encoding: 1 2024-09-21T06:17:53.812 INFO:journalctl@ceph.mon.a.smithi063.stdout: filter_policy: bloomfilter 2024-09-21T06:17:53.812 INFO:journalctl@ceph.mon.a.smithi063.stdout: whole_key_filtering: 1 2024-09-21T06:17:53.812 INFO:journalctl@ceph.mon.a.smithi063.stdout: verify_compression: 0 2024-09-21T06:17:53.812 INFO:journalctl@ceph.mon.a.smithi063.stdout: read_amp_bytes_per_bit: 0 2024-09-21T06:17:53.812 INFO:journalctl@ceph.mon.a.smithi063.stdout: format_version: 5 2024-09-21T06:17:53.812 INFO:journalctl@ceph.mon.a.smithi063.stdout: enable_index_compression: 1 2024-09-21T06:17:53.813 INFO:journalctl@ceph.mon.a.smithi063.stdout: block_align: 0 2024-09-21T06:17:53.813 INFO:journalctl@ceph.mon.a.smithi063.stdout: max_auto_readahead_size: 262144 2024-09-21T06:17:53.813 INFO:journalctl@ceph.mon.a.smithi063.stdout: prepopulate_block_cache: 0 2024-09-21T06:17:53.813 INFO:journalctl@ceph.mon.a.smithi063.stdout: initial_auto_readahead_size: 8192 2024-09-21T06:17:53.813 INFO:journalctl@ceph.mon.a.smithi063.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T06:17:53.813 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T06:17:53.813 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T06:17:53.813 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compression: NoCompression 2024-09-21T06:17:53.813 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T06:17:53.813 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T06:17:53.813 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T06:17:53.813 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.num_levels: 7 2024-09-21T06:17:53.813 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T06:17:53.813 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T06:17:53.813 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T06:17:53.814 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T06:17:53.814 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T06:17:53.814 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T06:17:53.814 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T06:17:53.814 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:17:53.814 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T06:17:53.814 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T06:17:53.814 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:17:53.814 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:17:53.814 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T06:17:53.814 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T06:17:53.814 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T06:17:53.814 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T06:17:53.814 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:17:53.814 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:17:53.815 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T06:17:53.815 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T06:17:53.815 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:17:53.815 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T06:17:53.815 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T06:17:53.815 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T06:17:53.815 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T06:17:53.815 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T06:17:53.815 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T06:17:53.815 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T06:17:53.815 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T06:17:53.815 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T06:17:53.815 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T06:17:53.815 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T06:17:53.816 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T06:17:53.816 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T06:17:53.816 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T06:17:53.816 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T06:17:53.816 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T06:17:53.816 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T06:17:53.816 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T06:17:53.816 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T06:17:53.816 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T06:17:53.816 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T06:17:53.816 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T06:17:53.816 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T06:17:53.816 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T06:17:53.816 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T06:17:53.816 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T06:17:53.816 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T06:17:53.817 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T06:17:53.817 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T06:17:53.817 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T06:17:53.817 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T06:17:53.817 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T06:17:53.817 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T06:17:53.817 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.inplace_update_support: 0 2024-09-21T06:17:53.817 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T06:17:53.817 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T06:17:53.817 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T06:17:53.817 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T06:17:53.817 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.bloom_locality: 0 2024-09-21T06:17:53.817 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.max_successive_merges: 0 2024-09-21T06:17:53.817 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T06:17:53.817 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T06:17:53.817 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T06:17:53.818 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T06:17:53.818 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.ttl: 2592000 2024-09-21T06:17:53.818 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T06:17:53.818 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T06:17:53.818 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T06:17:53.818 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.enable_blob_files: false 2024-09-21T06:17:53.818 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.min_blob_size: 0 2024-09-21T06:17:53.818 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T06:17:53.818 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T06:17:53.818 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T06:17:53.818 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T06:17:53.818 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T06:17:53.818 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T06:17:53.818 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T06:17:53.818 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T06:17:53.818 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T06:17:53.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T06:17:53.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6984af2b-eca1-4a9d-be67-be734fab9ef8 2024-09-21T06:17:53.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726899473628809, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T06:17:53.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T06:17:53.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726899473630010, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 90440, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 281, "table_properties": {"data_size": 88510, "index_size": 250, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11464, "raw_average_key_size": 47, "raw_value_size": 82067, "raw_average_value_size": 341, "num_data_blocks": 11, "num_entries": 240, "num_filter_entries": 240, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726899473, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6984af2b-eca1-4a9d-be67-be734fab9ef8", "db_session_id": "D5HHFZLVDTP4FZ194P9M", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T06:17:53.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726899473630109, "job": 1, "event": "recovery_finished"} 2024-09-21T06:17:53.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T06:17:53.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T06:17:53.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5652b9fe4a80 2024-09-21T06:17:53.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: DB pointer 0x5652bad8a000 2024-09-21T06:17:53.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T06:17:53.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T06:17:53.819 INFO:journalctl@ceph.mon.a.smithi063.stdout: ** DB Stats ** 2024-09-21T06:17:53.819 INFO:journalctl@ceph.mon.a.smithi063.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:17:53.819 INFO:journalctl@ceph.mon.a.smithi063.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T06:17:53.819 INFO:journalctl@ceph.mon.a.smithi063.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:17:53.820 INFO:journalctl@ceph.mon.a.smithi063.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:17:53.820 INFO:journalctl@ceph.mon.a.smithi063.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T06:17:53.820 INFO:journalctl@ceph.mon.a.smithi063.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:17:53.820 INFO:journalctl@ceph.mon.a.smithi063.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:17:53.820 INFO:journalctl@ceph.mon.a.smithi063.stdout: 2024-09-21T06:17:53.820 INFO:journalctl@ceph.mon.a.smithi063.stdout: ** Compaction Stats [default] ** 2024-09-21T06:17:53.820 INFO:journalctl@ceph.mon.a.smithi063.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:17:53.820 INFO:journalctl@ceph.mon.a.smithi063.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T06:17:53.820 INFO:journalctl@ceph.mon.a.smithi063.stdout: L0 2/0 90.18 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 122.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:17:53.820 INFO:journalctl@ceph.mon.a.smithi063.stdout: Sum 2/0 90.18 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 122.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:17:53.820 INFO:journalctl@ceph.mon.a.smithi063.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 122.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:17:53.820 INFO:journalctl@ceph.mon.a.smithi063.stdout: 2024-09-21T06:17:53.820 INFO:journalctl@ceph.mon.a.smithi063.stdout: ** Compaction Stats [default] ** 2024-09-21T06:17:53.820 INFO:journalctl@ceph.mon.a.smithi063.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:17:53.820 INFO:journalctl@ceph.mon.a.smithi063.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T06:17:53.821 INFO:journalctl@ceph.mon.a.smithi063.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 122.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:17:53.821 INFO:journalctl@ceph.mon.a.smithi063.stdout: 2024-09-21T06:17:53.821 INFO:journalctl@ceph.mon.a.smithi063.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T06:17:53.821 INFO:journalctl@ceph.mon.a.smithi063.stdout: 2024-09-21T06:17:53.821 INFO:journalctl@ceph.mon.a.smithi063.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:17:53.821 INFO:journalctl@ceph.mon.a.smithi063.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T06:17:53.821 INFO:journalctl@ceph.mon.a.smithi063.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T06:17:53.821 INFO:journalctl@ceph.mon.a.smithi063.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T06:17:53.821 INFO:journalctl@ceph.mon.a.smithi063.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T06:17:53.821 INFO:journalctl@ceph.mon.a.smithi063.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T06:17:53.821 INFO:journalctl@ceph.mon.a.smithi063.stdout: Cumulative compaction: 0.00 GB write, 24.92 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:17:53.821 INFO:journalctl@ceph.mon.a.smithi063.stdout: Interval compaction: 0.00 GB write, 24.92 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:17:53.821 INFO:journalctl@ceph.mon.a.smithi063.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T06:17:53.821 INFO:journalctl@ceph.mon.a.smithi063.stdout: Block cache BinnedLRUCache@0x5652b5f85610#2 capacity: 512.00 MB usage: 1.28 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T06:17:53.821 INFO:journalctl@ceph.mon.a.smithi063.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2024-09-21T06:17:53.822 INFO:journalctl@ceph.mon.a.smithi063.stdout: 2024-09-21T06:17:53.822 INFO:journalctl@ceph.mon.a.smithi063.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T06:17:53.822 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: starting mon.a rank 0 at public addrs [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] at bind addrs [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:17:53.822 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: mon.a@-1(???) e1 preinit fsid 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:17:53.822 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: mon.a@-1(???).mds e1 new map 2024-09-21T06:17:53.822 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: mon.a@-1(???).mds e1 print_map 2024-09-21T06:17:53.822 INFO:journalctl@ceph.mon.a.smithi063.stdout: e1 2024-09-21T06:17:53.822 INFO:journalctl@ceph.mon.a.smithi063.stdout: btime 2024-09-21T06:17:48:089129+0000 2024-09-21T06:17:53.822 INFO:journalctl@ceph.mon.a.smithi063.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T06:17:53.822 INFO:journalctl@ceph.mon.a.smithi063.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:17:53.822 INFO:journalctl@ceph.mon.a.smithi063.stdout: legacy client fscid: -1 2024-09-21T06:17:53.822 INFO:journalctl@ceph.mon.a.smithi063.stdout: 2024-09-21T06:17:53.822 INFO:journalctl@ceph.mon.a.smithi063.stdout: No filesystems configured 2024-09-21T06:17:53.822 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T06:17:53.823 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:17:53.823 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:17:53.823 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:17:53.823 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T06:17:53.823 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 bash[31130]: 13f6aeac32a8fd76aa761015ae596974397ec340d9150b813fd1c3a7dd5cf185 2024-09-21T06:17:53.823 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 systemd[1]: Started Ceph mon.a for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:17:53.823 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T06:17:53.823 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: monmap epoch 1 2024-09-21T06:17:53.823 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: fsid 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:17:53.823 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: last_changed 2024-09-21T06:17:43.635151+0000 2024-09-21T06:17:53.823 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: created 2024-09-21T06:17:43.635151+0000 2024-09-21T06:17:53.823 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: min_mon_release 19 (squid) 2024-09-21T06:17:53.823 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: election_strategy: 1 2024-09-21T06:17:53.823 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: 0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-21T06:17:53.823 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: fsmap 2024-09-21T06:17:53.823 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T06:17:53.823 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:53 smithi063 ceph-mon[31150]: mgrmap e1: no daemons active 2024-09-21T06:17:54.842 INFO:teuthology.orchestra.run.smithi063.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T06:17:54.863 INFO:teuthology.orchestra.run.smithi063.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:17:54.863 INFO:teuthology.orchestra.run.smithi063.stdout:Creating mgr... 2024-09-21T06:17:54.864 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T06:17:54.864 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T06:17:55.135 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-140899c8-77e1-11ef-baf5-efdc52797490@mgr.x 2024-09-21T06:17:55.136 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Failed to reset failed state of unit ceph-140899c8-77e1-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-140899c8-77e1-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T06:17:55.291 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-140899c8-77e1-11ef-baf5-efdc52797490.target.wants/ceph-140899c8-77e1-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-140899c8-77e1-11ef-baf5-efdc52797490@.service. 2024-09-21T06:17:55.525 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:55 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/4132496695' entity='client.admin' 2024-09-21T06:17:55.525 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:17:55 smithi063 systemd[1]: Starting Ceph mgr.x for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:17:55.794 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:17:55 smithi063 podman[31362]: 2024-09-21 06:17:55.523871874 +0000 UTC m=+0.112138104 container create 28d97f2ee4b571056bf079edc48675b6b1f6cc84e171d40f46bc1d9a37ac8451 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T06:17:55.794 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:17:55 smithi063 podman[31362]: 2024-09-21 06:17:55.427834338 +0000 UTC m=+0.016100568 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:17:55.794 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:17:55 smithi063 podman[31362]: 2024-09-21 06:17:55.717917376 +0000 UTC m=+0.306183613 container init 28d97f2ee4b571056bf079edc48675b6b1f6cc84e171d40f46bc1d9a37ac8451 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:17:55.794 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:17:55 smithi063 podman[31362]: 2024-09-21 06:17:55.720772378 +0000 UTC m=+0.309038599 container start 28d97f2ee4b571056bf079edc48675b6b1f6cc84e171d40f46bc1d9a37ac8451 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:17:55.794 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:17:55 smithi063 bash[31362]: 28d97f2ee4b571056bf079edc48675b6b1f6cc84e171d40f46bc1d9a37ac8451 2024-09-21T06:17:55.811 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:17:55.811 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout disabled 2024-09-21T06:17:55.820 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:17:55.820 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2024-09-21T06:17:55.820 INFO:teuthology.orchestra.run.smithi063.stdout:firewalld.service is not enabled 2024-09-21T06:17:55.820 INFO:teuthology.orchestra.run.smithi063.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T06:17:55.831 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:17:55.831 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout disabled 2024-09-21T06:17:55.840 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:17:55.840 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2024-09-21T06:17:55.840 INFO:teuthology.orchestra.run.smithi063.stdout:firewalld.service is not enabled 2024-09-21T06:17:55.840 INFO:teuthology.orchestra.run.smithi063.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T06:17:55.840 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mgr to start... 2024-09-21T06:17:55.840 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mgr... 2024-09-21T06:17:56.049 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:17:55 smithi063 systemd[1]: Started Ceph mgr.x for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:17:56.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:56 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1727549715' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:17:56.889 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-21T06:17:56.889 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:17:56.889 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsid": "140899c8-77e1-11ef-baf5-efdc52797490", 2024-09-21T06:17:56.889 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:17:56.889 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:17:56.889 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:17:56.890 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:17:56.890 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:17:56.890 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:17:56.890 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:17:56.890 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:17:56.890 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:17:56.890 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:17:56.890 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:17:56.890 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:17:56.890 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T06:17:56.890 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:17:56.890 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:17:56.890 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:17:56.890 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:17:56.891 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:17:56.891 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:17:56.891 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:17:56.891 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:17:56.891 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:17:56.891 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:17:56.891 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:17:56.891 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:17:56.891 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:17:56.894 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:17:56.894 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:17:56.894 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:17:56.894 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:17:56.894 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:17:56.894 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:17:56.894 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:17:56.894 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:17:56.895 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:17:56.895 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:17:56.895 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:17:56.895 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:17:56.895 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:17:56.895 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:17:48:089129+0000", 2024-09-21T06:17:56.895 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:17:56.895 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:17:56.895 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:17:56.895 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:17:56.895 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T06:17:56.895 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:17:56.895 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:17:56.895 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:17:56.895 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:17:56.895 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:17:56.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:17:56.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:17:56.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:17:56.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:17:56.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:17:56.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:17:48.089991+0000", 2024-09-21T06:17:56.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:17:56.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:17:56.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:17:56.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:17:56.896 INFO:teuthology.orchestra.run.smithi063.stdout:mgr not available, waiting (1/15)... 2024-09-21T06:17:59.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:17:59 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3817975724' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:17:59.946 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-21T06:17:59.946 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:17:59.946 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsid": "140899c8-77e1-11ef-baf5-efdc52797490", 2024-09-21T06:17:59.946 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:17:59.946 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:17:59.946 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:17:59.946 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:17:59.946 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:17:59.946 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:17:59.946 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:17:59.946 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:17:59.946 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:17:59.947 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:17:59.947 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:17:59.947 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:17:59.947 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-21T06:17:59.947 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:17:59.947 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:17:59.947 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:17:59.947 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:17:59.947 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:17:59.947 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:17:59.947 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:17:59.948 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:17:59.948 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:17:59.948 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:17:59.948 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:17:59.948 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:17:59.948 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:17:59.951 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:17:59.951 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:17:59.951 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:17:59.951 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:17:59.951 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:17:59.952 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:17:59.952 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:17:59.952 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:17:59.952 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:17:59.952 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:17:59.952 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:17:59.952 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:17:59.952 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:17:59.952 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:17:48:089129+0000", 2024-09-21T06:17:59.952 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:17:59.952 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:17:59.952 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:17:59.952 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:17:59.952 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T06:17:59.953 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:17:59.953 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:17:59.953 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:17:59.953 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:17:59.953 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:17:59.953 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:17:59.953 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:17:59.953 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:17:59.953 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:17:59.953 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:17:59.953 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:17:48.089991+0000", 2024-09-21T06:17:59.953 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:17:59.953 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:17:59.953 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:17:59.954 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:17:59.954 INFO:teuthology.orchestra.run.smithi063.stdout:mgr not available, waiting (2/15)... 2024-09-21T06:18:01.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:01 smithi063 ceph-mon[31150]: Activating manager daemon x 2024-09-21T06:18:01.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:01 smithi063 ceph-mon[31150]: mgrmap e2: x(active, starting, since 0.00348742s) 2024-09-21T06:18:01.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:01 smithi063 ceph-mon[31150]: from='mgr.14100 172.21.15.63:0/1277816621' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:18:01.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:01 smithi063 ceph-mon[31150]: from='mgr.14100 172.21.15.63:0/1277816621' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:18:01.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:01 smithi063 ceph-mon[31150]: from='mgr.14100 172.21.15.63:0/1277816621' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:18:01.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:01 smithi063 ceph-mon[31150]: from='mgr.14100 172.21.15.63:0/1277816621' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:18:01.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:01 smithi063 ceph-mon[31150]: from='mgr.14100 172.21.15.63:0/1277816621' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:18:01.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:01 smithi063 ceph-mon[31150]: Manager daemon x is now available 2024-09-21T06:18:01.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:01 smithi063 ceph-mon[31150]: from='mgr.14100 172.21.15.63:0/1277816621' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:18:01.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:01 smithi063 ceph-mon[31150]: from='mgr.14100 172.21.15.63:0/1277816621' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:18:01.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:01 smithi063 ceph-mon[31150]: from='mgr.14100 172.21.15.63:0/1277816621' entity='mgr.x' 2024-09-21T06:18:01.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:01 smithi063 ceph-mon[31150]: from='mgr.14100 172.21.15.63:0/1277816621' entity='mgr.x' 2024-09-21T06:18:01.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:01 smithi063 ceph-mon[31150]: from='mgr.14100 172.21.15.63:0/1277816621' entity='mgr.x' 2024-09-21T06:18:03.230 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-21T06:18:03.230 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:18:03.230 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsid": "140899c8-77e1-11ef-baf5-efdc52797490", 2024-09-21T06:18:03.230 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:18:03.231 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:18:03.231 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:18:03.231 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:18:03.231 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:18:03.231 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:18:03.231 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:18:03.231 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:18:03.231 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:18:03.231 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:18:03.231 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:18:03.231 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:18:03.231 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-21T06:18:03.231 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:18:03.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:18:03.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:18:03.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:18:03.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:18:03.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:18:03.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:18:03.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:18:03.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:18:03.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:18:03.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:18:03.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:18:03.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:18:03.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:18:03.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:18:03.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:18:03.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:18:03.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:18:03.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:18:03.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:18:03.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:18:03.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:18:03.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:18:03.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:18:03.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:18:03.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:18:03.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:17:48:089129+0000", 2024-09-21T06:18:03.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:18:03.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:18:03.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:18:03.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:18:03.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:18:03.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:18:03.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:18:03.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:18:03.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:18:03.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:18:03.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:18:03.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:18:03.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:18:03.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:18:03.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:18:03.235 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:17:48.089991+0000", 2024-09-21T06:18:03.235 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:18:03.235 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:18:03.235 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:18:03.235 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:18:03.235 INFO:teuthology.orchestra.run.smithi063.stdout:mgr is available 2024-09-21T06:18:03.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:03 smithi063 ceph-mon[31150]: mgrmap e3: x(active, since 1.00754s) 2024-09-21T06:18:03.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:03 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1989192968' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:18:04.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:04 smithi063 ceph-mon[31150]: mgrmap e4: x(active, since 2s) 2024-09-21T06:18:04.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:04 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3600929970' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T06:18:04.351 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-21T06:18:04.351 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T06:18:04.351 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout fsid = 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:18:04.351 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T06:18:04.351 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.63:3300,v1:172.21.15.63:6789] 2024-09-21T06:18:04.351 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T06:18:04.351 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T06:18:04.351 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T06:18:04.351 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T06:18:04.351 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-21T06:18:04.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T06:18:04.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T06:18:04.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-21T06:18:04.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T06:18:04.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T06:18:04.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T06:18:04.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T06:18:04.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T06:18:04.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T06:18:04.352 INFO:teuthology.orchestra.run.smithi063.stdout:Enabling cephadm module... 2024-09-21T06:18:05.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:05 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/156840297' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T06:18:05.333 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:05 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: ignoring --setuser ceph since I am not root 2024-09-21T06:18:05.333 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:05 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: ignoring --setgroup ceph since I am not root 2024-09-21T06:18:06.270 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:06 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/156840297' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T06:18:06.271 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:06 smithi063 ceph-mon[31150]: mgrmap e5: x(active, since 4s) 2024-09-21T06:18:06.846 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:18:06.846 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T06:18:06.846 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:18:06.846 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T06:18:06.846 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T06:18:06.846 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:18:06.846 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for the mgr to restart... 2024-09-21T06:18:06.846 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mgr epoch 5... 2024-09-21T06:18:07.153 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:07 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1004371772' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T06:18:10.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:10 smithi063 ceph-mon[31150]: Active manager daemon x restarted 2024-09-21T06:18:10.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:10 smithi063 ceph-mon[31150]: Activating manager daemon x 2024-09-21T06:18:10.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:10 smithi063 ceph-mon[31150]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T06:18:10.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:10 smithi063 ceph-mon[31150]: mgrmap e6: x(active, starting, since 0.00374476s) 2024-09-21T06:18:10.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:10 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:18:10.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:10 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:18:10.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:10 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:18:10.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:10 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:18:10.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:10 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:18:10.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:10 smithi063 ceph-mon[31150]: Manager daemon x is now available 2024-09-21T06:18:11.867 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:18:11.868 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T06:18:11.868 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T06:18:11.868 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:18:11.868 INFO:teuthology.orchestra.run.smithi063.stdout:mgr epoch 5 is available 2024-09-21T06:18:11.868 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying orchestrator module is enabled... 2024-09-21T06:18:12.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-mon[31150]: mgrmap e7: x(active, since 1.00611s) 2024-09-21T06:18:12.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' 2024-09-21T06:18:12.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' 2024-09-21T06:18:12.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-mon[31150]: Found migration_current of "None". Setting to last migration. 2024-09-21T06:18:12.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' 2024-09-21T06:18:12.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' 2024-09-21T06:18:12.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:18:12.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:18:12.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:18:12.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:18:13.333 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: 2024-09-21T06:18:12.873+0000 7f6a78893640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:06:18:12] ENGINE Error in HTTPServer.serve 2024-09-21T06:18:13.333 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: Traceback (most recent call last): 2024-09-21T06:18:13.333 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:18:13.333 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: self._connections.run(self.expiration_interval) 2024-09-21T06:18:13.333 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:18:13.333 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: self._run(expiration_interval) 2024-09-21T06:18:13.333 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:18:13.333 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:18:13.333 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:18:13.333 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:18:13.333 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:18:13.334 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: s = self.context.wrap_socket( 2024-09-21T06:18:13.334 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:18:13.334 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: return self.sslsocket_class._create( 2024-09-21T06:18:13.334 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:18:13.334 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: self.do_handshake() 2024-09-21T06:18:13.334 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:18:13.334 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: self._sslobj.do_handshake() 2024-09-21T06:18:13.334 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:18:13.334 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:12 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: 2024-09-21T06:18:13.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:13 smithi063 ceph-mon[31150]: mgrmap e8: x(active, since 2s) 2024-09-21T06:18:13.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:13 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1063366158' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T06:18:13.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:13 smithi063 ceph-mon[31150]: [21/Sep/2024:06:18:12] ENGINE Bus STARTING 2024-09-21T06:18:13.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:13 smithi063 ceph-mon[31150]: [21/Sep/2024:06:18:12] ENGINE Serving on https://172.21.15.63:7150 2024-09-21T06:18:13.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:13 smithi063 ceph-mon[31150]: [21/Sep/2024:06:18:12] ENGINE Error in HTTPServer.serve 2024-09-21T06:18:13.833 INFO:journalctl@ceph.mon.a.smithi063.stdout: Traceback (most recent call last): 2024-09-21T06:18:13.833 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:18:13.833 INFO:journalctl@ceph.mon.a.smithi063.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:18:13.833 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:18:13.833 INFO:journalctl@ceph.mon.a.smithi063.stdout: self._run(expiration_interval) 2024-09-21T06:18:13.833 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:18:13.833 INFO:journalctl@ceph.mon.a.smithi063.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:18:13.833 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:18:13.833 INFO:journalctl@ceph.mon.a.smithi063.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:18:13.833 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:18:13.833 INFO:journalctl@ceph.mon.a.smithi063.stdout: s = self.context.wrap_socket( 2024-09-21T06:18:13.833 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:18:13.833 INFO:journalctl@ceph.mon.a.smithi063.stdout: return self.sslsocket_class._create( 2024-09-21T06:18:13.833 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:18:13.834 INFO:journalctl@ceph.mon.a.smithi063.stdout: self.do_handshake() 2024-09-21T06:18:13.834 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:18:13.834 INFO:journalctl@ceph.mon.a.smithi063.stdout: self._sslobj.do_handshake() 2024-09-21T06:18:13.834 INFO:journalctl@ceph.mon.a.smithi063.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:18:13.834 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:13 smithi063 ceph-mon[31150]: [21/Sep/2024:06:18:12] ENGINE Serving on http://172.21.15.63:8765 2024-09-21T06:18:13.834 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:13 smithi063 ceph-mon[31150]: [21/Sep/2024:06:18:12] ENGINE Bus STARTED 2024-09-21T06:18:13.834 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:13 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:18:14.116 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T06:18:14.116 INFO:teuthology.orchestra.run.smithi063.stdout:Setting orchestrator backend to cephadm... 2024-09-21T06:18:14.828 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:14 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1063366158' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T06:18:14.828 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:14 smithi063 ceph-mon[31150]: mgrmap e9: x(active, since 3s) 2024-09-21T06:18:15.993 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:15 smithi063 ceph-mon[31150]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:15.993 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:15 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' 2024-09-21T06:18:15.993 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:15 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:18:16.536 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T06:18:16.536 INFO:teuthology.orchestra.run.smithi063.stdout:Generating ssh key... 2024-09-21T06:18:16.919 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:16 smithi063 ceph-mon[31150]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:17.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: Generating public/private rsa key pair. 2024-09-21T06:18:17.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: Your identification has been saved in /tmp/tmp8pe3uufl/key 2024-09-21T06:18:17.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: Your public key has been saved in /tmp/tmp8pe3uufl/key.pub 2024-09-21T06:18:17.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: The key fingerprint is: 2024-09-21T06:18:17.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: SHA256:+AXiqWWL1tgTOQ8evVTg32GS8kwScrHUV9yOG3i6VQY ceph-140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:18:17.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: The key's randomart image is: 2024-09-21T06:18:17.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: +---[RSA 3072]----+ 2024-09-21T06:18:17.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: | . *o o.. | 2024-09-21T06:18:17.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: | = +... E .| 2024-09-21T06:18:17.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: | . * =.o. + | 2024-09-21T06:18:17.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: | . * X +..+ +| 2024-09-21T06:18:17.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: | % S = .o = | 2024-09-21T06:18:17.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: | X X o . o | 2024-09-21T06:18:17.584 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: | = * + o | 2024-09-21T06:18:17.584 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: | . . . | 2024-09-21T06:18:17.584 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: | | 2024-09-21T06:18:17.584 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: +----[SHA256]-----+ 2024-09-21T06:18:18.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:18 smithi063 ceph-mon[31150]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:18.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:18 smithi063 ceph-mon[31150]: Generating ssh key... 2024-09-21T06:18:18.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:18 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' 2024-09-21T06:18:18.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:18 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' 2024-09-21T06:18:19.122 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxZR3f2JAfZAwHntsLR7eCIlvWWH2RhHuWf0NfCKn+W9xihH4lXvDYerfguIsmeeE6hsAOjYyqdIojOFJOk3LggTAe4ZWIpRrZUZ6DYQ2UVsO2JA7a0i1ALWC0xaQkcoGxye28l0AGs0THa+CmtTbu4ZRB2AMNZgHk3maOxniH3QHZ5mCPsvPUNID4SQwpxxjco5MITeJI0T37qBBlumhI3YUVur30h1wyCHlE0oxbc+OS9UfUV6jOW+wZvG9iZ+yElJSCyqmY9F88NO8PNKEP8PSgbVie9WclApxmdnqvgui5suG6ttV4R4maC4NwN2pPxfb3ls6fxvLXoc7XT4zja0Ai+V1TNkt2dDjuZJRtnSfUoyMYqLg9Wtf4jzDi9baa2FvGfWS+F/UjNgGNkB5BwPqJl46zyioIkf3oWkkIZhIpCUxYRn2ISIk6DFXvP28ooF4QoVviVF6lCCBYDqrf1GYEbU9xrTVlXvgQ0TqA0tjGX5e9ZKkUMmoonP17wns= ceph-140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:18:19.123 INFO:teuthology.orchestra.run.smithi063.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:18:19.123 INFO:teuthology.orchestra.run.smithi063.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T06:18:19.129 INFO:teuthology.orchestra.run.smithi063.stdout:Adding host smithi063... 2024-09-21T06:18:19.422 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:19 smithi063 ceph-mon[31150]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:20.420 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:20 smithi063 ceph-mon[31150]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi063", "addr": "172.21.15.63", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:21.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:21 smithi063 ceph-mon[31150]: Deploying cephadm binary to smithi063 2024-09-21T06:18:24.248 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Added host 'smithi063' with addr '172.21.15.63' 2024-09-21T06:18:24.248 INFO:teuthology.orchestra.run.smithi063.stdout:Deploying unmanaged mon service... 2024-09-21T06:18:24.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:24 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' 2024-09-21T06:18:24.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:24 smithi063 ceph-mon[31150]: Added host smithi063 2024-09-21T06:18:24.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:24 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:18:26.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:25 smithi063 ceph-mon[31150]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:26.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:25 smithi063 ceph-mon[31150]: Saving service mon spec with placement count:5 2024-09-21T06:18:26.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:25 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' 2024-09-21T06:18:26.294 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T06:18:26.294 INFO:teuthology.orchestra.run.smithi063.stdout:Deploying unmanaged mgr service... 2024-09-21T06:18:26.953 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:26 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' 2024-09-21T06:18:26.953 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:26 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' 2024-09-21T06:18:27.550 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T06:18:28.201 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:27 smithi063 ceph-mon[31150]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:28.201 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:27 smithi063 ceph-mon[31150]: Saving service mgr spec with placement count:2 2024-09-21T06:18:28.201 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:27 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' 2024-09-21T06:18:29.451 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:29 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/4052136886' entity='client.admin' 2024-09-21T06:18:30.298 INFO:teuthology.orchestra.run.smithi063.stdout:Enabling the dashboard module... 2024-09-21T06:18:30.547 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:30 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' 2024-09-21T06:18:30.548 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:30 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3630936904' entity='client.admin' 2024-09-21T06:18:30.548 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:30 smithi063 ceph-mon[31150]: from='mgr.14118 172.21.15.63:0/2554006658' entity='mgr.x' 2024-09-21T06:18:31.813 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:31 smithi063 ceph-mon[31150]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:18:31.814 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:31 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/920280858' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T06:18:31.814 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:31 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: ignoring --setuser ceph since I am not root 2024-09-21T06:18:31.814 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:31 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: ignoring --setgroup ceph since I am not root 2024-09-21T06:18:32.778 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:32 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/920280858' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T06:18:32.778 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:32 smithi063 ceph-mon[31150]: mgrmap e10: x(active, since 21s) 2024-09-21T06:18:33.722 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:33 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1739764572' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T06:18:33.726 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:18:33.726 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 10, 2024-09-21T06:18:33.726 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:18:33.726 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T06:18:33.726 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T06:18:33.726 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:18:33.726 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for the mgr to restart... 2024-09-21T06:18:33.726 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mgr epoch 10... 2024-09-21T06:18:37.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:36 smithi063 ceph-mon[31150]: Active manager daemon x restarted 2024-09-21T06:18:37.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:36 smithi063 ceph-mon[31150]: Activating manager daemon x 2024-09-21T06:18:37.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:36 smithi063 ceph-mon[31150]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T06:18:37.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:36 smithi063 ceph-mon[31150]: mgrmap e11: x(active, starting, since 0.00389261s) 2024-09-21T06:18:37.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:36 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:18:37.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:36 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:18:37.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:36 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:18:37.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:36 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:18:37.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:36 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:18:37.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:36 smithi063 ceph-mon[31150]: Manager daemon x is now available 2024-09-21T06:18:38.254 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:37 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:18:38.254 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:37 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:18:38.254 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:37 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:18:38.254 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:37 smithi063 ceph-mon[31150]: mgrmap e12: x(active, since 1.0071s) 2024-09-21T06:18:38.582 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: 2024-09-21T06:18:38.319+0000 7f34b4c1e640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:06:18:38] ENGINE Error in HTTPServer.serve 2024-09-21T06:18:38.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: Traceback (most recent call last): 2024-09-21T06:18:38.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:18:38.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: self._connections.run(self.expiration_interval) 2024-09-21T06:18:38.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:18:38.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: self._run(expiration_interval) 2024-09-21T06:18:38.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:18:38.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:18:38.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:18:38.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:18:38.583 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:18:38.584 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: s = self.context.wrap_socket( 2024-09-21T06:18:38.584 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:18:38.584 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: return self.sslsocket_class._create( 2024-09-21T06:18:38.584 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:18:38.584 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: self.do_handshake() 2024-09-21T06:18:38.584 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:18:38.584 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: self._sslobj.do_handshake() 2024-09-21T06:18:38.584 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:18:38.584 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: 2024-09-21T06:18:39.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-mon[31150]: [21/Sep/2024:06:18:38] ENGINE Bus STARTING 2024-09-21T06:18:39.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-mon[31150]: [21/Sep/2024:06:18:38] ENGINE Serving on https://172.21.15.63:7150 2024-09-21T06:18:39.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-mon[31150]: [21/Sep/2024:06:18:38] ENGINE Error in HTTPServer.serve 2024-09-21T06:18:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout: Traceback (most recent call last): 2024-09-21T06:18:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:18:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:18:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:18:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout: self._run(expiration_interval) 2024-09-21T06:18:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:18:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:18:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:18:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:18:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:18:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout: s = self.context.wrap_socket( 2024-09-21T06:18:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:18:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout: return self.sslsocket_class._create( 2024-09-21T06:18:39.084 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:18:39.084 INFO:journalctl@ceph.mon.a.smithi063.stdout: self.do_handshake() 2024-09-21T06:18:39.084 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:18:39.084 INFO:journalctl@ceph.mon.a.smithi063.stdout: self._sslobj.do_handshake() 2024-09-21T06:18:39.084 INFO:journalctl@ceph.mon.a.smithi063.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:18:39.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-mon[31150]: [21/Sep/2024:06:18:38] ENGINE Serving on http://172.21.15.63:8765 2024-09-21T06:18:39.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-mon[31150]: [21/Sep/2024:06:18:38] ENGINE Bus STARTED 2024-09-21T06:18:39.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:38 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:18:39.085 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:18:39.086 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 12, 2024-09-21T06:18:39.086 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T06:18:39.086 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:18:39.087 INFO:teuthology.orchestra.run.smithi063.stdout:mgr epoch 10 is available 2024-09-21T06:18:39.087 INFO:teuthology.orchestra.run.smithi063.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T06:18:40.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:40 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:18:40.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:40 smithi063 ceph-mon[31150]: mgrmap e13: x(active, since 2s) 2024-09-21T06:18:41.347 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIFEDCCAvigAwIBAgIUCfQciXk/TU3+EDCtXAwEE4cMFz4wDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTA2MTg0MFoXDTM0\nMDkyMjA2MTg0MFowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjYzMIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAz0rfXEHpG+ZdynqF/sE5iC5RUyl3/ArbygWb\nksM6y1tpNlVJdtSiub9Tx7YQ4MuZ22c9AXnhWflT7G7pgIT7X+tVMPqb2FUgiUo3\n50CIrIAEAWvMVhmHndCGZcyz95ec/BAFM/XyhtHlJzgCBsRN2V0qrRPe/NHcfM8V\ngN+m+Dmg9/v+TRV6ZZ4JBfwfZfxb86+k2wK2hY25XQNtpMGF4hSt9De9F5uyYA1h\nNG09fJKnXGMyCoNDvaSQfBxfImWeoAHVOPVH0liHoJRULApn9ZZ3wrub4rZh1I6a\nlkbNwh+yT8tF2t+Np+n9uBslxoDHjth6ATzlN2XGX80bxj1o8/GwxqB4UdVCqL+u\nFaTDD5mIua5AOxq8OmZnxWBcF66B2/CR04cJ5DTZB5EswPheZFGA+BL/z7kHe5WL\n7YP0+IoeWP1gn+ZiMRu0k+CJ3xyQ0n7wRr/CljOY8GF9vs3LpTWOxsNBOVITsgM4\nyKLMrMwZKjXa0vESItucFiKnVb4fXdw73oEmA/GpwnZPw14O3G3dvkMOvxAuClr3\n54mDoYedQ599uWje/cvy0fxGD0APkU1LU/WlG8hi+s4ZPL/OKqGyaCsRhOI6V1Iy\nXNkNZbYhIegvrnHdCV5FRuWARym7QG+PaGCV0KRBLKrtUvn+PQaQ6SUpB958hrUl\nqKtzgm0CAwEAAaNUMFIwQgYDVR0RBDswOYIec21pdGhpMDYzLmZyb250LnNlcGlh\nLmNlcGguY29tghFkYXNoYm9hcmRfc2VydmVyc4cErBUPPzAMBgNVHRMBAf8EAjAA\nMA0GCSqGSIb3DQEBCwUAA4ICAQCwx4SbYDP+fHPldzlTB9KOwouKVZqc28Z86p59\nEoKjpjz4W3j+0TvzzhUESvgEIhtV4LD4EVRTMmECNiqXsnUCSo8Kb9brLnbUuGgm\nPD8bKiVP7QfanHPSB+5WdHDhJW4uH3r+UfnJuihBwjyHGhaphVrcQDz12A5Fl91x\nNgwvJgix2QXup8TLOumMoIPtbCAmKyP1Ua2Y0ev2+t2Ebu2Ki4SA2KeU8gFK55Ax\nayUWTktofXBb4/i1Xvgcb1taqGp68lywudOJplEnsYV2UvbO4T3j2iM8Gr7LKFfS\nb7A0lt6nzmaGiKVpqNBmKxrjTkY1+ANIRTUhBs+PMxkrfxv1hXQyVaIQldVB8D0o\nnowJUlZ54sndCBIIoPOcDp4NKLvEBT4NgDG781GQkUg/ihhX9bnzGafSMgx8TyRh\npyzylTf8uCa8+GzDh9HBavdh03BoE20y9SQSWilCaVzvn6MnlQ1d+06JnBCBCDqv\nUKmbg3r/l+yj50bY2vWHzgoYFVoeSZ27NOzugzTPQKZinhyr4OzXxqOv+e8pRrZh\n4R+Caj7qYcdOqs4hqUuNob694z3paB+z2raFQThP8PvLnV9kCJo0Ds/r1NIvqYkh\n4U5mUVR5MouN78Zexi/YDNFOw9vzvO3z+FUog6ra6pzfMvXj9wCGXgR1oI8DKlmJ\ngn2M5Q==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEAz0rfXEHpG+ZdynqF/sE5iC5RUyl3/ArbygWbksM6y1tpNlVJ\ndtSiub9Tx7YQ4MuZ22c9AXnhWflT7G7pgIT7X+tVMPqb2FUgiUo350CIrIAEAWvM\nVhmHndCGZcyz95ec/BAFM/XyhtHlJzgCBsRN2V0qrRPe/NHcfM8VgN+m+Dmg9/v+\nTRV6ZZ4JBfwfZfxb86+k2wK2hY25XQNtpMGF4hSt9De9F5uyYA1hNG09fJKnXGMy\nCoNDvaSQfBxfImWeoAHVOPVH0liHoJRULApn9ZZ3wrub4rZh1I6alkbNwh+yT8tF\n2t+Np+n9uBslxoDHjth6ATzlN2XGX80bxj1o8/GwxqB4UdVCqL+uFaTDD5mIua5A\nOxq8OmZnxWBcF66B2/CR04cJ5DTZB5EswPheZFGA+BL/z7kHe5WL7YP0+IoeWP1g\nn+ZiMRu0k+CJ3xyQ0n7wRr/CljOY8GF9vs3LpTWOxsNBOVITsgM4yKLMrMwZKjXa\n0vESItucFiKnVb4fXdw73oEmA/GpwnZPw14O3G3dvkMOvxAuClr354mDoYedQ599\nuWje/cvy0fxGD0APkU1LU/WlG8hi+s4ZPL/OKqGyaCsRhOI6V1IyXNkNZbYhIegv\nrnHdCV5FRuWARym7QG+PaGCV0KRBLKrtUvn+PQaQ6SUpB958hrUlqKtzgm0CAwEA\nAQKCAgAEuBulqgp4jCIOfgOW7Sc2JnfLgOIuZsDiNIZ6LN+lyYr3pbFqdyTNPcHW\nhhqUQ45ZJFyLMA8lUTvL4iqGtoBSirUBzHLH1ghLl9j19s4lvzRYI/Ae9a3Ute6Z\nWrOuK1Fzm5nCuRKwZw7kea3yIX30ON7D2fP1pYFzhfNjX7QZapZzjtUXRCnpLlPe\nQwMj+z7MqW8DXWhyWeuiZnWUjqNRpk7fhHVVmEHTVfqkiugfcedFfyygeKSOKLTx\nXmP8EHwwAFquVUcxTrqnuTjBV+tN+AL59/Nwkd5gTG7QhQQiKz6P+ny4ouZCsF0K\nV/PgNQZWBi+g35YIUNTXUYAUX0mIWas0aEdZ1n1tkHYJt6poWlTI6b9tFIc1MgO1\nM68tTBiMkvpVbqEM4DPX5OQwvruuxmc1IgBKn3lcE/xat8LlekY3N6SuRFxsVLO1\n4b/+MrwYhCNkSva95RiL8hUdyLHh3bpCii7i6KhLws2dSUZryOlbVBtLxLiwPS7W\ndg7Ix/HU4OvwwPFK0aePedsb5SmNBJy4Xw0GWFfvRjmGbJQH/FaShGzM9DB99gve\nTN9W+d5mVG8Z/9fWmSJwNAj3TcCVckb+ah5U+Xh4aDurCKlgeyWW/pWWdFsqBDJA\nczFw43vnVYPrFWzsThpfc1uUfxnOMPiKmhwq3TKCBfBtEksKMQKCAQEA/RSEmk+c\nZoVGknBAuDnFGrWiLTG2BaZNv3Ef6bO7n3S7ZozeZ6f7v8Yxqt9EYg8vX1BZreWt\nkPGeJoASKcwp6zEge3tO51xxzz/es2ZYJvEi07+4GIZ8yEN0mD15PYmTU34pVrqM\nKZxtIP4NtMFcPeH58CeWHxo+NkMQAmowa+NheRlTq1XMIdSNBbFKCfXzVFlAyylt\nvOW6X3K2EOFjWR0dfg0iTfAWDbU4vAXRmEwEweNzsuHa/P0Q9BS7c9lWauvhRWPq\ne45LgYG6ZIb4lSAghEAsMxuV9a862GhIQsDwnxWJn6IAO5/5e/ZRvdnvGYAA5xCy\nnHTL2QOXtDbAfwKCAQEA0a8ebHaWO2Qm1BZWWPRa1ypikMi3MSz2vMVdgOM3HzTR\nsVPQlQE4iumjq/NMCulfI/OdgE+PUqQC827pDxKhzwWsLX6501J/RvVLOzrfBxMe\nIJFBYWUhrtyC4naDtWCD4Vtg83zhZa954q4EjrHpCN9MKRxEXeaR9y3YrLjiR327\nZm0QhHnIHwncqSQB3G2kGIhwd6f+uzaIk79rcrjLgGvBaZ8GHs2XsZKkypuMYCZY\nlXR/q3SXyoivxpmNLyZhyvJVSnCs9z05raykdSQV4CJEntwdBYNGOH9JkppiQs9G\npg1T4pTN1JwhCsF/DyK1xXn9EFKA8t3/angG5ABHEwKCAQAV5T6LszOO0x0F8lxH\nFAhvhSNg0Zoz5u13EKx4Jaqn4wuLlchwI2JudxE4/VQHP9UTY/o+R0666YyLPC1W\nHGnMBVYQGNz8u0zFZ3s2/jXGOLqQo1ekF46YLO3bdgYVQt/SK2ocLMuPlg8C+bfp\n2YjHedOL6YDddAHJ5Adwjgteai+2sHBCtIuSqbcBtRL4xaSluYsXiKAL5bw4Ic6K\nq1VTEmfIzg4XvBvMV89uxPobOQh4VdtesJenp6Vd2KVXIoiNe5bjz/8rbWYu8DBW\nHi9Hh54Ikxy/1zUkKmLm8i6+R78JpG1huDxY7EBDb04nJMHA7Qgm9ZTeYGR6hAsN\n9ma1AoIBAH03x8Jb+xFSmMF06XHL0ufFXwE5a/TI9jv63QDYL5XKNCNieyBQj1Sd\ne+l2rIWjofZVSExUtrFSUpTPOgyPQuPfblfo4s3o6SsV1yxy1rdh2k72j4W7ICdN\ndjgJMFRDY95TdI1TmULhTLdq1jvk0NZEizXNtKIizC5BSbCz5CVvV1cucHu8Qh8P\nA6BaaWYab7Fa4VcDkuJ4CY259U+YPabeMq2BkuUYP6uCeDiqNWVB4Qq3fHqGcRM5\nF0dRcXejwyiwGPEQYqpu/J/Tho6R0yJ7NGFt70LYhzm8AdKzsVRWdck6EkswM87w\nwearcNY4Ezbvx4lUy769hgct0GeeJtMCggEBAM5UNQneildqsCWqHzvPKMGXj6Hz\nemZ3o+EQMOsMj3b2otTeea8aGIJY6praTLS/UcZF0TrMenjCI2HagRiX4RqDD9dj\nVRSLdnwzG6xhGsFsxm3BysxgqR4thEUzuZPSMKdHgzgwe0A9NK2Y3McvOEN5OTtR\ntmfLvBaj/zYkc/5oJ7/FyW+goQ4QlHVNW4xGW+0kbV6mSzqXffgiSFvOYO5JZTSJ\nWryrPQ22QR66IQyP7j4yEOiPWnHK6w9scsqDBezw7zgZmbtT86Hbeh+HGMNxcUqo\nICyJJaeKmSPVjwLHF+KYqFq2KbgCvgfAuoTAH6xWZ5JEG2F1gfcTY584R7I=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T06:18:41.647 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:41 smithi063 ceph-mon[31150]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:42.528 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T06:18:43.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:42 smithi063 ceph-mon[31150]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:43.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:42 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:18:43.760 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T06:18:43.760 INFO:teuthology.orchestra.run.smithi063.stdout:Creating initial admin user... 2024-09-21T06:18:44.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:44 smithi063 ceph-mon[31150]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:44.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:44 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:18:45.199 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$ST2YzoCvjEumBPxXh42W/.tP0cOCb7lh1AJA4V1y9Uup4.GiCFtR2", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726899524, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T06:18:45.199 INFO:teuthology.orchestra.run.smithi063.stdout:Fetching dashboard port number... 2024-09-21T06:18:45.789 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:45 smithi063 ceph-mon[31150]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:45.789 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:45 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:18:46.321 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T06:18:46.332 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:18:46.332 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout disabled 2024-09-21T06:18:46.340 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:18:46.340 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2024-09-21T06:18:46.340 INFO:teuthology.orchestra.run.smithi063.stdout:firewalld.service is not enabled 2024-09-21T06:18:46.340 INFO:teuthology.orchestra.run.smithi063.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T06:18:46.342 INFO:teuthology.orchestra.run.smithi063.stdout:Ceph Dashboard is now available at: 2024-09-21T06:18:46.342 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:18:46.342 INFO:teuthology.orchestra.run.smithi063.stdout: URL: https://smithi063.front.sepia.ceph.com:8443/ 2024-09-21T06:18:46.342 INFO:teuthology.orchestra.run.smithi063.stdout: User: admin 2024-09-21T06:18:46.343 INFO:teuthology.orchestra.run.smithi063.stdout: Password: fpbnu4pbvi 2024-09-21T06:18:46.343 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:18:46.343 INFO:teuthology.orchestra.run.smithi063.stdout:Saving cluster configuration to /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config directory 2024-09-21T06:18:46.730 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:46 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1927834842' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T06:18:47.645 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T06:18:47.645 INFO:teuthology.orchestra.run.smithi063.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T06:18:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:18:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:18:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:18:47.645 INFO:teuthology.orchestra.run.smithi063.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T06:18:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:18:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T06:18:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:18:47.645 INFO:teuthology.orchestra.run.smithi063.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T06:18:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:18:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: ceph telemetry on 2024-09-21T06:18:47.646 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:18:47.646 INFO:teuthology.orchestra.run.smithi063.stdout:For more information see: 2024-09-21T06:18:47.646 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:18:47.646 INFO:teuthology.orchestra.run.smithi063.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T06:18:47.646 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:18:47.646 INFO:teuthology.orchestra.run.smithi063.stdout:Bootstrap complete. 2024-09-21T06:18:47.685 INFO:tasks.cephadm:Fetching config... 2024-09-21T06:18:47.685 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:18:47.685 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T06:18:47.702 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T06:18:47.702 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:18:47.702 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T06:18:47.757 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T06:18:47.757 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:18:47.758 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T06:18:47.824 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T06:18:47.824 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:18:47.824 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T06:18:47.880 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T06:18:47.880 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxZR3f2JAfZAwHntsLR7eCIlvWWH2RhHuWf0NfCKn+W9xihH4lXvDYerfguIsmeeE6hsAOjYyqdIojOFJOk3LggTAe4ZWIpRrZUZ6DYQ2UVsO2JA7a0i1ALWC0xaQkcoGxye28l0AGs0THa+CmtTbu4ZRB2AMNZgHk3maOxniH3QHZ5mCPsvPUNID4SQwpxxjco5MITeJI0T37qBBlumhI3YUVur30h1wyCHlE0oxbc+OS9UfUV6jOW+wZvG9iZ+yElJSCyqmY9F88NO8PNKEP8PSgbVie9WclApxmdnqvgui5suG6ttV4R4maC4NwN2pPxfb3ls6fxvLXoc7XT4zja0Ai+V1TNkt2dDjuZJRtnSfUoyMYqLg9Wtf4jzDi9baa2FvGfWS+F/UjNgGNkB5BwPqJl46zyioIkf3oWkkIZhIpCUxYRn2ISIk6DFXvP28ooF4QoVviVF6lCCBYDqrf1GYEbU9xrTVlXvgQ0TqA0tjGX5e9ZKkUMmoonP17wns= ceph-140899c8-77e1-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T06:18:47.980 INFO:teuthology.orchestra.run.smithi063.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxZR3f2JAfZAwHntsLR7eCIlvWWH2RhHuWf0NfCKn+W9xihH4lXvDYerfguIsmeeE6hsAOjYyqdIojOFJOk3LggTAe4ZWIpRrZUZ6DYQ2UVsO2JA7a0i1ALWC0xaQkcoGxye28l0AGs0THa+CmtTbu4ZRB2AMNZgHk3maOxniH3QHZ5mCPsvPUNID4SQwpxxjco5MITeJI0T37qBBlumhI3YUVur30h1wyCHlE0oxbc+OS9UfUV6jOW+wZvG9iZ+yElJSCyqmY9F88NO8PNKEP8PSgbVie9WclApxmdnqvgui5suG6ttV4R4maC4NwN2pPxfb3ls6fxvLXoc7XT4zja0Ai+V1TNkt2dDjuZJRtnSfUoyMYqLg9Wtf4jzDi9baa2FvGfWS+F/UjNgGNkB5BwPqJl46zyioIkf3oWkkIZhIpCUxYRn2ISIk6DFXvP28ooF4QoVviVF6lCCBYDqrf1GYEbU9xrTVlXvgQ0TqA0tjGX5e9ZKkUMmoonP17wns= ceph-140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:18:47.989 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxZR3f2JAfZAwHntsLR7eCIlvWWH2RhHuWf0NfCKn+W9xihH4lXvDYerfguIsmeeE6hsAOjYyqdIojOFJOk3LggTAe4ZWIpRrZUZ6DYQ2UVsO2JA7a0i1ALWC0xaQkcoGxye28l0AGs0THa+CmtTbu4ZRB2AMNZgHk3maOxniH3QHZ5mCPsvPUNID4SQwpxxjco5MITeJI0T37qBBlumhI3YUVur30h1wyCHlE0oxbc+OS9UfUV6jOW+wZvG9iZ+yElJSCyqmY9F88NO8PNKEP8PSgbVie9WclApxmdnqvgui5suG6ttV4R4maC4NwN2pPxfb3ls6fxvLXoc7XT4zja0Ai+V1TNkt2dDjuZJRtnSfUoyMYqLg9Wtf4jzDi9baa2FvGfWS+F/UjNgGNkB5BwPqJl46zyioIkf3oWkkIZhIpCUxYRn2ISIk6DFXvP28ooF4QoVviVF6lCCBYDqrf1GYEbU9xrTVlXvgQ0TqA0tjGX5e9ZKkUMmoonP17wns= ceph-140899c8-77e1-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T06:18:48.030 INFO:teuthology.orchestra.run.smithi071.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxZR3f2JAfZAwHntsLR7eCIlvWWH2RhHuWf0NfCKn+W9xihH4lXvDYerfguIsmeeE6hsAOjYyqdIojOFJOk3LggTAe4ZWIpRrZUZ6DYQ2UVsO2JA7a0i1ALWC0xaQkcoGxye28l0AGs0THa+CmtTbu4ZRB2AMNZgHk3maOxniH3QHZ5mCPsvPUNID4SQwpxxjco5MITeJI0T37qBBlumhI3YUVur30h1wyCHlE0oxbc+OS9UfUV6jOW+wZvG9iZ+yElJSCyqmY9F88NO8PNKEP8PSgbVie9WclApxmdnqvgui5suG6ttV4R4maC4NwN2pPxfb3ls6fxvLXoc7XT4zja0Ai+V1TNkt2dDjuZJRtnSfUoyMYqLg9Wtf4jzDi9baa2FvGfWS+F/UjNgGNkB5BwPqJl46zyioIkf3oWkkIZhIpCUxYRn2ISIk6DFXvP28ooF4QoVviVF6lCCBYDqrf1GYEbU9xrTVlXvgQ0TqA0tjGX5e9ZKkUMmoonP17wns= ceph-140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:18:48.043 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxZR3f2JAfZAwHntsLR7eCIlvWWH2RhHuWf0NfCKn+W9xihH4lXvDYerfguIsmeeE6hsAOjYyqdIojOFJOk3LggTAe4ZWIpRrZUZ6DYQ2UVsO2JA7a0i1ALWC0xaQkcoGxye28l0AGs0THa+CmtTbu4ZRB2AMNZgHk3maOxniH3QHZ5mCPsvPUNID4SQwpxxjco5MITeJI0T37qBBlumhI3YUVur30h1wyCHlE0oxbc+OS9UfUV6jOW+wZvG9iZ+yElJSCyqmY9F88NO8PNKEP8PSgbVie9WclApxmdnqvgui5suG6ttV4R4maC4NwN2pPxfb3ls6fxvLXoc7XT4zja0Ai+V1TNkt2dDjuZJRtnSfUoyMYqLg9Wtf4jzDi9baa2FvGfWS+F/UjNgGNkB5BwPqJl46zyioIkf3oWkkIZhIpCUxYRn2ISIk6DFXvP28ooF4QoVviVF6lCCBYDqrf1GYEbU9xrTVlXvgQ0TqA0tjGX5e9ZKkUMmoonP17wns= ceph-140899c8-77e1-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T06:18:48.083 INFO:teuthology.orchestra.run.smithi175.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxZR3f2JAfZAwHntsLR7eCIlvWWH2RhHuWf0NfCKn+W9xihH4lXvDYerfguIsmeeE6hsAOjYyqdIojOFJOk3LggTAe4ZWIpRrZUZ6DYQ2UVsO2JA7a0i1ALWC0xaQkcoGxye28l0AGs0THa+CmtTbu4ZRB2AMNZgHk3maOxniH3QHZ5mCPsvPUNID4SQwpxxjco5MITeJI0T37qBBlumhI3YUVur30h1wyCHlE0oxbc+OS9UfUV6jOW+wZvG9iZ+yElJSCyqmY9F88NO8PNKEP8PSgbVie9WclApxmdnqvgui5suG6ttV4R4maC4NwN2pPxfb3ls6fxvLXoc7XT4zja0Ai+V1TNkt2dDjuZJRtnSfUoyMYqLg9Wtf4jzDi9baa2FvGfWS+F/UjNgGNkB5BwPqJl46zyioIkf3oWkkIZhIpCUxYRn2ISIk6DFXvP28ooF4QoVviVF6lCCBYDqrf1GYEbU9xrTVlXvgQ0TqA0tjGX5e9ZKkUMmoonP17wns= ceph-140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:18:48.096 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T06:18:48.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:48 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2625270336' entity='client.admin' 2024-09-21T06:18:48.353 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:49.642 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T06:18:49.643 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T06:18:50.089 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:50.327 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:50 smithi063 ceph-mon[31150]: mgrmap e14: x(active, since 12s) 2024-09-21T06:18:50.327 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:50 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3694707895' entity='client.admin' 2024-09-21T06:18:50.327 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:50 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:18:50.327 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:50 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:18:50.327 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:50 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi063", "name": "osd_memory_target"} : dispatch 2024-09-21T06:18:51.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:51 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:18:51.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:51 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:18:51.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:51 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:18:51.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:51 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:18:51.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:51 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:18:51.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:51 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:18:51.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:51 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:18:51.679 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi071 2024-09-21T06:18:51.679 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:18:51.679 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/etc/ceph/ceph.conf 2024-09-21T06:18:51.699 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:18:51.699 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:18:51.756 INFO:tasks.cephadm:Adding host smithi071 to orchestrator... 2024-09-21T06:18:51.756 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph orch host add smithi071 2024-09-21T06:18:52.340 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:52.553 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:52 smithi063 ceph-mon[31150]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:52.553 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:52 smithi063 ceph-mon[31150]: Updating smithi063:/etc/ceph/ceph.conf 2024-09-21T06:18:52.553 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:52 smithi063 ceph-mon[31150]: Updating smithi063:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:18:52.553 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:52 smithi063 ceph-mon[31150]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:18:52.553 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:52 smithi063 ceph-mon[31150]: Updating smithi063:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:18:52.553 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:52 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:18:52.553 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:52 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:18:52.553 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:52 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:18:54.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:53 smithi063 ceph-mon[31150]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi071", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:55.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:54 smithi063 ceph-mon[31150]: Deploying cephadm binary to smithi071 2024-09-21T06:18:56.716 INFO:teuthology.orchestra.run.smithi063.stdout:Added host 'smithi071' with addr '172.21.15.71' 2024-09-21T06:18:57.369 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T06:18:57.625 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:57.976 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:57 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:18:57.976 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:57 smithi063 ceph-mon[31150]: Added host smithi071 2024-09-21T06:18:57.976 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:57 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:18:57.976 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:57 smithi063 ceph-mon[31150]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:18:57.976 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:57 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:18:57.976 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:57 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:18:58.272 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:18:58.272 INFO:teuthology.orchestra.run.smithi063.stdout:[{"addr": "172.21.15.63", "hostname": "smithi063", "labels": [], "status": ""}, {"addr": "172.21.15.71", "hostname": "smithi071", "labels": [], "status": ""}] 2024-09-21T06:18:58.855 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi175 2024-09-21T06:18:58.856 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T06:18:58.856 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/etc/ceph/ceph.conf 2024-09-21T06:18:58.876 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T06:18:58.876 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:18:58.934 INFO:tasks.cephadm:Adding host smithi175 to orchestrator... 2024-09-21T06:18:58.934 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph orch host add smithi175 2024-09-21T06:18:59.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:59 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:18:59.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:18:59 smithi063 ceph-mon[31150]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:18:59.184 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:00.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:00 smithi063 ceph-mon[31150]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:01.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:01 smithi063 ceph-mon[31150]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:01.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:01 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:01.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:01 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:01.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:01 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:01.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:01 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:01.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:01 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:01.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:01 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:01.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:01 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:19:02.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:02 smithi063 ceph-mon[31150]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-21T06:19:02.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:02 smithi063 ceph-mon[31150]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:02.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:02 smithi063 ceph-mon[31150]: Deploying cephadm binary to smithi175 2024-09-21T06:19:02.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:02 smithi063 ceph-mon[31150]: Updating smithi071:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:02.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:02 smithi063 ceph-mon[31150]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:19:02.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:02 smithi063 ceph-mon[31150]: Updating smithi071:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:19:02.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:02 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:02.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:02 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:02.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:02 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:03.658 INFO:teuthology.orchestra.run.smithi063.stdout:Added host 'smithi175' with addr '172.21.15.175' 2024-09-21T06:19:04.304 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T06:19:04.557 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:04.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:04 smithi063 ceph-mon[31150]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:04.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:04 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:04.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:04 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:19:04.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:04 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:04.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:04 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:05.204 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:19:05.204 INFO:teuthology.orchestra.run.smithi063.stdout:[{"addr": "172.21.15.63", "hostname": "smithi063", "labels": [], "status": ""}, {"addr": "172.21.15.71", "hostname": "smithi071", "labels": [], "status": ""}, {"addr": "172.21.15.175", "hostname": "smithi175", "labels": [], "status": ""}] 2024-09-21T06:19:05.805 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:05 smithi063 ceph-mon[31150]: Added host smithi175 2024-09-21T06:19:05.805 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:05 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:05.832 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T06:19:05.832 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T06:19:06.081 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:06.483 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:06 smithi063 ceph-mon[31150]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:06.484 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:06 smithi063 ceph-mon[31150]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:19:07.384 INFO:teuthology.orchestra.run.smithi063.stderr:adjusted tunables profile to default 2024-09-21T06:19:07.685 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:07 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2124484595' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T06:19:08.003 INFO:tasks.cephadm:Adding mon.a on smithi063 2024-09-21T06:19:08.003 INFO:tasks.cephadm:Adding mon.b on smithi071 2024-09-21T06:19:08.003 INFO:tasks.cephadm:Adding mon.c on smithi175 2024-09-21T06:19:08.003 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi063:172.21.15.63=a;smithi071:172.21.15.71=b;smithi175:172.21.15.175=c' 2024-09-21T06:19:08.245 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:08.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:08 smithi063 ceph-mon[31150]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:08.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:08 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2124484595' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T06:19:08.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:08 smithi063 ceph-mon[31150]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:19:08.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:08 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:08.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:08 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:08.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:08 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:08.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:08 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:08.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:08 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:08.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:08 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:08.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:08 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:19:08.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:08 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:08.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:08 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:08.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:08 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:08.913 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mon update... 2024-09-21T06:19:09.556 DEBUG:teuthology.orchestra.run.smithi071:mon.b> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T06:19:09.558 DEBUG:teuthology.orchestra.run.smithi175:mon.c> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T06:19:09.561 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:19:09.561 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:19:09.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:09 smithi063 ceph-mon[31150]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-21T06:19:09.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:09 smithi063 ceph-mon[31150]: Updating smithi175:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:09.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:09 smithi063 ceph-mon[31150]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:19:09.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:09 smithi063 ceph-mon[31150]: Updating smithi175:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:19:09.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:09 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:09.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:09 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:19:09.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:09 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:09.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:09 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:19:09.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:09 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:09.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:09 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:19:09.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:09 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:10.364 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:10.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:10 smithi063 ceph-mon[31150]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:10.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:10 smithi063 ceph-mon[31150]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi063:172.21.15.63=a;smithi071:172.21.15.71=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:10.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:10 smithi063 ceph-mon[31150]: Saving service mon spec with placement smithi063:172.21.15.63=a;smithi071:172.21.15.71=b;smithi175:172.21.15.175=c;count:3 2024-09-21T06:19:10.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:10 smithi063 ceph-mon[31150]: Deploying daemon mon.c on smithi175 2024-09-21T06:19:12.608 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:19:12.608 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":1,"fsid":"140899c8-77e1-11ef-baf5-efdc52797490","modified":"2024-09-21T06:17:43.635151Z","created":"2024-09-21T06:17:43.635151Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T06:19:12.608 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 1 2024-09-21T06:19:12.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:12 smithi063 ceph-mon[31150]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:12.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:12 smithi175 systemd[1]: Starting Ceph mon.c for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:19:13.524 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 podman[34491]: 2024-09-21 06:19:13.339473283 +0000 UTC m=+0.015242926 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:19:13.525 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 podman[34491]: 2024-09-21 06:19:13.440876111 +0000 UTC m=+0.116645751 container create b6be838a86a3efe9d4a5893d930d22eb149fdc710cdf44aeff26be45bb257367 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T06:19:13.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:13 smithi063 ceph-mon[31150]: from='client.? 172.21.15.175:0/3251103406' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:19:14.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 podman[34491]: 2024-09-21 06:19:13.618439927 +0000 UTC m=+0.294209563 container init b6be838a86a3efe9d4a5893d930d22eb149fdc710cdf44aeff26be45bb257367 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-c, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T06:19:14.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 podman[34491]: 2024-09-21 06:19:13.621687887 +0000 UTC m=+0.297457532 container start b6be838a86a3efe9d4a5893d930d22eb149fdc710cdf44aeff26be45bb257367 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-c, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:19:14.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T06:19:14.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T06:19:14.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: pidfile_write: ignore empty --pid-file 2024-09-21T06:19:14.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: load: jerasure load: lrc 2024-09-21T06:19:14.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: RocksDB version: 7.9.2 2024-09-21T06:19:14.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Git sha 0 2024-09-21T06:19:14.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T06:19:14.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: DB SUMMARY 2024-09-21T06:19:14.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: DB Session ID: H7JBDCSVJZZR7RUDJ9MZ 2024-09-21T06:19:14.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: CURRENT file: CURRENT 2024-09-21T06:19:14.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T06:19:14.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T06:19:14.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T06:19:14.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-21T06:19:14.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.error_if_exists: 0 2024-09-21T06:19:14.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.create_if_missing: 0 2024-09-21T06:19:14.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.paranoid_checks: 1 2024-09-21T06:19:14.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T06:19:14.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T06:19:14.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T06:19:14.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.env: 0x559b84e47d60 2024-09-21T06:19:14.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T06:19:14.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.info_log: 0x559b8b1c7360 2024-09-21T06:19:14.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T06:19:14.103 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.statistics: (nil) 2024-09-21T06:19:14.103 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.use_fsync: 0 2024-09-21T06:19:14.103 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_log_file_size: 0 2024-09-21T06:19:14.103 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T06:19:14.103 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T06:19:14.103 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T06:19:14.103 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T06:19:14.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.allow_fallocate: 1 2024-09-21T06:19:14.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T06:19:14.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T06:19:14.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.use_direct_reads: 0 2024-09-21T06:19:14.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T06:19:14.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T06:19:14.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.db_log_dir: 2024-09-21T06:19:14.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.wal_dir: 2024-09-21T06:19:14.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T06:19:14.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T06:19:14.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T06:19:14.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T06:19:14.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T06:19:14.104 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T06:19:14.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T06:19:14.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T06:19:14.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.write_buffer_manager: 0x559b8b1cbd60 2024-09-21T06:19:14.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T06:19:14.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T06:19:14.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T06:19:14.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T06:19:14.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T06:19:14.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T06:19:14.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T06:19:14.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T06:19:14.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.unordered_write: 0 2024-09-21T06:19:14.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T06:19:14.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T06:19:14.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T06:19:14.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T06:19:14.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.row_cache: None 2024-09-21T06:19:14.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.wal_filter: None 2024-09-21T06:19:14.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T06:19:14.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T06:19:14.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.two_write_queues: 0 2024-09-21T06:19:14.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T06:19:14.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.wal_compression: 0 2024-09-21T06:19:14.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.atomic_flush: 0 2024-09-21T06:19:14.106 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T06:19:14.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T06:19:14.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T06:19:14.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.log_readahead_size: 0 2024-09-21T06:19:14.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T06:19:14.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T06:19:14.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T06:19:14.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T06:19:14.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T06:19:14.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T06:19:14.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T06:19:14.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_background_jobs: 2 2024-09-21T06:19:14.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_background_compactions: -1 2024-09-21T06:19:14.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_subcompactions: 1 2024-09-21T06:19:14.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T06:19:14.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T06:19:14.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T06:19:14.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T06:19:14.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T06:19:14.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T06:19:14.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T06:19:14.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T06:19:14.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_open_files: -1 2024-09-21T06:19:14.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T06:19:14.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T06:19:14.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T06:19:14.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T06:19:14.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_background_flushes: -1 2024-09-21T06:19:14.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Compression algorithms supported: 2024-09-21T06:19:14.109 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: kZSTD supported: 0 2024-09-21T06:19:14.109 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: kXpressCompression supported: 0 2024-09-21T06:19:14.109 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: kBZip2Compression supported: 0 2024-09-21T06:19:14.109 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T06:19:14.109 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: kLZ4Compression supported: 1 2024-09-21T06:19:14.109 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: kZlibCompression supported: 1 2024-09-21T06:19:14.109 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T06:19:14.109 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: kSnappyCompression supported: 1 2024-09-21T06:19:14.109 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T06:19:14.109 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T06:19:14.109 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T06:19:14.109 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T06:19:14.109 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T06:19:14.109 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.merge_operator: 2024-09-21T06:19:14.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compaction_filter: None 2024-09-21T06:19:14.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T06:19:14.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T06:19:14.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T06:19:14.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T06:19:14.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559b8b1c6fa0) 2024-09-21T06:19:14.110 INFO:journalctl@ceph.mon.c.smithi175.stdout: cache_index_and_filter_blocks: 1 2024-09-21T06:19:14.110 INFO:journalctl@ceph.mon.c.smithi175.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T06:19:14.110 INFO:journalctl@ceph.mon.c.smithi175.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T06:19:14.110 INFO:journalctl@ceph.mon.c.smithi175.stdout: pin_top_level_index_and_filter: 1 2024-09-21T06:19:14.110 INFO:journalctl@ceph.mon.c.smithi175.stdout: index_type: 0 2024-09-21T06:19:14.110 INFO:journalctl@ceph.mon.c.smithi175.stdout: data_block_index_type: 0 2024-09-21T06:19:14.111 INFO:journalctl@ceph.mon.c.smithi175.stdout: index_shortening: 1 2024-09-21T06:19:14.111 INFO:journalctl@ceph.mon.c.smithi175.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T06:19:14.111 INFO:journalctl@ceph.mon.c.smithi175.stdout: checksum: 4 2024-09-21T06:19:14.111 INFO:journalctl@ceph.mon.c.smithi175.stdout: no_block_cache: 0 2024-09-21T06:19:14.111 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache: 0x559b8718b610 2024-09-21T06:19:14.111 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache_name: BinnedLRUCache 2024-09-21T06:19:14.111 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache_options: 2024-09-21T06:19:14.111 INFO:journalctl@ceph.mon.c.smithi175.stdout: capacity : 536870912 2024-09-21T06:19:14.111 INFO:journalctl@ceph.mon.c.smithi175.stdout: num_shard_bits : 4 2024-09-21T06:19:14.111 INFO:journalctl@ceph.mon.c.smithi175.stdout: strict_capacity_limit : 0 2024-09-21T06:19:14.111 INFO:journalctl@ceph.mon.c.smithi175.stdout: high_pri_pool_ratio: 0.000 2024-09-21T06:19:14.111 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache_compressed: (nil) 2024-09-21T06:19:14.111 INFO:journalctl@ceph.mon.c.smithi175.stdout: persistent_cache: (nil) 2024-09-21T06:19:14.111 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_size: 4096 2024-09-21T06:19:14.112 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_size_deviation: 10 2024-09-21T06:19:14.112 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_restart_interval: 16 2024-09-21T06:19:14.112 INFO:journalctl@ceph.mon.c.smithi175.stdout: index_block_restart_interval: 1 2024-09-21T06:19:14.112 INFO:journalctl@ceph.mon.c.smithi175.stdout: metadata_block_size: 4096 2024-09-21T06:19:14.112 INFO:journalctl@ceph.mon.c.smithi175.stdout: partition_filters: 0 2024-09-21T06:19:14.112 INFO:journalctl@ceph.mon.c.smithi175.stdout: use_delta_encoding: 1 2024-09-21T06:19:14.112 INFO:journalctl@ceph.mon.c.smithi175.stdout: filter_policy: bloomfilter 2024-09-21T06:19:14.112 INFO:journalctl@ceph.mon.c.smithi175.stdout: whole_key_filtering: 1 2024-09-21T06:19:14.112 INFO:journalctl@ceph.mon.c.smithi175.stdout: verify_compression: 0 2024-09-21T06:19:14.112 INFO:journalctl@ceph.mon.c.smithi175.stdout: read_amp_bytes_per_bit: 0 2024-09-21T06:19:14.113 INFO:journalctl@ceph.mon.c.smithi175.stdout: format_version: 5 2024-09-21T06:19:14.113 INFO:journalctl@ceph.mon.c.smithi175.stdout: enable_index_compression: 1 2024-09-21T06:19:14.113 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_align: 0 2024-09-21T06:19:14.113 INFO:journalctl@ceph.mon.c.smithi175.stdout: max_auto_readahead_size: 262144 2024-09-21T06:19:14.113 INFO:journalctl@ceph.mon.c.smithi175.stdout: prepopulate_block_cache: 0 2024-09-21T06:19:14.113 INFO:journalctl@ceph.mon.c.smithi175.stdout: initial_auto_readahead_size: 8192 2024-09-21T06:19:14.113 INFO:journalctl@ceph.mon.c.smithi175.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T06:19:14.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T06:19:14.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T06:19:14.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compression: NoCompression 2024-09-21T06:19:14.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T06:19:14.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T06:19:14.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T06:19:14.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.num_levels: 7 2024-09-21T06:19:14.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T06:19:14.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T06:19:14.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T06:19:14.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T06:19:14.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T06:19:14.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T06:19:14.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T06:19:14.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:19:14.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T06:19:14.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T06:19:14.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:19:14.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:19:14.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T06:19:14.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T06:19:14.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T06:19:14.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T06:19:14.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:19:14.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:19:14.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T06:19:14.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T06:19:14.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:19:14.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T06:19:14.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T06:19:14.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T06:19:14.115 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T06:19:14.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T06:19:14.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T06:19:14.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T06:19:14.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T06:19:14.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T06:19:14.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T06:19:14.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T06:19:14.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T06:19:14.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T06:19:14.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T06:19:14.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T06:19:14.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T06:19:14.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T06:19:14.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T06:19:14.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T06:19:14.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T06:19:14.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T06:19:14.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T06:19:14.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T06:19:14.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T06:19:14.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T06:19:14.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T06:19:14.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T06:19:14.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T06:19:14.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T06:19:14.118 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T06:19:14.118 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T06:19:14.118 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T06:19:14.118 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T06:19:14.118 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.inplace_update_support: 0 2024-09-21T06:19:14.118 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T06:19:14.118 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T06:19:14.118 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T06:19:14.118 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T06:19:14.118 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.bloom_locality: 0 2024-09-21T06:19:14.118 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.max_successive_merges: 0 2024-09-21T06:19:14.118 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T06:19:14.118 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T06:19:14.119 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T06:19:14.119 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T06:19:14.119 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.ttl: 2592000 2024-09-21T06:19:14.119 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T06:19:14.119 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T06:19:14.119 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T06:19:14.119 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.enable_blob_files: false 2024-09-21T06:19:14.119 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.min_blob_size: 0 2024-09-21T06:19:14.119 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T06:19:14.119 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T06:19:14.119 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T06:19:14.119 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T06:19:14.119 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T06:19:14.119 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T06:19:14.119 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T06:19:14.120 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T06:19:14.120 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T06:19:14.120 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T06:19:14.120 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 82f2041c-4134-473f-8eb1-ca6fd59b0e7a 2024-09-21T06:19:14.120 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726899553658409, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T06:19:14.120 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T06:19:14.120 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726899553658832, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726899553, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "82f2041c-4134-473f-8eb1-ca6fd59b0e7a", "db_session_id": "H7JBDCSVJZZR7RUDJ9MZ", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T06:19:14.120 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726899553658925, "job": 1, "event": "recovery_finished"} 2024-09-21T06:19:14.120 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T06:19:14.120 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T06:19:14.120 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559b8b1eaa80 2024-09-21T06:19:14.120 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: DB pointer 0x559b8bf90000 2024-09-21T06:19:14.120 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T06:19:14.120 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T06:19:14.121 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** DB Stats ** 2024-09-21T06:19:14.121 INFO:journalctl@ceph.mon.c.smithi175.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:19:14.121 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T06:19:14.121 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:19:14.121 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:19:14.121 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T06:19:14.121 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:19:14.121 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:19:14.121 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-09-21T06:19:14.121 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** Compaction Stats [default] ** 2024-09-21T06:19:14.121 INFO:journalctl@ceph.mon.c.smithi175.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:19:14.121 INFO:journalctl@ceph.mon.c.smithi175.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T06:19:14.121 INFO:journalctl@ceph.mon.c.smithi175.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T06:19:14.121 INFO:journalctl@ceph.mon.c.smithi175.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T06:19:14.121 INFO:journalctl@ceph.mon.c.smithi175.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T06:19:14.122 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-09-21T06:19:14.122 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** Compaction Stats [default] ** 2024-09-21T06:19:14.122 INFO:journalctl@ceph.mon.c.smithi175.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:19:14.122 INFO:journalctl@ceph.mon.c.smithi175.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T06:19:14.122 INFO:journalctl@ceph.mon.c.smithi175.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T06:19:14.122 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-09-21T06:19:14.122 INFO:journalctl@ceph.mon.c.smithi175.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T06:19:14.122 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-09-21T06:19:14.122 INFO:journalctl@ceph.mon.c.smithi175.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:19:14.122 INFO:journalctl@ceph.mon.c.smithi175.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T06:19:14.122 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T06:19:14.122 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T06:19:14.122 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T06:19:14.123 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T06:19:14.123 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:19:14.123 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:19:14.123 INFO:journalctl@ceph.mon.c.smithi175.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T06:19:14.123 INFO:journalctl@ceph.mon.c.smithi175.stdout: Block cache BinnedLRUCache@0x559b8718b610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T06:19:14.123 INFO:journalctl@ceph.mon.c.smithi175.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T06:19:14.123 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-09-21T06:19:14.123 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T06:19:14.123 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T06:19:14.123 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: using public_addr v2:172.21.15.175:0/0 -> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] 2024-09-21T06:19:14.123 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: starting mon.c rank -1 at public addrs [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] at bind addrs [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:19:14.123 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: mon.c@-1(???) e0 preinit fsid 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:19:14.123 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T06:19:14.123 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T06:19:14.123 INFO:journalctl@ceph.mon.c.smithi175.stdout: e1 2024-09-21T06:19:14.124 INFO:journalctl@ceph.mon.c.smithi175.stdout: btime 2024-09-21T06:17:48:089129+0000 2024-09-21T06:19:14.124 INFO:journalctl@ceph.mon.c.smithi175.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T06:19:14.124 INFO:journalctl@ceph.mon.c.smithi175.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:19:14.124 INFO:journalctl@ceph.mon.c.smithi175.stdout: legacy client fscid: -1 2024-09-21T06:19:14.124 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-09-21T06:19:14.124 INFO:journalctl@ceph.mon.c.smithi175.stdout: No filesystems configured 2024-09-21T06:19:14.124 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T06:19:14.124 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T06:19:14.124 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T06:19:14.124 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T06:19:14.124 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T06:19:14.124 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T06:19:14.124 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T06:19:14.124 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:19:14.125 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:19:14.125 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:19:14.125 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:14.125 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:14.125 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:14.125 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:14.125 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:14.125 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:14.125 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:14.125 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:14.125 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:19:14.125 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-21T06:19:14.125 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:14.126 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: Deploying cephadm binary to smithi175 2024-09-21T06:19:14.126 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: Updating smithi071:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:14.126 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:19:14.126 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: Updating smithi071:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:19:14.126 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:14.126 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:14.126 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:14.126 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:14.126 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:14.126 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:19:14.126 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:14.126 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:14.127 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: Added host smithi175 2024-09-21T06:19:14.127 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:14.127 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:14.127 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:19:14.127 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2124484595' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T06:19:14.127 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:14.127 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2124484595' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T06:19:14.127 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:19:14.127 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:14.127 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:14.127 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:14.127 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:14.127 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:14.127 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:14.127 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:19:14.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:14.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:14.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:14.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-21T06:19:14.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: Updating smithi175:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:14.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:19:14.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: Updating smithi175:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:19:14.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:14.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:19:14.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:14.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:19:14.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:14.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:19:14.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:14.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:14.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi063:172.21.15.63=a;smithi071:172.21.15.71=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:14.129 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: Saving service mon spec with placement smithi063:172.21.15.63=a;smithi071:172.21.15.71=b;smithi175:172.21.15.175=c;count:3 2024-09-21T06:19:14.129 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: Deploying daemon mon.c on smithi175 2024-09-21T06:19:14.129 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:14.129 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: from='client.? 172.21.15.175:0/3251103406' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:19:14.129 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 ceph-mon[34510]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T06:19:14.129 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 bash[34491]: b6be838a86a3efe9d4a5893d930d22eb149fdc710cdf44aeff26be45bb257367 2024-09-21T06:19:14.129 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:13 smithi175 systemd[1]: Started Ceph mon.c for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:19:14.228 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:19:14.228 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:19:14.476 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:19:19.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:19:19.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:19:19.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: mon.a calling monitor election 2024-09-21T06:19:19.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:19:19.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:19.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:19:19.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: mon.c calling monitor election 2024-09-21T06:19:19.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:19:19.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:19.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:19:19.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:19:19.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:19:19.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: monmap epoch 2 2024-09-21T06:19:19.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: fsid 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:19:19.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: last_changed 2024-09-21T06:19:13.687540+0000 2024-09-21T06:19:19.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: created 2024-09-21T06:17:43.635151+0000 2024-09-21T06:19:19.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: min_mon_release 19 (squid) 2024-09-21T06:19:19.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: election_strategy: 1 2024-09-21T06:19:19.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: 0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-21T06:19:19.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-21T06:19:19.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: fsmap 2024-09-21T06:19:19.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:19:19.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: mgrmap e14: x(active, since 41s) 2024-09-21T06:19:19.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: overall HEALTH_OK 2024-09-21T06:19:19.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:19.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:19.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:19.085 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:19:19.085 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:18 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:19.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:19:19.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:19:19.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: mon.a calling monitor election 2024-09-21T06:19:19.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:19:19.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:19.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:19:19.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: mon.c calling monitor election 2024-09-21T06:19:19.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:19:19.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:19.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:19:19.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:19:19.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:19:19.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: monmap epoch 2 2024-09-21T06:19:19.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: fsid 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:19:19.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: last_changed 2024-09-21T06:19:13.687540+0000 2024-09-21T06:19:19.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: created 2024-09-21T06:17:43.635151+0000 2024-09-21T06:19:19.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: min_mon_release 19 (squid) 2024-09-21T06:19:19.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: election_strategy: 1 2024-09-21T06:19:19.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: 0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-21T06:19:19.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-21T06:19:19.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: fsmap 2024-09-21T06:19:19.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:19:19.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: mgrmap e14: x(active, since 41s) 2024-09-21T06:19:19.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: overall HEALTH_OK 2024-09-21T06:19:19.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:19.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:19.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:19.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:19:19.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:18 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:19.578 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:19:19.578 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":2,"fsid":"140899c8-77e1-11ef-baf5-efdc52797490","modified":"2024-09-21T06:19:13.687540Z","created":"2024-09-21T06:17:43.635151Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T06:19:19.578 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 2 2024-09-21T06:19:19.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:19 smithi175 ceph-mon[34510]: Deploying daemon mon.b on smithi071 2024-09-21T06:19:19.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:19 smithi175 ceph-mon[34510]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:19.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:19 smithi175 ceph-mon[34510]: from='client.? 172.21.15.175:0/2557049181' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:19:19.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:19 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:19:20.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:19 smithi063 ceph-mon[31150]: Deploying daemon mon.b on smithi071 2024-09-21T06:19:20.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:19 smithi063 ceph-mon[31150]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:20.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:19 smithi063 ceph-mon[31150]: from='client.? 172.21.15.175:0/2557049181' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:19:20.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:19 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:19:21.210 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:19:21.211 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:19:21.461 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:19:22.151 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:19:22.151 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":2,"fsid":"140899c8-77e1-11ef-baf5-efdc52797490","modified":"2024-09-21T06:19:13.687540Z","created":"2024-09-21T06:17:43.635151Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T06:19:22.151 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 2 2024-09-21T06:19:22.151 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:21 smithi175 ceph-mon[34510]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:22.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:21 smithi063 ceph-mon[31150]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:22.568 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:22 smithi071 ceph-mon[34844]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T06:19:23.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:22 smithi071 bash[34825]: 8bebf6bf5b3930823e97162d51dd4f8afaf6c534e7516107cba901e500175e22 2024-09-21T06:19:23.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:22 smithi071 systemd[1]: Started Ceph mon.b for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:19:23.786 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:19:23.787 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:19:24.037 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:19:27.946 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:19:27.946 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":3,"fsid":"140899c8-77e1-11ef-baf5-efdc52797490","modified":"2024-09-21T06:19:22.559181Z","created":"2024-09-21T06:17:43.635151Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T06:19:27.946 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 3 2024-09-21T06:19:27.946 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:19:27.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: mon.a calling monitor election 2024-09-21T06:19:27.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: mon.c calling monitor election 2024-09-21T06:19:27.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:27.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:19:27.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:27.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:27.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:27.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:27.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:27.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:27.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:27.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:19:27.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: monmap epoch 3 2024-09-21T06:19:27.947 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: fsid 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:19:27.948 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: last_changed 2024-09-21T06:19:22.559181+0000 2024-09-21T06:19:27.948 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: created 2024-09-21T06:17:43.635151+0000 2024-09-21T06:19:27.948 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: min_mon_release 19 (squid) 2024-09-21T06:19:27.948 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: election_strategy: 1 2024-09-21T06:19:27.948 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: 0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-21T06:19:27.948 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-21T06:19:27.948 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: 2: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-09-21T06:19:27.948 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: fsmap 2024-09-21T06:19:27.948 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:19:27.948 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: mgrmap e14: x(active, since 50s) 2024-09-21T06:19:27.948 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: overall HEALTH_OK 2024-09-21T06:19:27.948 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:27.948 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:27.948 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:27.949 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:27 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:28.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:19:28.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: mon.a calling monitor election 2024-09-21T06:19:28.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: mon.c calling monitor election 2024-09-21T06:19:28.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:28.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:19:28.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:28.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:28.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:28.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:28.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:28.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:28.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:28.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:19:28.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: monmap epoch 3 2024-09-21T06:19:28.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: fsid 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:19:28.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: last_changed 2024-09-21T06:19:22.559181+0000 2024-09-21T06:19:28.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: created 2024-09-21T06:17:43.635151+0000 2024-09-21T06:19:28.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: min_mon_release 19 (squid) 2024-09-21T06:19:28.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: election_strategy: 1 2024-09-21T06:19:28.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: 0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-21T06:19:28.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-21T06:19:28.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: 2: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-09-21T06:19:28.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: fsmap 2024-09-21T06:19:28.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:19:28.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: mgrmap e14: x(active, since 50s) 2024-09-21T06:19:28.085 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: overall HEALTH_OK 2024-09-21T06:19:28.085 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:28.085 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:28.085 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:28.085 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:27 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:28.557 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T06:19:28.557 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T06:19:28.826 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:28.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:28 smithi175 ceph-mon[34510]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:28.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:28 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:19:28.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:28 smithi175 ceph-mon[34510]: from='client.? 172.21.15.175:0/2317202313' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:19:28.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:28 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:28.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:28 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:28.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:28 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:28.947 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:28 smithi063 ceph-mon[31150]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:28.947 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:28 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:19:28.947 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:28 smithi063 ceph-mon[31150]: from='client.? 172.21.15.175:0/2317202313' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:19:28.947 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:28 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:28.947 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:28 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:28.947 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:28 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:29.762 INFO:teuthology.orchestra.run.smithi063.stdout:# minimal ceph.conf for 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:19:29.762 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2024-09-21T06:19:29.762 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:19:29.762 INFO:teuthology.orchestra.run.smithi063.stdout: mon_host = [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] 2024-09-21T06:19:30.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:19:30.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: mon.a calling monitor election 2024-09-21T06:19:30.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: mon.c calling monitor election 2024-09-21T06:19:30.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:30.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:19:30.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:30.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:30.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:30.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:30.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:30.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:30.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:30.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:19:30.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: monmap epoch 3 2024-09-21T06:19:30.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: fsid 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:19:30.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: last_changed 2024-09-21T06:19:22.559181+0000 2024-09-21T06:19:30.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: created 2024-09-21T06:17:43.635151+0000 2024-09-21T06:19:30.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: min_mon_release 19 (squid) 2024-09-21T06:19:30.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: election_strategy: 1 2024-09-21T06:19:30.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: 0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-21T06:19:30.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-21T06:19:30.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: 2: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-09-21T06:19:30.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: fsmap 2024-09-21T06:19:30.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:19:30.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: mgrmap e14: x(active, since 50s) 2024-09-21T06:19:30.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: overall HEALTH_OK 2024-09-21T06:19:30.021 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.021 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.021 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.021 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.021 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:30.021 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:19:30.021 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: from='client.? 172.21.15.175:0/2317202313' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:19:30.021 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:30.021 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.021 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:29 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: mon.b calling monitor election 2024-09-21T06:19:30.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:30.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: Updating smithi063:/etc/ceph/ceph.conf 2024-09-21T06:19:30.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-21T06:19:30.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-21T06:19:30.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: Updating smithi063:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:30.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: Updating smithi175:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:30.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: Updating smithi071:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:30.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: mon.b calling monitor election 2024-09-21T06:19:30.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: mon.c calling monitor election 2024-09-21T06:19:30.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: mon.a calling monitor election 2024-09-21T06:19:30.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T06:19:30.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: monmap epoch 3 2024-09-21T06:19:30.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: fsid 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:19:30.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: last_changed 2024-09-21T06:19:22.559181+0000 2024-09-21T06:19:30.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: created 2024-09-21T06:17:43.635151+0000 2024-09-21T06:19:30.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: min_mon_release 19 (squid) 2024-09-21T06:19:30.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: election_strategy: 1 2024-09-21T06:19:30.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: 0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-21T06:19:30.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-21T06:19:30.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: 2: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-09-21T06:19:30.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: fsmap 2024-09-21T06:19:30.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:19:30.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: mgrmap e14: x(active, since 52s) 2024-09-21T06:19:30.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: overall HEALTH_OK 2024-09-21T06:19:30.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.336 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:19:30.336 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:19:30.336 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:30.336 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:30 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1389512075' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:30.378 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T06:19:30.378 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:19:30.378 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T06:19:30.406 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:19:30.406 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:19:30.472 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:19:30.473 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T06:19:30.505 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:19:30.505 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:19:30.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: mon.b calling monitor election 2024-09-21T06:19:30.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:30.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: Updating smithi063:/etc/ceph/ceph.conf 2024-09-21T06:19:30.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-21T06:19:30.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-21T06:19:30.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: Updating smithi063:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:30.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: Updating smithi175:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:30.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: Updating smithi071:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:30.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: mon.b calling monitor election 2024-09-21T06:19:30.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: mon.c calling monitor election 2024-09-21T06:19:30.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: mon.a calling monitor election 2024-09-21T06:19:30.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T06:19:30.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: monmap epoch 3 2024-09-21T06:19:30.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: fsid 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:19:30.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: last_changed 2024-09-21T06:19:22.559181+0000 2024-09-21T06:19:30.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: created 2024-09-21T06:17:43.635151+0000 2024-09-21T06:19:30.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: min_mon_release 19 (squid) 2024-09-21T06:19:30.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: election_strategy: 1 2024-09-21T06:19:30.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: 0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-21T06:19:30.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-21T06:19:30.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: 2: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-09-21T06:19:30.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: fsmap 2024-09-21T06:19:30.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:19:30.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: mgrmap e14: x(active, since 52s) 2024-09-21T06:19:30.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: overall HEALTH_OK 2024-09-21T06:19:30.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:19:30.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:19:30.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:30.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:30 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1389512075' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:30.549 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T06:19:30.550 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T06:19:30.578 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: mon.b calling monitor election 2024-09-21T06:19:30.578 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:30.578 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: Updating smithi063:/etc/ceph/ceph.conf 2024-09-21T06:19:30.578 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-21T06:19:30.578 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-21T06:19:30.578 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: Updating smithi063:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:30.578 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: Updating smithi175:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:30.578 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: Updating smithi071:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:30.578 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: mon.b calling monitor election 2024-09-21T06:19:30.578 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: mon.c calling monitor election 2024-09-21T06:19:30.578 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: mon.a calling monitor election 2024-09-21T06:19:30.578 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T06:19:30.578 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: monmap epoch 3 2024-09-21T06:19:30.579 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: fsid 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:19:30.579 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: last_changed 2024-09-21T06:19:22.559181+0000 2024-09-21T06:19:30.579 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: created 2024-09-21T06:17:43.635151+0000 2024-09-21T06:19:30.579 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: min_mon_release 19 (squid) 2024-09-21T06:19:30.579 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: election_strategy: 1 2024-09-21T06:19:30.579 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: 0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-21T06:19:30.579 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-21T06:19:30.579 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: 2: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-09-21T06:19:30.579 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: fsmap 2024-09-21T06:19:30.579 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:19:30.579 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: mgrmap e14: x(active, since 52s) 2024-09-21T06:19:30.579 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: overall HEALTH_OK 2024-09-21T06:19:30.579 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.579 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.579 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.580 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.580 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.580 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.580 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.580 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.580 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.580 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.580 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:30.580 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:19:30.580 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:19:30.580 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:30.580 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:30 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1389512075' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:30.582 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T06:19:30.582 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:19:30.650 INFO:tasks.cephadm:enabling module snap_schedule 2024-09-21T06:19:30.651 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-09-21T06:19:31.131 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:31.491 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:31 smithi063 ceph-mon[31150]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T06:19:31.491 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:31 smithi063 ceph-mon[31150]: Reconfiguring daemon mon.a on smithi063 2024-09-21T06:19:31.491 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:31 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:31.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:31 smithi175 ceph-mon[34510]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T06:19:31.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:31 smithi175 ceph-mon[34510]: Reconfiguring daemon mon.a on smithi063 2024-09-21T06:19:31.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:31 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:31.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:31 smithi071 ceph-mon[34844]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T06:19:31.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:31 smithi071 ceph-mon[34844]: Reconfiguring daemon mon.a on smithi063 2024-09-21T06:19:31.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:31 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:32.832 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:32 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: ignoring --setuser ceph since I am not root 2024-09-21T06:19:32.833 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:32 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: ignoring --setgroup ceph since I am not root 2024-09-21T06:19:32.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:32 smithi063 ceph-mon[31150]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:32.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:32 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:32.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:32 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:32.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:32 smithi063 ceph-mon[31150]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:19:32.834 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:32 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:19:32.834 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:32 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:19:32.834 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:32 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:32.834 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:32 smithi063 ceph-mon[31150]: Reconfiguring daemon mon.b on smithi071 2024-09-21T06:19:32.834 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:32 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1761335985' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T06:19:32.834 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:32 smithi063 ceph-mon[31150]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:32.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:32 smithi175 ceph-mon[34510]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:32.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:32 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:32.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:32 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:32.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:32 smithi175 ceph-mon[34510]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:19:32.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:32 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:19:32.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:32 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:19:32.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:32 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:32.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:32 smithi175 ceph-mon[34510]: Reconfiguring daemon mon.b on smithi071 2024-09-21T06:19:32.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:32 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1761335985' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T06:19:32.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:32 smithi175 ceph-mon[34510]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:32.877 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:32 smithi071 ceph-mon[34844]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:32.877 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:32 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:32.877 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:32 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:32.877 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:32 smithi071 ceph-mon[34844]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:19:32.877 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:32 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:19:32.877 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:32 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:19:32.877 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:32 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:32.877 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:32 smithi071 ceph-mon[34844]: Reconfiguring daemon mon.b on smithi071 2024-09-21T06:19:32.877 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:32 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1761335985' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T06:19:32.877 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:32 smithi071 ceph-mon[34844]: from='mgr.14152 172.21.15.63:0/4105750783' entity='mgr.x' 2024-09-21T06:19:33.177 INFO:tasks.cephadm:Adding mgr.x on smithi063 2024-09-21T06:19:33.178 INFO:tasks.cephadm:Adding mgr.y on smithi071 2024-09-21T06:19:33.178 INFO:tasks.cephadm:Adding mgr.z on smithi175 2024-09-21T06:19:33.178 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi063=x;smithi071=y;smithi175=z' 2024-09-21T06:19:33.434 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:19:33.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:33 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1761335985' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T06:19:33.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:33 smithi063 ceph-mon[31150]: mgrmap e15: x(active, since 55s) 2024-09-21T06:19:33.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:33 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1761335985' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T06:19:33.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:33 smithi175 ceph-mon[34510]: mgrmap e15: x(active, since 55s) 2024-09-21T06:19:34.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:33 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1761335985' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T06:19:34.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:33 smithi071 ceph-mon[34844]: mgrmap e15: x(active, since 55s) 2024-09-21T06:19:38.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:37 smithi063 ceph-mon[31150]: Active manager daemon x restarted 2024-09-21T06:19:38.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:37 smithi063 ceph-mon[31150]: Activating manager daemon x 2024-09-21T06:19:38.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:37 smithi063 ceph-mon[31150]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T06:19:38.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:37 smithi063 ceph-mon[31150]: mgrmap e16: x(active, starting, since 0.00487675s) 2024-09-21T06:19:38.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:19:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:19:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:19:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:19:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:19:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:19:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:37 smithi063 ceph-mon[31150]: Manager daemon x is now available 2024-09-21T06:19:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:37 smithi175 ceph-mon[34510]: Active manager daemon x restarted 2024-09-21T06:19:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:37 smithi175 ceph-mon[34510]: Activating manager daemon x 2024-09-21T06:19:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:37 smithi175 ceph-mon[34510]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T06:19:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:37 smithi175 ceph-mon[34510]: mgrmap e16: x(active, starting, since 0.00487675s) 2024-09-21T06:19:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:19:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:19:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:19:38.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:19:38.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:19:38.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:19:38.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:37 smithi175 ceph-mon[34510]: Manager daemon x is now available 2024-09-21T06:19:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:37 smithi071 ceph-mon[34844]: Active manager daemon x restarted 2024-09-21T06:19:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:37 smithi071 ceph-mon[34844]: Activating manager daemon x 2024-09-21T06:19:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:37 smithi071 ceph-mon[34844]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T06:19:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:37 smithi071 ceph-mon[34844]: mgrmap e16: x(active, starting, since 0.00487675s) 2024-09-21T06:19:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:19:38.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:19:38.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:19:38.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:19:38.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:19:38.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:19:38.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:19:38.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:37 smithi071 ceph-mon[34844]: Manager daemon x is now available 2024-09-21T06:19:38.803 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mgr update... 2024-09-21T06:19:39.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:19:39.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:19:39.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:19:39.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:38 smithi063 ceph-mon[31150]: mgrmap e17: x(active, since 1.01059s) 2024-09-21T06:19:39.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:19:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:19:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:19:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:38 smithi175 ceph-mon[34510]: mgrmap e17: x(active, since 1.01059s) 2024-09-21T06:19:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:39.140 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:19:39.216 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:19:39.216 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:19:39.216 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:38 smithi071 ceph-mon[34844]: mgrmap e17: x(active, since 1.01059s) 2024-09-21T06:19:39.216 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:39.395 DEBUG:teuthology.orchestra.run.smithi071:mgr.y> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T06:19:39.398 DEBUG:teuthology.orchestra.run.smithi175:mgr.z> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T06:19:39.400 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T06:19:39.400 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T06:19:39.403 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T06:19:39.403 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T06:19:39.445 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T06:19:39.445 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T06:19:39.488 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T06:19:39.488 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T06:19:39.532 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T06:19:39.532 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T06:19:39.575 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T06:19:39.575 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T06:19:39.618 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T06:19:39.618 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T06:19:39.662 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T06:19:39.662 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T06:19:39.707 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T06:19:39.707 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T06:19:39.752 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T06:19:39.752 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T06:19:39.767 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:39.769 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T06:19:39.769 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T06:19:39.820 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T06:19:39.820 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T06:19:39.863 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T06:19:39.863 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T06:19:39.906 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T06:19:39.906 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T06:19:39.964 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T06:19:39.964 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T06:19:39.968 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: 2024-09-21T06:19:39.874+0000 7f4c990ab640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:06:19:39] ENGINE Error in HTTPServer.serve 2024-09-21T06:19:39.968 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: Traceback (most recent call last): 2024-09-21T06:19:39.968 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:19:39.968 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: self._connections.run(self.expiration_interval) 2024-09-21T06:19:39.968 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:19:39.968 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: self._run(expiration_interval) 2024-09-21T06:19:39.968 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:19:39.969 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:19:39.969 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:19:39.969 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:19:39.969 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:19:39.969 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: s = self.context.wrap_socket( 2024-09-21T06:19:39.969 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:19:39.969 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: return self.sslsocket_class._create( 2024-09-21T06:19:39.969 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:19:39.969 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: self.do_handshake() 2024-09-21T06:19:39.969 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:19:39.969 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: self._sslobj.do_handshake() 2024-09-21T06:19:39.969 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:19:39.969 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:19:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: 2024-09-21T06:19:40.017 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T06:19:40.018 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T06:19:40.061 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T06:19:40.061 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T06:19:40.111 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T06:19:40.112 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T06:19:40.159 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T06:19:40.159 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T06:19:40.210 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:40.222 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T06:19:40.223 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T06:19:40.265 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-09-21T06:19:40.266 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mgr debug_cephsqlite 20 2024-09-21T06:19:40.309 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T06:19:40.309 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T06:19:40.361 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T06:19:40.361 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T06:19:40.413 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T06:19:40.413 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T06:19:40.468 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-09-21T06:19:40.468 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-09-21T06:19:40.524 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-09-21T06:19:40.524 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-09-21T06:19:40.575 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-09-21T06:19:40.575 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-09-21T06:19:40.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:40 smithi063 ceph-mon[31150]: Saving service mgr spec with placement smithi063=x;smithi071=y;smithi175=z;count:3 2024-09-21T06:19:40.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:40 smithi063 ceph-mon[31150]: [21/Sep/2024:06:19:39] ENGINE Bus STARTING 2024-09-21T06:19:40.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:40.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.592 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T06:19:40.592 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T06:19:40.646 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T06:19:40.646 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T06:19:40.698 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T06:19:40.698 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T06:19:40.755 DEBUG:tasks.cephadm:set 30 configs 2024-09-21T06:19:40.755 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi063') 2024-09-21T06:19:40.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:40 smithi071 ceph-mon[34844]: Saving service mgr spec with placement smithi063=x;smithi071=y;smithi175=z;count:3 2024-09-21T06:19:40.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:40 smithi071 ceph-mon[34844]: [21/Sep/2024:06:19:39] ENGINE Bus STARTING 2024-09-21T06:19:40.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:40.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:40 smithi175 ceph-mon[34510]: Saving service mgr spec with placement smithi063=x;smithi071=y;smithi175=z;count:3 2024-09-21T06:19:40.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:40 smithi175 ceph-mon[34510]: [21/Sep/2024:06:19:39] ENGINE Bus STARTING 2024-09-21T06:19:40.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:40.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:40.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:41.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:41 smithi063 ceph-mon[31150]: [21/Sep/2024:06:19:39] ENGINE Serving on http://172.21.15.63:8765 2024-09-21T06:19:41.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:41 smithi063 ceph-mon[31150]: [21/Sep/2024:06:19:39] ENGINE Serving on https://172.21.15.63:7150 2024-09-21T06:19:41.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:41 smithi063 ceph-mon[31150]: [21/Sep/2024:06:19:39] ENGINE Bus STARTED 2024-09-21T06:19:41.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:41 smithi063 ceph-mon[31150]: [21/Sep/2024:06:19:39] ENGINE Error in HTTPServer.serve 2024-09-21T06:19:41.583 INFO:journalctl@ceph.mon.a.smithi063.stdout: Traceback (most recent call last): 2024-09-21T06:19:41.583 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:19:41.583 INFO:journalctl@ceph.mon.a.smithi063.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:19:41.583 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:19:41.583 INFO:journalctl@ceph.mon.a.smithi063.stdout: self._run(expiration_interval) 2024-09-21T06:19:41.583 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:19:41.583 INFO:journalctl@ceph.mon.a.smithi063.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:19:41.584 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:19:41.584 INFO:journalctl@ceph.mon.a.smithi063.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:19:41.584 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:19:41.584 INFO:journalctl@ceph.mon.a.smithi063.stdout: s = self.context.wrap_socket( 2024-09-21T06:19:41.584 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:19:41.584 INFO:journalctl@ceph.mon.a.smithi063.stdout: return self.sslsocket_class._create( 2024-09-21T06:19:41.584 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:19:41.584 INFO:journalctl@ceph.mon.a.smithi063.stdout: self.do_handshake() 2024-09-21T06:19:41.584 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:19:41.584 INFO:journalctl@ceph.mon.a.smithi063.stdout: self._sslobj.do_handshake() 2024-09-21T06:19:41.584 INFO:journalctl@ceph.mon.a.smithi063.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:19:41.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:41 smithi063 ceph-mon[31150]: mgrmap e18: x(active, since 2s) 2024-09-21T06:19:41.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:41 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:41.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:41 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:41.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:41 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:41.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:41 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/4282636590' entity='client.admin' 2024-09-21T06:19:41.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:41 smithi071 ceph-mon[34844]: [21/Sep/2024:06:19:39] ENGINE Serving on http://172.21.15.63:8765 2024-09-21T06:19:41.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:41 smithi071 ceph-mon[34844]: [21/Sep/2024:06:19:39] ENGINE Serving on https://172.21.15.63:7150 2024-09-21T06:19:41.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:41 smithi071 ceph-mon[34844]: [21/Sep/2024:06:19:39] ENGINE Bus STARTED 2024-09-21T06:19:41.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:41 smithi071 ceph-mon[34844]: [21/Sep/2024:06:19:39] ENGINE Error in HTTPServer.serve 2024-09-21T06:19:41.769 INFO:journalctl@ceph.mon.b.smithi071.stdout: Traceback (most recent call last): 2024-09-21T06:19:41.769 INFO:journalctl@ceph.mon.b.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:19:41.769 INFO:journalctl@ceph.mon.b.smithi071.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:19:41.769 INFO:journalctl@ceph.mon.b.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:19:41.769 INFO:journalctl@ceph.mon.b.smithi071.stdout: self._run(expiration_interval) 2024-09-21T06:19:41.769 INFO:journalctl@ceph.mon.b.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:19:41.769 INFO:journalctl@ceph.mon.b.smithi071.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:19:41.769 INFO:journalctl@ceph.mon.b.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:19:41.769 INFO:journalctl@ceph.mon.b.smithi071.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:19:41.769 INFO:journalctl@ceph.mon.b.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:19:41.769 INFO:journalctl@ceph.mon.b.smithi071.stdout: s = self.context.wrap_socket( 2024-09-21T06:19:41.769 INFO:journalctl@ceph.mon.b.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:19:41.769 INFO:journalctl@ceph.mon.b.smithi071.stdout: return self.sslsocket_class._create( 2024-09-21T06:19:41.769 INFO:journalctl@ceph.mon.b.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:19:41.770 INFO:journalctl@ceph.mon.b.smithi071.stdout: self.do_handshake() 2024-09-21T06:19:41.770 INFO:journalctl@ceph.mon.b.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:19:41.770 INFO:journalctl@ceph.mon.b.smithi071.stdout: self._sslobj.do_handshake() 2024-09-21T06:19:41.770 INFO:journalctl@ceph.mon.b.smithi071.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:19:41.770 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:41 smithi071 ceph-mon[34844]: mgrmap e18: x(active, since 2s) 2024-09-21T06:19:41.770 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:41 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:41.770 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:41 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:41.770 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:41 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:41.770 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:41 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/4282636590' entity='client.admin' 2024-09-21T06:19:41.771 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi063') 2024-09-21T06:19:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:41 smithi175 ceph-mon[34510]: [21/Sep/2024:06:19:39] ENGINE Serving on http://172.21.15.63:8765 2024-09-21T06:19:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:41 smithi175 ceph-mon[34510]: [21/Sep/2024:06:19:39] ENGINE Serving on https://172.21.15.63:7150 2024-09-21T06:19:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:41 smithi175 ceph-mon[34510]: [21/Sep/2024:06:19:39] ENGINE Bus STARTED 2024-09-21T06:19:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:41 smithi175 ceph-mon[34510]: [21/Sep/2024:06:19:39] ENGINE Error in HTTPServer.serve 2024-09-21T06:19:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout: Traceback (most recent call last): 2024-09-21T06:19:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:19:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:19:41.850 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:19:41.850 INFO:journalctl@ceph.mon.c.smithi175.stdout: self._run(expiration_interval) 2024-09-21T06:19:41.850 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:19:41.850 INFO:journalctl@ceph.mon.c.smithi175.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:19:41.850 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:19:41.850 INFO:journalctl@ceph.mon.c.smithi175.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:19:41.850 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:19:41.850 INFO:journalctl@ceph.mon.c.smithi175.stdout: s = self.context.wrap_socket( 2024-09-21T06:19:41.850 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:19:41.850 INFO:journalctl@ceph.mon.c.smithi175.stdout: return self.sslsocket_class._create( 2024-09-21T06:19:41.850 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:19:41.850 INFO:journalctl@ceph.mon.c.smithi175.stdout: self.do_handshake() 2024-09-21T06:19:41.850 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:19:41.851 INFO:journalctl@ceph.mon.c.smithi175.stdout: self._sslobj.do_handshake() 2024-09-21T06:19:41.851 INFO:journalctl@ceph.mon.c.smithi175.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:19:41.851 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:41 smithi175 ceph-mon[34510]: mgrmap e18: x(active, since 2s) 2024-09-21T06:19:41.851 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:41 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:41.851 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:41 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:41.851 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:41 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:41.851 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:41 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/4282636590' entity='client.admin' 2024-09-21T06:19:42.378 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi063') 2024-09-21T06:19:42.546 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:42.554 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:42.565 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:42.568 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:42.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:42 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/46734216' entity='client.admin' 2024-09-21T06:19:42.584 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:42.594 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:42.607 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:42.608 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:42.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:42 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/46734216' entity='client.admin' 2024-09-21T06:19:42.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:42 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/46734216' entity='client.admin' 2024-09-21T06:19:45.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:44 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/383766407' entity='client.admin' 2024-09-21T06:19:45.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:44 smithi071 ceph-mon[34844]: from='client.? ' entity='client.admin' 2024-09-21T06:19:45.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:44 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2284973849' entity='client.admin' 2024-09-21T06:19:45.318 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:44 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/383766407' entity='client.admin' 2024-09-21T06:19:45.318 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:44 smithi063 ceph-mon[31150]: from='client.? ' entity='client.admin' 2024-09-21T06:19:45.318 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:44 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2284973849' entity='client.admin' 2024-09-21T06:19:45.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:44 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/383766407' entity='client.admin' 2024-09-21T06:19:45.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:44 smithi175 ceph-mon[34510]: from='client.? ' entity='client.admin' 2024-09-21T06:19:45.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:44 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2284973849' entity='client.admin' 2024-09-21T06:19:46.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:46.332+0000 7ff2eefba640 1 -- 172.21.15.63:0/1953581988 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff2d803fb70 msgr2=0x7ff2d8042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:46.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:46.332+0000 7ff2eefba640 1 --2- 172.21.15.63:0/1953581988 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff2d803fb70 0x7ff2d8042080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4009bb0 tx=0x7ff2d4005f90 comp rx=0 tx=0).stop 2024-09-21T06:19:46.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:46.332+0000 7ff2eefba640 1 -- 172.21.15.63:0/1953581988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2e806c6c0 msgr2=0x7ff2e8199d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:46.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:46.332+0000 7ff2eefba640 1 --2- 172.21.15.63:0/1953581988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2e806c6c0 0x7ff2e8199d90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00d950 tx=0x7ff2dc00de10 comp rx=0 tx=0).stop 2024-09-21T06:19:46.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:46.332+0000 7ff2eefba640 1 -- 172.21.15.63:0/1953581988 shutdown_connections 2024-09-21T06:19:46.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:46.332+0000 7ff2eefba640 1 --2- 172.21.15.63:0/1953581988 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff2d803fb70 0x7ff2d8042080 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:46.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:46.332+0000 7ff2eefba640 1 --2- 172.21.15.63:0/1953581988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2e8109470 0x7ff2e819afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:46.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:46.332+0000 7ff2eefba640 1 --2- 172.21.15.63:0/1953581988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2e81068d0 0x7ff2e819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:46.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:46.332+0000 7ff2eefba640 1 --2- 172.21.15.63:0/1953581988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2e806c6c0 0x7ff2e8199d90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:46.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:46.332+0000 7ff2eefba640 1 -- 172.21.15.63:0/1953581988 >> 172.21.15.63:0/1953581988 conn(0x7ff2e80fdfb0 msgr2=0x7ff2e8104e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:46.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:46.332+0000 7ff2eefba640 1 -- 172.21.15.63:0/1953581988 shutdown_connections 2024-09-21T06:19:46.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:46.332+0000 7ff2eefba640 1 -- 172.21.15.63:0/1953581988 wait complete. 2024-09-21T06:19:47.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi063", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:47.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:47.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:19:47.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: Updating smithi063:/etc/ceph/ceph.conf 2024-09-21T06:19:47.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-21T06:19:47.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-21T06:19:47.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: Updating smithi063:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:47.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: Updating smithi071:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:47.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: Updating smithi175:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:47.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:19:47.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:19:47.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:19:47.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: Updating smithi063:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:19:47.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: Updating smithi071:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:19:47.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: Updating smithi175:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:19:47.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1953581988' entity='client.admin' 2024-09-21T06:19:47.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.102 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.102 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:19:47.102 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:19:47.102 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:19:47.102 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:47.102 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:46 smithi175 ceph-mon[34510]: Deploying daemon mgr.z on smithi175 2024-09-21T06:19:47.143 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.143 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.143 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi063", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:47.143 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:47.143 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:19:47.143 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: Updating smithi063:/etc/ceph/ceph.conf 2024-09-21T06:19:47.143 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-21T06:19:47.144 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-21T06:19:47.144 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: Updating smithi063:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:47.144 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: Updating smithi071:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:47.144 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: Updating smithi175:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:47.144 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:19:47.144 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:19:47.144 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:19:47.144 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: Updating smithi063:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:19:47.144 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: Updating smithi071:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:19:47.144 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: Updating smithi175:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:19:47.144 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1953581988' entity='client.admin' 2024-09-21T06:19:47.144 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.145 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.145 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.145 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.145 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.145 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.145 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.145 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:19:47.145 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:19:47.145 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:19:47.145 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:47.145 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:46 smithi063 ceph-mon[31150]: Deploying daemon mgr.z on smithi175 2024-09-21T06:19:47.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.235+0000 7f2e1e480640 1 -- 172.21.15.63:0/3804994414 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e181094c0 msgr2=0x7f2e1810b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:47.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.235+0000 7f2e1e480640 1 --2- 172.21.15.63:0/3804994414 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e181094c0 0x7f2e1810b9d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009ca0 tx=0x7f2e1002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.235+0000 7f2e1e480640 1 -- 172.21.15.63:0/3804994414 shutdown_connections 2024-09-21T06:19:47.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.235+0000 7f2e1e480640 1 --2- 172.21.15.63:0/3804994414 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e181094c0 0x7f2e1810b9d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.235+0000 7f2e1e480640 1 --2- 172.21.15.63:0/3804994414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e18106920 0x7f2e18108d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.235+0000 7f2e1e480640 1 --2- 172.21.15.63:0/3804994414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e1806c340 0x7f2e181063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.236+0000 7f2e1e480640 1 -- 172.21.15.63:0/3804994414 >> 172.21.15.63:0/3804994414 conn(0x7f2e180fe000 msgr2=0x7f2e181004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:47.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.236+0000 7f2e1e480640 1 -- 172.21.15.63:0/3804994414 shutdown_connections 2024-09-21T06:19:47.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.236+0000 7f2e1e480640 1 -- 172.21.15.63:0/3804994414 wait complete. 2024-09-21T06:19:47.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.236+0000 7f2e1e480640 1 Processor -- start 2024-09-21T06:19:47.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.236+0000 7f2e1e480640 1 -- start start 2024-09-21T06:19:47.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.237+0000 7f2e1e480640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e1806c340 0x7f2e1819c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:47.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.237+0000 7f2e1e480640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e18106920 0x7f2e1819c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:47.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.237+0000 7f2e1e480640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e181094c0 0x7f2e1819d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:47.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.237+0000 7f2e1e480640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1810f2a0 con 0x7f2e18106920 2024-09-21T06:19:47.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.237+0000 7f2e1e480640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1810f120 con 0x7f2e181094c0 2024-09-21T06:19:47.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.237+0000 7f2e1e480640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1810f420 con 0x7f2e1806c340 2024-09-21T06:19:47.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.237+0000 7f2e177fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e18106920 0x7f2e1819c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:47.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.237+0000 7f2e17fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e1806c340 0x7f2e1819c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:47.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.237+0000 7f2e177fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e18106920 0x7f2e1819c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54150/0 (socket says 172.21.15.63:54150) 2024-09-21T06:19:47.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.237+0000 7f2e177fe640 1 -- 172.21.15.63:0/3355007557 learned_addr learned my addr 172.21.15.63:0/3355007557 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:19:47.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.237+0000 7f2e1ca1d640 1 --2- 172.21.15.63:0/3355007557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e181094c0 0x7f2e1819d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:47.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.237+0000 7f2e177fe640 1 -- 172.21.15.63:0/3355007557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e1806c340 msgr2=0x7f2e1819c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:47.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.237+0000 7f2e177fe640 1 --2- 172.21.15.63:0/3355007557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e1806c340 0x7f2e1819c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.237+0000 7f2e177fe640 1 -- 172.21.15.63:0/3355007557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e181094c0 msgr2=0x7f2e1819d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:47.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.237+0000 7f2e177fe640 1 --2- 172.21.15.63:0/3355007557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e181094c0 0x7f2e1819d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.237+0000 7f2e177fe640 1 -- 172.21.15.63:0/3355007557 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1819db00 con 0x7f2e18106920 2024-09-21T06:19:47.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.237+0000 7f2e17fff640 1 --2- 172.21.15.63:0/3355007557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e1806c340 0x7f2e1819c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:19:47.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.237+0000 7f2e177fe640 1 --2- 172.21.15.63:0/3355007557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e18106920 0x7f2e1819c740 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00d770 tx=0x7f2e0c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:47.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.238+0000 7f2e157fa640 1 -- 172.21.15.63:0/3355007557 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c017070 con 0x7f2e18106920 2024-09-21T06:19:47.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.238+0000 7f2e157fa640 1 -- 172.21.15.63:0/3355007557 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f2e0c0054b0 con 0x7f2e18106920 2024-09-21T06:19:47.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.238+0000 7f2e1e480640 1 -- 172.21.15.63:0/3355007557 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e1819ddf0 con 0x7f2e18106920 2024-09-21T06:19:47.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.238+0000 7f2e157fa640 1 -- 172.21.15.63:0/3355007557 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c004c70 con 0x7f2e18106920 2024-09-21T06:19:47.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.238+0000 7f2e1e480640 1 -- 172.21.15.63:0/3355007557 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e181a44f0 con 0x7f2e18106920 2024-09-21T06:19:47.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.239+0000 7f2e157fa640 1 -- 172.21.15.63:0/3355007557 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f2e0c010460 con 0x7f2e18106920 2024-09-21T06:19:47.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.239+0000 7f2e1e480640 1 -- 172.21.15.63:0/3355007557 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e18106d70 con 0x7f2e18106920 2024-09-21T06:19:47.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.239+0000 7f2e157fa640 1 --2- 172.21.15.63:0/3355007557 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2e0003fb70 0x7f2e00042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:47.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.239+0000 7f2e157fa640 1 -- 172.21.15.63:0/3355007557 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f2e0c053f80 con 0x7f2e18106920 2024-09-21T06:19:47.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.239+0000 7f2e17fff640 1 --2- 172.21.15.63:0/3355007557 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2e0003fb70 0x7f2e00042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:47.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.240+0000 7f2e17fff640 1 --2- 172.21.15.63:0/3355007557 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2e0003fb70 0x7f2e00042080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2e08005d00 tx=0x7f2e0800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:47.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.244+0000 7f2e157fa640 1 -- 172.21.15.63:0/3355007557 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2e0c009c30 con 0x7f2e18106920 2024-09-21T06:19:47.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi063", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:47.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:47.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:19:47.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: Updating smithi063:/etc/ceph/ceph.conf 2024-09-21T06:19:47.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-21T06:19:47.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-21T06:19:47.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: Updating smithi063:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:47.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: Updating smithi071:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:47.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: Updating smithi175:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:19:47.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:19:47.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:19:47.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:19:47.270 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: Updating smithi063:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:19:47.270 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: Updating smithi071:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:19:47.270 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: Updating smithi175:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:19:47.270 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1953581988' entity='client.admin' 2024-09-21T06:19:47.270 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.270 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.270 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.270 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.270 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.270 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.270 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:47.270 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:19:47.270 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:19:47.271 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:19:47.271 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:47.271 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:46 smithi071 ceph-mon[34844]: Deploying daemon mgr.z on smithi175 2024-09-21T06:19:47.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.436+0000 7f0c30fa2640 1 -- 172.21.15.63:0/1653890228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c2c1034f0 msgr2=0x7f0c2c103900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:47.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.436+0000 7f0c30fa2640 1 --2- 172.21.15.63:0/1653890228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c2c1034f0 0x7f0c2c103900 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009900 tx=0x7f0c1402a480 comp rx=0 tx=0).stop 2024-09-21T06:19:47.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.436+0000 7f0c30fa2640 1 -- 172.21.15.63:0/1653890228 shutdown_connections 2024-09-21T06:19:47.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.436+0000 7f0c30fa2640 1 --2- 172.21.15.63:0/1653890228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c2c103e90 0x7f0c2c10a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.436+0000 7f0c30fa2640 1 --2- 172.21.15.63:0/1653890228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c2c1034f0 0x7f0c2c103900 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.436+0000 7f0c30fa2640 1 --2- 172.21.15.63:0/1653890228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c2c102460 0x7f0c2c1028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.436+0000 7f0c30fa2640 1 -- 172.21.15.63:0/1653890228 >> 172.21.15.63:0/1653890228 conn(0x7f0c2c0fddd0 msgr2=0x7f0c2c100280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:47.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.436+0000 7f0c30fa2640 1 -- 172.21.15.63:0/1653890228 shutdown_connections 2024-09-21T06:19:47.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.436+0000 7f0c30fa2640 1 -- 172.21.15.63:0/1653890228 wait complete. 2024-09-21T06:19:47.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.437+0000 7f0c30fa2640 1 Processor -- start 2024-09-21T06:19:47.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.437+0000 7f0c30fa2640 1 -- start start 2024-09-21T06:19:47.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.437+0000 7f2e1e480640 1 -- 172.21.15.63:0/3355007557 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f2e181a47e0 con 0x7f2e18106920 2024-09-21T06:19:47.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.437+0000 7f0c30fa2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c2c102460 0x7f0c2c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:47.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.437+0000 7f0c30fa2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c2c1034f0 0x7f0c2c19ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:47.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.437+0000 7f0c30fa2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c2c103e90 0x7f0c2c1a0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:47.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.437+0000 7f0c30fa2640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c10dff0 con 0x7f0c2c102460 2024-09-21T06:19:47.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.437+0000 7f0c30fa2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c10de70 con 0x7f0c2c1034f0 2024-09-21T06:19:47.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.437+0000 7f0c30fa2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c10e170 con 0x7f0c2c103e90 2024-09-21T06:19:47.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.437+0000 7f0c2b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c2c102460 0x7f0c2c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:47.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.437+0000 7f0c2b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c2c102460 0x7f0c2c06b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54172/0 (socket says 172.21.15.63:54172) 2024-09-21T06:19:47.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.438+0000 7f0c2b7fe640 1 -- 172.21.15.63:0/674137447 learned_addr learned my addr 172.21.15.63:0/674137447 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:19:47.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.438+0000 7f0c2bfff640 1 --2- 172.21.15.63:0/674137447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c2c103e90 0x7f0c2c1a0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:47.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.438+0000 7f0c2affd640 1 --2- 172.21.15.63:0/674137447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c2c1034f0 0x7f0c2c19ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:47.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.438+0000 7f0c2b7fe640 1 -- 172.21.15.63:0/674137447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c2c103e90 msgr2=0x7f0c2c1a0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:47.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.438+0000 7f0c2b7fe640 1 --2- 172.21.15.63:0/674137447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c2c103e90 0x7f0c2c1a0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.438+0000 7f0c2b7fe640 1 -- 172.21.15.63:0/674137447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c2c1034f0 msgr2=0x7f0c2c19ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:47.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.438+0000 7f0c2b7fe640 1 --2- 172.21.15.63:0/674137447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c2c1034f0 0x7f0c2c19ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.438+0000 7f0c2b7fe640 1 -- 172.21.15.63:0/674137447 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c1a17d0 con 0x7f0c2c102460 2024-09-21T06:19:47.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.438+0000 7f0c2b7fe640 1 --2- 172.21.15.63:0/674137447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c2c102460 0x7f0c2c06b6c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00ebc0 tx=0x7f0c1c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:47.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.438+0000 7f0c28ff9640 1 -- 172.21.15.63:0/674137447 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c010630 con 0x7f0c2c102460 2024-09-21T06:19:47.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.438+0000 7f0c28ff9640 1 -- 172.21.15.63:0/674137447 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0c1c010c60 con 0x7f0c2c102460 2024-09-21T06:19:47.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.438+0000 7f0c30fa2640 1 -- 172.21.15.63:0/674137447 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2c1a1ac0 con 0x7f0c2c102460 2024-09-21T06:19:47.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.438+0000 7f0c28ff9640 1 -- 172.21.15.63:0/674137447 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c018b10 con 0x7f0c2c102460 2024-09-21T06:19:47.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.439+0000 7f0c30fa2640 1 -- 172.21.15.63:0/674137447 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2c1a2000 con 0x7f0c2c102460 2024-09-21T06:19:47.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.439+0000 7f0c30fa2640 1 -- 172.21.15.63:0/674137447 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c2c1028d0 con 0x7f0c2c102460 2024-09-21T06:19:47.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.441+0000 7f2e157fa640 1 -- 172.21.15.63:0/3355007557 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v16)=0 v16) ==== 117+0+0 (secure 0 0 0) 0x7f2e0c022300 con 0x7f2e18106920 2024-09-21T06:19:47.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.443+0000 7f0c28ff9640 1 -- 172.21.15.63:0/674137447 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f0c1c018cb0 con 0x7f0c2c102460 2024-09-21T06:19:47.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.443+0000 7f0c28ff9640 1 --2- 172.21.15.63:0/674137447 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0c1803fb70 0x7f0c18042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:47.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.443+0000 7f0c28ff9640 1 -- 172.21.15.63:0/674137447 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0c1c054fa0 con 0x7f0c2c102460 2024-09-21T06:19:47.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.443+0000 7f0c2affd640 1 --2- 172.21.15.63:0/674137447 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0c1803fb70 0x7f0c18042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:47.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.444+0000 7f2e1e480640 1 -- 172.21.15.63:0/3355007557 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2e0003fb70 msgr2=0x7f2e00042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:47.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.444+0000 7f2e1e480640 1 --2- 172.21.15.63:0/3355007557 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2e0003fb70 0x7f2e00042080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2e08005d00 tx=0x7f2e0800b410 comp rx=0 tx=0).stop 2024-09-21T06:19:47.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.444+0000 7f2e1e480640 1 -- 172.21.15.63:0/3355007557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e18106920 msgr2=0x7f2e1819c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:47.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.444+0000 7f2e1e480640 1 --2- 172.21.15.63:0/3355007557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e18106920 0x7f2e1819c740 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00d770 tx=0x7f2e0c00dc30 comp rx=0 tx=0).stop 2024-09-21T06:19:47.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.444+0000 7f0c2affd640 1 --2- 172.21.15.63:0/674137447 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0c1803fb70 0x7f0c18042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0c14005790 tx=0x7f0c14005720 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:47.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.444+0000 7f2e1e480640 1 -- 172.21.15.63:0/3355007557 shutdown_connections 2024-09-21T06:19:47.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.444+0000 7f2e1e480640 1 --2- 172.21.15.63:0/3355007557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e181094c0 0x7f2e1819d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.444+0000 7f2e1e480640 1 --2- 172.21.15.63:0/3355007557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e18106920 0x7f2e1819c740 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.444+0000 7f2e1e480640 1 --2- 172.21.15.63:0/3355007557 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2e0003fb70 0x7f2e00042080 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.444+0000 7f2e1e480640 1 --2- 172.21.15.63:0/3355007557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e1806c340 0x7f2e1819c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.444+0000 7f2e1e480640 1 -- 172.21.15.63:0/3355007557 >> 172.21.15.63:0/3355007557 conn(0x7f2e180fe000 msgr2=0x7f2e18100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:47.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.444+0000 7f2e1e480640 1 -- 172.21.15.63:0/3355007557 shutdown_connections 2024-09-21T06:19:47.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.444+0000 7f2e1e480640 1 -- 172.21.15.63:0/3355007557 wait complete. 2024-09-21T06:19:47.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.451+0000 7f0c28ff9640 1 -- 172.21.15.63:0/674137447 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0c1c004dd0 con 0x7f0c2c102460 2024-09-21T06:19:47.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.646+0000 7f0c30fa2640 1 -- 172.21.15.63:0/674137447 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f0c2c109620 con 0x7f0c2c102460 2024-09-21T06:19:47.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.651+0000 7f0c28ff9640 1 -- 172.21.15.63:0/674137447 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v17)=0 v17) ==== 123+0+0 (secure 0 0 0) 0x7f0c2c109620 con 0x7f0c2c102460 2024-09-21T06:19:47.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.652+0000 7f0c28ff9640 1 -- 172.21.15.63:0/674137447 <== mon.0 v2:172.21.15.63:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c1c018420 con 0x7f0c2c102460 2024-09-21T06:19:47.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.653+0000 7f0c30fa2640 1 -- 172.21.15.63:0/674137447 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0c1803fb70 msgr2=0x7f0c18042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:47.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.653+0000 7f0c30fa2640 1 --2- 172.21.15.63:0/674137447 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0c1803fb70 0x7f0c18042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0c14005790 tx=0x7f0c14005720 comp rx=0 tx=0).stop 2024-09-21T06:19:47.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.653+0000 7f0c30fa2640 1 -- 172.21.15.63:0/674137447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c2c102460 msgr2=0x7f0c2c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:47.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.653+0000 7f0c30fa2640 1 --2- 172.21.15.63:0/674137447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c2c102460 0x7f0c2c06b6c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00ebc0 tx=0x7f0c1c00c6a0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.653+0000 7f0c30fa2640 1 -- 172.21.15.63:0/674137447 shutdown_connections 2024-09-21T06:19:47.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.653+0000 7f0c30fa2640 1 --2- 172.21.15.63:0/674137447 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0c1803fb70 0x7f0c18042080 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.653+0000 7f0c30fa2640 1 --2- 172.21.15.63:0/674137447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c2c103e90 0x7f0c2c1a0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.653+0000 7f0c30fa2640 1 --2- 172.21.15.63:0/674137447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c2c1034f0 0x7f0c2c19ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.653+0000 7f0c30fa2640 1 --2- 172.21.15.63:0/674137447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c2c102460 0x7f0c2c06b6c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.653+0000 7f0c30fa2640 1 -- 172.21.15.63:0/674137447 >> 172.21.15.63:0/674137447 conn(0x7f0c2c0fddd0 msgr2=0x7f0c2c1067f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:47.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.654+0000 7f0c30fa2640 1 -- 172.21.15.63:0/674137447 shutdown_connections 2024-09-21T06:19:47.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.654+0000 7f0c30fa2640 1 -- 172.21.15.63:0/674137447 wait complete. 2024-09-21T06:19:47.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.655+0000 7f230b6c1640 1 -- 172.21.15.63:0/2928359173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2304103bc0 msgr2=0x7f2304103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:47.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.655+0000 7f230b6c1640 1 --2- 172.21.15.63:0/2928359173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2304103bc0 0x7f2304103fd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009ca0 tx=0x7f22f402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.655+0000 7f230b6c1640 1 -- 172.21.15.63:0/2928359173 shutdown_connections 2024-09-21T06:19:47.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.655+0000 7f230b6c1640 1 --2- 172.21.15.63:0/2928359173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2304109e00 0x7f2304110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.655+0000 7f230b6c1640 1 --2- 172.21.15.63:0/2928359173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23041094b0 0x7f23041098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.655+0000 7f230b6c1640 1 --2- 172.21.15.63:0/2928359173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2304103bc0 0x7f2304103fd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.655+0000 7f230b6c1640 1 -- 172.21.15.63:0/2928359173 >> 172.21.15.63:0/2928359173 conn(0x7f230407b910 msgr2=0x7f230407bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:47.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.655+0000 7f230b6c1640 1 -- 172.21.15.63:0/2928359173 shutdown_connections 2024-09-21T06:19:47.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.655+0000 7f230b6c1640 1 -- 172.21.15.63:0/2928359173 wait complete. 2024-09-21T06:19:47.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.656+0000 7f230b6c1640 1 Processor -- start 2024-09-21T06:19:47.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.656+0000 7f230b6c1640 1 -- start start 2024-09-21T06:19:47.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.656+0000 7f230b6c1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2304103bc0 0x7f230419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:47.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.656+0000 7f230b6c1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23041094b0 0x7f230419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:47.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.656+0000 7f230b6c1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2304109e00 0x7f230419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:47.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.656+0000 7f230b6c1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2304113ac0 con 0x7f23041094b0 2024-09-21T06:19:47.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.656+0000 7f230b6c1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2304113940 con 0x7f2304103bc0 2024-09-21T06:19:47.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.656+0000 7f230b6c1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2304113c40 con 0x7f2304109e00 2024-09-21T06:19:47.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.657+0000 7f2308c5c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23041094b0 0x7f230419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:47.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.657+0000 7f2308c5c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23041094b0 0x7f230419aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54184/0 (socket says 172.21.15.63:54184) 2024-09-21T06:19:47.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.657+0000 7f2308c5c640 1 -- 172.21.15.63:0/2191343552 learned_addr learned my addr 172.21.15.63:0/2191343552 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:19:47.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.657+0000 7f230945d640 1 --2- 172.21.15.63:0/2191343552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2304103bc0 0x7f230419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:47.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.657+0000 7f2309c5e640 1 --2- 172.21.15.63:0/2191343552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2304109e00 0x7f230419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:47.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.657+0000 7f2308c5c640 1 -- 172.21.15.63:0/2191343552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2304109e00 msgr2=0x7f230419fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:47.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.657+0000 7f2308c5c640 1 --2- 172.21.15.63:0/2191343552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2304109e00 0x7f230419fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.657+0000 7f2308c5c640 1 -- 172.21.15.63:0/2191343552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2304103bc0 msgr2=0x7f230419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:47.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.657+0000 7f2308c5c640 1 --2- 172.21.15.63:0/2191343552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2304103bc0 0x7f230419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.657+0000 7f2308c5c640 1 -- 172.21.15.63:0/2191343552 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23041a0440 con 0x7f23041094b0 2024-09-21T06:19:47.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.657+0000 7f2308c5c640 1 --2- 172.21.15.63:0/2191343552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23041094b0 0x7f230419aa70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f22f800e9f0 tx=0x7f22f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:47.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.657+0000 7f23027fc640 1 -- 172.21.15.63:0/2191343552 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f800ccc0 con 0x7f23041094b0 2024-09-21T06:19:47.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.657+0000 7f23027fc640 1 -- 172.21.15.63:0/2191343552 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22f80108e0 con 0x7f23041094b0 2024-09-21T06:19:47.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.657+0000 7f230b6c1640 1 -- 172.21.15.63:0/2191343552 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23041a0730 con 0x7f23041094b0 2024-09-21T06:19:47.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.657+0000 7f23027fc640 1 -- 172.21.15.63:0/2191343552 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f8018860 con 0x7f23041094b0 2024-09-21T06:19:47.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.658+0000 7f230b6c1640 1 -- 172.21.15.63:0/2191343552 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23041a6e90 con 0x7f23041094b0 2024-09-21T06:19:47.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.658+0000 7f23027fc640 1 -- 172.21.15.63:0/2191343552 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f22f8018a00 con 0x7f23041094b0 2024-09-21T06:19:47.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.659+0000 7f23027fc640 1 --2- 172.21.15.63:0/2191343552 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f22ec03fb70 0x7f22ec042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:47.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.659+0000 7f23027fc640 1 -- 172.21.15.63:0/2191343552 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f22f8055910 con 0x7f23041094b0 2024-09-21T06:19:47.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.659+0000 7f230b6c1640 1 -- 172.21.15.63:0/2191343552 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2304103fd0 con 0x7f23041094b0 2024-09-21T06:19:47.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.659+0000 7f230945d640 1 --2- 172.21.15.63:0/2191343552 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f22ec03fb70 0x7f22ec042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:47.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.659+0000 7f230945d640 1 --2- 172.21.15.63:0/2191343552 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f22ec03fb70 0x7f22ec042080 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f22f4005e30 tx=0x7f22f4009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:47.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.664+0000 7f23027fc640 1 -- 172.21.15.63:0/2191343552 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f22f8020360 con 0x7f23041094b0 2024-09-21T06:19:47.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.854+0000 7f230b6c1640 1 -- 172.21.15.63:0/2191343552 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f230410bbd0 con 0x7f23041094b0 2024-09-21T06:19:47.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.858+0000 7f23027fc640 1 -- 172.21.15.63:0/2191343552 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v18)=0 v18) ==== 108+0+0 (secure 0 0 0) 0x7f22f80071c0 con 0x7f23041094b0 2024-09-21T06:19:47.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.860+0000 7f230b6c1640 1 -- 172.21.15.63:0/2191343552 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f22ec03fb70 msgr2=0x7f22ec042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:47.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.860+0000 7f230b6c1640 1 --2- 172.21.15.63:0/2191343552 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f22ec03fb70 0x7f22ec042080 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f22f4005e30 tx=0x7f22f4009360 comp rx=0 tx=0).stop 2024-09-21T06:19:47.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.860+0000 7f230b6c1640 1 -- 172.21.15.63:0/2191343552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23041094b0 msgr2=0x7f230419aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:47.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.860+0000 7f230b6c1640 1 --2- 172.21.15.63:0/2191343552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23041094b0 0x7f230419aa70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f22f800e9f0 tx=0x7f22f800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.860+0000 7f230b6c1640 1 -- 172.21.15.63:0/2191343552 shutdown_connections 2024-09-21T06:19:47.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.860+0000 7f230b6c1640 1 --2- 172.21.15.63:0/2191343552 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f22ec03fb70 0x7f22ec042080 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.860+0000 7f230b6c1640 1 --2- 172.21.15.63:0/2191343552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2304109e00 0x7f230419fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.860+0000 7f230b6c1640 1 --2- 172.21.15.63:0/2191343552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23041094b0 0x7f230419aa70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.860+0000 7f230b6c1640 1 --2- 172.21.15.63:0/2191343552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2304103bc0 0x7f230419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:47.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.860+0000 7f230b6c1640 1 -- 172.21.15.63:0/2191343552 >> 172.21.15.63:0/2191343552 conn(0x7f230407b910 msgr2=0x7f2304107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:47.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.860+0000 7f230b6c1640 1 -- 172.21.15.63:0/2191343552 shutdown_connections 2024-09-21T06:19:47.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:47.860+0000 7f230b6c1640 1 -- 172.21.15.63:0/2191343552 wait complete. 2024-09-21T06:19:48.349 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 06:19:48 smithi175 systemd[1]: Starting Ceph mgr.z for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:19:48.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:48 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3355007557' entity='client.admin' 2024-09-21T06:19:48.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:48 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/674137447' entity='client.admin' 2024-09-21T06:19:48.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:48 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2191343552' entity='client.admin' 2024-09-21T06:19:48.754 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:48 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3355007557' entity='client.admin' 2024-09-21T06:19:48.754 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:48 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/674137447' entity='client.admin' 2024-09-21T06:19:48.754 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:48 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2191343552' entity='client.admin' 2024-09-21T06:19:48.755 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 06:19:48 smithi175 podman[36364]: 2024-09-21 06:19:48.351375963 +0000 UTC m=+0.016109920 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:19:48.755 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 06:19:48 smithi175 podman[36364]: 2024-09-21 06:19:48.450774499 +0000 UTC m=+0.115508457 container create b37aec2f18e0fbf2cbe38b21b6def672b593e5df184264071b0b815d91795c5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:19:48.755 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 06:19:48 smithi175 podman[36364]: 2024-09-21 06:19:48.653411108 +0000 UTC m=+0.318145068 container init b37aec2f18e0fbf2cbe38b21b6def672b593e5df184264071b0b815d91795c5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-z, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T06:19:48.755 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 06:19:48 smithi175 podman[36364]: 2024-09-21 06:19:48.656748319 +0000 UTC m=+0.321482279 container start b37aec2f18e0fbf2cbe38b21b6def672b593e5df184264071b0b815d91795c5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-z, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:19:48.755 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 06:19:48 smithi175 ceph-mgr[36383]: -- 172.21.15.175:0/4041451656 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5584936fb0e0 con 0x55849849e480 2024-09-21T06:19:48.755 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 06:19:48 smithi175 bash[36364]: b37aec2f18e0fbf2cbe38b21b6def672b593e5df184264071b0b815d91795c5c 2024-09-21T06:19:48.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:48 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3355007557' entity='client.admin' 2024-09-21T06:19:48.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:48 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/674137447' entity='client.admin' 2024-09-21T06:19:48.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:48 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2191343552' entity='client.admin' 2024-09-21T06:19:49.099 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 06:19:48 smithi175 systemd[1]: Started Ceph mgr.z for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:19:49.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.113+0000 7f67d3153640 1 -- 172.21.15.63:0/1746041054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67cc108cf0 msgr2=0x7f67cc10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:49.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.113+0000 7f67d3153640 1 --2- 172.21.15.63:0/1746041054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67cc108cf0 0x7f67cc10f520 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f67c4009ca0 tx=0x7f67c402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:19:49.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.113+0000 7f67d3153640 1 -- 172.21.15.63:0/1746041054 shutdown_connections 2024-09-21T06:19:49.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.113+0000 7f67d3153640 1 --2- 172.21.15.63:0/1746041054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67cc108cf0 0x7f67cc10f520 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:49.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.113+0000 7f67d3153640 1 --2- 172.21.15.63:0/1746041054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67cc1083a0 0x7f67cc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:49.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.113+0000 7f67d3153640 1 --2- 172.21.15.63:0/1746041054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67cc102a60 0x7f67cc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:49.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.113+0000 7f67d3153640 1 -- 172.21.15.63:0/1746041054 >> 172.21.15.63:0/1746041054 conn(0x7f67cc079730 msgr2=0x7f67cc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:49.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.113+0000 7f67d3153640 1 -- 172.21.15.63:0/1746041054 shutdown_connections 2024-09-21T06:19:49.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.113+0000 7f67d3153640 1 -- 172.21.15.63:0/1746041054 wait complete. 2024-09-21T06:19:49.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.114+0000 7f67d3153640 1 Processor -- start 2024-09-21T06:19:49.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.114+0000 7f67d3153640 1 -- start start 2024-09-21T06:19:49.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.114+0000 7f67d3153640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67cc102a60 0x7f67cc1050e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:49.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.114+0000 7f67d3153640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67cc1083a0 0x7f67cc105620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:49.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.114+0000 7f67d3153640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67cc108cf0 0x7f67cc105b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:49.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.114+0000 7f67d3153640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f67cc1129c0 con 0x7f67cc102a60 2024-09-21T06:19:49.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.114+0000 7f67d3153640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f67cc112840 con 0x7f67cc1083a0 2024-09-21T06:19:49.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.114+0000 7f67d3153640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f67cc112b40 con 0x7f67cc108cf0 2024-09-21T06:19:49.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.114+0000 7f67d0eef640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67cc102a60 0x7f67cc1050e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:49.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.114+0000 7f67d0eef640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67cc102a60 0x7f67cc1050e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54204/0 (socket says 172.21.15.63:54204) 2024-09-21T06:19:49.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.114+0000 7f67d0eef640 1 -- 172.21.15.63:0/3473280331 learned_addr learned my addr 172.21.15.63:0/3473280331 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:19:49.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.114+0000 7f67d16f0640 1 --2- 172.21.15.63:0/3473280331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67cc108cf0 0x7f67cc105b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:49.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.115+0000 7f67cbfff640 1 --2- 172.21.15.63:0/3473280331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67cc1083a0 0x7f67cc105620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:49.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.115+0000 7f67d0eef640 1 -- 172.21.15.63:0/3473280331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67cc108cf0 msgr2=0x7f67cc105b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:49.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.115+0000 7f67d0eef640 1 --2- 172.21.15.63:0/3473280331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67cc108cf0 0x7f67cc105b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:49.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.115+0000 7f67d0eef640 1 -- 172.21.15.63:0/3473280331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67cc1083a0 msgr2=0x7f67cc105620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:49.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.115+0000 7f67d0eef640 1 --2- 172.21.15.63:0/3473280331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67cc1083a0 0x7f67cc105620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:49.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.115+0000 7f67d0eef640 1 -- 172.21.15.63:0/3473280331 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67cc1a8730 con 0x7f67cc102a60 2024-09-21T06:19:49.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.115+0000 7f67d0eef640 1 --2- 172.21.15.63:0/3473280331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67cc102a60 0x7f67cc1050e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f67c000b4a0 tx=0x7f67c000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:49.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.115+0000 7f67c9ffb640 1 -- 172.21.15.63:0/3473280331 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c0014070 con 0x7f67cc102a60 2024-09-21T06:19:49.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.115+0000 7f67c9ffb640 1 -- 172.21.15.63:0/3473280331 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67c0010ac0 con 0x7f67cc102a60 2024-09-21T06:19:49.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.115+0000 7f67d3153640 1 -- 172.21.15.63:0/3473280331 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67cc1a8a20 con 0x7f67cc102a60 2024-09-21T06:19:49.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.115+0000 7f67c9ffb640 1 -- 172.21.15.63:0/3473280331 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c0017c30 con 0x7f67cc102a60 2024-09-21T06:19:49.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.115+0000 7f67d3153640 1 -- 172.21.15.63:0/3473280331 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67cc1a8fb0 con 0x7f67cc102a60 2024-09-21T06:19:49.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.116+0000 7f67c9ffb640 1 -- 172.21.15.63:0/3473280331 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f67c0017070 con 0x7f67cc102a60 2024-09-21T06:19:49.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.116+0000 7f67d3153640 1 -- 172.21.15.63:0/3473280331 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67cc102e70 con 0x7f67cc102a60 2024-09-21T06:19:49.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.117+0000 7f67c9ffb640 1 --2- 172.21.15.63:0/3473280331 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f67bc03fb70 0x7f67bc042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:49.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.117+0000 7f67c9ffb640 1 -- 172.21.15.63:0/3473280331 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f67c0053b90 con 0x7f67cc102a60 2024-09-21T06:19:49.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.117+0000 7f67cbfff640 1 --2- 172.21.15.63:0/3473280331 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f67bc03fb70 0x7f67bc042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:49.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.117+0000 7f67cbfff640 1 --2- 172.21.15.63:0/3473280331 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f67bc03fb70 0x7f67bc042080 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f67cc07a1d0 tx=0x7f67b8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:49.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.122+0000 7f67c9ffb640 1 -- 172.21.15.63:0/3473280331 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f67c000e2e0 con 0x7f67cc102a60 2024-09-21T06:19:49.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.312+0000 7f67d3153640 1 -- 172.21.15.63:0/3473280331 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f67cc02e640 con 0x7f67cc102a60 2024-09-21T06:19:49.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.317+0000 7f67c9ffb640 1 -- 172.21.15.63:0/3473280331 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v19)=0 v19) ==== 106+0+0 (secure 0 0 0) 0x7f67c0017dd0 con 0x7f67cc102a60 2024-09-21T06:19:49.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.319+0000 7f67d3153640 1 -- 172.21.15.63:0/3473280331 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f67bc03fb70 msgr2=0x7f67bc042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:49.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.319+0000 7f67d3153640 1 --2- 172.21.15.63:0/3473280331 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f67bc03fb70 0x7f67bc042080 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f67cc07a1d0 tx=0x7f67b8005f90 comp rx=0 tx=0).stop 2024-09-21T06:19:49.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.319+0000 7f67d3153640 1 -- 172.21.15.63:0/3473280331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67cc102a60 msgr2=0x7f67cc1050e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:49.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.319+0000 7f67d3153640 1 --2- 172.21.15.63:0/3473280331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67cc102a60 0x7f67cc1050e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f67c000b4a0 tx=0x7f67c000b960 comp rx=0 tx=0).stop 2024-09-21T06:19:49.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.319+0000 7f67d3153640 1 -- 172.21.15.63:0/3473280331 shutdown_connections 2024-09-21T06:19:49.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.319+0000 7f67d3153640 1 --2- 172.21.15.63:0/3473280331 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f67bc03fb70 0x7f67bc042080 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:49.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.319+0000 7f67d3153640 1 --2- 172.21.15.63:0/3473280331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67cc108cf0 0x7f67cc105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:49.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.319+0000 7f67d3153640 1 --2- 172.21.15.63:0/3473280331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67cc1083a0 0x7f67cc105620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:49.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.319+0000 7f67d3153640 1 --2- 172.21.15.63:0/3473280331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67cc102a60 0x7f67cc1050e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:49.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.319+0000 7f67d3153640 1 -- 172.21.15.63:0/3473280331 >> 172.21.15.63:0/3473280331 conn(0x7f67cc079730 msgr2=0x7f67cc06b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:49.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.320+0000 7f67d3153640 1 -- 172.21.15.63:0/3473280331 shutdown_connections 2024-09-21T06:19:49.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:49.320+0000 7f67d3153640 1 -- 172.21.15.63:0/3473280331 wait complete. 2024-09-21T06:19:49.892 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:49.993 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:49 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:49.993 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:49 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:49.993 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:49 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:49.993 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:49 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:19:49.993 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:49 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:19:49.993 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:49 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:19:49.994 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:49 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:49.994 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:49 smithi063 ceph-mon[31150]: Deploying daemon mgr.y on smithi071 2024-09-21T06:19:49.994 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:49 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3473280331' entity='client.admin' 2024-09-21T06:19:50.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:49 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:50.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:49 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:50.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:49 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:50.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:49 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:19:50.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:49 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:19:50.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:49 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:19:50.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:49 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:50.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:49 smithi175 ceph-mon[34510]: Deploying daemon mgr.y on smithi071 2024-09-21T06:19:50.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:49 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3473280331' entity='client.admin' 2024-09-21T06:19:50.176 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:49 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:50.177 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:49 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:50.177 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:49 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:50.177 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:49 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:19:50.177 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:49 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:19:50.177 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:49 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:19:50.177 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:49 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:50.177 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:49 smithi071 ceph-mon[34844]: Deploying daemon mgr.y on smithi071 2024-09-21T06:19:50.177 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:49 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3473280331' entity='client.admin' 2024-09-21T06:19:50.447 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:50.768 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 21 06:19:50 smithi071 systemd[1]: Starting Ceph mgr.y for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:19:50.830 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi063') 2024-09-21T06:19:50.830 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi063') 2024-09-21T06:19:50.830 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi063') 2024-09-21T06:19:50.830 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi063') 2024-09-21T06:19:51.072 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 21 06:19:50 smithi071 podman[36347]: 2024-09-21 06:19:50.703486563 +0000 UTC m=+0.015660105 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:19:51.073 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 21 06:19:50 smithi071 podman[36347]: 2024-09-21 06:19:50.802285215 +0000 UTC m=+0.114458746 container create c0bb7be67ac61ea3fc9593e7ce4264105ad56bdd68ca26109f7a4702736f011a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T06:19:51.073 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 21 06:19:50 smithi071 podman[36347]: 2024-09-21 06:19:50.996667466 +0000 UTC m=+0.308840996 container init c0bb7be67ac61ea3fc9593e7ce4264105ad56bdd68ca26109f7a4702736f011a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-y, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T06:19:51.073 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 21 06:19:50 smithi071 podman[36347]: 2024-09-21 06:19:50.999498949 +0000 UTC m=+0.311672481 container start c0bb7be67ac61ea3fc9593e7ce4264105ad56bdd68ca26109f7a4702736f011a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-y, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:19:51.073 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 21 06:19:51 smithi071 ceph-mgr[36366]: -- 172.21.15.71:0/1427168655 <== mon.2 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558f3afb90e0 con 0x558f3fd5c480 2024-09-21T06:19:51.073 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 21 06:19:51 smithi071 bash[36347]: c0bb7be67ac61ea3fc9593e7ce4264105ad56bdd68ca26109f7a4702736f011a 2024-09-21T06:19:51.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.229+0000 7fa87cf2a640 1 -- 172.21.15.63:0/56059658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa878108f60 msgr2=0x7fa87810f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:51.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.229+0000 7fa87cf2a640 1 --2- 172.21.15.63:0/56059658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa878108f60 0x7fa87810f790 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa870009ca0 tx=0x7fa87002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:19:51.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.229+0000 7fa87cf2a640 1 -- 172.21.15.63:0/56059658 shutdown_connections 2024-09-21T06:19:51.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.229+0000 7fa87cf2a640 1 --2- 172.21.15.63:0/56059658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa878108f60 0x7fa87810f790 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:51.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.230+0000 7fa87cf2a640 1 --2- 172.21.15.63:0/56059658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa878108610 0x7fa878108a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:51.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.230+0000 7fa87cf2a640 1 --2- 172.21.15.63:0/56059658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8781031d0 0x7fa8781035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:51.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.230+0000 7fa87cf2a640 1 -- 172.21.15.63:0/56059658 >> 172.21.15.63:0/56059658 conn(0x7fa878079e40 msgr2=0x7fa87807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:51.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.230+0000 7fa87cf2a640 1 -- 172.21.15.63:0/56059658 shutdown_connections 2024-09-21T06:19:51.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.230+0000 7fa87cf2a640 1 -- 172.21.15.63:0/56059658 wait complete. 2024-09-21T06:19:51.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.231+0000 7fa87cf2a640 1 Processor -- start 2024-09-21T06:19:51.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.231+0000 7fa87cf2a640 1 -- start start 2024-09-21T06:19:51.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.231+0000 7fa87cf2a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8781031d0 0x7fa8780fee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:51.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.231+0000 7fa87cf2a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa878108610 0x7fa8780ff3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:51.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.231+0000 7fa87cf2a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa878108f60 0x7fa8780ff8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:51.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.231+0000 7fa87cf2a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa878112c70 con 0x7fa878108f60 2024-09-21T06:19:51.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.231+0000 7fa87cf2a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa878112af0 con 0x7fa878108610 2024-09-21T06:19:51.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.231+0000 7fa87cf2a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa878112df0 con 0x7fa8781031d0 2024-09-21T06:19:51.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.231+0000 7fa876d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa878108f60 0x7fa8780ff8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:51.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.231+0000 7fa86ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa878108610 0x7fa8780ff3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:51.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.231+0000 7fa876d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa878108f60 0x7fa8780ff8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54236/0 (socket says 172.21.15.63:54236) 2024-09-21T06:19:51.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.231+0000 7fa876d9d640 1 -- 172.21.15.63:0/1408740946 learned_addr learned my addr 172.21.15.63:0/1408740946 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:19:51.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.231+0000 7fa87659c640 1 --2- 172.21.15.63:0/1408740946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8781031d0 0x7fa8780fee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:51.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.231+0000 7fa876d9d640 1 -- 172.21.15.63:0/1408740946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8781031d0 msgr2=0x7fa8780fee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:51.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.231+0000 7fa876d9d640 1 --2- 172.21.15.63:0/1408740946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8781031d0 0x7fa8780fee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:51.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.231+0000 7fa876d9d640 1 -- 172.21.15.63:0/1408740946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa878108610 msgr2=0x7fa8780ff3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:51.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.231+0000 7fa876d9d640 1 --2- 172.21.15.63:0/1408740946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa878108610 0x7fa8780ff3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:51.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.231+0000 7fa876d9d640 1 -- 172.21.15.63:0/1408740946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8781a88a0 con 0x7fa878108f60 2024-09-21T06:19:51.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.231+0000 7fa86ffff640 1 --2- 172.21.15.63:0/1408740946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa878108610 0x7fa8780ff3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:19:51.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.232+0000 7fa876d9d640 1 --2- 172.21.15.63:0/1408740946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa878108f60 0x7fa8780ff8f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa870009430 tx=0x7fa8700317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:51.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.232+0000 7fa86f7fe640 1 -- 172.21.15.63:0/1408740946 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa870003b70 con 0x7fa878108f60 2024-09-21T06:19:51.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.232+0000 7fa86f7fe640 1 -- 172.21.15.63:0/1408740946 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa870003d10 con 0x7fa878108f60 2024-09-21T06:19:51.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.232+0000 7fa87cf2a640 1 -- 172.21.15.63:0/1408740946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8781a8b30 con 0x7fa878108f60 2024-09-21T06:19:51.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.232+0000 7fa86f7fe640 1 -- 172.21.15.63:0/1408740946 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87002f990 con 0x7fa878108f60 2024-09-21T06:19:51.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.232+0000 7fa87cf2a640 1 -- 172.21.15.63:0/1408740946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8781a90c0 con 0x7fa878108f60 2024-09-21T06:19:51.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.233+0000 7fa87cf2a640 1 -- 172.21.15.63:0/1408740946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8781035e0 con 0x7fa878108f60 2024-09-21T06:19:51.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.233+0000 7fa86f7fe640 1 -- 172.21.15.63:0/1408740946 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7fa87002fb30 con 0x7fa878108f60 2024-09-21T06:19:51.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.233+0000 7fa86f7fe640 1 --2- 172.21.15.63:0/1408740946 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa86403fb70 0x7fa864042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:51.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.233+0000 7fa86f7fe640 1 -- 172.21.15.63:0/1408740946 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa8700759d0 con 0x7fa878108f60 2024-09-21T06:19:51.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.233+0000 7fa87659c640 1 --2- 172.21.15.63:0/1408740946 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa86403fb70 0x7fa864042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:51.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.234+0000 7fa87659c640 1 --2- 172.21.15.63:0/1408740946 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa86403fb70 0x7fa864042080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa8781008c0 tx=0x7fa868005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:51.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.242+0000 7fa86f7fe640 1 -- 172.21.15.63:0/1408740946 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa870037270 con 0x7fa878108f60 2024-09-21T06:19:51.277 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:51.353 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 21 06:19:51 smithi071 systemd[1]: Started Ceph mgr.y for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:19:51.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.437+0000 7fa87cf2a640 1 -- 172.21.15.63:0/1408740946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7fa87810bd60 con 0x7fa878108f60 2024-09-21T06:19:51.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.437+0000 7fa86f7fe640 1 -- 172.21.15.63:0/1408740946 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v19)=0 v19) ==== 108+0+0 (secure 0 0 0) 0x7fa87002fe20 con 0x7fa878108f60 2024-09-21T06:19:51.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.440+0000 7fa87cf2a640 1 -- 172.21.15.63:0/1408740946 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa86403fb70 msgr2=0x7fa864042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:51.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.440+0000 7fa87cf2a640 1 --2- 172.21.15.63:0/1408740946 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa86403fb70 0x7fa864042080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa8781008c0 tx=0x7fa868005f90 comp rx=0 tx=0).stop 2024-09-21T06:19:51.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.440+0000 7fa87cf2a640 1 -- 172.21.15.63:0/1408740946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa878108f60 msgr2=0x7fa8780ff8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:51.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.440+0000 7fa87cf2a640 1 --2- 172.21.15.63:0/1408740946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa878108f60 0x7fa8780ff8f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa870009430 tx=0x7fa8700317c0 comp rx=0 tx=0).stop 2024-09-21T06:19:51.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.440+0000 7fa87cf2a640 1 -- 172.21.15.63:0/1408740946 shutdown_connections 2024-09-21T06:19:51.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.440+0000 7fa87cf2a640 1 --2- 172.21.15.63:0/1408740946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa878108f60 0x7fa8780ff8f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:51.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.440+0000 7fa87cf2a640 1 --2- 172.21.15.63:0/1408740946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa878108610 0x7fa8780ff3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:51.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.440+0000 7fa87cf2a640 1 --2- 172.21.15.63:0/1408740946 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa86403fb70 0x7fa864042080 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:51.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.440+0000 7fa87cf2a640 1 --2- 172.21.15.63:0/1408740946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8781031d0 0x7fa8780fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:51.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.440+0000 7fa87cf2a640 1 -- 172.21.15.63:0/1408740946 >> 172.21.15.63:0/1408740946 conn(0x7fa878079e40 msgr2=0x7fa878101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:51.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.440+0000 7fa87cf2a640 1 -- 172.21.15.63:0/1408740946 shutdown_connections 2024-09-21T06:19:51.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:51.440+0000 7fa87cf2a640 1 -- 172.21.15.63:0/1408740946 wait complete. 2024-09-21T06:19:51.788 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:51.789 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:51.814 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:51.814 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:51.818 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:51.819 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:51.819 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:51.821 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:51.824 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:51.825 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:51.829 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:51.832 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:51.838 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:51.841 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:51.845 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:51.848 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi063') 2024-09-21T06:19:51.848 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi063') 2024-09-21T06:19:52.025 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:52.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.038+0000 7f2c88c66640 1 -- 172.21.15.63:0/815399860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c841094b0 msgr2=0x7f2c841098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:52.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.038+0000 7f2c88c66640 1 --2- 172.21.15.63:0/815399860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c841094b0 0x7f2c841098c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2c78009900 tx=0x7f2c7802a410 comp rx=0 tx=0).stop 2024-09-21T06:19:52.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.038+0000 7f2c88c66640 1 -- 172.21.15.63:0/815399860 shutdown_connections 2024-09-21T06:19:52.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.038+0000 7f2c88c66640 1 --2- 172.21.15.63:0/815399860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c84109e00 0x7f2c84110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:52.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.038+0000 7f2c88c66640 1 --2- 172.21.15.63:0/815399860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c841094b0 0x7f2c841098c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:52.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.038+0000 7f2c88c66640 1 --2- 172.21.15.63:0/815399860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c84103b70 0x7f2c84103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:52.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.038+0000 7f2c88c66640 1 -- 172.21.15.63:0/815399860 >> 172.21.15.63:0/815399860 conn(0x7f2c840ff5e0 msgr2=0x7f2c84101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:52.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.038+0000 7f2c88c66640 1 -- 172.21.15.63:0/815399860 shutdown_connections 2024-09-21T06:19:52.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.038+0000 7f2c88c66640 1 -- 172.21.15.63:0/815399860 wait complete. 2024-09-21T06:19:52.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.039+0000 7f2c88c66640 1 Processor -- start 2024-09-21T06:19:52.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.039+0000 7f2c88c66640 1 -- start start 2024-09-21T06:19:52.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.040+0000 7f2c88c66640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c84103b70 0x7f2c8419c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:52.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.040+0000 7f2c88c66640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c841094b0 0x7f2c8419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:52.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.040+0000 7f2c88c66640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c84109e00 0x7f2c841a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:52.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.040+0000 7f2c88c66640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2c84115cf0 con 0x7f2c84109e00 2024-09-21T06:19:52.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.040+0000 7f2c88c66640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2c84115b70 con 0x7f2c841094b0 2024-09-21T06:19:52.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.040+0000 7f2c88c66640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2c84115e70 con 0x7f2c84103b70 2024-09-21T06:19:52.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.040+0000 7f2c82d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c84109e00 0x7f2c841a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:52.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.040+0000 7f2c82d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c84109e00 0x7f2c841a1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54256/0 (socket says 172.21.15.63:54256) 2024-09-21T06:19:52.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.040+0000 7f2c82d9d640 1 -- 172.21.15.63:0/857818906 learned_addr learned my addr 172.21.15.63:0/857818906 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:19:52.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.040+0000 7f2c81d9b640 1 --2- 172.21.15.63:0/857818906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c841094b0 0x7f2c8419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:52.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.040+0000 7f2c8259c640 1 --2- 172.21.15.63:0/857818906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c84103b70 0x7f2c8419c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:52.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.040+0000 7f2c82d9d640 1 -- 172.21.15.63:0/857818906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c84103b70 msgr2=0x7f2c8419c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:52.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.040+0000 7f2c82d9d640 1 --2- 172.21.15.63:0/857818906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c84103b70 0x7f2c8419c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:52.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.040+0000 7f2c82d9d640 1 -- 172.21.15.63:0/857818906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c841094b0 msgr2=0x7f2c8419cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:52.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.040+0000 7f2c82d9d640 1 --2- 172.21.15.63:0/857818906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c841094b0 0x7f2c8419cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:52.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.040+0000 7f2c82d9d640 1 -- 172.21.15.63:0/857818906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c841a2630 con 0x7f2c84109e00 2024-09-21T06:19:52.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.041+0000 7f2c82d9d640 1 --2- 172.21.15.63:0/857818906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c84109e00 0x7f2c841a1f00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2c7400e970 tx=0x7f2c7400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:52.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.041+0000 7f2c737fe640 1 -- 172.21.15.63:0/857818906 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7400ccc0 con 0x7f2c84109e00 2024-09-21T06:19:52.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.041+0000 7f2c737fe640 1 -- 172.21.15.63:0/857818906 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c7400ce60 con 0x7f2c84109e00 2024-09-21T06:19:52.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.041+0000 7f2c737fe640 1 -- 172.21.15.63:0/857818906 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c74010430 con 0x7f2c84109e00 2024-09-21T06:19:52.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.041+0000 7f2c88c66640 1 -- 172.21.15.63:0/857818906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c841a2920 con 0x7f2c84109e00 2024-09-21T06:19:52.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.041+0000 7f2c88c66640 1 -- 172.21.15.63:0/857818906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c841a9080 con 0x7f2c84109e00 2024-09-21T06:19:52.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.042+0000 7f2c88c66640 1 -- 172.21.15.63:0/857818906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c640052c0 con 0x7f2c84109e00 2024-09-21T06:19:52.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.043+0000 7f2c737fe640 1 -- 172.21.15.63:0/857818906 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f2c740105d0 con 0x7f2c84109e00 2024-09-21T06:19:52.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.043+0000 7f2c737fe640 1 --2- 172.21.15.63:0/857818906 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2c6c03fbb0 0x7f2c6c0420c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:52.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.043+0000 7f2c737fe640 1 -- 172.21.15.63:0/857818906 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f2c74054980 con 0x7f2c84109e00 2024-09-21T06:19:52.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.043+0000 7f2c8259c640 1 --2- 172.21.15.63:0/857818906 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2c6c03fbb0 0x7f2c6c0420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:52.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.044+0000 7f2c8259c640 1 --2- 172.21.15.63:0/857818906 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2c6c03fbb0 0x7f2c6c0420c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c005fd0 tx=0x7f2c7c009520 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:52.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.048+0000 7f2c737fe640 1 -- 172.21.15.63:0/857818906 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2c74016590 con 0x7f2c84109e00 2024-09-21T06:19:52.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.245+0000 7f2c88c66640 1 -- 172.21.15.63:0/857818906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f2c640055b0 con 0x7f2c84109e00 2024-09-21T06:19:52.247 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:52 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:52.247 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:52 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:52.247 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:52 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:52.248 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:52 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:52.248 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:52 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:19:52.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.249+0000 7f2c737fe640 1 -- 172.21.15.63:0/857818906 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v20)=0 v20) ==== 119+0+0 (secure 0 0 0) 0x7f2c74016330 con 0x7f2c84109e00 2024-09-21T06:19:52.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.251+0000 7f2c88c66640 1 -- 172.21.15.63:0/857818906 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2c6c03fbb0 msgr2=0x7f2c6c0420c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:52.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.251+0000 7f2c88c66640 1 --2- 172.21.15.63:0/857818906 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2c6c03fbb0 0x7f2c6c0420c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c005fd0 tx=0x7f2c7c009520 comp rx=0 tx=0).stop 2024-09-21T06:19:52.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.251+0000 7f2c88c66640 1 -- 172.21.15.63:0/857818906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c84109e00 msgr2=0x7f2c841a1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:52.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.251+0000 7f2c88c66640 1 --2- 172.21.15.63:0/857818906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c84109e00 0x7f2c841a1f00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2c7400e970 tx=0x7f2c7400ed70 comp rx=0 tx=0).stop 2024-09-21T06:19:52.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.251+0000 7f2c88c66640 1 -- 172.21.15.63:0/857818906 shutdown_connections 2024-09-21T06:19:52.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.251+0000 7f2c88c66640 1 --2- 172.21.15.63:0/857818906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c84109e00 0x7f2c841a1f00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:52.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.251+0000 7f2c88c66640 1 --2- 172.21.15.63:0/857818906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c841094b0 0x7f2c8419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:52.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.251+0000 7f2c88c66640 1 --2- 172.21.15.63:0/857818906 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2c6c03fbb0 0x7f2c6c0420c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:52.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.251+0000 7f2c88c66640 1 --2- 172.21.15.63:0/857818906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c84103b70 0x7f2c8419c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:52.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.251+0000 7f2c88c66640 1 -- 172.21.15.63:0/857818906 >> 172.21.15.63:0/857818906 conn(0x7f2c840ff5e0 msgr2=0x7f2c84101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:52.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.252+0000 7f2c88c66640 1 -- 172.21.15.63:0/857818906 shutdown_connections 2024-09-21T06:19:52.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:52.252+0000 7f2c88c66640 1 -- 172.21.15.63:0/857818906 wait complete. 2024-09-21T06:19:52.402 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:52 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:52.402 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:52 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:52.402 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:52 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:52.402 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:52 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:52.402 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:52 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:19:52.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:52 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:52.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:52 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:52.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:52 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:52.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:52 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:52.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:52 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:19:53.428 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:53.428 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:53.428 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:53.429 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:53.429 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:53.429 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:19:53.429 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:53.429 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:53 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/857818906' entity='client.admin' 2024-09-21T06:19:53.429 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:53 smithi063 ceph-mon[31150]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T06:19:53.429 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:19:53.429 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:19:53.429 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:53.429 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:53 smithi063 ceph-mon[31150]: Reconfiguring daemon mgr.x on smithi063 2024-09-21T06:19:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:53.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:19:53.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:53.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:53 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/857818906' entity='client.admin' 2024-09-21T06:19:53.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:53 smithi071 ceph-mon[34844]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T06:19:53.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:19:53.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:19:53.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:53.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:53 smithi071 ceph-mon[34844]: Reconfiguring daemon mgr.x on smithi063 2024-09-21T06:19:53.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:53.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:53.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:53.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:53.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:53.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:19:53.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:53.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:53 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/857818906' entity='client.admin' 2024-09-21T06:19:53.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:53 smithi175 ceph-mon[34510]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T06:19:53.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:19:53.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:19:53.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:53.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:53 smithi175 ceph-mon[34510]: Reconfiguring daemon mgr.x on smithi063 2024-09-21T06:19:54.307 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:54 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:54.307 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:54 smithi063 ceph-mon[31150]: Standby manager daemon z started 2024-09-21T06:19:54.307 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:54 smithi063 ceph-mon[31150]: from='mgr.? 172.21.15.175:0/2863563711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T06:19:54.307 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:54 smithi063 ceph-mon[31150]: from='mgr.? 172.21.15.175:0/2863563711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:19:54.307 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:54 smithi063 ceph-mon[31150]: from='mgr.? 172.21.15.175:0/2863563711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T06:19:54.307 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:54 smithi063 ceph-mon[31150]: from='mgr.? 172.21.15.175:0/2863563711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:19:54.307 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:54 smithi063 ceph-mon[31150]: from='client.? ' entity='client.admin' 2024-09-21T06:19:54.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:54 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:54.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:54 smithi071 ceph-mon[34844]: Standby manager daemon z started 2024-09-21T06:19:54.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:54 smithi071 ceph-mon[34844]: from='mgr.? 172.21.15.175:0/2863563711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T06:19:54.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:54 smithi071 ceph-mon[34844]: from='mgr.? 172.21.15.175:0/2863563711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:19:54.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:54 smithi071 ceph-mon[34844]: from='mgr.? 172.21.15.175:0/2863563711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T06:19:54.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:54 smithi071 ceph-mon[34844]: from='mgr.? 172.21.15.175:0/2863563711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:19:54.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:54 smithi071 ceph-mon[34844]: from='client.? ' entity='client.admin' 2024-09-21T06:19:54.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:54 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:19:54.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:54 smithi175 ceph-mon[34510]: Standby manager daemon z started 2024-09-21T06:19:54.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:54 smithi175 ceph-mon[34510]: from='mgr.? 172.21.15.175:0/2863563711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T06:19:54.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:54 smithi175 ceph-mon[34510]: from='mgr.? 172.21.15.175:0/2863563711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:19:54.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:54 smithi175 ceph-mon[34510]: from='mgr.? 172.21.15.175:0/2863563711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T06:19:54.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:54 smithi175 ceph-mon[34510]: from='mgr.? 172.21.15.175:0/2863563711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:19:54.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:54 smithi175 ceph-mon[34510]: from='client.? ' entity='client.admin' 2024-09-21T06:19:54.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.654+0000 7fd48a8ec640 1 -- 172.21.15.63:0/2980570670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd484109df0 msgr2=0x7fd484110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:54.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.654+0000 7fd48a8ec640 1 --2- 172.21.15.63:0/2980570670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd484109df0 0x7fd484110620 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009ca0 tx=0x7fd47c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.655+0000 7fd48a8ec640 1 -- 172.21.15.63:0/2980570670 shutdown_connections 2024-09-21T06:19:54.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.655+0000 7fd48a8ec640 1 --2- 172.21.15.63:0/2980570670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd484109df0 0x7fd484110620 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.655+0000 7fd48a8ec640 1 --2- 172.21.15.63:0/2980570670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4841094a0 0x7fd4841098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.655+0000 7fd48a8ec640 1 --2- 172.21.15.63:0/2980570670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd484103b60 0x7fd484103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.655+0000 7fd48a8ec640 1 -- 172.21.15.63:0/2980570670 >> 172.21.15.63:0/2980570670 conn(0x7fd48407b850 msgr2=0x7fd48407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:54.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.655+0000 7fd48a8ec640 1 -- 172.21.15.63:0/2980570670 shutdown_connections 2024-09-21T06:19:54.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.655+0000 7fd48a8ec640 1 -- 172.21.15.63:0/2980570670 wait complete. 2024-09-21T06:19:54.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.655+0000 7fd48a8ec640 1 Processor -- start 2024-09-21T06:19:54.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.655+0000 7fd48a8ec640 1 -- start start 2024-09-21T06:19:54.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.656+0000 7fd48a8ec640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd484103b60 0x7fd48419a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.656+0000 7fd48a8ec640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4841094a0 0x7fd48419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.656+0000 7fd48a8ec640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd484109df0 0x7fd48419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.656+0000 7fd48a8ec640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd484113ab0 con 0x7fd4841094a0 2024-09-21T06:19:54.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.656+0000 7fd48a8ec640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd484113930 con 0x7fd484109df0 2024-09-21T06:19:54.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.656+0000 7fd48a8ec640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd484113c30 con 0x7fd484103b60 2024-09-21T06:19:54.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.656+0000 7fd4837fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4841094a0 0x7fd48419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.656+0000 7fd4837fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4841094a0 0x7fd48419a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54302/0 (socket says 172.21.15.63:54302) 2024-09-21T06:19:54.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.656+0000 7fd4837fe640 1 -- 172.21.15.63:0/1877679898 learned_addr learned my addr 172.21.15.63:0/1877679898 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:19:54.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.656+0000 7fd488e89640 1 --2- 172.21.15.63:0/1877679898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd484109df0 0x7fd48419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.656+0000 7fd483fff640 1 --2- 172.21.15.63:0/1877679898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd484103b60 0x7fd48419a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.656+0000 7fd4837fe640 1 -- 172.21.15.63:0/1877679898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd484103b60 msgr2=0x7fd48419a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:54.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.656+0000 7fd4837fe640 1 --2- 172.21.15.63:0/1877679898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd484103b60 0x7fd48419a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.656+0000 7fd4837fe640 1 -- 172.21.15.63:0/1877679898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd484109df0 msgr2=0x7fd48419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:54.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.656+0000 7fd4837fe640 1 --2- 172.21.15.63:0/1877679898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd484109df0 0x7fd48419fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.656+0000 7fd4837fe640 1 -- 172.21.15.63:0/1877679898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4841a0370 con 0x7fd4841094a0 2024-09-21T06:19:54.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.657+0000 7fd4837fe640 1 --2- 172.21.15.63:0/1877679898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4841094a0 0x7fd48419a9a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd47800e9f0 tx=0x7fd47800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:54.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.657+0000 7fd4817fa640 1 -- 172.21.15.63:0/1877679898 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47800ccc0 con 0x7fd4841094a0 2024-09-21T06:19:54.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.657+0000 7fd48a8ec640 1 -- 172.21.15.63:0/1877679898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4841a0660 con 0x7fd4841094a0 2024-09-21T06:19:54.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.657+0000 7fd4817fa640 1 -- 172.21.15.63:0/1877679898 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4780108e0 con 0x7fd4841094a0 2024-09-21T06:19:54.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.657+0000 7fd4817fa640 1 -- 172.21.15.63:0/1877679898 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd478018860 con 0x7fd4841094a0 2024-09-21T06:19:54.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.657+0000 7fd48a8ec640 1 -- 172.21.15.63:0/1877679898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4841a6dc0 con 0x7fd4841094a0 2024-09-21T06:19:54.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.658+0000 7fd48a8ec640 1 -- 172.21.15.63:0/1877679898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd484103f70 con 0x7fd4841094a0 2024-09-21T06:19:54.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.659+0000 7fd4817fa640 1 -- 172.21.15.63:0/1877679898 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) ==== 103194+0+0 (secure 0 0 0) 0x7fd478010430 con 0x7fd4841094a0 2024-09-21T06:19:54.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.659+0000 7fd4817fa640 1 --2- 172.21.15.63:0/1877679898 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd46c07b020 0x7fd46c07d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.660+0000 7fd483fff640 1 --2- 172.21.15.63:0/1877679898 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd46c07b020 0x7fd46c07d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.660+0000 7fd4817fa640 1 -- 172.21.15.63:0/1877679898 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd47809d140 con 0x7fd4841094a0 2024-09-21T06:19:54.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.660+0000 7fd483fff640 1 --2- 172.21.15.63:0/1877679898 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd46c07b020 0x7fd46c07d530 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd474009b60 tx=0x7fd474005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:54.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.664+0000 7fd4817fa640 1 -- 172.21.15.63:0/1877679898 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd478069ad0 con 0x7fd4841094a0 2024-09-21T06:19:54.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.837+0000 7f92c3851640 1 -- 172.21.15.63:0/3767971688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92bc105280 msgr2=0x7f92bc10d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:54.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.837+0000 7f92c3851640 1 --2- 172.21.15.63:0/3767971688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92bc105280 0x7f92bc10d910 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f92ac009900 tx=0x7f92ac02a410 comp rx=0 tx=0).stop 2024-09-21T06:19:54.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.837+0000 7f92c3851640 1 -- 172.21.15.63:0/3767971688 shutdown_connections 2024-09-21T06:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.837+0000 7f92c3851640 1 --2- 172.21.15.63:0/3767971688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92bc10de50 0x7f92bc110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.837+0000 7f92c3851640 1 --2- 172.21.15.63:0/3767971688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92bc105280 0x7f92bc10d910 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.837+0000 7f92c3851640 1 --2- 172.21.15.63:0/3767971688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92bc1048a0 0x7f92bc104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.837+0000 7f92c3851640 1 -- 172.21.15.63:0/3767971688 >> 172.21.15.63:0/3767971688 conn(0x7f92bc079790 msgr2=0x7f92bc079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.837+0000 7f92c3851640 1 -- 172.21.15.63:0/3767971688 shutdown_connections 2024-09-21T06:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.837+0000 7f92c3851640 1 -- 172.21.15.63:0/3767971688 wait complete. 2024-09-21T06:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.838+0000 7f92c3851640 1 Processor -- start 2024-09-21T06:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.838+0000 7f92c3851640 1 -- start start 2024-09-21T06:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.838+0000 7f92c3851640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92bc1048a0 0x7f92bc1027b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.838+0000 7f92c3851640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92bc105280 0x7f92bc102cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.838+0000 7f92c3851640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92bc10de50 0x7f92bc103230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.838+0000 7f92c3851640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc113a90 con 0x7f92bc10de50 2024-09-21T06:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.838+0000 7f92c3851640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc113910 con 0x7f92bc105280 2024-09-21T06:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.838+0000 7f92c3851640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc113c10 con 0x7f92bc1048a0 2024-09-21T06:19:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.838+0000 7f92c1dee640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92bc10de50 0x7f92bc103230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.839+0000 7f92c15ed640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92bc1048a0 0x7f92bc1027b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.839+0000 7f92c0dec640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92bc105280 0x7f92bc102cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.839+0000 7f92c1dee640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92bc10de50 0x7f92bc103230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54278/0 (socket says 172.21.15.63:54278) 2024-09-21T06:19:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.839+0000 7f92c1dee640 1 -- 172.21.15.63:0/2193320984 learned_addr learned my addr 172.21.15.63:0/2193320984 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:19:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.839+0000 7f92c0dec640 1 -- 172.21.15.63:0/2193320984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92bc1048a0 msgr2=0x7f92bc1027b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.839+0000 7f92c0dec640 1 --2- 172.21.15.63:0/2193320984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92bc1048a0 0x7f92bc1027b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.839+0000 7f92c0dec640 1 -- 172.21.15.63:0/2193320984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92bc10de50 msgr2=0x7f92bc103230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.839+0000 7f92c0dec640 1 --2- 172.21.15.63:0/2193320984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92bc10de50 0x7f92bc103230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.839+0000 7f92c0dec640 1 -- 172.21.15.63:0/2193320984 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92bc1a8740 con 0x7f92bc105280 2024-09-21T06:19:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.839+0000 7f92c1dee640 1 --2- 172.21.15.63:0/2193320984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92bc10de50 0x7f92bc103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:19:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.839+0000 7f92c15ed640 1 --2- 172.21.15.63:0/2193320984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92bc1048a0 0x7f92bc1027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:19:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.839+0000 7f92c0dec640 1 --2- 172.21.15.63:0/2193320984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92bc105280 0x7f92bc102cf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f92ac02a930 tx=0x7f92ac031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.839+0000 7f92b27fc640 1 -- 172.21.15.63:0/2193320984 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac03f070 con 0x7f92bc105280 2024-09-21T06:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.839+0000 7f92b27fc640 1 -- 172.21.15.63:0/2193320984 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92ac004490 con 0x7f92bc105280 2024-09-21T06:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.839+0000 7f92c3851640 1 -- 172.21.15.63:0/2193320984 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92bc1a89d0 con 0x7f92bc105280 2024-09-21T06:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.839+0000 7f92b27fc640 1 -- 172.21.15.63:0/2193320984 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac035070 con 0x7f92bc105280 2024-09-21T06:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.839+0000 7f92c3851640 1 -- 172.21.15.63:0/2193320984 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92bc1a8eb0 con 0x7f92bc105280 2024-09-21T06:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.840+0000 7f92b27fc640 1 -- 172.21.15.63:0/2193320984 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f92ac043400 con 0x7f92bc105280 2024-09-21T06:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.841+0000 7f92c3851640 1 -- 172.21.15.63:0/2193320984 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92bc104cb0 con 0x7f92bc105280 2024-09-21T06:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.841+0000 7f92b27fc640 1 --2- 172.21.15.63:0/2193320984 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f92a803fb70 0x7f92a8042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.841+0000 7f92b27fc640 1 -- 172.21.15.63:0/2193320984 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f92ac075aa0 con 0x7f92bc105280 2024-09-21T06:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.841+0000 7f92c15ed640 1 --2- 172.21.15.63:0/2193320984 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f92a803fb70 0x7f92a8042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.841+0000 7f92c15ed640 1 --2- 172.21.15.63:0/2193320984 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f92a803fb70 0x7f92a8042080 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f92bc104200 tx=0x7f92b8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:53.846+0000 7f92b27fc640 1 -- 172.21.15.63:0/2193320984 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f92ac03f210 con 0x7f92bc105280 2024-09-21T06:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.044+0000 7f92c3851640 1 -- 172.21.15.63:0/2193320984 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f92bc02e640 con 0x7f92bc105280 2024-09-21T06:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.049+0000 7f92b27fc640 1 -- 172.21.15.63:0/2193320984 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v21)=0 v21) ==== 125+0+0 (secure 0 0 0) 0x7f92ac035e70 con 0x7f92bc105280 2024-09-21T06:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.052+0000 7f92c3851640 1 -- 172.21.15.63:0/2193320984 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f92a803fb70 msgr2=0x7f92a8042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:54.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.052+0000 7f92c3851640 1 --2- 172.21.15.63:0/2193320984 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f92a803fb70 0x7f92a8042080 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f92bc104200 tx=0x7f92b8005f90 comp rx=0 tx=0).stop 2024-09-21T06:19:54.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.052+0000 7f92c3851640 1 -- 172.21.15.63:0/2193320984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92bc105280 msgr2=0x7f92bc102cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:54.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.052+0000 7f92c3851640 1 --2- 172.21.15.63:0/2193320984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92bc105280 0x7f92bc102cf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f92ac02a930 tx=0x7f92ac031a20 comp rx=0 tx=0).stop 2024-09-21T06:19:54.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.052+0000 7f92c3851640 1 -- 172.21.15.63:0/2193320984 shutdown_connections 2024-09-21T06:19:54.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.052+0000 7f92c3851640 1 --2- 172.21.15.63:0/2193320984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92bc10de50 0x7f92bc103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.052+0000 7f92c3851640 1 --2- 172.21.15.63:0/2193320984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92bc105280 0x7f92bc102cf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.052+0000 7f92c3851640 1 --2- 172.21.15.63:0/2193320984 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f92a803fb70 0x7f92a8042080 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.052+0000 7f92c3851640 1 --2- 172.21.15.63:0/2193320984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92bc1048a0 0x7f92bc1027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.052+0000 7f92c3851640 1 -- 172.21.15.63:0/2193320984 >> 172.21.15.63:0/2193320984 conn(0x7f92bc079790 msgr2=0x7f92bc1008e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:54.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.052+0000 7f92c3851640 1 -- 172.21.15.63:0/2193320984 shutdown_connections 2024-09-21T06:19:54.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.052+0000 7f92c3851640 1 -- 172.21.15.63:0/2193320984 wait complete. 2024-09-21T06:19:54.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.855+0000 7fd48a8ec640 1 -- 172.21.15.63:0/1877679898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fd48410bbe0 con 0x7fd4841094a0 2024-09-21T06:19:54.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.859+0000 7fd4817fa640 1 -- 172.21.15.63:0/1877679898 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7fd47806e980 con 0x7fd4841094a0 2024-09-21T06:19:54.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.861+0000 7fd48a8ec640 1 -- 172.21.15.63:0/1877679898 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd46c07b020 msgr2=0x7fd46c07d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:54.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.861+0000 7fd48a8ec640 1 --2- 172.21.15.63:0/1877679898 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd46c07b020 0x7fd46c07d530 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd474009b60 tx=0x7fd474005f90 comp rx=0 tx=0).stop 2024-09-21T06:19:54.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.861+0000 7fd48a8ec640 1 -- 172.21.15.63:0/1877679898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4841094a0 msgr2=0x7fd48419a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:54.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.861+0000 7fd48a8ec640 1 --2- 172.21.15.63:0/1877679898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4841094a0 0x7fd48419a9a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd47800e9f0 tx=0x7fd47800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.862+0000 7fd48a8ec640 1 -- 172.21.15.63:0/1877679898 shutdown_connections 2024-09-21T06:19:54.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.862+0000 7fd48a8ec640 1 --2- 172.21.15.63:0/1877679898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd484109df0 0x7fd48419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.862+0000 7fd48a8ec640 1 --2- 172.21.15.63:0/1877679898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4841094a0 0x7fd48419a9a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.862+0000 7fd48a8ec640 1 --2- 172.21.15.63:0/1877679898 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd46c07b020 0x7fd46c07d530 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.862+0000 7fd48a8ec640 1 --2- 172.21.15.63:0/1877679898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd484103b60 0x7fd48419a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.862+0000 7fd48a8ec640 1 -- 172.21.15.63:0/1877679898 >> 172.21.15.63:0/1877679898 conn(0x7fd48407b850 msgr2=0x7fd484105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:54.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.862+0000 7fd48a8ec640 1 -- 172.21.15.63:0/1877679898 shutdown_connections 2024-09-21T06:19:54.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:54.862+0000 7fd48a8ec640 1 -- 172.21.15.63:0/1877679898 wait complete. 2024-09-21T06:19:55.480 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:55 smithi063 ceph-mon[31150]: mgrmap e19: x(active, since 16s), standbys: z 2024-09-21T06:19:55.480 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:55 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T06:19:55.480 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:55 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1877679898' entity='client.admin' 2024-09-21T06:19:55.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:55 smithi071 ceph-mon[34844]: mgrmap e19: x(active, since 16s), standbys: z 2024-09-21T06:19:55.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:55 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T06:19:55.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:55 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1877679898' entity='client.admin' 2024-09-21T06:19:55.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:55 smithi175 ceph-mon[34510]: mgrmap e19: x(active, since 16s), standbys: z 2024-09-21T06:19:55.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:55 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T06:19:55.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:55 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1877679898' entity='client.admin' 2024-09-21T06:19:55.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.769+0000 7f39016a4640 1 -- 172.21.15.63:0/2183303136 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38fc1083a0 msgr2=0x7f38fc1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:55.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.769+0000 7f39016a4640 1 --2- 172.21.15.63:0/2183303136 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38fc1083a0 0x7f38fc1087b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f38e4009900 tx=0x7f38e402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:19:55.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.769+0000 7f39016a4640 1 -- 172.21.15.63:0/2183303136 shutdown_connections 2024-09-21T06:19:55.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.769+0000 7f39016a4640 1 --2- 172.21.15.63:0/2183303136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38fc108cf0 0x7f38fc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:55.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.769+0000 7f39016a4640 1 --2- 172.21.15.63:0/2183303136 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38fc1083a0 0x7f38fc1087b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:55.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.769+0000 7f39016a4640 1 --2- 172.21.15.63:0/2183303136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38fc102a60 0x7f38fc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:55.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.769+0000 7f39016a4640 1 -- 172.21.15.63:0/2183303136 >> 172.21.15.63:0/2183303136 conn(0x7f38fc079730 msgr2=0x7f38fc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:55.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.769+0000 7f39016a4640 1 -- 172.21.15.63:0/2183303136 shutdown_connections 2024-09-21T06:19:55.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.769+0000 7f39016a4640 1 -- 172.21.15.63:0/2183303136 wait complete. 2024-09-21T06:19:55.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.769+0000 7f39016a4640 1 Processor -- start 2024-09-21T06:19:55.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.770+0000 7f39016a4640 1 -- start start 2024-09-21T06:19:55.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.770+0000 7f39016a4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38fc102a60 0x7f38fc199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:55.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.770+0000 7f39016a4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38fc1083a0 0x7f38fc199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:55.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.770+0000 7f39016a4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38fc108cf0 0x7f38fc19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:55.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.770+0000 7f39016a4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc112960 con 0x7f38fc108cf0 2024-09-21T06:19:55.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.770+0000 7f39016a4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc1127e0 con 0x7f38fc1083a0 2024-09-21T06:19:55.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.770+0000 7f39016a4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc112ae0 con 0x7f38fc102a60 2024-09-21T06:19:55.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.770+0000 7f38fb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38fc108cf0 0x7f38fc19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:55.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.770+0000 7f38fa7fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38fc1083a0 0x7f38fc199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:55.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.770+0000 7f38fb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38fc108cf0 0x7f38fc19ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54322/0 (socket says 172.21.15.63:54322) 2024-09-21T06:19:55.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.770+0000 7f38fa7fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38fc1083a0 0x7f38fc199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:49162/0 (socket says 172.21.15.63:49162) 2024-09-21T06:19:55.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.770+0000 7f38fb7fe640 1 -- 172.21.15.63:0/2084461933 learned_addr learned my addr 172.21.15.63:0/2084461933 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:19:55.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.770+0000 7f38faffd640 1 --2- 172.21.15.63:0/2084461933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38fc102a60 0x7f38fc199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:55.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.770+0000 7f38fa7fc640 1 -- 172.21.15.63:0/2084461933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38fc102a60 msgr2=0x7f38fc199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:55.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.770+0000 7f38fa7fc640 1 --2- 172.21.15.63:0/2084461933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38fc102a60 0x7f38fc199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:55.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.770+0000 7f38fa7fc640 1 -- 172.21.15.63:0/2084461933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38fc108cf0 msgr2=0x7f38fc19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:55.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.770+0000 7f38fa7fc640 1 --2- 172.21.15.63:0/2084461933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38fc108cf0 0x7f38fc19ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:55.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.770+0000 7f38fa7fc640 1 -- 172.21.15.63:0/2084461933 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38fc19f220 con 0x7f38fc1083a0 2024-09-21T06:19:55.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.770+0000 7f38fb7fe640 1 --2- 172.21.15.63:0/2084461933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38fc108cf0 0x7f38fc19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:19:55.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.771+0000 7f38fa7fc640 1 --2- 172.21.15.63:0/2084461933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38fc1083a0 0x7f38fc199910 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f38e4006010 tx=0x7f38e4004060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:55.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.771+0000 7f38f3fff640 1 -- 172.21.15.63:0/2084461933 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e403f070 con 0x7f38fc1083a0 2024-09-21T06:19:55.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.771+0000 7f39016a4640 1 -- 172.21.15.63:0/2084461933 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38fc19f4b0 con 0x7f38fc1083a0 2024-09-21T06:19:55.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.771+0000 7f38f3fff640 1 -- 172.21.15.63:0/2084461933 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38e4003aa0 con 0x7f38fc1083a0 2024-09-21T06:19:55.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.771+0000 7f38f3fff640 1 -- 172.21.15.63:0/2084461933 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e4035070 con 0x7f38fc1083a0 2024-09-21T06:19:55.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.771+0000 7f39016a4640 1 -- 172.21.15.63:0/2084461933 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38fc19f990 con 0x7f38fc1083a0 2024-09-21T06:19:55.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.772+0000 7f39016a4640 1 -- 172.21.15.63:0/2084461933 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38fc102e70 con 0x7f38fc1083a0 2024-09-21T06:19:55.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.773+0000 7f38f3fff640 1 -- 172.21.15.63:0/2084461933 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) ==== 103194+0+0 (secure 0 0 0) 0x7f38e40035f0 con 0x7f38fc1083a0 2024-09-21T06:19:55.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.773+0000 7f38f3fff640 1 --2- 172.21.15.63:0/2084461933 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f38e807b050 0x7f38e807d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:55.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.773+0000 7f38faffd640 1 --2- 172.21.15.63:0/2084461933 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f38e807b050 0x7f38e807d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:55.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.773+0000 7f38f3fff640 1 -- 172.21.15.63:0/2084461933 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f38e40bd320 con 0x7f38fc1083a0 2024-09-21T06:19:55.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.774+0000 7f38faffd640 1 --2- 172.21.15.63:0/2084461933 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f38e807b050 0x7f38e807d560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00abe0 tx=0x7f38ec00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:55.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.778+0000 7f38f3fff640 1 -- 172.21.15.63:0/2084461933 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f38e4089cb0 con 0x7f38fc1083a0 2024-09-21T06:19:55.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.970+0000 7f39016a4640 1 -- 172.21.15.63:0/2084461933 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f38fc10aae0 con 0x7f38fc1083a0 2024-09-21T06:19:55.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.975+0000 7f38f3fff640 1 -- 172.21.15.63:0/2084461933 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v23)=0 v23) ==== 120+0+0 (secure 0 0 0) 0x7f38e408eb60 con 0x7f38fc1083a0 2024-09-21T06:19:55.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.978+0000 7f39016a4640 1 -- 172.21.15.63:0/2084461933 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f38e807b050 msgr2=0x7f38e807d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:55.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.978+0000 7f39016a4640 1 --2- 172.21.15.63:0/2084461933 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f38e807b050 0x7f38e807d560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00abe0 tx=0x7f38ec00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:19:55.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.978+0000 7f39016a4640 1 -- 172.21.15.63:0/2084461933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38fc1083a0 msgr2=0x7f38fc199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:55.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.978+0000 7f39016a4640 1 --2- 172.21.15.63:0/2084461933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38fc1083a0 0x7f38fc199910 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f38e4006010 tx=0x7f38e4004060 comp rx=0 tx=0).stop 2024-09-21T06:19:55.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.978+0000 7f39016a4640 1 -- 172.21.15.63:0/2084461933 shutdown_connections 2024-09-21T06:19:55.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.978+0000 7f39016a4640 1 --2- 172.21.15.63:0/2084461933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38fc108cf0 0x7f38fc19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:55.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.978+0000 7f39016a4640 1 --2- 172.21.15.63:0/2084461933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38fc1083a0 0x7f38fc199910 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:55.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.978+0000 7f39016a4640 1 --2- 172.21.15.63:0/2084461933 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f38e807b050 0x7f38e807d560 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:55.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.978+0000 7f39016a4640 1 --2- 172.21.15.63:0/2084461933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38fc102a60 0x7f38fc199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:55.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.978+0000 7f39016a4640 1 -- 172.21.15.63:0/2084461933 >> 172.21.15.63:0/2084461933 conn(0x7f38fc079730 msgr2=0x7f38fc104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:55.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.978+0000 7f39016a4640 1 -- 172.21.15.63:0/2084461933 shutdown_connections 2024-09-21T06:19:55.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:55.978+0000 7f39016a4640 1 -- 172.21.15.63:0/2084461933 wait complete. 2024-09-21T06:19:56.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.516+0000 7f0bed175640 1 -- 172.21.15.63:0/2409285485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0be8106280 msgr2=0x7f0be8106690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:56.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.516+0000 7f0bed175640 1 --2- 172.21.15.63:0/2409285485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0be8106280 0x7f0be8106690 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc009900 tx=0x7f0bdc02a410 comp rx=0 tx=0).stop 2024-09-21T06:19:56.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.516+0000 7f0bed175640 1 -- 172.21.15.63:0/2409285485 shutdown_connections 2024-09-21T06:19:56.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.516+0000 7f0bed175640 1 --2- 172.21.15.63:0/2409285485 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be8106bd0 0x7f0be8110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:56.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.516+0000 7f0bed175640 1 --2- 172.21.15.63:0/2409285485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0be8106280 0x7f0be8106690 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:56.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.516+0000 7f0bed175640 1 --2- 172.21.15.63:0/2409285485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0be8102030 0x7f0be8102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:56.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.516+0000 7f0bed175640 1 -- 172.21.15.63:0/2409285485 >> 172.21.15.63:0/2409285485 conn(0x7f0be8077c60 msgr2=0x7f0be80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:56.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.516+0000 7f0bed175640 1 -- 172.21.15.63:0/2409285485 shutdown_connections 2024-09-21T06:19:56.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.516+0000 7f0bed175640 1 -- 172.21.15.63:0/2409285485 wait complete. 2024-09-21T06:19:56.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.517+0000 7f0bed175640 1 Processor -- start 2024-09-21T06:19:56.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.517+0000 7f0bed175640 1 -- start start 2024-09-21T06:19:56.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.517+0000 7f0bed175640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0be8102030 0x7f0be819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:56.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.517+0000 7f0bed175640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be8106280 0x7f0be819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:56.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.517+0000 7f0bed175640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0be8106bd0 0x7f0be819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:56.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.517+0000 7f0bed175640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0be8113aa0 con 0x7f0be8102030 2024-09-21T06:19:56.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.517+0000 7f0bed175640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0be8113920 con 0x7f0be8106280 2024-09-21T06:19:56.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.517+0000 7f0bed175640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0be8113c20 con 0x7f0be8106bd0 2024-09-21T06:19:56.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.517+0000 7f0be6d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0be8102030 0x7f0be819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:56.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.517+0000 7f0be6d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0be8102030 0x7f0be819a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59136/0 (socket says 172.21.15.63:59136) 2024-09-21T06:19:56.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.518+0000 7f0be6d9d640 1 -- 172.21.15.63:0/1282452916 learned_addr learned my addr 172.21.15.63:0/1282452916 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:19:56.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.518+0000 7f0be659c640 1 --2- 172.21.15.63:0/1282452916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be8106280 0x7f0be819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.518+0000 7f0be759e640 1 --2- 172.21.15.63:0/1282452916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0be8106bd0 0x7f0be819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.518+0000 7f0be6d9d640 1 -- 172.21.15.63:0/1282452916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0be8106bd0 msgr2=0x7f0be819fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.518+0000 7f0be6d9d640 1 --2- 172.21.15.63:0/1282452916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0be8106bd0 0x7f0be819fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.518+0000 7f0be6d9d640 1 -- 172.21.15.63:0/1282452916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be8106280 msgr2=0x7f0be819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.518+0000 7f0be6d9d640 1 --2- 172.21.15.63:0/1282452916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be8106280 0x7f0be819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.518+0000 7f0be6d9d640 1 -- 172.21.15.63:0/1282452916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be81a0400 con 0x7f0be8102030 2024-09-21T06:19:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.518+0000 7f0be659c640 1 --2- 172.21.15.63:0/1282452916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be8106280 0x7f0be819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:19:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.518+0000 7f0be6d9d640 1 --2- 172.21.15.63:0/1282452916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0be8102030 0x7f0be819a490 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0bd800d950 tx=0x7f0bd800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.518+0000 7f0bcffff640 1 -- 172.21.15.63:0/1282452916 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8017070 con 0x7f0be8102030 2024-09-21T06:19:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.518+0000 7f0bed175640 1 -- 172.21.15.63:0/1282452916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be81a06f0 con 0x7f0be8102030 2024-09-21T06:19:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.518+0000 7f0bcffff640 1 -- 172.21.15.63:0/1282452916 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bd8009c30 con 0x7f0be8102030 2024-09-21T06:19:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.518+0000 7f0bcffff640 1 -- 172.21.15.63:0/1282452916 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd800f620 con 0x7f0be8102030 2024-09-21T06:19:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.518+0000 7f0bed175640 1 -- 172.21.15.63:0/1282452916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be81a6e50 con 0x7f0be8102030 2024-09-21T06:19:56.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.520+0000 7f0bed175640 1 -- 172.21.15.63:0/1282452916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0be806ab90 con 0x7f0be8102030 2024-09-21T06:19:56.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.520+0000 7f0bcffff640 1 -- 172.21.15.63:0/1282452916 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) ==== 103194+0+0 (secure 0 0 0) 0x7f0bd801a070 con 0x7f0be8102030 2024-09-21T06:19:56.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.521+0000 7f0bcffff640 1 --2- 172.21.15.63:0/1282452916 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0bd007b020 0x7f0bd007d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:56.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.521+0000 7f0be659c640 1 --2- 172.21.15.63:0/1282452916 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0bd007b020 0x7f0bd007d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:56.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.521+0000 7f0bcffff640 1 -- 172.21.15.63:0/1282452916 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0bd809c970 con 0x7f0be8102030 2024-09-21T06:19:56.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.522+0000 7f0be659c640 1 --2- 172.21.15.63:0/1282452916 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0bd007b020 0x7f0bd007d530 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc009230 tx=0x7f0bdc005de0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:56.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.526+0000 7f0bcffff640 1 -- 172.21.15.63:0/1282452916 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0bd8064f20 con 0x7f0be8102030 2024-09-21T06:19:56.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.718+0000 7f0bed175640 1 -- 172.21.15.63:0/1282452916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f0be810bc60 con 0x7f0be8102030 2024-09-21T06:19:56.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.722+0000 7f0bcffff640 1 -- 172.21.15.63:0/1282452916 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v24)=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7f0bd8009de0 con 0x7f0be8102030 2024-09-21T06:19:56.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.725+0000 7f0bed175640 1 -- 172.21.15.63:0/1282452916 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0bd007b020 msgr2=0x7f0bd007d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:56.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.725+0000 7f0bed175640 1 --2- 172.21.15.63:0/1282452916 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0bd007b020 0x7f0bd007d530 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc009230 tx=0x7f0bdc005de0 comp rx=0 tx=0).stop 2024-09-21T06:19:56.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.725+0000 7f0bed175640 1 -- 172.21.15.63:0/1282452916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0be8102030 msgr2=0x7f0be819a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:56.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.725+0000 7f0bed175640 1 --2- 172.21.15.63:0/1282452916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0be8102030 0x7f0be819a490 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0bd800d950 tx=0x7f0bd800de10 comp rx=0 tx=0).stop 2024-09-21T06:19:56.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.725+0000 7f0bed175640 1 -- 172.21.15.63:0/1282452916 shutdown_connections 2024-09-21T06:19:56.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.725+0000 7f0bed175640 1 --2- 172.21.15.63:0/1282452916 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0bd007b020 0x7f0bd007d530 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:56.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.725+0000 7f0bed175640 1 --2- 172.21.15.63:0/1282452916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0be8106bd0 0x7f0be819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:56.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.725+0000 7f0bed175640 1 --2- 172.21.15.63:0/1282452916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be8106280 0x7f0be819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:56.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.725+0000 7f0bed175640 1 --2- 172.21.15.63:0/1282452916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0be8102030 0x7f0be819a490 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:56.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.725+0000 7f0bed175640 1 -- 172.21.15.63:0/1282452916 >> 172.21.15.63:0/1282452916 conn(0x7f0be8077c60 msgr2=0x7f0be81074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:56.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.725+0000 7f0bed175640 1 -- 172.21.15.63:0/1282452916 shutdown_connections 2024-09-21T06:19:56.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.725+0000 7f0bed175640 1 -- 172.21.15.63:0/1282452916 wait complete. 2024-09-21T06:19:56.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.732+0000 7f6f379e0640 1 -- 172.21.15.63:0/1718239277 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f301094b0 msgr2=0x7f6f301098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:56.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.732+0000 7f6f379e0640 1 --2- 172.21.15.63:0/1718239277 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f301094b0 0x7f6f301098c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6f20009900 tx=0x7f6f2002a410 comp rx=0 tx=0).stop 2024-09-21T06:19:56.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.732+0000 7f6f379e0640 1 -- 172.21.15.63:0/1718239277 shutdown_connections 2024-09-21T06:19:56.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.732+0000 7f6f379e0640 1 --2- 172.21.15.63:0/1718239277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f30109e00 0x7f6f30110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:56.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.732+0000 7f6f379e0640 1 --2- 172.21.15.63:0/1718239277 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f301094b0 0x7f6f301098c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:56.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.732+0000 7f6f379e0640 1 --2- 172.21.15.63:0/1718239277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f30101f70 0x7f6f30102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:56.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.732+0000 7f6f379e0640 1 -- 172.21.15.63:0/1718239277 >> 172.21.15.63:0/1718239277 conn(0x7f6f30077c60 msgr2=0x7f6f300780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:56.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.732+0000 7f6f379e0640 1 -- 172.21.15.63:0/1718239277 shutdown_connections 2024-09-21T06:19:56.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.732+0000 7f6f379e0640 1 -- 172.21.15.63:0/1718239277 wait complete. 2024-09-21T06:19:56.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.733+0000 7f6f379e0640 1 Processor -- start 2024-09-21T06:19:56.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.733+0000 7f6f379e0640 1 -- start start 2024-09-21T06:19:56.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.733+0000 7f6f379e0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f30101f70 0x7f6f30102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:56.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.733+0000 7f6f379e0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f301094b0 0x7f6f30103450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:56.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.733+0000 7f6f379e0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f30109e00 0x7f6f30103990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:56.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.733+0000 7f6f379e0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6f30113ac0 con 0x7f6f30101f70 2024-09-21T06:19:56.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.733+0000 7f6f379e0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6f30113940 con 0x7f6f30109e00 2024-09-21T06:19:56.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.733+0000 7f6f379e0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6f30113c40 con 0x7f6f301094b0 2024-09-21T06:19:56.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.734+0000 7f6f3577c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f30101f70 0x7f6f30102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:56.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.734+0000 7f6f3577c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f30101f70 0x7f6f30102f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59142/0 (socket says 172.21.15.63:59142) 2024-09-21T06:19:56.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.734+0000 7f6f3577c640 1 -- 172.21.15.63:0/2087598959 learned_addr learned my addr 172.21.15.63:0/2087598959 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:19:56.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.734+0000 7f6f35f7d640 1 --2- 172.21.15.63:0/2087598959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f30109e00 0x7f6f30103990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:56.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.734+0000 7f6f34f7b640 1 --2- 172.21.15.63:0/2087598959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f301094b0 0x7f6f30103450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:56.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.734+0000 7f6f35f7d640 1 -- 172.21.15.63:0/2087598959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f301094b0 msgr2=0x7f6f30103450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:56.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.734+0000 7f6f35f7d640 1 --2- 172.21.15.63:0/2087598959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f301094b0 0x7f6f30103450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:56.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.734+0000 7f6f35f7d640 1 -- 172.21.15.63:0/2087598959 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f30101f70 msgr2=0x7f6f30102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:56.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.734+0000 7f6f35f7d640 1 --2- 172.21.15.63:0/2087598959 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f30101f70 0x7f6f30102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:56.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.734+0000 7f6f35f7d640 1 -- 172.21.15.63:0/2087598959 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f301a8710 con 0x7f6f30109e00 2024-09-21T06:19:56.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.734+0000 7f6f3577c640 1 --2- 172.21.15.63:0/2087598959 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f30101f70 0x7f6f30102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:19:56.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.734+0000 7f6f35f7d640 1 --2- 172.21.15.63:0/2087598959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f30109e00 0x7f6f30103990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009fd0 tx=0x7f6f2800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:56.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.734+0000 7f6f267fc640 1 -- 172.21.15.63:0/2087598959 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2800ce20 con 0x7f6f30109e00 2024-09-21T06:19:56.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.734+0000 7f6f267fc640 1 -- 172.21.15.63:0/2087598959 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f28005020 con 0x7f6f30109e00 2024-09-21T06:19:56.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.734+0000 7f6f379e0640 1 -- 172.21.15.63:0/2087598959 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f301a8a00 con 0x7f6f30109e00 2024-09-21T06:19:56.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.735+0000 7f6f267fc640 1 -- 172.21.15.63:0/2087598959 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f28010690 con 0x7f6f30109e00 2024-09-21T06:19:56.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.735+0000 7f6f379e0640 1 -- 172.21.15.63:0/2087598959 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f301a8f10 con 0x7f6f30109e00 2024-09-21T06:19:56.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.736+0000 7f6f379e0640 1 -- 172.21.15.63:0/2087598959 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f3006ac50 con 0x7f6f30109e00 2024-09-21T06:19:56.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.736+0000 7f6f267fc640 1 -- 172.21.15.63:0/2087598959 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) ==== 103194+0+0 (secure 0 0 0) 0x7f6f28010830 con 0x7f6f30109e00 2024-09-21T06:19:56.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.737+0000 7f6f267fc640 1 --2- 172.21.15.63:0/2087598959 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6f1c07b020 0x7f6f1c07d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:56.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.737+0000 7f6f267fc640 1 -- 172.21.15.63:0/2087598959 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f6f2809d480 con 0x7f6f30109e00 2024-09-21T06:19:56.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.737+0000 7f6f3577c640 1 --2- 172.21.15.63:0/2087598959 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6f1c07b020 0x7f6f1c07d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:56.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.737+0000 7f6f3577c640 1 --2- 172.21.15.63:0/2087598959 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6f1c07b020 0x7f6f1c07d530 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6f30104960 tx=0x7f6f2c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:56.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.741+0000 7f6f267fc640 1 -- 172.21.15.63:0/2087598959 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6f28069e90 con 0x7f6f30109e00 2024-09-21T06:19:56.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.938+0000 7f6f379e0640 1 -- 172.21.15.63:0/2087598959 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f6f3010bc50 con 0x7f6f30109e00 2024-09-21T06:19:56.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.943+0000 7f6f267fc640 1 -- 172.21.15.63:0/2087598959 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v25)=0 v25) ==== 133+0+0 (secure 0 0 0) 0x7f6f2806ed40 con 0x7f6f30109e00 2024-09-21T06:19:56.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.946+0000 7f6f379e0640 1 -- 172.21.15.63:0/2087598959 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6f1c07b020 msgr2=0x7f6f1c07d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:56.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.946+0000 7f6f379e0640 1 --2- 172.21.15.63:0/2087598959 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6f1c07b020 0x7f6f1c07d530 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6f30104960 tx=0x7f6f2c005f90 comp rx=0 tx=0).stop 2024-09-21T06:19:56.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.946+0000 7f6f379e0640 1 -- 172.21.15.63:0/2087598959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f30109e00 msgr2=0x7f6f30103990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:56.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.946+0000 7f6f379e0640 1 --2- 172.21.15.63:0/2087598959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f30109e00 0x7f6f30103990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009fd0 tx=0x7f6f2800ef10 comp rx=0 tx=0).stop 2024-09-21T06:19:56.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.946+0000 7f6f379e0640 1 -- 172.21.15.63:0/2087598959 shutdown_connections 2024-09-21T06:19:56.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.946+0000 7f6f379e0640 1 --2- 172.21.15.63:0/2087598959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f30109e00 0x7f6f30103990 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:56.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.946+0000 7f6f379e0640 1 --2- 172.21.15.63:0/2087598959 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6f1c07b020 0x7f6f1c07d530 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:56.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.946+0000 7f6f379e0640 1 --2- 172.21.15.63:0/2087598959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f301094b0 0x7f6f30103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:56.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.946+0000 7f6f379e0640 1 --2- 172.21.15.63:0/2087598959 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f30101f70 0x7f6f30102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:56.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.946+0000 7f6f379e0640 1 -- 172.21.15.63:0/2087598959 >> 172.21.15.63:0/2087598959 conn(0x7f6f30077c60 msgr2=0x7f6f30107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:56.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.946+0000 7f6f379e0640 1 -- 172.21.15.63:0/2087598959 shutdown_connections 2024-09-21T06:19:56.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:56.946+0000 7f6f379e0640 1 -- 172.21.15.63:0/2087598959 wait complete. 2024-09-21T06:19:57.162 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:56 smithi063 ceph-mon[31150]: from='client.? ' entity='client.admin' 2024-09-21T06:19:57.162 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:56 smithi063 ceph-mon[31150]: Standby manager daemon y started 2024-09-21T06:19:57.162 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:56 smithi063 ceph-mon[31150]: from='mgr.? 172.21.15.71:0/4115052335' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T06:19:57.162 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:56 smithi063 ceph-mon[31150]: from='mgr.? 172.21.15.71:0/4115052335' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:19:57.162 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:56 smithi063 ceph-mon[31150]: from='mgr.? 172.21.15.71:0/4115052335' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T06:19:57.162 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:56 smithi063 ceph-mon[31150]: from='mgr.? 172.21.15.71:0/4115052335' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:19:57.162 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:56 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1282452916' entity='client.admin' 2024-09-21T06:19:57.162 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:56 smithi063 ceph-mon[31150]: from='client.? ' entity='client.admin' 2024-09-21T06:19:57.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:56 smithi071 ceph-mon[34844]: from='client.? ' entity='client.admin' 2024-09-21T06:19:57.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:56 smithi071 ceph-mon[34844]: Standby manager daemon y started 2024-09-21T06:19:57.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:56 smithi071 ceph-mon[34844]: from='mgr.? 172.21.15.71:0/4115052335' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T06:19:57.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:56 smithi071 ceph-mon[34844]: from='mgr.? 172.21.15.71:0/4115052335' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:19:57.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:56 smithi071 ceph-mon[34844]: from='mgr.? 172.21.15.71:0/4115052335' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T06:19:57.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:56 smithi071 ceph-mon[34844]: from='mgr.? 172.21.15.71:0/4115052335' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:19:57.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:56 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1282452916' entity='client.admin' 2024-09-21T06:19:57.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:56 smithi071 ceph-mon[34844]: from='client.? ' entity='client.admin' 2024-09-21T06:19:57.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.326+0000 7fad4ec20640 1 -- 172.21.15.63:0/2495784561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad48108cf0 msgr2=0x7fad4810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:57.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.326+0000 7fad4ec20640 1 --2- 172.21.15.63:0/2495784561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad48108cf0 0x7fad4810f520 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fad40009ca0 tx=0x7fad4002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:19:57.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.326+0000 7fad4ec20640 1 -- 172.21.15.63:0/2495784561 shutdown_connections 2024-09-21T06:19:57.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.326+0000 7fad4ec20640 1 --2- 172.21.15.63:0/2495784561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad48108cf0 0x7fad4810f520 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:57.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.326+0000 7fad4ec20640 1 --2- 172.21.15.63:0/2495784561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad481083a0 0x7fad481087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:57.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.326+0000 7fad4ec20640 1 --2- 172.21.15.63:0/2495784561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad48102a60 0x7fad48102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:57.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.326+0000 7fad4ec20640 1 -- 172.21.15.63:0/2495784561 >> 172.21.15.63:0/2495784561 conn(0x7fad48079730 msgr2=0x7fad48079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:57.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.326+0000 7fad4ec20640 1 -- 172.21.15.63:0/2495784561 shutdown_connections 2024-09-21T06:19:57.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.326+0000 7fad4ec20640 1 -- 172.21.15.63:0/2495784561 wait complete. 2024-09-21T06:19:57.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.327+0000 7fad4ec20640 1 Processor -- start 2024-09-21T06:19:57.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.327+0000 7fad4ec20640 1 -- start start 2024-09-21T06:19:57.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.327+0000 7fad4ec20640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad48102a60 0x7fad4819b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:57.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.327+0000 7fad4ec20640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad481083a0 0x7fad4819b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:57.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.327+0000 7fad4ec20640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad48108cf0 0x7fad4819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:57.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.327+0000 7fad4ec20640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fad48112960 con 0x7fad481083a0 2024-09-21T06:19:57.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.327+0000 7fad4ec20640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fad481127e0 con 0x7fad48108cf0 2024-09-21T06:19:57.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.327+0000 7fad4ec20640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fad48112ae0 con 0x7fad48102a60 2024-09-21T06:19:57.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.328+0000 7fad47fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad481083a0 0x7fad4819b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.328+0000 7fad47fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad481083a0 0x7fad4819b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59184/0 (socket says 172.21.15.63:59184) 2024-09-21T06:19:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.328+0000 7fad47fff640 1 -- 172.21.15.63:0/3935444004 learned_addr learned my addr 172.21.15.63:0/3935444004 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:19:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.328+0000 7fad4c9bc640 1 --2- 172.21.15.63:0/3935444004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad48102a60 0x7fad4819b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.328+0000 7fad4d1bd640 1 --2- 172.21.15.63:0/3935444004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad48108cf0 0x7fad4819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.328+0000 7fad47fff640 1 -- 172.21.15.63:0/3935444004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad48102a60 msgr2=0x7fad4819b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.328+0000 7fad47fff640 1 --2- 172.21.15.63:0/3935444004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad48102a60 0x7fad4819b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.328+0000 7fad47fff640 1 -- 172.21.15.63:0/3935444004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad48108cf0 msgr2=0x7fad4819bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.328+0000 7fad47fff640 1 --2- 172.21.15.63:0/3935444004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad48108cf0 0x7fad4819bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.328+0000 7fad47fff640 1 -- 172.21.15.63:0/3935444004 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad481a6520 con 0x7fad481083a0 2024-09-21T06:19:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.328+0000 7fad47fff640 1 --2- 172.21.15.63:0/3935444004 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad481083a0 0x7fad4819b7d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fad3400e9c0 tx=0x7fad3400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.328+0000 7fad45ffb640 1 -- 172.21.15.63:0/3935444004 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3400cd80 con 0x7fad481083a0 2024-09-21T06:19:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.328+0000 7fad45ffb640 1 -- 172.21.15.63:0/3935444004 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad340054d0 con 0x7fad481083a0 2024-09-21T06:19:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.328+0000 7fad4ec20640 1 -- 172.21.15.63:0/3935444004 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad481a6810 con 0x7fad481083a0 2024-09-21T06:19:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.328+0000 7fad45ffb640 1 -- 172.21.15.63:0/3935444004 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad34010430 con 0x7fad481083a0 2024-09-21T06:19:57.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.329+0000 7fad4ec20640 1 -- 172.21.15.63:0/3935444004 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad481a6d50 con 0x7fad481083a0 2024-09-21T06:19:57.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.330+0000 7fad4ec20640 1 -- 172.21.15.63:0/3935444004 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad48102e70 con 0x7fad481083a0 2024-09-21T06:19:57.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.331+0000 7fad45ffb640 1 -- 172.21.15.63:0/3935444004 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fad34004fb0 con 0x7fad481083a0 2024-09-21T06:19:57.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.332+0000 7fad45ffb640 1 --2- 172.21.15.63:0/3935444004 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fad380b6500 0x7fad380b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:57.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.333+0000 7fad4c9bc640 1 --2- 172.21.15.63:0/3935444004 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fad380b6500 0x7fad380b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:57.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.333+0000 7fad45ffb640 1 -- 172.21.15.63:0/3935444004 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fad340e5d40 con 0x7fad481083a0 2024-09-21T06:19:57.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.333+0000 7fad4c9bc640 1 --2- 172.21.15.63:0/3935444004 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fad380b6500 0x7fad380b8a10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fad4806b9c0 tx=0x7fad3c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:57.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.336+0000 7fad45ffb640 1 -- 172.21.15.63:0/3935444004 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fad34056710 con 0x7fad481083a0 2024-09-21T06:19:57.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:56 smithi175 ceph-mon[34510]: from='client.? ' entity='client.admin' 2024-09-21T06:19:57.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:56 smithi175 ceph-mon[34510]: Standby manager daemon y started 2024-09-21T06:19:57.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:56 smithi175 ceph-mon[34510]: from='mgr.? 172.21.15.71:0/4115052335' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T06:19:57.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:56 smithi175 ceph-mon[34510]: from='mgr.? 172.21.15.71:0/4115052335' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:19:57.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:56 smithi175 ceph-mon[34510]: from='mgr.? 172.21.15.71:0/4115052335' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T06:19:57.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:56 smithi175 ceph-mon[34510]: from='mgr.? 172.21.15.71:0/4115052335' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:19:57.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:56 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1282452916' entity='client.admin' 2024-09-21T06:19:57.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:56 smithi175 ceph-mon[34510]: from='client.? ' entity='client.admin' 2024-09-21T06:19:57.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.536+0000 7fad4ec20640 1 -- 172.21.15.63:0/3935444004 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7fad4806b270 con 0x7fad481083a0 2024-09-21T06:19:57.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.540+0000 7fad45ffb640 1 -- 172.21.15.63:0/3935444004 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v27)=0 v27) ==== 129+0+0 (secure 0 0 0) 0x7fad4806b270 con 0x7fad481083a0 2024-09-21T06:19:57.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.542+0000 7fad4ec20640 1 -- 172.21.15.63:0/3935444004 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fad380b6500 msgr2=0x7fad380b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:57.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.542+0000 7fad4ec20640 1 --2- 172.21.15.63:0/3935444004 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fad380b6500 0x7fad380b8a10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fad4806b9c0 tx=0x7fad3c00b390 comp rx=0 tx=0).stop 2024-09-21T06:19:57.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.542+0000 7fad4ec20640 1 -- 172.21.15.63:0/3935444004 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad481083a0 msgr2=0x7fad4819b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:57.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.542+0000 7fad4ec20640 1 --2- 172.21.15.63:0/3935444004 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad481083a0 0x7fad4819b7d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fad3400e9c0 tx=0x7fad3400ee80 comp rx=0 tx=0).stop 2024-09-21T06:19:57.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.542+0000 7fad4ec20640 1 -- 172.21.15.63:0/3935444004 shutdown_connections 2024-09-21T06:19:57.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.542+0000 7fad4ec20640 1 --2- 172.21.15.63:0/3935444004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad48108cf0 0x7fad4819bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:57.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.542+0000 7fad4ec20640 1 --2- 172.21.15.63:0/3935444004 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad481083a0 0x7fad4819b7d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:57.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.542+0000 7fad4ec20640 1 --2- 172.21.15.63:0/3935444004 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fad380b6500 0x7fad380b8a10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:57.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.542+0000 7fad4ec20640 1 --2- 172.21.15.63:0/3935444004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad48102a60 0x7fad4819b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:57.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.542+0000 7fad4ec20640 1 -- 172.21.15.63:0/3935444004 >> 172.21.15.63:0/3935444004 conn(0x7fad48079730 msgr2=0x7fad48104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:57.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.543+0000 7fad4ec20640 1 -- 172.21.15.63:0/3935444004 shutdown_connections 2024-09-21T06:19:57.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.543+0000 7fad4ec20640 1 -- 172.21.15.63:0/3935444004 wait complete. 2024-09-21T06:19:58.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:57 smithi071 ceph-mon[34844]: mgrmap e20: x(active, since 19s), standbys: z, y 2024-09-21T06:19:58.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:57 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T06:19:58.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:57 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2653716668' entity='client.admin' 2024-09-21T06:19:58.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:57 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3935444004' entity='client.admin' 2024-09-21T06:19:58.277 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:57 smithi063 ceph-mon[31150]: mgrmap e20: x(active, since 19s), standbys: z, y 2024-09-21T06:19:58.277 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:57 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T06:19:58.277 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:57 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2653716668' entity='client.admin' 2024-09-21T06:19:58.278 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:57 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3935444004' entity='client.admin' 2024-09-21T06:19:58.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:57 smithi175 ceph-mon[34510]: mgrmap e20: x(active, since 19s), standbys: z, y 2024-09-21T06:19:58.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:57 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T06:19:58.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:57 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2653716668' entity='client.admin' 2024-09-21T06:19:58.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:57 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3935444004' entity='client.admin' 2024-09-21T06:19:58.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.372+0000 7f4c8f957640 1 -- 172.21.15.63:0/2145757924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c88108d20 msgr2=0x7f4c8810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:58.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.372+0000 7f4c8f957640 1 --2- 172.21.15.63:0/2145757924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c88108d20 0x7f4c8810f550 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4c80009ca0 tx=0x7f4c8002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:19:58.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.372+0000 7f4c8f957640 1 -- 172.21.15.63:0/2145757924 shutdown_connections 2024-09-21T06:19:58.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.372+0000 7f4c8f957640 1 --2- 172.21.15.63:0/2145757924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c88108d20 0x7f4c8810f550 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:58.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.372+0000 7f4c8f957640 1 --2- 172.21.15.63:0/2145757924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c881083d0 0x7f4c881087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:58.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.372+0000 7f4c8f957640 1 --2- 172.21.15.63:0/2145757924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c88102a90 0x7f4c88102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:58.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.372+0000 7f4c8f957640 1 -- 172.21.15.63:0/2145757924 >> 172.21.15.63:0/2145757924 conn(0x7f4c88079750 msgr2=0x7f4c88079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:58.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.373+0000 7f4c8f957640 1 -- 172.21.15.63:0/2145757924 shutdown_connections 2024-09-21T06:19:58.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.373+0000 7f4c8f957640 1 -- 172.21.15.63:0/2145757924 wait complete. 2024-09-21T06:19:58.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.373+0000 7f4c8f957640 1 Processor -- start 2024-09-21T06:19:58.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.373+0000 7f4c8f957640 1 -- start start 2024-09-21T06:19:58.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c8f957640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c88102a90 0x7f4c8819b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:58.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c8f957640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c881083d0 0x7f4c8819b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:58.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c8f957640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c88108d20 0x7f4c8819bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:58.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c8f957640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4c88112990 con 0x7f4c88102a90 2024-09-21T06:19:58.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c8f957640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4c88112810 con 0x7f4c88108d20 2024-09-21T06:19:58.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c8f957640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4c88112b10 con 0x7f4c881083d0 2024-09-21T06:19:58.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c8d6f3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c88102a90 0x7f4c8819b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:58.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c8d6f3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c88102a90 0x7f4c8819b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59214/0 (socket says 172.21.15.63:59214) 2024-09-21T06:19:58.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c8d6f3640 1 -- 172.21.15.63:0/1278570317 learned_addr learned my addr 172.21.15.63:0/1278570317 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:19:58.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c8cef2640 1 --2- 172.21.15.63:0/1278570317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c881083d0 0x7f4c8819b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:58.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c8def4640 1 --2- 172.21.15.63:0/1278570317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c88108d20 0x7f4c8819bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:58.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c8d6f3640 1 -- 172.21.15.63:0/1278570317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c881083d0 msgr2=0x7f4c8819b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:58.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c8d6f3640 1 --2- 172.21.15.63:0/1278570317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c881083d0 0x7f4c8819b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:58.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c8d6f3640 1 -- 172.21.15.63:0/1278570317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c88108d20 msgr2=0x7f4c8819bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:58.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c8d6f3640 1 --2- 172.21.15.63:0/1278570317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c88108d20 0x7f4c8819bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:58.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c8d6f3640 1 -- 172.21.15.63:0/1278570317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c881a64f0 con 0x7f4c88102a90 2024-09-21T06:19:58.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c8d6f3640 1 --2- 172.21.15.63:0/1278570317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c88102a90 0x7f4c8819b1e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4c8400d950 tx=0x7f4c8400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:58.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c7e7fc640 1 -- 172.21.15.63:0/1278570317 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c84017070 con 0x7f4c88102a90 2024-09-21T06:19:58.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c7e7fc640 1 -- 172.21.15.63:0/1278570317 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c84009c30 con 0x7f4c88102a90 2024-09-21T06:19:58.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c8f957640 1 -- 172.21.15.63:0/1278570317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c881a67e0 con 0x7f4c88102a90 2024-09-21T06:19:58.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.374+0000 7f4c7e7fc640 1 -- 172.21.15.63:0/1278570317 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8400f620 con 0x7f4c88102a90 2024-09-21T06:19:58.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.375+0000 7f4c8f957640 1 -- 172.21.15.63:0/1278570317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c881a6d20 con 0x7f4c88102a90 2024-09-21T06:19:58.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.376+0000 7f4c8f957640 1 -- 172.21.15.63:0/1278570317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c88103d10 con 0x7f4c88102a90 2024-09-21T06:19:58.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.377+0000 7f4c7e7fc640 1 -- 172.21.15.63:0/1278570317 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f4c84010460 con 0x7f4c88102a90 2024-09-21T06:19:58.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.378+0000 7f4c7e7fc640 1 --2- 172.21.15.63:0/1278570317 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4c740b64d0 0x7f4c740b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:58.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.378+0000 7f4c8cef2640 1 --2- 172.21.15.63:0/1278570317 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4c740b64d0 0x7f4c740b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:58.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.378+0000 7f4c7e7fc640 1 -- 172.21.15.63:0/1278570317 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4c840e5450 con 0x7f4c88102a90 2024-09-21T06:19:58.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.378+0000 7f4c8cef2640 1 --2- 172.21.15.63:0/1278570317 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4c740b64d0 0x7f4c740b89e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4c78005fd0 tx=0x7f4c78005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:58.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.382+0000 7f4c7e7fc640 1 -- 172.21.15.63:0/1278570317 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4c840ad8e0 con 0x7f4c88102a90 2024-09-21T06:19:58.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.575+0000 7f4c8f957640 1 -- 172.21.15.63:0/1278570317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f4c88102ea0 con 0x7f4c88102a90 2024-09-21T06:19:58.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.593+0000 7f4c7e7fc640 1 -- 172.21.15.63:0/1278570317 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7f4c84009de0 con 0x7f4c88102a90 2024-09-21T06:19:58.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.595+0000 7f4c8f957640 1 -- 172.21.15.63:0/1278570317 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4c740b64d0 msgr2=0x7f4c740b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:58.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.595+0000 7f4c8f957640 1 --2- 172.21.15.63:0/1278570317 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4c740b64d0 0x7f4c740b89e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4c78005fd0 tx=0x7f4c78005850 comp rx=0 tx=0).stop 2024-09-21T06:19:58.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.595+0000 7f4c8f957640 1 -- 172.21.15.63:0/1278570317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c88102a90 msgr2=0x7f4c8819b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:58.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.595+0000 7f4c8f957640 1 --2- 172.21.15.63:0/1278570317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c88102a90 0x7f4c8819b1e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4c8400d950 tx=0x7f4c8400de10 comp rx=0 tx=0).stop 2024-09-21T06:19:58.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.595+0000 7f4c8f957640 1 -- 172.21.15.63:0/1278570317 shutdown_connections 2024-09-21T06:19:58.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.595+0000 7f4c8f957640 1 --2- 172.21.15.63:0/1278570317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c88108d20 0x7f4c8819bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:58.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.595+0000 7f4c8f957640 1 --2- 172.21.15.63:0/1278570317 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4c740b64d0 0x7f4c740b89e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:58.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.595+0000 7f4c8f957640 1 --2- 172.21.15.63:0/1278570317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c881083d0 0x7f4c8819b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:58.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.595+0000 7f4c8f957640 1 --2- 172.21.15.63:0/1278570317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c88102a90 0x7f4c8819b1e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:58.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.596+0000 7f4c8f957640 1 -- 172.21.15.63:0/1278570317 >> 172.21.15.63:0/1278570317 conn(0x7f4c88079750 msgr2=0x7f4c88104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:58.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.596+0000 7f4c8f957640 1 -- 172.21.15.63:0/1278570317 shutdown_connections 2024-09-21T06:19:58.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.596+0000 7f4c8f957640 1 -- 172.21.15.63:0/1278570317 wait complete. 2024-09-21T06:19:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.966+0000 7f4ec96db640 1 -- 172.21.15.63:0/2727462053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ec4108fc0 msgr2=0x7f4ec410f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.966+0000 7f4ec96db640 1 --2- 172.21.15.63:0/2727462053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ec4108fc0 0x7f4ec410f7f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009ca0 tx=0x7f4ebc02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:19:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.966+0000 7f4ec96db640 1 -- 172.21.15.63:0/2727462053 shutdown_connections 2024-09-21T06:19:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.966+0000 7f4ec96db640 1 --2- 172.21.15.63:0/2727462053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ec4108fc0 0x7f4ec410f7f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.966+0000 7f4ec96db640 1 --2- 172.21.15.63:0/2727462053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ec4108670 0x7f4ec4108a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.966+0000 7f4ec96db640 1 --2- 172.21.15.63:0/2727462053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ec4103230 0x7f4ec4103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.966+0000 7f4ec96db640 1 -- 172.21.15.63:0/2727462053 >> 172.21.15.63:0/2727462053 conn(0x7f4ec4079ea0 msgr2=0x7f4ec407a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.966+0000 7f4ec96db640 1 -- 172.21.15.63:0/2727462053 shutdown_connections 2024-09-21T06:19:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.966+0000 7f4ec96db640 1 -- 172.21.15.63:0/2727462053 wait complete. 2024-09-21T06:19:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.967+0000 7f4ec96db640 1 Processor -- start 2024-09-21T06:19:58.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.967+0000 7f4ec96db640 1 -- start start 2024-09-21T06:19:58.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.967+0000 7f4ec96db640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ec4103230 0x7f4ec4199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:58.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.967+0000 7f4ec96db640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ec4108670 0x7f4ec4199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:58.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.968+0000 7f4ec96db640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ec4108fc0 0x7f4ec419ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:58.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.968+0000 7f4ec96db640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec4112c80 con 0x7f4ec4108fc0 2024-09-21T06:19:58.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.968+0000 7f4ec96db640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec4112b00 con 0x7f4ec4108670 2024-09-21T06:19:58.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.968+0000 7f4ec96db640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec4112e00 con 0x7f4ec4103230 2024-09-21T06:19:58.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.968+0000 7f4ec37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ec4108fc0 0x7f4ec419ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.968+0000 7f4ec37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ec4108fc0 0x7f4ec419ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59244/0 (socket says 172.21.15.63:59244) 2024-09-21T06:19:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.968+0000 7f4ec37fe640 1 -- 172.21.15.63:0/3813369557 learned_addr learned my addr 172.21.15.63:0/3813369557 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:19:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.968+0000 7f4ec27fc640 1 --2- 172.21.15.63:0/3813369557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ec4108670 0x7f4ec4199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.968+0000 7f4ec2ffd640 1 --2- 172.21.15.63:0/3813369557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ec4103230 0x7f4ec4199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.968+0000 7f4ec37fe640 1 -- 172.21.15.63:0/3813369557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ec4103230 msgr2=0x7f4ec4199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.968+0000 7f4ec37fe640 1 --2- 172.21.15.63:0/3813369557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ec4103230 0x7f4ec4199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.968+0000 7f4ec37fe640 1 -- 172.21.15.63:0/3813369557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ec4108670 msgr2=0x7f4ec4199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.968+0000 7f4ec37fe640 1 --2- 172.21.15.63:0/3813369557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ec4108670 0x7f4ec4199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.968+0000 7f4ec37fe640 1 -- 172.21.15.63:0/3813369557 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec419f5a0 con 0x7f4ec4108fc0 2024-09-21T06:19:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.968+0000 7f4ec37fe640 1 --2- 172.21.15.63:0/3813369557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ec4108fc0 0x7f4ec419ee70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc005cc0 tx=0x7f4ebc0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.968+0000 7f4eabfff640 1 -- 172.21.15.63:0/3813369557 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc04a070 con 0x7f4ec4108fc0 2024-09-21T06:19:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.968+0000 7f4eabfff640 1 -- 172.21.15.63:0/3813369557 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ebc003b80 con 0x7f4ec4108fc0 2024-09-21T06:19:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.968+0000 7f4ec96db640 1 -- 172.21.15.63:0/3813369557 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ec419f830 con 0x7f4ec4108fc0 2024-09-21T06:19:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.969+0000 7f4eabfff640 1 -- 172.21.15.63:0/3813369557 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc02f990 con 0x7f4ec4108fc0 2024-09-21T06:19:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.969+0000 7f4ec96db640 1 -- 172.21.15.63:0/3813369557 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ec4101e90 con 0x7f4ec4108fc0 2024-09-21T06:19:58.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.970+0000 7f4ec96db640 1 -- 172.21.15.63:0/3813369557 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ec4104040 con 0x7f4ec4108fc0 2024-09-21T06:19:58.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.971+0000 7f4eabfff640 1 -- 172.21.15.63:0/3813369557 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f4ebc04d070 con 0x7f4ec4108fc0 2024-09-21T06:19:58.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.972+0000 7f4eabfff640 1 --2- 172.21.15.63:0/3813369557 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4eac0b64d0 0x7f4eac0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:58.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.972+0000 7f4ec2ffd640 1 --2- 172.21.15.63:0/3813369557 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4eac0b64d0 0x7f4eac0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:58.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.972+0000 7f4eabfff640 1 -- 172.21.15.63:0/3813369557 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4ebc107d00 con 0x7f4ec4108fc0 2024-09-21T06:19:58.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.972+0000 7f4ec2ffd640 1 --2- 172.21.15.63:0/3813369557 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4eac0b64d0 0x7f4eac0b89e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40058c0 tx=0x7f4eb400a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:58.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:58.976+0000 7f4eabfff640 1 -- 172.21.15.63:0/3813369557 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4ebc084710 con 0x7f4ec4108fc0 2024-09-21T06:19:59.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:59.167+0000 7f4ec96db640 1 -- 172.21.15.63:0/3813369557 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f4ec406b9a0 con 0x7f4ec4108fc0 2024-09-21T06:19:59.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:59.171+0000 7f4eabfff640 1 -- 172.21.15.63:0/3813369557 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v29)=0 v29) ==== 119+0+0 (secure 0 0 0) 0x7f4ebc0098b0 con 0x7f4ec4108fc0 2024-09-21T06:19:59.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:59.173+0000 7f4ec96db640 1 -- 172.21.15.63:0/3813369557 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4eac0b64d0 msgr2=0x7f4eac0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:59.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:59.173+0000 7f4ec96db640 1 --2- 172.21.15.63:0/3813369557 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4eac0b64d0 0x7f4eac0b89e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40058c0 tx=0x7f4eb400a250 comp rx=0 tx=0).stop 2024-09-21T06:19:59.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:59.173+0000 7f4ec96db640 1 -- 172.21.15.63:0/3813369557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ec4108fc0 msgr2=0x7f4ec419ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:59.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:59.173+0000 7f4ec96db640 1 --2- 172.21.15.63:0/3813369557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ec4108fc0 0x7f4ec419ee70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc005cc0 tx=0x7f4ebc0319f0 comp rx=0 tx=0).stop 2024-09-21T06:19:59.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:59.174+0000 7f4ec96db640 1 -- 172.21.15.63:0/3813369557 shutdown_connections 2024-09-21T06:19:59.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:59.174+0000 7f4ec96db640 1 --2- 172.21.15.63:0/3813369557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ec4108fc0 0x7f4ec419ee70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:59.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:59.174+0000 7f4ec96db640 1 --2- 172.21.15.63:0/3813369557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ec4108670 0x7f4ec4199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:59.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:59.174+0000 7f4ec96db640 1 --2- 172.21.15.63:0/3813369557 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4eac0b64d0 0x7f4eac0b89e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:59.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:59.174+0000 7f4ec96db640 1 --2- 172.21.15.63:0/3813369557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ec4103230 0x7f4ec4199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:59.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:59.174+0000 7f4ec96db640 1 -- 172.21.15.63:0/3813369557 >> 172.21.15.63:0/3813369557 conn(0x7f4ec4079ea0 msgr2=0x7f4ec41045e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:59.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:59.174+0000 7f4ec96db640 1 -- 172.21.15.63:0/3813369557 shutdown_connections 2024-09-21T06:19:59.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:59.174+0000 7f4ec96db640 1 -- 172.21.15.63:0/3813369557 wait complete. 2024-09-21T06:19:59.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.255+0000 7ffa756c4640 1 -- 172.21.15.63:0/568756114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa70108d00 msgr2=0x7ffa7010f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:59.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.255+0000 7ffa756c4640 1 --2- 172.21.15.63:0/568756114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa70108d00 0x7ffa7010f530 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009900 tx=0x7ffa6002a410 comp rx=0 tx=0).stop 2024-09-21T06:19:59.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.255+0000 7ffa756c4640 1 -- 172.21.15.63:0/568756114 shutdown_connections 2024-09-21T06:19:59.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.255+0000 7ffa756c4640 1 --2- 172.21.15.63:0/568756114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa70108d00 0x7ffa7010f530 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:59.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.255+0000 7ffa756c4640 1 --2- 172.21.15.63:0/568756114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa701083b0 0x7ffa701087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:59.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.255+0000 7ffa756c4640 1 --2- 172.21.15.63:0/568756114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa70102ac0 0x7ffa70102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:59.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.255+0000 7ffa756c4640 1 -- 172.21.15.63:0/568756114 >> 172.21.15.63:0/568756114 conn(0x7ffa70079720 msgr2=0x7ffa70079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:59.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.255+0000 7ffa756c4640 1 -- 172.21.15.63:0/568756114 shutdown_connections 2024-09-21T06:19:59.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.255+0000 7ffa756c4640 1 -- 172.21.15.63:0/568756114 wait complete. 2024-09-21T06:19:59.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.256+0000 7ffa756c4640 1 Processor -- start 2024-09-21T06:19:59.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.256+0000 7ffa756c4640 1 -- start start 2024-09-21T06:19:59.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.257+0000 7ffa756c4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa70102ac0 0x7ffa70199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:59.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.257+0000 7ffa756c4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa701083b0 0x7ffa701995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:59.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.257+0000 7ffa756c4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa70108d00 0x7ffa70199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:59.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.257+0000 7ffa756c4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ffa701129c0 con 0x7ffa70108d00 2024-09-21T06:19:59.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.257+0000 7ffa756c4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffa70112840 con 0x7ffa70102ac0 2024-09-21T06:19:59.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.257+0000 7ffa756c4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffa70112b40 con 0x7ffa701083b0 2024-09-21T06:19:59.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.257+0000 7ffa6f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa70108d00 0x7ffa70199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:59.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.257+0000 7ffa6f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa70108d00 0x7ffa70199ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59164/0 (socket says 172.21.15.63:59164) 2024-09-21T06:19:59.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.257+0000 7ffa6f7fe640 1 -- 172.21.15.63:0/2653716668 learned_addr learned my addr 172.21.15.63:0/2653716668 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:19:59.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.257+0000 7ffa6effd640 1 --2- 172.21.15.63:0/2653716668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa70102ac0 0x7ffa70199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:59.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.257+0000 7ffa6e7fc640 1 --2- 172.21.15.63:0/2653716668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa701083b0 0x7ffa701995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:59.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.257+0000 7ffa6f7fe640 1 -- 172.21.15.63:0/2653716668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa701083b0 msgr2=0x7ffa701995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:59.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.257+0000 7ffa6f7fe640 1 --2- 172.21.15.63:0/2653716668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa701083b0 0x7ffa701995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:59.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.257+0000 7ffa6f7fe640 1 -- 172.21.15.63:0/2653716668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa70102ac0 msgr2=0x7ffa70199060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:59.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.257+0000 7ffa6f7fe640 1 --2- 172.21.15.63:0/2653716668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa70102ac0 0x7ffa70199060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:59.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.257+0000 7ffa6f7fe640 1 -- 172.21.15.63:0/2653716668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa701a8710 con 0x7ffa70108d00 2024-09-21T06:19:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.257+0000 7ffa6f7fe640 1 --2- 172.21.15.63:0/2653716668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa70108d00 0x7ffa70199ae0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffa60004770 tx=0x7ffa60004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.258+0000 7ffa67fff640 1 -- 172.21.15.63:0/2653716668 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6003f030 con 0x7ffa70108d00 2024-09-21T06:19:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.258+0000 7ffa756c4640 1 -- 172.21.15.63:0/2653716668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa701a89a0 con 0x7ffa70108d00 2024-09-21T06:19:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.258+0000 7ffa67fff640 1 -- 172.21.15.63:0/2653716668 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa60003aa0 con 0x7ffa70108d00 2024-09-21T06:19:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.258+0000 7ffa67fff640 1 -- 172.21.15.63:0/2653716668 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60035070 con 0x7ffa70108d00 2024-09-21T06:19:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.258+0000 7ffa756c4640 1 -- 172.21.15.63:0/2653716668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa701a8ed0 con 0x7ffa70108d00 2024-09-21T06:19:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.259+0000 7ffa756c4640 1 -- 172.21.15.63:0/2653716668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa70102ed0 con 0x7ffa70108d00 2024-09-21T06:19:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.261+0000 7ffa67fff640 1 -- 172.21.15.63:0/2653716668 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7ffa60042030 con 0x7ffa70108d00 2024-09-21T06:19:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.261+0000 7ffa67fff640 1 --2- 172.21.15.63:0/2653716668 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffa5c0b64d0 0x7ffa5c0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.261+0000 7ffa6effd640 1 --2- 172.21.15.63:0/2653716668 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffa5c0b64d0 0x7ffa5c0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.261+0000 7ffa67fff640 1 -- 172.21.15.63:0/2653716668 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ffa60105dc0 con 0x7ffa70108d00 2024-09-21T06:19:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.262+0000 7ffa6effd640 1 --2- 172.21.15.63:0/2653716668 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffa5c0b64d0 0x7ffa5c0b89e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffa70079b70 tx=0x7ffa68009760 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.270+0000 7ffa67fff640 1 -- 172.21.15.63:0/2653716668 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffa600ce250 con 0x7ffa70108d00 2024-09-21T06:19:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.464+0000 7ffa756c4640 1 -- 172.21.15.63:0/2653716668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7ffa7002e640 con 0x7ffa70108d00 2024-09-21T06:19:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.468+0000 7ffa67fff640 1 -- 172.21.15.63:0/2653716668 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v26)=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7ffa600d2630 con 0x7ffa70108d00 2024-09-21T06:19:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.471+0000 7ffa756c4640 1 -- 172.21.15.63:0/2653716668 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffa5c0b64d0 msgr2=0x7ffa5c0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.471+0000 7ffa756c4640 1 --2- 172.21.15.63:0/2653716668 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffa5c0b64d0 0x7ffa5c0b89e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffa70079b70 tx=0x7ffa68009760 comp rx=0 tx=0).stop 2024-09-21T06:19:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.471+0000 7ffa756c4640 1 -- 172.21.15.63:0/2653716668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa70108d00 msgr2=0x7ffa70199ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.471+0000 7ffa756c4640 1 --2- 172.21.15.63:0/2653716668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa70108d00 0x7ffa70199ae0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffa60004770 tx=0x7ffa60004270 comp rx=0 tx=0).stop 2024-09-21T06:19:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.471+0000 7ffa756c4640 1 -- 172.21.15.63:0/2653716668 shutdown_connections 2024-09-21T06:19:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.471+0000 7ffa756c4640 1 --2- 172.21.15.63:0/2653716668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa70108d00 0x7ffa70199ae0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.471+0000 7ffa756c4640 1 --2- 172.21.15.63:0/2653716668 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffa5c0b64d0 0x7ffa5c0b89e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.471+0000 7ffa756c4640 1 --2- 172.21.15.63:0/2653716668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa701083b0 0x7ffa701995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.471+0000 7ffa756c4640 1 --2- 172.21.15.63:0/2653716668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa70102ac0 0x7ffa70199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.471+0000 7ffa756c4640 1 -- 172.21.15.63:0/2653716668 >> 172.21.15.63:0/2653716668 conn(0x7ffa70079720 msgr2=0x7ffa70106400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.471+0000 7ffa756c4640 1 -- 172.21.15.63:0/2653716668 shutdown_connections 2024-09-21T06:19:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:19:57.471+0000 7ffa756c4640 1 -- 172.21.15.63:0/2653716668 wait complete. 2024-09-21T06:19:59.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:59 smithi063 ceph-mon[31150]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:59.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:59 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1278570317' entity='client.admin' 2024-09-21T06:19:59.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:19:59 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3813369557' entity='client.admin' 2024-09-21T06:19:59.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:59 smithi175 ceph-mon[34510]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:19:59.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:59 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1278570317' entity='client.admin' 2024-09-21T06:19:59.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:19:59 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3813369557' entity='client.admin' 2024-09-21T06:20:00.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:59 smithi071 ceph-mon[34844]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:00.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:59 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1278570317' entity='client.admin' 2024-09-21T06:20:00.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:19:59 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3813369557' entity='client.admin' 2024-09-21T06:20:00.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.268+0000 7f9cea4cc640 1 -- 172.21.15.63:0/3936445373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ce4108d70 msgr2=0x7f9ce410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:00.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.268+0000 7f9cea4cc640 1 --2- 172.21.15.63:0/3936445373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ce4108d70 0x7f9ce410f5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc009ca0 tx=0x7f9cdc02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.268+0000 7f9cea4cc640 1 -- 172.21.15.63:0/3936445373 shutdown_connections 2024-09-21T06:20:00.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.268+0000 7f9cea4cc640 1 --2- 172.21.15.63:0/3936445373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ce4108d70 0x7f9ce410f5a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.268+0000 7f9cea4cc640 1 --2- 172.21.15.63:0/3936445373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce4108420 0x7f9ce4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.268+0000 7f9cea4cc640 1 --2- 172.21.15.63:0/3936445373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ce4102ae0 0x7f9ce4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.268+0000 7f9cea4cc640 1 -- 172.21.15.63:0/3936445373 >> 172.21.15.63:0/3936445373 conn(0x7f9ce4079770 msgr2=0x7f9ce4079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:00.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.269+0000 7f9cea4cc640 1 -- 172.21.15.63:0/3936445373 shutdown_connections 2024-09-21T06:20:00.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.269+0000 7f9cea4cc640 1 -- 172.21.15.63:0/3936445373 wait complete. 2024-09-21T06:20:00.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.269+0000 7f9cea4cc640 1 Processor -- start 2024-09-21T06:20:00.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.269+0000 7f9cea4cc640 1 -- start start 2024-09-21T06:20:00.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.270+0000 7f9cea4cc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce4102ae0 0x7f9ce419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:00.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.270+0000 7f9cea4cc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ce4108420 0x7f9ce419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:00.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.270+0000 7f9cea4cc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ce4108d70 0x7f9ce419fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:00.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.270+0000 7f9cea4cc640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce4112a30 con 0x7f9ce4108d70 2024-09-21T06:20:00.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.270+0000 7f9cea4cc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce41128b0 con 0x7f9ce4102ae0 2024-09-21T06:20:00.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.270+0000 7f9cea4cc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce4112bb0 con 0x7f9ce4108420 2024-09-21T06:20:00.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.270+0000 7f9ce8a69640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ce4108d70 0x7f9ce419fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:00.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.270+0000 7f9ce3fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce4102ae0 0x7f9ce419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.270+0000 7f9ce8a69640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ce4108d70 0x7f9ce419fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59274/0 (socket says 172.21.15.63:59274) 2024-09-21T06:20:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.270+0000 7f9ce8a69640 1 -- 172.21.15.63:0/2270221373 learned_addr learned my addr 172.21.15.63:0/2270221373 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:20:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.270+0000 7f9ce37fe640 1 --2- 172.21.15.63:0/2270221373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ce4108420 0x7f9ce419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.271+0000 7f9ce8a69640 1 -- 172.21.15.63:0/2270221373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ce4108420 msgr2=0x7f9ce419a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.271+0000 7f9ce8a69640 1 --2- 172.21.15.63:0/2270221373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ce4108420 0x7f9ce419a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.271+0000 7f9ce8a69640 1 -- 172.21.15.63:0/2270221373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce4102ae0 msgr2=0x7f9ce419a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.271+0000 7f9ce8a69640 1 --2- 172.21.15.63:0/2270221373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce4102ae0 0x7f9ce419a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.271+0000 7f9ce8a69640 1 -- 172.21.15.63:0/2270221373 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce41a02c0 con 0x7f9ce4108d70 2024-09-21T06:20:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.271+0000 7f9ce37fe640 1 --2- 172.21.15.63:0/2270221373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ce4108420 0x7f9ce419a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.271+0000 7f9ce8a69640 1 --2- 172.21.15.63:0/2270221373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ce4108d70 0x7f9ce419fc50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc005cc0 tx=0x7f9cdc02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.271+0000 7f9ce17fa640 1 -- 172.21.15.63:0/2270221373 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc003cf0 con 0x7f9ce4108d70 2024-09-21T06:20:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.271+0000 7f9cea4cc640 1 -- 172.21.15.63:0/2270221373 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce41a0550 con 0x7f9ce4108d70 2024-09-21T06:20:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.271+0000 7f9ce17fa640 1 -- 172.21.15.63:0/2270221373 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cdc0044f0 con 0x7f9ce4108d70 2024-09-21T06:20:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.271+0000 7f9ce17fa640 1 -- 172.21.15.63:0/2270221373 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc02fc30 con 0x7f9ce4108d70 2024-09-21T06:20:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.271+0000 7f9cea4cc640 1 -- 172.21.15.63:0/2270221373 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce41a0a90 con 0x7f9ce4108d70 2024-09-21T06:20:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.272+0000 7f9cea4cc640 1 -- 172.21.15.63:0/2270221373 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce4103d60 con 0x7f9ce4108d70 2024-09-21T06:20:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.274+0000 7f9ce17fa640 1 -- 172.21.15.63:0/2270221373 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f9cdc0046a0 con 0x7f9ce4108d70 2024-09-21T06:20:00.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.275+0000 7f9ce17fa640 1 --2- 172.21.15.63:0/2270221373 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9ccc0b6500 0x7f9ccc0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:00.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.275+0000 7f9ce3fff640 1 --2- 172.21.15.63:0/2270221373 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9ccc0b6500 0x7f9ccc0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:00.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.275+0000 7f9ce17fa640 1 -- 172.21.15.63:0/2270221373 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9cdc106df0 con 0x7f9ce4108d70 2024-09-21T06:20:00.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.275+0000 7f9ce3fff640 1 --2- 172.21.15.63:0/2270221373 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9ccc0b6500 0x7f9ccc0b8a10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400abe0 tx=0x7f9cd400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:00.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.278+0000 7f9ce17fa640 1 -- 172.21.15.63:0/2270221373 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9cdc0cf310 con 0x7f9ce4108d70 2024-09-21T06:20:00.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.466+0000 7f9cea4cc640 1 -- 172.21.15.63:0/2270221373 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f9ce410bb70 con 0x7f9ce4108d70 2024-09-21T06:20:00.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.470+0000 7f9ce17fa640 1 -- 172.21.15.63:0/2270221373 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7f9cdc0d36f0 con 0x7f9ce4108d70 2024-09-21T06:20:00.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.473+0000 7f9cea4cc640 1 -- 172.21.15.63:0/2270221373 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9ccc0b6500 msgr2=0x7f9ccc0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:00.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.473+0000 7f9cea4cc640 1 --2- 172.21.15.63:0/2270221373 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9ccc0b6500 0x7f9ccc0b8a10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400abe0 tx=0x7f9cd400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.473+0000 7f9cea4cc640 1 -- 172.21.15.63:0/2270221373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ce4108d70 msgr2=0x7f9ce419fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:00.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.473+0000 7f9cea4cc640 1 --2- 172.21.15.63:0/2270221373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ce4108d70 0x7f9ce419fc50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc005cc0 tx=0x7f9cdc02f470 comp rx=0 tx=0).stop 2024-09-21T06:20:00.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.473+0000 7f9cea4cc640 1 -- 172.21.15.63:0/2270221373 shutdown_connections 2024-09-21T06:20:00.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.473+0000 7f9cea4cc640 1 --2- 172.21.15.63:0/2270221373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ce4108d70 0x7f9ce419fc50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.473+0000 7f9cea4cc640 1 --2- 172.21.15.63:0/2270221373 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9ccc0b6500 0x7f9ccc0b8a10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.473+0000 7f9cea4cc640 1 --2- 172.21.15.63:0/2270221373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ce4108420 0x7f9ce419a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.473+0000 7f9cea4cc640 1 --2- 172.21.15.63:0/2270221373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ce4102ae0 0x7f9ce419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.473+0000 7f9cea4cc640 1 -- 172.21.15.63:0/2270221373 >> 172.21.15.63:0/2270221373 conn(0x7f9ce4079770 msgr2=0x7f9ce4101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:00.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.473+0000 7f9cea4cc640 1 -- 172.21.15.63:0/2270221373 shutdown_connections 2024-09-21T06:20:00.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.473+0000 7f9cea4cc640 1 -- 172.21.15.63:0/2270221373 wait complete. 2024-09-21T06:20:00.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.734+0000 7f432f6b9640 1 -- 172.21.15.63:0/257235336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4328105380 msgr2=0x7f432810d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:00.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.734+0000 7f432f6b9640 1 --2- 172.21.15.63:0/257235336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4328105380 0x7f432810d8d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4318009900 tx=0x7f431802a410 comp rx=0 tx=0).stop 2024-09-21T06:20:00.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.734+0000 7f432f6b9640 1 -- 172.21.15.63:0/257235336 shutdown_connections 2024-09-21T06:20:00.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.734+0000 7f432f6b9640 1 --2- 172.21.15.63:0/257235336 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f432810de60 0x7f4328110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.734+0000 7f432f6b9640 1 --2- 172.21.15.63:0/257235336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4328105380 0x7f432810d8d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.734+0000 7f432f6b9640 1 --2- 172.21.15.63:0/257235336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4328104a30 0x7f4328104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.734+0000 7f432f6b9640 1 -- 172.21.15.63:0/257235336 >> 172.21.15.63:0/257235336 conn(0x7f4328079760 msgr2=0x7f4328079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:00.737 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:00 smithi063 ceph-mon[31150]: overall HEALTH_OK 2024-09-21T06:20:00.737 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:00 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2270221373' entity='client.admin' 2024-09-21T06:20:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.735+0000 7f432f6b9640 1 -- 172.21.15.63:0/257235336 shutdown_connections 2024-09-21T06:20:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.735+0000 7f432f6b9640 1 -- 172.21.15.63:0/257235336 wait complete. 2024-09-21T06:20:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.735+0000 7f432f6b9640 1 Processor -- start 2024-09-21T06:20:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.735+0000 7f432f6b9640 1 -- start start 2024-09-21T06:20:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.736+0000 7f432f6b9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4328104a30 0x7f4328102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.736+0000 7f432f6b9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4328105380 0x7f4328102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.736+0000 7f432f6b9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f432810de60 0x7f43281031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.736+0000 7f432f6b9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4328113af0 con 0x7f4328105380 2024-09-21T06:20:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.736+0000 7f432f6b9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4328113970 con 0x7f4328104a30 2024-09-21T06:20:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.736+0000 7f432f6b9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4328113c70 con 0x7f432810de60 2024-09-21T06:20:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.736+0000 7f432cc54640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4328105380 0x7f4328102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.736+0000 7f432cc54640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4328105380 0x7f4328102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59292/0 (socket says 172.21.15.63:59292) 2024-09-21T06:20:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.736+0000 7f432cc54640 1 -- 172.21.15.63:0/4008857621 learned_addr learned my addr 172.21.15.63:0/4008857621 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:20:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.736+0000 7f432d455640 1 --2- 172.21.15.63:0/4008857621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4328104a30 0x7f4328102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.736+0000 7f432dc56640 1 --2- 172.21.15.63:0/4008857621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f432810de60 0x7f43281031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.736+0000 7f432cc54640 1 -- 172.21.15.63:0/4008857621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f432810de60 msgr2=0x7f43281031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.736+0000 7f432cc54640 1 --2- 172.21.15.63:0/4008857621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f432810de60 0x7f43281031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.736+0000 7f432cc54640 1 -- 172.21.15.63:0/4008857621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4328104a30 msgr2=0x7f4328102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.736+0000 7f432cc54640 1 --2- 172.21.15.63:0/4008857621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4328104a30 0x7f4328102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.736+0000 7f432cc54640 1 -- 172.21.15.63:0/4008857621 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43281a86b0 con 0x7f4328105380 2024-09-21T06:20:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.736+0000 7f432dc56640 1 --2- 172.21.15.63:0/4008857621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f432810de60 0x7f43281031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:20:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.736+0000 7f432d455640 1 --2- 172.21.15.63:0/4008857621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4328104a30 0x7f4328102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.736+0000 7f432cc54640 1 --2- 172.21.15.63:0/4008857621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4328105380 0x7f4328102cb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4318005ab0 tx=0x7f4318003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:00.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.737+0000 7f431e7fc640 1 -- 172.21.15.63:0/4008857621 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431803f070 con 0x7f4328105380 2024-09-21T06:20:00.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.737+0000 7f431e7fc640 1 -- 172.21.15.63:0/4008857621 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4318031d60 con 0x7f4328105380 2024-09-21T06:20:00.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.737+0000 7f431e7fc640 1 -- 172.21.15.63:0/4008857621 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4318035030 con 0x7f4328105380 2024-09-21T06:20:00.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.737+0000 7f432f6b9640 1 -- 172.21.15.63:0/4008857621 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43281a8940 con 0x7f4328105380 2024-09-21T06:20:00.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.737+0000 7f432f6b9640 1 -- 172.21.15.63:0/4008857621 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43281a8dd0 con 0x7f4328105380 2024-09-21T06:20:00.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.738+0000 7f432f6b9640 1 -- 172.21.15.63:0/4008857621 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f432806c1f0 con 0x7f4328105380 2024-09-21T06:20:00.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.740+0000 7f431e7fc640 1 -- 172.21.15.63:0/4008857621 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f4318042070 con 0x7f4328105380 2024-09-21T06:20:00.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.740+0000 7f431e7fc640 1 --2- 172.21.15.63:0/4008857621 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f43140b6550 0x7f43140b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:00.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.740+0000 7f432d455640 1 --2- 172.21.15.63:0/4008857621 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f43140b6550 0x7f43140b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:00.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.741+0000 7f431e7fc640 1 -- 172.21.15.63:0/4008857621 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4318106680 con 0x7f4328105380 2024-09-21T06:20:00.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.741+0000 7f432d455640 1 --2- 172.21.15.63:0/4008857621 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f43140b6550 0x7f43140b8a60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4324005fd0 tx=0x7f4324005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:00.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.744+0000 7f431e7fc640 1 -- 172.21.15.63:0/4008857621 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f43180ceb10 con 0x7f4328105380 2024-09-21T06:20:00.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.937+0000 7f432f6b9640 1 -- 172.21.15.63:0/4008857621 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f4328103a70 con 0x7f4328105380 2024-09-21T06:20:00.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.942+0000 7f431e7fc640 1 -- 172.21.15.63:0/4008857621 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v31)=0 v31) ==== 120+0+0 (secure 0 0 0) 0x7f43180d2ef0 con 0x7f4328105380 2024-09-21T06:20:00.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.944+0000 7f432f6b9640 1 -- 172.21.15.63:0/4008857621 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f43140b6550 msgr2=0x7f43140b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:00.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.944+0000 7f432f6b9640 1 --2- 172.21.15.63:0/4008857621 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f43140b6550 0x7f43140b8a60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4324005fd0 tx=0x7f4324005850 comp rx=0 tx=0).stop 2024-09-21T06:20:00.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.944+0000 7f432f6b9640 1 -- 172.21.15.63:0/4008857621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4328105380 msgr2=0x7f4328102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:00.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.944+0000 7f432f6b9640 1 --2- 172.21.15.63:0/4008857621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4328105380 0x7f4328102cb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4318005ab0 tx=0x7f4318003cd0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.944+0000 7f432f6b9640 1 -- 172.21.15.63:0/4008857621 shutdown_connections 2024-09-21T06:20:00.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.944+0000 7f432f6b9640 1 --2- 172.21.15.63:0/4008857621 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f43140b6550 0x7f43140b8a60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.944+0000 7f432f6b9640 1 --2- 172.21.15.63:0/4008857621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f432810de60 0x7f43281031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.944+0000 7f432f6b9640 1 --2- 172.21.15.63:0/4008857621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4328105380 0x7f4328102cb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.944+0000 7f432f6b9640 1 --2- 172.21.15.63:0/4008857621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4328104a30 0x7f4328102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:00.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.944+0000 7f432f6b9640 1 -- 172.21.15.63:0/4008857621 >> 172.21.15.63:0/4008857621 conn(0x7f4328079760 msgr2=0x7f4328100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:00.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.944+0000 7f432f6b9640 1 -- 172.21.15.63:0/4008857621 shutdown_connections 2024-09-21T06:20:00.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.945+0000 7f432f6b9640 1 -- 172.21.15.63:0/4008857621 wait complete. 2024-09-21T06:20:01.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:00 smithi071 ceph-mon[34844]: overall HEALTH_OK 2024-09-21T06:20:01.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:00 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2270221373' entity='client.admin' 2024-09-21T06:20:01.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.030+0000 7fd3828ee640 1 -- 172.21.15.63:0/3304520913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd37c102ae0 msgr2=0x7fd37c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:01.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.030+0000 7fd3828ee640 1 --2- 172.21.15.63:0/3304520913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd37c102ae0 0x7fd37c102ef0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009900 tx=0x7fd36c02a410 comp rx=0 tx=0).stop 2024-09-21T06:20:01.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.031+0000 7fd3828ee640 1 -- 172.21.15.63:0/3304520913 shutdown_connections 2024-09-21T06:20:01.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.031+0000 7fd3828ee640 1 --2- 172.21.15.63:0/3304520913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c108d20 0x7fd37c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:01.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.031+0000 7fd3828ee640 1 --2- 172.21.15.63:0/3304520913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd37c1083d0 0x7fd37c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:01.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.031+0000 7fd3828ee640 1 --2- 172.21.15.63:0/3304520913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd37c102ae0 0x7fd37c102ef0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:01.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.031+0000 7fd3828ee640 1 -- 172.21.15.63:0/3304520913 >> 172.21.15.63:0/3304520913 conn(0x7fd37c079760 msgr2=0x7fd37c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:01.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.031+0000 7fd3828ee640 1 -- 172.21.15.63:0/3304520913 shutdown_connections 2024-09-21T06:20:01.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.031+0000 7fd3828ee640 1 -- 172.21.15.63:0/3304520913 wait complete. 2024-09-21T06:20:01.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.031+0000 7fd3828ee640 1 Processor -- start 2024-09-21T06:20:01.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.031+0000 7fd3828ee640 1 -- start start 2024-09-21T06:20:01.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.032+0000 7fd3828ee640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd37c102ae0 0x7fd37c199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:01.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.032+0000 7fd3828ee640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd37c1083d0 0x7fd37c199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:01.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.032+0000 7fd3828ee640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c108d20 0x7fd37c19eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:01.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.032+0000 7fd3828ee640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd37c112990 con 0x7fd37c102ae0 2024-09-21T06:20:01.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.032+0000 7fd3828ee640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd37c112810 con 0x7fd37c1083d0 2024-09-21T06:20:01.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.032+0000 7fd3828ee640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd37c112b10 con 0x7fd37c108d20 2024-09-21T06:20:01.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.032+0000 7fd37bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd37c102ae0 0x7fd37c199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:01.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.032+0000 7fd37bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd37c102ae0 0x7fd37c199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59344/0 (socket says 172.21.15.63:59344) 2024-09-21T06:20:01.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.032+0000 7fd37bfff640 1 -- 172.21.15.63:0/129661915 learned_addr learned my addr 172.21.15.63:0/129661915 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:20:01.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.032+0000 7fd37b7fe640 1 --2- 172.21.15.63:0/129661915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd37c1083d0 0x7fd37c199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:01.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.032+0000 7fd380e8b640 1 --2- 172.21.15.63:0/129661915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c108d20 0x7fd37c19eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:01.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.032+0000 7fd37bfff640 1 -- 172.21.15.63:0/129661915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c108d20 msgr2=0x7fd37c19eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:01.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.032+0000 7fd37bfff640 1 --2- 172.21.15.63:0/129661915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c108d20 0x7fd37c19eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:01.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.032+0000 7fd37bfff640 1 -- 172.21.15.63:0/129661915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd37c1083d0 msgr2=0x7fd37c199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:01.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.032+0000 7fd37bfff640 1 --2- 172.21.15.63:0/129661915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd37c1083d0 0x7fd37c199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:01.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.032+0000 7fd37bfff640 1 -- 172.21.15.63:0/129661915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37c19f2d0 con 0x7fd37c102ae0 2024-09-21T06:20:01.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.033+0000 7fd37bfff640 1 --2- 172.21.15.63:0/129661915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd37c102ae0 0x7fd37c199360 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd36c005940 tx=0x7fd36c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:01.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.033+0000 7fd3797fa640 1 -- 172.21.15.63:0/129661915 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c03f030 con 0x7fd37c102ae0 2024-09-21T06:20:01.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.033+0000 7fd3797fa640 1 -- 172.21.15.63:0/129661915 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd36c003cb0 con 0x7fd37c102ae0 2024-09-21T06:20:01.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.033+0000 7fd3828ee640 1 -- 172.21.15.63:0/129661915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd37c19f560 con 0x7fd37c102ae0 2024-09-21T06:20:01.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.033+0000 7fd3797fa640 1 -- 172.21.15.63:0/129661915 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c035070 con 0x7fd37c102ae0 2024-09-21T06:20:01.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.033+0000 7fd3828ee640 1 -- 172.21.15.63:0/129661915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd37c19f9d0 con 0x7fd37c102ae0 2024-09-21T06:20:01.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.034+0000 7fd3828ee640 1 -- 172.21.15.63:0/129661915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd37c103d10 con 0x7fd37c102ae0 2024-09-21T06:20:01.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.036+0000 7fd3797fa640 1 -- 172.21.15.63:0/129661915 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fd36c042030 con 0x7fd37c102ae0 2024-09-21T06:20:01.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.037+0000 7fd3797fa640 1 --2- 172.21.15.63:0/129661915 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd3640b6550 0x7fd3640b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:01.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.037+0000 7fd37b7fe640 1 --2- 172.21.15.63:0/129661915 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd3640b6550 0x7fd3640b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:01.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.037+0000 7fd3797fa640 1 -- 172.21.15.63:0/129661915 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd36c106110 con 0x7fd37c102ae0 2024-09-21T06:20:01.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.037+0000 7fd37b7fe640 1 --2- 172.21.15.63:0/129661915 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd3640b6550 0x7fd3640b8a60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd37c100cc0 tx=0x7fd37000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:01.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.040+0000 7fd3797fa640 1 -- 172.21.15.63:0/129661915 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd37c19f9d0 con 0x7fd37c102ae0 2024-09-21T06:20:01.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:00 smithi175 ceph-mon[34510]: overall HEALTH_OK 2024-09-21T06:20:01.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:00 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2270221373' entity='client.admin' 2024-09-21T06:20:01.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.234+0000 7fd3828ee640 1 -- 172.21.15.63:0/129661915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fd37c102ef0 con 0x7fd37c102ae0 2024-09-21T06:20:01.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.238+0000 7fd3797fa640 1 -- 172.21.15.63:0/129661915 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v33)=0 v33) ==== 138+0+0 (secure 0 0 0) 0x7fd36c0d2980 con 0x7fd37c102ae0 2024-09-21T06:20:01.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.240+0000 7fd3828ee640 1 -- 172.21.15.63:0/129661915 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd3640b6550 msgr2=0x7fd3640b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:01.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.240+0000 7fd3828ee640 1 --2- 172.21.15.63:0/129661915 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd3640b6550 0x7fd3640b8a60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd37c100cc0 tx=0x7fd37000b390 comp rx=0 tx=0).stop 2024-09-21T06:20:01.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.240+0000 7fd3828ee640 1 -- 172.21.15.63:0/129661915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd37c102ae0 msgr2=0x7fd37c199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:01.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.240+0000 7fd3828ee640 1 --2- 172.21.15.63:0/129661915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd37c102ae0 0x7fd37c199360 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd36c005940 tx=0x7fd36c0042f0 comp rx=0 tx=0).stop 2024-09-21T06:20:01.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.241+0000 7fd3828ee640 1 -- 172.21.15.63:0/129661915 shutdown_connections 2024-09-21T06:20:01.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.241+0000 7fd3828ee640 1 --2- 172.21.15.63:0/129661915 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd3640b6550 0x7fd3640b8a60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:01.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.241+0000 7fd3828ee640 1 --2- 172.21.15.63:0/129661915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c108d20 0x7fd37c19eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:01.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.241+0000 7fd3828ee640 1 --2- 172.21.15.63:0/129661915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd37c1083d0 0x7fd37c199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:01.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.241+0000 7fd3828ee640 1 --2- 172.21.15.63:0/129661915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd37c102ae0 0x7fd37c199360 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:01.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.241+0000 7fd3828ee640 1 -- 172.21.15.63:0/129661915 >> 172.21.15.63:0/129661915 conn(0x7fd37c079760 msgr2=0x7fd37c101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:01.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.241+0000 7fd3828ee640 1 -- 172.21.15.63:0/129661915 shutdown_connections 2024-09-21T06:20:01.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.241+0000 7fd3828ee640 1 -- 172.21.15.63:0/129661915 wait complete. 2024-09-21T06:20:01.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.895+0000 7f36f04da640 1 -- 172.21.15.63:0/459815127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36e81094d0 msgr2=0x7f36e81098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:01.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.895+0000 7f36f04da640 1 --2- 172.21.15.63:0/459815127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36e81094d0 0x7f36e81098e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f36d8009900 tx=0x7f36d802a410 comp rx=0 tx=0).stop 2024-09-21T06:20:01.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.895+0000 7f36f04da640 1 -- 172.21.15.63:0/459815127 shutdown_connections 2024-09-21T06:20:01.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.895+0000 7f36f04da640 1 --2- 172.21.15.63:0/459815127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e8109e20 0x7f36e8110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:01.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.895+0000 7f36f04da640 1 --2- 172.21.15.63:0/459815127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36e81094d0 0x7f36e81098e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:01.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.895+0000 7f36f04da640 1 --2- 172.21.15.63:0/459815127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36e8103b90 0x7f36e8103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:01.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.895+0000 7f36f04da640 1 -- 172.21.15.63:0/459815127 >> 172.21.15.63:0/459815127 conn(0x7f36e80ff600 msgr2=0x7f36e8101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:01.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.896+0000 7f36f04da640 1 -- 172.21.15.63:0/459815127 shutdown_connections 2024-09-21T06:20:01.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.896+0000 7f36f04da640 1 -- 172.21.15.63:0/459815127 wait complete. 2024-09-21T06:20:01.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.896+0000 7f36f04da640 1 Processor -- start 2024-09-21T06:20:01.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.896+0000 7f36f04da640 1 -- start start 2024-09-21T06:20:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.897+0000 7f36f04da640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36e8103b90 0x7f36e819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.897+0000 7f36f04da640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e81094d0 0x7f36e819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.897+0000 7f36f04da640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36e8109e20 0x7f36e81a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.897+0000 7f36f04da640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f36e8113b30 con 0x7f36e8109e20 2024-09-21T06:20:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.897+0000 7f36f04da640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f36e81139b0 con 0x7f36e81094d0 2024-09-21T06:20:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.897+0000 7f36f04da640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36e8113cb0 con 0x7f36e8103b90 2024-09-21T06:20:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.897+0000 7f36eea77640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36e8109e20 0x7f36e81a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.897+0000 7f36eea77640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36e8109e20 0x7f36e81a1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59324/0 (socket says 172.21.15.63:59324) 2024-09-21T06:20:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.897+0000 7f36eea77640 1 -- 172.21.15.63:0/2977566017 learned_addr learned my addr 172.21.15.63:0/2977566017 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:20:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.897+0000 7f36eda75640 1 --2- 172.21.15.63:0/2977566017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e81094d0 0x7f36e819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.897+0000 7f36ee276640 1 --2- 172.21.15.63:0/2977566017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36e8103b90 0x7f36e819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:01.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.897+0000 7f36eea77640 1 -- 172.21.15.63:0/2977566017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36e8103b90 msgr2=0x7f36e819c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:01.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.897+0000 7f36eea77640 1 --2- 172.21.15.63:0/2977566017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36e8103b90 0x7f36e819c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:01.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.897+0000 7f36eea77640 1 -- 172.21.15.63:0/2977566017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e81094d0 msgr2=0x7f36e819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:01.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.897+0000 7f36eea77640 1 --2- 172.21.15.63:0/2977566017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e81094d0 0x7f36e819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:01.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.897+0000 7f36eea77640 1 -- 172.21.15.63:0/2977566017 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e81a2630 con 0x7f36e8109e20 2024-09-21T06:20:01.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.897+0000 7f36ee276640 1 --2- 172.21.15.63:0/2977566017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36e8103b90 0x7f36e819c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:01.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.897+0000 7f36eea77640 1 --2- 172.21.15.63:0/2977566017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36e8109e20 0x7f36e81a1f00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f36e0009fd0 tx=0x7f36e000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:01.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.898+0000 7f36df7fe640 1 -- 172.21.15.63:0/2977566017 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e0017070 con 0x7f36e8109e20 2024-09-21T06:20:01.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.898+0000 7f36f04da640 1 -- 172.21.15.63:0/2977566017 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36e81a2920 con 0x7f36e8109e20 2024-09-21T06:20:01.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.898+0000 7f36df7fe640 1 -- 172.21.15.63:0/2977566017 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36e0003e20 con 0x7f36e8109e20 2024-09-21T06:20:01.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.898+0000 7f36df7fe640 1 -- 172.21.15.63:0/2977566017 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e0010460 con 0x7f36e8109e20 2024-09-21T06:20:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.898+0000 7f36f04da640 1 -- 172.21.15.63:0/2977566017 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36e81a9080 con 0x7f36e8109e20 2024-09-21T06:20:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.899+0000 7f36f04da640 1 -- 172.21.15.63:0/2977566017 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36e8103fa0 con 0x7f36e8109e20 2024-09-21T06:20:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.901+0000 7f36df7fe640 1 -- 172.21.15.63:0/2977566017 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f36e0003970 con 0x7f36e8109e20 2024-09-21T06:20:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.901+0000 7f36df7fe640 1 --2- 172.21.15.63:0/2977566017 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f36d40b64d0 0x7f36d40b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.902+0000 7f36ee276640 1 --2- 172.21.15.63:0/2977566017 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f36d40b64d0 0x7f36d40b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.902+0000 7f36df7fe640 1 -- 172.21.15.63:0/2977566017 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f36e00e54b0 con 0x7f36e8109e20 2024-09-21T06:20:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.902+0000 7f36ee276640 1 --2- 172.21.15.63:0/2977566017 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f36d40b64d0 0x7f36d40b89e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f36e4009c20 tx=0x7f36e4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:00.906+0000 7f36df7fe640 1 -- 172.21.15.63:0/2977566017 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f36e00ad940 con 0x7f36e8109e20 2024-09-21T06:20:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.156+0000 7f36f04da640 1 -- 172.21.15.63:0/2977566017 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f36e81a93b0 con 0x7f36e8109e20 2024-09-21T06:20:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.160+0000 7f36df7fe640 1 -- 172.21.15.63:0/2977566017 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v32)=0 v32) ==== 127+0+0 (secure 0 0 0) 0x7f36e00b1d20 con 0x7f36e8109e20 2024-09-21T06:20:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.162+0000 7f36f04da640 1 -- 172.21.15.63:0/2977566017 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f36d40b64d0 msgr2=0x7f36d40b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.162+0000 7f36f04da640 1 --2- 172.21.15.63:0/2977566017 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f36d40b64d0 0x7f36d40b89e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f36e4009c20 tx=0x7f36e4005f90 comp rx=0 tx=0).stop 2024-09-21T06:20:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.162+0000 7f36f04da640 1 -- 172.21.15.63:0/2977566017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36e8109e20 msgr2=0x7f36e81a1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.162+0000 7f36f04da640 1 --2- 172.21.15.63:0/2977566017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36e8109e20 0x7f36e81a1f00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f36e0009fd0 tx=0x7f36e000b260 comp rx=0 tx=0).stop 2024-09-21T06:20:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.162+0000 7f36f04da640 1 -- 172.21.15.63:0/2977566017 shutdown_connections 2024-09-21T06:20:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.162+0000 7f36f04da640 1 --2- 172.21.15.63:0/2977566017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36e8109e20 0x7f36e81a1f00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:01.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.162+0000 7f36f04da640 1 --2- 172.21.15.63:0/2977566017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e81094d0 0x7f36e819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:01.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.162+0000 7f36f04da640 1 --2- 172.21.15.63:0/2977566017 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f36d40b64d0 0x7f36d40b89e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:01.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.162+0000 7f36f04da640 1 --2- 172.21.15.63:0/2977566017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36e8103b90 0x7f36e819c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:01.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.162+0000 7f36f04da640 1 -- 172.21.15.63:0/2977566017 >> 172.21.15.63:0/2977566017 conn(0x7f36e80ff600 msgr2=0x7f36e8106af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:01.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.162+0000 7f36f04da640 1 -- 172.21.15.63:0/2977566017 shutdown_connections 2024-09-21T06:20:01.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:01.162+0000 7f36f04da640 1 -- 172.21.15.63:0/2977566017 wait complete. 2024-09-21T06:20:01.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:01 smithi175 ceph-mon[34510]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:01.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:01 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/4008857621' entity='client.admin' 2024-09-21T06:20:01.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:01 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2977566017' entity='client.admin' 2024-09-21T06:20:01.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:01 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/129661915' entity='client.admin' 2024-09-21T06:20:01.883 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:01 smithi063 ceph-mon[31150]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:01.883 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:01 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/4008857621' entity='client.admin' 2024-09-21T06:20:01.883 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:01 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2977566017' entity='client.admin' 2024-09-21T06:20:01.883 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:01 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/129661915' entity='client.admin' 2024-09-21T06:20:02.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:01 smithi071 ceph-mon[34844]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:02.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:01 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/4008857621' entity='client.admin' 2024-09-21T06:20:02.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:01 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2977566017' entity='client.admin' 2024-09-21T06:20:02.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:01 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/129661915' entity='client.admin' 2024-09-21T06:20:03.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:03 smithi175 ceph-mon[34510]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:03.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:03 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1422161749' entity='client.admin' 2024-09-21T06:20:03.880 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:03 smithi063 ceph-mon[31150]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:03.880 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:03 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1422161749' entity='client.admin' 2024-09-21T06:20:04.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:03 smithi071 ceph-mon[34844]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:04.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:03 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1422161749' entity='client.admin' 2024-09-21T06:20:04.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.313+0000 7fd05d2e0640 1 -- 172.21.15.63:0/2394266468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd058104850 msgr2=0x7fd058104c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:04.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.313+0000 7fd05d2e0640 1 --2- 172.21.15.63:0/2394266468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd058104850 0x7fd058104c60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd048009ca0 tx=0x7fd04802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:20:04.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.313+0000 7fd05d2e0640 1 -- 172.21.15.63:0/2394266468 shutdown_connections 2024-09-21T06:20:04.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.313+0000 7fd05d2e0640 1 --2- 172.21.15.63:0/2394266468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd05810de00 0x7fd058110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:04.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.313+0000 7fd05d2e0640 1 --2- 172.21.15.63:0/2394266468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd058105280 0x7fd05810d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:04.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.313+0000 7fd05d2e0640 1 --2- 172.21.15.63:0/2394266468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd058104850 0x7fd058104c60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:04.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.313+0000 7fd05d2e0640 1 -- 172.21.15.63:0/2394266468 >> 172.21.15.63:0/2394266468 conn(0x7fd058079730 msgr2=0x7fd058079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:04.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.313+0000 7fd05d2e0640 1 -- 172.21.15.63:0/2394266468 shutdown_connections 2024-09-21T06:20:04.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.313+0000 7fd05d2e0640 1 -- 172.21.15.63:0/2394266468 wait complete. 2024-09-21T06:20:04.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.314+0000 7fd05d2e0640 1 Processor -- start 2024-09-21T06:20:04.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.314+0000 7fd05d2e0640 1 -- start start 2024-09-21T06:20:04.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.315+0000 7fd05d2e0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd058104850 0x7fd058102760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:04.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.315+0000 7fd05d2e0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd058105280 0x7fd058102ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:04.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.315+0000 7fd05d2e0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd05810de00 0x7fd0581031e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:04.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.315+0000 7fd05d2e0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd058113aa0 con 0x7fd058104850 2024-09-21T06:20:04.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.315+0000 7fd05d2e0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd058113920 con 0x7fd05810de00 2024-09-21T06:20:04.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.315+0000 7fd05d2e0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd058113c20 con 0x7fd058105280 2024-09-21T06:20:04.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.315+0000 7fd056ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd058104850 0x7fd058102760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:04.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.315+0000 7fd056ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd058104850 0x7fd058102760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59370/0 (socket says 172.21.15.63:59370) 2024-09-21T06:20:04.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.315+0000 7fd056ffd640 1 -- 172.21.15.63:0/1422161749 learned_addr learned my addr 172.21.15.63:0/1422161749 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:20:04.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.315+0000 7fd0567fc640 1 --2- 172.21.15.63:0/1422161749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd058105280 0x7fd058102ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.315+0000 7fd0577fe640 1 --2- 172.21.15.63:0/1422161749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd05810de00 0x7fd0581031e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.315+0000 7fd056ffd640 1 -- 172.21.15.63:0/1422161749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd058105280 msgr2=0x7fd058102ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.315+0000 7fd056ffd640 1 --2- 172.21.15.63:0/1422161749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd058105280 0x7fd058102ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.315+0000 7fd056ffd640 1 -- 172.21.15.63:0/1422161749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd05810de00 msgr2=0x7fd0581031e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.315+0000 7fd056ffd640 1 --2- 172.21.15.63:0/1422161749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd05810de00 0x7fd0581031e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.315+0000 7fd056ffd640 1 -- 172.21.15.63:0/1422161749 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0581a87b0 con 0x7fd058104850 2024-09-21T06:20:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.315+0000 7fd0577fe640 1 --2- 172.21.15.63:0/1422161749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd05810de00 0x7fd0581031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.315+0000 7fd056ffd640 1 --2- 172.21.15.63:0/1422161749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd058104850 0x7fd058102760 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd04802ade0 tx=0x7fd048031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.316+0000 7fd04ffff640 1 -- 172.21.15.63:0/1422161749 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048003b70 con 0x7fd058104850 2024-09-21T06:20:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.316+0000 7fd05d2e0640 1 -- 172.21.15.63:0/1422161749 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0581a8a40 con 0x7fd058104850 2024-09-21T06:20:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.316+0000 7fd04ffff640 1 -- 172.21.15.63:0/1422161749 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd048003d10 con 0x7fd058104850 2024-09-21T06:20:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.316+0000 7fd04ffff640 1 -- 172.21.15.63:0/1422161749 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04802fa50 con 0x7fd058104850 2024-09-21T06:20:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.316+0000 7fd05d2e0640 1 -- 172.21.15.63:0/1422161749 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0581a8fd0 con 0x7fd058104850 2024-09-21T06:20:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.317+0000 7fd05d2e0640 1 -- 172.21.15.63:0/1422161749 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd05806c180 con 0x7fd058104850 2024-09-21T06:20:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.318+0000 7fd04ffff640 1 -- 172.21.15.63:0/1422161749 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fd048004580 con 0x7fd058104850 2024-09-21T06:20:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.319+0000 7fd04ffff640 1 --2- 172.21.15.63:0/1422161749 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd0440b64d0 0x7fd0440b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.319+0000 7fd0567fc640 1 --2- 172.21.15.63:0/1422161749 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd0440b64d0 0x7fd0440b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.319+0000 7fd04ffff640 1 -- 172.21.15.63:0/1422161749 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd048106b50 con 0x7fd058104850 2024-09-21T06:20:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.320+0000 7fd0567fc640 1 --2- 172.21.15.63:0/1422161749 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd0440b64d0 0x7fd0440b89e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd058102330 tx=0x7fd040005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.323+0000 7fd04ffff640 1 -- 172.21.15.63:0/1422161749 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd0480cefe0 con 0x7fd058104850 2024-09-21T06:20:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.512+0000 7fd05d2e0640 1 -- 172.21.15.63:0/1422161749 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7fd058103a60 con 0x7fd058104850 2024-09-21T06:20:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.516+0000 7fd04ffff640 1 -- 172.21.15.63:0/1422161749 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v34)=0 v34) ==== 111+0+0 (secure 0 0 0) 0x7fd0480d33c0 con 0x7fd058104850 2024-09-21T06:20:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.519+0000 7fd05d2e0640 1 -- 172.21.15.63:0/1422161749 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd0440b64d0 msgr2=0x7fd0440b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.519+0000 7fd05d2e0640 1 --2- 172.21.15.63:0/1422161749 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd0440b64d0 0x7fd0440b89e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd058102330 tx=0x7fd040005f90 comp rx=0 tx=0).stop 2024-09-21T06:20:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.519+0000 7fd05d2e0640 1 -- 172.21.15.63:0/1422161749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd058104850 msgr2=0x7fd058102760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.519+0000 7fd05d2e0640 1 --2- 172.21.15.63:0/1422161749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd058104850 0x7fd058102760 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd04802ade0 tx=0x7fd048031770 comp rx=0 tx=0).stop 2024-09-21T06:20:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.519+0000 7fd05d2e0640 1 -- 172.21.15.63:0/1422161749 shutdown_connections 2024-09-21T06:20:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.519+0000 7fd05d2e0640 1 --2- 172.21.15.63:0/1422161749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd05810de00 0x7fd0581031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:04.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.519+0000 7fd05d2e0640 1 --2- 172.21.15.63:0/1422161749 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd0440b64d0 0x7fd0440b89e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:04.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.519+0000 7fd05d2e0640 1 --2- 172.21.15.63:0/1422161749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd058105280 0x7fd058102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:04.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.519+0000 7fd05d2e0640 1 --2- 172.21.15.63:0/1422161749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd058104850 0x7fd058102760 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:04.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.519+0000 7fd05d2e0640 1 -- 172.21.15.63:0/1422161749 >> 172.21.15.63:0/1422161749 conn(0x7fd058079730 msgr2=0x7fd058100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:04.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.520+0000 7fd05d2e0640 1 -- 172.21.15.63:0/1422161749 shutdown_connections 2024-09-21T06:20:04.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:03.520+0000 7fd05d2e0640 1 -- 172.21.15.63:0/1422161749 wait complete. 2024-09-21T06:20:05.775 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:05 smithi063 ceph-mon[31150]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:06.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:05 smithi071 ceph-mon[34844]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:06.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:05 smithi175 ceph-mon[34510]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.405+0000 7f90c1865640 1 -- 172.21.15.63:0/2060554959 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90bc1083a0 msgr2=0x7f90bc1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.405+0000 7f90c1865640 1 --2- 172.21.15.63:0/2060554959 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90bc1083a0 0x7f90bc1087b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f90b0009900 tx=0x7f90b002a410 comp rx=0 tx=0).stop 2024-09-21T06:20:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.405+0000 7f90c1865640 1 -- 172.21.15.63:0/2060554959 shutdown_connections 2024-09-21T06:20:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.405+0000 7f90c1865640 1 --2- 172.21.15.63:0/2060554959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90bc108cf0 0x7f90bc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.405+0000 7f90c1865640 1 --2- 172.21.15.63:0/2060554959 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90bc1083a0 0x7f90bc1087b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.405+0000 7f90c1865640 1 --2- 172.21.15.63:0/2060554959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90bc102a60 0x7f90bc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.405+0000 7f90c1865640 1 -- 172.21.15.63:0/2060554959 >> 172.21.15.63:0/2060554959 conn(0x7f90bc079730 msgr2=0x7f90bc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.406+0000 7f90c1865640 1 -- 172.21.15.63:0/2060554959 shutdown_connections 2024-09-21T06:20:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.406+0000 7f90c1865640 1 -- 172.21.15.63:0/2060554959 wait complete. 2024-09-21T06:20:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.406+0000 7f90c1865640 1 Processor -- start 2024-09-21T06:20:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.407+0000 7f90c1865640 1 -- start start 2024-09-21T06:20:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.407+0000 7f90c1865640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90bc102a60 0x7f90bc19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.407+0000 7f90c1865640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90bc1083a0 0x7f90bc19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.407+0000 7f90c1865640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90bc108cf0 0x7f90bc19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.407+0000 7f90c1865640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc112960 con 0x7f90bc102a60 2024-09-21T06:20:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.407+0000 7f90c1865640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc1127e0 con 0x7f90bc1083a0 2024-09-21T06:20:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.407+0000 7f90c1865640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc112ae0 con 0x7f90bc108cf0 2024-09-21T06:20:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.407+0000 7f90baffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90bc102a60 0x7f90bc19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.407+0000 7f90baffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90bc102a60 0x7f90bc19a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60472/0 (socket says 172.21.15.63:60472) 2024-09-21T06:20:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.407+0000 7f90baffd640 1 -- 172.21.15.63:0/396334942 learned_addr learned my addr 172.21.15.63:0/396334942 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:20:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.408+0000 7f90bb7fe640 1 --2- 172.21.15.63:0/396334942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90bc108cf0 0x7f90bc19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.408+0000 7f90ba7fc640 1 --2- 172.21.15.63:0/396334942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90bc1083a0 0x7f90bc19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.408+0000 7f90baffd640 1 -- 172.21.15.63:0/396334942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90bc108cf0 msgr2=0x7f90bc19fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.408+0000 7f90baffd640 1 --2- 172.21.15.63:0/396334942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90bc108cf0 0x7f90bc19fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.408+0000 7f90baffd640 1 -- 172.21.15.63:0/396334942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90bc1083a0 msgr2=0x7f90bc19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.408+0000 7f90baffd640 1 --2- 172.21.15.63:0/396334942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90bc1083a0 0x7f90bc19aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.408+0000 7f90baffd640 1 -- 172.21.15.63:0/396334942 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90bc1a0410 con 0x7f90bc102a60 2024-09-21T06:20:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.408+0000 7f90baffd640 1 --2- 172.21.15.63:0/396334942 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90bc102a60 0x7f90bc19a4a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f90b400d770 tx=0x7f90b400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.408+0000 7f90c0863640 1 -- 172.21.15.63:0/396334942 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b4017070 con 0x7f90bc102a60 2024-09-21T06:20:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.408+0000 7f90c1865640 1 -- 172.21.15.63:0/396334942 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90bc1a0700 con 0x7f90bc102a60 2024-09-21T06:20:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.408+0000 7f90c0863640 1 -- 172.21.15.63:0/396334942 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90b40054d0 con 0x7f90bc102a60 2024-09-21T06:20:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.408+0000 7f90c0863640 1 -- 172.21.15.63:0/396334942 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b4004c30 con 0x7f90bc102a60 2024-09-21T06:20:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.409+0000 7f90c1865640 1 -- 172.21.15.63:0/396334942 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90bc1a6e60 con 0x7f90bc102a60 2024-09-21T06:20:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.410+0000 7f90c1865640 1 -- 172.21.15.63:0/396334942 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90bc102e70 con 0x7f90bc102a60 2024-09-21T06:20:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.411+0000 7f90c0863640 1 -- 172.21.15.63:0/396334942 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f90b4004e10 con 0x7f90bc102a60 2024-09-21T06:20:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.412+0000 7f90c0863640 1 --2- 172.21.15.63:0/396334942 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f90a40b64d0 0x7f90a40b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.412+0000 7f90ba7fc640 1 --2- 172.21.15.63:0/396334942 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f90a40b64d0 0x7f90a40b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.412+0000 7f90c0863640 1 -- 172.21.15.63:0/396334942 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f90b40e5220 con 0x7f90bc102a60 2024-09-21T06:20:07.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.413+0000 7f90ba7fc640 1 --2- 172.21.15.63:0/396334942 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f90a40b64d0 0x7f90a40b89e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f90b002a930 tx=0x7f90b0000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:07.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.417+0000 7f90c0863640 1 -- 172.21.15.63:0/396334942 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f90b40ad6b0 con 0x7f90bc102a60 2024-09-21T06:20:07.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.608+0000 7f90c1865640 1 -- 172.21.15.63:0/396334942 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f90bc10bad0 con 0x7f90bc102a60 2024-09-21T06:20:07.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.612+0000 7f90c0863640 1 -- 172.21.15.63:0/396334942 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v35)=0 v35) ==== 121+0+0 (secure 0 0 0) 0x7f90b40b1a90 con 0x7f90bc102a60 2024-09-21T06:20:07.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.614+0000 7f90c1865640 1 -- 172.21.15.63:0/396334942 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f90a40b64d0 msgr2=0x7f90a40b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:07.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.614+0000 7f90c1865640 1 --2- 172.21.15.63:0/396334942 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f90a40b64d0 0x7f90a40b89e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f90b002a930 tx=0x7f90b0000bc0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.614+0000 7f90c1865640 1 -- 172.21.15.63:0/396334942 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90bc102a60 msgr2=0x7f90bc19a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:07.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.614+0000 7f90c1865640 1 --2- 172.21.15.63:0/396334942 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90bc102a60 0x7f90bc19a4a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f90b400d770 tx=0x7f90b400dc30 comp rx=0 tx=0).stop 2024-09-21T06:20:07.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.614+0000 7f90c1865640 1 -- 172.21.15.63:0/396334942 shutdown_connections 2024-09-21T06:20:07.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.614+0000 7f90c1865640 1 --2- 172.21.15.63:0/396334942 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f90a40b64d0 0x7f90a40b89e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.614+0000 7f90c1865640 1 --2- 172.21.15.63:0/396334942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90bc108cf0 0x7f90bc19fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.614+0000 7f90c1865640 1 --2- 172.21.15.63:0/396334942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90bc1083a0 0x7f90bc19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.614+0000 7f90c1865640 1 --2- 172.21.15.63:0/396334942 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90bc102a60 0x7f90bc19a4a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.614+0000 7f90c1865640 1 -- 172.21.15.63:0/396334942 >> 172.21.15.63:0/396334942 conn(0x7f90bc079730 msgr2=0x7f90bc06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:07.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.614+0000 7f90c1865640 1 -- 172.21.15.63:0/396334942 shutdown_connections 2024-09-21T06:20:07.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.615+0000 7f90c1865640 1 -- 172.21.15.63:0/396334942 wait complete. 2024-09-21T06:20:07.713 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:07 smithi063 ceph-mon[31150]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:07.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.711+0000 7f692977a640 1 -- 172.21.15.63:0/1648920026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6924103bb0 msgr2=0x7f6924103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:07.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.711+0000 7f692977a640 1 --2- 172.21.15.63:0/1648920026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6924103bb0 0x7f6924103fc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6914009900 tx=0x7f691402a410 comp rx=0 tx=0).stop 2024-09-21T06:20:07.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.711+0000 7f692977a640 1 -- 172.21.15.63:0/1648920026 shutdown_connections 2024-09-21T06:20:07.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.711+0000 7f692977a640 1 --2- 172.21.15.63:0/1648920026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6924109e40 0x7f6924110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.711+0000 7f692977a640 1 --2- 172.21.15.63:0/1648920026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69241094f0 0x7f6924109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.711+0000 7f692977a640 1 --2- 172.21.15.63:0/1648920026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6924103bb0 0x7f6924103fc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.711+0000 7f692977a640 1 -- 172.21.15.63:0/1648920026 >> 172.21.15.63:0/1648920026 conn(0x7f69240ff600 msgr2=0x7f6924101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:07.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.711+0000 7f692977a640 1 -- 172.21.15.63:0/1648920026 shutdown_connections 2024-09-21T06:20:07.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.711+0000 7f692977a640 1 -- 172.21.15.63:0/1648920026 wait complete. 2024-09-21T06:20:07.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.712+0000 7f692977a640 1 Processor -- start 2024-09-21T06:20:07.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.712+0000 7f692977a640 1 -- start start 2024-09-21T06:20:07.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.712+0000 7f692977a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6924103bb0 0x7f6924075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.712+0000 7f692977a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69241094f0 0x7f6924075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.712+0000 7f692977a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6924109e40 0x7f6924076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.713+0000 7f692977a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6924113b50 con 0x7f6924109e40 2024-09-21T06:20:07.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.713+0000 7f692977a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f69241139d0 con 0x7f6924103bb0 2024-09-21T06:20:07.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.713+0000 7f692977a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6924113cd0 con 0x7f69241094f0 2024-09-21T06:20:07.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.713+0000 7f69237fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6924109e40 0x7f6924076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.713+0000 7f69237fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6924109e40 0x7f6924076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60504/0 (socket says 172.21.15.63:60504) 2024-09-21T06:20:07.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.713+0000 7f69237fe640 1 -- 172.21.15.63:0/4264775037 learned_addr learned my addr 172.21.15.63:0/4264775037 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:20:07.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.713+0000 7f69227fc640 1 --2- 172.21.15.63:0/4264775037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69241094f0 0x7f6924075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.713+0000 7f6922ffd640 1 --2- 172.21.15.63:0/4264775037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6924103bb0 0x7f6924075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.713+0000 7f69237fe640 1 -- 172.21.15.63:0/4264775037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69241094f0 msgr2=0x7f6924075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:07.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.713+0000 7f69237fe640 1 --2- 172.21.15.63:0/4264775037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69241094f0 0x7f6924075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.713+0000 7f69237fe640 1 -- 172.21.15.63:0/4264775037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6924103bb0 msgr2=0x7f6924075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:07.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.713+0000 7f69237fe640 1 --2- 172.21.15.63:0/4264775037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6924103bb0 0x7f6924075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.713+0000 7f69237fe640 1 -- 172.21.15.63:0/4264775037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69241a87a0 con 0x7f6924109e40 2024-09-21T06:20:07.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.713+0000 7f69237fe640 1 --2- 172.21.15.63:0/4264775037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6924109e40 0x7f6924076190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f691c00cad0 tx=0x7f691c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:07.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.713+0000 7f690bfff640 1 -- 172.21.15.63:0/4264775037 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691c00ae20 con 0x7f6924109e40 2024-09-21T06:20:07.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.713+0000 7f690bfff640 1 -- 172.21.15.63:0/4264775037 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f691c005020 con 0x7f6924109e40 2024-09-21T06:20:07.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.713+0000 7f690bfff640 1 -- 172.21.15.63:0/4264775037 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691c00f6b0 con 0x7f6924109e40 2024-09-21T06:20:07.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.713+0000 7f692977a640 1 -- 172.21.15.63:0/4264775037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69241a8a90 con 0x7f6924109e40 2024-09-21T06:20:07.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.713+0000 7f692977a640 1 -- 172.21.15.63:0/4264775037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69241a8f50 con 0x7f6924109e40 2024-09-21T06:20:07.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.715+0000 7f692977a640 1 -- 172.21.15.63:0/4264775037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6924103fc0 con 0x7f6924109e40 2024-09-21T06:20:07.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.717+0000 7f690bfff640 1 -- 172.21.15.63:0/4264775037 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f691c0051d0 con 0x7f6924109e40 2024-09-21T06:20:07.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.718+0000 7f690bfff640 1 --2- 172.21.15.63:0/4264775037 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f690c0b64d0 0x7f690c0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.718+0000 7f6922ffd640 1 --2- 172.21.15.63:0/4264775037 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f690c0b64d0 0x7f690c0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.718+0000 7f690bfff640 1 -- 172.21.15.63:0/4264775037 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f691c0e5690 con 0x7f6924109e40 2024-09-21T06:20:07.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.718+0000 7f6922ffd640 1 --2- 172.21.15.63:0/4264775037 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f690c0b64d0 0x7f690c0b89e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6914005ab0 tx=0x7f6914005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:07.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.722+0000 7f690bfff640 1 -- 172.21.15.63:0/4264775037 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f691c014030 con 0x7f6924109e40 2024-09-21T06:20:07.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.915+0000 7f692977a640 1 -- 172.21.15.63:0/4264775037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f692402e640 con 0x7f6924109e40 2024-09-21T06:20:07.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.915+0000 7f690bfff640 1 -- 172.21.15.63:0/4264775037 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v35)=0 v35) ==== 106+0+0 (secure 0 0 0) 0x7f691c0b1f00 con 0x7f6924109e40 2024-09-21T06:20:07.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.917+0000 7f692977a640 1 -- 172.21.15.63:0/4264775037 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f690c0b64d0 msgr2=0x7f690c0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:07.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.917+0000 7f692977a640 1 --2- 172.21.15.63:0/4264775037 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f690c0b64d0 0x7f690c0b89e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6914005ab0 tx=0x7f6914005a20 comp rx=0 tx=0).stop 2024-09-21T06:20:07.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.917+0000 7f692977a640 1 -- 172.21.15.63:0/4264775037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6924109e40 msgr2=0x7f6924076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:07.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.917+0000 7f692977a640 1 --2- 172.21.15.63:0/4264775037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6924109e40 0x7f6924076190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f691c00cad0 tx=0x7f691c00cf90 comp rx=0 tx=0).stop 2024-09-21T06:20:07.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.917+0000 7f692977a640 1 -- 172.21.15.63:0/4264775037 shutdown_connections 2024-09-21T06:20:07.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.917+0000 7f692977a640 1 --2- 172.21.15.63:0/4264775037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6924109e40 0x7f6924076190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.917+0000 7f692977a640 1 --2- 172.21.15.63:0/4264775037 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f690c0b64d0 0x7f690c0b89e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.917+0000 7f692977a640 1 --2- 172.21.15.63:0/4264775037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69241094f0 0x7f6924075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.917+0000 7f692977a640 1 --2- 172.21.15.63:0/4264775037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6924103bb0 0x7f6924075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.917+0000 7f692977a640 1 -- 172.21.15.63:0/4264775037 >> 172.21.15.63:0/4264775037 conn(0x7f69240ff600 msgr2=0x7f6924101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:07.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.918+0000 7f692977a640 1 -- 172.21.15.63:0/4264775037 shutdown_connections 2024-09-21T06:20:07.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:07.918+0000 7f692977a640 1 -- 172.21.15.63:0/4264775037 wait complete. 2024-09-21T06:20:08.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:07 smithi071 ceph-mon[34844]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:08.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:07 smithi175 ceph-mon[34510]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:08.903 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:08 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/396334942' entity='client.admin' 2024-09-21T06:20:08.903 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:08 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:08.903 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:08 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:08.903 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:08 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:20:08.903 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:08 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:20:08.903 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:08 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:09.041 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:08 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/396334942' entity='client.admin' 2024-09-21T06:20:09.041 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:08 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:09.041 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:08 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:09.041 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:08 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:20:09.042 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:08 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:20:09.042 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:08 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:09.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:08 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/396334942' entity='client.admin' 2024-09-21T06:20:09.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:08 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:09.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:08 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:09.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:08 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:20:09.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:08 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:20:09.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:08 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:09.515 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:09.879 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:09 smithi063 ceph-mon[31150]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:09.879 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:09 smithi063 ceph-mon[31150]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:20:09.879 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:09 smithi063 ceph-mon[31150]: Reconfiguring daemon mon.b on smithi071 2024-09-21T06:20:09.912 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi063') 2024-09-21T06:20:09.912 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi063') 2024-09-21T06:20:10.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:09 smithi071 ceph-mon[34844]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:10.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:09 smithi071 ceph-mon[34844]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:20:10.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:09 smithi071 ceph-mon[34844]: Reconfiguring daemon mon.b on smithi071 2024-09-21T06:20:10.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:09 smithi175 ceph-mon[34510]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:10.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:09 smithi175 ceph-mon[34510]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:20:10.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:09 smithi175 ceph-mon[34510]: Reconfiguring daemon mon.b on smithi071 2024-09-21T06:20:10.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.059+0000 7f13b7b55640 1 -- 172.21.15.63:0/3356514738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13b0103bb0 msgr2=0x7f13b0103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:10.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.059+0000 7f13b7b55640 1 --2- 172.21.15.63:0/3356514738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13b0103bb0 0x7f13b0103fc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009900 tx=0x7f13a802a410 comp rx=0 tx=0).stop 2024-09-21T06:20:10.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.059+0000 7f13b7b55640 1 -- 172.21.15.63:0/3356514738 shutdown_connections 2024-09-21T06:20:10.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.059+0000 7f13b7b55640 1 --2- 172.21.15.63:0/3356514738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13b0109e40 0x7f13b0110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:10.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.059+0000 7f13b7b55640 1 --2- 172.21.15.63:0/3356514738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b01094f0 0x7f13b0109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:10.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.059+0000 7f13b7b55640 1 --2- 172.21.15.63:0/3356514738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13b0103bb0 0x7f13b0103fc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:10.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.059+0000 7f13b7b55640 1 -- 172.21.15.63:0/3356514738 >> 172.21.15.63:0/3356514738 conn(0x7f13b00ff600 msgr2=0x7f13b0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:10.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.059+0000 7f13b7b55640 1 -- 172.21.15.63:0/3356514738 shutdown_connections 2024-09-21T06:20:10.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.059+0000 7f13b7b55640 1 -- 172.21.15.63:0/3356514738 wait complete. 2024-09-21T06:20:10.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.059+0000 7f13b7b55640 1 Processor -- start 2024-09-21T06:20:10.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.059+0000 7f13b7b55640 1 -- start start 2024-09-21T06:20:10.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.060+0000 7f13b7b55640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b0103bb0 0x7f13b019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.060+0000 7f13b7b55640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13b01094f0 0x7f13b019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.060+0000 7f13b7b55640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13b0109e40 0x7f13b019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.060+0000 7f13b7b55640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f13b0113b00 con 0x7f13b01094f0 2024-09-21T06:20:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.060+0000 7f13b7b55640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f13b0113980 con 0x7f13b0103bb0 2024-09-21T06:20:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.060+0000 7f13b7b55640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f13b0113c80 con 0x7f13b0109e40 2024-09-21T06:20:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.060+0000 7f13b50f0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13b01094f0 0x7f13b019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.060+0000 7f13b50f0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13b01094f0 0x7f13b019aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60518/0 (socket says 172.21.15.63:60518) 2024-09-21T06:20:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.060+0000 7f13b50f0640 1 -- 172.21.15.63:0/3800252106 learned_addr learned my addr 172.21.15.63:0/3800252106 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:20:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.060+0000 7f13b60f2640 1 --2- 172.21.15.63:0/3800252106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13b0109e40 0x7f13b019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:10.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.060+0000 7f13b58f1640 1 --2- 172.21.15.63:0/3800252106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b0103bb0 0x7f13b019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.060+0000 7f13b50f0640 1 -- 172.21.15.63:0/3800252106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13b0109e40 msgr2=0x7f13b019fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.060+0000 7f13b50f0640 1 --2- 172.21.15.63:0/3800252106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13b0109e40 0x7f13b019fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.060+0000 7f13b50f0640 1 -- 172.21.15.63:0/3800252106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b0103bb0 msgr2=0x7f13b019a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.060+0000 7f13b50f0640 1 --2- 172.21.15.63:0/3800252106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b0103bb0 0x7f13b019a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.060+0000 7f13b50f0640 1 -- 172.21.15.63:0/3800252106 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b01a0440 con 0x7f13b01094f0 2024-09-21T06:20:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.060+0000 7f13b50f0640 1 --2- 172.21.15.63:0/3800252106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13b01094f0 0x7f13b019aa70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f13a400c970 tx=0x7f13a400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.061+0000 7f13aeffd640 1 -- 172.21.15.63:0/3800252106 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a4007bb0 con 0x7f13b01094f0 2024-09-21T06:20:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.061+0000 7f13b7b55640 1 -- 172.21.15.63:0/3800252106 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13b01a0730 con 0x7f13b01094f0 2024-09-21T06:20:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.061+0000 7f13aeffd640 1 -- 172.21.15.63:0/3800252106 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13a4007d50 con 0x7f13b01094f0 2024-09-21T06:20:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.061+0000 7f13aeffd640 1 -- 172.21.15.63:0/3800252106 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a4004e10 con 0x7f13b01094f0 2024-09-21T06:20:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.061+0000 7f13b7b55640 1 -- 172.21.15.63:0/3800252106 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13b01a6e90 con 0x7f13b01094f0 2024-09-21T06:20:10.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.062+0000 7f13b7b55640 1 -- 172.21.15.63:0/3800252106 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13b0103fc0 con 0x7f13b01094f0 2024-09-21T06:20:10.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.064+0000 7f13aeffd640 1 -- 172.21.15.63:0/3800252106 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f13a4005000 con 0x7f13b01094f0 2024-09-21T06:20:10.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.065+0000 7f13aeffd640 1 --2- 172.21.15.63:0/3800252106 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f13980b64d0 0x7f13980b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:10.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.065+0000 7f13b58f1640 1 --2- 172.21.15.63:0/3800252106 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f13980b64d0 0x7f13980b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:10.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.065+0000 7f13aeffd640 1 -- 172.21.15.63:0/3800252106 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f13a40e5810 con 0x7f13b01094f0 2024-09-21T06:20:10.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.066+0000 7f13b58f1640 1 --2- 172.21.15.63:0/3800252106 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f13980b64d0 0x7f13980b89e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f13a8031440 tx=0x7f13a8005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:10.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.068+0000 7f13aeffd640 1 -- 172.21.15.63:0/3800252106 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f13a4014030 con 0x7f13b01094f0 2024-09-21T06:20:10.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.256+0000 7f13b7b55640 1 -- 172.21.15.63:0/3800252106 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f13b019b600 con 0x7f13b01094f0 2024-09-21T06:20:10.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.260+0000 7f13aeffd640 1 -- 172.21.15.63:0/3800252106 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v36)=0 v36) ==== 115+0+0 (secure 0 0 0) 0x7f13b019b600 con 0x7f13b01094f0 2024-09-21T06:20:10.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.263+0000 7f13b7b55640 1 -- 172.21.15.63:0/3800252106 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f13980b64d0 msgr2=0x7f13980b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:10.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.263+0000 7f13b7b55640 1 --2- 172.21.15.63:0/3800252106 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f13980b64d0 0x7f13980b89e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f13a8031440 tx=0x7f13a8005e80 comp rx=0 tx=0).stop 2024-09-21T06:20:10.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.263+0000 7f13b7b55640 1 -- 172.21.15.63:0/3800252106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13b01094f0 msgr2=0x7f13b019aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:10.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.263+0000 7f13b7b55640 1 --2- 172.21.15.63:0/3800252106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13b01094f0 0x7f13b019aa70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f13a400c970 tx=0x7f13a400ce30 comp rx=0 tx=0).stop 2024-09-21T06:20:10.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.263+0000 7f13b7b55640 1 -- 172.21.15.63:0/3800252106 shutdown_connections 2024-09-21T06:20:10.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.263+0000 7f13b7b55640 1 --2- 172.21.15.63:0/3800252106 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f13980b64d0 0x7f13980b89e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:10.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.263+0000 7f13b7b55640 1 --2- 172.21.15.63:0/3800252106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13b0109e40 0x7f13b019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:10.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.263+0000 7f13b7b55640 1 --2- 172.21.15.63:0/3800252106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13b01094f0 0x7f13b019aa70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:10.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.263+0000 7f13b7b55640 1 --2- 172.21.15.63:0/3800252106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b0103bb0 0x7f13b019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:10.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.263+0000 7f13b7b55640 1 -- 172.21.15.63:0/3800252106 >> 172.21.15.63:0/3800252106 conn(0x7f13b00ff600 msgr2=0x7f13b0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:10.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.263+0000 7f13b7b55640 1 -- 172.21.15.63:0/3800252106 shutdown_connections 2024-09-21T06:20:10.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:10.263+0000 7f13b7b55640 1 -- 172.21.15.63:0/3800252106 wait complete. 2024-09-21T06:20:10.874 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:10 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:10.874 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:10 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:10.874 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:10 smithi063 ceph-mon[31150]: Reconfiguring mon.c (monmap changed)... 2024-09-21T06:20:10.874 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:10 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:20:10.875 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:10 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:20:10.875 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:10 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:10.875 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:10 smithi063 ceph-mon[31150]: Reconfiguring daemon mon.c on smithi175 2024-09-21T06:20:10.875 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:10 smithi063 ceph-mon[31150]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:10.875 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:10 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3800252106' entity='client.admin' 2024-09-21T06:20:10.971 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:10 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:10.971 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:10 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:10.971 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:10 smithi175 ceph-mon[34510]: Reconfiguring mon.c (monmap changed)... 2024-09-21T06:20:10.971 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:10 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:20:10.971 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:10 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:20:10.971 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:10 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:10.971 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:10 smithi175 ceph-mon[34510]: Reconfiguring daemon mon.c on smithi175 2024-09-21T06:20:10.971 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:10 smithi175 ceph-mon[34510]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:10.971 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:10 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3800252106' entity='client.admin' 2024-09-21T06:20:11.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:10 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:11.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:10 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:11.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:10 smithi071 ceph-mon[34844]: Reconfiguring mon.c (monmap changed)... 2024-09-21T06:20:11.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:10 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:20:11.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:10 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:20:11.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:10 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:11.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:10 smithi071 ceph-mon[34844]: Reconfiguring daemon mon.c on smithi175 2024-09-21T06:20:11.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:10 smithi071 ceph-mon[34844]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:11.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:10 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3800252106' entity='client.admin' 2024-09-21T06:20:11.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.088+0000 7fdcb7b1b640 1 -- 172.21.15.63:0/2906079294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb01094d0 msgr2=0x7fdcb01098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:11.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.088+0000 7fdcb7b1b640 1 --2- 172.21.15.63:0/2906079294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb01094d0 0x7fdcb01098e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdca4009900 tx=0x7fdca402a410 comp rx=0 tx=0).stop 2024-09-21T06:20:11.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.088+0000 7fdcb7b1b640 1 -- 172.21.15.63:0/2906079294 shutdown_connections 2024-09-21T06:20:11.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.088+0000 7fdcb7b1b640 1 --2- 172.21.15.63:0/2906079294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb0109e20 0x7fdcb0110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:11.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.088+0000 7fdcb7b1b640 1 --2- 172.21.15.63:0/2906079294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb01094d0 0x7fdcb01098e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:11.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.088+0000 7fdcb7b1b640 1 --2- 172.21.15.63:0/2906079294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcb0103b90 0x7fdcb0103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:11.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.088+0000 7fdcb7b1b640 1 -- 172.21.15.63:0/2906079294 >> 172.21.15.63:0/2906079294 conn(0x7fdcb00ff5e0 msgr2=0x7fdcb0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:11.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.088+0000 7fdcb7b1b640 1 -- 172.21.15.63:0/2906079294 shutdown_connections 2024-09-21T06:20:11.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.088+0000 7fdcb7b1b640 1 -- 172.21.15.63:0/2906079294 wait complete. 2024-09-21T06:20:11.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.089+0000 7fdcb7b1b640 1 Processor -- start 2024-09-21T06:20:11.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.089+0000 7fdcb7b1b640 1 -- start start 2024-09-21T06:20:11.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.089+0000 7fdcb7b1b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcb0103b90 0x7fdcb019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.089+0000 7fdcb7b1b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb01094d0 0x7fdcb019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.089+0000 7fdcb7b1b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb0109e20 0x7fdcb019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.089+0000 7fdcb7b1b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb0113ae0 con 0x7fdcb0109e20 2024-09-21T06:20:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.090+0000 7fdcb7b1b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb0113960 con 0x7fdcb0103b90 2024-09-21T06:20:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.090+0000 7fdcb7b1b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb0113c60 con 0x7fdcb01094d0 2024-09-21T06:20:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.090+0000 7fdcb60b8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb0109e20 0x7fdcb019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.090+0000 7fdcb60b8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb0109e20 0x7fdcb019fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60536/0 (socket says 172.21.15.63:60536) 2024-09-21T06:20:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.090+0000 7fdcb60b8640 1 -- 172.21.15.63:0/2100126137 learned_addr learned my addr 172.21.15.63:0/2100126137 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:20:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.090+0000 7fdcb50b6640 1 --2- 172.21.15.63:0/2100126137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb01094d0 0x7fdcb019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.090+0000 7fdcb58b7640 1 --2- 172.21.15.63:0/2100126137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcb0103b90 0x7fdcb019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.090+0000 7fdcb60b8640 1 -- 172.21.15.63:0/2100126137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb01094d0 msgr2=0x7fdcb019aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.090+0000 7fdcb60b8640 1 --2- 172.21.15.63:0/2100126137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb01094d0 0x7fdcb019aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.090+0000 7fdcb60b8640 1 -- 172.21.15.63:0/2100126137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcb0103b90 msgr2=0x7fdcb019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.090+0000 7fdcb60b8640 1 --2- 172.21.15.63:0/2100126137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcb0103b90 0x7fdcb019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.090+0000 7fdcb60b8640 1 -- 172.21.15.63:0/2100126137 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb01a0340 con 0x7fdcb0109e20 2024-09-21T06:20:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.090+0000 7fdcb58b7640 1 --2- 172.21.15.63:0/2100126137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcb0103b90 0x7fdcb019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.090+0000 7fdcb60b8640 1 --2- 172.21.15.63:0/2100126137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb0109e20 0x7fdcb019fcd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdca800eb10 tx=0x7fdca800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.090+0000 7fdca2ffd640 1 -- 172.21.15.63:0/2100126137 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca8004b20 con 0x7fdcb0109e20 2024-09-21T06:20:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.090+0000 7fdcb7b1b640 1 -- 172.21.15.63:0/2100126137 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcb01a0630 con 0x7fdcb0109e20 2024-09-21T06:20:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.090+0000 7fdca2ffd640 1 -- 172.21.15.63:0/2100126137 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdca8004cc0 con 0x7fdcb0109e20 2024-09-21T06:20:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.090+0000 7fdca2ffd640 1 -- 172.21.15.63:0/2100126137 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca8010670 con 0x7fdcb0109e20 2024-09-21T06:20:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.091+0000 7fdcb7b1b640 1 -- 172.21.15.63:0/2100126137 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcb01a6e50 con 0x7fdcb0109e20 2024-09-21T06:20:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.092+0000 7fdcb7b1b640 1 -- 172.21.15.63:0/2100126137 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcb0103fa0 con 0x7fdcb0109e20 2024-09-21T06:20:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.094+0000 7fdca2ffd640 1 -- 172.21.15.63:0/2100126137 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fdca8004fe0 con 0x7fdcb0109e20 2024-09-21T06:20:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.096+0000 7fdca2ffd640 1 --2- 172.21.15.63:0/2100126137 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdc9c0b6500 0x7fdc9c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.096+0000 7fdcb58b7640 1 --2- 172.21.15.63:0/2100126137 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdc9c0b6500 0x7fdc9c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.096+0000 7fdca2ffd640 1 -- 172.21.15.63:0/2100126137 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fdca80e5f00 con 0x7fdcb0109e20 2024-09-21T06:20:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.096+0000 7fdcb58b7640 1 --2- 172.21.15.63:0/2100126137 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdc9c0b6500 0x7fdc9c0b8a10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00abe0 tx=0x7fdcac00a5c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.098+0000 7fdca2ffd640 1 -- 172.21.15.63:0/2100126137 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdca8056710 con 0x7fdcb0109e20 2024-09-21T06:20:11.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.288+0000 7fdcb7b1b640 1 -- 172.21.15.63:0/2100126137 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fdcb019b5c0 con 0x7fdcb0109e20 2024-09-21T06:20:11.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.294+0000 7fdca2ffd640 1 -- 172.21.15.63:0/2100126137 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v37)=0 v37) ==== 116+0+0 (secure 0 0 0) 0x7fdcb019b5c0 con 0x7fdcb0109e20 2024-09-21T06:20:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.297+0000 7fdcb7b1b640 1 -- 172.21.15.63:0/2100126137 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdc9c0b6500 msgr2=0x7fdc9c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.297+0000 7fdcb7b1b640 1 --2- 172.21.15.63:0/2100126137 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdc9c0b6500 0x7fdc9c0b8a10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00abe0 tx=0x7fdcac00a5c0 comp rx=0 tx=0).stop 2024-09-21T06:20:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.297+0000 7fdcb7b1b640 1 -- 172.21.15.63:0/2100126137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb0109e20 msgr2=0x7fdcb019fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.297+0000 7fdcb7b1b640 1 --2- 172.21.15.63:0/2100126137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb0109e20 0x7fdcb019fcd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdca800eb10 tx=0x7fdca800c2d0 comp rx=0 tx=0).stop 2024-09-21T06:20:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.297+0000 7fdcb7b1b640 1 -- 172.21.15.63:0/2100126137 shutdown_connections 2024-09-21T06:20:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.297+0000 7fdcb7b1b640 1 --2- 172.21.15.63:0/2100126137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdcb0109e20 0x7fdcb019fcd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.297+0000 7fdcb7b1b640 1 --2- 172.21.15.63:0/2100126137 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdc9c0b6500 0x7fdc9c0b8a10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.297+0000 7fdcb7b1b640 1 --2- 172.21.15.63:0/2100126137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb01094d0 0x7fdcb019aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.297+0000 7fdcb7b1b640 1 --2- 172.21.15.63:0/2100126137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcb0103b90 0x7fdcb019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.297+0000 7fdcb7b1b640 1 -- 172.21.15.63:0/2100126137 >> 172.21.15.63:0/2100126137 conn(0x7fdcb00ff5e0 msgr2=0x7fdcb0101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.297+0000 7fdcb7b1b640 1 -- 172.21.15.63:0/2100126137 shutdown_connections 2024-09-21T06:20:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:11.297+0000 7fdcb7b1b640 1 -- 172.21.15.63:0/2100126137 wait complete. 2024-09-21T06:20:12.256 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:12 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:12.256 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:12 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:12.256 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:12 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:20:12.257 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:12 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:12.257 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:12 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:20:12.257 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:12 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:12.257 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:12 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2100126137' entity='client.admin' 2024-09-21T06:20:12.286 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi063') 2024-09-21T06:20:12.286 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi063') 2024-09-21T06:20:12.286 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi063') 2024-09-21T06:20:12.286 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi063') 2024-09-21T06:20:12.287 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi063') 2024-09-21T06:20:12.287 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi063') 2024-09-21T06:20:12.287 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi063') 2024-09-21T06:20:12.287 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi063') 2024-09-21T06:20:12.287 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi063') 2024-09-21T06:20:12.287 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi063') 2024-09-21T06:20:12.287 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi063') 2024-09-21T06:20:12.287 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi063') 2024-09-21T06:20:12.287 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi063') 2024-09-21T06:20:12.287 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi063') 2024-09-21T06:20:12.288 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi063') 2024-09-21T06:20:12.288 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi063') 2024-09-21T06:20:12.288 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi063') 2024-09-21T06:20:12.288 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi063') 2024-09-21T06:20:12.288 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '140899c8-77e1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi063') 2024-09-21T06:20:12.288 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T06:20:12.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:12 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:12.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:12 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:12.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:12 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:20:12.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:12 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:12.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:12 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:20:12.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:12 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:12.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:12 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2100126137' entity='client.admin' 2024-09-21T06:20:12.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:12 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:12.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:12 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:12.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:12 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:20:12.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:12 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:12.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:12 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:20:12.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:12 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:12.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:12 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2100126137' entity='client.admin' 2024-09-21T06:20:12.541 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:12.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.984+0000 7fd5d83a1640 1 -- 172.21.15.63:0/4281510954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d01083c0 msgr2=0x7fd5d01087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:12.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.984+0000 7fd5d83a1640 1 --2- 172.21.15.63:0/4281510954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d01083c0 0x7fd5d01087d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009900 tx=0x7fd5c002a410 comp rx=0 tx=0).stop 2024-09-21T06:20:12.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.984+0000 7fd5d83a1640 1 -- 172.21.15.63:0/4281510954 shutdown_connections 2024-09-21T06:20:12.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.984+0000 7fd5d83a1640 1 --2- 172.21.15.63:0/4281510954 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5d0108d10 0x7fd5d010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:12.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.984+0000 7fd5d83a1640 1 --2- 172.21.15.63:0/4281510954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d01083c0 0x7fd5d01087d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:12.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.984+0000 7fd5d83a1640 1 --2- 172.21.15.63:0/4281510954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5d0102a80 0x7fd5d0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:12.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.984+0000 7fd5d83a1640 1 -- 172.21.15.63:0/4281510954 >> 172.21.15.63:0/4281510954 conn(0x7fd5d0079740 msgr2=0x7fd5d0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:12.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.984+0000 7fd5d83a1640 1 -- 172.21.15.63:0/4281510954 shutdown_connections 2024-09-21T06:20:12.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.984+0000 7fd5d83a1640 1 -- 172.21.15.63:0/4281510954 wait complete. 2024-09-21T06:20:12.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.985+0000 7fd5d83a1640 1 Processor -- start 2024-09-21T06:20:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.985+0000 7fd5d83a1640 1 -- start start 2024-09-21T06:20:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.985+0000 7fd5d83a1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5d0102a80 0x7fd5d019b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.985+0000 7fd5d83a1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d01083c0 0x7fd5d019b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.985+0000 7fd5d83a1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5d0108d10 0x7fd5d019bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.985+0000 7fd5d83a1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d01129d0 con 0x7fd5d01083c0 2024-09-21T06:20:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.985+0000 7fd5d83a1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d0112850 con 0x7fd5d0102a80 2024-09-21T06:20:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.985+0000 7fd5d83a1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d0112b50 con 0x7fd5d0108d10 2024-09-21T06:20:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.985+0000 7fd5d593c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d01083c0 0x7fd5d019b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.985+0000 7fd5d593c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d01083c0 0x7fd5d019b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60544/0 (socket says 172.21.15.63:60544) 2024-09-21T06:20:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.985+0000 7fd5d593c640 1 -- 172.21.15.63:0/1694469688 learned_addr learned my addr 172.21.15.63:0/1694469688 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:20:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.985+0000 7fd5d693e640 1 --2- 172.21.15.63:0/1694469688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5d0108d10 0x7fd5d019bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.986+0000 7fd5d613d640 1 --2- 172.21.15.63:0/1694469688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5d0102a80 0x7fd5d019b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:12.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.986+0000 7fd5d593c640 1 -- 172.21.15.63:0/1694469688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5d0108d10 msgr2=0x7fd5d019bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:12.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.986+0000 7fd5d593c640 1 --2- 172.21.15.63:0/1694469688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5d0108d10 0x7fd5d019bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:12.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.986+0000 7fd5d593c640 1 -- 172.21.15.63:0/1694469688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5d0102a80 msgr2=0x7fd5d019b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:12.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.986+0000 7fd5d593c640 1 --2- 172.21.15.63:0/1694469688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5d0102a80 0x7fd5d019b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:12.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.986+0000 7fd5d593c640 1 -- 172.21.15.63:0/1694469688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d01a65e0 con 0x7fd5d01083c0 2024-09-21T06:20:12.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.986+0000 7fd5d593c640 1 --2- 172.21.15.63:0/1694469688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d01083c0 0x7fd5d019b860 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0005ab0 tx=0x7fd5c0003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:12.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.986+0000 7fd5c77fe640 1 -- 172.21.15.63:0/1694469688 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c003f070 con 0x7fd5d01083c0 2024-09-21T06:20:12.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.986+0000 7fd5c77fe640 1 -- 172.21.15.63:0/1694469688 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5c0031d60 con 0x7fd5d01083c0 2024-09-21T06:20:12.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.986+0000 7fd5d83a1640 1 -- 172.21.15.63:0/1694469688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d01a6870 con 0x7fd5d01083c0 2024-09-21T06:20:12.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.986+0000 7fd5c77fe640 1 -- 172.21.15.63:0/1694469688 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0035030 con 0x7fd5d01083c0 2024-09-21T06:20:12.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.986+0000 7fd5d83a1640 1 -- 172.21.15.63:0/1694469688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d01a6d50 con 0x7fd5d01083c0 2024-09-21T06:20:12.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.987+0000 7fd5d83a1640 1 -- 172.21.15.63:0/1694469688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d0103d00 con 0x7fd5d01083c0 2024-09-21T06:20:12.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.989+0000 7fd5c77fe640 1 -- 172.21.15.63:0/1694469688 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fd5c0042070 con 0x7fd5d01083c0 2024-09-21T06:20:12.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.989+0000 7fd5c77fe640 1 --2- 172.21.15.63:0/1694469688 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd5bc0b64d0 0x7fd5bc0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:12.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.990+0000 7fd5d613d640 1 --2- 172.21.15.63:0/1694469688 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd5bc0b64d0 0x7fd5bc0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:12.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.990+0000 7fd5c77fe640 1 -- 172.21.15.63:0/1694469688 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd5c01066b0 con 0x7fd5d01083c0 2024-09-21T06:20:12.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.990+0000 7fd5d613d640 1 --2- 172.21.15.63:0/1694469688 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd5bc0b64d0 0x7fd5bc0b89e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc005fd0 tx=0x7fd5cc005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:12.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:12.993+0000 7fd5c77fe640 1 -- 172.21.15.63:0/1694469688 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd5c00ceb40 con 0x7fd5d01083c0 2024-09-21T06:20:13.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:13.184+0000 7fd5d83a1640 1 -- 172.21.15.63:0/1694469688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fd5d0102e90 con 0x7fd5d01083c0 2024-09-21T06:20:13.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:13.185+0000 7fd5c77fe640 1 -- 172.21.15.63:0/1694469688 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+21924 (secure 0 0 0) 0x7fd5d0102e90 con 0x7fd5d01083c0 2024-09-21T06:20:13.187 INFO:teuthology.orchestra.run.smithi063.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:20:13.188 INFO:teuthology.orchestra.run.smithi063.stdout:global dev auth_debug true 2024-09-21T06:20:13.188 INFO:teuthology.orchestra.run.smithi063.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T06:20:13.188 INFO:teuthology.orchestra.run.smithi063.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T06:20:13.188 INFO:teuthology.orchestra.run.smithi063.stdout:global basic log_to_file true 2024-09-21T06:20:13.188 INFO:teuthology.orchestra.run.smithi063.stdout:global basic log_to_journald false 2024-09-21T06:20:13.188 INFO:teuthology.orchestra.run.smithi063.stdout:global basic log_to_stderr false 2024-09-21T06:20:13.189 INFO:teuthology.orchestra.run.smithi063.stdout:global advanced mon_allow_pool_delete true 2024-09-21T06:20:13.189 INFO:teuthology.orchestra.run.smithi063.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T06:20:13.189 INFO:teuthology.orchestra.run.smithi063.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T06:20:13.189 INFO:teuthology.orchestra.run.smithi063.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T06:20:13.189 INFO:teuthology.orchestra.run.smithi063.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T06:20:13.189 INFO:teuthology.orchestra.run.smithi063.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T06:20:13.189 INFO:teuthology.orchestra.run.smithi063.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T06:20:13.190 INFO:teuthology.orchestra.run.smithi063.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T06:20:13.190 INFO:teuthology.orchestra.run.smithi063.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T06:20:13.190 INFO:teuthology.orchestra.run.smithi063.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T06:20:13.190 INFO:teuthology.orchestra.run.smithi063.stdout:global dev ms_die_on_bug true 2024-09-21T06:20:13.190 INFO:teuthology.orchestra.run.smithi063.stdout:global dev ms_die_on_old_message true 2024-09-21T06:20:13.190 INFO:teuthology.orchestra.run.smithi063.stdout:global dev ms_die_on_skipped_message false 2024-09-21T06:20:13.191 INFO:teuthology.orchestra.run.smithi063.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T06:20:13.191 INFO:teuthology.orchestra.run.smithi063.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T06:20:13.191 INFO:teuthology.orchestra.run.smithi063.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T06:20:13.191 INFO:teuthology.orchestra.run.smithi063.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T06:20:13.191 INFO:teuthology.orchestra.run.smithi063.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T06:20:13.191 INFO:teuthology.orchestra.run.smithi063.stdout:mon advanced debug_mon 20/20 2024-09-21T06:20:13.191 INFO:teuthology.orchestra.run.smithi063.stdout:mon advanced debug_ms 1/1 2024-09-21T06:20:13.192 INFO:teuthology.orchestra.run.smithi063.stdout:mon advanced debug_paxos 20/20 2024-09-21T06:20:13.192 INFO:teuthology.orchestra.run.smithi063.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T06:20:13.192 INFO:teuthology.orchestra.run.smithi063.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T06:20:13.192 INFO:teuthology.orchestra.run.smithi063.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T06:20:13.192 INFO:teuthology.orchestra.run.smithi063.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:20:13.192 INFO:teuthology.orchestra.run.smithi063.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T06:20:13.192 INFO:teuthology.orchestra.run.smithi063.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T06:20:13.193 INFO:teuthology.orchestra.run.smithi063.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T06:20:13.193 INFO:teuthology.orchestra.run.smithi063.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T06:20:13.193 INFO:teuthology.orchestra.run.smithi063.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T06:20:13.193 INFO:teuthology.orchestra.run.smithi063.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T06:20:13.193 INFO:teuthology.orchestra.run.smithi063.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T06:20:13.193 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T06:20:13.193 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:20:13.194 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced debug_cephsqlite 20/20 2024-09-21T06:20:13.194 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced debug_client 20/20 2024-09-21T06:20:13.194 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:20:13.194 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:20:13.194 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T06:20:13.194 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T06:20:13.195 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T06:20:13.195 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T06:20:13.195 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T06:20:13.195 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced mgr/snap_schedule/allow_m_granularity true 2024-09-21T06:20:13.195 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced mgr/snap_schedule/dump_on_update true 2024-09-21T06:20:13.195 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced mgr/snap_schedule/log_level debug 2024-09-21T06:20:13.195 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T06:20:13.196 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T06:20:13.196 INFO:teuthology.orchestra.run.smithi063.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:20:13.196 INFO:teuthology.orchestra.run.smithi063.stdout:osd dev bdev_debug_aio true 2024-09-21T06:20:13.196 INFO:teuthology.orchestra.run.smithi063.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T06:20:13.196 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced bluestore_compression_mode aggressive 2024-09-21T06:20:13.196 INFO:teuthology.orchestra.run.smithi063.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T06:20:13.196 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced debug_bluefs 20/20 2024-09-21T06:20:13.197 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced debug_bluestore 20/20 2024-09-21T06:20:13.197 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced debug_ms 1/1 2024-09-21T06:20:13.197 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced debug_osd 20/20 2024-09-21T06:20:13.197 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced debug_rocksdb 10/10 2024-09-21T06:20:13.197 INFO:teuthology.orchestra.run.smithi063.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T06:20:13.197 INFO:teuthology.orchestra.run.smithi063.stdout:osd dev osd_debug_op_order true 2024-09-21T06:20:13.197 INFO:teuthology.orchestra.run.smithi063.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T06:20:13.197 INFO:teuthology.orchestra.run.smithi063.stdout:osd dev osd_debug_shutdown true 2024-09-21T06:20:13.198 INFO:teuthology.orchestra.run.smithi063.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T06:20:13.198 INFO:teuthology.orchestra.run.smithi063.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T06:20:13.198 INFO:teuthology.orchestra.run.smithi063.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T06:20:13.198 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T06:20:13.198 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T06:20:13.198 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced osd_max_omap_entries_per_request 10 2024-09-21T06:20:13.198 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T06:20:13.199 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T06:20:13.199 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T06:20:13.199 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:20:13.199 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T06:20:13.199 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T06:20:13.199 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T06:20:13.199 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T06:20:13.200 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T06:20:13.200 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T06:20:13.200 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T06:20:13.200 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced debug_mds 20/20 2024-09-21T06:20:13.200 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:20:13.200 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced debug_ms 2/2 2024-09-21T06:20:13.200 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T06:20:13.201 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T06:20:13.201 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T06:20:13.201 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced mds_bal_split_size 100 2024-09-21T06:20:13.201 INFO:teuthology.orchestra.run.smithi063.stdout:mds dev mds_debug_frag true 2024-09-21T06:20:13.201 INFO:teuthology.orchestra.run.smithi063.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:20:13.201 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:20:13.201 INFO:teuthology.orchestra.run.smithi063.stdout:mds dev mds_verify_scatter true 2024-09-21T06:20:13.202 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:20:13.202 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:20:13.202 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:20:13.202 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced client_mount_timeout 600 2024-09-21T06:20:13.202 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced debug_client 20/20 2024-09-21T06:20:13.202 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced debug_ms 1/1 2024-09-21T06:20:13.203 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:20:13.203 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:20:13.203 INFO:teuthology.orchestra.run.smithi063.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T06:20:13.203 INFO:teuthology.orchestra.run.smithi063.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T06:20:13.203 INFO:teuthology.orchestra.run.smithi063.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T06:20:13.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:13.188+0000 7fd5d83a1640 1 -- 172.21.15.63:0/1694469688 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd5bc0b64d0 msgr2=0x7fd5bc0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:13.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:13.189+0000 7fd5d83a1640 1 --2- 172.21.15.63:0/1694469688 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd5bc0b64d0 0x7fd5bc0b89e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc005fd0 tx=0x7fd5cc005850 comp rx=0 tx=0).stop 2024-09-21T06:20:13.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:13.189+0000 7fd5d83a1640 1 -- 172.21.15.63:0/1694469688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d01083c0 msgr2=0x7fd5d019b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:13.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:13.189+0000 7fd5d83a1640 1 --2- 172.21.15.63:0/1694469688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d01083c0 0x7fd5d019b860 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0005ab0 tx=0x7fd5c0003cd0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:13.189+0000 7fd5d83a1640 1 -- 172.21.15.63:0/1694469688 shutdown_connections 2024-09-21T06:20:13.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:13.189+0000 7fd5d83a1640 1 --2- 172.21.15.63:0/1694469688 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd5bc0b64d0 0x7fd5bc0b89e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:13.189+0000 7fd5d83a1640 1 --2- 172.21.15.63:0/1694469688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5d0108d10 0x7fd5d019bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:13.189+0000 7fd5d83a1640 1 --2- 172.21.15.63:0/1694469688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d01083c0 0x7fd5d019b860 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:13.189+0000 7fd5d83a1640 1 --2- 172.21.15.63:0/1694469688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5d0102a80 0x7fd5d019b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:13.189+0000 7fd5d83a1640 1 -- 172.21.15.63:0/1694469688 >> 172.21.15.63:0/1694469688 conn(0x7fd5d0079740 msgr2=0x7fd5d0104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:13.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:13.189+0000 7fd5d83a1640 1 -- 172.21.15.63:0/1694469688 shutdown_connections 2024-09-21T06:20:13.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:13.189+0000 7fd5d83a1640 1 -- 172.21.15.63:0/1694469688 wait complete. 2024-09-21T06:20:13.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:13 smithi063 ceph-mon[31150]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:13.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:13 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1694469688' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T06:20:13.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:13 smithi175 ceph-mon[34510]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:13.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:13 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1694469688' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T06:20:13.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:13 smithi071 ceph-mon[34844]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:13.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:13 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1694469688' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T06:20:13.881 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T06:20:13.882 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:20:13.882 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:20:13.903 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:20:13.903 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_1 2024-09-21T06:20:13.961 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:20:13.962 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:20:13.962 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T06:20:13.962 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:20:13.962 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:20:13.962 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-21 06:18:51.278844617 +0000 2024-09-21T06:20:13.962 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-21 06:14:00.938378397 +0000 2024-09-21T06:20:13.962 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-21 06:14:00.938378397 +0000 2024-09-21T06:20:13.962 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-21 06:14:00.938378397 +0000 2024-09-21T06:20:13.962 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:20:14.030 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-21T06:20:14.030 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-21T06:20:14.030 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.00022778 s, 2.2 MB/s 2024-09-21T06:20:14.032 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:20:14.091 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_2 2024-09-21T06:20:14.149 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:20:14.149 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:20:14.149 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T06:20:14.149 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:20:14.149 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:20:14.149 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-21 06:18:51.309844314 +0000 2024-09-21T06:20:14.149 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-21 06:14:01.264375212 +0000 2024-09-21T06:20:14.149 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-21 06:14:01.264375212 +0000 2024-09-21T06:20:14.149 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-21 06:14:01.264375212 +0000 2024-09-21T06:20:14.150 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:20:14.217 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-21T06:20:14.217 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-21T06:20:14.217 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000240548 s, 2.1 MB/s 2024-09-21T06:20:14.218 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:20:14.277 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_3 2024-09-21T06:20:14.336 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:20:14.336 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:20:14.336 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T06:20:14.336 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:20:14.336 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:20:14.336 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-21 06:18:51.340844011 +0000 2024-09-21T06:20:14.336 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-21 06:14:01.611371821 +0000 2024-09-21T06:20:14.337 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-21 06:14:01.611371821 +0000 2024-09-21T06:20:14.337 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-21 06:14:01.611371821 +0000 2024-09-21T06:20:14.337 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:20:14.402 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-21T06:20:14.402 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-21T06:20:14.402 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000208396 s, 2.5 MB/s 2024-09-21T06:20:14.403 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:20:14.462 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_4 2024-09-21T06:20:14.518 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:20:14.518 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:20:14.518 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T06:20:14.518 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:20:14.519 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:20:14.519 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-21 06:18:51.375843669 +0000 2024-09-21T06:20:14.519 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-21 06:14:01.953368480 +0000 2024-09-21T06:20:14.519 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-21 06:14:01.953368480 +0000 2024-09-21T06:20:14.519 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-21 06:14:01.953368480 +0000 2024-09-21T06:20:14.521 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:20:14.584 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-21T06:20:14.584 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-21T06:20:14.584 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000198447 s, 2.6 MB/s 2024-09-21T06:20:14.585 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:20:14.643 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:20:14.643 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:20:14.663 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:20:14.663 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2024-09-21T06:20:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:20:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:20:14.721 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-21T06:20:14.721 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:20:14.721 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:20:14.722 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-21 06:19:50.540955994 +0000 2024-09-21T06:20:14.722 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-21 06:14:05.890444904 +0000 2024-09-21T06:20:14.722 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-21 06:14:05.890444904 +0000 2024-09-21T06:20:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-21 06:14:05.890444904 +0000 2024-09-21T06:20:14.722 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:20:14.792 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-21T06:20:14.792 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-21T06:20:14.792 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000290463 s, 1.8 MB/s 2024-09-21T06:20:14.793 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:20:14.851 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2024-09-21T06:20:14.909 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:20:14.909 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:20:14.910 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-21T06:20:14.910 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:20:14.910 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:20:14.910 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-21 06:19:50.541955977 +0000 2024-09-21T06:20:14.910 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-21 06:14:06.214439389 +0000 2024-09-21T06:20:14.910 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-21 06:14:06.214439389 +0000 2024-09-21T06:20:14.910 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-21 06:14:06.214439389 +0000 2024-09-21T06:20:14.910 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:20:14.976 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-21T06:20:14.976 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-21T06:20:14.976 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000250089 s, 2.0 MB/s 2024-09-21T06:20:14.977 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:20:15.035 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2024-09-21T06:20:15.093 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:20:15.093 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:20:15.093 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T06:20:15.093 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:20:15.093 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:20:15.093 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-21 06:19:50.541955977 +0000 2024-09-21T06:20:15.093 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-21 06:14:06.552433636 +0000 2024-09-21T06:20:15.094 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-21 06:14:06.552433636 +0000 2024-09-21T06:20:15.094 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-21 06:14:06.552433636 +0000 2024-09-21T06:20:15.094 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:20:15.158 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-21T06:20:15.158 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-21T06:20:15.158 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000251749 s, 2.0 MB/s 2024-09-21T06:20:15.159 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:20:15.215 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2024-09-21T06:20:15.271 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:20:15.271 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:20:15.271 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T06:20:15.271 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:20:15.271 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:20:15.271 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-21 06:19:50.541955977 +0000 2024-09-21T06:20:15.272 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-21 06:14:06.874428155 +0000 2024-09-21T06:20:15.272 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-21 06:14:06.874428155 +0000 2024-09-21T06:20:15.272 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-21 06:14:06.874428155 +0000 2024-09-21T06:20:15.272 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:20:15.336 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-21T06:20:15.336 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-21T06:20:15.336 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000197401 s, 2.6 MB/s 2024-09-21T06:20:15.337 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:20:15.393 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T06:20:15.394 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:20:15.414 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:20:15.414 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2024-09-21T06:20:15.472 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:20:15.472 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:20:15.472 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-21T06:20:15.472 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:20:15.472 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:20:15.472 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-21 06:19:48.173221985 +0000 2024-09-21T06:20:15.472 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-21 06:14:07.160520621 +0000 2024-09-21T06:20:15.472 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-21 06:14:07.160520621 +0000 2024-09-21T06:20:15.473 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-21 06:14:07.160520621 +0000 2024-09-21T06:20:15.473 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:20:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:15 smithi071 ceph-mon[34844]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:15.542 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-21T06:20:15.542 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-21T06:20:15.542 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.00027736 s, 1.8 MB/s 2024-09-21T06:20:15.543 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:20:15.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:15 smithi063 ceph-mon[31150]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:15.598 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:15 smithi175 ceph-mon[34510]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:15.601 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2024-09-21T06:20:15.657 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:20:15.657 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:20:15.658 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T06:20:15.658 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:20:15.658 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:20:15.658 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-21 06:19:48.173221985 +0000 2024-09-21T06:20:15.658 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-21 06:14:07.486515473 +0000 2024-09-21T06:20:15.658 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-21 06:14:07.486515473 +0000 2024-09-21T06:20:15.658 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-21 06:14:07.486515473 +0000 2024-09-21T06:20:15.658 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:20:15.722 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-21T06:20:15.722 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-21T06:20:15.722 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000183215 s, 2.8 MB/s 2024-09-21T06:20:15.723 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:20:15.780 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2024-09-21T06:20:15.836 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:20:15.836 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:20:15.836 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T06:20:15.836 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:20:15.837 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:20:15.837 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-21 06:19:48.174221970 +0000 2024-09-21T06:20:15.837 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-21 06:14:07.803510467 +0000 2024-09-21T06:20:15.837 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-21 06:14:07.803510467 +0000 2024-09-21T06:20:15.837 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-21 06:14:07.803510467 +0000 2024-09-21T06:20:15.837 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:20:15.900 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-21T06:20:15.900 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-21T06:20:15.900 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000203362 s, 2.5 MB/s 2024-09-21T06:20:15.901 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:20:15.957 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2024-09-21T06:20:16.012 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:20:16.012 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:20:16.012 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-09-21T06:20:16.012 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:20:16.012 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:20:16.013 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-21 06:19:48.174221970 +0000 2024-09-21T06:20:16.013 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-21 06:14:08.139505161 +0000 2024-09-21T06:20:16.013 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-21 06:14:08.139505161 +0000 2024-09-21T06:20:16.013 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-21 06:14:08.139505161 +0000 2024-09-21T06:20:16.013 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:20:16.075 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-21T06:20:16.075 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-21T06:20:16.075 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000193894 s, 2.6 MB/s 2024-09-21T06:20:16.077 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:20:16.133 INFO:tasks.cephadm:Deploying osd.0 on smithi063 with /dev/vg_nvme/lv_4... 2024-09-21T06:20:16.133 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T06:20:16.390 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:17.567 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:17 smithi063 ceph-mon[31150]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:17.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:17 smithi175 ceph-mon[34510]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:17.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:17 smithi071 ceph-mon[34844]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:18.739 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:20:18.765 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi063:vg_nvme/lv_4 2024-09-21T06:20:19.015 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:19.463 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:19 smithi063 ceph-mon[31150]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:19.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.474+0000 7f8060c7d640 1 -- 172.21.15.63:0/1071327639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f805c104a30 msgr2=0x7f805c104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:19.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.474+0000 7f8060c7d640 1 --2- 172.21.15.63:0/1071327639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f805c104a30 0x7f805c104e40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f804c009ca0 tx=0x7f804c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:20:19.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.474+0000 7f8060c7d640 1 -- 172.21.15.63:0/1071327639 shutdown_connections 2024-09-21T06:20:19.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.474+0000 7f8060c7d640 1 --2- 172.21.15.63:0/1071327639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f805c10de60 0x7f805c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:19.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.474+0000 7f8060c7d640 1 --2- 172.21.15.63:0/1071327639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f805c105380 0x7f805c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:19.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.474+0000 7f8060c7d640 1 --2- 172.21.15.63:0/1071327639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f805c104a30 0x7f805c104e40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:19.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.474+0000 7f8060c7d640 1 -- 172.21.15.63:0/1071327639 >> 172.21.15.63:0/1071327639 conn(0x7f805c079760 msgr2=0x7f805c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:19.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.474+0000 7f8060c7d640 1 -- 172.21.15.63:0/1071327639 shutdown_connections 2024-09-21T06:20:19.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.474+0000 7f8060c7d640 1 -- 172.21.15.63:0/1071327639 wait complete. 2024-09-21T06:20:19.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.475+0000 7f8060c7d640 1 Processor -- start 2024-09-21T06:20:19.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.475+0000 7f8060c7d640 1 -- start start 2024-09-21T06:20:19.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.475+0000 7f8060c7d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f805c104a30 0x7f805c19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:19.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.475+0000 7f8060c7d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f805c105380 0x7f805c19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:19.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.475+0000 7f8060c7d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f805c10de60 0x7f805c19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:19.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.475+0000 7f8060c7d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f805c113ac0 con 0x7f805c104a30 2024-09-21T06:20:19.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.475+0000 7f8060c7d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f805c113940 con 0x7f805c10de60 2024-09-21T06:20:19.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.475+0000 7f8060c7d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f805c113c40 con 0x7f805c105380 2024-09-21T06:20:19.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.475+0000 7f805a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f805c104a30 0x7f805c19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:19.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.475+0000 7f805a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f805c104a30 0x7f805c19a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55852/0 (socket says 172.21.15.63:55852) 2024-09-21T06:20:19.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.475+0000 7f805a59c640 1 -- 172.21.15.63:0/2439485298 learned_addr learned my addr 172.21.15.63:0/2439485298 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:20:19.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.475+0000 7f8059d9b640 1 --2- 172.21.15.63:0/2439485298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f805c105380 0x7f805c19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:19.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.476+0000 7f805ad9d640 1 --2- 172.21.15.63:0/2439485298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f805c10de60 0x7f805c19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:19.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.476+0000 7f805a59c640 1 -- 172.21.15.63:0/2439485298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f805c105380 msgr2=0x7f805c19aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:19.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.476+0000 7f805a59c640 1 --2- 172.21.15.63:0/2439485298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f805c105380 0x7f805c19aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:19.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.476+0000 7f805a59c640 1 -- 172.21.15.63:0/2439485298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f805c10de60 msgr2=0x7f805c19fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:19.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.476+0000 7f805a59c640 1 --2- 172.21.15.63:0/2439485298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f805c10de60 0x7f805c19fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:19.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.476+0000 7f805a59c640 1 -- 172.21.15.63:0/2439485298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f805c1a0460 con 0x7f805c104a30 2024-09-21T06:20:19.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.476+0000 7f805a59c640 1 --2- 172.21.15.63:0/2439485298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f805c104a30 0x7f805c19a4f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f804c006010 tx=0x7f804c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:19.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.476+0000 7f804b7fe640 1 -- 172.21.15.63:0/2439485298 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c003bf0 con 0x7f805c104a30 2024-09-21T06:20:19.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.476+0000 7f8060c7d640 1 -- 172.21.15.63:0/2439485298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f805c1a06f0 con 0x7f805c104a30 2024-09-21T06:20:19.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.476+0000 7f804b7fe640 1 -- 172.21.15.63:0/2439485298 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f804c003d90 con 0x7f805c104a30 2024-09-21T06:20:19.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.476+0000 7f804b7fe640 1 -- 172.21.15.63:0/2439485298 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c02fb60 con 0x7f805c104a30 2024-09-21T06:20:19.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.476+0000 7f8060c7d640 1 -- 172.21.15.63:0/2439485298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f805c1a6eb0 con 0x7f805c104a30 2024-09-21T06:20:19.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.477+0000 7f8060c7d640 1 -- 172.21.15.63:0/2439485298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f805c06c1f0 con 0x7f805c104a30 2024-09-21T06:20:19.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.480+0000 7f804b7fe640 1 -- 172.21.15.63:0/2439485298 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f804c02fd00 con 0x7f805c104a30 2024-09-21T06:20:19.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.480+0000 7f804b7fe640 1 --2- 172.21.15.63:0/2439485298 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f80440b64d0 0x7f80440b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:19.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.481+0000 7f8059d9b640 1 --2- 172.21.15.63:0/2439485298 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f80440b64d0 0x7f80440b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:19.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.481+0000 7f804b7fe640 1 -- 172.21.15.63:0/2439485298 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f804c106ba0 con 0x7f805c104a30 2024-09-21T06:20:19.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.481+0000 7f8059d9b640 1 --2- 172.21.15.63:0/2439485298 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f80440b64d0 0x7f80440b89e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f805c1024b0 tx=0x7f805000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:19.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.484+0000 7f804b7fe640 1 -- 172.21.15.63:0/2439485298 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f804c0cf030 con 0x7f805c104a30 2024-09-21T06:20:19.570 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:19 smithi071 ceph-mon[34844]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:19.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:19 smithi175 ceph-mon[34510]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:19.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:19.681+0000 7f8060c7d640 1 -- 172.21.15.63:0/2439485298 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f805c063800 con 0x7f80440b64d0 2024-09-21T06:20:20.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:20 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:20:20.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:20 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:20:20.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:20 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:20.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:20 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:20:20.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:20 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:20:20.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:20 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:20.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:20 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:20:20.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:20 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:20:20.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:20 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:21.526 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:21 smithi063 ceph-mon[31150]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:20:21.526 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:21 smithi063 ceph-mon[31150]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:21.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:21 smithi175 ceph-mon[34510]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:20:21.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:21 smithi175 ceph-mon[34510]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:21.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:21 smithi071 ceph-mon[34844]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:20:21.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:21 smithi071 ceph-mon[34844]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:22.510 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:22 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/4041424663' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df4162c1-dd66-4d11-99bc-0ae36ea130f0"} : dispatch 2024-09-21T06:20:22.510 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:22 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/4041424663' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df4162c1-dd66-4d11-99bc-0ae36ea130f0"}]': finished 2024-09-21T06:20:22.510 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:22 smithi063 ceph-mon[31150]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T06:20:22.510 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:22 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:20:22.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:22 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/4041424663' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df4162c1-dd66-4d11-99bc-0ae36ea130f0"} : dispatch 2024-09-21T06:20:22.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:22 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/4041424663' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df4162c1-dd66-4d11-99bc-0ae36ea130f0"}]': finished 2024-09-21T06:20:22.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:22 smithi175 ceph-mon[34510]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T06:20:22.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:22 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:20:22.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:22 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/4041424663' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df4162c1-dd66-4d11-99bc-0ae36ea130f0"} : dispatch 2024-09-21T06:20:22.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:22 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/4041424663' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df4162c1-dd66-4d11-99bc-0ae36ea130f0"}]': finished 2024-09-21T06:20:22.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:22 smithi071 ceph-mon[34844]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T06:20:22.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:22 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:20:23.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:23 smithi063 ceph-mon[31150]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:23.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:23 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/237632618' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:20:23.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:23 smithi175 ceph-mon[34510]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:23.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:23 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/237632618' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:20:23.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:23 smithi071 ceph-mon[34844]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:23.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:23 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/237632618' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:20:25.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:25 smithi063 ceph-mon[31150]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:25.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:25 smithi175 ceph-mon[34510]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:25.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:25 smithi071 ceph-mon[34844]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:27.495 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:27 smithi063 ceph-mon[31150]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:27.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:27 smithi175 ceph-mon[34510]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:27.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:27 smithi071 ceph-mon[34844]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:29.554 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:29 smithi063 ceph-mon[31150]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:29.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:29 smithi175 ceph-mon[34510]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:29 smithi071 ceph-mon[34844]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:31.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:31 smithi063 ceph-mon[31150]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:31.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:31 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T06:20:31.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:31 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:31.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:31 smithi063 ceph-mon[31150]: Deploying daemon osd.0 on smithi063 2024-09-21T06:20:31.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:31 smithi175 ceph-mon[34510]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:31.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:31 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T06:20:31.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:31 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:31.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:31 smithi175 ceph-mon[34510]: Deploying daemon osd.0 on smithi063 2024-09-21T06:20:31.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:31 smithi071 ceph-mon[34844]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:31.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:31 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T06:20:31.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:31 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:31.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:31 smithi071 ceph-mon[34844]: Deploying daemon osd.0 on smithi063 2024-09-21T06:20:33.491 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:33 smithi063 ceph-mon[31150]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:33.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:33 smithi175 ceph-mon[34510]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:33.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:33 smithi071 ceph-mon[34844]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:35.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:35 smithi175 ceph-mon[34510]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:35.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:35 smithi071 ceph-mon[34844]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:35.792 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:35 smithi063 ceph-mon[31150]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:37.483 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:37 smithi063 ceph-mon[31150]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:37.483 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:20:37.483 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:37.483 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:37.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:37 smithi175 ceph-mon[34510]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:37.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:20:37.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:37.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:37.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:37 smithi071 ceph-mon[34844]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:37.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:20:37.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:37.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:39.370 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:39 smithi063 ceph-mon[31150]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:39.370 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:39 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:39.370 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:39 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:39.370 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:39 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:39.370 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:39 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:20:39.370 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:39 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:39.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:39 smithi175 ceph-mon[34510]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:39.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:39 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:39.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:39 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:39.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:39 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:39.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:39 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:20:39.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:39 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:39.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:39 smithi071 ceph-mon[34844]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:39.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:39 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:39.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:39 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:39.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:39 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:39.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:39 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:20:39.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:39 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:41.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:41.284+0000 7f804b7fe640 1 -- 172.21.15.63:0/2439485298 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f805c063800 con 0x7f80440b64d0 2024-09-21T06:20:41.287 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 0 on host 'smithi063' 2024-09-21T06:20:41.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:41.286+0000 7f8060c7d640 1 -- 172.21.15.63:0/2439485298 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f80440b64d0 msgr2=0x7f80440b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:41.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:41.286+0000 7f8060c7d640 1 --2- 172.21.15.63:0/2439485298 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f80440b64d0 0x7f80440b89e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f805c1024b0 tx=0x7f805000b390 comp rx=0 tx=0).stop 2024-09-21T06:20:41.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:41.286+0000 7f8060c7d640 1 -- 172.21.15.63:0/2439485298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f805c104a30 msgr2=0x7f805c19a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:41.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:41.286+0000 7f8060c7d640 1 --2- 172.21.15.63:0/2439485298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f805c104a30 0x7f805c19a4f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f804c006010 tx=0x7f804c0319f0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:41.286+0000 7f8060c7d640 1 -- 172.21.15.63:0/2439485298 shutdown_connections 2024-09-21T06:20:41.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:41.286+0000 7f8060c7d640 1 --2- 172.21.15.63:0/2439485298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f805c10de60 0x7f805c19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:41.286+0000 7f8060c7d640 1 --2- 172.21.15.63:0/2439485298 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f80440b64d0 0x7f80440b89e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:41.286+0000 7f8060c7d640 1 --2- 172.21.15.63:0/2439485298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f805c105380 0x7f805c19aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:41.286+0000 7f8060c7d640 1 --2- 172.21.15.63:0/2439485298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f805c104a30 0x7f805c19a4f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:41.286+0000 7f8060c7d640 1 -- 172.21.15.63:0/2439485298 >> 172.21.15.63:0/2439485298 conn(0x7f805c079760 msgr2=0x7f805c1008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:41.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:41.287+0000 7f8060c7d640 1 -- 172.21.15.63:0/2439485298 shutdown_connections 2024-09-21T06:20:41.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:20:41.287+0000 7f8060c7d640 1 -- 172.21.15.63:0/2439485298 wait complete. 2024-09-21T06:20:41.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:41 smithi063 ceph-mon[31150]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:41.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:41 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:20:41.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:41 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:41.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:41 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:41.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:41 smithi071 ceph-mon[34844]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:41.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:41 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:20:41.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:41 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:41.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:41 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:41 smithi175 ceph-mon[34510]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:41 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:20:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:41 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:41 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:41.865 DEBUG:teuthology.orchestra.run.smithi063:osd.0> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T06:20:41.867 INFO:tasks.cephadm:Deploying osd.1 on smithi071 with /dev/vg_nvme/lv_4... 2024-09-21T06:20:41.867 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T06:20:42.197 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:20:43.083 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:20:42 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-0[47840]: 2024-09-21T06:20:42.777+0000 7feb84418640 -1 osd.0 0 log_to_monitors true 2024-09-21T06:20:43.370 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:43 smithi063 ceph-mon[31150]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:43.370 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:43 smithi063 ceph-mon[31150]: from='osd.0 [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T06:20:43.500 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:43 smithi071 ceph-mon[34844]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:43.500 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:43 smithi071 ceph-mon[34844]: from='osd.0 [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T06:20:43.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:43 smithi175 ceph-mon[34510]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:43.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:43 smithi175 ceph-mon[34510]: from='osd.0 [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T06:20:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:20:44.571 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:44 smithi071 ceph-mon[34844]: from='osd.0 [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T06:20:44.571 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:44 smithi071 ceph-mon[34844]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T06:20:44.571 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:44 smithi071 ceph-mon[34844]: from='osd.0 [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]} : dispatch 2024-09-21T06:20:44.571 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:44 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:20:44.571 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:44 smithi071 ceph-mon[34844]: from='osd.0 [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-21T06:20:44.571 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:44 smithi071 ceph-mon[34844]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T06:20:44.572 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:44 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:20:44.573 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi071:vg_nvme/lv_4 2024-09-21T06:20:44.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:44 smithi063 ceph-mon[31150]: from='osd.0 [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T06:20:44.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:44 smithi063 ceph-mon[31150]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T06:20:44.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:44 smithi063 ceph-mon[31150]: from='osd.0 [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]} : dispatch 2024-09-21T06:20:44.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:44 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:20:44.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:44 smithi063 ceph-mon[31150]: from='osd.0 [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-21T06:20:44.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:44 smithi063 ceph-mon[31150]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T06:20:44.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:44 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:20:44.829 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:20:44.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:44 smithi175 ceph-mon[34510]: from='osd.0 [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T06:20:44.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:44 smithi175 ceph-mon[34510]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T06:20:44.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:44 smithi175 ceph-mon[34510]: from='osd.0 [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]} : dispatch 2024-09-21T06:20:44.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:44 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:20:44.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:44 smithi175 ceph-mon[34510]: from='osd.0 [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-21T06:20:44.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:44 smithi175 ceph-mon[34510]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T06:20:44.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:44 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:20:45.082 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:20:44 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-0[47840]: 2024-09-21T06:20:44.822+0000 7feb8039a640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T06:20:45.082 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:20:44 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-0[47840]: 2024-09-21T06:20:44.828+0000 7feb78190640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:20:45.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.259+0000 7f17eee92640 1 -- 172.21.15.71:0/2322869529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17e8108cf0 msgr2=0x7f17e810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:45.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.259+0000 7f17eee92640 1 --2- 172.21.15.71:0/2322869529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17e8108cf0 0x7f17e810f520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009ca0 tx=0x7f17e002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:20:45.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.259+0000 7f17eee92640 1 -- 172.21.15.71:0/2322869529 shutdown_connections 2024-09-21T06:20:45.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.259+0000 7f17eee92640 1 --2- 172.21.15.71:0/2322869529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17e8108cf0 0x7f17e810f520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:45.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.259+0000 7f17eee92640 1 --2- 172.21.15.71:0/2322869529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17e81083a0 0x7f17e81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:45.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.259+0000 7f17eee92640 1 --2- 172.21.15.71:0/2322869529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17e8102a60 0x7f17e8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:45.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.259+0000 7f17eee92640 1 -- 172.21.15.71:0/2322869529 >> 172.21.15.71:0/2322869529 conn(0x7f17e8079730 msgr2=0x7f17e8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.259+0000 7f17eee92640 1 -- 172.21.15.71:0/2322869529 shutdown_connections 2024-09-21T06:20:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.259+0000 7f17eee92640 1 -- 172.21.15.71:0/2322869529 wait complete. 2024-09-21T06:20:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.259+0000 7f17eee92640 1 Processor -- start 2024-09-21T06:20:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.260+0000 7f17eee92640 1 -- start start 2024-09-21T06:20:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.260+0000 7f17eee92640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17e8102a60 0x7f17e819b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.260+0000 7f17eee92640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17e81083a0 0x7f17e819b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.260+0000 7f17eee92640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17e8108cf0 0x7f17e819bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.260+0000 7f17eee92640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f17e8112960 con 0x7f17e8108cf0 2024-09-21T06:20:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.260+0000 7f17eee92640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f17e81127e0 con 0x7f17e8102a60 2024-09-21T06:20:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.260+0000 7f17eee92640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f17e8112ae0 con 0x7f17e81083a0 2024-09-21T06:20:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.260+0000 7f17ecc2e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17e8102a60 0x7f17e819b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.260+0000 7f17ecc2e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17e8102a60 0x7f17e819b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42238/0 (socket says 172.21.15.71:42238) 2024-09-21T06:20:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.260+0000 7f17ecc2e640 1 -- 172.21.15.71:0/2836862099 learned_addr learned my addr 172.21.15.71:0/2836862099 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-21T06:20:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.260+0000 7f17ed42f640 1 --2- 172.21.15.71:0/2836862099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17e8108cf0 0x7f17e819bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.260+0000 7f17e7fff640 1 --2- 172.21.15.71:0/2836862099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17e81083a0 0x7f17e819b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.260+0000 7f17ecc2e640 1 -- 172.21.15.71:0/2836862099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17e81083a0 msgr2=0x7f17e819b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.260+0000 7f17ecc2e640 1 --2- 172.21.15.71:0/2836862099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17e81083a0 0x7f17e819b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.260+0000 7f17ecc2e640 1 -- 172.21.15.71:0/2836862099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17e8108cf0 msgr2=0x7f17e819bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.260+0000 7f17ecc2e640 1 --2- 172.21.15.71:0/2836862099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17e8108cf0 0x7f17e819bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.260+0000 7f17ecc2e640 1 -- 172.21.15.71:0/2836862099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e81990a0 con 0x7f17e8102a60 2024-09-21T06:20:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.260+0000 7f17ed42f640 1 --2- 172.21.15.71:0/2836862099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17e8108cf0 0x7f17e819bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.260+0000 7f17ecc2e640 1 --2- 172.21.15.71:0/2836862099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17e8102a60 0x7f17e819b2b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00c920 tx=0x7f17dc00cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.261+0000 7f17e5ffb640 1 -- 172.21.15.71:0/2836862099 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc007c70 con 0x7f17e8102a60 2024-09-21T06:20:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.261+0000 7f17e5ffb640 1 -- 172.21.15.71:0/2836862099 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17dc007e10 con 0x7f17e8102a60 2024-09-21T06:20:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.261+0000 7f17e5ffb640 1 -- 172.21.15.71:0/2836862099 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc018820 con 0x7f17e8102a60 2024-09-21T06:20:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.261+0000 7f17eee92640 1 -- 172.21.15.71:0/2836862099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17e8199390 con 0x7f17e8102a60 2024-09-21T06:20:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.261+0000 7f17eee92640 1 -- 172.21.15.71:0/2836862099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17e8199920 con 0x7f17e8102a60 2024-09-21T06:20:45.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.262+0000 7f17eee92640 1 -- 172.21.15.71:0/2836862099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17e8102e70 con 0x7f17e8102a60 2024-09-21T06:20:45.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.264+0000 7f17e5ffb640 1 -- 172.21.15.71:0/2836862099 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f17dc00f450 con 0x7f17e8102a60 2024-09-21T06:20:45.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.264+0000 7f17e5ffb640 1 --2- 172.21.15.71:0/2836862099 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f17d80b6580 0x7f17d80b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:45.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.264+0000 7f17e5ffb640 1 -- 172.21.15.71:0/2836862099 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1702+0+0 (secure 0 0 0) 0x7f17dc0e5c80 con 0x7f17e8102a60 2024-09-21T06:20:45.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.264+0000 7f17e7fff640 1 --2- 172.21.15.71:0/2836862099 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f17d80b6580 0x7f17d80b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:45.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.265+0000 7f17e7fff640 1 --2- 172.21.15.71:0/2836862099 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f17d80b6580 0x7f17d80b8a90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f17d4005fd0 tx=0x7f17d400b510 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:45.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.272+0000 7f17e5ffb640 1 -- 172.21.15.71:0/2836862099 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f17dc014030 con 0x7f17e8102a60 2024-09-21T06:20:45.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:20:45.468+0000 7f17eee92640 1 -- 172.21.15.71:0/2836862099 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f17e819ae70 con 0x7f17d80b6580 2024-09-21T06:20:45.469 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:45 smithi071 ceph-mon[34844]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:45.469 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:20:45.469 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:45.469 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:45.470 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:20:45.470 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:45.470 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:45.470 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:20:45.470 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:45.470 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:45 smithi071 ceph-mon[34844]: from='osd.0 [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772]' entity='osd.0' 2024-09-21T06:20:45.470 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:20:45.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:45 smithi063 ceph-mon[31150]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:45.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:20:45.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:45.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:45.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:20:45.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:45.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:45.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:20:45.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:45.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:45 smithi063 ceph-mon[31150]: from='osd.0 [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772]' entity='osd.0' 2024-09-21T06:20:45.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:20:45.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:45 smithi175 ceph-mon[34510]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:45.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:20:45.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:45.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:45.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:20:45.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:45.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:45.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:20:45.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:20:45.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:45 smithi175 ceph-mon[34510]: from='osd.0 [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772]' entity='osd.0' 2024-09-21T06:20:45.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:20:46.413 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:46 smithi071 ceph-mon[34844]: purged_snaps scrub starts 2024-09-21T06:20:46.413 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:46 smithi071 ceph-mon[34844]: purged_snaps scrub ok 2024-09-21T06:20:46.413 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:46 smithi071 ceph-mon[34844]: Detected new or changed devices on smithi063 2024-09-21T06:20:46.413 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:46 smithi071 ceph-mon[34844]: Adjusting osd_memory_target on smithi063 to 17088M 2024-09-21T06:20:46.413 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:46 smithi071 ceph-mon[34844]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:20:46.413 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:20:46.413 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:20:46.414 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:46.414 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:46 smithi071 ceph-mon[34844]: osd.0 [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772] boot 2024-09-21T06:20:46.414 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:46 smithi071 ceph-mon[34844]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T06:20:46.414 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:20:46.628 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:46 smithi063 ceph-mon[31150]: purged_snaps scrub starts 2024-09-21T06:20:46.628 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:46 smithi063 ceph-mon[31150]: purged_snaps scrub ok 2024-09-21T06:20:46.628 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:46 smithi063 ceph-mon[31150]: Detected new or changed devices on smithi063 2024-09-21T06:20:46.628 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:46 smithi063 ceph-mon[31150]: Adjusting osd_memory_target on smithi063 to 17088M 2024-09-21T06:20:46.628 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:46 smithi063 ceph-mon[31150]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:20:46.628 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:20:46.629 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:20:46.629 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:46.629 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:46 smithi063 ceph-mon[31150]: osd.0 [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772] boot 2024-09-21T06:20:46.629 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:46 smithi063 ceph-mon[31150]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T06:20:46.629 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:20:46.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:46 smithi175 ceph-mon[34510]: purged_snaps scrub starts 2024-09-21T06:20:46.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:46 smithi175 ceph-mon[34510]: purged_snaps scrub ok 2024-09-21T06:20:46.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:46 smithi175 ceph-mon[34510]: Detected new or changed devices on smithi063 2024-09-21T06:20:46.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:46 smithi175 ceph-mon[34510]: Adjusting osd_memory_target on smithi063 to 17088M 2024-09-21T06:20:46.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:46 smithi175 ceph-mon[34510]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:20:46.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:20:46.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:20:46.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:46.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:46 smithi175 ceph-mon[34510]: osd.0 [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772] boot 2024-09-21T06:20:46.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:46 smithi175 ceph-mon[34510]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T06:20:46.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:20:47.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:47 smithi063 ceph-mon[31150]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:47.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:47 smithi063 ceph-mon[31150]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T06:20:47.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:47 smithi071 ceph-mon[34844]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:47.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:47 smithi071 ceph-mon[34844]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T06:20:47.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:47 smithi175 ceph-mon[34510]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:20:47.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:47 smithi175 ceph-mon[34510]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T06:20:48.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:48 smithi071 ceph-mon[34844]: from='client.? 172.21.15.71:0/1695771703' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65a12def-9f66-4153-8f1a-2ebfbbfeba99"} : dispatch 2024-09-21T06:20:48.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:48 smithi071 ceph-mon[34844]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65a12def-9f66-4153-8f1a-2ebfbbfeba99"} : dispatch 2024-09-21T06:20:48.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:48 smithi071 ceph-mon[34844]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65a12def-9f66-4153-8f1a-2ebfbbfeba99"}]': finished 2024-09-21T06:20:48.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:48 smithi071 ceph-mon[34844]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T06:20:48.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:48 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:20:48.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:48 smithi071 ceph-mon[34844]: from='client.? 172.21.15.71:0/4188135136' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:20:48.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:48 smithi063 ceph-mon[31150]: from='client.? 172.21.15.71:0/1695771703' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65a12def-9f66-4153-8f1a-2ebfbbfeba99"} : dispatch 2024-09-21T06:20:48.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:48 smithi063 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65a12def-9f66-4153-8f1a-2ebfbbfeba99"} : dispatch 2024-09-21T06:20:48.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:48 smithi063 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65a12def-9f66-4153-8f1a-2ebfbbfeba99"}]': finished 2024-09-21T06:20:48.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:48 smithi063 ceph-mon[31150]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T06:20:48.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:48 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:20:48.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:48 smithi063 ceph-mon[31150]: from='client.? 172.21.15.71:0/4188135136' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:20:48.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:48 smithi175 ceph-mon[34510]: from='client.? 172.21.15.71:0/1695771703' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65a12def-9f66-4153-8f1a-2ebfbbfeba99"} : dispatch 2024-09-21T06:20:48.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:48 smithi175 ceph-mon[34510]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65a12def-9f66-4153-8f1a-2ebfbbfeba99"} : dispatch 2024-09-21T06:20:48.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:48 smithi175 ceph-mon[34510]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65a12def-9f66-4153-8f1a-2ebfbbfeba99"}]': finished 2024-09-21T06:20:48.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:48 smithi175 ceph-mon[34510]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T06:20:48.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:48 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:20:48.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:48 smithi175 ceph-mon[34510]: from='client.? 172.21.15.71:0/4188135136' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:20:49.672 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:49 smithi071 ceph-mon[34844]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:20:49.750 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:49 smithi175 ceph-mon[34510]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:20:49.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:49 smithi063 ceph-mon[31150]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:20:51.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:51 smithi071 ceph-mon[34844]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:20:51.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:51 smithi063 ceph-mon[31150]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:20:51.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:51 smithi175 ceph-mon[34510]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:20:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:53 smithi071 ceph-mon[34844]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:20:53.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:53 smithi063 ceph-mon[31150]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:20:53.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:53 smithi175 ceph-mon[34510]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:20:55.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:55 smithi071 ceph-mon[34844]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:20:55.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:55 smithi063 ceph-mon[31150]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:20:55.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:55 smithi175 ceph-mon[34510]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:20:56.748 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:56 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T06:20:56.748 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:56 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:56.748 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:56 smithi071 ceph-mon[34844]: Deploying daemon osd.1 on smithi071 2024-09-21T06:20:56.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:56 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T06:20:56.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:56 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:56.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:56 smithi063 ceph-mon[31150]: Deploying daemon osd.1 on smithi071 2024-09-21T06:20:56.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:56 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T06:20:56.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:56 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:56.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:56 smithi175 ceph-mon[34510]: Deploying daemon osd.1 on smithi071 2024-09-21T06:20:57.603 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:57 smithi071 ceph-mon[34844]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:20:57.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:57 smithi063 ceph-mon[31150]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:20:57.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:57 smithi175 ceph-mon[34510]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:20:59.711 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:20:59 smithi071 ceph-mon[34844]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:20:59.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:20:59 smithi063 ceph-mon[31150]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:20:59.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:20:59 smithi175 ceph-mon[34510]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:21:01.483 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:01 smithi071 ceph-mon[34844]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:21:01.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:01 smithi063 ceph-mon[31150]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:21:01.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:01 smithi175 ceph-mon[34510]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:21:02.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:02 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:02.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:02 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:02.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:02 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:02.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:02 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:02.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:02 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:02.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:02 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:02.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:02 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:02.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:02 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:02.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:02 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:03.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:03 smithi071 ceph-mon[34844]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:21:03.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:03 smithi063 ceph-mon[31150]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:21:03.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:03 smithi175 ceph-mon[34510]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:21:05.500 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:05 smithi071 ceph-mon[34844]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:21:05.500 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:05 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:05.500 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:05 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:05.500 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:05 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:05.501 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:05 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:21:05.501 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:05 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:05.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:05 smithi063 ceph-mon[31150]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:21:05.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:05 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:05.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:05 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:05.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:05 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:05.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:05 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:21:05.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:05 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:05.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:05 smithi175 ceph-mon[34510]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:21:05.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:05 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:05.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:05 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:05.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:05 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:05.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:05 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:21:05.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:05 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:05.926 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 1 on host 'smithi071' 2024-09-21T06:21:05.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:21:05.924+0000 7f17e5ffb640 1 -- 172.21.15.71:0/2836862099 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f17e819ae70 con 0x7f17d80b6580 2024-09-21T06:21:05.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:21:05.926+0000 7f17eee92640 1 -- 172.21.15.71:0/2836862099 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f17d80b6580 msgr2=0x7f17d80b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:05.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:21:05.926+0000 7f17eee92640 1 --2- 172.21.15.71:0/2836862099 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f17d80b6580 0x7f17d80b8a90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f17d4005fd0 tx=0x7f17d400b510 comp rx=0 tx=0).stop 2024-09-21T06:21:05.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:21:05.926+0000 7f17eee92640 1 -- 172.21.15.71:0/2836862099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17e8102a60 msgr2=0x7f17e819b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:05.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:21:05.926+0000 7f17eee92640 1 --2- 172.21.15.71:0/2836862099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17e8102a60 0x7f17e819b2b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00c920 tx=0x7f17dc00cde0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:21:05.926+0000 7f17eee92640 1 -- 172.21.15.71:0/2836862099 shutdown_connections 2024-09-21T06:21:05.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:21:05.926+0000 7f17eee92640 1 --2- 172.21.15.71:0/2836862099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17e8108cf0 0x7f17e819bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:21:05.926+0000 7f17eee92640 1 --2- 172.21.15.71:0/2836862099 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f17d80b6580 0x7f17d80b8a90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:21:05.927+0000 7f17eee92640 1 --2- 172.21.15.71:0/2836862099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17e81083a0 0x7f17e819b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:21:05.927+0000 7f17eee92640 1 --2- 172.21.15.71:0/2836862099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17e8102a60 0x7f17e819b2b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:21:05.927+0000 7f17eee92640 1 -- 172.21.15.71:0/2836862099 >> 172.21.15.71:0/2836862099 conn(0x7f17e8079730 msgr2=0x7f17e8104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:05.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:21:05.927+0000 7f17eee92640 1 -- 172.21.15.71:0/2836862099 shutdown_connections 2024-09-21T06:21:05.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:21:05.927+0000 7f17eee92640 1 -- 172.21.15.71:0/2836862099 wait complete. 2024-09-21T06:21:06.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:06 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:06.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:06 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:06.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:06 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:06.474 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:06 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:06.474 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:06 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:06.474 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:06 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:06.521 DEBUG:teuthology.orchestra.run.smithi071:osd.1> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T06:21:06.523 INFO:tasks.cephadm:Deploying osd.2 on smithi175 with /dev/vg_nvme/lv_4... 2024-09-21T06:21:06.523 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T06:21:06.550 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:06 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:06.550 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:06 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:06.550 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:06 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:06.788 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:21:07.475 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:07 smithi071 ceph-mon[34844]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:21:07.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:07 smithi063 ceph-mon[31150]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:21:07.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:07 smithi175 ceph-mon[34510]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:21:08.100 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:21:07 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-1[39554]: 2024-09-21T06:21:07.997+0000 7f2095d4b640 -1 osd.1 0 log_to_monitors true 2024-09-21T06:21:08.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:08 smithi175 ceph-mon[34510]: from='osd.1 [v2:172.21.15.71:6800/1676297548,v1:172.21.15.71:6801/1676297548]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:21:08.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:08 smithi175 ceph-mon[34510]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:21:08.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:08 smithi071 ceph-mon[34844]: from='osd.1 [v2:172.21.15.71:6800/1676297548,v1:172.21.15.71:6801/1676297548]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:21:08.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:08 smithi071 ceph-mon[34844]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:21:08.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:08 smithi063 ceph-mon[31150]: from='osd.1 [v2:172.21.15.71:6800/1676297548,v1:172.21.15.71:6801/1676297548]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:21:08.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:08 smithi063 ceph-mon[31150]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:21:09.131 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:21:09.156 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi175:vg_nvme/lv_4 2024-09-21T06:21:09.421 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:09 smithi175 ceph-mon[34510]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:21:09.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:09 smithi175 ceph-mon[34510]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T06:21:09.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:09 smithi175 ceph-mon[34510]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T06:21:09.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:09 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:21:09.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:09 smithi175 ceph-mon[34510]: from='osd.1 [v2:172.21.15.71:6800/1676297548,v1:172.21.15.71:6801/1676297548]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:21:09.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:09 smithi175 ceph-mon[34510]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:21:09.442 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:21:09.493 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:09 smithi071 ceph-mon[34844]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:21:09.494 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:09 smithi071 ceph-mon[34844]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T06:21:09.494 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:09 smithi071 ceph-mon[34844]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T06:21:09.494 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:09 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:21:09.494 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:09 smithi071 ceph-mon[34844]: from='osd.1 [v2:172.21.15.71:6800/1676297548,v1:172.21.15.71:6801/1676297548]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:21:09.494 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:09 smithi071 ceph-mon[34844]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:21:09.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:09 smithi063 ceph-mon[31150]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:21:09.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:09 smithi063 ceph-mon[31150]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T06:21:09.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:09 smithi063 ceph-mon[31150]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T06:21:09.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:09 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:21:09.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:09 smithi063 ceph-mon[31150]: from='osd.1 [v2:172.21.15.71:6800/1676297548,v1:172.21.15.71:6801/1676297548]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:21:09.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:09 smithi063 ceph-mon[31150]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:21:09.768 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:21:09 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-1[39554]: 2024-09-21T06:21:09.629+0000 7f2091ccd640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T06:21:09.768 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:21:09 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-1[39554]: 2024-09-21T06:21:09.632+0000 7f2089ac3640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:21:09.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.917+0000 7f960eec6640 1 -- 172.21.15.175:0/957274561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9608102a60 msgr2=0x7f9608102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:09.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.917+0000 7f960eec6640 1 --2- 172.21.15.175:0/957274561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9608102a60 0x7f9608102e70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9604009ca0 tx=0x7f960402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:21:09.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.917+0000 7f960eec6640 1 -- 172.21.15.175:0/957274561 shutdown_connections 2024-09-21T06:21:09.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.917+0000 7f960eec6640 1 --2- 172.21.15.175:0/957274561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9608108cf0 0x7f960810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:09.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.917+0000 7f960eec6640 1 --2- 172.21.15.175:0/957274561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96081083a0 0x7f96081087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:09.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.917+0000 7f960eec6640 1 --2- 172.21.15.175:0/957274561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9608102a60 0x7f9608102e70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:09.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.917+0000 7f960eec6640 1 -- 172.21.15.175:0/957274561 >> 172.21.15.175:0/957274561 conn(0x7f9608079730 msgr2=0x7f9608079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:09.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.917+0000 7f960eec6640 1 -- 172.21.15.175:0/957274561 shutdown_connections 2024-09-21T06:21:09.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.917+0000 7f960eec6640 1 -- 172.21.15.175:0/957274561 wait complete. 2024-09-21T06:21:09.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.918+0000 7f960eec6640 1 Processor -- start 2024-09-21T06:21:09.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.918+0000 7f960eec6640 1 -- start start 2024-09-21T06:21:09.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.918+0000 7f960eec6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9608102a60 0x7f960819b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:09.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.918+0000 7f960eec6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96081083a0 0x7f960819b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:09.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.918+0000 7f960eec6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9608108cf0 0x7f960819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:09.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.918+0000 7f960eec6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f96081129b0 con 0x7f9608108cf0 2024-09-21T06:21:09.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.918+0000 7f960eec6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9608112830 con 0x7f96081083a0 2024-09-21T06:21:09.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.918+0000 7f960eec6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9608112b30 con 0x7f9608102a60 2024-09-21T06:21:09.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.918+0000 7f960cc62640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9608102a60 0x7f960819b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:09.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.918+0000 7f960cc62640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9608102a60 0x7f960819b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34208/0 (socket says 172.21.15.175:34208) 2024-09-21T06:21:09.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.918+0000 7f960cc62640 1 -- 172.21.15.175:0/725653345 learned_addr learned my addr 172.21.15.175:0/725653345 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-21T06:21:09.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.918+0000 7f95fffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96081083a0 0x7f960819b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:09.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.918+0000 7f960d463640 1 --2- 172.21.15.175:0/725653345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9608108cf0 0x7f960819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:09.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.918+0000 7f960cc62640 1 -- 172.21.15.175:0/725653345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96081083a0 msgr2=0x7f960819b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:09.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.918+0000 7f960cc62640 1 --2- 172.21.15.175:0/725653345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96081083a0 0x7f960819b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:09.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.918+0000 7f960cc62640 1 -- 172.21.15.175:0/725653345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9608108cf0 msgr2=0x7f960819bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:09.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.918+0000 7f960cc62640 1 --2- 172.21.15.175:0/725653345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9608108cf0 0x7f960819bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:09.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.919+0000 7f960cc62640 1 -- 172.21.15.175:0/725653345 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96081a65a0 con 0x7f9608102a60 2024-09-21T06:21:09.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.919+0000 7f95fffff640 1 --2- 172.21.15.175:0/725653345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96081083a0 0x7f960819b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:09.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.919+0000 7f960cc62640 1 --2- 172.21.15.175:0/725653345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9608102a60 0x7f960819b2e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9604005e30 tx=0x7f9604031840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:09.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.919+0000 7f95fdffb640 1 -- 172.21.15.175:0/725653345 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9604003b70 con 0x7f9608102a60 2024-09-21T06:21:09.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.919+0000 7f95fdffb640 1 -- 172.21.15.175:0/725653345 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9604003d10 con 0x7f9608102a60 2024-09-21T06:21:09.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.919+0000 7f960eec6640 1 -- 172.21.15.175:0/725653345 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96081a6830 con 0x7f9608102a60 2024-09-21T06:21:09.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.919+0000 7f95fdffb640 1 -- 172.21.15.175:0/725653345 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960402fa50 con 0x7f9608102a60 2024-09-21T06:21:09.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.919+0000 7f960eec6640 1 -- 172.21.15.175:0/725653345 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96081a6dc0 con 0x7f9608102a60 2024-09-21T06:21:09.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.920+0000 7f960eec6640 1 -- 172.21.15.175:0/725653345 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9608102e70 con 0x7f9608102a60 2024-09-21T06:21:09.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.923+0000 7f95fdffb640 1 -- 172.21.15.175:0/725653345 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f960402fbf0 con 0x7f9608102a60 2024-09-21T06:21:09.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.923+0000 7f95fdffb640 1 --2- 172.21.15.175:0/725653345 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f95f00b6550 0x7f95f00b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:09.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.924+0000 7f95fdffb640 1 -- 172.21.15.175:0/725653345 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2244+0+0 (secure 0 0 0) 0x7f9604106d20 con 0x7f9608102a60 2024-09-21T06:21:09.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.924+0000 7f95fffff640 1 --2- 172.21.15.175:0/725653345 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f95f00b6550 0x7f95f00b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:09.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.924+0000 7f95fffff640 1 --2- 172.21.15.175:0/725653345 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f95f00b6550 0x7f95f00b8a60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9608107e90 tx=0x7f95f8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:09.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:09.927+0000 7f95fdffb640 1 -- 172.21.15.175:0/725653345 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f96040cee40 con 0x7f9608102a60 2024-09-21T06:21:10.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:10.120+0000 7f960eec6640 1 -- 172.21.15.175:0/725653345 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9608063800 con 0x7f95f00b6550 2024-09-21T06:21:10.424 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:10 smithi175 ceph-mon[34510]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-21T06:21:10.424 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:10 smithi175 ceph-mon[34510]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T06:21:10.424 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:10 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:21:10.424 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:10 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:21:10.424 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:10 smithi175 ceph-mon[34510]: Detected new or changed devices on smithi071 2024-09-21T06:21:10.424 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:10 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:10.424 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:10 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:10.424 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:10 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:21:10.424 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:10 smithi175 ceph-mon[34510]: Adjusting osd_memory_target on smithi071 to 17088M 2024-09-21T06:21:10.425 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:10 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:10.425 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:10 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:10.425 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:10 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:21:10.425 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:10 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:10.425 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:10 smithi175 ceph-mon[34510]: from='osd.1 ' entity='osd.1' 2024-09-21T06:21:10.425 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:10 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:21:10.425 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:10 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:21:10.425 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:10 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:10.425 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:10 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:21:10.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:10 smithi071 ceph-mon[34844]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-21T06:21:10.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:10 smithi071 ceph-mon[34844]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T06:21:10.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:10 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:21:10.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:10 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:21:10.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:10 smithi071 ceph-mon[34844]: Detected new or changed devices on smithi071 2024-09-21T06:21:10.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:10 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:10.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:10 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:10.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:10 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:21:10.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:10 smithi071 ceph-mon[34844]: Adjusting osd_memory_target on smithi071 to 17088M 2024-09-21T06:21:10.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:10 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:10.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:10 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:10.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:10 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:21:10.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:10 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:10.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:10 smithi071 ceph-mon[34844]: from='osd.1 ' entity='osd.1' 2024-09-21T06:21:10.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:10 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:21:10.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:10 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:21:10.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:10 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:10.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:10 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:21:10.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:10 smithi063 ceph-mon[31150]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-21T06:21:10.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:10 smithi063 ceph-mon[31150]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T06:21:10.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:10 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:21:10.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:10 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:21:10.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:10 smithi063 ceph-mon[31150]: Detected new or changed devices on smithi071 2024-09-21T06:21:10.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:10 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:10.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:10 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:10.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:10 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:21:10.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:10 smithi063 ceph-mon[31150]: Adjusting osd_memory_target on smithi071 to 17088M 2024-09-21T06:21:10.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:10 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:10.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:10 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:10.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:10 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:21:10.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:10 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:10.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:10 smithi063 ceph-mon[31150]: from='osd.1 ' entity='osd.1' 2024-09-21T06:21:10.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:10 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:21:10.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:10 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:21:10.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:10 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:10.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:10 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:21:11.774 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:11 smithi175 ceph-mon[34510]: purged_snaps scrub starts 2024-09-21T06:21:11.774 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:11 smithi175 ceph-mon[34510]: purged_snaps scrub ok 2024-09-21T06:21:11.774 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:11 smithi175 ceph-mon[34510]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:21:11.774 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:11 smithi175 ceph-mon[34510]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:21:11.774 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:11 smithi175 ceph-mon[34510]: osd.1 [v2:172.21.15.71:6800/1676297548,v1:172.21.15.71:6801/1676297548] boot 2024-09-21T06:21:11.774 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:11 smithi175 ceph-mon[34510]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T06:21:11.774 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:21:12.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:11 smithi071 ceph-mon[34844]: purged_snaps scrub starts 2024-09-21T06:21:12.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:11 smithi071 ceph-mon[34844]: purged_snaps scrub ok 2024-09-21T06:21:12.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:11 smithi071 ceph-mon[34844]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:21:12.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:11 smithi071 ceph-mon[34844]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:21:12.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:11 smithi071 ceph-mon[34844]: osd.1 [v2:172.21.15.71:6800/1676297548,v1:172.21.15.71:6801/1676297548] boot 2024-09-21T06:21:12.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:11 smithi071 ceph-mon[34844]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T06:21:12.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:21:12.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:11 smithi063 ceph-mon[31150]: purged_snaps scrub starts 2024-09-21T06:21:12.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:11 smithi063 ceph-mon[31150]: purged_snaps scrub ok 2024-09-21T06:21:12.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:11 smithi063 ceph-mon[31150]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:21:12.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:11 smithi063 ceph-mon[31150]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:21:12.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:11 smithi063 ceph-mon[31150]: osd.1 [v2:172.21.15.71:6800/1676297548,v1:172.21.15.71:6801/1676297548] boot 2024-09-21T06:21:12.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:11 smithi063 ceph-mon[31150]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T06:21:12.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:21:13.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:12 smithi071 ceph-mon[34844]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T06:21:13.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:12 smithi071 ceph-mon[34844]: from='client.? 172.21.15.175:0/1269295740' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "031daa9e-9d4a-4901-95e8-695db5671fb4"} : dispatch 2024-09-21T06:21:13.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:12 smithi071 ceph-mon[34844]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "031daa9e-9d4a-4901-95e8-695db5671fb4"} : dispatch 2024-09-21T06:21:13.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:12 smithi071 ceph-mon[34844]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "031daa9e-9d4a-4901-95e8-695db5671fb4"}]': finished 2024-09-21T06:21:13.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:12 smithi071 ceph-mon[34844]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T06:21:13.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:12 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:21:13.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:12 smithi063 ceph-mon[31150]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T06:21:13.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:12 smithi063 ceph-mon[31150]: from='client.? 172.21.15.175:0/1269295740' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "031daa9e-9d4a-4901-95e8-695db5671fb4"} : dispatch 2024-09-21T06:21:13.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:12 smithi063 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "031daa9e-9d4a-4901-95e8-695db5671fb4"} : dispatch 2024-09-21T06:21:13.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:12 smithi063 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "031daa9e-9d4a-4901-95e8-695db5671fb4"}]': finished 2024-09-21T06:21:13.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:12 smithi063 ceph-mon[31150]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T06:21:13.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:12 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:21:13.094 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:12 smithi175 ceph-mon[34510]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T06:21:13.094 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:12 smithi175 ceph-mon[34510]: from='client.? 172.21.15.175:0/1269295740' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "031daa9e-9d4a-4901-95e8-695db5671fb4"} : dispatch 2024-09-21T06:21:13.094 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:12 smithi175 ceph-mon[34510]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "031daa9e-9d4a-4901-95e8-695db5671fb4"} : dispatch 2024-09-21T06:21:13.094 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:12 smithi175 ceph-mon[34510]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "031daa9e-9d4a-4901-95e8-695db5671fb4"}]': finished 2024-09-21T06:21:13.094 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:12 smithi175 ceph-mon[34510]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T06:21:13.094 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:12 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:21:14.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:13 smithi071 ceph-mon[34844]: pgmap v50: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:14.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:13 smithi071 ceph-mon[34844]: from='client.? 172.21.15.175:0/2779952768' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:21:14.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:13 smithi063 ceph-mon[31150]: pgmap v50: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:14.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:13 smithi063 ceph-mon[31150]: from='client.? 172.21.15.175:0/2779952768' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:21:14.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:13 smithi175 ceph-mon[34510]: pgmap v50: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:14.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:13 smithi175 ceph-mon[34510]: from='client.? 172.21.15.175:0/2779952768' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:21:15.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:14 smithi071 ceph-mon[34844]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:15.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:14 smithi063 ceph-mon[31150]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:15.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:14 smithi175 ceph-mon[34510]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:17.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:16 smithi071 ceph-mon[34844]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:17.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:16 smithi063 ceph-mon[31150]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:17.345 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:16 smithi175 ceph-mon[34510]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:18.921 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:18 smithi175 ceph-mon[34510]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:19.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:18 smithi071 ceph-mon[34844]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:19.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:18 smithi063 ceph-mon[31150]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:21.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:20 smithi071 ceph-mon[34844]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:21.325 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:20 smithi175 ceph-mon[34510]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:21.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:20 smithi063 ceph-mon[31150]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:21.982 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:21 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T06:21:21.982 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:21 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:21.983 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:21 smithi175 ceph-mon[34510]: Deploying daemon osd.2 on smithi175 2024-09-21T06:21:22.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:21 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T06:21:22.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:21 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:22.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:21 smithi071 ceph-mon[34844]: Deploying daemon osd.2 on smithi175 2024-09-21T06:21:22.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:21 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T06:21:22.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:21 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:22.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:21 smithi063 ceph-mon[31150]: Deploying daemon osd.2 on smithi175 2024-09-21T06:21:23.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:22 smithi175 ceph-mon[34510]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:23.233 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:22 smithi063 ceph-mon[31150]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:23.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:22 smithi071 ceph-mon[34844]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:25.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:24 smithi071 ceph-mon[34844]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:25.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:24 smithi063 ceph-mon[31150]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:25.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:24 smithi175 ceph-mon[34510]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:27.088 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:26 smithi175 ceph-mon[34510]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:27.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:26 smithi071 ceph-mon[34844]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:27.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:26 smithi063 ceph-mon[31150]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:28.005 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:27 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:28.005 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:27 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:28.005 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:27 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:28.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:27 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:28.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:27 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:28.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:27 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:28.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:27 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:28.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:27 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:28.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:27 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:29.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:29 smithi175 ceph-mon[34510]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:29 smithi071 ceph-mon[34844]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:29.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:29 smithi063 ceph-mon[31150]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:30.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:30 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:30.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:30 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:30.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:30 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:30.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:30 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:21:30.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:30 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:30.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:30 smithi175 ceph-mon[34510]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:31.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:30 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:31.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:30 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:31.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:30 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:31.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:30 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:21:31.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:30 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:31.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:30 smithi071 ceph-mon[34844]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:31.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:30 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:31.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:30 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:31.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:30 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:31.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:30 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:21:31.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:30 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:31.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:30 smithi063 ceph-mon[31150]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:31.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:31.695+0000 7f95fdffb640 1 -- 172.21.15.175:0/725653345 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9608063800 con 0x7f95f00b6550 2024-09-21T06:21:31.697 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 2 on host 'smithi175' 2024-09-21T06:21:31.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:31.698+0000 7f960eec6640 1 -- 172.21.15.175:0/725653345 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f95f00b6550 msgr2=0x7f95f00b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:31.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:31.698+0000 7f960eec6640 1 --2- 172.21.15.175:0/725653345 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f95f00b6550 0x7f95f00b8a60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9608107e90 tx=0x7f95f8005f90 comp rx=0 tx=0).stop 2024-09-21T06:21:31.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:31.698+0000 7f960eec6640 1 -- 172.21.15.175:0/725653345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9608102a60 msgr2=0x7f960819b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:31.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:31.698+0000 7f960eec6640 1 --2- 172.21.15.175:0/725653345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9608102a60 0x7f960819b2e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9604005e30 tx=0x7f9604031840 comp rx=0 tx=0).stop 2024-09-21T06:21:31.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:31.698+0000 7f960eec6640 1 -- 172.21.15.175:0/725653345 shutdown_connections 2024-09-21T06:21:31.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:31.698+0000 7f960eec6640 1 --2- 172.21.15.175:0/725653345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9608108cf0 0x7f960819bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:31.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:31.698+0000 7f960eec6640 1 --2- 172.21.15.175:0/725653345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96081083a0 0x7f960819b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:31.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:31.698+0000 7f960eec6640 1 --2- 172.21.15.175:0/725653345 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f95f00b6550 0x7f95f00b8a60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:31.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:31.698+0000 7f960eec6640 1 --2- 172.21.15.175:0/725653345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9608102a60 0x7f960819b2e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:31.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:31.698+0000 7f960eec6640 1 -- 172.21.15.175:0/725653345 >> 172.21.15.175:0/725653345 conn(0x7f9608079730 msgr2=0x7f9608101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:31.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:31.698+0000 7f960eec6640 1 -- 172.21.15.175:0/725653345 shutdown_connections 2024-09-21T06:21:31.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:21:31.698+0000 7f960eec6640 1 -- 172.21.15.175:0/725653345 wait complete. 2024-09-21T06:21:32.000 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:31 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:32.000 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:31 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:32.000 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:31 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:32.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:31 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:32.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:31 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:32.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:31 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:32.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:31 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:32.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:31 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:32.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:31 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:32.327 DEBUG:teuthology.orchestra.run.smithi175:osd.2> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T06:21:32.330 INFO:tasks.cephadm:Deploying osd.3 on smithi063 with /dev/vg_nvme/lv_3... 2024-09-21T06:21:32.330 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T06:21:32.596 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:33.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:32 smithi071 ceph-mon[34844]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:33.060 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:32 smithi063 ceph-mon[31150]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:33.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:32 smithi175 ceph-mon[34510]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:33.515 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:21:33 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-2[39605]: 2024-09-21T06:21:33.160+0000 7f0a968df640 -1 osd.2 0 log_to_monitors true 2024-09-21T06:21:33.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:33 smithi175 ceph-mon[34510]: from='osd.2 [v2:172.21.15.175:6800/2356865390,v1:172.21.15.175:6801/2356865390]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:21:33.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:33 smithi175 ceph-mon[34510]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:21:34.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:33 smithi071 ceph-mon[34844]: from='osd.2 [v2:172.21.15.175:6800/2356865390,v1:172.21.15.175:6801/2356865390]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:21:34.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:33 smithi071 ceph-mon[34844]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:21:34.021 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:33 smithi063 ceph-mon[31150]: from='osd.2 [v2:172.21.15.175:6800/2356865390,v1:172.21.15.175:6801/2356865390]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:21:34.021 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:33 smithi063 ceph-mon[31150]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:21:34.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:34 smithi175 ceph-mon[34510]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T06:21:34.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:34 smithi175 ceph-mon[34510]: from='osd.2 [v2:172.21.15.175:6800/2356865390,v1:172.21.15.175:6801/2356865390]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:21:34.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:34 smithi175 ceph-mon[34510]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T06:21:34.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:34 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:21:34.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:34 smithi175 ceph-mon[34510]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:21:34.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:34 smithi175 ceph-mon[34510]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:35.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:34 smithi063 ceph-mon[31150]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T06:21:35.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:34 smithi063 ceph-mon[31150]: from='osd.2 [v2:172.21.15.175:6800/2356865390,v1:172.21.15.175:6801/2356865390]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:21:35.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:34 smithi063 ceph-mon[31150]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T06:21:35.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:34 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:21:35.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:34 smithi063 ceph-mon[31150]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:21:35.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:34 smithi063 ceph-mon[31150]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:35.133 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:21:35.161 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi063:vg_nvme/lv_3 2024-09-21T06:21:35.191 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:21:35 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-2[39605]: 2024-09-21T06:21:35.185+0000 7f0a92861640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T06:21:35.191 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:21:35 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-2[39605]: 2024-09-21T06:21:35.189+0000 7f0a8a657640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:21:35.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:34 smithi071 ceph-mon[34844]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T06:21:35.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:34 smithi071 ceph-mon[34844]: from='osd.2 [v2:172.21.15.175:6800/2356865390,v1:172.21.15.175:6801/2356865390]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:21:35.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:34 smithi071 ceph-mon[34844]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T06:21:35.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:34 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:21:35.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:34 smithi071 ceph-mon[34844]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:21:35.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:34 smithi071 ceph-mon[34844]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:35.428 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:35.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:35 smithi063 ceph-mon[31150]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T06:21:35.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:35 smithi063 ceph-mon[31150]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T06:21:35.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:35 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:21:35.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:35 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:21:35.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:35 smithi063 ceph-mon[31150]: from='osd.2 ' entity='osd.2' 2024-09-21T06:21:35.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:35 smithi063 ceph-mon[31150]: Detected new or changed devices on smithi175 2024-09-21T06:21:35.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:35 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:35.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:35 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:35.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:35 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:21:35.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:35 smithi063 ceph-mon[31150]: Adjusting osd_memory_target on smithi175 to 17088M 2024-09-21T06:21:35.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:35 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:35.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:35 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:35.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:35 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:21:35.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:35 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:35.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.862+0000 7fb0535cc640 1 -- 172.21.15.63:0/4218062376 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb04c108d20 msgr2=0x7fb04c10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:35.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.862+0000 7fb0535cc640 1 --2- 172.21.15.63:0/4218062376 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb04c108d20 0x7fb04c10f550 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb044009ca0 tx=0x7fb04402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:21:35.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.862+0000 7fb0535cc640 1 -- 172.21.15.63:0/4218062376 shutdown_connections 2024-09-21T06:21:35.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.862+0000 7fb0535cc640 1 --2- 172.21.15.63:0/4218062376 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb04c108d20 0x7fb04c10f550 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:35.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.862+0000 7fb0535cc640 1 --2- 172.21.15.63:0/4218062376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb04c1083d0 0x7fb04c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:35.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.862+0000 7fb0535cc640 1 --2- 172.21.15.63:0/4218062376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb04c102ae0 0x7fb04c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.862+0000 7fb0535cc640 1 -- 172.21.15.63:0/4218062376 >> 172.21.15.63:0/4218062376 conn(0x7fb04c079760 msgr2=0x7fb04c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.862+0000 7fb0535cc640 1 -- 172.21.15.63:0/4218062376 shutdown_connections 2024-09-21T06:21:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.862+0000 7fb0535cc640 1 -- 172.21.15.63:0/4218062376 wait complete. 2024-09-21T06:21:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.863+0000 7fb0535cc640 1 Processor -- start 2024-09-21T06:21:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.863+0000 7fb0535cc640 1 -- start start 2024-09-21T06:21:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.863+0000 7fb0535cc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb04c102ae0 0x7fb04c0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.863+0000 7fb0535cc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb04c1083d0 0x7fb04c0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.863+0000 7fb0535cc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb04c108d20 0x7fb04c1000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.863+0000 7fb0535cc640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c112990 con 0x7fb04c1083d0 2024-09-21T06:21:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.863+0000 7fb0535cc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c112810 con 0x7fb04c102ae0 2024-09-21T06:21:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.863+0000 7fb0535cc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c112b10 con 0x7fb04c108d20 2024-09-21T06:21:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.863+0000 7fb050b67640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb04c1083d0 0x7fb04c0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.863+0000 7fb050b67640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb04c1083d0 0x7fb04c0ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45006/0 (socket says 172.21.15.63:45006) 2024-09-21T06:21:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.863+0000 7fb050b67640 1 -- 172.21.15.63:0/1652391593 learned_addr learned my addr 172.21.15.63:0/1652391593 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:21:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.863+0000 7fb051368640 1 --2- 172.21.15.63:0/1652391593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb04c102ae0 0x7fb04c0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.863+0000 7fb051b69640 1 --2- 172.21.15.63:0/1652391593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb04c108d20 0x7fb04c1000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.864+0000 7fb050b67640 1 -- 172.21.15.63:0/1652391593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb04c108d20 msgr2=0x7fb04c1000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.864+0000 7fb050b67640 1 --2- 172.21.15.63:0/1652391593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb04c108d20 0x7fb04c1000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.864+0000 7fb050b67640 1 -- 172.21.15.63:0/1652391593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb04c102ae0 msgr2=0x7fb04c0ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.864+0000 7fb050b67640 1 --2- 172.21.15.63:0/1652391593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb04c102ae0 0x7fb04c0ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.864+0000 7fb050b67640 1 -- 172.21.15.63:0/1652391593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb04c1a86f0 con 0x7fb04c1083d0 2024-09-21T06:21:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.864+0000 7fb051b69640 1 --2- 172.21.15.63:0/1652391593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb04c108d20 0x7fb04c1000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:21:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.864+0000 7fb050b67640 1 --2- 172.21.15.63:0/1652391593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb04c1083d0 0x7fb04c0ffbb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00e9c0 tx=0x7fb03c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.864+0000 7fb0427fc640 1 -- 172.21.15.63:0/1652391593 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c00cd80 con 0x7fb04c1083d0 2024-09-21T06:21:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.864+0000 7fb0427fc640 1 -- 172.21.15.63:0/1652391593 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb03c0054d0 con 0x7fb04c1083d0 2024-09-21T06:21:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.864+0000 7fb0535cc640 1 -- 172.21.15.63:0/1652391593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb04c1a89e0 con 0x7fb04c1083d0 2024-09-21T06:21:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.864+0000 7fb0427fc640 1 -- 172.21.15.63:0/1652391593 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c010430 con 0x7fb04c1083d0 2024-09-21T06:21:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.864+0000 7fb0535cc640 1 -- 172.21.15.63:0/1652391593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb04c1a8f70 con 0x7fb04c1083d0 2024-09-21T06:21:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.865+0000 7fb0535cc640 1 -- 172.21.15.63:0/1652391593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb04c103d10 con 0x7fb04c1083d0 2024-09-21T06:21:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.866+0000 7fb0427fc640 1 -- 172.21.15.63:0/1652391593 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fb03c004fb0 con 0x7fb04c1083d0 2024-09-21T06:21:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.867+0000 7fb0427fc640 1 --2- 172.21.15.63:0/1652391593 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb0380b6550 0x7fb0380b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.867+0000 7fb051368640 1 --2- 172.21.15.63:0/1652391593 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb0380b6550 0x7fb0380b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.867+0000 7fb0427fc640 1 -- 172.21.15.63:0/1652391593 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2786+0+0 (secure 0 0 0) 0x7fb03c0e6150 con 0x7fb04c1083d0 2024-09-21T06:21:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.868+0000 7fb051368640 1 --2- 172.21.15.63:0/1652391593 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb0380b6550 0x7fb0380b8a60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb04c1010c0 tx=0x7fb048005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:35.872+0000 7fb0427fc640 1 -- 172.21.15.63:0/1652391593 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb03c0ae050 con 0x7fb04c1083d0 2024-09-21T06:21:36.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:36.071+0000 7fb0535cc640 1 -- 172.21.15.63:0/1652391593 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb04c063800 con 0x7fb0380b6550 2024-09-21T06:21:36.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:35 smithi175 ceph-mon[34510]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T06:21:36.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:35 smithi175 ceph-mon[34510]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T06:21:36.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:35 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:21:36.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:35 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:21:36.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:35 smithi175 ceph-mon[34510]: from='osd.2 ' entity='osd.2' 2024-09-21T06:21:36.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:35 smithi175 ceph-mon[34510]: Detected new or changed devices on smithi175 2024-09-21T06:21:36.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:35 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:36.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:35 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:36.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:35 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:21:36.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:35 smithi175 ceph-mon[34510]: Adjusting osd_memory_target on smithi175 to 17088M 2024-09-21T06:21:36.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:35 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:36.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:35 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:36.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:35 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:21:36.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:35 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:36.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:35 smithi071 ceph-mon[34844]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T06:21:36.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:35 smithi071 ceph-mon[34844]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T06:21:36.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:35 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:21:36.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:35 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:21:36.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:35 smithi071 ceph-mon[34844]: from='osd.2 ' entity='osd.2' 2024-09-21T06:21:36.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:35 smithi071 ceph-mon[34844]: Detected new or changed devices on smithi175 2024-09-21T06:21:36.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:35 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:36.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:35 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:36.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:35 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:21:36.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:35 smithi071 ceph-mon[34844]: Adjusting osd_memory_target on smithi175 to 17088M 2024-09-21T06:21:36.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:35 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:36.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:35 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:36.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:35 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:21:36.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:35 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:37.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:36 smithi063 ceph-mon[31150]: purged_snaps scrub starts 2024-09-21T06:21:37.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:36 smithi063 ceph-mon[31150]: purged_snaps scrub ok 2024-09-21T06:21:37.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:21:37.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:36 smithi063 ceph-mon[31150]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:37.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:36 smithi063 ceph-mon[31150]: from='client.14496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:21:37.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:21:37.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:21:37.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:37.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:36 smithi063 ceph-mon[31150]: osd.2 [v2:172.21.15.175:6800/2356865390,v1:172.21.15.175:6801/2356865390] boot 2024-09-21T06:21:37.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:36 smithi063 ceph-mon[31150]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T06:21:37.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:21:37.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:21:37.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:36 smithi175 ceph-mon[34510]: purged_snaps scrub starts 2024-09-21T06:21:37.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:36 smithi175 ceph-mon[34510]: purged_snaps scrub ok 2024-09-21T06:21:37.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:21:37.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:36 smithi175 ceph-mon[34510]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:37.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:36 smithi175 ceph-mon[34510]: from='client.14496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:21:37.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:21:37.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:21:37.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:37.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:36 smithi175 ceph-mon[34510]: osd.2 [v2:172.21.15.175:6800/2356865390,v1:172.21.15.175:6801/2356865390] boot 2024-09-21T06:21:37.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:36 smithi175 ceph-mon[34510]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T06:21:37.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:21:37.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:21:37.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:36 smithi071 ceph-mon[34844]: purged_snaps scrub starts 2024-09-21T06:21:37.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:36 smithi071 ceph-mon[34844]: purged_snaps scrub ok 2024-09-21T06:21:37.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:21:37.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:36 smithi071 ceph-mon[34844]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:21:37.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:36 smithi071 ceph-mon[34844]: from='client.14496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:21:37.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:21:37.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:21:37.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:37.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:36 smithi071 ceph-mon[34844]: osd.2 [v2:172.21.15.175:6800/2356865390,v1:172.21.15.175:6801/2356865390] boot 2024-09-21T06:21:37.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:36 smithi071 ceph-mon[34844]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T06:21:37.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:21:37.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:21:38.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T06:21:38.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:38 smithi063 ceph-mon[31150]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T06:21:38.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:21:38.333 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:21:38 smithi063 sudo[51945]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:21:38.333 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:21:38 smithi063 sudo[51945]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:21:38.333 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:21:38 smithi063 sudo[51945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:21:38.333 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:21:38 smithi063 sudo[51945]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:21:38.333 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:21:38 smithi063 sudo[51952]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:21:38.333 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:21:38 smithi063 sudo[51952]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:21:38.334 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:21:38 smithi063 sudo[51952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:21:38.334 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:21:38 smithi063 sudo[51952]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:21:38.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T06:21:38.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:38 smithi071 ceph-mon[34844]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T06:21:38.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:21:38.519 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:21:38 smithi071 sudo[43534]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:21:38.519 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:21:38 smithi071 sudo[43534]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:21:38.519 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:21:38 smithi071 sudo[43534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:21:38.519 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:21:38 smithi071 sudo[43534]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:21:38.519 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:21:38 smithi071 sudo[43537]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:21:38.519 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:21:38 smithi071 sudo[43537]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:21:38.519 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:21:38 smithi071 sudo[43537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:21:38.519 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:21:38 smithi071 sudo[43537]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:21:38.520 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T06:21:38.521 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:38 smithi175 ceph-mon[34510]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T06:21:38.521 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:21:38.521 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:21:38 smithi175 sudo[43236]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:21:38.521 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:21:38 smithi175 sudo[43236]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:21:38.521 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:21:38 smithi175 sudo[43236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:21:38.521 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:21:38 smithi175 sudo[43236]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:21:38.521 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:21:38 smithi175 sudo[43239]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:21:38.522 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:21:38 smithi175 sudo[43239]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:21:38.522 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:21:38 smithi175 sudo[43239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:21:38.522 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:21:38 smithi175 sudo[43239]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:21:38.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:38 smithi063 sudo[51975]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:21:38.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:38 smithi063 sudo[51975]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:21:38.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:38 smithi063 sudo[51975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:21:38.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:38 smithi063 sudo[51975]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:21:38.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:38 smithi063 sudo[51978]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:21:38.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:38 smithi063 sudo[51978]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:21:38.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:38 smithi063 sudo[51978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:21:38.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:38 smithi063 sudo[51978]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:21:38.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:38 smithi175 sudo[43242]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:21:38.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:38 smithi175 sudo[43242]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:21:38.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:38 smithi175 sudo[43242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:21:38.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:38 smithi175 sudo[43242]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:21:38.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:38 smithi175 sudo[43245]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:21:38.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:38 smithi175 sudo[43245]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:21:38.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:38 smithi175 sudo[43245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:21:38.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:38 smithi175 sudo[43245]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:21:39.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:38 smithi071 sudo[43540]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:21:39.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:38 smithi071 sudo[43540]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:21:39.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:38 smithi071 sudo[43540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:21:39.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:38 smithi071 sudo[43540]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:21:39.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:38 smithi071 sudo[43543]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:21:39.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:38 smithi071 sudo[43543]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:21:39.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:38 smithi071 sudo[43543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:21:39.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:38 smithi071 sudo[43543]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:21:39.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: pgmap v68: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:39.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:21:39.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T06:21:39.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:39.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:39.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:39.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:21:39.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:21:39.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:21:39.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:21:39.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:21:39.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:21:39.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:21:39.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:21:39.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:21:39.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:21:39.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:21:39.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:21:39.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:21:39.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:21:39.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:21:39.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/854863779' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75d23a7a-c560-4b26-84a4-74d6772a37ce"} : dispatch 2024-09-21T06:21:39.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/854863779' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75d23a7a-c560-4b26-84a4-74d6772a37ce"}]': finished 2024-09-21T06:21:39.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T06:21:39.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:39 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:21:39.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: pgmap v68: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:39.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:21:39.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T06:21:39.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:39.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:39.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:39.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:21:39.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:21:39.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:21:39.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:21:39.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:21:39.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:21:39.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:21:39.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:21:39.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:21:39.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:21:39.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:21:39.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:21:39.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:21:39.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:21:39.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:21:39.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/854863779' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75d23a7a-c560-4b26-84a4-74d6772a37ce"} : dispatch 2024-09-21T06:21:39.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/854863779' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75d23a7a-c560-4b26-84a4-74d6772a37ce"}]': finished 2024-09-21T06:21:39.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T06:21:39.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:39 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:21:39.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: pgmap v68: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:39.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:21:39.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T06:21:39.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:39.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:39.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:39.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:21:39.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:21:39.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:21:39.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:21:39.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:21:39.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:21:39.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:21:39.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:21:39.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:21:39.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:21:39.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:21:39.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:21:39.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:21:39.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:21:39.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:21:39.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/854863779' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75d23a7a-c560-4b26-84a4-74d6772a37ce"} : dispatch 2024-09-21T06:21:39.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/854863779' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75d23a7a-c560-4b26-84a4-74d6772a37ce"}]': finished 2024-09-21T06:21:39.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T06:21:39.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:39 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:21:40.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:40.212+0000 7fb0427fc640 1 -- 172.21.15.63:0/1652391593 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fb03c0a9bc0 con 0x7fb04c1083d0 2024-09-21T06:21:40.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:40 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/575436125' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:21:40.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:40 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/575436125' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:21:40.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:40 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/575436125' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:21:41.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:41 smithi071 ceph-mon[34844]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:41.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:41 smithi071 ceph-mon[34844]: mgrmap e21: x(active, since 2m), standbys: z, y 2024-09-21T06:21:41.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:41 smithi063 ceph-mon[31150]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:41.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:41 smithi063 ceph-mon[31150]: mgrmap e21: x(active, since 2m), standbys: z, y 2024-09-21T06:21:41.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:41 smithi175 ceph-mon[34510]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:41.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:41 smithi175 ceph-mon[34510]: mgrmap e21: x(active, since 2m), standbys: z, y 2024-09-21T06:21:43.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:43 smithi071 ceph-mon[34844]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:43.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:43 smithi063 ceph-mon[31150]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:43.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:43 smithi175 ceph-mon[34510]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:45.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:45 smithi063 ceph-mon[31150]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:45.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:45 smithi071 ceph-mon[34844]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:45.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:45 smithi175 ceph-mon[34510]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:47.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:47 smithi071 ceph-mon[34844]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:47.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:47 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T06:21:47.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:47 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:47.540 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:47 smithi063 ceph-mon[31150]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:47.541 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:47 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T06:21:47.541 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:47 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:47.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:47 smithi175 ceph-mon[34510]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:47.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:47 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T06:21:47.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:47 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:48.463 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:48 smithi063 ceph-mon[31150]: Deploying daemon osd.3 on smithi063 2024-09-21T06:21:48.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:48 smithi071 ceph-mon[34844]: Deploying daemon osd.3 on smithi063 2024-09-21T06:21:48.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:48 smithi175 ceph-mon[34510]: Deploying daemon osd.3 on smithi063 2024-09-21T06:21:49.500 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:49 smithi175 ceph-mon[34510]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:49.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:49 smithi071 ceph-mon[34844]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:49.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:49 smithi063 ceph-mon[31150]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:51.493 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:51 smithi063 ceph-mon[31150]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:51.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:51 smithi071 ceph-mon[34844]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:51.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:51 smithi175 ceph-mon[34510]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:53.411 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:53 smithi063 ceph-mon[31150]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:53.411 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:53.411 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:53.411 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:53 smithi071 ceph-mon[34844]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:53.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:53 smithi175 ceph-mon[34510]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:53.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:53.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:53.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:55.460 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:55 smithi063 ceph-mon[31150]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:55.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:55 smithi071 ceph-mon[34844]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:55.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:55 smithi175 ceph-mon[34510]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:56.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:56.371+0000 7fb0427fc640 1 -- 172.21.15.63:0/1652391593 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb04c063800 con 0x7fb0380b6550 2024-09-21T06:21:56.373 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 3 on host 'smithi063' 2024-09-21T06:21:56.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:56.373+0000 7fb0535cc640 1 -- 172.21.15.63:0/1652391593 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb0380b6550 msgr2=0x7fb0380b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:56.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:56.373+0000 7fb0535cc640 1 --2- 172.21.15.63:0/1652391593 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb0380b6550 0x7fb0380b8a60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb04c1010c0 tx=0x7fb048005f90 comp rx=0 tx=0).stop 2024-09-21T06:21:56.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:56.373+0000 7fb0535cc640 1 -- 172.21.15.63:0/1652391593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb04c1083d0 msgr2=0x7fb04c0ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:56.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:56.373+0000 7fb0535cc640 1 --2- 172.21.15.63:0/1652391593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb04c1083d0 0x7fb04c0ffbb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00e9c0 tx=0x7fb03c00ee80 comp rx=0 tx=0).stop 2024-09-21T06:21:56.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:56.373+0000 7fb0535cc640 1 -- 172.21.15.63:0/1652391593 shutdown_connections 2024-09-21T06:21:56.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:56.373+0000 7fb0535cc640 1 --2- 172.21.15.63:0/1652391593 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb0380b6550 0x7fb0380b8a60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:56.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:56.373+0000 7fb0535cc640 1 --2- 172.21.15.63:0/1652391593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb04c108d20 0x7fb04c1000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:56.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:56.373+0000 7fb0535cc640 1 --2- 172.21.15.63:0/1652391593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb04c1083d0 0x7fb04c0ffbb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:56.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:56.373+0000 7fb0535cc640 1 --2- 172.21.15.63:0/1652391593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb04c102ae0 0x7fb04c0ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:56.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:56.373+0000 7fb0535cc640 1 -- 172.21.15.63:0/1652391593 >> 172.21.15.63:0/1652391593 conn(0x7fb04c079760 msgr2=0x7fb04c101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:56.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:56.374+0000 7fb0535cc640 1 -- 172.21.15.63:0/1652391593 shutdown_connections 2024-09-21T06:21:56.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:21:56.374+0000 7fb0535cc640 1 -- 172.21.15.63:0/1652391593 wait complete. 2024-09-21T06:21:56.988 DEBUG:teuthology.orchestra.run.smithi063:osd.3> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T06:21:56.991 INFO:tasks.cephadm:Deploying osd.4 on smithi071 with /dev/vg_nvme/lv_3... 2024-09-21T06:21:56.991 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T06:21:57.242 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:21:57.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:57 smithi063 ceph-mon[31150]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:57.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:57 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:57.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:57 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:57.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:57 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:57.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:57 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:57.624 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:57 smithi071 ceph-mon[34844]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:57.624 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:57 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:57.624 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:57 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:57.624 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:57 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:57.624 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:57 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:57.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:57 smithi175 ceph-mon[34510]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:57.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:57 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:57.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:57 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:57.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:57 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:57.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:57 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:21:59.376 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:21:59 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-3[53936]: 2024-09-21T06:21:59.082+0000 7f9fb5455640 -1 osd.3 0 log_to_monitors true 2024-09-21T06:21:59.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:59 smithi071 ceph-mon[34844]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:59.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:21:59 smithi071 ceph-mon[34844]: from='osd.3 [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T06:21:59.797 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:21:59.821 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi071:vg_nvme/lv_3 2024-09-21T06:21:59.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:59 smithi063 ceph-mon[31150]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:59.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:21:59 smithi063 ceph-mon[31150]: from='osd.3 [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T06:21:59.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:59 smithi175 ceph-mon[34510]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:21:59.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:21:59 smithi175 ceph-mon[34510]: from='osd.3 [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T06:22:00.066 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:22:00.497 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:00 smithi071 ceph-mon[34844]: from='osd.3 [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T06:22:00.498 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:00 smithi071 ceph-mon[34844]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T06:22:00.498 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:00 smithi071 ceph-mon[34844]: from='osd.3 [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi063", "root=default"]} : dispatch 2024-09-21T06:22:00.498 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:00 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:22:00.498 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:00 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:00.498 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:00 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:00.498 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:00 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:22:00.498 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:00 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:22:00.498 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:00 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:00.498 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:00 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:00.498 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:00 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:00.498 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:00 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:00.498 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:00 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:00.499 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:00 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:00.499 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:00 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:00.499 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:00 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:00.499 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:00 smithi071 ceph-mon[34844]: from='osd.3 [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-21T06:22:00.499 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:00 smithi071 ceph-mon[34844]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T06:22:00.499 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:00 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:22:00.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.587+0000 7fe238d5d640 1 -- 172.21.15.71:0/3536488046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe234108d70 msgr2=0x7fe23410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:00.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.587+0000 7fe238d5d640 1 --2- 172.21.15.71:0/3536488046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe234108d70 0x7fe23410f5a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe22c009ca0 tx=0x7fe22c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:22:00.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.587+0000 7fe238d5d640 1 -- 172.21.15.71:0/3536488046 shutdown_connections 2024-09-21T06:22:00.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.587+0000 7fe238d5d640 1 --2- 172.21.15.71:0/3536488046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe234108d70 0x7fe23410f5a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:00.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.587+0000 7fe238d5d640 1 --2- 172.21.15.71:0/3536488046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe234108420 0x7fe234108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:00.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.587+0000 7fe238d5d640 1 --2- 172.21.15.71:0/3536488046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe234102ae0 0x7fe234102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:00.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.587+0000 7fe238d5d640 1 -- 172.21.15.71:0/3536488046 >> 172.21.15.71:0/3536488046 conn(0x7fe234079770 msgr2=0x7fe234079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:00.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.587+0000 7fe238d5d640 1 -- 172.21.15.71:0/3536488046 shutdown_connections 2024-09-21T06:22:00.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.587+0000 7fe238d5d640 1 -- 172.21.15.71:0/3536488046 wait complete. 2024-09-21T06:22:00.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.588+0000 7fe238d5d640 1 Processor -- start 2024-09-21T06:22:00.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.588+0000 7fe238d5d640 1 -- start start 2024-09-21T06:22:00.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.588+0000 7fe238d5d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe234102ae0 0x7fe23419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:00.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.588+0000 7fe238d5d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe234108420 0x7fe23419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:00.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.588+0000 7fe238d5d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe234108d70 0x7fe23419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:00.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.588+0000 7fe238d5d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe234112a30 con 0x7fe234108420 2024-09-21T06:22:00.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.588+0000 7fe238d5d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe2341128b0 con 0x7fe234108d70 2024-09-21T06:22:00.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.588+0000 7fe238d5d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe234112bb0 con 0x7fe234102ae0 2024-09-21T06:22:00.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.588+0000 7fe232d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe234108d70 0x7fe23419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:00.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.589+0000 7fe22bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe234108420 0x7fe23419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:00.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.589+0000 7fe232d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe234108d70 0x7fe23419fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40276/0 (socket says 172.21.15.71:40276) 2024-09-21T06:22:00.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.589+0000 7fe232d9d640 1 -- 172.21.15.71:0/2367887759 learned_addr learned my addr 172.21.15.71:0/2367887759 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-21T06:22:00.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.589+0000 7fe23259c640 1 --2- 172.21.15.71:0/2367887759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe234102ae0 0x7fe23419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:00.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.589+0000 7fe22bfff640 1 -- 172.21.15.71:0/2367887759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe234102ae0 msgr2=0x7fe23419a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:00.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.589+0000 7fe22bfff640 1 --2- 172.21.15.71:0/2367887759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe234102ae0 0x7fe23419a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:00.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.589+0000 7fe22bfff640 1 -- 172.21.15.71:0/2367887759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe234108d70 msgr2=0x7fe23419fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:00.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.589+0000 7fe22bfff640 1 --2- 172.21.15.71:0/2367887759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe234108d70 0x7fe23419fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:00.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.589+0000 7fe22bfff640 1 -- 172.21.15.71:0/2367887759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2341a0420 con 0x7fe234108420 2024-09-21T06:22:00.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.589+0000 7fe232d9d640 1 --2- 172.21.15.71:0/2367887759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe234108d70 0x7fe23419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:22:00.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.589+0000 7fe23259c640 1 --2- 172.21.15.71:0/2367887759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe234102ae0 0x7fe23419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:22:00.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.589+0000 7fe22bfff640 1 --2- 172.21.15.71:0/2367887759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe234108420 0x7fe23419aa50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe23406b9c0 tx=0x7fe21c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:00.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.589+0000 7fe22b7fe640 1 -- 172.21.15.71:0/2367887759 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c00cc40 con 0x7fe234108420 2024-09-21T06:22:00.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.589+0000 7fe238d5d640 1 -- 172.21.15.71:0/2367887759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2341a0710 con 0x7fe234108420 2024-09-21T06:22:00.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.589+0000 7fe22b7fe640 1 -- 172.21.15.71:0/2367887759 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe21c00cde0 con 0x7fe234108420 2024-09-21T06:22:00.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.589+0000 7fe22b7fe640 1 -- 172.21.15.71:0/2367887759 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c004a00 con 0x7fe234108420 2024-09-21T06:22:00.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.589+0000 7fe238d5d640 1 -- 172.21.15.71:0/2367887759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2341a6e70 con 0x7fe234108420 2024-09-21T06:22:00.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.590+0000 7fe238d5d640 1 -- 172.21.15.71:0/2367887759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe234103d60 con 0x7fe234108420 2024-09-21T06:22:00.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.592+0000 7fe22b7fe640 1 -- 172.21.15.71:0/2367887759 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fe21c004ba0 con 0x7fe234108420 2024-09-21T06:22:00.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.593+0000 7fe22b7fe640 1 --2- 172.21.15.71:0/2367887759 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe2200b6560 0x7fe2200b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:00.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.593+0000 7fe22b7fe640 1 -- 172.21.15.71:0/2367887759 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3604+0+0 (secure 0 0 0) 0x7fe21c0e61e0 con 0x7fe234108420 2024-09-21T06:22:00.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.593+0000 7fe23259c640 1 --2- 172.21.15.71:0/2367887759 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe2200b6560 0x7fe2200b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:00.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.594+0000 7fe23259c640 1 --2- 172.21.15.71:0/2367887759 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe2200b6560 0x7fe2200b8a70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe224005d00 tx=0x7fe224005c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:00.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.597+0000 7fe22b7fe640 1 -- 172.21.15.71:0/2367887759 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe21c0adcc0 con 0x7fe234108420 2024-09-21T06:22:00.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:00 smithi175 ceph-mon[34510]: from='osd.3 [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T06:22:00.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:00 smithi175 ceph-mon[34510]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T06:22:00.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:00 smithi175 ceph-mon[34510]: from='osd.3 [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi063", "root=default"]} : dispatch 2024-09-21T06:22:00.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:00 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:22:00.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:00 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:00.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:00 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:00 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:22:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:00 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:22:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:00 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:00 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:00 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:00 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:00 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:00 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:00 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:00 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:00 smithi175 ceph-mon[34510]: from='osd.3 [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-21T06:22:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:00 smithi175 ceph-mon[34510]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T06:22:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:00 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:22:00.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:00.781+0000 7fe238d5d640 1 -- 172.21.15.71:0/2367887759 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe234101c70 con 0x7fe2200b6560 2024-09-21T06:22:00.805 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-mon[31150]: from='osd.3 [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T06:22:00.805 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-mon[31150]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T06:22:00.806 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-mon[31150]: from='osd.3 [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi063", "root=default"]} : dispatch 2024-09-21T06:22:00.806 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:22:00.806 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:00.806 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:00.806 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:22:00.806 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:22:00.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:00.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:00.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:00.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:00.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:00.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:00.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:00.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:00.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-mon[31150]: from='osd.3 [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-21T06:22:00.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-mon[31150]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T06:22:00.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:22:01.082 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-3[53936]: 2024-09-21T06:22:00.802+0000 7f9fb1bec640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T06:22:01.082 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:22:00 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-3[53936]: 2024-09-21T06:22:00.809+0000 7f9fa91cd640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:22:01.459 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:01 smithi071 ceph-mon[34844]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:22:01.459 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:01 smithi071 ceph-mon[34844]: Detected new or changed devices on smithi063 2024-09-21T06:22:01.459 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:01 smithi071 ceph-mon[34844]: Adjusting osd_memory_target on smithi063 to 8544M 2024-09-21T06:22:01.459 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:01 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:22:01.459 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:01 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:22:01.459 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:01 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:22:01.460 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:01 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:01.460 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:01 smithi071 ceph-mon[34844]: from='osd.3 [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339]' entity='osd.3' 2024-09-21T06:22:01.460 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:01 smithi071 ceph-mon[34844]: osd.3 [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339] boot 2024-09-21T06:22:01.460 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:01 smithi071 ceph-mon[34844]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T06:22:01.460 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:01 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:22:01.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:01 smithi063 ceph-mon[31150]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:22:01.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:01 smithi063 ceph-mon[31150]: Detected new or changed devices on smithi063 2024-09-21T06:22:01.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:01 smithi063 ceph-mon[31150]: Adjusting osd_memory_target on smithi063 to 8544M 2024-09-21T06:22:01.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:01 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:22:01.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:01 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:22:01.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:01 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:22:01.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:01 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:01.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:01 smithi063 ceph-mon[31150]: from='osd.3 [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339]' entity='osd.3' 2024-09-21T06:22:01.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:01 smithi063 ceph-mon[31150]: osd.3 [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339] boot 2024-09-21T06:22:01.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:01 smithi063 ceph-mon[31150]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T06:22:01.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:01 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:22:01.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:01 smithi175 ceph-mon[34510]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:22:01.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:01 smithi175 ceph-mon[34510]: Detected new or changed devices on smithi063 2024-09-21T06:22:01.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:01 smithi175 ceph-mon[34510]: Adjusting osd_memory_target on smithi063 to 8544M 2024-09-21T06:22:01.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:01 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:22:01.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:01 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:22:01.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:01 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:22:01.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:01 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:01.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:01 smithi175 ceph-mon[34510]: from='osd.3 [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339]' entity='osd.3' 2024-09-21T06:22:01.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:01 smithi175 ceph-mon[34510]: osd.3 [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339] boot 2024-09-21T06:22:01.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:01 smithi175 ceph-mon[34510]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T06:22:01.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:01 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:22:02.486 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:02 smithi071 ceph-mon[34844]: purged_snaps scrub starts 2024-09-21T06:22:02.486 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:02 smithi071 ceph-mon[34844]: purged_snaps scrub ok 2024-09-21T06:22:02.486 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:02 smithi071 ceph-mon[34844]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:22:02.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:02 smithi063 ceph-mon[31150]: purged_snaps scrub starts 2024-09-21T06:22:02.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:02 smithi063 ceph-mon[31150]: purged_snaps scrub ok 2024-09-21T06:22:02.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:02 smithi063 ceph-mon[31150]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:22:02.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:02 smithi175 ceph-mon[34510]: purged_snaps scrub starts 2024-09-21T06:22:02.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:02 smithi175 ceph-mon[34510]: purged_snaps scrub ok 2024-09-21T06:22:02.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:02 smithi175 ceph-mon[34510]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:22:03.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:03 smithi071 ceph-mon[34844]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:03.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:03 smithi071 ceph-mon[34844]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T06:22:03.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:03 smithi071 ceph-mon[34844]: from='client.? 172.21.15.71:0/2282984930' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6aaefd09-93dd-4f21-9b3c-701a7ff97f61"} : dispatch 2024-09-21T06:22:03.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:03 smithi071 ceph-mon[34844]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6aaefd09-93dd-4f21-9b3c-701a7ff97f61"} : dispatch 2024-09-21T06:22:03.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:03 smithi071 ceph-mon[34844]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6aaefd09-93dd-4f21-9b3c-701a7ff97f61"}]': finished 2024-09-21T06:22:03.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:03 smithi071 ceph-mon[34844]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T06:22:03.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:03 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:22:03.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:03 smithi063 ceph-mon[31150]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:03.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:03 smithi063 ceph-mon[31150]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T06:22:03.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:03 smithi063 ceph-mon[31150]: from='client.? 172.21.15.71:0/2282984930' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6aaefd09-93dd-4f21-9b3c-701a7ff97f61"} : dispatch 2024-09-21T06:22:03.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:03 smithi063 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6aaefd09-93dd-4f21-9b3c-701a7ff97f61"} : dispatch 2024-09-21T06:22:03.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:03 smithi063 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6aaefd09-93dd-4f21-9b3c-701a7ff97f61"}]': finished 2024-09-21T06:22:03.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:03 smithi063 ceph-mon[31150]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T06:22:03.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:03 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:22:03.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:03 smithi175 ceph-mon[34510]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:03.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:03 smithi175 ceph-mon[34510]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T06:22:03.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:03 smithi175 ceph-mon[34510]: from='client.? 172.21.15.71:0/2282984930' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6aaefd09-93dd-4f21-9b3c-701a7ff97f61"} : dispatch 2024-09-21T06:22:03.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:03 smithi175 ceph-mon[34510]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6aaefd09-93dd-4f21-9b3c-701a7ff97f61"} : dispatch 2024-09-21T06:22:03.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:03 smithi175 ceph-mon[34510]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6aaefd09-93dd-4f21-9b3c-701a7ff97f61"}]': finished 2024-09-21T06:22:03.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:03 smithi175 ceph-mon[34510]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T06:22:03.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:03 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:22:04.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:04 smithi063 ceph-mon[31150]: from='client.? 172.21.15.71:0/857249476' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:22:04.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:04 smithi071 ceph-mon[34844]: from='client.? 172.21.15.71:0/857249476' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:22:04.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:04 smithi175 ceph-mon[34510]: from='client.? 172.21.15.71:0/857249476' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:22:05.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:05 smithi071 ceph-mon[34844]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:05.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:05 smithi063 ceph-mon[31150]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:05.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:05 smithi175 ceph-mon[34510]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:07.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:07 smithi071 ceph-mon[34844]: pgmap v89: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:07.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:07 smithi063 ceph-mon[31150]: pgmap v89: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:07.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:07 smithi175 ceph-mon[34510]: pgmap v89: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:09.725 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:09 smithi071 ceph-mon[34844]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-21T06:22:09.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:09 smithi063 ceph-mon[31150]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-21T06:22:09.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:09 smithi175 ceph-mon[34510]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-21T06:22:11.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:11 smithi071 ceph-mon[34844]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:22:11.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:11 smithi063 ceph-mon[31150]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:22:11.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:11 smithi175 ceph-mon[34510]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:22:12.607 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:12 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T06:22:12.607 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:12 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:12.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:12 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T06:22:12.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:12 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:12.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:12 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T06:22:12.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:12 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:13.589 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:13 smithi071 ceph-mon[34844]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T06:22:13.589 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:13 smithi071 ceph-mon[34844]: Deploying daemon osd.4 on smithi071 2024-09-21T06:22:13.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:13 smithi063 ceph-mon[31150]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T06:22:13.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:13 smithi063 ceph-mon[31150]: Deploying daemon osd.4 on smithi071 2024-09-21T06:22:13.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:13 smithi175 ceph-mon[34510]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T06:22:13.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:13 smithi175 ceph-mon[34510]: Deploying daemon osd.4 on smithi071 2024-09-21T06:22:15.654 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:15 smithi071 ceph-mon[34844]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T06:22:15.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:15 smithi063 ceph-mon[31150]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T06:22:15.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:15 smithi175 ceph-mon[34510]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T06:22:17.677 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:17 smithi071 ceph-mon[34844]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:22:17.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:17 smithi063 ceph-mon[31150]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:22:17.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:17 smithi175 ceph-mon[34510]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:22:18.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:18 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:18.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:18 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:18.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:18 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:18.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:18 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:18.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:18 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:18.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:18 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:18.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:18 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:18.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:18 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:18.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:18 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:19.747 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:19 smithi071 ceph-mon[34844]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:22:19.750 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:19 smithi175 ceph-mon[34510]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:22:19.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:19 smithi063 ceph-mon[31150]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:22:21.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:21 smithi071 ceph-mon[34844]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:21.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:21 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:21.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:21 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:21.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:21 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:21.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:21 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:21.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:21 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:21.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:21 smithi063 ceph-mon[31150]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:21.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:21 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:21.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:21 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:21.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:21 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:21.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:21 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:21.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:21 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:21.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:21 smithi175 ceph-mon[34510]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:21.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:21 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:21.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:21 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:21.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:21 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:21.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:21 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:21.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:21 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:22.592 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 4 on host 'smithi071' 2024-09-21T06:22:22.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:22.589+0000 7fe22b7fe640 1 -- 172.21.15.71:0/2367887759 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe234101c70 con 0x7fe2200b6560 2024-09-21T06:22:22.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:22.592+0000 7fe238d5d640 1 -- 172.21.15.71:0/2367887759 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe2200b6560 msgr2=0x7fe2200b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:22.592+0000 7fe238d5d640 1 --2- 172.21.15.71:0/2367887759 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe2200b6560 0x7fe2200b8a70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe224005d00 tx=0x7fe224005c70 comp rx=0 tx=0).stop 2024-09-21T06:22:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:22.592+0000 7fe238d5d640 1 -- 172.21.15.71:0/2367887759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe234108420 msgr2=0x7fe23419aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:22.592+0000 7fe238d5d640 1 --2- 172.21.15.71:0/2367887759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe234108420 0x7fe23419aa50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe23406b9c0 tx=0x7fe21c00ee50 comp rx=0 tx=0).stop 2024-09-21T06:22:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:22.592+0000 7fe238d5d640 1 -- 172.21.15.71:0/2367887759 shutdown_connections 2024-09-21T06:22:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:22.592+0000 7fe238d5d640 1 --2- 172.21.15.71:0/2367887759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe234108d70 0x7fe23419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:22.592+0000 7fe238d5d640 1 --2- 172.21.15.71:0/2367887759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe234108420 0x7fe23419aa50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:22.592+0000 7fe238d5d640 1 --2- 172.21.15.71:0/2367887759 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe2200b6560 0x7fe2200b8a70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:22.592+0000 7fe238d5d640 1 --2- 172.21.15.71:0/2367887759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe234102ae0 0x7fe23419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:22.592+0000 7fe238d5d640 1 -- 172.21.15.71:0/2367887759 >> 172.21.15.71:0/2367887759 conn(0x7fe234079770 msgr2=0x7fe234101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:22.592+0000 7fe238d5d640 1 -- 172.21.15.71:0/2367887759 shutdown_connections 2024-09-21T06:22:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:22:22.592+0000 7fe238d5d640 1 -- 172.21.15.71:0/2367887759 wait complete. 2024-09-21T06:22:23.248 DEBUG:teuthology.orchestra.run.smithi071:osd.4> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T06:22:23.250 INFO:tasks.cephadm:Deploying osd.5 on smithi175 with /dev/vg_nvme/lv_3... 2024-09-21T06:22:23.250 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T06:22:23.481 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:23 smithi071 ceph-mon[34844]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:23.482 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:23 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:23.482 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:23 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:23.482 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:23 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:23.506 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:22:23.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:23 smithi175 ceph-mon[34510]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:23.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:23 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:23.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:23 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:23.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:23 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:23.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:23 smithi063 ceph-mon[31150]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:23.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:23 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:23.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:23 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:23.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:23 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:24.732 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 21 06:22:24 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-4[46093]: 2024-09-21T06:22:24.470+0000 7f7bbad67640 -1 osd.4 0 log_to_monitors true 2024-09-21T06:22:25.597 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:25 smithi175 ceph-mon[34510]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:25.597 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:25 smithi175 ceph-mon[34510]: from='osd.4 [v2:172.21.15.71:6808/829449898,v1:172.21.15.71:6809/829449898]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:22:25.597 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:25 smithi175 ceph-mon[34510]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:22:25.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:25 smithi071 ceph-mon[34844]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:25.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:25 smithi071 ceph-mon[34844]: from='osd.4 [v2:172.21.15.71:6808/829449898,v1:172.21.15.71:6809/829449898]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:22:25.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:25 smithi071 ceph-mon[34844]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:22:25.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:25 smithi063 ceph-mon[31150]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:25.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:25 smithi063 ceph-mon[31150]: from='osd.4 [v2:172.21.15.71:6808/829449898,v1:172.21.15.71:6809/829449898]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:22:25.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:25 smithi063 ceph-mon[31150]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:22:26.268 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:22:26.294 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi175:vg_nvme/lv_3 2024-09-21T06:22:26.536 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:22:26.572 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:26 smithi175 ceph-mon[34510]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T06:22:26.573 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:26 smithi175 ceph-mon[34510]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T06:22:26.573 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:26 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:22:26.573 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:26 smithi175 ceph-mon[34510]: from='osd.4 [v2:172.21.15.71:6808/829449898,v1:172.21.15.71:6809/829449898]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:22:26.573 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:26 smithi175 ceph-mon[34510]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:22:26.573 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:26 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:26.573 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:26 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:26.573 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:26 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:22:26.573 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:26 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:22:26.573 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:26 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:26.573 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:26 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:26.573 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:26 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:26.573 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:26 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:26.768 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 21 06:22:26 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-4[46093]: 2024-09-21T06:22:26.464+0000 7f7bb6ce9640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T06:22:26.768 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 21 06:22:26 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-4[46093]: 2024-09-21T06:22:26.470+0000 7f7bb2ae7640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:22:26.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:26 smithi071 ceph-mon[34844]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T06:22:26.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:26 smithi071 ceph-mon[34844]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T06:22:26.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:26 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:22:26.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:26 smithi071 ceph-mon[34844]: from='osd.4 [v2:172.21.15.71:6808/829449898,v1:172.21.15.71:6809/829449898]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:22:26.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:26 smithi071 ceph-mon[34844]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:22:26.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:26 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:26.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:26 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:26.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:26 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:22:26.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:26 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:22:26.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:26 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:26.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:26 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:26.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:26 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:26.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:26 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:26.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:26 smithi063 ceph-mon[31150]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T06:22:26.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:26 smithi063 ceph-mon[31150]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T06:22:26.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:26 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:22:26.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:26 smithi063 ceph-mon[31150]: from='osd.4 [v2:172.21.15.71:6808/829449898,v1:172.21.15.71:6809/829449898]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:22:26.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:26 smithi063 ceph-mon[31150]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:22:26.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:26 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:26.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:26 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:26.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:26 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:22:26.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:26 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:22:26.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:26 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:26.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:26 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:26.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:26 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:26.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:26 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:26.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.992+0000 7f6cc6de6640 1 -- 172.21.15.175:0/422466345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc0109df0 msgr2=0x7f6cc0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:26.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.992+0000 7f6cc6de6640 1 --2- 172.21.15.175:0/422466345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc0109df0 0x7f6cc0110620 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009900 tx=0x7f6cb802a410 comp rx=0 tx=0).stop 2024-09-21T06:22:26.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.992+0000 7f6cc6de6640 1 -- 172.21.15.175:0/422466345 shutdown_connections 2024-09-21T06:22:26.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.992+0000 7f6cc6de6640 1 --2- 172.21.15.175:0/422466345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc0109df0 0x7f6cc0110620 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:26.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.992+0000 7f6cc6de6640 1 --2- 172.21.15.175:0/422466345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc01094a0 0x7f6cc01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:26.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.992+0000 7f6cc6de6640 1 --2- 172.21.15.175:0/422466345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cc0103b60 0x7f6cc0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:26.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.992+0000 7f6cc6de6640 1 -- 172.21.15.175:0/422466345 >> 172.21.15.175:0/422466345 conn(0x7f6cc007b850 msgr2=0x7f6cc007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:26.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.992+0000 7f6cc6de6640 1 -- 172.21.15.175:0/422466345 shutdown_connections 2024-09-21T06:22:26.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.992+0000 7f6cc6de6640 1 -- 172.21.15.175:0/422466345 wait complete. 2024-09-21T06:22:26.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.993+0000 7f6cc6de6640 1 Processor -- start 2024-09-21T06:22:26.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.993+0000 7f6cc6de6640 1 -- start start 2024-09-21T06:22:26.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.993+0000 7f6cc6de6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc0103b60 0x7f6cc019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:26.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.993+0000 7f6cc6de6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc01094a0 0x7f6cc019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:26.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.993+0000 7f6cc6de6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cc0109df0 0x7f6cc019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:26.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.993+0000 7f6cc6de6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc0113ab0 con 0x7f6cc01094a0 2024-09-21T06:22:26.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.993+0000 7f6cc6de6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc0113930 con 0x7f6cc0109df0 2024-09-21T06:22:26.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.993+0000 7f6cc6de6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc0113c30 con 0x7f6cc0103b60 2024-09-21T06:22:26.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.993+0000 7f6cc4b82640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc0103b60 0x7f6cc019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:26.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.993+0000 7f6cc4b82640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc0103b60 0x7f6cc019a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35048/0 (socket says 172.21.15.175:35048) 2024-09-21T06:22:26.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.993+0000 7f6cc4b82640 1 -- 172.21.15.175:0/4144289470 learned_addr learned my addr 172.21.15.175:0/4144289470 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-21T06:22:26.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.993+0000 7f6cc5383640 1 --2- 172.21.15.175:0/4144289470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cc0109df0 0x7f6cc019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:26.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.993+0000 7f6cbffff640 1 --2- 172.21.15.175:0/4144289470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc01094a0 0x7f6cc019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:26.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.993+0000 7f6cc4b82640 1 -- 172.21.15.175:0/4144289470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cc0109df0 msgr2=0x7f6cc019fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:26.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.993+0000 7f6cc4b82640 1 --2- 172.21.15.175:0/4144289470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cc0109df0 0x7f6cc019fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:26.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.993+0000 7f6cc4b82640 1 -- 172.21.15.175:0/4144289470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc01094a0 msgr2=0x7f6cc019a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:26.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.993+0000 7f6cc4b82640 1 --2- 172.21.15.175:0/4144289470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc01094a0 0x7f6cc019a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:26.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.993+0000 7f6cc4b82640 1 -- 172.21.15.175:0/4144289470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc01a03b0 con 0x7f6cc0103b60 2024-09-21T06:22:26.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.994+0000 7f6cc4b82640 1 --2- 172.21.15.175:0/4144289470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc0103b60 0x7f6cc019a440 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000d950 tx=0x7f6cb000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:26.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.994+0000 7f6cbdffb640 1 -- 172.21.15.175:0/4144289470 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0017030 con 0x7f6cc0103b60 2024-09-21T06:22:26.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.994+0000 7f6cc6de6640 1 -- 172.21.15.175:0/4144289470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc01a06a0 con 0x7f6cc0103b60 2024-09-21T06:22:26.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.994+0000 7f6cbdffb640 1 -- 172.21.15.175:0/4144289470 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cb0004020 con 0x7f6cc0103b60 2024-09-21T06:22:26.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.994+0000 7f6cbdffb640 1 -- 172.21.15.175:0/4144289470 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb00047a0 con 0x7f6cc0103b60 2024-09-21T06:22:26.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.994+0000 7f6cc6de6640 1 -- 172.21.15.175:0/4144289470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc00755f0 con 0x7f6cc0103b60 2024-09-21T06:22:27.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.995+0000 7f6cc6de6640 1 -- 172.21.15.175:0/4144289470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cc0103f70 con 0x7f6cc0103b60 2024-09-21T06:22:27.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.996+0000 7f6cbdffb640 1 -- 172.21.15.175:0/4144289470 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f6cb0009a30 con 0x7f6cc0103b60 2024-09-21T06:22:27.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.997+0000 7f6cbdffb640 1 --2- 172.21.15.175:0/4144289470 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6ca80b6560 0x7f6ca80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:27.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.997+0000 7f6cbdffb640 1 -- 172.21.15.175:0/4144289470 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4036+0+0 (secure 0 0 0) 0x7f6cb00e5df0 con 0x7f6cc0103b60 2024-09-21T06:22:27.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.997+0000 7f6cbffff640 1 --2- 172.21.15.175:0/4144289470 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6ca80b6560 0x7f6ca80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:27.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:26.998+0000 7f6cbffff640 1 --2- 172.21.15.175:0/4144289470 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6ca80b6560 0x7f6ca80b8a70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0109040 tx=0x7f6cb4009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:27.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:27.002+0000 7f6cbdffb640 1 -- 172.21.15.175:0/4144289470 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6cb00ad730 con 0x7f6cc0103b60 2024-09-21T06:22:27.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:27.186+0000 7f6cc6de6640 1 -- 172.21.15.175:0/4144289470 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6cc0063800 con 0x7f6ca80b6560 2024-09-21T06:22:27.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:27 smithi175 ceph-mon[34510]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:27.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:27 smithi175 ceph-mon[34510]: Detected new or changed devices on smithi071 2024-09-21T06:22:27.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:27 smithi175 ceph-mon[34510]: Adjusting osd_memory_target on smithi071 to 8544M 2024-09-21T06:22:27.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:27 smithi175 ceph-mon[34510]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-21T06:22:27.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:27 smithi175 ceph-mon[34510]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T06:22:27.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:27 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:22:27.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:27 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:22:27.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:27 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:22:27.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:27 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:22:27.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:27 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:27.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:27 smithi071 ceph-mon[34844]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:27.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:27 smithi071 ceph-mon[34844]: Detected new or changed devices on smithi071 2024-09-21T06:22:27.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:27 smithi071 ceph-mon[34844]: Adjusting osd_memory_target on smithi071 to 8544M 2024-09-21T06:22:27.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:27 smithi071 ceph-mon[34844]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-21T06:22:27.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:27 smithi071 ceph-mon[34844]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T06:22:27.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:27 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:22:27.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:27 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:22:27.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:27 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:22:27.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:27 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:22:27.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:27 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:27.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:27 smithi063 ceph-mon[31150]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:22:27.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:27 smithi063 ceph-mon[31150]: Detected new or changed devices on smithi071 2024-09-21T06:22:27.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:27 smithi063 ceph-mon[31150]: Adjusting osd_memory_target on smithi071 to 8544M 2024-09-21T06:22:27.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:27 smithi063 ceph-mon[31150]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-21T06:22:27.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:27 smithi063 ceph-mon[31150]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T06:22:27.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:27 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:22:27.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:27 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:22:27.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:27 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:22:27.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:27 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:22:27.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:27 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:28.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:28 smithi071 ceph-mon[34844]: purged_snaps scrub starts 2024-09-21T06:22:28.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:28 smithi071 ceph-mon[34844]: purged_snaps scrub ok 2024-09-21T06:22:28.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:28 smithi071 ceph-mon[34844]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:22:28.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:28 smithi071 ceph-mon[34844]: osd.4 [v2:172.21.15.71:6808/829449898,v1:172.21.15.71:6809/829449898] boot 2024-09-21T06:22:28.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:28 smithi071 ceph-mon[34844]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T06:22:28.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:28 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:22:28.827 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:28 smithi175 ceph-mon[34510]: purged_snaps scrub starts 2024-09-21T06:22:28.828 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:28 smithi175 ceph-mon[34510]: purged_snaps scrub ok 2024-09-21T06:22:28.828 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:28 smithi175 ceph-mon[34510]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:22:28.828 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:28 smithi175 ceph-mon[34510]: osd.4 [v2:172.21.15.71:6808/829449898,v1:172.21.15.71:6809/829449898] boot 2024-09-21T06:22:28.828 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:28 smithi175 ceph-mon[34510]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T06:22:28.828 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:28 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:22:28.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:28 smithi063 ceph-mon[31150]: purged_snaps scrub starts 2024-09-21T06:22:28.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:28 smithi063 ceph-mon[31150]: purged_snaps scrub ok 2024-09-21T06:22:28.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:28 smithi063 ceph-mon[31150]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:22:28.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:28 smithi063 ceph-mon[31150]: osd.4 [v2:172.21.15.71:6808/829449898,v1:172.21.15.71:6809/829449898] boot 2024-09-21T06:22:28.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:28 smithi063 ceph-mon[31150]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T06:22:28.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:28 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:22:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:29 smithi071 ceph-mon[34844]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:29 smithi071 ceph-mon[34844]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T06:22:29.813 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:29 smithi175 ceph-mon[34510]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:29.813 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:29 smithi175 ceph-mon[34510]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T06:22:29.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:29 smithi063 ceph-mon[31150]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:29.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:29 smithi063 ceph-mon[31150]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T06:22:30.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:30 smithi071 ceph-mon[34844]: from='client.? 172.21.15.175:0/1931327579' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91f28121-c94e-4012-b74c-dd4597545e3e"} : dispatch 2024-09-21T06:22:30.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:30 smithi071 ceph-mon[34844]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91f28121-c94e-4012-b74c-dd4597545e3e"} : dispatch 2024-09-21T06:22:30.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:30 smithi071 ceph-mon[34844]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91f28121-c94e-4012-b74c-dd4597545e3e"}]': finished 2024-09-21T06:22:30.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:30 smithi071 ceph-mon[34844]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T06:22:30.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:30 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:22:30.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:30 smithi071 ceph-mon[34844]: from='client.? 172.21.15.175:0/4074121854' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:22:30.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:30 smithi063 ceph-mon[31150]: from='client.? 172.21.15.175:0/1931327579' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91f28121-c94e-4012-b74c-dd4597545e3e"} : dispatch 2024-09-21T06:22:30.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:30 smithi063 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91f28121-c94e-4012-b74c-dd4597545e3e"} : dispatch 2024-09-21T06:22:30.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:30 smithi063 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91f28121-c94e-4012-b74c-dd4597545e3e"}]': finished 2024-09-21T06:22:30.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:30 smithi063 ceph-mon[31150]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T06:22:30.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:30 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:22:30.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:30 smithi063 ceph-mon[31150]: from='client.? 172.21.15.175:0/4074121854' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:22:30.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:30 smithi175 ceph-mon[34510]: from='client.? 172.21.15.175:0/1931327579' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91f28121-c94e-4012-b74c-dd4597545e3e"} : dispatch 2024-09-21T06:22:30.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:30 smithi175 ceph-mon[34510]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91f28121-c94e-4012-b74c-dd4597545e3e"} : dispatch 2024-09-21T06:22:30.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:30 smithi175 ceph-mon[34510]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91f28121-c94e-4012-b74c-dd4597545e3e"}]': finished 2024-09-21T06:22:30.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:30 smithi175 ceph-mon[34510]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T06:22:30.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:30 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:22:30.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:30 smithi175 ceph-mon[34510]: from='client.? 172.21.15.175:0/4074121854' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:22:31.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:31 smithi063 ceph-mon[31150]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:31.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:31 smithi175 ceph-mon[34510]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:32.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:31 smithi071 ceph-mon[34844]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:33.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:33 smithi063 ceph-mon[31150]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:33.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:33 smithi175 ceph-mon[34510]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:34.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:33 smithi071 ceph-mon[34844]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:35.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:35 smithi063 ceph-mon[31150]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:35.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:35 smithi175 ceph-mon[34510]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:36.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:35 smithi071 ceph-mon[34844]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:37.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:37 smithi063 ceph-mon[31150]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:37.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:37 smithi175 ceph-mon[34510]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:38.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:37 smithi071 ceph-mon[34844]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:38.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T06:22:38.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:39.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T06:22:39.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:39.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T06:22:39.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:39.844 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:39 smithi175 ceph-mon[34510]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:39.844 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:39 smithi175 ceph-mon[34510]: Deploying daemon osd.5 on smithi175 2024-09-21T06:22:40.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:39 smithi071 ceph-mon[34844]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:40.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:39 smithi071 ceph-mon[34844]: Deploying daemon osd.5 on smithi175 2024-09-21T06:22:40.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:39 smithi063 ceph-mon[31150]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:40.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:39 smithi063 ceph-mon[31150]: Deploying daemon osd.5 on smithi175 2024-09-21T06:22:41.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:41 smithi175 ceph-mon[34510]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:42.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:41 smithi071 ceph-mon[34844]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:42.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:41 smithi063 ceph-mon[31150]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:43.774 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:43 smithi175 ceph-mon[34510]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:44.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:43 smithi071 ceph-mon[34844]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:44.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:43 smithi063 ceph-mon[31150]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:45.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:45 smithi175 ceph-mon[34510]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:45.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:45.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:45.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:46.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:45 smithi071 ceph-mon[34844]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:46.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:46.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:46.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:46.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:45 smithi063 ceph-mon[31150]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:46.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:46.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:46.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:48.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:47 smithi071 ceph-mon[34844]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:48.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:47 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:48.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:47 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:48.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:47 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:48.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:47 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:48.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:47 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:48.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:47 smithi063 ceph-mon[31150]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:48.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:47 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:48.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:47 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:48.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:47 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:48.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:47 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:48.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:47 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:48.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:47 smithi175 ceph-mon[34510]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:48.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:47 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:48.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:47 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:48.097 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:47 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:48.097 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:47 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:48.097 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:47 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:48.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:48.743+0000 7f6cbdffb640 1 -- 172.21.15.175:0/4144289470 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6cc0063800 con 0x7f6ca80b6560 2024-09-21T06:22:48.745 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 5 on host 'smithi175' 2024-09-21T06:22:48.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:48.746+0000 7f6cc6de6640 1 -- 172.21.15.175:0/4144289470 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6ca80b6560 msgr2=0x7f6ca80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:48.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:48.746+0000 7f6cc6de6640 1 --2- 172.21.15.175:0/4144289470 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6ca80b6560 0x7f6ca80b8a70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0109040 tx=0x7f6cb4009500 comp rx=0 tx=0).stop 2024-09-21T06:22:48.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:48.746+0000 7f6cc6de6640 1 -- 172.21.15.175:0/4144289470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc0103b60 msgr2=0x7f6cc019a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:48.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:48.746+0000 7f6cc6de6640 1 --2- 172.21.15.175:0/4144289470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc0103b60 0x7f6cc019a440 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000d950 tx=0x7f6cb000de10 comp rx=0 tx=0).stop 2024-09-21T06:22:48.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:48.746+0000 7f6cc6de6640 1 -- 172.21.15.175:0/4144289470 shutdown_connections 2024-09-21T06:22:48.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:48.746+0000 7f6cc6de6640 1 --2- 172.21.15.175:0/4144289470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cc0109df0 0x7f6cc019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:48.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:48.746+0000 7f6cc6de6640 1 --2- 172.21.15.175:0/4144289470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc01094a0 0x7f6cc019a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:48.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:48.746+0000 7f6cc6de6640 1 --2- 172.21.15.175:0/4144289470 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6ca80b6560 0x7f6ca80b8a70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:48.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:48.746+0000 7f6cc6de6640 1 --2- 172.21.15.175:0/4144289470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc0103b60 0x7f6cc019a440 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:48.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:48.746+0000 7f6cc6de6640 1 -- 172.21.15.175:0/4144289470 >> 172.21.15.175:0/4144289470 conn(0x7f6cc007b850 msgr2=0x7f6cc01074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:48.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:48.746+0000 7f6cc6de6640 1 -- 172.21.15.175:0/4144289470 shutdown_connections 2024-09-21T06:22:48.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:22:48.746+0000 7f6cc6de6640 1 -- 172.21.15.175:0/4144289470 wait complete. 2024-09-21T06:22:49.433 DEBUG:teuthology.orchestra.run.smithi175:osd.5> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T06:22:49.436 INFO:tasks.cephadm:Deploying osd.6 on smithi063 with /dev/vg_nvme/lv_2... 2024-09-21T06:22:49.436 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T06:22:49.706 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:49.715 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:49 smithi175 ceph-mon[34510]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:49.715 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:49 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:49.715 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:49 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:49.715 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:49 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:49.827 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:49 smithi063 ceph-mon[31150]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:49.827 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:49 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:49.827 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:49 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:49.827 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:49 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:50.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:49 smithi071 ceph-mon[34844]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:50.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:49 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:50.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:49 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:50.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:49 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:50.849 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:22:50 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:22:50.750+0000 7faaae600640 -1 osd.5 0 log_to_monitors true 2024-09-21T06:22:51.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:51 smithi175 ceph-mon[34510]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:51.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:51 smithi175 ceph-mon[34510]: from='osd.5 [v2:172.21.15.175:6808/3005600597,v1:172.21.15.175:6809/3005600597]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:22:51.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:51 smithi175 ceph-mon[34510]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:22:52.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:51 smithi071 ceph-mon[34844]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:52.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:51 smithi071 ceph-mon[34844]: from='osd.5 [v2:172.21.15.175:6808/3005600597,v1:172.21.15.175:6809/3005600597]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:22:52.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:51 smithi071 ceph-mon[34844]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:22:52.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:51 smithi063 ceph-mon[31150]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:52.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:51 smithi063 ceph-mon[31150]: from='osd.5 [v2:172.21.15.175:6808/3005600597,v1:172.21.15.175:6809/3005600597]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:22:52.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:51 smithi063 ceph-mon[31150]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:22:52.587 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:22:52.618 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi063:vg_nvme/lv_2 2024-09-21T06:22:52.878 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:53.000 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:52 smithi063 ceph-mon[31150]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T06:22:53.000 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:52 smithi063 ceph-mon[31150]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T06:22:53.000 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:52 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:22:53.000 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:52 smithi063 ceph-mon[31150]: from='osd.5 [v2:172.21.15.175:6808/3005600597,v1:172.21.15.175:6809/3005600597]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:22:53.000 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:52 smithi063 ceph-mon[31150]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:22:53.000 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:52 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:53.001 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:52 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:53.001 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:52 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:22:53.001 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:52 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:22:53.001 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:52 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:53.001 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:52 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:53.001 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:52 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:53.001 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:52 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:53.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:52 smithi071 ceph-mon[34844]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T06:22:53.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:52 smithi071 ceph-mon[34844]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T06:22:53.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:52 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:22:53.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:52 smithi071 ceph-mon[34844]: from='osd.5 [v2:172.21.15.175:6808/3005600597,v1:172.21.15.175:6809/3005600597]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:22:53.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:52 smithi071 ceph-mon[34844]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:22:53.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:52 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:53.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:52 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:53.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:52 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:22:53.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:52 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:22:53.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:52 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:53.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:52 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:53.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:52 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:53.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:52 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:53.037 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:52 smithi175 ceph-mon[34510]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T06:22:53.037 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:52 smithi175 ceph-mon[34510]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T06:22:53.037 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:52 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:22:53.037 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:52 smithi175 ceph-mon[34510]: from='osd.5 [v2:172.21.15.175:6808/3005600597,v1:172.21.15.175:6809/3005600597]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:22:53.037 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:52 smithi175 ceph-mon[34510]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:22:53.037 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:52 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:53.037 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:52 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:53.038 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:52 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:22:53.038 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:52 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:22:53.038 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:52 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:53.038 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:52 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:53.038 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:52 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:53.038 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:52 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:22:53.349 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:22:53 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:22:53.035+0000 7faaaad97640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T06:22:53.349 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:22:53 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:22:53.041+0000 7faaa2378640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:22:53.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.356+0000 7fa9fd888640 1 -- 172.21.15.63:0/3418987460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9f8109df0 msgr2=0x7fa9f8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:53.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.356+0000 7fa9fd888640 1 --2- 172.21.15.63:0/3418987460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9f8109df0 0x7fa9f8110620 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009ca0 tx=0x7fa9f002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:22:53.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.357+0000 7fa9fd888640 1 -- 172.21.15.63:0/3418987460 shutdown_connections 2024-09-21T06:22:53.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.357+0000 7fa9fd888640 1 --2- 172.21.15.63:0/3418987460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9f8109df0 0x7fa9f8110620 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:53.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.357+0000 7fa9fd888640 1 --2- 172.21.15.63:0/3418987460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9f81094a0 0x7fa9f81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:53.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.357+0000 7fa9fd888640 1 --2- 172.21.15.63:0/3418987460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9f8103b60 0x7fa9f8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:53.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.357+0000 7fa9fd888640 1 -- 172.21.15.63:0/3418987460 >> 172.21.15.63:0/3418987460 conn(0x7fa9f807b850 msgr2=0x7fa9f807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:53.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.357+0000 7fa9fd888640 1 -- 172.21.15.63:0/3418987460 shutdown_connections 2024-09-21T06:22:53.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.357+0000 7fa9fd888640 1 -- 172.21.15.63:0/3418987460 wait complete. 2024-09-21T06:22:53.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.357+0000 7fa9fd888640 1 Processor -- start 2024-09-21T06:22:53.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.357+0000 7fa9fd888640 1 -- start start 2024-09-21T06:22:53.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.358+0000 7fa9fd888640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9f8103b60 0x7fa9f8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:53.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.358+0000 7fa9fd888640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9f81094a0 0x7fa9f8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:53.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.358+0000 7fa9fd888640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9f8109df0 0x7fa9f8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:53.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.358+0000 7fa9fd888640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f8113ab0 con 0x7fa9f81094a0 2024-09-21T06:22:53.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.358+0000 7fa9fd888640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f8113930 con 0x7fa9f8109df0 2024-09-21T06:22:53.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.358+0000 7fa9fd888640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f8113c30 con 0x7fa9f8103b60 2024-09-21T06:22:53.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.358+0000 7fa9f67fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9f81094a0 0x7fa9f8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:53.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.358+0000 7fa9f67fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9f81094a0 0x7fa9f8075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52372/0 (socket says 172.21.15.63:52372) 2024-09-21T06:22:53.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.358+0000 7fa9f67fc640 1 -- 172.21.15.63:0/4257213972 learned_addr learned my addr 172.21.15.63:0/4257213972 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:22:53.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.358+0000 7fa9f77fe640 1 --2- 172.21.15.63:0/4257213972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9f8109df0 0x7fa9f8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:53.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.358+0000 7fa9f6ffd640 1 --2- 172.21.15.63:0/4257213972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9f8103b60 0x7fa9f8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:53.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.358+0000 7fa9f67fc640 1 -- 172.21.15.63:0/4257213972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9f8103b60 msgr2=0x7fa9f8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:53.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.358+0000 7fa9f67fc640 1 --2- 172.21.15.63:0/4257213972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9f8103b60 0x7fa9f8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:53.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.358+0000 7fa9f67fc640 1 -- 172.21.15.63:0/4257213972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9f8109df0 msgr2=0x7fa9f8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:53.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.358+0000 7fa9f67fc640 1 --2- 172.21.15.63:0/4257213972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9f8109df0 0x7fa9f8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:53.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.358+0000 7fa9f67fc640 1 -- 172.21.15.63:0/4257213972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f81a8740 con 0x7fa9f81094a0 2024-09-21T06:22:53.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.359+0000 7fa9f67fc640 1 --2- 172.21.15.63:0/4257213972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9f81094a0 0x7fa9f8075c50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00d950 tx=0x7fa9ec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:53.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.359+0000 7fa9fc886640 1 -- 172.21.15.63:0/4257213972 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec017070 con 0x7fa9f81094a0 2024-09-21T06:22:53.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.359+0000 7fa9fd888640 1 -- 172.21.15.63:0/4257213972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f81a8a30 con 0x7fa9f81094a0 2024-09-21T06:22:53.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.359+0000 7fa9fc886640 1 -- 172.21.15.63:0/4257213972 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9ec009c30 con 0x7fa9f81094a0 2024-09-21T06:22:53.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.359+0000 7fa9fc886640 1 -- 172.21.15.63:0/4257213972 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec0047a0 con 0x7fa9f81094a0 2024-09-21T06:22:53.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.359+0000 7fa9fd888640 1 -- 172.21.15.63:0/4257213972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f81a8fc0 con 0x7fa9f81094a0 2024-09-21T06:22:53.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.360+0000 7fa9fd888640 1 -- 172.21.15.63:0/4257213972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9f8103f70 con 0x7fa9f81094a0 2024-09-21T06:22:53.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.362+0000 7fa9fc886640 1 -- 172.21.15.63:0/4257213972 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fa9ec004020 con 0x7fa9f81094a0 2024-09-21T06:22:53.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.362+0000 7fa9fc886640 1 --2- 172.21.15.63:0/4257213972 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa9e00b6560 0x7fa9e00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:53.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.363+0000 7fa9f6ffd640 1 --2- 172.21.15.63:0/4257213972 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa9e00b6560 0x7fa9e00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:53.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.363+0000 7fa9fc886640 1 -- 172.21.15.63:0/4257213972 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4468+0+0 (secure 0 0 0) 0x7fa9ec0e64a0 con 0x7fa9f81094a0 2024-09-21T06:22:53.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.363+0000 7fa9f6ffd640 1 --2- 172.21.15.63:0/4257213972 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa9e00b6560 0x7fa9e00b8a70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8077160 tx=0x7fa9e8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:53.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.370+0000 7fa9fc886640 1 -- 172.21.15.63:0/4257213972 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa9ec020020 con 0x7fa9f81094a0 2024-09-21T06:22:53.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:22:53.570+0000 7fa9fd888640 1 -- 172.21.15.63:0/4257213972 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fa9f8063800 con 0x7fa9e00b6560 2024-09-21T06:22:53.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:53 smithi063 ceph-mon[31150]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:53.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:53 smithi063 ceph-mon[31150]: Detected new or changed devices on smithi175 2024-09-21T06:22:53.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:53 smithi063 ceph-mon[31150]: Adjusting osd_memory_target on smithi175 to 8544M 2024-09-21T06:22:53.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:53 smithi063 ceph-mon[31150]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T06:22:53.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:53 smithi063 ceph-mon[31150]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T06:22:53.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:22:53.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:22:53.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:53 smithi063 ceph-mon[31150]: from='osd.5 ' entity='osd.5' 2024-09-21T06:22:53.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:22:53.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:22:53.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:54.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:53 smithi071 ceph-mon[34844]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:54.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:53 smithi071 ceph-mon[34844]: Detected new or changed devices on smithi175 2024-09-21T06:22:54.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:53 smithi071 ceph-mon[34844]: Adjusting osd_memory_target on smithi175 to 8544M 2024-09-21T06:22:54.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:53 smithi071 ceph-mon[34844]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T06:22:54.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:53 smithi071 ceph-mon[34844]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T06:22:54.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:22:54.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:22:54.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:53 smithi071 ceph-mon[34844]: from='osd.5 ' entity='osd.5' 2024-09-21T06:22:54.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:22:54.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:22:54.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:54.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:53 smithi175 ceph-mon[34510]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:54.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:53 smithi175 ceph-mon[34510]: Detected new or changed devices on smithi175 2024-09-21T06:22:54.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:53 smithi175 ceph-mon[34510]: Adjusting osd_memory_target on smithi175 to 8544M 2024-09-21T06:22:54.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:53 smithi175 ceph-mon[34510]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T06:22:54.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:53 smithi175 ceph-mon[34510]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T06:22:54.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:22:54.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:22:54.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:53 smithi175 ceph-mon[34510]: from='osd.5 ' entity='osd.5' 2024-09-21T06:22:54.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:22:54.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:22:54.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:55.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:54 smithi071 ceph-mon[34844]: purged_snaps scrub starts 2024-09-21T06:22:55.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:54 smithi071 ceph-mon[34844]: purged_snaps scrub ok 2024-09-21T06:22:55.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:54 smithi071 ceph-mon[34844]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:22:55.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:54 smithi071 ceph-mon[34844]: osd.5 [v2:172.21.15.175:6808/3005600597,v1:172.21.15.175:6809/3005600597] boot 2024-09-21T06:22:55.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:54 smithi071 ceph-mon[34844]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T06:22:55.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:54 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:22:55.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:54 smithi071 ceph-mon[34844]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T06:22:55.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:54 smithi063 ceph-mon[31150]: purged_snaps scrub starts 2024-09-21T06:22:55.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:54 smithi063 ceph-mon[31150]: purged_snaps scrub ok 2024-09-21T06:22:55.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:54 smithi063 ceph-mon[31150]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:22:55.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:54 smithi063 ceph-mon[31150]: osd.5 [v2:172.21.15.175:6808/3005600597,v1:172.21.15.175:6809/3005600597] boot 2024-09-21T06:22:55.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:54 smithi063 ceph-mon[31150]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T06:22:55.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:54 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:22:55.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:54 smithi063 ceph-mon[31150]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T06:22:55.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:54 smithi175 ceph-mon[34510]: purged_snaps scrub starts 2024-09-21T06:22:55.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:54 smithi175 ceph-mon[34510]: purged_snaps scrub ok 2024-09-21T06:22:55.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:54 smithi175 ceph-mon[34510]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:22:55.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:54 smithi175 ceph-mon[34510]: osd.5 [v2:172.21.15.175:6808/3005600597,v1:172.21.15.175:6809/3005600597] boot 2024-09-21T06:22:55.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:54 smithi175 ceph-mon[34510]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T06:22:55.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:54 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:22:55.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:54 smithi175 ceph-mon[34510]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T06:22:55.799 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:55 smithi063 ceph-mon[31150]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:55.800 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:55 smithi063 ceph-mon[31150]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T06:22:56.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:55 smithi071 ceph-mon[34844]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:56.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:55 smithi071 ceph-mon[34844]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T06:22:56.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:55 smithi175 ceph-mon[34510]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:22:56.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:55 smithi175 ceph-mon[34510]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T06:22:56.799 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:56 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2729003021' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bda28014-4dca-40f1-bb23-3ef61605c1ca"} : dispatch 2024-09-21T06:22:56.799 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:56 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2729003021' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bda28014-4dca-40f1-bb23-3ef61605c1ca"}]': finished 2024-09-21T06:22:56.799 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:56 smithi063 ceph-mon[31150]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T06:22:56.799 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:56 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:22:57.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:56 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2729003021' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bda28014-4dca-40f1-bb23-3ef61605c1ca"} : dispatch 2024-09-21T06:22:57.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:56 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2729003021' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bda28014-4dca-40f1-bb23-3ef61605c1ca"}]': finished 2024-09-21T06:22:57.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:56 smithi071 ceph-mon[34844]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T06:22:57.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:56 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:22:57.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:56 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2729003021' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bda28014-4dca-40f1-bb23-3ef61605c1ca"} : dispatch 2024-09-21T06:22:57.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:56 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2729003021' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bda28014-4dca-40f1-bb23-3ef61605c1ca"}]': finished 2024-09-21T06:22:57.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:56 smithi175 ceph-mon[34510]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T06:22:57.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:56 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:22:58.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:57 smithi071 ceph-mon[34844]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:22:58.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:57 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1464386034' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:22:58.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:57 smithi063 ceph-mon[31150]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:22:58.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:57 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1464386034' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:22:58.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:57 smithi175 ceph-mon[34510]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:22:58.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:57 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1464386034' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:23:00.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:22:59 smithi071 ceph-mon[34844]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-09-21T06:23:00.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:22:59 smithi063 ceph-mon[31150]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-09-21T06:23:00.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:22:59 smithi175 ceph-mon[34510]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-09-21T06:23:01.787 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:01 smithi063 ceph-mon[31150]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-21T06:23:02.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:01 smithi071 ceph-mon[34844]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-21T06:23:02.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:01 smithi175 ceph-mon[34510]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-21T06:23:03.899 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:03 smithi063 ceph-mon[31150]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:23:04.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:03 smithi071 ceph-mon[34844]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:23:04.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:03 smithi175 ceph-mon[34510]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:23:06.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:05 smithi071 ceph-mon[34844]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T06:23:06.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:05 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T06:23:06.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:05 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:06.062 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:05 smithi063 ceph-mon[31150]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T06:23:06.062 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:05 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T06:23:06.062 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:05 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:06.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:05 smithi175 ceph-mon[34510]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T06:23:06.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:05 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T06:23:06.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:05 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:06.782 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:06 smithi063 ceph-mon[31150]: Deploying daemon osd.6 on smithi063 2024-09-21T06:23:07.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:06 smithi071 ceph-mon[34844]: Deploying daemon osd.6 on smithi063 2024-09-21T06:23:07.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:06 smithi175 ceph-mon[34510]: Deploying daemon osd.6 on smithi063 2024-09-21T06:23:07.728 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:07 smithi063 ceph-mon[31150]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:23:08.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:07 smithi071 ceph-mon[34844]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:23:08.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:07 smithi175 ceph-mon[34510]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:23:10.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:09 smithi071 ceph-mon[34844]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T06:23:10.047 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:09 smithi063 ceph-mon[31150]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T06:23:10.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:09 smithi175 ceph-mon[34510]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T06:23:11.943 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:11 smithi063 ceph-mon[31150]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:23:11.944 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:23:11.944 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:11.944 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:12.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:11 smithi071 ceph-mon[34844]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:23:12.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:23:12.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:12.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:12.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:11 smithi175 ceph-mon[34510]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:23:12.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:23:12.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:12.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:13.875 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:13 smithi063 ceph-mon[31150]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:23:14.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:13 smithi071 ceph-mon[34844]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:23:14.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:13 smithi175 ceph-mon[34510]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:23:15.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:15 smithi063 ceph-mon[31150]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:23:15.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:15 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:15.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:15 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:15.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:15 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:15.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:15 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:23:15.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:15 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:15.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:23:15.492+0000 7fa9fc886640 1 -- 172.21.15.63:0/4257213972 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa9f8063800 con 0x7fa9e00b6560 2024-09-21T06:23:15.494 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 6 on host 'smithi063' 2024-09-21T06:23:15.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:23:15.494+0000 7fa9fd888640 1 -- 172.21.15.63:0/4257213972 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa9e00b6560 msgr2=0x7fa9e00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:15.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:23:15.494+0000 7fa9fd888640 1 --2- 172.21.15.63:0/4257213972 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa9e00b6560 0x7fa9e00b8a70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8077160 tx=0x7fa9e8005f90 comp rx=0 tx=0).stop 2024-09-21T06:23:15.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:23:15.494+0000 7fa9fd888640 1 -- 172.21.15.63:0/4257213972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9f81094a0 msgr2=0x7fa9f8075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:15.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:23:15.494+0000 7fa9fd888640 1 --2- 172.21.15.63:0/4257213972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9f81094a0 0x7fa9f8075c50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00d950 tx=0x7fa9ec00de10 comp rx=0 tx=0).stop 2024-09-21T06:23:15.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:23:15.495+0000 7fa9fd888640 1 -- 172.21.15.63:0/4257213972 shutdown_connections 2024-09-21T06:23:15.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:23:15.495+0000 7fa9fd888640 1 --2- 172.21.15.63:0/4257213972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9f8109df0 0x7fa9f8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:15.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:23:15.495+0000 7fa9fd888640 1 --2- 172.21.15.63:0/4257213972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9f81094a0 0x7fa9f8075c50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:15.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:23:15.495+0000 7fa9fd888640 1 --2- 172.21.15.63:0/4257213972 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa9e00b6560 0x7fa9e00b8a70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:15.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:23:15.495+0000 7fa9fd888640 1 --2- 172.21.15.63:0/4257213972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9f8103b60 0x7fa9f8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:15.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:23:15.495+0000 7fa9fd888640 1 -- 172.21.15.63:0/4257213972 >> 172.21.15.63:0/4257213972 conn(0x7fa9f807b850 msgr2=0x7fa9f8105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:15.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:23:15.495+0000 7fa9fd888640 1 -- 172.21.15.63:0/4257213972 shutdown_connections 2024-09-21T06:23:15.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:23:15.495+0000 7fa9fd888640 1 -- 172.21.15.63:0/4257213972 wait complete. 2024-09-21T06:23:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:15 smithi071 ceph-mon[34844]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:23:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:15 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:15 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:15 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:15 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:23:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:15 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:15.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:15 smithi175 ceph-mon[34510]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:23:15.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:15 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:15.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:15 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:15.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:15 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:15.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:15 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:23:15.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:15 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:16.417 DEBUG:teuthology.orchestra.run.smithi063:osd.6> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T06:23:16.419 INFO:tasks.cephadm:Deploying osd.7 on smithi071 with /dev/vg_nvme/lv_2... 2024-09-21T06:23:16.419 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T06:23:16.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:16 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:23:16.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:16 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:16.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:16 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:16.539 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:16 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:23:16.539 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:16 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:16.539 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:16 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:16.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:16 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:23:16.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:16 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:16.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:16 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:16.676 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:23:17.504 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:23:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:23:17.325+0000 7f23ac3ba640 -1 osd.6 0 log_to_monitors true 2024-09-21T06:23:17.763 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:17 smithi063 ceph-mon[31150]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:23:17.763 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:17 smithi063 ceph-mon[31150]: from='osd.6 [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T06:23:17.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:17 smithi071 ceph-mon[34844]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:23:17.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:17 smithi071 ceph-mon[34844]: from='osd.6 [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T06:23:17.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:17 smithi175 ceph-mon[34510]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:23:17.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:17 smithi175 ceph-mon[34510]: from='osd.6 [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T06:23:18.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:18 smithi071 ceph-mon[34844]: from='osd.6 [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T06:23:18.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:18 smithi071 ceph-mon[34844]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T06:23:18.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:18 smithi071 ceph-mon[34844]: from='osd.6 [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]} : dispatch 2024-09-21T06:23:18.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:18 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:23:18.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:18 smithi071 ceph-mon[34844]: from='osd.6 [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-21T06:23:18.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:18 smithi071 ceph-mon[34844]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T06:23:18.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:18 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:23:18.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:18 smithi063 ceph-mon[31150]: from='osd.6 [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T06:23:18.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:18 smithi063 ceph-mon[31150]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T06:23:18.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:18 smithi063 ceph-mon[31150]: from='osd.6 [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]} : dispatch 2024-09-21T06:23:18.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:18 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:23:18.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:18 smithi063 ceph-mon[31150]: from='osd.6 [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-21T06:23:18.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:18 smithi063 ceph-mon[31150]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T06:23:18.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:18 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:23:18.834 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:23:18 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:23:18.506+0000 7f23a833c640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T06:23:18.834 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:23:18 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:23:18.515+0000 7f23a413a640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:23:18.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:18 smithi175 ceph-mon[34510]: from='osd.6 [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T06:23:18.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:18 smithi175 ceph-mon[34510]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T06:23:18.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:18 smithi175 ceph-mon[34510]: from='osd.6 [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]} : dispatch 2024-09-21T06:23:18.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:18 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:23:18.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:18 smithi175 ceph-mon[34510]: from='osd.6 [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-21T06:23:18.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:18 smithi175 ceph-mon[34510]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T06:23:18.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:18 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:23:19.226 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:23:19.254 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi071:vg_nvme/lv_2 2024-09-21T06:23:19.512 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:23:19.788 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:19 smithi071 ceph-mon[34844]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:23:19.788 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:19 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:23:19.788 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:19 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:23:19.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:19 smithi063 ceph-mon[31150]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:23:19.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:19 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:23:19.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:19 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:23:19.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:19 smithi175 ceph-mon[34510]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:23:19.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:19 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:23:19.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:19 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:23:20.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.012+0000 7f8eeed41640 1 -- 172.21.15.71:0/2831504815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ee8105270 msgr2=0x7f8ee810d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:20.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.012+0000 7f8eeed41640 1 --2- 172.21.15.71:0/2831504815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ee8105270 0x7f8ee810d8b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8009900 tx=0x7f8ed802a410 comp rx=0 tx=0).stop 2024-09-21T06:23:20.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.012+0000 7f8eeed41640 1 -- 172.21.15.71:0/2831504815 shutdown_connections 2024-09-21T06:23:20.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.012+0000 7f8eeed41640 1 --2- 172.21.15.71:0/2831504815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ee810ddf0 0x7f8ee8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:20.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.012+0000 7f8eeed41640 1 --2- 172.21.15.71:0/2831504815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ee8105270 0x7f8ee810d8b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:20.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.012+0000 7f8eeed41640 1 --2- 172.21.15.71:0/2831504815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ee8104840 0x7f8ee8104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:20.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.012+0000 7f8eeed41640 1 -- 172.21.15.71:0/2831504815 >> 172.21.15.71:0/2831504815 conn(0x7f8ee8079730 msgr2=0x7f8ee8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:20.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.012+0000 7f8eeed41640 1 -- 172.21.15.71:0/2831504815 shutdown_connections 2024-09-21T06:23:20.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.012+0000 7f8eeed41640 1 -- 172.21.15.71:0/2831504815 wait complete. 2024-09-21T06:23:20.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.013+0000 7f8eeed41640 1 Processor -- start 2024-09-21T06:23:20.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.013+0000 7f8eeed41640 1 -- start start 2024-09-21T06:23:20.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.013+0000 7f8eeed41640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ee8104840 0x7f8ee8102750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:20.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.013+0000 7f8eeed41640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ee8105270 0x7f8ee8102c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:20.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.013+0000 7f8eeed41640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ee810ddf0 0x7f8ee81031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:20.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.013+0000 7f8eeed41640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee8113a70 con 0x7f8ee8104840 2024-09-21T06:23:20.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.014+0000 7f8eeed41640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee81138f0 con 0x7f8ee810ddf0 2024-09-21T06:23:20.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.014+0000 7f8eeed41640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee8113bf0 con 0x7f8ee8105270 2024-09-21T06:23:20.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.014+0000 7f8eed2de640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ee810ddf0 0x7f8ee81031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:20.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.014+0000 7f8eed2de640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ee810ddf0 0x7f8ee81031d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47604/0 (socket says 172.21.15.71:47604) 2024-09-21T06:23:20.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.014+0000 7f8eed2de640 1 -- 172.21.15.71:0/1076385421 learned_addr learned my addr 172.21.15.71:0/1076385421 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-21T06:23:20.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.014+0000 7f8ee7fff640 1 --2- 172.21.15.71:0/1076385421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ee8105270 0x7f8ee8102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:20.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.014+0000 7f8eecadd640 1 --2- 172.21.15.71:0/1076385421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ee8104840 0x7f8ee8102750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:20.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.014+0000 7f8eed2de640 1 -- 172.21.15.71:0/1076385421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ee8105270 msgr2=0x7f8ee8102c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:20.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.014+0000 7f8eed2de640 1 --2- 172.21.15.71:0/1076385421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ee8105270 0x7f8ee8102c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:20.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.014+0000 7f8eed2de640 1 -- 172.21.15.71:0/1076385421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ee8104840 msgr2=0x7f8ee8102750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:20.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.014+0000 7f8eed2de640 1 --2- 172.21.15.71:0/1076385421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ee8104840 0x7f8ee8102750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:20.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.014+0000 7f8eed2de640 1 -- 172.21.15.71:0/1076385421 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee81a87e0 con 0x7f8ee810ddf0 2024-09-21T06:23:20.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.014+0000 7f8ee7fff640 1 --2- 172.21.15.71:0/1076385421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ee8105270 0x7f8ee8102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:23:20.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.014+0000 7f8eecadd640 1 --2- 172.21.15.71:0/1076385421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ee8104840 0x7f8ee8102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:23:20.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.014+0000 7f8eed2de640 1 --2- 172.21.15.71:0/1076385421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ee810ddf0 0x7f8ee81031d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000c970 tx=0x7f8ed000ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:20.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.014+0000 7f8ee5ffb640 1 -- 172.21.15.71:0/1076385421 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0007bb0 con 0x7f8ee810ddf0 2024-09-21T06:23:20.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.014+0000 7f8eeed41640 1 -- 172.21.15.71:0/1076385421 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee81a8ad0 con 0x7f8ee810ddf0 2024-09-21T06:23:20.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.014+0000 7f8ee5ffb640 1 -- 172.21.15.71:0/1076385421 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ed0007d50 con 0x7f8ee810ddf0 2024-09-21T06:23:20.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.014+0000 7f8ee5ffb640 1 -- 172.21.15.71:0/1076385421 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0004e60 con 0x7f8ee810ddf0 2024-09-21T06:23:20.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.015+0000 7f8eeed41640 1 -- 172.21.15.71:0/1076385421 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee81a8f90 con 0x7f8ee810ddf0 2024-09-21T06:23:20.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.016+0000 7f8eeed41640 1 -- 172.21.15.71:0/1076385421 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ee8104c50 con 0x7f8ee810ddf0 2024-09-21T06:23:20.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.017+0000 7f8ee5ffb640 1 -- 172.21.15.71:0/1076385421 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f8ed0005020 con 0x7f8ee810ddf0 2024-09-21T06:23:20.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.018+0000 7f8ee5ffb640 1 --2- 172.21.15.71:0/1076385421 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8ed40b6560 0x7f8ed40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:20.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.018+0000 7f8ee5ffb640 1 -- 172.21.15.71:0/1076385421 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5180+0+0 (secure 0 0 0) 0x7f8ed00e6390 con 0x7f8ee810ddf0 2024-09-21T06:23:20.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.018+0000 7f8eecadd640 1 --2- 172.21.15.71:0/1076385421 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8ed40b6560 0x7f8ed40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:20.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.019+0000 7f8eecadd640 1 --2- 172.21.15.71:0/1076385421 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8ed40b6560 0x7f8ed40b8a70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8ee81041a0 tx=0x7f8ee0009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:20.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.022+0000 7f8ee5ffb640 1 -- 172.21.15.71:0/1076385421 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8ed0014030 con 0x7f8ee810ddf0 2024-09-21T06:23:20.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:20.215+0000 7f8eeed41640 1 -- 172.21.15.71:0/1076385421 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8ee8063800 con 0x7f8ed40b6560 2024-09-21T06:23:20.806 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:20 smithi071 ceph-mon[34844]: purged_snaps scrub starts 2024-09-21T06:23:20.806 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:20 smithi071 ceph-mon[34844]: purged_snaps scrub ok 2024-09-21T06:23:20.807 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:20 smithi071 ceph-mon[34844]: osd.6 [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408] boot 2024-09-21T06:23:20.807 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:20 smithi071 ceph-mon[34844]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T06:23:20.807 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:20 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:23:20.807 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:20 smithi071 ceph-mon[34844]: Detected new or changed devices on smithi063 2024-09-21T06:23:20.807 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:20 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:20.807 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:20 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:20.807 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:20 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:23:20.807 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:20 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:23:20.807 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:20 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:23:20.807 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:20 smithi071 ceph-mon[34844]: Adjusting osd_memory_target on smithi063 to 5696M 2024-09-21T06:23:20.807 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:20 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:20.807 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:20 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:20.807 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:20 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:23:20.808 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:20 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:20.808 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:20 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:23:20.808 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:20 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:23:20.808 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:20 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:20.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:20 smithi063 ceph-mon[31150]: purged_snaps scrub starts 2024-09-21T06:23:20.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:20 smithi063 ceph-mon[31150]: purged_snaps scrub ok 2024-09-21T06:23:20.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:20 smithi063 ceph-mon[31150]: osd.6 [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408] boot 2024-09-21T06:23:20.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:20 smithi063 ceph-mon[31150]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T06:23:20.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:20 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:23:20.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:20 smithi063 ceph-mon[31150]: Detected new or changed devices on smithi063 2024-09-21T06:23:20.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:20 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:20.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:20 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:20.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:20 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:23:20.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:20 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:23:20.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:20 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:23:20.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:20 smithi063 ceph-mon[31150]: Adjusting osd_memory_target on smithi063 to 5696M 2024-09-21T06:23:20.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:20 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:20.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:20 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:20.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:20 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:23:20.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:20 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:20.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:20 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:23:20.834 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:20 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:23:20.834 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:20 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:20.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:20 smithi175 ceph-mon[34510]: purged_snaps scrub starts 2024-09-21T06:23:20.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:20 smithi175 ceph-mon[34510]: purged_snaps scrub ok 2024-09-21T06:23:20.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:20 smithi175 ceph-mon[34510]: osd.6 [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408] boot 2024-09-21T06:23:20.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:20 smithi175 ceph-mon[34510]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T06:23:20.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:20 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:23:20.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:20 smithi175 ceph-mon[34510]: Detected new or changed devices on smithi063 2024-09-21T06:23:20.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:20 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:20.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:20 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:20.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:20 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:23:20.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:20 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:23:20.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:20 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:23:20.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:20 smithi175 ceph-mon[34510]: Adjusting osd_memory_target on smithi063 to 5696M 2024-09-21T06:23:20.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:20 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:20.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:20 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:20.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:20 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:23:20.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:20 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:20.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:20 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:23:20.851 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:20 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:23:20.851 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:20 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:21.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:21 smithi063 ceph-mon[31150]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:23:21.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:21 smithi063 ceph-mon[31150]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:23:21.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:21 smithi063 ceph-mon[31150]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T06:23:21.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:21 smithi175 ceph-mon[34510]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:23:21.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:21 smithi175 ceph-mon[34510]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:23:21.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:21 smithi175 ceph-mon[34510]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T06:23:21.902 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:21 smithi071 ceph-mon[34844]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:23:21.902 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:21 smithi071 ceph-mon[34844]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:23:21.903 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:21 smithi071 ceph-mon[34844]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T06:23:23.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:23 smithi175 ceph-mon[34510]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:23.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:23 smithi175 ceph-mon[34510]: from='client.? 172.21.15.71:0/1012828932' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9026588-ccdc-4e6c-b628-1ac8a7dbfa64"} : dispatch 2024-09-21T06:23:23.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:23 smithi175 ceph-mon[34510]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9026588-ccdc-4e6c-b628-1ac8a7dbfa64"} : dispatch 2024-09-21T06:23:23.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:23 smithi175 ceph-mon[34510]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9026588-ccdc-4e6c-b628-1ac8a7dbfa64"}]': finished 2024-09-21T06:23:23.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:23 smithi175 ceph-mon[34510]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T06:23:23.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:23 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:23:23.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:23 smithi175 ceph-mon[34510]: from='client.? 172.21.15.71:0/2519903450' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:23:23.923 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:23 smithi063 ceph-mon[31150]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:23.924 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:23 smithi063 ceph-mon[31150]: from='client.? 172.21.15.71:0/1012828932' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9026588-ccdc-4e6c-b628-1ac8a7dbfa64"} : dispatch 2024-09-21T06:23:23.924 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:23 smithi063 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9026588-ccdc-4e6c-b628-1ac8a7dbfa64"} : dispatch 2024-09-21T06:23:23.924 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:23 smithi063 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9026588-ccdc-4e6c-b628-1ac8a7dbfa64"}]': finished 2024-09-21T06:23:23.924 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:23 smithi063 ceph-mon[31150]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T06:23:23.924 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:23 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:23:23.924 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:23 smithi063 ceph-mon[31150]: from='client.? 172.21.15.71:0/2519903450' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:23:24.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:23 smithi071 ceph-mon[34844]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:24.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:23 smithi071 ceph-mon[34844]: from='client.? 172.21.15.71:0/1012828932' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9026588-ccdc-4e6c-b628-1ac8a7dbfa64"} : dispatch 2024-09-21T06:23:24.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:23 smithi071 ceph-mon[34844]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9026588-ccdc-4e6c-b628-1ac8a7dbfa64"} : dispatch 2024-09-21T06:23:24.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:23 smithi071 ceph-mon[34844]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9026588-ccdc-4e6c-b628-1ac8a7dbfa64"}]': finished 2024-09-21T06:23:24.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:23 smithi071 ceph-mon[34844]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T06:23:24.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:23 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:23:24.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:23 smithi071 ceph-mon[34844]: from='client.? 172.21.15.71:0/2519903450' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:23:25.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:25 smithi175 ceph-mon[34510]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:26.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:25 smithi071 ceph-mon[34844]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:26.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:25 smithi063 ceph-mon[31150]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:27.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:27 smithi071 ceph-mon[34844]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:27.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:27 smithi175 ceph-mon[34510]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:28.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:27 smithi063 ceph-mon[31150]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:29.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:29 smithi175 ceph-mon[34510]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:29.937 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:29 smithi071 ceph-mon[34844]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:30.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:29 smithi063 ceph-mon[31150]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:31.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:31 smithi175 ceph-mon[34510]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:31.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:31 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T06:23:31.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:31 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:31.933 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:31 smithi071 ceph-mon[34844]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:31.933 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:31 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T06:23:31.933 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:31 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:32.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:31 smithi063 ceph-mon[31150]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:32.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:31 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T06:23:32.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:31 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:32.713 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:32 smithi071 ceph-mon[34844]: Deploying daemon osd.7 on smithi071 2024-09-21T06:23:33.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:32 smithi063 ceph-mon[31150]: Deploying daemon osd.7 on smithi071 2024-09-21T06:23:33.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:32 smithi175 ceph-mon[34510]: Deploying daemon osd.7 on smithi071 2024-09-21T06:23:33.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:33 smithi071 ceph-mon[34844]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:34.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:33 smithi063 ceph-mon[31150]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:34.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:33 smithi175 ceph-mon[34510]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:36.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:35 smithi071 ceph-mon[34844]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:36.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:35 smithi063 ceph-mon[31150]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:36.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:35 smithi175 ceph-mon[34510]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:38.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:37 smithi071 ceph-mon[34844]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:38.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:37 smithi063 ceph-mon[31150]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:37 smithi175 ceph-mon[34510]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:38.876 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:23:38.876 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:38.876 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:39.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:23:39.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:23:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:39.770 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:39 smithi071 ceph-mon[34844]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:40.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:39 smithi063 ceph-mon[31150]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:40.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:39 smithi175 ceph-mon[34510]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:41.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:41 smithi071 ceph-mon[34844]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:41.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:41 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:41.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:41 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:41.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:41 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:41.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:41 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:23:41.692 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:41 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:41.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:41.734+0000 7f8ee5ffb640 1 -- 172.21.15.71:0/1076385421 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8ee8063800 con 0x7f8ed40b6560 2024-09-21T06:23:41.735 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 7 on host 'smithi071' 2024-09-21T06:23:41.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:41.736+0000 7f8eeed41640 1 -- 172.21.15.71:0/1076385421 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8ed40b6560 msgr2=0x7f8ed40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:41.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:41.736+0000 7f8eeed41640 1 --2- 172.21.15.71:0/1076385421 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8ed40b6560 0x7f8ed40b8a70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8ee81041a0 tx=0x7f8ee0009500 comp rx=0 tx=0).stop 2024-09-21T06:23:41.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:41.736+0000 7f8eeed41640 1 -- 172.21.15.71:0/1076385421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ee810ddf0 msgr2=0x7f8ee81031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:41.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:41.736+0000 7f8eeed41640 1 --2- 172.21.15.71:0/1076385421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ee810ddf0 0x7f8ee81031d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000c970 tx=0x7f8ed000ce30 comp rx=0 tx=0).stop 2024-09-21T06:23:41.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:41.736+0000 7f8eeed41640 1 -- 172.21.15.71:0/1076385421 shutdown_connections 2024-09-21T06:23:41.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:41.736+0000 7f8eeed41640 1 --2- 172.21.15.71:0/1076385421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ee810ddf0 0x7f8ee81031d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:41.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:41.736+0000 7f8eeed41640 1 --2- 172.21.15.71:0/1076385421 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8ed40b6560 0x7f8ed40b8a70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:41.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:41.736+0000 7f8eeed41640 1 --2- 172.21.15.71:0/1076385421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ee8105270 0x7f8ee8102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:41.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:41.736+0000 7f8eeed41640 1 --2- 172.21.15.71:0/1076385421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ee8104840 0x7f8ee8102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:41.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:41.736+0000 7f8eeed41640 1 -- 172.21.15.71:0/1076385421 >> 172.21.15.71:0/1076385421 conn(0x7f8ee8079730 msgr2=0x7f8ee8100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:41.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:41.736+0000 7f8eeed41640 1 -- 172.21.15.71:0/1076385421 shutdown_connections 2024-09-21T06:23:41.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:23:41.736+0000 7f8eeed41640 1 -- 172.21.15.71:0/1076385421 wait complete. 2024-09-21T06:23:41.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:41 smithi063 ceph-mon[31150]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:41.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:41 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:41.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:41 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:41.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:41 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:41.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:41 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:23:41.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:41 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:41 smithi175 ceph-mon[34510]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:41 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:41 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:41 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:41 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:23:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:41 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:42.420 DEBUG:teuthology.orchestra.run.smithi071:osd.7> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T06:23:42.422 INFO:tasks.cephadm:Deploying osd.8 on smithi175 with /dev/vg_nvme/lv_2... 2024-09-21T06:23:42.423 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T06:23:42.680 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:23:42.723 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:42 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:23:42.723 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:42 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:42.723 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:42 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:42.800 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:42 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:23:42.800 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:42 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:42.800 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:42 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:42.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:42 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:23:42.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:42 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:42.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:42 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:43.568 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:23:43 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:23:43.453+0000 7f370bab5640 -1 osd.7 0 log_to_monitors true 2024-09-21T06:23:43.819 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:43 smithi071 ceph-mon[34844]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:43.819 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:43 smithi071 ceph-mon[34844]: from='osd.7 [v2:172.21.15.71:6816/2913027708,v1:172.21.15.71:6817/2913027708]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:23:43.819 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:43 smithi071 ceph-mon[34844]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:23:43.820 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:43 smithi175 ceph-mon[34510]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:43.820 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:43 smithi175 ceph-mon[34510]: from='osd.7 [v2:172.21.15.71:6816/2913027708,v1:172.21.15.71:6817/2913027708]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:23:43.820 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:43 smithi175 ceph-mon[34510]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:23:43.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:43 smithi063 ceph-mon[31150]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:43.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:43 smithi063 ceph-mon[31150]: from='osd.7 [v2:172.21.15.71:6816/2913027708,v1:172.21.15.71:6817/2913027708]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:23:43.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:43 smithi063 ceph-mon[31150]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:23:44.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:44 smithi175 ceph-mon[34510]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T06:23:44.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:44 smithi175 ceph-mon[34510]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T06:23:44.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:44 smithi175 ceph-mon[34510]: from='osd.7 [v2:172.21.15.71:6816/2913027708,v1:172.21.15.71:6817/2913027708]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:23:44.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:44 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:23:44.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:44 smithi175 ceph-mon[34510]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:23:44.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:44 smithi175 ceph-mon[34510]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:44.995 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:23:44 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:23:44.748+0000 7f3707a37640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T06:23:44.995 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:23:44 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:23:44.756+0000 7f3703835640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:23:44.995 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:44 smithi071 ceph-mon[34844]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T06:23:44.995 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:44 smithi071 ceph-mon[34844]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T06:23:44.995 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:44 smithi071 ceph-mon[34844]: from='osd.7 [v2:172.21.15.71:6816/2913027708,v1:172.21.15.71:6817/2913027708]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:23:44.996 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:44 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:23:44.996 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:44 smithi071 ceph-mon[34844]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:23:44.996 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:44 smithi071 ceph-mon[34844]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:45.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:44 smithi063 ceph-mon[31150]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T06:23:45.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:44 smithi063 ceph-mon[31150]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T06:23:45.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:44 smithi063 ceph-mon[31150]: from='osd.7 [v2:172.21.15.71:6816/2913027708,v1:172.21.15.71:6817/2913027708]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:23:45.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:44 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:23:45.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:44 smithi063 ceph-mon[31150]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:23:45.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:44 smithi063 ceph-mon[31150]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:45.316 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:23:45.348 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi175:vg_nvme/lv_2 2024-09-21T06:23:45.599 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:23:45.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:45 smithi175 ceph-mon[34510]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-21T06:23:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:45 smithi175 ceph-mon[34510]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T06:23:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:23:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:23:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:45 smithi175 ceph-mon[34510]: Detected new or changed devices on smithi071 2024-09-21T06:23:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:23:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:23:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:23:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:45 smithi175 ceph-mon[34510]: Adjusting osd_memory_target on smithi071 to 5696M 2024-09-21T06:23:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:23:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:45 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:46.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:45 smithi071 ceph-mon[34844]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-21T06:23:46.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:45 smithi071 ceph-mon[34844]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T06:23:46.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:23:46.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:23:46.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:45 smithi071 ceph-mon[34844]: Detected new or changed devices on smithi071 2024-09-21T06:23:46.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:46.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:46.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:23:46.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:23:46.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:23:46.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:45 smithi071 ceph-mon[34844]: Adjusting osd_memory_target on smithi071 to 5696M 2024-09-21T06:23:46.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:46.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:46.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:23:46.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:45 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:46.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:45 smithi063 ceph-mon[31150]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-21T06:23:46.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:45 smithi063 ceph-mon[31150]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T06:23:46.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:23:46.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:23:46.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:45 smithi063 ceph-mon[31150]: Detected new or changed devices on smithi071 2024-09-21T06:23:46.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:46.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:46.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:23:46.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:23:46.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:23:46.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:45 smithi063 ceph-mon[31150]: Adjusting osd_memory_target on smithi071 to 5696M 2024-09-21T06:23:46.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:46.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:46.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:23:46.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:45 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:23:46.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.102+0000 7fb3f533d640 1 -- 172.21.15.175:0/3281415049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3f01083d0 msgr2=0x7fb3f01087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:46.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.102+0000 7fb3f533d640 1 --2- 172.21.15.175:0/3281415049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3f01083d0 0x7fb3f01087e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8009900 tx=0x7fb3d802a410 comp rx=0 tx=0).stop 2024-09-21T06:23:46.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.102+0000 7fb3f533d640 1 -- 172.21.15.175:0/3281415049 shutdown_connections 2024-09-21T06:23:46.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.102+0000 7fb3f533d640 1 --2- 172.21.15.175:0/3281415049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f0108d20 0x7fb3f010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:46.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.102+0000 7fb3f533d640 1 --2- 172.21.15.175:0/3281415049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3f01083d0 0x7fb3f01087e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:46.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.102+0000 7fb3f533d640 1 --2- 172.21.15.175:0/3281415049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3f0102ae0 0x7fb3f0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:46.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.102+0000 7fb3f533d640 1 -- 172.21.15.175:0/3281415049 >> 172.21.15.175:0/3281415049 conn(0x7fb3f00797b0 msgr2=0x7fb3f0079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:46.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.102+0000 7fb3f533d640 1 -- 172.21.15.175:0/3281415049 shutdown_connections 2024-09-21T06:23:46.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.102+0000 7fb3f533d640 1 -- 172.21.15.175:0/3281415049 wait complete. 2024-09-21T06:23:46.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.103+0000 7fb3f533d640 1 Processor -- start 2024-09-21T06:23:46.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.103+0000 7fb3f533d640 1 -- start start 2024-09-21T06:23:46.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.103+0000 7fb3f533d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f0102ae0 0x7fb3f019b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:46.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.103+0000 7fb3f533d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3f01083d0 0x7fb3f019b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:46.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.104+0000 7fb3f533d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3f0108d20 0x7fb3f019bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:46.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.104+0000 7fb3f533d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f01129e0 con 0x7fb3f01083d0 2024-09-21T06:23:46.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.104+0000 7fb3f533d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f0112860 con 0x7fb3f0102ae0 2024-09-21T06:23:46.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.104+0000 7fb3f533d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f0112b60 con 0x7fb3f0108d20 2024-09-21T06:23:46.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.104+0000 7fb3ef7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3f0108d20 0x7fb3f019bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:46.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.104+0000 7fb3ef7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3f0108d20 0x7fb3f019bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41674/0 (socket says 172.21.15.175:41674) 2024-09-21T06:23:46.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.104+0000 7fb3ef7fe640 1 -- 172.21.15.175:0/2765984453 learned_addr learned my addr 172.21.15.175:0/2765984453 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-21T06:23:46.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.104+0000 7fb3eeffd640 1 --2- 172.21.15.175:0/2765984453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f0102ae0 0x7fb3f019b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:46.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.104+0000 7fb3ee7fc640 1 --2- 172.21.15.175:0/2765984453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3f01083d0 0x7fb3f019b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:46.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.104+0000 7fb3eeffd640 1 -- 172.21.15.175:0/2765984453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3f0108d20 msgr2=0x7fb3f019bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:46.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.104+0000 7fb3eeffd640 1 --2- 172.21.15.175:0/2765984453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3f0108d20 0x7fb3f019bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:46.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.104+0000 7fb3eeffd640 1 -- 172.21.15.175:0/2765984453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3f01083d0 msgr2=0x7fb3f019b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:46.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.104+0000 7fb3eeffd640 1 --2- 172.21.15.175:0/2765984453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3f01083d0 0x7fb3f019b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:46.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.104+0000 7fb3eeffd640 1 -- 172.21.15.175:0/2765984453 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f01a6560 con 0x7fb3f0102ae0 2024-09-21T06:23:46.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.104+0000 7fb3ef7fe640 1 --2- 172.21.15.175:0/2765984453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3f0108d20 0x7fb3f019bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:23:46.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.104+0000 7fb3eeffd640 1 --2- 172.21.15.175:0/2765984453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f0102ae0 0x7fb3f019b250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000e9f0 tx=0x7fb3e000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:46.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.104+0000 7fb3e7fff640 1 -- 172.21.15.175:0/2765984453 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e000ccc0 con 0x7fb3f0102ae0 2024-09-21T06:23:46.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.104+0000 7fb3f533d640 1 -- 172.21.15.175:0/2765984453 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3f01a6850 con 0x7fb3f0102ae0 2024-09-21T06:23:46.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.104+0000 7fb3e7fff640 1 -- 172.21.15.175:0/2765984453 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3e00108e0 con 0x7fb3f0102ae0 2024-09-21T06:23:46.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.104+0000 7fb3e7fff640 1 -- 172.21.15.175:0/2765984453 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0018880 con 0x7fb3f0102ae0 2024-09-21T06:23:46.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.105+0000 7fb3f533d640 1 -- 172.21.15.175:0/2765984453 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f01a6d60 con 0x7fb3f0102ae0 2024-09-21T06:23:46.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.106+0000 7fb3f533d640 1 -- 172.21.15.175:0/2765984453 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f0102ef0 con 0x7fb3f0102ae0 2024-09-21T06:23:46.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.108+0000 7fb3e7fff640 1 -- 172.21.15.175:0/2765984453 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fb3e0010430 con 0x7fb3f0102ae0 2024-09-21T06:23:46.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.109+0000 7fb3e7fff640 1 --2- 172.21.15.175:0/2765984453 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb3dc0b6560 0x7fb3dc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:46.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.109+0000 7fb3e7fff640 1 -- 172.21.15.175:0/2765984453 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5645+0+0 (secure 0 0 0) 0x7fb3e00e7090 con 0x7fb3f0102ae0 2024-09-21T06:23:46.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.109+0000 7fb3ee7fc640 1 --2- 172.21.15.175:0/2765984453 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb3dc0b6560 0x7fb3dc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:46.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.110+0000 7fb3ee7fc640 1 --2- 172.21.15.175:0/2765984453 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb3dc0b6560 0x7fb3dc0b8a70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8009230 tx=0x7fb3d8031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:46.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.111+0000 7fb3e7fff640 1 -- 172.21.15.175:0/2765984453 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb3e00b2770 con 0x7fb3f0102ae0 2024-09-21T06:23:46.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:23:46.304+0000 7fb3f533d640 1 -- 172.21.15.175:0/2765984453 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fb3f0063800 con 0x7fb3dc0b6560 2024-09-21T06:23:46.962 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:46 smithi175 ceph-mon[34510]: purged_snaps scrub starts 2024-09-21T06:23:46.962 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:46 smithi175 ceph-mon[34510]: purged_snaps scrub ok 2024-09-21T06:23:46.962 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:23:46.962 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:46 smithi175 ceph-mon[34510]: osd.7 [v2:172.21.15.71:6816/2913027708,v1:172.21.15.71:6817/2913027708] boot 2024-09-21T06:23:46.962 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:46 smithi175 ceph-mon[34510]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T06:23:46.962 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:23:46.962 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:46 smithi175 ceph-mon[34510]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:46.962 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:46 smithi175 ceph-mon[34510]: from='client.24488 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:23:46.962 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:23:46.963 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:23:46.963 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:46 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:47.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:46 smithi071 ceph-mon[34844]: purged_snaps scrub starts 2024-09-21T06:23:47.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:46 smithi071 ceph-mon[34844]: purged_snaps scrub ok 2024-09-21T06:23:47.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:23:47.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:46 smithi071 ceph-mon[34844]: osd.7 [v2:172.21.15.71:6816/2913027708,v1:172.21.15.71:6817/2913027708] boot 2024-09-21T06:23:47.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:46 smithi071 ceph-mon[34844]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T06:23:47.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:23:47.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:46 smithi071 ceph-mon[34844]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:47.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:46 smithi071 ceph-mon[34844]: from='client.24488 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:23:47.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:23:47.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:23:47.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:46 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:47.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:46 smithi063 ceph-mon[31150]: purged_snaps scrub starts 2024-09-21T06:23:47.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:46 smithi063 ceph-mon[31150]: purged_snaps scrub ok 2024-09-21T06:23:47.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:23:47.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:46 smithi063 ceph-mon[31150]: osd.7 [v2:172.21.15.71:6816/2913027708,v1:172.21.15.71:6817/2913027708] boot 2024-09-21T06:23:47.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:46 smithi063 ceph-mon[31150]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T06:23:47.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:23:47.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:46 smithi063 ceph-mon[31150]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:23:47.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:46 smithi063 ceph-mon[31150]: from='client.24488 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:23:47.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:23:47.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:23:47.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:46 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:48.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:47 smithi071 ceph-mon[34844]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T06:23:48.050 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:47 smithi175 ceph-mon[34510]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T06:23:48.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:47 smithi063 ceph-mon[31150]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T06:23:49.029 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:48 smithi175 ceph-mon[34510]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T06:23:49.029 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:48 smithi175 ceph-mon[34510]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:23:49.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:48 smithi063 ceph-mon[31150]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T06:23:49.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:48 smithi063 ceph-mon[31150]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:23:49.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:48 smithi071 ceph-mon[34844]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T06:23:49.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:48 smithi071 ceph-mon[34844]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:23:50.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:49 smithi063 ceph-mon[31150]: from='client.? 172.21.15.175:0/3362261081' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2e1dacea-483c-4587-8d19-5c77a7b98667"} : dispatch 2024-09-21T06:23:50.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:49 smithi063 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2e1dacea-483c-4587-8d19-5c77a7b98667"} : dispatch 2024-09-21T06:23:50.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:49 smithi063 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e1dacea-483c-4587-8d19-5c77a7b98667"}]': finished 2024-09-21T06:23:50.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:49 smithi063 ceph-mon[31150]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T06:23:50.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:49 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:23:50.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:49 smithi063 ceph-mon[31150]: from='client.? 172.21.15.175:0/1538024899' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:23:50.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:49 smithi175 ceph-mon[34510]: from='client.? 172.21.15.175:0/3362261081' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2e1dacea-483c-4587-8d19-5c77a7b98667"} : dispatch 2024-09-21T06:23:50.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:49 smithi175 ceph-mon[34510]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2e1dacea-483c-4587-8d19-5c77a7b98667"} : dispatch 2024-09-21T06:23:50.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:49 smithi175 ceph-mon[34510]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e1dacea-483c-4587-8d19-5c77a7b98667"}]': finished 2024-09-21T06:23:50.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:49 smithi175 ceph-mon[34510]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T06:23:50.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:49 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:23:50.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:49 smithi175 ceph-mon[34510]: from='client.? 172.21.15.175:0/1538024899' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:23:50.169 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:49 smithi071 ceph-mon[34844]: from='client.? 172.21.15.175:0/3362261081' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2e1dacea-483c-4587-8d19-5c77a7b98667"} : dispatch 2024-09-21T06:23:50.169 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:49 smithi071 ceph-mon[34844]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2e1dacea-483c-4587-8d19-5c77a7b98667"} : dispatch 2024-09-21T06:23:50.169 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:49 smithi071 ceph-mon[34844]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e1dacea-483c-4587-8d19-5c77a7b98667"}]': finished 2024-09-21T06:23:50.170 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:49 smithi071 ceph-mon[34844]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T06:23:50.170 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:49 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:23:50.170 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:49 smithi071 ceph-mon[34844]: from='client.? 172.21.15.175:0/1538024899' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:23:51.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:50 smithi063 ceph-mon[31150]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:23:51.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:50 smithi175 ceph-mon[34510]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:23:51.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:50 smithi071 ceph-mon[34844]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:23:53.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:52 smithi071 ceph-mon[34844]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:23:53.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:52 smithi063 ceph-mon[31150]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:23:53.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:52 smithi175 ceph-mon[34510]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:23:55.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:54 smithi175 ceph-mon[34510]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-21T06:23:55.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:54 smithi071 ceph-mon[34844]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-21T06:23:55.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:54 smithi063 ceph-mon[31150]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-21T06:23:57.213 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:56 smithi175 ceph-mon[34510]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-21T06:23:57.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:56 smithi071 ceph-mon[34844]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-21T06:23:57.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:56 smithi063 ceph-mon[31150]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-21T06:23:58.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:57 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T06:23:58.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:57 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:58.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:57 smithi071 ceph-mon[34844]: Deploying daemon osd.8 on smithi175 2024-09-21T06:23:58.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:57 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T06:23:58.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:57 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:58.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:57 smithi063 ceph-mon[31150]: Deploying daemon osd.8 on smithi175 2024-09-21T06:23:58.344 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:57 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T06:23:58.344 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:57 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:58.344 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:57 smithi175 ceph-mon[34510]: Deploying daemon osd.8 on smithi175 2024-09-21T06:23:58.989 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:23:58 smithi175 ceph-mon[34510]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:23:59.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:23:58 smithi071 ceph-mon[34844]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:23:59.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:23:58 smithi063 ceph-mon[31150]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:24:00.940 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:00 smithi175 ceph-mon[34510]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T06:24:01.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:00 smithi071 ceph-mon[34844]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T06:24:01.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:00 smithi063 ceph-mon[31150]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T06:24:03.045 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:02 smithi175 ceph-mon[34510]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:24:03.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:02 smithi071 ceph-mon[34844]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:24:03.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:02 smithi063 ceph-mon[31150]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:24:04.116 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:03 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:04.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:03 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:04.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:03 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:04.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:03 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:04.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:03 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:04.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:03 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:04.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:03 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:04.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:03 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:04.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:03 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:05.718 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:05 smithi175 ceph-mon[34510]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:24:05.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:05 smithi071 ceph-mon[34844]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:24:05.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:05 smithi063 ceph-mon[31150]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:24:07.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:24:07.444+0000 7fb3e7fff640 1 -- 172.21.15.175:0/2765984453 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb3f0063800 con 0x7fb3dc0b6560 2024-09-21T06:24:07.446 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 8 on host 'smithi175' 2024-09-21T06:24:07.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:24:07.447+0000 7fb3f533d640 1 -- 172.21.15.175:0/2765984453 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb3dc0b6560 msgr2=0x7fb3dc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:07.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:24:07.447+0000 7fb3f533d640 1 --2- 172.21.15.175:0/2765984453 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb3dc0b6560 0x7fb3dc0b8a70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8009230 tx=0x7fb3d8031400 comp rx=0 tx=0).stop 2024-09-21T06:24:07.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:24:07.447+0000 7fb3f533d640 1 -- 172.21.15.175:0/2765984453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f0102ae0 msgr2=0x7fb3f019b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:07.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:24:07.447+0000 7fb3f533d640 1 --2- 172.21.15.175:0/2765984453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f0102ae0 0x7fb3f019b250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000e9f0 tx=0x7fb3e000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:24:07.447+0000 7fb3f533d640 1 -- 172.21.15.175:0/2765984453 shutdown_connections 2024-09-21T06:24:07.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:24:07.447+0000 7fb3f533d640 1 --2- 172.21.15.175:0/2765984453 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb3dc0b6560 0x7fb3dc0b8a70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:24:07.447+0000 7fb3f533d640 1 --2- 172.21.15.175:0/2765984453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3f0108d20 0x7fb3f019bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:24:07.447+0000 7fb3f533d640 1 --2- 172.21.15.175:0/2765984453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3f01083d0 0x7fb3f019b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:24:07.447+0000 7fb3f533d640 1 --2- 172.21.15.175:0/2765984453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f0102ae0 0x7fb3f019b250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:24:07.447+0000 7fb3f533d640 1 -- 172.21.15.175:0/2765984453 >> 172.21.15.175:0/2765984453 conn(0x7fb3f00797b0 msgr2=0x7fb3f0106460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:07.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:24:07.447+0000 7fb3f533d640 1 -- 172.21.15.175:0/2765984453 shutdown_connections 2024-09-21T06:24:07.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:24:07.447+0000 7fb3f533d640 1 -- 172.21.15.175:0/2765984453 wait complete. 2024-09-21T06:24:07.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:07 smithi063 ceph-mon[31150]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:24:07.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:07 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:07.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:07 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:07.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:07 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:07.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:07 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:24:07.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:07 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:07.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:07 smithi175 ceph-mon[34510]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:24:07.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:07 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:07.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:07 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:07.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:07 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:07.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:07 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:24:07.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:07 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:07.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:07 smithi071 ceph-mon[34844]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:24:07.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:07 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:07.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:07 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:07.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:07 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:07.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:07 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:24:07.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:07 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:08.175 DEBUG:teuthology.orchestra.run.smithi175:osd.8> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T06:24:08.177 INFO:tasks.cephadm:Deploying osd.9 on smithi063 with /dev/vg_nvme/lv_1... 2024-09-21T06:24:08.178 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T06:24:08.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:08 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:08.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:08 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:08.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:08 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:08.449 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:24:08.571 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:08 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:08.571 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:08 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:08.571 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:08 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:08.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:08 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:08.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:08 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:08.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:08 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:09.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:09 smithi175 ceph-mon[34510]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:24:09.712 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:09 smithi063 ceph-mon[31150]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:24:09.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:09 smithi071 ceph-mon[34844]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:24:09.923 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:24:09 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:24:09.752+0000 7f04ed525640 -1 osd.8 0 log_to_monitors true 2024-09-21T06:24:10.602 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:10 smithi063 ceph-mon[31150]: from='osd.8 [v2:172.21.15.175:6816/2058692148,v1:172.21.15.175:6817/2058692148]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:24:10.602 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:10 smithi063 ceph-mon[31150]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:24:10.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:10 smithi071 ceph-mon[34844]: from='osd.8 [v2:172.21.15.175:6816/2058692148,v1:172.21.15.175:6817/2058692148]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:24:10.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:10 smithi071 ceph-mon[34844]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:24:10.818 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:10 smithi175 ceph-mon[34510]: from='osd.8 [v2:172.21.15.175:6816/2058692148,v1:172.21.15.175:6817/2058692148]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:24:10.818 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:10 smithi175 ceph-mon[34510]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:24:11.274 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:24:11.305 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi063:vg_nvme/lv_1 2024-09-21T06:24:11.573 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:24:11.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:11 smithi063 ceph-mon[31150]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:24:11.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:11 smithi063 ceph-mon[31150]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T06:24:11.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:11 smithi063 ceph-mon[31150]: from='osd.8 [v2:172.21.15.175:6816/2058692148,v1:172.21.15.175:6817/2058692148]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:24:11.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:11 smithi063 ceph-mon[31150]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T06:24:11.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:24:11.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:11 smithi063 ceph-mon[31150]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:24:11.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:11.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:11.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:11.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:11.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:11.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:11.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:11.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:24:11.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:11 smithi175 ceph-mon[34510]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:24:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:11 smithi175 ceph-mon[34510]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T06:24:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:11 smithi175 ceph-mon[34510]: from='osd.8 [v2:172.21.15.175:6816/2058692148,v1:172.21.15.175:6817/2058692148]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:24:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:11 smithi175 ceph-mon[34510]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T06:24:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:24:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:11 smithi175 ceph-mon[34510]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:24:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:11.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:11.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:11.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:11.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:11.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:11.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:24:11.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:11.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:11 smithi071 ceph-mon[34844]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:24:11.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:11 smithi071 ceph-mon[34844]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T06:24:11.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:11 smithi071 ceph-mon[34844]: from='osd.8 [v2:172.21.15.175:6816/2058692148,v1:172.21.15.175:6817/2058692148]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:24:11.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:11 smithi071 ceph-mon[34844]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T06:24:11.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:24:11.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:11 smithi071 ceph-mon[34844]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:24:11.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:11.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:11.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:11.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:11.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:11.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:11.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:11.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:24:11.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:12.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.052+0000 7f6369512640 1 -- 172.21.15.63:0/4005889127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6364109df0 msgr2=0x7f6364110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:12.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.052+0000 7f6369512640 1 --2- 172.21.15.63:0/4005889127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6364109df0 0x7f6364110620 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f635c009900 tx=0x7f635c02a410 comp rx=0 tx=0).stop 2024-09-21T06:24:12.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.052+0000 7f6369512640 1 -- 172.21.15.63:0/4005889127 shutdown_connections 2024-09-21T06:24:12.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.052+0000 7f6369512640 1 --2- 172.21.15.63:0/4005889127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6364109df0 0x7f6364110620 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.052+0000 7f6369512640 1 --2- 172.21.15.63:0/4005889127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63641094a0 0x7f63641098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.052+0000 7f6369512640 1 --2- 172.21.15.63:0/4005889127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6364103b60 0x7f6364103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.052+0000 7f6369512640 1 -- 172.21.15.63:0/4005889127 >> 172.21.15.63:0/4005889127 conn(0x7f636407b850 msgr2=0x7f636407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:12.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.052+0000 7f6369512640 1 -- 172.21.15.63:0/4005889127 shutdown_connections 2024-09-21T06:24:12.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.052+0000 7f6369512640 1 -- 172.21.15.63:0/4005889127 wait complete. 2024-09-21T06:24:12.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.053+0000 7f6369512640 1 Processor -- start 2024-09-21T06:24:12.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.053+0000 7f6369512640 1 -- start start 2024-09-21T06:24:12.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.054+0000 7f6369512640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6364103b60 0x7f636419c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.054+0000 7f6369512640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63641094a0 0x7f636419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.054+0000 7f6369512640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6364109df0 0x7f63641a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.054+0000 7f6369512640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6364113ab0 con 0x7f6364103b60 2024-09-21T06:24:12.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.054+0000 7f6369512640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6364113930 con 0x7f6364109df0 2024-09-21T06:24:12.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.054+0000 7f6369512640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6364113c30 con 0x7f63641094a0 2024-09-21T06:24:12.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.054+0000 7f6362ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6364103b60 0x7f636419c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.054+0000 7f6362ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6364103b60 0x7f636419c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54270/0 (socket says 172.21.15.63:54270) 2024-09-21T06:24:12.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.054+0000 7f6362ffd640 1 -- 172.21.15.63:0/895826055 learned_addr learned my addr 172.21.15.63:0/895826055 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:24:12.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.054+0000 7f63627fc640 1 --2- 172.21.15.63:0/895826055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63641094a0 0x7f636419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.054+0000 7f63637fe640 1 --2- 172.21.15.63:0/895826055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6364109df0 0x7f63641a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.054+0000 7f6362ffd640 1 -- 172.21.15.63:0/895826055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63641094a0 msgr2=0x7f636419cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:12.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.054+0000 7f6362ffd640 1 --2- 172.21.15.63:0/895826055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63641094a0 0x7f636419cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.054+0000 7f6362ffd640 1 -- 172.21.15.63:0/895826055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6364109df0 msgr2=0x7f63641a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:12.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.054+0000 7f6362ffd640 1 --2- 172.21.15.63:0/895826055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6364109df0 0x7f63641a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.054+0000 7f6362ffd640 1 -- 172.21.15.63:0/895826055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63641a2630 con 0x7f6364103b60 2024-09-21T06:24:12.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.054+0000 7f6362ffd640 1 --2- 172.21.15.63:0/895826055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6364103b60 0x7f636419c6c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f635400db80 tx=0x7f635400b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:12.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.055+0000 7f634bfff640 1 -- 172.21.15.63:0/895826055 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354017070 con 0x7f6364103b60 2024-09-21T06:24:12.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.055+0000 7f634bfff640 1 -- 172.21.15.63:0/895826055 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6354003b70 con 0x7f6364103b60 2024-09-21T06:24:12.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.055+0000 7f634bfff640 1 -- 172.21.15.63:0/895826055 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63540106c0 con 0x7f6364103b60 2024-09-21T06:24:12.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.055+0000 7f6369512640 1 -- 172.21.15.63:0/895826055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63641a2920 con 0x7f6364103b60 2024-09-21T06:24:12.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.055+0000 7f6369512640 1 -- 172.21.15.63:0/895826055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63641a9080 con 0x7f6364103b60 2024-09-21T06:24:12.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.056+0000 7f6369512640 1 -- 172.21.15.63:0/895826055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6364103f70 con 0x7f6364103b60 2024-09-21T06:24:12.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.057+0000 7f634bfff640 1 -- 172.21.15.63:0/895826055 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f6354004020 con 0x7f6364103b60 2024-09-21T06:24:12.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.058+0000 7f634bfff640 1 --2- 172.21.15.63:0/895826055 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f634c0b6560 0x7f634c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.058+0000 7f63627fc640 1 --2- 172.21.15.63:0/895826055 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f634c0b6560 0x7f634c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.058+0000 7f634bfff640 1 -- 172.21.15.63:0/895826055 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5764+0+0 (secure 0 0 0) 0x7f63540e6dd0 con 0x7f6364103b60 2024-09-21T06:24:12.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.059+0000 7f63627fc640 1 --2- 172.21.15.63:0/895826055 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f634c0b6560 0x7f634c0b8a70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6358005fd0 tx=0x7f6358005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:12.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.061+0000 7f634bfff640 1 -- 172.21.15.63:0/895826055 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f63540ae050 con 0x7f6364103b60 2024-09-21T06:24:12.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:12.262+0000 7f6369512640 1 -- 172.21.15.63:0/895826055 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6364107a20 con 0x7f634c0b6560 2024-09-21T06:24:12.349 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:24:11 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:24:11.876+0000 7f04e94a7640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T06:24:12.349 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:24:11 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:24:11.890+0000 7f04e129d640 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:24:12.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:12 smithi063 ceph-mon[31150]: Detected new or changed devices on smithi175 2024-09-21T06:24:12.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:12 smithi063 ceph-mon[31150]: Adjusting osd_memory_target on smithi175 to 5696M 2024-09-21T06:24:12.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:12 smithi063 ceph-mon[31150]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T06:24:12.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:12 smithi063 ceph-mon[31150]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T06:24:12.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:12 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:24:12.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:12 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:24:12.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:12 smithi063 ceph-mon[31150]: from='osd.8 ' entity='osd.8' 2024-09-21T06:24:12.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:12 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:24:12.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:12 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:24:12.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:12 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:12.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:12 smithi071 ceph-mon[34844]: Detected new or changed devices on smithi175 2024-09-21T06:24:12.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:12 smithi071 ceph-mon[34844]: Adjusting osd_memory_target on smithi175 to 5696M 2024-09-21T06:24:12.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:12 smithi071 ceph-mon[34844]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T06:24:12.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:12 smithi071 ceph-mon[34844]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T06:24:12.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:12 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:24:12.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:12 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:24:12.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:12 smithi071 ceph-mon[34844]: from='osd.8 ' entity='osd.8' 2024-09-21T06:24:12.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:12 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:24:12.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:12 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:24:12.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:12 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:12.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:12 smithi175 ceph-mon[34510]: Detected new or changed devices on smithi175 2024-09-21T06:24:12.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:12 smithi175 ceph-mon[34510]: Adjusting osd_memory_target on smithi175 to 5696M 2024-09-21T06:24:12.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:12 smithi175 ceph-mon[34510]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T06:24:12.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:12 smithi175 ceph-mon[34510]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T06:24:12.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:12 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:24:12.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:12 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:24:12.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:12 smithi175 ceph-mon[34510]: from='osd.8 ' entity='osd.8' 2024-09-21T06:24:12.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:12 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:24:12.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:12 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:24:12.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:12 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:13.707 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:13 smithi063 ceph-mon[31150]: purged_snaps scrub starts 2024-09-21T06:24:13.707 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:13 smithi063 ceph-mon[31150]: purged_snaps scrub ok 2024-09-21T06:24:13.708 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:13 smithi063 ceph-mon[31150]: pgmap v176: 1 pgs: 1 peering; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:24:13.708 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:13 smithi063 ceph-mon[31150]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:24:13.708 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:13 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:24:13.708 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:13 smithi063 ceph-mon[31150]: osd.8 [v2:172.21.15.175:6816/2058692148,v1:172.21.15.175:6817/2058692148] boot 2024-09-21T06:24:13.708 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:13 smithi063 ceph-mon[31150]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T06:24:13.708 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:13 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:24:13.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:13 smithi071 ceph-mon[34844]: purged_snaps scrub starts 2024-09-21T06:24:13.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:13 smithi071 ceph-mon[34844]: purged_snaps scrub ok 2024-09-21T06:24:13.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:13 smithi071 ceph-mon[34844]: pgmap v176: 1 pgs: 1 peering; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:24:13.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:13 smithi071 ceph-mon[34844]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:24:13.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:13 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:24:13.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:13 smithi071 ceph-mon[34844]: osd.8 [v2:172.21.15.175:6816/2058692148,v1:172.21.15.175:6817/2058692148] boot 2024-09-21T06:24:13.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:13 smithi071 ceph-mon[34844]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T06:24:13.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:13 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:24:13.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:13 smithi175 ceph-mon[34510]: purged_snaps scrub starts 2024-09-21T06:24:13.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:13 smithi175 ceph-mon[34510]: purged_snaps scrub ok 2024-09-21T06:24:13.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:13 smithi175 ceph-mon[34510]: pgmap v176: 1 pgs: 1 peering; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:24:13.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:13 smithi175 ceph-mon[34510]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:24:13.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:13 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:24:13.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:13 smithi175 ceph-mon[34510]: osd.8 [v2:172.21.15.175:6816/2058692148,v1:172.21.15.175:6817/2058692148] boot 2024-09-21T06:24:13.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:13 smithi175 ceph-mon[34510]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T06:24:13.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:13 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:24:14.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:14 smithi071 ceph-mon[34844]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T06:24:14.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:14 smithi063 ceph-mon[31150]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T06:24:14.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:14 smithi175 ceph-mon[34510]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T06:24:15.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:15 smithi071 ceph-mon[34844]: pgmap v179: 1 pgs: 1 peering; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:15.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:15 smithi071 ceph-mon[34844]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T06:24:15.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:15 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1136812881' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7077ba4d-1fce-4197-a556-8b6a859c6f82"} : dispatch 2024-09-21T06:24:15.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:15 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1136812881' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7077ba4d-1fce-4197-a556-8b6a859c6f82"}]': finished 2024-09-21T06:24:15.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:15 smithi071 ceph-mon[34844]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T06:24:15.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:15 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:24:15.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:15 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3435419495' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:24:15.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:15 smithi063 ceph-mon[31150]: pgmap v179: 1 pgs: 1 peering; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:15.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:15 smithi063 ceph-mon[31150]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T06:24:15.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:15 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1136812881' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7077ba4d-1fce-4197-a556-8b6a859c6f82"} : dispatch 2024-09-21T06:24:15.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:15 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1136812881' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7077ba4d-1fce-4197-a556-8b6a859c6f82"}]': finished 2024-09-21T06:24:15.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:15 smithi063 ceph-mon[31150]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T06:24:15.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:15 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:24:15.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:15 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3435419495' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:24:15.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:15 smithi175 ceph-mon[34510]: pgmap v179: 1 pgs: 1 peering; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:15.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:15 smithi175 ceph-mon[34510]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T06:24:15.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:15 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1136812881' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7077ba4d-1fce-4197-a556-8b6a859c6f82"} : dispatch 2024-09-21T06:24:15.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:15 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1136812881' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7077ba4d-1fce-4197-a556-8b6a859c6f82"}]': finished 2024-09-21T06:24:15.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:15 smithi175 ceph-mon[34510]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T06:24:15.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:15 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:24:15.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:15 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3435419495' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:24:17.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:17 smithi071 ceph-mon[34844]: pgmap v182: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:17.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:17 smithi063 ceph-mon[31150]: pgmap v182: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:17.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:17 smithi175 ceph-mon[34510]: pgmap v182: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:19.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:19 smithi071 ceph-mon[34844]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-21T06:24:19.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:19 smithi063 ceph-mon[31150]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-21T06:24:19.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:19 smithi175 ceph-mon[34510]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-21T06:24:21.728 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:21 smithi063 ceph-mon[31150]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T06:24:21.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:21 smithi071 ceph-mon[34844]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T06:24:21.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:21 smithi175 ceph-mon[34510]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T06:24:23.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:23 smithi071 ceph-mon[34844]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:24:23.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:23 smithi063 ceph-mon[31150]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:24:23.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:23 smithi175 ceph-mon[34510]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:24:24.578 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:24 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T06:24:24.578 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:24 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:24.578 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:24 smithi063 ceph-mon[31150]: Deploying daemon osd.9 on smithi063 2024-09-21T06:24:24.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:24 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T06:24:24.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:24 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:24.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:24 smithi071 ceph-mon[34844]: Deploying daemon osd.9 on smithi063 2024-09-21T06:24:24.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:24 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T06:24:24.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:24 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:24.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:24 smithi175 ceph-mon[34510]: Deploying daemon osd.9 on smithi063 2024-09-21T06:24:25.594 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:25 smithi063 ceph-mon[31150]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T06:24:25.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:25 smithi071 ceph-mon[34844]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T06:24:25.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:25 smithi175 ceph-mon[34510]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T06:24:27.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:27 smithi071 ceph-mon[34844]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T06:24:27.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:27 smithi063 ceph-mon[31150]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T06:24:27.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:27 smithi175 ceph-mon[34510]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T06:24:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:29 smithi071 ceph-mon[34844]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:24:29.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:29 smithi063 ceph-mon[31150]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:24:29.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:29 smithi175 ceph-mon[34510]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:24:30.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:30 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:30.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:30 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:30.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:30 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:30.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:30 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:30.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:30 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:30.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:30 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:30.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:30 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:30.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:30 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:30.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:30 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:31.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:31 smithi071 ceph-mon[34844]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:31.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:31 smithi063 ceph-mon[31150]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:31.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:31 smithi175 ceph-mon[34510]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:33.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:33 smithi063 ceph-mon[31150]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:33.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:33.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:33.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:33.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:24:33.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:33.753 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 9 on host 'smithi063' 2024-09-21T06:24:33.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:33.750+0000 7f634bfff640 1 -- 172.21.15.63:0/895826055 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6364107a20 con 0x7f634c0b6560 2024-09-21T06:24:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:33.753+0000 7f6369512640 1 -- 172.21.15.63:0/895826055 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f634c0b6560 msgr2=0x7f634c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:33.753+0000 7f6369512640 1 --2- 172.21.15.63:0/895826055 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f634c0b6560 0x7f634c0b8a70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6358005fd0 tx=0x7f6358005850 comp rx=0 tx=0).stop 2024-09-21T06:24:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:33.753+0000 7f6369512640 1 -- 172.21.15.63:0/895826055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6364103b60 msgr2=0x7f636419c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:33.753+0000 7f6369512640 1 --2- 172.21.15.63:0/895826055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6364103b60 0x7f636419c6c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f635400db80 tx=0x7f635400b630 comp rx=0 tx=0).stop 2024-09-21T06:24:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:33.753+0000 7f6369512640 1 -- 172.21.15.63:0/895826055 shutdown_connections 2024-09-21T06:24:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:33.753+0000 7f6369512640 1 --2- 172.21.15.63:0/895826055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6364109df0 0x7f63641a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:33.753+0000 7f6369512640 1 --2- 172.21.15.63:0/895826055 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f634c0b6560 0x7f634c0b8a70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:33.753+0000 7f6369512640 1 --2- 172.21.15.63:0/895826055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63641094a0 0x7f636419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:33.753+0000 7f6369512640 1 --2- 172.21.15.63:0/895826055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6364103b60 0x7f636419c6c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:33.753+0000 7f6369512640 1 -- 172.21.15.63:0/895826055 >> 172.21.15.63:0/895826055 conn(0x7f636407b850 msgr2=0x7f6364107310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:33.753+0000 7f6369512640 1 -- 172.21.15.63:0/895826055 shutdown_connections 2024-09-21T06:24:33.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:24:33.753+0000 7f6369512640 1 -- 172.21.15.63:0/895826055 wait complete. 2024-09-21T06:24:33.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:33 smithi071 ceph-mon[34844]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:33.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:33.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:33.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:33.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:24:33.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:33.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:33 smithi175 ceph-mon[34510]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:33.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:33.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:33.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:33.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:24:33.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:34.447 DEBUG:teuthology.orchestra.run.smithi063:osd.9> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T06:24:34.449 INFO:tasks.cephadm:Deploying osd.10 on smithi071 with /dev/vg_nvme/lv_1... 2024-09-21T06:24:34.450 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T06:24:34.706 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:24:34.706 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:34 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:34.707 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:34 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:34.707 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:34 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:34.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:34 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:34.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:34 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:34.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:34 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:34.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:34 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:34.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:34 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:34.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:34 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:35.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:35 smithi063 ceph-mon[31150]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:35.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:35 smithi063 ceph-mon[31150]: from='osd.9 [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T06:24:35.808 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:24:35 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:24:35.485+0000 7fcf4092a640 -1 osd.9 0 log_to_monitors true 2024-09-21T06:24:35.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:35 smithi175 ceph-mon[34510]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:35.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:35 smithi175 ceph-mon[34510]: from='osd.9 [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T06:24:36.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:35 smithi071 ceph-mon[34844]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:36.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:35 smithi071 ceph-mon[34844]: from='osd.9 [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T06:24:36.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:36 smithi063 ceph-mon[31150]: from='osd.9 [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T06:24:36.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:36 smithi063 ceph-mon[31150]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T06:24:36.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:36 smithi063 ceph-mon[31150]: from='osd.9 [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi063", "root=default"]} : dispatch 2024-09-21T06:24:36.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:24:36.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:36 smithi063 ceph-mon[31150]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:37.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:36 smithi071 ceph-mon[34844]: from='osd.9 [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T06:24:37.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:36 smithi071 ceph-mon[34844]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T06:24:37.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:36 smithi071 ceph-mon[34844]: from='osd.9 [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi063", "root=default"]} : dispatch 2024-09-21T06:24:37.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:24:37.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:36 smithi071 ceph-mon[34844]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:37.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:36 smithi175 ceph-mon[34510]: from='osd.9 [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T06:24:37.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:36 smithi175 ceph-mon[34510]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T06:24:37.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:36 smithi175 ceph-mon[34510]: from='osd.9 [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi063", "root=default"]} : dispatch 2024-09-21T06:24:37.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:24:37.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:36 smithi175 ceph-mon[34510]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:37.437 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:24:37.464 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi071:vg_nvme/lv_1 2024-09-21T06:24:37.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:24:37 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:24:37.199+0000 7fcf3c8ac640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T06:24:37.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:24:37 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:24:37.213+0000 7fcf346a2640 -1 osd.9 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:24:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:24:38.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:37 smithi071 ceph-mon[34844]: from='osd.9 [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-21T06:24:38.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:37 smithi071 ceph-mon[34844]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T06:24:38.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:24:38.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:24:38.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:37 smithi071 ceph-mon[34844]: from='osd.9 [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285]' entity='osd.9' 2024-09-21T06:24:38.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:37 smithi071 ceph-mon[34844]: Detected new or changed devices on smithi063 2024-09-21T06:24:38.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:38.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:38.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:38.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:38.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:38.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:38.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:37 smithi071 ceph-mon[34844]: Adjusting osd_memory_target on smithi063 to 4272M 2024-09-21T06:24:38.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:38.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:38.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:24:38.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:37 smithi063 ceph-mon[31150]: from='osd.9 [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-21T06:24:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:37 smithi063 ceph-mon[31150]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T06:24:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:24:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:24:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:37 smithi063 ceph-mon[31150]: from='osd.9 [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285]' entity='osd.9' 2024-09-21T06:24:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:37 smithi063 ceph-mon[31150]: Detected new or changed devices on smithi063 2024-09-21T06:24:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:38.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:38.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:37 smithi063 ceph-mon[31150]: Adjusting osd_memory_target on smithi063 to 4272M 2024-09-21T06:24:38.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:38.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:38.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:24:38.084 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:37 smithi175 ceph-mon[34510]: from='osd.9 [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-21T06:24:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:37 smithi175 ceph-mon[34510]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T06:24:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:24:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:24:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:37 smithi175 ceph-mon[34510]: from='osd.9 [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285]' entity='osd.9' 2024-09-21T06:24:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:37 smithi175 ceph-mon[34510]: Detected new or changed devices on smithi063 2024-09-21T06:24:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:38.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:38.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:38.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:24:38.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:37 smithi175 ceph-mon[34510]: Adjusting osd_memory_target on smithi063 to 4272M 2024-09-21T06:24:38.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:38.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:38.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:24:38.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.225+0000 7fb839f1d640 1 -- 172.21.15.71:0/1944731645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb834109e00 msgr2=0x7fb834110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.225+0000 7fb839f1d640 1 --2- 172.21.15.71:0/1944731645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb834109e00 0x7fb834110630 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb82c009ca0 tx=0x7fb82c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:24:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.225+0000 7fb839f1d640 1 -- 172.21.15.71:0/1944731645 shutdown_connections 2024-09-21T06:24:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.225+0000 7fb839f1d640 1 --2- 172.21.15.71:0/1944731645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb834109e00 0x7fb834110630 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.225+0000 7fb839f1d640 1 --2- 172.21.15.71:0/1944731645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8341094b0 0x7fb8341098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.225+0000 7fb839f1d640 1 --2- 172.21.15.71:0/1944731645 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb834101f70 0x7fb834102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.225+0000 7fb839f1d640 1 -- 172.21.15.71:0/1944731645 >> 172.21.15.71:0/1944731645 conn(0x7fb834077c60 msgr2=0x7fb8340780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.225+0000 7fb839f1d640 1 -- 172.21.15.71:0/1944731645 shutdown_connections 2024-09-21T06:24:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.225+0000 7fb839f1d640 1 -- 172.21.15.71:0/1944731645 wait complete. 2024-09-21T06:24:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.226+0000 7fb839f1d640 1 Processor -- start 2024-09-21T06:24:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.226+0000 7fb839f1d640 1 -- start start 2024-09-21T06:24:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.226+0000 7fb839f1d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb834101f70 0x7fb83419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.226+0000 7fb839f1d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8341094b0 0x7fb83419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.226+0000 7fb839f1d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb834109e00 0x7fb83419fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.226+0000 7fb839f1d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb834113ac0 con 0x7fb834101f70 2024-09-21T06:24:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.226+0000 7fb839f1d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb834113940 con 0x7fb834109e00 2024-09-21T06:24:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.226+0000 7fb839f1d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb834113c40 con 0x7fb8341094b0 2024-09-21T06:24:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.226+0000 7fb833fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb834109e00 0x7fb83419fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.227+0000 7fb833fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb834109e00 0x7fb83419fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44856/0 (socket says 172.21.15.71:44856) 2024-09-21T06:24:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.227+0000 7fb8337fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb834101f70 0x7fb83419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.227+0000 7fb833fff640 1 -- 172.21.15.71:0/3488860928 learned_addr learned my addr 172.21.15.71:0/3488860928 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-21T06:24:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.227+0000 7fb832ffd640 1 --2- 172.21.15.71:0/3488860928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8341094b0 0x7fb83419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.227+0000 7fb833fff640 1 -- 172.21.15.71:0/3488860928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8341094b0 msgr2=0x7fb83419aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.227+0000 7fb833fff640 1 --2- 172.21.15.71:0/3488860928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8341094b0 0x7fb83419aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.227+0000 7fb833fff640 1 -- 172.21.15.71:0/3488860928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb834101f70 msgr2=0x7fb83419a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.227+0000 7fb833fff640 1 --2- 172.21.15.71:0/3488860928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb834101f70 0x7fb83419a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.227+0000 7fb833fff640 1 -- 172.21.15.71:0/3488860928 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8341a03e0 con 0x7fb834109e00 2024-09-21T06:24:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.227+0000 7fb8337fe640 1 --2- 172.21.15.71:0/3488860928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb834101f70 0x7fb83419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:24:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.227+0000 7fb833fff640 1 --2- 172.21.15.71:0/3488860928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb834109e00 0x7fb83419fcb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb82c005cc0 tx=0x7fb82c031700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.227+0000 7fb830ff9640 1 -- 172.21.15.71:0/3488860928 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82c003b70 con 0x7fb834109e00 2024-09-21T06:24:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.227+0000 7fb839f1d640 1 -- 172.21.15.71:0/3488860928 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8341a0670 con 0x7fb834109e00 2024-09-21T06:24:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.227+0000 7fb830ff9640 1 -- 172.21.15.71:0/3488860928 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb82c0318f0 con 0x7fb834109e00 2024-09-21T06:24:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.227+0000 7fb830ff9640 1 -- 172.21.15.71:0/3488860928 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82c02f950 con 0x7fb834109e00 2024-09-21T06:24:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.227+0000 7fb839f1d640 1 -- 172.21.15.71:0/3488860928 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8341a6e30 con 0x7fb834109e00 2024-09-21T06:24:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.228+0000 7fb839f1d640 1 -- 172.21.15.71:0/3488860928 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb83406ac50 con 0x7fb834109e00 2024-09-21T06:24:38.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.230+0000 7fb830ff9640 1 -- 172.21.15.71:0/3488860928 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fb82c004b40 con 0x7fb834109e00 2024-09-21T06:24:38.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.231+0000 7fb830ff9640 1 --2- 172.21.15.71:0/3488860928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb81c0b6560 0x7fb81c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:38.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.231+0000 7fb830ff9640 1 -- 172.21.15.71:0/3488860928 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6476+0+0 (secure 0 0 0) 0x7fb82c107ed0 con 0x7fb834109e00 2024-09-21T06:24:38.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.231+0000 7fb8337fe640 1 --2- 172.21.15.71:0/3488860928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb81c0b6560 0x7fb81c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:38.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.232+0000 7fb8337fe640 1 --2- 172.21.15.71:0/3488860928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb81c0b6560 0x7fb81c0b8a70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb828009fc0 tx=0x7fb828005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:38.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.234+0000 7fb830ff9640 1 -- 172.21.15.71:0/3488860928 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb82c0cee70 con 0x7fb834109e00 2024-09-21T06:24:38.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:38.427+0000 7fb839f1d640 1 -- 172.21.15.71:0/3488860928 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb834063800 con 0x7fb81c0b6560 2024-09-21T06:24:39.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:38 smithi063 ceph-mon[31150]: purged_snaps scrub starts 2024-09-21T06:24:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:38 smithi063 ceph-mon[31150]: purged_snaps scrub ok 2024-09-21T06:24:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:24:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:38 smithi063 ceph-mon[31150]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:38 smithi063 ceph-mon[31150]: osd.9 [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285] boot 2024-09-21T06:24:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:38 smithi063 ceph-mon[31150]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T06:24:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:24:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:38 smithi063 ceph-mon[31150]: from='client.24530 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:24:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:24:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:24:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:38 smithi175 ceph-mon[34510]: purged_snaps scrub starts 2024-09-21T06:24:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:38 smithi175 ceph-mon[34510]: purged_snaps scrub ok 2024-09-21T06:24:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:24:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:38 smithi175 ceph-mon[34510]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:38 smithi175 ceph-mon[34510]: osd.9 [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285] boot 2024-09-21T06:24:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:38 smithi175 ceph-mon[34510]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T06:24:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:24:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:38 smithi175 ceph-mon[34510]: from='client.24530 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:24:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:24:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:24:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:39.134 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:38 smithi071 ceph-mon[34844]: purged_snaps scrub starts 2024-09-21T06:24:39.134 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:38 smithi071 ceph-mon[34844]: purged_snaps scrub ok 2024-09-21T06:24:39.134 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:24:39.134 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:38 smithi071 ceph-mon[34844]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:24:39.135 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:38 smithi071 ceph-mon[34844]: osd.9 [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285] boot 2024-09-21T06:24:39.135 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:38 smithi071 ceph-mon[34844]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T06:24:39.135 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:24:39.135 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:38 smithi071 ceph-mon[34844]: from='client.24530 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:24:39.135 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:24:39.135 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:24:39.135 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:40.451 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:40 smithi071 ceph-mon[34844]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T06:24:40.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:40 smithi063 ceph-mon[31150]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T06:24:40.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:40 smithi175 ceph-mon[34510]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T06:24:41.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:41 smithi071 ceph-mon[34844]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:41.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:41 smithi071 ceph-mon[34844]: from='client.? 172.21.15.71:0/1470341650' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "99965496-91ee-4eef-9f2e-8f9c8dc54f39"} : dispatch 2024-09-21T06:24:41.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:41 smithi071 ceph-mon[34844]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "99965496-91ee-4eef-9f2e-8f9c8dc54f39"} : dispatch 2024-09-21T06:24:41.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:41 smithi071 ceph-mon[34844]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99965496-91ee-4eef-9f2e-8f9c8dc54f39"}]': finished 2024-09-21T06:24:41.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:41 smithi071 ceph-mon[34844]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T06:24:41.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:41 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:24:41.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:41 smithi063 ceph-mon[31150]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:41.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:41 smithi063 ceph-mon[31150]: from='client.? 172.21.15.71:0/1470341650' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "99965496-91ee-4eef-9f2e-8f9c8dc54f39"} : dispatch 2024-09-21T06:24:41.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:41 smithi063 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "99965496-91ee-4eef-9f2e-8f9c8dc54f39"} : dispatch 2024-09-21T06:24:41.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:41 smithi063 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99965496-91ee-4eef-9f2e-8f9c8dc54f39"}]': finished 2024-09-21T06:24:41.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:41 smithi063 ceph-mon[31150]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T06:24:41.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:41 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:24:41.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:41 smithi175 ceph-mon[34510]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:41.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:41 smithi175 ceph-mon[34510]: from='client.? 172.21.15.71:0/1470341650' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "99965496-91ee-4eef-9f2e-8f9c8dc54f39"} : dispatch 2024-09-21T06:24:41.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:41 smithi175 ceph-mon[34510]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "99965496-91ee-4eef-9f2e-8f9c8dc54f39"} : dispatch 2024-09-21T06:24:41.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:41 smithi175 ceph-mon[34510]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99965496-91ee-4eef-9f2e-8f9c8dc54f39"}]': finished 2024-09-21T06:24:41.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:41 smithi175 ceph-mon[34510]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T06:24:41.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:41 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:24:42.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:42 smithi071 ceph-mon[34844]: from='client.? 172.21.15.71:0/3623448851' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:24:42.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:42 smithi063 ceph-mon[31150]: from='client.? 172.21.15.71:0/3623448851' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:24:42.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:42 smithi175 ceph-mon[34510]: from='client.? 172.21.15.71:0/3623448851' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:24:43.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:43 smithi071 ceph-mon[34844]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:43.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:43 smithi063 ceph-mon[31150]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:43.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:43 smithi175 ceph-mon[34510]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:45.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:45 smithi071 ceph-mon[34844]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:45.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:45 smithi063 ceph-mon[31150]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:45.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:45 smithi175 ceph-mon[34510]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:47.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:47 smithi071 ceph-mon[34844]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:47.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:47 smithi063 ceph-mon[31150]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:47.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:47 smithi175 ceph-mon[34510]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:49.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:49 smithi071 ceph-mon[34844]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:49.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:49 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T06:24:49.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:49 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:49.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:49 smithi063 ceph-mon[31150]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:49.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:49 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T06:24:49.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:49 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:49.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:49 smithi175 ceph-mon[34510]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:49.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:49 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T06:24:49.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:49 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:50.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:50 smithi071 ceph-mon[34844]: Deploying daemon osd.10 on smithi071 2024-09-21T06:24:50.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:50 smithi063 ceph-mon[31150]: Deploying daemon osd.10 on smithi071 2024-09-21T06:24:50.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:50 smithi175 ceph-mon[34510]: Deploying daemon osd.10 on smithi071 2024-09-21T06:24:51.406 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:51 smithi071 ceph-mon[34844]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:51.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:51 smithi063 ceph-mon[31150]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:51.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:51 smithi175 ceph-mon[34510]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:53 smithi071 ceph-mon[34844]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:53.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:53 smithi063 ceph-mon[31150]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:53.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:53 smithi175 ceph-mon[34510]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:55.248 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:55 smithi071 ceph-mon[34844]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:55.248 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:55 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:55.248 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:55 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:55.248 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:55 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:55.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:55 smithi063 ceph-mon[31150]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:55.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:55 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:55.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:55 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:55.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:55 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:55.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:55 smithi175 ceph-mon[34510]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:55.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:55 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:55.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:55 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:55.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:55 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:57.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:57 smithi071 ceph-mon[34844]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:57.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:57 smithi063 ceph-mon[31150]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:57.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:57 smithi175 ceph-mon[34510]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:58.875 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 10 on host 'smithi071' 2024-09-21T06:24:58.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:58.872+0000 7fb830ff9640 1 -- 172.21.15.71:0/3488860928 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fb834063800 con 0x7fb81c0b6560 2024-09-21T06:24:58.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:58.875+0000 7fb839f1d640 1 -- 172.21.15.71:0/3488860928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb81c0b6560 msgr2=0x7fb81c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:58.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:58.875+0000 7fb839f1d640 1 --2- 172.21.15.71:0/3488860928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb81c0b6560 0x7fb81c0b8a70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb828009fc0 tx=0x7fb828005f90 comp rx=0 tx=0).stop 2024-09-21T06:24:58.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:58.875+0000 7fb839f1d640 1 -- 172.21.15.71:0/3488860928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb834109e00 msgr2=0x7fb83419fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:58.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:58.875+0000 7fb839f1d640 1 --2- 172.21.15.71:0/3488860928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb834109e00 0x7fb83419fcb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb82c005cc0 tx=0x7fb82c031700 comp rx=0 tx=0).stop 2024-09-21T06:24:58.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:58.875+0000 7fb839f1d640 1 -- 172.21.15.71:0/3488860928 shutdown_connections 2024-09-21T06:24:58.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:58.875+0000 7fb839f1d640 1 --2- 172.21.15.71:0/3488860928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb834109e00 0x7fb83419fcb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:58.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:58.875+0000 7fb839f1d640 1 --2- 172.21.15.71:0/3488860928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb81c0b6560 0x7fb81c0b8a70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:58.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:58.875+0000 7fb839f1d640 1 --2- 172.21.15.71:0/3488860928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8341094b0 0x7fb83419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:58.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:58.875+0000 7fb839f1d640 1 --2- 172.21.15.71:0/3488860928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb834101f70 0x7fb83419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:58.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:58.875+0000 7fb839f1d640 1 -- 172.21.15.71:0/3488860928 >> 172.21.15.71:0/3488860928 conn(0x7fb834077c60 msgr2=0x7fb8341074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:58.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:58.875+0000 7fb839f1d640 1 -- 172.21.15.71:0/3488860928 shutdown_connections 2024-09-21T06:24:58.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:24:58.875+0000 7fb839f1d640 1 -- 172.21.15.71:0/3488860928 wait complete. 2024-09-21T06:24:59.244 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:59 smithi071 ceph-mon[34844]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:59.244 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:59 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:59.244 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:59 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:59.244 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:59 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:59.244 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:59 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:24:59.244 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:59 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:59.244 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:59 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:59.244 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:59 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:59.244 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:24:59 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:59.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:59 smithi063 ceph-mon[31150]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:59.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:59 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:59.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:59 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:59.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:59 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:59.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:59 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:24:59.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:59 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:59.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:59 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:59.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:59 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:59.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:24:59 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:59.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:59 smithi175 ceph-mon[34510]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:24:59.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:59 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:59.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:59 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:59.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:59 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:59.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:59 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:24:59.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:59 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:59.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:59 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:59.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:59 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:59.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:24:59 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:24:59.609 DEBUG:teuthology.orchestra.run.smithi071:osd.10> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T06:24:59.611 INFO:tasks.cephadm:Deploying osd.11 on smithi175 with /dev/vg_nvme/lv_1... 2024-09-21T06:24:59.611 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T06:24:59.867 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:25:01.015 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:25:00 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:25:00.853+0000 7fed57a5d640 -1 osd.10 0 log_to_monitors true 2024-09-21T06:25:01.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:01 smithi071 ceph-mon[34844]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:25:01.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:01 smithi071 ceph-mon[34844]: from='osd.10 [v2:172.21.15.71:6824/3297929438,v1:172.21.15.71:6825/3297929438]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:25:01.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:01 smithi071 ceph-mon[34844]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:25:01.311 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:01 smithi175 ceph-mon[34510]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:25:01.311 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:01 smithi175 ceph-mon[34510]: from='osd.10 [v2:172.21.15.71:6824/3297929438,v1:172.21.15.71:6825/3297929438]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:25:01.311 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:01 smithi175 ceph-mon[34510]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:25:01.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:01 smithi063 ceph-mon[31150]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:25:01.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:01 smithi063 ceph-mon[31150]: from='osd.10 [v2:172.21.15.71:6824/3297929438,v1:172.21.15.71:6825/3297929438]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:25:01.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:01 smithi063 ceph-mon[31150]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:25:02.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:02 smithi063 ceph-mon[31150]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T06:25:02.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:02 smithi063 ceph-mon[31150]: from='osd.10 [v2:172.21.15.71:6824/3297929438,v1:172.21.15.71:6825/3297929438]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:25:02.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:02 smithi063 ceph-mon[31150]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T06:25:02.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:02 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:25:02.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:02 smithi063 ceph-mon[31150]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:25:02.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:02 smithi063 ceph-mon[31150]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-21T06:25:02.336 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:02 smithi175 ceph-mon[34510]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T06:25:02.336 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:02 smithi175 ceph-mon[34510]: from='osd.10 [v2:172.21.15.71:6824/3297929438,v1:172.21.15.71:6825/3297929438]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:25:02.336 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:02 smithi175 ceph-mon[34510]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T06:25:02.336 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:02 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:25:02.336 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:02 smithi175 ceph-mon[34510]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:25:02.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:02 smithi175 ceph-mon[34510]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-21T06:25:02.456 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:02 smithi071 ceph-mon[34844]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T06:25:02.456 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:02 smithi071 ceph-mon[34844]: from='osd.10 [v2:172.21.15.71:6824/3297929438,v1:172.21.15.71:6825/3297929438]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:25:02.456 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:02 smithi071 ceph-mon[34844]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T06:25:02.456 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:02 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:25:02.456 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:02 smithi071 ceph-mon[34844]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-21T06:25:02.456 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:02 smithi071 ceph-mon[34844]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-21T06:25:02.627 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:25:02.654 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi175:vg_nvme/lv_1 2024-09-21T06:25:02.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:25:02 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:25:02.457+0000 7fed539df640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T06:25:02.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:25:02 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:25:02.472+0000 7fed4b7d5640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:25:02.905 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:25:03.286 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:03 smithi175 ceph-mon[34510]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:25:03.286 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:03 smithi175 ceph-mon[34510]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T06:25:03.286 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:03 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:25:03.286 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:03 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:25:03.286 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:03 smithi175 ceph-mon[34510]: from='osd.10 ' entity='osd.10' 2024-09-21T06:25:03.286 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:03 smithi175 ceph-mon[34510]: Detected new or changed devices on smithi071 2024-09-21T06:25:03.286 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:03 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:03.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:03 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:03.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:03 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:03.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:03 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:03.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:03 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:03.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:03 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:03.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:03 smithi175 ceph-mon[34510]: Adjusting osd_memory_target on smithi071 to 4272M 2024-09-21T06:25:03.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:03 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:03.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:03 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:03.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:03 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:25:03.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:03 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:03.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:03 smithi063 ceph-mon[31150]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:25:03.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:03 smithi063 ceph-mon[31150]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T06:25:03.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:03 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:25:03.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:03 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:25:03.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:03 smithi063 ceph-mon[31150]: from='osd.10 ' entity='osd.10' 2024-09-21T06:25:03.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:03 smithi063 ceph-mon[31150]: Detected new or changed devices on smithi071 2024-09-21T06:25:03.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:03 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:03.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:03 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:03.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:03 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:03.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:03 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:03.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:03 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:03.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:03 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:03.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:03 smithi063 ceph-mon[31150]: Adjusting osd_memory_target on smithi071 to 4272M 2024-09-21T06:25:03.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:03 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:03.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:03 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:03.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:03 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:25:03.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:03 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:03.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.379+0000 7fced7ebd640 1 -- 172.21.15.175:0/2667391086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fced0105310 msgr2=0x7fced010d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:03.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.379+0000 7fced7ebd640 1 --2- 172.21.15.175:0/2667391086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fced0105310 0x7fced010d860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009900 tx=0x7fcec002a410 comp rx=0 tx=0).stop 2024-09-21T06:25:03.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.379+0000 7fced7ebd640 1 -- 172.21.15.175:0/2667391086 shutdown_connections 2024-09-21T06:25:03.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.379+0000 7fced7ebd640 1 --2- 172.21.15.175:0/2667391086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fced010de20 0x7fced0110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:03.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.379+0000 7fced7ebd640 1 --2- 172.21.15.175:0/2667391086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fced0105310 0x7fced010d860 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:03.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.379+0000 7fced7ebd640 1 --2- 172.21.15.175:0/2667391086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fced01049c0 0x7fced0104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:03.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.379+0000 7fced7ebd640 1 -- 172.21.15.175:0/2667391086 >> 172.21.15.175:0/2667391086 conn(0x7fced0079730 msgr2=0x7fced0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:03.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.379+0000 7fced7ebd640 1 -- 172.21.15.175:0/2667391086 shutdown_connections 2024-09-21T06:25:03.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.380+0000 7fced7ebd640 1 -- 172.21.15.175:0/2667391086 wait complete. 2024-09-21T06:25:03.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.380+0000 7fced7ebd640 1 Processor -- start 2024-09-21T06:25:03.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.380+0000 7fced7ebd640 1 -- start start 2024-09-21T06:25:03.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.380+0000 7fced7ebd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fced01049c0 0x7fced019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:03.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.380+0000 7fced7ebd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fced0105310 0x7fced019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:03.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.380+0000 7fced7ebd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fced010de20 0x7fced019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:03.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.380+0000 7fced7ebd640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fced0113a80 con 0x7fced0105310 2024-09-21T06:25:03.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.380+0000 7fced7ebd640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fced0113900 con 0x7fced01049c0 2024-09-21T06:25:03.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.380+0000 7fced7ebd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fced0113c00 con 0x7fced010de20 2024-09-21T06:25:03.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.381+0000 7fced645a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fced010de20 0x7fced019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:03.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.381+0000 7fced645a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fced010de20 0x7fced019fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51196/0 (socket says 172.21.15.175:51196) 2024-09-21T06:25:03.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.381+0000 7fced645a640 1 -- 172.21.15.175:0/3485601661 learned_addr learned my addr 172.21.15.175:0/3485601661 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-21T06:25:03.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.381+0000 7fced5c59640 1 --2- 172.21.15.175:0/3485601661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fced01049c0 0x7fced019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:03.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.381+0000 7fced5458640 1 --2- 172.21.15.175:0/3485601661 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fced0105310 0x7fced019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:03.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.381+0000 7fced5c59640 1 -- 172.21.15.175:0/3485601661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fced010de20 msgr2=0x7fced019fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:03.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.381+0000 7fced5c59640 1 --2- 172.21.15.175:0/3485601661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fced010de20 0x7fced019fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:03.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.381+0000 7fced5c59640 1 -- 172.21.15.175:0/3485601661 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fced0105310 msgr2=0x7fced019aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:03.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.381+0000 7fced5c59640 1 --2- 172.21.15.175:0/3485601661 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fced0105310 0x7fced019aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:03.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.381+0000 7fced5c59640 1 -- 172.21.15.175:0/3485601661 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced01a03e0 con 0x7fced01049c0 2024-09-21T06:25:03.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.381+0000 7fced645a640 1 --2- 172.21.15.175:0/3485601661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fced010de20 0x7fced019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:25:03.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.381+0000 7fced5c59640 1 --2- 172.21.15.175:0/3485601661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fced01049c0 0x7fced019a470 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcecc00e9c0 tx=0x7fcecc00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:03.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.381+0000 7fcec6ffd640 1 -- 172.21.15.175:0/3485601661 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00cd80 con 0x7fced01049c0 2024-09-21T06:25:03.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.381+0000 7fcec6ffd640 1 -- 172.21.15.175:0/3485601661 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcecc0108e0 con 0x7fced01049c0 2024-09-21T06:25:03.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.381+0000 7fced7ebd640 1 -- 172.21.15.175:0/3485601661 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced01a06d0 con 0x7fced01049c0 2024-09-21T06:25:03.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.381+0000 7fcec6ffd640 1 -- 172.21.15.175:0/3485601661 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc0187f0 con 0x7fced01049c0 2024-09-21T06:25:03.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.382+0000 7fced7ebd640 1 -- 172.21.15.175:0/3485601661 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced01a6e30 con 0x7fced01049c0 2024-09-21T06:25:03.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.383+0000 7fced7ebd640 1 -- 172.21.15.175:0/3485601661 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fced006c1e0 con 0x7fced01049c0 2024-09-21T06:25:03.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.385+0000 7fcec6ffd640 1 -- 172.21.15.175:0/3485601661 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fcecc049d10 con 0x7fced01049c0 2024-09-21T06:25:03.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.386+0000 7fcec6ffd640 1 --2- 172.21.15.175:0/3485601661 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcebc0b6560 0x7fcebc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:03.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.386+0000 7fcec6ffd640 1 -- 172.21.15.175:0/3485601661 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6942+0+0 (secure 0 0 0) 0x7fcecc0e7260 con 0x7fced01049c0 2024-09-21T06:25:03.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.386+0000 7fced5458640 1 --2- 172.21.15.175:0/3485601661 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcebc0b6560 0x7fcebc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:03.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.387+0000 7fced5458640 1 --2- 172.21.15.175:0/3485601661 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcebc0b6560 0x7fcebc0b8a70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009230 tx=0x7fcec0031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:03.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.388+0000 7fcec6ffd640 1 -- 172.21.15.175:0/3485601661 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcecc0adfb0 con 0x7fced01049c0 2024-09-21T06:25:03.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:03 smithi071 ceph-mon[34844]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:25:03.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:03 smithi071 ceph-mon[34844]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T06:25:03.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:03 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:25:03.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:03 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:25:03.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:03 smithi071 ceph-mon[34844]: from='osd.10 ' entity='osd.10' 2024-09-21T06:25:03.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:03 smithi071 ceph-mon[34844]: Detected new or changed devices on smithi071 2024-09-21T06:25:03.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:03 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:03.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:03 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:03.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:03 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:03 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:03 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:03 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:03 smithi071 ceph-mon[34844]: Adjusting osd_memory_target on smithi071 to 4272M 2024-09-21T06:25:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:03 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:03 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:03 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:25:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:03 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:03.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:03.579+0000 7fced7ebd640 1 -- 172.21.15.175:0/3485601661 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fced0108f50 con 0x7fcebc0b6560 2024-09-21T06:25:04.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:04 smithi175 ceph-mon[34510]: purged_snaps scrub starts 2024-09-21T06:25:04.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:04 smithi175 ceph-mon[34510]: purged_snaps scrub ok 2024-09-21T06:25:04.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:04 smithi175 ceph-mon[34510]: osd.10 [v2:172.21.15.71:6824/3297929438,v1:172.21.15.71:6825/3297929438] boot 2024-09-21T06:25:04.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:04 smithi175 ceph-mon[34510]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T06:25:04.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:04 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:25:04.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:04 smithi175 ceph-mon[34510]: from='client.24557 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:25:04.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:04 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:25:04.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:04 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:25:04.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:04 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:04.110 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:04 smithi175 ceph-mon[34510]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T06:25:04.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:04 smithi063 ceph-mon[31150]: purged_snaps scrub starts 2024-09-21T06:25:04.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:04 smithi063 ceph-mon[31150]: purged_snaps scrub ok 2024-09-21T06:25:04.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:04 smithi063 ceph-mon[31150]: osd.10 [v2:172.21.15.71:6824/3297929438,v1:172.21.15.71:6825/3297929438] boot 2024-09-21T06:25:04.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:04 smithi063 ceph-mon[31150]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T06:25:04.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:04 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:25:04.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:04 smithi063 ceph-mon[31150]: from='client.24557 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:25:04.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:04 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:25:04.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:04 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:25:04.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:04 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:04.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:04 smithi063 ceph-mon[31150]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T06:25:04.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:04 smithi071 ceph-mon[34844]: purged_snaps scrub starts 2024-09-21T06:25:04.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:04 smithi071 ceph-mon[34844]: purged_snaps scrub ok 2024-09-21T06:25:04.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:04 smithi071 ceph-mon[34844]: osd.10 [v2:172.21.15.71:6824/3297929438,v1:172.21.15.71:6825/3297929438] boot 2024-09-21T06:25:04.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:04 smithi071 ceph-mon[34844]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T06:25:04.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:04 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:25:04.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:04 smithi071 ceph-mon[34844]: from='client.24557 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:25:04.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:04 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:25:04.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:04 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:25:04.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:04 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:04.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:04 smithi071 ceph-mon[34844]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T06:25:05.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:05 smithi063 ceph-mon[31150]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:25:05.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:05 smithi063 ceph-mon[31150]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T06:25:05.342 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:05 smithi175 ceph-mon[34510]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:25:05.343 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:05 smithi175 ceph-mon[34510]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T06:25:05.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:05 smithi071 ceph-mon[34844]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:25:05.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:05 smithi071 ceph-mon[34844]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T06:25:07.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:07 smithi063 ceph-mon[31150]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:07.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:07 smithi063 ceph-mon[31150]: from='client.? 172.21.15.175:0/3006515076' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1b26d1a8-91a4-4877-ad1c-18160a1b3b6c"} : dispatch 2024-09-21T06:25:07.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:07 smithi063 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1b26d1a8-91a4-4877-ad1c-18160a1b3b6c"} : dispatch 2024-09-21T06:25:07.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:07 smithi063 ceph-mon[31150]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b26d1a8-91a4-4877-ad1c-18160a1b3b6c"}]': finished 2024-09-21T06:25:07.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:07 smithi063 ceph-mon[31150]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T06:25:07.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:07 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:25:07.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:07 smithi063 ceph-mon[31150]: from='client.? 172.21.15.175:0/1682463619' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:25:07.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:07 smithi175 ceph-mon[34510]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:07.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:07 smithi175 ceph-mon[34510]: from='client.? 172.21.15.175:0/3006515076' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1b26d1a8-91a4-4877-ad1c-18160a1b3b6c"} : dispatch 2024-09-21T06:25:07.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:07 smithi175 ceph-mon[34510]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1b26d1a8-91a4-4877-ad1c-18160a1b3b6c"} : dispatch 2024-09-21T06:25:07.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:07 smithi175 ceph-mon[34510]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b26d1a8-91a4-4877-ad1c-18160a1b3b6c"}]': finished 2024-09-21T06:25:07.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:07 smithi175 ceph-mon[34510]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T06:25:07.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:07 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:25:07.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:07 smithi175 ceph-mon[34510]: from='client.? 172.21.15.175:0/1682463619' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:25:07.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:07 smithi071 ceph-mon[34844]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:07.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:07 smithi071 ceph-mon[34844]: from='client.? 172.21.15.175:0/3006515076' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1b26d1a8-91a4-4877-ad1c-18160a1b3b6c"} : dispatch 2024-09-21T06:25:07.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:07 smithi071 ceph-mon[34844]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1b26d1a8-91a4-4877-ad1c-18160a1b3b6c"} : dispatch 2024-09-21T06:25:07.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:07 smithi071 ceph-mon[34844]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b26d1a8-91a4-4877-ad1c-18160a1b3b6c"}]': finished 2024-09-21T06:25:07.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:07 smithi071 ceph-mon[34844]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T06:25:07.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:07 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:25:07.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:07 smithi071 ceph-mon[34844]: from='client.? 172.21.15.175:0/1682463619' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:25:09.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:09 smithi063 ceph-mon[31150]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-09-21T06:25:09.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:09 smithi175 ceph-mon[34510]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-09-21T06:25:09.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:09 smithi071 ceph-mon[34844]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-09-21T06:25:11.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:11 smithi063 ceph-mon[31150]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-21T06:25:11.344 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:11 smithi175 ceph-mon[34510]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-21T06:25:11.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:11 smithi071 ceph-mon[34844]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-21T06:25:13.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:13 smithi175 ceph-mon[34510]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:25:13.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:13 smithi063 ceph-mon[31150]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:25:13.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:13 smithi071 ceph-mon[34844]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:25:15.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:15 smithi063 ceph-mon[31150]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T06:25:15.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:15 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T06:25:15.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:15 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:15.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:15 smithi175 ceph-mon[34510]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T06:25:15.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:15 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T06:25:15.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:15 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:15 smithi071 ceph-mon[34844]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T06:25:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:15 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T06:25:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:15 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:16.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:16 smithi063 ceph-mon[31150]: Deploying daemon osd.11 on smithi175 2024-09-21T06:25:16.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:16 smithi175 ceph-mon[34510]: Deploying daemon osd.11 on smithi175 2024-09-21T06:25:16.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:16 smithi071 ceph-mon[34844]: Deploying daemon osd.11 on smithi175 2024-09-21T06:25:17.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:17 smithi063 ceph-mon[31150]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:25:17.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:17 smithi175 ceph-mon[34510]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:25:17.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:17 smithi071 ceph-mon[34844]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:25:19.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:19 smithi063 ceph-mon[31150]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T06:25:19.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:19 smithi175 ceph-mon[34510]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T06:25:19.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:19 smithi071 ceph-mon[34844]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T06:25:21.320 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:21 smithi071 ceph-mon[34844]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:21.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:21 smithi063 ceph-mon[31150]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:21.348 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:21 smithi175 ceph-mon[34510]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:22.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:22 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:25:22.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:22 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:22.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:22 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:22.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:22 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:25:22.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:22 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:22.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:22 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:22.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:22 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:25:22.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:22 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:22.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:22 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:23.331 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:23 smithi175 ceph-mon[34510]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:23.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:23 smithi071 ceph-mon[34844]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:23.522 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:23 smithi063 ceph-mon[31150]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:24.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:24.891+0000 7fcec6ffd640 1 -- 172.21.15.175:0/3485601661 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fced0108f50 con 0x7fcebc0b6560 2024-09-21T06:25:24.894 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 11 on host 'smithi175' 2024-09-21T06:25:24.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:24.894+0000 7fced7ebd640 1 -- 172.21.15.175:0/3485601661 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcebc0b6560 msgr2=0x7fcebc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:24.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:24.894+0000 7fced7ebd640 1 --2- 172.21.15.175:0/3485601661 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcebc0b6560 0x7fcebc0b8a70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009230 tx=0x7fcec0031400 comp rx=0 tx=0).stop 2024-09-21T06:25:24.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:24.894+0000 7fced7ebd640 1 -- 172.21.15.175:0/3485601661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fced01049c0 msgr2=0x7fced019a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:24.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:24.894+0000 7fced7ebd640 1 --2- 172.21.15.175:0/3485601661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fced01049c0 0x7fced019a470 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcecc00e9c0 tx=0x7fcecc00ee80 comp rx=0 tx=0).stop 2024-09-21T06:25:24.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:24.894+0000 7fced7ebd640 1 -- 172.21.15.175:0/3485601661 shutdown_connections 2024-09-21T06:25:24.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:24.894+0000 7fced7ebd640 1 --2- 172.21.15.175:0/3485601661 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcebc0b6560 0x7fcebc0b8a70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:24.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:24.894+0000 7fced7ebd640 1 --2- 172.21.15.175:0/3485601661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fced010de20 0x7fced019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:24.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:24.894+0000 7fced7ebd640 1 --2- 172.21.15.175:0/3485601661 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fced0105310 0x7fced019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:24.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:24.894+0000 7fced7ebd640 1 --2- 172.21.15.175:0/3485601661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fced01049c0 0x7fced019a470 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:24.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:24.894+0000 7fced7ebd640 1 -- 172.21.15.175:0/3485601661 >> 172.21.15.175:0/3485601661 conn(0x7fced0079730 msgr2=0x7fced0100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:24.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:24.894+0000 7fced7ebd640 1 -- 172.21.15.175:0/3485601661 shutdown_connections 2024-09-21T06:25:24.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:24.894+0000 7fced7ebd640 1 -- 172.21.15.175:0/3485601661 wait complete. 2024-09-21T06:25:25.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:25 smithi175 ceph-mon[34510]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:25.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:25 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:25.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:25 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:25.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:25 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:25.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:25 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:25:25.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:25 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:25.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:25 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:25:25.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:25 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:25.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:25 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:25.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:25 smithi063 ceph-mon[31150]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:25.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:25 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:25.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:25 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:25.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:25 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:25.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:25 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:25:25.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:25 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:25.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:25 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:25:25.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:25 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:25.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:25 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:25.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:25 smithi071 ceph-mon[34844]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:25.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:25 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:25.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:25 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:25.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:25 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:25.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:25 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:25:25.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:25 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:25.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:25 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:25:25.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:25 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:25.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:25 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:25.628 DEBUG:teuthology.orchestra.run.smithi175:osd.11> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T06:25:25.630 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T06:25:25.630 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T06:25:25.900 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:26.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.455+0000 7fe003fd1640 1 -- 172.21.15.63:0/3971634337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdffc1083a0 msgr2=0x7fdffc1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:26.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.455+0000 7fe003fd1640 1 --2- 172.21.15.63:0/3971634337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdffc1083a0 0x7fdffc1087b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009900 tx=0x7fdff002a410 comp rx=0 tx=0).stop 2024-09-21T06:25:26.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.455+0000 7fe003fd1640 1 -- 172.21.15.63:0/3971634337 shutdown_connections 2024-09-21T06:25:26.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.455+0000 7fe003fd1640 1 --2- 172.21.15.63:0/3971634337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdffc108cf0 0x7fdffc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:26.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.455+0000 7fe003fd1640 1 --2- 172.21.15.63:0/3971634337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdffc1083a0 0x7fdffc1087b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:26.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.455+0000 7fe003fd1640 1 --2- 172.21.15.63:0/3971634337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdffc102a60 0x7fdffc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:26.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.455+0000 7fe003fd1640 1 -- 172.21.15.63:0/3971634337 >> 172.21.15.63:0/3971634337 conn(0x7fdffc079730 msgr2=0x7fdffc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:26.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.455+0000 7fe003fd1640 1 -- 172.21.15.63:0/3971634337 shutdown_connections 2024-09-21T06:25:26.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.455+0000 7fe003fd1640 1 -- 172.21.15.63:0/3971634337 wait complete. 2024-09-21T06:25:26.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.456+0000 7fe003fd1640 1 Processor -- start 2024-09-21T06:25:26.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.456+0000 7fe003fd1640 1 -- start start 2024-09-21T06:25:26.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.456+0000 7fe003fd1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdffc102a60 0x7fdffc19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:26.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.456+0000 7fe003fd1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdffc1083a0 0x7fdffc19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:26.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.456+0000 7fe003fd1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdffc108cf0 0x7fdffc19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:26.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.456+0000 7fe003fd1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdffc112960 con 0x7fdffc108cf0 2024-09-21T06:25:26.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.456+0000 7fe003fd1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdffc1127e0 con 0x7fdffc102a60 2024-09-21T06:25:26.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.456+0000 7fe003fd1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdffc112ae0 con 0x7fdffc1083a0 2024-09-21T06:25:26.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.457+0000 7fe00256e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdffc108cf0 0x7fdffc19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:26.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.457+0000 7fe00256e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdffc108cf0 0x7fdffc19fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38516/0 (socket says 172.21.15.63:38516) 2024-09-21T06:25:26.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.457+0000 7fe00256e640 1 -- 172.21.15.63:0/1203675162 learned_addr learned my addr 172.21.15.63:0/1203675162 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:25:26.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.457+0000 7fe00156c640 1 --2- 172.21.15.63:0/1203675162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdffc1083a0 0x7fdffc19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:26.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.457+0000 7fe001d6d640 1 --2- 172.21.15.63:0/1203675162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdffc102a60 0x7fdffc19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:26.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.457+0000 7fe00256e640 1 -- 172.21.15.63:0/1203675162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdffc1083a0 msgr2=0x7fdffc19aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:26.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.457+0000 7fe00256e640 1 --2- 172.21.15.63:0/1203675162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdffc1083a0 0x7fdffc19aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:26.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.457+0000 7fe00256e640 1 -- 172.21.15.63:0/1203675162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdffc102a60 msgr2=0x7fdffc19a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:26.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.457+0000 7fe00256e640 1 --2- 172.21.15.63:0/1203675162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdffc102a60 0x7fdffc19a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:26.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.457+0000 7fe00256e640 1 -- 172.21.15.63:0/1203675162 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdffc1a03b0 con 0x7fdffc108cf0 2024-09-21T06:25:26.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.457+0000 7fe00256e640 1 --2- 172.21.15.63:0/1203675162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdffc108cf0 0x7fdffc19fd40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdff400cce0 tx=0x7fdff400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:26.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.457+0000 7fdfeeffd640 1 -- 172.21.15.63:0/1203675162 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff400f450 con 0x7fdffc108cf0 2024-09-21T06:25:26.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.457+0000 7fe003fd1640 1 -- 172.21.15.63:0/1203675162 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdffc1a06a0 con 0x7fdffc108cf0 2024-09-21T06:25:26.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.457+0000 7fdfeeffd640 1 -- 172.21.15.63:0/1203675162 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdff400faa0 con 0x7fdffc108cf0 2024-09-21T06:25:26.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.457+0000 7fdfeeffd640 1 -- 172.21.15.63:0/1203675162 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff4018b70 con 0x7fdffc108cf0 2024-09-21T06:25:26.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.457+0000 7fe003fd1640 1 -- 172.21.15.63:0/1203675162 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdffc1a6ec0 con 0x7fdffc108cf0 2024-09-21T06:25:26.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.458+0000 7fe003fd1640 1 -- 172.21.15.63:0/1203675162 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdffc102e70 con 0x7fdffc108cf0 2024-09-21T06:25:26.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.460+0000 7fdfeeffd640 1 -- 172.21.15.63:0/1203675162 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fdff4018d10 con 0x7fdffc108cf0 2024-09-21T06:25:26.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.461+0000 7fdfeeffd640 1 --2- 172.21.15.63:0/1203675162 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdfe80b6590 0x7fdfe80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:26.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.461+0000 7fe001d6d640 1 --2- 172.21.15.63:0/1203675162 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdfe80b6590 0x7fdfe80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:26.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.461+0000 7fdfeeffd640 1 -- 172.21.15.63:0/1203675162 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7024+0+0 (secure 0 0 0) 0x7fdff40e72f0 con 0x7fdffc108cf0 2024-09-21T06:25:26.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.461+0000 7fe001d6d640 1 --2- 172.21.15.63:0/1203675162 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdfe80b6590 0x7fdfe80b8aa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdff8005fd0 tx=0x7fdff8005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:26.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.464+0000 7fdfeeffd640 1 -- 172.21.15.63:0/1203675162 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdff4014030 con 0x7fdffc108cf0 2024-09-21T06:25:26.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.652+0000 7fe003fd1640 1 -- 172.21.15.63:0/1203675162 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fdffc19b630 con 0x7fdffc108cf0 2024-09-21T06:25:26.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.653+0000 7fdfeeffd640 1 -- 172.21.15.63:0/1203675162 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7fdffc19b630 con 0x7fdffc108cf0 2024-09-21T06:25:26.656 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:25:26.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.655+0000 7fe003fd1640 1 -- 172.21.15.63:0/1203675162 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdfe80b6590 msgr2=0x7fdfe80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:26.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.655+0000 7fe003fd1640 1 --2- 172.21.15.63:0/1203675162 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdfe80b6590 0x7fdfe80b8aa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdff8005fd0 tx=0x7fdff8005850 comp rx=0 tx=0).stop 2024-09-21T06:25:26.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.655+0000 7fe003fd1640 1 -- 172.21.15.63:0/1203675162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdffc108cf0 msgr2=0x7fdffc19fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:26.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.655+0000 7fe003fd1640 1 --2- 172.21.15.63:0/1203675162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdffc108cf0 0x7fdffc19fd40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdff400cce0 tx=0x7fdff400a620 comp rx=0 tx=0).stop 2024-09-21T06:25:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.655+0000 7fe003fd1640 1 -- 172.21.15.63:0/1203675162 shutdown_connections 2024-09-21T06:25:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.655+0000 7fe003fd1640 1 --2- 172.21.15.63:0/1203675162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdffc108cf0 0x7fdffc19fd40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.655+0000 7fe003fd1640 1 --2- 172.21.15.63:0/1203675162 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdfe80b6590 0x7fdfe80b8aa0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.655+0000 7fe003fd1640 1 --2- 172.21.15.63:0/1203675162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdffc1083a0 0x7fdffc19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.655+0000 7fe003fd1640 1 --2- 172.21.15.63:0/1203675162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdffc102a60 0x7fdffc19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.655+0000 7fe003fd1640 1 -- 172.21.15.63:0/1203675162 >> 172.21.15.63:0/1203675162 conn(0x7fdffc079730 msgr2=0x7fdffc06b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.655+0000 7fe003fd1640 1 -- 172.21.15.63:0/1203675162 shutdown_connections 2024-09-21T06:25:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:26.655+0000 7fe003fd1640 1 -- 172.21.15.63:0/1203675162 wait complete. 2024-09-21T06:25:26.826 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:25:26 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:25:26.664+0000 7f41467d9640 -1 osd.11 0 log_to_monitors true 2024-09-21T06:25:27.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:27 smithi175 ceph-mon[34510]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:27.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:27 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1203675162' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:25:27.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:27 smithi175 ceph-mon[34510]: from='osd.11 [v2:172.21.15.175:6824/1970094291,v1:172.21.15.175:6825/1970094291]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:25:27.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:27 smithi175 ceph-mon[34510]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:25:27.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:27 smithi063 ceph-mon[31150]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:27.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:27 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1203675162' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:25:27.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:27 smithi063 ceph-mon[31150]: from='osd.11 [v2:172.21.15.175:6824/1970094291,v1:172.21.15.175:6825/1970094291]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:25:27.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:27 smithi063 ceph-mon[31150]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:25:27.467 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1726899903,"num_in_osds":12,"osd_in_since":1726899906,"num_remapped_pgs":0} 2024-09-21T06:25:27.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:27 smithi071 ceph-mon[34844]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:27.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:27 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1203675162' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:25:27.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:27 smithi071 ceph-mon[34844]: from='osd.11 [v2:172.21.15.175:6824/1970094291,v1:172.21.15.175:6825/1970094291]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:25:27.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:27 smithi071 ceph-mon[34844]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:25:28.300 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:28 smithi175 ceph-mon[34510]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T06:25:28.300 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:28 smithi175 ceph-mon[34510]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T06:25:28.300 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:28 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:25:28.300 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:28 smithi175 ceph-mon[34510]: from='osd.11 [v2:172.21.15.175:6824/1970094291,v1:172.21.15.175:6825/1970094291]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:25:28.300 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:28 smithi175 ceph-mon[34510]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:25:28.300 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:25:28 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:25:28.074+0000 7f414275b640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T06:25:28.300 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:25:28 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:25:28.087+0000 7f413e559640 -1 osd.11 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:25:28.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:28 smithi063 ceph-mon[31150]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T06:25:28.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:28 smithi063 ceph-mon[31150]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T06:25:28.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:28 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:25:28.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:28 smithi063 ceph-mon[31150]: from='osd.11 [v2:172.21.15.175:6824/1970094291,v1:172.21.15.175:6825/1970094291]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:25:28.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:28 smithi063 ceph-mon[31150]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:25:28.468 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T06:25:28.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:28 smithi071 ceph-mon[34844]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T06:25:28.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:28 smithi071 ceph-mon[34844]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T06:25:28.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:28 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:25:28.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:28 smithi071 ceph-mon[34844]: from='osd.11 [v2:172.21.15.175:6824/1970094291,v1:172.21.15.175:6825/1970094291]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:25:28.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:28 smithi071 ceph-mon[34844]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T06:25:28.747 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:29.125 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:29 smithi063 ceph-mon[31150]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:29.125 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:29 smithi063 ceph-mon[31150]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T06:25:29.125 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:29 smithi063 ceph-mon[31150]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T06:25:29.125 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:29 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:25:29.125 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:29 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:25:29.125 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:29 smithi063 ceph-mon[31150]: Detected new or changed devices on smithi175 2024-09-21T06:25:29.125 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:29 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:29.125 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:29 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:29.125 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:29 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:29.126 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:29 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:29.126 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:29 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:29.126 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:29 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:29.126 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:29 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:29.126 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:29 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:29.126 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:29 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:25:29.126 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:29 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:29 smithi175 ceph-mon[34510]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:29 smithi175 ceph-mon[34510]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T06:25:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:29 smithi175 ceph-mon[34510]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T06:25:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:29 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:25:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:29 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:25:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:29 smithi175 ceph-mon[34510]: Detected new or changed devices on smithi175 2024-09-21T06:25:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:29 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:29 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:29.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:29 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:29.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:29 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:29.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:29 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:29.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:29 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:29.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:29 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:29.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:29 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:29.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:29 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:25:29.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:29 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:29.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.356+0000 7f8ba6658640 1 -- 172.21.15.63:0/806962966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ba0103190 msgr2=0x7f8ba01035a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:29.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.356+0000 7f8ba6658640 1 --2- 172.21.15.63:0/806962966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ba0103190 0x7f8ba01035a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8b90009900 tx=0x7f8b9002a410 comp rx=0 tx=0).stop 2024-09-21T06:25:29.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.356+0000 7f8ba6658640 1 -- 172.21.15.63:0/806962966 shutdown_connections 2024-09-21T06:25:29.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.356+0000 7f8ba6658640 1 --2- 172.21.15.63:0/806962966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ba0108d50 0x7f8ba010f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:29.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.356+0000 7f8ba6658640 1 --2- 172.21.15.63:0/806962966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ba0108400 0x7f8ba0108810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:29.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.356+0000 7f8ba6658640 1 --2- 172.21.15.63:0/806962966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ba0103190 0x7f8ba01035a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:29.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.356+0000 7f8ba6658640 1 -- 172.21.15.63:0/806962966 >> 172.21.15.63:0/806962966 conn(0x7f8ba0079f90 msgr2=0x7f8ba007a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:29.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.356+0000 7f8ba6658640 1 -- 172.21.15.63:0/806962966 shutdown_connections 2024-09-21T06:25:29.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.356+0000 7f8ba6658640 1 -- 172.21.15.63:0/806962966 wait complete. 2024-09-21T06:25:29.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.357+0000 7f8ba6658640 1 Processor -- start 2024-09-21T06:25:29.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.357+0000 7f8ba6658640 1 -- start start 2024-09-21T06:25:29.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.357+0000 7f8ba6658640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ba0103190 0x7f8ba019a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:29.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.357+0000 7f8ba6658640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ba0108400 0x7f8ba019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:29.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.357+0000 7f8ba6658640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ba0108d50 0x7f8ba019fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:29.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.357+0000 7f8ba6658640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba0112a10 con 0x7f8ba0103190 2024-09-21T06:25:29.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.357+0000 7f8ba6658640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba0112890 con 0x7f8ba0108d50 2024-09-21T06:25:29.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.357+0000 7f8ba6658640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba0112b90 con 0x7f8ba0108400 2024-09-21T06:25:29.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.357+0000 7f8b9ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ba0103190 0x7f8ba019a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:29.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.357+0000 7f8b9ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ba0103190 0x7f8ba019a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38536/0 (socket says 172.21.15.63:38536) 2024-09-21T06:25:29.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.357+0000 7f8b9ffff640 1 -- 172.21.15.63:0/210972406 learned_addr learned my addr 172.21.15.63:0/210972406 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:25:29.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.357+0000 7f8b97fff640 1 --2- 172.21.15.63:0/210972406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ba0108400 0x7f8ba019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:29.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.357+0000 7f8ba4bf5640 1 --2- 172.21.15.63:0/210972406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ba0108d50 0x7f8ba019fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:29.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.358+0000 7f8b9ffff640 1 -- 172.21.15.63:0/210972406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ba0108400 msgr2=0x7f8ba019ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:29.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.358+0000 7f8b9ffff640 1 --2- 172.21.15.63:0/210972406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ba0108400 0x7f8ba019ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:29.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.358+0000 7f8b9ffff640 1 -- 172.21.15.63:0/210972406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ba0108d50 msgr2=0x7f8ba019fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:29.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.358+0000 7f8b9ffff640 1 --2- 172.21.15.63:0/210972406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ba0108d50 0x7f8ba019fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:29.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.358+0000 7f8b9ffff640 1 -- 172.21.15.63:0/210972406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba01a04e0 con 0x7f8ba0103190 2024-09-21T06:25:29.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.358+0000 7f8ba4bf5640 1 --2- 172.21.15.63:0/210972406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ba0108d50 0x7f8ba019fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:29.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.358+0000 7f8b9ffff640 1 --2- 172.21.15.63:0/210972406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ba0103190 0x7f8ba019a570 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8b90005940 tx=0x7f8b900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:29.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.358+0000 7f8b9dffb640 1 -- 172.21.15.63:0/210972406 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9003f030 con 0x7f8ba0103190 2024-09-21T06:25:29.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.358+0000 7f8ba6658640 1 -- 172.21.15.63:0/210972406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba01a0770 con 0x7f8ba0103190 2024-09-21T06:25:29.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.358+0000 7f8b9dffb640 1 -- 172.21.15.63:0/210972406 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b90003cb0 con 0x7f8ba0103190 2024-09-21T06:25:29.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.358+0000 7f8b9dffb640 1 -- 172.21.15.63:0/210972406 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b90035070 con 0x7f8ba0103190 2024-09-21T06:25:29.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.358+0000 7f8ba6658640 1 -- 172.21.15.63:0/210972406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba01a6f30 con 0x7f8ba0103190 2024-09-21T06:25:29.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.359+0000 7f8ba6658640 1 -- 172.21.15.63:0/210972406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba0103f10 con 0x7f8ba0103190 2024-09-21T06:25:29.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.362+0000 7f8b9dffb640 1 -- 172.21.15.63:0/210972406 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f8b90042030 con 0x7f8ba0103190 2024-09-21T06:25:29.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.362+0000 7f8b9dffb640 1 --2- 172.21.15.63:0/210972406 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8b8c0b6560 0x7f8b8c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:29.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.363+0000 7f8b97fff640 1 --2- 172.21.15.63:0/210972406 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8b8c0b6560 0x7f8b8c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:29.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.363+0000 7f8b9dffb640 1 -- 172.21.15.63:0/210972406 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f8b90107ae0 con 0x7f8ba0103190 2024-09-21T06:25:29.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.363+0000 7f8b97fff640 1 --2- 172.21.15.63:0/210972406 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8b8c0b6560 0x7f8b8c0b8a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8ba006b160 tx=0x7f8b8800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:29.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.366+0000 7f8b9dffb640 1 -- 172.21.15.63:0/210972406 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8b900ce740 con 0x7f8ba0103190 2024-09-21T06:25:29.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:29 smithi071 ceph-mon[34844]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:29.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:29 smithi071 ceph-mon[34844]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T06:25:29.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:29 smithi071 ceph-mon[34844]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T06:25:29.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:29 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:25:29.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:29 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:25:29.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:29 smithi071 ceph-mon[34844]: Detected new or changed devices on smithi175 2024-09-21T06:25:29.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:29 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:29.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:29 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:29.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:29 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:29.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:29 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:29.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:29 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:29.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:29 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:25:29.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:29 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:29.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:29 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:29.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:29 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:25:29.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:29 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:29.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.555+0000 7f8ba6658640 1 -- 172.21.15.63:0/210972406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f8ba01035a0 con 0x7f8ba0103190 2024-09-21T06:25:29.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.556+0000 7f8b9dffb640 1 -- 172.21.15.63:0/210972406 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7f8b900d2b20 con 0x7f8ba0103190 2024-09-21T06:25:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:25:29.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.558+0000 7f8ba6658640 1 -- 172.21.15.63:0/210972406 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8b8c0b6560 msgr2=0x7f8b8c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:29.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.558+0000 7f8ba6658640 1 --2- 172.21.15.63:0/210972406 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8b8c0b6560 0x7f8b8c0b8a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8ba006b160 tx=0x7f8b8800b390 comp rx=0 tx=0).stop 2024-09-21T06:25:29.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.558+0000 7f8ba6658640 1 -- 172.21.15.63:0/210972406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ba0103190 msgr2=0x7f8ba019a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:29.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.558+0000 7f8ba6658640 1 --2- 172.21.15.63:0/210972406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ba0103190 0x7f8ba019a570 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8b90005940 tx=0x7f8b900042f0 comp rx=0 tx=0).stop 2024-09-21T06:25:29.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.558+0000 7f8ba6658640 1 -- 172.21.15.63:0/210972406 shutdown_connections 2024-09-21T06:25:29.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.558+0000 7f8ba6658640 1 --2- 172.21.15.63:0/210972406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ba0108d50 0x7f8ba019fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:29.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.558+0000 7f8ba6658640 1 --2- 172.21.15.63:0/210972406 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8b8c0b6560 0x7f8b8c0b8a70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:29.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.558+0000 7f8ba6658640 1 --2- 172.21.15.63:0/210972406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ba0108400 0x7f8ba019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:29.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.558+0000 7f8ba6658640 1 --2- 172.21.15.63:0/210972406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ba0103190 0x7f8ba019a570 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:29.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.558+0000 7f8ba6658640 1 -- 172.21.15.63:0/210972406 >> 172.21.15.63:0/210972406 conn(0x7f8ba0079f90 msgr2=0x7f8ba01012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:29.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.558+0000 7f8ba6658640 1 -- 172.21.15.63:0/210972406 shutdown_connections 2024-09-21T06:25:29.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:29.558+0000 7f8ba6658640 1 -- 172.21.15.63:0/210972406 wait complete. 2024-09-21T06:25:30.314 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:30 smithi063 ceph-mon[31150]: purged_snaps scrub starts 2024-09-21T06:25:30.314 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:30 smithi063 ceph-mon[31150]: purged_snaps scrub ok 2024-09-21T06:25:30.314 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:30 smithi063 ceph-mon[31150]: Adjusting osd_memory_target on smithi175 to 4272M 2024-09-21T06:25:30.314 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:30 smithi063 ceph-mon[31150]: osd.11 [v2:172.21.15.175:6824/1970094291,v1:172.21.15.175:6825/1970094291] boot 2024-09-21T06:25:30.314 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:30 smithi063 ceph-mon[31150]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T06:25:30.315 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:30 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:25:30.315 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:30 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/210972406' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:25:30.345 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":69,"num_osds":12,"num_up_osds":12,"osd_up_since":1726899929,"num_in_osds":12,"osd_in_since":1726899906,"num_remapped_pgs":0} 2024-09-21T06:25:30.345 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:25:30.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:30 smithi175 ceph-mon[34510]: purged_snaps scrub starts 2024-09-21T06:25:30.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:30 smithi175 ceph-mon[34510]: purged_snaps scrub ok 2024-09-21T06:25:30.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:30 smithi175 ceph-mon[34510]: Adjusting osd_memory_target on smithi175 to 4272M 2024-09-21T06:25:30.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:30 smithi175 ceph-mon[34510]: osd.11 [v2:172.21.15.175:6824/1970094291,v1:172.21.15.175:6825/1970094291] boot 2024-09-21T06:25:30.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:30 smithi175 ceph-mon[34510]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T06:25:30.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:30 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:25:30.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:30 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/210972406' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:25:30.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:30 smithi071 ceph-mon[34844]: purged_snaps scrub starts 2024-09-21T06:25:30.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:30 smithi071 ceph-mon[34844]: purged_snaps scrub ok 2024-09-21T06:25:30.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:30 smithi071 ceph-mon[34844]: Adjusting osd_memory_target on smithi175 to 4272M 2024-09-21T06:25:30.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:30 smithi071 ceph-mon[34844]: osd.11 [v2:172.21.15.175:6824/1970094291,v1:172.21.15.175:6825/1970094291] boot 2024-09-21T06:25:30.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:30 smithi071 ceph-mon[34844]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T06:25:30.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:30 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:25:30.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:30 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/210972406' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:25:30.602 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:31.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.134+0000 7f47f4f3a640 1 -- 172.21.15.63:0/2216716813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47f01083d0 msgr2=0x7f47f01087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:31.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.134+0000 7f47f4f3a640 1 --2- 172.21.15.63:0/2216716813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47f01083d0 0x7f47f01087e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009900 tx=0x7f47e402a410 comp rx=0 tx=0).stop 2024-09-21T06:25:31.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.135+0000 7f47f4f3a640 1 -- 172.21.15.63:0/2216716813 shutdown_connections 2024-09-21T06:25:31.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.135+0000 7f47f4f3a640 1 --2- 172.21.15.63:0/2216716813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47f0108d20 0x7f47f010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:31.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.135+0000 7f47f4f3a640 1 --2- 172.21.15.63:0/2216716813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47f01083d0 0x7f47f01087e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:31.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.135+0000 7f47f4f3a640 1 --2- 172.21.15.63:0/2216716813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47f0102ae0 0x7f47f0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:31.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.135+0000 7f47f4f3a640 1 -- 172.21.15.63:0/2216716813 >> 172.21.15.63:0/2216716813 conn(0x7f47f0079760 msgr2=0x7f47f0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:31.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.135+0000 7f47f4f3a640 1 -- 172.21.15.63:0/2216716813 shutdown_connections 2024-09-21T06:25:31.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.135+0000 7f47f4f3a640 1 -- 172.21.15.63:0/2216716813 wait complete. 2024-09-21T06:25:31.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.136+0000 7f47f4f3a640 1 Processor -- start 2024-09-21T06:25:31.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.136+0000 7f47f4f3a640 1 -- start start 2024-09-21T06:25:31.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.136+0000 7f47f4f3a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47f0102ae0 0x7f47f019b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:31.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.136+0000 7f47f4f3a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47f01083d0 0x7f47f019b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:31.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.136+0000 7f47f4f3a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47f0108d20 0x7f47f019bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:31.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.136+0000 7f47f4f3a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f47f0112990 con 0x7f47f01083d0 2024-09-21T06:25:31.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.136+0000 7f47f4f3a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f47f0112810 con 0x7f47f0108d20 2024-09-21T06:25:31.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.136+0000 7f47f4f3a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f47f0112b10 con 0x7f47f0102ae0 2024-09-21T06:25:31.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.136+0000 7f47edd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47f01083d0 0x7f47f019b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:31.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.136+0000 7f47edd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47f01083d0 0x7f47f019b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38564/0 (socket says 172.21.15.63:38564) 2024-09-21T06:25:31.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.136+0000 7f47edd9b640 1 -- 172.21.15.63:0/361593914 learned_addr learned my addr 172.21.15.63:0/361593914 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:25:31.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.136+0000 7f47ee59c640 1 --2- 172.21.15.63:0/361593914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47f0102ae0 0x7f47f019b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:31.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.136+0000 7f47eed9d640 1 --2- 172.21.15.63:0/361593914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47f0108d20 0x7f47f019bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:31.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.137+0000 7f47edd9b640 1 -- 172.21.15.63:0/361593914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47f0102ae0 msgr2=0x7f47f019b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:31.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.137+0000 7f47edd9b640 1 --2- 172.21.15.63:0/361593914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47f0102ae0 0x7f47f019b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:31.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.137+0000 7f47edd9b640 1 -- 172.21.15.63:0/361593914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47f0108d20 msgr2=0x7f47f019bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:31.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.137+0000 7f47edd9b640 1 --2- 172.21.15.63:0/361593914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47f0108d20 0x7f47f019bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:31.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.137+0000 7f47edd9b640 1 -- 172.21.15.63:0/361593914 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f01a6590 con 0x7f47f01083d0 2024-09-21T06:25:31.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.137+0000 7f47edd9b640 1 --2- 172.21.15.63:0/361593914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47f01083d0 0x7f47f019b7c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f47e4006010 tx=0x7f47e4004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:31.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.137+0000 7f47df7fe640 1 -- 172.21.15.63:0/361593914 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e403f030 con 0x7f47f01083d0 2024-09-21T06:25:31.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.137+0000 7f47df7fe640 1 -- 172.21.15.63:0/361593914 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47e4003aa0 con 0x7f47f01083d0 2024-09-21T06:25:31.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.137+0000 7f47f4f3a640 1 -- 172.21.15.63:0/361593914 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f01a6820 con 0x7f47f01083d0 2024-09-21T06:25:31.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.137+0000 7f47df7fe640 1 -- 172.21.15.63:0/361593914 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4035070 con 0x7f47f01083d0 2024-09-21T06:25:31.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.137+0000 7f47f4f3a640 1 -- 172.21.15.63:0/361593914 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f01a6d00 con 0x7f47f01083d0 2024-09-21T06:25:31.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.138+0000 7f47f4f3a640 1 -- 172.21.15.63:0/361593914 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f0103d10 con 0x7f47f01083d0 2024-09-21T06:25:31.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.140+0000 7f47df7fe640 1 -- 172.21.15.63:0/361593914 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f47e4042030 con 0x7f47f01083d0 2024-09-21T06:25:31.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.140+0000 7f47df7fe640 1 --2- 172.21.15.63:0/361593914 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f47d80b6560 0x7f47d80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:31.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.141+0000 7f47ee59c640 1 --2- 172.21.15.63:0/361593914 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f47d80b6560 0x7f47d80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:31.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.141+0000 7f47df7fe640 1 -- 172.21.15.63:0/361593914 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f47e41077e0 con 0x7f47f01083d0 2024-09-21T06:25:31.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.141+0000 7f47ee59c640 1 --2- 172.21.15.63:0/361593914 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f47d80b6560 0x7f47d80b8a70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f47f006c700 tx=0x7f47e000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:31.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.144+0000 7f47df7fe640 1 -- 172.21.15.63:0/361593914 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f47e40d2820 con 0x7f47f01083d0 2024-09-21T06:25:31.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:31 smithi063 ceph-mon[31150]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:31.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:31 smithi063 ceph-mon[31150]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T06:25:31.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.332+0000 7f47f4f3a640 1 -- 172.21.15.63:0/361593914 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47f0102ef0 con 0x7f47f01083d0 2024-09-21T06:25:31.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.333+0000 7f47df7fe640 1 -- 172.21.15.63:0/361593914 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+18740 (secure 0 0 0) 0x7f47f0102ef0 con 0x7f47f01083d0 2024-09-21T06:25:31.335 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:25:31.335 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":70,"fsid":"140899c8-77e1-11ef-baf5-efdc52797490","created":"2024-09-21T06:17:48.089366+0000","modified":"2024-09-21T06:25:30.080467+0000","last_up_change":"2024-09-21T06:25:29.072128+0000","last_in_change":"2024-09-21T06:25:06.097647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:21:36.236868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df4162c1-dd66-4d11-99bc-0ae36ea130f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6803","nonce":2090653772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6805","nonce":2090653772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6809","nonce":2090653772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6807","nonce":2090653772}]},"public_addr":"172.21.15.63:6803/2090653772","cluster_addr":"172.21.15.63:6805/2090653772","heartbeat_back_addr":"172.21.15.63:6809/2090653772","heartbeat_front_addr":"172.21.15.63:6807/2090653772","state":["exists","up"]},{"osd":1,"uuid":"65a12def-9f66-4153-8f1a-2ebfbbfeba99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6801","nonce":1676297548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6803","nonce":1676297548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6807","nonce":1676297548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6805","nonce":1676297548}]},"public_addr":"172.21.15.71:6801/1676297548","cluster_addr":"172.21.15.71:6803/1676297548","heartbeat_back_addr":"172.21.15.71:6807/1676297548","heartbeat_front_addr":"172.21.15.71:6805/1676297548","state":["exists","up"]},{"osd":2,"uuid":"031daa9e-9d4a-4901-95e8-695db5671fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6801","nonce":2356865390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6803","nonce":2356865390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6807","nonce":2356865390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6805","nonce":2356865390}]},"public_addr":"172.21.15.175:6801/2356865390","cluster_addr":"172.21.15.175:6803/2356865390","heartbeat_back_addr":"172.21.15.175:6807/2356865390","heartbeat_front_addr":"172.21.15.175:6805/2356865390","state":["exists","up"]},{"osd":3,"uuid":"75d23a7a-c560-4b26-84a4-74d6772a37ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6811","nonce":31683339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6813","nonce":31683339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6817","nonce":31683339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6815","nonce":31683339}]},"public_addr":"172.21.15.63:6811/31683339","cluster_addr":"172.21.15.63:6813/31683339","heartbeat_back_addr":"172.21.15.63:6817/31683339","heartbeat_front_addr":"172.21.15.63:6815/31683339","state":["exists","up"]},{"osd":4,"uuid":"6aaefd09-93dd-4f21-9b3c-701a7ff97f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6809","nonce":829449898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6811","nonce":829449898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6815","nonce":829449898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6813","nonce":829449898}]},"public_addr":"172.21.15.71:6809/829449898","cluster_addr":"172.21.15.71:6811/829449898","heartbeat_back_addr":"172.21.15.71:6815/829449898","heartbeat_front_addr":"172.21.15.71:6813/829449898","state":["exists","up"]},{"osd":5,"uuid":"91f28121-c94e-4012-b74c-dd4597545e3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6809","nonce":3005600597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6811","nonce":3005600597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6815","nonce":3005600597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6813","nonce":3005600597}]},"public_addr":"172.21.15.175:6809/3005600597","cluster_addr":"172.21.15.175:6811/3005600597","heartbeat_back_addr":"172.21.15.175:6815/3005600597","heartbeat_front_addr":"172.21.15.175:6813/3005600597","state":["exists","up"]},{"osd":6,"uuid":"bda28014-4dca-40f1-bb23-3ef61605c1ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6819","nonce":4044730408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6821","nonce":4044730408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6825","nonce":4044730408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6823","nonce":4044730408}]},"public_addr":"172.21.15.63:6819/4044730408","cluster_addr":"172.21.15.63:6821/4044730408","heartbeat_back_addr":"172.21.15.63:6825/4044730408","heartbeat_front_addr":"172.21.15.63:6823/4044730408","state":["exists","up"]},{"osd":7,"uuid":"a9026588-ccdc-4e6c-b628-1ac8a7dbfa64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6817","nonce":2913027708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6819","nonce":2913027708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6823","nonce":2913027708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6821","nonce":2913027708}]},"public_addr":"172.21.15.71:6817/2913027708","cluster_addr":"172.21.15.71:6819/2913027708","heartbeat_back_addr":"172.21.15.71:6823/2913027708","heartbeat_front_addr":"172.21.15.71:6821/2913027708","state":["exists","up"]},{"osd":8,"uuid":"2e1dacea-483c-4587-8d19-5c77a7b98667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6817","nonce":2058692148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6819","nonce":2058692148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6823","nonce":2058692148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6821","nonce":2058692148}]},"public_addr":"172.21.15.175:6817/2058692148","cluster_addr":"172.21.15.175:6819/2058692148","heartbeat_back_addr":"172.21.15.175:6823/2058692148","heartbeat_front_addr":"172.21.15.175:6821/2058692148","state":["exists","up"]},{"osd":9,"uuid":"7077ba4d-1fce-4197-a556-8b6a859c6f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6827","nonce":3278012285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6829","nonce":3278012285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6833","nonce":3278012285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6831","nonce":3278012285}]},"public_addr":"172.21.15.63:6827/3278012285","cluster_addr":"172.21.15.63:6829/3278012285","heartbeat_back_addr":"172.21.15.63:6833/3278012285","heartbeat_front_addr":"172.21.15.63:6831/3278012285","state":["exists","up"]},{"osd":10,"uuid":"99965496-91ee-4eef-9f2e-8f9c8dc54f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6825","nonce":3297929438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6827","nonce":3297929438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6831","nonce":3297929438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6829","nonce":3297929438}]},"public_addr":"172.21.15.71:6825/3297929438","cluster_addr":"172.21.15.71:6827/3297929438","heartbeat_back_addr":"172.21.15.71:6831/3297929438","heartbeat_front_addr":"172.21.15.71:6829/3297929438","state":["exists","up"]},{"osd":11,"uuid":"1b26d1a8-91a4-4877-ad1c-18160a1b3b6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6825","nonce":1970094291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6827","nonce":1970094291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6831","nonce":1970094291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6829","nonce":1970094291}]},"public_addr":"172.21.15.175:6825/1970094291","cluster_addr":"172.21.15.175:6827/1970094291","heartbeat_back_addr":"172.21.15.175:6831/1970094291","heartbeat_front_addr":"172.21.15.175:6829/1970094291","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:20:43.732676+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:08.957775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:34.157788+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:00.134410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:25.502998+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:51.739501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:18.325642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:44.430626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:10.776017+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:36.482831+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:01.898216+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:27.644941+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/1652196301":"2024-09-22T06:19:37.776447+0000","172.21.15.63:6801/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/2740830999":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6801/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6801/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/2958589237":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/1398493582":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/3529491525":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/363262068":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6800/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/3928056461":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/128321401":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/39222803":"2024-09-22T06:19:37.776447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:25:31.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.336+0000 7f47f4f3a640 1 -- 172.21.15.63:0/361593914 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f47d80b6560 msgr2=0x7f47d80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:31.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.336+0000 7f47f4f3a640 1 --2- 172.21.15.63:0/361593914 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f47d80b6560 0x7f47d80b8a70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f47f006c700 tx=0x7f47e000b390 comp rx=0 tx=0).stop 2024-09-21T06:25:31.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.336+0000 7f47f4f3a640 1 -- 172.21.15.63:0/361593914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47f01083d0 msgr2=0x7f47f019b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:31.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.336+0000 7f47f4f3a640 1 --2- 172.21.15.63:0/361593914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47f01083d0 0x7f47f019b7c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f47e4006010 tx=0x7f47e4004060 comp rx=0 tx=0).stop 2024-09-21T06:25:31.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.336+0000 7f47f4f3a640 1 -- 172.21.15.63:0/361593914 shutdown_connections 2024-09-21T06:25:31.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.336+0000 7f47f4f3a640 1 --2- 172.21.15.63:0/361593914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47f0108d20 0x7f47f019bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:31.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.336+0000 7f47f4f3a640 1 --2- 172.21.15.63:0/361593914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47f01083d0 0x7f47f019b7c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:31.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.336+0000 7f47f4f3a640 1 --2- 172.21.15.63:0/361593914 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f47d80b6560 0x7f47d80b8a70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:31.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.336+0000 7f47f4f3a640 1 --2- 172.21.15.63:0/361593914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47f0102ae0 0x7f47f019b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:31.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.336+0000 7f47f4f3a640 1 -- 172.21.15.63:0/361593914 >> 172.21.15.63:0/361593914 conn(0x7f47f0079760 msgr2=0x7f47f0104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:31.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.336+0000 7f47f4f3a640 1 -- 172.21.15.63:0/361593914 shutdown_connections 2024-09-21T06:25:31.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:31.336+0000 7f47f4f3a640 1 -- 172.21.15.63:0/361593914 wait complete. 2024-09-21T06:25:31.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:31 smithi175 ceph-mon[34510]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:31.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:31 smithi175 ceph-mon[34510]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T06:25:31.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:31 smithi071 ceph-mon[34844]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:25:31.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:31 smithi071 ceph-mon[34844]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T06:25:32.084 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:21:36.236868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:25:32.084 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T06:25:32.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:32 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/361593914' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:25:32.346 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:32.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:32 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/361593914' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:25:32.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:32 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/361593914' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:25:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.844+0000 7efee26be640 1 -- 172.21.15.63:0/3867457763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efedc1083c0 msgr2=0x7efedc1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.844+0000 7efee26be640 1 --2- 172.21.15.63:0/3867457763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efedc1083c0 0x7efedc1087d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efed0009900 tx=0x7efed002a410 comp rx=0 tx=0).stop 2024-09-21T06:25:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.844+0000 7efee26be640 1 -- 172.21.15.63:0/3867457763 shutdown_connections 2024-09-21T06:25:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.844+0000 7efee26be640 1 --2- 172.21.15.63:0/3867457763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efedc108d10 0x7efedc10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.844+0000 7efee26be640 1 --2- 172.21.15.63:0/3867457763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efedc1083c0 0x7efedc1087d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.844+0000 7efee26be640 1 --2- 172.21.15.63:0/3867457763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efedc102a80 0x7efedc102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.844+0000 7efee26be640 1 -- 172.21.15.63:0/3867457763 >> 172.21.15.63:0/3867457763 conn(0x7efedc079740 msgr2=0x7efedc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.844+0000 7efee26be640 1 -- 172.21.15.63:0/3867457763 shutdown_connections 2024-09-21T06:25:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.844+0000 7efee26be640 1 -- 172.21.15.63:0/3867457763 wait complete. 2024-09-21T06:25:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.845+0000 7efee26be640 1 Processor -- start 2024-09-21T06:25:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.845+0000 7efee26be640 1 -- start start 2024-09-21T06:25:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.845+0000 7efee26be640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efedc102a80 0x7efedc199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.845+0000 7efee26be640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efedc1083c0 0x7efedc199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.845+0000 7efee26be640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efedc108d10 0x7efedc19edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.845+0000 7efee26be640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7efedc1129c0 con 0x7efedc102a80 2024-09-21T06:25:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.845+0000 7efee26be640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efedc112840 con 0x7efedc108d10 2024-09-21T06:25:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.845+0000 7efee26be640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efedc112b40 con 0x7efedc1083c0 2024-09-21T06:25:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.846+0000 7efedbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efedc102a80 0x7efedc199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.846+0000 7efedbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efedc102a80 0x7efedc199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38584/0 (socket says 172.21.15.63:38584) 2024-09-21T06:25:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.846+0000 7efedbfff640 1 -- 172.21.15.63:0/2142356113 learned_addr learned my addr 172.21.15.63:0/2142356113 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:25:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.846+0000 7efee0c5b640 1 --2- 172.21.15.63:0/2142356113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efedc108d10 0x7efedc19edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.846+0000 7efedb7fe640 1 --2- 172.21.15.63:0/2142356113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efedc1083c0 0x7efedc199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.846+0000 7efedbfff640 1 -- 172.21.15.63:0/2142356113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efedc1083c0 msgr2=0x7efedc199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.846+0000 7efedbfff640 1 --2- 172.21.15.63:0/2142356113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efedc1083c0 0x7efedc199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.846+0000 7efedbfff640 1 -- 172.21.15.63:0/2142356113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efedc108d10 msgr2=0x7efedc19edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.846+0000 7efedbfff640 1 --2- 172.21.15.63:0/2142356113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efedc108d10 0x7efedc19edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.846+0000 7efedbfff640 1 -- 172.21.15.63:0/2142356113 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efedc19f4e0 con 0x7efedc102a80 2024-09-21T06:25:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.846+0000 7efedbfff640 1 --2- 172.21.15.63:0/2142356113 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efedc102a80 0x7efedc199570 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efecc00c890 tx=0x7efecc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.846+0000 7efed97fa640 1 -- 172.21.15.63:0/2142356113 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc004220 con 0x7efedc102a80 2024-09-21T06:25:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.847+0000 7efed97fa640 1 -- 172.21.15.63:0/2142356113 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efecc0043c0 con 0x7efedc102a80 2024-09-21T06:25:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.847+0000 7efee26be640 1 -- 172.21.15.63:0/2142356113 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efedc19f7d0 con 0x7efedc102a80 2024-09-21T06:25:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.847+0000 7efed97fa640 1 -- 172.21.15.63:0/2142356113 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc004a00 con 0x7efedc102a80 2024-09-21T06:25:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.847+0000 7efee26be640 1 -- 172.21.15.63:0/2142356113 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efedc1a5f30 con 0x7efedc102a80 2024-09-21T06:25:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.848+0000 7efee26be640 1 -- 172.21.15.63:0/2142356113 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efedc103d00 con 0x7efedc102a80 2024-09-21T06:25:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.849+0000 7efed97fa640 1 -- 172.21.15.63:0/2142356113 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7efecc0079b0 con 0x7efedc102a80 2024-09-21T06:25:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.850+0000 7efed97fa640 1 --2- 172.21.15.63:0/2142356113 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efec40b65e0 0x7efec40b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.850+0000 7efedb7fe640 1 --2- 172.21.15.63:0/2142356113 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efec40b65e0 0x7efec40b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.851+0000 7efed97fa640 1 -- 172.21.15.63:0/2142356113 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7efecc0e70b0 con 0x7efedc102a80 2024-09-21T06:25:32.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.851+0000 7efedb7fe640 1 --2- 172.21.15.63:0/2142356113 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efec40b65e0 0x7efec40b8af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efed0000c00 tx=0x7efed0031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:32.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:32.854+0000 7efed97fa640 1 -- 172.21.15.63:0/2142356113 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efecc014030 con 0x7efedc102a80 2024-09-21T06:25:33.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:33.041+0000 7efee26be640 1 -- 172.21.15.63:0/2142356113 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efedc10ab00 con 0x7efedc102a80 2024-09-21T06:25:33.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:33.042+0000 7efed97fa640 1 -- 172.21.15.63:0/2142356113 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7efecc0add70 con 0x7efedc102a80 2024-09-21T06:25:33.044 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-09-21T06:25:33.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:33.044+0000 7efee26be640 1 -- 172.21.15.63:0/2142356113 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efec40b65e0 msgr2=0x7efec40b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:33.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:33.044+0000 7efee26be640 1 --2- 172.21.15.63:0/2142356113 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efec40b65e0 0x7efec40b8af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efed0000c00 tx=0x7efed0031400 comp rx=0 tx=0).stop 2024-09-21T06:25:33.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:33.044+0000 7efee26be640 1 -- 172.21.15.63:0/2142356113 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efedc102a80 msgr2=0x7efedc199570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:33.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:33.044+0000 7efee26be640 1 --2- 172.21.15.63:0/2142356113 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efedc102a80 0x7efedc199570 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efecc00c890 tx=0x7efecc00cd50 comp rx=0 tx=0).stop 2024-09-21T06:25:33.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:33.044+0000 7efee26be640 1 -- 172.21.15.63:0/2142356113 shutdown_connections 2024-09-21T06:25:33.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:33.044+0000 7efee26be640 1 --2- 172.21.15.63:0/2142356113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efedc108d10 0x7efedc19edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:33.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:33.044+0000 7efee26be640 1 --2- 172.21.15.63:0/2142356113 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efec40b65e0 0x7efec40b8af0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:33.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:33.044+0000 7efee26be640 1 --2- 172.21.15.63:0/2142356113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efedc1083c0 0x7efedc199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:33.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:33.044+0000 7efee26be640 1 --2- 172.21.15.63:0/2142356113 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efedc102a80 0x7efedc199570 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:33.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:33.044+0000 7efee26be640 1 -- 172.21.15.63:0/2142356113 >> 172.21.15.63:0/2142356113 conn(0x7efedc079740 msgr2=0x7efedc1053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:33.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:33.044+0000 7efee26be640 1 -- 172.21.15.63:0/2142356113 shutdown_connections 2024-09-21T06:25:33.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:33.044+0000 7efee26be640 1 -- 172.21.15.63:0/2142356113 wait complete. 2024-09-21T06:25:33.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:33 smithi063 ceph-mon[31150]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:33.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:33 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2142356113' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:25:33.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:33 smithi071 ceph-mon[34844]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:33.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:33 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2142356113' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:25:33.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:33 smithi175 ceph-mon[34510]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:33.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:33 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2142356113' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:25:33.793 INFO:tasks.cephadm:Adding mds.a on smithi063 2024-09-21T06:25:33.793 INFO:tasks.cephadm:Adding mds.d on smithi063 2024-09-21T06:25:33.794 INFO:tasks.cephadm:Adding mds.g on smithi063 2024-09-21T06:25:33.794 INFO:tasks.cephadm:Adding mds.j on smithi063 2024-09-21T06:25:33.794 INFO:tasks.cephadm:Adding mds.b on smithi071 2024-09-21T06:25:33.794 INFO:tasks.cephadm:Adding mds.e on smithi071 2024-09-21T06:25:33.794 INFO:tasks.cephadm:Adding mds.h on smithi071 2024-09-21T06:25:33.794 INFO:tasks.cephadm:Adding mds.k on smithi071 2024-09-21T06:25:33.794 INFO:tasks.cephadm:Adding mds.c on smithi175 2024-09-21T06:25:33.794 INFO:tasks.cephadm:Adding mds.f on smithi175 2024-09-21T06:25:33.794 INFO:tasks.cephadm:Adding mds.i on smithi175 2024-09-21T06:25:33.794 INFO:tasks.cephadm:Adding mds.l on smithi175 2024-09-21T06:25:33.794 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi063=a;smithi063=d;smithi063=g;smithi063=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l' 2024-09-21T06:25:34.053 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:25:34.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.553+0000 7fd17fb73640 1 -- 172.21.15.175:0/1991641249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1781094a0 msgr2=0x7fd1781098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:34.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.553+0000 7fd17fb73640 1 --2- 172.21.15.175:0/1991641249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1781094a0 0x7fd1781098b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd168009900 tx=0x7fd16802a410 comp rx=0 tx=0).stop 2024-09-21T06:25:34.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.553+0000 7fd17fb73640 1 -- 172.21.15.175:0/1991641249 shutdown_connections 2024-09-21T06:25:34.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.553+0000 7fd17fb73640 1 --2- 172.21.15.175:0/1991641249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd178109df0 0x7fd178110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:34.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.553+0000 7fd17fb73640 1 --2- 172.21.15.175:0/1991641249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1781094a0 0x7fd1781098b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:34.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.553+0000 7fd17fb73640 1 --2- 172.21.15.175:0/1991641249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd178103b60 0x7fd178103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:34.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.553+0000 7fd17fb73640 1 -- 172.21.15.175:0/1991641249 >> 172.21.15.175:0/1991641249 conn(0x7fd17807b850 msgr2=0x7fd17807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:34.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.553+0000 7fd17fb73640 1 -- 172.21.15.175:0/1991641249 shutdown_connections 2024-09-21T06:25:34.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.553+0000 7fd17fb73640 1 -- 172.21.15.175:0/1991641249 wait complete. 2024-09-21T06:25:34.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.553+0000 7fd17fb73640 1 Processor -- start 2024-09-21T06:25:34.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.554+0000 7fd17fb73640 1 -- start start 2024-09-21T06:25:34.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.554+0000 7fd17fb73640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd178103b60 0x7fd178075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:34.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.554+0000 7fd17fb73640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1781094a0 0x7fd178075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:34.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.554+0000 7fd17fb73640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd178109df0 0x7fd178076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:34.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.554+0000 7fd17fb73640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd178113af0 con 0x7fd178109df0 2024-09-21T06:25:34.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.554+0000 7fd17fb73640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd178113970 con 0x7fd1781094a0 2024-09-21T06:25:34.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.554+0000 7fd17fb73640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd178113c70 con 0x7fd178103b60 2024-09-21T06:25:34.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.554+0000 7fd17d90f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd178103b60 0x7fd178075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:34.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.554+0000 7fd17d90f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd178103b60 0x7fd178075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37364/0 (socket says 172.21.15.175:37364) 2024-09-21T06:25:34.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.554+0000 7fd17d90f640 1 -- 172.21.15.175:0/817648888 learned_addr learned my addr 172.21.15.175:0/817648888 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-21T06:25:34.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.554+0000 7fd17e110640 1 --2- 172.21.15.175:0/817648888 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd178109df0 0x7fd178076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:34.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.554+0000 7fd17d10e640 1 --2- 172.21.15.175:0/817648888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1781094a0 0x7fd178075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:34.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.554+0000 7fd17d90f640 1 -- 172.21.15.175:0/817648888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1781094a0 msgr2=0x7fd178075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:34.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.554+0000 7fd17d90f640 1 --2- 172.21.15.175:0/817648888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1781094a0 0x7fd178075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:34.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.554+0000 7fd17d90f640 1 -- 172.21.15.175:0/817648888 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd178109df0 msgr2=0x7fd178076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:34.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.554+0000 7fd17d90f640 1 --2- 172.21.15.175:0/817648888 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd178109df0 0x7fd178076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:34.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.554+0000 7fd17d90f640 1 -- 172.21.15.175:0/817648888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1781a87e0 con 0x7fd178103b60 2024-09-21T06:25:34.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.554+0000 7fd17d10e640 1 --2- 172.21.15.175:0/817648888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1781094a0 0x7fd178075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:25:34.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.554+0000 7fd17d90f640 1 --2- 172.21.15.175:0/817648888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd178103b60 0x7fd178075710 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd17400b4a0 tx=0x7fd17400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:34.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.555+0000 7fd16effd640 1 -- 172.21.15.175:0/817648888 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd174014070 con 0x7fd178103b60 2024-09-21T06:25:34.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.555+0000 7fd16effd640 1 -- 172.21.15.175:0/817648888 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd174010ac0 con 0x7fd178103b60 2024-09-21T06:25:34.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.555+0000 7fd16effd640 1 -- 172.21.15.175:0/817648888 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd174017c30 con 0x7fd178103b60 2024-09-21T06:25:34.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.555+0000 7fd17fb73640 1 -- 172.21.15.175:0/817648888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1781a8ad0 con 0x7fd178103b60 2024-09-21T06:25:34.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.555+0000 7fd17fb73640 1 -- 172.21.15.175:0/817648888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1781a9060 con 0x7fd178103b60 2024-09-21T06:25:34.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.556+0000 7fd17fb73640 1 -- 172.21.15.175:0/817648888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd178103f70 con 0x7fd178103b60 2024-09-21T06:25:34.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.557+0000 7fd16effd640 1 -- 172.21.15.175:0/817648888 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fd174017070 con 0x7fd178103b60 2024-09-21T06:25:34.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.558+0000 7fd16effd640 1 --2- 172.21.15.175:0/817648888 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd1640b65e0 0x7fd1640b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:34.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.558+0000 7fd16effd640 1 -- 172.21.15.175:0/817648888 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fd1740e64b0 con 0x7fd178103b60 2024-09-21T06:25:34.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.558+0000 7fd17d10e640 1 --2- 172.21.15.175:0/817648888 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd1640b65e0 0x7fd1640b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:34.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.559+0000 7fd17d10e640 1 --2- 172.21.15.175:0/817648888 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd1640b65e0 0x7fd1640b8af0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd168000c00 tx=0x7fd168031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:34.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.561+0000 7fd16effd640 1 -- 172.21.15.175:0/817648888 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd1740ad110 con 0x7fd178103b60 2024-09-21T06:25:34.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.749+0000 7fd17fb73640 1 -- 172.21.15.175:0/817648888 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi063=a;smithi063=d;smithi063=g;smithi063=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}) -- 0x7fd178063900 con 0x7fd1640b65e0 2024-09-21T06:25:34.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.758+0000 7fd16effd640 1 -- 172.21.15.175:0/817648888 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fd178063900 con 0x7fd1640b65e0 2024-09-21T06:25:34.761 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mds.all update... 2024-09-21T06:25:34.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.760+0000 7fd17fb73640 1 -- 172.21.15.175:0/817648888 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd1640b65e0 msgr2=0x7fd1640b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:34.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.760+0000 7fd17fb73640 1 --2- 172.21.15.175:0/817648888 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd1640b65e0 0x7fd1640b8af0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd168000c00 tx=0x7fd168031400 comp rx=0 tx=0).stop 2024-09-21T06:25:34.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.761+0000 7fd17fb73640 1 -- 172.21.15.175:0/817648888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd178103b60 msgr2=0x7fd178075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:34.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.761+0000 7fd17fb73640 1 --2- 172.21.15.175:0/817648888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd178103b60 0x7fd178075710 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd17400b4a0 tx=0x7fd17400b960 comp rx=0 tx=0).stop 2024-09-21T06:25:34.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.761+0000 7fd17fb73640 1 -- 172.21.15.175:0/817648888 shutdown_connections 2024-09-21T06:25:34.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.761+0000 7fd17fb73640 1 --2- 172.21.15.175:0/817648888 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd178109df0 0x7fd178076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:34.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.761+0000 7fd17fb73640 1 --2- 172.21.15.175:0/817648888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1781094a0 0x7fd178075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:34.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.761+0000 7fd17fb73640 1 --2- 172.21.15.175:0/817648888 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd1640b65e0 0x7fd1640b8af0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:34.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.761+0000 7fd17fb73640 1 --2- 172.21.15.175:0/817648888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd178103b60 0x7fd178075710 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:34.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.761+0000 7fd17fb73640 1 -- 172.21.15.175:0/817648888 >> 172.21.15.175:0/817648888 conn(0x7fd17807b850 msgr2=0x7fd178107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:34.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.761+0000 7fd17fb73640 1 -- 172.21.15.175:0/817648888 shutdown_connections 2024-09-21T06:25:34.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T06:25:34.761+0000 7fd17fb73640 1 -- 172.21.15.175:0/817648888 wait complete. 2024-09-21T06:25:35.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:35 smithi175 ceph-mon[34510]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:35.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:35 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:35.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:35 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:25:35.484 DEBUG:teuthology.orchestra.run.smithi063:mds.a> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T06:25:35.486 DEBUG:teuthology.orchestra.run.smithi063:mds.d> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T06:25:35.509 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:35 smithi063 ceph-mon[31150]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:35.509 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:35 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:35.509 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:35 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:25:35.510 DEBUG:teuthology.orchestra.run.smithi063:mds.g> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T06:25:35.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:35 smithi071 ceph-mon[34844]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:35.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:35 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:35.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:35 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:25:35.554 DEBUG:teuthology.orchestra.run.smithi063:mds.j> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T06:25:35.597 DEBUG:teuthology.orchestra.run.smithi071:mds.b> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T06:25:35.600 DEBUG:teuthology.orchestra.run.smithi071:mds.e> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T06:25:35.643 DEBUG:teuthology.orchestra.run.smithi071:mds.h> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T06:25:35.686 DEBUG:teuthology.orchestra.run.smithi071:mds.k> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T06:25:35.729 DEBUG:teuthology.orchestra.run.smithi175:mds.c> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T06:25:35.731 DEBUG:teuthology.orchestra.run.smithi175:mds.f> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T06:25:35.775 DEBUG:teuthology.orchestra.run.smithi175:mds.i> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T06:25:35.818 DEBUG:teuthology.orchestra.run.smithi175:mds.l> sudo journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T06:25:35.861 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T06:25:35.861 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:25:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:36.234 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:36 smithi063 ceph-mon[31150]: from='client.24610 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi063=a;smithi063=d;smithi063=g;smithi063=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:25:36.234 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:36 smithi063 ceph-mon[31150]: Saving service mds.all spec with placement smithi063=a;smithi063=d;smithi063=g;smithi063=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-09-21T06:25:36.234 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:36.234 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:25:36.234 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:36.235 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:36.235 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:36.235 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:36.235 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:36 smithi063 ceph-mon[31150]: Deploying daemon mds.l on smithi175 2024-09-21T06:25:36.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:36 smithi175 ceph-mon[34510]: from='client.24610 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi063=a;smithi063=d;smithi063=g;smithi063=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:25:36.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:36 smithi175 ceph-mon[34510]: Saving service mds.all spec with placement smithi063=a;smithi063=d;smithi063=g;smithi063=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-09-21T06:25:36.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:36.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:25:36.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:36.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:36.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:36.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:36.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:36 smithi175 ceph-mon[34510]: Deploying daemon mds.l on smithi175 2024-09-21T06:25:36.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:36 smithi071 ceph-mon[34844]: from='client.24610 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi063=a;smithi063=d;smithi063=g;smithi063=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:25:36.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:36 smithi071 ceph-mon[34844]: Saving service mds.all spec with placement smithi063=a;smithi063=d;smithi063=g;smithi063=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-09-21T06:25:36.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:36.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:25:36.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:36.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:36.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:36.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:36.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:36 smithi071 ceph-mon[34844]: Deploying daemon mds.l on smithi175 2024-09-21T06:25:36.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.542+0000 7fea84c5d640 1 -- 172.21.15.63:0/780915722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea801083a0 msgr2=0x7fea801087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:36.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.542+0000 7fea84c5d640 1 --2- 172.21.15.63:0/780915722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea801083a0 0x7fea801087b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fea68009900 tx=0x7fea6802a410 comp rx=0 tx=0).stop 2024-09-21T06:25:36.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.542+0000 7fea84c5d640 1 -- 172.21.15.63:0/780915722 shutdown_connections 2024-09-21T06:25:36.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.542+0000 7fea84c5d640 1 --2- 172.21.15.63:0/780915722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea80108cf0 0x7fea8010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:36.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.542+0000 7fea84c5d640 1 --2- 172.21.15.63:0/780915722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea801083a0 0x7fea801087b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:36.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.542+0000 7fea84c5d640 1 --2- 172.21.15.63:0/780915722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea80102a60 0x7fea80102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:36.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.542+0000 7fea84c5d640 1 -- 172.21.15.63:0/780915722 >> 172.21.15.63:0/780915722 conn(0x7fea80079730 msgr2=0x7fea80079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:36.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.542+0000 7fea84c5d640 1 -- 172.21.15.63:0/780915722 shutdown_connections 2024-09-21T06:25:36.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.542+0000 7fea84c5d640 1 -- 172.21.15.63:0/780915722 wait complete. 2024-09-21T06:25:36.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.543+0000 7fea84c5d640 1 Processor -- start 2024-09-21T06:25:36.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.543+0000 7fea84c5d640 1 -- start start 2024-09-21T06:25:36.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.544+0000 7fea84c5d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea80102a60 0x7fea8019b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.544+0000 7fea84c5d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea801083a0 0x7fea8019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.544+0000 7fea84c5d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea80108cf0 0x7fea8019bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.544+0000 7fea84c5d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fea80112960 con 0x7fea80108cf0 2024-09-21T06:25:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.544+0000 7fea84c5d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fea801127e0 con 0x7fea80102a60 2024-09-21T06:25:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.544+0000 7fea84c5d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fea80112ae0 con 0x7fea801083a0 2024-09-21T06:25:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.544+0000 7fea7ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea80108cf0 0x7fea8019bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.544+0000 7fea7ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea80108cf0 0x7fea8019bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53254/0 (socket says 172.21.15.63:53254) 2024-09-21T06:25:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.544+0000 7fea7ed9d640 1 -- 172.21.15.63:0/2290859119 learned_addr learned my addr 172.21.15.63:0/2290859119 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:25:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.544+0000 7fea7e59c640 1 --2- 172.21.15.63:0/2290859119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea80102a60 0x7fea8019b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.544+0000 7fea7dd9b640 1 --2- 172.21.15.63:0/2290859119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea801083a0 0x7fea8019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.544+0000 7fea7ed9d640 1 -- 172.21.15.63:0/2290859119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea801083a0 msgr2=0x7fea8019b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.544+0000 7fea7ed9d640 1 --2- 172.21.15.63:0/2290859119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea801083a0 0x7fea8019b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.544+0000 7fea7ed9d640 1 -- 172.21.15.63:0/2290859119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea80102a60 msgr2=0x7fea8019b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:36.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.544+0000 7fea7ed9d640 1 --2- 172.21.15.63:0/2290859119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea80102a60 0x7fea8019b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:36.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.544+0000 7fea7ed9d640 1 -- 172.21.15.63:0/2290859119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea801a65c0 con 0x7fea80108cf0 2024-09-21T06:25:36.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.544+0000 7fea7dd9b640 1 --2- 172.21.15.63:0/2290859119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea801083a0 0x7fea8019b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:36.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.544+0000 7fea7ed9d640 1 --2- 172.21.15.63:0/2290859119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea80108cf0 0x7fea8019bdb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fea78009fd0 tx=0x7fea7800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:36.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.545+0000 7fea777fe640 1 -- 172.21.15.63:0/2290859119 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78017070 con 0x7fea80108cf0 2024-09-21T06:25:36.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.545+0000 7fea84c5d640 1 -- 172.21.15.63:0/2290859119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea801a68b0 con 0x7fea80108cf0 2024-09-21T06:25:36.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.545+0000 7fea777fe640 1 -- 172.21.15.63:0/2290859119 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea78003e20 con 0x7fea80108cf0 2024-09-21T06:25:36.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.545+0000 7fea777fe640 1 -- 172.21.15.63:0/2290859119 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78010460 con 0x7fea80108cf0 2024-09-21T06:25:36.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.545+0000 7fea84c5d640 1 -- 172.21.15.63:0/2290859119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea801a6dc0 con 0x7fea80108cf0 2024-09-21T06:25:36.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.546+0000 7fea84c5d640 1 -- 172.21.15.63:0/2290859119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea80102e70 con 0x7fea80108cf0 2024-09-21T06:25:36.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.547+0000 7fea777fe640 1 -- 172.21.15.63:0/2290859119 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fea78003970 con 0x7fea80108cf0 2024-09-21T06:25:36.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.548+0000 7fea777fe640 1 --2- 172.21.15.63:0/2290859119 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fea6c0b6590 0x7fea6c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:36.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.549+0000 7fea7e59c640 1 --2- 172.21.15.63:0/2290859119 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fea6c0b6590 0x7fea6c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:36.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.549+0000 7fea777fe640 1 -- 172.21.15.63:0/2290859119 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fea780e6c60 con 0x7fea80108cf0 2024-09-21T06:25:36.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.549+0000 7fea7e59c640 1 --2- 172.21.15.63:0/2290859119 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fea6c0b6590 0x7fea6c0b8aa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fea8006b9c0 tx=0x7fea70005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:36.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.553+0000 7fea777fe640 1 -- 172.21.15.63:0/2290859119 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fea780ad8c0 con 0x7fea80108cf0 2024-09-21T06:25:36.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.779+0000 7fea84c5d640 1 -- 172.21.15.63:0/2290859119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea8002e640 con 0x7fea80108cf0 2024-09-21T06:25:36.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.780+0000 7fea777fe640 1 -- 172.21.15.63:0/2290859119 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fea780b1ca0 con 0x7fea80108cf0 2024-09-21T06:25:36.782 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:25:36.782 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":1,"btime":"2024-09-21T06:17:48:089129+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T06:25:36.782 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 1 2024-09-21T06:25:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.782+0000 7fea84c5d640 1 -- 172.21.15.63:0/2290859119 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fea6c0b6590 msgr2=0x7fea6c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.782+0000 7fea84c5d640 1 --2- 172.21.15.63:0/2290859119 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fea6c0b6590 0x7fea6c0b8aa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fea8006b9c0 tx=0x7fea70005f90 comp rx=0 tx=0).stop 2024-09-21T06:25:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.782+0000 7fea84c5d640 1 -- 172.21.15.63:0/2290859119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea80108cf0 msgr2=0x7fea8019bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.782+0000 7fea84c5d640 1 --2- 172.21.15.63:0/2290859119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea80108cf0 0x7fea8019bdb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fea78009fd0 tx=0x7fea7800b260 comp rx=0 tx=0).stop 2024-09-21T06:25:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.782+0000 7fea84c5d640 1 -- 172.21.15.63:0/2290859119 shutdown_connections 2024-09-21T06:25:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.782+0000 7fea84c5d640 1 --2- 172.21.15.63:0/2290859119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea80108cf0 0x7fea8019bdb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.782+0000 7fea84c5d640 1 --2- 172.21.15.63:0/2290859119 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fea6c0b6590 0x7fea6c0b8aa0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.782+0000 7fea84c5d640 1 --2- 172.21.15.63:0/2290859119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea801083a0 0x7fea8019b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.782+0000 7fea84c5d640 1 --2- 172.21.15.63:0/2290859119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea80102a60 0x7fea8019b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.782+0000 7fea84c5d640 1 -- 172.21.15.63:0/2290859119 >> 172.21.15.63:0/2290859119 conn(0x7fea80079730 msgr2=0x7fea801044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.782+0000 7fea84c5d640 1 -- 172.21.15.63:0/2290859119 shutdown_connections 2024-09-21T06:25:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:36.782+0000 7fea84c5d640 1 -- 172.21.15.63:0/2290859119 wait complete. 2024-09-21T06:25:37.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:37 smithi175 ceph-mon[34510]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:37.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:37 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2290859119' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:37.350 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 06:25:37 smithi175 systemd[1]: Starting Ceph mds.l for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:25:37.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:37 smithi071 ceph-mon[34844]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:37.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:37 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2290859119' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:37.533 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:37 smithi063 ceph-mon[31150]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:37.547 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:37 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2290859119' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:37.738 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 06:25:37 smithi175 podman[62971]: 2024-09-21 06:25:37.360874503 +0000 UTC m=+0.015908319 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:25:37.738 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 06:25:37 smithi175 podman[62971]: 2024-09-21 06:25:37.476661562 +0000 UTC m=+0.131695366 container create bd5a6049237d068677370e9d9ca862a3f2154c2c768fe141187a4429c72686f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-l, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T06:25:37.738 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 06:25:37 smithi175 podman[62971]: 2024-09-21 06:25:37.737444347 +0000 UTC m=+0.392478160 container init bd5a6049237d068677370e9d9ca862a3f2154c2c768fe141187a4429c72686f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-l, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:25:38.099 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 06:25:37 smithi175 podman[62971]: 2024-09-21 06:25:37.7402611 +0000 UTC m=+0.395294917 container start bd5a6049237d068677370e9d9ca862a3f2154c2c768fe141187a4429c72686f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-l, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T06:25:38.099 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 06:25:37 smithi175 ceph-mds[62990]: -- 172.21.15.175:0/2642084637 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562d5baed860 con 0x562d5fc95600 2024-09-21T06:25:38.099 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 06:25:37 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-l[62986]: starting mds.l at 2024-09-21T06:25:38.099 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 06:25:37 smithi175 bash[62971]: bd5a6049237d068677370e9d9ca862a3f2154c2c768fe141187a4429c72686f5 2024-09-21T06:25:38.099 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 06:25:37 smithi175 systemd[1]: Started Ceph mds.l for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:25:39.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:38 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.175:6832/825731342,v1:172.21.15.175:6833/825731342] up:boot 2024-09-21T06:25:39.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:38 smithi071 ceph-mon[34844]: fsmap 1 up:standby 2024-09-21T06:25:39.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:25:39.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:38 smithi071 ceph-mon[34844]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:39.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:39.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:39.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:39.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:39.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:39.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:39.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:38 smithi071 ceph-mon[34844]: Deploying daemon mds.k on smithi071 2024-09-21T06:25:39.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:38 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.175:6832/825731342,v1:172.21.15.175:6833/825731342] up:boot 2024-09-21T06:25:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:38 smithi063 ceph-mon[31150]: fsmap 1 up:standby 2024-09-21T06:25:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:25:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:38 smithi063 ceph-mon[31150]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:38 smithi063 ceph-mon[31150]: Deploying daemon mds.k on smithi071 2024-09-21T06:25:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:38 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.175:6832/825731342,v1:172.21.15.175:6833/825731342] up:boot 2024-09-21T06:25:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:38 smithi175 ceph-mon[34510]: fsmap 1 up:standby 2024-09-21T06:25:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:25:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:38 smithi175 ceph-mon[34510]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:39.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:39.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:39.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:39.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:39.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:38 smithi175 ceph-mon[34510]: Deploying daemon mds.k on smithi071 2024-09-21T06:25:39.564 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:25:39.833 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:40.188 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 21 06:25:39 smithi071 systemd[1]: Starting Ceph mds.k for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:25:40.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.294+0000 7f8bca17a640 1 -- 172.21.15.63:0/3698237719 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bc4103b60 msgr2=0x7f8bc4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:40.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.294+0000 7f8bca17a640 1 --2- 172.21.15.63:0/3698237719 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bc4103b60 0x7f8bc4103f70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4009900 tx=0x7f8bb402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:25:40.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.294+0000 7f8bca17a640 1 -- 172.21.15.63:0/3698237719 shutdown_connections 2024-09-21T06:25:40.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.294+0000 7f8bca17a640 1 --2- 172.21.15.63:0/3698237719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bc4109df0 0x7f8bc4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:40.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.294+0000 7f8bca17a640 1 --2- 172.21.15.63:0/3698237719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bc41094a0 0x7f8bc41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:40.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.294+0000 7f8bca17a640 1 --2- 172.21.15.63:0/3698237719 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bc4103b60 0x7f8bc4103f70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:40.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.294+0000 7f8bca17a640 1 -- 172.21.15.63:0/3698237719 >> 172.21.15.63:0/3698237719 conn(0x7f8bc407b850 msgr2=0x7f8bc407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:40.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.294+0000 7f8bca17a640 1 -- 172.21.15.63:0/3698237719 shutdown_connections 2024-09-21T06:25:40.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.294+0000 7f8bca17a640 1 -- 172.21.15.63:0/3698237719 wait complete. 2024-09-21T06:25:40.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.295+0000 7f8bca17a640 1 Processor -- start 2024-09-21T06:25:40.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.295+0000 7f8bca17a640 1 -- start start 2024-09-21T06:25:40.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.295+0000 7f8bca17a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bc4103b60 0x7f8bc419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:40.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.295+0000 7f8bca17a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bc41094a0 0x7f8bc419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:40.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.295+0000 7f8bca17a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bc4109df0 0x7f8bc419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:40.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.295+0000 7f8bca17a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc4113ab0 con 0x7f8bc4103b60 2024-09-21T06:25:40.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.296+0000 7f8bca17a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc4113930 con 0x7f8bc4109df0 2024-09-21T06:25:40.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.296+0000 7f8bca17a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc4113c30 con 0x7f8bc41094a0 2024-09-21T06:25:40.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.296+0000 7f8bc37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bc4103b60 0x7f8bc419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:40.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.296+0000 7f8bc37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bc4103b60 0x7f8bc419a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53274/0 (socket says 172.21.15.63:53274) 2024-09-21T06:25:40.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.296+0000 7f8bc37fe640 1 -- 172.21.15.63:0/1471429649 learned_addr learned my addr 172.21.15.63:0/1471429649 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:25:40.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.296+0000 7f8bc2ffd640 1 --2- 172.21.15.63:0/1471429649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bc41094a0 0x7f8bc419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:40.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.296+0000 7f8bc3fff640 1 --2- 172.21.15.63:0/1471429649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bc4109df0 0x7f8bc419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:40.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.296+0000 7f8bc37fe640 1 -- 172.21.15.63:0/1471429649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bc41094a0 msgr2=0x7f8bc419aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:40.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.296+0000 7f8bc37fe640 1 --2- 172.21.15.63:0/1471429649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bc41094a0 0x7f8bc419aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:40.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.296+0000 7f8bc37fe640 1 -- 172.21.15.63:0/1471429649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bc4109df0 msgr2=0x7f8bc419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:40.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.296+0000 7f8bc37fe640 1 --2- 172.21.15.63:0/1471429649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bc4109df0 0x7f8bc419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:40.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.296+0000 7f8bc37fe640 1 -- 172.21.15.63:0/1471429649 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc41a03b0 con 0x7f8bc4103b60 2024-09-21T06:25:40.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.296+0000 7f8bc37fe640 1 --2- 172.21.15.63:0/1471429649 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bc4103b60 0x7f8bc419a500 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4005940 tx=0x7f8bb40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:40.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.296+0000 7f8bc0ff9640 1 -- 172.21.15.63:0/1471429649 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb403f030 con 0x7f8bc4103b60 2024-09-21T06:25:40.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.296+0000 7f8bca17a640 1 -- 172.21.15.63:0/1471429649 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc41a0640 con 0x7f8bc4103b60 2024-09-21T06:25:40.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.296+0000 7f8bc0ff9640 1 -- 172.21.15.63:0/1471429649 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bb4003cb0 con 0x7f8bc4103b60 2024-09-21T06:25:40.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.296+0000 7f8bc0ff9640 1 -- 172.21.15.63:0/1471429649 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4035070 con 0x7f8bc4103b60 2024-09-21T06:25:40.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.296+0000 7f8bca17a640 1 -- 172.21.15.63:0/1471429649 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc41a0b20 con 0x7f8bc4103b60 2024-09-21T06:25:40.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.297+0000 7f8bca17a640 1 -- 172.21.15.63:0/1471429649 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bc4103f70 con 0x7f8bc4103b60 2024-09-21T06:25:40.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.299+0000 7f8bc0ff9640 1 -- 172.21.15.63:0/1471429649 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f8bb4042030 con 0x7f8bc4103b60 2024-09-21T06:25:40.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.300+0000 7f8bc0ff9640 1 --2- 172.21.15.63:0/1471429649 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8bac0b6590 0x7f8bac0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:40.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.300+0000 7f8bc2ffd640 1 --2- 172.21.15.63:0/1471429649 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8bac0b6590 0x7f8bac0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:40.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.300+0000 7f8bc0ff9640 1 -- 172.21.15.63:0/1471429649 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f8bb41076f0 con 0x7f8bc4103b60 2024-09-21T06:25:40.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.300+0000 7f8bc2ffd640 1 --2- 172.21.15.63:0/1471429649 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8bac0b6590 0x7f8bac0b8aa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8bc41064c0 tx=0x7f8bb800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:40.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.303+0000 7f8bc0ff9640 1 -- 172.21.15.63:0/1471429649 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8bb40d2730 con 0x7f8bc4103b60 2024-09-21T06:25:40.459 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 21 06:25:40 smithi071 podman[63134]: 2024-09-21 06:25:40.089888715 +0000 UTC m=+0.015453055 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:25:40.460 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 21 06:25:40 smithi071 podman[63134]: 2024-09-21 06:25:40.21372025 +0000 UTC m=+0.139284580 container create eaccc093baabc54caf882a229023a5059e1d5cd96da8475bc1bae4d84dd9d743 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T06:25:40.460 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 21 06:25:40 smithi071 podman[63134]: 2024-09-21 06:25:40.458250756 +0000 UTC m=+0.383815085 container init eaccc093baabc54caf882a229023a5059e1d5cd96da8475bc1bae4d84dd9d743 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T06:25:40.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.529+0000 7f8bca17a640 1 -- 172.21.15.63:0/1471429649 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8bc419b630 con 0x7f8bc4103b60 2024-09-21T06:25:40.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.529+0000 7f8bc0ff9640 1 -- 172.21.15.63:0/1471429649 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1435 (secure 0 0 0) 0x7f8bb40d7670 con 0x7f8bc4103b60 2024-09-21T06:25:40.531 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:25:40.531 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":2,"btime":"2024-09-21T06:25:37:779303+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T06:25:40.532 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 2 2024-09-21T06:25:40.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.531+0000 7f8bca17a640 1 -- 172.21.15.63:0/1471429649 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8bac0b6590 msgr2=0x7f8bac0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:40.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.531+0000 7f8bca17a640 1 --2- 172.21.15.63:0/1471429649 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8bac0b6590 0x7f8bac0b8aa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8bc41064c0 tx=0x7f8bb800b390 comp rx=0 tx=0).stop 2024-09-21T06:25:40.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.531+0000 7f8bca17a640 1 -- 172.21.15.63:0/1471429649 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bc4103b60 msgr2=0x7f8bc419a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:40.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.531+0000 7f8bca17a640 1 --2- 172.21.15.63:0/1471429649 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bc4103b60 0x7f8bc419a500 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4005940 tx=0x7f8bb40042f0 comp rx=0 tx=0).stop 2024-09-21T06:25:40.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.532+0000 7f8bca17a640 1 -- 172.21.15.63:0/1471429649 shutdown_connections 2024-09-21T06:25:40.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.532+0000 7f8bca17a640 1 --2- 172.21.15.63:0/1471429649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bc4109df0 0x7f8bc419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:40.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.532+0000 7f8bca17a640 1 --2- 172.21.15.63:0/1471429649 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8bac0b6590 0x7f8bac0b8aa0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:40.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.532+0000 7f8bca17a640 1 --2- 172.21.15.63:0/1471429649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bc41094a0 0x7f8bc419aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:40.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.532+0000 7f8bca17a640 1 --2- 172.21.15.63:0/1471429649 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bc4103b60 0x7f8bc419a500 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:40.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.532+0000 7f8bca17a640 1 -- 172.21.15.63:0/1471429649 >> 172.21.15.63:0/1471429649 conn(0x7f8bc407b850 msgr2=0x7f8bc41075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:40.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.532+0000 7f8bca17a640 1 -- 172.21.15.63:0/1471429649 shutdown_connections 2024-09-21T06:25:40.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:40.532+0000 7f8bca17a640 1 -- 172.21.15.63:0/1471429649 wait complete. 2024-09-21T06:25:40.768 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 21 06:25:40 smithi071 podman[63134]: 2024-09-21 06:25:40.461456249 +0000 UTC m=+0.387020588 container start eaccc093baabc54caf882a229023a5059e1d5cd96da8475bc1bae4d84dd9d743 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-k, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T06:25:40.768 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 21 06:25:40 smithi071 ceph-mds[63154]: -- 172.21.15.71:0/3594475866 <== mon.2 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e4f2e09c20 con 0x55e4f6fb1a80 2024-09-21T06:25:40.768 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 21 06:25:40 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-k[63150]: starting mds.k at 2024-09-21T06:25:40.768 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 21 06:25:40 smithi071 bash[63134]: eaccc093baabc54caf882a229023a5059e1d5cd96da8475bc1bae4d84dd9d743 2024-09-21T06:25:40.769 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 21 06:25:40 smithi071 systemd[1]: Started Ceph mds.k for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:25:41.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:40 smithi071 ceph-mon[34844]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:41.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:40 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1471429649' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:41.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:41.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:41.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:41.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:41.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:41.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:41.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:40 smithi071 ceph-mon[34844]: Deploying daemon mds.j on smithi063 2024-09-21T06:25:41.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:40 smithi063 ceph-mon[31150]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:41.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:40 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1471429649' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:41.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:41.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:41.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:41.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:41.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:41.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:41.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:40 smithi063 ceph-mon[31150]: Deploying daemon mds.j on smithi063 2024-09-21T06:25:41.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:40 smithi175 ceph-mon[34510]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:41.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:40 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1471429649' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:41.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:41.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:41.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:41.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:41.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:41.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:41.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:40 smithi175 ceph-mon[34510]: Deploying daemon mds.j on smithi063 2024-09-21T06:25:42.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:41 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.71:6832/3879125360,v1:172.21.15.71:6833/3879125360] up:boot 2024-09-21T06:25:42.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:41 smithi063 ceph-mon[31150]: fsmap 2 up:standby 2024-09-21T06:25:42.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:41 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:25:42.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:41 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.71:6832/3879125360,v1:172.21.15.71:6833/3879125360] up:boot 2024-09-21T06:25:42.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:41 smithi071 ceph-mon[34844]: fsmap 2 up:standby 2024-09-21T06:25:42.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:41 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:25:42.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:41 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.71:6832/3879125360,v1:172.21.15.71:6833/3879125360] up:boot 2024-09-21T06:25:42.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:41 smithi175 ceph-mon[34510]: fsmap 2 up:standby 2024-09-21T06:25:42.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:41 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:25:43.003 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:42 smithi063 ceph-mon[31150]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:43.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:42 smithi071 ceph-mon[34844]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:43.332 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 21 06:25:43 smithi063 systemd[1]: Starting Ceph mds.j for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:25:43.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:42 smithi175 ceph-mon[34510]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:43.484 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:25:43.688 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 21 06:25:43 smithi063 podman[71663]: 2024-09-21 06:25:43.303288783 +0000 UTC m=+0.016302773 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:25:43.689 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 21 06:25:43 smithi063 podman[71663]: 2024-09-21 06:25:43.402872146 +0000 UTC m=+0.115886122 container create 251f166d66e0294ac62ed7df3ccdc6efb98cddb4e9214181857f5d2ecd376fce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-j, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T06:25:43.689 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 21 06:25:43 smithi063 podman[71663]: 2024-09-21 06:25:43.647013136 +0000 UTC m=+0.360027122 container init 251f166d66e0294ac62ed7df3ccdc6efb98cddb4e9214181857f5d2ecd376fce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-j, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:25:43.689 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 21 06:25:43 smithi063 podman[71663]: 2024-09-21 06:25:43.649986688 +0000 UTC m=+0.363000672 container start 251f166d66e0294ac62ed7df3ccdc6efb98cddb4e9214181857f5d2ecd376fce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-j, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T06:25:43.689 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 21 06:25:43 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-j[71696]: starting mds.j at 2024-09-21T06:25:43.832 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:43.954 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 21 06:25:43 smithi063 bash[71663]: 251f166d66e0294ac62ed7df3ccdc6efb98cddb4e9214181857f5d2ecd376fce 2024-09-21T06:25:43.954 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 21 06:25:43 smithi063 systemd[1]: Started Ceph mds.j for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:25:44.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.303+0000 7fd29c243640 1 -- 172.21.15.63:0/1393418518 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd294103b60 msgr2=0x7fd294103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:44.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.303+0000 7fd29c243640 1 --2- 172.21.15.63:0/1393418518 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd294103b60 0x7fd294103f70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd290009900 tx=0x7fd29002a410 comp rx=0 tx=0).stop 2024-09-21T06:25:44.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.303+0000 7fd29c243640 1 -- 172.21.15.63:0/1393418518 shutdown_connections 2024-09-21T06:25:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.303+0000 7fd29c243640 1 --2- 172.21.15.63:0/1393418518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd294109df0 0x7fd294110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.303+0000 7fd29c243640 1 --2- 172.21.15.63:0/1393418518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2941094a0 0x7fd2941098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.303+0000 7fd29c243640 1 --2- 172.21.15.63:0/1393418518 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd294103b60 0x7fd294103f70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.303+0000 7fd29c243640 1 -- 172.21.15.63:0/1393418518 >> 172.21.15.63:0/1393418518 conn(0x7fd29407b850 msgr2=0x7fd29407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.303+0000 7fd29c243640 1 -- 172.21.15.63:0/1393418518 shutdown_connections 2024-09-21T06:25:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.303+0000 7fd29c243640 1 -- 172.21.15.63:0/1393418518 wait complete. 2024-09-21T06:25:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.303+0000 7fd29c243640 1 Processor -- start 2024-09-21T06:25:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.303+0000 7fd29c243640 1 -- start start 2024-09-21T06:25:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.304+0000 7fd29c243640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd294103b60 0x7fd29419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.304+0000 7fd29c243640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2941094a0 0x7fd29419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.304+0000 7fd29c243640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd294109df0 0x7fd29419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.304+0000 7fd29c243640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd294113ab0 con 0x7fd294109df0 2024-09-21T06:25:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.304+0000 7fd29c243640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd294113930 con 0x7fd2941094a0 2024-09-21T06:25:44.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.304+0000 7fd29c243640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd294113c30 con 0x7fd294103b60 2024-09-21T06:25:44.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.304+0000 7fd29a7e0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd294109df0 0x7fd29419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:44.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.304+0000 7fd29a7e0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd294109df0 0x7fd29419fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53312/0 (socket says 172.21.15.63:53312) 2024-09-21T06:25:44.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.304+0000 7fd29a7e0640 1 -- 172.21.15.63:0/3628952065 learned_addr learned my addr 172.21.15.63:0/3628952065 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:25:44.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.304+0000 7fd299fdf640 1 --2- 172.21.15.63:0/3628952065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd294103b60 0x7fd29419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:44.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.304+0000 7fd2997de640 1 --2- 172.21.15.63:0/3628952065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2941094a0 0x7fd29419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:44.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.304+0000 7fd29a7e0640 1 -- 172.21.15.63:0/3628952065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd294103b60 msgr2=0x7fd29419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:44.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.304+0000 7fd29a7e0640 1 --2- 172.21.15.63:0/3628952065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd294103b60 0x7fd29419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:44.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.304+0000 7fd29a7e0640 1 -- 172.21.15.63:0/3628952065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2941094a0 msgr2=0x7fd29419aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:44.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.304+0000 7fd29a7e0640 1 --2- 172.21.15.63:0/3628952065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2941094a0 0x7fd29419aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:44.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.304+0000 7fd29a7e0640 1 -- 172.21.15.63:0/3628952065 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2941a0330 con 0x7fd294109df0 2024-09-21T06:25:44.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.304+0000 7fd29a7e0640 1 --2- 172.21.15.63:0/3628952065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd294109df0 0x7fd29419fcc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00eaa0 tx=0x7fd28c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:44.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.305+0000 7fd28affd640 1 -- 172.21.15.63:0/3628952065 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c00cdb0 con 0x7fd294109df0 2024-09-21T06:25:44.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.305+0000 7fd28affd640 1 -- 172.21.15.63:0/3628952065 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd28c005020 con 0x7fd294109df0 2024-09-21T06:25:44.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.305+0000 7fd28affd640 1 -- 172.21.15.63:0/3628952065 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0116d0 con 0x7fd294109df0 2024-09-21T06:25:44.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.305+0000 7fd29c243640 1 -- 172.21.15.63:0/3628952065 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2941a0620 con 0x7fd294109df0 2024-09-21T06:25:44.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.305+0000 7fd29c243640 1 -- 172.21.15.63:0/3628952065 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2941a6e40 con 0x7fd294109df0 2024-09-21T06:25:44.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.306+0000 7fd29c243640 1 -- 172.21.15.63:0/3628952065 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd294103f70 con 0x7fd294109df0 2024-09-21T06:25:44.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.308+0000 7fd28affd640 1 -- 172.21.15.63:0/3628952065 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fd28c0051d0 con 0x7fd294109df0 2024-09-21T06:25:44.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.308+0000 7fd28affd640 1 --2- 172.21.15.63:0/3628952065 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd2800b6590 0x7fd2800b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:44.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.308+0000 7fd299fdf640 1 --2- 172.21.15.63:0/3628952065 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd2800b6590 0x7fd2800b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:44.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.308+0000 7fd28affd640 1 -- 172.21.15.63:0/3628952065 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fd28c0e7590 con 0x7fd294109df0 2024-09-21T06:25:44.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.309+0000 7fd299fdf640 1 --2- 172.21.15.63:0/3628952065 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd2800b6590 0x7fd2800b8aa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd290031440 tx=0x7fd290005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:44.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.312+0000 7fd28affd640 1 -- 172.21.15.63:0/3628952065 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd28c016030 con 0x7fd294109df0 2024-09-21T06:25:44.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.546+0000 7fd29c243640 1 -- 172.21.15.63:0/3628952065 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd29419b5b0 con 0x7fd294109df0 2024-09-21T06:25:44.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.546+0000 7fd28affd640 1 -- 172.21.15.63:0/3628952065 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7fd29419b5b0 con 0x7fd294109df0 2024-09-21T06:25:44.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:25:44.549 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":4,"btime":"2024-09-21T06:25:43:923249+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24608,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T06:25:44.549 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 4 2024-09-21T06:25:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.549+0000 7fd29c243640 1 -- 172.21.15.63:0/3628952065 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd2800b6590 msgr2=0x7fd2800b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.549+0000 7fd29c243640 1 --2- 172.21.15.63:0/3628952065 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd2800b6590 0x7fd2800b8aa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd290031440 tx=0x7fd290005d50 comp rx=0 tx=0).stop 2024-09-21T06:25:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.549+0000 7fd29c243640 1 -- 172.21.15.63:0/3628952065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd294109df0 msgr2=0x7fd29419fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.549+0000 7fd29c243640 1 --2- 172.21.15.63:0/3628952065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd294109df0 0x7fd29419fcc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00eaa0 tx=0x7fd28c00ef60 comp rx=0 tx=0).stop 2024-09-21T06:25:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.549+0000 7fd29c243640 1 -- 172.21.15.63:0/3628952065 shutdown_connections 2024-09-21T06:25:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.549+0000 7fd29c243640 1 --2- 172.21.15.63:0/3628952065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd294109df0 0x7fd29419fcc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.549+0000 7fd29c243640 1 --2- 172.21.15.63:0/3628952065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2941094a0 0x7fd29419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.549+0000 7fd29c243640 1 --2- 172.21.15.63:0/3628952065 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd2800b6590 0x7fd2800b8aa0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.549+0000 7fd29c243640 1 --2- 172.21.15.63:0/3628952065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd294103b60 0x7fd29419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.549+0000 7fd29c243640 1 -- 172.21.15.63:0/3628952065 >> 172.21.15.63:0/3628952065 conn(0x7fd29407b850 msgr2=0x7fd294107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.549+0000 7fd29c243640 1 -- 172.21.15.63:0/3628952065 shutdown_connections 2024-09-21T06:25:44.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:44.549+0000 7fd29c243640 1 -- 172.21.15.63:0/3628952065 wait complete. 2024-09-21T06:25:45.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:44 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:45.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:44 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:45.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:44 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:45.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:44 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:45.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:44 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:45.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:44 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:45.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:44 smithi063 ceph-mon[31150]: Deploying daemon mds.d on smithi063 2024-09-21T06:25:45.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:44 smithi063 ceph-mon[31150]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:45.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:44 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.63:6834/4115433943,v1:172.21.15.63:6835/4115433943] up:boot 2024-09-21T06:25:45.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:44 smithi063 ceph-mon[31150]: fsmap 3 up:standby 2024-09-21T06:25:45.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:44 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T06:25:45.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:44 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3628952065' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:44 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:44 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:44 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:44 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:44 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:44 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:44 smithi175 ceph-mon[34510]: Deploying daemon mds.d on smithi063 2024-09-21T06:25:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:44 smithi175 ceph-mon[34510]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:44 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.63:6834/4115433943,v1:172.21.15.63:6835/4115433943] up:boot 2024-09-21T06:25:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:44 smithi175 ceph-mon[34510]: fsmap 3 up:standby 2024-09-21T06:25:45.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:44 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T06:25:45.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:44 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3628952065' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:45.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:44 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:45.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:44 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:45.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:44 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:45.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:44 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:45.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:44 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:45.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:44 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:45.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:44 smithi071 ceph-mon[34844]: Deploying daemon mds.d on smithi063 2024-09-21T06:25:45.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:44 smithi071 ceph-mon[34844]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:45.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:44 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.63:6834/4115433943,v1:172.21.15.63:6835/4115433943] up:boot 2024-09-21T06:25:45.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:44 smithi071 ceph-mon[34844]: fsmap 3 up:standby 2024-09-21T06:25:45.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:44 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T06:25:45.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:44 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3628952065' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:46.913 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 21 06:25:46 smithi063 systemd[1]: Starting Ceph mds.d for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:25:47.168 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:46 smithi063 ceph-mon[31150]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:47.169 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 21 06:25:47 smithi063 podman[72042]: 2024-09-21 06:25:46.917762429 +0000 UTC m=+0.017236582 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:25:47.169 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 21 06:25:47 smithi063 podman[72042]: 2024-09-21 06:25:47.034715942 +0000 UTC m=+0.134190141 container create c5701a61e3e7c5ef1ef7cea843c2a5d2b42fcc83d32396e85260cff6ed78aec7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-d, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T06:25:47.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:46 smithi071 ceph-mon[34844]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:47.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:46 smithi175 ceph-mon[34510]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:47.437 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:25:47.462 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 21 06:25:47 smithi063 podman[72042]: 2024-09-21 06:25:47.280826134 +0000 UTC m=+0.380300282 container init c5701a61e3e7c5ef1ef7cea843c2a5d2b42fcc83d32396e85260cff6ed78aec7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-d, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:25:47.462 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 21 06:25:47 smithi063 podman[72042]: 2024-09-21 06:25:47.283678151 +0000 UTC m=+0.383152288 container start c5701a61e3e7c5ef1ef7cea843c2a5d2b42fcc83d32396e85260cff6ed78aec7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-d, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T06:25:47.462 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 21 06:25:47 smithi063 ceph-mds[72061]: -- 172.21.15.63:0/1244523641 <== mon.0 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5635d8fcb860 con 0x5635dd173180 2024-09-21T06:25:47.462 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 21 06:25:47 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-d[72057]: starting mds.d at 2024-09-21T06:25:47.462 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 21 06:25:47 smithi063 bash[72042]: c5701a61e3e7c5ef1ef7cea843c2a5d2b42fcc83d32396e85260cff6ed78aec7 2024-09-21T06:25:47.462 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 21 06:25:47 smithi063 systemd[1]: Started Ceph mds.d for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:25:47.699 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:48.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.212+0000 7fdaea543640 1 -- 172.21.15.63:0/343960081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4102a60 msgr2=0x7fdae4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:48.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.212+0000 7fdaea543640 1 --2- 172.21.15.63:0/343960081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4102a60 0x7fdae4102e70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009900 tx=0x7fdad402a410 comp rx=0 tx=0).stop 2024-09-21T06:25:48.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.212+0000 7fdaea543640 1 -- 172.21.15.63:0/343960081 shutdown_connections 2024-09-21T06:25:48.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.212+0000 7fdaea543640 1 --2- 172.21.15.63:0/343960081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdae4108cf0 0x7fdae410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.212+0000 7fdaea543640 1 --2- 172.21.15.63:0/343960081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdae41083a0 0x7fdae41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.212+0000 7fdaea543640 1 --2- 172.21.15.63:0/343960081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4102a60 0x7fdae4102e70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.212+0000 7fdaea543640 1 -- 172.21.15.63:0/343960081 >> 172.21.15.63:0/343960081 conn(0x7fdae4079730 msgr2=0x7fdae4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:48.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.212+0000 7fdaea543640 1 -- 172.21.15.63:0/343960081 shutdown_connections 2024-09-21T06:25:48.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.212+0000 7fdaea543640 1 -- 172.21.15.63:0/343960081 wait complete. 2024-09-21T06:25:48.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.212+0000 7fdaea543640 1 Processor -- start 2024-09-21T06:25:48.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.212+0000 7fdaea543640 1 -- start start 2024-09-21T06:25:48.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.213+0000 7fdaea543640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdae4102a60 0x7fdae419b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.213+0000 7fdaea543640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdae41083a0 0x7fdae419b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.213+0000 7fdaea543640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4108cf0 0x7fdae419bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.213+0000 7fdaea543640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdae4112960 con 0x7fdae4108cf0 2024-09-21T06:25:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.213+0000 7fdaea543640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdae41127e0 con 0x7fdae4102a60 2024-09-21T06:25:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.213+0000 7fdaea543640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdae4112ae0 con 0x7fdae41083a0 2024-09-21T06:25:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.213+0000 7fdae8ae0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4108cf0 0x7fdae419bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.213+0000 7fdae8ae0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4108cf0 0x7fdae419bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52922/0 (socket says 172.21.15.63:52922) 2024-09-21T06:25:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.213+0000 7fdae3fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdae4102a60 0x7fdae419b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.213+0000 7fdae8ae0640 1 -- 172.21.15.63:0/447668457 learned_addr learned my addr 172.21.15.63:0/447668457 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:25:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.213+0000 7fdae37fe640 1 --2- 172.21.15.63:0/447668457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdae41083a0 0x7fdae419b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.213+0000 7fdae8ae0640 1 -- 172.21.15.63:0/447668457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdae41083a0 msgr2=0x7fdae419b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.213+0000 7fdae8ae0640 1 --2- 172.21.15.63:0/447668457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdae41083a0 0x7fdae419b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.213+0000 7fdae8ae0640 1 -- 172.21.15.63:0/447668457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdae4102a60 msgr2=0x7fdae419b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.213+0000 7fdae8ae0640 1 --2- 172.21.15.63:0/447668457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdae4102a60 0x7fdae419b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.213+0000 7fdae8ae0640 1 -- 172.21.15.63:0/447668457 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdae41a64c0 con 0x7fdae4108cf0 2024-09-21T06:25:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.213+0000 7fdae3fff640 1 --2- 172.21.15.63:0/447668457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdae4102a60 0x7fdae419b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:25:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.213+0000 7fdae8ae0640 1 --2- 172.21.15.63:0/447668457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4108cf0 0x7fdae419bcb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00eaa0 tx=0x7fdadc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.214+0000 7fdae17fa640 1 -- 172.21.15.63:0/447668457 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdadc00cdb0 con 0x7fdae4108cf0 2024-09-21T06:25:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.214+0000 7fdae17fa640 1 -- 172.21.15.63:0/447668457 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdadc005020 con 0x7fdae4108cf0 2024-09-21T06:25:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.214+0000 7fdae17fa640 1 -- 172.21.15.63:0/447668457 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdadc0116d0 con 0x7fdae4108cf0 2024-09-21T06:25:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.214+0000 7fdaea543640 1 -- 172.21.15.63:0/447668457 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdae41a67b0 con 0x7fdae4108cf0 2024-09-21T06:25:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.214+0000 7fdaea543640 1 -- 172.21.15.63:0/447668457 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdae41a6cf0 con 0x7fdae4108cf0 2024-09-21T06:25:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.215+0000 7fdaea543640 1 -- 172.21.15.63:0/447668457 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdae4102e70 con 0x7fdae4108cf0 2024-09-21T06:25:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.217+0000 7fdae17fa640 1 -- 172.21.15.63:0/447668457 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fdadc0051d0 con 0x7fdae4108cf0 2024-09-21T06:25:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.217+0000 7fdae17fa640 1 --2- 172.21.15.63:0/447668457 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdacc0b6590 0x7fdacc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.217+0000 7fdae3fff640 1 --2- 172.21.15.63:0/447668457 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdacc0b6590 0x7fdacc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.217+0000 7fdae17fa640 1 -- 172.21.15.63:0/447668457 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fdadc0e7430 con 0x7fdae4108cf0 2024-09-21T06:25:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.218+0000 7fdae3fff640 1 --2- 172.21.15.63:0/447668457 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdacc0b6590 0x7fdacc0b8aa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdad4000c00 tx=0x7fdad4031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.220+0000 7fdae17fa640 1 -- 172.21.15.63:0/447668457 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdadc016030 con 0x7fdae4108cf0 2024-09-21T06:25:48.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.448+0000 7fdaea543640 1 -- 172.21.15.63:0/447668457 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdae406b270 con 0x7fdae4108cf0 2024-09-21T06:25:48.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.450+0000 7fdae17fa640 1 -- 172.21.15.63:0/447668457 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7fdadc0b2470 con 0x7fdae4108cf0 2024-09-21T06:25:48.452 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:25:48.452 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":5,"btime":"2024-09-21T06:25:47:911583+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24608,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T06:25:48.453 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 5 2024-09-21T06:25:48.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.452+0000 7fdaea543640 1 -- 172.21.15.63:0/447668457 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdacc0b6590 msgr2=0x7fdacc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:48.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.452+0000 7fdaea543640 1 --2- 172.21.15.63:0/447668457 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdacc0b6590 0x7fdacc0b8aa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdad4000c00 tx=0x7fdad4031400 comp rx=0 tx=0).stop 2024-09-21T06:25:48.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.452+0000 7fdaea543640 1 -- 172.21.15.63:0/447668457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4108cf0 msgr2=0x7fdae419bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:48.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.452+0000 7fdaea543640 1 --2- 172.21.15.63:0/447668457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4108cf0 0x7fdae419bcb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00eaa0 tx=0x7fdadc00ef60 comp rx=0 tx=0).stop 2024-09-21T06:25:48.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.453+0000 7fdaea543640 1 -- 172.21.15.63:0/447668457 shutdown_connections 2024-09-21T06:25:48.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.453+0000 7fdaea543640 1 --2- 172.21.15.63:0/447668457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdae4108cf0 0x7fdae419bcb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.453+0000 7fdaea543640 1 --2- 172.21.15.63:0/447668457 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdacc0b6590 0x7fdacc0b8aa0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.453+0000 7fdaea543640 1 --2- 172.21.15.63:0/447668457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdae41083a0 0x7fdae419b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.453+0000 7fdaea543640 1 --2- 172.21.15.63:0/447668457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdae4102a60 0x7fdae419b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.453+0000 7fdaea543640 1 -- 172.21.15.63:0/447668457 >> 172.21.15.63:0/447668457 conn(0x7fdae4079730 msgr2=0x7fdae4101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:48.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.453+0000 7fdaea543640 1 -- 172.21.15.63:0/447668457 shutdown_connections 2024-09-21T06:25:48.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:48.453+0000 7fdaea543640 1 -- 172.21.15.63:0/447668457 wait complete. 2024-09-21T06:25:48.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:48 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:48.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:48 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:48.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:48 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:48.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:48 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:48.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:48 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:48.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:48 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:48.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:48 smithi071 ceph-mon[34844]: Deploying daemon mds.e on smithi071 2024-09-21T06:25:48.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:48 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.63:6836/3545415905,v1:172.21.15.63:6837/3545415905] up:boot 2024-09-21T06:25:48.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:48 smithi071 ceph-mon[34844]: fsmap 4 up:standby 2024-09-21T06:25:48.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:48 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T06:25:48.807 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:48 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:48.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:48 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:48.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:48 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:48.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:48 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:48.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:48 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:48.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:48 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:48.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:48 smithi063 ceph-mon[31150]: Deploying daemon mds.e on smithi071 2024-09-21T06:25:48.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:48 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.63:6836/3545415905,v1:172.21.15.63:6837/3545415905] up:boot 2024-09-21T06:25:48.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:48 smithi063 ceph-mon[31150]: fsmap 4 up:standby 2024-09-21T06:25:48.808 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:48 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T06:25:48.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:48 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:48.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:48 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:48.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:48 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:48.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:48 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:48.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:48 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:48.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:48 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:48.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:48 smithi175 ceph-mon[34510]: Deploying daemon mds.e on smithi071 2024-09-21T06:25:48.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:48 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.63:6836/3545415905,v1:172.21.15.63:6837/3545415905] up:boot 2024-09-21T06:25:48.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:48 smithi175 ceph-mon[34510]: fsmap 4 up:standby 2024-09-21T06:25:48.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:48 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T06:25:49.751 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:49 smithi175 ceph-mon[34510]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:49.751 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:49 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/447668457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:49.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:49 smithi071 ceph-mon[34844]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:49.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:49 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/447668457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:49.768 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 21 06:25:49 smithi071 systemd[1]: Starting Ceph mds.e for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:25:49.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:49 smithi063 ceph-mon[31150]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:49.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:49 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/447668457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:50.051 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 21 06:25:49 smithi071 podman[63415]: 2024-09-21 06:25:49.676894832 +0000 UTC m=+0.015702872 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:25:50.051 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 21 06:25:49 smithi071 podman[63415]: 2024-09-21 06:25:49.805768222 +0000 UTC m=+0.144576299 container create a387471fdfc80cef85ed86b24105af2b58b8d5a1340abfa291ecd560ac24d8f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-e, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:25:50.519 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 21 06:25:50 smithi071 podman[63415]: 2024-09-21 06:25:50.050350589 +0000 UTC m=+0.389158621 container init a387471fdfc80cef85ed86b24105af2b58b8d5a1340abfa291ecd560ac24d8f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T06:25:50.519 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 21 06:25:50 smithi071 podman[63415]: 2024-09-21 06:25:50.053503183 +0000 UTC m=+0.392311233 container start a387471fdfc80cef85ed86b24105af2b58b8d5a1340abfa291ecd560ac24d8f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-e, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T06:25:50.519 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 21 06:25:50 smithi071 ceph-mds[63434]: -- 172.21.15.71:0/689308193 <== mon.2 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55972b21d860 con 0x55972f3c5a80 2024-09-21T06:25:50.519 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 21 06:25:50 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-e[63430]: starting mds.e at 2024-09-21T06:25:50.519 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 21 06:25:50 smithi071 bash[63415]: a387471fdfc80cef85ed86b24105af2b58b8d5a1340abfa291ecd560ac24d8f4 2024-09-21T06:25:50.519 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 21 06:25:50 smithi071 systemd[1]: Started Ceph mds.e for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:25:51.146 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:25:51.419 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:51.458 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:51 smithi175 ceph-mon[34510]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:51.458 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:51 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:51.458 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:51 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:51.459 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:51 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:51.459 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:51 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:51.459 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:51 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:51.459 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:51 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:51.459 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:51 smithi175 ceph-mon[34510]: Deploying daemon mds.f on smithi175 2024-09-21T06:25:51.459 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:51 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.71:6834/946121091,v1:172.21.15.71:6835/946121091] up:boot 2024-09-21T06:25:51.459 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:51 smithi175 ceph-mon[34510]: fsmap 5 up:standby 2024-09-21T06:25:51.459 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:51 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:25:51.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:51 smithi071 ceph-mon[34844]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:51.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:51 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:51.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:51 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:51.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:51 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:51.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:51 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:51.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:51 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:51.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:51 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:51.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:51 smithi071 ceph-mon[34844]: Deploying daemon mds.f on smithi175 2024-09-21T06:25:51.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:51 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.71:6834/946121091,v1:172.21.15.71:6835/946121091] up:boot 2024-09-21T06:25:51.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:51 smithi071 ceph-mon[34844]: fsmap 5 up:standby 2024-09-21T06:25:51.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:51 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:25:51.540 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:51 smithi063 ceph-mon[31150]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:51.540 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:51 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:51.541 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:51 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:51.541 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:51 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:51.541 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:51 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:51.541 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:51 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:51.541 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:51 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:51.541 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:51 smithi063 ceph-mon[31150]: Deploying daemon mds.f on smithi175 2024-09-21T06:25:51.541 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:51 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.71:6834/946121091,v1:172.21.15.71:6835/946121091] up:boot 2024-09-21T06:25:51.541 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:51 smithi063 ceph-mon[31150]: fsmap 5 up:standby 2024-09-21T06:25:51.541 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:51 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:25:51.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.908+0000 7effd233e640 1 -- 172.21.15.63:0/1149535733 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc1094a0 msgr2=0x7effcc1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.908+0000 7effd233e640 1 --2- 172.21.15.63:0/1149535733 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc1094a0 0x7effcc1098b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7effc0009900 tx=0x7effc002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.908+0000 7effd233e640 1 -- 172.21.15.63:0/1149535733 shutdown_connections 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.908+0000 7effd233e640 1 --2- 172.21.15.63:0/1149535733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc109df0 0x7effcc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.908+0000 7effd233e640 1 --2- 172.21.15.63:0/1149535733 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc1094a0 0x7effcc1098b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.908+0000 7effd233e640 1 --2- 172.21.15.63:0/1149535733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effcc103b60 0x7effcc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.908+0000 7effd233e640 1 -- 172.21.15.63:0/1149535733 >> 172.21.15.63:0/1149535733 conn(0x7effcc07b850 msgr2=0x7effcc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.908+0000 7effd233e640 1 -- 172.21.15.63:0/1149535733 shutdown_connections 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.908+0000 7effd233e640 1 -- 172.21.15.63:0/1149535733 wait complete. 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.909+0000 7effd233e640 1 Processor -- start 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.909+0000 7effd233e640 1 -- start start 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.909+0000 7effd233e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc103b60 0x7effcc19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.909+0000 7effd233e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc1094a0 0x7effcc19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.909+0000 7effd233e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effcc109df0 0x7effcc19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.909+0000 7effd233e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7effcc113ab0 con 0x7effcc1094a0 2024-09-21T06:25:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.909+0000 7effd233e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7effcc113930 con 0x7effcc103b60 2024-09-21T06:25:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.909+0000 7effd233e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7effcc113c30 con 0x7effcc109df0 2024-09-21T06:25:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.910+0000 7effcb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc1094a0 0x7effcc19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.910+0000 7effcb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc1094a0 0x7effcc19aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52944/0 (socket says 172.21.15.63:52944) 2024-09-21T06:25:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.910+0000 7effcb7fe640 1 -- 172.21.15.63:0/2999944569 learned_addr learned my addr 172.21.15.63:0/2999944569 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:25:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.910+0000 7effd08db640 1 --2- 172.21.15.63:0/2999944569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effcc109df0 0x7effcc19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.910+0000 7effcbfff640 1 --2- 172.21.15.63:0/2999944569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc103b60 0x7effcc19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.910+0000 7effd08db640 1 -- 172.21.15.63:0/2999944569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc103b60 msgr2=0x7effcc19a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.910+0000 7effd08db640 1 --2- 172.21.15.63:0/2999944569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc103b60 0x7effcc19a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.910+0000 7effd08db640 1 -- 172.21.15.63:0/2999944569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc1094a0 msgr2=0x7effcc19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.910+0000 7effd08db640 1 --2- 172.21.15.63:0/2999944569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc1094a0 0x7effcc19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.910+0000 7effd08db640 1 -- 172.21.15.63:0/2999944569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effcc1a0370 con 0x7effcc109df0 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.910+0000 7effcb7fe640 1 --2- 172.21.15.63:0/2999944569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc1094a0 0x7effcc19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.910+0000 7effd08db640 1 --2- 172.21.15.63:0/2999944569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effcc109df0 0x7effcc19fd00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7effc400cab0 tx=0x7effc400cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.910+0000 7effc97fa640 1 -- 172.21.15.63:0/2999944569 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc400ae20 con 0x7effcc109df0 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.910+0000 7effd233e640 1 -- 172.21.15.63:0/2999944569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effcc1a0660 con 0x7effcc109df0 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.910+0000 7effc97fa640 1 -- 172.21.15.63:0/2999944569 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effc400f900 con 0x7effcc109df0 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.910+0000 7effc97fa640 1 -- 172.21.15.63:0/2999944569 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc40189f0 con 0x7effcc109df0 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.911+0000 7effd233e640 1 -- 172.21.15.63:0/2999944569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effcc1a6e80 con 0x7effcc109df0 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.912+0000 7effd233e640 1 -- 172.21.15.63:0/2999944569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effcc103f70 con 0x7effcc109df0 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.914+0000 7effc97fa640 1 -- 172.21.15.63:0/2999944569 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7effc400f450 con 0x7effcc109df0 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.914+0000 7effc97fa640 1 --2- 172.21.15.63:0/2999944569 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7effb40b6590 0x7effb40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.915+0000 7effcbfff640 1 --2- 172.21.15.63:0/2999944569 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7effb40b6590 0x7effb40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.915+0000 7effc97fa640 1 -- 172.21.15.63:0/2999944569 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7effc40e78e0 con 0x7effcc109df0 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.915+0000 7effcbfff640 1 --2- 172.21.15.63:0/2999944569 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7effb40b6590 0x7effb40b8aa0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7effbc009bd0 tx=0x7effbc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:51.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:51.921+0000 7effc97fa640 1 -- 172.21.15.63:0/2999944569 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7effc4014030 con 0x7effcc109df0 2024-09-21T06:25:52.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:52.146+0000 7effd233e640 1 -- 172.21.15.63:0/2999944569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effcc19b5f0 con 0x7effcc109df0 2024-09-21T06:25:52.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:52.147+0000 7effc97fa640 1 -- 172.21.15.63:0/2999944569 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4732 (secure 0 0 0) 0x7effcc19b5f0 con 0x7effcc109df0 2024-09-21T06:25:52.149 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:25:52.149 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":6,"btime":"2024-09-21T06:25:50:451231+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24608,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T06:25:52.149 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 6 2024-09-21T06:25:52.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:52.149+0000 7effd233e640 1 -- 172.21.15.63:0/2999944569 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7effb40b6590 msgr2=0x7effb40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:52.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:52.149+0000 7effd233e640 1 --2- 172.21.15.63:0/2999944569 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7effb40b6590 0x7effb40b8aa0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7effbc009bd0 tx=0x7effbc005f90 comp rx=0 tx=0).stop 2024-09-21T06:25:52.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:52.149+0000 7effd233e640 1 -- 172.21.15.63:0/2999944569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effcc109df0 msgr2=0x7effcc19fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:52.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:52.149+0000 7effd233e640 1 --2- 172.21.15.63:0/2999944569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effcc109df0 0x7effcc19fd00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7effc400cab0 tx=0x7effc400cf70 comp rx=0 tx=0).stop 2024-09-21T06:25:52.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:52.150+0000 7effd233e640 1 -- 172.21.15.63:0/2999944569 shutdown_connections 2024-09-21T06:25:52.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:52.150+0000 7effd233e640 1 --2- 172.21.15.63:0/2999944569 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7effb40b6590 0x7effb40b8aa0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:52.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:52.150+0000 7effd233e640 1 --2- 172.21.15.63:0/2999944569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effcc109df0 0x7effcc19fd00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:52.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:52.150+0000 7effd233e640 1 --2- 172.21.15.63:0/2999944569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc1094a0 0x7effcc19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:52.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:52.150+0000 7effd233e640 1 --2- 172.21.15.63:0/2999944569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc103b60 0x7effcc19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:52.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:52.150+0000 7effd233e640 1 -- 172.21.15.63:0/2999944569 >> 172.21.15.63:0/2999944569 conn(0x7effcc07b850 msgr2=0x7effcc105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:52.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:52.150+0000 7effd233e640 1 -- 172.21.15.63:0/2999944569 shutdown_connections 2024-09-21T06:25:52.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:52.150+0000 7effd233e640 1 -- 172.21.15.63:0/2999944569 wait complete. 2024-09-21T06:25:52.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:52 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2999944569' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:52.524 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:52 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2999944569' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:52.531 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:52 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2999944569' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:53.099 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 06:25:52 smithi175 systemd[1]: Started Ceph mds.f for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:25:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:53 smithi071 ceph-mon[34844]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:53.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:53 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:53.529 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:53 smithi175 ceph-mon[34510]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:53.529 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:53.529 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:53.529 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:53.530 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:53.530 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:53.530 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:53 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:53.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:53 smithi063 ceph-mon[31150]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:53.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:53.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:53.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:53.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:53.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:53.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:53 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:54.325 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:54 smithi175 ceph-mon[34510]: Deploying daemon mds.c on smithi175 2024-09-21T06:25:54.326 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:54 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] up:boot 2024-09-21T06:25:54.326 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:54 smithi175 ceph-mon[34510]: fsmap 6 up:standby 2024-09-21T06:25:54.326 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:54 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:25:54.374 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:54 smithi063 ceph-mon[31150]: Deploying daemon mds.c on smithi175 2024-09-21T06:25:54.374 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:54 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] up:boot 2024-09-21T06:25:54.374 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:54 smithi063 ceph-mon[31150]: fsmap 6 up:standby 2024-09-21T06:25:54.374 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:54 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:25:54.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:54 smithi071 ceph-mon[34844]: Deploying daemon mds.c on smithi175 2024-09-21T06:25:54.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:54 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] up:boot 2024-09-21T06:25:54.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:54 smithi071 ceph-mon[34844]: fsmap 6 up:standby 2024-09-21T06:25:54.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:54 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:25:54.863 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:25:55.018 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 06:25:54 smithi175 systemd[1]: Starting Ceph mds.c for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:25:55.130 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:55.330 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:55 smithi175 ceph-mon[34510]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:55.331 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 06:25:55 smithi175 podman[63520]: 2024-09-21 06:25:54.918987958 +0000 UTC m=+0.015477460 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:25:55.331 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 06:25:55 smithi175 podman[63520]: 2024-09-21 06:25:55.051933047 +0000 UTC m=+0.148422543 container create 553dd633b676f34edae2d12d455fdc05349d2f0d7f854903c774d744529311f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T06:25:55.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:55 smithi071 ceph-mon[34844]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:55.542 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:55 smithi063 ceph-mon[31150]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:55.599 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 06:25:55 smithi175 podman[63520]: 2024-09-21 06:25:55.329672434 +0000 UTC m=+0.426161935 container init 553dd633b676f34edae2d12d455fdc05349d2f0d7f854903c774d744529311f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:25:55.599 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 06:25:55 smithi175 podman[63520]: 2024-09-21 06:25:55.332833444 +0000 UTC m=+0.429322951 container start 553dd633b676f34edae2d12d455fdc05349d2f0d7f854903c774d744529311f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-c, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T06:25:55.599 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 06:25:55 smithi175 ceph-mds[63540]: -- 172.21.15.175:0/1532874793 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562d95291860 con 0x562d99439a80 2024-09-21T06:25:55.599 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 06:25:55 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-c[63536]: starting mds.c at 2024-09-21T06:25:55.600 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 06:25:55 smithi175 bash[63520]: 553dd633b676f34edae2d12d455fdc05349d2f0d7f854903c774d744529311f1 2024-09-21T06:25:55.600 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 06:25:55 smithi175 systemd[1]: Started Ceph mds.c for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:25:55.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.636+0000 7fd2a2470640 1 -- 172.21.15.63:0/555432546 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd29c109500 msgr2=0x7fd29c109910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:55.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.636+0000 7fd2a2470640 1 --2- 172.21.15.63:0/555432546 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd29c109500 0x7fd29c109910 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd290009900 tx=0x7fd29002a410 comp rx=0 tx=0).stop 2024-09-21T06:25:55.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.636+0000 7fd2a2470640 1 -- 172.21.15.63:0/555432546 shutdown_connections 2024-09-21T06:25:55.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.636+0000 7fd2a2470640 1 --2- 172.21.15.63:0/555432546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd29c109e50 0x7fd29c110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:55.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.636+0000 7fd2a2470640 1 --2- 172.21.15.63:0/555432546 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd29c109500 0x7fd29c109910 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:55.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.636+0000 7fd2a2470640 1 --2- 172.21.15.63:0/555432546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd29c101fc0 0x7fd29c1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:55.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.636+0000 7fd2a2470640 1 -- 172.21.15.63:0/555432546 >> 172.21.15.63:0/555432546 conn(0x7fd29c079f90 msgr2=0x7fd29c07a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:55.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.636+0000 7fd2a2470640 1 -- 172.21.15.63:0/555432546 shutdown_connections 2024-09-21T06:25:55.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.636+0000 7fd2a2470640 1 -- 172.21.15.63:0/555432546 wait complete. 2024-09-21T06:25:55.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.637+0000 7fd2a2470640 1 Processor -- start 2024-09-21T06:25:55.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.637+0000 7fd2a2470640 1 -- start start 2024-09-21T06:25:55.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.637+0000 7fd2a2470640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd29c101fc0 0x7fd29c102f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:55.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.637+0000 7fd2a2470640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd29c109500 0x7fd29c1034a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:55.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.637+0000 7fd2a2470640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd29c109e50 0x7fd29c1039e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:55.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.637+0000 7fd2a2470640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c113b10 con 0x7fd29c101fc0 2024-09-21T06:25:55.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.637+0000 7fd2a2470640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c113990 con 0x7fd29c109e50 2024-09-21T06:25:55.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.637+0000 7fd2a2470640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c113c90 con 0x7fd29c109500 2024-09-21T06:25:55.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.637+0000 7fd29bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd29c101fc0 0x7fd29c102f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:55.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.637+0000 7fd29b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd29c109500 0x7fd29c1034a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:55.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.637+0000 7fd29bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd29c101fc0 0x7fd29c102f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52962/0 (socket says 172.21.15.63:52962) 2024-09-21T06:25:55.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.637+0000 7fd29bfff640 1 -- 172.21.15.63:0/739390825 learned_addr learned my addr 172.21.15.63:0/739390825 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:25:55.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.638+0000 7fd2a0a0d640 1 --2- 172.21.15.63:0/739390825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd29c109e50 0x7fd29c1039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:55.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.638+0000 7fd29b7fe640 1 -- 172.21.15.63:0/739390825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd29c109e50 msgr2=0x7fd29c1039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:55.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.638+0000 7fd29b7fe640 1 --2- 172.21.15.63:0/739390825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd29c109e50 0x7fd29c1039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:55.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.638+0000 7fd29b7fe640 1 -- 172.21.15.63:0/739390825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd29c101fc0 msgr2=0x7fd29c102f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:55.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.638+0000 7fd29b7fe640 1 --2- 172.21.15.63:0/739390825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd29c101fc0 0x7fd29c102f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:55.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.638+0000 7fd29b7fe640 1 -- 172.21.15.63:0/739390825 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd29c1a87c0 con 0x7fd29c109500 2024-09-21T06:25:55.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.638+0000 7fd29b7fe640 1 --2- 172.21.15.63:0/739390825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd29c109500 0x7fd29c1034a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd29002a930 tx=0x7fd290004060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:55.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.638+0000 7fd2997fa640 1 -- 172.21.15.63:0/739390825 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29003f070 con 0x7fd29c109500 2024-09-21T06:25:55.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.638+0000 7fd2997fa640 1 -- 172.21.15.63:0/739390825 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd290003ca0 con 0x7fd29c109500 2024-09-21T06:25:55.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.638+0000 7fd2a2470640 1 -- 172.21.15.63:0/739390825 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd29c1a8a50 con 0x7fd29c109500 2024-09-21T06:25:55.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.638+0000 7fd2997fa640 1 -- 172.21.15.63:0/739390825 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd290035070 con 0x7fd29c109500 2024-09-21T06:25:55.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.638+0000 7fd2a2470640 1 -- 172.21.15.63:0/739390825 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd29c1a8f50 con 0x7fd29c109500 2024-09-21T06:25:55.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.639+0000 7fd2a2470640 1 -- 172.21.15.63:0/739390825 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd29c1023d0 con 0x7fd29c109500 2024-09-21T06:25:55.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.641+0000 7fd2997fa640 1 -- 172.21.15.63:0/739390825 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fd29003b460 con 0x7fd29c109500 2024-09-21T06:25:55.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.641+0000 7fd2997fa640 1 --2- 172.21.15.63:0/739390825 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd2840b65e0 0x7fd2840b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:55.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.642+0000 7fd29bfff640 1 --2- 172.21.15.63:0/739390825 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd2840b65e0 0x7fd2840b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:55.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.642+0000 7fd2997fa640 1 -- 172.21.15.63:0/739390825 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fd2901073a0 con 0x7fd29c109500 2024-09-21T06:25:55.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.642+0000 7fd29bfff640 1 --2- 172.21.15.63:0/739390825 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd2840b65e0 0x7fd2840b8af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd29c1049b0 tx=0x7fd28c00b4a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:55.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.646+0000 7fd2997fa640 1 -- 172.21.15.63:0/739390825 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd2900d23e0 con 0x7fd29c109500 2024-09-21T06:25:55.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.874+0000 7fd2a2470640 1 -- 172.21.15.63:0/739390825 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd29c02e640 con 0x7fd29c109500 2024-09-21T06:25:55.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.875+0000 7fd2997fa640 1 -- 172.21.15.63:0/739390825 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5560 (secure 0 0 0) 0x7fd2900d7320 con 0x7fd29c109500 2024-09-21T06:25:55.877 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:25:55.877 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":7,"btime":"2024-09-21T06:25:53:190769+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24608,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24670,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-21T06:25:55.877 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 7 2024-09-21T06:25:55.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.877+0000 7fd2a2470640 1 -- 172.21.15.63:0/739390825 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd2840b65e0 msgr2=0x7fd2840b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:55.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.877+0000 7fd2a2470640 1 --2- 172.21.15.63:0/739390825 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd2840b65e0 0x7fd2840b8af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd29c1049b0 tx=0x7fd28c00b4a0 comp rx=0 tx=0).stop 2024-09-21T06:25:55.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.877+0000 7fd2a2470640 1 -- 172.21.15.63:0/739390825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd29c109500 msgr2=0x7fd29c1034a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:55.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.877+0000 7fd2a2470640 1 --2- 172.21.15.63:0/739390825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd29c109500 0x7fd29c1034a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd29002a930 tx=0x7fd290004060 comp rx=0 tx=0).stop 2024-09-21T06:25:55.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.877+0000 7fd2a2470640 1 -- 172.21.15.63:0/739390825 shutdown_connections 2024-09-21T06:25:55.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.877+0000 7fd2a2470640 1 --2- 172.21.15.63:0/739390825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd29c109e50 0x7fd29c1039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:55.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.877+0000 7fd2a2470640 1 --2- 172.21.15.63:0/739390825 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd2840b65e0 0x7fd2840b8af0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:55.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.877+0000 7fd2a2470640 1 --2- 172.21.15.63:0/739390825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd29c109500 0x7fd29c1034a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:55.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.877+0000 7fd2a2470640 1 --2- 172.21.15.63:0/739390825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd29c101fc0 0x7fd29c102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:55.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.877+0000 7fd2a2470640 1 -- 172.21.15.63:0/739390825 >> 172.21.15.63:0/739390825 conn(0x7fd29c079f90 msgr2=0x7fd29c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:55.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.877+0000 7fd2a2470640 1 -- 172.21.15.63:0/739390825 shutdown_connections 2024-09-21T06:25:55.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:55.877+0000 7fd2a2470640 1 -- 172.21.15.63:0/739390825 wait complete. 2024-09-21T06:25:56.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:56 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:56.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:56 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:56.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:56 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:56.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:56 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:56.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:56 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:56.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:56 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:56.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:56 smithi063 ceph-mon[31150]: Deploying daemon mds.h on smithi071 2024-09-21T06:25:56.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:56 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/739390825' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:56.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:56 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] up:boot 2024-09-21T06:25:56.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:56 smithi063 ceph-mon[31150]: fsmap 7 up:standby 2024-09-21T06:25:56.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:56 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:25:56.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:56 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:56.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:56 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:56.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:56 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:56.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:56 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:56.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:56 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:56.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:56 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:56.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:56 smithi175 ceph-mon[34510]: Deploying daemon mds.h on smithi071 2024-09-21T06:25:56.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:56 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/739390825' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:56.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:56 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] up:boot 2024-09-21T06:25:56.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:56 smithi175 ceph-mon[34510]: fsmap 7 up:standby 2024-09-21T06:25:56.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:56 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:25:57.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:56 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:57.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:56 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:57.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:56 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:57.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:56 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:57.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:56 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:57.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:56 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:57.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:56 smithi071 ceph-mon[34844]: Deploying daemon mds.h on smithi071 2024-09-21T06:25:57.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:56 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/739390825' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:57.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:56 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] up:boot 2024-09-21T06:25:57.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:56 smithi071 ceph-mon[34844]: fsmap 7 up:standby 2024-09-21T06:25:57.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:56 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:25:57.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:57 smithi071 ceph-mon[34844]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:57.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:57 smithi063 ceph-mon[31150]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:57.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:57 smithi175 ceph-mon[34510]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:58.518 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 21 06:25:58 smithi071 systemd[1]: Started Ceph mds.h for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:25:58.555 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:25:58.826 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:59.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.332+0000 7fecf59ba640 1 -- 172.21.15.63:0/1050387385 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecf01083a0 msgr2=0x7fecf01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:59.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.332+0000 7fecf59ba640 1 --2- 172.21.15.63:0/1050387385 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecf01083a0 0x7fecf01087b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fece4009900 tx=0x7fece402a410 comp rx=0 tx=0).stop 2024-09-21T06:25:59.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.332+0000 7fecf59ba640 1 -- 172.21.15.63:0/1050387385 shutdown_connections 2024-09-21T06:25:59.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.332+0000 7fecf59ba640 1 --2- 172.21.15.63:0/1050387385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf0108cf0 0x7fecf010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.332+0000 7fecf59ba640 1 --2- 172.21.15.63:0/1050387385 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecf01083a0 0x7fecf01087b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.332+0000 7fecf59ba640 1 --2- 172.21.15.63:0/1050387385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecf0102a60 0x7fecf0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.332+0000 7fecf59ba640 1 -- 172.21.15.63:0/1050387385 >> 172.21.15.63:0/1050387385 conn(0x7fecf0079730 msgr2=0x7fecf0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.332+0000 7fecf59ba640 1 -- 172.21.15.63:0/1050387385 shutdown_connections 2024-09-21T06:25:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.332+0000 7fecf59ba640 1 -- 172.21.15.63:0/1050387385 wait complete. 2024-09-21T06:25:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.333+0000 7fecf59ba640 1 Processor -- start 2024-09-21T06:25:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.333+0000 7fecf59ba640 1 -- start start 2024-09-21T06:25:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.333+0000 7fecf59ba640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecf0102a60 0x7fecf0199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.333+0000 7fecf59ba640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf01083a0 0x7fecf01999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.333+0000 7fecf59ba640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecf0108cf0 0x7fecf019ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.333+0000 7fecf59ba640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fecf0112960 con 0x7fecf0108cf0 2024-09-21T06:25:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.333+0000 7fecf59ba640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fecf01127e0 con 0x7fecf0102a60 2024-09-21T06:25:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.333+0000 7fecf59ba640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fecf0112ae0 con 0x7fecf01083a0 2024-09-21T06:25:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.333+0000 7fecef7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecf0108cf0 0x7fecf019ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.333+0000 7fecef7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecf0108cf0 0x7fecf019ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49680/0 (socket says 172.21.15.63:49680) 2024-09-21T06:25:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.333+0000 7fecef7fe640 1 -- 172.21.15.63:0/4211887102 learned_addr learned my addr 172.21.15.63:0/4211887102 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:25:59.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.333+0000 7feceeffd640 1 --2- 172.21.15.63:0/4211887102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecf0102a60 0x7fecf0199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.334+0000 7fecee7fc640 1 --2- 172.21.15.63:0/4211887102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf01083a0 0x7fecf01999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.334+0000 7fecef7fe640 1 -- 172.21.15.63:0/4211887102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf01083a0 msgr2=0x7fecf01999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:59.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.334+0000 7fecef7fe640 1 --2- 172.21.15.63:0/4211887102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf01083a0 0x7fecf01999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.334+0000 7fecef7fe640 1 -- 172.21.15.63:0/4211887102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecf0102a60 msgr2=0x7fecf0199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:59.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.334+0000 7fecef7fe640 1 --2- 172.21.15.63:0/4211887102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecf0102a60 0x7fecf0199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.334+0000 7fecef7fe640 1 -- 172.21.15.63:0/4211887102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf019f2e0 con 0x7fecf0108cf0 2024-09-21T06:25:59.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.334+0000 7fecee7fc640 1 --2- 172.21.15.63:0/4211887102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf01083a0 0x7fecf01999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:59.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.334+0000 7fecef7fe640 1 --2- 172.21.15.63:0/4211887102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecf0108cf0 0x7fecf019ec70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fece800cce0 tx=0x7fece800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:59.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.334+0000 7fecf49b8640 1 -- 172.21.15.63:0/4211887102 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece800f450 con 0x7fecf0108cf0 2024-09-21T06:25:59.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.334+0000 7fecf59ba640 1 -- 172.21.15.63:0/4211887102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf019f5d0 con 0x7fecf0108cf0 2024-09-21T06:25:59.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.334+0000 7fecf49b8640 1 -- 172.21.15.63:0/4211887102 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fece800faa0 con 0x7fecf0108cf0 2024-09-21T06:25:59.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.334+0000 7fecf49b8640 1 -- 172.21.15.63:0/4211887102 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece8018b70 con 0x7fecf0108cf0 2024-09-21T06:25:59.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.334+0000 7fecf59ba640 1 -- 172.21.15.63:0/4211887102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf01a5df0 con 0x7fecf0108cf0 2024-09-21T06:25:59.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.335+0000 7fecf59ba640 1 -- 172.21.15.63:0/4211887102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf0102e70 con 0x7fecf0108cf0 2024-09-21T06:25:59.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.337+0000 7fecf49b8640 1 -- 172.21.15.63:0/4211887102 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fece8018d10 con 0x7fecf0108cf0 2024-09-21T06:25:59.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.337+0000 7fecf49b8640 1 --2- 172.21.15.63:0/4211887102 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fecd80b6590 0x7fecd80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.338+0000 7feceeffd640 1 --2- 172.21.15.63:0/4211887102 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fecd80b6590 0x7fecd80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.338+0000 7fecf49b8640 1 -- 172.21.15.63:0/4211887102 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fece80e7400 con 0x7fecf0108cf0 2024-09-21T06:25:59.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.338+0000 7feceeffd640 1 --2- 172.21.15.63:0/4211887102 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fecd80b6590 0x7fecd80b8aa0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fece000bbe0 tx=0x7fece000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:59.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.341+0000 7fecf49b8640 1 -- 172.21.15.63:0/4211887102 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fece8014030 con 0x7fecf0108cf0 2024-09-21T06:25:59.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:59 smithi071 ceph-mon[34844]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:59.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:59 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:59.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:59 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:59.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:59 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:59.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:59 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:59.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:59 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:59.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:59 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:59.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:59 smithi071 ceph-mon[34844]: Deploying daemon mds.i on smithi175 2024-09-21T06:25:59.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:59 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] up:boot 2024-09-21T06:25:59.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:59 smithi071 ceph-mon[34844]: fsmap 8 up:standby 2024-09-21T06:25:59.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:25:59 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:25:59.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.566+0000 7fecf59ba640 1 -- 172.21.15.63:0/4211887102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fecf019a560 con 0x7fecf0108cf0 2024-09-21T06:25:59.568 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:59 smithi063 ceph-mon[31150]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:59.568 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:59 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:59.568 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:59 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:59.568 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:59 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:59.568 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:59 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:59.568 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:59 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:59.568 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:59 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:59.568 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:59 smithi063 ceph-mon[31150]: Deploying daemon mds.i on smithi175 2024-09-21T06:25:59.569 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:59 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] up:boot 2024-09-21T06:25:59.569 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:59 smithi063 ceph-mon[31150]: fsmap 8 up:standby 2024-09-21T06:25:59.569 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:25:59 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:25:59.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.566+0000 7fecf49b8640 1 -- 172.21.15.63:0/4211887102 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7213 (secure 0 0 0) 0x7fecf019a560 con 0x7fecf0108cf0 2024-09-21T06:25:59.569 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:25:59.569 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":9,"btime":"2024-09-21T06:25:58:560382+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24608,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24659,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24670,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T06:25:59.570 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 9 2024-09-21T06:25:59.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.569+0000 7fecf59ba640 1 -- 172.21.15.63:0/4211887102 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fecd80b6590 msgr2=0x7fecd80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:59.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.569+0000 7fecf59ba640 1 --2- 172.21.15.63:0/4211887102 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fecd80b6590 0x7fecd80b8aa0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fece000bbe0 tx=0x7fece000b390 comp rx=0 tx=0).stop 2024-09-21T06:25:59.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.569+0000 7fecf59ba640 1 -- 172.21.15.63:0/4211887102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecf0108cf0 msgr2=0x7fecf019ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:59.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.569+0000 7fecf59ba640 1 --2- 172.21.15.63:0/4211887102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecf0108cf0 0x7fecf019ec70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fece800cce0 tx=0x7fece800a620 comp rx=0 tx=0).stop 2024-09-21T06:25:59.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.569+0000 7fecf59ba640 1 -- 172.21.15.63:0/4211887102 shutdown_connections 2024-09-21T06:25:59.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.569+0000 7fecf59ba640 1 --2- 172.21.15.63:0/4211887102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecf0108cf0 0x7fecf019ec70 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.569+0000 7fecf59ba640 1 --2- 172.21.15.63:0/4211887102 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fecd80b6590 0x7fecd80b8aa0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.569+0000 7fecf59ba640 1 --2- 172.21.15.63:0/4211887102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf01083a0 0x7fecf01999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.569+0000 7fecf59ba640 1 --2- 172.21.15.63:0/4211887102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecf0102a60 0x7fecf0199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.569+0000 7fecf59ba640 1 -- 172.21.15.63:0/4211887102 >> 172.21.15.63:0/4211887102 conn(0x7fecf0079730 msgr2=0x7fecf0104520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:59.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.569+0000 7fecf59ba640 1 -- 172.21.15.63:0/4211887102 shutdown_connections 2024-09-21T06:25:59.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:25:59.569+0000 7fecf59ba640 1 -- 172.21.15.63:0/4211887102 wait complete. 2024-09-21T06:25:59.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:59 smithi175 ceph-mon[34510]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:25:59.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:59 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:59.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:59 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:59.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:59 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:25:59.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:59 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:25:59.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:59 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:25:59.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:59 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:59.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:59 smithi175 ceph-mon[34510]: Deploying daemon mds.i on smithi175 2024-09-21T06:25:59.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:59 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] up:boot 2024-09-21T06:25:59.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:59 smithi175 ceph-mon[34510]: fsmap 8 up:standby 2024-09-21T06:25:59.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:25:59 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:26:00.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:00 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/4211887102' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:00.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:00 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/4211887102' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:00.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:00 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/4211887102' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:00.961 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 06:26:00 smithi175 systemd[1]: Started Ceph mds.i for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:26:01.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:01 smithi071 ceph-mon[34844]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:01.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:01 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:01.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:01 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:01.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:01 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:01.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:01 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:26:01.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:01 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:26:01.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:01 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:26:01.526 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:01 smithi175 ceph-mon[34510]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:01.526 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:01 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:01.526 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:01 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:01.526 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:01 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:01.526 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:01 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:26:01.526 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:01 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:26:01.526 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:01 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:26:01.534 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:01 smithi063 ceph-mon[31150]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:01.534 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:01 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:01.534 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:01 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:01.534 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:01 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:01.534 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:01 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:26:01.534 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:01 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:26:01.534 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:01 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:26:02.237 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:26:02.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:02 smithi071 ceph-mon[34844]: Deploying daemon mds.g on smithi063 2024-09-21T06:26:02.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:02 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] up:boot 2024-09-21T06:26:02.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:02 smithi071 ceph-mon[34844]: fsmap 9 up:standby 2024-09-21T06:26:02.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:02 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:26:02.519 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:02.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:02 smithi063 ceph-mon[31150]: Deploying daemon mds.g on smithi063 2024-09-21T06:26:02.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:02 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] up:boot 2024-09-21T06:26:02.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:02 smithi063 ceph-mon[31150]: fsmap 9 up:standby 2024-09-21T06:26:02.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:02 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:26:02.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:02 smithi175 ceph-mon[34510]: Deploying daemon mds.g on smithi063 2024-09-21T06:26:02.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:02 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] up:boot 2024-09-21T06:26:02.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:02 smithi175 ceph-mon[34510]: fsmap 9 up:standby 2024-09-21T06:26:02.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:02 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:26:03.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.046+0000 7fea84633640 1 -- 172.21.15.63:0/187228756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea7c1083a0 msgr2=0x7fea7c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:03.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.046+0000 7fea84633640 1 --2- 172.21.15.63:0/187228756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea7c1083a0 0x7fea7c1087b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fea6c009900 tx=0x7fea6c02a410 comp rx=0 tx=0).stop 2024-09-21T06:26:03.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.046+0000 7fea84633640 1 -- 172.21.15.63:0/187228756 shutdown_connections 2024-09-21T06:26:03.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.046+0000 7fea84633640 1 --2- 172.21.15.63:0/187228756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea7c108cf0 0x7fea7c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.046+0000 7fea84633640 1 --2- 172.21.15.63:0/187228756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea7c1083a0 0x7fea7c1087b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.046+0000 7fea84633640 1 --2- 172.21.15.63:0/187228756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea7c102a60 0x7fea7c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.046+0000 7fea84633640 1 -- 172.21.15.63:0/187228756 >> 172.21.15.63:0/187228756 conn(0x7fea7c079730 msgr2=0x7fea7c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:03.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.046+0000 7fea84633640 1 -- 172.21.15.63:0/187228756 shutdown_connections 2024-09-21T06:26:03.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.046+0000 7fea84633640 1 -- 172.21.15.63:0/187228756 wait complete. 2024-09-21T06:26:03.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.047+0000 7fea84633640 1 Processor -- start 2024-09-21T06:26:03.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.047+0000 7fea84633640 1 -- start start 2024-09-21T06:26:03.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.047+0000 7fea84633640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea7c102a60 0x7fea7c19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.047+0000 7fea84633640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea7c1083a0 0x7fea7c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.047+0000 7fea84633640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea7c108cf0 0x7fea7c19fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.047+0000 7fea84633640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c112960 con 0x7fea7c102a60 2024-09-21T06:26:03.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.047+0000 7fea84633640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c1127e0 con 0x7fea7c108cf0 2024-09-21T06:26:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.047+0000 7fea84633640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c112ae0 con 0x7fea7c1083a0 2024-09-21T06:26:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.047+0000 7fea823cf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea7c102a60 0x7fea7c19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.047+0000 7fea823cf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea7c102a60 0x7fea7c19a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49692/0 (socket says 172.21.15.63:49692) 2024-09-21T06:26:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.047+0000 7fea823cf640 1 -- 172.21.15.63:0/4130236091 learned_addr learned my addr 172.21.15.63:0/4130236091 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.047+0000 7fea82bd0640 1 --2- 172.21.15.63:0/4130236091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea7c108cf0 0x7fea7c19fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.047+0000 7fea81bce640 1 --2- 172.21.15.63:0/4130236091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea7c1083a0 0x7fea7c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.047+0000 7fea823cf640 1 -- 172.21.15.63:0/4130236091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea7c1083a0 msgr2=0x7fea7c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.047+0000 7fea823cf640 1 --2- 172.21.15.63:0/4130236091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea7c1083a0 0x7fea7c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.047+0000 7fea823cf640 1 -- 172.21.15.63:0/4130236091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea7c108cf0 msgr2=0x7fea7c19fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.047+0000 7fea823cf640 1 --2- 172.21.15.63:0/4130236091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea7c108cf0 0x7fea7c19fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.047+0000 7fea823cf640 1 -- 172.21.15.63:0/4130236091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7c1a0510 con 0x7fea7c102a60 2024-09-21T06:26:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.047+0000 7fea81bce640 1 --2- 172.21.15.63:0/4130236091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea7c1083a0 0x7fea7c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.048+0000 7fea823cf640 1 --2- 172.21.15.63:0/4130236091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea7c102a60 0x7fea7c19a5a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fea7800d770 tx=0x7fea7800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.048+0000 7fea737fe640 1 -- 172.21.15.63:0/4130236091 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78017070 con 0x7fea7c102a60 2024-09-21T06:26:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.048+0000 7fea84633640 1 -- 172.21.15.63:0/4130236091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea7c1a0800 con 0x7fea7c102a60 2024-09-21T06:26:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.048+0000 7fea737fe640 1 -- 172.21.15.63:0/4130236091 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea780054d0 con 0x7fea7c102a60 2024-09-21T06:26:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.048+0000 7fea737fe640 1 -- 172.21.15.63:0/4130236091 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78004c30 con 0x7fea7c102a60 2024-09-21T06:26:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.048+0000 7fea84633640 1 -- 172.21.15.63:0/4130236091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea7c1a6f60 con 0x7fea7c102a60 2024-09-21T06:26:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.049+0000 7fea84633640 1 -- 172.21.15.63:0/4130236091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea7c102e70 con 0x7fea7c102a60 2024-09-21T06:26:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.051+0000 7fea737fe640 1 -- 172.21.15.63:0/4130236091 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fea78004dd0 con 0x7fea7c102a60 2024-09-21T06:26:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.051+0000 7fea737fe640 1 --2- 172.21.15.63:0/4130236091 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fea680b6560 0x7fea680b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.052+0000 7fea81bce640 1 --2- 172.21.15.63:0/4130236091 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fea680b6560 0x7fea680b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.052+0000 7fea737fe640 1 -- 172.21.15.63:0/4130236091 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fea780e6e40 con 0x7fea7c102a60 2024-09-21T06:26:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.052+0000 7fea81bce640 1 --2- 172.21.15.63:0/4130236091 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fea680b6560 0x7fea680b8a70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fea6c000c00 tx=0x7fea6c032cc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:03.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.055+0000 7fea737fe640 1 -- 172.21.15.63:0/4130236091 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fea780adaa0 con 0x7fea7c102a60 2024-09-21T06:26:03.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.288+0000 7fea84633640 1 -- 172.21.15.63:0/4130236091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea7c1a7130 con 0x7fea7c102a60 2024-09-21T06:26:03.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.288+0000 7fea737fe640 1 -- 172.21.15.63:0/4130236091 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8043 (secure 0 0 0) 0x7fea780b1e80 con 0x7fea7c102a60 2024-09-21T06:26:03.290 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:26:03.290 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":10,"btime":"2024-09-21T06:26:01:239291+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24608,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24659,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24670,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24694,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T06:26:03.291 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 10 2024-09-21T06:26:03.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.290+0000 7fea84633640 1 -- 172.21.15.63:0/4130236091 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fea680b6560 msgr2=0x7fea680b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:03.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.290+0000 7fea84633640 1 --2- 172.21.15.63:0/4130236091 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fea680b6560 0x7fea680b8a70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fea6c000c00 tx=0x7fea6c032cc0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.290+0000 7fea84633640 1 -- 172.21.15.63:0/4130236091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea7c102a60 msgr2=0x7fea7c19a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:03.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.290+0000 7fea84633640 1 --2- 172.21.15.63:0/4130236091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea7c102a60 0x7fea7c19a5a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fea7800d770 tx=0x7fea7800dc30 comp rx=0 tx=0).stop 2024-09-21T06:26:03.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.290+0000 7fea84633640 1 -- 172.21.15.63:0/4130236091 shutdown_connections 2024-09-21T06:26:03.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.290+0000 7fea84633640 1 --2- 172.21.15.63:0/4130236091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea7c108cf0 0x7fea7c19fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.290+0000 7fea84633640 1 --2- 172.21.15.63:0/4130236091 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fea680b6560 0x7fea680b8a70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.290+0000 7fea84633640 1 --2- 172.21.15.63:0/4130236091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea7c1083a0 0x7fea7c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.290+0000 7fea84633640 1 --2- 172.21.15.63:0/4130236091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea7c102a60 0x7fea7c19a5a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.290+0000 7fea84633640 1 -- 172.21.15.63:0/4130236091 >> 172.21.15.63:0/4130236091 conn(0x7fea7c079730 msgr2=0x7fea7c1019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:03.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.290+0000 7fea84633640 1 -- 172.21.15.63:0/4130236091 shutdown_connections 2024-09-21T06:26:03.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:03.290+0000 7fea84633640 1 -- 172.21.15.63:0/4130236091 wait complete. 2024-09-21T06:26:03.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:03 smithi071 ceph-mon[34844]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:03.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:03 smithi063 ceph-mon[31150]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:03.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:03 smithi175 ceph-mon[34510]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:04.263 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 21 06:26:04 smithi063 ceph-mds[72905]: -- 172.21.15.63:0/1904525392 <== mon.0 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56549cb23860 con 0x5654a0ccba80 2024-09-21T06:26:04.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:04 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/4130236091' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:04.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:04 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/4130236091' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:04.582 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 21 06:26:04 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-g[72896]: starting mds.g at 2024-09-21T06:26:04.582 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 21 06:26:04 smithi063 bash[72869]: 6b8372c01d429f3810f265a0428b6f0954e684ec113d68c3e5c368d519dc9a07 2024-09-21T06:26:04.583 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 21 06:26:04 smithi063 systemd[1]: Started Ceph mds.g for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:26:04.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:04 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/4130236091' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:05.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:05 smithi071 ceph-mon[34844]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:05.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:05 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:05.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:05 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:05.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:05 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:05.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:05 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:26:05.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:05 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:26:05.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:05 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:26:05.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:05 smithi071 ceph-mon[34844]: Deploying daemon mds.a on smithi063 2024-09-21T06:26:05.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:05 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.63:6838/2446248912,v1:172.21.15.63:6839/2446248912] up:boot 2024-09-21T06:26:05.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:05 smithi071 ceph-mon[34844]: fsmap 10 up:standby 2024-09-21T06:26:05.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:05 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T06:26:05.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:05 smithi063 ceph-mon[31150]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:05.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:05 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:05.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:05 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:05.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:05 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:05.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:05 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:26:05.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:05 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:26:05.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:05 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:26:05.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:05 smithi063 ceph-mon[31150]: Deploying daemon mds.a on smithi063 2024-09-21T06:26:05.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:05 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.63:6838/2446248912,v1:172.21.15.63:6839/2446248912] up:boot 2024-09-21T06:26:05.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:05 smithi063 ceph-mon[31150]: fsmap 10 up:standby 2024-09-21T06:26:05.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:05 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T06:26:05.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:05 smithi175 ceph-mon[34510]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:05.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:05 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:05.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:05 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:05.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:05 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:05.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:05 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:26:05.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:05 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:26:05.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:05 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:26:05.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:05 smithi175 ceph-mon[34510]: Deploying daemon mds.a on smithi063 2024-09-21T06:26:05.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:05 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.63:6838/2446248912,v1:172.21.15.63:6839/2446248912] up:boot 2024-09-21T06:26:05.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:05 smithi175 ceph-mon[34510]: fsmap 10 up:standby 2024-09-21T06:26:05.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:05 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T06:26:06.016 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:26:06.374 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:06.501 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 21 06:26:06 smithi063 systemd[1]: Starting Ceph mds.a for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:26:06.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.878+0000 7ff3dace0640 1 -- 172.21.15.63:0/2383199886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3d4108cf0 msgr2=0x7ff3d410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:06.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.878+0000 7ff3dace0640 1 --2- 172.21.15.63:0/2383199886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3d4108cf0 0x7ff3d410f520 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc009900 tx=0x7ff3cc02a410 comp rx=0 tx=0).stop 2024-09-21T06:26:06.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.878+0000 7ff3dace0640 1 -- 172.21.15.63:0/2383199886 shutdown_connections 2024-09-21T06:26:06.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.878+0000 7ff3dace0640 1 --2- 172.21.15.63:0/2383199886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3d4108cf0 0x7ff3d410f520 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.878+0000 7ff3dace0640 1 --2- 172.21.15.63:0/2383199886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d41083a0 0x7ff3d41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.878+0000 7ff3dace0640 1 --2- 172.21.15.63:0/2383199886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3d4102a60 0x7ff3d4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.878+0000 7ff3dace0640 1 -- 172.21.15.63:0/2383199886 >> 172.21.15.63:0/2383199886 conn(0x7ff3d4079730 msgr2=0x7ff3d4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:06.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.878+0000 7ff3dace0640 1 -- 172.21.15.63:0/2383199886 shutdown_connections 2024-09-21T06:26:06.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.878+0000 7ff3dace0640 1 -- 172.21.15.63:0/2383199886 wait complete. 2024-09-21T06:26:06.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.879+0000 7ff3dace0640 1 Processor -- start 2024-09-21T06:26:06.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.879+0000 7ff3dace0640 1 -- start start 2024-09-21T06:26:06.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.879+0000 7ff3dace0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3d4102a60 0x7ff3d419b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.879+0000 7ff3dace0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3d41083a0 0x7ff3d419b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.879+0000 7ff3dace0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d4108cf0 0x7ff3d419bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.879+0000 7ff3dace0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d4112960 con 0x7ff3d41083a0 2024-09-21T06:26:06.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.879+0000 7ff3dace0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d41127e0 con 0x7ff3d4108cf0 2024-09-21T06:26:06.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.879+0000 7ff3dace0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d4112ae0 con 0x7ff3d4102a60 2024-09-21T06:26:06.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.880+0000 7ff3d3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3d41083a0 0x7ff3d419b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.880+0000 7ff3d3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3d41083a0 0x7ff3d419b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51204/0 (socket says 172.21.15.63:51204) 2024-09-21T06:26:06.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.880+0000 7ff3d3fff640 1 -- 172.21.15.63:0/2968072859 learned_addr learned my addr 172.21.15.63:0/2968072859 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:06.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.880+0000 7ff3d8a7c640 1 --2- 172.21.15.63:0/2968072859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3d4102a60 0x7ff3d419b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.880+0000 7ff3d927d640 1 --2- 172.21.15.63:0/2968072859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d4108cf0 0x7ff3d419bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.880+0000 7ff3d3fff640 1 -- 172.21.15.63:0/2968072859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3d4102a60 msgr2=0x7ff3d419b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:06.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.880+0000 7ff3d3fff640 1 --2- 172.21.15.63:0/2968072859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3d4102a60 0x7ff3d419b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.880+0000 7ff3d3fff640 1 -- 172.21.15.63:0/2968072859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d4108cf0 msgr2=0x7ff3d419bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:06.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.880+0000 7ff3d3fff640 1 --2- 172.21.15.63:0/2968072859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d4108cf0 0x7ff3d419bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.880+0000 7ff3d3fff640 1 -- 172.21.15.63:0/2968072859 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d41a6530 con 0x7ff3d41083a0 2024-09-21T06:26:06.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.880+0000 7ff3d927d640 1 --2- 172.21.15.63:0/2968072859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d4108cf0 0x7ff3d419bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:06.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.880+0000 7ff3d3fff640 1 --2- 172.21.15.63:0/2968072859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3d41083a0 0x7ff3d419b7b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400eb90 tx=0x7ff3c400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:06.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.880+0000 7ff3d1ffb640 1 -- 172.21.15.63:0/2968072859 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4010630 con 0x7ff3d41083a0 2024-09-21T06:26:06.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.880+0000 7ff3dace0640 1 -- 172.21.15.63:0/2968072859 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d41a6820 con 0x7ff3d41083a0 2024-09-21T06:26:06.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.880+0000 7ff3d1ffb640 1 -- 172.21.15.63:0/2968072859 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3c400ee90 con 0x7ff3d41083a0 2024-09-21T06:26:06.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.880+0000 7ff3d1ffb640 1 -- 172.21.15.63:0/2968072859 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4018ac0 con 0x7ff3d41083a0 2024-09-21T06:26:06.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.881+0000 7ff3dace0640 1 -- 172.21.15.63:0/2968072859 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d41a6db0 con 0x7ff3d41083a0 2024-09-21T06:26:06.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.881+0000 7ff3dace0640 1 -- 172.21.15.63:0/2968072859 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3d4102e70 con 0x7ff3d41083a0 2024-09-21T06:26:06.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.883+0000 7ff3d1ffb640 1 -- 172.21.15.63:0/2968072859 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7ff3c4018c60 con 0x7ff3d41083a0 2024-09-21T06:26:06.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.884+0000 7ff3d1ffb640 1 --2- 172.21.15.63:0/2968072859 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff3c00b6560 0x7ff3c00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.884+0000 7ff3d8a7c640 1 --2- 172.21.15.63:0/2968072859 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff3c00b6560 0x7ff3c00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.884+0000 7ff3d1ffb640 1 -- 172.21.15.63:0/2968072859 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7ff3c40e7a30 con 0x7ff3d41083a0 2024-09-21T06:26:06.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.884+0000 7ff3d8a7c640 1 --2- 172.21.15.63:0/2968072859 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff3c00b6560 0x7ff3c00b8a70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff3d406b9e0 tx=0x7ff3bc00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:06.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:06.887+0000 7ff3d1ffb640 1 -- 172.21.15.63:0/2968072859 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff3c40ae690 con 0x7ff3d41083a0 2024-09-21T06:26:07.082 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 21 06:26:07 smithi063 podman[73256]: 2024-09-21 06:26:06.929466233 +0000 UTC m=+0.020421231 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:26:07.082 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 21 06:26:07 smithi063 podman[73256]: 2024-09-21 06:26:07.029194668 +0000 UTC m=+0.120149662 container create e1f8a16f1e1ecd98d450addc1afe0d0cd79f28137a1da184edaddc6a50d9f360 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-a, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T06:26:07.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:07.125+0000 7ff3dace0640 1 -- 172.21.15.63:0/2968072859 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3d406b290 con 0x7ff3d41083a0 2024-09-21T06:26:07.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:07.125+0000 7ff3d1ffb640 1 -- 172.21.15.63:0/2968072859 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8869 (secure 0 0 0) 0x7ff3c40b2a70 con 0x7ff3d41083a0 2024-09-21T06:26:07.127 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:26:07.127 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":11,"btime":"2024-09-21T06:26:05:262307+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24608,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24659,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24670,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24694,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T06:26:07.128 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 11 2024-09-21T06:26:07.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:07.127+0000 7ff3dace0640 1 -- 172.21.15.63:0/2968072859 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff3c00b6560 msgr2=0x7ff3c00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:07.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:07.127+0000 7ff3dace0640 1 --2- 172.21.15.63:0/2968072859 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff3c00b6560 0x7ff3c00b8a70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff3d406b9e0 tx=0x7ff3bc00b390 comp rx=0 tx=0).stop 2024-09-21T06:26:07.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:07.127+0000 7ff3dace0640 1 -- 172.21.15.63:0/2968072859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3d41083a0 msgr2=0x7ff3d419b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:07.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:07.127+0000 7ff3dace0640 1 --2- 172.21.15.63:0/2968072859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3d41083a0 0x7ff3d419b7b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400eb90 tx=0x7ff3c400c6a0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:07.128+0000 7ff3dace0640 1 -- 172.21.15.63:0/2968072859 shutdown_connections 2024-09-21T06:26:07.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:07.128+0000 7ff3dace0640 1 --2- 172.21.15.63:0/2968072859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d4108cf0 0x7ff3d419bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:07.128+0000 7ff3dace0640 1 --2- 172.21.15.63:0/2968072859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3d41083a0 0x7ff3d419b7b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:07.128+0000 7ff3dace0640 1 --2- 172.21.15.63:0/2968072859 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff3c00b6560 0x7ff3c00b8a70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:07.128+0000 7ff3dace0640 1 --2- 172.21.15.63:0/2968072859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3d4102a60 0x7ff3d419b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:07.128+0000 7ff3dace0640 1 -- 172.21.15.63:0/2968072859 >> 172.21.15.63:0/2968072859 conn(0x7ff3d4079730 msgr2=0x7ff3d4104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:07.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:07.128+0000 7ff3dace0640 1 -- 172.21.15.63:0/2968072859 shutdown_connections 2024-09-21T06:26:07.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:07.128+0000 7ff3dace0640 1 -- 172.21.15.63:0/2968072859 wait complete. 2024-09-21T06:26:07.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:07 smithi071 ceph-mon[34844]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:07.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:07 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2968072859' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:07.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:07 smithi063 ceph-mon[31150]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:07.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:07 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2968072859' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:07.833 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 21 06:26:07 smithi063 podman[73256]: 2024-09-21 06:26:07.458536393 +0000 UTC m=+0.549491389 container init e1f8a16f1e1ecd98d450addc1afe0d0cd79f28137a1da184edaddc6a50d9f360 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True) 2024-09-21T06:26:07.833 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 21 06:26:07 smithi063 podman[73256]: 2024-09-21 06:26:07.461650995 +0000 UTC m=+0.552605991 container start e1f8a16f1e1ecd98d450addc1afe0d0cd79f28137a1da184edaddc6a50d9f360 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T06:26:07.833 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 21 06:26:07 smithi063 ceph-mds[73288]: -- 172.21.15.63:0/1514226730 <== mon.0 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56417f4c1c20 con 0x564183669a80 2024-09-21T06:26:07.833 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 21 06:26:07 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-a[73284]: starting mds.a at 2024-09-21T06:26:07.833 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 21 06:26:07 smithi063 bash[73256]: e1f8a16f1e1ecd98d450addc1afe0d0cd79f28137a1da184edaddc6a50d9f360 2024-09-21T06:26:07.833 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 21 06:26:07 smithi063 systemd[1]: Started Ceph mds.a for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:26:07.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:07 smithi175 ceph-mon[34510]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:07.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:07 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2968072859' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:08.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:08 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:08.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:08 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:08.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:08 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:08.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:08 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:26:08.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:08 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:26:08.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:08 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:26:08.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:08 smithi175 ceph-mon[34510]: Deploying daemon mds.b on smithi071 2024-09-21T06:26:08.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:08 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] up:boot 2024-09-21T06:26:08.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:08 smithi175 ceph-mon[34510]: fsmap 11 up:standby 2024-09-21T06:26:08.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:08 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T06:26:09.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:08 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:09.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:08 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:09.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:08 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:09.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:08 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:26:09.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:08 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:26:09.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:08 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:26:09.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:08 smithi071 ceph-mon[34844]: Deploying daemon mds.b on smithi071 2024-09-21T06:26:09.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:08 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] up:boot 2024-09-21T06:26:09.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:08 smithi071 ceph-mon[34844]: fsmap 11 up:standby 2024-09-21T06:26:09.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:08 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T06:26:09.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:08 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:09.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:08 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:09.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:08 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:09.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:08 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:26:09.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:08 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:26:09.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:08 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:26:09.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:08 smithi063 ceph-mon[31150]: Deploying daemon mds.b on smithi071 2024-09-21T06:26:09.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:08 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] up:boot 2024-09-21T06:26:09.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:08 smithi063 ceph-mon[31150]: fsmap 11 up:standby 2024-09-21T06:26:09.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:08 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T06:26:09.909 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:09 smithi071 ceph-mon[34844]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:09.909 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:26:09 smithi071 systemd[1]: Starting Ceph mds.b for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:26:10.052 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:26:10.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:09 smithi063 ceph-mon[31150]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:10.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:09 smithi175 ceph-mon[34510]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:10.183 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:26:09 smithi071 podman[63955]: 2024-09-21 06:26:09.810825192 +0000 UTC m=+0.015840613 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:26:10.183 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:26:09 smithi071 podman[63955]: 2024-09-21 06:26:09.928523715 +0000 UTC m=+0.133539127 container create 0b826c7310b6d6c198fe5be608a821fcbf880dd372290899b66d374716c96025 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T06:26:10.183 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:26:10 smithi071 podman[63955]: 2024-09-21 06:26:10.181995947 +0000 UTC m=+0.387011354 container init 0b826c7310b6d6c198fe5be608a821fcbf880dd372290899b66d374716c96025 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T06:26:10.327 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:10.518 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:26:10 smithi071 podman[63955]: 2024-09-21 06:26:10.185019218 +0000 UTC m=+0.390034636 container start 0b826c7310b6d6c198fe5be608a821fcbf880dd372290899b66d374716c96025 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T06:26:10.518 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:26:10 smithi071 ceph-mds[63974]: -- 172.21.15.71:0/2131697882 <== mon.2 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563ad672f860 con 0x563ada8d7180 2024-09-21T06:26:10.518 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:26:10 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: starting mds.b at 2024-09-21T06:26:10.518 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:26:10 smithi071 bash[63955]: 0b826c7310b6d6c198fe5be608a821fcbf880dd372290899b66d374716c96025 2024-09-21T06:26:10.518 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:26:10 smithi071 systemd[1]: Started Ceph mds.b for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:26:10.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.826+0000 7faf525f2640 1 -- 172.21.15.63:0/1360075206 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf4c108cf0 msgr2=0x7faf4c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:10.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.826+0000 7faf525f2640 1 --2- 172.21.15.63:0/1360075206 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf4c108cf0 0x7faf4c10f520 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faf44009ca0 tx=0x7faf4402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:26:10.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.826+0000 7faf525f2640 1 -- 172.21.15.63:0/1360075206 shutdown_connections 2024-09-21T06:26:10.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.826+0000 7faf525f2640 1 --2- 172.21.15.63:0/1360075206 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf4c108cf0 0x7faf4c10f520 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:10.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.826+0000 7faf525f2640 1 --2- 172.21.15.63:0/1360075206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf4c1083a0 0x7faf4c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:10.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.826+0000 7faf525f2640 1 --2- 172.21.15.63:0/1360075206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf4c102a60 0x7faf4c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:10.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.826+0000 7faf525f2640 1 -- 172.21.15.63:0/1360075206 >> 172.21.15.63:0/1360075206 conn(0x7faf4c079730 msgr2=0x7faf4c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:10.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.826+0000 7faf525f2640 1 -- 172.21.15.63:0/1360075206 shutdown_connections 2024-09-21T06:26:10.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.826+0000 7faf525f2640 1 -- 172.21.15.63:0/1360075206 wait complete. 2024-09-21T06:26:10.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.827+0000 7faf525f2640 1 Processor -- start 2024-09-21T06:26:10.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.827+0000 7faf525f2640 1 -- start start 2024-09-21T06:26:10.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf525f2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf4c102a60 0x7faf4c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:10.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf525f2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf4c1083a0 0x7faf4c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:10.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf525f2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf4c108cf0 0x7faf4c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:10.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf525f2640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faf4c112960 con 0x7faf4c1083a0 2024-09-21T06:26:10.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf525f2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faf4c1127e0 con 0x7faf4c108cf0 2024-09-21T06:26:10.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf525f2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faf4c112ae0 con 0x7faf4c102a60 2024-09-21T06:26:10.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf4b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf4c1083a0 0x7faf4c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:10.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf4b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf4c1083a0 0x7faf4c19aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51254/0 (socket says 172.21.15.63:51254) 2024-09-21T06:26:10.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf4b7fe640 1 -- 172.21.15.63:0/3614328730 learned_addr learned my addr 172.21.15.63:0/3614328730 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:10.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf50b8f640 1 --2- 172.21.15.63:0/3614328730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf4c108cf0 0x7faf4c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:10.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf4bfff640 1 --2- 172.21.15.63:0/3614328730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf4c102a60 0x7faf4c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:10.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf4b7fe640 1 -- 172.21.15.63:0/3614328730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf4c102a60 msgr2=0x7faf4c19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:10.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf4b7fe640 1 --2- 172.21.15.63:0/3614328730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf4c102a60 0x7faf4c19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:10.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf4b7fe640 1 -- 172.21.15.63:0/3614328730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf4c108cf0 msgr2=0x7faf4c19fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:10.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf4b7fe640 1 --2- 172.21.15.63:0/3614328730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf4c108cf0 0x7faf4c19fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:10.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf4b7fe640 1 -- 172.21.15.63:0/3614328730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf4c1a0410 con 0x7faf4c1083a0 2024-09-21T06:26:10.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf4b7fe640 1 --2- 172.21.15.63:0/3614328730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf4c1083a0 0x7faf4c19aa40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faf4000d740 tx=0x7faf4000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:10.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf497fa640 1 -- 172.21.15.63:0/3614328730 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf40017070 con 0x7faf4c1083a0 2024-09-21T06:26:10.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf525f2640 1 -- 172.21.15.63:0/3614328730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf4c1a0700 con 0x7faf4c1083a0 2024-09-21T06:26:10.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf497fa640 1 -- 172.21.15.63:0/3614328730 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf4000de50 con 0x7faf4c1083a0 2024-09-21T06:26:10.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf497fa640 1 -- 172.21.15.63:0/3614328730 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf40004ce0 con 0x7faf4c1083a0 2024-09-21T06:26:10.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.828+0000 7faf525f2640 1 -- 172.21.15.63:0/3614328730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf4c1a6e60 con 0x7faf4c1083a0 2024-09-21T06:26:10.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.830+0000 7faf525f2640 1 -- 172.21.15.63:0/3614328730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf4c102e70 con 0x7faf4c1083a0 2024-09-21T06:26:10.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.831+0000 7faf497fa640 1 -- 172.21.15.63:0/3614328730 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7faf40004e80 con 0x7faf4c1083a0 2024-09-21T06:26:10.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.832+0000 7faf497fa640 1 --2- 172.21.15.63:0/3614328730 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7faf340b6560 0x7faf340b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:10.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.832+0000 7faf4bfff640 1 --2- 172.21.15.63:0/3614328730 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7faf340b6560 0x7faf340b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:10.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.832+0000 7faf497fa640 1 -- 172.21.15.63:0/3614328730 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7faf400e6cb0 con 0x7faf4c1083a0 2024-09-21T06:26:10.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.832+0000 7faf4bfff640 1 --2- 172.21.15.63:0/3614328730 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7faf340b6560 0x7faf340b8a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faf3c005fd0 tx=0x7faf3c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:10.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:10.835+0000 7faf497fa640 1 -- 172.21.15.63:0/3614328730 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faf400ad910 con 0x7faf4c1083a0 2024-09-21T06:26:11.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:11.076+0000 7faf525f2640 1 -- 172.21.15.63:0/3614328730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf4c10baf0 con 0x7faf4c1083a0 2024-09-21T06:26:11.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:11.077+0000 7faf497fa640 1 -- 172.21.15.63:0/3614328730 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10521 (secure 0 0 0) 0x7faf400b1cf0 con 0x7faf4c1083a0 2024-09-21T06:26:11.079 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:26:11.079 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":13,"btime":"2024-09-21T06:26:10:620780+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24608,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24659,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24670,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24694,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24698,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6839/3472481253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3472481253},{"type":"v1","addr":"172.21.15.71:6839","nonce":3472481253}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T06:26:11.079 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2024-09-21T06:26:11.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:11.079+0000 7faf525f2640 1 -- 172.21.15.63:0/3614328730 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7faf340b6560 msgr2=0x7faf340b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:11.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:11.079+0000 7faf525f2640 1 --2- 172.21.15.63:0/3614328730 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7faf340b6560 0x7faf340b8a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faf3c005fd0 tx=0x7faf3c005850 comp rx=0 tx=0).stop 2024-09-21T06:26:11.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:11.079+0000 7faf525f2640 1 -- 172.21.15.63:0/3614328730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf4c1083a0 msgr2=0x7faf4c19aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:11.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:11.079+0000 7faf525f2640 1 --2- 172.21.15.63:0/3614328730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf4c1083a0 0x7faf4c19aa40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faf4000d740 tx=0x7faf4000dc00 comp rx=0 tx=0).stop 2024-09-21T06:26:11.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:11.080+0000 7faf525f2640 1 -- 172.21.15.63:0/3614328730 shutdown_connections 2024-09-21T06:26:11.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:11.080+0000 7faf525f2640 1 --2- 172.21.15.63:0/3614328730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf4c108cf0 0x7faf4c19fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:11.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:11.080+0000 7faf525f2640 1 --2- 172.21.15.63:0/3614328730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf4c1083a0 0x7faf4c19aa40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:11.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:11.080+0000 7faf525f2640 1 --2- 172.21.15.63:0/3614328730 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7faf340b6560 0x7faf340b8a70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:11.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:11.080+0000 7faf525f2640 1 --2- 172.21.15.63:0/3614328730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf4c102a60 0x7faf4c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:11.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:11.080+0000 7faf525f2640 1 -- 172.21.15.63:0/3614328730 >> 172.21.15.63:0/3614328730 conn(0x7faf4c079730 msgr2=0x7faf4c06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:11.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:11.080+0000 7faf525f2640 1 -- 172.21.15.63:0/3614328730 shutdown_connections 2024-09-21T06:26:11.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:11.080+0000 7faf525f2640 1 -- 172.21.15.63:0/3614328730 wait complete. 2024-09-21T06:26:11.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:11 smithi071 ceph-mon[34844]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:11.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:11.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:11.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:11.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:11.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:11.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:11.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:11 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] up:boot 2024-09-21T06:26:11.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:11 smithi071 ceph-mon[34844]: fsmap 12 up:standby 2024-09-21T06:26:11.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:11 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:26:11.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:11 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3614328730' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:11.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:11 smithi063 ceph-mon[31150]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:11.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:11.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:11.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:11.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:11.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:11.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:11.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:11 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] up:boot 2024-09-21T06:26:11.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:11 smithi063 ceph-mon[31150]: fsmap 12 up:standby 2024-09-21T06:26:11.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:11 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:26:11.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:11 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3614328730' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:11 smithi175 ceph-mon[34510]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:11 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] up:boot 2024-09-21T06:26:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:11 smithi175 ceph-mon[34510]: fsmap 12 up:standby 2024-09-21T06:26:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:11 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:26:11.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:11 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3614328730' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:12.358 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T06:26:12.687 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:13.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:12 smithi071 ceph-mon[34844]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:13.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:12 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:13.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:12 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:13.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:12 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:13.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:12 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:13.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:12 smithi063 ceph-mon[31150]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:13.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:12 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:13.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:12 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:13.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:12 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:13.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:12 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:13.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.175+0000 7f253d3d8640 1 -- 172.21.15.63:0/1864792690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25381052a0 msgr2=0x7f253810d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:13.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.175+0000 7f253d3d8640 1 --2- 172.21.15.63:0/1864792690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25381052a0 0x7f253810d930 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f252c009900 tx=0x7f252c02a410 comp rx=0 tx=0).stop 2024-09-21T06:26:13.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.176+0000 7f253d3d8640 1 -- 172.21.15.63:0/1864792690 shutdown_connections 2024-09-21T06:26:13.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.176+0000 7f253d3d8640 1 --2- 172.21.15.63:0/1864792690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253810de70 0x7f2538110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:13.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.176+0000 7f253d3d8640 1 --2- 172.21.15.63:0/1864792690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25381052a0 0x7f253810d930 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:13.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.176+0000 7f253d3d8640 1 --2- 172.21.15.63:0/1864792690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25381048c0 0x7f2538104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:13.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.176+0000 7f253d3d8640 1 -- 172.21.15.63:0/1864792690 >> 172.21.15.63:0/1864792690 conn(0x7f2538079760 msgr2=0x7f2538079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:13.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.176+0000 7f253d3d8640 1 -- 172.21.15.63:0/1864792690 shutdown_connections 2024-09-21T06:26:13.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.176+0000 7f253d3d8640 1 -- 172.21.15.63:0/1864792690 wait complete. 2024-09-21T06:26:13.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.176+0000 7f253d3d8640 1 Processor -- start 2024-09-21T06:26:13.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.176+0000 7f253d3d8640 1 -- start start 2024-09-21T06:26:13.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.177+0000 7f253d3d8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25381048c0 0x7f25381027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:13.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.177+0000 7f253d3d8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25381052a0 0x7f2538102d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:13.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.177+0000 7f253d3d8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253810de70 0x7f2538103250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:13.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.177+0000 7f253d3d8640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2538113ab0 con 0x7f25381048c0 2024-09-21T06:26:13.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.177+0000 7f253d3d8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2538113930 con 0x7f25381052a0 2024-09-21T06:26:13.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.177+0000 7f253d3d8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2538113c30 con 0x7f253810de70 2024-09-21T06:26:13.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.177+0000 7f2536ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25381048c0 0x7f25381027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:13.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.177+0000 7f2536ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25381048c0 0x7f25381027d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51276/0 (socket says 172.21.15.63:51276) 2024-09-21T06:26:13.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.177+0000 7f2536ffd640 1 -- 172.21.15.63:0/3878783081 learned_addr learned my addr 172.21.15.63:0/3878783081 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:13.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.177+0000 7f25367fc640 1 --2- 172.21.15.63:0/3878783081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25381052a0 0x7f2538102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:13.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.177+0000 7f2536ffd640 1 -- 172.21.15.63:0/3878783081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253810de70 msgr2=0x7f2538103250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:13.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.177+0000 7f25377fe640 1 --2- 172.21.15.63:0/3878783081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253810de70 0x7f2538103250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:13.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.177+0000 7f2536ffd640 1 --2- 172.21.15.63:0/3878783081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253810de70 0x7f2538103250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:13.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.177+0000 7f2536ffd640 1 -- 172.21.15.63:0/3878783081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25381052a0 msgr2=0x7f2538102d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:13.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.177+0000 7f2536ffd640 1 --2- 172.21.15.63:0/3878783081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25381052a0 0x7f2538102d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:13.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.177+0000 7f2536ffd640 1 -- 172.21.15.63:0/3878783081 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25381a87c0 con 0x7f25381048c0 2024-09-21T06:26:13.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.177+0000 7f2536ffd640 1 --2- 172.21.15.63:0/3878783081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25381048c0 0x7f25381027d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f252800d770 tx=0x7f252800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:13.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.178+0000 7f251ffff640 1 -- 172.21.15.63:0/3878783081 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2528017070 con 0x7f25381048c0 2024-09-21T06:26:13.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.178+0000 7f253d3d8640 1 -- 172.21.15.63:0/3878783081 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25381a8ab0 con 0x7f25381048c0 2024-09-21T06:26:13.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.178+0000 7f251ffff640 1 -- 172.21.15.63:0/3878783081 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2528009c30 con 0x7f25381048c0 2024-09-21T06:26:13.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.178+0000 7f251ffff640 1 -- 172.21.15.63:0/3878783081 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2528003cc0 con 0x7f25381048c0 2024-09-21T06:26:13.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.178+0000 7f253d3d8640 1 -- 172.21.15.63:0/3878783081 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25381a8fc0 con 0x7f25381048c0 2024-09-21T06:26:13.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.179+0000 7f253d3d8640 1 -- 172.21.15.63:0/3878783081 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f253806c190 con 0x7f25381048c0 2024-09-21T06:26:13.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.181+0000 7f251ffff640 1 -- 172.21.15.63:0/3878783081 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f2528003e60 con 0x7f25381048c0 2024-09-21T06:26:13.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.182+0000 7f251ffff640 1 --2- 172.21.15.63:0/3878783081 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f25200b6560 0x7f25200b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:13.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.182+0000 7f25367fc640 1 --2- 172.21.15.63:0/3878783081 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f25200b6560 0x7f25200b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:13.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.182+0000 7f251ffff640 1 -- 172.21.15.63:0/3878783081 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f25280e6d70 con 0x7f25381048c0 2024-09-21T06:26:13.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.182+0000 7f25367fc640 1 --2- 172.21.15.63:0/3878783081 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f25200b6560 0x7f25200b8a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f252c009230 tx=0x7f252c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:13.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.185+0000 7f251ffff640 1 -- 172.21.15.63:0/3878783081 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2528009de0 con 0x7f25381048c0 2024-09-21T06:26:13.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:12 smithi175 ceph-mon[34510]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:13.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:12 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:13.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:12 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:13.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:12 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:13.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:12 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:13.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.394+0000 7f253d3d8640 1 -- 172.21.15.63:0/3878783081 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2538103ad0 con 0x7f25381048c0 2024-09-21T06:26:13.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.395+0000 7f251ffff640 1 -- 172.21.15.63:0/3878783081 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) ==== 84+0+65 (secure 0 0 0) 0x7f25280ad9d0 con 0x7f25381048c0 2024-09-21T06:26:13.396 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:26:13.397 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2024-09-21T06:26:13.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:26:13.397 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2024-09-21T06:26:13.397 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": ".mgr" 2024-09-21T06:26:13.397 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:26:13.397 INFO:teuthology.orchestra.run.smithi063.stdout:] 2024-09-21T06:26:13.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.397+0000 7f253d3d8640 1 -- 172.21.15.63:0/3878783081 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f25200b6560 msgr2=0x7f25200b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:13.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.397+0000 7f253d3d8640 1 --2- 172.21.15.63:0/3878783081 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f25200b6560 0x7f25200b8a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f252c009230 tx=0x7f252c031400 comp rx=0 tx=0).stop 2024-09-21T06:26:13.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.397+0000 7f253d3d8640 1 -- 172.21.15.63:0/3878783081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25381048c0 msgr2=0x7f25381027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:13.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.397+0000 7f253d3d8640 1 --2- 172.21.15.63:0/3878783081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25381048c0 0x7f25381027d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f252800d770 tx=0x7f252800dc30 comp rx=0 tx=0).stop 2024-09-21T06:26:13.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.397+0000 7f253d3d8640 1 -- 172.21.15.63:0/3878783081 shutdown_connections 2024-09-21T06:26:13.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.397+0000 7f253d3d8640 1 --2- 172.21.15.63:0/3878783081 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f25200b6560 0x7f25200b8a70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:13.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.397+0000 7f253d3d8640 1 --2- 172.21.15.63:0/3878783081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253810de70 0x7f2538103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:13.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.397+0000 7f253d3d8640 1 --2- 172.21.15.63:0/3878783081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25381052a0 0x7f2538102d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:13.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.397+0000 7f253d3d8640 1 --2- 172.21.15.63:0/3878783081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25381048c0 0x7f25381027d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:13.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.397+0000 7f253d3d8640 1 -- 172.21.15.63:0/3878783081 >> 172.21.15.63:0/3878783081 conn(0x7f2538079760 msgr2=0x7f25380ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:13.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.398+0000 7f253d3d8640 1 -- 172.21.15.63:0/3878783081 shutdown_connections 2024-09-21T06:26:13.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:13.398+0000 7f253d3d8640 1 -- 172.21.15.63:0/3878783081 wait complete. 2024-09-21T06:26:14.039 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T06:26:14.039 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T06:26:14.306 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:14.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:14 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:14.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:14 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:14.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:14 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:14.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:14 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3878783081' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T06:26:14.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:14 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:26:14.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:14 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:26:14.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:14 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:14.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:14 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:14.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:14 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:14.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:14 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:14.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:14 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3878783081' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T06:26:14.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:14 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:26:14.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:14 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:26:14.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:14 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:14.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:14 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:14.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:14 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:14.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:14 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:14.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:14 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3878783081' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T06:26:14.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:14 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:26:14.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:14 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:26:14.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:14 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:14.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.792+0000 7f30406cb640 1 -- 172.21.15.63:0/1972312879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30381048c0 msgr2=0x7f3038104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:14.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.792+0000 7f30406cb640 1 --2- 172.21.15.63:0/1972312879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30381048c0 0x7f3038104cd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3034009900 tx=0x7f303402a410 comp rx=0 tx=0).stop 2024-09-21T06:26:14.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.793+0000 7f30406cb640 1 -- 172.21.15.63:0/1972312879 shutdown_connections 2024-09-21T06:26:14.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.793+0000 7f30406cb640 1 --2- 172.21.15.63:0/1972312879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f303810de70 0x7f3038110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.793+0000 7f30406cb640 1 --2- 172.21.15.63:0/1972312879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30381052a0 0x7f303810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.793+0000 7f30406cb640 1 --2- 172.21.15.63:0/1972312879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30381048c0 0x7f3038104cd0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.793+0000 7f30406cb640 1 -- 172.21.15.63:0/1972312879 >> 172.21.15.63:0/1972312879 conn(0x7f3038079760 msgr2=0x7f3038079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.793+0000 7f30406cb640 1 -- 172.21.15.63:0/1972312879 shutdown_connections 2024-09-21T06:26:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.793+0000 7f30406cb640 1 -- 172.21.15.63:0/1972312879 wait complete. 2024-09-21T06:26:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.793+0000 7f30406cb640 1 Processor -- start 2024-09-21T06:26:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.793+0000 7f30406cb640 1 -- start start 2024-09-21T06:26:14.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.794+0000 7f30406cb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30381048c0 0x7f30381027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.794+0000 7f30406cb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30381052a0 0x7f3038102d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.794+0000 7f30406cb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f303810de70 0x7f3038103250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.794+0000 7f30406cb640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3038113b00 con 0x7f30381052a0 2024-09-21T06:26:14.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.794+0000 7f30406cb640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3038113980 con 0x7f30381048c0 2024-09-21T06:26:14.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.794+0000 7f30406cb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3038113c80 con 0x7f303810de70 2024-09-21T06:26:14.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.794+0000 7f303dc66640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30381052a0 0x7f3038102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.794+0000 7f303dc66640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30381052a0 0x7f3038102d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51286/0 (socket says 172.21.15.63:51286) 2024-09-21T06:26:14.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.794+0000 7f303dc66640 1 -- 172.21.15.63:0/2446827016 learned_addr learned my addr 172.21.15.63:0/2446827016 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:14.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.794+0000 7f303e467640 1 --2- 172.21.15.63:0/2446827016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30381048c0 0x7f30381027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.794+0000 7f303ec68640 1 --2- 172.21.15.63:0/2446827016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f303810de70 0x7f3038103250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.794+0000 7f303dc66640 1 -- 172.21.15.63:0/2446827016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f303810de70 msgr2=0x7f3038103250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:14.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.794+0000 7f303dc66640 1 --2- 172.21.15.63:0/2446827016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f303810de70 0x7f3038103250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.794+0000 7f303dc66640 1 -- 172.21.15.63:0/2446827016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30381048c0 msgr2=0x7f30381027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:14.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.794+0000 7f303dc66640 1 --2- 172.21.15.63:0/2446827016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30381048c0 0x7f30381027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.794+0000 7f303dc66640 1 -- 172.21.15.63:0/2446827016 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30381a8790 con 0x7f30381052a0 2024-09-21T06:26:14.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.794+0000 7f303dc66640 1 --2- 172.21.15.63:0/2446827016 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30381052a0 0x7f3038102d10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f302800d950 tx=0x7f302800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:14.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.795+0000 7f302f7fe640 1 -- 172.21.15.63:0/2446827016 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3028017070 con 0x7f30381052a0 2024-09-21T06:26:14.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.795+0000 7f302f7fe640 1 -- 172.21.15.63:0/2446827016 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3028009c30 con 0x7f30381052a0 2024-09-21T06:26:14.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.795+0000 7f30406cb640 1 -- 172.21.15.63:0/2446827016 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30381a8a80 con 0x7f30381052a0 2024-09-21T06:26:14.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.795+0000 7f302f7fe640 1 -- 172.21.15.63:0/2446827016 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30280047a0 con 0x7f30381052a0 2024-09-21T06:26:14.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.795+0000 7f30406cb640 1 -- 172.21.15.63:0/2446827016 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30381a8fc0 con 0x7f30381052a0 2024-09-21T06:26:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.796+0000 7f30406cb640 1 -- 172.21.15.63:0/2446827016 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f303806c190 con 0x7f30381052a0 2024-09-21T06:26:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.797+0000 7f302f7fe640 1 -- 172.21.15.63:0/2446827016 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f3028004020 con 0x7f30381052a0 2024-09-21T06:26:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.798+0000 7f302f7fe640 1 --2- 172.21.15.63:0/2446827016 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f30240b6560 0x7f30240b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.798+0000 7f303e467640 1 --2- 172.21.15.63:0/2446827016 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f30240b6560 0x7f30240b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.798+0000 7f302f7fe640 1 -- 172.21.15.63:0/2446827016 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f30280e6d50 con 0x7f30381052a0 2024-09-21T06:26:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.799+0000 7f303e467640 1 --2- 172.21.15.63:0/2446827016 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f30240b6560 0x7f30240b8a70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3038104220 tx=0x7f3034031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:14.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:14.802+0000 7f302f7fe640 1 -- 172.21.15.63:0/2446827016 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f30280ea030 con 0x7f30381052a0 2024-09-21T06:26:15.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:15.011+0000 7f30406cb640 1 -- 172.21.15.63:0/2446827016 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3038103ad0 con 0x7f30381052a0 2024-09-21T06:26:15.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:15.255+0000 7f302f7fe640 1 -- 172.21.15.63:0/2446827016 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) ==== 138+0+0 (secure 0 0 0) 0x7f3028020020 con 0x7f30381052a0 2024-09-21T06:26:15.258 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2024-09-21T06:26:15.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:15.257+0000 7f30406cb640 1 -- 172.21.15.63:0/2446827016 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f30240b6560 msgr2=0x7f30240b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:15.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:15.257+0000 7f30406cb640 1 --2- 172.21.15.63:0/2446827016 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f30240b6560 0x7f30240b8a70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3038104220 tx=0x7f3034031400 comp rx=0 tx=0).stop 2024-09-21T06:26:15.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:15.257+0000 7f30406cb640 1 -- 172.21.15.63:0/2446827016 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30381052a0 msgr2=0x7f3038102d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:15.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:15.257+0000 7f30406cb640 1 --2- 172.21.15.63:0/2446827016 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30381052a0 0x7f3038102d10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f302800d950 tx=0x7f302800de10 comp rx=0 tx=0).stop 2024-09-21T06:26:15.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:15.258+0000 7f30406cb640 1 -- 172.21.15.63:0/2446827016 shutdown_connections 2024-09-21T06:26:15.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:15.258+0000 7f30406cb640 1 --2- 172.21.15.63:0/2446827016 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f30240b6560 0x7f30240b8a70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:15.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:15.258+0000 7f30406cb640 1 --2- 172.21.15.63:0/2446827016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f303810de70 0x7f3038103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:15.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:15.258+0000 7f30406cb640 1 --2- 172.21.15.63:0/2446827016 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30381052a0 0x7f3038102d10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:15.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:15.258+0000 7f30406cb640 1 --2- 172.21.15.63:0/2446827016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30381048c0 0x7f30381027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:15.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:15.258+0000 7f30406cb640 1 -- 172.21.15.63:0/2446827016 >> 172.21.15.63:0/2446827016 conn(0x7f3038079760 msgr2=0x7f3038100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:15.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:15.258+0000 7f30406cb640 1 -- 172.21.15.63:0/2446827016 shutdown_connections 2024-09-21T06:26:15.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:15.258+0000 7f30406cb640 1 -- 172.21.15.63:0/2446827016 wait complete. 2024-09-21T06:26:15.275 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:15 smithi063 ceph-mon[31150]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:15.275 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:15 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:15.275 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:15 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2446827016' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T06:26:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:15 smithi071 ceph-mon[34844]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:15 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:15 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2446827016' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T06:26:15.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:15 smithi175 ceph-mon[34510]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:15.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:15 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:15.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:15 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2446827016' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T06:26:15.985 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T06:26:16.359 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:16.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:16 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2446827016' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T06:26:16.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:16 smithi063 ceph-mon[31150]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T06:26:16.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:16 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:16.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:16 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:16.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:16 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:16.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:16 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:16.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:16 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2446827016' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T06:26:16.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:16 smithi175 ceph-mon[34510]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T06:26:16.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:16 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:16.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:16 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:16.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:16 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:16.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:16 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:16.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:16 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2446827016' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T06:26:16.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:16 smithi071 ceph-mon[34844]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T06:26:16.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:16 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:16.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:16 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:16.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:16 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:16.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:16 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:16.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.861+0000 7f8ba29aa640 1 -- 172.21.15.63:0/3469918992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9c102780 msgr2=0x7f8b9c1105b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:16.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.861+0000 7f8ba29aa640 1 --2- 172.21.15.63:0/3469918992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9c102780 0x7f8b9c1105b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8b94009ca0 tx=0x7f8b9402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:26:16.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.861+0000 7f8ba29aa640 1 -- 172.21.15.63:0/3469918992 shutdown_connections 2024-09-21T06:26:16.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.861+0000 7f8ba29aa640 1 --2- 172.21.15.63:0/3469918992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9c102780 0x7f8b9c1105b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:16.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.861+0000 7f8ba29aa640 1 --2- 172.21.15.63:0/3469918992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b9c101e30 0x7f8b9c102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:16.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.861+0000 7f8ba29aa640 1 --2- 172.21.15.63:0/3469918992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b9c108740 0x7f8b9c108b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:16.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.861+0000 7f8ba29aa640 1 -- 172.21.15.63:0/3469918992 >> 172.21.15.63:0/3469918992 conn(0x7f8b9c079f90 msgr2=0x7f8b9c07a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:16.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.861+0000 7f8ba29aa640 1 -- 172.21.15.63:0/3469918992 shutdown_connections 2024-09-21T06:26:16.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.861+0000 7f8ba29aa640 1 -- 172.21.15.63:0/3469918992 wait complete. 2024-09-21T06:26:16.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.862+0000 7f8ba29aa640 1 Processor -- start 2024-09-21T06:26:16.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.862+0000 7f8ba29aa640 1 -- start start 2024-09-21T06:26:16.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.862+0000 7f8ba29aa640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9c101e30 0x7f8b9c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:16.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.862+0000 7f8ba29aa640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b9c102780 0x7f8b9c19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:16.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.862+0000 7f8ba29aa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b9c108740 0x7f8b9c19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:16.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.862+0000 7f8ba29aa640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c113af0 con 0x7f8b9c101e30 2024-09-21T06:26:16.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.862+0000 7f8ba29aa640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c113970 con 0x7f8b9c102780 2024-09-21T06:26:16.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.862+0000 7f8ba29aa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c113c70 con 0x7f8b9c108740 2024-09-21T06:26:16.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.862+0000 7f8b9bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9c101e30 0x7f8b9c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:16.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.862+0000 7f8b9bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9c101e30 0x7f8b9c19a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40304/0 (socket says 172.21.15.63:40304) 2024-09-21T06:26:16.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.862+0000 7f8b9bfff640 1 -- 172.21.15.63:0/4071591090 learned_addr learned my addr 172.21.15.63:0/4071591090 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:16.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.862+0000 7f8b9b7fe640 1 --2- 172.21.15.63:0/4071591090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b9c102780 0x7f8b9c19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:16.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.862+0000 7f8ba0f47640 1 --2- 172.21.15.63:0/4071591090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b9c108740 0x7f8b9c19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:16.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.863+0000 7f8b9bfff640 1 -- 172.21.15.63:0/4071591090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b9c108740 msgr2=0x7f8b9c19fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:16.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.863+0000 7f8b9bfff640 1 --2- 172.21.15.63:0/4071591090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b9c108740 0x7f8b9c19fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:16.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.863+0000 7f8b9bfff640 1 -- 172.21.15.63:0/4071591090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b9c102780 msgr2=0x7f8b9c19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:16.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.863+0000 7f8b9bfff640 1 --2- 172.21.15.63:0/4071591090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b9c102780 0x7f8b9c19aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:16.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.863+0000 7f8b9bfff640 1 -- 172.21.15.63:0/4071591090 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9c1a0450 con 0x7f8b9c101e30 2024-09-21T06:26:16.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.863+0000 7f8b9b7fe640 1 --2- 172.21.15.63:0/4071591090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b9c102780 0x7f8b9c19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:26:16.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.863+0000 7f8b9bfff640 1 --2- 172.21.15.63:0/4071591090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9c101e30 0x7f8b9c19a4e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00e9f0 tx=0x7f8b8c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:16.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.863+0000 7f8b997fa640 1 -- 172.21.15.63:0/4071591090 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c00cd80 con 0x7f8b9c101e30 2024-09-21T06:26:16.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.863+0000 7f8b997fa640 1 -- 172.21.15.63:0/4071591090 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b8c0054d0 con 0x7f8b9c101e30 2024-09-21T06:26:16.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.863+0000 7f8ba29aa640 1 -- 172.21.15.63:0/4071591090 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b9c1a0740 con 0x7f8b9c101e30 2024-09-21T06:26:16.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.863+0000 7f8b997fa640 1 -- 172.21.15.63:0/4071591090 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c010690 con 0x7f8b9c101e30 2024-09-21T06:26:16.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.863+0000 7f8ba29aa640 1 -- 172.21.15.63:0/4071591090 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b9c1a6ea0 con 0x7f8b9c101e30 2024-09-21T06:26:16.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.864+0000 7f8ba29aa640 1 -- 172.21.15.63:0/4071591090 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b9c102240 con 0x7f8b9c101e30 2024-09-21T06:26:16.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.866+0000 7f8b997fa640 1 -- 172.21.15.63:0/4071591090 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f8b8c004e30 con 0x7f8b9c101e30 2024-09-21T06:26:16.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.867+0000 7f8b997fa640 1 --2- 172.21.15.63:0/4071591090 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8b840b6560 0x7f8b840b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:16.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.867+0000 7f8b9b7fe640 1 --2- 172.21.15.63:0/4071591090 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8b840b6560 0x7f8b840b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:16.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.867+0000 7f8b997fa640 1 -- 172.21.15.63:0/4071591090 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7712+0+0 (secure 0 0 0) 0x7f8b8c0e7630 con 0x7f8b9c101e30 2024-09-21T06:26:16.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.868+0000 7f8b9b7fe640 1 --2- 172.21.15.63:0/4071591090 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8b840b6560 0x7f8b840b8a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c105f60 tx=0x7f8b90005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:16.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:16.870+0000 7f8b997fa640 1 -- 172.21.15.63:0/4071591090 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8b8c0ae120 con 0x7f8b9c101e30 2024-09-21T06:26:17.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:17.068+0000 7f8ba29aa640 1 -- 172.21.15.63:0/4071591090 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8b9c19b610 con 0x7f8b9c101e30 2024-09-21T06:26:17.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:17.272+0000 7f8b997fa640 1 -- 172.21.15.63:0/4071591090 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7f8b8c0b2500 con 0x7f8b9c101e30 2024-09-21T06:26:17.274 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2024-09-21T06:26:17.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:17.275+0000 7f8ba29aa640 1 -- 172.21.15.63:0/4071591090 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8b840b6560 msgr2=0x7f8b840b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:17.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:17.275+0000 7f8ba29aa640 1 --2- 172.21.15.63:0/4071591090 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8b840b6560 0x7f8b840b8a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c105f60 tx=0x7f8b90005f90 comp rx=0 tx=0).stop 2024-09-21T06:26:17.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:17.275+0000 7f8ba29aa640 1 -- 172.21.15.63:0/4071591090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9c101e30 msgr2=0x7f8b9c19a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:17.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:17.275+0000 7f8ba29aa640 1 --2- 172.21.15.63:0/4071591090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9c101e30 0x7f8b9c19a4e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00e9f0 tx=0x7f8b8c00edf0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:17.275+0000 7f8ba29aa640 1 -- 172.21.15.63:0/4071591090 shutdown_connections 2024-09-21T06:26:17.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:17.275+0000 7f8ba29aa640 1 --2- 172.21.15.63:0/4071591090 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8b840b6560 0x7f8b840b8a70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:17.275+0000 7f8ba29aa640 1 --2- 172.21.15.63:0/4071591090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b9c108740 0x7f8b9c19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:17.275+0000 7f8ba29aa640 1 --2- 172.21.15.63:0/4071591090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b9c102780 0x7f8b9c19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:17.275+0000 7f8ba29aa640 1 --2- 172.21.15.63:0/4071591090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9c101e30 0x7f8b9c19a4e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:17.275+0000 7f8ba29aa640 1 -- 172.21.15.63:0/4071591090 >> 172.21.15.63:0/4071591090 conn(0x7f8b9c079f90 msgr2=0x7f8b9c1064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:17.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:17.275+0000 7f8ba29aa640 1 -- 172.21.15.63:0/4071591090 shutdown_connections 2024-09-21T06:26:17.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:17.275+0000 7f8ba29aa640 1 -- 172.21.15.63:0/4071591090 wait complete. 2024-09-21T06:26:17.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:17 smithi063 ceph-mon[31150]: pgmap v258: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:17.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:17 smithi063 ceph-mon[31150]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T06:26:17.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:17 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/4071591090' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T06:26:17.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:17 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:17.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:17 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:17.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:17 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:26:17.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:17 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:26:17.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:17 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:17.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:17 smithi175 ceph-mon[34510]: pgmap v258: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:17.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:17 smithi175 ceph-mon[34510]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T06:26:17.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:17 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/4071591090' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T06:26:17.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:17 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:17.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:17 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:17.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:17 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:26:17.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:17 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:26:17.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:17 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:17.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:17 smithi071 ceph-mon[34844]: pgmap v258: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:17.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:17 smithi071 ceph-mon[34844]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T06:26:17.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:17 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/4071591090' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T06:26:17.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:17 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:17.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:17 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:17.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:17 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:26:17.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:17 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:26:17.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:17 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:26:17.948 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T06:26:18.207 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:18.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:18 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/4071591090' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T06:26:18.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:18 smithi063 ceph-mon[31150]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T06:26:18.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:18 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/4071591090' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T06:26:18.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:18 smithi175 ceph-mon[34510]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T06:26:18.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.716+0000 7fdec293e640 1 -- 172.21.15.63:0/2939163845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdebc1084c0 msgr2=0x7fdebc10ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:18.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.716+0000 7fdec293e640 1 --2- 172.21.15.63:0/2939163845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdebc1084c0 0x7fdebc10ecf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009ca0 tx=0x7fdeb402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.716+0000 7fdec293e640 1 -- 172.21.15.63:0/2939163845 shutdown_connections 2024-09-21T06:26:18.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.716+0000 7fdec293e640 1 --2- 172.21.15.63:0/2939163845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdebc1084c0 0x7fdebc10ecf0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.716+0000 7fdec293e640 1 --2- 172.21.15.63:0/2939163845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdebc107b70 0x7fdebc107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.716+0000 7fdec293e640 1 --2- 172.21.15.63:0/2939163845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdebc102230 0x7fdebc102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.716+0000 7fdec293e640 1 -- 172.21.15.63:0/2939163845 >> 172.21.15.63:0/2939163845 conn(0x7fdebc079e40 msgr2=0x7fdebc07a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:18.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.716+0000 7fdec293e640 1 -- 172.21.15.63:0/2939163845 shutdown_connections 2024-09-21T06:26:18.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.716+0000 7fdec293e640 1 -- 172.21.15.63:0/2939163845 wait complete. 2024-09-21T06:26:18.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.717+0000 7fdec293e640 1 Processor -- start 2024-09-21T06:26:18.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.717+0000 7fdec293e640 1 -- start start 2024-09-21T06:26:18.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.717+0000 7fdec293e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdebc102230 0x7fdebc1105e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.717+0000 7fdec293e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdebc107b70 0x7fdebc110b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.717+0000 7fdec293e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdebc1084c0 0x7fdebc111060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.717+0000 7fdec293e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdebc113af0 con 0x7fdebc102230 2024-09-21T06:26:18.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.717+0000 7fdec293e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdebc113970 con 0x7fdebc1084c0 2024-09-21T06:26:18.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.717+0000 7fdec293e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdebc113c70 con 0x7fdebc107b70 2024-09-21T06:26:18.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.717+0000 7fdebbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdebc102230 0x7fdebc1105e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.717+0000 7fdebbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdebc102230 0x7fdebc1105e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40320/0 (socket says 172.21.15.63:40320) 2024-09-21T06:26:18.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.717+0000 7fdebbfff640 1 -- 172.21.15.63:0/3596405399 learned_addr learned my addr 172.21.15.63:0/3596405399 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:18.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.717+0000 7fdeb3fff640 1 --2- 172.21.15.63:0/3596405399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdebc107b70 0x7fdebc110b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.717+0000 7fdec0edb640 1 --2- 172.21.15.63:0/3596405399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdebc1084c0 0x7fdebc111060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.717+0000 7fdebbfff640 1 -- 172.21.15.63:0/3596405399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdebc107b70 msgr2=0x7fdebc110b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:18.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.717+0000 7fdebbfff640 1 --2- 172.21.15.63:0/3596405399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdebc107b70 0x7fdebc110b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.718+0000 7fdebbfff640 1 -- 172.21.15.63:0/3596405399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdebc1084c0 msgr2=0x7fdebc111060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:18.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.718+0000 7fdebbfff640 1 --2- 172.21.15.63:0/3596405399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdebc1084c0 0x7fdebc111060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.718+0000 7fdebbfff640 1 -- 172.21.15.63:0/3596405399 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdebc1a8740 con 0x7fdebc102230 2024-09-21T06:26:18.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.718+0000 7fdebbfff640 1 --2- 172.21.15.63:0/3596405399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdebc102230 0x7fdebc1105e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdeac00d950 tx=0x7fdeac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:18.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.718+0000 7fdeb9ffb640 1 -- 172.21.15.63:0/3596405399 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac017070 con 0x7fdebc102230 2024-09-21T06:26:18.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.718+0000 7fdeb9ffb640 1 -- 172.21.15.63:0/3596405399 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdeac009c30 con 0x7fdebc102230 2024-09-21T06:26:18.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.718+0000 7fdeb9ffb640 1 -- 172.21.15.63:0/3596405399 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac00f620 con 0x7fdebc102230 2024-09-21T06:26:18.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.718+0000 7fdec293e640 1 -- 172.21.15.63:0/3596405399 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdebc1a8a30 con 0x7fdebc102230 2024-09-21T06:26:18.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.718+0000 7fdec293e640 1 -- 172.21.15.63:0/3596405399 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdebc1a8f20 con 0x7fdebc102230 2024-09-21T06:26:18.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.719+0000 7fdec293e640 1 -- 172.21.15.63:0/3596405399 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdebc102640 con 0x7fdebc102230 2024-09-21T06:26:18.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.721+0000 7fdeb9ffb640 1 -- 172.21.15.63:0/3596405399 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fdeac010460 con 0x7fdebc102230 2024-09-21T06:26:18.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.721+0000 7fdeb9ffb640 1 --2- 172.21.15.63:0/3596405399 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdea80b65e0 0x7fdea80b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.722+0000 7fdeb3fff640 1 --2- 172.21.15.63:0/3596405399 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdea80b65e0 0x7fdea80b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.722+0000 7fdeb9ffb640 1 -- 172.21.15.63:0/3596405399 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8094+0+0 (secure 0 0 0) 0x7fdeac0e6e70 con 0x7fdebc102230 2024-09-21T06:26:18.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.722+0000 7fdeb3fff640 1 --2- 172.21.15.63:0/3596405399 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdea80b65e0 0x7fdea80b8af0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdebc1057a0 tx=0x7fdea400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:18.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.726+0000 7fdeb9ffb640 1 -- 172.21.15.63:0/3596405399 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdeac0ad7e0 con 0x7fdebc102230 2024-09-21T06:26:18.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:18 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/4071591090' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T06:26:18.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:18 smithi071 ceph-mon[34844]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T06:26:18.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:18.958+0000 7fdec293e640 1 -- 172.21.15.63:0/3596405399 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fdebc1118e0 con 0x7fdebc102230 2024-09-21T06:26:19.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:19.281+0000 7fdeb9ffb640 1 -- 172.21.15.63:0/3596405399 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fdebc1118e0 con 0x7fdebc102230 2024-09-21T06:26:19.284 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T06:26:19.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:19.285+0000 7fdec293e640 1 -- 172.21.15.63:0/3596405399 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdea80b65e0 msgr2=0x7fdea80b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:19.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:19.285+0000 7fdec293e640 1 --2- 172.21.15.63:0/3596405399 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdea80b65e0 0x7fdea80b8af0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdebc1057a0 tx=0x7fdea400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:26:19.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:19.285+0000 7fdec293e640 1 -- 172.21.15.63:0/3596405399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdebc102230 msgr2=0x7fdebc1105e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:19.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:19.285+0000 7fdec293e640 1 --2- 172.21.15.63:0/3596405399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdebc102230 0x7fdebc1105e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdeac00d950 tx=0x7fdeac00de10 comp rx=0 tx=0).stop 2024-09-21T06:26:19.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:19.285+0000 7fdec293e640 1 -- 172.21.15.63:0/3596405399 shutdown_connections 2024-09-21T06:26:19.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:19.285+0000 7fdec293e640 1 --2- 172.21.15.63:0/3596405399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdebc1084c0 0x7fdebc111060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:19.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:19.285+0000 7fdec293e640 1 --2- 172.21.15.63:0/3596405399 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdea80b65e0 0x7fdea80b8af0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:19.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:19.285+0000 7fdec293e640 1 --2- 172.21.15.63:0/3596405399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdebc107b70 0x7fdebc110b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:19.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:19.285+0000 7fdec293e640 1 --2- 172.21.15.63:0/3596405399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdebc102230 0x7fdebc1105e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:19.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:19.285+0000 7fdec293e640 1 -- 172.21.15.63:0/3596405399 >> 172.21.15.63:0/3596405399 conn(0x7fdebc079e40 msgr2=0x7fdebc105b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:19.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:19.285+0000 7fdec293e640 1 -- 172.21.15.63:0/3596405399 shutdown_connections 2024-09-21T06:26:19.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:19.285+0000 7fdec293e640 1 -- 172.21.15.63:0/3596405399 wait complete. 2024-09-21T06:26:19.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:19 smithi063 ceph-mon[31150]: pgmap v261: 97 pgs: 12 active+clean, 6 creating+peering, 79 unknown; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:19.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:19 smithi063 ceph-mon[31150]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T06:26:19.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:19 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3596405399' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T06:26:19.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:19 smithi063 ceph-mon[31150]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T06:26:19.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:19 smithi175 ceph-mon[34510]: pgmap v261: 97 pgs: 12 active+clean, 6 creating+peering, 79 unknown; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:19.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:19 smithi175 ceph-mon[34510]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T06:26:19.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:19 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3596405399' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T06:26:19.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:19 smithi175 ceph-mon[34510]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T06:26:19.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:19 smithi071 ceph-mon[34844]: pgmap v261: 97 pgs: 12 active+clean, 6 creating+peering, 79 unknown; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:26:19.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:19 smithi071 ceph-mon[34844]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T06:26:19.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:19 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3596405399' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T06:26:19.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:19 smithi071 ceph-mon[34844]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T06:26:19.902 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:26:20.163 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:20.539 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:20 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3596405399' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T06:26:20.539 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:20 smithi063 ceph-mon[31150]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T06:26:20.539 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:20 smithi063 ceph-mon[31150]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T06:26:20.539 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:20 smithi063 ceph-mon[31150]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T06:26:20.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:20 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3596405399' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T06:26:20.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:20 smithi175 ceph-mon[34510]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T06:26:20.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:20 smithi175 ceph-mon[34510]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T06:26:20.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:20 smithi175 ceph-mon[34510]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T06:26:20.650 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:20 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3596405399' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T06:26:20.650 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:20 smithi071 ceph-mon[34844]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T06:26:20.651 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:20 smithi071 ceph-mon[34844]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T06:26:20.651 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:20 smithi071 ceph-mon[34844]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T06:26:20.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.628+0000 7f800f29d640 1 -- 172.21.15.63:0/3372094976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8008101e90 msgr2=0x7f80081022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:20.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.628+0000 7f800f29d640 1 --2- 172.21.15.63:0/3372094976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8008101e90 0x7f80081022a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc009900 tx=0x7f7ffc02a410 comp rx=0 tx=0).stop 2024-09-21T06:26:20.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.628+0000 7f800f29d640 1 -- 172.21.15.63:0/3372094976 shutdown_connections 2024-09-21T06:26:20.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.628+0000 7f800f29d640 1 --2- 172.21.15.63:0/3372094976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80081027e0 0x7f8008110610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.628+0000 7f800f29d640 1 --2- 172.21.15.63:0/3372094976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8008101e90 0x7f80081022a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.628+0000 7f800f29d640 1 --2- 172.21.15.63:0/3372094976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80081087a0 0x7f8008108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.628+0000 7f800f29d640 1 -- 172.21.15.63:0/3372094976 >> 172.21.15.63:0/3372094976 conn(0x7f8008079ec0 msgr2=0x7f800807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:20.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.628+0000 7f800f29d640 1 -- 172.21.15.63:0/3372094976 shutdown_connections 2024-09-21T06:26:20.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.628+0000 7f800f29d640 1 -- 172.21.15.63:0/3372094976 wait complete. 2024-09-21T06:26:20.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.629+0000 7f800f29d640 1 Processor -- start 2024-09-21T06:26:20.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.629+0000 7f800f29d640 1 -- start start 2024-09-21T06:26:20.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.629+0000 7f800f29d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8008101e90 0x7f800819c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.629+0000 7f800f29d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80081027e0 0x7f800819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.629+0000 7f800f29d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80081087a0 0x7f80081a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.629+0000 7f800f29d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8008113b50 con 0x7f80081087a0 2024-09-21T06:26:20.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.630+0000 7f800f29d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f80081139d0 con 0x7f8008101e90 2024-09-21T06:26:20.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.630+0000 7f800f29d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8008113cd0 con 0x7f80081027e0 2024-09-21T06:26:20.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.630+0000 7f800d83a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80081087a0 0x7f80081a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.630+0000 7f800d83a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80081087a0 0x7f80081a1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40336/0 (socket says 172.21.15.63:40336) 2024-09-21T06:26:20.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.630+0000 7f800d83a640 1 -- 172.21.15.63:0/1027899503 learned_addr learned my addr 172.21.15.63:0/1027899503 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:20.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.630+0000 7f800c838640 1 --2- 172.21.15.63:0/1027899503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80081027e0 0x7f800819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.630+0000 7f800d039640 1 --2- 172.21.15.63:0/1027899503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8008101e90 0x7f800819c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.630+0000 7f800d83a640 1 -- 172.21.15.63:0/1027899503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80081027e0 msgr2=0x7f800819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:20.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.630+0000 7f800d83a640 1 --2- 172.21.15.63:0/1027899503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80081027e0 0x7f800819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.630+0000 7f800d83a640 1 -- 172.21.15.63:0/1027899503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8008101e90 msgr2=0x7f800819c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:20.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.630+0000 7f800d83a640 1 --2- 172.21.15.63:0/1027899503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8008101e90 0x7f800819c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.630+0000 7f800d83a640 1 -- 172.21.15.63:0/1027899503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80081a26b0 con 0x7f80081087a0 2024-09-21T06:26:20.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.630+0000 7f800d039640 1 --2- 172.21.15.63:0/1027899503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8008101e90 0x7f800819c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:20.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.630+0000 7f800d83a640 1 --2- 172.21.15.63:0/1027899503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80081087a0 0x7f80081a1f80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f800000eb10 tx=0x7f800000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:20.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.630+0000 7f7ffa7fc640 1 -- 172.21.15.63:0/1027899503 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000004b20 con 0x7f80081087a0 2024-09-21T06:26:20.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.630+0000 7f7ffa7fc640 1 -- 172.21.15.63:0/1027899503 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8000004cc0 con 0x7f80081087a0 2024-09-21T06:26:20.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.630+0000 7f800f29d640 1 -- 172.21.15.63:0/1027899503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80081a29a0 con 0x7f80081087a0 2024-09-21T06:26:20.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.630+0000 7f7ffa7fc640 1 -- 172.21.15.63:0/1027899503 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000010670 con 0x7f80081087a0 2024-09-21T06:26:20.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.630+0000 7f800f29d640 1 -- 172.21.15.63:0/1027899503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80081a9100 con 0x7f80081087a0 2024-09-21T06:26:20.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.631+0000 7f800f29d640 1 -- 172.21.15.63:0/1027899503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80081022a0 con 0x7f80081087a0 2024-09-21T06:26:20.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.633+0000 7f7ffa7fc640 1 -- 172.21.15.63:0/1027899503 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f8000005000 con 0x7f80081087a0 2024-09-21T06:26:20.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.634+0000 7f7ffa7fc640 1 --2- 172.21.15.63:0/1027899503 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7ff40b6560 0x7f7ff40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.634+0000 7f800d039640 1 --2- 172.21.15.63:0/1027899503 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7ff40b6560 0x7f7ff40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.634+0000 7f7ffa7fc640 1 -- 172.21.15.63:0/1027899503 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f80000e7b60 con 0x7f80081087a0 2024-09-21T06:26:20.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.635+0000 7f800d039640 1 --2- 172.21.15.63:0/1027899503 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7ff40b6560 0x7f7ff40b8a70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8004009b40 tx=0x7f8004005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:20.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.638+0000 7f7ffa7fc640 1 -- 172.21.15.63:0/1027899503 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8000056710 con 0x7f80081087a0 2024-09-21T06:26:20.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.827+0000 7f800f29d640 1 -- 172.21.15.63:0/1027899503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f800819d870 con 0x7f80081087a0 2024-09-21T06:26:20.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.828+0000 7f7ffa7fc640 1 -- 172.21.15.63:0/1027899503 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22551 (secure 0 0 0) 0x7f80000ae410 con 0x7f80081087a0 2024-09-21T06:26:20.830 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:26:20.830 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":75,"fsid":"140899c8-77e1-11ef-baf5-efdc52797490","created":"2024-09-21T06:17:48.089366+0000","modified":"2024-09-21T06:26:18.960270+0000","last_up_change":"2024-09-21T06:25:29.072128+0000","last_in_change":"2024-09-21T06:25:06.097647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:21:36.236868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:26:15.016085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:26:17.072883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df4162c1-dd66-4d11-99bc-0ae36ea130f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6803","nonce":2090653772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6805","nonce":2090653772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6809","nonce":2090653772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6807","nonce":2090653772}]},"public_addr":"172.21.15.63:6803/2090653772","cluster_addr":"172.21.15.63:6805/2090653772","heartbeat_back_addr":"172.21.15.63:6809/2090653772","heartbeat_front_addr":"172.21.15.63:6807/2090653772","state":["exists","up"]},{"osd":1,"uuid":"65a12def-9f66-4153-8f1a-2ebfbbfeba99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6801","nonce":1676297548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6803","nonce":1676297548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6807","nonce":1676297548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6805","nonce":1676297548}]},"public_addr":"172.21.15.71:6801/1676297548","cluster_addr":"172.21.15.71:6803/1676297548","heartbeat_back_addr":"172.21.15.71:6807/1676297548","heartbeat_front_addr":"172.21.15.71:6805/1676297548","state":["exists","up"]},{"osd":2,"uuid":"031daa9e-9d4a-4901-95e8-695db5671fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6801","nonce":2356865390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6803","nonce":2356865390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6807","nonce":2356865390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6805","nonce":2356865390}]},"public_addr":"172.21.15.175:6801/2356865390","cluster_addr":"172.21.15.175:6803/2356865390","heartbeat_back_addr":"172.21.15.175:6807/2356865390","heartbeat_front_addr":"172.21.15.175:6805/2356865390","state":["exists","up"]},{"osd":3,"uuid":"75d23a7a-c560-4b26-84a4-74d6772a37ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6811","nonce":31683339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6813","nonce":31683339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6817","nonce":31683339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6815","nonce":31683339}]},"public_addr":"172.21.15.63:6811/31683339","cluster_addr":"172.21.15.63:6813/31683339","heartbeat_back_addr":"172.21.15.63:6817/31683339","heartbeat_front_addr":"172.21.15.63:6815/31683339","state":["exists","up"]},{"osd":4,"uuid":"6aaefd09-93dd-4f21-9b3c-701a7ff97f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6809","nonce":829449898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6811","nonce":829449898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6815","nonce":829449898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6813","nonce":829449898}]},"public_addr":"172.21.15.71:6809/829449898","cluster_addr":"172.21.15.71:6811/829449898","heartbeat_back_addr":"172.21.15.71:6815/829449898","heartbeat_front_addr":"172.21.15.71:6813/829449898","state":["exists","up"]},{"osd":5,"uuid":"91f28121-c94e-4012-b74c-dd4597545e3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6809","nonce":3005600597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6811","nonce":3005600597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6815","nonce":3005600597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6813","nonce":3005600597}]},"public_addr":"172.21.15.175:6809/3005600597","cluster_addr":"172.21.15.175:6811/3005600597","heartbeat_back_addr":"172.21.15.175:6815/3005600597","heartbeat_front_addr":"172.21.15.175:6813/3005600597","state":["exists","up"]},{"osd":6,"uuid":"bda28014-4dca-40f1-bb23-3ef61605c1ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6819","nonce":4044730408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6821","nonce":4044730408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6825","nonce":4044730408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6823","nonce":4044730408}]},"public_addr":"172.21.15.63:6819/4044730408","cluster_addr":"172.21.15.63:6821/4044730408","heartbeat_back_addr":"172.21.15.63:6825/4044730408","heartbeat_front_addr":"172.21.15.63:6823/4044730408","state":["exists","up"]},{"osd":7,"uuid":"a9026588-ccdc-4e6c-b628-1ac8a7dbfa64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6817","nonce":2913027708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6819","nonce":2913027708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6823","nonce":2913027708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6821","nonce":2913027708}]},"public_addr":"172.21.15.71:6817/2913027708","cluster_addr":"172.21.15.71:6819/2913027708","heartbeat_back_addr":"172.21.15.71:6823/2913027708","heartbeat_front_addr":"172.21.15.71:6821/2913027708","state":["exists","up"]},{"osd":8,"uuid":"2e1dacea-483c-4587-8d19-5c77a7b98667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6817","nonce":2058692148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6819","nonce":2058692148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6823","nonce":2058692148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6821","nonce":2058692148}]},"public_addr":"172.21.15.175:6817/2058692148","cluster_addr":"172.21.15.175:6819/2058692148","heartbeat_back_addr":"172.21.15.175:6823/2058692148","heartbeat_front_addr":"172.21.15.175:6821/2058692148","state":["exists","up"]},{"osd":9,"uuid":"7077ba4d-1fce-4197-a556-8b6a859c6f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6827","nonce":3278012285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6829","nonce":3278012285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6833","nonce":3278012285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6831","nonce":3278012285}]},"public_addr":"172.21.15.63:6827/3278012285","cluster_addr":"172.21.15.63:6829/3278012285","heartbeat_back_addr":"172.21.15.63:6833/3278012285","heartbeat_front_addr":"172.21.15.63:6831/3278012285","state":["exists","up"]},{"osd":10,"uuid":"99965496-91ee-4eef-9f2e-8f9c8dc54f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6825","nonce":3297929438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6827","nonce":3297929438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6831","nonce":3297929438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6829","nonce":3297929438}]},"public_addr":"172.21.15.71:6825/3297929438","cluster_addr":"172.21.15.71:6827/3297929438","heartbeat_back_addr":"172.21.15.71:6831/3297929438","heartbeat_front_addr":"172.21.15.71:6829/3297929438","state":["exists","up"]},{"osd":11,"uuid":"1b26d1a8-91a4-4877-ad1c-18160a1b3b6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6825","nonce":1970094291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6827","nonce":1970094291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6831","nonce":1970094291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6829","nonce":1970094291}]},"public_addr":"172.21.15.175:6825/1970094291","cluster_addr":"172.21.15.175:6827/1970094291","heartbeat_back_addr":"172.21.15.175:6831/1970094291","heartbeat_front_addr":"172.21.15.175:6829/1970094291","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:20:43.732676+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:08.957775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:34.157788+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:00.134410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:25.502998+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:51.739501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:18.325642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:44.430626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:10.776017+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:36.482831+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:01.898216+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:27.644941+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/1652196301":"2024-09-22T06:19:37.776447+0000","172.21.15.63:6801/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/2740830999":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6801/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6801/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/2958589237":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/1398493582":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/3529491525":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/363262068":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6800/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/3928056461":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/128321401":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/39222803":"2024-09-22T06:19:37.776447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:26:20.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.831+0000 7f800f29d640 1 -- 172.21.15.63:0/1027899503 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7ff40b6560 msgr2=0x7f7ff40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:20.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.831+0000 7f800f29d640 1 --2- 172.21.15.63:0/1027899503 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7ff40b6560 0x7f7ff40b8a70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8004009b40 tx=0x7f8004005e50 comp rx=0 tx=0).stop 2024-09-21T06:26:20.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.831+0000 7f800f29d640 1 -- 172.21.15.63:0/1027899503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80081087a0 msgr2=0x7f80081a1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:20.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.831+0000 7f800f29d640 1 --2- 172.21.15.63:0/1027899503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80081087a0 0x7f80081a1f80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f800000eb10 tx=0x7f800000c2d0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.831+0000 7f800f29d640 1 -- 172.21.15.63:0/1027899503 shutdown_connections 2024-09-21T06:26:20.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.831+0000 7f800f29d640 1 --2- 172.21.15.63:0/1027899503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80081087a0 0x7f80081a1f80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.831+0000 7f800f29d640 1 --2- 172.21.15.63:0/1027899503 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7ff40b6560 0x7f7ff40b8a70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.831+0000 7f800f29d640 1 --2- 172.21.15.63:0/1027899503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80081027e0 0x7f800819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.831+0000 7f800f29d640 1 --2- 172.21.15.63:0/1027899503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8008101e90 0x7f800819c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.831+0000 7f800f29d640 1 -- 172.21.15.63:0/1027899503 >> 172.21.15.63:0/1027899503 conn(0x7f8008079ec0 msgr2=0x7f8008106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:20.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.831+0000 7f800f29d640 1 -- 172.21.15.63:0/1027899503 shutdown_connections 2024-09-21T06:26:20.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:20.831+0000 7f800f29d640 1 -- 172.21.15.63:0/1027899503 wait complete. 2024-09-21T06:26:21.018 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:26:20 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 2024-09-21T06:26:20.647+0000 7f7db6fcc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:26:21.511 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:21 smithi063 ceph-mon[31150]: pgmap v264: 97 pgs: 44 active+clean, 6 creating+peering, 47 unknown; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2024-09-21T06:26:21.512 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:21 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] up:active 2024-09-21T06:26:21.512 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:21 smithi063 ceph-mon[31150]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:26:21.512 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:21 smithi063 ceph-mon[31150]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:26:21.512 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:21 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1027899503' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:26:21.544 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:26:21.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:21 smithi175 ceph-mon[34510]: pgmap v264: 97 pgs: 44 active+clean, 6 creating+peering, 47 unknown; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2024-09-21T06:26:21.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:21 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] up:active 2024-09-21T06:26:21.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:21 smithi175 ceph-mon[34510]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:26:21.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:21 smithi175 ceph-mon[34510]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:26:21.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:21 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1027899503' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:26:21.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:21 smithi071 ceph-mon[34844]: pgmap v264: 97 pgs: 44 active+clean, 6 creating+peering, 47 unknown; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2024-09-21T06:26:21.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:21 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] up:active 2024-09-21T06:26:21.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:21 smithi071 ceph-mon[34844]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:26:21.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:21 smithi071 ceph-mon[34844]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:26:21.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:21 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1027899503' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:26:21.804 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:22.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.263+0000 7ff246b96640 1 -- 172.21.15.63:0/4043879921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2401083a0 msgr2=0x7ff2401087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:22.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.263+0000 7ff246b96640 1 --2- 172.21.15.63:0/4043879921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2401083a0 0x7ff2401087b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff228009900 tx=0x7ff22802a410 comp rx=0 tx=0).stop 2024-09-21T06:26:22.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.263+0000 7ff246b96640 1 -- 172.21.15.63:0/4043879921 shutdown_connections 2024-09-21T06:26:22.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.263+0000 7ff246b96640 1 --2- 172.21.15.63:0/4043879921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff240108cf0 0x7ff24010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.263+0000 7ff246b96640 1 --2- 172.21.15.63:0/4043879921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2401083a0 0x7ff2401087b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.263+0000 7ff246b96640 1 --2- 172.21.15.63:0/4043879921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff240102a60 0x7ff240102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.263+0000 7ff246b96640 1 -- 172.21.15.63:0/4043879921 >> 172.21.15.63:0/4043879921 conn(0x7ff240079730 msgr2=0x7ff240079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:22.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.263+0000 7ff246b96640 1 -- 172.21.15.63:0/4043879921 shutdown_connections 2024-09-21T06:26:22.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.263+0000 7ff246b96640 1 -- 172.21.15.63:0/4043879921 wait complete. 2024-09-21T06:26:22.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.264+0000 7ff246b96640 1 Processor -- start 2024-09-21T06:26:22.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.264+0000 7ff246b96640 1 -- start start 2024-09-21T06:26:22.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.264+0000 7ff246b96640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff240102a60 0x7ff240199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.264+0000 7ff246b96640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2401083a0 0x7ff2401995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.264+0000 7ff246b96640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff240108cf0 0x7ff240199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.264+0000 7ff246b96640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff240112960 con 0x7ff240108cf0 2024-09-21T06:26:22.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.264+0000 7ff246b96640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff2401127e0 con 0x7ff2401083a0 2024-09-21T06:26:22.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.264+0000 7ff246b96640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff240112ae0 con 0x7ff240102a60 2024-09-21T06:26:22.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.264+0000 7ff245133640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff240108cf0 0x7ff240199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.264+0000 7ff245133640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff240108cf0 0x7ff240199ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40350/0 (socket says 172.21.15.63:40350) 2024-09-21T06:26:22.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.264+0000 7ff245133640 1 -- 172.21.15.63:0/2869023690 learned_addr learned my addr 172.21.15.63:0/2869023690 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:22.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.264+0000 7ff244932640 1 --2- 172.21.15.63:0/2869023690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff240102a60 0x7ff240199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.264+0000 7ff23ffff640 1 --2- 172.21.15.63:0/2869023690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2401083a0 0x7ff2401995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.265+0000 7ff245133640 1 -- 172.21.15.63:0/2869023690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff240102a60 msgr2=0x7ff240199060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:22.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.265+0000 7ff245133640 1 --2- 172.21.15.63:0/2869023690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff240102a60 0x7ff240199060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.265+0000 7ff245133640 1 -- 172.21.15.63:0/2869023690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2401083a0 msgr2=0x7ff2401995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:22.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.265+0000 7ff245133640 1 --2- 172.21.15.63:0/2869023690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2401083a0 0x7ff2401995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.265+0000 7ff245133640 1 -- 172.21.15.63:0/2869023690 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2401a8710 con 0x7ff240108cf0 2024-09-21T06:26:22.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.265+0000 7ff244932640 1 --2- 172.21.15.63:0/2869023690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff240102a60 0x7ff240199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:22.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.265+0000 7ff245133640 1 --2- 172.21.15.63:0/2869023690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff240108cf0 0x7ff240199ae0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff23800eaa0 tx=0x7ff23800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:22.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.265+0000 7ff23dffb640 1 -- 172.21.15.63:0/2869023690 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23800cdb0 con 0x7ff240108cf0 2024-09-21T06:26:22.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.265+0000 7ff23dffb640 1 -- 172.21.15.63:0/2869023690 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff238005020 con 0x7ff240108cf0 2024-09-21T06:26:22.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.265+0000 7ff246b96640 1 -- 172.21.15.63:0/2869023690 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2401a8a00 con 0x7ff240108cf0 2024-09-21T06:26:22.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.265+0000 7ff23dffb640 1 -- 172.21.15.63:0/2869023690 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2380116d0 con 0x7ff240108cf0 2024-09-21T06:26:22.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.265+0000 7ff246b96640 1 -- 172.21.15.63:0/2869023690 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2401a8ec0 con 0x7ff240108cf0 2024-09-21T06:26:22.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.266+0000 7ff246b96640 1 -- 172.21.15.63:0/2869023690 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff240102e70 con 0x7ff240108cf0 2024-09-21T06:26:22.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.268+0000 7ff23dffb640 1 -- 172.21.15.63:0/2869023690 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7ff2380051d0 con 0x7ff240108cf0 2024-09-21T06:26:22.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.269+0000 7ff23dffb640 1 --2- 172.21.15.63:0/2869023690 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff22c0b6560 0x7ff22c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.269+0000 7ff244932640 1 --2- 172.21.15.63:0/2869023690 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff22c0b6560 0x7ff22c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.269+0000 7ff23dffb640 1 -- 172.21.15.63:0/2869023690 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7ff2380e7600 con 0x7ff240108cf0 2024-09-21T06:26:22.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.269+0000 7ff244932640 1 --2- 172.21.15.63:0/2869023690 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff22c0b6560 0x7ff22c0b8a70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff230005fd0 tx=0x7ff230005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:22.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.273+0000 7ff23dffb640 1 -- 172.21.15.63:0/2869023690 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff238016030 con 0x7ff240108cf0 2024-09-21T06:26:22.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.462+0000 7ff246b96640 1 -- 172.21.15.63:0/2869023690 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff24002e640 con 0x7ff240108cf0 2024-09-21T06:26:22.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.464+0000 7ff23dffb640 1 -- 172.21.15.63:0/2869023690 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22551 (secure 0 0 0) 0x7ff2380adeb0 con 0x7ff240108cf0 2024-09-21T06:26:22.466 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:26:22.466 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":75,"fsid":"140899c8-77e1-11ef-baf5-efdc52797490","created":"2024-09-21T06:17:48.089366+0000","modified":"2024-09-21T06:26:18.960270+0000","last_up_change":"2024-09-21T06:25:29.072128+0000","last_in_change":"2024-09-21T06:25:06.097647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:21:36.236868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:26:15.016085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:26:17.072883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df4162c1-dd66-4d11-99bc-0ae36ea130f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6803","nonce":2090653772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6805","nonce":2090653772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6809","nonce":2090653772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6807","nonce":2090653772}]},"public_addr":"172.21.15.63:6803/2090653772","cluster_addr":"172.21.15.63:6805/2090653772","heartbeat_back_addr":"172.21.15.63:6809/2090653772","heartbeat_front_addr":"172.21.15.63:6807/2090653772","state":["exists","up"]},{"osd":1,"uuid":"65a12def-9f66-4153-8f1a-2ebfbbfeba99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6801","nonce":1676297548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6803","nonce":1676297548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6807","nonce":1676297548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6805","nonce":1676297548}]},"public_addr":"172.21.15.71:6801/1676297548","cluster_addr":"172.21.15.71:6803/1676297548","heartbeat_back_addr":"172.21.15.71:6807/1676297548","heartbeat_front_addr":"172.21.15.71:6805/1676297548","state":["exists","up"]},{"osd":2,"uuid":"031daa9e-9d4a-4901-95e8-695db5671fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6801","nonce":2356865390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6803","nonce":2356865390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6807","nonce":2356865390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6805","nonce":2356865390}]},"public_addr":"172.21.15.175:6801/2356865390","cluster_addr":"172.21.15.175:6803/2356865390","heartbeat_back_addr":"172.21.15.175:6807/2356865390","heartbeat_front_addr":"172.21.15.175:6805/2356865390","state":["exists","up"]},{"osd":3,"uuid":"75d23a7a-c560-4b26-84a4-74d6772a37ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6811","nonce":31683339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6813","nonce":31683339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6817","nonce":31683339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6815","nonce":31683339}]},"public_addr":"172.21.15.63:6811/31683339","cluster_addr":"172.21.15.63:6813/31683339","heartbeat_back_addr":"172.21.15.63:6817/31683339","heartbeat_front_addr":"172.21.15.63:6815/31683339","state":["exists","up"]},{"osd":4,"uuid":"6aaefd09-93dd-4f21-9b3c-701a7ff97f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6809","nonce":829449898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6811","nonce":829449898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6815","nonce":829449898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6813","nonce":829449898}]},"public_addr":"172.21.15.71:6809/829449898","cluster_addr":"172.21.15.71:6811/829449898","heartbeat_back_addr":"172.21.15.71:6815/829449898","heartbeat_front_addr":"172.21.15.71:6813/829449898","state":["exists","up"]},{"osd":5,"uuid":"91f28121-c94e-4012-b74c-dd4597545e3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6809","nonce":3005600597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6811","nonce":3005600597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6815","nonce":3005600597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6813","nonce":3005600597}]},"public_addr":"172.21.15.175:6809/3005600597","cluster_addr":"172.21.15.175:6811/3005600597","heartbeat_back_addr":"172.21.15.175:6815/3005600597","heartbeat_front_addr":"172.21.15.175:6813/3005600597","state":["exists","up"]},{"osd":6,"uuid":"bda28014-4dca-40f1-bb23-3ef61605c1ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6819","nonce":4044730408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6821","nonce":4044730408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6825","nonce":4044730408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6823","nonce":4044730408}]},"public_addr":"172.21.15.63:6819/4044730408","cluster_addr":"172.21.15.63:6821/4044730408","heartbeat_back_addr":"172.21.15.63:6825/4044730408","heartbeat_front_addr":"172.21.15.63:6823/4044730408","state":["exists","up"]},{"osd":7,"uuid":"a9026588-ccdc-4e6c-b628-1ac8a7dbfa64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6817","nonce":2913027708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6819","nonce":2913027708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6823","nonce":2913027708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6821","nonce":2913027708}]},"public_addr":"172.21.15.71:6817/2913027708","cluster_addr":"172.21.15.71:6819/2913027708","heartbeat_back_addr":"172.21.15.71:6823/2913027708","heartbeat_front_addr":"172.21.15.71:6821/2913027708","state":["exists","up"]},{"osd":8,"uuid":"2e1dacea-483c-4587-8d19-5c77a7b98667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6817","nonce":2058692148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6819","nonce":2058692148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6823","nonce":2058692148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6821","nonce":2058692148}]},"public_addr":"172.21.15.175:6817/2058692148","cluster_addr":"172.21.15.175:6819/2058692148","heartbeat_back_addr":"172.21.15.175:6823/2058692148","heartbeat_front_addr":"172.21.15.175:6821/2058692148","state":["exists","up"]},{"osd":9,"uuid":"7077ba4d-1fce-4197-a556-8b6a859c6f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6827","nonce":3278012285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6829","nonce":3278012285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6833","nonce":3278012285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6831","nonce":3278012285}]},"public_addr":"172.21.15.63:6827/3278012285","cluster_addr":"172.21.15.63:6829/3278012285","heartbeat_back_addr":"172.21.15.63:6833/3278012285","heartbeat_front_addr":"172.21.15.63:6831/3278012285","state":["exists","up"]},{"osd":10,"uuid":"99965496-91ee-4eef-9f2e-8f9c8dc54f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6825","nonce":3297929438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6827","nonce":3297929438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6831","nonce":3297929438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6829","nonce":3297929438}]},"public_addr":"172.21.15.71:6825/3297929438","cluster_addr":"172.21.15.71:6827/3297929438","heartbeat_back_addr":"172.21.15.71:6831/3297929438","heartbeat_front_addr":"172.21.15.71:6829/3297929438","state":["exists","up"]},{"osd":11,"uuid":"1b26d1a8-91a4-4877-ad1c-18160a1b3b6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6825","nonce":1970094291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6827","nonce":1970094291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6831","nonce":1970094291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6829","nonce":1970094291}]},"public_addr":"172.21.15.175:6825/1970094291","cluster_addr":"172.21.15.175:6827/1970094291","heartbeat_back_addr":"172.21.15.175:6831/1970094291","heartbeat_front_addr":"172.21.15.175:6829/1970094291","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:20:43.732676+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:08.957775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:34.157788+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:00.134410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:25.502998+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:51.739501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:18.325642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:44.430626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:10.776017+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:36.482831+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:01.898216+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:27.644941+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/1652196301":"2024-09-22T06:19:37.776447+0000","172.21.15.63:6801/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/2740830999":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6801/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6801/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/2958589237":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/1398493582":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/3529491525":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/363262068":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6800/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/3928056461":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/128321401":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/39222803":"2024-09-22T06:19:37.776447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:26:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.466+0000 7ff246b96640 1 -- 172.21.15.63:0/2869023690 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff22c0b6560 msgr2=0x7ff22c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.466+0000 7ff246b96640 1 --2- 172.21.15.63:0/2869023690 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff22c0b6560 0x7ff22c0b8a70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff230005fd0 tx=0x7ff230005850 comp rx=0 tx=0).stop 2024-09-21T06:26:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.466+0000 7ff246b96640 1 -- 172.21.15.63:0/2869023690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff240108cf0 msgr2=0x7ff240199ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.466+0000 7ff246b96640 1 --2- 172.21.15.63:0/2869023690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff240108cf0 0x7ff240199ae0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff23800eaa0 tx=0x7ff23800ef60 comp rx=0 tx=0).stop 2024-09-21T06:26:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.466+0000 7ff246b96640 1 -- 172.21.15.63:0/2869023690 shutdown_connections 2024-09-21T06:26:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.466+0000 7ff246b96640 1 --2- 172.21.15.63:0/2869023690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff240108cf0 0x7ff240199ae0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.466+0000 7ff246b96640 1 --2- 172.21.15.63:0/2869023690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2401083a0 0x7ff2401995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.466+0000 7ff246b96640 1 --2- 172.21.15.63:0/2869023690 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff22c0b6560 0x7ff22c0b8a70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.466+0000 7ff246b96640 1 --2- 172.21.15.63:0/2869023690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff240102a60 0x7ff240199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.466+0000 7ff246b96640 1 -- 172.21.15.63:0/2869023690 >> 172.21.15.63:0/2869023690 conn(0x7ff240079730 msgr2=0x7ff2401043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.466+0000 7ff246b96640 1 -- 172.21.15.63:0/2869023690 shutdown_connections 2024-09-21T06:26:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:22.466+0000 7ff246b96640 1 -- 172.21.15.63:0/2869023690 wait complete. 2024-09-21T06:26:23.142 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T06:26:23.401 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:23.556 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:23 smithi063 ceph-mon[31150]: pgmap v265: 97 pgs: 95 active+clean, 2 creating+peering; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 1 op/s 2024-09-21T06:26:23.556 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:23 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2869023690' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:26:23.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:23 smithi175 ceph-mon[34510]: pgmap v265: 97 pgs: 95 active+clean, 2 creating+peering; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 1 op/s 2024-09-21T06:26:23.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:23 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2869023690' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:26:23.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:23 smithi071 ceph-mon[34844]: pgmap v265: 97 pgs: 95 active+clean, 2 creating+peering; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 1 op/s 2024-09-21T06:26:23.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:23 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2869023690' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:26:23.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.894+0000 7ff7fd3d3640 1 -- 172.21.15.63:0/938222655 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7f810ddf0 msgr2=0x7ff7f8110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:23.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.894+0000 7ff7fd3d3640 1 --2- 172.21.15.63:0/938222655 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7f810ddf0 0x7ff7f8110300 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8009ca0 tx=0x7ff7e802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:26:23.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.894+0000 7ff7fd3d3640 1 -- 172.21.15.63:0/938222655 shutdown_connections 2024-09-21T06:26:23.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.894+0000 7ff7fd3d3640 1 --2- 172.21.15.63:0/938222655 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7f810ddf0 0x7ff7f8110300 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:23.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.894+0000 7ff7fd3d3640 1 --2- 172.21.15.63:0/938222655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7f8105270 0x7ff7f810d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:23.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.894+0000 7ff7fd3d3640 1 --2- 172.21.15.63:0/938222655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7f8104840 0x7ff7f8104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:23.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.894+0000 7ff7fd3d3640 1 -- 172.21.15.63:0/938222655 >> 172.21.15.63:0/938222655 conn(0x7ff7f8079730 msgr2=0x7ff7f8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:23.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.894+0000 7ff7fd3d3640 1 -- 172.21.15.63:0/938222655 shutdown_connections 2024-09-21T06:26:23.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.894+0000 7ff7fd3d3640 1 -- 172.21.15.63:0/938222655 wait complete. 2024-09-21T06:26:23.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.894+0000 7ff7fd3d3640 1 Processor -- start 2024-09-21T06:26:23.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.895+0000 7ff7fd3d3640 1 -- start start 2024-09-21T06:26:23.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.895+0000 7ff7fd3d3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7f8104840 0x7ff7f8102750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:23.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.895+0000 7ff7fd3d3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7f8105270 0x7ff7f8102c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:23.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.895+0000 7ff7fd3d3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7f810ddf0 0x7ff7f81031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:23.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.895+0000 7ff7fd3d3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f8113a90 con 0x7ff7f8105270 2024-09-21T06:26:23.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.895+0000 7ff7fd3d3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f8113910 con 0x7ff7f8104840 2024-09-21T06:26:23.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.895+0000 7ff7fd3d3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f8113c10 con 0x7ff7f810ddf0 2024-09-21T06:26:23.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.895+0000 7ff7f67fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7f8105270 0x7ff7f8102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:23.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.895+0000 7ff7f67fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7f8105270 0x7ff7f8102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40362/0 (socket says 172.21.15.63:40362) 2024-09-21T06:26:23.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.895+0000 7ff7f67fc640 1 -- 172.21.15.63:0/401484096 learned_addr learned my addr 172.21.15.63:0/401484096 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:23.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.895+0000 7ff7f6ffd640 1 --2- 172.21.15.63:0/401484096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7f8104840 0x7ff7f8102750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:23.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.895+0000 7ff7f77fe640 1 --2- 172.21.15.63:0/401484096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7f810ddf0 0x7ff7f81031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:23.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.895+0000 7ff7f67fc640 1 -- 172.21.15.63:0/401484096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7f810ddf0 msgr2=0x7ff7f81031d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:23.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.895+0000 7ff7f67fc640 1 --2- 172.21.15.63:0/401484096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7f810ddf0 0x7ff7f81031d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:23.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.895+0000 7ff7f67fc640 1 -- 172.21.15.63:0/401484096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7f8104840 msgr2=0x7ff7f8102750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:23.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.895+0000 7ff7f67fc640 1 --2- 172.21.15.63:0/401484096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7f8104840 0x7ff7f8102750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:23.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.895+0000 7ff7f67fc640 1 -- 172.21.15.63:0/401484096 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f81a87c0 con 0x7ff7f8105270 2024-09-21T06:26:23.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.895+0000 7ff7f77fe640 1 --2- 172.21.15.63:0/401484096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7f810ddf0 0x7ff7f81031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:23.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.896+0000 7ff7f67fc640 1 --2- 172.21.15.63:0/401484096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7f8105270 0x7ff7f8102c90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000d740 tx=0x7ff7e000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:23.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.896+0000 7ff7effff640 1 -- 172.21.15.63:0/401484096 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0017070 con 0x7ff7f8105270 2024-09-21T06:26:23.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.896+0000 7ff7effff640 1 -- 172.21.15.63:0/401484096 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7e000de50 con 0x7ff7f8105270 2024-09-21T06:26:23.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.896+0000 7ff7fd3d3640 1 -- 172.21.15.63:0/401484096 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f81a8ab0 con 0x7ff7f8105270 2024-09-21T06:26:23.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.896+0000 7ff7effff640 1 -- 172.21.15.63:0/401484096 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e000f620 con 0x7ff7f8105270 2024-09-21T06:26:23.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.896+0000 7ff7fd3d3640 1 -- 172.21.15.63:0/401484096 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f81a8ff0 con 0x7ff7f8105270 2024-09-21T06:26:23.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.897+0000 7ff7fd3d3640 1 -- 172.21.15.63:0/401484096 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f8104c50 con 0x7ff7f8105270 2024-09-21T06:26:23.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.898+0000 7ff7effff640 1 -- 172.21.15.63:0/401484096 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7ff7e001a070 con 0x7ff7f8105270 2024-09-21T06:26:23.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.899+0000 7ff7effff640 1 --2- 172.21.15.63:0/401484096 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7e40b6560 0x7ff7e40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:23.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.899+0000 7ff7f6ffd640 1 --2- 172.21.15.63:0/401484096 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7e40b6560 0x7ff7e40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:23.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.899+0000 7ff7effff640 1 -- 172.21.15.63:0/401484096 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7ff7e00e6ce0 con 0x7ff7f8105270 2024-09-21T06:26:23.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.900+0000 7ff7f6ffd640 1 --2- 172.21.15.63:0/401484096 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7e40b6560 0x7ff7e40b8a70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00058c0 tx=0x7ff7f000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:23.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:23.904+0000 7ff7effff640 1 -- 172.21.15.63:0/401484096 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff7e00ad590 con 0x7ff7f8105270 2024-09-21T06:26:24.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:24.128+0000 7ff7fd3d3640 1 -- 172.21.15.63:0/401484096 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff7f81a93c0 con 0x7ff7f8105270 2024-09-21T06:26:24.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:24.305+0000 7ff7effff640 1 -- 172.21.15.63:0/401484096 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7ff7e00b1970 con 0x7ff7f8105270 2024-09-21T06:26:24.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:24.307+0000 7ff7fd3d3640 1 -- 172.21.15.63:0/401484096 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7e40b6560 msgr2=0x7ff7e40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:24.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:24.307+0000 7ff7fd3d3640 1 --2- 172.21.15.63:0/401484096 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7e40b6560 0x7ff7e40b8a70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00058c0 tx=0x7ff7f000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:24.307+0000 7ff7fd3d3640 1 -- 172.21.15.63:0/401484096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7f8105270 msgr2=0x7ff7f8102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:24.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:24.307+0000 7ff7fd3d3640 1 --2- 172.21.15.63:0/401484096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7f8105270 0x7ff7f8102c90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000d740 tx=0x7ff7e000dc00 comp rx=0 tx=0).stop 2024-09-21T06:26:24.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:24.307+0000 7ff7fd3d3640 1 -- 172.21.15.63:0/401484096 shutdown_connections 2024-09-21T06:26:24.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:24.307+0000 7ff7fd3d3640 1 --2- 172.21.15.63:0/401484096 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7e40b6560 0x7ff7e40b8a70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:24.307+0000 7ff7fd3d3640 1 --2- 172.21.15.63:0/401484096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7f810ddf0 0x7ff7f81031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:24.307+0000 7ff7fd3d3640 1 --2- 172.21.15.63:0/401484096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7f8105270 0x7ff7f8102c90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:24.307+0000 7ff7fd3d3640 1 --2- 172.21.15.63:0/401484096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7f8104840 0x7ff7f8102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:24.307+0000 7ff7fd3d3640 1 -- 172.21.15.63:0/401484096 >> 172.21.15.63:0/401484096 conn(0x7ff7f8079730 msgr2=0x7ff7f8106950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:24.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:24.308+0000 7ff7fd3d3640 1 -- 172.21.15.63:0/401484096 shutdown_connections 2024-09-21T06:26:24.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:24.308+0000 7ff7fd3d3640 1 -- 172.21.15.63:0/401484096 wait complete. 2024-09-21T06:26:24.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:24 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/401484096' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T06:26:24.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:24 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/401484096' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T06:26:24.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:24 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/401484096' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T06:26:24.976 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-21T06:26:24.977 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 5 2024-09-21T06:26:25.250 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:25.588 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:25 smithi063 ceph-mon[31150]: pgmap v266: 97 pgs: 97 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T06:26:25.589 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:25 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/401484096' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T06:26:25.589 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:25 smithi063 ceph-mon[31150]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:26:25.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:25 smithi175 ceph-mon[34510]: pgmap v266: 97 pgs: 97 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T06:26:25.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:25 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/401484096' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T06:26:25.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:25 smithi175 ceph-mon[34510]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:26:25.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.764+0000 7f6cc9955640 1 -- 172.21.15.63:0/814763110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc4108f60 msgr2=0x7f6cc410f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:25.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.764+0000 7f6cc9955640 1 --2- 172.21.15.63:0/814763110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc4108f60 0x7f6cc410f790 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009ca0 tx=0x7f6cbc02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:26:25.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.764+0000 7f6cc9955640 1 -- 172.21.15.63:0/814763110 shutdown_connections 2024-09-21T06:26:25.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.764+0000 7f6cc9955640 1 --2- 172.21.15.63:0/814763110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc4108f60 0x7f6cc410f790 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:25.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.764+0000 7f6cc9955640 1 --2- 172.21.15.63:0/814763110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cc4108610 0x7f6cc4108a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:25.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.764+0000 7f6cc9955640 1 --2- 172.21.15.63:0/814763110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc41031d0 0x7f6cc41035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:25.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.764+0000 7f6cc9955640 1 -- 172.21.15.63:0/814763110 >> 172.21.15.63:0/814763110 conn(0x7f6cc4079e40 msgr2=0x7f6cc407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:25.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.764+0000 7f6cc9955640 1 -- 172.21.15.63:0/814763110 shutdown_connections 2024-09-21T06:26:25.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.764+0000 7f6cc9955640 1 -- 172.21.15.63:0/814763110 wait complete. 2024-09-21T06:26:25.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.764+0000 7f6cc9955640 1 Processor -- start 2024-09-21T06:26:25.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.765+0000 7f6cc9955640 1 -- start start 2024-09-21T06:26:25.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.765+0000 7f6cc9955640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc41031d0 0x7f6cc419b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:25.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.765+0000 7f6cc9955640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc4108610 0x7f6cc419baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:25.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.765+0000 7f6cc9955640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cc4108f60 0x7f6cc419c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:25.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.765+0000 7f6cc9955640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc4112c20 con 0x7f6cc41031d0 2024-09-21T06:26:25.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.765+0000 7f6cc9955640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc4112aa0 con 0x7f6cc4108f60 2024-09-21T06:26:25.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.765+0000 7f6cc9955640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc4112da0 con 0x7f6cc4108610 2024-09-21T06:26:25.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.765+0000 7f6cc2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc41031d0 0x7f6cc419b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:25.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.765+0000 7f6cc2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc41031d0 0x7f6cc419b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40376/0 (socket says 172.21.15.63:40376) 2024-09-21T06:26:25.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.765+0000 7f6cc2ffd640 1 -- 172.21.15.63:0/3625218851 learned_addr learned my addr 172.21.15.63:0/3625218851 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:25.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.765+0000 7f6cc37fe640 1 --2- 172.21.15.63:0/3625218851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cc4108f60 0x7f6cc419c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:25.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.765+0000 7f6cc27fc640 1 --2- 172.21.15.63:0/3625218851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc4108610 0x7f6cc419baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:25.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.766+0000 7f6cc2ffd640 1 -- 172.21.15.63:0/3625218851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc4108610 msgr2=0x7f6cc419baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:25.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.766+0000 7f6cc2ffd640 1 --2- 172.21.15.63:0/3625218851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc4108610 0x7f6cc419baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:25.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.766+0000 7f6cc2ffd640 1 -- 172.21.15.63:0/3625218851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cc4108f60 msgr2=0x7f6cc419c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:25.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.766+0000 7f6cc2ffd640 1 --2- 172.21.15.63:0/3625218851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cc4108f60 0x7f6cc419c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:25.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.766+0000 7f6cc2ffd640 1 -- 172.21.15.63:0/3625218851 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc41a6840 con 0x7f6cc41031d0 2024-09-21T06:26:25.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.766+0000 7f6cc37fe640 1 --2- 172.21.15.63:0/3625218851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cc4108f60 0x7f6cc419c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:25.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.766+0000 7f6cc2ffd640 1 --2- 172.21.15.63:0/3625218851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc41031d0 0x7f6cc419b5b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400e9f0 tx=0x7f6cb400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:25.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.766+0000 7f6cc8953640 1 -- 172.21.15.63:0/3625218851 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb400cd80 con 0x7f6cc41031d0 2024-09-21T06:26:25.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.766+0000 7f6cc9955640 1 -- 172.21.15.63:0/3625218851 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc41a6b30 con 0x7f6cc41031d0 2024-09-21T06:26:25.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.766+0000 7f6cc8953640 1 -- 172.21.15.63:0/3625218851 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cb40054d0 con 0x7f6cc41031d0 2024-09-21T06:26:25.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.766+0000 7f6cc8953640 1 -- 172.21.15.63:0/3625218851 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4010690 con 0x7f6cc41031d0 2024-09-21T06:26:25.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.766+0000 7f6cc9955640 1 -- 172.21.15.63:0/3625218851 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc41a7020 con 0x7f6cc41031d0 2024-09-21T06:26:25.770 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:25 smithi071 ceph-mon[34844]: pgmap v266: 97 pgs: 97 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T06:26:25.770 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:25 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/401484096' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T06:26:25.771 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:25 smithi071 ceph-mon[34844]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:26:25.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.767+0000 7f6cc9955640 1 -- 172.21.15.63:0/3625218851 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cc41035e0 con 0x7f6cc41031d0 2024-09-21T06:26:25.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.769+0000 7f6cc8953640 1 -- 172.21.15.63:0/3625218851 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f6cb4004e10 con 0x7f6cc41031d0 2024-09-21T06:26:25.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.770+0000 7f6cc8953640 1 --2- 172.21.15.63:0/3625218851 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6cac0b6590 0x7f6cac0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:25.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.770+0000 7f6cc27fc640 1 --2- 172.21.15.63:0/3625218851 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6cac0b6590 0x7f6cac0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:25.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.770+0000 7f6cc8953640 1 -- 172.21.15.63:0/3625218851 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f6cb40e7ac0 con 0x7f6cc41031d0 2024-09-21T06:26:25.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.770+0000 7f6cc27fc640 1 --2- 172.21.15.63:0/3625218851 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6cac0b6590 0x7f6cac0b8aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8005e00 tx=0x7f6cb8005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:25.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.773+0000 7f6cc8953640 1 -- 172.21.15.63:0/3625218851 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6cb40ae400 con 0x7f6cc41031d0 2024-09-21T06:26:26.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:25.999+0000 7f6cc9955640 1 -- 172.21.15.63:0/3625218851 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f6cc410ad50 con 0x7f6cc41031d0 2024-09-21T06:26:26.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:26.314+0000 7f6cc8953640 1 -- 172.21.15.63:0/3625218851 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f6cb40b27e0 con 0x7f6cc41031d0 2024-09-21T06:26:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:26.317+0000 7f6cc9955640 1 -- 172.21.15.63:0/3625218851 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6cac0b6590 msgr2=0x7f6cac0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:26.317+0000 7f6cc9955640 1 --2- 172.21.15.63:0/3625218851 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6cac0b6590 0x7f6cac0b8aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8005e00 tx=0x7f6cb8005c50 comp rx=0 tx=0).stop 2024-09-21T06:26:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:26.317+0000 7f6cc9955640 1 -- 172.21.15.63:0/3625218851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc41031d0 msgr2=0x7f6cc419b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:26.317+0000 7f6cc9955640 1 --2- 172.21.15.63:0/3625218851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc41031d0 0x7f6cc419b5b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400e9f0 tx=0x7f6cb400edf0 comp rx=0 tx=0).stop 2024-09-21T06:26:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:26.317+0000 7f6cc9955640 1 -- 172.21.15.63:0/3625218851 shutdown_connections 2024-09-21T06:26:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:26.317+0000 7f6cc9955640 1 --2- 172.21.15.63:0/3625218851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cc4108f60 0x7f6cc419c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:26.317+0000 7f6cc9955640 1 --2- 172.21.15.63:0/3625218851 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6cac0b6590 0x7f6cac0b8aa0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:26.317+0000 7f6cc9955640 1 --2- 172.21.15.63:0/3625218851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc4108610 0x7f6cc419baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:26.317+0000 7f6cc9955640 1 --2- 172.21.15.63:0/3625218851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc41031d0 0x7f6cc419b5b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:26.317+0000 7f6cc9955640 1 -- 172.21.15.63:0/3625218851 >> 172.21.15.63:0/3625218851 conn(0x7f6cc4079e40 msgr2=0x7f6cc41045e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:26.317+0000 7f6cc9955640 1 -- 172.21.15.63:0/3625218851 shutdown_connections 2024-09-21T06:26:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:26.317+0000 7f6cc9955640 1 -- 172.21.15.63:0/3625218851 wait complete. 2024-09-21T06:26:26.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:26 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3625218851' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T06:26:26.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:26 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3625218851' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T06:26:26.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:26 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3625218851' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T06:26:26.981 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T06:26:27.244 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:27.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:27 smithi063 ceph-mon[31150]: pgmap v267: 97 pgs: 97 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T06:26:27.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:27 smithi063 ceph-mon[31150]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T06:26:27.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:27 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3625218851' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T06:26:27.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:27 smithi063 ceph-mon[31150]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T06:26:27.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:27 smithi063 ceph-mon[31150]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:26:27.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:27 smithi063 ceph-mon[31150]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T06:26:27.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:27 smithi063 ceph-mon[31150]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T06:26:27.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:27 smithi175 ceph-mon[34510]: pgmap v267: 97 pgs: 97 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T06:26:27.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:27 smithi175 ceph-mon[34510]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T06:26:27.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:27 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3625218851' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T06:26:27.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:27 smithi175 ceph-mon[34510]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T06:26:27.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:27 smithi175 ceph-mon[34510]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:26:27.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:27 smithi175 ceph-mon[34510]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T06:26:27.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:27 smithi175 ceph-mon[34510]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T06:26:27.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.731+0000 7f79da3dc640 1 -- 172.21.15.63:0/3814296814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79d41094a0 msgr2=0x7f79d41098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:27.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.731+0000 7f79da3dc640 1 --2- 172.21.15.63:0/3814296814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79d41094a0 0x7f79d41098b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f79c8009900 tx=0x7f79c802a410 comp rx=0 tx=0).stop 2024-09-21T06:26:27.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.731+0000 7f79da3dc640 1 -- 172.21.15.63:0/3814296814 shutdown_connections 2024-09-21T06:26:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.731+0000 7f79da3dc640 1 --2- 172.21.15.63:0/3814296814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79d4109df0 0x7f79d4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.731+0000 7f79da3dc640 1 --2- 172.21.15.63:0/3814296814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79d41094a0 0x7f79d41098b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.731+0000 7f79da3dc640 1 --2- 172.21.15.63:0/3814296814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79d4103b60 0x7f79d4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.731+0000 7f79da3dc640 1 -- 172.21.15.63:0/3814296814 >> 172.21.15.63:0/3814296814 conn(0x7f79d407b850 msgr2=0x7f79d407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.731+0000 7f79da3dc640 1 -- 172.21.15.63:0/3814296814 shutdown_connections 2024-09-21T06:26:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.731+0000 7f79da3dc640 1 -- 172.21.15.63:0/3814296814 wait complete. 2024-09-21T06:26:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.732+0000 7f79da3dc640 1 Processor -- start 2024-09-21T06:26:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.732+0000 7f79da3dc640 1 -- start start 2024-09-21T06:26:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.732+0000 7f79da3dc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79d4103b60 0x7f79d419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79da3dc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79d41094a0 0x7f79d419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79da3dc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79d4109df0 0x7f79d419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79da3dc640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f79d4113b00 con 0x7f79d4103b60 2024-09-21T06:26:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79da3dc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f79d4113980 con 0x7f79d41094a0 2024-09-21T06:26:27.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79da3dc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f79d4113c80 con 0x7f79d4109df0 2024-09-21T06:26:27.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79d3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79d4103b60 0x7f79d419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79d3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79d4103b60 0x7f79d419a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54770/0 (socket says 172.21.15.63:54770) 2024-09-21T06:26:27.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79d3fff640 1 -- 172.21.15.63:0/2196220496 learned_addr learned my addr 172.21.15.63:0/2196220496 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:27.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79d37fe640 1 --2- 172.21.15.63:0/2196220496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79d41094a0 0x7f79d419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79d8979640 1 --2- 172.21.15.63:0/2196220496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79d4109df0 0x7f79d419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79d3fff640 1 -- 172.21.15.63:0/2196220496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79d4109df0 msgr2=0x7f79d419fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:27.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79d3fff640 1 --2- 172.21.15.63:0/2196220496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79d4109df0 0x7f79d419fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79d3fff640 1 -- 172.21.15.63:0/2196220496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79d41094a0 msgr2=0x7f79d419aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:27.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79d3fff640 1 --2- 172.21.15.63:0/2196220496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79d41094a0 0x7f79d419aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79d3fff640 1 -- 172.21.15.63:0/2196220496 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d41a0420 con 0x7f79d4103b60 2024-09-21T06:26:27.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79d8979640 1 --2- 172.21.15.63:0/2196220496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79d4109df0 0x7f79d419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:27.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79d37fe640 1 --2- 172.21.15.63:0/2196220496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79d41094a0 0x7f79d419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:27.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79d3fff640 1 --2- 172.21.15.63:0/2196220496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79d4103b60 0x7f79d419a4b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f79c400d950 tx=0x7f79c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:27.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79d17fa640 1 -- 172.21.15.63:0/2196220496 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c4017070 con 0x7f79d4103b60 2024-09-21T06:26:27.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79d17fa640 1 -- 172.21.15.63:0/2196220496 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79c4009c30 con 0x7f79d4103b60 2024-09-21T06:26:27.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79da3dc640 1 -- 172.21.15.63:0/2196220496 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d41a0710 con 0x7f79d4103b60 2024-09-21T06:26:27.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79d17fa640 1 -- 172.21.15.63:0/2196220496 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c400f620 con 0x7f79d4103b60 2024-09-21T06:26:27.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.733+0000 7f79da3dc640 1 -- 172.21.15.63:0/2196220496 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d41a6e70 con 0x7f79d4103b60 2024-09-21T06:26:27.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.734+0000 7f79da3dc640 1 -- 172.21.15.63:0/2196220496 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79d4103f70 con 0x7f79d4103b60 2024-09-21T06:26:27.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.737+0000 7f79d17fa640 1 -- 172.21.15.63:0/2196220496 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f79c4005030 con 0x7f79d4103b60 2024-09-21T06:26:27.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.738+0000 7f79d17fa640 1 --2- 172.21.15.63:0/2196220496 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f79bc0b6560 0x7f79bc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.738+0000 7f79d37fe640 1 --2- 172.21.15.63:0/2196220496 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f79bc0b6560 0x7f79bc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.738+0000 7f79d17fa640 1 -- 172.21.15.63:0/2196220496 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f79c40e6ff0 con 0x7f79d4103b60 2024-09-21T06:26:27.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.738+0000 7f79d37fe640 1 --2- 172.21.15.63:0/2196220496 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f79bc0b6560 0x7f79bc0b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f79c802aa00 tx=0x7f79c8031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:27.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.741+0000 7f79d17fa640 1 -- 172.21.15.63:0/2196220496 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f79c40ad8a0 con 0x7f79d4103b60 2024-09-21T06:26:27.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:27 smithi071 ceph-mon[34844]: pgmap v267: 97 pgs: 97 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T06:26:27.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:27 smithi071 ceph-mon[34844]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T06:26:27.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:27 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3625218851' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T06:26:27.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:27 smithi071 ceph-mon[34844]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T06:26:27.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:27 smithi071 ceph-mon[34844]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:26:27.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:27 smithi071 ceph-mon[34844]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T06:26:27.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:27 smithi071 ceph-mon[34844]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T06:26:27.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:27.969+0000 7f79da3dc640 1 -- 172.21.15.63:0/2196220496 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f79d402e640 con 0x7f79d4103b60 2024-09-21T06:26:28.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:28.337+0000 7f79d17fa640 1 -- 172.21.15.63:0/2196220496 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f79c40d0020 con 0x7f79d4103b60 2024-09-21T06:26:28.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:28.340+0000 7f79da3dc640 1 -- 172.21.15.63:0/2196220496 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f79bc0b6560 msgr2=0x7f79bc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:28.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:28.340+0000 7f79da3dc640 1 --2- 172.21.15.63:0/2196220496 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f79bc0b6560 0x7f79bc0b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f79c802aa00 tx=0x7f79c8031400 comp rx=0 tx=0).stop 2024-09-21T06:26:28.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:28.340+0000 7f79da3dc640 1 -- 172.21.15.63:0/2196220496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79d4103b60 msgr2=0x7f79d419a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:28.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:28.340+0000 7f79da3dc640 1 --2- 172.21.15.63:0/2196220496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79d4103b60 0x7f79d419a4b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f79c400d950 tx=0x7f79c400de10 comp rx=0 tx=0).stop 2024-09-21T06:26:28.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:28.340+0000 7f79da3dc640 1 -- 172.21.15.63:0/2196220496 shutdown_connections 2024-09-21T06:26:28.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:28.340+0000 7f79da3dc640 1 --2- 172.21.15.63:0/2196220496 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f79bc0b6560 0x7f79bc0b8a70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:28.340+0000 7f79da3dc640 1 --2- 172.21.15.63:0/2196220496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79d4109df0 0x7f79d419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:28.340+0000 7f79da3dc640 1 --2- 172.21.15.63:0/2196220496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79d41094a0 0x7f79d419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:28.340+0000 7f79da3dc640 1 --2- 172.21.15.63:0/2196220496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79d4103b60 0x7f79d419a4b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:28.340+0000 7f79da3dc640 1 -- 172.21.15.63:0/2196220496 >> 172.21.15.63:0/2196220496 conn(0x7f79d407b850 msgr2=0x7f79d4107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:28.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:28.340+0000 7f79da3dc640 1 -- 172.21.15.63:0/2196220496 shutdown_connections 2024-09-21T06:26:28.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:28.340+0000 7f79da3dc640 1 -- 172.21.15.63:0/2196220496 wait complete. 2024-09-21T06:26:28.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:28 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] up:active 2024-09-21T06:26:28.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:28 smithi063 ceph-mon[31150]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T06:26:28.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:28 smithi063 ceph-mon[31150]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T06:26:28.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:28 smithi063 ceph-mon[31150]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T06:26:28.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:28 smithi063 ceph-mon[31150]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T06:26:28.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:28 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2196220496' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T06:26:28.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:28 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] up:active 2024-09-21T06:26:28.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:28 smithi175 ceph-mon[34510]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T06:26:28.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:28 smithi175 ceph-mon[34510]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T06:26:28.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:28 smithi175 ceph-mon[34510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T06:26:28.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:28 smithi175 ceph-mon[34510]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T06:26:28.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:28 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2196220496' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T06:26:28.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:28 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] up:active 2024-09-21T06:26:28.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:28 smithi071 ceph-mon[34844]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T06:26:28.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:28 smithi071 ceph-mon[34844]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T06:26:28.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:28 smithi071 ceph-mon[34844]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T06:26:28.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:28 smithi071 ceph-mon[34844]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T06:26:28.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:28 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2196220496' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T06:26:29.031 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T06:26:29.288 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:29.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:29 smithi175 ceph-mon[34510]: pgmap v268: 97 pgs: 97 active+clean; 580 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-09-21T06:26:29.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:29 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2196220496' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T06:26:29.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:29 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] up:active 2024-09-21T06:26:29.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:29 smithi175 ceph-mon[34510]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T06:26:29.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:29 smithi175 ceph-mon[34510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T06:26:29.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:29 smithi175 ceph-mon[34510]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-09-21T06:26:29.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:29 smithi175 ceph-mon[34510]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-09-21T06:26:29.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:29 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] up:active 2024-09-21T06:26:29.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:29 smithi175 ceph-mon[34510]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T06:26:29.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:29 smithi175 ceph-mon[34510]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T06:26:29.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:29 smithi175 ceph-mon[34510]: Cluster is now healthy 2024-09-21T06:26:29.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:29 smithi175 ceph-mon[34510]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 4 up:standby-replay 4 up:standby 2024-09-21T06:26:29.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:29 smithi175 ceph-mon[34510]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-21T06:26:29.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:29 smithi175 ceph-mon[34510]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-09-21T06:26:29.672 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:29 smithi063 ceph-mon[31150]: pgmap v268: 97 pgs: 97 active+clean; 580 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-09-21T06:26:29.673 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:29 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2196220496' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T06:26:29.673 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:29 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] up:active 2024-09-21T06:26:29.673 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:29 smithi063 ceph-mon[31150]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T06:26:29.673 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:29 smithi063 ceph-mon[31150]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T06:26:29.673 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:29 smithi063 ceph-mon[31150]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-09-21T06:26:29.673 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:29 smithi063 ceph-mon[31150]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-09-21T06:26:29.673 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:29 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] up:active 2024-09-21T06:26:29.673 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:29 smithi063 ceph-mon[31150]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T06:26:29.673 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:29 smithi063 ceph-mon[31150]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T06:26:29.673 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:29 smithi063 ceph-mon[31150]: Cluster is now healthy 2024-09-21T06:26:29.673 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:29 smithi063 ceph-mon[31150]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 4 up:standby-replay 4 up:standby 2024-09-21T06:26:29.673 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:29 smithi063 ceph-mon[31150]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-21T06:26:29.674 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:29 smithi063 ceph-mon[31150]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-09-21T06:26:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:29 smithi071 ceph-mon[34844]: pgmap v268: 97 pgs: 97 active+clean; 580 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-09-21T06:26:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:29 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2196220496' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T06:26:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:29 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] up:active 2024-09-21T06:26:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:29 smithi071 ceph-mon[34844]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T06:26:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:29 smithi071 ceph-mon[34844]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T06:26:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:29 smithi071 ceph-mon[34844]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-09-21T06:26:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:29 smithi071 ceph-mon[34844]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-09-21T06:26:29.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:29 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] up:active 2024-09-21T06:26:29.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:29 smithi071 ceph-mon[34844]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T06:26:29.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:29 smithi071 ceph-mon[34844]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T06:26:29.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:29 smithi071 ceph-mon[34844]: Cluster is now healthy 2024-09-21T06:26:29.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:29 smithi071 ceph-mon[34844]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 4 up:standby-replay 4 up:standby 2024-09-21T06:26:29.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:29 smithi071 ceph-mon[34844]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-21T06:26:29.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:29 smithi071 ceph-mon[34844]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-09-21T06:26:29.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.767+0000 7f5bbb78f640 1 -- 172.21.15.63:0/3910726428 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bb41084b0 msgr2=0x7f5bb410ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:29.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.767+0000 7f5bbb78f640 1 --2- 172.21.15.63:0/3910726428 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bb41084b0 0x7f5bb410ece0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00adb0 tx=0x7f5bac02b7a0 comp rx=0 tx=0).stop 2024-09-21T06:26:29.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.767+0000 7f5bbb78f640 1 -- 172.21.15.63:0/3910726428 shutdown_connections 2024-09-21T06:26:29.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.767+0000 7f5bbb78f640 1 --2- 172.21.15.63:0/3910726428 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bb41084b0 0x7f5bb410ece0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:29.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.767+0000 7f5bbb78f640 1 --2- 172.21.15.63:0/3910726428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bb4107b60 0x7f5bb4107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:29.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.767+0000 7f5bbb78f640 1 --2- 172.21.15.63:0/3910726428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bb4102270 0x7f5bb4102680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:29.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.767+0000 7f5bbb78f640 1 -- 172.21.15.63:0/3910726428 >> 172.21.15.63:0/3910726428 conn(0x7f5bb4077cc0 msgr2=0x7f5bb4078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:29.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.768+0000 7f5bbb78f640 1 -- 172.21.15.63:0/3910726428 shutdown_connections 2024-09-21T06:26:29.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.768+0000 7f5bbb78f640 1 -- 172.21.15.63:0/3910726428 wait complete. 2024-09-21T06:26:29.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.768+0000 7f5bbb78f640 1 Processor -- start 2024-09-21T06:26:29.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.768+0000 7f5bbb78f640 1 -- start start 2024-09-21T06:26:29.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.769+0000 7f5bbb78f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bb4102270 0x7f5bb419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:29.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.769+0000 7f5bbb78f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bb4107b60 0x7f5bb419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:29.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.769+0000 7f5bbb78f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bb41084b0 0x7f5bb419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:29.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.769+0000 7f5bbb78f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb41118f0 con 0x7f5bb4102270 2024-09-21T06:26:29.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.769+0000 7f5bbb78f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb4111770 con 0x7f5bb41084b0 2024-09-21T06:26:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.769+0000 7f5bbb78f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb4111a70 con 0x7f5bb4107b60 2024-09-21T06:26:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.769+0000 7f5bb952b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bb4102270 0x7f5bb419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.769+0000 7f5bb952b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bb4102270 0x7f5bb419a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54794/0 (socket says 172.21.15.63:54794) 2024-09-21T06:26:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.769+0000 7f5bb952b640 1 -- 172.21.15.63:0/3437539011 learned_addr learned my addr 172.21.15.63:0/3437539011 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.769+0000 7f5bb9d2c640 1 --2- 172.21.15.63:0/3437539011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bb41084b0 0x7f5bb419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.769+0000 7f5bb8d2a640 1 --2- 172.21.15.63:0/3437539011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bb4107b60 0x7f5bb419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.769+0000 7f5bb952b640 1 -- 172.21.15.63:0/3437539011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bb4107b60 msgr2=0x7f5bb419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.769+0000 7f5bb952b640 1 --2- 172.21.15.63:0/3437539011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bb4107b60 0x7f5bb419aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.769+0000 7f5bb952b640 1 -- 172.21.15.63:0/3437539011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bb41084b0 msgr2=0x7f5bb419fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.769+0000 7f5bb952b640 1 --2- 172.21.15.63:0/3437539011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bb41084b0 0x7f5bb419fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.769+0000 7f5bb952b640 1 -- 172.21.15.63:0/3437539011 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb41a0450 con 0x7f5bb4102270 2024-09-21T06:26:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.769+0000 7f5bb952b640 1 --2- 172.21.15.63:0/3437539011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bb4102270 0x7f5bb419a4e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000e9f0 tx=0x7f5bb000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.770+0000 7f5baa7fc640 1 -- 172.21.15.63:0/3437539011 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb000cd80 con 0x7f5bb4102270 2024-09-21T06:26:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.770+0000 7f5baa7fc640 1 -- 172.21.15.63:0/3437539011 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bb00108e0 con 0x7f5bb4102270 2024-09-21T06:26:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.770+0000 7f5bbb78f640 1 -- 172.21.15.63:0/3437539011 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb41a0740 con 0x7f5bb4102270 2024-09-21T06:26:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.770+0000 7f5baa7fc640 1 -- 172.21.15.63:0/3437539011 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0018980 con 0x7f5bb4102270 2024-09-21T06:26:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.770+0000 7f5bbb78f640 1 -- 172.21.15.63:0/3437539011 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb41a6ea0 con 0x7f5bb4102270 2024-09-21T06:26:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.771+0000 7f5bbb78f640 1 -- 172.21.15.63:0/3437539011 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb4102680 con 0x7f5bb4102270 2024-09-21T06:26:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.772+0000 7f5baa7fc640 1 -- 172.21.15.63:0/3437539011 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f5bb0010430 con 0x7f5bb4102270 2024-09-21T06:26:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.773+0000 7f5baa7fc640 1 --2- 172.21.15.63:0/3437539011 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f5ba00b6560 0x7f5ba00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.773+0000 7f5bb8d2a640 1 --2- 172.21.15.63:0/3437539011 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f5ba00b6560 0x7f5ba00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.773+0000 7f5baa7fc640 1 -- 172.21.15.63:0/3437539011 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f5bb00e77e0 con 0x7f5bb4102270 2024-09-21T06:26:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.774+0000 7f5bb8d2a640 1 --2- 172.21.15.63:0/3437539011 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f5ba00b6560 0x7f5ba00b8a70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4106d40 tx=0x7f5ba4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:29.777+0000 7f5baa7fc640 1 -- 172.21.15.63:0/3437539011 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5bb00ae090 con 0x7f5bb4102270 2024-09-21T06:26:30.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:30.004+0000 7f5bbb78f640 1 -- 172.21.15.63:0/3437539011 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f5bb419b610 con 0x7f5bb4102270 2024-09-21T06:26:30.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:30.758+0000 7f5baa7fc640 1 -- 172.21.15.63:0/3437539011 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v28) ==== 115+0+0 (secure 0 0 0) 0x7f5bb00b2470 con 0x7f5bb4102270 2024-09-21T06:26:30.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:30.761+0000 7f5bbb78f640 1 -- 172.21.15.63:0/3437539011 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f5ba00b6560 msgr2=0x7f5ba00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:30.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:30.761+0000 7f5bbb78f640 1 --2- 172.21.15.63:0/3437539011 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f5ba00b6560 0x7f5ba00b8a70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4106d40 tx=0x7f5ba4005f90 comp rx=0 tx=0).stop 2024-09-21T06:26:30.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:30.761+0000 7f5bbb78f640 1 -- 172.21.15.63:0/3437539011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bb4102270 msgr2=0x7f5bb419a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:30.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:30.761+0000 7f5bbb78f640 1 --2- 172.21.15.63:0/3437539011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bb4102270 0x7f5bb419a4e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000e9f0 tx=0x7f5bb000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:30.761+0000 7f5bbb78f640 1 -- 172.21.15.63:0/3437539011 shutdown_connections 2024-09-21T06:26:30.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:30.761+0000 7f5bbb78f640 1 --2- 172.21.15.63:0/3437539011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bb41084b0 0x7f5bb419fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:30.761+0000 7f5bbb78f640 1 --2- 172.21.15.63:0/3437539011 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f5ba00b6560 0x7f5ba00b8a70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:30.761+0000 7f5bbb78f640 1 --2- 172.21.15.63:0/3437539011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bb4107b60 0x7f5bb419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:30.761+0000 7f5bbb78f640 1 --2- 172.21.15.63:0/3437539011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bb4102270 0x7f5bb419a4e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:30.761+0000 7f5bbb78f640 1 -- 172.21.15.63:0/3437539011 >> 172.21.15.63:0/3437539011 conn(0x7f5bb4077cc0 msgr2=0x7f5bb4105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:30.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:30.761+0000 7f5bbb78f640 1 -- 172.21.15.63:0/3437539011 shutdown_connections 2024-09-21T06:26:30.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:30.761+0000 7f5bbb78f640 1 -- 172.21.15.63:0/3437539011 wait complete. 2024-09-21T06:26:31.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:30 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] up:active 2024-09-21T06:26:31.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:30 smithi071 ceph-mon[34844]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-21T06:26:31.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:30 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:26:31.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:30 smithi071 ceph-mon[34844]: pgmap v269: 97 pgs: 97 active+clean; 582 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-09-21T06:26:31.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:30 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3437539011' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T06:26:31.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:30 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] up:active 2024-09-21T06:26:31.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:30 smithi063 ceph-mon[31150]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-21T06:26:31.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:30 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:26:31.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:30 smithi063 ceph-mon[31150]: pgmap v269: 97 pgs: 97 active+clean; 582 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-09-21T06:26:31.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:30 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3437539011' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T06:26:31.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:30 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] up:active 2024-09-21T06:26:31.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:30 smithi175 ceph-mon[34510]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-21T06:26:31.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:30 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:26:31.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:30 smithi175 ceph-mon[34510]: pgmap v269: 97 pgs: 97 active+clean; 582 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-09-21T06:26:31.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:30 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3437539011' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T06:26:31.464 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-21T06:26:31.464 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T06:26:31.729 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:32.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:31 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3437539011' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T06:26:32.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:31 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:26:32.057 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:31 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3437539011' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T06:26:32.057 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:31 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:26:32.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:31 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3437539011' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T06:26:32.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:31 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:26:32.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.286+0000 7fe5f9f5b640 1 -- 172.21.15.63:0/2502024064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5f410de60 msgr2=0x7fe5f4110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:32.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.286+0000 7fe5f9f5b640 1 --2- 172.21.15.63:0/2502024064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5f410de60 0x7fe5f4110330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009ca0 tx=0x7fe5ec02a8e0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.286+0000 7fe5f9f5b640 1 -- 172.21.15.63:0/2502024064 shutdown_connections 2024-09-21T06:26:32.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.286+0000 7fe5f9f5b640 1 --2- 172.21.15.63:0/2502024064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5f410de60 0x7fe5f4110330 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.286+0000 7fe5f9f5b640 1 --2- 172.21.15.63:0/2502024064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5f4105380 0x7fe5f410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.286+0000 7fe5f9f5b640 1 --2- 172.21.15.63:0/2502024064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5f4104a30 0x7fe5f4104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.286+0000 7fe5f9f5b640 1 -- 172.21.15.63:0/2502024064 >> 172.21.15.63:0/2502024064 conn(0x7fe5f4079760 msgr2=0x7fe5f4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:32.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.286+0000 7fe5f9f5b640 1 -- 172.21.15.63:0/2502024064 shutdown_connections 2024-09-21T06:26:32.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.286+0000 7fe5f9f5b640 1 -- 172.21.15.63:0/2502024064 wait complete. 2024-09-21T06:26:32.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.286+0000 7fe5f9f5b640 1 Processor -- start 2024-09-21T06:26:32.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.287+0000 7fe5f9f5b640 1 -- start start 2024-09-21T06:26:32.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.287+0000 7fe5f9f5b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5f4104a30 0x7fe5f419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.287+0000 7fe5f9f5b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5f4105380 0x7fe5f419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.287+0000 7fe5f9f5b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5f410de60 0x7fe5f419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.287+0000 7fe5f9f5b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f4113b00 con 0x7fe5f4104a30 2024-09-21T06:26:32.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.287+0000 7fe5f9f5b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f4113980 con 0x7fe5f410de60 2024-09-21T06:26:32.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.287+0000 7fe5f9f5b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f4113c80 con 0x7fe5f4105380 2024-09-21T06:26:32.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.287+0000 7fe5f37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5f4104a30 0x7fe5f419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.287+0000 7fe5f37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5f4104a30 0x7fe5f419a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54804/0 (socket says 172.21.15.63:54804) 2024-09-21T06:26:32.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.287+0000 7fe5f37fe640 1 -- 172.21.15.63:0/2559079482 learned_addr learned my addr 172.21.15.63:0/2559079482 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:32.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.287+0000 7fe5f3fff640 1 --2- 172.21.15.63:0/2559079482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5f410de60 0x7fe5f419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.287+0000 7fe5f2ffd640 1 --2- 172.21.15.63:0/2559079482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5f4105380 0x7fe5f419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.287+0000 7fe5f37fe640 1 -- 172.21.15.63:0/2559079482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5f4105380 msgr2=0x7fe5f419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:32.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.288+0000 7fe5f37fe640 1 --2- 172.21.15.63:0/2559079482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5f4105380 0x7fe5f419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.288+0000 7fe5f37fe640 1 -- 172.21.15.63:0/2559079482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5f410de60 msgr2=0x7fe5f419fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:32.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.288+0000 7fe5f37fe640 1 --2- 172.21.15.63:0/2559079482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5f410de60 0x7fe5f419fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.288+0000 7fe5f37fe640 1 -- 172.21.15.63:0/2559079482 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f41a0500 con 0x7fe5f4104a30 2024-09-21T06:26:32.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.288+0000 7fe5f2ffd640 1 --2- 172.21.15.63:0/2559079482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5f4105380 0x7fe5f419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:32.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.288+0000 7fe5f37fe640 1 --2- 172.21.15.63:0/2559079482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5f4104a30 0x7fe5f419a590 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400d770 tx=0x7fe5e400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:32.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.288+0000 7fe5f0ff9640 1 -- 172.21.15.63:0/2559079482 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4017070 con 0x7fe5f4104a30 2024-09-21T06:26:32.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.288+0000 7fe5f9f5b640 1 -- 172.21.15.63:0/2559079482 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f41a07f0 con 0x7fe5f4104a30 2024-09-21T06:26:32.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.288+0000 7fe5f0ff9640 1 -- 172.21.15.63:0/2559079482 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5e4009c30 con 0x7fe5f4104a30 2024-09-21T06:26:32.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.288+0000 7fe5f0ff9640 1 -- 172.21.15.63:0/2559079482 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4003c90 con 0x7fe5f4104a30 2024-09-21T06:26:32.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.288+0000 7fe5f9f5b640 1 -- 172.21.15.63:0/2559079482 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f41a6f50 con 0x7fe5f4104a30 2024-09-21T06:26:32.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.289+0000 7fe5f9f5b640 1 -- 172.21.15.63:0/2559079482 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f406c1f0 con 0x7fe5f4104a30 2024-09-21T06:26:32.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.291+0000 7fe5f0ff9640 1 -- 172.21.15.63:0/2559079482 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fe5e4003e30 con 0x7fe5f4104a30 2024-09-21T06:26:32.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.291+0000 7fe5f0ff9640 1 --2- 172.21.15.63:0/2559079482 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe5dc0b6560 0x7fe5dc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.292+0000 7fe5f2ffd640 1 --2- 172.21.15.63:0/2559079482 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe5dc0b6560 0x7fe5dc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.292+0000 7fe5f0ff9640 1 -- 172.21.15.63:0/2559079482 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fe5e40e70e0 con 0x7fe5f4104a30 2024-09-21T06:26:32.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.292+0000 7fe5f2ffd640 1 --2- 172.21.15.63:0/2559079482 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe5dc0b6560 0x7fe5dc0b8a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe5f410fc30 tx=0x7fe5e8008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.295+0000 7fe5f0ff9640 1 -- 172.21.15.63:0/2559079482 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe5e4009de0 con 0x7fe5f4104a30 2024-09-21T06:26:32.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.509+0000 7fe5f9f5b640 1 -- 172.21.15.63:0/2559079482 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fe5f41070a0 con 0x7fe5dc0b6560 2024-09-21T06:26:32.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.538+0000 7fe5f0ff9640 1 -- 172.21.15.63:0/2559079482 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe5f41070a0 con 0x7fe5dc0b6560 2024-09-21T06:26:32.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.540+0000 7fe5f9f5b640 1 -- 172.21.15.63:0/2559079482 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe5dc0b6560 msgr2=0x7fe5dc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:32.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.540+0000 7fe5f9f5b640 1 --2- 172.21.15.63:0/2559079482 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe5dc0b6560 0x7fe5dc0b8a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe5f410fc30 tx=0x7fe5e8008040 comp rx=0 tx=0).stop 2024-09-21T06:26:32.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.540+0000 7fe5f9f5b640 1 -- 172.21.15.63:0/2559079482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5f4104a30 msgr2=0x7fe5f419a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:32.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.540+0000 7fe5f9f5b640 1 --2- 172.21.15.63:0/2559079482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5f4104a30 0x7fe5f419a590 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400d770 tx=0x7fe5e400dc30 comp rx=0 tx=0).stop 2024-09-21T06:26:32.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.540+0000 7fe5f9f5b640 1 -- 172.21.15.63:0/2559079482 shutdown_connections 2024-09-21T06:26:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.540+0000 7fe5f9f5b640 1 --2- 172.21.15.63:0/2559079482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5f410de60 0x7fe5f419fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.540+0000 7fe5f9f5b640 1 --2- 172.21.15.63:0/2559079482 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe5dc0b6560 0x7fe5dc0b8a70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.540+0000 7fe5f9f5b640 1 --2- 172.21.15.63:0/2559079482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5f4105380 0x7fe5f419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.540+0000 7fe5f9f5b640 1 --2- 172.21.15.63:0/2559079482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5f4104a30 0x7fe5f419a590 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.540+0000 7fe5f9f5b640 1 -- 172.21.15.63:0/2559079482 >> 172.21.15.63:0/2559079482 conn(0x7fe5f4079760 msgr2=0x7fe5f4106990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.540+0000 7fe5f9f5b640 1 -- 172.21.15.63:0/2559079482 shutdown_connections 2024-09-21T06:26:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:32.540+0000 7fe5f9f5b640 1 -- 172.21.15.63:0/2559079482 wait complete. 2024-09-21T06:26:32.768 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:26:32 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: 2024-09-21T06:26:32.515+0000 7f4ca62ff640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:26:32.768 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:26:32 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: 2024-09-21T06:26:32.515+0000 7f4ca62ff640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:26:32.768 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:26:32 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: 2024-09-21T06:26:32.515+0000 7f4ca62ff640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:26:32.768 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:26:32 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: 2024-09-21T06:26:32.515+0000 7f4ca62ff640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:26:32.768 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:26:32 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: 2024-09-21T06:26:32.515+0000 7f4ca62ff640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:26:33.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:32 smithi071 ceph-mon[34844]: pgmap v270: 97 pgs: 97 active+clean; 584 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 4.7 KiB/s wr, 16 op/s 2024-09-21T06:26:33.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:32 smithi071 ceph-mon[34844]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:33.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:32 smithi063 ceph-mon[31150]: pgmap v270: 97 pgs: 97 active+clean; 584 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 4.7 KiB/s wr, 16 op/s 2024-09-21T06:26:33.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:32 smithi063 ceph-mon[31150]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:33.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:32 smithi175 ceph-mon[34510]: pgmap v270: 97 pgs: 97 active+clean; 584 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 4.7 KiB/s wr, 16 op/s 2024-09-21T06:26:33.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:32 smithi175 ceph-mon[34510]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:33.207 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T06:26:33.463 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:33.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.946+0000 7f4537509640 1 -- 172.21.15.63:0/2614561225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4530077380 msgr2=0x7f45300757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:34.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.946+0000 7f4537509640 1 --2- 172.21.15.63:0/2614561225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4530077380 0x7f45300757b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f452c009900 tx=0x7f452c02a410 comp rx=0 tx=0).stop 2024-09-21T06:26:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.946+0000 7f4537509640 1 -- 172.21.15.63:0/2614561225 shutdown_connections 2024-09-21T06:26:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.946+0000 7f4537509640 1 --2- 172.21.15.63:0/2614561225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4530114480 0x7f4530116950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.946+0000 7f4537509640 1 --2- 172.21.15.63:0/2614561225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4530075dd0 0x7f45300761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.946+0000 7f4537509640 1 --2- 172.21.15.63:0/2614561225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4530077380 0x7f45300757b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.946+0000 7f4537509640 1 -- 172.21.15.63:0/2614561225 >> 172.21.15.63:0/2614561225 conn(0x7f45300ff600 msgr2=0x7f4530101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.946+0000 7f4537509640 1 -- 172.21.15.63:0/2614561225 shutdown_connections 2024-09-21T06:26:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.946+0000 7f4537509640 1 -- 172.21.15.63:0/2614561225 wait complete. 2024-09-21T06:26:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.947+0000 7f4537509640 1 Processor -- start 2024-09-21T06:26:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.947+0000 7f4537509640 1 -- start start 2024-09-21T06:26:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.947+0000 7f4537509640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4530075dd0 0x7f45301a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.947+0000 7f4537509640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4530077380 0x7f45301a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.947+0000 7f4537509640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4530114480 0x7f45301a6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.947+0000 7f4537509640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f453011a0b0 con 0x7f4530114480 2024-09-21T06:26:34.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.947+0000 7f4537509640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4530119f30 con 0x7f4530075dd0 2024-09-21T06:26:34.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.947+0000 7f4537509640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f453011a230 con 0x7f4530077380 2024-09-21T06:26:34.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.947+0000 7f4535aa6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4530114480 0x7f45301a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.947+0000 7f45352a5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4530075dd0 0x7f45301a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.947+0000 7f4535aa6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4530114480 0x7f45301a6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54848/0 (socket says 172.21.15.63:54848) 2024-09-21T06:26:34.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.947+0000 7f4535aa6640 1 -- 172.21.15.63:0/555580954 learned_addr learned my addr 172.21.15.63:0/555580954 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:34.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.947+0000 7f4534aa4640 1 --2- 172.21.15.63:0/555580954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4530077380 0x7f45301a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.948+0000 7f4535aa6640 1 -- 172.21.15.63:0/555580954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4530077380 msgr2=0x7f45301a10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:34.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.948+0000 7f4535aa6640 1 --2- 172.21.15.63:0/555580954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4530077380 0x7f45301a10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.948+0000 7f4535aa6640 1 -- 172.21.15.63:0/555580954 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4530075dd0 msgr2=0x7f45301a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:34.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.948+0000 7f4535aa6640 1 --2- 172.21.15.63:0/555580954 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4530075dd0 0x7f45301a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.948+0000 7f4535aa6640 1 -- 172.21.15.63:0/555580954 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45301a69b0 con 0x7f4530114480 2024-09-21T06:26:34.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.948+0000 7f4534aa4640 1 --2- 172.21.15.63:0/555580954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4530077380 0x7f45301a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:34.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.948+0000 7f4535aa6640 1 --2- 172.21.15.63:0/555580954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4530114480 0x7f45301a6340 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f452800cce0 tx=0x7f452800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:34.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.948+0000 7f45267fc640 1 -- 172.21.15.63:0/555580954 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452800f450 con 0x7f4530114480 2024-09-21T06:26:34.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.948+0000 7f4537509640 1 -- 172.21.15.63:0/555580954 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45301a6ca0 con 0x7f4530114480 2024-09-21T06:26:34.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.948+0000 7f45267fc640 1 -- 172.21.15.63:0/555580954 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f452800faa0 con 0x7f4530114480 2024-09-21T06:26:34.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.948+0000 7f45267fc640 1 -- 172.21.15.63:0/555580954 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528018b70 con 0x7f4530114480 2024-09-21T06:26:34.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.948+0000 7f4537509640 1 -- 172.21.15.63:0/555580954 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45301ad4c0 con 0x7f4530114480 2024-09-21T06:26:34.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.949+0000 7f4537509640 1 -- 172.21.15.63:0/555580954 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45300761e0 con 0x7f4530114480 2024-09-21T06:26:34.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.951+0000 7f45267fc640 1 -- 172.21.15.63:0/555580954 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f4528018d10 con 0x7f4530114480 2024-09-21T06:26:34.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.951+0000 7f45267fc640 1 --2- 172.21.15.63:0/555580954 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f451c0b6590 0x7f451c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.951+0000 7f45352a5640 1 --2- 172.21.15.63:0/555580954 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f451c0b6590 0x7f451c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.952+0000 7f45267fc640 1 -- 172.21.15.63:0/555580954 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f45280e76f0 con 0x7f4530114480 2024-09-21T06:26:34.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.952+0000 7f45352a5640 1 --2- 172.21.15.63:0/555580954 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f451c0b6590 0x7f451c0b8aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f452c031440 tx=0x7f452c009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:34.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:33.956+0000 7f45267fc640 1 -- 172.21.15.63:0/555580954 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4528014030 con 0x7f4530114480 2024-09-21T06:26:34.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:34.170+0000 7f4537509640 1 -- 172.21.15.63:0/555580954 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f4530113210 con 0x7f451c0b6590 2024-09-21T06:26:34.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:34.198+0000 7f45267fc640 1 -- 172.21.15.63:0/555580954 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4530113210 con 0x7f451c0b6590 2024-09-21T06:26:34.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:34.200+0000 7f4537509640 1 -- 172.21.15.63:0/555580954 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f451c0b6590 msgr2=0x7f451c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:34.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:34.200+0000 7f4537509640 1 --2- 172.21.15.63:0/555580954 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f451c0b6590 0x7f451c0b8aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f452c031440 tx=0x7f452c009560 comp rx=0 tx=0).stop 2024-09-21T06:26:34.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:34.200+0000 7f4537509640 1 -- 172.21.15.63:0/555580954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4530114480 msgr2=0x7f45301a6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:34.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:34.200+0000 7f4537509640 1 --2- 172.21.15.63:0/555580954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4530114480 0x7f45301a6340 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f452800cce0 tx=0x7f452800a620 comp rx=0 tx=0).stop 2024-09-21T06:26:34.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:34.200+0000 7f4537509640 1 -- 172.21.15.63:0/555580954 shutdown_connections 2024-09-21T06:26:34.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:34.200+0000 7f4537509640 1 --2- 172.21.15.63:0/555580954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4530114480 0x7f45301a6340 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:34.200+0000 7f4537509640 1 --2- 172.21.15.63:0/555580954 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f451c0b6590 0x7f451c0b8aa0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:34.200+0000 7f4537509640 1 --2- 172.21.15.63:0/555580954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4530077380 0x7f45301a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:34.200+0000 7f4537509640 1 --2- 172.21.15.63:0/555580954 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4530075dd0 0x7f45301a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:34.200+0000 7f4537509640 1 -- 172.21.15.63:0/555580954 >> 172.21.15.63:0/555580954 conn(0x7f45300ff600 msgr2=0x7f4530110380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:34.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:34.200+0000 7f4537509640 1 -- 172.21.15.63:0/555580954 shutdown_connections 2024-09-21T06:26:34.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:34.200+0000 7f4537509640 1 -- 172.21.15.63:0/555580954 wait complete. 2024-09-21T06:26:34.940 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T06:26:35.195 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:35.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:34 smithi071 ceph-mon[34844]: pgmap v271: 97 pgs: 97 active+clean; 584 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 4.5 KiB/s wr, 20 op/s 2024-09-21T06:26:35.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:34 smithi071 ceph-mon[34844]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:35.318 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:34 smithi063 ceph-mon[31150]: pgmap v271: 97 pgs: 97 active+clean; 584 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 4.5 KiB/s wr, 20 op/s 2024-09-21T06:26:35.318 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:34 smithi063 ceph-mon[31150]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:35.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:34 smithi175 ceph-mon[34510]: pgmap v271: 97 pgs: 97 active+clean; 584 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 4.5 KiB/s wr, 20 op/s 2024-09-21T06:26:35.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:34 smithi175 ceph-mon[34510]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:35.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.747+0000 7effc57ba640 1 -- 172.21.15.63:0/906997103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effc0102a70 msgr2=0x7effc0102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:35.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.747+0000 7effc57ba640 1 --2- 172.21.15.63:0/906997103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effc0102a70 0x7effc0102e80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7effb8009900 tx=0x7effb802a410 comp rx=0 tx=0).stop 2024-09-21T06:26:35.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.747+0000 7effc57ba640 1 -- 172.21.15.63:0/906997103 shutdown_connections 2024-09-21T06:26:35.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.747+0000 7effc57ba640 1 --2- 172.21.15.63:0/906997103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effc0108d00 0x7effc010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:35.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.747+0000 7effc57ba640 1 --2- 172.21.15.63:0/906997103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effc01083b0 0x7effc01087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:35.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.747+0000 7effc57ba640 1 --2- 172.21.15.63:0/906997103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effc0102a70 0x7effc0102e80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:35.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.747+0000 7effc57ba640 1 -- 172.21.15.63:0/906997103 >> 172.21.15.63:0/906997103 conn(0x7effc0079730 msgr2=0x7effc0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:35.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.747+0000 7effc57ba640 1 -- 172.21.15.63:0/906997103 shutdown_connections 2024-09-21T06:26:35.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.747+0000 7effc57ba640 1 -- 172.21.15.63:0/906997103 wait complete. 2024-09-21T06:26:35.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.747+0000 7effc57ba640 1 Processor -- start 2024-09-21T06:26:35.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.748+0000 7effc57ba640 1 -- start start 2024-09-21T06:26:35.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.748+0000 7effc57ba640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effc0102a70 0x7effc019b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:35.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.748+0000 7effc57ba640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effc01083b0 0x7effc019b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:35.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.748+0000 7effc57ba640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effc0108d00 0x7effc019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:35.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.748+0000 7effc57ba640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7effc0112970 con 0x7effc0108d00 2024-09-21T06:26:35.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.748+0000 7effc57ba640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7effc01127f0 con 0x7effc01083b0 2024-09-21T06:26:35.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.748+0000 7effc57ba640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7effc0112af0 con 0x7effc0102a70 2024-09-21T06:26:35.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.748+0000 7effbf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effc0108d00 0x7effc019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:35.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.748+0000 7effbf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effc0108d00 0x7effc019bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54870/0 (socket says 172.21.15.63:54870) 2024-09-21T06:26:35.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.748+0000 7effbe7fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effc01083b0 0x7effc019b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:35.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.748+0000 7effbf7fe640 1 -- 172.21.15.63:0/3669286780 learned_addr learned my addr 172.21.15.63:0/3669286780 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:35.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.748+0000 7effbeffd640 1 --2- 172.21.15.63:0/3669286780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effc0102a70 0x7effc019b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:35.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.749+0000 7effbf7fe640 1 -- 172.21.15.63:0/3669286780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effc0102a70 msgr2=0x7effc019b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:35.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.749+0000 7effbf7fe640 1 --2- 172.21.15.63:0/3669286780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effc0102a70 0x7effc019b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:35.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.749+0000 7effbf7fe640 1 -- 172.21.15.63:0/3669286780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effc01083b0 msgr2=0x7effc019b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:35.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.749+0000 7effbf7fe640 1 --2- 172.21.15.63:0/3669286780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effc01083b0 0x7effc019b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:35.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.749+0000 7effbf7fe640 1 -- 172.21.15.63:0/3669286780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc01a6570 con 0x7effc0108d00 2024-09-21T06:26:35.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.749+0000 7effbeffd640 1 --2- 172.21.15.63:0/3669286780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effc0102a70 0x7effc019b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:35.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.749+0000 7effbf7fe640 1 --2- 172.21.15.63:0/3669286780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effc0108d00 0x7effc019bd60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7effb000eaa0 tx=0x7effb000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:35.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.749+0000 7effb7fff640 1 -- 172.21.15.63:0/3669286780 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb000cdb0 con 0x7effc0108d00 2024-09-21T06:26:35.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.749+0000 7effc57ba640 1 -- 172.21.15.63:0/3669286780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effc01a6860 con 0x7effc0108d00 2024-09-21T06:26:35.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.749+0000 7effb7fff640 1 -- 172.21.15.63:0/3669286780 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effb0005020 con 0x7effc0108d00 2024-09-21T06:26:35.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.749+0000 7effb7fff640 1 -- 172.21.15.63:0/3669286780 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb00116d0 con 0x7effc0108d00 2024-09-21T06:26:35.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.749+0000 7effc57ba640 1 -- 172.21.15.63:0/3669286780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effc01a6da0 con 0x7effc0108d00 2024-09-21T06:26:35.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.750+0000 7effc57ba640 1 -- 172.21.15.63:0/3669286780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effc0103cf0 con 0x7effc0108d00 2024-09-21T06:26:35.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.752+0000 7effb7fff640 1 -- 172.21.15.63:0/3669286780 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7effb00051d0 con 0x7effc0108d00 2024-09-21T06:26:35.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.752+0000 7effb7fff640 1 --2- 172.21.15.63:0/3669286780 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7effac0b6620 0x7effac0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:35.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.753+0000 7effbeffd640 1 --2- 172.21.15.63:0/3669286780 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7effac0b6620 0x7effac0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:35.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.753+0000 7effb7fff640 1 -- 172.21.15.63:0/3669286780 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7effb00e7a70 con 0x7effc0108d00 2024-09-21T06:26:35.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.753+0000 7effbeffd640 1 --2- 172.21.15.63:0/3669286780 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7effac0b6620 0x7effac0b8b30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7effb8000c00 tx=0x7effb8009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:35.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.756+0000 7effb7fff640 1 -- 172.21.15.63:0/3669286780 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7effb0016030 con 0x7effc0108d00 2024-09-21T06:26:35.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.976+0000 7effc57ba640 1 -- 172.21.15.63:0/3669286780 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7effc0063800 con 0x7effac0b6620 2024-09-21T06:26:35.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.983+0000 7effb7fff640 1 -- 172.21.15.63:0/3669286780 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7effc0063800 con 0x7effac0b6620 2024-09-21T06:26:35.984 INFO:teuthology.orchestra.run.smithi063.stdout:/volumes/qa/sv_0/88340922-557d-427c-903d-1e16e331f758 2024-09-21T06:26:35.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.985+0000 7effc57ba640 1 -- 172.21.15.63:0/3669286780 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7effac0b6620 msgr2=0x7effac0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.985+0000 7effc57ba640 1 --2- 172.21.15.63:0/3669286780 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7effac0b6620 0x7effac0b8b30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7effb8000c00 tx=0x7effb8009680 comp rx=0 tx=0).stop 2024-09-21T06:26:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.985+0000 7effc57ba640 1 -- 172.21.15.63:0/3669286780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effc0108d00 msgr2=0x7effc019bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.985+0000 7effc57ba640 1 --2- 172.21.15.63:0/3669286780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effc0108d00 0x7effc019bd60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7effb000eaa0 tx=0x7effb000ef60 comp rx=0 tx=0).stop 2024-09-21T06:26:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.985+0000 7effc57ba640 1 -- 172.21.15.63:0/3669286780 shutdown_connections 2024-09-21T06:26:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.985+0000 7effc57ba640 1 --2- 172.21.15.63:0/3669286780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effc0108d00 0x7effc019bd60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.985+0000 7effc57ba640 1 --2- 172.21.15.63:0/3669286780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effc01083b0 0x7effc019b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.985+0000 7effc57ba640 1 --2- 172.21.15.63:0/3669286780 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7effac0b6620 0x7effac0b8b30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.985+0000 7effc57ba640 1 --2- 172.21.15.63:0/3669286780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effc0102a70 0x7effc019b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.985+0000 7effc57ba640 1 -- 172.21.15.63:0/3669286780 >> 172.21.15.63:0/3669286780 conn(0x7effc0079730 msgr2=0x7effc0101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.985+0000 7effc57ba640 1 -- 172.21.15.63:0/3669286780 shutdown_connections 2024-09-21T06:26:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:35.985+0000 7effc57ba640 1 -- 172.21.15.63:0/3669286780 wait complete. 2024-09-21T06:26:36.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:35 smithi071 ceph-mon[34844]: mgrmap e22: x(active, since 6m), standbys: z, y 2024-09-21T06:26:36.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:35 smithi063 ceph-mon[31150]: mgrmap e22: x(active, since 6m), standbys: z, y 2024-09-21T06:26:36.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:35 smithi175 ceph-mon[34510]: mgrmap e22: x(active, since 6m), standbys: z, y 2024-09-21T06:26:36.768 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T06:26:37.028 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:37.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:36 smithi063 ceph-mon[31150]: pgmap v272: 97 pgs: 97 active+clean; 591 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 KiB/s wr, 21 op/s 2024-09-21T06:26:37.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:36 smithi063 ceph-mon[31150]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:37.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:36 smithi071 ceph-mon[34844]: pgmap v272: 97 pgs: 97 active+clean; 591 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 KiB/s wr, 21 op/s 2024-09-21T06:26:37.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:36 smithi071 ceph-mon[34844]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:37.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:36 smithi175 ceph-mon[34510]: pgmap v272: 97 pgs: 97 active+clean; 591 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 KiB/s wr, 21 op/s 2024-09-21T06:26:37.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:36 smithi175 ceph-mon[34510]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:37.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.508+0000 7fd4263eb640 1 -- 172.21.15.63:0/3869018387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd420105220 msgr2=0x7fd420105630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:37.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.508+0000 7fd4263eb640 1 --2- 172.21.15.63:0/3869018387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd420105220 0x7fd420105630 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd414009900 tx=0x7fd41402a410 comp rx=0 tx=0).stop 2024-09-21T06:26:37.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.508+0000 7fd4263eb640 1 -- 172.21.15.63:0/3869018387 shutdown_connections 2024-09-21T06:26:37.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.508+0000 7fd4263eb640 1 --2- 172.21.15.63:0/3869018387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd420105b70 0x7fd42010f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.508+0000 7fd4263eb640 1 --2- 172.21.15.63:0/3869018387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd420105220 0x7fd420105630 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.509+0000 7fd4263eb640 1 --2- 172.21.15.63:0/3869018387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd420103210 0x7fd420103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.509+0000 7fd4263eb640 1 -- 172.21.15.63:0/3869018387 >> 172.21.15.63:0/3869018387 conn(0x7fd420079ea0 msgr2=0x7fd42007a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:37.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.509+0000 7fd4263eb640 1 -- 172.21.15.63:0/3869018387 shutdown_connections 2024-09-21T06:26:37.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.509+0000 7fd4263eb640 1 -- 172.21.15.63:0/3869018387 wait complete. 2024-09-21T06:26:37.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.509+0000 7fd4263eb640 1 Processor -- start 2024-09-21T06:26:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.509+0000 7fd4263eb640 1 -- start start 2024-09-21T06:26:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.510+0000 7fd4263eb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd420103210 0x7fd42019b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.510+0000 7fd4263eb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd420105220 0x7fd42019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.510+0000 7fd4263eb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd420105b70 0x7fd42019bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.510+0000 7fd4263eb640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd420112a40 con 0x7fd420105b70 2024-09-21T06:26:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.510+0000 7fd4263eb640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd4201128c0 con 0x7fd420105220 2024-09-21T06:26:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.510+0000 7fd4263eb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd420112bc0 con 0x7fd420103210 2024-09-21T06:26:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.510+0000 7fd424988640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd420105b70 0x7fd42019bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.510+0000 7fd424988640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd420105b70 0x7fd42019bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44832/0 (socket says 172.21.15.63:44832) 2024-09-21T06:26:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.510+0000 7fd424988640 1 -- 172.21.15.63:0/3861084558 learned_addr learned my addr 172.21.15.63:0/3861084558 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.510+0000 7fd41ffff640 1 --2- 172.21.15.63:0/3861084558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd420103210 0x7fd42019b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.510+0000 7fd41f7fe640 1 --2- 172.21.15.63:0/3861084558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd420105220 0x7fd42019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.510+0000 7fd424988640 1 -- 172.21.15.63:0/3861084558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd420103210 msgr2=0x7fd42019b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.510+0000 7fd424988640 1 --2- 172.21.15.63:0/3861084558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd420103210 0x7fd42019b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.510+0000 7fd424988640 1 -- 172.21.15.63:0/3861084558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd420105220 msgr2=0x7fd42019b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:37.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.510+0000 7fd424988640 1 --2- 172.21.15.63:0/3861084558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd420105220 0x7fd42019b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.510+0000 7fd424988640 1 -- 172.21.15.63:0/3861084558 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4201a65c0 con 0x7fd420105b70 2024-09-21T06:26:37.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.510+0000 7fd424988640 1 --2- 172.21.15.63:0/3861084558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd420105b70 0x7fd42019bdb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd41800eb10 tx=0x7fd41800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:37.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.510+0000 7fd41d7fa640 1 -- 172.21.15.63:0/3861084558 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418004b20 con 0x7fd420105b70 2024-09-21T06:26:37.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.511+0000 7fd4263eb640 1 -- 172.21.15.63:0/3861084558 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4201a68b0 con 0x7fd420105b70 2024-09-21T06:26:37.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.511+0000 7fd41d7fa640 1 -- 172.21.15.63:0/3861084558 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd418004cc0 con 0x7fd420105b70 2024-09-21T06:26:37.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.511+0000 7fd41d7fa640 1 -- 172.21.15.63:0/3861084558 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418010670 con 0x7fd420105b70 2024-09-21T06:26:37.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.511+0000 7fd4263eb640 1 -- 172.21.15.63:0/3861084558 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4201a6df0 con 0x7fd420105b70 2024-09-21T06:26:37.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.512+0000 7fd4263eb640 1 -- 172.21.15.63:0/3861084558 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd420103620 con 0x7fd420105b70 2024-09-21T06:26:37.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.513+0000 7fd41d7fa640 1 -- 172.21.15.63:0/3861084558 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fd418005020 con 0x7fd420105b70 2024-09-21T06:26:37.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.514+0000 7fd41d7fa640 1 --2- 172.21.15.63:0/3861084558 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd4080b6620 0x7fd4080b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.514+0000 7fd41ffff640 1 --2- 172.21.15.63:0/3861084558 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd4080b6620 0x7fd4080b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.514+0000 7fd41d7fa640 1 -- 172.21.15.63:0/3861084558 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fd4180e7b10 con 0x7fd420105b70 2024-09-21T06:26:37.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.514+0000 7fd41ffff640 1 --2- 172.21.15.63:0/3861084558 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd4080b6620 0x7fd4080b8b30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd410005d00 tx=0x7fd410005c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:37.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.518+0000 7fd41d7fa640 1 -- 172.21.15.63:0/3861084558 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd4180ae260 con 0x7fd420105b70 2024-09-21T06:26:37.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.735+0000 7fd4263eb640 1 -- 172.21.15.63:0/3861084558 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fd42010ac90 con 0x7fd4080b6620 2024-09-21T06:26:37.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.763+0000 7fd41d7fa640 1 -- 172.21.15.63:0/3861084558 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd42010ac90 con 0x7fd4080b6620 2024-09-21T06:26:37.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.765+0000 7fd4263eb640 1 -- 172.21.15.63:0/3861084558 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd4080b6620 msgr2=0x7fd4080b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:37.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.765+0000 7fd4263eb640 1 --2- 172.21.15.63:0/3861084558 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd4080b6620 0x7fd4080b8b30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd410005d00 tx=0x7fd410005c70 comp rx=0 tx=0).stop 2024-09-21T06:26:37.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.765+0000 7fd4263eb640 1 -- 172.21.15.63:0/3861084558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd420105b70 msgr2=0x7fd42019bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:37.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.765+0000 7fd4263eb640 1 --2- 172.21.15.63:0/3861084558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd420105b70 0x7fd42019bdb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd41800eb10 tx=0x7fd41800c2d0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.765+0000 7fd4263eb640 1 -- 172.21.15.63:0/3861084558 shutdown_connections 2024-09-21T06:26:37.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.765+0000 7fd4263eb640 1 --2- 172.21.15.63:0/3861084558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd420105b70 0x7fd42019bdb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.765+0000 7fd4263eb640 1 --2- 172.21.15.63:0/3861084558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd420105220 0x7fd42019b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.765+0000 7fd4263eb640 1 --2- 172.21.15.63:0/3861084558 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd4080b6620 0x7fd4080b8b30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.765+0000 7fd4263eb640 1 --2- 172.21.15.63:0/3861084558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd420103210 0x7fd42019b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.765+0000 7fd4263eb640 1 -- 172.21.15.63:0/3861084558 >> 172.21.15.63:0/3861084558 conn(0x7fd420079ea0 msgr2=0x7fd420106450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:37.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.765+0000 7fd4263eb640 1 -- 172.21.15.63:0/3861084558 shutdown_connections 2024-09-21T06:26:37.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:37.765+0000 7fd4263eb640 1 -- 172.21.15.63:0/3861084558 wait complete. 2024-09-21T06:26:38.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]} : dispatch 2024-09-21T06:26:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-21T06:26:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]} : dispatch 2024-09-21T06:26:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T06:26:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]} : dispatch 2024-09-21T06:26:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]} : dispatch 2024-09-21T06:26:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9, 4, 6]} : dispatch 2024-09-21T06:26:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]} : dispatch 2024-09-21T06:26:38.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-09-21T06:26:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]} : dispatch 2024-09-21T06:26:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-21T06:26:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]} : dispatch 2024-09-21T06:26:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T06:26:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]} : dispatch 2024-09-21T06:26:38.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]} : dispatch 2024-09-21T06:26:38.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9, 4, 6]} : dispatch 2024-09-21T06:26:38.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]} : dispatch 2024-09-21T06:26:38.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-09-21T06:26:38.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]} : dispatch 2024-09-21T06:26:38.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-21T06:26:38.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]} : dispatch 2024-09-21T06:26:38.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T06:26:38.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]} : dispatch 2024-09-21T06:26:38.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]} : dispatch 2024-09-21T06:26:38.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9, 4, 6]} : dispatch 2024-09-21T06:26:38.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]} : dispatch 2024-09-21T06:26:38.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-09-21T06:26:38.397 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T06:26:38.653 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:39.047 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:38 smithi063 ceph-mon[31150]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:39.047 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:38 smithi063 ceph-mon[31150]: pgmap v273: 97 pgs: 97 active+clean; 592 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.9 KiB/s wr, 22 op/s 2024-09-21T06:26:39.047 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]': finished 2024-09-21T06:26:39.047 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-21T06:26:39.047 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-21T06:26:39.047 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T06:26:39.047 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-21T06:26:39.047 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-21T06:26:39.047 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9, 4, 6]}]': finished 2024-09-21T06:26:39.047 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-09-21T06:26:39.048 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:38 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-21T06:26:39.048 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:38 smithi063 ceph-mon[31150]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T06:26:39.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.142+0000 7f4cbff1c640 1 -- 172.21.15.63:0/2580066975 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cb81083d0 msgr2=0x7f4cb81087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:39.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.142+0000 7f4cbff1c640 1 --2- 172.21.15.63:0/2580066975 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cb81083d0 0x7f4cb81087e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009900 tx=0x7f4ca802a410 comp rx=0 tx=0).stop 2024-09-21T06:26:39.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.142+0000 7f4cbff1c640 1 -- 172.21.15.63:0/2580066975 shutdown_connections 2024-09-21T06:26:39.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.142+0000 7f4cbff1c640 1 --2- 172.21.15.63:0/2580066975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cb8108d20 0x7f4cb810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:39.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.142+0000 7f4cbff1c640 1 --2- 172.21.15.63:0/2580066975 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cb81083d0 0x7f4cb81087e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:39.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.142+0000 7f4cbff1c640 1 --2- 172.21.15.63:0/2580066975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4cb8102ae0 0x7f4cb8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:39.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.142+0000 7f4cbff1c640 1 -- 172.21.15.63:0/2580066975 >> 172.21.15.63:0/2580066975 conn(0x7f4cb8079760 msgr2=0x7f4cb8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:39.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.142+0000 7f4cbff1c640 1 -- 172.21.15.63:0/2580066975 shutdown_connections 2024-09-21T06:26:39.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.142+0000 7f4cbff1c640 1 -- 172.21.15.63:0/2580066975 wait complete. 2024-09-21T06:26:39.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.142+0000 7f4cbff1c640 1 Processor -- start 2024-09-21T06:26:39.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.142+0000 7f4cbff1c640 1 -- start start 2024-09-21T06:26:39.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.143+0000 7f4cbff1c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cb8102ae0 0x7f4cb819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:39.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.143+0000 7f4cbff1c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cb81083d0 0x7f4cb819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:39.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.143+0000 7f4cbff1c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4cb8108d20 0x7f4cb819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.143+0000 7f4cbff1c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb8113aa0 con 0x7f4cb8102ae0 2024-09-21T06:26:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.143+0000 7f4cbff1c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb8113920 con 0x7f4cb8108d20 2024-09-21T06:26:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.143+0000 7f4cbff1c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb8113c20 con 0x7f4cb81083d0 2024-09-21T06:26:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.143+0000 7f4cbdcb8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cb8102ae0 0x7f4cb819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.143+0000 7f4cbdcb8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cb8102ae0 0x7f4cb819a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44848/0 (socket says 172.21.15.63:44848) 2024-09-21T06:26:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.143+0000 7f4cbdcb8640 1 -- 172.21.15.63:0/1423403216 learned_addr learned my addr 172.21.15.63:0/1423403216 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.143+0000 7f4cbd4b7640 1 --2- 172.21.15.63:0/1423403216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cb81083d0 0x7f4cb819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.143+0000 7f4cbe4b9640 1 --2- 172.21.15.63:0/1423403216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4cb8108d20 0x7f4cb819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.143+0000 7f4cbdcb8640 1 -- 172.21.15.63:0/1423403216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cb81083d0 msgr2=0x7f4cb819aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.143+0000 7f4cbdcb8640 1 --2- 172.21.15.63:0/1423403216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cb81083d0 0x7f4cb819aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.143+0000 7f4cbdcb8640 1 -- 172.21.15.63:0/1423403216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4cb8108d20 msgr2=0x7f4cb819fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.143+0000 7f4cbdcb8640 1 --2- 172.21.15.63:0/1423403216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4cb8108d20 0x7f4cb819fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.143+0000 7f4cbdcb8640 1 -- 172.21.15.63:0/1423403216 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb81a03e0 con 0x7f4cb8102ae0 2024-09-21T06:26:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.143+0000 7f4cbd4b7640 1 --2- 172.21.15.63:0/1423403216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cb81083d0 0x7f4cb819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.144+0000 7f4cbdcb8640 1 --2- 172.21.15.63:0/1423403216 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cb8102ae0 0x7f4cb819a470 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400c890 tx=0x7f4cb400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:39.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.144+0000 7f4caeffd640 1 -- 172.21.15.63:0/1423403216 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4004220 con 0x7f4cb8102ae0 2024-09-21T06:26:39.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.144+0000 7f4caeffd640 1 -- 172.21.15.63:0/1423403216 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cb40043c0 con 0x7f4cb8102ae0 2024-09-21T06:26:39.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.144+0000 7f4cbff1c640 1 -- 172.21.15.63:0/1423403216 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb81a06d0 con 0x7f4cb8102ae0 2024-09-21T06:26:39.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.144+0000 7f4caeffd640 1 -- 172.21.15.63:0/1423403216 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4004a00 con 0x7f4cb8102ae0 2024-09-21T06:26:39.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.144+0000 7f4cbff1c640 1 -- 172.21.15.63:0/1423403216 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb81a6e30 con 0x7f4cb8102ae0 2024-09-21T06:26:39.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.145+0000 7f4cbff1c640 1 -- 172.21.15.63:0/1423403216 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cb8103d10 con 0x7f4cb8102ae0 2024-09-21T06:26:39.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.146+0000 7f4caeffd640 1 -- 172.21.15.63:0/1423403216 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f4cb40079b0 con 0x7f4cb8102ae0 2024-09-21T06:26:39.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.147+0000 7f4caeffd640 1 --2- 172.21.15.63:0/1423403216 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4ca40b6670 0x7f4ca40b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:39.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.147+0000 7f4cbd4b7640 1 --2- 172.21.15.63:0/1423403216 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4ca40b6670 0x7f4ca40b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:39.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.147+0000 7f4caeffd640 1 -- 172.21.15.63:0/1423403216 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f4cb40e7780 con 0x7f4cb8102ae0 2024-09-21T06:26:39.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.148+0000 7f4cbd4b7640 1 --2- 172.21.15.63:0/1423403216 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4ca40b6670 0x7f4ca40b8b80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8000c00 tx=0x7f4ca8032da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:39.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.150+0000 7f4caeffd640 1 -- 172.21.15.63:0/1423403216 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4cb4014030 con 0x7f4cb8102ae0 2024-09-21T06:26:39.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:38 smithi071 ceph-mon[34844]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:39.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:38 smithi071 ceph-mon[34844]: pgmap v273: 97 pgs: 97 active+clean; 592 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.9 KiB/s wr, 22 op/s 2024-09-21T06:26:39.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]': finished 2024-09-21T06:26:39.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-21T06:26:39.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-21T06:26:39.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T06:26:39.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-21T06:26:39.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-21T06:26:39.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9, 4, 6]}]': finished 2024-09-21T06:26:39.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-09-21T06:26:39.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:38 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-21T06:26:39.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:38 smithi071 ceph-mon[34844]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T06:26:39.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:38 smithi175 ceph-mon[34510]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:39.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:38 smithi175 ceph-mon[34510]: pgmap v273: 97 pgs: 97 active+clean; 592 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.9 KiB/s wr, 22 op/s 2024-09-21T06:26:39.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]': finished 2024-09-21T06:26:39.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-21T06:26:39.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-21T06:26:39.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T06:26:39.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-21T06:26:39.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-21T06:26:39.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9, 4, 6]}]': finished 2024-09-21T06:26:39.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-09-21T06:26:39.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:38 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-21T06:26:39.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:38 smithi175 ceph-mon[34510]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T06:26:39.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.368+0000 7f4cbff1c640 1 -- 172.21.15.63:0/1423403216 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f4cb8063800 con 0x7f4ca40b6670 2024-09-21T06:26:39.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.374+0000 7f4caeffd640 1 -- 172.21.15.63:0/1423403216 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f4cb8063800 con 0x7f4ca40b6670 2024-09-21T06:26:39.376 INFO:teuthology.orchestra.run.smithi063.stdout:/volumes/qa/sv_1/5340b01f-481e-4db9-84fa-0125b1b9d150 2024-09-21T06:26:39.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.376+0000 7f4cbff1c640 1 -- 172.21.15.63:0/1423403216 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4ca40b6670 msgr2=0x7f4ca40b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:39.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.376+0000 7f4cbff1c640 1 --2- 172.21.15.63:0/1423403216 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4ca40b6670 0x7f4ca40b8b80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8000c00 tx=0x7f4ca8032da0 comp rx=0 tx=0).stop 2024-09-21T06:26:39.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.376+0000 7f4cbff1c640 1 -- 172.21.15.63:0/1423403216 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cb8102ae0 msgr2=0x7f4cb819a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:39.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.376+0000 7f4cbff1c640 1 --2- 172.21.15.63:0/1423403216 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cb8102ae0 0x7f4cb819a470 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400c890 tx=0x7f4cb400cd50 comp rx=0 tx=0).stop 2024-09-21T06:26:39.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.376+0000 7f4cbff1c640 1 -- 172.21.15.63:0/1423403216 shutdown_connections 2024-09-21T06:26:39.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.376+0000 7f4cbff1c640 1 --2- 172.21.15.63:0/1423403216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4cb8108d20 0x7f4cb819fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:39.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.376+0000 7f4cbff1c640 1 --2- 172.21.15.63:0/1423403216 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4ca40b6670 0x7f4ca40b8b80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:39.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.376+0000 7f4cbff1c640 1 --2- 172.21.15.63:0/1423403216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cb81083d0 0x7f4cb819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:39.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.376+0000 7f4cbff1c640 1 --2- 172.21.15.63:0/1423403216 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4cb8102ae0 0x7f4cb819a470 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:39.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.376+0000 7f4cbff1c640 1 -- 172.21.15.63:0/1423403216 >> 172.21.15.63:0/1423403216 conn(0x7f4cb8079760 msgr2=0x7f4cb8104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:39.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.376+0000 7f4cbff1c640 1 -- 172.21.15.63:0/1423403216 shutdown_connections 2024-09-21T06:26:39.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:39.376+0000 7f4cbff1c640 1 -- 172.21.15.63:0/1423403216 wait complete. 2024-09-21T06:26:40.044 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:26:40.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:39 smithi071 ceph-mon[34844]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T06:26:40.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:39 smithi071 ceph-mon[34844]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:40.302 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:40.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:39 smithi063 ceph-mon[31150]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T06:26:40.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:39 smithi063 ceph-mon[31150]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:40.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:39 smithi175 ceph-mon[34510]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T06:26:40.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:39 smithi175 ceph-mon[34510]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:40.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.841+0000 7ff77d699640 1 -- 172.21.15.63:0/1848927760 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7781052c0 msgr2=0x7ff77810d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:40.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.841+0000 7ff77d699640 1 --2- 172.21.15.63:0/1848927760 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7781052c0 0x7ff77810d900 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff760009900 tx=0x7ff76002a410 comp rx=0 tx=0).stop 2024-09-21T06:26:40.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.841+0000 7ff77d699640 1 -- 172.21.15.63:0/1848927760 shutdown_connections 2024-09-21T06:26:40.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.841+0000 7ff77d699640 1 --2- 172.21.15.63:0/1848927760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff77810de40 0x7ff778110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.841+0000 7ff77d699640 1 --2- 172.21.15.63:0/1848927760 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7781052c0 0x7ff77810d900 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.841+0000 7ff77d699640 1 --2- 172.21.15.63:0/1848927760 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff778104890 0x7ff778104ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.841+0000 7ff77d699640 1 -- 172.21.15.63:0/1848927760 >> 172.21.15.63:0/1848927760 conn(0x7ff778079730 msgr2=0x7ff778079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:40.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.841+0000 7ff77d699640 1 -- 172.21.15.63:0/1848927760 shutdown_connections 2024-09-21T06:26:40.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.841+0000 7ff77d699640 1 -- 172.21.15.63:0/1848927760 wait complete. 2024-09-21T06:26:40.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.842+0000 7ff77d699640 1 Processor -- start 2024-09-21T06:26:40.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.842+0000 7ff77d699640 1 -- start start 2024-09-21T06:26:40.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.843+0000 7ff77d699640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff778104890 0x7ff778074e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.843+0000 7ff77d699640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7781052c0 0x7ff77806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.843+0000 7ff77d699640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff77810de40 0x7ff77806e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.843+0000 7ff77d699640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff778113ad0 con 0x7ff77810de40 2024-09-21T06:26:40.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.843+0000 7ff77d699640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff778113950 con 0x7ff7781052c0 2024-09-21T06:26:40.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.843+0000 7ff77d699640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff778113c50 con 0x7ff778104890 2024-09-21T06:26:40.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.843+0000 7ff7777fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff77810de40 0x7ff77806e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.843+0000 7ff7777fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff77810de40 0x7ff77806e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44872/0 (socket says 172.21.15.63:44872) 2024-09-21T06:26:40.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.843+0000 7ff7777fe640 1 -- 172.21.15.63:0/593798859 learned_addr learned my addr 172.21.15.63:0/593798859 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:40.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.843+0000 7ff776ffd640 1 --2- 172.21.15.63:0/593798859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff778104890 0x7ff778074e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.843+0000 7ff7767fc640 1 --2- 172.21.15.63:0/593798859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7781052c0 0x7ff77806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.843+0000 7ff7777fe640 1 -- 172.21.15.63:0/593798859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff778104890 msgr2=0x7ff778074e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:40.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.843+0000 7ff7777fe640 1 --2- 172.21.15.63:0/593798859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff778104890 0x7ff778074e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.843+0000 7ff7777fe640 1 -- 172.21.15.63:0/593798859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7781052c0 msgr2=0x7ff77806e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:40.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.843+0000 7ff7777fe640 1 --2- 172.21.15.63:0/593798859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7781052c0 0x7ff77806e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.843+0000 7ff7777fe640 1 -- 172.21.15.63:0/593798859 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77806ee90 con 0x7ff77810de40 2024-09-21T06:26:40.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.843+0000 7ff7777fe640 1 --2- 172.21.15.63:0/593798859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff77810de40 0x7ff77806e670 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff76800eaa0 tx=0x7ff76800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:40.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.844+0000 7ff76ffff640 1 -- 172.21.15.63:0/593798859 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76800cdb0 con 0x7ff77810de40 2024-09-21T06:26:40.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.844+0000 7ff77d699640 1 -- 172.21.15.63:0/593798859 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff778073b10 con 0x7ff77810de40 2024-09-21T06:26:40.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.844+0000 7ff76ffff640 1 -- 172.21.15.63:0/593798859 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff768005020 con 0x7ff77810de40 2024-09-21T06:26:40.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.844+0000 7ff76ffff640 1 -- 172.21.15.63:0/593798859 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7680116d0 con 0x7ff77810de40 2024-09-21T06:26:40.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.844+0000 7ff77d699640 1 -- 172.21.15.63:0/593798859 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff778073fd0 con 0x7ff77810de40 2024-09-21T06:26:40.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.845+0000 7ff77d699640 1 -- 172.21.15.63:0/593798859 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff77806c140 con 0x7ff77810de40 2024-09-21T06:26:40.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.846+0000 7ff76ffff640 1 -- 172.21.15.63:0/593798859 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7ff7680051d0 con 0x7ff77810de40 2024-09-21T06:26:40.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.847+0000 7ff76ffff640 1 --2- 172.21.15.63:0/593798859 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7640b65f0 0x7ff7640b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.847+0000 7ff776ffd640 1 --2- 172.21.15.63:0/593798859 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7640b65f0 0x7ff7640b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.847+0000 7ff76ffff640 1 -- 172.21.15.63:0/593798859 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ff7680e7ab0 con 0x7ff77810de40 2024-09-21T06:26:40.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.848+0000 7ff776ffd640 1 --2- 172.21.15.63:0/593798859 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7640b65f0 0x7ff7640b8b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff770005fd0 tx=0x7ff77000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:40.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:40.850+0000 7ff76ffff640 1 -- 172.21.15.63:0/593798859 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff768016030 con 0x7ff77810de40 2024-09-21T06:26:41.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:41.080+0000 7ff77d699640 1 -- 172.21.15.63:0/593798859 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff778104ca0 con 0x7ff77810de40 2024-09-21T06:26:41.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:41.081+0000 7ff76ffff640 1 -- 172.21.15.63:0/593798859 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11969 (secure 0 0 0) 0x7ff778104ca0 con 0x7ff77810de40 2024-09-21T06:26:41.083 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:26:41.083 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":28,"btime":"2024-09-21T06:26:30:754530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:26:30.006003+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24698,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24698":{"gid":24698,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3472481253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3472481253},{"type":"v1","addr":"172.21.15.71:6839","nonce":3472481253}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24698,"qdb_cluster":[14835,24676,24670,24694,24698]},"id":1}]} 2024-09-21T06:26:41.083 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 28 2024-09-21T06:26:41.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:41.083+0000 7ff77d699640 1 -- 172.21.15.63:0/593798859 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7640b65f0 msgr2=0x7ff7640b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:41.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:41.083+0000 7ff77d699640 1 --2- 172.21.15.63:0/593798859 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7640b65f0 0x7ff7640b8b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff770005fd0 tx=0x7ff77000b410 comp rx=0 tx=0).stop 2024-09-21T06:26:41.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:41.083+0000 7ff77d699640 1 -- 172.21.15.63:0/593798859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff77810de40 msgr2=0x7ff77806e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:41.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:41.083+0000 7ff77d699640 1 --2- 172.21.15.63:0/593798859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff77810de40 0x7ff77806e670 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff76800eaa0 tx=0x7ff76800ef60 comp rx=0 tx=0).stop 2024-09-21T06:26:41.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:41.083+0000 7ff77d699640 1 -- 172.21.15.63:0/593798859 shutdown_connections 2024-09-21T06:26:41.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:41.083+0000 7ff77d699640 1 --2- 172.21.15.63:0/593798859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff77810de40 0x7ff77806e670 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:41.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:41.083+0000 7ff77d699640 1 --2- 172.21.15.63:0/593798859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7781052c0 0x7ff77806e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:41.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:41.083+0000 7ff77d699640 1 --2- 172.21.15.63:0/593798859 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7640b65f0 0x7ff7640b8b00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:41.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:41.083+0000 7ff77d699640 1 --2- 172.21.15.63:0/593798859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff778104890 0x7ff778074e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:41.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:41.083+0000 7ff77d699640 1 -- 172.21.15.63:0/593798859 >> 172.21.15.63:0/593798859 conn(0x7ff778079730 msgr2=0x7ff778100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:41.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:41.083+0000 7ff77d699640 1 -- 172.21.15.63:0/593798859 shutdown_connections 2024-09-21T06:26:41.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:41.083+0000 7ff77d699640 1 -- 172.21.15.63:0/593798859 wait complete. 2024-09-21T06:26:41.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:40 smithi071 ceph-mon[34844]: pgmap v276: 97 pgs: 3 peering, 94 active+clean; 628 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.4 KiB/s wr, 18 op/s 2024-09-21T06:26:41.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:40 smithi063 ceph-mon[31150]: pgmap v276: 97 pgs: 3 peering, 94 active+clean; 628 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.4 KiB/s wr, 18 op/s 2024-09-21T06:26:41.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:40 smithi175 ceph-mon[34510]: pgmap v276: 97 pgs: 3 peering, 94 active+clean; 628 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.4 KiB/s wr, 18 op/s 2024-09-21T06:26:41.746 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:26:42.011 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:42.262 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:41 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/593798859' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:42.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:41 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/593798859' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:42.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:41 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/593798859' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:42.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.475+0000 7fe54612b640 1 -- 172.21.15.63:0/1615954539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540109e40 msgr2=0x7fe540110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:42.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.475+0000 7fe54612b640 1 --2- 172.21.15.63:0/1615954539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540109e40 0x7fe540110670 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe538009ca0 tx=0x7fe53802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.475+0000 7fe54612b640 1 -- 172.21.15.63:0/1615954539 shutdown_connections 2024-09-21T06:26:42.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.475+0000 7fe54612b640 1 --2- 172.21.15.63:0/1615954539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540109e40 0x7fe540110670 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.475+0000 7fe54612b640 1 --2- 172.21.15.63:0/1615954539 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5401094f0 0x7fe540109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.475+0000 7fe54612b640 1 --2- 172.21.15.63:0/1615954539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe540103bb0 0x7fe540103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.475+0000 7fe54612b640 1 -- 172.21.15.63:0/1615954539 >> 172.21.15.63:0/1615954539 conn(0x7fe5400ff600 msgr2=0x7fe540101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:42.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.475+0000 7fe54612b640 1 -- 172.21.15.63:0/1615954539 shutdown_connections 2024-09-21T06:26:42.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.475+0000 7fe54612b640 1 -- 172.21.15.63:0/1615954539 wait complete. 2024-09-21T06:26:42.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.476+0000 7fe54612b640 1 Processor -- start 2024-09-21T06:26:42.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.476+0000 7fe54612b640 1 -- start start 2024-09-21T06:26:42.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.476+0000 7fe54612b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540103bb0 0x7fe54019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.476+0000 7fe54612b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5401094f0 0x7fe54019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.476+0000 7fe54612b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe540109e40 0x7fe54019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.477+0000 7fe54612b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe540113b00 con 0x7fe540103bb0 2024-09-21T06:26:42.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.477+0000 7fe54612b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe540113980 con 0x7fe5401094f0 2024-09-21T06:26:42.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.477+0000 7fe54612b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe540113c80 con 0x7fe540109e40 2024-09-21T06:26:42.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.477+0000 7fe53f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540103bb0 0x7fe54019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.477+0000 7fe53f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540103bb0 0x7fe54019a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44884/0 (socket says 172.21.15.63:44884) 2024-09-21T06:26:42.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.477+0000 7fe53f7fe640 1 -- 172.21.15.63:0/3826736072 learned_addr learned my addr 172.21.15.63:0/3826736072 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:42.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.477+0000 7fe53ffff640 1 --2- 172.21.15.63:0/3826736072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe540109e40 0x7fe54019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.477+0000 7fe536ffd640 1 --2- 172.21.15.63:0/3826736072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5401094f0 0x7fe54019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.477+0000 7fe53f7fe640 1 -- 172.21.15.63:0/3826736072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe540109e40 msgr2=0x7fe54019fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:42.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.477+0000 7fe53f7fe640 1 --2- 172.21.15.63:0/3826736072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe540109e40 0x7fe54019fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.477+0000 7fe53f7fe640 1 -- 172.21.15.63:0/3826736072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5401094f0 msgr2=0x7fe54019aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:42.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.477+0000 7fe53f7fe640 1 --2- 172.21.15.63:0/3826736072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5401094f0 0x7fe54019aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.477+0000 7fe53f7fe640 1 -- 172.21.15.63:0/3826736072 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5401a03e0 con 0x7fe540103bb0 2024-09-21T06:26:42.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.477+0000 7fe53f7fe640 1 --2- 172.21.15.63:0/3826736072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540103bb0 0x7fe54019a470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe53000d950 tx=0x7fe53000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:42.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.477+0000 7fe53d7fa640 1 -- 172.21.15.63:0/3826736072 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe530017070 con 0x7fe540103bb0 2024-09-21T06:26:42.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.477+0000 7fe53d7fa640 1 -- 172.21.15.63:0/3826736072 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe530009c30 con 0x7fe540103bb0 2024-09-21T06:26:42.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.477+0000 7fe54612b640 1 -- 172.21.15.63:0/3826736072 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5401a06d0 con 0x7fe540103bb0 2024-09-21T06:26:42.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.477+0000 7fe53d7fa640 1 -- 172.21.15.63:0/3826736072 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53000f620 con 0x7fe540103bb0 2024-09-21T06:26:42.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.478+0000 7fe54612b640 1 -- 172.21.15.63:0/3826736072 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5401a6e30 con 0x7fe540103bb0 2024-09-21T06:26:42.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.479+0000 7fe54612b640 1 -- 172.21.15.63:0/3826736072 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe540103fc0 con 0x7fe540103bb0 2024-09-21T06:26:42.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.480+0000 7fe53d7fa640 1 -- 172.21.15.63:0/3826736072 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fe530005030 con 0x7fe540103bb0 2024-09-21T06:26:42.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.481+0000 7fe53d7fa640 1 --2- 172.21.15.63:0/3826736072 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe52c0b65f0 0x7fe52c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.481+0000 7fe536ffd640 1 --2- 172.21.15.63:0/3826736072 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe52c0b65f0 0x7fe52c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.481+0000 7fe53d7fa640 1 -- 172.21.15.63:0/3826736072 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fe5300e7090 con 0x7fe540103bb0 2024-09-21T06:26:42.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.481+0000 7fe536ffd640 1 --2- 172.21.15.63:0/3826736072 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe52c0b65f0 0x7fe52c0b8b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe540106ea0 tx=0x7fe52800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:42.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.484+0000 7fe53d7fa640 1 -- 172.21.15.63:0/3826736072 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe530009de0 con 0x7fe540103bb0 2024-09-21T06:26:42.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.676+0000 7fe54612b640 1 -- 172.21.15.63:0/3826736072 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe54019b5a0 con 0x7fe540103bb0 2024-09-21T06:26:42.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.677+0000 7fe53d7fa640 1 -- 172.21.15.63:0/3826736072 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+23049 (secure 0 0 0) 0x7fe5300b1b60 con 0x7fe540103bb0 2024-09-21T06:26:42.679 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:26:42.679 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":77,"fsid":"140899c8-77e1-11ef-baf5-efdc52797490","created":"2024-09-21T06:17:48.089366+0000","modified":"2024-09-21T06:26:38.957699+0000","last_up_change":"2024-09-21T06:25:29.072128+0000","last_in_change":"2024-09-21T06:25:06.097647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:21:36.236868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:26:15.016085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:26:17.072883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df4162c1-dd66-4d11-99bc-0ae36ea130f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6803","nonce":2090653772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6805","nonce":2090653772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6809","nonce":2090653772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6807","nonce":2090653772}]},"public_addr":"172.21.15.63:6803/2090653772","cluster_addr":"172.21.15.63:6805/2090653772","heartbeat_back_addr":"172.21.15.63:6809/2090653772","heartbeat_front_addr":"172.21.15.63:6807/2090653772","state":["exists","up"]},{"osd":1,"uuid":"65a12def-9f66-4153-8f1a-2ebfbbfeba99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6801","nonce":1676297548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6803","nonce":1676297548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6807","nonce":1676297548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6805","nonce":1676297548}]},"public_addr":"172.21.15.71:6801/1676297548","cluster_addr":"172.21.15.71:6803/1676297548","heartbeat_back_addr":"172.21.15.71:6807/1676297548","heartbeat_front_addr":"172.21.15.71:6805/1676297548","state":["exists","up"]},{"osd":2,"uuid":"031daa9e-9d4a-4901-95e8-695db5671fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6801","nonce":2356865390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6803","nonce":2356865390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6807","nonce":2356865390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6805","nonce":2356865390}]},"public_addr":"172.21.15.175:6801/2356865390","cluster_addr":"172.21.15.175:6803/2356865390","heartbeat_back_addr":"172.21.15.175:6807/2356865390","heartbeat_front_addr":"172.21.15.175:6805/2356865390","state":["exists","up"]},{"osd":3,"uuid":"75d23a7a-c560-4b26-84a4-74d6772a37ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6811","nonce":31683339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6813","nonce":31683339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6817","nonce":31683339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6815","nonce":31683339}]},"public_addr":"172.21.15.63:6811/31683339","cluster_addr":"172.21.15.63:6813/31683339","heartbeat_back_addr":"172.21.15.63:6817/31683339","heartbeat_front_addr":"172.21.15.63:6815/31683339","state":["exists","up"]},{"osd":4,"uuid":"6aaefd09-93dd-4f21-9b3c-701a7ff97f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6809","nonce":829449898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6811","nonce":829449898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6815","nonce":829449898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6813","nonce":829449898}]},"public_addr":"172.21.15.71:6809/829449898","cluster_addr":"172.21.15.71:6811/829449898","heartbeat_back_addr":"172.21.15.71:6815/829449898","heartbeat_front_addr":"172.21.15.71:6813/829449898","state":["exists","up"]},{"osd":5,"uuid":"91f28121-c94e-4012-b74c-dd4597545e3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6809","nonce":3005600597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6811","nonce":3005600597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6815","nonce":3005600597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6813","nonce":3005600597}]},"public_addr":"172.21.15.175:6809/3005600597","cluster_addr":"172.21.15.175:6811/3005600597","heartbeat_back_addr":"172.21.15.175:6815/3005600597","heartbeat_front_addr":"172.21.15.175:6813/3005600597","state":["exists","up"]},{"osd":6,"uuid":"bda28014-4dca-40f1-bb23-3ef61605c1ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6819","nonce":4044730408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6821","nonce":4044730408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6825","nonce":4044730408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6823","nonce":4044730408}]},"public_addr":"172.21.15.63:6819/4044730408","cluster_addr":"172.21.15.63:6821/4044730408","heartbeat_back_addr":"172.21.15.63:6825/4044730408","heartbeat_front_addr":"172.21.15.63:6823/4044730408","state":["exists","up"]},{"osd":7,"uuid":"a9026588-ccdc-4e6c-b628-1ac8a7dbfa64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6817","nonce":2913027708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6819","nonce":2913027708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6823","nonce":2913027708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6821","nonce":2913027708}]},"public_addr":"172.21.15.71:6817/2913027708","cluster_addr":"172.21.15.71:6819/2913027708","heartbeat_back_addr":"172.21.15.71:6823/2913027708","heartbeat_front_addr":"172.21.15.71:6821/2913027708","state":["exists","up"]},{"osd":8,"uuid":"2e1dacea-483c-4587-8d19-5c77a7b98667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6817","nonce":2058692148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6819","nonce":2058692148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6823","nonce":2058692148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6821","nonce":2058692148}]},"public_addr":"172.21.15.175:6817/2058692148","cluster_addr":"172.21.15.175:6819/2058692148","heartbeat_back_addr":"172.21.15.175:6823/2058692148","heartbeat_front_addr":"172.21.15.175:6821/2058692148","state":["exists","up"]},{"osd":9,"uuid":"7077ba4d-1fce-4197-a556-8b6a859c6f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6827","nonce":3278012285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6829","nonce":3278012285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6833","nonce":3278012285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6831","nonce":3278012285}]},"public_addr":"172.21.15.63:6827/3278012285","cluster_addr":"172.21.15.63:6829/3278012285","heartbeat_back_addr":"172.21.15.63:6833/3278012285","heartbeat_front_addr":"172.21.15.63:6831/3278012285","state":["exists","up"]},{"osd":10,"uuid":"99965496-91ee-4eef-9f2e-8f9c8dc54f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6825","nonce":3297929438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6827","nonce":3297929438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6831","nonce":3297929438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6829","nonce":3297929438}]},"public_addr":"172.21.15.71:6825/3297929438","cluster_addr":"172.21.15.71:6827/3297929438","heartbeat_back_addr":"172.21.15.71:6831/3297929438","heartbeat_front_addr":"172.21.15.71:6829/3297929438","state":["exists","up"]},{"osd":11,"uuid":"1b26d1a8-91a4-4877-ad1c-18160a1b3b6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6825","nonce":1970094291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6827","nonce":1970094291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6831","nonce":1970094291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6829","nonce":1970094291}]},"public_addr":"172.21.15.175:6825/1970094291","cluster_addr":"172.21.15.175:6827/1970094291","heartbeat_back_addr":"172.21.15.175:6831/1970094291","heartbeat_front_addr":"172.21.15.175:6829/1970094291","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:20:43.732676+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:08.957775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:34.157788+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:00.134410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:25.502998+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:51.739501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:18.325642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:44.430626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:10.776017+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:36.482831+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:01.898216+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:27.644941+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/1652196301":"2024-09-22T06:19:37.776447+0000","172.21.15.63:6801/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/2740830999":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6801/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6801/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/2958589237":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/1398493582":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/3529491525":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/363262068":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6800/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/3928056461":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/128321401":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/39222803":"2024-09-22T06:19:37.776447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:26:42.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.679+0000 7fe54612b640 1 -- 172.21.15.63:0/3826736072 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe52c0b65f0 msgr2=0x7fe52c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:42.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.679+0000 7fe54612b640 1 --2- 172.21.15.63:0/3826736072 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe52c0b65f0 0x7fe52c0b8b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe540106ea0 tx=0x7fe52800b390 comp rx=0 tx=0).stop 2024-09-21T06:26:42.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.679+0000 7fe54612b640 1 -- 172.21.15.63:0/3826736072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540103bb0 msgr2=0x7fe54019a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:42.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.680+0000 7fe54612b640 1 --2- 172.21.15.63:0/3826736072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540103bb0 0x7fe54019a470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe53000d950 tx=0x7fe53000de10 comp rx=0 tx=0).stop 2024-09-21T06:26:42.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.680+0000 7fe54612b640 1 -- 172.21.15.63:0/3826736072 shutdown_connections 2024-09-21T06:26:42.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.680+0000 7fe54612b640 1 --2- 172.21.15.63:0/3826736072 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe52c0b65f0 0x7fe52c0b8b00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.680+0000 7fe54612b640 1 --2- 172.21.15.63:0/3826736072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe540109e40 0x7fe54019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.680+0000 7fe54612b640 1 --2- 172.21.15.63:0/3826736072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5401094f0 0x7fe54019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.680+0000 7fe54612b640 1 --2- 172.21.15.63:0/3826736072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540103bb0 0x7fe54019a470 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.680+0000 7fe54612b640 1 -- 172.21.15.63:0/3826736072 >> 172.21.15.63:0/3826736072 conn(0x7fe5400ff600 msgr2=0x7fe540101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:42.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.680+0000 7fe54612b640 1 -- 172.21.15.63:0/3826736072 shutdown_connections 2024-09-21T06:26:42.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:42.680+0000 7fe54612b640 1 -- 172.21.15.63:0/3826736072 wait complete. 2024-09-21T06:26:43.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:42 smithi071 ceph-mon[34844]: pgmap v277: 97 pgs: 3 peering, 94 active+clean; 628 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.9 KiB/s wr, 12 op/s; 102 B/s, 0 objects/s recovering 2024-09-21T06:26:43.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:42 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3826736072' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:26:43.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:42 smithi063 ceph-mon[31150]: pgmap v277: 97 pgs: 3 peering, 94 active+clean; 628 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.9 KiB/s wr, 12 op/s; 102 B/s, 0 objects/s recovering 2024-09-21T06:26:43.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:42 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3826736072' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:26:43.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:42 smithi175 ceph-mon[34510]: pgmap v277: 97 pgs: 3 peering, 94 active+clean; 628 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.9 KiB/s wr, 12 op/s; 102 B/s, 0 objects/s recovering 2024-09-21T06:26:43.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:42 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3826736072' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:26:43.372 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T06:26:43.372 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:26:43.630 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:44.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.120+0000 7fe970db7640 1 -- 172.21.15.63:0/1879887147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe96c108cf0 msgr2=0x7fe96c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:44.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.120+0000 7fe970db7640 1 --2- 172.21.15.63:0/1879887147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe96c108cf0 0x7fe96c10f520 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009900 tx=0x7fe95c02a3f0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.120+0000 7fe970db7640 1 -- 172.21.15.63:0/1879887147 shutdown_connections 2024-09-21T06:26:44.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.120+0000 7fe970db7640 1 --2- 172.21.15.63:0/1879887147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe96c108cf0 0x7fe96c10f520 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.120+0000 7fe970db7640 1 --2- 172.21.15.63:0/1879887147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe96c1083a0 0x7fe96c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.120+0000 7fe970db7640 1 --2- 172.21.15.63:0/1879887147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe96c102a60 0x7fe96c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.120+0000 7fe970db7640 1 -- 172.21.15.63:0/1879887147 >> 172.21.15.63:0/1879887147 conn(0x7fe96c079730 msgr2=0x7fe96c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:44.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.120+0000 7fe970db7640 1 -- 172.21.15.63:0/1879887147 shutdown_connections 2024-09-21T06:26:44.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.120+0000 7fe970db7640 1 -- 172.21.15.63:0/1879887147 wait complete. 2024-09-21T06:26:44.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.121+0000 7fe970db7640 1 Processor -- start 2024-09-21T06:26:44.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.121+0000 7fe970db7640 1 -- start start 2024-09-21T06:26:44.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.121+0000 7fe970db7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe96c102a60 0x7fe96c10ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.121+0000 7fe970db7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe96c1083a0 0x7fe96c1104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.121+0000 7fe970db7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe96c108cf0 0x7fe96c110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.122+0000 7fe970db7640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe96c113a80 con 0x7fe96c102a60 2024-09-21T06:26:44.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.122+0000 7fe970db7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe96c113900 con 0x7fe96c1083a0 2024-09-21T06:26:44.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.122+0000 7fe970db7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe96c113c00 con 0x7fe96c108cf0 2024-09-21T06:26:44.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.122+0000 7fe96a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe96c102a60 0x7fe96c10ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.122+0000 7fe96a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe96c102a60 0x7fe96c10ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44898/0 (socket says 172.21.15.63:44898) 2024-09-21T06:26:44.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.122+0000 7fe96a59c640 1 -- 172.21.15.63:0/1907021630 learned_addr learned my addr 172.21.15.63:0/1907021630 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:44.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.122+0000 7fe96ad9d640 1 --2- 172.21.15.63:0/1907021630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe96c108cf0 0x7fe96c110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.122+0000 7fe969d9b640 1 --2- 172.21.15.63:0/1907021630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe96c1083a0 0x7fe96c1104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.122+0000 7fe96a59c640 1 -- 172.21.15.63:0/1907021630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe96c108cf0 msgr2=0x7fe96c110a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:44.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.122+0000 7fe96a59c640 1 --2- 172.21.15.63:0/1907021630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe96c108cf0 0x7fe96c110a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.122+0000 7fe96a59c640 1 -- 172.21.15.63:0/1907021630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe96c1083a0 msgr2=0x7fe96c1104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:44.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.122+0000 7fe96a59c640 1 --2- 172.21.15.63:0/1907021630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe96c1083a0 0x7fe96c1104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.122+0000 7fe96a59c640 1 -- 172.21.15.63:0/1907021630 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe96c1a8620 con 0x7fe96c102a60 2024-09-21T06:26:44.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.122+0000 7fe969d9b640 1 --2- 172.21.15.63:0/1907021630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe96c1083a0 0x7fe96c1104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:44.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.122+0000 7fe96a59c640 1 --2- 172.21.15.63:0/1907021630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe96c102a60 0x7fe96c10ffb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe96400cce0 tx=0x7fe96400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:44.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.122+0000 7fe9637fe640 1 -- 172.21.15.63:0/1907021630 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96400f650 con 0x7fe96c102a60 2024-09-21T06:26:44.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.122+0000 7fe9637fe640 1 -- 172.21.15.63:0/1907021630 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe96400fca0 con 0x7fe96c102a60 2024-09-21T06:26:44.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.122+0000 7fe9637fe640 1 -- 172.21.15.63:0/1907021630 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964018b40 con 0x7fe96c102a60 2024-09-21T06:26:44.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.122+0000 7fe970db7640 1 -- 172.21.15.63:0/1907021630 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe96c1a8910 con 0x7fe96c102a60 2024-09-21T06:26:44.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.122+0000 7fe970db7640 1 -- 172.21.15.63:0/1907021630 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe96c1a8e50 con 0x7fe96c102a60 2024-09-21T06:26:44.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.124+0000 7fe970db7640 1 -- 172.21.15.63:0/1907021630 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe96c102e70 con 0x7fe96c102a60 2024-09-21T06:26:44.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.125+0000 7fe9637fe640 1 -- 172.21.15.63:0/1907021630 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fe964018d00 con 0x7fe96c102a60 2024-09-21T06:26:44.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.126+0000 7fe9637fe640 1 --2- 172.21.15.63:0/1907021630 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe9580b65f0 0x7fe9580b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.126+0000 7fe969d9b640 1 --2- 172.21.15.63:0/1907021630 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe9580b65f0 0x7fe9580b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.126+0000 7fe9637fe640 1 -- 172.21.15.63:0/1907021630 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fe9640e7d60 con 0x7fe96c102a60 2024-09-21T06:26:44.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.127+0000 7fe969d9b640 1 --2- 172.21.15.63:0/1907021630 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe9580b65f0 0x7fe9580b8b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe96c107100 tx=0x7fe954005d30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:44.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.130+0000 7fe9637fe640 1 -- 172.21.15.63:0/1907021630 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe964014030 con 0x7fe96c102a60 2024-09-21T06:26:44.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.315+0000 7fe970db7640 1 -- 172.21.15.63:0/1907021630 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe96c063800 con 0x7fe9580b65f0 2024-09-21T06:26:44.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.319+0000 7fe9637fe640 1 -- 172.21.15.63:0/1907021630 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259040 (secure 0 0 0) 0x7fe96c063800 con 0x7fe9580b65f0 2024-09-21T06:26:44.324 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:26:44.325 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T06:26:44.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.323+0000 7fe970db7640 1 -- 172.21.15.63:0/1907021630 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe9580b65f0 msgr2=0x7fe9580b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:44.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.323+0000 7fe970db7640 1 --2- 172.21.15.63:0/1907021630 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe9580b65f0 0x7fe9580b8b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe96c107100 tx=0x7fe954005d30 comp rx=0 tx=0).stop 2024-09-21T06:26:44.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.323+0000 7fe970db7640 1 -- 172.21.15.63:0/1907021630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe96c102a60 msgr2=0x7fe96c10ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:44.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.323+0000 7fe970db7640 1 --2- 172.21.15.63:0/1907021630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe96c102a60 0x7fe96c10ffb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe96400cce0 tx=0x7fe96400a620 comp rx=0 tx=0).stop 2024-09-21T06:26:44.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.324+0000 7fe970db7640 1 -- 172.21.15.63:0/1907021630 shutdown_connections 2024-09-21T06:26:44.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.324+0000 7fe970db7640 1 --2- 172.21.15.63:0/1907021630 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe9580b65f0 0x7fe9580b8b00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.324+0000 7fe970db7640 1 --2- 172.21.15.63:0/1907021630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe96c108cf0 0x7fe96c110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.324+0000 7fe970db7640 1 --2- 172.21.15.63:0/1907021630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe96c1083a0 0x7fe96c1104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.324+0000 7fe970db7640 1 --2- 172.21.15.63:0/1907021630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe96c102a60 0x7fe96c10ffb0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.324+0000 7fe970db7640 1 -- 172.21.15.63:0/1907021630 >> 172.21.15.63:0/1907021630 conn(0x7fe96c079730 msgr2=0x7fe96c105240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.324+0000 7fe970db7640 1 -- 172.21.15.63:0/1907021630 shutdown_connections 2024-09-21T06:26:44.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:44.324+0000 7fe970db7640 1 -- 172.21.15.63:0/1907021630 wait complete. 2024-09-21T06:26:45.093 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-21T06:26:43.871510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":643009,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":222,"num_read_kb":198,"num_write":358,"num_write_kb":2269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":2953441,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":294,"ondisk_log_size":294,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":293,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376396,"kb_used_data":10456,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565428,"statfs":{"total":1151940427776,"available":1151554998272,"internally_reserved":0,"allocated":10706944,"data_stored":6950477,"data_compressed":172727,"data_compressed_allocated":225280,"data_compressed_original":1949696,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":38007,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":60,"num_write":25,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":1601,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002196"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962115+0000","last_change":"2024-09-21T06:26:18.307729+0000","last_active":"2024-09-21T06:26:38.962115+0000","last_peered":"2024-09-21T06:26:38.962115+0000","last_clean":"2024-09-21T06:26:38.962115+0000","last_became_active":"2024-09-21T06:26:18.306345+0000","last_became_peered":"2024-09-21T06:26:18.306345+0000","last_unstale":"2024-09-21T06:26:38.962115+0000","last_undegraded":"2024-09-21T06:26:38.962115+0000","last_fullsized":"2024-09-21T06:26:38.962115+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:58.409506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967037+0000","last_change":"2024-09-21T06:26:18.302982+0000","last_active":"2024-09-21T06:26:38.967037+0000","last_peered":"2024-09-21T06:26:38.967037+0000","last_clean":"2024-09-21T06:26:38.967037+0000","last_became_active":"2024-09-21T06:26:18.302636+0000","last_became_peered":"2024-09-21T06:26:18.302636+0000","last_unstale":"2024-09-21T06:26:38.967037+0000","last_undegraded":"2024-09-21T06:26:38.967037+0000","last_fullsized":"2024-09-21T06:26:38.967037+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:28.165964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967428+0000","last_change":"2024-09-21T06:26:18.305293+0000","last_active":"2024-09-21T06:26:38.967428+0000","last_peered":"2024-09-21T06:26:38.967428+0000","last_clean":"2024-09-21T06:26:38.967428+0000","last_became_active":"2024-09-21T06:26:18.304689+0000","last_became_peered":"2024-09-21T06:26:18.304689+0000","last_unstale":"2024-09-21T06:26:38.967428+0000","last_undegraded":"2024-09-21T06:26:38.967428+0000","last_fullsized":"2024-09-21T06:26:38.967428+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:37.442558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962224+0000","last_change":"2024-09-21T06:26:18.306443+0000","last_active":"2024-09-21T06:26:38.962224+0000","last_peered":"2024-09-21T06:26:38.962224+0000","last_clean":"2024-09-21T06:26:38.962224+0000","last_became_active":"2024-09-21T06:26:18.305062+0000","last_became_peered":"2024-09-21T06:26:18.305062+0000","last_unstale":"2024-09-21T06:26:38.962224+0000","last_undegraded":"2024-09-21T06:26:38.962224+0000","last_fullsized":"2024-09-21T06:26:38.962224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:07.896971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964110+0000","last_change":"2024-09-21T06:26:18.298857+0000","last_active":"2024-09-21T06:26:38.964110+0000","last_peered":"2024-09-21T06:26:38.964110+0000","last_clean":"2024-09-21T06:26:38.964110+0000","last_became_active":"2024-09-21T06:26:18.298439+0000","last_became_peered":"2024-09-21T06:26:18.298439+0000","last_unstale":"2024-09-21T06:26:38.964110+0000","last_undegraded":"2024-09-21T06:26:38.964110+0000","last_fullsized":"2024-09-21T06:26:38.964110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:24.695856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964685+0000","last_change":"2024-09-21T06:26:18.313029+0000","last_active":"2024-09-21T06:26:38.964685+0000","last_peered":"2024-09-21T06:26:38.964685+0000","last_clean":"2024-09-21T06:26:38.964685+0000","last_became_active":"2024-09-21T06:26:18.312627+0000","last_became_peered":"2024-09-21T06:26:18.312627+0000","last_unstale":"2024-09-21T06:26:38.964685+0000","last_undegraded":"2024-09-21T06:26:38.964685+0000","last_fullsized":"2024-09-21T06:26:38.964685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:23.086862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965223+0000","last_change":"2024-09-21T06:26:18.299082+0000","last_active":"2024-09-21T06:26:38.965223+0000","last_peered":"2024-09-21T06:26:38.965223+0000","last_clean":"2024-09-21T06:26:38.965223+0000","last_became_active":"2024-09-21T06:26:18.298279+0000","last_became_peered":"2024-09-21T06:26:18.298279+0000","last_unstale":"2024-09-21T06:26:38.965223+0000","last_undegraded":"2024-09-21T06:26:38.965223+0000","last_fullsized":"2024-09-21T06:26:38.965223+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:05.652407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963617+0000","last_change":"2024-09-21T06:26:18.298565+0000","last_active":"2024-09-21T06:26:38.963617+0000","last_peered":"2024-09-21T06:26:38.963617+0000","last_clean":"2024-09-21T06:26:38.963617+0000","last_became_active":"2024-09-21T06:26:18.298172+0000","last_became_peered":"2024-09-21T06:26:18.298172+0000","last_unstale":"2024-09-21T06:26:38.963617+0000","last_undegraded":"2024-09-21T06:26:38.963617+0000","last_fullsized":"2024-09-21T06:26:38.963617+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:33.045038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967371+0000","last_change":"2024-09-21T06:26:18.304901+0000","last_active":"2024-09-21T06:26:38.967371+0000","last_peered":"2024-09-21T06:26:38.967371+0000","last_clean":"2024-09-21T06:26:38.967371+0000","last_became_active":"2024-09-21T06:26:18.304521+0000","last_became_peered":"2024-09-21T06:26:18.304521+0000","last_unstale":"2024-09-21T06:26:38.967371+0000","last_undegraded":"2024-09-21T06:26:38.967371+0000","last_fullsized":"2024-09-21T06:26:38.967371+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:31.859554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.970297+0000","last_change":"2024-09-21T06:26:38.970119+0000","last_active":"2024-09-21T06:26:38.970297+0000","last_peered":"2024-09-21T06:26:38.970297+0000","last_clean":"2024-09-21T06:26:38.970297+0000","last_became_active":"2024-09-21T06:26:38.969521+0000","last_became_peered":"2024-09-21T06:26:38.969521+0000","last_unstale":"2024-09-21T06:26:38.970297+0000","last_undegraded":"2024-09-21T06:26:38.970297+0000","last_fullsized":"2024-09-21T06:26:38.970297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:54.407153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966009+0000","last_change":"2024-09-21T06:26:18.300178+0000","last_active":"2024-09-21T06:26:38.966009+0000","last_peered":"2024-09-21T06:26:38.966009+0000","last_clean":"2024-09-21T06:26:38.966009+0000","last_became_active":"2024-09-21T06:26:18.298651+0000","last_became_peered":"2024-09-21T06:26:18.298651+0000","last_unstale":"2024-09-21T06:26:38.966009+0000","last_undegraded":"2024-09-21T06:26:38.966009+0000","last_fullsized":"2024-09-21T06:26:38.966009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:07.261974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962238+0000","last_change":"2024-09-21T06:26:18.311310+0000","last_active":"2024-09-21T06:26:38.962238+0000","last_peered":"2024-09-21T06:26:38.962238+0000","last_clean":"2024-09-21T06:26:38.962238+0000","last_became_active":"2024-09-21T06:26:18.310671+0000","last_became_peered":"2024-09-21T06:26:18.310671+0000","last_unstale":"2024-09-21T06:26:38.962238+0000","last_undegraded":"2024-09-21T06:26:38.962238+0000","last_fullsized":"2024-09-21T06:26:38.962238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:52.060682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965742+0000","last_change":"2024-09-21T06:26:18.296958+0000","last_active":"2024-09-21T06:26:38.965742+0000","last_peered":"2024-09-21T06:26:38.965742+0000","last_clean":"2024-09-21T06:26:38.965742+0000","last_became_active":"2024-09-21T06:26:18.296081+0000","last_became_peered":"2024-09-21T06:26:18.296081+0000","last_unstale":"2024-09-21T06:26:38.965742+0000","last_undegraded":"2024-09-21T06:26:38.965742+0000","last_fullsized":"2024-09-21T06:26:38.965742+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:28.501906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966438+0000","last_change":"2024-09-21T06:26:18.301289+0000","last_active":"2024-09-21T06:26:38.966438+0000","last_peered":"2024-09-21T06:26:38.966438+0000","last_clean":"2024-09-21T06:26:38.966438+0000","last_became_active":"2024-09-21T06:26:18.300834+0000","last_became_peered":"2024-09-21T06:26:18.300834+0000","last_unstale":"2024-09-21T06:26:38.966438+0000","last_undegraded":"2024-09-21T06:26:38.966438+0000","last_fullsized":"2024-09-21T06:26:38.966438+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:31.206650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966259+0000","last_change":"2024-09-21T06:26:18.312436+0000","last_active":"2024-09-21T06:26:38.966259+0000","last_peered":"2024-09-21T06:26:38.966259+0000","last_clean":"2024-09-21T06:26:38.966259+0000","last_became_active":"2024-09-21T06:26:18.311230+0000","last_became_peered":"2024-09-21T06:26:18.311230+0000","last_unstale":"2024-09-21T06:26:38.966259+0000","last_undegraded":"2024-09-21T06:26:38.966259+0000","last_fullsized":"2024-09-21T06:26:38.966259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:07.163105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966586+0000","last_change":"2024-09-21T06:26:18.307775+0000","last_active":"2024-09-21T06:26:38.966586+0000","last_peered":"2024-09-21T06:26:38.966586+0000","last_clean":"2024-09-21T06:26:38.966586+0000","last_became_active":"2024-09-21T06:26:18.307326+0000","last_became_peered":"2024-09-21T06:26:18.307326+0000","last_unstale":"2024-09-21T06:26:38.966586+0000","last_undegraded":"2024-09-21T06:26:38.966586+0000","last_fullsized":"2024-09-21T06:26:38.966586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:18.213503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962147+0000","last_change":"2024-09-21T06:26:18.309004+0000","last_active":"2024-09-21T06:26:38.962147+0000","last_peered":"2024-09-21T06:26:38.962147+0000","last_clean":"2024-09-21T06:26:38.962147+0000","last_became_active":"2024-09-21T06:26:18.306098+0000","last_became_peered":"2024-09-21T06:26:18.306098+0000","last_unstale":"2024-09-21T06:26:38.962147+0000","last_undegraded":"2024-09-21T06:26:38.962147+0000","last_fullsized":"2024-09-21T06:26:38.962147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:09.102610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965512+0000","last_change":"2024-09-21T06:26:18.306699+0000","last_active":"2024-09-21T06:26:38.965512+0000","last_peered":"2024-09-21T06:26:38.965512+0000","last_clean":"2024-09-21T06:26:38.965512+0000","last_became_active":"2024-09-21T06:26:18.306352+0000","last_became_peered":"2024-09-21T06:26:18.306352+0000","last_unstale":"2024-09-21T06:26:38.965512+0000","last_undegraded":"2024-09-21T06:26:38.965512+0000","last_fullsized":"2024-09-21T06:26:38.965512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:47.992315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.968447+0000","last_change":"2024-09-21T06:26:18.301677+0000","last_active":"2024-09-21T06:26:38.968447+0000","last_peered":"2024-09-21T06:26:38.968447+0000","last_clean":"2024-09-21T06:26:38.968447+0000","last_became_active":"2024-09-21T06:26:18.301260+0000","last_became_peered":"2024-09-21T06:26:18.301260+0000","last_unstale":"2024-09-21T06:26:38.968447+0000","last_undegraded":"2024-09-21T06:26:38.968447+0000","last_fullsized":"2024-09-21T06:26:38.968447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:53.209062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.961797+0000","last_change":"2024-09-21T06:26:18.312004+0000","last_active":"2024-09-21T06:26:38.961797+0000","last_peered":"2024-09-21T06:26:38.961797+0000","last_clean":"2024-09-21T06:26:38.961797+0000","last_became_active":"2024-09-21T06:26:18.311602+0000","last_became_peered":"2024-09-21T06:26:18.311602+0000","last_unstale":"2024-09-21T06:26:38.961797+0000","last_undegraded":"2024-09-21T06:26:38.961797+0000","last_fullsized":"2024-09-21T06:26:38.961797+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:30.074887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965890+0000","last_change":"2024-09-21T06:26:18.296581+0000","last_active":"2024-09-21T06:26:38.965890+0000","last_peered":"2024-09-21T06:26:38.965890+0000","last_clean":"2024-09-21T06:26:38.965890+0000","last_became_active":"2024-09-21T06:26:18.296078+0000","last_became_peered":"2024-09-21T06:26:18.296078+0000","last_unstale":"2024-09-21T06:26:38.965890+0000","last_undegraded":"2024-09-21T06:26:38.965890+0000","last_fullsized":"2024-09-21T06:26:38.965890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:39.120626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966804+0000","last_change":"2024-09-21T06:26:18.307793+0000","last_active":"2024-09-21T06:26:38.966804+0000","last_peered":"2024-09-21T06:26:38.966804+0000","last_clean":"2024-09-21T06:26:38.966804+0000","last_became_active":"2024-09-21T06:26:18.307310+0000","last_became_peered":"2024-09-21T06:26:18.307310+0000","last_unstale":"2024-09-21T06:26:38.966804+0000","last_undegraded":"2024-09-21T06:26:38.966804+0000","last_fullsized":"2024-09-21T06:26:38.966804+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:11.761986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963619+0000","last_change":"2024-09-21T06:26:18.305700+0000","last_active":"2024-09-21T06:26:38.963619+0000","last_peered":"2024-09-21T06:26:38.963619+0000","last_clean":"2024-09-21T06:26:38.963619+0000","last_became_active":"2024-09-21T06:26:18.305319+0000","last_became_peered":"2024-09-21T06:26:18.305319+0000","last_unstale":"2024-09-21T06:26:38.963619+0000","last_undegraded":"2024-09-21T06:26:38.963619+0000","last_fullsized":"2024-09-21T06:26:38.963619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:52.479565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971092+0000","last_change":"2024-09-21T06:26:18.304111+0000","last_active":"2024-09-21T06:26:38.971092+0000","last_peered":"2024-09-21T06:26:38.971092+0000","last_clean":"2024-09-21T06:26:38.971092+0000","last_became_active":"2024-09-21T06:26:18.302716+0000","last_became_peered":"2024-09-21T06:26:18.302716+0000","last_unstale":"2024-09-21T06:26:38.971092+0000","last_undegraded":"2024-09-21T06:26:38.971092+0000","last_fullsized":"2024-09-21T06:26:38.971092+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:39.298737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964408+0000","last_change":"2024-09-21T06:26:18.310154+0000","last_active":"2024-09-21T06:26:38.964408+0000","last_peered":"2024-09-21T06:26:38.964408+0000","last_clean":"2024-09-21T06:26:38.964408+0000","last_became_active":"2024-09-21T06:26:18.309735+0000","last_became_peered":"2024-09-21T06:26:18.309735+0000","last_unstale":"2024-09-21T06:26:38.964408+0000","last_undegraded":"2024-09-21T06:26:38.964408+0000","last_fullsized":"2024-09-21T06:26:38.964408+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:42:37.535841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.968784+0000","last_change":"2024-09-21T06:26:18.312302+0000","last_active":"2024-09-21T06:26:38.968784+0000","last_peered":"2024-09-21T06:26:38.968784+0000","last_clean":"2024-09-21T06:26:38.968784+0000","last_became_active":"2024-09-21T06:26:18.311950+0000","last_became_peered":"2024-09-21T06:26:18.311950+0000","last_unstale":"2024-09-21T06:26:38.968784+0000","last_undegraded":"2024-09-21T06:26:38.968784+0000","last_fullsized":"2024-09-21T06:26:38.968784+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:03.899946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962182+0000","last_change":"2024-09-21T06:26:18.308291+0000","last_active":"2024-09-21T06:26:38.962182+0000","last_peered":"2024-09-21T06:26:38.962182+0000","last_clean":"2024-09-21T06:26:38.962182+0000","last_became_active":"2024-09-21T06:26:18.307907+0000","last_became_peered":"2024-09-21T06:26:18.307907+0000","last_unstale":"2024-09-21T06:26:38.962182+0000","last_undegraded":"2024-09-21T06:26:38.962182+0000","last_fullsized":"2024-09-21T06:26:38.962182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:17.418996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965105+0000","last_change":"2024-09-21T06:26:18.311774+0000","last_active":"2024-09-21T06:26:38.965105+0000","last_peered":"2024-09-21T06:26:38.965105+0000","last_clean":"2024-09-21T06:26:38.965105+0000","last_became_active":"2024-09-21T06:26:18.311373+0000","last_became_peered":"2024-09-21T06:26:18.311373+0000","last_unstale":"2024-09-21T06:26:38.965105+0000","last_undegraded":"2024-09-21T06:26:38.965105+0000","last_fullsized":"2024-09-21T06:26:38.965105+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:08.310931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.977753+0000","last_change":"2024-09-21T06:26:38.977655+0000","last_active":"2024-09-21T06:26:38.977753+0000","last_peered":"2024-09-21T06:26:38.977753+0000","last_clean":"2024-09-21T06:26:38.977753+0000","last_became_active":"2024-09-21T06:26:38.977309+0000","last_became_peered":"2024-09-21T06:26:38.977309+0000","last_unstale":"2024-09-21T06:26:38.977753+0000","last_undegraded":"2024-09-21T06:26:38.977753+0000","last_fullsized":"2024-09-21T06:26:38.977753+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:10.083264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967567+0000","last_change":"2024-09-21T06:26:18.302851+0000","last_active":"2024-09-21T06:26:38.967567+0000","last_peered":"2024-09-21T06:26:38.967567+0000","last_clean":"2024-09-21T06:26:38.967567+0000","last_became_active":"2024-09-21T06:26:18.302120+0000","last_became_peered":"2024-09-21T06:26:18.302120+0000","last_unstale":"2024-09-21T06:26:38.967567+0000","last_undegraded":"2024-09-21T06:26:38.967567+0000","last_fullsized":"2024-09-21T06:26:38.967567+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:18.442711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967011+0000","last_change":"2024-09-21T06:26:18.310447+0000","last_active":"2024-09-21T06:26:38.967011+0000","last_peered":"2024-09-21T06:26:38.967011+0000","last_clean":"2024-09-21T06:26:38.967011+0000","last_became_active":"2024-09-21T06:26:18.310079+0000","last_became_peered":"2024-09-21T06:26:18.310079+0000","last_unstale":"2024-09-21T06:26:38.967011+0000","last_undegraded":"2024-09-21T06:26:38.967011+0000","last_fullsized":"2024-09-21T06:26:38.967011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:14.364382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.961670+0000","last_change":"2024-09-21T06:26:18.307260+0000","last_active":"2024-09-21T06:26:38.961670+0000","last_peered":"2024-09-21T06:26:38.961670+0000","last_clean":"2024-09-21T06:26:38.961670+0000","last_became_active":"2024-09-21T06:26:18.306131+0000","last_became_peered":"2024-09-21T06:26:18.306131+0000","last_unstale":"2024-09-21T06:26:38.961670+0000","last_undegraded":"2024-09-21T06:26:38.961670+0000","last_fullsized":"2024-09-21T06:26:38.961670+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:14.746652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964110+0000","last_change":"2024-09-21T06:26:18.292714+0000","last_active":"2024-09-21T06:26:38.964110+0000","last_peered":"2024-09-21T06:26:38.964110+0000","last_clean":"2024-09-21T06:26:38.964110+0000","last_became_active":"2024-09-21T06:26:18.292322+0000","last_became_peered":"2024-09-21T06:26:18.292322+0000","last_unstale":"2024-09-21T06:26:38.964110+0000","last_undegraded":"2024-09-21T06:26:38.964110+0000","last_fullsized":"2024-09-21T06:26:38.964110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:51.017455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.970739+0000","last_change":"2024-09-21T06:26:16.269788+0000","last_active":"2024-09-21T06:26:38.970739+0000","last_peered":"2024-09-21T06:26:38.970739+0000","last_clean":"2024-09-21T06:26:38.970739+0000","last_became_active":"2024-09-21T06:26:16.269342+0000","last_became_peered":"2024-09-21T06:26:16.269342+0000","last_unstale":"2024-09-21T06:26:38.970739+0000","last_undegraded":"2024-09-21T06:26:38.970739+0000","last_fullsized":"2024-09-21T06:26:38.970739+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:34.782237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.970505+0000","last_change":"2024-09-21T06:26:38.970396+0000","last_active":"2024-09-21T06:26:38.970505+0000","last_peered":"2024-09-21T06:26:38.970505+0000","last_clean":"2024-09-21T06:26:38.970505+0000","last_became_active":"2024-09-21T06:26:38.969976+0000","last_became_peered":"2024-09-21T06:26:38.969976+0000","last_unstale":"2024-09-21T06:26:38.970505+0000","last_undegraded":"2024-09-21T06:26:38.970505+0000","last_fullsized":"2024-09-21T06:26:38.970505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:44.540563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,3],"acting":[9,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964833+0000","last_change":"2024-09-21T06:26:16.272832+0000","last_active":"2024-09-21T06:26:38.964833+0000","last_peered":"2024-09-21T06:26:38.964833+0000","last_clean":"2024-09-21T06:26:38.964833+0000","last_became_active":"2024-09-21T06:26:16.272447+0000","last_became_peered":"2024-09-21T06:26:16.272447+0000","last_unstale":"2024-09-21T06:26:38.964833+0000","last_undegraded":"2024-09-21T06:26:38.964833+0000","last_fullsized":"2024-09-21T06:26:38.964833+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:22.836267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966506+0000","last_change":"2024-09-21T06:26:16.269067+0000","last_active":"2024-09-21T06:26:38.966506+0000","last_peered":"2024-09-21T06:26:38.966506+0000","last_clean":"2024-09-21T06:26:38.966506+0000","last_became_active":"2024-09-21T06:26:16.268524+0000","last_became_peered":"2024-09-21T06:26:16.268524+0000","last_unstale":"2024-09-21T06:26:38.966506+0000","last_undegraded":"2024-09-21T06:26:38.966506+0000","last_fullsized":"2024-09-21T06:26:38.966506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:32.224321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963670+0000","last_change":"2024-09-21T06:26:18.306489+0000","last_active":"2024-09-21T06:26:38.963670+0000","last_peered":"2024-09-21T06:26:38.963670+0000","last_clean":"2024-09-21T06:26:38.963670+0000","last_became_active":"2024-09-21T06:26:18.305883+0000","last_became_peered":"2024-09-21T06:26:18.305883+0000","last_unstale":"2024-09-21T06:26:38.963670+0000","last_undegraded":"2024-09-21T06:26:38.963670+0000","last_fullsized":"2024-09-21T06:26:38.963670+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:54.012308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971279+0000","last_change":"2024-09-21T06:26:16.269793+0000","last_active":"2024-09-21T06:26:38.971279+0000","last_peered":"2024-09-21T06:26:38.971279+0000","last_clean":"2024-09-21T06:26:38.971279+0000","last_became_active":"2024-09-21T06:26:16.269455+0000","last_became_peered":"2024-09-21T06:26:16.269455+0000","last_unstale":"2024-09-21T06:26:38.971279+0000","last_undegraded":"2024-09-21T06:26:38.971279+0000","last_fullsized":"2024-09-21T06:26:38.971279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:44.369742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965132+0000","last_change":"2024-09-21T06:26:18.297573+0000","last_active":"2024-09-21T06:26:38.965132+0000","last_peered":"2024-09-21T06:26:38.965132+0000","last_clean":"2024-09-21T06:26:38.965132+0000","last_became_active":"2024-09-21T06:26:18.297190+0000","last_became_peered":"2024-09-21T06:26:18.297190+0000","last_unstale":"2024-09-21T06:26:38.965132+0000","last_undegraded":"2024-09-21T06:26:38.965132+0000","last_fullsized":"2024-09-21T06:26:38.965132+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:28.055520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'4","reported_seq":49,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965578+0000","last_change":"2024-09-21T06:26:16.273604+0000","last_active":"2024-09-21T06:26:38.965578+0000","last_peered":"2024-09-21T06:26:38.965578+0000","last_clean":"2024-09-21T06:26:38.965578+0000","last_became_active":"2024-09-21T06:26:16.273194+0000","last_became_peered":"2024-09-21T06:26:16.273194+0000","last_unstale":"2024-09-21T06:26:38.965578+0000","last_undegraded":"2024-09-21T06:26:38.965578+0000","last_fullsized":"2024-09-21T06:26:38.965578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:08.218442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966787+0000","last_change":"2024-09-21T06:26:18.303960+0000","last_active":"2024-09-21T06:26:38.966787+0000","last_peered":"2024-09-21T06:26:38.966787+0000","last_clean":"2024-09-21T06:26:38.966787+0000","last_became_active":"2024-09-21T06:26:18.303550+0000","last_became_peered":"2024-09-21T06:26:18.303550+0000","last_unstale":"2024-09-21T06:26:38.966787+0000","last_undegraded":"2024-09-21T06:26:38.966787+0000","last_fullsized":"2024-09-21T06:26:38.966787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:47.331439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.978327+0000","last_change":"2024-09-21T06:26:38.978161+0000","last_active":"2024-09-21T06:26:38.978327+0000","last_peered":"2024-09-21T06:26:38.978327+0000","last_clean":"2024-09-21T06:26:38.978327+0000","last_became_active":"2024-09-21T06:26:38.970818+0000","last_became_peered":"2024-09-21T06:26:38.970818+0000","last_unstale":"2024-09-21T06:26:38.978327+0000","last_undegraded":"2024-09-21T06:26:38.978327+0000","last_fullsized":"2024-09-21T06:26:38.978327+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:55.273463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967598+0000","last_change":"2024-09-21T06:26:18.311643+0000","last_active":"2024-09-21T06:26:38.967598+0000","last_peered":"2024-09-21T06:26:38.967598+0000","last_clean":"2024-09-21T06:26:38.967598+0000","last_became_active":"2024-09-21T06:26:18.311246+0000","last_became_peered":"2024-09-21T06:26:18.311246+0000","last_unstale":"2024-09-21T06:26:38.967598+0000","last_undegraded":"2024-09-21T06:26:38.967598+0000","last_fullsized":"2024-09-21T06:26:38.967598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:00.342212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971107+0000","last_change":"2024-09-21T06:26:16.313648+0000","last_active":"2024-09-21T06:26:38.971107+0000","last_peered":"2024-09-21T06:26:38.971107+0000","last_clean":"2024-09-21T06:26:38.971107+0000","last_became_active":"2024-09-21T06:26:16.313337+0000","last_became_peered":"2024-09-21T06:26:16.313337+0000","last_unstale":"2024-09-21T06:26:38.971107+0000","last_undegraded":"2024-09-21T06:26:38.971107+0000","last_fullsized":"2024-09-21T06:26:38.971107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:12.095276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966410+0000","last_change":"2024-09-21T06:26:18.310168+0000","last_active":"2024-09-21T06:26:38.966410+0000","last_peered":"2024-09-21T06:26:38.966410+0000","last_clean":"2024-09-21T06:26:38.966410+0000","last_became_active":"2024-09-21T06:26:18.309756+0000","last_became_peered":"2024-09-21T06:26:18.309756+0000","last_unstale":"2024-09-21T06:26:38.966410+0000","last_undegraded":"2024-09-21T06:26:38.966410+0000","last_fullsized":"2024-09-21T06:26:38.966410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:07.203202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'23","reported_seq":74,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964852+0000","last_change":"2024-09-21T06:26:16.270243+0000","last_active":"2024-09-21T06:26:38.964852+0000","last_peered":"2024-09-21T06:26:38.964852+0000","last_clean":"2024-09-21T06:26:38.964852+0000","last_became_active":"2024-09-21T06:26:16.269883+0000","last_became_peered":"2024-09-21T06:26:16.269883+0000","last_unstale":"2024-09-21T06:26:38.964852+0000","last_undegraded":"2024-09-21T06:26:38.964852+0000","last_fullsized":"2024-09-21T06:26:38.964852+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:55.906972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45203,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":57,"num_write":25,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964370+0000","last_change":"2024-09-21T06:26:18.305508+0000","last_active":"2024-09-21T06:26:38.964370+0000","last_peered":"2024-09-21T06:26:38.964370+0000","last_clean":"2024-09-21T06:26:38.964370+0000","last_became_active":"2024-09-21T06:26:18.305104+0000","last_became_peered":"2024-09-21T06:26:18.305104+0000","last_unstale":"2024-09-21T06:26:38.964370+0000","last_undegraded":"2024-09-21T06:26:38.964370+0000","last_fullsized":"2024-09-21T06:26:38.964370+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:14.727084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'9","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.969025+0000","last_change":"2024-09-21T06:26:16.268331+0000","last_active":"2024-09-21T06:26:38.969025+0000","last_peered":"2024-09-21T06:26:38.969025+0000","last_clean":"2024-09-21T06:26:38.969025+0000","last_became_active":"2024-09-21T06:26:16.267918+0000","last_became_peered":"2024-09-21T06:26:16.267918+0000","last_unstale":"2024-09-21T06:26:38.969025+0000","last_undegraded":"2024-09-21T06:26:38.969025+0000","last_fullsized":"2024-09-21T06:26:38.969025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:50.198883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965178+0000","last_change":"2024-09-21T06:26:18.298052+0000","last_active":"2024-09-21T06:26:38.965178+0000","last_peered":"2024-09-21T06:26:38.965178+0000","last_clean":"2024-09-21T06:26:38.965178+0000","last_became_active":"2024-09-21T06:26:18.297686+0000","last_became_peered":"2024-09-21T06:26:18.297686+0000","last_unstale":"2024-09-21T06:26:38.965178+0000","last_undegraded":"2024-09-21T06:26:38.965178+0000","last_fullsized":"2024-09-21T06:26:38.965178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:56.261608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.970277+0000","last_change":"2024-09-21T06:26:16.270917+0000","last_active":"2024-09-21T06:26:38.970277+0000","last_peered":"2024-09-21T06:26:38.970277+0000","last_clean":"2024-09-21T06:26:38.970277+0000","last_became_active":"2024-09-21T06:26:16.270530+0000","last_became_peered":"2024-09-21T06:26:16.270530+0000","last_unstale":"2024-09-21T06:26:38.970277+0000","last_undegraded":"2024-09-21T06:26:38.970277+0000","last_fullsized":"2024-09-21T06:26:38.970277+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:30.772991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965618+0000","last_change":"2024-09-21T06:26:18.302286+0000","last_active":"2024-09-21T06:26:38.965618+0000","last_peered":"2024-09-21T06:26:38.965618+0000","last_clean":"2024-09-21T06:26:38.965618+0000","last_became_active":"2024-09-21T06:26:18.301777+0000","last_became_peered":"2024-09-21T06:26:18.301777+0000","last_unstale":"2024-09-21T06:26:38.965618+0000","last_undegraded":"2024-09-21T06:26:38.965618+0000","last_fullsized":"2024-09-21T06:26:38.965618+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:31.339898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":46,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:40.777827+0000","last_change":"2024-09-21T06:26:16.267569+0000","last_active":"2024-09-21T06:26:40.777827+0000","last_peered":"2024-09-21T06:26:40.777827+0000","last_clean":"2024-09-21T06:26:40.777827+0000","last_became_active":"2024-09-21T06:26:16.267198+0000","last_became_peered":"2024-09-21T06:26:16.267198+0000","last_unstale":"2024-09-21T06:26:40.777827+0000","last_undegraded":"2024-09-21T06:26:40.777827+0000","last_fullsized":"2024-09-21T06:26:40.777827+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:16.323246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964474+0000","last_change":"2024-09-21T06:26:18.294473+0000","last_active":"2024-09-21T06:26:38.964474+0000","last_peered":"2024-09-21T06:26:38.964474+0000","last_clean":"2024-09-21T06:26:38.964474+0000","last_became_active":"2024-09-21T06:26:18.294010+0000","last_became_peered":"2024-09-21T06:26:18.294010+0000","last_unstale":"2024-09-21T06:26:38.964474+0000","last_undegraded":"2024-09-21T06:26:38.964474+0000","last_fullsized":"2024-09-21T06:26:38.964474+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:12.098589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'17","reported_seq":66,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.994281+0000","last_change":"2024-09-21T06:26:38.994178+0000","last_active":"2024-09-21T06:26:38.994281+0000","last_peered":"2024-09-21T06:26:38.994281+0000","last_clean":"2024-09-21T06:26:38.994281+0000","last_became_active":"2024-09-21T06:26:38.977865+0000","last_became_peered":"2024-09-21T06:26:38.977865+0000","last_unstale":"2024-09-21T06:26:38.994281+0000","last_undegraded":"2024-09-21T06:26:38.994281+0000","last_fullsized":"2024-09-21T06:26:38.994281+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:44.368499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.969981+0000","last_change":"2024-09-21T06:26:18.312319+0000","last_active":"2024-09-21T06:26:38.969981+0000","last_peered":"2024-09-21T06:26:38.969981+0000","last_clean":"2024-09-21T06:26:38.969981+0000","last_became_active":"2024-09-21T06:26:18.311949+0000","last_became_peered":"2024-09-21T06:26:18.311949+0000","last_unstale":"2024-09-21T06:26:38.969981+0000","last_undegraded":"2024-09-21T06:26:38.969981+0000","last_fullsized":"2024-09-21T06:26:38.969981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:49.729693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964667+0000","last_change":"2024-09-21T06:26:16.273771+0000","last_active":"2024-09-21T06:26:38.964667+0000","last_peered":"2024-09-21T06:26:38.964667+0000","last_clean":"2024-09-21T06:26:38.964667+0000","last_became_active":"2024-09-21T06:26:16.273293+0000","last_became_peered":"2024-09-21T06:26:16.273293+0000","last_unstale":"2024-09-21T06:26:38.964667+0000","last_undegraded":"2024-09-21T06:26:38.964667+0000","last_fullsized":"2024-09-21T06:26:38.964667+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:21.867844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.961892+0000","last_change":"2024-09-21T06:26:18.309204+0000","last_active":"2024-09-21T06:26:38.961892+0000","last_peered":"2024-09-21T06:26:38.961892+0000","last_clean":"2024-09-21T06:26:38.961892+0000","last_became_active":"2024-09-21T06:26:18.308838+0000","last_became_peered":"2024-09-21T06:26:18.308838+0000","last_unstale":"2024-09-21T06:26:38.961892+0000","last_undegraded":"2024-09-21T06:26:38.961892+0000","last_fullsized":"2024-09-21T06:26:38.961892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:14.011799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'5","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965404+0000","last_change":"2024-09-21T06:26:16.267965+0000","last_active":"2024-09-21T06:26:38.965404+0000","last_peered":"2024-09-21T06:26:38.965404+0000","last_clean":"2024-09-21T06:26:38.965404+0000","last_became_active":"2024-09-21T06:26:16.267548+0000","last_became_peered":"2024-09-21T06:26:16.267548+0000","last_unstale":"2024-09-21T06:26:38.965404+0000","last_undegraded":"2024-09-21T06:26:38.965404+0000","last_fullsized":"2024-09-21T06:26:38.965404+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:51.915817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965963+0000","last_change":"2024-09-21T06:26:18.306376+0000","last_active":"2024-09-21T06:26:38.965963+0000","last_peered":"2024-09-21T06:26:38.965963+0000","last_clean":"2024-09-21T06:26:38.965963+0000","last_became_active":"2024-09-21T06:26:18.305956+0000","last_became_peered":"2024-09-21T06:26:18.305956+0000","last_unstale":"2024-09-21T06:26:38.965963+0000","last_undegraded":"2024-09-21T06:26:38.965963+0000","last_fullsized":"2024-09-21T06:26:38.965963+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:27.229499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971383+0000","last_change":"2024-09-21T06:26:16.267201+0000","last_active":"2024-09-21T06:26:38.971383+0000","last_peered":"2024-09-21T06:26:38.971383+0000","last_clean":"2024-09-21T06:26:38.971383+0000","last_became_active":"2024-09-21T06:26:16.266832+0000","last_became_peered":"2024-09-21T06:26:16.266832+0000","last_unstale":"2024-09-21T06:26:38.971383+0000","last_undegraded":"2024-09-21T06:26:38.971383+0000","last_fullsized":"2024-09-21T06:26:38.971383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:48.626106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.984188+0000","last_change":"2024-09-21T06:26:38.984119+0000","last_active":"2024-09-21T06:26:38.984188+0000","last_peered":"2024-09-21T06:26:38.984188+0000","last_clean":"2024-09-21T06:26:38.984188+0000","last_became_active":"2024-09-21T06:26:38.972316+0000","last_became_peered":"2024-09-21T06:26:38.972316+0000","last_unstale":"2024-09-21T06:26:38.984188+0000","last_undegraded":"2024-09-21T06:26:38.984188+0000","last_fullsized":"2024-09-21T06:26:38.984188+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:22.788293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'6","reported_seq":46,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:40.777639+0000","last_change":"2024-09-21T06:26:16.572993+0000","last_active":"2024-09-21T06:26:40.777639+0000","last_peered":"2024-09-21T06:26:40.777639+0000","last_clean":"2024-09-21T06:26:40.777639+0000","last_became_active":"2024-09-21T06:26:16.572631+0000","last_became_peered":"2024-09-21T06:26:16.572631+0000","last_unstale":"2024-09-21T06:26:40.777639+0000","last_undegraded":"2024-09-21T06:26:40.777639+0000","last_fullsized":"2024-09-21T06:26:40.777639+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:05.276119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966079+0000","last_change":"2024-09-21T06:26:18.304685+0000","last_active":"2024-09-21T06:26:38.966079+0000","last_peered":"2024-09-21T06:26:38.966079+0000","last_clean":"2024-09-21T06:26:38.966079+0000","last_became_active":"2024-09-21T06:26:18.304325+0000","last_became_peered":"2024-09-21T06:26:18.304325+0000","last_unstale":"2024-09-21T06:26:38.966079+0000","last_undegraded":"2024-09-21T06:26:38.966079+0000","last_fullsized":"2024-09-21T06:26:38.966079+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:18.072602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965169+0000","last_change":"2024-09-21T06:25:04.875443+0000","last_active":"2024-09-21T06:26:38.965169+0000","last_peered":"2024-09-21T06:26:38.965169+0000","last_clean":"2024-09-21T06:26:38.965169+0000","last_became_active":"2024-09-21T06:25:04.869179+0000","last_became_peered":"2024-09-21T06:25:04.869179+0000","last_unstale":"2024-09-21T06:26:38.965169+0000","last_undegraded":"2024-09-21T06:26:38.965169+0000","last_fullsized":"2024-09-21T06:26:38.965169+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:21:37.191501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:21:37.191501+0000","last_clean_scrub_stamp":"2024-09-21T06:21:37.191501+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:19.981367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'6","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962414+0000","last_change":"2024-09-21T06:26:16.268440+0000","last_active":"2024-09-21T06:26:38.962414+0000","last_peered":"2024-09-21T06:26:38.962414+0000","last_clean":"2024-09-21T06:26:38.962414+0000","last_became_active":"2024-09-21T06:26:16.268078+0000","last_became_peered":"2024-09-21T06:26:16.268078+0000","last_unstale":"2024-09-21T06:26:38.962414+0000","last_undegraded":"2024-09-21T06:26:38.962414+0000","last_fullsized":"2024-09-21T06:26:38.962414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:55.696736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963878+0000","last_change":"2024-09-21T06:26:18.306410+0000","last_active":"2024-09-21T06:26:38.963878+0000","last_peered":"2024-09-21T06:26:38.963878+0000","last_clean":"2024-09-21T06:26:38.963878+0000","last_became_active":"2024-09-21T06:26:18.304718+0000","last_became_peered":"2024-09-21T06:26:18.304718+0000","last_unstale":"2024-09-21T06:26:38.963878+0000","last_undegraded":"2024-09-21T06:26:38.963878+0000","last_fullsized":"2024-09-21T06:26:38.963878+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:18.521867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964484+0000","last_change":"2024-09-21T06:26:16.270305+0000","last_active":"2024-09-21T06:26:38.964484+0000","last_peered":"2024-09-21T06:26:38.964484+0000","last_clean":"2024-09-21T06:26:38.964484+0000","last_became_active":"2024-09-21T06:26:16.269891+0000","last_became_peered":"2024-09-21T06:26:16.269891+0000","last_unstale":"2024-09-21T06:26:38.964484+0000","last_undegraded":"2024-09-21T06:26:38.964484+0000","last_fullsized":"2024-09-21T06:26:38.964484+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:48.575805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966049+0000","last_change":"2024-09-21T06:26:18.302404+0000","last_active":"2024-09-21T06:26:38.966049+0000","last_peered":"2024-09-21T06:26:38.966049+0000","last_clean":"2024-09-21T06:26:38.966049+0000","last_became_active":"2024-09-21T06:26:18.302036+0000","last_became_peered":"2024-09-21T06:26:18.302036+0000","last_unstale":"2024-09-21T06:26:38.966049+0000","last_undegraded":"2024-09-21T06:26:38.966049+0000","last_fullsized":"2024-09-21T06:26:38.966049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:36.688018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967176+0000","last_change":"2024-09-21T06:26:16.310996+0000","last_active":"2024-09-21T06:26:38.967176+0000","last_peered":"2024-09-21T06:26:38.967176+0000","last_clean":"2024-09-21T06:26:38.967176+0000","last_became_active":"2024-09-21T06:26:16.310566+0000","last_became_peered":"2024-09-21T06:26:16.310566+0000","last_unstale":"2024-09-21T06:26:38.967176+0000","last_undegraded":"2024-09-21T06:26:38.967176+0000","last_fullsized":"2024-09-21T06:26:38.967176+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:27.569789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971180+0000","last_change":"2024-09-21T06:26:18.310343+0000","last_active":"2024-09-21T06:26:38.971180+0000","last_peered":"2024-09-21T06:26:38.971180+0000","last_clean":"2024-09-21T06:26:38.971180+0000","last_became_active":"2024-09-21T06:26:18.309979+0000","last_became_peered":"2024-09-21T06:26:18.309979+0000","last_unstale":"2024-09-21T06:26:38.971180+0000","last_undegraded":"2024-09-21T06:26:38.971180+0000","last_fullsized":"2024-09-21T06:26:38.971180+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:20.340822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'5","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:39.976030+0000","last_change":"2024-09-21T06:26:38.974313+0000","last_active":"2024-09-21T06:26:39.976030+0000","last_peered":"2024-09-21T06:26:39.976030+0000","last_clean":"2024-09-21T06:26:39.976030+0000","last_became_active":"2024-09-21T06:26:38.966498+0000","last_became_peered":"2024-09-21T06:26:38.966498+0000","last_unstale":"2024-09-21T06:26:39.976030+0000","last_undegraded":"2024-09-21T06:26:39.976030+0000","last_fullsized":"2024-09-21T06:26:39.976030+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:56.732330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":588,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964787+0000","last_change":"2024-09-21T06:26:18.312080+0000","last_active":"2024-09-21T06:26:38.964787+0000","last_peered":"2024-09-21T06:26:38.964787+0000","last_clean":"2024-09-21T06:26:38.964787+0000","last_became_active":"2024-09-21T06:26:18.311351+0000","last_became_peered":"2024-09-21T06:26:18.311351+0000","last_unstale":"2024-09-21T06:26:38.964787+0000","last_undegraded":"2024-09-21T06:26:38.964787+0000","last_fullsized":"2024-09-21T06:26:38.964787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:33.545677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965339+0000","last_change":"2024-09-21T06:26:16.311108+0000","last_active":"2024-09-21T06:26:38.965339+0000","last_peered":"2024-09-21T06:26:38.965339+0000","last_clean":"2024-09-21T06:26:38.965339+0000","last_became_active":"2024-09-21T06:26:16.310595+0000","last_became_peered":"2024-09-21T06:26:16.310595+0000","last_unstale":"2024-09-21T06:26:38.965339+0000","last_undegraded":"2024-09-21T06:26:38.965339+0000","last_fullsized":"2024-09-21T06:26:38.965339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:43.125242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964942+0000","last_change":"2024-09-21T06:26:18.300618+0000","last_active":"2024-09-21T06:26:38.964942+0000","last_peered":"2024-09-21T06:26:38.964942+0000","last_clean":"2024-09-21T06:26:38.964942+0000","last_became_active":"2024-09-21T06:26:18.300234+0000","last_became_peered":"2024-09-21T06:26:18.300234+0000","last_unstale":"2024-09-21T06:26:38.964942+0000","last_undegraded":"2024-09-21T06:26:38.964942+0000","last_fullsized":"2024-09-21T06:26:38.964942+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:53.224425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'4","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.982480+0000","last_change":"2024-09-21T06:26:38.981999+0000","last_active":"2024-09-21T06:26:38.982480+0000","last_peered":"2024-09-21T06:26:38.982480+0000","last_clean":"2024-09-21T06:26:38.982480+0000","last_became_active":"2024-09-21T06:26:38.969199+0000","last_became_peered":"2024-09-21T06:26:38.969199+0000","last_unstale":"2024-09-21T06:26:38.982480+0000","last_undegraded":"2024-09-21T06:26:38.982480+0000","last_fullsized":"2024-09-21T06:26:38.982480+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:17.389262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965217+0000","last_change":"2024-09-21T06:26:18.297693+0000","last_active":"2024-09-21T06:26:38.965217+0000","last_peered":"2024-09-21T06:26:38.965217+0000","last_clean":"2024-09-21T06:26:38.965217+0000","last_became_active":"2024-09-21T06:26:18.297335+0000","last_became_peered":"2024-09-21T06:26:18.297335+0000","last_unstale":"2024-09-21T06:26:38.965217+0000","last_undegraded":"2024-09-21T06:26:38.965217+0000","last_fullsized":"2024-09-21T06:26:38.965217+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:30.144220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'13","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:40.294033+0000","last_change":"2024-09-21T06:26:16.269854+0000","last_active":"2024-09-21T06:26:40.294033+0000","last_peered":"2024-09-21T06:26:40.294033+0000","last_clean":"2024-09-21T06:26:40.294033+0000","last_became_active":"2024-09-21T06:26:16.269415+0000","last_became_peered":"2024-09-21T06:26:16.269415+0000","last_unstale":"2024-09-21T06:26:40.294033+0000","last_undegraded":"2024-09-21T06:26:40.294033+0000","last_fullsized":"2024-09-21T06:26:40.294033+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:50.525916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964317+0000","last_change":"2024-09-21T06:26:18.306302+0000","last_active":"2024-09-21T06:26:38.964317+0000","last_peered":"2024-09-21T06:26:38.964317+0000","last_clean":"2024-09-21T06:26:38.964317+0000","last_became_active":"2024-09-21T06:26:18.305723+0000","last_became_peered":"2024-09-21T06:26:18.305723+0000","last_unstale":"2024-09-21T06:26:38.964317+0000","last_undegraded":"2024-09-21T06:26:38.964317+0000","last_fullsized":"2024-09-21T06:26:38.964317+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:30.051791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'7","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962517+0000","last_change":"2024-09-21T06:26:16.573081+0000","last_active":"2024-09-21T06:26:38.962517+0000","last_peered":"2024-09-21T06:26:38.962517+0000","last_clean":"2024-09-21T06:26:38.962517+0000","last_became_active":"2024-09-21T06:26:16.572680+0000","last_became_peered":"2024-09-21T06:26:16.572680+0000","last_unstale":"2024-09-21T06:26:38.962517+0000","last_undegraded":"2024-09-21T06:26:38.962517+0000","last_fullsized":"2024-09-21T06:26:38.962517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:04.698258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967148+0000","last_change":"2024-09-21T06:26:18.311610+0000","last_active":"2024-09-21T06:26:38.967148+0000","last_peered":"2024-09-21T06:26:38.967148+0000","last_clean":"2024-09-21T06:26:38.967148+0000","last_became_active":"2024-09-21T06:26:18.311239+0000","last_became_peered":"2024-09-21T06:26:18.311239+0000","last_unstale":"2024-09-21T06:26:38.967148+0000","last_undegraded":"2024-09-21T06:26:38.967148+0000","last_fullsized":"2024-09-21T06:26:38.967148+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:36.995768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965260+0000","last_change":"2024-09-21T06:26:16.313612+0000","last_active":"2024-09-21T06:26:38.965260+0000","last_peered":"2024-09-21T06:26:38.965260+0000","last_clean":"2024-09-21T06:26:38.965260+0000","last_became_active":"2024-09-21T06:26:16.313298+0000","last_became_peered":"2024-09-21T06:26:16.313298+0000","last_unstale":"2024-09-21T06:26:38.965260+0000","last_undegraded":"2024-09-21T06:26:38.965260+0000","last_fullsized":"2024-09-21T06:26:38.965260+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:45.035454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963931+0000","last_change":"2024-09-21T06:26:18.304772+0000","last_active":"2024-09-21T06:26:38.963931+0000","last_peered":"2024-09-21T06:26:38.963931+0000","last_clean":"2024-09-21T06:26:38.963931+0000","last_became_active":"2024-09-21T06:26:18.303909+0000","last_became_peered":"2024-09-21T06:26:18.303909+0000","last_unstale":"2024-09-21T06:26:38.963931+0000","last_undegraded":"2024-09-21T06:26:38.963931+0000","last_fullsized":"2024-09-21T06:26:38.963931+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:28.707169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963811+0000","last_change":"2024-09-21T06:26:16.267563+0000","last_active":"2024-09-21T06:26:38.963811+0000","last_peered":"2024-09-21T06:26:38.963811+0000","last_clean":"2024-09-21T06:26:38.963811+0000","last_became_active":"2024-09-21T06:26:16.267182+0000","last_became_peered":"2024-09-21T06:26:16.267182+0000","last_unstale":"2024-09-21T06:26:38.963811+0000","last_undegraded":"2024-09-21T06:26:38.963811+0000","last_fullsized":"2024-09-21T06:26:38.963811+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:16.042105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.961758+0000","last_change":"2024-09-21T06:26:18.310772+0000","last_active":"2024-09-21T06:26:38.961758+0000","last_peered":"2024-09-21T06:26:38.961758+0000","last_clean":"2024-09-21T06:26:38.961758+0000","last_became_active":"2024-09-21T06:26:18.310382+0000","last_became_peered":"2024-09-21T06:26:18.310382+0000","last_unstale":"2024-09-21T06:26:38.961758+0000","last_undegraded":"2024-09-21T06:26:38.961758+0000","last_fullsized":"2024-09-21T06:26:38.961758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:54:35.028081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967712+0000","last_change":"2024-09-21T06:26:16.270971+0000","last_active":"2024-09-21T06:26:38.967712+0000","last_peered":"2024-09-21T06:26:38.967712+0000","last_clean":"2024-09-21T06:26:38.967712+0000","last_became_active":"2024-09-21T06:26:16.270453+0000","last_became_peered":"2024-09-21T06:26:16.270453+0000","last_unstale":"2024-09-21T06:26:38.967712+0000","last_undegraded":"2024-09-21T06:26:38.967712+0000","last_fullsized":"2024-09-21T06:26:38.967712+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:34.687380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963945+0000","last_change":"2024-09-21T06:26:18.300568+0000","last_active":"2024-09-21T06:26:38.963945+0000","last_peered":"2024-09-21T06:26:38.963945+0000","last_clean":"2024-09-21T06:26:38.963945+0000","last_became_active":"2024-09-21T06:26:18.298864+0000","last_became_peered":"2024-09-21T06:26:18.298864+0000","last_unstale":"2024-09-21T06:26:38.963945+0000","last_undegraded":"2024-09-21T06:26:38.963945+0000","last_fullsized":"2024-09-21T06:26:38.963945+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:00.786225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964246+0000","last_change":"2024-09-21T06:26:16.274093+0000","last_active":"2024-09-21T06:26:38.964246+0000","last_peered":"2024-09-21T06:26:38.964246+0000","last_clean":"2024-09-21T06:26:38.964246+0000","last_became_active":"2024-09-21T06:26:16.273707+0000","last_became_peered":"2024-09-21T06:26:16.273707+0000","last_unstale":"2024-09-21T06:26:38.964246+0000","last_undegraded":"2024-09-21T06:26:38.964246+0000","last_fullsized":"2024-09-21T06:26:38.964246+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:26.710260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965837+0000","last_change":"2024-09-21T06:26:18.300140+0000","last_active":"2024-09-21T06:26:38.965837+0000","last_peered":"2024-09-21T06:26:38.965837+0000","last_clean":"2024-09-21T06:26:38.965837+0000","last_became_active":"2024-09-21T06:26:18.299543+0000","last_became_peered":"2024-09-21T06:26:18.299543+0000","last_unstale":"2024-09-21T06:26:38.965837+0000","last_undegraded":"2024-09-21T06:26:38.965837+0000","last_fullsized":"2024-09-21T06:26:38.965837+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:50.272247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.970973+0000","last_change":"2024-09-21T06:26:18.311528+0000","last_active":"2024-09-21T06:26:38.970973+0000","last_peered":"2024-09-21T06:26:38.970973+0000","last_clean":"2024-09-21T06:26:38.970973+0000","last_became_active":"2024-09-21T06:26:18.311144+0000","last_became_peered":"2024-09-21T06:26:18.311144+0000","last_unstale":"2024-09-21T06:26:38.970973+0000","last_undegraded":"2024-09-21T06:26:38.970973+0000","last_fullsized":"2024-09-21T06:26:38.970973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:05.554255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964467+0000","last_change":"2024-09-21T06:26:16.275378+0000","last_active":"2024-09-21T06:26:38.964467+0000","last_peered":"2024-09-21T06:26:38.964467+0000","last_clean":"2024-09-21T06:26:38.964467+0000","last_became_active":"2024-09-21T06:26:16.274990+0000","last_became_peered":"2024-09-21T06:26:16.274990+0000","last_unstale":"2024-09-21T06:26:38.964467+0000","last_undegraded":"2024-09-21T06:26:38.964467+0000","last_fullsized":"2024-09-21T06:26:38.964467+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:57.252993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966421+0000","last_change":"2024-09-21T06:26:18.300879+0000","last_active":"2024-09-21T06:26:38.966421+0000","last_peered":"2024-09-21T06:26:38.966421+0000","last_clean":"2024-09-21T06:26:38.966421+0000","last_became_active":"2024-09-21T06:26:18.300514+0000","last_became_peered":"2024-09-21T06:26:18.300514+0000","last_unstale":"2024-09-21T06:26:38.966421+0000","last_undegraded":"2024-09-21T06:26:38.966421+0000","last_fullsized":"2024-09-21T06:26:38.966421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:02.581145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'12","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964519+0000","last_change":"2024-09-21T06:26:16.274139+0000","last_active":"2024-09-21T06:26:38.964519+0000","last_peered":"2024-09-21T06:26:38.964519+0000","last_clean":"2024-09-21T06:26:38.964519+0000","last_became_active":"2024-09-21T06:26:16.273723+0000","last_became_peered":"2024-09-21T06:26:16.273723+0000","last_unstale":"2024-09-21T06:26:38.964519+0000","last_undegraded":"2024-09-21T06:26:38.964519+0000","last_fullsized":"2024-09-21T06:26:38.964519+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:24.366714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967496+0000","last_change":"2024-09-21T06:26:18.304602+0000","last_active":"2024-09-21T06:26:38.967496+0000","last_peered":"2024-09-21T06:26:38.967496+0000","last_clean":"2024-09-21T06:26:38.967496+0000","last_became_active":"2024-09-21T06:26:18.304259+0000","last_became_peered":"2024-09-21T06:26:18.304259+0000","last_unstale":"2024-09-21T06:26:38.967496+0000","last_undegraded":"2024-09-21T06:26:38.967496+0000","last_fullsized":"2024-09-21T06:26:38.967496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:16.428247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964281+0000","last_change":"2024-09-21T06:26:16.311107+0000","last_active":"2024-09-21T06:26:38.964281+0000","last_peered":"2024-09-21T06:26:38.964281+0000","last_clean":"2024-09-21T06:26:38.964281+0000","last_became_active":"2024-09-21T06:26:16.310692+0000","last_became_peered":"2024-09-21T06:26:16.310692+0000","last_unstale":"2024-09-21T06:26:38.964281+0000","last_undegraded":"2024-09-21T06:26:38.964281+0000","last_fullsized":"2024-09-21T06:26:38.964281+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:29.074606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964061+0000","last_change":"2024-09-21T06:26:18.300614+0000","last_active":"2024-09-21T06:26:38.964061+0000","last_peered":"2024-09-21T06:26:38.964061+0000","last_clean":"2024-09-21T06:26:38.964061+0000","last_became_active":"2024-09-21T06:26:18.300173+0000","last_became_peered":"2024-09-21T06:26:18.300173+0000","last_unstale":"2024-09-21T06:26:38.964061+0000","last_undegraded":"2024-09-21T06:26:38.964061+0000","last_fullsized":"2024-09-21T06:26:38.964061+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:49.040667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'13","reported_seq":72,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:41.978420+0000","last_change":"2024-09-21T06:26:38.986822+0000","last_active":"2024-09-21T06:26:41.978420+0000","last_peered":"2024-09-21T06:26:41.978420+0000","last_clean":"2024-09-21T06:26:41.978420+0000","last_became_active":"2024-09-21T06:26:38.972368+0000","last_became_peered":"2024-09-21T06:26:38.972368+0000","last_unstale":"2024-09-21T06:26:41.978420+0000","last_undegraded":"2024-09-21T06:26:41.978420+0000","last_fullsized":"2024-09-21T06:26:41.978420+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:53.273388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":52407,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":141,"num_read_kb":129,"num_write":233,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1484,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":174297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282590,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743440,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":860160,"data_stored":420766,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939670,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":974848,"data_stored":1047587,"data_compressed":38888,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103196,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":876544,"data_stored":419722,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299425,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":419199,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495654,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":1011913,"data_compressed":41842,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659179,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":419322,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855408,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":1003077,"data_compressed":38888,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":864256,"data_stored":419686,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":419030,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378688,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":474475,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542213,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":917504,"data_stored":474648,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":876544,"data_stored":421052,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":56165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":55992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":47330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:26:45.098 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:26:45.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:44 smithi071 ceph-mon[34844]: pgmap v278: 97 pgs: 97 active+clean; 628 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.0 KiB/s wr, 10 op/s; 200 B/s, 2 objects/s recovering 2024-09-21T06:26:45.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:44 smithi071 ceph-mon[34844]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:26:45.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:44 smithi063 ceph-mon[31150]: pgmap v278: 97 pgs: 97 active+clean; 628 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.0 KiB/s wr, 10 op/s; 200 B/s, 2 objects/s recovering 2024-09-21T06:26:45.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:44 smithi063 ceph-mon[31150]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:26:45.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:44 smithi175 ceph-mon[34510]: pgmap v278: 97 pgs: 97 active+clean; 628 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.0 KiB/s wr, 10 op/s; 200 B/s, 2 objects/s recovering 2024-09-21T06:26:45.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:44 smithi175 ceph-mon[34510]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:26:45.356 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.861+0000 7f1e36362640 1 -- 172.21.15.63:0/2891868957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e301048c0 msgr2=0x7f1e30104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.861+0000 7f1e36362640 1 --2- 172.21.15.63:0/2891868957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e301048c0 0x7f1e30104cd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009900 tx=0x7f1e2002a410 comp rx=0 tx=0).stop 2024-09-21T06:26:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.861+0000 7f1e36362640 1 -- 172.21.15.63:0/2891868957 shutdown_connections 2024-09-21T06:26:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.861+0000 7f1e36362640 1 --2- 172.21.15.63:0/2891868957 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e3010de70 0x7f1e30110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.861+0000 7f1e36362640 1 --2- 172.21.15.63:0/2891868957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e301052a0 0x7f1e3010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.861+0000 7f1e36362640 1 --2- 172.21.15.63:0/2891868957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e301048c0 0x7f1e30104cd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.861+0000 7f1e36362640 1 -- 172.21.15.63:0/2891868957 >> 172.21.15.63:0/2891868957 conn(0x7f1e30079760 msgr2=0x7f1e30079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.861+0000 7f1e36362640 1 -- 172.21.15.63:0/2891868957 shutdown_connections 2024-09-21T06:26:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.861+0000 7f1e36362640 1 -- 172.21.15.63:0/2891868957 wait complete. 2024-09-21T06:26:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.861+0000 7f1e36362640 1 Processor -- start 2024-09-21T06:26:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.861+0000 7f1e36362640 1 -- start start 2024-09-21T06:26:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.862+0000 7f1e36362640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e301048c0 0x7f1e3019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.862+0000 7f1e36362640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e301052a0 0x7f1e3019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.862+0000 7f1e36362640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e3010de70 0x7f1e3019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.862+0000 7f1e36362640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1e30113ad0 con 0x7f1e301048c0 2024-09-21T06:26:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.862+0000 7f1e36362640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1e30113950 con 0x7f1e301052a0 2024-09-21T06:26:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.862+0000 7f1e36362640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1e30113c50 con 0x7f1e3010de70 2024-09-21T06:26:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.862+0000 7f1e2ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e301048c0 0x7f1e3019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.862+0000 7f1e2ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e301048c0 0x7f1e3019a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44916/0 (socket says 172.21.15.63:44916) 2024-09-21T06:26:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.862+0000 7f1e2ffff640 1 -- 172.21.15.63:0/3577106163 learned_addr learned my addr 172.21.15.63:0/3577106163 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.862+0000 7f1e2f7fe640 1 --2- 172.21.15.63:0/3577106163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e301052a0 0x7f1e3019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:45.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.862+0000 7f1e2ffff640 1 -- 172.21.15.63:0/3577106163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e3010de70 msgr2=0x7f1e3019fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:45.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.862+0000 7f1e2ffff640 1 --2- 172.21.15.63:0/3577106163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e3010de70 0x7f1e3019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:45.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.862+0000 7f1e2ffff640 1 -- 172.21.15.63:0/3577106163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e301052a0 msgr2=0x7f1e3019aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:45.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.862+0000 7f1e2ffff640 1 --2- 172.21.15.63:0/3577106163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e301052a0 0x7f1e3019aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:45.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.862+0000 7f1e2ffff640 1 -- 172.21.15.63:0/3577106163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e301a0470 con 0x7f1e301048c0 2024-09-21T06:26:45.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.863+0000 7f1e2ffff640 1 --2- 172.21.15.63:0/3577106163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e301048c0 0x7f1e3019a500 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1e20032fd0 tx=0x7f1e20004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:45.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.863+0000 7f1e2d7fa640 1 -- 172.21.15.63:0/3577106163 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2003f030 con 0x7f1e301048c0 2024-09-21T06:26:45.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.863+0000 7f1e2d7fa640 1 -- 172.21.15.63:0/3577106163 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e20004490 con 0x7f1e301048c0 2024-09-21T06:26:45.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.863+0000 7f1e2d7fa640 1 -- 172.21.15.63:0/3577106163 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e20035070 con 0x7f1e301048c0 2024-09-21T06:26:45.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.863+0000 7f1e36362640 1 -- 172.21.15.63:0/3577106163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e301a0700 con 0x7f1e301048c0 2024-09-21T06:26:45.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.863+0000 7f1e36362640 1 -- 172.21.15.63:0/3577106163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e301a6ec0 con 0x7f1e301048c0 2024-09-21T06:26:45.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.864+0000 7f1e36362640 1 -- 172.21.15.63:0/3577106163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e3006c190 con 0x7f1e301048c0 2024-09-21T06:26:45.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.865+0000 7f1e2d7fa640 1 -- 172.21.15.63:0/3577106163 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f1e20042030 con 0x7f1e301048c0 2024-09-21T06:26:45.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.866+0000 7f1e2d7fa640 1 --2- 172.21.15.63:0/3577106163 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1e1c0b65f0 0x7f1e1c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:45.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.866+0000 7f1e2f7fe640 1 --2- 172.21.15.63:0/3577106163 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1e1c0b65f0 0x7f1e1c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:45.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.866+0000 7f1e2d7fa640 1 -- 172.21.15.63:0/3577106163 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f1e20107f80 con 0x7f1e301048c0 2024-09-21T06:26:45.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.867+0000 7f1e2f7fe640 1 --2- 172.21.15.63:0/3577106163 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1e1c0b65f0 0x7f1e1c0b8b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1e18005fd0 tx=0x7f1e18005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:45.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:45.869+0000 7f1e2d7fa640 1 -- 172.21.15.63:0/3577106163 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1e200ce5d0 con 0x7f1e301048c0 2024-09-21T06:26:46.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:46.056+0000 7f1e36362640 1 -- 172.21.15.63:0/3577106163 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1e30063800 con 0x7f1e1c0b65f0 2024-09-21T06:26:46.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:46.061+0000 7f1e2d7fa640 1 -- 172.21.15.63:0/3577106163 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259041 (secure 0 0 0) 0x7f1e30063800 con 0x7f1e1c0b65f0 2024-09-21T06:26:46.065 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:26:46.065 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T06:26:46.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:46.063+0000 7f1e36362640 1 -- 172.21.15.63:0/3577106163 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1e1c0b65f0 msgr2=0x7f1e1c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:46.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:46.063+0000 7f1e36362640 1 --2- 172.21.15.63:0/3577106163 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1e1c0b65f0 0x7f1e1c0b8b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1e18005fd0 tx=0x7f1e18005850 comp rx=0 tx=0).stop 2024-09-21T06:26:46.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:46.063+0000 7f1e36362640 1 -- 172.21.15.63:0/3577106163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e301048c0 msgr2=0x7f1e3019a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:46.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:46.063+0000 7f1e36362640 1 --2- 172.21.15.63:0/3577106163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e301048c0 0x7f1e3019a500 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1e20032fd0 tx=0x7f1e20004270 comp rx=0 tx=0).stop 2024-09-21T06:26:46.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:46.064+0000 7f1e36362640 1 -- 172.21.15.63:0/3577106163 shutdown_connections 2024-09-21T06:26:46.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:46.064+0000 7f1e36362640 1 --2- 172.21.15.63:0/3577106163 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1e1c0b65f0 0x7f1e1c0b8b00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:46.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:46.064+0000 7f1e36362640 1 --2- 172.21.15.63:0/3577106163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e3010de70 0x7f1e3019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:46.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:46.064+0000 7f1e36362640 1 --2- 172.21.15.63:0/3577106163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e301052a0 0x7f1e3019aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:46.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:46.064+0000 7f1e36362640 1 --2- 172.21.15.63:0/3577106163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e301048c0 0x7f1e3019a500 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:46.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:46.064+0000 7f1e36362640 1 -- 172.21.15.63:0/3577106163 >> 172.21.15.63:0/3577106163 conn(0x7f1e30079760 msgr2=0x7f1e300ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:46.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:46.064+0000 7f1e36362640 1 -- 172.21.15.63:0/3577106163 shutdown_connections 2024-09-21T06:26:46.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:46.064+0000 7f1e36362640 1 -- 172.21.15.63:0/3577106163 wait complete. 2024-09-21T06:26:46.982 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-09-21T06:26:45.871963+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651547,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":258,"num_read_kb":227,"num_write":362,"num_write_kb":2280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":2953441,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":298,"ondisk_log_size":298,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376424,"kb_used_data":10488,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565400,"statfs":{"total":1151940427776,"available":1151554969600,"internally_reserved":0,"allocated":10739712,"data_stored":6976437,"data_compressed":178635,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45763,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":87,"num_write":27,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":1601,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002127"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962115+0000","last_change":"2024-09-21T06:26:18.307729+0000","last_active":"2024-09-21T06:26:38.962115+0000","last_peered":"2024-09-21T06:26:38.962115+0000","last_clean":"2024-09-21T06:26:38.962115+0000","last_became_active":"2024-09-21T06:26:18.306345+0000","last_became_peered":"2024-09-21T06:26:18.306345+0000","last_unstale":"2024-09-21T06:26:38.962115+0000","last_undegraded":"2024-09-21T06:26:38.962115+0000","last_fullsized":"2024-09-21T06:26:38.962115+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:58.409506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967037+0000","last_change":"2024-09-21T06:26:18.302982+0000","last_active":"2024-09-21T06:26:38.967037+0000","last_peered":"2024-09-21T06:26:38.967037+0000","last_clean":"2024-09-21T06:26:38.967037+0000","last_became_active":"2024-09-21T06:26:18.302636+0000","last_became_peered":"2024-09-21T06:26:18.302636+0000","last_unstale":"2024-09-21T06:26:38.967037+0000","last_undegraded":"2024-09-21T06:26:38.967037+0000","last_fullsized":"2024-09-21T06:26:38.967037+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:28.165964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967428+0000","last_change":"2024-09-21T06:26:18.305293+0000","last_active":"2024-09-21T06:26:38.967428+0000","last_peered":"2024-09-21T06:26:38.967428+0000","last_clean":"2024-09-21T06:26:38.967428+0000","last_became_active":"2024-09-21T06:26:18.304689+0000","last_became_peered":"2024-09-21T06:26:18.304689+0000","last_unstale":"2024-09-21T06:26:38.967428+0000","last_undegraded":"2024-09-21T06:26:38.967428+0000","last_fullsized":"2024-09-21T06:26:38.967428+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:37.442558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962224+0000","last_change":"2024-09-21T06:26:18.306443+0000","last_active":"2024-09-21T06:26:38.962224+0000","last_peered":"2024-09-21T06:26:38.962224+0000","last_clean":"2024-09-21T06:26:38.962224+0000","last_became_active":"2024-09-21T06:26:18.305062+0000","last_became_peered":"2024-09-21T06:26:18.305062+0000","last_unstale":"2024-09-21T06:26:38.962224+0000","last_undegraded":"2024-09-21T06:26:38.962224+0000","last_fullsized":"2024-09-21T06:26:38.962224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:07.896971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964110+0000","last_change":"2024-09-21T06:26:18.298857+0000","last_active":"2024-09-21T06:26:38.964110+0000","last_peered":"2024-09-21T06:26:38.964110+0000","last_clean":"2024-09-21T06:26:38.964110+0000","last_became_active":"2024-09-21T06:26:18.298439+0000","last_became_peered":"2024-09-21T06:26:18.298439+0000","last_unstale":"2024-09-21T06:26:38.964110+0000","last_undegraded":"2024-09-21T06:26:38.964110+0000","last_fullsized":"2024-09-21T06:26:38.964110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:24.695856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964685+0000","last_change":"2024-09-21T06:26:18.313029+0000","last_active":"2024-09-21T06:26:38.964685+0000","last_peered":"2024-09-21T06:26:38.964685+0000","last_clean":"2024-09-21T06:26:38.964685+0000","last_became_active":"2024-09-21T06:26:18.312627+0000","last_became_peered":"2024-09-21T06:26:18.312627+0000","last_unstale":"2024-09-21T06:26:38.964685+0000","last_undegraded":"2024-09-21T06:26:38.964685+0000","last_fullsized":"2024-09-21T06:26:38.964685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:23.086862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965223+0000","last_change":"2024-09-21T06:26:18.299082+0000","last_active":"2024-09-21T06:26:38.965223+0000","last_peered":"2024-09-21T06:26:38.965223+0000","last_clean":"2024-09-21T06:26:38.965223+0000","last_became_active":"2024-09-21T06:26:18.298279+0000","last_became_peered":"2024-09-21T06:26:18.298279+0000","last_unstale":"2024-09-21T06:26:38.965223+0000","last_undegraded":"2024-09-21T06:26:38.965223+0000","last_fullsized":"2024-09-21T06:26:38.965223+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:05.652407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963617+0000","last_change":"2024-09-21T06:26:18.298565+0000","last_active":"2024-09-21T06:26:38.963617+0000","last_peered":"2024-09-21T06:26:38.963617+0000","last_clean":"2024-09-21T06:26:38.963617+0000","last_became_active":"2024-09-21T06:26:18.298172+0000","last_became_peered":"2024-09-21T06:26:18.298172+0000","last_unstale":"2024-09-21T06:26:38.963617+0000","last_undegraded":"2024-09-21T06:26:38.963617+0000","last_fullsized":"2024-09-21T06:26:38.963617+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:33.045038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967371+0000","last_change":"2024-09-21T06:26:18.304901+0000","last_active":"2024-09-21T06:26:38.967371+0000","last_peered":"2024-09-21T06:26:38.967371+0000","last_clean":"2024-09-21T06:26:38.967371+0000","last_became_active":"2024-09-21T06:26:18.304521+0000","last_became_peered":"2024-09-21T06:26:18.304521+0000","last_unstale":"2024-09-21T06:26:38.967371+0000","last_undegraded":"2024-09-21T06:26:38.967371+0000","last_fullsized":"2024-09-21T06:26:38.967371+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:31.859554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.970297+0000","last_change":"2024-09-21T06:26:38.970119+0000","last_active":"2024-09-21T06:26:38.970297+0000","last_peered":"2024-09-21T06:26:38.970297+0000","last_clean":"2024-09-21T06:26:38.970297+0000","last_became_active":"2024-09-21T06:26:38.969521+0000","last_became_peered":"2024-09-21T06:26:38.969521+0000","last_unstale":"2024-09-21T06:26:38.970297+0000","last_undegraded":"2024-09-21T06:26:38.970297+0000","last_fullsized":"2024-09-21T06:26:38.970297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:54.407153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966009+0000","last_change":"2024-09-21T06:26:18.300178+0000","last_active":"2024-09-21T06:26:38.966009+0000","last_peered":"2024-09-21T06:26:38.966009+0000","last_clean":"2024-09-21T06:26:38.966009+0000","last_became_active":"2024-09-21T06:26:18.298651+0000","last_became_peered":"2024-09-21T06:26:18.298651+0000","last_unstale":"2024-09-21T06:26:38.966009+0000","last_undegraded":"2024-09-21T06:26:38.966009+0000","last_fullsized":"2024-09-21T06:26:38.966009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:07.261974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962238+0000","last_change":"2024-09-21T06:26:18.311310+0000","last_active":"2024-09-21T06:26:38.962238+0000","last_peered":"2024-09-21T06:26:38.962238+0000","last_clean":"2024-09-21T06:26:38.962238+0000","last_became_active":"2024-09-21T06:26:18.310671+0000","last_became_peered":"2024-09-21T06:26:18.310671+0000","last_unstale":"2024-09-21T06:26:38.962238+0000","last_undegraded":"2024-09-21T06:26:38.962238+0000","last_fullsized":"2024-09-21T06:26:38.962238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:52.060682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965742+0000","last_change":"2024-09-21T06:26:18.296958+0000","last_active":"2024-09-21T06:26:38.965742+0000","last_peered":"2024-09-21T06:26:38.965742+0000","last_clean":"2024-09-21T06:26:38.965742+0000","last_became_active":"2024-09-21T06:26:18.296081+0000","last_became_peered":"2024-09-21T06:26:18.296081+0000","last_unstale":"2024-09-21T06:26:38.965742+0000","last_undegraded":"2024-09-21T06:26:38.965742+0000","last_fullsized":"2024-09-21T06:26:38.965742+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:28.501906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966438+0000","last_change":"2024-09-21T06:26:18.301289+0000","last_active":"2024-09-21T06:26:38.966438+0000","last_peered":"2024-09-21T06:26:38.966438+0000","last_clean":"2024-09-21T06:26:38.966438+0000","last_became_active":"2024-09-21T06:26:18.300834+0000","last_became_peered":"2024-09-21T06:26:18.300834+0000","last_unstale":"2024-09-21T06:26:38.966438+0000","last_undegraded":"2024-09-21T06:26:38.966438+0000","last_fullsized":"2024-09-21T06:26:38.966438+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:31.206650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966259+0000","last_change":"2024-09-21T06:26:18.312436+0000","last_active":"2024-09-21T06:26:38.966259+0000","last_peered":"2024-09-21T06:26:38.966259+0000","last_clean":"2024-09-21T06:26:38.966259+0000","last_became_active":"2024-09-21T06:26:18.311230+0000","last_became_peered":"2024-09-21T06:26:18.311230+0000","last_unstale":"2024-09-21T06:26:38.966259+0000","last_undegraded":"2024-09-21T06:26:38.966259+0000","last_fullsized":"2024-09-21T06:26:38.966259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:07.163105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966586+0000","last_change":"2024-09-21T06:26:18.307775+0000","last_active":"2024-09-21T06:26:38.966586+0000","last_peered":"2024-09-21T06:26:38.966586+0000","last_clean":"2024-09-21T06:26:38.966586+0000","last_became_active":"2024-09-21T06:26:18.307326+0000","last_became_peered":"2024-09-21T06:26:18.307326+0000","last_unstale":"2024-09-21T06:26:38.966586+0000","last_undegraded":"2024-09-21T06:26:38.966586+0000","last_fullsized":"2024-09-21T06:26:38.966586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:18.213503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962147+0000","last_change":"2024-09-21T06:26:18.309004+0000","last_active":"2024-09-21T06:26:38.962147+0000","last_peered":"2024-09-21T06:26:38.962147+0000","last_clean":"2024-09-21T06:26:38.962147+0000","last_became_active":"2024-09-21T06:26:18.306098+0000","last_became_peered":"2024-09-21T06:26:18.306098+0000","last_unstale":"2024-09-21T06:26:38.962147+0000","last_undegraded":"2024-09-21T06:26:38.962147+0000","last_fullsized":"2024-09-21T06:26:38.962147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:09.102610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965512+0000","last_change":"2024-09-21T06:26:18.306699+0000","last_active":"2024-09-21T06:26:38.965512+0000","last_peered":"2024-09-21T06:26:38.965512+0000","last_clean":"2024-09-21T06:26:38.965512+0000","last_became_active":"2024-09-21T06:26:18.306352+0000","last_became_peered":"2024-09-21T06:26:18.306352+0000","last_unstale":"2024-09-21T06:26:38.965512+0000","last_undegraded":"2024-09-21T06:26:38.965512+0000","last_fullsized":"2024-09-21T06:26:38.965512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:47.992315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.968447+0000","last_change":"2024-09-21T06:26:18.301677+0000","last_active":"2024-09-21T06:26:38.968447+0000","last_peered":"2024-09-21T06:26:38.968447+0000","last_clean":"2024-09-21T06:26:38.968447+0000","last_became_active":"2024-09-21T06:26:18.301260+0000","last_became_peered":"2024-09-21T06:26:18.301260+0000","last_unstale":"2024-09-21T06:26:38.968447+0000","last_undegraded":"2024-09-21T06:26:38.968447+0000","last_fullsized":"2024-09-21T06:26:38.968447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:53.209062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.961797+0000","last_change":"2024-09-21T06:26:18.312004+0000","last_active":"2024-09-21T06:26:38.961797+0000","last_peered":"2024-09-21T06:26:38.961797+0000","last_clean":"2024-09-21T06:26:38.961797+0000","last_became_active":"2024-09-21T06:26:18.311602+0000","last_became_peered":"2024-09-21T06:26:18.311602+0000","last_unstale":"2024-09-21T06:26:38.961797+0000","last_undegraded":"2024-09-21T06:26:38.961797+0000","last_fullsized":"2024-09-21T06:26:38.961797+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:30.074887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965890+0000","last_change":"2024-09-21T06:26:18.296581+0000","last_active":"2024-09-21T06:26:38.965890+0000","last_peered":"2024-09-21T06:26:38.965890+0000","last_clean":"2024-09-21T06:26:38.965890+0000","last_became_active":"2024-09-21T06:26:18.296078+0000","last_became_peered":"2024-09-21T06:26:18.296078+0000","last_unstale":"2024-09-21T06:26:38.965890+0000","last_undegraded":"2024-09-21T06:26:38.965890+0000","last_fullsized":"2024-09-21T06:26:38.965890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:39.120626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966804+0000","last_change":"2024-09-21T06:26:18.307793+0000","last_active":"2024-09-21T06:26:38.966804+0000","last_peered":"2024-09-21T06:26:38.966804+0000","last_clean":"2024-09-21T06:26:38.966804+0000","last_became_active":"2024-09-21T06:26:18.307310+0000","last_became_peered":"2024-09-21T06:26:18.307310+0000","last_unstale":"2024-09-21T06:26:38.966804+0000","last_undegraded":"2024-09-21T06:26:38.966804+0000","last_fullsized":"2024-09-21T06:26:38.966804+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:11.761986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963619+0000","last_change":"2024-09-21T06:26:18.305700+0000","last_active":"2024-09-21T06:26:38.963619+0000","last_peered":"2024-09-21T06:26:38.963619+0000","last_clean":"2024-09-21T06:26:38.963619+0000","last_became_active":"2024-09-21T06:26:18.305319+0000","last_became_peered":"2024-09-21T06:26:18.305319+0000","last_unstale":"2024-09-21T06:26:38.963619+0000","last_undegraded":"2024-09-21T06:26:38.963619+0000","last_fullsized":"2024-09-21T06:26:38.963619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:52.479565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971092+0000","last_change":"2024-09-21T06:26:18.304111+0000","last_active":"2024-09-21T06:26:38.971092+0000","last_peered":"2024-09-21T06:26:38.971092+0000","last_clean":"2024-09-21T06:26:38.971092+0000","last_became_active":"2024-09-21T06:26:18.302716+0000","last_became_peered":"2024-09-21T06:26:18.302716+0000","last_unstale":"2024-09-21T06:26:38.971092+0000","last_undegraded":"2024-09-21T06:26:38.971092+0000","last_fullsized":"2024-09-21T06:26:38.971092+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:39.298737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964408+0000","last_change":"2024-09-21T06:26:18.310154+0000","last_active":"2024-09-21T06:26:38.964408+0000","last_peered":"2024-09-21T06:26:38.964408+0000","last_clean":"2024-09-21T06:26:38.964408+0000","last_became_active":"2024-09-21T06:26:18.309735+0000","last_became_peered":"2024-09-21T06:26:18.309735+0000","last_unstale":"2024-09-21T06:26:38.964408+0000","last_undegraded":"2024-09-21T06:26:38.964408+0000","last_fullsized":"2024-09-21T06:26:38.964408+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:42:37.535841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.968784+0000","last_change":"2024-09-21T06:26:18.312302+0000","last_active":"2024-09-21T06:26:38.968784+0000","last_peered":"2024-09-21T06:26:38.968784+0000","last_clean":"2024-09-21T06:26:38.968784+0000","last_became_active":"2024-09-21T06:26:18.311950+0000","last_became_peered":"2024-09-21T06:26:18.311950+0000","last_unstale":"2024-09-21T06:26:38.968784+0000","last_undegraded":"2024-09-21T06:26:38.968784+0000","last_fullsized":"2024-09-21T06:26:38.968784+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:03.899946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962182+0000","last_change":"2024-09-21T06:26:18.308291+0000","last_active":"2024-09-21T06:26:38.962182+0000","last_peered":"2024-09-21T06:26:38.962182+0000","last_clean":"2024-09-21T06:26:38.962182+0000","last_became_active":"2024-09-21T06:26:18.307907+0000","last_became_peered":"2024-09-21T06:26:18.307907+0000","last_unstale":"2024-09-21T06:26:38.962182+0000","last_undegraded":"2024-09-21T06:26:38.962182+0000","last_fullsized":"2024-09-21T06:26:38.962182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:17.418996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965105+0000","last_change":"2024-09-21T06:26:18.311774+0000","last_active":"2024-09-21T06:26:38.965105+0000","last_peered":"2024-09-21T06:26:38.965105+0000","last_clean":"2024-09-21T06:26:38.965105+0000","last_became_active":"2024-09-21T06:26:18.311373+0000","last_became_peered":"2024-09-21T06:26:18.311373+0000","last_unstale":"2024-09-21T06:26:38.965105+0000","last_undegraded":"2024-09-21T06:26:38.965105+0000","last_fullsized":"2024-09-21T06:26:38.965105+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:08.310931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.977753+0000","last_change":"2024-09-21T06:26:38.977655+0000","last_active":"2024-09-21T06:26:38.977753+0000","last_peered":"2024-09-21T06:26:38.977753+0000","last_clean":"2024-09-21T06:26:38.977753+0000","last_became_active":"2024-09-21T06:26:38.977309+0000","last_became_peered":"2024-09-21T06:26:38.977309+0000","last_unstale":"2024-09-21T06:26:38.977753+0000","last_undegraded":"2024-09-21T06:26:38.977753+0000","last_fullsized":"2024-09-21T06:26:38.977753+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:10.083264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967567+0000","last_change":"2024-09-21T06:26:18.302851+0000","last_active":"2024-09-21T06:26:38.967567+0000","last_peered":"2024-09-21T06:26:38.967567+0000","last_clean":"2024-09-21T06:26:38.967567+0000","last_became_active":"2024-09-21T06:26:18.302120+0000","last_became_peered":"2024-09-21T06:26:18.302120+0000","last_unstale":"2024-09-21T06:26:38.967567+0000","last_undegraded":"2024-09-21T06:26:38.967567+0000","last_fullsized":"2024-09-21T06:26:38.967567+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:18.442711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967011+0000","last_change":"2024-09-21T06:26:18.310447+0000","last_active":"2024-09-21T06:26:38.967011+0000","last_peered":"2024-09-21T06:26:38.967011+0000","last_clean":"2024-09-21T06:26:38.967011+0000","last_became_active":"2024-09-21T06:26:18.310079+0000","last_became_peered":"2024-09-21T06:26:18.310079+0000","last_unstale":"2024-09-21T06:26:38.967011+0000","last_undegraded":"2024-09-21T06:26:38.967011+0000","last_fullsized":"2024-09-21T06:26:38.967011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:14.364382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.961670+0000","last_change":"2024-09-21T06:26:18.307260+0000","last_active":"2024-09-21T06:26:38.961670+0000","last_peered":"2024-09-21T06:26:38.961670+0000","last_clean":"2024-09-21T06:26:38.961670+0000","last_became_active":"2024-09-21T06:26:18.306131+0000","last_became_peered":"2024-09-21T06:26:18.306131+0000","last_unstale":"2024-09-21T06:26:38.961670+0000","last_undegraded":"2024-09-21T06:26:38.961670+0000","last_fullsized":"2024-09-21T06:26:38.961670+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:14.746652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964110+0000","last_change":"2024-09-21T06:26:18.292714+0000","last_active":"2024-09-21T06:26:38.964110+0000","last_peered":"2024-09-21T06:26:38.964110+0000","last_clean":"2024-09-21T06:26:38.964110+0000","last_became_active":"2024-09-21T06:26:18.292322+0000","last_became_peered":"2024-09-21T06:26:18.292322+0000","last_unstale":"2024-09-21T06:26:38.964110+0000","last_undegraded":"2024-09-21T06:26:38.964110+0000","last_fullsized":"2024-09-21T06:26:38.964110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:51.017455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":46,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:42.780872+0000","last_change":"2024-09-21T06:26:16.269788+0000","last_active":"2024-09-21T06:26:42.780872+0000","last_peered":"2024-09-21T06:26:42.780872+0000","last_clean":"2024-09-21T06:26:42.780872+0000","last_became_active":"2024-09-21T06:26:16.269342+0000","last_became_peered":"2024-09-21T06:26:16.269342+0000","last_unstale":"2024-09-21T06:26:42.780872+0000","last_undegraded":"2024-09-21T06:26:42.780872+0000","last_fullsized":"2024-09-21T06:26:42.780872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:34.782237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.970505+0000","last_change":"2024-09-21T06:26:38.970396+0000","last_active":"2024-09-21T06:26:38.970505+0000","last_peered":"2024-09-21T06:26:38.970505+0000","last_clean":"2024-09-21T06:26:38.970505+0000","last_became_active":"2024-09-21T06:26:38.969976+0000","last_became_peered":"2024-09-21T06:26:38.969976+0000","last_unstale":"2024-09-21T06:26:38.970505+0000","last_undegraded":"2024-09-21T06:26:38.970505+0000","last_fullsized":"2024-09-21T06:26:38.970505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:44.540563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,3],"acting":[9,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964833+0000","last_change":"2024-09-21T06:26:16.272832+0000","last_active":"2024-09-21T06:26:38.964833+0000","last_peered":"2024-09-21T06:26:38.964833+0000","last_clean":"2024-09-21T06:26:38.964833+0000","last_became_active":"2024-09-21T06:26:16.272447+0000","last_became_peered":"2024-09-21T06:26:16.272447+0000","last_unstale":"2024-09-21T06:26:38.964833+0000","last_undegraded":"2024-09-21T06:26:38.964833+0000","last_fullsized":"2024-09-21T06:26:38.964833+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:22.836267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966506+0000","last_change":"2024-09-21T06:26:16.269067+0000","last_active":"2024-09-21T06:26:38.966506+0000","last_peered":"2024-09-21T06:26:38.966506+0000","last_clean":"2024-09-21T06:26:38.966506+0000","last_became_active":"2024-09-21T06:26:16.268524+0000","last_became_peered":"2024-09-21T06:26:16.268524+0000","last_unstale":"2024-09-21T06:26:38.966506+0000","last_undegraded":"2024-09-21T06:26:38.966506+0000","last_fullsized":"2024-09-21T06:26:38.966506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:32.224321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963670+0000","last_change":"2024-09-21T06:26:18.306489+0000","last_active":"2024-09-21T06:26:38.963670+0000","last_peered":"2024-09-21T06:26:38.963670+0000","last_clean":"2024-09-21T06:26:38.963670+0000","last_became_active":"2024-09-21T06:26:18.305883+0000","last_became_peered":"2024-09-21T06:26:18.305883+0000","last_unstale":"2024-09-21T06:26:38.963670+0000","last_undegraded":"2024-09-21T06:26:38.963670+0000","last_fullsized":"2024-09-21T06:26:38.963670+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:54.012308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971279+0000","last_change":"2024-09-21T06:26:16.269793+0000","last_active":"2024-09-21T06:26:38.971279+0000","last_peered":"2024-09-21T06:26:38.971279+0000","last_clean":"2024-09-21T06:26:38.971279+0000","last_became_active":"2024-09-21T06:26:16.269455+0000","last_became_peered":"2024-09-21T06:26:16.269455+0000","last_unstale":"2024-09-21T06:26:38.971279+0000","last_undegraded":"2024-09-21T06:26:38.971279+0000","last_fullsized":"2024-09-21T06:26:38.971279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:44.369742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965132+0000","last_change":"2024-09-21T06:26:18.297573+0000","last_active":"2024-09-21T06:26:38.965132+0000","last_peered":"2024-09-21T06:26:38.965132+0000","last_clean":"2024-09-21T06:26:38.965132+0000","last_became_active":"2024-09-21T06:26:18.297190+0000","last_became_peered":"2024-09-21T06:26:18.297190+0000","last_unstale":"2024-09-21T06:26:38.965132+0000","last_undegraded":"2024-09-21T06:26:38.965132+0000","last_fullsized":"2024-09-21T06:26:38.965132+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:28.055520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'4","reported_seq":59,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:43.781975+0000","last_change":"2024-09-21T06:26:16.273604+0000","last_active":"2024-09-21T06:26:43.781975+0000","last_peered":"2024-09-21T06:26:43.781975+0000","last_clean":"2024-09-21T06:26:43.781975+0000","last_became_active":"2024-09-21T06:26:16.273194+0000","last_became_peered":"2024-09-21T06:26:16.273194+0000","last_unstale":"2024-09-21T06:26:43.781975+0000","last_undegraded":"2024-09-21T06:26:43.781975+0000","last_fullsized":"2024-09-21T06:26:43.781975+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:08.218442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966787+0000","last_change":"2024-09-21T06:26:18.303960+0000","last_active":"2024-09-21T06:26:38.966787+0000","last_peered":"2024-09-21T06:26:38.966787+0000","last_clean":"2024-09-21T06:26:38.966787+0000","last_became_active":"2024-09-21T06:26:18.303550+0000","last_became_peered":"2024-09-21T06:26:18.303550+0000","last_unstale":"2024-09-21T06:26:38.966787+0000","last_undegraded":"2024-09-21T06:26:38.966787+0000","last_fullsized":"2024-09-21T06:26:38.966787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:47.331439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.978327+0000","last_change":"2024-09-21T06:26:38.978161+0000","last_active":"2024-09-21T06:26:38.978327+0000","last_peered":"2024-09-21T06:26:38.978327+0000","last_clean":"2024-09-21T06:26:38.978327+0000","last_became_active":"2024-09-21T06:26:38.970818+0000","last_became_peered":"2024-09-21T06:26:38.970818+0000","last_unstale":"2024-09-21T06:26:38.978327+0000","last_undegraded":"2024-09-21T06:26:38.978327+0000","last_fullsized":"2024-09-21T06:26:38.978327+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:55.273463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967598+0000","last_change":"2024-09-21T06:26:18.311643+0000","last_active":"2024-09-21T06:26:38.967598+0000","last_peered":"2024-09-21T06:26:38.967598+0000","last_clean":"2024-09-21T06:26:38.967598+0000","last_became_active":"2024-09-21T06:26:18.311246+0000","last_became_peered":"2024-09-21T06:26:18.311246+0000","last_unstale":"2024-09-21T06:26:38.967598+0000","last_undegraded":"2024-09-21T06:26:38.967598+0000","last_fullsized":"2024-09-21T06:26:38.967598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:00.342212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971107+0000","last_change":"2024-09-21T06:26:16.313648+0000","last_active":"2024-09-21T06:26:38.971107+0000","last_peered":"2024-09-21T06:26:38.971107+0000","last_clean":"2024-09-21T06:26:38.971107+0000","last_became_active":"2024-09-21T06:26:16.313337+0000","last_became_peered":"2024-09-21T06:26:16.313337+0000","last_unstale":"2024-09-21T06:26:38.971107+0000","last_undegraded":"2024-09-21T06:26:38.971107+0000","last_fullsized":"2024-09-21T06:26:38.971107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:12.095276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966410+0000","last_change":"2024-09-21T06:26:18.310168+0000","last_active":"2024-09-21T06:26:38.966410+0000","last_peered":"2024-09-21T06:26:38.966410+0000","last_clean":"2024-09-21T06:26:38.966410+0000","last_became_active":"2024-09-21T06:26:18.309756+0000","last_became_peered":"2024-09-21T06:26:18.309756+0000","last_unstale":"2024-09-21T06:26:38.966410+0000","last_undegraded":"2024-09-21T06:26:38.966410+0000","last_fullsized":"2024-09-21T06:26:38.966410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:07.203202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'27","reported_seq":89,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:43.781954+0000","last_change":"2024-09-21T06:26:16.270243+0000","last_active":"2024-09-21T06:26:43.781954+0000","last_peered":"2024-09-21T06:26:43.781954+0000","last_clean":"2024-09-21T06:26:43.781954+0000","last_became_active":"2024-09-21T06:26:16.269883+0000","last_became_peered":"2024-09-21T06:26:16.269883+0000","last_unstale":"2024-09-21T06:26:43.781954+0000","last_undegraded":"2024-09-21T06:26:43.781954+0000","last_fullsized":"2024-09-21T06:26:43.781954+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:55.906972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53741,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":71,"num_write":29,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964370+0000","last_change":"2024-09-21T06:26:18.305508+0000","last_active":"2024-09-21T06:26:38.964370+0000","last_peered":"2024-09-21T06:26:38.964370+0000","last_clean":"2024-09-21T06:26:38.964370+0000","last_became_active":"2024-09-21T06:26:18.305104+0000","last_became_peered":"2024-09-21T06:26:18.305104+0000","last_unstale":"2024-09-21T06:26:38.964370+0000","last_undegraded":"2024-09-21T06:26:38.964370+0000","last_fullsized":"2024-09-21T06:26:38.964370+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:14.727084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'9","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.969025+0000","last_change":"2024-09-21T06:26:16.268331+0000","last_active":"2024-09-21T06:26:38.969025+0000","last_peered":"2024-09-21T06:26:38.969025+0000","last_clean":"2024-09-21T06:26:38.969025+0000","last_became_active":"2024-09-21T06:26:16.267918+0000","last_became_peered":"2024-09-21T06:26:16.267918+0000","last_unstale":"2024-09-21T06:26:38.969025+0000","last_undegraded":"2024-09-21T06:26:38.969025+0000","last_fullsized":"2024-09-21T06:26:38.969025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:50.198883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965178+0000","last_change":"2024-09-21T06:26:18.298052+0000","last_active":"2024-09-21T06:26:38.965178+0000","last_peered":"2024-09-21T06:26:38.965178+0000","last_clean":"2024-09-21T06:26:38.965178+0000","last_became_active":"2024-09-21T06:26:18.297686+0000","last_became_peered":"2024-09-21T06:26:18.297686+0000","last_unstale":"2024-09-21T06:26:38.965178+0000","last_undegraded":"2024-09-21T06:26:38.965178+0000","last_fullsized":"2024-09-21T06:26:38.965178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:56.261608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.970277+0000","last_change":"2024-09-21T06:26:16.270917+0000","last_active":"2024-09-21T06:26:38.970277+0000","last_peered":"2024-09-21T06:26:38.970277+0000","last_clean":"2024-09-21T06:26:38.970277+0000","last_became_active":"2024-09-21T06:26:16.270530+0000","last_became_peered":"2024-09-21T06:26:16.270530+0000","last_unstale":"2024-09-21T06:26:38.970277+0000","last_undegraded":"2024-09-21T06:26:38.970277+0000","last_fullsized":"2024-09-21T06:26:38.970277+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:30.772991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965618+0000","last_change":"2024-09-21T06:26:18.302286+0000","last_active":"2024-09-21T06:26:38.965618+0000","last_peered":"2024-09-21T06:26:38.965618+0000","last_clean":"2024-09-21T06:26:38.965618+0000","last_became_active":"2024-09-21T06:26:18.301777+0000","last_became_peered":"2024-09-21T06:26:18.301777+0000","last_unstale":"2024-09-21T06:26:38.965618+0000","last_undegraded":"2024-09-21T06:26:38.965618+0000","last_fullsized":"2024-09-21T06:26:38.965618+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:31.339898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":46,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:40.777827+0000","last_change":"2024-09-21T06:26:16.267569+0000","last_active":"2024-09-21T06:26:40.777827+0000","last_peered":"2024-09-21T06:26:40.777827+0000","last_clean":"2024-09-21T06:26:40.777827+0000","last_became_active":"2024-09-21T06:26:16.267198+0000","last_became_peered":"2024-09-21T06:26:16.267198+0000","last_unstale":"2024-09-21T06:26:40.777827+0000","last_undegraded":"2024-09-21T06:26:40.777827+0000","last_fullsized":"2024-09-21T06:26:40.777827+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:16.323246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964474+0000","last_change":"2024-09-21T06:26:18.294473+0000","last_active":"2024-09-21T06:26:38.964474+0000","last_peered":"2024-09-21T06:26:38.964474+0000","last_clean":"2024-09-21T06:26:38.964474+0000","last_became_active":"2024-09-21T06:26:18.294010+0000","last_became_peered":"2024-09-21T06:26:18.294010+0000","last_unstale":"2024-09-21T06:26:38.964474+0000","last_undegraded":"2024-09-21T06:26:38.964474+0000","last_fullsized":"2024-09-21T06:26:38.964474+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:12.098589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'17","reported_seq":66,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.994281+0000","last_change":"2024-09-21T06:26:38.994178+0000","last_active":"2024-09-21T06:26:38.994281+0000","last_peered":"2024-09-21T06:26:38.994281+0000","last_clean":"2024-09-21T06:26:38.994281+0000","last_became_active":"2024-09-21T06:26:38.977865+0000","last_became_peered":"2024-09-21T06:26:38.977865+0000","last_unstale":"2024-09-21T06:26:38.994281+0000","last_undegraded":"2024-09-21T06:26:38.994281+0000","last_fullsized":"2024-09-21T06:26:38.994281+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:44.368499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.969981+0000","last_change":"2024-09-21T06:26:18.312319+0000","last_active":"2024-09-21T06:26:38.969981+0000","last_peered":"2024-09-21T06:26:38.969981+0000","last_clean":"2024-09-21T06:26:38.969981+0000","last_became_active":"2024-09-21T06:26:18.311949+0000","last_became_peered":"2024-09-21T06:26:18.311949+0000","last_unstale":"2024-09-21T06:26:38.969981+0000","last_undegraded":"2024-09-21T06:26:38.969981+0000","last_fullsized":"2024-09-21T06:26:38.969981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:49.729693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964667+0000","last_change":"2024-09-21T06:26:16.273771+0000","last_active":"2024-09-21T06:26:38.964667+0000","last_peered":"2024-09-21T06:26:38.964667+0000","last_clean":"2024-09-21T06:26:38.964667+0000","last_became_active":"2024-09-21T06:26:16.273293+0000","last_became_peered":"2024-09-21T06:26:16.273293+0000","last_unstale":"2024-09-21T06:26:38.964667+0000","last_undegraded":"2024-09-21T06:26:38.964667+0000","last_fullsized":"2024-09-21T06:26:38.964667+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:21.867844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.961892+0000","last_change":"2024-09-21T06:26:18.309204+0000","last_active":"2024-09-21T06:26:38.961892+0000","last_peered":"2024-09-21T06:26:38.961892+0000","last_clean":"2024-09-21T06:26:38.961892+0000","last_became_active":"2024-09-21T06:26:18.308838+0000","last_became_peered":"2024-09-21T06:26:18.308838+0000","last_unstale":"2024-09-21T06:26:38.961892+0000","last_undegraded":"2024-09-21T06:26:38.961892+0000","last_fullsized":"2024-09-21T06:26:38.961892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:14.011799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'5","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965404+0000","last_change":"2024-09-21T06:26:16.267965+0000","last_active":"2024-09-21T06:26:38.965404+0000","last_peered":"2024-09-21T06:26:38.965404+0000","last_clean":"2024-09-21T06:26:38.965404+0000","last_became_active":"2024-09-21T06:26:16.267548+0000","last_became_peered":"2024-09-21T06:26:16.267548+0000","last_unstale":"2024-09-21T06:26:38.965404+0000","last_undegraded":"2024-09-21T06:26:38.965404+0000","last_fullsized":"2024-09-21T06:26:38.965404+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:51.915817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965963+0000","last_change":"2024-09-21T06:26:18.306376+0000","last_active":"2024-09-21T06:26:38.965963+0000","last_peered":"2024-09-21T06:26:38.965963+0000","last_clean":"2024-09-21T06:26:38.965963+0000","last_became_active":"2024-09-21T06:26:18.305956+0000","last_became_peered":"2024-09-21T06:26:18.305956+0000","last_unstale":"2024-09-21T06:26:38.965963+0000","last_undegraded":"2024-09-21T06:26:38.965963+0000","last_fullsized":"2024-09-21T06:26:38.965963+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:27.229499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971383+0000","last_change":"2024-09-21T06:26:16.267201+0000","last_active":"2024-09-21T06:26:38.971383+0000","last_peered":"2024-09-21T06:26:38.971383+0000","last_clean":"2024-09-21T06:26:38.971383+0000","last_became_active":"2024-09-21T06:26:16.266832+0000","last_became_peered":"2024-09-21T06:26:16.266832+0000","last_unstale":"2024-09-21T06:26:38.971383+0000","last_undegraded":"2024-09-21T06:26:38.971383+0000","last_fullsized":"2024-09-21T06:26:38.971383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:48.626106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.984188+0000","last_change":"2024-09-21T06:26:38.984119+0000","last_active":"2024-09-21T06:26:38.984188+0000","last_peered":"2024-09-21T06:26:38.984188+0000","last_clean":"2024-09-21T06:26:38.984188+0000","last_became_active":"2024-09-21T06:26:38.972316+0000","last_became_peered":"2024-09-21T06:26:38.972316+0000","last_unstale":"2024-09-21T06:26:38.984188+0000","last_undegraded":"2024-09-21T06:26:38.984188+0000","last_fullsized":"2024-09-21T06:26:38.984188+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:22.788293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'6","reported_seq":46,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:40.777639+0000","last_change":"2024-09-21T06:26:16.572993+0000","last_active":"2024-09-21T06:26:40.777639+0000","last_peered":"2024-09-21T06:26:40.777639+0000","last_clean":"2024-09-21T06:26:40.777639+0000","last_became_active":"2024-09-21T06:26:16.572631+0000","last_became_peered":"2024-09-21T06:26:16.572631+0000","last_unstale":"2024-09-21T06:26:40.777639+0000","last_undegraded":"2024-09-21T06:26:40.777639+0000","last_fullsized":"2024-09-21T06:26:40.777639+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:05.276119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966079+0000","last_change":"2024-09-21T06:26:18.304685+0000","last_active":"2024-09-21T06:26:38.966079+0000","last_peered":"2024-09-21T06:26:38.966079+0000","last_clean":"2024-09-21T06:26:38.966079+0000","last_became_active":"2024-09-21T06:26:18.304325+0000","last_became_peered":"2024-09-21T06:26:18.304325+0000","last_unstale":"2024-09-21T06:26:38.966079+0000","last_undegraded":"2024-09-21T06:26:38.966079+0000","last_fullsized":"2024-09-21T06:26:38.966079+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:18.072602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965169+0000","last_change":"2024-09-21T06:25:04.875443+0000","last_active":"2024-09-21T06:26:38.965169+0000","last_peered":"2024-09-21T06:26:38.965169+0000","last_clean":"2024-09-21T06:26:38.965169+0000","last_became_active":"2024-09-21T06:25:04.869179+0000","last_became_peered":"2024-09-21T06:25:04.869179+0000","last_unstale":"2024-09-21T06:26:38.965169+0000","last_undegraded":"2024-09-21T06:26:38.965169+0000","last_fullsized":"2024-09-21T06:26:38.965169+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:21:37.191501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:21:37.191501+0000","last_clean_scrub_stamp":"2024-09-21T06:21:37.191501+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:19.981367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'6","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962414+0000","last_change":"2024-09-21T06:26:16.268440+0000","last_active":"2024-09-21T06:26:38.962414+0000","last_peered":"2024-09-21T06:26:38.962414+0000","last_clean":"2024-09-21T06:26:38.962414+0000","last_became_active":"2024-09-21T06:26:16.268078+0000","last_became_peered":"2024-09-21T06:26:16.268078+0000","last_unstale":"2024-09-21T06:26:38.962414+0000","last_undegraded":"2024-09-21T06:26:38.962414+0000","last_fullsized":"2024-09-21T06:26:38.962414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:55.696736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963878+0000","last_change":"2024-09-21T06:26:18.306410+0000","last_active":"2024-09-21T06:26:38.963878+0000","last_peered":"2024-09-21T06:26:38.963878+0000","last_clean":"2024-09-21T06:26:38.963878+0000","last_became_active":"2024-09-21T06:26:18.304718+0000","last_became_peered":"2024-09-21T06:26:18.304718+0000","last_unstale":"2024-09-21T06:26:38.963878+0000","last_undegraded":"2024-09-21T06:26:38.963878+0000","last_fullsized":"2024-09-21T06:26:38.963878+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:18.521867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964484+0000","last_change":"2024-09-21T06:26:16.270305+0000","last_active":"2024-09-21T06:26:38.964484+0000","last_peered":"2024-09-21T06:26:38.964484+0000","last_clean":"2024-09-21T06:26:38.964484+0000","last_became_active":"2024-09-21T06:26:16.269891+0000","last_became_peered":"2024-09-21T06:26:16.269891+0000","last_unstale":"2024-09-21T06:26:38.964484+0000","last_undegraded":"2024-09-21T06:26:38.964484+0000","last_fullsized":"2024-09-21T06:26:38.964484+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:48.575805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966049+0000","last_change":"2024-09-21T06:26:18.302404+0000","last_active":"2024-09-21T06:26:38.966049+0000","last_peered":"2024-09-21T06:26:38.966049+0000","last_clean":"2024-09-21T06:26:38.966049+0000","last_became_active":"2024-09-21T06:26:18.302036+0000","last_became_peered":"2024-09-21T06:26:18.302036+0000","last_unstale":"2024-09-21T06:26:38.966049+0000","last_undegraded":"2024-09-21T06:26:38.966049+0000","last_fullsized":"2024-09-21T06:26:38.966049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:36.688018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":46,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:43.782110+0000","last_change":"2024-09-21T06:26:16.310996+0000","last_active":"2024-09-21T06:26:43.782110+0000","last_peered":"2024-09-21T06:26:43.782110+0000","last_clean":"2024-09-21T06:26:43.782110+0000","last_became_active":"2024-09-21T06:26:16.310566+0000","last_became_peered":"2024-09-21T06:26:16.310566+0000","last_unstale":"2024-09-21T06:26:43.782110+0000","last_undegraded":"2024-09-21T06:26:43.782110+0000","last_fullsized":"2024-09-21T06:26:43.782110+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:27.569789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971180+0000","last_change":"2024-09-21T06:26:18.310343+0000","last_active":"2024-09-21T06:26:38.971180+0000","last_peered":"2024-09-21T06:26:38.971180+0000","last_clean":"2024-09-21T06:26:38.971180+0000","last_became_active":"2024-09-21T06:26:18.309979+0000","last_became_peered":"2024-09-21T06:26:18.309979+0000","last_unstale":"2024-09-21T06:26:38.971180+0000","last_undegraded":"2024-09-21T06:26:38.971180+0000","last_fullsized":"2024-09-21T06:26:38.971180+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:20.340822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'5","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:43.981949+0000","last_change":"2024-09-21T06:26:38.974313+0000","last_active":"2024-09-21T06:26:43.981949+0000","last_peered":"2024-09-21T06:26:43.981949+0000","last_clean":"2024-09-21T06:26:43.981949+0000","last_became_active":"2024-09-21T06:26:38.966498+0000","last_became_peered":"2024-09-21T06:26:38.966498+0000","last_unstale":"2024-09-21T06:26:43.981949+0000","last_undegraded":"2024-09-21T06:26:43.981949+0000","last_fullsized":"2024-09-21T06:26:43.981949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:56.732330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":588,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964787+0000","last_change":"2024-09-21T06:26:18.312080+0000","last_active":"2024-09-21T06:26:38.964787+0000","last_peered":"2024-09-21T06:26:38.964787+0000","last_clean":"2024-09-21T06:26:38.964787+0000","last_became_active":"2024-09-21T06:26:18.311351+0000","last_became_peered":"2024-09-21T06:26:18.311351+0000","last_unstale":"2024-09-21T06:26:38.964787+0000","last_undegraded":"2024-09-21T06:26:38.964787+0000","last_fullsized":"2024-09-21T06:26:38.964787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:33.545677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965339+0000","last_change":"2024-09-21T06:26:16.311108+0000","last_active":"2024-09-21T06:26:38.965339+0000","last_peered":"2024-09-21T06:26:38.965339+0000","last_clean":"2024-09-21T06:26:38.965339+0000","last_became_active":"2024-09-21T06:26:16.310595+0000","last_became_peered":"2024-09-21T06:26:16.310595+0000","last_unstale":"2024-09-21T06:26:38.965339+0000","last_undegraded":"2024-09-21T06:26:38.965339+0000","last_fullsized":"2024-09-21T06:26:38.965339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:43.125242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964942+0000","last_change":"2024-09-21T06:26:18.300618+0000","last_active":"2024-09-21T06:26:38.964942+0000","last_peered":"2024-09-21T06:26:38.964942+0000","last_clean":"2024-09-21T06:26:38.964942+0000","last_became_active":"2024-09-21T06:26:18.300234+0000","last_became_peered":"2024-09-21T06:26:18.300234+0000","last_unstale":"2024-09-21T06:26:38.964942+0000","last_undegraded":"2024-09-21T06:26:38.964942+0000","last_fullsized":"2024-09-21T06:26:38.964942+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:53.224425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'4","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.982480+0000","last_change":"2024-09-21T06:26:38.981999+0000","last_active":"2024-09-21T06:26:38.982480+0000","last_peered":"2024-09-21T06:26:38.982480+0000","last_clean":"2024-09-21T06:26:38.982480+0000","last_became_active":"2024-09-21T06:26:38.969199+0000","last_became_peered":"2024-09-21T06:26:38.969199+0000","last_unstale":"2024-09-21T06:26:38.982480+0000","last_undegraded":"2024-09-21T06:26:38.982480+0000","last_fullsized":"2024-09-21T06:26:38.982480+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:17.389262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965217+0000","last_change":"2024-09-21T06:26:18.297693+0000","last_active":"2024-09-21T06:26:38.965217+0000","last_peered":"2024-09-21T06:26:38.965217+0000","last_clean":"2024-09-21T06:26:38.965217+0000","last_became_active":"2024-09-21T06:26:18.297335+0000","last_became_peered":"2024-09-21T06:26:18.297335+0000","last_unstale":"2024-09-21T06:26:38.965217+0000","last_undegraded":"2024-09-21T06:26:38.965217+0000","last_fullsized":"2024-09-21T06:26:38.965217+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:30.144220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'13","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:40.294033+0000","last_change":"2024-09-21T06:26:16.269854+0000","last_active":"2024-09-21T06:26:40.294033+0000","last_peered":"2024-09-21T06:26:40.294033+0000","last_clean":"2024-09-21T06:26:40.294033+0000","last_became_active":"2024-09-21T06:26:16.269415+0000","last_became_peered":"2024-09-21T06:26:16.269415+0000","last_unstale":"2024-09-21T06:26:40.294033+0000","last_undegraded":"2024-09-21T06:26:40.294033+0000","last_fullsized":"2024-09-21T06:26:40.294033+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:50.525916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964317+0000","last_change":"2024-09-21T06:26:18.306302+0000","last_active":"2024-09-21T06:26:38.964317+0000","last_peered":"2024-09-21T06:26:38.964317+0000","last_clean":"2024-09-21T06:26:38.964317+0000","last_became_active":"2024-09-21T06:26:18.305723+0000","last_became_peered":"2024-09-21T06:26:18.305723+0000","last_unstale":"2024-09-21T06:26:38.964317+0000","last_undegraded":"2024-09-21T06:26:38.964317+0000","last_fullsized":"2024-09-21T06:26:38.964317+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:30.051791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'7","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962517+0000","last_change":"2024-09-21T06:26:16.573081+0000","last_active":"2024-09-21T06:26:38.962517+0000","last_peered":"2024-09-21T06:26:38.962517+0000","last_clean":"2024-09-21T06:26:38.962517+0000","last_became_active":"2024-09-21T06:26:16.572680+0000","last_became_peered":"2024-09-21T06:26:16.572680+0000","last_unstale":"2024-09-21T06:26:38.962517+0000","last_undegraded":"2024-09-21T06:26:38.962517+0000","last_fullsized":"2024-09-21T06:26:38.962517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:04.698258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967148+0000","last_change":"2024-09-21T06:26:18.311610+0000","last_active":"2024-09-21T06:26:38.967148+0000","last_peered":"2024-09-21T06:26:38.967148+0000","last_clean":"2024-09-21T06:26:38.967148+0000","last_became_active":"2024-09-21T06:26:18.311239+0000","last_became_peered":"2024-09-21T06:26:18.311239+0000","last_unstale":"2024-09-21T06:26:38.967148+0000","last_undegraded":"2024-09-21T06:26:38.967148+0000","last_fullsized":"2024-09-21T06:26:38.967148+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:36.995768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965260+0000","last_change":"2024-09-21T06:26:16.313612+0000","last_active":"2024-09-21T06:26:38.965260+0000","last_peered":"2024-09-21T06:26:38.965260+0000","last_clean":"2024-09-21T06:26:38.965260+0000","last_became_active":"2024-09-21T06:26:16.313298+0000","last_became_peered":"2024-09-21T06:26:16.313298+0000","last_unstale":"2024-09-21T06:26:38.965260+0000","last_undegraded":"2024-09-21T06:26:38.965260+0000","last_fullsized":"2024-09-21T06:26:38.965260+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:45.035454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963931+0000","last_change":"2024-09-21T06:26:18.304772+0000","last_active":"2024-09-21T06:26:38.963931+0000","last_peered":"2024-09-21T06:26:38.963931+0000","last_clean":"2024-09-21T06:26:38.963931+0000","last_became_active":"2024-09-21T06:26:18.303909+0000","last_became_peered":"2024-09-21T06:26:18.303909+0000","last_unstale":"2024-09-21T06:26:38.963931+0000","last_undegraded":"2024-09-21T06:26:38.963931+0000","last_fullsized":"2024-09-21T06:26:38.963931+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:28.707169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963811+0000","last_change":"2024-09-21T06:26:16.267563+0000","last_active":"2024-09-21T06:26:38.963811+0000","last_peered":"2024-09-21T06:26:38.963811+0000","last_clean":"2024-09-21T06:26:38.963811+0000","last_became_active":"2024-09-21T06:26:16.267182+0000","last_became_peered":"2024-09-21T06:26:16.267182+0000","last_unstale":"2024-09-21T06:26:38.963811+0000","last_undegraded":"2024-09-21T06:26:38.963811+0000","last_fullsized":"2024-09-21T06:26:38.963811+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:16.042105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.961758+0000","last_change":"2024-09-21T06:26:18.310772+0000","last_active":"2024-09-21T06:26:38.961758+0000","last_peered":"2024-09-21T06:26:38.961758+0000","last_clean":"2024-09-21T06:26:38.961758+0000","last_became_active":"2024-09-21T06:26:18.310382+0000","last_became_peered":"2024-09-21T06:26:18.310382+0000","last_unstale":"2024-09-21T06:26:38.961758+0000","last_undegraded":"2024-09-21T06:26:38.961758+0000","last_fullsized":"2024-09-21T06:26:38.961758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:54:35.028081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967712+0000","last_change":"2024-09-21T06:26:16.270971+0000","last_active":"2024-09-21T06:26:38.967712+0000","last_peered":"2024-09-21T06:26:38.967712+0000","last_clean":"2024-09-21T06:26:38.967712+0000","last_became_active":"2024-09-21T06:26:16.270453+0000","last_became_peered":"2024-09-21T06:26:16.270453+0000","last_unstale":"2024-09-21T06:26:38.967712+0000","last_undegraded":"2024-09-21T06:26:38.967712+0000","last_fullsized":"2024-09-21T06:26:38.967712+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:34.687380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963945+0000","last_change":"2024-09-21T06:26:18.300568+0000","last_active":"2024-09-21T06:26:38.963945+0000","last_peered":"2024-09-21T06:26:38.963945+0000","last_clean":"2024-09-21T06:26:38.963945+0000","last_became_active":"2024-09-21T06:26:18.298864+0000","last_became_peered":"2024-09-21T06:26:18.298864+0000","last_unstale":"2024-09-21T06:26:38.963945+0000","last_undegraded":"2024-09-21T06:26:38.963945+0000","last_fullsized":"2024-09-21T06:26:38.963945+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:00.786225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964246+0000","last_change":"2024-09-21T06:26:16.274093+0000","last_active":"2024-09-21T06:26:38.964246+0000","last_peered":"2024-09-21T06:26:38.964246+0000","last_clean":"2024-09-21T06:26:38.964246+0000","last_became_active":"2024-09-21T06:26:16.273707+0000","last_became_peered":"2024-09-21T06:26:16.273707+0000","last_unstale":"2024-09-21T06:26:38.964246+0000","last_undegraded":"2024-09-21T06:26:38.964246+0000","last_fullsized":"2024-09-21T06:26:38.964246+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:26.710260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965837+0000","last_change":"2024-09-21T06:26:18.300140+0000","last_active":"2024-09-21T06:26:38.965837+0000","last_peered":"2024-09-21T06:26:38.965837+0000","last_clean":"2024-09-21T06:26:38.965837+0000","last_became_active":"2024-09-21T06:26:18.299543+0000","last_became_peered":"2024-09-21T06:26:18.299543+0000","last_unstale":"2024-09-21T06:26:38.965837+0000","last_undegraded":"2024-09-21T06:26:38.965837+0000","last_fullsized":"2024-09-21T06:26:38.965837+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:50.272247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.970973+0000","last_change":"2024-09-21T06:26:18.311528+0000","last_active":"2024-09-21T06:26:38.970973+0000","last_peered":"2024-09-21T06:26:38.970973+0000","last_clean":"2024-09-21T06:26:38.970973+0000","last_became_active":"2024-09-21T06:26:18.311144+0000","last_became_peered":"2024-09-21T06:26:18.311144+0000","last_unstale":"2024-09-21T06:26:38.970973+0000","last_undegraded":"2024-09-21T06:26:38.970973+0000","last_fullsized":"2024-09-21T06:26:38.970973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:05.554255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964467+0000","last_change":"2024-09-21T06:26:16.275378+0000","last_active":"2024-09-21T06:26:38.964467+0000","last_peered":"2024-09-21T06:26:38.964467+0000","last_clean":"2024-09-21T06:26:38.964467+0000","last_became_active":"2024-09-21T06:26:16.274990+0000","last_became_peered":"2024-09-21T06:26:16.274990+0000","last_unstale":"2024-09-21T06:26:38.964467+0000","last_undegraded":"2024-09-21T06:26:38.964467+0000","last_fullsized":"2024-09-21T06:26:38.964467+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:57.252993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966421+0000","last_change":"2024-09-21T06:26:18.300879+0000","last_active":"2024-09-21T06:26:38.966421+0000","last_peered":"2024-09-21T06:26:38.966421+0000","last_clean":"2024-09-21T06:26:38.966421+0000","last_became_active":"2024-09-21T06:26:18.300514+0000","last_became_peered":"2024-09-21T06:26:18.300514+0000","last_unstale":"2024-09-21T06:26:38.966421+0000","last_undegraded":"2024-09-21T06:26:38.966421+0000","last_fullsized":"2024-09-21T06:26:38.966421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:02.581145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'12","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964519+0000","last_change":"2024-09-21T06:26:16.274139+0000","last_active":"2024-09-21T06:26:38.964519+0000","last_peered":"2024-09-21T06:26:38.964519+0000","last_clean":"2024-09-21T06:26:38.964519+0000","last_became_active":"2024-09-21T06:26:16.273723+0000","last_became_peered":"2024-09-21T06:26:16.273723+0000","last_unstale":"2024-09-21T06:26:38.964519+0000","last_undegraded":"2024-09-21T06:26:38.964519+0000","last_fullsized":"2024-09-21T06:26:38.964519+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:24.366714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967496+0000","last_change":"2024-09-21T06:26:18.304602+0000","last_active":"2024-09-21T06:26:38.967496+0000","last_peered":"2024-09-21T06:26:38.967496+0000","last_clean":"2024-09-21T06:26:38.967496+0000","last_became_active":"2024-09-21T06:26:18.304259+0000","last_became_peered":"2024-09-21T06:26:18.304259+0000","last_unstale":"2024-09-21T06:26:38.967496+0000","last_undegraded":"2024-09-21T06:26:38.967496+0000","last_fullsized":"2024-09-21T06:26:38.967496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:16.428247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964281+0000","last_change":"2024-09-21T06:26:16.311107+0000","last_active":"2024-09-21T06:26:38.964281+0000","last_peered":"2024-09-21T06:26:38.964281+0000","last_clean":"2024-09-21T06:26:38.964281+0000","last_became_active":"2024-09-21T06:26:16.310692+0000","last_became_peered":"2024-09-21T06:26:16.310692+0000","last_unstale":"2024-09-21T06:26:38.964281+0000","last_undegraded":"2024-09-21T06:26:38.964281+0000","last_fullsized":"2024-09-21T06:26:38.964281+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:29.074606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964061+0000","last_change":"2024-09-21T06:26:18.300614+0000","last_active":"2024-09-21T06:26:38.964061+0000","last_peered":"2024-09-21T06:26:38.964061+0000","last_clean":"2024-09-21T06:26:38.964061+0000","last_became_active":"2024-09-21T06:26:18.300173+0000","last_became_peered":"2024-09-21T06:26:18.300173+0000","last_unstale":"2024-09-21T06:26:38.964061+0000","last_undegraded":"2024-09-21T06:26:38.964061+0000","last_fullsized":"2024-09-21T06:26:38.964061+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:49.040667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'13","reported_seq":72,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:41.978420+0000","last_change":"2024-09-21T06:26:38.986822+0000","last_active":"2024-09-21T06:26:41.978420+0000","last_peered":"2024-09-21T06:26:41.978420+0000","last_clean":"2024-09-21T06:26:41.978420+0000","last_became_active":"2024-09-21T06:26:38.972368+0000","last_became_peered":"2024-09-21T06:26:38.972368+0000","last_unstale":"2024-09-21T06:26:41.978420+0000","last_undegraded":"2024-09-21T06:26:41.978420+0000","last_fullsized":"2024-09-21T06:26:41.978420+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:53.273388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60945,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":177,"num_read_kb":158,"num_write":237,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1484,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":182835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282590,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743441,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":860160,"data_stored":420766,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939671,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":995328,"data_stored":1064836,"data_compressed":41842,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103196,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":876544,"data_stored":419722,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299425,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":419199,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495654,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":1011913,"data_compressed":41842,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659180,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":419322,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855409,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":933888,"data_stored":1011788,"data_compressed":41842,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":864256,"data_stored":419686,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":419030,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378688,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":474475,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542213,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":917504,"data_stored":474648,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":876544,"data_stored":421052,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":56165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":55992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":55868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:26:46.986 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T06:26:46.987 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T06:26:46.987 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T06:26:47.250 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:47.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:46 smithi071 ceph-mon[34844]: pgmap v279: 97 pgs: 97 active+clean; 636 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 KiB/s wr, 12 op/s; 200 B/s, 2 objects/s recovering 2024-09-21T06:26:47.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:46 smithi071 ceph-mon[34844]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:26:47.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:46 smithi063 ceph-mon[31150]: pgmap v279: 97 pgs: 97 active+clean; 636 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 KiB/s wr, 12 op/s; 200 B/s, 2 objects/s recovering 2024-09-21T06:26:47.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:46 smithi063 ceph-mon[31150]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:26:47.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:46 smithi175 ceph-mon[34510]: pgmap v279: 97 pgs: 97 active+clean; 636 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 KiB/s wr, 12 op/s; 200 B/s, 2 objects/s recovering 2024-09-21T06:26:47.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:46 smithi175 ceph-mon[34510]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:26:47.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.717+0000 7f2988cd4640 1 -- 172.21.15.63:0/3329361388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f298406be50 msgr2=0x7f298406c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.717+0000 7f2988cd4640 1 --2- 172.21.15.63:0/3329361388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f298406be50 0x7f298406c260 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2974009ca0 tx=0x7f297402a8e0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.717+0000 7f2988cd4640 1 -- 172.21.15.63:0/3329361388 shutdown_connections 2024-09-21T06:26:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.717+0000 7f2988cd4640 1 --2- 172.21.15.63:0/3329361388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2984109e20 0x7f2984110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.717+0000 7f2988cd4640 1 --2- 172.21.15.63:0/3329361388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29841094d0 0x7f29841098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.717+0000 7f2988cd4640 1 --2- 172.21.15.63:0/3329361388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f298406be50 0x7f298406c260 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.717+0000 7f2988cd4640 1 -- 172.21.15.63:0/3329361388 >> 172.21.15.63:0/3329361388 conn(0x7f2984079820 msgr2=0x7f2984079c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.717+0000 7f2988cd4640 1 -- 172.21.15.63:0/3329361388 shutdown_connections 2024-09-21T06:26:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.717+0000 7f2988cd4640 1 -- 172.21.15.63:0/3329361388 wait complete. 2024-09-21T06:26:47.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.718+0000 7f2988cd4640 1 Processor -- start 2024-09-21T06:26:47.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.718+0000 7f2988cd4640 1 -- start start 2024-09-21T06:26:47.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.719+0000 7f2988cd4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f298406be50 0x7f298419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.719+0000 7f2988cd4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29841094d0 0x7f298419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.719+0000 7f2988cd4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2984109e20 0x7f298419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.719+0000 7f2988cd4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2984113b20 con 0x7f29841094d0 2024-09-21T06:26:47.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.719+0000 7f2988cd4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f29841139a0 con 0x7f298406be50 2024-09-21T06:26:47.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.719+0000 7f2988cd4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2984113ca0 con 0x7f2984109e20 2024-09-21T06:26:47.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.719+0000 7f2981d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29841094d0 0x7f298419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.719+0000 7f2981d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29841094d0 0x7f298419ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47988/0 (socket says 172.21.15.63:47988) 2024-09-21T06:26:47.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.719+0000 7f2981d9b640 1 -- 172.21.15.63:0/2086891298 learned_addr learned my addr 172.21.15.63:0/2086891298 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:47.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.719+0000 7f298259c640 1 --2- 172.21.15.63:0/2086891298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f298406be50 0x7f298419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.719+0000 7f2982d9d640 1 --2- 172.21.15.63:0/2086891298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2984109e20 0x7f298419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.719+0000 7f2981d9b640 1 -- 172.21.15.63:0/2086891298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2984109e20 msgr2=0x7f298419fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:47.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.719+0000 7f2981d9b640 1 --2- 172.21.15.63:0/2086891298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2984109e20 0x7f298419fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.719+0000 7f2981d9b640 1 -- 172.21.15.63:0/2086891298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f298406be50 msgr2=0x7f298419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:47.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.719+0000 7f2981d9b640 1 --2- 172.21.15.63:0/2086891298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f298406be50 0x7f298419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.719+0000 7f2981d9b640 1 -- 172.21.15.63:0/2086891298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29841a0440 con 0x7f29841094d0 2024-09-21T06:26:47.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.719+0000 7f2981d9b640 1 --2- 172.21.15.63:0/2086891298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29841094d0 0x7f298419ab30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2978006fd0 tx=0x7f297800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:47.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.719+0000 7f29737fe640 1 -- 172.21.15.63:0/2086891298 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2978011830 con 0x7f29841094d0 2024-09-21T06:26:47.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.720+0000 7f29737fe640 1 -- 172.21.15.63:0/2086891298 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2978016070 con 0x7f29841094d0 2024-09-21T06:26:47.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.720+0000 7f2988cd4640 1 -- 172.21.15.63:0/2086891298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29841a0730 con 0x7f29841094d0 2024-09-21T06:26:47.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.720+0000 7f29737fe640 1 -- 172.21.15.63:0/2086891298 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2978010e00 con 0x7f29841094d0 2024-09-21T06:26:47.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.720+0000 7f2988cd4640 1 -- 172.21.15.63:0/2086891298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29841a6f50 con 0x7f29841094d0 2024-09-21T06:26:47.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.721+0000 7f2988cd4640 1 -- 172.21.15.63:0/2086891298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2984104e10 con 0x7f29841094d0 2024-09-21T06:26:47.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.722+0000 7f29737fe640 1 -- 172.21.15.63:0/2086891298 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f29780119d0 con 0x7f29841094d0 2024-09-21T06:26:47.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.723+0000 7f29737fe640 1 --2- 172.21.15.63:0/2086891298 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f296c0b6620 0x7f296c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.723+0000 7f298259c640 1 --2- 172.21.15.63:0/2086891298 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f296c0b6620 0x7f296c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.723+0000 7f29737fe640 1 -- 172.21.15.63:0/2086891298 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f29780e7090 con 0x7f29841094d0 2024-09-21T06:26:47.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.724+0000 7f298259c640 1 --2- 172.21.15.63:0/2086891298 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f296c0b6620 0x7f296c0b8b30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2974009a60 tx=0x7f29740093e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:47.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.726+0000 7f29737fe640 1 -- 172.21.15.63:0/2086891298 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f29780ad6e0 con 0x7f29841094d0 2024-09-21T06:26:47.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.987+0000 7f2988cd4640 1 -- 172.21.15.63:0/2086891298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f298406c260 con 0x7f29841094d0 2024-09-21T06:26:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.990+0000 7f29737fe640 1 -- 172.21.15.63:0/2086891298 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f298406c260 con 0x7f29841094d0 2024-09-21T06:26:47.992 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2024-09-21T06:26:47.992 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAnZ+5mBiXyOhAAJjsKAhRzqEHZzKo6slqk5g== 2024-09-21T06:26:47.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.992+0000 7f2988cd4640 1 -- 172.21.15.63:0/2086891298 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f296c0b6620 msgr2=0x7f296c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:47.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.992+0000 7f2988cd4640 1 --2- 172.21.15.63:0/2086891298 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f296c0b6620 0x7f296c0b8b30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2974009a60 tx=0x7f29740093e0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.992+0000 7f2988cd4640 1 -- 172.21.15.63:0/2086891298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29841094d0 msgr2=0x7f298419ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.992+0000 7f2988cd4640 1 --2- 172.21.15.63:0/2086891298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29841094d0 0x7f298419ab30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2978006fd0 tx=0x7f297800b8e0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.992+0000 7f2988cd4640 1 -- 172.21.15.63:0/2086891298 shutdown_connections 2024-09-21T06:26:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.992+0000 7f2988cd4640 1 --2- 172.21.15.63:0/2086891298 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f296c0b6620 0x7f296c0b8b30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.992+0000 7f2988cd4640 1 --2- 172.21.15.63:0/2086891298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2984109e20 0x7f298419fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.992+0000 7f2988cd4640 1 --2- 172.21.15.63:0/2086891298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29841094d0 0x7f298419ab30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.992+0000 7f2988cd4640 1 --2- 172.21.15.63:0/2086891298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f298406be50 0x7f298419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.992+0000 7f2988cd4640 1 -- 172.21.15.63:0/2086891298 >> 172.21.15.63:0/2086891298 conn(0x7f2984079820 msgr2=0x7f29841075c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.993+0000 7f2988cd4640 1 -- 172.21.15.63:0/2086891298 shutdown_connections 2024-09-21T06:26:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:47.993+0000 7f2988cd4640 1 -- 172.21.15.63:0/2086891298 wait complete. 2024-09-21T06:26:48.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:48 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2086891298' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T06:26:48.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:48 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2086891298' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T06:26:48.307 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:48 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2086891298' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T06:26:48.307 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:48 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2086891298' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T06:26:48.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:48 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2086891298' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T06:26:48.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:48 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2086891298' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T06:26:48.706 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:26:48.706 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T06:26:48.706 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T06:26:48.746 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T06:26:49.044 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:49.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:49 smithi071 ceph-mon[34844]: pgmap v280: 97 pgs: 97 active+clean; 636 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.7 KiB/s wr, 11 op/s; 161 B/s, 2 objects/s recovering 2024-09-21T06:26:49.311 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:49 smithi063 ceph-mon[31150]: pgmap v280: 97 pgs: 97 active+clean; 636 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.7 KiB/s wr, 11 op/s; 161 B/s, 2 objects/s recovering 2024-09-21T06:26:49.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:49 smithi175 ceph-mon[34510]: pgmap v280: 97 pgs: 97 active+clean; 636 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.7 KiB/s wr, 11 op/s; 161 B/s, 2 objects/s recovering 2024-09-21T06:26:49.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.556+0000 7f97c0552640 1 -- 172.21.15.63:0/2732517422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97b8108d10 msgr2=0x7f97b810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:49.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.556+0000 7f97c0552640 1 --2- 172.21.15.63:0/2732517422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97b8108d10 0x7f97b810f540 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009ca0 tx=0x7f97b002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:26:49.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.556+0000 7f97c0552640 1 -- 172.21.15.63:0/2732517422 shutdown_connections 2024-09-21T06:26:49.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.556+0000 7f97c0552640 1 --2- 172.21.15.63:0/2732517422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97b8108d10 0x7f97b810f540 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:49.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.556+0000 7f97c0552640 1 --2- 172.21.15.63:0/2732517422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97b81083c0 0x7f97b81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:49.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.556+0000 7f97c0552640 1 --2- 172.21.15.63:0/2732517422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97b8102a80 0x7f97b8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:49.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.556+0000 7f97c0552640 1 -- 172.21.15.63:0/2732517422 >> 172.21.15.63:0/2732517422 conn(0x7f97b8079740 msgr2=0x7f97b8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:49.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.556+0000 7f97c0552640 1 -- 172.21.15.63:0/2732517422 shutdown_connections 2024-09-21T06:26:49.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.556+0000 7f97c0552640 1 -- 172.21.15.63:0/2732517422 wait complete. 2024-09-21T06:26:49.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.557+0000 7f97c0552640 1 Processor -- start 2024-09-21T06:26:49.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.557+0000 7f97c0552640 1 -- start start 2024-09-21T06:26:49.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.557+0000 7f97c0552640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97b8102a80 0x7f97b819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:49.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.557+0000 7f97c0552640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97b81083c0 0x7f97b819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:49.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.557+0000 7f97c0552640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97b8108d10 0x7f97b819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:49.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.557+0000 7f97c0552640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f97b8112980 con 0x7f97b81083c0 2024-09-21T06:26:49.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.557+0000 7f97c0552640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f97b8112800 con 0x7f97b8108d10 2024-09-21T06:26:49.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.557+0000 7f97c0552640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f97b8112b00 con 0x7f97b8102a80 2024-09-21T06:26:49.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.558+0000 7f97bdaed640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97b81083c0 0x7f97b819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:49.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.558+0000 7f97bdaed640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97b81083c0 0x7f97b819a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48020/0 (socket says 172.21.15.63:48020) 2024-09-21T06:26:49.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.558+0000 7f97bdaed640 1 -- 172.21.15.63:0/4218015282 learned_addr learned my addr 172.21.15.63:0/4218015282 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:49.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.558+0000 7f97be2ee640 1 --2- 172.21.15.63:0/4218015282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97b8102a80 0x7f97b819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:49.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.558+0000 7f97beaef640 1 --2- 172.21.15.63:0/4218015282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97b8108d10 0x7f97b819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:49.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.558+0000 7f97bdaed640 1 -- 172.21.15.63:0/4218015282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97b8102a80 msgr2=0x7f97b819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:49.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.558+0000 7f97bdaed640 1 --2- 172.21.15.63:0/4218015282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97b8102a80 0x7f97b819a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:49.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.558+0000 7f97bdaed640 1 -- 172.21.15.63:0/4218015282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97b8108d10 msgr2=0x7f97b819fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:49.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.558+0000 7f97bdaed640 1 --2- 172.21.15.63:0/4218015282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97b8108d10 0x7f97b819fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:49.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.558+0000 7f97bdaed640 1 -- 172.21.15.63:0/4218015282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b81a02f0 con 0x7f97b81083c0 2024-09-21T06:26:49.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.558+0000 7f97bdaed640 1 --2- 172.21.15.63:0/4218015282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97b81083c0 0x7f97b819a9e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f97ac00d770 tx=0x7f97ac00db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:49.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.558+0000 7f97ab7fe640 1 -- 172.21.15.63:0/4218015282 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac017070 con 0x7f97b81083c0 2024-09-21T06:26:49.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.558+0000 7f97ab7fe640 1 -- 172.21.15.63:0/4218015282 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97ac010460 con 0x7f97b81083c0 2024-09-21T06:26:49.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.558+0000 7f97c0552640 1 -- 172.21.15.63:0/4218015282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97b81a05e0 con 0x7f97b81083c0 2024-09-21T06:26:49.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.558+0000 7f97ab7fe640 1 -- 172.21.15.63:0/4218015282 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac00f620 con 0x7f97b81083c0 2024-09-21T06:26:49.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.558+0000 7f97c0552640 1 -- 172.21.15.63:0/4218015282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97b81a6e00 con 0x7f97b81083c0 2024-09-21T06:26:49.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.559+0000 7f97c0552640 1 -- 172.21.15.63:0/4218015282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97b8103d00 con 0x7f97b81083c0 2024-09-21T06:26:49.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.561+0000 7f97ab7fe640 1 -- 172.21.15.63:0/4218015282 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f97ac01a070 con 0x7f97b81083c0 2024-09-21T06:26:49.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.562+0000 7f97ab7fe640 1 --2- 172.21.15.63:0/4218015282 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f97a40b6620 0x7f97a40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:49.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.563+0000 7f97be2ee640 1 --2- 172.21.15.63:0/4218015282 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f97a40b6620 0x7f97a40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:49.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.563+0000 7f97ab7fe640 1 -- 172.21.15.63:0/4218015282 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f97ac0e6f80 con 0x7f97b81083c0 2024-09-21T06:26:49.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.563+0000 7f97be2ee640 1 --2- 172.21.15.63:0/4218015282 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f97a40b6620 0x7f97a40b8b30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f97b400abe0 tx=0x7f97b400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:49.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.566+0000 7f97ab7fe640 1 -- 172.21.15.63:0/4218015282 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f97ac0ad5d0 con 0x7f97b81083c0 2024-09-21T06:26:49.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.755+0000 7f97c0552640 1 -- 172.21.15.63:0/4218015282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f97b81a7000 con 0x7f97b81083c0 2024-09-21T06:26:49.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.755+0000 7f97ab7fe640 1 -- 172.21.15.63:0/4218015282 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v58) ==== 86+0+133 (secure 0 0 0) 0x7f97ac0b19b0 con 0x7f97b81083c0 2024-09-21T06:26:49.757 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:26:49.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.757+0000 7f97c0552640 1 -- 172.21.15.63:0/4218015282 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f97a40b6620 msgr2=0x7f97a40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:49.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.757+0000 7f97c0552640 1 --2- 172.21.15.63:0/4218015282 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f97a40b6620 0x7f97a40b8b30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f97b400abe0 tx=0x7f97b400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:26:49.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.757+0000 7f97c0552640 1 -- 172.21.15.63:0/4218015282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97b81083c0 msgr2=0x7f97b819a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:49.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.757+0000 7f97c0552640 1 --2- 172.21.15.63:0/4218015282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97b81083c0 0x7f97b819a9e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f97ac00d770 tx=0x7f97ac00db70 comp rx=0 tx=0).stop 2024-09-21T06:26:49.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.757+0000 7f97c0552640 1 -- 172.21.15.63:0/4218015282 shutdown_connections 2024-09-21T06:26:49.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.757+0000 7f97c0552640 1 --2- 172.21.15.63:0/4218015282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97b8108d10 0x7f97b819fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:49.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.757+0000 7f97c0552640 1 --2- 172.21.15.63:0/4218015282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97b81083c0 0x7f97b819a9e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:49.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.758+0000 7f97c0552640 1 --2- 172.21.15.63:0/4218015282 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f97a40b6620 0x7f97a40b8b30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:49.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.758+0000 7f97c0552640 1 --2- 172.21.15.63:0/4218015282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97b8102a80 0x7f97b819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:49.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.758+0000 7f97c0552640 1 -- 172.21.15.63:0/4218015282 >> 172.21.15.63:0/4218015282 conn(0x7f97b8079740 msgr2=0x7f97b8101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:49.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.758+0000 7f97c0552640 1 -- 172.21.15.63:0/4218015282 shutdown_connections 2024-09-21T06:26:49.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:49.758+0000 7f97c0552640 1 -- 172.21.15.63:0/4218015282 wait complete. 2024-09-21T06:26:50.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:50 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/4218015282' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T06:26:50.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:50 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/4218015282' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T06:26:50.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:50 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/4218015282' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T06:26:50.464 INFO:teuthology.orchestra.run.smithi063.stdout:[{"version":58,"timestamp":"2024-09-21T06:26:10.348837+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T06:26:50.464 INFO:tasks.ceph_manager:config epoch is 58 2024-09-21T06:26:50.465 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T06:26:50.465 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T06:26:50.465 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T06:26:50.722 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:51.124 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:51 smithi063 ceph-mon[31150]: pgmap v281: 97 pgs: 97 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 13 op/s; 146 B/s, 2 objects/s recovering 2024-09-21T06:26:51.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.215+0000 7fd053ee0640 1 -- 172.21.15.63:0/2459491687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c102ae0 msgr2=0x7fd04c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:51.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.215+0000 7fd053ee0640 1 --2- 172.21.15.63:0/2459491687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c102ae0 0x7fd04c102ef0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd040009900 tx=0x7fd04002a410 comp rx=0 tx=0).stop 2024-09-21T06:26:51.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.215+0000 7fd053ee0640 1 -- 172.21.15.63:0/2459491687 shutdown_connections 2024-09-21T06:26:51.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.215+0000 7fd053ee0640 1 --2- 172.21.15.63:0/2459491687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd04c108d20 0x7fd04c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:51.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.215+0000 7fd053ee0640 1 --2- 172.21.15.63:0/2459491687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c1083d0 0x7fd04c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:51.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.215+0000 7fd053ee0640 1 --2- 172.21.15.63:0/2459491687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c102ae0 0x7fd04c102ef0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:51.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.215+0000 7fd053ee0640 1 -- 172.21.15.63:0/2459491687 >> 172.21.15.63:0/2459491687 conn(0x7fd04c0797b0 msgr2=0x7fd04c079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:51.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.215+0000 7fd053ee0640 1 -- 172.21.15.63:0/2459491687 shutdown_connections 2024-09-21T06:26:51.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.215+0000 7fd053ee0640 1 -- 172.21.15.63:0/2459491687 wait complete. 2024-09-21T06:26:51.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.216+0000 7fd053ee0640 1 Processor -- start 2024-09-21T06:26:51.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.216+0000 7fd053ee0640 1 -- start start 2024-09-21T06:26:51.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.216+0000 7fd053ee0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c102ae0 0x7fd04c0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:51.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.216+0000 7fd053ee0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c1083d0 0x7fd04c0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:51.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.216+0000 7fd053ee0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd04c108d20 0x7fd04c1000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:51.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.216+0000 7fd053ee0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c1129e0 con 0x7fd04c1083d0 2024-09-21T06:26:51.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.216+0000 7fd053ee0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c112860 con 0x7fd04c108d20 2024-09-21T06:26:51.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.216+0000 7fd053ee0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c112b60 con 0x7fd04c102ae0 2024-09-21T06:26:51.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.216+0000 7fd05147b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c1083d0 0x7fd04c0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:51.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.216+0000 7fd05147b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c1083d0 0x7fd04c0ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48038/0 (socket says 172.21.15.63:48038) 2024-09-21T06:26:51.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.216+0000 7fd05147b640 1 -- 172.21.15.63:0/2844518556 learned_addr learned my addr 172.21.15.63:0/2844518556 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:51.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.217+0000 7fd051c7c640 1 --2- 172.21.15.63:0/2844518556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c102ae0 0x7fd04c0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:51.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.217+0000 7fd05247d640 1 --2- 172.21.15.63:0/2844518556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd04c108d20 0x7fd04c1000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:51.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.217+0000 7fd05147b640 1 -- 172.21.15.63:0/2844518556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c102ae0 msgr2=0x7fd04c0ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:51.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.217+0000 7fd05147b640 1 --2- 172.21.15.63:0/2844518556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c102ae0 0x7fd04c0ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:51.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.217+0000 7fd05147b640 1 -- 172.21.15.63:0/2844518556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd04c108d20 msgr2=0x7fd04c1000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:51.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.217+0000 7fd05147b640 1 --2- 172.21.15.63:0/2844518556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd04c108d20 0x7fd04c1000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:51.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.217+0000 7fd05147b640 1 -- 172.21.15.63:0/2844518556 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04c1a8760 con 0x7fd04c1083d0 2024-09-21T06:26:51.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.217+0000 7fd05247d640 1 --2- 172.21.15.63:0/2844518556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd04c108d20 0x7fd04c1000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:51.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.217+0000 7fd05147b640 1 --2- 172.21.15.63:0/2844518556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c1083d0 0x7fd04c0ffbb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd04800d750 tx=0x7fd04800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:51.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.217+0000 7fd03effd640 1 -- 172.21.15.63:0/2844518556 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048017070 con 0x7fd04c1083d0 2024-09-21T06:26:51.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.217+0000 7fd053ee0640 1 -- 172.21.15.63:0/2844518556 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd04c1a8a50 con 0x7fd04c1083d0 2024-09-21T06:26:51.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.217+0000 7fd03effd640 1 -- 172.21.15.63:0/2844518556 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0480054d0 con 0x7fd04c1083d0 2024-09-21T06:26:51.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.217+0000 7fd03effd640 1 -- 172.21.15.63:0/2844518556 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048004c30 con 0x7fd04c1083d0 2024-09-21T06:26:51.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.217+0000 7fd053ee0640 1 -- 172.21.15.63:0/2844518556 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd04c1a8f90 con 0x7fd04c1083d0 2024-09-21T06:26:51.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.218+0000 7fd053ee0640 1 -- 172.21.15.63:0/2844518556 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd04c102ef0 con 0x7fd04c1083d0 2024-09-21T06:26:51.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.221+0000 7fd03effd640 1 -- 172.21.15.63:0/2844518556 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fd048004dd0 con 0x7fd04c1083d0 2024-09-21T06:26:51.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.221+0000 7fd03effd640 1 --2- 172.21.15.63:0/2844518556 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd0380b65f0 0x7fd0380b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:51.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.222+0000 7fd051c7c640 1 --2- 172.21.15.63:0/2844518556 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd0380b65f0 0x7fd0380b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:51.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.222+0000 7fd03effd640 1 -- 172.21.15.63:0/2844518556 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fd0480e74b0 con 0x7fd04c1083d0 2024-09-21T06:26:51.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.222+0000 7fd051c7c640 1 --2- 172.21.15.63:0/2844518556 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd0380b65f0 0x7fd0380b8b00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd040000c00 tx=0x7fd040031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:51.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.225+0000 7fd03effd640 1 -- 172.21.15.63:0/2844518556 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd0480adb00 con 0x7fd04c1083d0 2024-09-21T06:26:51.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:51 smithi071 ceph-mon[34844]: pgmap v281: 97 pgs: 97 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 13 op/s; 146 B/s, 2 objects/s recovering 2024-09-21T06:26:51.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:51 smithi175 ceph-mon[34510]: pgmap v281: 97 pgs: 97 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 13 op/s; 146 B/s, 2 objects/s recovering 2024-09-21T06:26:51.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.462+0000 7fd053ee0640 1 -- 172.21.15.63:0/2844518556 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fd04c1a9320 con 0x7fd04c1083d0 2024-09-21T06:26:51.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.467+0000 7fd03effd640 1 -- 172.21.15.63:0/2844518556 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v22) ==== 74+0+296449 (secure 0 0 0) 0x7fd0480b1ee0 con 0x7fd04c1083d0 2024-09-21T06:26:51.472 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:26:51.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.471+0000 7fd053ee0640 1 -- 172.21.15.63:0/2844518556 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd0380b65f0 msgr2=0x7fd0380b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:51.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.471+0000 7fd053ee0640 1 --2- 172.21.15.63:0/2844518556 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd0380b65f0 0x7fd0380b8b00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd040000c00 tx=0x7fd040031400 comp rx=0 tx=0).stop 2024-09-21T06:26:51.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.471+0000 7fd053ee0640 1 -- 172.21.15.63:0/2844518556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c1083d0 msgr2=0x7fd04c0ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:51.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.471+0000 7fd053ee0640 1 --2- 172.21.15.63:0/2844518556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c1083d0 0x7fd04c0ffbb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd04800d750 tx=0x7fd04800dc10 comp rx=0 tx=0).stop 2024-09-21T06:26:51.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.471+0000 7fd053ee0640 1 -- 172.21.15.63:0/2844518556 shutdown_connections 2024-09-21T06:26:51.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.471+0000 7fd053ee0640 1 --2- 172.21.15.63:0/2844518556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd04c108d20 0x7fd04c1000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:51.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.471+0000 7fd053ee0640 1 --2- 172.21.15.63:0/2844518556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c1083d0 0x7fd04c0ffbb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:51.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.471+0000 7fd053ee0640 1 --2- 172.21.15.63:0/2844518556 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd0380b65f0 0x7fd0380b8b00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:51.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.471+0000 7fd053ee0640 1 --2- 172.21.15.63:0/2844518556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c102ae0 0x7fd04c0ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:51.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.471+0000 7fd053ee0640 1 -- 172.21.15.63:0/2844518556 >> 172.21.15.63:0/2844518556 conn(0x7fd04c0797b0 msgr2=0x7fd04c101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:51.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.471+0000 7fd053ee0640 1 -- 172.21.15.63:0/2844518556 shutdown_connections 2024-09-21T06:26:51.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:51.471+0000 7fd053ee0640 1 -- 172.21.15.63:0/2844518556 wait complete. 2024-09-21T06:26:52.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:52 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2844518556' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T06:26:52.235 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":22,"flags":0,"active_gid":14223,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":651259686},{"type":"v1","addr":"172.21.15.63:6801","nonce":651259686}]},"active_addr":"172.21.15.63:6801/651259686","active_change":"2024-09-21T06:19:37.776620+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24175,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24176,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.63:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":737649430}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":1537358700}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":3987488206}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":3330818744}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":691351293}]}]} 2024-09-21T06:26:52.242 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T06:26:52.242 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T06:26:52.242 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:26:52.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:52 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2844518556' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T06:26:52.498 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:52.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:52 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2844518556' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T06:26:53.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.003+0000 7f3af92e0640 1 -- 172.21.15.63:0/3093245133 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3af4102ae0 msgr2=0x7f3af4102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:53.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.003+0000 7f3af92e0640 1 --2- 172.21.15.63:0/3093245133 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3af4102ae0 0x7f3af4102ef0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4009900 tx=0x7f3ae402a410 comp rx=0 tx=0).stop 2024-09-21T06:26:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.003+0000 7f3af92e0640 1 -- 172.21.15.63:0/3093245133 shutdown_connections 2024-09-21T06:26:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.003+0000 7f3af92e0640 1 --2- 172.21.15.63:0/3093245133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3af4108d20 0x7f3af410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.003+0000 7f3af92e0640 1 --2- 172.21.15.63:0/3093245133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3af41083d0 0x7f3af41087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.003+0000 7f3af92e0640 1 --2- 172.21.15.63:0/3093245133 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3af4102ae0 0x7f3af4102ef0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.003+0000 7f3af92e0640 1 -- 172.21.15.63:0/3093245133 >> 172.21.15.63:0/3093245133 conn(0x7f3af4079760 msgr2=0x7f3af4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.003+0000 7f3af92e0640 1 -- 172.21.15.63:0/3093245133 shutdown_connections 2024-09-21T06:26:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.003+0000 7f3af92e0640 1 -- 172.21.15.63:0/3093245133 wait complete. 2024-09-21T06:26:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.004+0000 7f3af92e0640 1 Processor -- start 2024-09-21T06:26:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.004+0000 7f3af92e0640 1 -- start start 2024-09-21T06:26:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.004+0000 7f3af92e0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3af4102ae0 0x7f3af410ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.004+0000 7f3af92e0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3af41083d0 0x7f3af4110520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.004+0000 7f3af92e0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3af4108d20 0x7f3af4110a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.005+0000 7f3af92e0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3af4113ab0 con 0x7f3af4102ae0 2024-09-21T06:26:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.005+0000 7f3af92e0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3af4113930 con 0x7f3af4108d20 2024-09-21T06:26:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.005+0000 7f3af92e0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3af4113c30 con 0x7f3af41083d0 2024-09-21T06:26:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.005+0000 7f3af2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3af4102ae0 0x7f3af410ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.005+0000 7f3af2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3af4102ae0 0x7f3af410ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48046/0 (socket says 172.21.15.63:48046) 2024-09-21T06:26:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.005+0000 7f3af2ffd640 1 -- 172.21.15.63:0/700642570 learned_addr learned my addr 172.21.15.63:0/700642570 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.005+0000 7f3af37fe640 1 --2- 172.21.15.63:0/700642570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3af4108d20 0x7f3af4110a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.005+0000 7f3af27fc640 1 --2- 172.21.15.63:0/700642570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3af41083d0 0x7f3af4110520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.005+0000 7f3af2ffd640 1 -- 172.21.15.63:0/700642570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3af41083d0 msgr2=0x7f3af4110520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.005+0000 7f3af2ffd640 1 --2- 172.21.15.63:0/700642570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3af41083d0 0x7f3af4110520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.005+0000 7f3af2ffd640 1 -- 172.21.15.63:0/700642570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3af4108d20 msgr2=0x7f3af4110a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.005+0000 7f3af2ffd640 1 --2- 172.21.15.63:0/700642570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3af4108d20 0x7f3af4110a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.005+0000 7f3af2ffd640 1 -- 172.21.15.63:0/700642570 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af41a87c0 con 0x7f3af4102ae0 2024-09-21T06:26:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.006+0000 7f3af2ffd640 1 --2- 172.21.15.63:0/700642570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3af4102ae0 0x7f3af410ffe0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4005940 tx=0x7f3ae40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.006+0000 7f3aebfff640 1 -- 172.21.15.63:0/700642570 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae403f030 con 0x7f3af4102ae0 2024-09-21T06:26:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.006+0000 7f3af92e0640 1 -- 172.21.15.63:0/700642570 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3af41a8a50 con 0x7f3af4102ae0 2024-09-21T06:26:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.006+0000 7f3aebfff640 1 -- 172.21.15.63:0/700642570 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ae4003cb0 con 0x7f3af4102ae0 2024-09-21T06:26:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.006+0000 7f3aebfff640 1 -- 172.21.15.63:0/700642570 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4035070 con 0x7f3af4102ae0 2024-09-21T06:26:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.006+0000 7f3af92e0640 1 -- 172.21.15.63:0/700642570 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af41a8f80 con 0x7f3af4102ae0 2024-09-21T06:26:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.007+0000 7f3af92e0640 1 -- 172.21.15.63:0/700642570 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3af4103d10 con 0x7f3af4102ae0 2024-09-21T06:26:53.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.010+0000 7f3aebfff640 1 -- 172.21.15.63:0/700642570 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f3ae4042030 con 0x7f3af4102ae0 2024-09-21T06:26:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.010+0000 7f3aebfff640 1 --2- 172.21.15.63:0/700642570 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3ae00b65f0 0x7f3ae00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.010+0000 7f3af27fc640 1 --2- 172.21.15.63:0/700642570 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3ae00b65f0 0x7f3ae00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.011+0000 7f3aebfff640 1 -- 172.21.15.63:0/700642570 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f3ae41080b0 con 0x7f3af4102ae0 2024-09-21T06:26:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.011+0000 7f3af27fc640 1 --2- 172.21.15.63:0/700642570 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3ae00b65f0 0x7f3ae00b8b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3adc005fd0 tx=0x7f3adc005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:53.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.014+0000 7f3aebfff640 1 -- 172.21.15.63:0/700642570 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3ae40ce7a0 con 0x7f3af4102ae0 2024-09-21T06:26:53.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.203+0000 7f3af92e0640 1 -- 172.21.15.63:0/700642570 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3af4102ef0 con 0x7f3af4102ae0 2024-09-21T06:26:53.205 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:53 smithi063 ceph-mon[31150]: pgmap v282: 97 pgs: 97 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.8 KiB/s wr, 9 op/s; 133 B/s, 1 objects/s recovering 2024-09-21T06:26:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.205+0000 7f3aebfff640 1 -- 172.21.15.63:0/700642570 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+23049 (secure 0 0 0) 0x7f3af4102ef0 con 0x7f3af4102ae0 2024-09-21T06:26:53.207 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:26:53.207 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":77,"fsid":"140899c8-77e1-11ef-baf5-efdc52797490","created":"2024-09-21T06:17:48.089366+0000","modified":"2024-09-21T06:26:38.957699+0000","last_up_change":"2024-09-21T06:25:29.072128+0000","last_in_change":"2024-09-21T06:25:06.097647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:21:36.236868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:26:15.016085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:26:17.072883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df4162c1-dd66-4d11-99bc-0ae36ea130f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6803","nonce":2090653772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6805","nonce":2090653772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6809","nonce":2090653772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6807","nonce":2090653772}]},"public_addr":"172.21.15.63:6803/2090653772","cluster_addr":"172.21.15.63:6805/2090653772","heartbeat_back_addr":"172.21.15.63:6809/2090653772","heartbeat_front_addr":"172.21.15.63:6807/2090653772","state":["exists","up"]},{"osd":1,"uuid":"65a12def-9f66-4153-8f1a-2ebfbbfeba99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6801","nonce":1676297548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6803","nonce":1676297548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6807","nonce":1676297548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6805","nonce":1676297548}]},"public_addr":"172.21.15.71:6801/1676297548","cluster_addr":"172.21.15.71:6803/1676297548","heartbeat_back_addr":"172.21.15.71:6807/1676297548","heartbeat_front_addr":"172.21.15.71:6805/1676297548","state":["exists","up"]},{"osd":2,"uuid":"031daa9e-9d4a-4901-95e8-695db5671fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6801","nonce":2356865390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6803","nonce":2356865390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6807","nonce":2356865390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6805","nonce":2356865390}]},"public_addr":"172.21.15.175:6801/2356865390","cluster_addr":"172.21.15.175:6803/2356865390","heartbeat_back_addr":"172.21.15.175:6807/2356865390","heartbeat_front_addr":"172.21.15.175:6805/2356865390","state":["exists","up"]},{"osd":3,"uuid":"75d23a7a-c560-4b26-84a4-74d6772a37ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6811","nonce":31683339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6813","nonce":31683339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6817","nonce":31683339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6815","nonce":31683339}]},"public_addr":"172.21.15.63:6811/31683339","cluster_addr":"172.21.15.63:6813/31683339","heartbeat_back_addr":"172.21.15.63:6817/31683339","heartbeat_front_addr":"172.21.15.63:6815/31683339","state":["exists","up"]},{"osd":4,"uuid":"6aaefd09-93dd-4f21-9b3c-701a7ff97f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6809","nonce":829449898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6811","nonce":829449898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6815","nonce":829449898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6813","nonce":829449898}]},"public_addr":"172.21.15.71:6809/829449898","cluster_addr":"172.21.15.71:6811/829449898","heartbeat_back_addr":"172.21.15.71:6815/829449898","heartbeat_front_addr":"172.21.15.71:6813/829449898","state":["exists","up"]},{"osd":5,"uuid":"91f28121-c94e-4012-b74c-dd4597545e3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6809","nonce":3005600597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6811","nonce":3005600597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6815","nonce":3005600597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6813","nonce":3005600597}]},"public_addr":"172.21.15.175:6809/3005600597","cluster_addr":"172.21.15.175:6811/3005600597","heartbeat_back_addr":"172.21.15.175:6815/3005600597","heartbeat_front_addr":"172.21.15.175:6813/3005600597","state":["exists","up"]},{"osd":6,"uuid":"bda28014-4dca-40f1-bb23-3ef61605c1ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6819","nonce":4044730408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6821","nonce":4044730408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6825","nonce":4044730408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6823","nonce":4044730408}]},"public_addr":"172.21.15.63:6819/4044730408","cluster_addr":"172.21.15.63:6821/4044730408","heartbeat_back_addr":"172.21.15.63:6825/4044730408","heartbeat_front_addr":"172.21.15.63:6823/4044730408","state":["exists","up"]},{"osd":7,"uuid":"a9026588-ccdc-4e6c-b628-1ac8a7dbfa64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6817","nonce":2913027708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6819","nonce":2913027708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6823","nonce":2913027708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6821","nonce":2913027708}]},"public_addr":"172.21.15.71:6817/2913027708","cluster_addr":"172.21.15.71:6819/2913027708","heartbeat_back_addr":"172.21.15.71:6823/2913027708","heartbeat_front_addr":"172.21.15.71:6821/2913027708","state":["exists","up"]},{"osd":8,"uuid":"2e1dacea-483c-4587-8d19-5c77a7b98667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6817","nonce":2058692148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6819","nonce":2058692148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6823","nonce":2058692148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6821","nonce":2058692148}]},"public_addr":"172.21.15.175:6817/2058692148","cluster_addr":"172.21.15.175:6819/2058692148","heartbeat_back_addr":"172.21.15.175:6823/2058692148","heartbeat_front_addr":"172.21.15.175:6821/2058692148","state":["exists","up"]},{"osd":9,"uuid":"7077ba4d-1fce-4197-a556-8b6a859c6f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6827","nonce":3278012285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6829","nonce":3278012285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6833","nonce":3278012285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6831","nonce":3278012285}]},"public_addr":"172.21.15.63:6827/3278012285","cluster_addr":"172.21.15.63:6829/3278012285","heartbeat_back_addr":"172.21.15.63:6833/3278012285","heartbeat_front_addr":"172.21.15.63:6831/3278012285","state":["exists","up"]},{"osd":10,"uuid":"99965496-91ee-4eef-9f2e-8f9c8dc54f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6825","nonce":3297929438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6827","nonce":3297929438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6831","nonce":3297929438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6829","nonce":3297929438}]},"public_addr":"172.21.15.71:6825/3297929438","cluster_addr":"172.21.15.71:6827/3297929438","heartbeat_back_addr":"172.21.15.71:6831/3297929438","heartbeat_front_addr":"172.21.15.71:6829/3297929438","state":["exists","up"]},{"osd":11,"uuid":"1b26d1a8-91a4-4877-ad1c-18160a1b3b6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6825","nonce":1970094291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6827","nonce":1970094291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6831","nonce":1970094291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6829","nonce":1970094291}]},"public_addr":"172.21.15.175:6825/1970094291","cluster_addr":"172.21.15.175:6827/1970094291","heartbeat_back_addr":"172.21.15.175:6831/1970094291","heartbeat_front_addr":"172.21.15.175:6829/1970094291","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:20:43.732676+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:08.957775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:34.157788+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:00.134410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:25.502998+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:51.739501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:18.325642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:44.430626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:10.776017+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:36.482831+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:01.898216+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:27.644941+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/1652196301":"2024-09-22T06:19:37.776447+0000","172.21.15.63:6801/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/2740830999":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6801/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6801/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/2958589237":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/1398493582":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/3529491525":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/363262068":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6800/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/3928056461":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/128321401":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/39222803":"2024-09-22T06:19:37.776447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:26:53.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.208+0000 7f3af92e0640 1 -- 172.21.15.63:0/700642570 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3ae00b65f0 msgr2=0x7f3ae00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:53.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.208+0000 7f3af92e0640 1 --2- 172.21.15.63:0/700642570 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3ae00b65f0 0x7f3ae00b8b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3adc005fd0 tx=0x7f3adc005850 comp rx=0 tx=0).stop 2024-09-21T06:26:53.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.208+0000 7f3af92e0640 1 -- 172.21.15.63:0/700642570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3af4102ae0 msgr2=0x7f3af410ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:53.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.208+0000 7f3af92e0640 1 --2- 172.21.15.63:0/700642570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3af4102ae0 0x7f3af410ffe0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4005940 tx=0x7f3ae40042f0 comp rx=0 tx=0).stop 2024-09-21T06:26:53.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.208+0000 7f3af92e0640 1 -- 172.21.15.63:0/700642570 shutdown_connections 2024-09-21T06:26:53.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.208+0000 7f3af92e0640 1 --2- 172.21.15.63:0/700642570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3af4108d20 0x7f3af4110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:53.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.208+0000 7f3af92e0640 1 --2- 172.21.15.63:0/700642570 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3ae00b65f0 0x7f3ae00b8b00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:53.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.208+0000 7f3af92e0640 1 --2- 172.21.15.63:0/700642570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3af41083d0 0x7f3af4110520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:53.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.208+0000 7f3af92e0640 1 --2- 172.21.15.63:0/700642570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3af4102ae0 0x7f3af410ffe0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:53.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.208+0000 7f3af92e0640 1 -- 172.21.15.63:0/700642570 >> 172.21.15.63:0/700642570 conn(0x7f3af4079760 msgr2=0x7f3af41014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:53.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.208+0000 7f3af92e0640 1 -- 172.21.15.63:0/700642570 shutdown_connections 2024-09-21T06:26:53.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:53.208+0000 7f3af92e0640 1 -- 172.21.15.63:0/700642570 wait complete. 2024-09-21T06:26:53.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:53 smithi175 ceph-mon[34510]: pgmap v282: 97 pgs: 97 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.8 KiB/s wr, 9 op/s; 133 B/s, 1 objects/s recovering 2024-09-21T06:26:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:53 smithi071 ceph-mon[34844]: pgmap v282: 97 pgs: 97 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.8 KiB/s wr, 9 op/s; 133 B/s, 1 objects/s recovering 2024-09-21T06:26:53.959 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T06:26:53.960 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:26:54.223 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:54.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:54 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/700642570' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:26:54.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:54 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/700642570' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:26:54.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:54 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/700642570' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:26:54.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.761+0000 7ffbc5a5e640 1 -- 172.21.15.63:0/618848565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbc01094a0 msgr2=0x7ffbc01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:54.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.761+0000 7ffbc5a5e640 1 --2- 172.21.15.63:0/618848565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbc01094a0 0x7ffbc01098b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009900 tx=0x7ffbb402a410 comp rx=0 tx=0).stop 2024-09-21T06:26:54.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.761+0000 7ffbc5a5e640 1 -- 172.21.15.63:0/618848565 shutdown_connections 2024-09-21T06:26:54.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.761+0000 7ffbc5a5e640 1 --2- 172.21.15.63:0/618848565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc0109df0 0x7ffbc0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.761+0000 7ffbc5a5e640 1 --2- 172.21.15.63:0/618848565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbc01094a0 0x7ffbc01098b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.761+0000 7ffbc5a5e640 1 --2- 172.21.15.63:0/618848565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbc0103b60 0x7ffbc0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.761+0000 7ffbc5a5e640 1 -- 172.21.15.63:0/618848565 >> 172.21.15.63:0/618848565 conn(0x7ffbc007b850 msgr2=0x7ffbc007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:54.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.761+0000 7ffbc5a5e640 1 -- 172.21.15.63:0/618848565 shutdown_connections 2024-09-21T06:26:54.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.761+0000 7ffbc5a5e640 1 -- 172.21.15.63:0/618848565 wait complete. 2024-09-21T06:26:54.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.761+0000 7ffbc5a5e640 1 Processor -- start 2024-09-21T06:26:54.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.762+0000 7ffbc5a5e640 1 -- start start 2024-09-21T06:26:54.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.762+0000 7ffbc5a5e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc0103b60 0x7ffbc019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.762+0000 7ffbc5a5e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbc01094a0 0x7ffbc019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.762+0000 7ffbc5a5e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbc0109df0 0x7ffbc019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.762+0000 7ffbc5a5e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc0113ab0 con 0x7ffbc0109df0 2024-09-21T06:26:54.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.762+0000 7ffbc5a5e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc0113930 con 0x7ffbc0103b60 2024-09-21T06:26:54.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.762+0000 7ffbc5a5e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc0113c30 con 0x7ffbc01094a0 2024-09-21T06:26:54.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.762+0000 7ffbbf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbc0109df0 0x7ffbc019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.762+0000 7ffbbf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbc0109df0 0x7ffbc019fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48066/0 (socket says 172.21.15.63:48066) 2024-09-21T06:26:54.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.762+0000 7ffbbf7fe640 1 -- 172.21.15.63:0/1617556688 learned_addr learned my addr 172.21.15.63:0/1617556688 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:54.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.762+0000 7ffbbeffd640 1 --2- 172.21.15.63:0/1617556688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc0103b60 0x7ffbc019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.762+0000 7ffbbe7fc640 1 --2- 172.21.15.63:0/1617556688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbc01094a0 0x7ffbc019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.762+0000 7ffbbf7fe640 1 -- 172.21.15.63:0/1617556688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbc01094a0 msgr2=0x7ffbc019ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:54.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.762+0000 7ffbbf7fe640 1 --2- 172.21.15.63:0/1617556688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbc01094a0 0x7ffbc019ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.762+0000 7ffbbf7fe640 1 -- 172.21.15.63:0/1617556688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc0103b60 msgr2=0x7ffbc019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:54.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.762+0000 7ffbbf7fe640 1 --2- 172.21.15.63:0/1617556688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc0103b60 0x7ffbc019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.762+0000 7ffbbf7fe640 1 -- 172.21.15.63:0/1617556688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc01a04f0 con 0x7ffbc0109df0 2024-09-21T06:26:54.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.763+0000 7ffbbf7fe640 1 --2- 172.21.15.63:0/1617556688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbc0109df0 0x7ffbc019fdc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800eaa0 tx=0x7ffbb800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:54.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.763+0000 7ffbc4a5c640 1 -- 172.21.15.63:0/1617556688 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb800cdb0 con 0x7ffbc0109df0 2024-09-21T06:26:54.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.763+0000 7ffbc4a5c640 1 -- 172.21.15.63:0/1617556688 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbb8005020 con 0x7ffbc0109df0 2024-09-21T06:26:54.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.763+0000 7ffbc5a5e640 1 -- 172.21.15.63:0/1617556688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc01a07e0 con 0x7ffbc0109df0 2024-09-21T06:26:54.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.763+0000 7ffbc4a5c640 1 -- 172.21.15.63:0/1617556688 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb80116d0 con 0x7ffbc0109df0 2024-09-21T06:26:54.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.763+0000 7ffbc5a5e640 1 -- 172.21.15.63:0/1617556688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc01a6f40 con 0x7ffbc0109df0 2024-09-21T06:26:54.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.764+0000 7ffbc5a5e640 1 -- 172.21.15.63:0/1617556688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc0103f70 con 0x7ffbc0109df0 2024-09-21T06:26:54.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.766+0000 7ffbc4a5c640 1 -- 172.21.15.63:0/1617556688 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7ffbb80051d0 con 0x7ffbc0109df0 2024-09-21T06:26:54.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.767+0000 7ffbc4a5c640 1 --2- 172.21.15.63:0/1617556688 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffba80b65f0 0x7ffba80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.768+0000 7ffbbeffd640 1 --2- 172.21.15.63:0/1617556688 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffba80b65f0 0x7ffba80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.768+0000 7ffbc4a5c640 1 -- 172.21.15.63:0/1617556688 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ffbb80e7b50 con 0x7ffbc0109df0 2024-09-21T06:26:54.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.768+0000 7ffbbeffd640 1 --2- 172.21.15.63:0/1617556688 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffba80b65f0 0x7ffba80b8b00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0005fd0 tx=0x7ffbb000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:54.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.770+0000 7ffbc4a5c640 1 -- 172.21.15.63:0/1617556688 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffbb8016030 con 0x7ffbc0109df0 2024-09-21T06:26:54.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.960+0000 7ffbc5a5e640 1 -- 172.21.15.63:0/1617556688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffbc019b6b0 con 0x7ffbc0109df0 2024-09-21T06:26:54.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.962+0000 7ffbc4a5c640 1 -- 172.21.15.63:0/1617556688 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+23049 (secure 0 0 0) 0x7ffbb80ae1a0 con 0x7ffbc0109df0 2024-09-21T06:26:54.967 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:26:54.967 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":77,"fsid":"140899c8-77e1-11ef-baf5-efdc52797490","created":"2024-09-21T06:17:48.089366+0000","modified":"2024-09-21T06:26:38.957699+0000","last_up_change":"2024-09-21T06:25:29.072128+0000","last_in_change":"2024-09-21T06:25:06.097647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:21:36.236868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:26:15.016085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:26:17.072883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df4162c1-dd66-4d11-99bc-0ae36ea130f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6803","nonce":2090653772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6805","nonce":2090653772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6809","nonce":2090653772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6807","nonce":2090653772}]},"public_addr":"172.21.15.63:6803/2090653772","cluster_addr":"172.21.15.63:6805/2090653772","heartbeat_back_addr":"172.21.15.63:6809/2090653772","heartbeat_front_addr":"172.21.15.63:6807/2090653772","state":["exists","up"]},{"osd":1,"uuid":"65a12def-9f66-4153-8f1a-2ebfbbfeba99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6801","nonce":1676297548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6803","nonce":1676297548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6807","nonce":1676297548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6805","nonce":1676297548}]},"public_addr":"172.21.15.71:6801/1676297548","cluster_addr":"172.21.15.71:6803/1676297548","heartbeat_back_addr":"172.21.15.71:6807/1676297548","heartbeat_front_addr":"172.21.15.71:6805/1676297548","state":["exists","up"]},{"osd":2,"uuid":"031daa9e-9d4a-4901-95e8-695db5671fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6801","nonce":2356865390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6803","nonce":2356865390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6807","nonce":2356865390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6805","nonce":2356865390}]},"public_addr":"172.21.15.175:6801/2356865390","cluster_addr":"172.21.15.175:6803/2356865390","heartbeat_back_addr":"172.21.15.175:6807/2356865390","heartbeat_front_addr":"172.21.15.175:6805/2356865390","state":["exists","up"]},{"osd":3,"uuid":"75d23a7a-c560-4b26-84a4-74d6772a37ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6811","nonce":31683339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6813","nonce":31683339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6817","nonce":31683339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6815","nonce":31683339}]},"public_addr":"172.21.15.63:6811/31683339","cluster_addr":"172.21.15.63:6813/31683339","heartbeat_back_addr":"172.21.15.63:6817/31683339","heartbeat_front_addr":"172.21.15.63:6815/31683339","state":["exists","up"]},{"osd":4,"uuid":"6aaefd09-93dd-4f21-9b3c-701a7ff97f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6809","nonce":829449898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6811","nonce":829449898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6815","nonce":829449898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6813","nonce":829449898}]},"public_addr":"172.21.15.71:6809/829449898","cluster_addr":"172.21.15.71:6811/829449898","heartbeat_back_addr":"172.21.15.71:6815/829449898","heartbeat_front_addr":"172.21.15.71:6813/829449898","state":["exists","up"]},{"osd":5,"uuid":"91f28121-c94e-4012-b74c-dd4597545e3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6809","nonce":3005600597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6811","nonce":3005600597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6815","nonce":3005600597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6813","nonce":3005600597}]},"public_addr":"172.21.15.175:6809/3005600597","cluster_addr":"172.21.15.175:6811/3005600597","heartbeat_back_addr":"172.21.15.175:6815/3005600597","heartbeat_front_addr":"172.21.15.175:6813/3005600597","state":["exists","up"]},{"osd":6,"uuid":"bda28014-4dca-40f1-bb23-3ef61605c1ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6819","nonce":4044730408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6821","nonce":4044730408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6825","nonce":4044730408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6823","nonce":4044730408}]},"public_addr":"172.21.15.63:6819/4044730408","cluster_addr":"172.21.15.63:6821/4044730408","heartbeat_back_addr":"172.21.15.63:6825/4044730408","heartbeat_front_addr":"172.21.15.63:6823/4044730408","state":["exists","up"]},{"osd":7,"uuid":"a9026588-ccdc-4e6c-b628-1ac8a7dbfa64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6817","nonce":2913027708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6819","nonce":2913027708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6823","nonce":2913027708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6821","nonce":2913027708}]},"public_addr":"172.21.15.71:6817/2913027708","cluster_addr":"172.21.15.71:6819/2913027708","heartbeat_back_addr":"172.21.15.71:6823/2913027708","heartbeat_front_addr":"172.21.15.71:6821/2913027708","state":["exists","up"]},{"osd":8,"uuid":"2e1dacea-483c-4587-8d19-5c77a7b98667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6817","nonce":2058692148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6819","nonce":2058692148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6823","nonce":2058692148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6821","nonce":2058692148}]},"public_addr":"172.21.15.175:6817/2058692148","cluster_addr":"172.21.15.175:6819/2058692148","heartbeat_back_addr":"172.21.15.175:6823/2058692148","heartbeat_front_addr":"172.21.15.175:6821/2058692148","state":["exists","up"]},{"osd":9,"uuid":"7077ba4d-1fce-4197-a556-8b6a859c6f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6827","nonce":3278012285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6829","nonce":3278012285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6833","nonce":3278012285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6831","nonce":3278012285}]},"public_addr":"172.21.15.63:6827/3278012285","cluster_addr":"172.21.15.63:6829/3278012285","heartbeat_back_addr":"172.21.15.63:6833/3278012285","heartbeat_front_addr":"172.21.15.63:6831/3278012285","state":["exists","up"]},{"osd":10,"uuid":"99965496-91ee-4eef-9f2e-8f9c8dc54f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6825","nonce":3297929438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6827","nonce":3297929438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6831","nonce":3297929438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6829","nonce":3297929438}]},"public_addr":"172.21.15.71:6825/3297929438","cluster_addr":"172.21.15.71:6827/3297929438","heartbeat_back_addr":"172.21.15.71:6831/3297929438","heartbeat_front_addr":"172.21.15.71:6829/3297929438","state":["exists","up"]},{"osd":11,"uuid":"1b26d1a8-91a4-4877-ad1c-18160a1b3b6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6825","nonce":1970094291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6827","nonce":1970094291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6831","nonce":1970094291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6829","nonce":1970094291}]},"public_addr":"172.21.15.175:6825/1970094291","cluster_addr":"172.21.15.175:6827/1970094291","heartbeat_back_addr":"172.21.15.175:6831/1970094291","heartbeat_front_addr":"172.21.15.175:6829/1970094291","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:20:43.732676+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:08.957775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:34.157788+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:00.134410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:25.502998+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:51.739501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:18.325642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:44.430626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:10.776017+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:36.482831+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:01.898216+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:27.644941+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/1652196301":"2024-09-22T06:19:37.776447+0000","172.21.15.63:6801/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/2740830999":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6801/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6801/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/2958589237":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/1398493582":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/3529491525":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/363262068":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6800/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/3928056461":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/128321401":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/39222803":"2024-09-22T06:19:37.776447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:26:54.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.964+0000 7ffbc5a5e640 1 -- 172.21.15.63:0/1617556688 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffba80b65f0 msgr2=0x7ffba80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:54.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.964+0000 7ffbc5a5e640 1 --2- 172.21.15.63:0/1617556688 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffba80b65f0 0x7ffba80b8b00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0005fd0 tx=0x7ffbb000b390 comp rx=0 tx=0).stop 2024-09-21T06:26:54.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.964+0000 7ffbc5a5e640 1 -- 172.21.15.63:0/1617556688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbc0109df0 msgr2=0x7ffbc019fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:54.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.964+0000 7ffbc5a5e640 1 --2- 172.21.15.63:0/1617556688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbc0109df0 0x7ffbc019fdc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800eaa0 tx=0x7ffbb800ef60 comp rx=0 tx=0).stop 2024-09-21T06:26:54.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.964+0000 7ffbc5a5e640 1 -- 172.21.15.63:0/1617556688 shutdown_connections 2024-09-21T06:26:54.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.964+0000 7ffbc5a5e640 1 --2- 172.21.15.63:0/1617556688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbc0109df0 0x7ffbc019fdc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.964+0000 7ffbc5a5e640 1 --2- 172.21.15.63:0/1617556688 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffba80b65f0 0x7ffba80b8b00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.964+0000 7ffbc5a5e640 1 --2- 172.21.15.63:0/1617556688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbc01094a0 0x7ffbc019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.964+0000 7ffbc5a5e640 1 --2- 172.21.15.63:0/1617556688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc0103b60 0x7ffbc019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.964+0000 7ffbc5a5e640 1 -- 172.21.15.63:0/1617556688 >> 172.21.15.63:0/1617556688 conn(0x7ffbc007b850 msgr2=0x7ffbc0105580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:54.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.964+0000 7ffbc5a5e640 1 -- 172.21.15.63:0/1617556688 shutdown_connections 2024-09-21T06:26:54.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:54.964+0000 7ffbc5a5e640 1 -- 172.21.15.63:0/1617556688 wait complete. 2024-09-21T06:26:55.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:55 smithi063 ceph-mon[31150]: pgmap v283: 97 pgs: 97 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s; 65 B/s, 1 objects/s recovering 2024-09-21T06:26:55.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:55 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1617556688' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:26:55.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:55 smithi175 ceph-mon[34510]: pgmap v283: 97 pgs: 97 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s; 65 B/s, 1 objects/s recovering 2024-09-21T06:26:55.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:55 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1617556688' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:26:55.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:55 smithi071 ceph-mon[34844]: pgmap v283: 97 pgs: 97 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s; 65 B/s, 1 objects/s recovering 2024-09-21T06:26:55.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:55 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1617556688' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:26:55.747 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T06:26:55.747 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T06:26:55.748 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T06:26:55.748 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T06:26:55.749 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T06:26:55.749 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T06:26:55.749 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T06:26:55.750 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T06:26:55.750 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T06:26:55.751 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T06:26:55.751 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T06:26:55.752 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T06:26:56.437 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:56.541 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:57.199 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:57 smithi063 ceph-mon[31150]: pgmap v284: 97 pgs: 97 active+clean; 647 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-09-21T06:26:57.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.290+0000 7f77734b3640 1 -- 172.21.15.63:0/2105895641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f776c103b60 msgr2=0x7f776c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:57.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.290+0000 7f77734b3640 1 --2- 172.21.15.63:0/2105895641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f776c103b60 0x7f776c103f70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7768009900 tx=0x7f776802a410 comp rx=0 tx=0).stop 2024-09-21T06:26:57.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.290+0000 7f77734b3640 1 -- 172.21.15.63:0/2105895641 shutdown_connections 2024-09-21T06:26:57.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.290+0000 7f77734b3640 1 --2- 172.21.15.63:0/2105895641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f776c109df0 0x7f776c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.290+0000 7f77734b3640 1 --2- 172.21.15.63:0/2105895641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f776c1094a0 0x7f776c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.290+0000 7f77734b3640 1 --2- 172.21.15.63:0/2105895641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f776c103b60 0x7f776c103f70 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.290+0000 7f77734b3640 1 -- 172.21.15.63:0/2105895641 >> 172.21.15.63:0/2105895641 conn(0x7f776c07b850 msgr2=0x7f776c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:57.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.290+0000 7f77734b3640 1 -- 172.21.15.63:0/2105895641 shutdown_connections 2024-09-21T06:26:57.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.290+0000 7f77734b3640 1 -- 172.21.15.63:0/2105895641 wait complete. 2024-09-21T06:26:57.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.291+0000 7f77734b3640 1 Processor -- start 2024-09-21T06:26:57.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.291+0000 7f77734b3640 1 -- start start 2024-09-21T06:26:57.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.291+0000 7f77734b3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f776c103b60 0x7f776c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.291+0000 7f77734b3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f776c1094a0 0x7f776c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.291+0000 7f77734b3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f776c109df0 0x7f776c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.291+0000 7f77734b3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f776c113ab0 con 0x7f776c109df0 2024-09-21T06:26:57.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.291+0000 7f77734b3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f776c113930 con 0x7f776c103b60 2024-09-21T06:26:57.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.291+0000 7f77734b3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f776c113c30 con 0x7f776c1094a0 2024-09-21T06:26:57.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.291+0000 7f7771a50640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f776c109df0 0x7f776c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.291+0000 7f7771a50640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f776c109df0 0x7f776c19fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58504/0 (socket says 172.21.15.63:58504) 2024-09-21T06:26:57.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.291+0000 7f7771a50640 1 -- 172.21.15.63:0/3802909659 learned_addr learned my addr 172.21.15.63:0/3802909659 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:57.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.291+0000 7f7770a4e640 1 --2- 172.21.15.63:0/3802909659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f776c1094a0 0x7f776c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.291+0000 7f777124f640 1 --2- 172.21.15.63:0/3802909659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f776c103b60 0x7f776c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.291+0000 7f7771a50640 1 -- 172.21.15.63:0/3802909659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f776c1094a0 msgr2=0x7f776c19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:57.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.291+0000 7f7771a50640 1 --2- 172.21.15.63:0/3802909659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f776c1094a0 0x7f776c19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.291+0000 7f7771a50640 1 -- 172.21.15.63:0/3802909659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f776c103b60 msgr2=0x7f776c19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:57.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.291+0000 7f7771a50640 1 --2- 172.21.15.63:0/3802909659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f776c103b60 0x7f776c19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.291+0000 7f7771a50640 1 -- 172.21.15.63:0/3802909659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776c1a0350 con 0x7f776c109df0 2024-09-21T06:26:57.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.291+0000 7f777124f640 1 --2- 172.21.15.63:0/3802909659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f776c103b60 0x7f776c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:57.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.292+0000 7f7771a50640 1 --2- 172.21.15.63:0/3802909659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f776c109df0 0x7f776c19fce0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f776400eaa0 tx=0x7f776400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:57.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.292+0000 7f775e7fc640 1 -- 172.21.15.63:0/3802909659 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7764004d20 con 0x7f776c109df0 2024-09-21T06:26:57.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.292+0000 7f775e7fc640 1 -- 172.21.15.63:0/3802909659 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7764005020 con 0x7f776c109df0 2024-09-21T06:26:57.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.292+0000 7f77734b3640 1 -- 172.21.15.63:0/3802909659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f776c1a0640 con 0x7f776c109df0 2024-09-21T06:26:57.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.292+0000 7f775e7fc640 1 -- 172.21.15.63:0/3802909659 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77640116b0 con 0x7f776c109df0 2024-09-21T06:26:57.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.292+0000 7f77734b3640 1 -- 172.21.15.63:0/3802909659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f776c1a6e60 con 0x7f776c109df0 2024-09-21T06:26:57.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.293+0000 7f77734b3640 1 -- 172.21.15.63:0/3802909659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f776c063b50 con 0x7f776c109df0 2024-09-21T06:26:57.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.295+0000 7f775e7fc640 1 -- 172.21.15.63:0/3802909659 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f77640051d0 con 0x7f776c109df0 2024-09-21T06:26:57.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.295+0000 7f775e7fc640 1 --2- 172.21.15.63:0/3802909659 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f77580b66a0 0x7f77580b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.296+0000 7f777124f640 1 --2- 172.21.15.63:0/3802909659 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f77580b66a0 0x7f77580b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.296+0000 7f775e7fc640 1 -- 172.21.15.63:0/3802909659 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f77640e7b80 con 0x7f776c109df0 2024-09-21T06:26:57.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.296+0000 7f775e7fc640 1 --2- 172.21.15.63:0/3802909659 >> [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772] conn(0x7f77580c0490 0x7f77580c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.296+0000 7f775e7fc640 1 -- 172.21.15.63:0/3802909659 --> [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f776401ce50 con 0x7f77580c0490 2024-09-21T06:26:57.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.296+0000 7f775e7fc640 1 -- 172.21.15.63:0/3802909659 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f77640e7fd0 con 0x7f776c109df0 2024-09-21T06:26:57.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.296+0000 7f7770a4e640 1 --2- 172.21.15.63:0/3802909659 >> [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772] conn(0x7f77580c0490 0x7f77580c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.296+0000 7f777124f640 1 --2- 172.21.15.63:0/3802909659 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f77580b66a0 0x7f77580b8bb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7768031440 tx=0x7f7768009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:57.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.296+0000 7f7770a4e640 1 --2- 172.21.15.63:0/3802909659 >> [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772] conn(0x7f77580c0490 0x7f77580c2980 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:57.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.297+0000 7f775e7fc640 1 -- 172.21.15.63:0/3802909659 <== osd.0 v2:172.21.15.63:6802/2090653772 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f776401ce50 con 0x7f77580c0490 2024-09-21T06:26:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.311+0000 7f77734b3640 1 -- 172.21.15.63:0/3802909659 --> [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f776c063fd0 con 0x7f77580c0490 2024-09-21T06:26:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.311+0000 7f775e7fc640 1 -- 172.21.15.63:0/3802909659 <== osd.0 v2:172.21.15.63:6802/2090653772 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f776c063fd0 con 0x7f77580c0490 2024-09-21T06:26:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.311+0000 7f77734b3640 1 -- 172.21.15.63:0/3802909659 >> [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772] conn(0x7f77580c0490 msgr2=0x7f77580c2980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.311+0000 7f77734b3640 1 --2- 172.21.15.63:0/3802909659 >> [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772] conn(0x7f77580c0490 0x7f77580c2980 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.311+0000 7f77734b3640 1 -- 172.21.15.63:0/3802909659 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f77580b66a0 msgr2=0x7f77580b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.311+0000 7f77734b3640 1 --2- 172.21.15.63:0/3802909659 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f77580b66a0 0x7f77580b8bb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7768031440 tx=0x7f7768009680 comp rx=0 tx=0).stop 2024-09-21T06:26:57.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.311+0000 7f77734b3640 1 -- 172.21.15.63:0/3802909659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f776c109df0 msgr2=0x7f776c19fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:57.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.311+0000 7f77734b3640 1 --2- 172.21.15.63:0/3802909659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f776c109df0 0x7f776c19fce0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f776400eaa0 tx=0x7f776400eea0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.311+0000 7f7771a50640 1 -- 172.21.15.63:0/3802909659 reap_dead start 2024-09-21T06:26:57.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.311+0000 7f77734b3640 1 -- 172.21.15.63:0/3802909659 shutdown_connections 2024-09-21T06:26:57.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.311+0000 7f77734b3640 1 -- 172.21.15.63:0/3802909659 >> 172.21.15.63:0/3802909659 conn(0x7f776c07b850 msgr2=0x7f776c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:57.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.312+0000 7f77734b3640 1 -- 172.21.15.63:0/3802909659 shutdown_connections 2024-09-21T06:26:57.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:57.312+0000 7f77734b3640 1 -- 172.21.15.63:0/3802909659 wait complete. 2024-09-21T06:26:57.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:57 smithi175 ceph-mon[34510]: pgmap v284: 97 pgs: 97 active+clean; 647 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-09-21T06:26:57.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:57 smithi071 ceph-mon[34844]: pgmap v284: 97 pgs: 97 active+clean; 647 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-09-21T06:26:58.059 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:58.059 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:58.060 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:58.060 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:58.065 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:58.065 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:58.066 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:58.069 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:58.111 INFO:teuthology.orchestra.run.smithi063.stdout:38654705741 2024-09-21T06:26:58.112 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T06:26:58.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.415+0000 7f585a4a1640 1 -- 172.21.15.63:0/1486039111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5854108d10 msgr2=0x7f585410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:58.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.415+0000 7f585a4a1640 1 --2- 172.21.15.63:0/1486039111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5854108d10 0x7f585410f540 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f584c009ca0 tx=0x7f584c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:26:58.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.415+0000 7f585a4a1640 1 -- 172.21.15.63:0/1486039111 shutdown_connections 2024-09-21T06:26:58.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.415+0000 7f585a4a1640 1 --2- 172.21.15.63:0/1486039111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5854108d10 0x7f585410f540 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:58.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.415+0000 7f585a4a1640 1 --2- 172.21.15.63:0/1486039111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58541083c0 0x7f58541087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:58.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.415+0000 7f585a4a1640 1 --2- 172.21.15.63:0/1486039111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5854102a80 0x7f5854102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:58.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.415+0000 7f585a4a1640 1 -- 172.21.15.63:0/1486039111 >> 172.21.15.63:0/1486039111 conn(0x7f5854079740 msgr2=0x7f5854079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:58.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.415+0000 7f585a4a1640 1 -- 172.21.15.63:0/1486039111 shutdown_connections 2024-09-21T06:26:58.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.415+0000 7f585a4a1640 1 -- 172.21.15.63:0/1486039111 wait complete. 2024-09-21T06:26:58.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.416+0000 7f585a4a1640 1 Processor -- start 2024-09-21T06:26:58.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.416+0000 7f585a4a1640 1 -- start start 2024-09-21T06:26:58.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.416+0000 7f585a4a1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5854102a80 0x7f585419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:58.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.416+0000 7f585a4a1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58541083c0 0x7f585419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:58.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.416+0000 7f585a4a1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5854108d10 0x7f585419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:58.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.416+0000 7f585a4a1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5854112980 con 0x7f5854108d10 2024-09-21T06:26:58.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.416+0000 7f585a4a1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5854112800 con 0x7f5854102a80 2024-09-21T06:26:58.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.416+0000 7f585a4a1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5854112b00 con 0x7f58541083c0 2024-09-21T06:26:58.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.416+0000 7f5858a3e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5854108d10 0x7f585419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:58.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.416+0000 7f5858a3e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5854108d10 0x7f585419fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58526/0 (socket says 172.21.15.63:58526) 2024-09-21T06:26:58.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.416+0000 7f5858a3e640 1 -- 172.21.15.63:0/4187415310 learned_addr learned my addr 172.21.15.63:0/4187415310 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:58.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.416+0000 7f5853fff640 1 --2- 172.21.15.63:0/4187415310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5854102a80 0x7f585419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:58.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.417+0000 7f58537fe640 1 --2- 172.21.15.63:0/4187415310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58541083c0 0x7f585419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:58.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.417+0000 7f5858a3e640 1 -- 172.21.15.63:0/4187415310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58541083c0 msgr2=0x7f585419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:58.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.417+0000 7f5858a3e640 1 --2- 172.21.15.63:0/4187415310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58541083c0 0x7f585419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:58.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.417+0000 7f5858a3e640 1 -- 172.21.15.63:0/4187415310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5854102a80 msgr2=0x7f585419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:58.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.417+0000 7f5858a3e640 1 --2- 172.21.15.63:0/4187415310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5854102a80 0x7f585419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:58.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.417+0000 7f5858a3e640 1 -- 172.21.15.63:0/4187415310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58541a03d0 con 0x7f5854108d10 2024-09-21T06:26:58.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.417+0000 7f58537fe640 1 --2- 172.21.15.63:0/4187415310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58541083c0 0x7f585419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:58.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.417+0000 7f5853fff640 1 --2- 172.21.15.63:0/4187415310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5854102a80 0x7f585419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:26:58.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.418+0000 7f5858a3e640 1 --2- 172.21.15.63:0/4187415310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5854108d10 0x7f585419fca0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f584c005cc0 tx=0x7f584c02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:58.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.418+0000 7f58517fa640 1 -- 172.21.15.63:0/4187415310 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c003cf0 con 0x7f5854108d10 2024-09-21T06:26:58.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.418+0000 7f58517fa640 1 -- 172.21.15.63:0/4187415310 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f584c0044f0 con 0x7f5854108d10 2024-09-21T06:26:58.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.418+0000 7f585a4a1640 1 -- 172.21.15.63:0/4187415310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58541a0660 con 0x7f5854108d10 2024-09-21T06:26:58.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.418+0000 7f58517fa640 1 -- 172.21.15.63:0/4187415310 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c02fd10 con 0x7f5854108d10 2024-09-21T06:26:58.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.418+0000 7f585a4a1640 1 -- 172.21.15.63:0/4187415310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58540ff570 con 0x7f5854108d10 2024-09-21T06:26:58.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.419+0000 7f585a4a1640 1 -- 172.21.15.63:0/4187415310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5854063b10 con 0x7f5854108d10 2024-09-21T06:26:58.422 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:58.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.421+0000 7f58517fa640 1 -- 172.21.15.63:0/4187415310 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f584c004040 con 0x7f5854108d10 2024-09-21T06:26:58.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.423+0000 7f58517fa640 1 --2- 172.21.15.63:0/4187415310 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f583c0b65f0 0x7f583c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:58.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.423+0000 7f5853fff640 1 --2- 172.21.15.63:0/4187415310 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f583c0b65f0 0x7f583c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:58.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.423+0000 7f58517fa640 1 -- 172.21.15.63:0/4187415310 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f584c108f90 con 0x7f5854108d10 2024-09-21T06:26:58.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.423+0000 7f58517fa640 1 --2- 172.21.15.63:0/4187415310 >> [v2:172.21.15.175:6808/3005600597,v1:172.21.15.175:6809/3005600597] conn(0x7f583c0c03e0 0x7f583c0c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:58.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.423+0000 7f58517fa640 1 -- 172.21.15.63:0/4187415310 --> [v2:172.21.15.175:6808/3005600597,v1:172.21.15.175:6809/3005600597] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f583c0c2fa0 con 0x7f583c0c03e0 2024-09-21T06:26:58.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.423+0000 7f58517fa640 1 -- 172.21.15.63:0/4187415310 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f584c1093e0 con 0x7f5854108d10 2024-09-21T06:26:58.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.423+0000 7f58537fe640 1 --2- 172.21.15.63:0/4187415310 >> [v2:172.21.15.175:6808/3005600597,v1:172.21.15.175:6809/3005600597] conn(0x7f583c0c03e0 0x7f583c0c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:58.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.424+0000 7f5853fff640 1 --2- 172.21.15.63:0/4187415310 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f583c0b65f0 0x7f583c0b8b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f58440058c0 tx=0x7f584400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:58.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.424+0000 7f58537fe640 1 --2- 172.21.15.63:0/4187415310 >> [v2:172.21.15.175:6808/3005600597,v1:172.21.15.175:6809/3005600597] conn(0x7f583c0c03e0 0x7f583c0c28d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:58.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.425+0000 7f58517fa640 1 -- 172.21.15.63:0/4187415310 <== osd.5 v2:172.21.15.175:6808/3005600597 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f583c0c2fa0 con 0x7f583c0c03e0 2024-09-21T06:26:58.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.447+0000 7f585a4a1640 1 -- 172.21.15.63:0/4187415310 --> [v2:172.21.15.175:6808/3005600597,v1:172.21.15.175:6809/3005600597] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5854063f10 con 0x7f583c0c03e0 2024-09-21T06:26:58.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.448+0000 7f58517fa640 1 -- 172.21.15.63:0/4187415310 <== osd.5 v2:172.21.15.175:6808/3005600597 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5854063f10 con 0x7f583c0c03e0 2024-09-21T06:26:58.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.448+0000 7f585a4a1640 1 -- 172.21.15.63:0/4187415310 >> [v2:172.21.15.175:6808/3005600597,v1:172.21.15.175:6809/3005600597] conn(0x7f583c0c03e0 msgr2=0x7f583c0c28d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:58.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.448+0000 7f585a4a1640 1 --2- 172.21.15.63:0/4187415310 >> [v2:172.21.15.175:6808/3005600597,v1:172.21.15.175:6809/3005600597] conn(0x7f583c0c03e0 0x7f583c0c28d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:58.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.448+0000 7f585a4a1640 1 -- 172.21.15.63:0/4187415310 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f583c0b65f0 msgr2=0x7f583c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:58.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.448+0000 7f585a4a1640 1 --2- 172.21.15.63:0/4187415310 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f583c0b65f0 0x7f583c0b8b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f58440058c0 tx=0x7f584400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:26:58.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.448+0000 7f585a4a1640 1 -- 172.21.15.63:0/4187415310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5854108d10 msgr2=0x7f585419fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:58.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.448+0000 7f585a4a1640 1 --2- 172.21.15.63:0/4187415310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5854108d10 0x7f585419fca0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f584c005cc0 tx=0x7f584c02f470 comp rx=0 tx=0).stop 2024-09-21T06:26:58.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.448+0000 7f5858a3e640 1 -- 172.21.15.63:0/4187415310 reap_dead start 2024-09-21T06:26:58.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.448+0000 7f585a4a1640 1 -- 172.21.15.63:0/4187415310 shutdown_connections 2024-09-21T06:26:58.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.448+0000 7f585a4a1640 1 -- 172.21.15.63:0/4187415310 >> 172.21.15.63:0/4187415310 conn(0x7f5854079740 msgr2=0x7f585406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:58.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.449+0000 7f585a4a1640 1 -- 172.21.15.63:0/4187415310 shutdown_connections 2024-09-21T06:26:58.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:58.449+0000 7f585a4a1640 1 -- 172.21.15.63:0/4187415310 wait complete. 2024-09-21T06:26:58.683 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:59.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:26:59 smithi063 ceph-mon[31150]: pgmap v285: 97 pgs: 97 active+clean; 647 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-21T06:26:59.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:26:59 smithi175 ceph-mon[34510]: pgmap v285: 97 pgs: 97 active+clean; 647 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-21T06:26:59.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:26:59 smithi071 ceph-mon[34844]: pgmap v285: 97 pgs: 97 active+clean; 647 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-21T06:26:59.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.796+0000 7fca1c89f640 1 -- 172.21.15.63:0/1556391336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca181062e0 msgr2=0x7fca181066f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:59.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.796+0000 7fca1c89f640 1 --2- 172.21.15.63:0/1556391336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca181062e0 0x7fca181066f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fca0c009900 tx=0x7fca0c02a410 comp rx=0 tx=0).stop 2024-09-21T06:26:59.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.796+0000 7fca1c89f640 1 -- 172.21.15.63:0/1556391336 shutdown_connections 2024-09-21T06:26:59.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.796+0000 7fca1c89f640 1 --2- 172.21.15.63:0/1556391336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca18106c30 0x7fca18110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.796+0000 7fca1c89f640 1 --2- 172.21.15.63:0/1556391336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca181062e0 0x7fca181066f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.796+0000 7fca1c89f640 1 --2- 172.21.15.63:0/1556391336 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca18102000 0x7fca18102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.796+0000 7fca1c89f640 1 -- 172.21.15.63:0/1556391336 >> 172.21.15.63:0/1556391336 conn(0x7fca18079e40 msgr2=0x7fca1807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:59.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.796+0000 7fca1c89f640 1 -- 172.21.15.63:0/1556391336 shutdown_connections 2024-09-21T06:26:59.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.796+0000 7fca1c89f640 1 -- 172.21.15.63:0/1556391336 wait complete. 2024-09-21T06:26:59.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.797+0000 7fca1c89f640 1 Processor -- start 2024-09-21T06:26:59.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.797+0000 7fca1c89f640 1 -- start start 2024-09-21T06:26:59.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.797+0000 7fca1c89f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca18102000 0x7fca1819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.797+0000 7fca1c89f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca181062e0 0x7fca1819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.797+0000 7fca1c89f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca18106c30 0x7fca1819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.797+0000 7fca1c89f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fca18113ad0 con 0x7fca18106c30 2024-09-21T06:26:59.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.797+0000 7fca1c89f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fca18113950 con 0x7fca18102000 2024-09-21T06:26:59.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.797+0000 7fca1c89f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fca18113c50 con 0x7fca181062e0 2024-09-21T06:26:59.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.798+0000 7fca16d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca18106c30 0x7fca1819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.798+0000 7fca16d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca18106c30 0x7fca1819fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58556/0 (socket says 172.21.15.63:58556) 2024-09-21T06:26:59.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.798+0000 7fca16d9d640 1 -- 172.21.15.63:0/786422007 learned_addr learned my addr 172.21.15.63:0/786422007 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:26:59.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.798+0000 7fca1659c640 1 --2- 172.21.15.63:0/786422007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca18102000 0x7fca1819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.798+0000 7fca15d9b640 1 --2- 172.21.15.63:0/786422007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca181062e0 0x7fca1819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.798+0000 7fca16d9d640 1 -- 172.21.15.63:0/786422007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca181062e0 msgr2=0x7fca1819aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:59.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.798+0000 7fca16d9d640 1 --2- 172.21.15.63:0/786422007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca181062e0 0x7fca1819aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.798+0000 7fca16d9d640 1 -- 172.21.15.63:0/786422007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca18102000 msgr2=0x7fca1819a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:59.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.798+0000 7fca16d9d640 1 --2- 172.21.15.63:0/786422007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca18102000 0x7fca1819a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.798+0000 7fca16d9d640 1 -- 172.21.15.63:0/786422007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca181a03b0 con 0x7fca18106c30 2024-09-21T06:26:59.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.798+0000 7fca16d9d640 1 --2- 172.21.15.63:0/786422007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca18106c30 0x7fca1819fd40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fca1000eaa0 tx=0x7fca1000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:59.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.798+0000 7fca077fe640 1 -- 172.21.15.63:0/786422007 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10004d20 con 0x7fca18106c30 2024-09-21T06:26:59.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.798+0000 7fca077fe640 1 -- 172.21.15.63:0/786422007 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca10005020 con 0x7fca18106c30 2024-09-21T06:26:59.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.798+0000 7fca1c89f640 1 -- 172.21.15.63:0/786422007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca181a06a0 con 0x7fca18106c30 2024-09-21T06:26:59.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.798+0000 7fca077fe640 1 -- 172.21.15.63:0/786422007 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca100116b0 con 0x7fca18106c30 2024-09-21T06:26:59.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.799+0000 7fca1c89f640 1 -- 172.21.15.63:0/786422007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca181a0b60 con 0x7fca18106c30 2024-09-21T06:26:59.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.799+0000 7fca1c89f640 1 -- 172.21.15.63:0/786422007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca18063b50 con 0x7fca18106c30 2024-09-21T06:26:59.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.801+0000 7fca077fe640 1 -- 172.21.15.63:0/786422007 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fca100051d0 con 0x7fca18106c30 2024-09-21T06:26:59.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.802+0000 7fca077fe640 1 --2- 172.21.15.63:0/786422007 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fca000b6620 0x7fca000b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.802+0000 7fca1659c640 1 --2- 172.21.15.63:0/786422007 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fca000b6620 0x7fca000b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.802+0000 7fca077fe640 1 -- 172.21.15.63:0/786422007 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fca100e7c40 con 0x7fca18106c30 2024-09-21T06:26:59.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.802+0000 7fca077fe640 1 --2- 172.21.15.63:0/786422007 >> [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339] conn(0x7fca000c0410 0x7fca000c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.802+0000 7fca077fe640 1 -- 172.21.15.63:0/786422007 --> [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca10014ec0 con 0x7fca000c0410 2024-09-21T06:26:59.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.802+0000 7fca077fe640 1 -- 172.21.15.63:0/786422007 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fca100e8090 con 0x7fca18106c30 2024-09-21T06:26:59.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.802+0000 7fca15d9b640 1 --2- 172.21.15.63:0/786422007 >> [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339] conn(0x7fca000c0410 0x7fca000c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.802+0000 7fca1659c640 1 --2- 172.21.15.63:0/786422007 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fca000b6620 0x7fca000b8b30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fca0800abe0 tx=0x7fca0800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:59.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.803+0000 7fca15d9b640 1 --2- 172.21.15.63:0/786422007 >> [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339] conn(0x7fca000c0410 0x7fca000c2900 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:59.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.804+0000 7fca077fe640 1 -- 172.21.15.63:0/786422007 <== osd.3 v2:172.21.15.63:6810/31683339 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca10014ec0 con 0x7fca000c0410 2024-09-21T06:26:59.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.819+0000 7fca1c89f640 1 -- 172.21.15.63:0/786422007 --> [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca18063f50 con 0x7fca000c0410 2024-09-21T06:26:59.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.819+0000 7fca077fe640 1 -- 172.21.15.63:0/786422007 <== osd.3 v2:172.21.15.63:6810/31683339 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fca18063f50 con 0x7fca000c0410 2024-09-21T06:26:59.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.820+0000 7fca1c89f640 1 -- 172.21.15.63:0/786422007 >> [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339] conn(0x7fca000c0410 msgr2=0x7fca000c2900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:59.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.820+0000 7fca1c89f640 1 --2- 172.21.15.63:0/786422007 >> [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339] conn(0x7fca000c0410 0x7fca000c2900 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.820+0000 7fca1c89f640 1 -- 172.21.15.63:0/786422007 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fca000b6620 msgr2=0x7fca000b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:59.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.820+0000 7fca1c89f640 1 --2- 172.21.15.63:0/786422007 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fca000b6620 0x7fca000b8b30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fca0800abe0 tx=0x7fca0800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.820+0000 7fca1c89f640 1 -- 172.21.15.63:0/786422007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca18106c30 msgr2=0x7fca1819fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:59.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.820+0000 7fca1c89f640 1 --2- 172.21.15.63:0/786422007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca18106c30 0x7fca1819fd40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fca1000eaa0 tx=0x7fca1000eea0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.820+0000 7fca16d9d640 1 -- 172.21.15.63:0/786422007 reap_dead start 2024-09-21T06:26:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.820+0000 7fca1c89f640 1 -- 172.21.15.63:0/786422007 shutdown_connections 2024-09-21T06:26:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.820+0000 7fca1c89f640 1 -- 172.21.15.63:0/786422007 >> 172.21.15.63:0/786422007 conn(0x7fca18079e40 msgr2=0x7fca18107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.820+0000 7fca1c89f640 1 -- 172.21.15.63:0/786422007 shutdown_connections 2024-09-21T06:26:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:26:59.820+0000 7fca1c89f640 1 -- 172.21.15.63:0/786422007 wait complete. 2024-09-21T06:27:00.307 INFO:teuthology.orchestra.run.smithi063.stdout:150323855412 2024-09-21T06:27:00.307 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T06:27:01.176 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:01 smithi063 ceph-mon[31150]: pgmap v286: 97 pgs: 97 active+clean; 647 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T06:27:01.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:01 smithi175 ceph-mon[34510]: pgmap v286: 97 pgs: 97 active+clean; 647 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T06:27:01.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:01 smithi071 ceph-mon[34844]: pgmap v286: 97 pgs: 97 active+clean; 647 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T06:27:01.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.509+0000 7faafe025640 1 -- 172.21.15.63:0/2921009137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaf8104870 msgr2=0x7faaf8104c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:01.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.509+0000 7faafe025640 1 --2- 172.21.15.63:0/2921009137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaf8104870 0x7faaf8104c80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7faae8009900 tx=0x7faae802a410 comp rx=0 tx=0).stop 2024-09-21T06:27:01.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.510+0000 7faafe025640 1 -- 172.21.15.63:0/2921009137 shutdown_connections 2024-09-21T06:27:01.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.510+0000 7faafe025640 1 --2- 172.21.15.63:0/2921009137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaf810de20 0x7faaf8110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:01.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.510+0000 7faafe025640 1 --2- 172.21.15.63:0/2921009137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faaf81052a0 0x7faaf810d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:01.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.510+0000 7faafe025640 1 --2- 172.21.15.63:0/2921009137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaf8104870 0x7faaf8104c80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:01.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.510+0000 7faafe025640 1 -- 172.21.15.63:0/2921009137 >> 172.21.15.63:0/2921009137 conn(0x7faaf8079750 msgr2=0x7faaf8079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:01.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.510+0000 7faafe025640 1 -- 172.21.15.63:0/2921009137 shutdown_connections 2024-09-21T06:27:01.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.510+0000 7faafe025640 1 -- 172.21.15.63:0/2921009137 wait complete. 2024-09-21T06:27:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.510+0000 7faafe025640 1 Processor -- start 2024-09-21T06:27:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.511+0000 7faafe025640 1 -- start start 2024-09-21T06:27:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.511+0000 7faafe025640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaf8104870 0x7faaf819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.511+0000 7faafe025640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faaf81052a0 0x7faaf819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.511+0000 7faafe025640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaf810de20 0x7faaf819fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.511+0000 7faafe025640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faaf8113b20 con 0x7faaf8104870 2024-09-21T06:27:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.511+0000 7faafe025640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faaf81139a0 con 0x7faaf81052a0 2024-09-21T06:27:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.511+0000 7faafe025640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faaf8113ca0 con 0x7faaf810de20 2024-09-21T06:27:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.511+0000 7faaf77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaf8104870 0x7faaf819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.511+0000 7faaf77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaf8104870 0x7faaf819a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58584/0 (socket says 172.21.15.63:58584) 2024-09-21T06:27:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.511+0000 7faaf77fe640 1 -- 172.21.15.63:0/3786960970 learned_addr learned my addr 172.21.15.63:0/3786960970 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.511+0000 7faaf6ffd640 1 --2- 172.21.15.63:0/3786960970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faaf81052a0 0x7faaf819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.511+0000 7faaf7fff640 1 --2- 172.21.15.63:0/3786960970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaf810de20 0x7faaf819fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.511+0000 7faaf77fe640 1 -- 172.21.15.63:0/3786960970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaf810de20 msgr2=0x7faaf819fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.512+0000 7faaf77fe640 1 --2- 172.21.15.63:0/3786960970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaf810de20 0x7faaf819fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.512+0000 7faaf77fe640 1 -- 172.21.15.63:0/3786960970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faaf81052a0 msgr2=0x7faaf819aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.512+0000 7faaf77fe640 1 --2- 172.21.15.63:0/3786960970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faaf81052a0 0x7faaf819aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.512+0000 7faaf77fe640 1 -- 172.21.15.63:0/3786960970 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf81a0400 con 0x7faaf8104870 2024-09-21T06:27:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.512+0000 7faaf77fe640 1 --2- 172.21.15.63:0/3786960970 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaf8104870 0x7faaf819a550 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7faae8031a90 tx=0x7faae8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.512+0000 7faaf4ff9640 1 -- 172.21.15.63:0/3786960970 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae803f030 con 0x7faaf8104870 2024-09-21T06:27:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.512+0000 7faafe025640 1 -- 172.21.15.63:0/3786960970 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf81a0690 con 0x7faaf8104870 2024-09-21T06:27:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.512+0000 7faaf4ff9640 1 -- 172.21.15.63:0/3786960970 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faae8004490 con 0x7faaf8104870 2024-09-21T06:27:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.512+0000 7faaf4ff9640 1 -- 172.21.15.63:0/3786960970 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8035070 con 0x7faaf8104870 2024-09-21T06:27:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.512+0000 7faafe025640 1 -- 172.21.15.63:0/3786960970 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf81a6f10 con 0x7faaf8104870 2024-09-21T06:27:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.513+0000 7faafe025640 1 -- 172.21.15.63:0/3786960970 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faaf81083c0 con 0x7faaf8104870 2024-09-21T06:27:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.515+0000 7faaf4ff9640 1 -- 172.21.15.63:0/3786960970 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7faae8042030 con 0x7faaf8104870 2024-09-21T06:27:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.515+0000 7faaf4ff9640 1 --2- 172.21.15.63:0/3786960970 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7faae00b6620 0x7faae00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.515+0000 7faaf6ffd640 1 --2- 172.21.15.63:0/3786960970 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7faae00b6620 0x7faae00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.515+0000 7faaf4ff9640 1 -- 172.21.15.63:0/3786960970 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7faae8108040 con 0x7faaf8104870 2024-09-21T06:27:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.516+0000 7faaf4ff9640 1 --2- 172.21.15.63:0/3786960970 >> [v2:172.21.15.175:6824/1970094291,v1:172.21.15.175:6825/1970094291] conn(0x7faae00c0410 0x7faae00c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:01.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.516+0000 7faaf4ff9640 1 -- 172.21.15.63:0/3786960970 --> [v2:172.21.15.175:6824/1970094291,v1:172.21.15.175:6825/1970094291] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faae00c2fd0 con 0x7faae00c0410 2024-09-21T06:27:01.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.516+0000 7faaf4ff9640 1 -- 172.21.15.63:0/3786960970 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7faae8108490 con 0x7faaf8104870 2024-09-21T06:27:01.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.516+0000 7faaf6ffd640 1 --2- 172.21.15.63:0/3786960970 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7faae00b6620 0x7faae00b8b30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faaf810fb80 tx=0x7faaec00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:01.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.516+0000 7faaf7fff640 1 --2- 172.21.15.63:0/3786960970 >> [v2:172.21.15.175:6824/1970094291,v1:172.21.15.175:6825/1970094291] conn(0x7faae00c0410 0x7faae00c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:01.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.516+0000 7faaf7fff640 1 --2- 172.21.15.63:0/3786960970 >> [v2:172.21.15.175:6824/1970094291,v1:172.21.15.175:6825/1970094291] conn(0x7faae00c0410 0x7faae00c2900 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:01.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.517+0000 7faaf4ff9640 1 -- 172.21.15.63:0/3786960970 <== osd.11 v2:172.21.15.175:6824/1970094291 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faae00c2fd0 con 0x7faae00c0410 2024-09-21T06:27:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.531+0000 7faafe025640 1 -- 172.21.15.63:0/3786960970 --> [v2:172.21.15.175:6824/1970094291,v1:172.21.15.175:6825/1970094291] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faaf806b350 con 0x7faae00c0410 2024-09-21T06:27:01.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.532+0000 7faaf4ff9640 1 -- 172.21.15.63:0/3786960970 <== osd.11 v2:172.21.15.175:6824/1970094291 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faaf806b350 con 0x7faae00c0410 2024-09-21T06:27:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.533+0000 7faafe025640 1 -- 172.21.15.63:0/3786960970 >> [v2:172.21.15.175:6824/1970094291,v1:172.21.15.175:6825/1970094291] conn(0x7faae00c0410 msgr2=0x7faae00c2900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.533+0000 7faafe025640 1 --2- 172.21.15.63:0/3786960970 >> [v2:172.21.15.175:6824/1970094291,v1:172.21.15.175:6825/1970094291] conn(0x7faae00c0410 0x7faae00c2900 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.533+0000 7faafe025640 1 -- 172.21.15.63:0/3786960970 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7faae00b6620 msgr2=0x7faae00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.533+0000 7faafe025640 1 --2- 172.21.15.63:0/3786960970 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7faae00b6620 0x7faae00b8b30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faaf810fb80 tx=0x7faaec00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:27:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.533+0000 7faafe025640 1 -- 172.21.15.63:0/3786960970 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaf8104870 msgr2=0x7faaf819a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.533+0000 7faafe025640 1 --2- 172.21.15.63:0/3786960970 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaf8104870 0x7faaf819a550 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7faae8031a90 tx=0x7faae8004270 comp rx=0 tx=0).stop 2024-09-21T06:27:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.533+0000 7faaf7fff640 1 -- 172.21.15.63:0/3786960970 reap_dead start 2024-09-21T06:27:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.533+0000 7faafe025640 1 -- 172.21.15.63:0/3786960970 shutdown_connections 2024-09-21T06:27:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.533+0000 7faafe025640 1 -- 172.21.15.63:0/3786960970 >> 172.21.15.63:0/3786960970 conn(0x7faaf8079750 msgr2=0x7faaf81079a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.533+0000 7faafe025640 1 -- 172.21.15.63:0/3786960970 shutdown_connections 2024-09-21T06:27:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.533+0000 7faafe025640 1 -- 172.21.15.63:0/3786960970 wait complete. 2024-09-21T06:27:02.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.274+0000 7f6491343640 1 -- 172.21.15.63:0/1678514150 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f648c108d10 msgr2=0x7f648c10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:02.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.274+0000 7f6491343640 1 --2- 172.21.15.63:0/1678514150 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f648c108d10 0x7f648c10f540 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6484009ca0 tx=0x7f648402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:02.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.274+0000 7f6491343640 1 -- 172.21.15.63:0/1678514150 shutdown_connections 2024-09-21T06:27:02.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.274+0000 7f6491343640 1 --2- 172.21.15.63:0/1678514150 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f648c108d10 0x7f648c10f540 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:02.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.274+0000 7f6491343640 1 --2- 172.21.15.63:0/1678514150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f648c1083c0 0x7f648c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:02.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.274+0000 7f6491343640 1 --2- 172.21.15.63:0/1678514150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f648c102a80 0x7f648c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:02.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.274+0000 7f6491343640 1 -- 172.21.15.63:0/1678514150 >> 172.21.15.63:0/1678514150 conn(0x7f648c079740 msgr2=0x7f648c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:02.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.274+0000 7f6491343640 1 -- 172.21.15.63:0/1678514150 shutdown_connections 2024-09-21T06:27:02.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.274+0000 7f6491343640 1 -- 172.21.15.63:0/1678514150 wait complete. 2024-09-21T06:27:02.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.275+0000 7f6491343640 1 Processor -- start 2024-09-21T06:27:02.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.275+0000 7f6491343640 1 -- start start 2024-09-21T06:27:02.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.275+0000 7f6491343640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f648c102a80 0x7f648c19c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:02.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.275+0000 7f6491343640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f648c1083c0 0x7f648c19cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:02.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.275+0000 7f6491343640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f648c108d10 0x7f648c1a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:02.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.275+0000 7f6491343640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f648c112980 con 0x7f648c102a80 2024-09-21T06:27:02.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.275+0000 7f6491343640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f648c112800 con 0x7f648c108d10 2024-09-21T06:27:02.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.275+0000 7f6491343640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f648c112b00 con 0x7f648c1083c0 2024-09-21T06:27:02.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.276+0000 7f648affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f648c102a80 0x7f648c19c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:02.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.276+0000 7f648affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f648c102a80 0x7f648c19c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58626/0 (socket says 172.21.15.63:58626) 2024-09-21T06:27:02.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.276+0000 7f648affd640 1 -- 172.21.15.63:0/3930829397 learned_addr learned my addr 172.21.15.63:0/3930829397 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:02.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.276+0000 7f6483fff640 1 --2- 172.21.15.63:0/3930829397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f648c1083c0 0x7f648c19cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:02.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.276+0000 7f648b7fe640 1 --2- 172.21.15.63:0/3930829397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f648c108d10 0x7f648c1a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:02.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.276+0000 7f648affd640 1 -- 172.21.15.63:0/3930829397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f648c1083c0 msgr2=0x7f648c19cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:02.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.276+0000 7f648affd640 1 --2- 172.21.15.63:0/3930829397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f648c1083c0 0x7f648c19cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:02.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.276+0000 7f648affd640 1 -- 172.21.15.63:0/3930829397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f648c108d10 msgr2=0x7f648c1a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:02.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.276+0000 7f648affd640 1 --2- 172.21.15.63:0/3930829397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f648c108d10 0x7f648c1a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:02.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.276+0000 7f648affd640 1 -- 172.21.15.63:0/3930829397 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c1a24b0 con 0x7f648c102a80 2024-09-21T06:27:02.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.276+0000 7f648affd640 1 --2- 172.21.15.63:0/3930829397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f648c102a80 0x7f648c19c600 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f647c00d950 tx=0x7f647c00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:02.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.276+0000 7f6488ff9640 1 -- 172.21.15.63:0/3930829397 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c017070 con 0x7f648c102a80 2024-09-21T06:27:02.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.276+0000 7f6491343640 1 -- 172.21.15.63:0/3930829397 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f648c1a27a0 con 0x7f648c102a80 2024-09-21T06:27:02.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.276+0000 7f6488ff9640 1 -- 172.21.15.63:0/3930829397 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f647c00de80 con 0x7f648c102a80 2024-09-21T06:27:02.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.277+0000 7f6491343640 1 -- 172.21.15.63:0/3930829397 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f648c1a8fc0 con 0x7f648c102a80 2024-09-21T06:27:02.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.277+0000 7f6488ff9640 1 -- 172.21.15.63:0/3930829397 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c00f620 con 0x7f648c102a80 2024-09-21T06:27:02.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.278+0000 7f6491343640 1 -- 172.21.15.63:0/3930829397 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f646c001030 con 0x7f648c102a80 2024-09-21T06:27:02.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.280+0000 7f6488ff9640 1 -- 172.21.15.63:0/3930829397 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f647c009c30 con 0x7f648c102a80 2024-09-21T06:27:02.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.281+0000 7f6488ff9640 1 --2- 172.21.15.63:0/3930829397 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f64780b6620 0x7f64780b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:02.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.281+0000 7f6483fff640 1 --2- 172.21.15.63:0/3930829397 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f64780b6620 0x7f64780b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:02.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.282+0000 7f6488ff9640 1 -- 172.21.15.63:0/3930829397 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f647c0e75b0 con 0x7f648c102a80 2024-09-21T06:27:02.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.282+0000 7f6483fff640 1 --2- 172.21.15.63:0/3930829397 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f64780b6620 0x7f64780b8b30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f648c06b320 tx=0x7f647400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:02.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.282+0000 7f6488ff9640 1 --2- 172.21.15.63:0/3930829397 >> [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285] conn(0x7f64780c0410 0x7f64780c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:02.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.282+0000 7f6488ff9640 1 -- 172.21.15.63:0/3930829397 --> [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64780c2fd0 con 0x7f64780c0410 2024-09-21T06:27:02.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.282+0000 7f6488ff9640 1 -- 172.21.15.63:0/3930829397 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f647c0e79f0 con 0x7f648c102a80 2024-09-21T06:27:02.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.282+0000 7f648b7fe640 1 --2- 172.21.15.63:0/3930829397 >> [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285] conn(0x7f64780c0410 0x7f64780c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:02.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.282+0000 7f648b7fe640 1 --2- 172.21.15.63:0/3930829397 >> [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285] conn(0x7f64780c0410 0x7f64780c2900 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:02.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.283+0000 7f6488ff9640 1 -- 172.21.15.63:0/3930829397 <== osd.9 v2:172.21.15.63:6826/3278012285 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f64780c2fd0 con 0x7f64780c0410 2024-09-21T06:27:02.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.297+0000 7f6491343640 1 -- 172.21.15.63:0/3930829397 --> [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f646c002dd0 con 0x7f64780c0410 2024-09-21T06:27:02.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.297+0000 7f6488ff9640 1 -- 172.21.15.63:0/3930829397 <== osd.9 v2:172.21.15.63:6826/3278012285 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f646c002dd0 con 0x7f64780c0410 2024-09-21T06:27:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.298+0000 7f6491343640 1 -- 172.21.15.63:0/3930829397 >> [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285] conn(0x7f64780c0410 msgr2=0x7f64780c2900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.298+0000 7f6491343640 1 --2- 172.21.15.63:0/3930829397 >> [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285] conn(0x7f64780c0410 0x7f64780c2900 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.298+0000 7f6491343640 1 -- 172.21.15.63:0/3930829397 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f64780b6620 msgr2=0x7f64780b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.298+0000 7f6491343640 1 --2- 172.21.15.63:0/3930829397 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f64780b6620 0x7f64780b8b30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f648c06b320 tx=0x7f647400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:27:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.298+0000 7f6491343640 1 -- 172.21.15.63:0/3930829397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f648c102a80 msgr2=0x7f648c19c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.298+0000 7f6491343640 1 --2- 172.21.15.63:0/3930829397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f648c102a80 0x7f648c19c600 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f647c00d950 tx=0x7f647c00dd50 comp rx=0 tx=0).stop 2024-09-21T06:27:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.298+0000 7f648b7fe640 1 -- 172.21.15.63:0/3930829397 reap_dead start 2024-09-21T06:27:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.298+0000 7f6491343640 1 -- 172.21.15.63:0/3930829397 shutdown_connections 2024-09-21T06:27:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.298+0000 7f6491343640 1 -- 172.21.15.63:0/3930829397 >> 172.21.15.63:0/3930829397 conn(0x7f648c079740 msgr2=0x7f648c104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.298+0000 7f6491343640 1 -- 172.21.15.63:0/3930829397 shutdown_connections 2024-09-21T06:27:02.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.298+0000 7f6491343640 1 -- 172.21.15.63:0/3930829397 wait complete. 2024-09-21T06:27:02.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.477+0000 7f6946aa8640 1 -- 172.21.15.63:0/3525534076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6940106c30 msgr2=0x7f6940110680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:02.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.477+0000 7f6946aa8640 1 --2- 172.21.15.63:0/3525534076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6940106c30 0x7f6940110680 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6930009ca0 tx=0x7f693002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:02.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.477+0000 7f6946aa8640 1 -- 172.21.15.63:0/3525534076 shutdown_connections 2024-09-21T06:27:02.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.477+0000 7f6946aa8640 1 --2- 172.21.15.63:0/3525534076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6940106c30 0x7f6940110680 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:02.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.477+0000 7f6946aa8640 1 --2- 172.21.15.63:0/3525534076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69401062e0 0x7f69401066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:02.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.477+0000 7f6946aa8640 1 --2- 172.21.15.63:0/3525534076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6940102000 0x7f6940102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:02.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.477+0000 7f6946aa8640 1 -- 172.21.15.63:0/3525534076 >> 172.21.15.63:0/3525534076 conn(0x7f6940079e40 msgr2=0x7f694007a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:02.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.477+0000 7f6946aa8640 1 -- 172.21.15.63:0/3525534076 shutdown_connections 2024-09-21T06:27:02.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.477+0000 7f6946aa8640 1 -- 172.21.15.63:0/3525534076 wait complete. 2024-09-21T06:27:02.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.478+0000 7f6946aa8640 1 Processor -- start 2024-09-21T06:27:02.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.478+0000 7f6946aa8640 1 -- start start 2024-09-21T06:27:02.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.479+0000 7f6946aa8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6940102000 0x7f694019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:02.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.479+0000 7f6946aa8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69401062e0 0x7f694019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:02.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.479+0000 7f6946aa8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6940106c30 0x7f694019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:02.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.479+0000 7f6946aa8640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6940113ad0 con 0x7f6940102000 2024-09-21T06:27:02.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.479+0000 7f6946aa8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6940113950 con 0x7f6940106c30 2024-09-21T06:27:02.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.479+0000 7f6946aa8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6940113c50 con 0x7f69401062e0 2024-09-21T06:27:02.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.479+0000 7f6944844640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6940102000 0x7f694019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:02.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.479+0000 7f6944844640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6940102000 0x7f694019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58646/0 (socket says 172.21.15.63:58646) 2024-09-21T06:27:02.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.479+0000 7f6944844640 1 -- 172.21.15.63:0/1920576494 learned_addr learned my addr 172.21.15.63:0/1920576494 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:02.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.479+0000 7f693ffff640 1 --2- 172.21.15.63:0/1920576494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69401062e0 0x7f694019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:02.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.479+0000 7f6945045640 1 --2- 172.21.15.63:0/1920576494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6940106c30 0x7f694019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:02.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.479+0000 7f6944844640 1 -- 172.21.15.63:0/1920576494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69401062e0 msgr2=0x7f694019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:02.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.479+0000 7f6944844640 1 --2- 172.21.15.63:0/1920576494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69401062e0 0x7f694019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:02.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.479+0000 7f6944844640 1 -- 172.21.15.63:0/1920576494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6940106c30 msgr2=0x7f694019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:02.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.479+0000 7f6944844640 1 --2- 172.21.15.63:0/1920576494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6940106c30 0x7f694019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:02.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.479+0000 7f6944844640 1 -- 172.21.15.63:0/1920576494 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69401a0410 con 0x7f6940102000 2024-09-21T06:27:02.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.479+0000 7f6945045640 1 --2- 172.21.15.63:0/1920576494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6940106c30 0x7f694019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:02.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.479+0000 7f6944844640 1 --2- 172.21.15.63:0/1920576494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6940102000 0x7f694019a4a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f693800d770 tx=0x7f693800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:02.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.480+0000 7f693dffb640 1 -- 172.21.15.63:0/1920576494 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938017070 con 0x7f6940102000 2024-09-21T06:27:02.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.480+0000 7f6946aa8640 1 -- 172.21.15.63:0/1920576494 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69401a0700 con 0x7f6940102000 2024-09-21T06:27:02.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.480+0000 7f693dffb640 1 -- 172.21.15.63:0/1920576494 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69380054d0 con 0x7f6940102000 2024-09-21T06:27:02.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.480+0000 7f693dffb640 1 -- 172.21.15.63:0/1920576494 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938004c30 con 0x7f6940102000 2024-09-21T06:27:02.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.480+0000 7f6946aa8640 1 -- 172.21.15.63:0/1920576494 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69401a6e60 con 0x7f6940102000 2024-09-21T06:27:02.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.481+0000 7f6946aa8640 1 -- 172.21.15.63:0/1920576494 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6940063b50 con 0x7f6940102000 2024-09-21T06:27:02.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.482+0000 7f693dffb640 1 -- 172.21.15.63:0/1920576494 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f6938004dd0 con 0x7f6940102000 2024-09-21T06:27:02.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.483+0000 7f693dffb640 1 --2- 172.21.15.63:0/1920576494 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f692c0b65f0 0x7f692c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:02.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.484+0000 7f693ffff640 1 --2- 172.21.15.63:0/1920576494 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f692c0b65f0 0x7f692c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:02.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.484+0000 7f693dffb640 1 -- 172.21.15.63:0/1920576494 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f69380e7590 con 0x7f6940102000 2024-09-21T06:27:02.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.484+0000 7f693dffb640 1 --2- 172.21.15.63:0/1920576494 >> [v2:172.21.15.71:6824/3297929438,v1:172.21.15.71:6825/3297929438] conn(0x7f692c0c03e0 0x7f692c0c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:02.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.484+0000 7f693dffb640 1 -- 172.21.15.63:0/1920576494 --> [v2:172.21.15.71:6824/3297929438,v1:172.21.15.71:6825/3297929438] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6938021e50 con 0x7f692c0c03e0 2024-09-21T06:27:02.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.484+0000 7f693dffb640 1 -- 172.21.15.63:0/1920576494 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f69380e79e0 con 0x7f6940102000 2024-09-21T06:27:02.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.484+0000 7f6945045640 1 --2- 172.21.15.63:0/1920576494 >> [v2:172.21.15.71:6824/3297929438,v1:172.21.15.71:6825/3297929438] conn(0x7f692c0c03e0 0x7f692c0c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:02.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.484+0000 7f693ffff640 1 --2- 172.21.15.63:0/1920576494 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f692c0b65f0 0x7f692c0b8b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6928005e00 tx=0x7f6928005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:02.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.485+0000 7f6945045640 1 --2- 172.21.15.63:0/1920576494 >> [v2:172.21.15.71:6824/3297929438,v1:172.21.15.71:6825/3297929438] conn(0x7f692c0c03e0 0x7f692c0c28d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:02.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.485+0000 7f693dffb640 1 -- 172.21.15.63:0/1920576494 <== osd.10 v2:172.21.15.71:6824/3297929438 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6938021e50 con 0x7f692c0c03e0 2024-09-21T06:27:02.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.499+0000 7f6946aa8640 1 -- 172.21.15.63:0/1920576494 --> [v2:172.21.15.71:6824/3297929438,v1:172.21.15.71:6825/3297929438] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6940063fd0 con 0x7f692c0c03e0 2024-09-21T06:27:02.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.499+0000 7f693dffb640 1 -- 172.21.15.63:0/1920576494 <== osd.10 v2:172.21.15.71:6824/3297929438 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6940063fd0 con 0x7f692c0c03e0 2024-09-21T06:27:02.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.500+0000 7f6946aa8640 1 -- 172.21.15.63:0/1920576494 >> [v2:172.21.15.71:6824/3297929438,v1:172.21.15.71:6825/3297929438] conn(0x7f692c0c03e0 msgr2=0x7f692c0c28d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:02.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.500+0000 7f6946aa8640 1 --2- 172.21.15.63:0/1920576494 >> [v2:172.21.15.71:6824/3297929438,v1:172.21.15.71:6825/3297929438] conn(0x7f692c0c03e0 0x7f692c0c28d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:02.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.500+0000 7f6946aa8640 1 -- 172.21.15.63:0/1920576494 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f692c0b65f0 msgr2=0x7f692c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:02.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.500+0000 7f6946aa8640 1 --2- 172.21.15.63:0/1920576494 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f692c0b65f0 0x7f692c0b8b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6928005e00 tx=0x7f6928005c50 comp rx=0 tx=0).stop 2024-09-21T06:27:02.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.500+0000 7f6946aa8640 1 -- 172.21.15.63:0/1920576494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6940102000 msgr2=0x7f694019a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:02.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.500+0000 7f6946aa8640 1 --2- 172.21.15.63:0/1920576494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6940102000 0x7f694019a4a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f693800d770 tx=0x7f693800dc30 comp rx=0 tx=0).stop 2024-09-21T06:27:02.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.500+0000 7f6945045640 1 -- 172.21.15.63:0/1920576494 reap_dead start 2024-09-21T06:27:02.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.500+0000 7f6946aa8640 1 -- 172.21.15.63:0/1920576494 shutdown_connections 2024-09-21T06:27:02.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.500+0000 7f6946aa8640 1 -- 172.21.15.63:0/1920576494 >> 172.21.15.63:0/1920576494 conn(0x7f6940079e40 msgr2=0x7f6940107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:02.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.500+0000 7f6946aa8640 1 -- 172.21.15.63:0/1920576494 shutdown_connections 2024-09-21T06:27:02.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:02.500+0000 7f6946aa8640 1 -- 172.21.15.63:0/1920576494 wait complete. 2024-09-21T06:27:03.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.081+0000 7f1a8f323640 1 -- 172.21.15.63:0/3467033802 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a88103b70 msgr2=0x7f1a88103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.081+0000 7f1a8f323640 1 --2- 172.21.15.63:0/3467033802 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a88103b70 0x7f1a88103f80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1a84009900 tx=0x7f1a8402a410 comp rx=0 tx=0).stop 2024-09-21T06:27:03.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.081+0000 7f1a8f323640 1 -- 172.21.15.63:0/3467033802 shutdown_connections 2024-09-21T06:27:03.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.081+0000 7f1a8f323640 1 --2- 172.21.15.63:0/3467033802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a88109e00 0x7f1a88110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.081+0000 7f1a8f323640 1 --2- 172.21.15.63:0/3467033802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a881094b0 0x7f1a881098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.081+0000 7f1a8f323640 1 --2- 172.21.15.63:0/3467033802 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a88103b70 0x7f1a88103f80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.081+0000 7f1a8f323640 1 -- 172.21.15.63:0/3467033802 >> 172.21.15.63:0/3467033802 conn(0x7f1a880ff5e0 msgr2=0x7f1a88101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:03.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.081+0000 7f1a8f323640 1 -- 172.21.15.63:0/3467033802 shutdown_connections 2024-09-21T06:27:03.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.081+0000 7f1a8f323640 1 -- 172.21.15.63:0/3467033802 wait complete. 2024-09-21T06:27:03.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.082+0000 7f1a8f323640 1 Processor -- start 2024-09-21T06:27:03.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.082+0000 7f1a8f323640 1 -- start start 2024-09-21T06:27:03.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.082+0000 7f1a8f323640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a88103b70 0x7f1a8819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.082+0000 7f1a8f323640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a881094b0 0x7f1a8819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.082+0000 7f1a8f323640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a88109e00 0x7f1a8819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.082+0000 7f1a8f323640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1a88113ac0 con 0x7f1a881094b0 2024-09-21T06:27:03.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.082+0000 7f1a8f323640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1a88113940 con 0x7f1a88103b70 2024-09-21T06:27:03.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.082+0000 7f1a8f323640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1a88113c40 con 0x7f1a88109e00 2024-09-21T06:27:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.082+0000 7f1a8c8be640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a881094b0 0x7f1a8819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.082+0000 7f1a8c8be640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a881094b0 0x7f1a8819aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58666/0 (socket says 172.21.15.63:58666) 2024-09-21T06:27:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.082+0000 7f1a8c8be640 1 -- 172.21.15.63:0/3719535695 learned_addr learned my addr 172.21.15.63:0/3719535695 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.082+0000 7f1a8d0bf640 1 --2- 172.21.15.63:0/3719535695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a88103b70 0x7f1a8819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.082+0000 7f1a8d8c0640 1 --2- 172.21.15.63:0/3719535695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a88109e00 0x7f1a8819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.083+0000 7f1a8c8be640 1 -- 172.21.15.63:0/3719535695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a88109e00 msgr2=0x7f1a8819fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.083+0000 7f1a8c8be640 1 --2- 172.21.15.63:0/3719535695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a88109e00 0x7f1a8819fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.083+0000 7f1a8c8be640 1 -- 172.21.15.63:0/3719535695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a88103b70 msgr2=0x7f1a8819a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.083+0000 7f1a8c8be640 1 --2- 172.21.15.63:0/3719535695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a88103b70 0x7f1a8819a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.083+0000 7f1a8c8be640 1 -- 172.21.15.63:0/3719535695 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a881a0440 con 0x7f1a881094b0 2024-09-21T06:27:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.083+0000 7f1a8c8be640 1 --2- 172.21.15.63:0/3719535695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a881094b0 0x7f1a8819aa70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800d950 tx=0x7f1a7800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.083+0000 7f1a7e7fc640 1 -- 172.21.15.63:0/3719535695 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a78017070 con 0x7f1a881094b0 2024-09-21T06:27:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.083+0000 7f1a7e7fc640 1 -- 172.21.15.63:0/3719535695 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a78009c30 con 0x7f1a881094b0 2024-09-21T06:27:03.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.083+0000 7f1a8f323640 1 -- 172.21.15.63:0/3719535695 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a881a0730 con 0x7f1a881094b0 2024-09-21T06:27:03.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.083+0000 7f1a7e7fc640 1 -- 172.21.15.63:0/3719535695 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a780047a0 con 0x7f1a881094b0 2024-09-21T06:27:03.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.083+0000 7f1a8f323640 1 -- 172.21.15.63:0/3719535695 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a881a6e90 con 0x7f1a881094b0 2024-09-21T06:27:03.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.084+0000 7f1a8f323640 1 -- 172.21.15.63:0/3719535695 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1a88063ad0 con 0x7f1a881094b0 2024-09-21T06:27:03.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.086+0000 7f1a7e7fc640 1 -- 172.21.15.63:0/3719535695 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f1a78004020 con 0x7f1a881094b0 2024-09-21T06:27:03.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.087+0000 7f1a7e7fc640 1 --2- 172.21.15.63:0/3719535695 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1a740b6670 0x7f1a740b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.087+0000 7f1a8d0bf640 1 --2- 172.21.15.63:0/3719535695 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1a740b6670 0x7f1a740b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.087+0000 7f1a7e7fc640 1 -- 172.21.15.63:0/3719535695 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f1a780e7750 con 0x7f1a881094b0 2024-09-21T06:27:03.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.087+0000 7f1a7e7fc640 1 --2- 172.21.15.63:0/3719535695 >> [v2:172.21.15.71:6808/829449898,v1:172.21.15.71:6809/829449898] conn(0x7f1a740c0460 0x7f1a740c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.087+0000 7f1a7e7fc640 1 -- 172.21.15.63:0/3719535695 --> [v2:172.21.15.71:6808/829449898,v1:172.21.15.71:6809/829449898] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a740c3020 con 0x7f1a740c0460 2024-09-21T06:27:03.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.087+0000 7f1a7e7fc640 1 -- 172.21.15.63:0/3719535695 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f1a780e7ba0 con 0x7f1a881094b0 2024-09-21T06:27:03.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.087+0000 7f1a8d0bf640 1 --2- 172.21.15.63:0/3719535695 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1a740b6670 0x7f1a740b8b80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1a84031440 tx=0x7f1a84009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:03.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.087+0000 7f1a8d8c0640 1 --2- 172.21.15.63:0/3719535695 >> [v2:172.21.15.71:6808/829449898,v1:172.21.15.71:6809/829449898] conn(0x7f1a740c0460 0x7f1a740c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.088+0000 7f1a8d8c0640 1 --2- 172.21.15.63:0/3719535695 >> [v2:172.21.15.71:6808/829449898,v1:172.21.15.71:6809/829449898] conn(0x7f1a740c0460 0x7f1a740c2950 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:03.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.089+0000 7f1a7e7fc640 1 -- 172.21.15.63:0/3719535695 <== osd.4 v2:172.21.15.71:6808/829449898 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1a740c3020 con 0x7f1a740c0460 2024-09-21T06:27:03.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.102+0000 7f1a8f323640 1 -- 172.21.15.63:0/3719535695 --> [v2:172.21.15.71:6808/829449898,v1:172.21.15.71:6809/829449898] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1a88063f00 con 0x7f1a740c0460 2024-09-21T06:27:03.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.103+0000 7f1a7e7fc640 1 -- 172.21.15.63:0/3719535695 <== osd.4 v2:172.21.15.71:6808/829449898 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1a88063f00 con 0x7f1a740c0460 2024-09-21T06:27:03.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.103+0000 7f1a8f323640 1 -- 172.21.15.63:0/3719535695 >> [v2:172.21.15.71:6808/829449898,v1:172.21.15.71:6809/829449898] conn(0x7f1a740c0460 msgr2=0x7f1a740c2950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.103+0000 7f1a8f323640 1 --2- 172.21.15.63:0/3719535695 >> [v2:172.21.15.71:6808/829449898,v1:172.21.15.71:6809/829449898] conn(0x7f1a740c0460 0x7f1a740c2950 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.103+0000 7f1a8f323640 1 -- 172.21.15.63:0/3719535695 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1a740b6670 msgr2=0x7f1a740b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.103+0000 7f1a8f323640 1 --2- 172.21.15.63:0/3719535695 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1a740b6670 0x7f1a740b8b80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1a84031440 tx=0x7f1a84009560 comp rx=0 tx=0).stop 2024-09-21T06:27:03.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.103+0000 7f1a8f323640 1 -- 172.21.15.63:0/3719535695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a881094b0 msgr2=0x7f1a8819aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.103+0000 7f1a8f323640 1 --2- 172.21.15.63:0/3719535695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a881094b0 0x7f1a8819aa70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800d950 tx=0x7f1a7800de10 comp rx=0 tx=0).stop 2024-09-21T06:27:03.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.103+0000 7f1a8d8c0640 1 -- 172.21.15.63:0/3719535695 reap_dead start 2024-09-21T06:27:03.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.103+0000 7f1a8f323640 1 -- 172.21.15.63:0/3719535695 shutdown_connections 2024-09-21T06:27:03.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.103+0000 7f1a8f323640 1 -- 172.21.15.63:0/3719535695 >> 172.21.15.63:0/3719535695 conn(0x7f1a880ff5e0 msgr2=0x7f1a88101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:03.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.103+0000 7f1a8f323640 1 -- 172.21.15.63:0/3719535695 shutdown_connections 2024-09-21T06:27:03.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.103+0000 7f1a8f323640 1 -- 172.21.15.63:0/3719535695 wait complete. 2024-09-21T06:27:03.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:03 smithi063 ceph-mon[31150]: pgmap v287: 97 pgs: 97 active+clean; 647 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-21T06:27:03.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:03 smithi175 ceph-mon[34510]: pgmap v287: 97 pgs: 97 active+clean; 647 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-21T06:27:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.475+0000 7f8ac2aef640 1 -- 172.21.15.63:0/2560740868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8abc103b60 msgr2=0x7f8abc103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.475+0000 7f8ac2aef640 1 --2- 172.21.15.63:0/2560740868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8abc103b60 0x7f8abc103f70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0009900 tx=0x7f8ab002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.475+0000 7f8ac2aef640 1 -- 172.21.15.63:0/2560740868 shutdown_connections 2024-09-21T06:27:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.475+0000 7f8ac2aef640 1 --2- 172.21.15.63:0/2560740868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8abc109df0 0x7f8abc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.475+0000 7f8ac2aef640 1 --2- 172.21.15.63:0/2560740868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8abc1094a0 0x7f8abc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.475+0000 7f8ac2aef640 1 --2- 172.21.15.63:0/2560740868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8abc103b60 0x7f8abc103f70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.475+0000 7f8ac2aef640 1 -- 172.21.15.63:0/2560740868 >> 172.21.15.63:0/2560740868 conn(0x7f8abc07b850 msgr2=0x7f8abc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.475+0000 7f8ac2aef640 1 -- 172.21.15.63:0/2560740868 shutdown_connections 2024-09-21T06:27:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.476+0000 7f8ac2aef640 1 -- 172.21.15.63:0/2560740868 wait complete. 2024-09-21T06:27:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.476+0000 7f8ac2aef640 1 Processor -- start 2024-09-21T06:27:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.476+0000 7f8ac2aef640 1 -- start start 2024-09-21T06:27:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.477+0000 7f8ac2aef640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8abc103b60 0x7f8abc19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.477+0000 7f8ac2aef640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8abc1094a0 0x7f8abc19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.477+0000 7f8ac2aef640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8abc109df0 0x7f8abc19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.477+0000 7f8ac2aef640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc113ab0 con 0x7f8abc1094a0 2024-09-21T06:27:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.477+0000 7f8ac2aef640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc113930 con 0x7f8abc109df0 2024-09-21T06:27:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.477+0000 7f8ac2aef640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc113c30 con 0x7f8abc103b60 2024-09-21T06:27:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.477+0000 7f8abbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8abc1094a0 0x7f8abc19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.477+0000 7f8abbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8abc1094a0 0x7f8abc19aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58674/0 (socket says 172.21.15.63:58674) 2024-09-21T06:27:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.477+0000 7f8abbfff640 1 -- 172.21.15.63:0/2387826599 learned_addr learned my addr 172.21.15.63:0/2387826599 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.477+0000 7f8ac108c640 1 --2- 172.21.15.63:0/2387826599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8abc109df0 0x7f8abc19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.477+0000 7f8ac088b640 1 --2- 172.21.15.63:0/2387826599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8abc103b60 0x7f8abc19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.477+0000 7f8abbfff640 1 -- 172.21.15.63:0/2387826599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8abc103b60 msgr2=0x7f8abc19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.477+0000 7f8abbfff640 1 --2- 172.21.15.63:0/2387826599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8abc103b60 0x7f8abc19a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.477+0000 7f8abbfff640 1 -- 172.21.15.63:0/2387826599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8abc109df0 msgr2=0x7f8abc19fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.477+0000 7f8abbfff640 1 --2- 172.21.15.63:0/2387826599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8abc109df0 0x7f8abc19fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.477+0000 7f8abbfff640 1 -- 172.21.15.63:0/2387826599 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8abc1a0310 con 0x7f8abc1094a0 2024-09-21T06:27:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.477+0000 7f8abbfff640 1 --2- 172.21.15.63:0/2387826599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8abc1094a0 0x7f8abc19aa00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800d740 tx=0x7f8aa800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.478+0000 7f8ab9ffb640 1 -- 172.21.15.63:0/2387826599 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8017070 con 0x7f8abc1094a0 2024-09-21T06:27:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.478+0000 7f8ab9ffb640 1 -- 172.21.15.63:0/2387826599 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8aa800de50 con 0x7f8abc1094a0 2024-09-21T06:27:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.478+0000 7f8ac2aef640 1 -- 172.21.15.63:0/2387826599 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8abc1a0600 con 0x7f8abc1094a0 2024-09-21T06:27:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.478+0000 7f8ab9ffb640 1 -- 172.21.15.63:0/2387826599 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa800f620 con 0x7f8abc1094a0 2024-09-21T06:27:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.478+0000 7f8ac2aef640 1 -- 172.21.15.63:0/2387826599 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8abc1a6e20 con 0x7f8abc1094a0 2024-09-21T06:27:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.479+0000 7f8ac2aef640 1 -- 172.21.15.63:0/2387826599 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8abc063b50 con 0x7f8abc1094a0 2024-09-21T06:27:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.481+0000 7f8ab9ffb640 1 -- 172.21.15.63:0/2387826599 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f8aa801a070 con 0x7f8abc1094a0 2024-09-21T06:27:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.481+0000 7f8ab9ffb640 1 --2- 172.21.15.63:0/2387826599 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8aac0b66a0 0x7f8aac0b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.481+0000 7f8ac088b640 1 --2- 172.21.15.63:0/2387826599 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8aac0b66a0 0x7f8aac0b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.481+0000 7f8ab9ffb640 1 -- 172.21.15.63:0/2387826599 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f8aa80e7350 con 0x7f8abc1094a0 2024-09-21T06:27:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.482+0000 7f8ab9ffb640 1 --2- 172.21.15.63:0/2387826599 >> [v2:172.21.15.71:6816/2913027708,v1:172.21.15.71:6817/2913027708] conn(0x7f8aac0c0490 0x7f8aac0c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.482+0000 7f8ab9ffb640 1 -- 172.21.15.63:0/2387826599 --> [v2:172.21.15.71:6816/2913027708,v1:172.21.15.71:6817/2913027708] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8aac0c3050 con 0x7f8aac0c0490 2024-09-21T06:27:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.482+0000 7f8ab9ffb640 1 -- 172.21.15.63:0/2387826599 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f8aa80e77a0 con 0x7f8abc1094a0 2024-09-21T06:27:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.482+0000 7f8ac088b640 1 --2- 172.21.15.63:0/2387826599 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8aac0b66a0 0x7f8aac0b8bb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0031440 tx=0x7f8ab0005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.482+0000 7f8ac108c640 1 --2- 172.21.15.63:0/2387826599 >> [v2:172.21.15.71:6816/2913027708,v1:172.21.15.71:6817/2913027708] conn(0x7f8aac0c0490 0x7f8aac0c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.482+0000 7f8ac108c640 1 --2- 172.21.15.63:0/2387826599 >> [v2:172.21.15.71:6816/2913027708,v1:172.21.15.71:6817/2913027708] conn(0x7f8aac0c0490 0x7f8aac0c2980 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.483+0000 7f8ab9ffb640 1 -- 172.21.15.63:0/2387826599 <== osd.7 v2:172.21.15.71:6816/2913027708 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8aac0c3050 con 0x7f8aac0c0490 2024-09-21T06:27:03.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.497+0000 7f8ac2aef640 1 -- 172.21.15.63:0/2387826599 --> [v2:172.21.15.71:6816/2913027708,v1:172.21.15.71:6817/2913027708] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8abc063f50 con 0x7f8aac0c0490 2024-09-21T06:27:03.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.497+0000 7f8ab9ffb640 1 -- 172.21.15.63:0/2387826599 <== osd.7 v2:172.21.15.71:6816/2913027708 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8abc063f50 con 0x7f8aac0c0490 2024-09-21T06:27:03.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.498+0000 7f8ac2aef640 1 -- 172.21.15.63:0/2387826599 >> [v2:172.21.15.71:6816/2913027708,v1:172.21.15.71:6817/2913027708] conn(0x7f8aac0c0490 msgr2=0x7f8aac0c2980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.498+0000 7f8ac2aef640 1 --2- 172.21.15.63:0/2387826599 >> [v2:172.21.15.71:6816/2913027708,v1:172.21.15.71:6817/2913027708] conn(0x7f8aac0c0490 0x7f8aac0c2980 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.498+0000 7f8ac2aef640 1 -- 172.21.15.63:0/2387826599 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8aac0b66a0 msgr2=0x7f8aac0b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.498+0000 7f8ac2aef640 1 --2- 172.21.15.63:0/2387826599 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8aac0b66a0 0x7f8aac0b8bb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0031440 tx=0x7f8ab0005d50 comp rx=0 tx=0).stop 2024-09-21T06:27:03.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.498+0000 7f8ac2aef640 1 -- 172.21.15.63:0/2387826599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8abc1094a0 msgr2=0x7f8abc19aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.498+0000 7f8ac2aef640 1 --2- 172.21.15.63:0/2387826599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8abc1094a0 0x7f8abc19aa00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800d740 tx=0x7f8aa800dc00 comp rx=0 tx=0).stop 2024-09-21T06:27:03.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.498+0000 7f8ac108c640 1 -- 172.21.15.63:0/2387826599 reap_dead start 2024-09-21T06:27:03.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.498+0000 7f8ac2aef640 1 -- 172.21.15.63:0/2387826599 shutdown_connections 2024-09-21T06:27:03.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.498+0000 7f8ac2aef640 1 -- 172.21.15.63:0/2387826599 >> 172.21.15.63:0/2387826599 conn(0x7f8abc07b850 msgr2=0x7f8abc107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:03.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.498+0000 7f8ac2aef640 1 -- 172.21.15.63:0/2387826599 shutdown_connections 2024-09-21T06:27:03.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.498+0000 7f8ac2aef640 1 -- 172.21.15.63:0/2387826599 wait complete. 2024-09-21T06:27:03.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:03 smithi071 ceph-mon[34844]: pgmap v287: 97 pgs: 97 active+clean; 647 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-21T06:27:03.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.684+0000 7f029c0bf640 1 -- 172.21.15.63:0/3474538850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02941083a0 msgr2=0x7f02941087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.684+0000 7f029c0bf640 1 --2- 172.21.15.63:0/3474538850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02941083a0 0x7f02941087b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0284009900 tx=0x7f028402a410 comp rx=0 tx=0).stop 2024-09-21T06:27:03.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.684+0000 7f029c0bf640 1 -- 172.21.15.63:0/3474538850 shutdown_connections 2024-09-21T06:27:03.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.684+0000 7f029c0bf640 1 --2- 172.21.15.63:0/3474538850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0294108cf0 0x7f029410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.684+0000 7f029c0bf640 1 --2- 172.21.15.63:0/3474538850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02941083a0 0x7f02941087b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.684+0000 7f029c0bf640 1 --2- 172.21.15.63:0/3474538850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0294102a60 0x7f0294102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.684+0000 7f029c0bf640 1 -- 172.21.15.63:0/3474538850 >> 172.21.15.63:0/3474538850 conn(0x7f0294079730 msgr2=0x7f0294079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:03.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.684+0000 7f029c0bf640 1 -- 172.21.15.63:0/3474538850 shutdown_connections 2024-09-21T06:27:03.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.684+0000 7f029c0bf640 1 -- 172.21.15.63:0/3474538850 wait complete. 2024-09-21T06:27:03.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.685+0000 7f029c0bf640 1 Processor -- start 2024-09-21T06:27:03.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.685+0000 7f029c0bf640 1 -- start start 2024-09-21T06:27:03.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f029c0bf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0294102a60 0x7f02940ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f029c0bf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02941083a0 0x7f02940ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f029c0bf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0294108cf0 0x7f02941000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f029c0bf640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0294112960 con 0x7f0294108cf0 2024-09-21T06:27:03.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f029c0bf640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f02941127e0 con 0x7f02941083a0 2024-09-21T06:27:03.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f029c0bf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0294112ae0 con 0x7f0294102a60 2024-09-21T06:27:03.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f029a65c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0294108cf0 0x7f02941000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f029a65c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0294108cf0 0x7f02941000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58692/0 (socket says 172.21.15.63:58692) 2024-09-21T06:27:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f029a65c640 1 -- 172.21.15.63:0/404945948 learned_addr learned my addr 172.21.15.63:0/404945948 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f0299e5b640 1 --2- 172.21.15.63:0/404945948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0294102a60 0x7f02940ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f029a65c640 1 -- 172.21.15.63:0/404945948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0294102a60 msgr2=0x7f02940ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f029a65c640 1 --2- 172.21.15.63:0/404945948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0294102a60 0x7f02940ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f029965a640 1 --2- 172.21.15.63:0/404945948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02941083a0 0x7f02940ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f029a65c640 1 -- 172.21.15.63:0/404945948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02941083a0 msgr2=0x7f02940ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f029a65c640 1 --2- 172.21.15.63:0/404945948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02941083a0 0x7f02940ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f029a65c640 1 -- 172.21.15.63:0/404945948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02941a8700 con 0x7f0294108cf0 2024-09-21T06:27:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f029a65c640 1 --2- 172.21.15.63:0/404945948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0294108cf0 0x7f02941000f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f028c00eaa0 tx=0x7f028c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f028affd640 1 -- 172.21.15.63:0/404945948 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c00cdb0 con 0x7f0294108cf0 2024-09-21T06:27:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f028affd640 1 -- 172.21.15.63:0/404945948 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f028c005020 con 0x7f0294108cf0 2024-09-21T06:27:03.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f029c0bf640 1 -- 172.21.15.63:0/404945948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02941a89f0 con 0x7f0294108cf0 2024-09-21T06:27:03.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.686+0000 7f028affd640 1 -- 172.21.15.63:0/404945948 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c0116d0 con 0x7f0294108cf0 2024-09-21T06:27:03.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.687+0000 7f029c0bf640 1 -- 172.21.15.63:0/404945948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02941a8ee0 con 0x7f0294108cf0 2024-09-21T06:27:03.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.687+0000 7f029c0bf640 1 -- 172.21.15.63:0/404945948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0294063b50 con 0x7f0294108cf0 2024-09-21T06:27:03.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.689+0000 7f028affd640 1 -- 172.21.15.63:0/404945948 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f028c0051d0 con 0x7f0294108cf0 2024-09-21T06:27:03.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.690+0000 7f028affd640 1 --2- 172.21.15.63:0/404945948 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f02800b65f0 0x7f02800b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.690+0000 7f0299e5b640 1 --2- 172.21.15.63:0/404945948 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f02800b65f0 0x7f02800b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.690+0000 7f028affd640 1 -- 172.21.15.63:0/404945948 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f028c0e7c50 con 0x7f0294108cf0 2024-09-21T06:27:03.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.690+0000 7f028affd640 1 --2- 172.21.15.63:0/404945948 >> [v2:172.21.15.71:6800/1676297548,v1:172.21.15.71:6801/1676297548] conn(0x7f02800c03e0 0x7f02800c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.690+0000 7f028affd640 1 -- 172.21.15.63:0/404945948 --> [v2:172.21.15.71:6800/1676297548,v1:172.21.15.71:6801/1676297548] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f028c018ec0 con 0x7f02800c03e0 2024-09-21T06:27:03.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.690+0000 7f028affd640 1 -- 172.21.15.63:0/404945948 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f028c0e80a0 con 0x7f0294108cf0 2024-09-21T06:27:03.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.691+0000 7f0299e5b640 1 --2- 172.21.15.63:0/404945948 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f02800b65f0 0x7f02800b8b00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f02941010c0 tx=0x7f0290005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:03.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.691+0000 7f029965a640 1 --2- 172.21.15.63:0/404945948 >> [v2:172.21.15.71:6800/1676297548,v1:172.21.15.71:6801/1676297548] conn(0x7f02800c03e0 0x7f02800c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.691+0000 7f029965a640 1 --2- 172.21.15.63:0/404945948 >> [v2:172.21.15.71:6800/1676297548,v1:172.21.15.71:6801/1676297548] conn(0x7f02800c03e0 0x7f02800c28d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:03.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.692+0000 7f028affd640 1 -- 172.21.15.63:0/404945948 <== osd.1 v2:172.21.15.71:6800/1676297548 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f028c018ec0 con 0x7f02800c03e0 2024-09-21T06:27:03.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.711+0000 7f029c0bf640 1 -- 172.21.15.63:0/404945948 --> [v2:172.21.15.71:6800/1676297548,v1:172.21.15.71:6801/1676297548] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0294063fd0 con 0x7f02800c03e0 2024-09-21T06:27:03.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.712+0000 7f028affd640 1 -- 172.21.15.63:0/404945948 <== osd.1 v2:172.21.15.71:6800/1676297548 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0294063fd0 con 0x7f02800c03e0 2024-09-21T06:27:03.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.712+0000 7f029c0bf640 1 -- 172.21.15.63:0/404945948 >> [v2:172.21.15.71:6800/1676297548,v1:172.21.15.71:6801/1676297548] conn(0x7f02800c03e0 msgr2=0x7f02800c28d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.712+0000 7f029c0bf640 1 --2- 172.21.15.63:0/404945948 >> [v2:172.21.15.71:6800/1676297548,v1:172.21.15.71:6801/1676297548] conn(0x7f02800c03e0 0x7f02800c28d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.712+0000 7f029c0bf640 1 -- 172.21.15.63:0/404945948 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f02800b65f0 msgr2=0x7f02800b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.712+0000 7f029c0bf640 1 --2- 172.21.15.63:0/404945948 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f02800b65f0 0x7f02800b8b00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f02941010c0 tx=0x7f0290005f90 comp rx=0 tx=0).stop 2024-09-21T06:27:03.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.712+0000 7f029c0bf640 1 -- 172.21.15.63:0/404945948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0294108cf0 msgr2=0x7f02941000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.712+0000 7f029c0bf640 1 --2- 172.21.15.63:0/404945948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0294108cf0 0x7f02941000f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f028c00eaa0 tx=0x7f028c00ef60 comp rx=0 tx=0).stop 2024-09-21T06:27:03.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.712+0000 7f029a65c640 1 -- 172.21.15.63:0/404945948 reap_dead start 2024-09-21T06:27:03.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.712+0000 7f029c0bf640 1 -- 172.21.15.63:0/404945948 shutdown_connections 2024-09-21T06:27:03.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.712+0000 7f029c0bf640 1 -- 172.21.15.63:0/404945948 >> 172.21.15.63:0/404945948 conn(0x7f0294079730 msgr2=0x7f029406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:03.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.712+0000 7f029c0bf640 1 -- 172.21.15.63:0/404945948 shutdown_connections 2024-09-21T06:27:03.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:03.712+0000 7f029c0bf640 1 -- 172.21.15.63:0/404945948 wait complete. 2024-09-21T06:27:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.031+0000 7fd9f9607640 1 -- 172.21.15.63:0/3993819843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f410de10 msgr2=0x7fd9f4110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.031+0000 7fd9f9607640 1 --2- 172.21.15.63:0/3993819843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f410de10 0x7fd9f4110300 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009ca0 tx=0x7fd9e402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.031+0000 7fd9f9607640 1 -- 172.21.15.63:0/3993819843 shutdown_connections 2024-09-21T06:27:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.031+0000 7fd9f9607640 1 --2- 172.21.15.63:0/3993819843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f410de10 0x7fd9f4110300 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.031+0000 7fd9f9607640 1 --2- 172.21.15.63:0/3993819843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9f4105300 0x7fd9f410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.031+0000 7fd9f9607640 1 --2- 172.21.15.63:0/3993819843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9f41049b0 0x7fd9f4104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.031+0000 7fd9f9607640 1 -- 172.21.15.63:0/3993819843 >> 172.21.15.63:0/3993819843 conn(0x7fd9f4079730 msgr2=0x7fd9f4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.031+0000 7fd9f9607640 1 -- 172.21.15.63:0/3993819843 shutdown_connections 2024-09-21T06:27:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.031+0000 7fd9f9607640 1 -- 172.21.15.63:0/3993819843 wait complete. 2024-09-21T06:27:04.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.032+0000 7fd9f9607640 1 Processor -- start 2024-09-21T06:27:04.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.032+0000 7fd9f9607640 1 -- start start 2024-09-21T06:27:04.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.032+0000 7fd9f9607640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9f41049b0 0x7fd9f419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.032+0000 7fd9f9607640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9f4105300 0x7fd9f419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.032+0000 7fd9f9607640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f410de10 0x7fd9f419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.032+0000 7fd9f9607640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f4113a70 con 0x7fd9f410de10 2024-09-21T06:27:04.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.032+0000 7fd9f9607640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f41138f0 con 0x7fd9f41049b0 2024-09-21T06:27:04.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.032+0000 7fd9f9607640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f4113bf0 con 0x7fd9f4105300 2024-09-21T06:27:04.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.033+0000 7fd9f37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f410de10 0x7fd9f419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.033+0000 7fd9f2ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9f41049b0 0x7fd9f419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.033+0000 7fd9f37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f410de10 0x7fd9f419fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58708/0 (socket says 172.21.15.63:58708) 2024-09-21T06:27:04.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.033+0000 7fd9f37fe640 1 -- 172.21.15.63:0/4133588606 learned_addr learned my addr 172.21.15.63:0/4133588606 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:04.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.033+0000 7fd9f27fc640 1 --2- 172.21.15.63:0/4133588606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9f4105300 0x7fd9f419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.033+0000 7fd9f37fe640 1 -- 172.21.15.63:0/4133588606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9f4105300 msgr2=0x7fd9f419aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.033+0000 7fd9f37fe640 1 --2- 172.21.15.63:0/4133588606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9f4105300 0x7fd9f419aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.033+0000 7fd9f37fe640 1 -- 172.21.15.63:0/4133588606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9f41049b0 msgr2=0x7fd9f419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.033+0000 7fd9f37fe640 1 --2- 172.21.15.63:0/4133588606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9f41049b0 0x7fd9f419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.033+0000 7fd9f37fe640 1 -- 172.21.15.63:0/4133588606 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f41a0350 con 0x7fd9f410de10 2024-09-21T06:27:04.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.033+0000 7fd9f37fe640 1 --2- 172.21.15.63:0/4133588606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f410de10 0x7fd9f419fce0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4005cc0 tx=0x7fd9e402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:04.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.033+0000 7fd9ebfff640 1 -- 172.21.15.63:0/4133588606 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4003bf0 con 0x7fd9f410de10 2024-09-21T06:27:04.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.033+0000 7fd9f9607640 1 -- 172.21.15.63:0/4133588606 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9f41a05e0 con 0x7fd9f410de10 2024-09-21T06:27:04.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.033+0000 7fd9ebfff640 1 -- 172.21.15.63:0/4133588606 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9e4003d90 con 0x7fd9f410de10 2024-09-21T06:27:04.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.033+0000 7fd9ebfff640 1 -- 172.21.15.63:0/4133588606 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e402fbc0 con 0x7fd9f410de10 2024-09-21T06:27:04.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.034+0000 7fd9f9607640 1 -- 172.21.15.63:0/4133588606 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9f41a0b20 con 0x7fd9f410de10 2024-09-21T06:27:04.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.035+0000 7fd9f9607640 1 -- 172.21.15.63:0/4133588606 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd9f4100fc0 con 0x7fd9f410de10 2024-09-21T06:27:04.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.036+0000 7fd9ebfff640 1 -- 172.21.15.63:0/4133588606 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fd9e402fd60 con 0x7fd9f410de10 2024-09-21T06:27:04.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.037+0000 7fd9ebfff640 1 --2- 172.21.15.63:0/4133588606 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd9e00b6620 0x7fd9e00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.037+0000 7fd9f2ffd640 1 --2- 172.21.15.63:0/4133588606 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd9e00b6620 0x7fd9e00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.037+0000 7fd9ebfff640 1 -- 172.21.15.63:0/4133588606 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fd9e4108c40 con 0x7fd9f410de10 2024-09-21T06:27:04.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.037+0000 7fd9ebfff640 1 --2- 172.21.15.63:0/4133588606 >> [v2:172.21.15.175:6800/2356865390,v1:172.21.15.175:6801/2356865390] conn(0x7fd9e00c0410 0x7fd9e00c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.037+0000 7fd9ebfff640 1 -- 172.21.15.63:0/4133588606 --> [v2:172.21.15.175:6800/2356865390,v1:172.21.15.175:6801/2356865390] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9e00c2fd0 con 0x7fd9e00c0410 2024-09-21T06:27:04.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.037+0000 7fd9ebfff640 1 -- 172.21.15.63:0/4133588606 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fd9e4109090 con 0x7fd9f410de10 2024-09-21T06:27:04.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.037+0000 7fd9f2ffd640 1 --2- 172.21.15.63:0/4133588606 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd9e00b6620 0x7fd9e00b8b30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd9f406bc60 tx=0x7fd9ec005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:04.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.037+0000 7fd9f27fc640 1 --2- 172.21.15.63:0/4133588606 >> [v2:172.21.15.175:6800/2356865390,v1:172.21.15.175:6801/2356865390] conn(0x7fd9e00c0410 0x7fd9e00c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.038+0000 7fd9f27fc640 1 --2- 172.21.15.63:0/4133588606 >> [v2:172.21.15.175:6800/2356865390,v1:172.21.15.175:6801/2356865390] conn(0x7fd9e00c0410 0x7fd9e00c2900 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:04.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.039+0000 7fd9ebfff640 1 -- 172.21.15.63:0/4133588606 <== osd.2 v2:172.21.15.175:6800/2356865390 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd9e00c2fd0 con 0x7fd9e00c0410 2024-09-21T06:27:04.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.053+0000 7fd9f9607640 1 -- 172.21.15.63:0/4133588606 --> [v2:172.21.15.175:6800/2356865390,v1:172.21.15.175:6801/2356865390] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd9f406b560 con 0x7fd9e00c0410 2024-09-21T06:27:04.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.054+0000 7fd9ebfff640 1 -- 172.21.15.63:0/4133588606 <== osd.2 v2:172.21.15.175:6800/2356865390 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd9f406b560 con 0x7fd9e00c0410 2024-09-21T06:27:04.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.054+0000 7fd9f9607640 1 -- 172.21.15.63:0/4133588606 >> [v2:172.21.15.175:6800/2356865390,v1:172.21.15.175:6801/2356865390] conn(0x7fd9e00c0410 msgr2=0x7fd9e00c2900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.054+0000 7fd9f9607640 1 --2- 172.21.15.63:0/4133588606 >> [v2:172.21.15.175:6800/2356865390,v1:172.21.15.175:6801/2356865390] conn(0x7fd9e00c0410 0x7fd9e00c2900 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.054+0000 7fd9f9607640 1 -- 172.21.15.63:0/4133588606 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd9e00b6620 msgr2=0x7fd9e00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.054+0000 7fd9f9607640 1 --2- 172.21.15.63:0/4133588606 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd9e00b6620 0x7fd9e00b8b30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd9f406bc60 tx=0x7fd9ec005f90 comp rx=0 tx=0).stop 2024-09-21T06:27:04.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.054+0000 7fd9f9607640 1 -- 172.21.15.63:0/4133588606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f410de10 msgr2=0x7fd9f419fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.054+0000 7fd9f9607640 1 --2- 172.21.15.63:0/4133588606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f410de10 0x7fd9f419fce0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4005cc0 tx=0x7fd9e402f380 comp rx=0 tx=0).stop 2024-09-21T06:27:04.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.054+0000 7fd9f37fe640 1 -- 172.21.15.63:0/4133588606 reap_dead start 2024-09-21T06:27:04.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.054+0000 7fd9f9607640 1 -- 172.21.15.63:0/4133588606 shutdown_connections 2024-09-21T06:27:04.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.054+0000 7fd9f9607640 1 -- 172.21.15.63:0/4133588606 >> 172.21.15.63:0/4133588606 conn(0x7fd9f4079730 msgr2=0x7fd9f40ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:04.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.054+0000 7fd9f9607640 1 -- 172.21.15.63:0/4133588606 shutdown_connections 2024-09-21T06:27:04.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:04.054+0000 7fd9f9607640 1 -- 172.21.15.63:0/4133588606 wait complete. 2024-09-21T06:27:04.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.888+0000 7f2327e10640 1 -- 172.21.15.63:0/2188697300 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23201083a0 msgr2=0x7f23201087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.888+0000 7f2327e10640 1 --2- 172.21.15.63:0/2188697300 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23201083a0 0x7f23201087b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2314009900 tx=0x7f231402a410 comp rx=0 tx=0).stop 2024-09-21T06:27:04.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.888+0000 7f2327e10640 1 -- 172.21.15.63:0/2188697300 shutdown_connections 2024-09-21T06:27:04.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.888+0000 7f2327e10640 1 --2- 172.21.15.63:0/2188697300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2320108cf0 0x7f232010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.888+0000 7f2327e10640 1 --2- 172.21.15.63:0/2188697300 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23201083a0 0x7f23201087b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.888+0000 7f2327e10640 1 --2- 172.21.15.63:0/2188697300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2320102a60 0x7f2320102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.888+0000 7f2327e10640 1 -- 172.21.15.63:0/2188697300 >> 172.21.15.63:0/2188697300 conn(0x7f2320079730 msgr2=0x7f2320079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:04.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.888+0000 7f2327e10640 1 -- 172.21.15.63:0/2188697300 shutdown_connections 2024-09-21T06:27:04.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.888+0000 7f2327e10640 1 -- 172.21.15.63:0/2188697300 wait complete. 2024-09-21T06:27:04.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.889+0000 7f2327e10640 1 Processor -- start 2024-09-21T06:27:04.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.889+0000 7f2327e10640 1 -- start start 2024-09-21T06:27:04.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.889+0000 7f2327e10640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2320102a60 0x7f232019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.889+0000 7f2327e10640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23201083a0 0x7f232019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.889+0000 7f2327e10640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2320108cf0 0x7f232019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.889+0000 7f2327e10640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2320113a80 con 0x7f2320108cf0 2024-09-21T06:27:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.889+0000 7f2327e10640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2320113900 con 0x7f23201083a0 2024-09-21T06:27:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.889+0000 7f2327e10640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2320113c00 con 0x7f2320102a60 2024-09-21T06:27:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.889+0000 7f23263ad640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2320108cf0 0x7f232019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.889+0000 7f23263ad640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2320108cf0 0x7f232019fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58598/0 (socket says 172.21.15.63:58598) 2024-09-21T06:27:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.889+0000 7f23263ad640 1 -- 172.21.15.63:0/2239156842 learned_addr learned my addr 172.21.15.63:0/2239156842 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.889+0000 7f23253ab640 1 --2- 172.21.15.63:0/2239156842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23201083a0 0x7f232019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.889+0000 7f2325bac640 1 --2- 172.21.15.63:0/2239156842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2320102a60 0x7f232019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.889+0000 7f23263ad640 1 -- 172.21.15.63:0/2239156842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2320102a60 msgr2=0x7f232019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.889+0000 7f23263ad640 1 --2- 172.21.15.63:0/2239156842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2320102a60 0x7f232019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.889+0000 7f23263ad640 1 -- 172.21.15.63:0/2239156842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23201083a0 msgr2=0x7f232019aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.889+0000 7f23263ad640 1 --2- 172.21.15.63:0/2239156842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23201083a0 0x7f232019aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.889+0000 7f23263ad640 1 -- 172.21.15.63:0/2239156842 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23201a0480 con 0x7f2320108cf0 2024-09-21T06:27:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.890+0000 7f23263ad640 1 --2- 172.21.15.63:0/2239156842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2320108cf0 0x7f232019fd50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f231800eaa0 tx=0x7f231800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.890+0000 7f2312ffd640 1 -- 172.21.15.63:0/2239156842 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231800cdb0 con 0x7f2320108cf0 2024-09-21T06:27:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.890+0000 7f2327e10640 1 -- 172.21.15.63:0/2239156842 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23201a0770 con 0x7f2320108cf0 2024-09-21T06:27:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.890+0000 7f2312ffd640 1 -- 172.21.15.63:0/2239156842 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2318005020 con 0x7f2320108cf0 2024-09-21T06:27:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.890+0000 7f2312ffd640 1 -- 172.21.15.63:0/2239156842 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23180116d0 con 0x7f2320108cf0 2024-09-21T06:27:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.890+0000 7f2327e10640 1 -- 172.21.15.63:0/2239156842 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23201a6ed0 con 0x7f2320108cf0 2024-09-21T06:27:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.891+0000 7f2327e10640 1 -- 172.21.15.63:0/2239156842 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2320063b10 con 0x7f2320108cf0 2024-09-21T06:27:04.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.892+0000 7f2312ffd640 1 -- 172.21.15.63:0/2239156842 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f23180051d0 con 0x7f2320108cf0 2024-09-21T06:27:04.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.893+0000 7f2312ffd640 1 --2- 172.21.15.63:0/2239156842 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f230c0b65f0 0x7f230c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.893+0000 7f2325bac640 1 --2- 172.21.15.63:0/2239156842 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f230c0b65f0 0x7f230c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.893+0000 7f2312ffd640 1 -- 172.21.15.63:0/2239156842 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f23180e7b50 con 0x7f2320108cf0 2024-09-21T06:27:04.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.894+0000 7f2312ffd640 1 --2- 172.21.15.63:0/2239156842 >> [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408] conn(0x7f230c0c03e0 0x7f230c0c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.894+0000 7f2312ffd640 1 -- 172.21.15.63:0/2239156842 --> [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f231801ce50 con 0x7f230c0c03e0 2024-09-21T06:27:04.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.894+0000 7f2312ffd640 1 -- 172.21.15.63:0/2239156842 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f23180e7fa0 con 0x7f2320108cf0 2024-09-21T06:27:04.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.894+0000 7f23253ab640 1 --2- 172.21.15.63:0/2239156842 >> [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408] conn(0x7f230c0c03e0 0x7f230c0c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.894+0000 7f2325bac640 1 --2- 172.21.15.63:0/2239156842 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f230c0b65f0 0x7f230c0b8b00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f231c005fd0 tx=0x7f231c005e20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:04.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.894+0000 7f23253ab640 1 --2- 172.21.15.63:0/2239156842 >> [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408] conn(0x7f230c0c03e0 0x7f230c0c28d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:04.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.895+0000 7f2312ffd640 1 -- 172.21.15.63:0/2239156842 <== osd.6 v2:172.21.15.63:6818/4044730408 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f231801ce50 con 0x7f230c0c03e0 2024-09-21T06:27:04.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.908+0000 7f2327e10640 1 -- 172.21.15.63:0/2239156842 --> [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2320063f90 con 0x7f230c0c03e0 2024-09-21T06:27:04.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.909+0000 7f2312ffd640 1 -- 172.21.15.63:0/2239156842 <== osd.6 v2:172.21.15.63:6818/4044730408 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2320063f90 con 0x7f230c0c03e0 2024-09-21T06:27:04.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.909+0000 7f2327e10640 1 -- 172.21.15.63:0/2239156842 >> [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408] conn(0x7f230c0c03e0 msgr2=0x7f230c0c28d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.909+0000 7f2327e10640 1 --2- 172.21.15.63:0/2239156842 >> [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408] conn(0x7f230c0c03e0 0x7f230c0c28d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.909+0000 7f2327e10640 1 -- 172.21.15.63:0/2239156842 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f230c0b65f0 msgr2=0x7f230c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.909+0000 7f2327e10640 1 --2- 172.21.15.63:0/2239156842 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f230c0b65f0 0x7f230c0b8b00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f231c005fd0 tx=0x7f231c005e20 comp rx=0 tx=0).stop 2024-09-21T06:27:04.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.909+0000 7f2327e10640 1 -- 172.21.15.63:0/2239156842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2320108cf0 msgr2=0x7f232019fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.909+0000 7f2327e10640 1 --2- 172.21.15.63:0/2239156842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2320108cf0 0x7f232019fd50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f231800eaa0 tx=0x7f231800ef60 comp rx=0 tx=0).stop 2024-09-21T06:27:04.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.909+0000 7f23263ad640 1 -- 172.21.15.63:0/2239156842 reap_dead start 2024-09-21T06:27:04.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.909+0000 7f2327e10640 1 -- 172.21.15.63:0/2239156842 shutdown_connections 2024-09-21T06:27:04.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.909+0000 7f2327e10640 1 -- 172.21.15.63:0/2239156842 >> 172.21.15.63:0/2239156842 conn(0x7f2320079730 msgr2=0x7f2320104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:04.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.909+0000 7f2327e10640 1 -- 172.21.15.63:0/2239156842 shutdown_connections 2024-09-21T06:27:04.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:01.909+0000 7f2327e10640 1 -- 172.21.15.63:0/2239156842 wait complete. 2024-09-21T06:27:04.945 INFO:teuthology.orchestra.run.smithi063.stdout:176093659184 2024-09-21T06:27:04.945 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T06:27:05.298 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:05 smithi063 ceph-mon[31150]: pgmap v288: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T06:27:05.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:05 smithi175 ceph-mon[34510]: pgmap v288: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T06:27:05.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:05 smithi071 ceph-mon[34844]: pgmap v288: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T06:27:05.815 INFO:teuthology.orchestra.run.smithi063.stdout:296352743445 2024-09-21T06:27:05.815 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T06:27:05.953 INFO:teuthology.orchestra.run.smithi063.stdout:81604378693 2024-09-21T06:27:05.953 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T06:27:06.579 INFO:teuthology.orchestra.run.smithi063.stdout:197568495659 2024-09-21T06:27:06.579 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T06:27:07.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.046+0000 7fde9add8640 1 -- 172.21.15.63:0/715565578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde94108cf0 msgr2=0x7fde9410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:07.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.046+0000 7fde9add8640 1 --2- 172.21.15.63:0/715565578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde94108cf0 0x7fde9410f520 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009ca0 tx=0x7fde8c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:07.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.047+0000 7fde9add8640 1 -- 172.21.15.63:0/715565578 shutdown_connections 2024-09-21T06:27:07.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.047+0000 7fde9add8640 1 --2- 172.21.15.63:0/715565578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde94108cf0 0x7fde9410f520 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:07.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.047+0000 7fde9add8640 1 --2- 172.21.15.63:0/715565578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde941083a0 0x7fde941087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:07.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.047+0000 7fde9add8640 1 --2- 172.21.15.63:0/715565578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde94102a60 0x7fde94102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:07.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.047+0000 7fde9add8640 1 -- 172.21.15.63:0/715565578 >> 172.21.15.63:0/715565578 conn(0x7fde94079730 msgr2=0x7fde94079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:07.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.047+0000 7fde9add8640 1 -- 172.21.15.63:0/715565578 shutdown_connections 2024-09-21T06:27:07.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.047+0000 7fde9add8640 1 -- 172.21.15.63:0/715565578 wait complete. 2024-09-21T06:27:07.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.047+0000 7fde9add8640 1 Processor -- start 2024-09-21T06:27:07.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.048+0000 7fde9add8640 1 -- start start 2024-09-21T06:27:07.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.048+0000 7fde9add8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde94102a60 0x7fde9419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:07.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.048+0000 7fde9add8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde941083a0 0x7fde9419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:07.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.048+0000 7fde9add8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde94108cf0 0x7fde9419fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:07.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.048+0000 7fde9add8640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fde94113a80 con 0x7fde94108cf0 2024-09-21T06:27:07.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.048+0000 7fde9add8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fde94113900 con 0x7fde941083a0 2024-09-21T06:27:07.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.048+0000 7fde9add8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fde94113c00 con 0x7fde94102a60 2024-09-21T06:27:07.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.048+0000 7fde99375640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde94108cf0 0x7fde9419fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:07.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.048+0000 7fde99375640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde94108cf0 0x7fde9419fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54252/0 (socket says 172.21.15.63:54252) 2024-09-21T06:27:07.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.048+0000 7fde99375640 1 -- 172.21.15.63:0/3252290777 learned_addr learned my addr 172.21.15.63:0/3252290777 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:07.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.048+0000 7fde93fff640 1 --2- 172.21.15.63:0/3252290777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde941083a0 0x7fde9419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:07.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.048+0000 7fde98b74640 1 --2- 172.21.15.63:0/3252290777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde94102a60 0x7fde9419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:07.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.048+0000 7fde99375640 1 -- 172.21.15.63:0/3252290777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde94102a60 msgr2=0x7fde9419a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:07.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.048+0000 7fde99375640 1 --2- 172.21.15.63:0/3252290777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde94102a60 0x7fde9419a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:07.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.048+0000 7fde99375640 1 -- 172.21.15.63:0/3252290777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde941083a0 msgr2=0x7fde9419a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:07.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.048+0000 7fde99375640 1 --2- 172.21.15.63:0/3252290777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde941083a0 0x7fde9419a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:07.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.048+0000 7fde99375640 1 -- 172.21.15.63:0/3252290777 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde941a0300 con 0x7fde94108cf0 2024-09-21T06:27:07.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.049+0000 7fde99375640 1 --2- 172.21.15.63:0/3252290777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde94108cf0 0x7fde9419fc90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fde8c005cc0 tx=0x7fde8c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:07.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.051+0000 7fde91ffb640 1 -- 172.21.15.63:0/3252290777 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8c003bf0 con 0x7fde94108cf0 2024-09-21T06:27:07.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.051+0000 7fde91ffb640 1 -- 172.21.15.63:0/3252290777 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde8c003d90 con 0x7fde94108cf0 2024-09-21T06:27:07.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.051+0000 7fde91ffb640 1 -- 172.21.15.63:0/3252290777 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8c02fb20 con 0x7fde94108cf0 2024-09-21T06:27:07.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.051+0000 7fde9add8640 1 -- 172.21.15.63:0/3252290777 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde941a0590 con 0x7fde94108cf0 2024-09-21T06:27:07.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.051+0000 7fde9add8640 1 -- 172.21.15.63:0/3252290777 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde941a6e10 con 0x7fde94108cf0 2024-09-21T06:27:07.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.052+0000 7fde9add8640 1 -- 172.21.15.63:0/3252290777 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fde94063b50 con 0x7fde94108cf0 2024-09-21T06:27:07.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.053+0000 7fde91ffb640 1 -- 172.21.15.63:0/3252290777 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fde8c004580 con 0x7fde94108cf0 2024-09-21T06:27:07.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.054+0000 7fde91ffb640 1 --2- 172.21.15.63:0/3252290777 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fde840b66a0 0x7fde840b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:07.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.054+0000 7fde98b74640 1 --2- 172.21.15.63:0/3252290777 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fde840b66a0 0x7fde840b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:07.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.054+0000 7fde91ffb640 1 -- 172.21.15.63:0/3252290777 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fde8c108ad0 con 0x7fde94108cf0 2024-09-21T06:27:07.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.054+0000 7fde91ffb640 1 --2- 172.21.15.63:0/3252290777 >> [v2:172.21.15.175:6816/2058692148,v1:172.21.15.175:6817/2058692148] conn(0x7fde840c0490 0x7fde840c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:07.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.054+0000 7fde91ffb640 1 -- 172.21.15.63:0/3252290777 --> [v2:172.21.15.175:6816/2058692148,v1:172.21.15.175:6817/2058692148] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde840c3050 con 0x7fde840c0490 2024-09-21T06:27:07.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.054+0000 7fde91ffb640 1 -- 172.21.15.63:0/3252290777 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fde8c108f20 con 0x7fde94108cf0 2024-09-21T06:27:07.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.055+0000 7fde93fff640 1 --2- 172.21.15.63:0/3252290777 >> [v2:172.21.15.175:6816/2058692148,v1:172.21.15.175:6817/2058692148] conn(0x7fde840c0490 0x7fde840c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:07.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.055+0000 7fde98b74640 1 --2- 172.21.15.63:0/3252290777 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fde840b66a0 0x7fde840b8bb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fde8800abe0 tx=0x7fde8800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:07.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.055+0000 7fde93fff640 1 --2- 172.21.15.63:0/3252290777 >> [v2:172.21.15.175:6816/2058692148,v1:172.21.15.175:6817/2058692148] conn(0x7fde840c0490 0x7fde840c2980 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:07.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.056+0000 7fde91ffb640 1 -- 172.21.15.63:0/3252290777 <== osd.8 v2:172.21.15.175:6816/2058692148 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fde840c3050 con 0x7fde840c0490 2024-09-21T06:27:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.074+0000 7fde9add8640 1 -- 172.21.15.63:0/3252290777 --> [v2:172.21.15.175:6816/2058692148,v1:172.21.15.175:6817/2058692148] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fde94063f50 con 0x7fde840c0490 2024-09-21T06:27:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.074+0000 7fde91ffb640 1 -- 172.21.15.63:0/3252290777 <== osd.8 v2:172.21.15.175:6816/2058692148 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fde94063f50 con 0x7fde840c0490 2024-09-21T06:27:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.075+0000 7fde9add8640 1 -- 172.21.15.63:0/3252290777 >> [v2:172.21.15.175:6816/2058692148,v1:172.21.15.175:6817/2058692148] conn(0x7fde840c0490 msgr2=0x7fde840c2980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.075+0000 7fde9add8640 1 --2- 172.21.15.63:0/3252290777 >> [v2:172.21.15.175:6816/2058692148,v1:172.21.15.175:6817/2058692148] conn(0x7fde840c0490 0x7fde840c2980 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.075+0000 7fde9add8640 1 -- 172.21.15.63:0/3252290777 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fde840b66a0 msgr2=0x7fde840b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.075+0000 7fde9add8640 1 --2- 172.21.15.63:0/3252290777 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fde840b66a0 0x7fde840b8bb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fde8800abe0 tx=0x7fde8800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:27:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.075+0000 7fde9add8640 1 -- 172.21.15.63:0/3252290777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde94108cf0 msgr2=0x7fde9419fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.075+0000 7fde9add8640 1 --2- 172.21.15.63:0/3252290777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde94108cf0 0x7fde9419fc90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fde8c005cc0 tx=0x7fde8c02f380 comp rx=0 tx=0).stop 2024-09-21T06:27:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.075+0000 7fde99375640 1 -- 172.21.15.63:0/3252290777 reap_dead start 2024-09-21T06:27:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.075+0000 7fde9add8640 1 -- 172.21.15.63:0/3252290777 shutdown_connections 2024-09-21T06:27:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.075+0000 7fde9add8640 1 -- 172.21.15.63:0/3252290777 >> 172.21.15.63:0/3252290777 conn(0x7fde94079730 msgr2=0x7fde94104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.075+0000 7fde9add8640 1 -- 172.21.15.63:0/3252290777 shutdown_connections 2024-09-21T06:27:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:07.075+0000 7fde9add8640 1 -- 172.21.15.63:0/3252290777 wait complete. 2024-09-21T06:27:07.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:07 smithi063 ceph-mon[31150]: pgmap v289: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T06:27:07.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:07 smithi175 ceph-mon[34510]: pgmap v289: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T06:27:07.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:07 smithi071 ceph-mon[34844]: pgmap v289: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T06:27:08.072 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:08.501 INFO:teuthology.orchestra.run.smithi063.stdout:249108103200 2024-09-21T06:27:08.501 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T06:27:08.921 INFO:teuthology.orchestra.run.smithi063.stdout:107374182461 2024-09-21T06:27:08.921 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T06:27:08.944 INFO:teuthology.orchestra.run.smithi063.stdout:270582939675 2024-09-21T06:27:08.945 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T06:27:09.232 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:09 smithi063 ceph-mon[31150]: pgmap v290: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:27:09.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:09 smithi175 ceph-mon[34510]: pgmap v290: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:27:09.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:09 smithi071 ceph-mon[34844]: pgmap v290: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:27:09.594 INFO:teuthology.orchestra.run.smithi063.stdout:60129542218 2024-09-21T06:27:09.594 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T06:27:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:10.235 INFO:teuthology.orchestra.run.smithi063.stdout:128849018938 2024-09-21T06:27:10.235 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T06:27:10.931 INFO:teuthology.orchestra.run.smithi063.stdout:223338299430 2024-09-21T06:27:10.933 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T06:27:11.165 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:11 smithi063 ceph-mon[31150]: pgmap v291: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T06:27:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.163+0000 7fadcaea6640 1 -- 172.21.15.63:0/675704903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadc4108cf0 msgr2=0x7fadc410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.163+0000 7fadcaea6640 1 --2- 172.21.15.63:0/675704903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadc4108cf0 0x7fadc410f520 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fadbc009ca0 tx=0x7fadbc02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.163+0000 7fadcaea6640 1 -- 172.21.15.63:0/675704903 shutdown_connections 2024-09-21T06:27:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.163+0000 7fadcaea6640 1 --2- 172.21.15.63:0/675704903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadc4108cf0 0x7fadc410f520 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.163+0000 7fadcaea6640 1 --2- 172.21.15.63:0/675704903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadc41083a0 0x7fadc41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.163+0000 7fadcaea6640 1 --2- 172.21.15.63:0/675704903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc4102a60 0x7fadc4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.163+0000 7fadcaea6640 1 -- 172.21.15.63:0/675704903 >> 172.21.15.63:0/675704903 conn(0x7fadc4079730 msgr2=0x7fadc4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.164+0000 7fadcaea6640 1 -- 172.21.15.63:0/675704903 shutdown_connections 2024-09-21T06:27:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.164+0000 7fadcaea6640 1 -- 172.21.15.63:0/675704903 wait complete. 2024-09-21T06:27:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.164+0000 7fadcaea6640 1 Processor -- start 2024-09-21T06:27:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.164+0000 7fadcaea6640 1 -- start start 2024-09-21T06:27:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.165+0000 7fadcaea6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc4102a60 0x7fadc419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.165+0000 7fadcaea6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadc41083a0 0x7fadc419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.165+0000 7fadcaea6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadc4108cf0 0x7fadc419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.165+0000 7fadcaea6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fadc4112960 con 0x7fadc41083a0 2024-09-21T06:27:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.165+0000 7fadcaea6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fadc41127e0 con 0x7fadc4108cf0 2024-09-21T06:27:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.165+0000 7fadcaea6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fadc4112ae0 con 0x7fadc4102a60 2024-09-21T06:27:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.165+0000 7fadc3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadc41083a0 0x7fadc419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.165+0000 7fadc3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadc41083a0 0x7fadc419a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54274/0 (socket says 172.21.15.63:54274) 2024-09-21T06:27:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.165+0000 7fadc3fff640 1 -- 172.21.15.63:0/251705458 learned_addr learned my addr 172.21.15.63:0/251705458 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.165+0000 7fadc9443640 1 --2- 172.21.15.63:0/251705458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadc4108cf0 0x7fadc419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.165+0000 7fadc8c42640 1 --2- 172.21.15.63:0/251705458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc4102a60 0x7fadc419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.165+0000 7fadc3fff640 1 -- 172.21.15.63:0/251705458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc4102a60 msgr2=0x7fadc419a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.165+0000 7fadc3fff640 1 --2- 172.21.15.63:0/251705458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc4102a60 0x7fadc419a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.165+0000 7fadc3fff640 1 -- 172.21.15.63:0/251705458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadc4108cf0 msgr2=0x7fadc419fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.165+0000 7fadc3fff640 1 --2- 172.21.15.63:0/251705458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadc4108cf0 0x7fadc419fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.165+0000 7fadc3fff640 1 -- 172.21.15.63:0/251705458 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc41a0250 con 0x7fadc41083a0 2024-09-21T06:27:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.165+0000 7fadc8c42640 1 --2- 172.21.15.63:0/251705458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc4102a60 0x7fadc419a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.165+0000 7fadc9443640 1 --2- 172.21.15.63:0/251705458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadc4108cf0 0x7fadc419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.165+0000 7fadc3fff640 1 --2- 172.21.15.63:0/251705458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadc41083a0 0x7fadc419a940 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fadb400c970 tx=0x7fadb400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.166+0000 7fadc1ffb640 1 -- 172.21.15.63:0/251705458 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb4014070 con 0x7fadc41083a0 2024-09-21T06:27:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.166+0000 7fadc1ffb640 1 -- 172.21.15.63:0/251705458 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadb4004440 con 0x7fadc41083a0 2024-09-21T06:27:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.166+0000 7fadcaea6640 1 -- 172.21.15.63:0/251705458 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc41a0540 con 0x7fadc41083a0 2024-09-21T06:27:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.166+0000 7fadc1ffb640 1 -- 172.21.15.63:0/251705458 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb4003e50 con 0x7fadc41083a0 2024-09-21T06:27:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.166+0000 7fadcaea6640 1 -- 172.21.15.63:0/251705458 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc41a6d60 con 0x7fadc41083a0 2024-09-21T06:27:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.167+0000 7fadcaea6640 1 -- 172.21.15.63:0/251705458 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc4102e70 con 0x7fadc41083a0 2024-09-21T06:27:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.168+0000 7fadc1ffb640 1 -- 172.21.15.63:0/251705458 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fadb4017070 con 0x7fadc41083a0 2024-09-21T06:27:11.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.169+0000 7fadc1ffb640 1 --2- 172.21.15.63:0/251705458 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fadb00b67c0 0x7fadb00b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:11.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.169+0000 7fadc8c42640 1 --2- 172.21.15.63:0/251705458 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fadb00b67c0 0x7fadb00b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:11.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.169+0000 7fadc1ffb640 1 -- 172.21.15.63:0/251705458 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fadb40e7980 con 0x7fadc41083a0 2024-09-21T06:27:11.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.170+0000 7fadc8c42640 1 --2- 172.21.15.63:0/251705458 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fadb00b67c0 0x7fadb00b8cd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fadac0058c0 tx=0x7fadac005ec0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:11.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.172+0000 7fadc1ffb640 1 -- 172.21.15.63:0/251705458 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fadb401e030 con 0x7fadc41083a0 2024-09-21T06:27:11.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:11 smithi175 ceph-mon[34510]: pgmap v291: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T06:27:11.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.366+0000 7fadcaea6640 1 -- 172.21.15.63:0/251705458 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fadc419b4d0 con 0x7fadc41083a0 2024-09-21T06:27:11.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.367+0000 7fadc1ffb640 1 -- 172.21.15.63:0/251705458 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fadc419b4d0 con 0x7fadc41083a0 2024-09-21T06:27:11.369 INFO:teuthology.orchestra.run.smithi063.stdout:150323855415 2024-09-21T06:27:11.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.369+0000 7fadcaea6640 1 -- 172.21.15.63:0/251705458 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fadb00b67c0 msgr2=0x7fadb00b8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:11.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.369+0000 7fadcaea6640 1 --2- 172.21.15.63:0/251705458 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fadb00b67c0 0x7fadb00b8cd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fadac0058c0 tx=0x7fadac005ec0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.369+0000 7fadcaea6640 1 -- 172.21.15.63:0/251705458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadc41083a0 msgr2=0x7fadc419a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:11.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.369+0000 7fadcaea6640 1 --2- 172.21.15.63:0/251705458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadc41083a0 0x7fadc419a940 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fadb400c970 tx=0x7fadb400ce30 comp rx=0 tx=0).stop 2024-09-21T06:27:11.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.369+0000 7fadcaea6640 1 -- 172.21.15.63:0/251705458 shutdown_connections 2024-09-21T06:27:11.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.369+0000 7fadcaea6640 1 --2- 172.21.15.63:0/251705458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadc4108cf0 0x7fadc419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.369+0000 7fadcaea6640 1 --2- 172.21.15.63:0/251705458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadc41083a0 0x7fadc419a940 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.369+0000 7fadcaea6640 1 --2- 172.21.15.63:0/251705458 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fadb00b67c0 0x7fadb00b8cd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.369+0000 7fadcaea6640 1 --2- 172.21.15.63:0/251705458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc4102a60 0x7fadc419a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.369+0000 7fadcaea6640 1 -- 172.21.15.63:0/251705458 >> 172.21.15.63:0/251705458 conn(0x7fadc4079730 msgr2=0x7fadc406b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:11.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.369+0000 7fadcaea6640 1 -- 172.21.15.63:0/251705458 shutdown_connections 2024-09-21T06:27:11.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.369+0000 7fadcaea6640 1 -- 172.21.15.63:0/251705458 wait complete. 2024-09-21T06:27:11.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.397+0000 7fb5444e3640 1 -- 172.21.15.63:0/873657266 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c1083d0 msgr2=0x7fb53c1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:11.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.397+0000 7fb5444e3640 1 --2- 172.21.15.63:0/873657266 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c1083d0 0x7fb53c1087e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009900 tx=0x7fb52c02a410 comp rx=0 tx=0).stop 2024-09-21T06:27:11.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.398+0000 7fb5444e3640 1 -- 172.21.15.63:0/873657266 shutdown_connections 2024-09-21T06:27:11.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.398+0000 7fb5444e3640 1 --2- 172.21.15.63:0/873657266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb53c108d20 0x7fb53c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.398+0000 7fb5444e3640 1 --2- 172.21.15.63:0/873657266 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c1083d0 0x7fb53c1087e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.398+0000 7fb5444e3640 1 --2- 172.21.15.63:0/873657266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb53c102ae0 0x7fb53c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.398+0000 7fb5444e3640 1 -- 172.21.15.63:0/873657266 >> 172.21.15.63:0/873657266 conn(0x7fb53c0797b0 msgr2=0x7fb53c079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:11.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.398+0000 7fb5444e3640 1 -- 172.21.15.63:0/873657266 shutdown_connections 2024-09-21T06:27:11.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.398+0000 7fb5444e3640 1 -- 172.21.15.63:0/873657266 wait complete. 2024-09-21T06:27:11.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.399+0000 7fb5444e3640 1 Processor -- start 2024-09-21T06:27:11.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.399+0000 7fb5444e3640 1 -- start start 2024-09-21T06:27:11.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.399+0000 7fb5444e3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb53c102ae0 0x7fb53c19b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:11.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.399+0000 7fb5444e3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb53c1083d0 0x7fb53c19b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:11.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.399+0000 7fb5444e3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c108d20 0x7fb53c19bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:11.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.399+0000 7fb5444e3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c1129e0 con 0x7fb53c108d20 2024-09-21T06:27:11.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.399+0000 7fb5444e3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c112860 con 0x7fb53c102ae0 2024-09-21T06:27:11.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.399+0000 7fb5444e3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c112b60 con 0x7fb53c1083d0 2024-09-21T06:27:11.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.399+0000 7fb542a80640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c108d20 0x7fb53c19bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:11.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.399+0000 7fb542a80640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c108d20 0x7fb53c19bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54292/0 (socket says 172.21.15.63:54292) 2024-09-21T06:27:11.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.400+0000 7fb541a7e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb53c1083d0 0x7fb53c19b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:11.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.400+0000 7fb542a80640 1 -- 172.21.15.63:0/4265663181 learned_addr learned my addr 172.21.15.63:0/4265663181 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:11.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.400+0000 7fb54227f640 1 --2- 172.21.15.63:0/4265663181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb53c102ae0 0x7fb53c19b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:11.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.400+0000 7fb542a80640 1 -- 172.21.15.63:0/4265663181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb53c1083d0 msgr2=0x7fb53c19b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:11.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.400+0000 7fb542a80640 1 --2- 172.21.15.63:0/4265663181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb53c1083d0 0x7fb53c19b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.400+0000 7fb542a80640 1 -- 172.21.15.63:0/4265663181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb53c102ae0 msgr2=0x7fb53c19b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:11.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.400+0000 7fb542a80640 1 --2- 172.21.15.63:0/4265663181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb53c102ae0 0x7fb53c19b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.400+0000 7fb542a80640 1 -- 172.21.15.63:0/4265663181 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb53c1a65d0 con 0x7fb53c108d20 2024-09-21T06:27:11.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.400+0000 7fb541a7e640 1 --2- 172.21.15.63:0/4265663181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb53c1083d0 0x7fb53c19b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:27:11.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.400+0000 7fb54227f640 1 --2- 172.21.15.63:0/4265663181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb53c102ae0 0x7fb53c19b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:27:11.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.400+0000 7fb542a80640 1 --2- 172.21.15.63:0/4265663181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c108d20 0x7fb53c19bd90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb53400eb10 tx=0x7fb53400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:11.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.400+0000 7fb5337fe640 1 -- 172.21.15.63:0/4265663181 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb534004b20 con 0x7fb53c108d20 2024-09-21T06:27:11.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.400+0000 7fb5337fe640 1 -- 172.21.15.63:0/4265663181 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb534004cc0 con 0x7fb53c108d20 2024-09-21T06:27:11.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.400+0000 7fb5444e3640 1 -- 172.21.15.63:0/4265663181 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb53c1a68c0 con 0x7fb53c108d20 2024-09-21T06:27:11.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.400+0000 7fb5337fe640 1 -- 172.21.15.63:0/4265663181 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb534010670 con 0x7fb53c108d20 2024-09-21T06:27:11.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.401+0000 7fb5444e3640 1 -- 172.21.15.63:0/4265663181 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb53c1a6dd0 con 0x7fb53c108d20 2024-09-21T06:27:11.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.402+0000 7fb5444e3640 1 -- 172.21.15.63:0/4265663181 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb53c102ef0 con 0x7fb53c108d20 2024-09-21T06:27:11.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.404+0000 7fb5337fe640 1 -- 172.21.15.63:0/4265663181 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fb534005000 con 0x7fb53c108d20 2024-09-21T06:27:11.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.405+0000 7fb5337fe640 1 --2- 172.21.15.63:0/4265663181 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb5280b6670 0x7fb5280b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:11.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.405+0000 7fb54227f640 1 --2- 172.21.15.63:0/4265663181 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb5280b6670 0x7fb5280b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:11.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.406+0000 7fb5337fe640 1 -- 172.21.15.63:0/4265663181 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fb5340e7cb0 con 0x7fb53c108d20 2024-09-21T06:27:11.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.406+0000 7fb54227f640 1 --2- 172.21.15.63:0/4265663181 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb5280b6670 0x7fb5280b8b80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb53c06c3a0 tx=0x7fb538005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:11.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.408+0000 7fb5337fe640 1 -- 172.21.15.63:0/4265663181 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb534056710 con 0x7fb53c108d20 2024-09-21T06:27:11.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:11 smithi071 ceph-mon[34844]: pgmap v291: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T06:27:11.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.603+0000 7fb5444e3640 1 -- 172.21.15.63:0/4265663181 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb53c06bc50 con 0x7fb53c108d20 2024-09-21T06:27:11.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.604+0000 7fb5337fe640 1 -- 172.21.15.63:0/4265663181 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb5340ae300 con 0x7fb53c108d20 2024-09-21T06:27:11.606 INFO:teuthology.orchestra.run.smithi063.stdout:38654705743 2024-09-21T06:27:11.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.606+0000 7fb5444e3640 1 -- 172.21.15.63:0/4265663181 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb5280b6670 msgr2=0x7fb5280b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:11.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.606+0000 7fb5444e3640 1 --2- 172.21.15.63:0/4265663181 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb5280b6670 0x7fb5280b8b80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb53c06c3a0 tx=0x7fb538005f90 comp rx=0 tx=0).stop 2024-09-21T06:27:11.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.606+0000 7fb5444e3640 1 -- 172.21.15.63:0/4265663181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c108d20 msgr2=0x7fb53c19bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:11.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.606+0000 7fb5444e3640 1 --2- 172.21.15.63:0/4265663181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c108d20 0x7fb53c19bd90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb53400eb10 tx=0x7fb53400c2d0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.606+0000 7fb5444e3640 1 -- 172.21.15.63:0/4265663181 shutdown_connections 2024-09-21T06:27:11.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.606+0000 7fb5444e3640 1 --2- 172.21.15.63:0/4265663181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c108d20 0x7fb53c19bd90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.606+0000 7fb5444e3640 1 --2- 172.21.15.63:0/4265663181 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb5280b6670 0x7fb5280b8b80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.606+0000 7fb5444e3640 1 --2- 172.21.15.63:0/4265663181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb53c1083d0 0x7fb53c19b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.606+0000 7fb5444e3640 1 --2- 172.21.15.63:0/4265663181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb53c102ae0 0x7fb53c19b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:11.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.606+0000 7fb5444e3640 1 -- 172.21.15.63:0/4265663181 >> 172.21.15.63:0/4265663181 conn(0x7fb53c0797b0 msgr2=0x7fb53c106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:11.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.606+0000 7fb5444e3640 1 -- 172.21.15.63:0/4265663181 shutdown_connections 2024-09-21T06:27:11.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:11.606+0000 7fb5444e3640 1 -- 172.21.15.63:0/4265663181 wait complete. 2024-09-21T06:27:12.010 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855412 got 150323855415 for osd.5 2024-09-21T06:27:12.010 DEBUG:teuthology.parallel:result is None 2024-09-21T06:27:12.312 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:12 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/251705458' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T06:27:12.312 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:12 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/4265663181' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T06:27:12.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:12 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/251705458' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T06:27:12.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:12 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/4265663181' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T06:27:12.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:12 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/251705458' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T06:27:12.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:12 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/4265663181' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T06:27:12.594 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:12.594 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:12.594 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:12.600 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:12.602 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:12.662 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705741 got 38654705743 for osd.0 2024-09-21T06:27:12.663 DEBUG:teuthology.parallel:result is None 2024-09-21T06:27:13.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.100+0000 7fe1d5ce0640 1 -- 172.21.15.63:0/2628618223 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1d01094a0 msgr2=0x7fe1d01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:13.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.100+0000 7fe1d5ce0640 1 --2- 172.21.15.63:0/2628618223 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1d01094a0 0x7fe1d01098b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8009900 tx=0x7fe1b802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:27:13.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.100+0000 7fe1d5ce0640 1 -- 172.21.15.63:0/2628618223 shutdown_connections 2024-09-21T06:27:13.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.100+0000 7fe1d5ce0640 1 --2- 172.21.15.63:0/2628618223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1d0109df0 0x7fe1d0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:13.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.100+0000 7fe1d5ce0640 1 --2- 172.21.15.63:0/2628618223 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1d01094a0 0x7fe1d01098b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:13.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.100+0000 7fe1d5ce0640 1 --2- 172.21.15.63:0/2628618223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1d0103b60 0x7fe1d0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:13.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.100+0000 7fe1d5ce0640 1 -- 172.21.15.63:0/2628618223 >> 172.21.15.63:0/2628618223 conn(0x7fe1d007b850 msgr2=0x7fe1d007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:13.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.100+0000 7fe1d5ce0640 1 -- 172.21.15.63:0/2628618223 shutdown_connections 2024-09-21T06:27:13.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.100+0000 7fe1d5ce0640 1 -- 172.21.15.63:0/2628618223 wait complete. 2024-09-21T06:27:13.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.101+0000 7fe1d5ce0640 1 Processor -- start 2024-09-21T06:27:13.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.101+0000 7fe1d5ce0640 1 -- start start 2024-09-21T06:27:13.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.101+0000 7fe1d5ce0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1d0103b60 0x7fe1d019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:13.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.101+0000 7fe1d5ce0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1d01094a0 0x7fe1d019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:13.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.101+0000 7fe1d5ce0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1d0109df0 0x7fe1d019fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:13.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.101+0000 7fe1d5ce0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d0113ab0 con 0x7fe1d0109df0 2024-09-21T06:27:13.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.101+0000 7fe1d5ce0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d0113930 con 0x7fe1d0103b60 2024-09-21T06:27:13.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.101+0000 7fe1d5ce0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d0113c30 con 0x7fe1d01094a0 2024-09-21T06:27:13.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.101+0000 7fe1cffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1d0109df0 0x7fe1d019fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:13.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.101+0000 7fe1cffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1d0109df0 0x7fe1d019fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54316/0 (socket says 172.21.15.63:54316) 2024-09-21T06:27:13.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.101+0000 7fe1cffff640 1 -- 172.21.15.63:0/1043222930 learned_addr learned my addr 172.21.15.63:0/1043222930 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:13.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.101+0000 7fe1c7fff640 1 --2- 172.21.15.63:0/1043222930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1d01094a0 0x7fe1d019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:13.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.102+0000 7fe1cf7fe640 1 --2- 172.21.15.63:0/1043222930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1d0103b60 0x7fe1d019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:13.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.102+0000 7fe1cffff640 1 -- 172.21.15.63:0/1043222930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1d01094a0 msgr2=0x7fe1d019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:13.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.102+0000 7fe1cffff640 1 --2- 172.21.15.63:0/1043222930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1d01094a0 0x7fe1d019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:13.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.102+0000 7fe1cffff640 1 -- 172.21.15.63:0/1043222930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1d0103b60 msgr2=0x7fe1d019a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:13.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.102+0000 7fe1cffff640 1 --2- 172.21.15.63:0/1043222930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1d0103b60 0x7fe1d019a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:13.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.102+0000 7fe1cffff640 1 -- 172.21.15.63:0/1043222930 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d01a0450 con 0x7fe1d0109df0 2024-09-21T06:27:13.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.102+0000 7fe1cf7fe640 1 --2- 172.21.15.63:0/1043222930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1d0103b60 0x7fe1d019a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:13.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.102+0000 7fe1cffff640 1 --2- 172.21.15.63:0/1043222930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1d0109df0 0x7fe1d019fde0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800cce0 tx=0x7fe1c800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:13.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.102+0000 7fe1cd7fa640 1 -- 172.21.15.63:0/1043222930 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c800f450 con 0x7fe1d0109df0 2024-09-21T06:27:13.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.102+0000 7fe1cd7fa640 1 -- 172.21.15.63:0/1043222930 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1c800faa0 con 0x7fe1d0109df0 2024-09-21T06:27:13.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.102+0000 7fe1d5ce0640 1 -- 172.21.15.63:0/1043222930 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d01a0740 con 0x7fe1d0109df0 2024-09-21T06:27:13.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.102+0000 7fe1cd7fa640 1 -- 172.21.15.63:0/1043222930 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8018b70 con 0x7fe1d0109df0 2024-09-21T06:27:13.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.102+0000 7fe1d5ce0640 1 -- 172.21.15.63:0/1043222930 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d01a6f60 con 0x7fe1d0109df0 2024-09-21T06:27:13.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.103+0000 7fe1d5ce0640 1 -- 172.21.15.63:0/1043222930 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d0103f70 con 0x7fe1d0109df0 2024-09-21T06:27:13.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.106+0000 7fe1cd7fa640 1 -- 172.21.15.63:0/1043222930 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fe1c8018d10 con 0x7fe1d0109df0 2024-09-21T06:27:13.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.106+0000 7fe1cd7fa640 1 --2- 172.21.15.63:0/1043222930 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe1bc0b66a0 0x7fe1bc0b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:13.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.107+0000 7fe1cf7fe640 1 --2- 172.21.15.63:0/1043222930 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe1bc0b66a0 0x7fe1bc0b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:13.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.107+0000 7fe1cd7fa640 1 -- 172.21.15.63:0/1043222930 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fe1c80e7aa0 con 0x7fe1d0109df0 2024-09-21T06:27:13.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.107+0000 7fe1cf7fe640 1 --2- 172.21.15.63:0/1043222930 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe1bc0b66a0 0x7fe1bc0b8bb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00058c0 tx=0x7fe1c0005d30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:13.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.109+0000 7fe1cd7fa640 1 -- 172.21.15.63:0/1043222930 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe1c8014030 con 0x7fe1d0109df0 2024-09-21T06:27:13.217 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:13 smithi063 ceph-mon[31150]: pgmap v292: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:27:13.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.302+0000 7fe1d5ce0640 1 -- 172.21.15.63:0/1043222930 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe1d019b6d0 con 0x7fe1d0109df0 2024-09-21T06:27:13.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.303+0000 7fe1cd7fa640 1 -- 172.21.15.63:0/1043222930 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe1d019b6d0 con 0x7fe1d0109df0 2024-09-21T06:27:13.305 INFO:teuthology.orchestra.run.smithi063.stdout:107374182464 2024-09-21T06:27:13.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.305+0000 7fe1d5ce0640 1 -- 172.21.15.63:0/1043222930 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe1bc0b66a0 msgr2=0x7fe1bc0b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:13.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.305+0000 7fe1d5ce0640 1 --2- 172.21.15.63:0/1043222930 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe1bc0b66a0 0x7fe1bc0b8bb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00058c0 tx=0x7fe1c0005d30 comp rx=0 tx=0).stop 2024-09-21T06:27:13.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.305+0000 7fe1d5ce0640 1 -- 172.21.15.63:0/1043222930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1d0109df0 msgr2=0x7fe1d019fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:13.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.305+0000 7fe1d5ce0640 1 --2- 172.21.15.63:0/1043222930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1d0109df0 0x7fe1d019fde0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800cce0 tx=0x7fe1c800a620 comp rx=0 tx=0).stop 2024-09-21T06:27:13.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.305+0000 7fe1d5ce0640 1 -- 172.21.15.63:0/1043222930 shutdown_connections 2024-09-21T06:27:13.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.305+0000 7fe1d5ce0640 1 --2- 172.21.15.63:0/1043222930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1d0109df0 0x7fe1d019fde0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:13.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.305+0000 7fe1d5ce0640 1 --2- 172.21.15.63:0/1043222930 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe1bc0b66a0 0x7fe1bc0b8bb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:13.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.305+0000 7fe1d5ce0640 1 --2- 172.21.15.63:0/1043222930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1d01094a0 0x7fe1d019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:13.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.305+0000 7fe1d5ce0640 1 --2- 172.21.15.63:0/1043222930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1d0103b60 0x7fe1d019a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:13.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.305+0000 7fe1d5ce0640 1 -- 172.21.15.63:0/1043222930 >> 172.21.15.63:0/1043222930 conn(0x7fe1d007b850 msgr2=0x7fe1d0105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:13.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.305+0000 7fe1d5ce0640 1 -- 172.21.15.63:0/1043222930 shutdown_connections 2024-09-21T06:27:13.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:13.305+0000 7fe1d5ce0640 1 -- 172.21.15.63:0/1043222930 wait complete. 2024-09-21T06:27:13.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:13 smithi175 ceph-mon[34510]: pgmap v292: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:27:13.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:13 smithi071 ceph-mon[34844]: pgmap v292: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:27:14.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.159+0000 7ff766abe640 1 -- 172.21.15.63:0/4010779880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7601083a0 msgr2=0x7ff7601087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:14.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.159+0000 7ff766abe640 1 --2- 172.21.15.63:0/4010779880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7601083a0 0x7ff7601087b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff74c009900 tx=0x7ff74c02a3f0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.159+0000 7ff766abe640 1 -- 172.21.15.63:0/4010779880 shutdown_connections 2024-09-21T06:27:14.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.159+0000 7ff766abe640 1 --2- 172.21.15.63:0/4010779880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff760108cf0 0x7ff76010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.159+0000 7ff766abe640 1 --2- 172.21.15.63:0/4010779880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7601083a0 0x7ff7601087b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.159+0000 7ff766abe640 1 --2- 172.21.15.63:0/4010779880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff760102a60 0x7ff760102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.159+0000 7ff766abe640 1 -- 172.21.15.63:0/4010779880 >> 172.21.15.63:0/4010779880 conn(0x7ff760079730 msgr2=0x7ff760079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:14.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.159+0000 7ff766abe640 1 -- 172.21.15.63:0/4010779880 shutdown_connections 2024-09-21T06:27:14.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.159+0000 7ff766abe640 1 -- 172.21.15.63:0/4010779880 wait complete. 2024-09-21T06:27:14.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.160+0000 7ff766abe640 1 Processor -- start 2024-09-21T06:27:14.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.160+0000 7ff766abe640 1 -- start start 2024-09-21T06:27:14.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.160+0000 7ff766abe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff760102a60 0x7ff760199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:14.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.160+0000 7ff766abe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7601083a0 0x7ff7601998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:14.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.160+0000 7ff766abe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff760108cf0 0x7ff76019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:14.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.160+0000 7ff766abe640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff760112960 con 0x7ff760108cf0 2024-09-21T06:27:14.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.160+0000 7ff766abe640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7601127e0 con 0x7ff7601083a0 2024-09-21T06:27:14.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.160+0000 7ff766abe640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff760112ae0 con 0x7ff760102a60 2024-09-21T06:27:14.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.161+0000 7ff76505b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff760108cf0 0x7ff76019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:14.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.161+0000 7ff76505b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff760108cf0 0x7ff76019eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54346/0 (socket says 172.21.15.63:54346) 2024-09-21T06:27:14.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.161+0000 7ff76505b640 1 -- 172.21.15.63:0/2462469835 learned_addr learned my addr 172.21.15.63:0/2462469835 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:14.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.161+0000 7ff76485a640 1 --2- 172.21.15.63:0/2462469835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff760102a60 0x7ff760199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:14.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.161+0000 7ff75ffff640 1 --2- 172.21.15.63:0/2462469835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7601083a0 0x7ff7601998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:14.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.161+0000 7ff76505b640 1 -- 172.21.15.63:0/2462469835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff760102a60 msgr2=0x7ff760199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:14.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.161+0000 7ff76505b640 1 --2- 172.21.15.63:0/2462469835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff760102a60 0x7ff760199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.161+0000 7ff76505b640 1 -- 172.21.15.63:0/2462469835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7601083a0 msgr2=0x7ff7601998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:14.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.161+0000 7ff76505b640 1 --2- 172.21.15.63:0/2462469835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7601083a0 0x7ff7601998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.161+0000 7ff76505b640 1 -- 172.21.15.63:0/2462469835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76019f200 con 0x7ff760108cf0 2024-09-21T06:27:14.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.161+0000 7ff76505b640 1 --2- 172.21.15.63:0/2462469835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff760108cf0 0x7ff76019eb90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff75800ebb0 tx=0x7ff758009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:14.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.161+0000 7ff75dffb640 1 -- 172.21.15.63:0/2462469835 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75800e2e0 con 0x7ff760108cf0 2024-09-21T06:27:14.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.161+0000 7ff75dffb640 1 -- 172.21.15.63:0/2462469835 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff758007950 con 0x7ff760108cf0 2024-09-21T06:27:14.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.161+0000 7ff766abe640 1 -- 172.21.15.63:0/2462469835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76019f490 con 0x7ff760108cf0 2024-09-21T06:27:14.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.161+0000 7ff75dffb640 1 -- 172.21.15.63:0/2462469835 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7580056f0 con 0x7ff760108cf0 2024-09-21T06:27:14.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.162+0000 7ff766abe640 1 -- 172.21.15.63:0/2462469835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff76019f950 con 0x7ff760108cf0 2024-09-21T06:27:14.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.163+0000 7ff766abe640 1 -- 172.21.15.63:0/2462469835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff760102e70 con 0x7ff760108cf0 2024-09-21T06:27:14.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.164+0000 7ff75dffb640 1 -- 172.21.15.63:0/2462469835 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7ff758005890 con 0x7ff760108cf0 2024-09-21T06:27:14.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.165+0000 7ff75dffb640 1 --2- 172.21.15.63:0/2462469835 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7500b6620 0x7ff7500b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:14.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.166+0000 7ff76485a640 1 --2- 172.21.15.63:0/2462469835 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7500b6620 0x7ff7500b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:14.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.166+0000 7ff75dffb640 1 -- 172.21.15.63:0/2462469835 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ff7580e8fc0 con 0x7ff760108cf0 2024-09-21T06:27:14.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.166+0000 7ff76485a640 1 --2- 172.21.15.63:0/2462469835 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7500b6620 0x7ff7500b8b30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff75400abe0 tx=0x7ff75400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:14.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.169+0000 7ff75dffb640 1 -- 172.21.15.63:0/2462469835 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff7580af610 con 0x7ff760108cf0 2024-09-21T06:27:14.188 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:14.192 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:14.194 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:14.280 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:14 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1043222930' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T06:27:14.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.057+0000 7f1646e57640 1 -- 172.21.15.63:0/2732002197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1640103b90 msgr2=0x7f1640103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:14.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.057+0000 7f1646e57640 1 --2- 172.21.15.63:0/2732002197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1640103b90 0x7f1640103fa0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1630009ca0 tx=0x7f163002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.057+0000 7f1646e57640 1 -- 172.21.15.63:0/2732002197 shutdown_connections 2024-09-21T06:27:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.057+0000 7f1646e57640 1 --2- 172.21.15.63:0/2732002197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1640109e20 0x7f1640110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.057+0000 7f1646e57640 1 --2- 172.21.15.63:0/2732002197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16401094d0 0x7f16401098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.057+0000 7f1646e57640 1 --2- 172.21.15.63:0/2732002197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1640103b90 0x7f1640103fa0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.057+0000 7f1646e57640 1 -- 172.21.15.63:0/2732002197 >> 172.21.15.63:0/2732002197 conn(0x7f16400ff600 msgr2=0x7f1640101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.057+0000 7f1646e57640 1 -- 172.21.15.63:0/2732002197 shutdown_connections 2024-09-21T06:27:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.057+0000 7f1646e57640 1 -- 172.21.15.63:0/2732002197 wait complete. 2024-09-21T06:27:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.058+0000 7f1646e57640 1 Processor -- start 2024-09-21T06:27:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.058+0000 7f1646e57640 1 -- start start 2024-09-21T06:27:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.058+0000 7f1646e57640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1640103b90 0x7f164019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.058+0000 7f1646e57640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16401094d0 0x7f164019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.058+0000 7f1646e57640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1640109e20 0x7f164019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.058+0000 7f1646e57640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1640113ae0 con 0x7f1640103b90 2024-09-21T06:27:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.058+0000 7f1646e57640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1640113960 con 0x7f16401094d0 2024-09-21T06:27:14.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.058+0000 7f1646e57640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1640113c60 con 0x7f1640109e20 2024-09-21T06:27:14.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.058+0000 7f1644bf3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1640103b90 0x7f164019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:14.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.058+0000 7f1644bf3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1640103b90 0x7f164019a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54330/0 (socket says 172.21.15.63:54330) 2024-09-21T06:27:14.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.058+0000 7f1644bf3640 1 -- 172.21.15.63:0/4227531928 learned_addr learned my addr 172.21.15.63:0/4227531928 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:14.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.058+0000 7f163ffff640 1 --2- 172.21.15.63:0/4227531928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16401094d0 0x7f164019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:14.286 INFO:teuthology.orchestra.run.smithi063.stdout:81604378695 2024-09-21T06:27:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.058+0000 7f16453f4640 1 --2- 172.21.15.63:0/4227531928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1640109e20 0x7f164019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.058+0000 7f1644bf3640 1 -- 172.21.15.63:0/4227531928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1640109e20 msgr2=0x7f164019fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.058+0000 7f1644bf3640 1 --2- 172.21.15.63:0/4227531928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1640109e20 0x7f164019fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.058+0000 7f1644bf3640 1 -- 172.21.15.63:0/4227531928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16401094d0 msgr2=0x7f164019a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.058+0000 7f1644bf3640 1 --2- 172.21.15.63:0/4227531928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16401094d0 0x7f164019a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.058+0000 7f1644bf3640 1 -- 172.21.15.63:0/4227531928 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16401a03c0 con 0x7f1640103b90 2024-09-21T06:27:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.058+0000 7f16453f4640 1 --2- 172.21.15.63:0/4227531928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1640109e20 0x7f164019fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.059+0000 7f1644bf3640 1 --2- 172.21.15.63:0/4227531928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1640103b90 0x7f164019a450 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1630006010 tx=0x7f16300319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.059+0000 7f163dffb640 1 -- 172.21.15.63:0/4227531928 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1630003bf0 con 0x7f1640103b90 2024-09-21T06:27:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.059+0000 7f1646e57640 1 -- 172.21.15.63:0/4227531928 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16401a0650 con 0x7f1640103b90 2024-09-21T06:27:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.059+0000 7f163dffb640 1 -- 172.21.15.63:0/4227531928 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1630003d90 con 0x7f1640103b90 2024-09-21T06:27:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.059+0000 7f163dffb640 1 -- 172.21.15.63:0/4227531928 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163002fc20 con 0x7f1640103b90 2024-09-21T06:27:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.059+0000 7f1646e57640 1 -- 172.21.15.63:0/4227531928 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16401a6e10 con 0x7f1640103b90 2024-09-21T06:27:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.060+0000 7f1646e57640 1 -- 172.21.15.63:0/4227531928 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1640103fa0 con 0x7f1640103b90 2024-09-21T06:27:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.062+0000 7f163dffb640 1 -- 172.21.15.63:0/4227531928 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f16300046a0 con 0x7f1640103b90 2024-09-21T06:27:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.062+0000 7f163dffb640 1 --2- 172.21.15.63:0/4227531928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f162c0b65f0 0x7f162c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.062+0000 7f163ffff640 1 --2- 172.21.15.63:0/4227531928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f162c0b65f0 0x7f162c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.062+0000 7f163dffb640 1 -- 172.21.15.63:0/4227531928 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f1630108b20 con 0x7f1640103b90 2024-09-21T06:27:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.063+0000 7f163ffff640 1 --2- 172.21.15.63:0/4227531928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f162c0b65f0 0x7f162c0b8b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1640108f90 tx=0x7f162800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.066+0000 7f163dffb640 1 -- 172.21.15.63:0/4227531928 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f16300cf170 con 0x7f1640103b90 2024-09-21T06:27:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.278+0000 7f1646e57640 1 -- 172.21.15.63:0/4227531928 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f164019b580 con 0x7f1640103b90 2024-09-21T06:27:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.279+0000 7f163dffb640 1 -- 172.21.15.63:0/4227531928 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f16300d3550 con 0x7f1640103b90 2024-09-21T06:27:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.281+0000 7f1646e57640 1 -- 172.21.15.63:0/4227531928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f162c0b65f0 msgr2=0x7f162c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:14.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.281+0000 7f1646e57640 1 --2- 172.21.15.63:0/4227531928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f162c0b65f0 0x7f162c0b8b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1640108f90 tx=0x7f162800b390 comp rx=0 tx=0).stop 2024-09-21T06:27:14.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.281+0000 7f1646e57640 1 -- 172.21.15.63:0/4227531928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1640103b90 msgr2=0x7f164019a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:14.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.281+0000 7f1646e57640 1 --2- 172.21.15.63:0/4227531928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1640103b90 0x7f164019a450 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1630006010 tx=0x7f16300319f0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.281+0000 7f1646e57640 1 -- 172.21.15.63:0/4227531928 shutdown_connections 2024-09-21T06:27:14.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.281+0000 7f1646e57640 1 --2- 172.21.15.63:0/4227531928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f162c0b65f0 0x7f162c0b8b00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.281+0000 7f1646e57640 1 --2- 172.21.15.63:0/4227531928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1640109e20 0x7f164019fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.281+0000 7f1646e57640 1 --2- 172.21.15.63:0/4227531928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16401094d0 0x7f164019a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.281+0000 7f1646e57640 1 --2- 172.21.15.63:0/4227531928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1640103b90 0x7f164019a450 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.281+0000 7f1646e57640 1 -- 172.21.15.63:0/4227531928 >> 172.21.15.63:0/4227531928 conn(0x7f16400ff600 msgr2=0x7f1640101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:14.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.281+0000 7f1646e57640 1 -- 172.21.15.63:0/4227531928 shutdown_connections 2024-09-21T06:27:14.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.281+0000 7f1646e57640 1 -- 172.21.15.63:0/4227531928 wait complete. 2024-09-21T06:27:14.293 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:14.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:14 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1043222930' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T06:27:14.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.388+0000 7ff766abe640 1 -- 172.21.15.63:0/2462469835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff76010a660 con 0x7ff760108cf0 2024-09-21T06:27:14.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.389+0000 7ff75dffb640 1 -- 172.21.15.63:0/2462469835 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff7580b39f0 con 0x7ff760108cf0 2024-09-21T06:27:14.390 INFO:teuthology.orchestra.run.smithi063.stdout:176093659186 2024-09-21T06:27:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.391+0000 7ff766abe640 1 -- 172.21.15.63:0/2462469835 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7500b6620 msgr2=0x7ff7500b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.391+0000 7ff766abe640 1 --2- 172.21.15.63:0/2462469835 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7500b6620 0x7ff7500b8b30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff75400abe0 tx=0x7ff75400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.391+0000 7ff766abe640 1 -- 172.21.15.63:0/2462469835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff760108cf0 msgr2=0x7ff76019eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.391+0000 7ff766abe640 1 --2- 172.21.15.63:0/2462469835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff760108cf0 0x7ff76019eb90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff75800ebb0 tx=0x7ff758009f60 comp rx=0 tx=0).stop 2024-09-21T06:27:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.391+0000 7ff766abe640 1 -- 172.21.15.63:0/2462469835 shutdown_connections 2024-09-21T06:27:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.391+0000 7ff766abe640 1 --2- 172.21.15.63:0/2462469835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff760108cf0 0x7ff76019eb90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.391+0000 7ff766abe640 1 --2- 172.21.15.63:0/2462469835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7601083a0 0x7ff7601998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.391+0000 7ff766abe640 1 --2- 172.21.15.63:0/2462469835 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7500b6620 0x7ff7500b8b30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.391+0000 7ff766abe640 1 --2- 172.21.15.63:0/2462469835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff760102a60 0x7ff760199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.391+0000 7ff766abe640 1 -- 172.21.15.63:0/2462469835 >> 172.21.15.63:0/2462469835 conn(0x7ff760079730 msgr2=0x7ff760104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.391+0000 7ff766abe640 1 -- 172.21.15.63:0/2462469835 shutdown_connections 2024-09-21T06:27:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:14.391+0000 7ff766abe640 1 -- 172.21.15.63:0/2462469835 wait complete. 2024-09-21T06:27:14.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:14 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1043222930' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T06:27:14.755 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:15.192 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:15 smithi063 ceph-mon[31150]: pgmap v293: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:27:15.192 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:15 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/4227531928' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T06:27:15.193 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:15 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2462469835' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T06:27:15.222 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659184 got 176093659186 for osd.6 2024-09-21T06:27:15.222 DEBUG:teuthology.parallel:result is None 2024-09-21T06:27:15.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:15 smithi175 ceph-mon[34510]: pgmap v293: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:27:15.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:15 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/4227531928' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T06:27:15.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:15 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2462469835' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T06:27:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:15 smithi071 ceph-mon[34844]: pgmap v293: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:27:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:15 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/4227531928' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T06:27:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:15 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2462469835' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T06:27:15.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.941+0000 7f69ef03c640 1 -- 172.21.15.63:0/164302056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69e8101ff0 msgr2=0x7f69e8102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:15.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.941+0000 7f69ef03c640 1 --2- 172.21.15.63:0/164302056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69e8101ff0 0x7f69e8102400 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f69e0009900 tx=0x7f69e002a410 comp rx=0 tx=0).stop 2024-09-21T06:27:15.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.941+0000 7f69ef03c640 1 -- 172.21.15.63:0/164302056 shutdown_connections 2024-09-21T06:27:15.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.941+0000 7f69ef03c640 1 --2- 172.21.15.63:0/164302056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69e8106c20 0x7f69e8110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:15.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.941+0000 7f69ef03c640 1 --2- 172.21.15.63:0/164302056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69e81062d0 0x7f69e81066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:15.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.941+0000 7f69ef03c640 1 --2- 172.21.15.63:0/164302056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69e8101ff0 0x7f69e8102400 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:15.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.941+0000 7f69ef03c640 1 -- 172.21.15.63:0/164302056 >> 172.21.15.63:0/164302056 conn(0x7f69e8079e30 msgr2=0x7f69e807a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:15.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.941+0000 7f69ef03c640 1 -- 172.21.15.63:0/164302056 shutdown_connections 2024-09-21T06:27:15.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.941+0000 7f69ef03c640 1 -- 172.21.15.63:0/164302056 wait complete. 2024-09-21T06:27:15.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.941+0000 7f69ef03c640 1 Processor -- start 2024-09-21T06:27:15.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.942+0000 7f69ef03c640 1 -- start start 2024-09-21T06:27:15.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.942+0000 7f69ef03c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69e8101ff0 0x7f69e819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:15.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.942+0000 7f69ef03c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69e81062d0 0x7f69e819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:15.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.942+0000 7f69ef03c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69e8106c20 0x7f69e819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:15.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.942+0000 7f69ef03c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f69e8113ac0 con 0x7f69e81062d0 2024-09-21T06:27:15.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.942+0000 7f69ef03c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f69e8113940 con 0x7f69e8106c20 2024-09-21T06:27:15.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.942+0000 7f69ef03c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f69e8113c40 con 0x7f69e8101ff0 2024-09-21T06:27:15.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.942+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69e81062d0 0x7f69e819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:15.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.942+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69e81062d0 0x7f69e819aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54354/0 (socket says 172.21.15.63:54354) 2024-09-21T06:27:15.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.942+0000 7f69e7fff640 1 -- 172.21.15.63:0/345183289 learned_addr learned my addr 172.21.15.63:0/345183289 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:15.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.942+0000 7f69ecdd8640 1 --2- 172.21.15.63:0/345183289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69e8101ff0 0x7f69e819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:15.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.942+0000 7f69ed5d9640 1 --2- 172.21.15.63:0/345183289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69e8106c20 0x7f69e819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:15.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.942+0000 7f69e7fff640 1 -- 172.21.15.63:0/345183289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69e8101ff0 msgr2=0x7f69e819a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:15.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.942+0000 7f69e7fff640 1 --2- 172.21.15.63:0/345183289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69e8101ff0 0x7f69e819a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:15.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.942+0000 7f69e7fff640 1 -- 172.21.15.63:0/345183289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69e8106c20 msgr2=0x7f69e819fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:15.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.942+0000 7f69e7fff640 1 --2- 172.21.15.63:0/345183289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69e8106c20 0x7f69e819fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:15.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.942+0000 7f69e7fff640 1 -- 172.21.15.63:0/345183289 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e81a0440 con 0x7f69e81062d0 2024-09-21T06:27:15.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.943+0000 7f69e7fff640 1 --2- 172.21.15.63:0/345183289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69e81062d0 0x7f69e819aa70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f69d800ea50 tx=0x7f69d800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:15.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.943+0000 7f69e5ffb640 1 -- 172.21.15.63:0/345183289 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d800cdc0 con 0x7f69e81062d0 2024-09-21T06:27:15.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.943+0000 7f69e5ffb640 1 -- 172.21.15.63:0/345183289 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69d8005020 con 0x7f69e81062d0 2024-09-21T06:27:15.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.943+0000 7f69e5ffb640 1 -- 172.21.15.63:0/345183289 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d80116b0 con 0x7f69e81062d0 2024-09-21T06:27:15.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.943+0000 7f69ef03c640 1 -- 172.21.15.63:0/345183289 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e81a0730 con 0x7f69e81062d0 2024-09-21T06:27:15.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.943+0000 7f69ef03c640 1 -- 172.21.15.63:0/345183289 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e81a6e90 con 0x7f69e81062d0 2024-09-21T06:27:15.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.944+0000 7f69ef03c640 1 -- 172.21.15.63:0/345183289 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69e819b600 con 0x7f69e81062d0 2024-09-21T06:27:15.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.945+0000 7f69e5ffb640 1 -- 172.21.15.63:0/345183289 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f69d80051d0 con 0x7f69e81062d0 2024-09-21T06:27:15.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.946+0000 7f69e5ffb640 1 --2- 172.21.15.63:0/345183289 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f69d40b65f0 0x7f69d40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:15.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.946+0000 7f69ecdd8640 1 --2- 172.21.15.63:0/345183289 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f69d40b65f0 0x7f69d40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:15.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.946+0000 7f69e5ffb640 1 -- 172.21.15.63:0/345183289 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f69d80e7910 con 0x7f69e81062d0 2024-09-21T06:27:15.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.947+0000 7f69ecdd8640 1 --2- 172.21.15.63:0/345183289 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f69d40b65f0 0x7f69d40b8b00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f69e0031440 tx=0x7f69e0005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:15.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:15.951+0000 7f69e5ffb640 1 -- 172.21.15.63:0/345183289 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f69d8016030 con 0x7f69e81062d0 2024-09-21T06:27:16.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.142+0000 7f69ef03c640 1 -- 172.21.15.63:0/345183289 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f69e802e640 con 0x7f69e81062d0 2024-09-21T06:27:16.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.143+0000 7f69e5ffb640 1 -- 172.21.15.63:0/345183289 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f69d80adf60 con 0x7f69e81062d0 2024-09-21T06:27:16.145 INFO:teuthology.orchestra.run.smithi063.stdout:60129542220 2024-09-21T06:27:16.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.145+0000 7f69ef03c640 1 -- 172.21.15.63:0/345183289 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f69d40b65f0 msgr2=0x7f69d40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:16.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.145+0000 7f69ef03c640 1 --2- 172.21.15.63:0/345183289 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f69d40b65f0 0x7f69d40b8b00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f69e0031440 tx=0x7f69e0005d50 comp rx=0 tx=0).stop 2024-09-21T06:27:16.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.145+0000 7f69ef03c640 1 -- 172.21.15.63:0/345183289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69e81062d0 msgr2=0x7f69e819aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:16.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.145+0000 7f69ef03c640 1 --2- 172.21.15.63:0/345183289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69e81062d0 0x7f69e819aa70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f69d800ea50 tx=0x7f69d800ef10 comp rx=0 tx=0).stop 2024-09-21T06:27:16.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.145+0000 7f69ef03c640 1 -- 172.21.15.63:0/345183289 shutdown_connections 2024-09-21T06:27:16.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.145+0000 7f69ef03c640 1 --2- 172.21.15.63:0/345183289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69e8106c20 0x7f69e819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:16.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.145+0000 7f69ef03c640 1 --2- 172.21.15.63:0/345183289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69e81062d0 0x7f69e819aa70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:16.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.145+0000 7f69ef03c640 1 --2- 172.21.15.63:0/345183289 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f69d40b65f0 0x7f69d40b8b00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:16.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.145+0000 7f69ef03c640 1 --2- 172.21.15.63:0/345183289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69e8101ff0 0x7f69e819a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:16.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.145+0000 7f69ef03c640 1 -- 172.21.15.63:0/345183289 >> 172.21.15.63:0/345183289 conn(0x7f69e8079e30 msgr2=0x7f69e8108050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:16.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.145+0000 7f69ef03c640 1 -- 172.21.15.63:0/345183289 shutdown_connections 2024-09-21T06:27:16.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.145+0000 7f69ef03c640 1 -- 172.21.15.63:0/345183289 wait complete. 2024-09-21T06:27:17.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.964+0000 7ff729fa1640 1 -- 172.21.15.63:0/4244251978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff724108d20 msgr2=0x7ff72410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:17.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.964+0000 7ff729fa1640 1 --2- 172.21.15.63:0/4244251978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff724108d20 0x7ff72410f550 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009ca0 tx=0x7ff71c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.965+0000 7ff729fa1640 1 -- 172.21.15.63:0/4244251978 shutdown_connections 2024-09-21T06:27:17.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.965+0000 7ff729fa1640 1 --2- 172.21.15.63:0/4244251978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff724108d20 0x7ff72410f550 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.965+0000 7ff729fa1640 1 --2- 172.21.15.63:0/4244251978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7241083d0 0x7ff7241087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.965+0000 7ff729fa1640 1 --2- 172.21.15.63:0/4244251978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff724102a90 0x7ff724102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.965+0000 7ff729fa1640 1 -- 172.21.15.63:0/4244251978 >> 172.21.15.63:0/4244251978 conn(0x7ff724079750 msgr2=0x7ff724079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:17.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.965+0000 7ff729fa1640 1 -- 172.21.15.63:0/4244251978 shutdown_connections 2024-09-21T06:27:17.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.965+0000 7ff729fa1640 1 -- 172.21.15.63:0/4244251978 wait complete. 2024-09-21T06:27:17.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.965+0000 7ff729fa1640 1 Processor -- start 2024-09-21T06:27:17.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.965+0000 7ff729fa1640 1 -- start start 2024-09-21T06:27:17.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.966+0000 7ff729fa1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff724102a90 0x7ff7241992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:17.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.966+0000 7ff729fa1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7241083d0 0x7ff724199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:17.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.966+0000 7ff729fa1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff724108d20 0x7ff72419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:17.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.966+0000 7ff729fa1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff724112990 con 0x7ff7241083d0 2024-09-21T06:27:17.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.966+0000 7ff729fa1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff724112810 con 0x7ff724108d20 2024-09-21T06:27:17.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.966+0000 7ff729fa1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff724112b10 con 0x7ff724102a90 2024-09-21T06:27:17.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.966+0000 7ff722ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7241083d0 0x7ff724199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:17.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.966+0000 7ff722ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7241083d0 0x7ff724199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47150/0 (socket says 172.21.15.63:47150) 2024-09-21T06:27:17.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.966+0000 7ff722ffd640 1 -- 172.21.15.63:0/480847196 learned_addr learned my addr 172.21.15.63:0/480847196 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:17.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.966+0000 7ff723fff640 1 --2- 172.21.15.63:0/480847196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff724108d20 0x7ff72419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:17.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.966+0000 7ff7237fe640 1 --2- 172.21.15.63:0/480847196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff724102a90 0x7ff7241992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:17.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.966+0000 7ff722ffd640 1 -- 172.21.15.63:0/480847196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff724102a90 msgr2=0x7ff7241992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:17.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.966+0000 7ff722ffd640 1 --2- 172.21.15.63:0/480847196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff724102a90 0x7ff7241992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.966+0000 7ff722ffd640 1 -- 172.21.15.63:0/480847196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff724108d20 msgr2=0x7ff72419eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:17.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.966+0000 7ff722ffd640 1 --2- 172.21.15.63:0/480847196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff724108d20 0x7ff72419eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.966+0000 7ff722ffd640 1 -- 172.21.15.63:0/480847196 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff72419f250 con 0x7ff7241083d0 2024-09-21T06:27:17.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.967+0000 7ff722ffd640 1 --2- 172.21.15.63:0/480847196 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7241083d0 0x7ff724199880 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff718005fd0 tx=0x7ff71800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:17.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.967+0000 7ff720ff9640 1 -- 172.21.15.63:0/480847196 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff718017070 con 0x7ff7241083d0 2024-09-21T06:27:17.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.967+0000 7ff720ff9640 1 -- 172.21.15.63:0/480847196 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff718009c30 con 0x7ff7241083d0 2024-09-21T06:27:17.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.967+0000 7ff729fa1640 1 -- 172.21.15.63:0/480847196 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff72419f540 con 0x7ff7241083d0 2024-09-21T06:27:17.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.967+0000 7ff720ff9640 1 -- 172.21.15.63:0/480847196 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff718003d30 con 0x7ff7241083d0 2024-09-21T06:27:17.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.967+0000 7ff729fa1640 1 -- 172.21.15.63:0/480847196 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7241a5ca0 con 0x7ff7241083d0 2024-09-21T06:27:17.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.968+0000 7ff729fa1640 1 -- 172.21.15.63:0/480847196 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff724103d10 con 0x7ff7241083d0 2024-09-21T06:27:17.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.970+0000 7ff720ff9640 1 -- 172.21.15.63:0/480847196 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7ff718003ed0 con 0x7ff7241083d0 2024-09-21T06:27:17.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.971+0000 7ff720ff9640 1 --2- 172.21.15.63:0/480847196 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff70c0b6670 0x7ff70c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:17.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.971+0000 7ff7237fe640 1 --2- 172.21.15.63:0/480847196 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff70c0b6670 0x7ff70c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:17.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.971+0000 7ff720ff9640 1 -- 172.21.15.63:0/480847196 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ff7180e7910 con 0x7ff7241083d0 2024-09-21T06:27:17.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.971+0000 7ff7237fe640 1 --2- 172.21.15.63:0/480847196 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff70c0b6670 0x7ff70c0b8b80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff714005fd0 tx=0x7ff71400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:17.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:16.974+0000 7ff720ff9640 1 -- 172.21.15.63:0/480847196 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff718020030 con 0x7ff7241083d0 2024-09-21T06:27:17.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.166+0000 7ff729fa1640 1 -- 172.21.15.63:0/480847196 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff724102ea0 con 0x7ff7241083d0 2024-09-21T06:27:17.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.167+0000 7ff720ff9640 1 -- 172.21.15.63:0/480847196 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff724102ea0 con 0x7ff7241083d0 2024-09-21T06:27:17.169 INFO:teuthology.orchestra.run.smithi063.stdout:197568495661 2024-09-21T06:27:17.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.169+0000 7ff729fa1640 1 -- 172.21.15.63:0/480847196 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff70c0b6670 msgr2=0x7ff70c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:17.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.169+0000 7ff729fa1640 1 --2- 172.21.15.63:0/480847196 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff70c0b6670 0x7ff70c0b8b80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff714005fd0 tx=0x7ff71400b390 comp rx=0 tx=0).stop 2024-09-21T06:27:17.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.169+0000 7ff729fa1640 1 -- 172.21.15.63:0/480847196 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7241083d0 msgr2=0x7ff724199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:17.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.169+0000 7ff729fa1640 1 --2- 172.21.15.63:0/480847196 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7241083d0 0x7ff724199880 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff718005fd0 tx=0x7ff71800dde0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.169+0000 7ff729fa1640 1 -- 172.21.15.63:0/480847196 shutdown_connections 2024-09-21T06:27:17.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.169+0000 7ff729fa1640 1 --2- 172.21.15.63:0/480847196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff724108d20 0x7ff72419eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.169+0000 7ff729fa1640 1 --2- 172.21.15.63:0/480847196 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7241083d0 0x7ff724199880 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.169+0000 7ff729fa1640 1 --2- 172.21.15.63:0/480847196 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff70c0b6670 0x7ff70c0b8b80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.169+0000 7ff729fa1640 1 --2- 172.21.15.63:0/480847196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff724102a90 0x7ff7241992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.169+0000 7ff729fa1640 1 -- 172.21.15.63:0/480847196 >> 172.21.15.63:0/480847196 conn(0x7ff724079750 msgr2=0x7ff724104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:17.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.169+0000 7ff729fa1640 1 -- 172.21.15.63:0/480847196 shutdown_connections 2024-09-21T06:27:17.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.169+0000 7ff729fa1640 1 -- 172.21.15.63:0/480847196 wait complete. 2024-09-21T06:27:17.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:17 smithi063 ceph-mon[31150]: pgmap v294: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-21T06:27:17.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:17 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/345183289' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T06:27:17.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.335+0000 7f2794fd6640 1 -- 172.21.15.63:0/3380346438 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2790108cf0 msgr2=0x7f279010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:17.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.335+0000 7f2794fd6640 1 --2- 172.21.15.63:0/3380346438 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2790108cf0 0x7f279010f520 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2788009ca0 tx=0x7f278802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.335+0000 7f2794fd6640 1 -- 172.21.15.63:0/3380346438 shutdown_connections 2024-09-21T06:27:17.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.335+0000 7f2794fd6640 1 --2- 172.21.15.63:0/3380346438 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2790108cf0 0x7f279010f520 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.335+0000 7f2794fd6640 1 --2- 172.21.15.63:0/3380346438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27901083a0 0x7f27901087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.335+0000 7f2794fd6640 1 --2- 172.21.15.63:0/3380346438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2790102a60 0x7f2790102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.335+0000 7f2794fd6640 1 -- 172.21.15.63:0/3380346438 >> 172.21.15.63:0/3380346438 conn(0x7f2790079730 msgr2=0x7f2790079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:17.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.335+0000 7f2794fd6640 1 -- 172.21.15.63:0/3380346438 shutdown_connections 2024-09-21T06:27:17.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.335+0000 7f2794fd6640 1 -- 172.21.15.63:0/3380346438 wait complete. 2024-09-21T06:27:17.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.336+0000 7f2794fd6640 1 Processor -- start 2024-09-21T06:27:17.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.336+0000 7f2794fd6640 1 -- start start 2024-09-21T06:27:17.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.336+0000 7f2794fd6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2790102a60 0x7f279019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:17.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.336+0000 7f2794fd6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27901083a0 0x7f279019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:17.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.336+0000 7f2794fd6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2790108cf0 0x7f279019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:17.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.336+0000 7f2794fd6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2790112960 con 0x7f27901083a0 2024-09-21T06:27:17.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.336+0000 7f2794fd6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f27901127e0 con 0x7f2790102a60 2024-09-21T06:27:17.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.336+0000 7f2794fd6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2790112ae0 con 0x7f2790108cf0 2024-09-21T06:27:17.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.336+0000 7f278dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27901083a0 0x7f279019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:17.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.336+0000 7f278dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27901083a0 0x7f279019aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47170/0 (socket says 172.21.15.63:47170) 2024-09-21T06:27:17.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.336+0000 7f278dd9b640 1 -- 172.21.15.63:0/1942640055 learned_addr learned my addr 172.21.15.63:0/1942640055 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:17.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.336+0000 7f278e59c640 1 --2- 172.21.15.63:0/1942640055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2790102a60 0x7f279019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:17.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.336+0000 7f278ed9d640 1 --2- 172.21.15.63:0/1942640055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2790108cf0 0x7f279019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:17.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.337+0000 7f278dd9b640 1 -- 172.21.15.63:0/1942640055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2790108cf0 msgr2=0x7f279019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:17.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.337+0000 7f278dd9b640 1 --2- 172.21.15.63:0/1942640055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2790108cf0 0x7f279019fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.337+0000 7f278dd9b640 1 -- 172.21.15.63:0/1942640055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2790102a60 msgr2=0x7f279019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:17.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.337+0000 7f278dd9b640 1 --2- 172.21.15.63:0/1942640055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2790102a60 0x7f279019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.337+0000 7f278dd9b640 1 -- 172.21.15.63:0/1942640055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27901a0430 con 0x7f27901083a0 2024-09-21T06:27:17.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.337+0000 7f278e59c640 1 --2- 172.21.15.63:0/1942640055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2790102a60 0x7f279019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:27:17.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.337+0000 7f278dd9b640 1 --2- 172.21.15.63:0/1942640055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27901083a0 0x7f279019aa60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f278400e9c0 tx=0x7f278400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:17.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.337+0000 7f277f7fe640 1 -- 172.21.15.63:0/1942640055 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278400cd80 con 0x7f27901083a0 2024-09-21T06:27:17.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.337+0000 7f277f7fe640 1 -- 172.21.15.63:0/1942640055 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27840054d0 con 0x7f27901083a0 2024-09-21T06:27:17.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.337+0000 7f277f7fe640 1 -- 172.21.15.63:0/1942640055 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2784010430 con 0x7f27901083a0 2024-09-21T06:27:17.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.337+0000 7f2794fd6640 1 -- 172.21.15.63:0/1942640055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27901a0720 con 0x7f27901083a0 2024-09-21T06:27:17.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.337+0000 7f2794fd6640 1 -- 172.21.15.63:0/1942640055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27900ff550 con 0x7f27901083a0 2024-09-21T06:27:17.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.339+0000 7f2794fd6640 1 -- 172.21.15.63:0/1942640055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2790103ce0 con 0x7f27901083a0 2024-09-21T06:27:17.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.340+0000 7f277f7fe640 1 -- 172.21.15.63:0/1942640055 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f2784004fd0 con 0x7f27901083a0 2024-09-21T06:27:17.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.341+0000 7f277f7fe640 1 --2- 172.21.15.63:0/1942640055 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27780b65f0 0x7f27780b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:17.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.341+0000 7f277f7fe640 1 -- 172.21.15.63:0/1942640055 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f27840e79d0 con 0x7f27901083a0 2024-09-21T06:27:17.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.341+0000 7f278e59c640 1 --2- 172.21.15.63:0/1942640055 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27780b65f0 0x7f27780b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:17.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.341+0000 7f278e59c640 1 --2- 172.21.15.63:0/1942640055 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27780b65f0 0x7f27780b8b00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f27800096a0 tx=0x7f2780012040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:17.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.345+0000 7f277f7fe640 1 -- 172.21.15.63:0/1942640055 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f27840ae020 con 0x7f27901083a0 2024-09-21T06:27:17.348 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:17 smithi175 ceph-mon[34510]: pgmap v294: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-21T06:27:17.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:17 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/345183289' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T06:27:17.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:17 smithi071 ceph-mon[34844]: pgmap v294: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-21T06:27:17.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:17 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/345183289' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T06:27:17.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.539+0000 7f2794fd6640 1 -- 172.21.15.63:0/1942640055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f279010bad0 con 0x7f27901083a0 2024-09-21T06:27:17.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.540+0000 7f277f7fe640 1 -- 172.21.15.63:0/1942640055 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f27840b2400 con 0x7f27901083a0 2024-09-21T06:27:17.542 INFO:teuthology.orchestra.run.smithi063.stdout:296352743448 2024-09-21T06:27:17.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.542+0000 7f2794fd6640 1 -- 172.21.15.63:0/1942640055 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27780b65f0 msgr2=0x7f27780b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:17.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.542+0000 7f2794fd6640 1 --2- 172.21.15.63:0/1942640055 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27780b65f0 0x7f27780b8b00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f27800096a0 tx=0x7f2780012040 comp rx=0 tx=0).stop 2024-09-21T06:27:17.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.542+0000 7f2794fd6640 1 -- 172.21.15.63:0/1942640055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27901083a0 msgr2=0x7f279019aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:17.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.542+0000 7f2794fd6640 1 --2- 172.21.15.63:0/1942640055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27901083a0 0x7f279019aa60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f278400e9c0 tx=0x7f278400ee80 comp rx=0 tx=0).stop 2024-09-21T06:27:17.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.542+0000 7f2794fd6640 1 -- 172.21.15.63:0/1942640055 shutdown_connections 2024-09-21T06:27:17.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.542+0000 7f2794fd6640 1 --2- 172.21.15.63:0/1942640055 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27780b65f0 0x7f27780b8b00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.542+0000 7f2794fd6640 1 --2- 172.21.15.63:0/1942640055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2790108cf0 0x7f279019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.542+0000 7f2794fd6640 1 --2- 172.21.15.63:0/1942640055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27901083a0 0x7f279019aa60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.542+0000 7f2794fd6640 1 --2- 172.21.15.63:0/1942640055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2790102a60 0x7f279019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:17.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.542+0000 7f2794fd6640 1 -- 172.21.15.63:0/1942640055 >> 172.21.15.63:0/1942640055 conn(0x7f2790079730 msgr2=0x7f279006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:17.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.542+0000 7f2794fd6640 1 -- 172.21.15.63:0/1942640055 shutdown_connections 2024-09-21T06:27:17.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:17.542+0000 7f2794fd6640 1 -- 172.21.15.63:0/1942640055 wait complete. 2024-09-21T06:27:17.891 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542218 got 60129542220 for osd.1 2024-09-21T06:27:17.891 DEBUG:teuthology.parallel:result is None 2024-09-21T06:27:18.184 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:18 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/480847196' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T06:27:18.184 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:18 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:18.184 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:18 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1942640055' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T06:27:18.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:18 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/480847196' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T06:27:18.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:18 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:18.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:18 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1942640055' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T06:27:18.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:18 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/480847196' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T06:27:18.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:18 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:18.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:18 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1942640055' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T06:27:18.904 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495659 got 197568495661 for osd.7 2024-09-21T06:27:18.904 DEBUG:teuthology.parallel:result is None 2024-09-21T06:27:19.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.199+0000 7fbc88ac3640 1 -- 172.21.15.63:0/3703444293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc84102a60 msgr2=0x7fbc84102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:19.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.199+0000 7fbc88ac3640 1 --2- 172.21.15.63:0/3703444293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc84102a60 0x7fbc84102e70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c009ca0 tx=0x7fbc7c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:19.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.200+0000 7fbc88ac3640 1 -- 172.21.15.63:0/3703444293 shutdown_connections 2024-09-21T06:27:19.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.200+0000 7fbc88ac3640 1 --2- 172.21.15.63:0/3703444293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc84108cf0 0x7fbc8410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:19.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.200+0000 7fbc88ac3640 1 --2- 172.21.15.63:0/3703444293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc841083a0 0x7fbc841087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:19.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.200+0000 7fbc88ac3640 1 --2- 172.21.15.63:0/3703444293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc84102a60 0x7fbc84102e70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:19.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.200+0000 7fbc88ac3640 1 -- 172.21.15.63:0/3703444293 >> 172.21.15.63:0/3703444293 conn(0x7fbc84079730 msgr2=0x7fbc84079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:19.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.200+0000 7fbc88ac3640 1 -- 172.21.15.63:0/3703444293 shutdown_connections 2024-09-21T06:27:19.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.200+0000 7fbc88ac3640 1 -- 172.21.15.63:0/3703444293 wait complete. 2024-09-21T06:27:19.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.201+0000 7fbc88ac3640 1 Processor -- start 2024-09-21T06:27:19.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.201+0000 7fbc88ac3640 1 -- start start 2024-09-21T06:27:19.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.201+0000 7fbc88ac3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc84102a60 0x7fbc8419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:19.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.201+0000 7fbc88ac3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc841083a0 0x7fbc8419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:19.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.201+0000 7fbc88ac3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc84108cf0 0x7fbc8419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:19.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.201+0000 7fbc88ac3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbc84112960 con 0x7fbc84108cf0 2024-09-21T06:27:19.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.201+0000 7fbc88ac3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbc841127e0 con 0x7fbc84102a60 2024-09-21T06:27:19.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.201+0000 7fbc88ac3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbc84112ae0 con 0x7fbc841083a0 2024-09-21T06:27:19.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.201+0000 7fbc82d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc84108cf0 0x7fbc8419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:19.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.201+0000 7fbc8259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc84102a60 0x7fbc8419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:19.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.201+0000 7fbc82d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc84108cf0 0x7fbc8419fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47206/0 (socket says 172.21.15.63:47206) 2024-09-21T06:27:19.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.201+0000 7fbc82d9d640 1 -- 172.21.15.63:0/2936036193 learned_addr learned my addr 172.21.15.63:0/2936036193 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:19.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.201+0000 7fbc81d9b640 1 --2- 172.21.15.63:0/2936036193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc841083a0 0x7fbc8419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:19.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.202+0000 7fbc82d9d640 1 -- 172.21.15.63:0/2936036193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc841083a0 msgr2=0x7fbc8419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:19.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.202+0000 7fbc82d9d640 1 --2- 172.21.15.63:0/2936036193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc841083a0 0x7fbc8419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:19.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.202+0000 7fbc82d9d640 1 -- 172.21.15.63:0/2936036193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc84102a60 msgr2=0x7fbc8419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:19.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.202+0000 7fbc82d9d640 1 --2- 172.21.15.63:0/2936036193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc84102a60 0x7fbc8419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:19.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.202+0000 7fbc82d9d640 1 -- 172.21.15.63:0/2936036193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc841a0430 con 0x7fbc84108cf0 2024-09-21T06:27:19.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.202+0000 7fbc8259c640 1 --2- 172.21.15.63:0/2936036193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc84102a60 0x7fbc8419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:27:19.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.202+0000 7fbc82d9d640 1 --2- 172.21.15.63:0/2936036193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc84108cf0 0x7fbc8419fd00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400e970 tx=0x7fbc7400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:19.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.202+0000 7fbc737fe640 1 -- 172.21.15.63:0/2936036193 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400ccc0 con 0x7fbc84108cf0 2024-09-21T06:27:19.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.202+0000 7fbc88ac3640 1 -- 172.21.15.63:0/2936036193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc841a0720 con 0x7fbc84108cf0 2024-09-21T06:27:19.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.202+0000 7fbc88ac3640 1 -- 172.21.15.63:0/2936036193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc84104130 con 0x7fbc84108cf0 2024-09-21T06:27:19.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.202+0000 7fbc737fe640 1 -- 172.21.15.63:0/2936036193 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc7400ce60 con 0x7fbc84108cf0 2024-09-21T06:27:19.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.202+0000 7fbc737fe640 1 -- 172.21.15.63:0/2936036193 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74010430 con 0x7fbc84108cf0 2024-09-21T06:27:19.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.204+0000 7fbc88ac3640 1 -- 172.21.15.63:0/2936036193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc64005290 con 0x7fbc84108cf0 2024-09-21T06:27:19.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.205+0000 7fbc737fe640 1 -- 172.21.15.63:0/2936036193 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fbc740046c0 con 0x7fbc84108cf0 2024-09-21T06:27:19.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.206+0000 7fbc737fe640 1 --2- 172.21.15.63:0/2936036193 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbc6c0b6670 0x7fbc6c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:19.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.206+0000 7fbc8259c640 1 --2- 172.21.15.63:0/2936036193 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbc6c0b6670 0x7fbc6c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:19.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.206+0000 7fbc737fe640 1 -- 172.21.15.63:0/2936036193 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fbc740e7700 con 0x7fbc84108cf0 2024-09-21T06:27:19.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.206+0000 7fbc8259c640 1 --2- 172.21.15.63:0/2936036193 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbc6c0b6670 0x7fbc6c0b8b80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c005e30 tx=0x7fbc7c009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:19.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.210+0000 7fbc737fe640 1 -- 172.21.15.63:0/2936036193 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbc740add50 con 0x7fbc84108cf0 2024-09-21T06:27:19.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.433+0000 7fbc88ac3640 1 -- 172.21.15.63:0/2936036193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fbc64005850 con 0x7fbc84108cf0 2024-09-21T06:27:19.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.433+0000 7fbc737fe640 1 -- 172.21.15.63:0/2936036193 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbc740b2130 con 0x7fbc84108cf0 2024-09-21T06:27:19.435 INFO:teuthology.orchestra.run.smithi063.stdout:223338299432 2024-09-21T06:27:19.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.435+0000 7fbc88ac3640 1 -- 172.21.15.63:0/2936036193 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbc6c0b6670 msgr2=0x7fbc6c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:19.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.435+0000 7fbc88ac3640 1 --2- 172.21.15.63:0/2936036193 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbc6c0b6670 0x7fbc6c0b8b80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c005e30 tx=0x7fbc7c009360 comp rx=0 tx=0).stop 2024-09-21T06:27:19.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.435+0000 7fbc88ac3640 1 -- 172.21.15.63:0/2936036193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc84108cf0 msgr2=0x7fbc8419fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:19.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.435+0000 7fbc88ac3640 1 --2- 172.21.15.63:0/2936036193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc84108cf0 0x7fbc8419fd00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400e970 tx=0x7fbc7400ed70 comp rx=0 tx=0).stop 2024-09-21T06:27:19.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.435+0000 7fbc88ac3640 1 -- 172.21.15.63:0/2936036193 shutdown_connections 2024-09-21T06:27:19.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.435+0000 7fbc88ac3640 1 --2- 172.21.15.63:0/2936036193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc84108cf0 0x7fbc8419fd00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:19.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.435+0000 7fbc88ac3640 1 --2- 172.21.15.63:0/2936036193 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbc6c0b6670 0x7fbc6c0b8b80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:19.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.435+0000 7fbc88ac3640 1 --2- 172.21.15.63:0/2936036193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc841083a0 0x7fbc8419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:19.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.435+0000 7fbc88ac3640 1 --2- 172.21.15.63:0/2936036193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc84102a60 0x7fbc8419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:19.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.435+0000 7fbc88ac3640 1 -- 172.21.15.63:0/2936036193 >> 172.21.15.63:0/2936036193 conn(0x7fbc84079730 msgr2=0x7fbc841066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:19.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.436+0000 7fbc88ac3640 1 -- 172.21.15.63:0/2936036193 shutdown_connections 2024-09-21T06:27:19.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.436+0000 7fbc88ac3640 1 -- 172.21.15.63:0/2936036193 wait complete. 2024-09-21T06:27:19.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.099+0000 7fe316919640 1 -- 172.21.15.63:0/1687038099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe310102ae0 msgr2=0x7fe310102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:19.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.099+0000 7fe316919640 1 --2- 172.21.15.63:0/1687038099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe310102ae0 0x7fe310102ef0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe300009900 tx=0x7fe30002a410 comp rx=0 tx=0).stop 2024-09-21T06:27:19.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.099+0000 7fe316919640 1 -- 172.21.15.63:0/1687038099 shutdown_connections 2024-09-21T06:27:19.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.099+0000 7fe316919640 1 --2- 172.21.15.63:0/1687038099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe310108d20 0x7fe31010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:19.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.099+0000 7fe316919640 1 --2- 172.21.15.63:0/1687038099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3101083d0 0x7fe3101087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:19.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.099+0000 7fe316919640 1 --2- 172.21.15.63:0/1687038099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe310102ae0 0x7fe310102ef0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:19.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.099+0000 7fe316919640 1 -- 172.21.15.63:0/1687038099 >> 172.21.15.63:0/1687038099 conn(0x7fe310079760 msgr2=0x7fe310079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:19.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.100+0000 7fe316919640 1 -- 172.21.15.63:0/1687038099 shutdown_connections 2024-09-21T06:27:19.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.100+0000 7fe316919640 1 -- 172.21.15.63:0/1687038099 wait complete. 2024-09-21T06:27:19.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.100+0000 7fe316919640 1 Processor -- start 2024-09-21T06:27:19.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.100+0000 7fe316919640 1 -- start start 2024-09-21T06:27:19.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.101+0000 7fe316919640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe310102ae0 0x7fe310104280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:19.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.101+0000 7fe316919640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3101083d0 0x7fe3101047c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:19.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.101+0000 7fe316919640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe310108d20 0x7fe310104d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:19.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.101+0000 7fe316919640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe310112990 con 0x7fe310108d20 2024-09-21T06:27:19.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.101+0000 7fe316919640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe310112810 con 0x7fe310102ae0 2024-09-21T06:27:19.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.101+0000 7fe316919640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe310112b10 con 0x7fe3101083d0 2024-09-21T06:27:19.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.101+0000 7fe314eb6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe310108d20 0x7fe310104d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:19.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.101+0000 7fe314eb6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe310108d20 0x7fe310104d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47196/0 (socket says 172.21.15.63:47196) 2024-09-21T06:27:19.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.101+0000 7fe314eb6640 1 -- 172.21.15.63:0/835758706 learned_addr learned my addr 172.21.15.63:0/835758706 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:19.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.101+0000 7fe30ffff640 1 --2- 172.21.15.63:0/835758706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe310102ae0 0x7fe310104280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:19.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.101+0000 7fe30f7fe640 1 --2- 172.21.15.63:0/835758706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3101083d0 0x7fe3101047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:19.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.101+0000 7fe314eb6640 1 -- 172.21.15.63:0/835758706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3101083d0 msgr2=0x7fe3101047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:19.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.101+0000 7fe314eb6640 1 --2- 172.21.15.63:0/835758706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3101083d0 0x7fe3101047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:19.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.101+0000 7fe314eb6640 1 -- 172.21.15.63:0/835758706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe310102ae0 msgr2=0x7fe310104280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:19.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.101+0000 7fe314eb6640 1 --2- 172.21.15.63:0/835758706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe310102ae0 0x7fe310104280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:19.590 INFO:teuthology.orchestra.run.smithi063.stdout:270582939678 2024-09-21T06:27:19.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.101+0000 7fe314eb6640 1 -- 172.21.15.63:0/835758706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3101a8750 con 0x7fe310108d20 2024-09-21T06:27:19.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.101+0000 7fe314eb6640 1 --2- 172.21.15.63:0/835758706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe310108d20 0x7fe310104d00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe30800eb10 tx=0x7fe30800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:19.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.102+0000 7fe30d7fa640 1 -- 172.21.15.63:0/835758706 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe308004b20 con 0x7fe310108d20 2024-09-21T06:27:19.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.102+0000 7fe30d7fa640 1 -- 172.21.15.63:0/835758706 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe308004cc0 con 0x7fe310108d20 2024-09-21T06:27:19.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.102+0000 7fe316919640 1 -- 172.21.15.63:0/835758706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3101a8a40 con 0x7fe310108d20 2024-09-21T06:27:19.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.102+0000 7fe30d7fa640 1 -- 172.21.15.63:0/835758706 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe308010670 con 0x7fe310108d20 2024-09-21T06:27:19.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.102+0000 7fe316919640 1 -- 172.21.15.63:0/835758706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3101a8f80 con 0x7fe310108d20 2024-09-21T06:27:19.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.103+0000 7fe316919640 1 -- 172.21.15.63:0/835758706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe310103d10 con 0x7fe310108d20 2024-09-21T06:27:19.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.104+0000 7fe30d7fa640 1 -- 172.21.15.63:0/835758706 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fe308005020 con 0x7fe310108d20 2024-09-21T06:27:19.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.105+0000 7fe30d7fa640 1 --2- 172.21.15.63:0/835758706 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe2f80b6670 0x7fe2f80b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:19.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.105+0000 7fe30ffff640 1 --2- 172.21.15.63:0/835758706 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe2f80b6670 0x7fe2f80b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:19.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.106+0000 7fe30d7fa640 1 -- 172.21.15.63:0/835758706 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fe3080e7c10 con 0x7fe310108d20 2024-09-21T06:27:19.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.106+0000 7fe30ffff640 1 --2- 172.21.15.63:0/835758706 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe2f80b6670 0x7fe2f80b8b80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe300000c00 tx=0x7fe300031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:19.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.110+0000 7fe30d7fa640 1 -- 172.21.15.63:0/835758706 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe3080ae260 con 0x7fe310108d20 2024-09-21T06:27:19.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.339+0000 7fe316919640 1 -- 172.21.15.63:0/835758706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fe310105580 con 0x7fe310108d20 2024-09-21T06:27:19.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.340+0000 7fe30d7fa640 1 -- 172.21.15.63:0/835758706 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fe3080b2640 con 0x7fe310108d20 2024-09-21T06:27:19.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.342+0000 7fe316919640 1 -- 172.21.15.63:0/835758706 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe2f80b6670 msgr2=0x7fe2f80b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:19.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.342+0000 7fe316919640 1 --2- 172.21.15.63:0/835758706 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe2f80b6670 0x7fe2f80b8b80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe300000c00 tx=0x7fe300031400 comp rx=0 tx=0).stop 2024-09-21T06:27:19.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.342+0000 7fe316919640 1 -- 172.21.15.63:0/835758706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe310108d20 msgr2=0x7fe310104d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:19.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.342+0000 7fe316919640 1 --2- 172.21.15.63:0/835758706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe310108d20 0x7fe310104d00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe30800eb10 tx=0x7fe30800c2d0 comp rx=0 tx=0).stop 2024-09-21T06:27:19.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.342+0000 7fe316919640 1 -- 172.21.15.63:0/835758706 shutdown_connections 2024-09-21T06:27:19.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.342+0000 7fe316919640 1 --2- 172.21.15.63:0/835758706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe310108d20 0x7fe310104d00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:19.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.342+0000 7fe316919640 1 --2- 172.21.15.63:0/835758706 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe2f80b6670 0x7fe2f80b8b80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:19.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.342+0000 7fe316919640 1 --2- 172.21.15.63:0/835758706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3101083d0 0x7fe3101047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:19.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.342+0000 7fe316919640 1 --2- 172.21.15.63:0/835758706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe310102ae0 0x7fe310104280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:19.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.342+0000 7fe316919640 1 -- 172.21.15.63:0/835758706 >> 172.21.15.63:0/835758706 conn(0x7fe310079760 msgr2=0x7fe310101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:19.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.342+0000 7fe316919640 1 -- 172.21.15.63:0/835758706 shutdown_connections 2024-09-21T06:27:19.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:19.342+0000 7fe316919640 1 -- 172.21.15.63:0/835758706 wait complete. 2024-09-21T06:27:19.778 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:19 smithi063 ceph-mon[31150]: pgmap v295: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T06:27:19.778 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:19 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:19.778 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:19 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:19.778 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:19 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:19.778 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:19 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:19.778 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:19 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/835758706' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T06:27:19.778 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:19 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2936036193' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T06:27:20.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:19 smithi071 ceph-mon[34844]: pgmap v295: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T06:27:20.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:19 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:20.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:19 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:20.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:19 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:20.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:19 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:20.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:19 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/835758706' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T06:27:20.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:19 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2936036193' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T06:27:20.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:19 smithi175 ceph-mon[34510]: pgmap v295: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T06:27:20.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:19 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:20.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:19 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:20.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:19 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:20.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:19 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:20.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:19 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/835758706' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T06:27:20.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:19 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2936036193' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T06:27:20.557 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299430 got 223338299432 for osd.8 2024-09-21T06:27:20.557 DEBUG:teuthology.parallel:result is None 2024-09-21T06:27:20.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.617+0000 7f09f995f640 1 -- 172.21.15.63:0/2370254417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f410de60 msgr2=0x7f09f4110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:20.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.617+0000 7f09f995f640 1 --2- 172.21.15.63:0/2370254417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f410de60 0x7f09f4110330 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009ca0 tx=0x7f09e402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:20.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.617+0000 7f09f995f640 1 -- 172.21.15.63:0/2370254417 shutdown_connections 2024-09-21T06:27:20.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.617+0000 7f09f995f640 1 --2- 172.21.15.63:0/2370254417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f410de60 0x7f09f4110330 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:20.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.617+0000 7f09f995f640 1 --2- 172.21.15.63:0/2370254417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09f4105380 0x7f09f410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:20.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.617+0000 7f09f995f640 1 --2- 172.21.15.63:0/2370254417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f4104a30 0x7f09f4104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:20.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.617+0000 7f09f995f640 1 -- 172.21.15.63:0/2370254417 >> 172.21.15.63:0/2370254417 conn(0x7f09f40797b0 msgr2=0x7f09f4079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:20.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.617+0000 7f09f995f640 1 -- 172.21.15.63:0/2370254417 shutdown_connections 2024-09-21T06:27:20.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.617+0000 7f09f995f640 1 -- 172.21.15.63:0/2370254417 wait complete. 2024-09-21T06:27:20.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.618+0000 7f09f995f640 1 Processor -- start 2024-09-21T06:27:20.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.618+0000 7f09f995f640 1 -- start start 2024-09-21T06:27:20.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.618+0000 7f09f995f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f4104a30 0x7f09f419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:20.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.618+0000 7f09f995f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f4105380 0x7f09f419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:20.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.618+0000 7f09f995f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09f410de60 0x7f09f419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:20.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.618+0000 7f09f995f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f09f4113ac0 con 0x7f09f4104a30 2024-09-21T06:27:20.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.618+0000 7f09f995f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f09f4113940 con 0x7f09f4105380 2024-09-21T06:27:20.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.618+0000 7f09f995f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f09f4113c40 con 0x7f09f410de60 2024-09-21T06:27:20.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.619+0000 7f09f2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f4104a30 0x7f09f419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:20.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.619+0000 7f09f2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f4104a30 0x7f09f419a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47230/0 (socket says 172.21.15.63:47230) 2024-09-21T06:27:20.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.619+0000 7f09f2ffd640 1 -- 172.21.15.63:0/3688460332 learned_addr learned my addr 172.21.15.63:0/3688460332 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:20.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.619+0000 7f09f37fe640 1 --2- 172.21.15.63:0/3688460332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09f410de60 0x7f09f419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:20.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.619+0000 7f09f27fc640 1 --2- 172.21.15.63:0/3688460332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f4105380 0x7f09f419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:20.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.619+0000 7f09f2ffd640 1 -- 172.21.15.63:0/3688460332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09f410de60 msgr2=0x7f09f419fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:20.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.619+0000 7f09f2ffd640 1 --2- 172.21.15.63:0/3688460332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09f410de60 0x7f09f419fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:20.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.619+0000 7f09f2ffd640 1 -- 172.21.15.63:0/3688460332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f4105380 msgr2=0x7f09f419aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:20.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.619+0000 7f09f2ffd640 1 --2- 172.21.15.63:0/3688460332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f4105380 0x7f09f419aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:20.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.619+0000 7f09f2ffd640 1 -- 172.21.15.63:0/3688460332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f41a0420 con 0x7f09f4104a30 2024-09-21T06:27:20.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.619+0000 7f09f2ffd640 1 --2- 172.21.15.63:0/3688460332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f4104a30 0x7f09f419a4b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00d950 tx=0x7f09ec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:20.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.619+0000 7f09f895d640 1 -- 172.21.15.63:0/3688460332 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec017030 con 0x7f09f4104a30 2024-09-21T06:27:20.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.619+0000 7f09f895d640 1 -- 172.21.15.63:0/3688460332 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09ec004020 con 0x7f09f4104a30 2024-09-21T06:27:20.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.619+0000 7f09f995f640 1 -- 172.21.15.63:0/3688460332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f41a0710 con 0x7f09f4104a30 2024-09-21T06:27:20.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.619+0000 7f09f895d640 1 -- 172.21.15.63:0/3688460332 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec0047a0 con 0x7f09f4104a30 2024-09-21T06:27:20.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.620+0000 7f09f995f640 1 -- 172.21.15.63:0/3688460332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f41a6e70 con 0x7f09f4104a30 2024-09-21T06:27:20.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.621+0000 7f09f995f640 1 -- 172.21.15.63:0/3688460332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09f4104e40 con 0x7f09f4104a30 2024-09-21T06:27:20.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.622+0000 7f09f895d640 1 -- 172.21.15.63:0/3688460332 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f09ec009a30 con 0x7f09f4104a30 2024-09-21T06:27:20.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.623+0000 7f09f895d640 1 --2- 172.21.15.63:0/3688460332 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f09e00b65f0 0x7f09e00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:20.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.623+0000 7f09f27fc640 1 --2- 172.21.15.63:0/3688460332 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f09e00b65f0 0x7f09e00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:20.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.623+0000 7f09f895d640 1 -- 172.21.15.63:0/3688460332 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f09ec0e75c0 con 0x7f09f4104a30 2024-09-21T06:27:20.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.623+0000 7f09f27fc640 1 --2- 172.21.15.63:0/3688460332 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f09e00b65f0 0x7f09e00b8b00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f09f410fb20 tx=0x7f09dc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:20.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.626+0000 7f09f895d640 1 -- 172.21.15.63:0/3688460332 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f09ec0adc10 con 0x7f09f4104a30 2024-09-21T06:27:20.755 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182461 got 107374182464 for osd.3 2024-09-21T06:27:20.756 DEBUG:teuthology.parallel:result is None 2024-09-21T06:27:20.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.829+0000 7f09f995f640 1 -- 172.21.15.63:0/3688460332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f09f419b5e0 con 0x7f09f4104a30 2024-09-21T06:27:20.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.829+0000 7f09f895d640 1 -- 172.21.15.63:0/3688460332 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f09f419b5e0 con 0x7f09f4104a30 2024-09-21T06:27:20.831 INFO:teuthology.orchestra.run.smithi063.stdout:249108103204 2024-09-21T06:27:20.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.831+0000 7f09f995f640 1 -- 172.21.15.63:0/3688460332 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f09e00b65f0 msgr2=0x7f09e00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:20.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.831+0000 7f09f995f640 1 --2- 172.21.15.63:0/3688460332 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f09e00b65f0 0x7f09e00b8b00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f09f410fb20 tx=0x7f09dc005f90 comp rx=0 tx=0).stop 2024-09-21T06:27:20.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.831+0000 7f09f995f640 1 -- 172.21.15.63:0/3688460332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f4104a30 msgr2=0x7f09f419a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:20.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.831+0000 7f09f995f640 1 --2- 172.21.15.63:0/3688460332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f4104a30 0x7f09f419a4b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00d950 tx=0x7f09ec00de10 comp rx=0 tx=0).stop 2024-09-21T06:27:20.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.831+0000 7f09f995f640 1 -- 172.21.15.63:0/3688460332 shutdown_connections 2024-09-21T06:27:20.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.831+0000 7f09f995f640 1 --2- 172.21.15.63:0/3688460332 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f09e00b65f0 0x7f09e00b8b00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:20.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.831+0000 7f09f995f640 1 --2- 172.21.15.63:0/3688460332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09f410de60 0x7f09f419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:20.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.831+0000 7f09f995f640 1 --2- 172.21.15.63:0/3688460332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f4105380 0x7f09f419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:20.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.831+0000 7f09f995f640 1 --2- 172.21.15.63:0/3688460332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f4104a30 0x7f09f419a4b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:20.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.831+0000 7f09f995f640 1 -- 172.21.15.63:0/3688460332 >> 172.21.15.63:0/3688460332 conn(0x7f09f40797b0 msgr2=0x7f09f40ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:20.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.832+0000 7f09f995f640 1 -- 172.21.15.63:0/3688460332 shutdown_connections 2024-09-21T06:27:20.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:20.832+0000 7f09f995f640 1 -- 172.21.15.63:0/3688460332 wait complete. 2024-09-21T06:27:21.684 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103200 got 249108103204 for osd.9 2024-09-21T06:27:21.684 DEBUG:teuthology.parallel:result is None 2024-09-21T06:27:21.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:21 smithi063 ceph-mon[31150]: pgmap v296: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:27:21.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:21 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3688460332' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T06:27:22.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:21 smithi071 ceph-mon[34844]: pgmap v296: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:27:22.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:21 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3688460332' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T06:27:22.069 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743445 got 296352743448 for osd.11 2024-09-21T06:27:22.069 DEBUG:teuthology.parallel:result is None 2024-09-21T06:27:22.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:21 smithi175 ceph-mon[34510]: pgmap v296: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:27:22.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:21 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3688460332' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T06:27:22.460 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939675 got 270582939678 for osd.10 2024-09-21T06:27:22.461 DEBUG:teuthology.parallel:result is None 2024-09-21T06:27:22.939 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378693 got 81604378695 for osd.2 2024-09-21T06:27:22.939 DEBUG:teuthology.parallel:result is None 2024-09-21T06:27:23.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.146+0000 7fc0dbf3f640 1 -- 172.21.15.63:0/3512086008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0d4108cf0 msgr2=0x7fc0d410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:23.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.146+0000 7fc0dbf3f640 1 --2- 172.21.15.63:0/3512086008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0d4108cf0 0x7fc0d410f520 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc009900 tx=0x7fc0cc02a410 comp rx=0 tx=0).stop 2024-09-21T06:27:23.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.146+0000 7fc0dbf3f640 1 -- 172.21.15.63:0/3512086008 shutdown_connections 2024-09-21T06:27:23.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.146+0000 7fc0dbf3f640 1 --2- 172.21.15.63:0/3512086008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0d4108cf0 0x7fc0d410f520 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:23.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.146+0000 7fc0dbf3f640 1 --2- 172.21.15.63:0/3512086008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d41083a0 0x7fc0d41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:23.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.146+0000 7fc0dbf3f640 1 --2- 172.21.15.63:0/3512086008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d4102a60 0x7fc0d4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:23.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.146+0000 7fc0dbf3f640 1 -- 172.21.15.63:0/3512086008 >> 172.21.15.63:0/3512086008 conn(0x7fc0d4079730 msgr2=0x7fc0d4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:23.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.146+0000 7fc0dbf3f640 1 -- 172.21.15.63:0/3512086008 shutdown_connections 2024-09-21T06:27:23.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.146+0000 7fc0dbf3f640 1 -- 172.21.15.63:0/3512086008 wait complete. 2024-09-21T06:27:23.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.147+0000 7fc0dbf3f640 1 Processor -- start 2024-09-21T06:27:23.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.147+0000 7fc0dbf3f640 1 -- start start 2024-09-21T06:27:23.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.148+0000 7fc0dbf3f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0d4102a60 0x7fc0d419c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:23.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.148+0000 7fc0dbf3f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d41083a0 0x7fc0d419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:23.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.148+0000 7fc0dbf3f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d4108cf0 0x7fc0d41a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:23.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.148+0000 7fc0dbf3f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d41118a0 con 0x7fc0d4102a60 2024-09-21T06:27:23.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.148+0000 7fc0dbf3f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d4111720 con 0x7fc0d41083a0 2024-09-21T06:27:23.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.148+0000 7fc0dbf3f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d4111a20 con 0x7fc0d4108cf0 2024-09-21T06:27:23.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.148+0000 7fc0d9cdb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0d4102a60 0x7fc0d419c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:23.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.148+0000 7fc0d9cdb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0d4102a60 0x7fc0d419c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47244/0 (socket says 172.21.15.63:47244) 2024-09-21T06:27:23.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.148+0000 7fc0d9cdb640 1 -- 172.21.15.63:0/2448770029 learned_addr learned my addr 172.21.15.63:0/2448770029 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:23.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.148+0000 7fc0d94da640 1 --2- 172.21.15.63:0/2448770029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d41083a0 0x7fc0d419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:23.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.148+0000 7fc0da4dc640 1 --2- 172.21.15.63:0/2448770029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d4108cf0 0x7fc0d41a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:23.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.148+0000 7fc0d9cdb640 1 -- 172.21.15.63:0/2448770029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d4108cf0 msgr2=0x7fc0d41a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:23.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.148+0000 7fc0d9cdb640 1 --2- 172.21.15.63:0/2448770029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d4108cf0 0x7fc0d41a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:23.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.148+0000 7fc0d9cdb640 1 -- 172.21.15.63:0/2448770029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d41083a0 msgr2=0x7fc0d419cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:23.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.148+0000 7fc0d9cdb640 1 --2- 172.21.15.63:0/2448770029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d41083a0 0x7fc0d419cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:23.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.148+0000 7fc0d9cdb640 1 -- 172.21.15.63:0/2448770029 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d41a25b0 con 0x7fc0d4102a60 2024-09-21T06:27:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.148+0000 7fc0d94da640 1 --2- 172.21.15.63:0/2448770029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d41083a0 0x7fc0d419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:27:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.149+0000 7fc0d9cdb640 1 --2- 172.21.15.63:0/2448770029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0d4102a60 0x7fc0d419c640 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400ebc0 tx=0x7fc0c400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.149+0000 7fc0d2ffd640 1 -- 172.21.15.63:0/2448770029 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4010630 con 0x7fc0d4102a60 2024-09-21T06:27:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.149+0000 7fc0d2ffd640 1 -- 172.21.15.63:0/2448770029 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0c4010c80 con 0x7fc0d4102a60 2024-09-21T06:27:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.149+0000 7fc0d2ffd640 1 -- 172.21.15.63:0/2448770029 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4018b60 con 0x7fc0d4102a60 2024-09-21T06:27:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.149+0000 7fc0dbf3f640 1 -- 172.21.15.63:0/2448770029 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d41a28a0 con 0x7fc0d4102a60 2024-09-21T06:27:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.149+0000 7fc0dbf3f640 1 -- 172.21.15.63:0/2448770029 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d41a9000 con 0x7fc0d4102a60 2024-09-21T06:27:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.150+0000 7fc0dbf3f640 1 -- 172.21.15.63:0/2448770029 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d4102e70 con 0x7fc0d4102a60 2024-09-21T06:27:23.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.153+0000 7fc0d2ffd640 1 -- 172.21.15.63:0/2448770029 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fc0c4018d00 con 0x7fc0d4102a60 2024-09-21T06:27:23.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.154+0000 7fc0d2ffd640 1 --2- 172.21.15.63:0/2448770029 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc0bc0b65d0 0x7fc0bc0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:23.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.154+0000 7fc0d94da640 1 --2- 172.21.15.63:0/2448770029 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc0bc0b65d0 0x7fc0bc0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:23.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.154+0000 7fc0d2ffd640 1 -- 172.21.15.63:0/2448770029 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fc0c40e8000 con 0x7fc0d4102a60 2024-09-21T06:27:23.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.154+0000 7fc0d94da640 1 --2- 172.21.15.63:0/2448770029 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc0bc0b65d0 0x7fc0bc0b8ae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4105ef0 tx=0x7fc0c800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:23.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.157+0000 7fc0d2ffd640 1 -- 172.21.15.63:0/2448770029 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc0c40b2a30 con 0x7fc0d4102a60 2024-09-21T06:27:23.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.352+0000 7fc0dbf3f640 1 -- 172.21.15.63:0/2448770029 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc0d410ab40 con 0x7fc0d4102a60 2024-09-21T06:27:23.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.353+0000 7fc0d2ffd640 1 -- 172.21.15.63:0/2448770029 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc0c40b7970 con 0x7fc0d4102a60 2024-09-21T06:27:23.355 INFO:teuthology.orchestra.run.smithi063.stdout:128849018941 2024-09-21T06:27:23.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.355+0000 7fc0dbf3f640 1 -- 172.21.15.63:0/2448770029 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc0bc0b65d0 msgr2=0x7fc0bc0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.355+0000 7fc0dbf3f640 1 --2- 172.21.15.63:0/2448770029 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc0bc0b65d0 0x7fc0bc0b8ae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4105ef0 tx=0x7fc0c800b390 comp rx=0 tx=0).stop 2024-09-21T06:27:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.355+0000 7fc0dbf3f640 1 -- 172.21.15.63:0/2448770029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0d4102a60 msgr2=0x7fc0d419c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.355+0000 7fc0dbf3f640 1 --2- 172.21.15.63:0/2448770029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0d4102a60 0x7fc0d419c640 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400ebc0 tx=0x7fc0c400c6a0 comp rx=0 tx=0).stop 2024-09-21T06:27:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.355+0000 7fc0dbf3f640 1 -- 172.21.15.63:0/2448770029 shutdown_connections 2024-09-21T06:27:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.355+0000 7fc0dbf3f640 1 --2- 172.21.15.63:0/2448770029 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc0bc0b65d0 0x7fc0bc0b8ae0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.355+0000 7fc0dbf3f640 1 --2- 172.21.15.63:0/2448770029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d4108cf0 0x7fc0d41a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.355+0000 7fc0dbf3f640 1 --2- 172.21.15.63:0/2448770029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d41083a0 0x7fc0d419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.355+0000 7fc0dbf3f640 1 --2- 172.21.15.63:0/2448770029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0d4102a60 0x7fc0d419c640 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.355+0000 7fc0dbf3f640 1 -- 172.21.15.63:0/2448770029 >> 172.21.15.63:0/2448770029 conn(0x7fc0d4079730 msgr2=0x7fc0d41043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.355+0000 7fc0dbf3f640 1 -- 172.21.15.63:0/2448770029 shutdown_connections 2024-09-21T06:27:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:23.355+0000 7fc0dbf3f640 1 -- 172.21.15.63:0/2448770029 wait complete. 2024-09-21T06:27:23.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:23 smithi063 ceph-mon[31150]: pgmap v297: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:23.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:23 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2448770029' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T06:27:24.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:23 smithi071 ceph-mon[34844]: pgmap v297: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:24.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:23 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2448770029' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T06:27:24.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:23 smithi175 ceph-mon[34510]: pgmap v297: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:24.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:23 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2448770029' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T06:27:24.230 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018938 got 128849018941 for osd.4 2024-09-21T06:27:24.231 DEBUG:teuthology.parallel:result is None 2024-09-21T06:27:24.231 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T06:27:24.231 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:27:24.610 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:25.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.121+0000 7fc701611640 1 -- 172.21.15.63:0/1884184190 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6fc104a30 msgr2=0x7fc6fc104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:25.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.121+0000 7fc701611640 1 --2- 172.21.15.63:0/1884184190 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6fc104a30 0x7fc6fc104e40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec009900 tx=0x7fc6ec02a410 comp rx=0 tx=0).stop 2024-09-21T06:27:25.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.121+0000 7fc701611640 1 -- 172.21.15.63:0/1884184190 shutdown_connections 2024-09-21T06:27:25.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.121+0000 7fc701611640 1 --2- 172.21.15.63:0/1884184190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6fc10de60 0x7fc6fc110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:25.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.121+0000 7fc701611640 1 --2- 172.21.15.63:0/1884184190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6fc105380 0x7fc6fc10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:25.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.121+0000 7fc701611640 1 --2- 172.21.15.63:0/1884184190 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6fc104a30 0x7fc6fc104e40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:25.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.121+0000 7fc701611640 1 -- 172.21.15.63:0/1884184190 >> 172.21.15.63:0/1884184190 conn(0x7fc6fc079760 msgr2=0x7fc6fc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.121+0000 7fc701611640 1 -- 172.21.15.63:0/1884184190 shutdown_connections 2024-09-21T06:27:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.121+0000 7fc701611640 1 -- 172.21.15.63:0/1884184190 wait complete. 2024-09-21T06:27:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.121+0000 7fc701611640 1 Processor -- start 2024-09-21T06:27:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.122+0000 7fc701611640 1 -- start start 2024-09-21T06:27:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.122+0000 7fc701611640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6fc104a30 0x7fc6fc19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.122+0000 7fc701611640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6fc105380 0x7fc6fc19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.122+0000 7fc701611640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6fc10de60 0x7fc6fc19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.122+0000 7fc701611640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc6fc113ac0 con 0x7fc6fc105380 2024-09-21T06:27:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.122+0000 7fc701611640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc6fc113940 con 0x7fc6fc104a30 2024-09-21T06:27:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.122+0000 7fc701611640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6fc113c40 con 0x7fc6fc10de60 2024-09-21T06:27:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.122+0000 7fc6fa7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6fc105380 0x7fc6fc19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.122+0000 7fc6fa7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6fc105380 0x7fc6fc19aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47250/0 (socket says 172.21.15.63:47250) 2024-09-21T06:27:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.122+0000 7fc6fa7fc640 1 -- 172.21.15.63:0/3587372401 learned_addr learned my addr 172.21.15.63:0/3587372401 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.122+0000 7fc6faffd640 1 --2- 172.21.15.63:0/3587372401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6fc104a30 0x7fc6fc19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.122+0000 7fc6fb7fe640 1 --2- 172.21.15.63:0/3587372401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6fc10de60 0x7fc6fc19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.123+0000 7fc6fa7fc640 1 -- 172.21.15.63:0/3587372401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6fc10de60 msgr2=0x7fc6fc19fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.123+0000 7fc6fa7fc640 1 --2- 172.21.15.63:0/3587372401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6fc10de60 0x7fc6fc19fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.123+0000 7fc6fa7fc640 1 -- 172.21.15.63:0/3587372401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6fc104a30 msgr2=0x7fc6fc19a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.123+0000 7fc6fa7fc640 1 --2- 172.21.15.63:0/3587372401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6fc104a30 0x7fc6fc19a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.123+0000 7fc6fa7fc640 1 -- 172.21.15.63:0/3587372401 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6fc1a0480 con 0x7fc6fc105380 2024-09-21T06:27:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.123+0000 7fc6fa7fc640 1 --2- 172.21.15.63:0/3587372401 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6fc105380 0x7fc6fc19aab0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc6f000d750 tx=0x7fc6f000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.123+0000 7fc6e3fff640 1 -- 172.21.15.63:0/3587372401 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0017070 con 0x7fc6fc105380 2024-09-21T06:27:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.123+0000 7fc701611640 1 -- 172.21.15.63:0/3587372401 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6fc1a0770 con 0x7fc6fc105380 2024-09-21T06:27:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.123+0000 7fc6e3fff640 1 -- 172.21.15.63:0/3587372401 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6f00054d0 con 0x7fc6fc105380 2024-09-21T06:27:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.123+0000 7fc6e3fff640 1 -- 172.21.15.63:0/3587372401 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0004c30 con 0x7fc6fc105380 2024-09-21T06:27:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.123+0000 7fc701611640 1 -- 172.21.15.63:0/3587372401 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6fc1a6ed0 con 0x7fc6fc105380 2024-09-21T06:27:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.124+0000 7fc701611640 1 -- 172.21.15.63:0/3587372401 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6fc06c1f0 con 0x7fc6fc105380 2024-09-21T06:27:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.127+0000 7fc6e3fff640 1 -- 172.21.15.63:0/3587372401 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fc6f0004dd0 con 0x7fc6fc105380 2024-09-21T06:27:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.127+0000 7fc6e3fff640 1 --2- 172.21.15.63:0/3587372401 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc6e40b65f0 0x7fc6e40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:25.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.127+0000 7fc6faffd640 1 --2- 172.21.15.63:0/3587372401 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc6e40b65f0 0x7fc6e40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:25.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.127+0000 7fc6e3fff640 1 -- 172.21.15.63:0/3587372401 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fc6f00e73a0 con 0x7fc6fc105380 2024-09-21T06:27:25.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.128+0000 7fc6faffd640 1 --2- 172.21.15.63:0/3587372401 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc6e40b65f0 0x7fc6e40b8b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec000c00 tx=0x7fc6ec031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:25.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.130+0000 7fc6e3fff640 1 -- 172.21.15.63:0/3587372401 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc6f00ad9f0 con 0x7fc6fc105380 2024-09-21T06:27:25.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.321+0000 7fc701611640 1 -- 172.21.15.63:0/3587372401 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc6fc108f70 con 0x7fc6e40b65f0 2024-09-21T06:27:25.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.326+0000 7fc6e3fff640 1 -- 172.21.15.63:0/3587372401 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259060 (secure 0 0 0) 0x7fc6fc108f70 con 0x7fc6e40b65f0 2024-09-21T06:27:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:27:25.332 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T06:27:25.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.330+0000 7fc701611640 1 -- 172.21.15.63:0/3587372401 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc6e40b65f0 msgr2=0x7fc6e40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:25.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.330+0000 7fc701611640 1 --2- 172.21.15.63:0/3587372401 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc6e40b65f0 0x7fc6e40b8b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec000c00 tx=0x7fc6ec031400 comp rx=0 tx=0).stop 2024-09-21T06:27:25.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.330+0000 7fc701611640 1 -- 172.21.15.63:0/3587372401 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6fc105380 msgr2=0x7fc6fc19aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:25.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.330+0000 7fc701611640 1 --2- 172.21.15.63:0/3587372401 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6fc105380 0x7fc6fc19aab0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc6f000d750 tx=0x7fc6f000dc10 comp rx=0 tx=0).stop 2024-09-21T06:27:25.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.330+0000 7fc701611640 1 -- 172.21.15.63:0/3587372401 shutdown_connections 2024-09-21T06:27:25.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.330+0000 7fc701611640 1 --2- 172.21.15.63:0/3587372401 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc6e40b65f0 0x7fc6e40b8b00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:25.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.330+0000 7fc701611640 1 --2- 172.21.15.63:0/3587372401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6fc10de60 0x7fc6fc19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:25.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.330+0000 7fc701611640 1 --2- 172.21.15.63:0/3587372401 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6fc105380 0x7fc6fc19aab0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:25.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.330+0000 7fc701611640 1 --2- 172.21.15.63:0/3587372401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6fc104a30 0x7fc6fc19a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:25.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.330+0000 7fc701611640 1 -- 172.21.15.63:0/3587372401 >> 172.21.15.63:0/3587372401 conn(0x7fc6fc079760 msgr2=0x7fc6fc1008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:25.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.330+0000 7fc701611640 1 -- 172.21.15.63:0/3587372401 shutdown_connections 2024-09-21T06:27:25.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:25.330+0000 7fc701611640 1 -- 172.21.15.63:0/3587372401 wait complete. 2024-09-21T06:27:25.983 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:25 smithi063 ceph-mon[31150]: pgmap v298: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:26.011 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2024-09-21T06:27:23.882293+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664254,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":625,"num_read_kb":421,"num_write":371,"num_write_kb":2296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":2953441,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376444,"kb_used_data":10524,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565380,"statfs":{"total":1151940427776,"available":1151554949120,"internally_reserved":0,"allocated":10776576,"data_stored":7014558,"data_compressed":183549,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003185"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962115+0000","last_change":"2024-09-21T06:26:18.307729+0000","last_active":"2024-09-21T06:26:38.962115+0000","last_peered":"2024-09-21T06:26:38.962115+0000","last_clean":"2024-09-21T06:26:38.962115+0000","last_became_active":"2024-09-21T06:26:18.306345+0000","last_became_peered":"2024-09-21T06:26:18.306345+0000","last_unstale":"2024-09-21T06:26:38.962115+0000","last_undegraded":"2024-09-21T06:26:38.962115+0000","last_fullsized":"2024-09-21T06:26:38.962115+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:58.409506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967037+0000","last_change":"2024-09-21T06:26:18.302982+0000","last_active":"2024-09-21T06:26:38.967037+0000","last_peered":"2024-09-21T06:26:38.967037+0000","last_clean":"2024-09-21T06:26:38.967037+0000","last_became_active":"2024-09-21T06:26:18.302636+0000","last_became_peered":"2024-09-21T06:26:18.302636+0000","last_unstale":"2024-09-21T06:26:38.967037+0000","last_undegraded":"2024-09-21T06:26:38.967037+0000","last_fullsized":"2024-09-21T06:26:38.967037+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:28.165964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967428+0000","last_change":"2024-09-21T06:26:18.305293+0000","last_active":"2024-09-21T06:26:38.967428+0000","last_peered":"2024-09-21T06:26:38.967428+0000","last_clean":"2024-09-21T06:26:38.967428+0000","last_became_active":"2024-09-21T06:26:18.304689+0000","last_became_peered":"2024-09-21T06:26:18.304689+0000","last_unstale":"2024-09-21T06:26:38.967428+0000","last_undegraded":"2024-09-21T06:26:38.967428+0000","last_fullsized":"2024-09-21T06:26:38.967428+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:37.442558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962224+0000","last_change":"2024-09-21T06:26:18.306443+0000","last_active":"2024-09-21T06:26:38.962224+0000","last_peered":"2024-09-21T06:26:38.962224+0000","last_clean":"2024-09-21T06:26:38.962224+0000","last_became_active":"2024-09-21T06:26:18.305062+0000","last_became_peered":"2024-09-21T06:26:18.305062+0000","last_unstale":"2024-09-21T06:26:38.962224+0000","last_undegraded":"2024-09-21T06:26:38.962224+0000","last_fullsized":"2024-09-21T06:26:38.962224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:07.896971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964110+0000","last_change":"2024-09-21T06:26:18.298857+0000","last_active":"2024-09-21T06:26:38.964110+0000","last_peered":"2024-09-21T06:26:38.964110+0000","last_clean":"2024-09-21T06:26:38.964110+0000","last_became_active":"2024-09-21T06:26:18.298439+0000","last_became_peered":"2024-09-21T06:26:18.298439+0000","last_unstale":"2024-09-21T06:26:38.964110+0000","last_undegraded":"2024-09-21T06:26:38.964110+0000","last_fullsized":"2024-09-21T06:26:38.964110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:24.695856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964685+0000","last_change":"2024-09-21T06:26:18.313029+0000","last_active":"2024-09-21T06:26:38.964685+0000","last_peered":"2024-09-21T06:26:38.964685+0000","last_clean":"2024-09-21T06:26:38.964685+0000","last_became_active":"2024-09-21T06:26:18.312627+0000","last_became_peered":"2024-09-21T06:26:18.312627+0000","last_unstale":"2024-09-21T06:26:38.964685+0000","last_undegraded":"2024-09-21T06:26:38.964685+0000","last_fullsized":"2024-09-21T06:26:38.964685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:23.086862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965223+0000","last_change":"2024-09-21T06:26:18.299082+0000","last_active":"2024-09-21T06:26:38.965223+0000","last_peered":"2024-09-21T06:26:38.965223+0000","last_clean":"2024-09-21T06:26:38.965223+0000","last_became_active":"2024-09-21T06:26:18.298279+0000","last_became_peered":"2024-09-21T06:26:18.298279+0000","last_unstale":"2024-09-21T06:26:38.965223+0000","last_undegraded":"2024-09-21T06:26:38.965223+0000","last_fullsized":"2024-09-21T06:26:38.965223+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:05.652407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963617+0000","last_change":"2024-09-21T06:26:18.298565+0000","last_active":"2024-09-21T06:26:38.963617+0000","last_peered":"2024-09-21T06:26:38.963617+0000","last_clean":"2024-09-21T06:26:38.963617+0000","last_became_active":"2024-09-21T06:26:18.298172+0000","last_became_peered":"2024-09-21T06:26:18.298172+0000","last_unstale":"2024-09-21T06:26:38.963617+0000","last_undegraded":"2024-09-21T06:26:38.963617+0000","last_fullsized":"2024-09-21T06:26:38.963617+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:33.045038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967371+0000","last_change":"2024-09-21T06:26:18.304901+0000","last_active":"2024-09-21T06:26:38.967371+0000","last_peered":"2024-09-21T06:26:38.967371+0000","last_clean":"2024-09-21T06:26:38.967371+0000","last_became_active":"2024-09-21T06:26:18.304521+0000","last_became_peered":"2024-09-21T06:26:18.304521+0000","last_unstale":"2024-09-21T06:26:38.967371+0000","last_undegraded":"2024-09-21T06:26:38.967371+0000","last_fullsized":"2024-09-21T06:26:38.967371+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:31.859554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.970297+0000","last_change":"2024-09-21T06:26:38.970119+0000","last_active":"2024-09-21T06:26:38.970297+0000","last_peered":"2024-09-21T06:26:38.970297+0000","last_clean":"2024-09-21T06:26:38.970297+0000","last_became_active":"2024-09-21T06:26:38.969521+0000","last_became_peered":"2024-09-21T06:26:38.969521+0000","last_unstale":"2024-09-21T06:26:38.970297+0000","last_undegraded":"2024-09-21T06:26:38.970297+0000","last_fullsized":"2024-09-21T06:26:38.970297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:54.407153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966009+0000","last_change":"2024-09-21T06:26:18.300178+0000","last_active":"2024-09-21T06:26:38.966009+0000","last_peered":"2024-09-21T06:26:38.966009+0000","last_clean":"2024-09-21T06:26:38.966009+0000","last_became_active":"2024-09-21T06:26:18.298651+0000","last_became_peered":"2024-09-21T06:26:18.298651+0000","last_unstale":"2024-09-21T06:26:38.966009+0000","last_undegraded":"2024-09-21T06:26:38.966009+0000","last_fullsized":"2024-09-21T06:26:38.966009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:07.261974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962238+0000","last_change":"2024-09-21T06:26:18.311310+0000","last_active":"2024-09-21T06:26:38.962238+0000","last_peered":"2024-09-21T06:26:38.962238+0000","last_clean":"2024-09-21T06:26:38.962238+0000","last_became_active":"2024-09-21T06:26:18.310671+0000","last_became_peered":"2024-09-21T06:26:18.310671+0000","last_unstale":"2024-09-21T06:26:38.962238+0000","last_undegraded":"2024-09-21T06:26:38.962238+0000","last_fullsized":"2024-09-21T06:26:38.962238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:52.060682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965742+0000","last_change":"2024-09-21T06:26:18.296958+0000","last_active":"2024-09-21T06:26:38.965742+0000","last_peered":"2024-09-21T06:26:38.965742+0000","last_clean":"2024-09-21T06:26:38.965742+0000","last_became_active":"2024-09-21T06:26:18.296081+0000","last_became_peered":"2024-09-21T06:26:18.296081+0000","last_unstale":"2024-09-21T06:26:38.965742+0000","last_undegraded":"2024-09-21T06:26:38.965742+0000","last_fullsized":"2024-09-21T06:26:38.965742+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:28.501906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966438+0000","last_change":"2024-09-21T06:26:18.301289+0000","last_active":"2024-09-21T06:26:38.966438+0000","last_peered":"2024-09-21T06:26:38.966438+0000","last_clean":"2024-09-21T06:26:38.966438+0000","last_became_active":"2024-09-21T06:26:18.300834+0000","last_became_peered":"2024-09-21T06:26:18.300834+0000","last_unstale":"2024-09-21T06:26:38.966438+0000","last_undegraded":"2024-09-21T06:26:38.966438+0000","last_fullsized":"2024-09-21T06:26:38.966438+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:31.206650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966259+0000","last_change":"2024-09-21T06:26:18.312436+0000","last_active":"2024-09-21T06:26:38.966259+0000","last_peered":"2024-09-21T06:26:38.966259+0000","last_clean":"2024-09-21T06:26:38.966259+0000","last_became_active":"2024-09-21T06:26:18.311230+0000","last_became_peered":"2024-09-21T06:26:18.311230+0000","last_unstale":"2024-09-21T06:26:38.966259+0000","last_undegraded":"2024-09-21T06:26:38.966259+0000","last_fullsized":"2024-09-21T06:26:38.966259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:07.163105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966586+0000","last_change":"2024-09-21T06:26:18.307775+0000","last_active":"2024-09-21T06:26:38.966586+0000","last_peered":"2024-09-21T06:26:38.966586+0000","last_clean":"2024-09-21T06:26:38.966586+0000","last_became_active":"2024-09-21T06:26:18.307326+0000","last_became_peered":"2024-09-21T06:26:18.307326+0000","last_unstale":"2024-09-21T06:26:38.966586+0000","last_undegraded":"2024-09-21T06:26:38.966586+0000","last_fullsized":"2024-09-21T06:26:38.966586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:18.213503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962147+0000","last_change":"2024-09-21T06:26:18.309004+0000","last_active":"2024-09-21T06:26:38.962147+0000","last_peered":"2024-09-21T06:26:38.962147+0000","last_clean":"2024-09-21T06:26:38.962147+0000","last_became_active":"2024-09-21T06:26:18.306098+0000","last_became_peered":"2024-09-21T06:26:18.306098+0000","last_unstale":"2024-09-21T06:26:38.962147+0000","last_undegraded":"2024-09-21T06:26:38.962147+0000","last_fullsized":"2024-09-21T06:26:38.962147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:09.102610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965512+0000","last_change":"2024-09-21T06:26:18.306699+0000","last_active":"2024-09-21T06:26:38.965512+0000","last_peered":"2024-09-21T06:26:38.965512+0000","last_clean":"2024-09-21T06:26:38.965512+0000","last_became_active":"2024-09-21T06:26:18.306352+0000","last_became_peered":"2024-09-21T06:26:18.306352+0000","last_unstale":"2024-09-21T06:26:38.965512+0000","last_undegraded":"2024-09-21T06:26:38.965512+0000","last_fullsized":"2024-09-21T06:26:38.965512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:47.992315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.968447+0000","last_change":"2024-09-21T06:26:18.301677+0000","last_active":"2024-09-21T06:26:38.968447+0000","last_peered":"2024-09-21T06:26:38.968447+0000","last_clean":"2024-09-21T06:26:38.968447+0000","last_became_active":"2024-09-21T06:26:18.301260+0000","last_became_peered":"2024-09-21T06:26:18.301260+0000","last_unstale":"2024-09-21T06:26:38.968447+0000","last_undegraded":"2024-09-21T06:26:38.968447+0000","last_fullsized":"2024-09-21T06:26:38.968447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:53.209062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.961797+0000","last_change":"2024-09-21T06:26:18.312004+0000","last_active":"2024-09-21T06:26:38.961797+0000","last_peered":"2024-09-21T06:26:38.961797+0000","last_clean":"2024-09-21T06:26:38.961797+0000","last_became_active":"2024-09-21T06:26:18.311602+0000","last_became_peered":"2024-09-21T06:26:18.311602+0000","last_unstale":"2024-09-21T06:26:38.961797+0000","last_undegraded":"2024-09-21T06:26:38.961797+0000","last_fullsized":"2024-09-21T06:26:38.961797+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:30.074887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965890+0000","last_change":"2024-09-21T06:26:18.296581+0000","last_active":"2024-09-21T06:26:38.965890+0000","last_peered":"2024-09-21T06:26:38.965890+0000","last_clean":"2024-09-21T06:26:38.965890+0000","last_became_active":"2024-09-21T06:26:18.296078+0000","last_became_peered":"2024-09-21T06:26:18.296078+0000","last_unstale":"2024-09-21T06:26:38.965890+0000","last_undegraded":"2024-09-21T06:26:38.965890+0000","last_fullsized":"2024-09-21T06:26:38.965890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:39.120626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966804+0000","last_change":"2024-09-21T06:26:18.307793+0000","last_active":"2024-09-21T06:26:38.966804+0000","last_peered":"2024-09-21T06:26:38.966804+0000","last_clean":"2024-09-21T06:26:38.966804+0000","last_became_active":"2024-09-21T06:26:18.307310+0000","last_became_peered":"2024-09-21T06:26:18.307310+0000","last_unstale":"2024-09-21T06:26:38.966804+0000","last_undegraded":"2024-09-21T06:26:38.966804+0000","last_fullsized":"2024-09-21T06:26:38.966804+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:11.761986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963619+0000","last_change":"2024-09-21T06:26:18.305700+0000","last_active":"2024-09-21T06:26:38.963619+0000","last_peered":"2024-09-21T06:26:38.963619+0000","last_clean":"2024-09-21T06:26:38.963619+0000","last_became_active":"2024-09-21T06:26:18.305319+0000","last_became_peered":"2024-09-21T06:26:18.305319+0000","last_unstale":"2024-09-21T06:26:38.963619+0000","last_undegraded":"2024-09-21T06:26:38.963619+0000","last_fullsized":"2024-09-21T06:26:38.963619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:52.479565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971092+0000","last_change":"2024-09-21T06:26:18.304111+0000","last_active":"2024-09-21T06:26:38.971092+0000","last_peered":"2024-09-21T06:26:38.971092+0000","last_clean":"2024-09-21T06:26:38.971092+0000","last_became_active":"2024-09-21T06:26:18.302716+0000","last_became_peered":"2024-09-21T06:26:18.302716+0000","last_unstale":"2024-09-21T06:26:38.971092+0000","last_undegraded":"2024-09-21T06:26:38.971092+0000","last_fullsized":"2024-09-21T06:26:38.971092+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:39.298737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964408+0000","last_change":"2024-09-21T06:26:18.310154+0000","last_active":"2024-09-21T06:26:38.964408+0000","last_peered":"2024-09-21T06:26:38.964408+0000","last_clean":"2024-09-21T06:26:38.964408+0000","last_became_active":"2024-09-21T06:26:18.309735+0000","last_became_peered":"2024-09-21T06:26:18.309735+0000","last_unstale":"2024-09-21T06:26:38.964408+0000","last_undegraded":"2024-09-21T06:26:38.964408+0000","last_fullsized":"2024-09-21T06:26:38.964408+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:42:37.535841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.968784+0000","last_change":"2024-09-21T06:26:18.312302+0000","last_active":"2024-09-21T06:26:38.968784+0000","last_peered":"2024-09-21T06:26:38.968784+0000","last_clean":"2024-09-21T06:26:38.968784+0000","last_became_active":"2024-09-21T06:26:18.311950+0000","last_became_peered":"2024-09-21T06:26:18.311950+0000","last_unstale":"2024-09-21T06:26:38.968784+0000","last_undegraded":"2024-09-21T06:26:38.968784+0000","last_fullsized":"2024-09-21T06:26:38.968784+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:03.899946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962182+0000","last_change":"2024-09-21T06:26:18.308291+0000","last_active":"2024-09-21T06:26:38.962182+0000","last_peered":"2024-09-21T06:26:38.962182+0000","last_clean":"2024-09-21T06:26:38.962182+0000","last_became_active":"2024-09-21T06:26:18.307907+0000","last_became_peered":"2024-09-21T06:26:18.307907+0000","last_unstale":"2024-09-21T06:26:38.962182+0000","last_undegraded":"2024-09-21T06:26:38.962182+0000","last_fullsized":"2024-09-21T06:26:38.962182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:17.418996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965105+0000","last_change":"2024-09-21T06:26:18.311774+0000","last_active":"2024-09-21T06:26:38.965105+0000","last_peered":"2024-09-21T06:26:38.965105+0000","last_clean":"2024-09-21T06:26:38.965105+0000","last_became_active":"2024-09-21T06:26:18.311373+0000","last_became_peered":"2024-09-21T06:26:18.311373+0000","last_unstale":"2024-09-21T06:26:38.965105+0000","last_undegraded":"2024-09-21T06:26:38.965105+0000","last_fullsized":"2024-09-21T06:26:38.965105+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:08.310931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.977753+0000","last_change":"2024-09-21T06:26:38.977655+0000","last_active":"2024-09-21T06:26:38.977753+0000","last_peered":"2024-09-21T06:26:38.977753+0000","last_clean":"2024-09-21T06:26:38.977753+0000","last_became_active":"2024-09-21T06:26:38.977309+0000","last_became_peered":"2024-09-21T06:26:38.977309+0000","last_unstale":"2024-09-21T06:26:38.977753+0000","last_undegraded":"2024-09-21T06:26:38.977753+0000","last_fullsized":"2024-09-21T06:26:38.977753+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:10.083264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967567+0000","last_change":"2024-09-21T06:26:18.302851+0000","last_active":"2024-09-21T06:26:38.967567+0000","last_peered":"2024-09-21T06:26:38.967567+0000","last_clean":"2024-09-21T06:26:38.967567+0000","last_became_active":"2024-09-21T06:26:18.302120+0000","last_became_peered":"2024-09-21T06:26:18.302120+0000","last_unstale":"2024-09-21T06:26:38.967567+0000","last_undegraded":"2024-09-21T06:26:38.967567+0000","last_fullsized":"2024-09-21T06:26:38.967567+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:18.442711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967011+0000","last_change":"2024-09-21T06:26:18.310447+0000","last_active":"2024-09-21T06:26:38.967011+0000","last_peered":"2024-09-21T06:26:38.967011+0000","last_clean":"2024-09-21T06:26:38.967011+0000","last_became_active":"2024-09-21T06:26:18.310079+0000","last_became_peered":"2024-09-21T06:26:18.310079+0000","last_unstale":"2024-09-21T06:26:38.967011+0000","last_undegraded":"2024-09-21T06:26:38.967011+0000","last_fullsized":"2024-09-21T06:26:38.967011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:14.364382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.961670+0000","last_change":"2024-09-21T06:26:18.307260+0000","last_active":"2024-09-21T06:26:38.961670+0000","last_peered":"2024-09-21T06:26:38.961670+0000","last_clean":"2024-09-21T06:26:38.961670+0000","last_became_active":"2024-09-21T06:26:18.306131+0000","last_became_peered":"2024-09-21T06:26:18.306131+0000","last_unstale":"2024-09-21T06:26:38.961670+0000","last_undegraded":"2024-09-21T06:26:38.961670+0000","last_fullsized":"2024-09-21T06:26:38.961670+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:14.746652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964110+0000","last_change":"2024-09-21T06:26:18.292714+0000","last_active":"2024-09-21T06:26:38.964110+0000","last_peered":"2024-09-21T06:26:38.964110+0000","last_clean":"2024-09-21T06:26:38.964110+0000","last_became_active":"2024-09-21T06:26:18.292322+0000","last_became_peered":"2024-09-21T06:26:18.292322+0000","last_unstale":"2024-09-21T06:26:38.964110+0000","last_undegraded":"2024-09-21T06:26:38.964110+0000","last_fullsized":"2024-09-21T06:26:38.964110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:51.017455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":81,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:27:17.835872+0000","last_change":"2024-09-21T06:26:16.269788+0000","last_active":"2024-09-21T06:27:17.835872+0000","last_peered":"2024-09-21T06:27:17.835872+0000","last_clean":"2024-09-21T06:27:17.835872+0000","last_became_active":"2024-09-21T06:26:16.269342+0000","last_became_peered":"2024-09-21T06:26:16.269342+0000","last_unstale":"2024-09-21T06:27:17.835872+0000","last_undegraded":"2024-09-21T06:27:17.835872+0000","last_fullsized":"2024-09-21T06:27:17.835872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:34.782237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.970505+0000","last_change":"2024-09-21T06:26:38.970396+0000","last_active":"2024-09-21T06:26:38.970505+0000","last_peered":"2024-09-21T06:26:38.970505+0000","last_clean":"2024-09-21T06:26:38.970505+0000","last_became_active":"2024-09-21T06:26:38.969976+0000","last_became_peered":"2024-09-21T06:26:38.969976+0000","last_unstale":"2024-09-21T06:26:38.970505+0000","last_undegraded":"2024-09-21T06:26:38.970505+0000","last_fullsized":"2024-09-21T06:26:38.970505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:44.540563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,3],"acting":[9,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964833+0000","last_change":"2024-09-21T06:26:16.272832+0000","last_active":"2024-09-21T06:26:38.964833+0000","last_peered":"2024-09-21T06:26:38.964833+0000","last_clean":"2024-09-21T06:26:38.964833+0000","last_became_active":"2024-09-21T06:26:16.272447+0000","last_became_peered":"2024-09-21T06:26:16.272447+0000","last_unstale":"2024-09-21T06:26:38.964833+0000","last_undegraded":"2024-09-21T06:26:38.964833+0000","last_fullsized":"2024-09-21T06:26:38.964833+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:22.836267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966506+0000","last_change":"2024-09-21T06:26:16.269067+0000","last_active":"2024-09-21T06:26:38.966506+0000","last_peered":"2024-09-21T06:26:38.966506+0000","last_clean":"2024-09-21T06:26:38.966506+0000","last_became_active":"2024-09-21T06:26:16.268524+0000","last_became_peered":"2024-09-21T06:26:16.268524+0000","last_unstale":"2024-09-21T06:26:38.966506+0000","last_undegraded":"2024-09-21T06:26:38.966506+0000","last_fullsized":"2024-09-21T06:26:38.966506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:32.224321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963670+0000","last_change":"2024-09-21T06:26:18.306489+0000","last_active":"2024-09-21T06:26:38.963670+0000","last_peered":"2024-09-21T06:26:38.963670+0000","last_clean":"2024-09-21T06:26:38.963670+0000","last_became_active":"2024-09-21T06:26:18.305883+0000","last_became_peered":"2024-09-21T06:26:18.305883+0000","last_unstale":"2024-09-21T06:26:38.963670+0000","last_undegraded":"2024-09-21T06:26:38.963670+0000","last_fullsized":"2024-09-21T06:26:38.963670+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:54.012308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971279+0000","last_change":"2024-09-21T06:26:16.269793+0000","last_active":"2024-09-21T06:26:38.971279+0000","last_peered":"2024-09-21T06:26:38.971279+0000","last_clean":"2024-09-21T06:26:38.971279+0000","last_became_active":"2024-09-21T06:26:16.269455+0000","last_became_peered":"2024-09-21T06:26:16.269455+0000","last_unstale":"2024-09-21T06:26:38.971279+0000","last_undegraded":"2024-09-21T06:26:38.971279+0000","last_fullsized":"2024-09-21T06:26:38.971279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:44.369742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965132+0000","last_change":"2024-09-21T06:26:18.297573+0000","last_active":"2024-09-21T06:26:38.965132+0000","last_peered":"2024-09-21T06:26:38.965132+0000","last_clean":"2024-09-21T06:26:38.965132+0000","last_became_active":"2024-09-21T06:26:18.297190+0000","last_became_peered":"2024-09-21T06:26:18.297190+0000","last_unstale":"2024-09-21T06:26:38.965132+0000","last_undegraded":"2024-09-21T06:26:38.965132+0000","last_fullsized":"2024-09-21T06:26:38.965132+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:28.055520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'4","reported_seq":129,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:27:18.836385+0000","last_change":"2024-09-21T06:26:16.273604+0000","last_active":"2024-09-21T06:27:18.836385+0000","last_peered":"2024-09-21T06:27:18.836385+0000","last_clean":"2024-09-21T06:27:18.836385+0000","last_became_active":"2024-09-21T06:26:16.273194+0000","last_became_peered":"2024-09-21T06:26:16.273194+0000","last_unstale":"2024-09-21T06:27:18.836385+0000","last_undegraded":"2024-09-21T06:27:18.836385+0000","last_fullsized":"2024-09-21T06:27:18.836385+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:08.218442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966787+0000","last_change":"2024-09-21T06:26:18.303960+0000","last_active":"2024-09-21T06:26:38.966787+0000","last_peered":"2024-09-21T06:26:38.966787+0000","last_clean":"2024-09-21T06:26:38.966787+0000","last_became_active":"2024-09-21T06:26:18.303550+0000","last_became_peered":"2024-09-21T06:26:18.303550+0000","last_unstale":"2024-09-21T06:26:38.966787+0000","last_undegraded":"2024-09-21T06:26:38.966787+0000","last_fullsized":"2024-09-21T06:26:38.966787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:47.331439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.978327+0000","last_change":"2024-09-21T06:26:38.978161+0000","last_active":"2024-09-21T06:26:38.978327+0000","last_peered":"2024-09-21T06:26:38.978327+0000","last_clean":"2024-09-21T06:26:38.978327+0000","last_became_active":"2024-09-21T06:26:38.970818+0000","last_became_peered":"2024-09-21T06:26:38.970818+0000","last_unstale":"2024-09-21T06:26:38.978327+0000","last_undegraded":"2024-09-21T06:26:38.978327+0000","last_fullsized":"2024-09-21T06:26:38.978327+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:55.273463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967598+0000","last_change":"2024-09-21T06:26:18.311643+0000","last_active":"2024-09-21T06:26:38.967598+0000","last_peered":"2024-09-21T06:26:38.967598+0000","last_clean":"2024-09-21T06:26:38.967598+0000","last_became_active":"2024-09-21T06:26:18.311246+0000","last_became_peered":"2024-09-21T06:26:18.311246+0000","last_unstale":"2024-09-21T06:26:38.967598+0000","last_undegraded":"2024-09-21T06:26:38.967598+0000","last_fullsized":"2024-09-21T06:26:38.967598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:00.342212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971107+0000","last_change":"2024-09-21T06:26:16.313648+0000","last_active":"2024-09-21T06:26:38.971107+0000","last_peered":"2024-09-21T06:26:38.971107+0000","last_clean":"2024-09-21T06:26:38.971107+0000","last_became_active":"2024-09-21T06:26:16.313337+0000","last_became_peered":"2024-09-21T06:26:16.313337+0000","last_unstale":"2024-09-21T06:26:38.971107+0000","last_undegraded":"2024-09-21T06:26:38.971107+0000","last_fullsized":"2024-09-21T06:26:38.971107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:12.095276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966410+0000","last_change":"2024-09-21T06:26:18.310168+0000","last_active":"2024-09-21T06:26:38.966410+0000","last_peered":"2024-09-21T06:26:38.966410+0000","last_clean":"2024-09-21T06:26:38.966410+0000","last_became_active":"2024-09-21T06:26:18.309756+0000","last_became_peered":"2024-09-21T06:26:18.309756+0000","last_unstale":"2024-09-21T06:26:38.966410+0000","last_undegraded":"2024-09-21T06:26:38.966410+0000","last_fullsized":"2024-09-21T06:26:38.966410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:07.203202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'32","reported_seq":167,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:27:18.836425+0000","last_change":"2024-09-21T06:26:16.270243+0000","last_active":"2024-09-21T06:27:18.836425+0000","last_peered":"2024-09-21T06:27:18.836425+0000","last_clean":"2024-09-21T06:27:18.836425+0000","last_became_active":"2024-09-21T06:26:16.269883+0000","last_became_peered":"2024-09-21T06:26:16.269883+0000","last_unstale":"2024-09-21T06:27:18.836425+0000","last_undegraded":"2024-09-21T06:27:18.836425+0000","last_fullsized":"2024-09-21T06:27:18.836425+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:55.906972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66448,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":112,"num_read_kb":120,"num_write":34,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964370+0000","last_change":"2024-09-21T06:26:18.305508+0000","last_active":"2024-09-21T06:26:38.964370+0000","last_peered":"2024-09-21T06:26:38.964370+0000","last_clean":"2024-09-21T06:26:38.964370+0000","last_became_active":"2024-09-21T06:26:18.305104+0000","last_became_peered":"2024-09-21T06:26:18.305104+0000","last_unstale":"2024-09-21T06:26:38.964370+0000","last_undegraded":"2024-09-21T06:26:38.964370+0000","last_fullsized":"2024-09-21T06:26:38.964370+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:14.727084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'9","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.969025+0000","last_change":"2024-09-21T06:26:16.268331+0000","last_active":"2024-09-21T06:26:38.969025+0000","last_peered":"2024-09-21T06:26:38.969025+0000","last_clean":"2024-09-21T06:26:38.969025+0000","last_became_active":"2024-09-21T06:26:16.267918+0000","last_became_peered":"2024-09-21T06:26:16.267918+0000","last_unstale":"2024-09-21T06:26:38.969025+0000","last_undegraded":"2024-09-21T06:26:38.969025+0000","last_fullsized":"2024-09-21T06:26:38.969025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:50.198883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965178+0000","last_change":"2024-09-21T06:26:18.298052+0000","last_active":"2024-09-21T06:26:38.965178+0000","last_peered":"2024-09-21T06:26:38.965178+0000","last_clean":"2024-09-21T06:26:38.965178+0000","last_became_active":"2024-09-21T06:26:18.297686+0000","last_became_peered":"2024-09-21T06:26:18.297686+0000","last_unstale":"2024-09-21T06:26:38.965178+0000","last_undegraded":"2024-09-21T06:26:38.965178+0000","last_fullsized":"2024-09-21T06:26:38.965178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:56.261608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.970277+0000","last_change":"2024-09-21T06:26:16.270917+0000","last_active":"2024-09-21T06:26:38.970277+0000","last_peered":"2024-09-21T06:26:38.970277+0000","last_clean":"2024-09-21T06:26:38.970277+0000","last_became_active":"2024-09-21T06:26:16.270530+0000","last_became_peered":"2024-09-21T06:26:16.270530+0000","last_unstale":"2024-09-21T06:26:38.970277+0000","last_undegraded":"2024-09-21T06:26:38.970277+0000","last_fullsized":"2024-09-21T06:26:38.970277+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:30.772991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965618+0000","last_change":"2024-09-21T06:26:18.302286+0000","last_active":"2024-09-21T06:26:38.965618+0000","last_peered":"2024-09-21T06:26:38.965618+0000","last_clean":"2024-09-21T06:26:38.965618+0000","last_became_active":"2024-09-21T06:26:18.301777+0000","last_became_peered":"2024-09-21T06:26:18.301777+0000","last_unstale":"2024-09-21T06:26:38.965618+0000","last_undegraded":"2024-09-21T06:26:38.965618+0000","last_fullsized":"2024-09-21T06:26:38.965618+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:31.339898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":86,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:27:20.840257+0000","last_change":"2024-09-21T06:26:16.267569+0000","last_active":"2024-09-21T06:27:20.840257+0000","last_peered":"2024-09-21T06:27:20.840257+0000","last_clean":"2024-09-21T06:27:20.840257+0000","last_became_active":"2024-09-21T06:26:16.267198+0000","last_became_peered":"2024-09-21T06:26:16.267198+0000","last_unstale":"2024-09-21T06:27:20.840257+0000","last_undegraded":"2024-09-21T06:27:20.840257+0000","last_fullsized":"2024-09-21T06:27:20.840257+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:16.323246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964474+0000","last_change":"2024-09-21T06:26:18.294473+0000","last_active":"2024-09-21T06:26:38.964474+0000","last_peered":"2024-09-21T06:26:38.964474+0000","last_clean":"2024-09-21T06:26:38.964474+0000","last_became_active":"2024-09-21T06:26:18.294010+0000","last_became_peered":"2024-09-21T06:26:18.294010+0000","last_unstale":"2024-09-21T06:26:38.964474+0000","last_undegraded":"2024-09-21T06:26:38.964474+0000","last_fullsized":"2024-09-21T06:26:38.964474+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:12.098589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'17","reported_seq":66,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.994281+0000","last_change":"2024-09-21T06:26:38.994178+0000","last_active":"2024-09-21T06:26:38.994281+0000","last_peered":"2024-09-21T06:26:38.994281+0000","last_clean":"2024-09-21T06:26:38.994281+0000","last_became_active":"2024-09-21T06:26:38.977865+0000","last_became_peered":"2024-09-21T06:26:38.977865+0000","last_unstale":"2024-09-21T06:26:38.994281+0000","last_undegraded":"2024-09-21T06:26:38.994281+0000","last_fullsized":"2024-09-21T06:26:38.994281+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:44.368499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.969981+0000","last_change":"2024-09-21T06:26:18.312319+0000","last_active":"2024-09-21T06:26:38.969981+0000","last_peered":"2024-09-21T06:26:38.969981+0000","last_clean":"2024-09-21T06:26:38.969981+0000","last_became_active":"2024-09-21T06:26:18.311949+0000","last_became_peered":"2024-09-21T06:26:18.311949+0000","last_unstale":"2024-09-21T06:26:38.969981+0000","last_undegraded":"2024-09-21T06:26:38.969981+0000","last_fullsized":"2024-09-21T06:26:38.969981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:49.729693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964667+0000","last_change":"2024-09-21T06:26:16.273771+0000","last_active":"2024-09-21T06:26:38.964667+0000","last_peered":"2024-09-21T06:26:38.964667+0000","last_clean":"2024-09-21T06:26:38.964667+0000","last_became_active":"2024-09-21T06:26:16.273293+0000","last_became_peered":"2024-09-21T06:26:16.273293+0000","last_unstale":"2024-09-21T06:26:38.964667+0000","last_undegraded":"2024-09-21T06:26:38.964667+0000","last_fullsized":"2024-09-21T06:26:38.964667+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:21.867844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.961892+0000","last_change":"2024-09-21T06:26:18.309204+0000","last_active":"2024-09-21T06:26:38.961892+0000","last_peered":"2024-09-21T06:26:38.961892+0000","last_clean":"2024-09-21T06:26:38.961892+0000","last_became_active":"2024-09-21T06:26:18.308838+0000","last_became_peered":"2024-09-21T06:26:18.308838+0000","last_unstale":"2024-09-21T06:26:38.961892+0000","last_undegraded":"2024-09-21T06:26:38.961892+0000","last_fullsized":"2024-09-21T06:26:38.961892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:14.011799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'5","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965404+0000","last_change":"2024-09-21T06:26:16.267965+0000","last_active":"2024-09-21T06:26:38.965404+0000","last_peered":"2024-09-21T06:26:38.965404+0000","last_clean":"2024-09-21T06:26:38.965404+0000","last_became_active":"2024-09-21T06:26:16.267548+0000","last_became_peered":"2024-09-21T06:26:16.267548+0000","last_unstale":"2024-09-21T06:26:38.965404+0000","last_undegraded":"2024-09-21T06:26:38.965404+0000","last_fullsized":"2024-09-21T06:26:38.965404+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:51.915817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965963+0000","last_change":"2024-09-21T06:26:18.306376+0000","last_active":"2024-09-21T06:26:38.965963+0000","last_peered":"2024-09-21T06:26:38.965963+0000","last_clean":"2024-09-21T06:26:38.965963+0000","last_became_active":"2024-09-21T06:26:18.305956+0000","last_became_peered":"2024-09-21T06:26:18.305956+0000","last_unstale":"2024-09-21T06:26:38.965963+0000","last_undegraded":"2024-09-21T06:26:38.965963+0000","last_fullsized":"2024-09-21T06:26:38.965963+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:27.229499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971383+0000","last_change":"2024-09-21T06:26:16.267201+0000","last_active":"2024-09-21T06:26:38.971383+0000","last_peered":"2024-09-21T06:26:38.971383+0000","last_clean":"2024-09-21T06:26:38.971383+0000","last_became_active":"2024-09-21T06:26:16.266832+0000","last_became_peered":"2024-09-21T06:26:16.266832+0000","last_unstale":"2024-09-21T06:26:38.971383+0000","last_undegraded":"2024-09-21T06:26:38.971383+0000","last_fullsized":"2024-09-21T06:26:38.971383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:48.626106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.984188+0000","last_change":"2024-09-21T06:26:38.984119+0000","last_active":"2024-09-21T06:26:38.984188+0000","last_peered":"2024-09-21T06:26:38.984188+0000","last_clean":"2024-09-21T06:26:38.984188+0000","last_became_active":"2024-09-21T06:26:38.972316+0000","last_became_peered":"2024-09-21T06:26:38.972316+0000","last_unstale":"2024-09-21T06:26:38.984188+0000","last_undegraded":"2024-09-21T06:26:38.984188+0000","last_fullsized":"2024-09-21T06:26:38.984188+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:22.788293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'6","reported_seq":85,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:27:19.838322+0000","last_change":"2024-09-21T06:26:16.572993+0000","last_active":"2024-09-21T06:27:19.838322+0000","last_peered":"2024-09-21T06:27:19.838322+0000","last_clean":"2024-09-21T06:27:19.838322+0000","last_became_active":"2024-09-21T06:26:16.572631+0000","last_became_peered":"2024-09-21T06:26:16.572631+0000","last_unstale":"2024-09-21T06:27:19.838322+0000","last_undegraded":"2024-09-21T06:27:19.838322+0000","last_fullsized":"2024-09-21T06:27:19.838322+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:05.276119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966079+0000","last_change":"2024-09-21T06:26:18.304685+0000","last_active":"2024-09-21T06:26:38.966079+0000","last_peered":"2024-09-21T06:26:38.966079+0000","last_clean":"2024-09-21T06:26:38.966079+0000","last_became_active":"2024-09-21T06:26:18.304325+0000","last_became_peered":"2024-09-21T06:26:18.304325+0000","last_unstale":"2024-09-21T06:26:38.966079+0000","last_undegraded":"2024-09-21T06:26:38.966079+0000","last_fullsized":"2024-09-21T06:26:38.966079+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:18.072602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965169+0000","last_change":"2024-09-21T06:25:04.875443+0000","last_active":"2024-09-21T06:26:38.965169+0000","last_peered":"2024-09-21T06:26:38.965169+0000","last_clean":"2024-09-21T06:26:38.965169+0000","last_became_active":"2024-09-21T06:25:04.869179+0000","last_became_peered":"2024-09-21T06:25:04.869179+0000","last_unstale":"2024-09-21T06:26:38.965169+0000","last_undegraded":"2024-09-21T06:26:38.965169+0000","last_fullsized":"2024-09-21T06:26:38.965169+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:21:37.191501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:21:37.191501+0000","last_clean_scrub_stamp":"2024-09-21T06:21:37.191501+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:19.981367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'6","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962414+0000","last_change":"2024-09-21T06:26:16.268440+0000","last_active":"2024-09-21T06:26:38.962414+0000","last_peered":"2024-09-21T06:26:38.962414+0000","last_clean":"2024-09-21T06:26:38.962414+0000","last_became_active":"2024-09-21T06:26:16.268078+0000","last_became_peered":"2024-09-21T06:26:16.268078+0000","last_unstale":"2024-09-21T06:26:38.962414+0000","last_undegraded":"2024-09-21T06:26:38.962414+0000","last_fullsized":"2024-09-21T06:26:38.962414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:55.696736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963878+0000","last_change":"2024-09-21T06:26:18.306410+0000","last_active":"2024-09-21T06:26:38.963878+0000","last_peered":"2024-09-21T06:26:38.963878+0000","last_clean":"2024-09-21T06:26:38.963878+0000","last_became_active":"2024-09-21T06:26:18.304718+0000","last_became_peered":"2024-09-21T06:26:18.304718+0000","last_unstale":"2024-09-21T06:26:38.963878+0000","last_undegraded":"2024-09-21T06:26:38.963878+0000","last_fullsized":"2024-09-21T06:26:38.963878+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:18.521867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964484+0000","last_change":"2024-09-21T06:26:16.270305+0000","last_active":"2024-09-21T06:26:38.964484+0000","last_peered":"2024-09-21T06:26:38.964484+0000","last_clean":"2024-09-21T06:26:38.964484+0000","last_became_active":"2024-09-21T06:26:16.269891+0000","last_became_peered":"2024-09-21T06:26:16.269891+0000","last_unstale":"2024-09-21T06:26:38.964484+0000","last_undegraded":"2024-09-21T06:26:38.964484+0000","last_fullsized":"2024-09-21T06:26:38.964484+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:48.575805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966049+0000","last_change":"2024-09-21T06:26:18.302404+0000","last_active":"2024-09-21T06:26:38.966049+0000","last_peered":"2024-09-21T06:26:38.966049+0000","last_clean":"2024-09-21T06:26:38.966049+0000","last_became_active":"2024-09-21T06:26:18.302036+0000","last_became_peered":"2024-09-21T06:26:18.302036+0000","last_unstale":"2024-09-21T06:26:38.966049+0000","last_undegraded":"2024-09-21T06:26:38.966049+0000","last_fullsized":"2024-09-21T06:26:38.966049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:36.688018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":81,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:27:18.837086+0000","last_change":"2024-09-21T06:26:16.310996+0000","last_active":"2024-09-21T06:27:18.837086+0000","last_peered":"2024-09-21T06:27:18.837086+0000","last_clean":"2024-09-21T06:27:18.837086+0000","last_became_active":"2024-09-21T06:26:16.310566+0000","last_became_peered":"2024-09-21T06:26:16.310566+0000","last_unstale":"2024-09-21T06:27:18.837086+0000","last_undegraded":"2024-09-21T06:27:18.837086+0000","last_fullsized":"2024-09-21T06:27:18.837086+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:27.569789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971180+0000","last_change":"2024-09-21T06:26:18.310343+0000","last_active":"2024-09-21T06:26:38.971180+0000","last_peered":"2024-09-21T06:26:38.971180+0000","last_clean":"2024-09-21T06:26:38.971180+0000","last_became_active":"2024-09-21T06:26:18.309979+0000","last_became_peered":"2024-09-21T06:26:18.309979+0000","last_unstale":"2024-09-21T06:26:38.971180+0000","last_undegraded":"2024-09-21T06:26:38.971180+0000","last_fullsized":"2024-09-21T06:26:38.971180+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:20.340822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'5","reported_seq":60,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:27:19.031743+0000","last_change":"2024-09-21T06:26:38.974313+0000","last_active":"2024-09-21T06:27:19.031743+0000","last_peered":"2024-09-21T06:27:19.031743+0000","last_clean":"2024-09-21T06:27:19.031743+0000","last_became_active":"2024-09-21T06:26:38.966498+0000","last_became_peered":"2024-09-21T06:26:38.966498+0000","last_unstale":"2024-09-21T06:27:19.031743+0000","last_undegraded":"2024-09-21T06:27:19.031743+0000","last_fullsized":"2024-09-21T06:27:19.031743+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:56.732330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":588,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964787+0000","last_change":"2024-09-21T06:26:18.312080+0000","last_active":"2024-09-21T06:26:38.964787+0000","last_peered":"2024-09-21T06:26:38.964787+0000","last_clean":"2024-09-21T06:26:38.964787+0000","last_became_active":"2024-09-21T06:26:18.311351+0000","last_became_peered":"2024-09-21T06:26:18.311351+0000","last_unstale":"2024-09-21T06:26:38.964787+0000","last_undegraded":"2024-09-21T06:26:38.964787+0000","last_fullsized":"2024-09-21T06:26:38.964787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:33.545677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965339+0000","last_change":"2024-09-21T06:26:16.311108+0000","last_active":"2024-09-21T06:26:38.965339+0000","last_peered":"2024-09-21T06:26:38.965339+0000","last_clean":"2024-09-21T06:26:38.965339+0000","last_became_active":"2024-09-21T06:26:16.310595+0000","last_became_peered":"2024-09-21T06:26:16.310595+0000","last_unstale":"2024-09-21T06:26:38.965339+0000","last_undegraded":"2024-09-21T06:26:38.965339+0000","last_fullsized":"2024-09-21T06:26:38.965339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:43.125242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964942+0000","last_change":"2024-09-21T06:26:18.300618+0000","last_active":"2024-09-21T06:26:38.964942+0000","last_peered":"2024-09-21T06:26:38.964942+0000","last_clean":"2024-09-21T06:26:38.964942+0000","last_became_active":"2024-09-21T06:26:18.300234+0000","last_became_peered":"2024-09-21T06:26:18.300234+0000","last_unstale":"2024-09-21T06:26:38.964942+0000","last_undegraded":"2024-09-21T06:26:38.964942+0000","last_fullsized":"2024-09-21T06:26:38.964942+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:53.224425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'4","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.982480+0000","last_change":"2024-09-21T06:26:38.981999+0000","last_active":"2024-09-21T06:26:38.982480+0000","last_peered":"2024-09-21T06:26:38.982480+0000","last_clean":"2024-09-21T06:26:38.982480+0000","last_became_active":"2024-09-21T06:26:38.969199+0000","last_became_peered":"2024-09-21T06:26:38.969199+0000","last_unstale":"2024-09-21T06:26:38.982480+0000","last_undegraded":"2024-09-21T06:26:38.982480+0000","last_fullsized":"2024-09-21T06:26:38.982480+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:17.389262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965217+0000","last_change":"2024-09-21T06:26:18.297693+0000","last_active":"2024-09-21T06:26:38.965217+0000","last_peered":"2024-09-21T06:26:38.965217+0000","last_clean":"2024-09-21T06:26:38.965217+0000","last_became_active":"2024-09-21T06:26:18.297335+0000","last_became_peered":"2024-09-21T06:26:18.297335+0000","last_unstale":"2024-09-21T06:26:38.965217+0000","last_undegraded":"2024-09-21T06:26:38.965217+0000","last_fullsized":"2024-09-21T06:26:38.965217+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:30.144220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'15","reported_seq":38,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:44.295312+0000","last_change":"2024-09-21T06:26:16.269854+0000","last_active":"2024-09-21T06:26:44.295312+0000","last_peered":"2024-09-21T06:26:44.295312+0000","last_clean":"2024-09-21T06:26:44.295312+0000","last_became_active":"2024-09-21T06:26:16.269415+0000","last_became_peered":"2024-09-21T06:26:16.269415+0000","last_unstale":"2024-09-21T06:26:44.295312+0000","last_undegraded":"2024-09-21T06:26:44.295312+0000","last_fullsized":"2024-09-21T06:26:44.295312+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:50.525916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964317+0000","last_change":"2024-09-21T06:26:18.306302+0000","last_active":"2024-09-21T06:26:38.964317+0000","last_peered":"2024-09-21T06:26:38.964317+0000","last_clean":"2024-09-21T06:26:38.964317+0000","last_became_active":"2024-09-21T06:26:18.305723+0000","last_became_peered":"2024-09-21T06:26:18.305723+0000","last_unstale":"2024-09-21T06:26:38.964317+0000","last_undegraded":"2024-09-21T06:26:38.964317+0000","last_fullsized":"2024-09-21T06:26:38.964317+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:30.051791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'7","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962517+0000","last_change":"2024-09-21T06:26:16.573081+0000","last_active":"2024-09-21T06:26:38.962517+0000","last_peered":"2024-09-21T06:26:38.962517+0000","last_clean":"2024-09-21T06:26:38.962517+0000","last_became_active":"2024-09-21T06:26:16.572680+0000","last_became_peered":"2024-09-21T06:26:16.572680+0000","last_unstale":"2024-09-21T06:26:38.962517+0000","last_undegraded":"2024-09-21T06:26:38.962517+0000","last_fullsized":"2024-09-21T06:26:38.962517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:04.698258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967148+0000","last_change":"2024-09-21T06:26:18.311610+0000","last_active":"2024-09-21T06:26:38.967148+0000","last_peered":"2024-09-21T06:26:38.967148+0000","last_clean":"2024-09-21T06:26:38.967148+0000","last_became_active":"2024-09-21T06:26:18.311239+0000","last_became_peered":"2024-09-21T06:26:18.311239+0000","last_unstale":"2024-09-21T06:26:38.967148+0000","last_undegraded":"2024-09-21T06:26:38.967148+0000","last_fullsized":"2024-09-21T06:26:38.967148+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:36.995768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965260+0000","last_change":"2024-09-21T06:26:16.313612+0000","last_active":"2024-09-21T06:26:38.965260+0000","last_peered":"2024-09-21T06:26:38.965260+0000","last_clean":"2024-09-21T06:26:38.965260+0000","last_became_active":"2024-09-21T06:26:16.313298+0000","last_became_peered":"2024-09-21T06:26:16.313298+0000","last_unstale":"2024-09-21T06:26:38.965260+0000","last_undegraded":"2024-09-21T06:26:38.965260+0000","last_fullsized":"2024-09-21T06:26:38.965260+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:45.035454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963931+0000","last_change":"2024-09-21T06:26:18.304772+0000","last_active":"2024-09-21T06:26:38.963931+0000","last_peered":"2024-09-21T06:26:38.963931+0000","last_clean":"2024-09-21T06:26:38.963931+0000","last_became_active":"2024-09-21T06:26:18.303909+0000","last_became_peered":"2024-09-21T06:26:18.303909+0000","last_unstale":"2024-09-21T06:26:38.963931+0000","last_undegraded":"2024-09-21T06:26:38.963931+0000","last_fullsized":"2024-09-21T06:26:38.963931+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:28.707169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963811+0000","last_change":"2024-09-21T06:26:16.267563+0000","last_active":"2024-09-21T06:26:38.963811+0000","last_peered":"2024-09-21T06:26:38.963811+0000","last_clean":"2024-09-21T06:26:38.963811+0000","last_became_active":"2024-09-21T06:26:16.267182+0000","last_became_peered":"2024-09-21T06:26:16.267182+0000","last_unstale":"2024-09-21T06:26:38.963811+0000","last_undegraded":"2024-09-21T06:26:38.963811+0000","last_fullsized":"2024-09-21T06:26:38.963811+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:16.042105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.961758+0000","last_change":"2024-09-21T06:26:18.310772+0000","last_active":"2024-09-21T06:26:38.961758+0000","last_peered":"2024-09-21T06:26:38.961758+0000","last_clean":"2024-09-21T06:26:38.961758+0000","last_became_active":"2024-09-21T06:26:18.310382+0000","last_became_peered":"2024-09-21T06:26:18.310382+0000","last_unstale":"2024-09-21T06:26:38.961758+0000","last_undegraded":"2024-09-21T06:26:38.961758+0000","last_fullsized":"2024-09-21T06:26:38.961758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:54:35.028081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967712+0000","last_change":"2024-09-21T06:26:16.270971+0000","last_active":"2024-09-21T06:26:38.967712+0000","last_peered":"2024-09-21T06:26:38.967712+0000","last_clean":"2024-09-21T06:26:38.967712+0000","last_became_active":"2024-09-21T06:26:16.270453+0000","last_became_peered":"2024-09-21T06:26:16.270453+0000","last_unstale":"2024-09-21T06:26:38.967712+0000","last_undegraded":"2024-09-21T06:26:38.967712+0000","last_fullsized":"2024-09-21T06:26:38.967712+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:34.687380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963945+0000","last_change":"2024-09-21T06:26:18.300568+0000","last_active":"2024-09-21T06:26:38.963945+0000","last_peered":"2024-09-21T06:26:38.963945+0000","last_clean":"2024-09-21T06:26:38.963945+0000","last_became_active":"2024-09-21T06:26:18.298864+0000","last_became_peered":"2024-09-21T06:26:18.298864+0000","last_unstale":"2024-09-21T06:26:38.963945+0000","last_undegraded":"2024-09-21T06:26:38.963945+0000","last_fullsized":"2024-09-21T06:26:38.963945+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:00.786225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964246+0000","last_change":"2024-09-21T06:26:16.274093+0000","last_active":"2024-09-21T06:26:38.964246+0000","last_peered":"2024-09-21T06:26:38.964246+0000","last_clean":"2024-09-21T06:26:38.964246+0000","last_became_active":"2024-09-21T06:26:16.273707+0000","last_became_peered":"2024-09-21T06:26:16.273707+0000","last_unstale":"2024-09-21T06:26:38.964246+0000","last_undegraded":"2024-09-21T06:26:38.964246+0000","last_fullsized":"2024-09-21T06:26:38.964246+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:26.710260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965837+0000","last_change":"2024-09-21T06:26:18.300140+0000","last_active":"2024-09-21T06:26:38.965837+0000","last_peered":"2024-09-21T06:26:38.965837+0000","last_clean":"2024-09-21T06:26:38.965837+0000","last_became_active":"2024-09-21T06:26:18.299543+0000","last_became_peered":"2024-09-21T06:26:18.299543+0000","last_unstale":"2024-09-21T06:26:38.965837+0000","last_undegraded":"2024-09-21T06:26:38.965837+0000","last_fullsized":"2024-09-21T06:26:38.965837+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:50.272247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.970973+0000","last_change":"2024-09-21T06:26:18.311528+0000","last_active":"2024-09-21T06:26:38.970973+0000","last_peered":"2024-09-21T06:26:38.970973+0000","last_clean":"2024-09-21T06:26:38.970973+0000","last_became_active":"2024-09-21T06:26:18.311144+0000","last_became_peered":"2024-09-21T06:26:18.311144+0000","last_unstale":"2024-09-21T06:26:38.970973+0000","last_undegraded":"2024-09-21T06:26:38.970973+0000","last_fullsized":"2024-09-21T06:26:38.970973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:05.554255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964467+0000","last_change":"2024-09-21T06:26:16.275378+0000","last_active":"2024-09-21T06:26:38.964467+0000","last_peered":"2024-09-21T06:26:38.964467+0000","last_clean":"2024-09-21T06:26:38.964467+0000","last_became_active":"2024-09-21T06:26:16.274990+0000","last_became_peered":"2024-09-21T06:26:16.274990+0000","last_unstale":"2024-09-21T06:26:38.964467+0000","last_undegraded":"2024-09-21T06:26:38.964467+0000","last_fullsized":"2024-09-21T06:26:38.964467+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:57.252993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966421+0000","last_change":"2024-09-21T06:26:18.300879+0000","last_active":"2024-09-21T06:26:38.966421+0000","last_peered":"2024-09-21T06:26:38.966421+0000","last_clean":"2024-09-21T06:26:38.966421+0000","last_became_active":"2024-09-21T06:26:18.300514+0000","last_became_peered":"2024-09-21T06:26:18.300514+0000","last_unstale":"2024-09-21T06:26:38.966421+0000","last_undegraded":"2024-09-21T06:26:38.966421+0000","last_fullsized":"2024-09-21T06:26:38.966421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:02.581145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'12","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964519+0000","last_change":"2024-09-21T06:26:16.274139+0000","last_active":"2024-09-21T06:26:38.964519+0000","last_peered":"2024-09-21T06:26:38.964519+0000","last_clean":"2024-09-21T06:26:38.964519+0000","last_became_active":"2024-09-21T06:26:16.273723+0000","last_became_peered":"2024-09-21T06:26:16.273723+0000","last_unstale":"2024-09-21T06:26:38.964519+0000","last_undegraded":"2024-09-21T06:26:38.964519+0000","last_fullsized":"2024-09-21T06:26:38.964519+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:24.366714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967496+0000","last_change":"2024-09-21T06:26:18.304602+0000","last_active":"2024-09-21T06:26:38.967496+0000","last_peered":"2024-09-21T06:26:38.967496+0000","last_clean":"2024-09-21T06:26:38.967496+0000","last_became_active":"2024-09-21T06:26:18.304259+0000","last_became_peered":"2024-09-21T06:26:18.304259+0000","last_unstale":"2024-09-21T06:26:38.967496+0000","last_undegraded":"2024-09-21T06:26:38.967496+0000","last_fullsized":"2024-09-21T06:26:38.967496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:16.428247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964281+0000","last_change":"2024-09-21T06:26:16.311107+0000","last_active":"2024-09-21T06:26:38.964281+0000","last_peered":"2024-09-21T06:26:38.964281+0000","last_clean":"2024-09-21T06:26:38.964281+0000","last_became_active":"2024-09-21T06:26:16.310692+0000","last_became_peered":"2024-09-21T06:26:16.310692+0000","last_unstale":"2024-09-21T06:26:38.964281+0000","last_undegraded":"2024-09-21T06:26:38.964281+0000","last_fullsized":"2024-09-21T06:26:38.964281+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:29.074606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964061+0000","last_change":"2024-09-21T06:26:18.300614+0000","last_active":"2024-09-21T06:26:38.964061+0000","last_peered":"2024-09-21T06:26:38.964061+0000","last_clean":"2024-09-21T06:26:38.964061+0000","last_became_active":"2024-09-21T06:26:18.300173+0000","last_became_peered":"2024-09-21T06:26:18.300173+0000","last_unstale":"2024-09-21T06:26:38.964061+0000","last_undegraded":"2024-09-21T06:26:38.964061+0000","last_fullsized":"2024-09-21T06:26:38.964061+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:49.040667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'13","reported_seq":112,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:27:22.035413+0000","last_change":"2024-09-21T06:26:38.986822+0000","last_active":"2024-09-21T06:27:22.035413+0000","last_peered":"2024-09-21T06:27:22.035413+0000","last_clean":"2024-09-21T06:27:22.035413+0000","last_became_active":"2024-09-21T06:26:38.972368+0000","last_became_peered":"2024-09-21T06:26:38.972368+0000","last_unstale":"2024-09-21T06:27:22.035413+0000","last_undegraded":"2024-09-21T06:27:22.035413+0000","last_fullsized":"2024-09-21T06:27:22.035413+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:53.273388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73652,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":544,"num_read_kb":352,"num_write":246,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1484,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":220956,"data_compressed":4914,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282590,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743449,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":860160,"data_stored":420766,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939679,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1007616,"data_stored":1077543,"data_compressed":43480,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103205,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":876544,"data_stored":419722,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299434,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":419199,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495663,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":1011913,"data_compressed":41842,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659188,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":419322,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855417,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":933888,"data_stored":1011788,"data_compressed":41842,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018942,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":864256,"data_stored":419686,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":419030,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378697,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":487182,"data_compressed":7539,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542222,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":929792,"data_stored":487355,"data_compressed":7539,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705746,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":876544,"data_stored":421052,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68872,"data_compressed":1638,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68699,"data_compressed":1638,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":68575,"data_compressed":1638,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:27:26.016 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:27:26.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:25 smithi071 ceph-mon[34844]: pgmap v298: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:26.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:25 smithi175 ceph-mon[34510]: pgmap v298: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:26.298 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:26.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.831+0000 7f06f3049640 1 -- 172.21.15.63:0/4085068061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec104880 msgr2=0x7f06ec104c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:26.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.831+0000 7f06f3049640 1 --2- 172.21.15.63:0/4085068061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec104880 0x7f06ec104c90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009900 tx=0x7f06dc02a410 comp rx=0 tx=0).stop 2024-09-21T06:27:26.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.831+0000 7f06f3049640 1 -- 172.21.15.63:0/4085068061 shutdown_connections 2024-09-21T06:27:26.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.831+0000 7f06f3049640 1 --2- 172.21.15.63:0/4085068061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06ec10de30 0x7f06ec110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:26.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.831+0000 7f06f3049640 1 --2- 172.21.15.63:0/4085068061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06ec1052b0 0x7f06ec10d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:26.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.831+0000 7f06f3049640 1 --2- 172.21.15.63:0/4085068061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec104880 0x7f06ec104c90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:26.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.831+0000 7f06f3049640 1 -- 172.21.15.63:0/4085068061 >> 172.21.15.63:0/4085068061 conn(0x7f06ec079730 msgr2=0x7f06ec079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:26.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.831+0000 7f06f3049640 1 -- 172.21.15.63:0/4085068061 shutdown_connections 2024-09-21T06:27:26.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.831+0000 7f06f3049640 1 -- 172.21.15.63:0/4085068061 wait complete. 2024-09-21T06:27:26.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.832+0000 7f06f3049640 1 Processor -- start 2024-09-21T06:27:26.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.832+0000 7f06f3049640 1 -- start start 2024-09-21T06:27:26.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.832+0000 7f06f3049640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06ec104880 0x7f06ec19c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:26.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.832+0000 7f06f3049640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec1052b0 0x7f06ec19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:26.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.832+0000 7f06f3049640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06ec10de30 0x7f06ec1a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:26.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.832+0000 7f06f3049640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec115cd0 con 0x7f06ec1052b0 2024-09-21T06:27:26.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.832+0000 7f06f3049640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec115b50 con 0x7f06ec104880 2024-09-21T06:27:26.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.832+0000 7f06f3049640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec115e50 con 0x7f06ec10de30 2024-09-21T06:27:26.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.833+0000 7f06ebfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec1052b0 0x7f06ec19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:26.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.833+0000 7f06ebfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec1052b0 0x7f06ec19cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46580/0 (socket says 172.21.15.63:46580) 2024-09-21T06:27:26.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.833+0000 7f06ebfff640 1 -- 172.21.15.63:0/4083128918 learned_addr learned my addr 172.21.15.63:0/4083128918 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:26.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.833+0000 7f06f0de5640 1 --2- 172.21.15.63:0/4083128918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06ec104880 0x7f06ec19c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.833+0000 7f06f15e6640 1 --2- 172.21.15.63:0/4083128918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06ec10de30 0x7f06ec1a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.833+0000 7f06ebfff640 1 -- 172.21.15.63:0/4083128918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06ec10de30 msgr2=0x7f06ec1a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.833+0000 7f06ebfff640 1 --2- 172.21.15.63:0/4083128918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06ec10de30 0x7f06ec1a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.833+0000 7f06ebfff640 1 -- 172.21.15.63:0/4083128918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06ec104880 msgr2=0x7f06ec19c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.833+0000 7f06ebfff640 1 --2- 172.21.15.63:0/4083128918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06ec104880 0x7f06ec19c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.833+0000 7f06ebfff640 1 -- 172.21.15.63:0/4083128918 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ec1a2550 con 0x7f06ec1052b0 2024-09-21T06:27:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.833+0000 7f06f15e6640 1 --2- 172.21.15.63:0/4083128918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06ec10de30 0x7f06ec1a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.833+0000 7f06ebfff640 1 --2- 172.21.15.63:0/4083128918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec1052b0 0x7f06ec19cc40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f06d400ccb0 tx=0x7f06d400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.833+0000 7f06e9ffb640 1 -- 172.21.15.63:0/4083128918 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d400ce60 con 0x7f06ec1052b0 2024-09-21T06:27:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.833+0000 7f06e9ffb640 1 -- 172.21.15.63:0/4083128918 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06d400fb00 con 0x7f06ec1052b0 2024-09-21T06:27:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.833+0000 7f06f3049640 1 -- 172.21.15.63:0/4083128918 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ec1a2840 con 0x7f06ec1052b0 2024-09-21T06:27:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.833+0000 7f06e9ffb640 1 -- 172.21.15.63:0/4083128918 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d4018bb0 con 0x7f06ec1052b0 2024-09-21T06:27:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.834+0000 7f06f3049640 1 -- 172.21.15.63:0/4083128918 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ec1a9060 con 0x7f06ec1052b0 2024-09-21T06:27:26.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.835+0000 7f06f3049640 1 -- 172.21.15.63:0/4083128918 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06ec104c90 con 0x7f06ec1052b0 2024-09-21T06:27:26.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.836+0000 7f06e9ffb640 1 -- 172.21.15.63:0/4083128918 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f06d400f650 con 0x7f06ec1052b0 2024-09-21T06:27:26.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.837+0000 7f06e9ffb640 1 --2- 172.21.15.63:0/4083128918 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f06d80b6620 0x7f06d80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:26.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.837+0000 7f06f0de5640 1 --2- 172.21.15.63:0/4083128918 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f06d80b6620 0x7f06d80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:26.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.837+0000 7f06e9ffb640 1 -- 172.21.15.63:0/4083128918 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f06d40e7a40 con 0x7f06ec1052b0 2024-09-21T06:27:26.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.838+0000 7f06f0de5640 1 --2- 172.21.15.63:0/4083128918 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f06d80b6620 0x7f06d80b8b30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f06dc000c00 tx=0x7f06dc031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:26.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:26.841+0000 7f06e9ffb640 1 -- 172.21.15.63:0/4083128918 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f06d4014030 con 0x7f06ec1052b0 2024-09-21T06:27:27.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:26 smithi071 ceph-mon[34844]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:27:27.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:26 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:27.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:26 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:27.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:26 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:27.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:26 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:27.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:26 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:27.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:27.029+0000 7f06f3049640 1 -- 172.21.15.63:0/4083128918 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f06ec108fe0 con 0x7f06d80b6620 2024-09-21T06:27:27.031 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:26 smithi063 ceph-mon[31150]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:27:27.031 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:26 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:27.031 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:26 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:27.031 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:26 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:27.031 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:26 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:27.031 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:26 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:27.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:27.034+0000 7f06e9ffb640 1 -- 172.21.15.63:0/4083128918 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259060 (secure 0 0 0) 0x7f06ec108fe0 con 0x7f06d80b6620 2024-09-21T06:27:27.038 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:27:27.038 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T06:27:27.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:27.037+0000 7f06f3049640 1 -- 172.21.15.63:0/4083128918 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f06d80b6620 msgr2=0x7f06d80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:27.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:27.037+0000 7f06f3049640 1 --2- 172.21.15.63:0/4083128918 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f06d80b6620 0x7f06d80b8b30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f06dc000c00 tx=0x7f06dc031400 comp rx=0 tx=0).stop 2024-09-21T06:27:27.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:27.037+0000 7f06f3049640 1 -- 172.21.15.63:0/4083128918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec1052b0 msgr2=0x7f06ec19cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:27.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:27.037+0000 7f06f3049640 1 --2- 172.21.15.63:0/4083128918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec1052b0 0x7f06ec19cc40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f06d400ccb0 tx=0x7f06d400a620 comp rx=0 tx=0).stop 2024-09-21T06:27:27.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:27.037+0000 7f06f3049640 1 -- 172.21.15.63:0/4083128918 shutdown_connections 2024-09-21T06:27:27.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:27.037+0000 7f06f3049640 1 --2- 172.21.15.63:0/4083128918 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f06d80b6620 0x7f06d80b8b30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:27.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:27.037+0000 7f06f3049640 1 --2- 172.21.15.63:0/4083128918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06ec10de30 0x7f06ec1a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:27.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:27.037+0000 7f06f3049640 1 --2- 172.21.15.63:0/4083128918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06ec1052b0 0x7f06ec19cc40 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:27.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:27.037+0000 7f06f3049640 1 --2- 172.21.15.63:0/4083128918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06ec104880 0x7f06ec19c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:27.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:27.037+0000 7f06f3049640 1 -- 172.21.15.63:0/4083128918 >> 172.21.15.63:0/4083128918 conn(0x7f06ec079730 msgr2=0x7f06ec100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:27.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:27.037+0000 7f06f3049640 1 -- 172.21.15.63:0/4083128918 shutdown_connections 2024-09-21T06:27:27.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:27.037+0000 7f06f3049640 1 -- 172.21.15.63:0/4083128918 wait complete. 2024-09-21T06:27:27.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:26 smithi175 ceph-mon[34510]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:27:27.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:26 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:27.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:26 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:27.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:26 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:27.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:26 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:27.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:26 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:27:27.690 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2024-09-21T06:27:25.882800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664254,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":660,"num_read_kb":441,"num_write":371,"num_write_kb":2296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":2953441,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376444,"kb_used_data":10524,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565380,"statfs":{"total":1151940427776,"available":1151554949120,"internally_reserved":0,"allocated":10776576,"data_stored":7014558,"data_compressed":183549,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003145"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962115+0000","last_change":"2024-09-21T06:26:18.307729+0000","last_active":"2024-09-21T06:26:38.962115+0000","last_peered":"2024-09-21T06:26:38.962115+0000","last_clean":"2024-09-21T06:26:38.962115+0000","last_became_active":"2024-09-21T06:26:18.306345+0000","last_became_peered":"2024-09-21T06:26:18.306345+0000","last_unstale":"2024-09-21T06:26:38.962115+0000","last_undegraded":"2024-09-21T06:26:38.962115+0000","last_fullsized":"2024-09-21T06:26:38.962115+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:58.409506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967037+0000","last_change":"2024-09-21T06:26:18.302982+0000","last_active":"2024-09-21T06:26:38.967037+0000","last_peered":"2024-09-21T06:26:38.967037+0000","last_clean":"2024-09-21T06:26:38.967037+0000","last_became_active":"2024-09-21T06:26:18.302636+0000","last_became_peered":"2024-09-21T06:26:18.302636+0000","last_unstale":"2024-09-21T06:26:38.967037+0000","last_undegraded":"2024-09-21T06:26:38.967037+0000","last_fullsized":"2024-09-21T06:26:38.967037+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:28.165964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967428+0000","last_change":"2024-09-21T06:26:18.305293+0000","last_active":"2024-09-21T06:26:38.967428+0000","last_peered":"2024-09-21T06:26:38.967428+0000","last_clean":"2024-09-21T06:26:38.967428+0000","last_became_active":"2024-09-21T06:26:18.304689+0000","last_became_peered":"2024-09-21T06:26:18.304689+0000","last_unstale":"2024-09-21T06:26:38.967428+0000","last_undegraded":"2024-09-21T06:26:38.967428+0000","last_fullsized":"2024-09-21T06:26:38.967428+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:37.442558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962224+0000","last_change":"2024-09-21T06:26:18.306443+0000","last_active":"2024-09-21T06:26:38.962224+0000","last_peered":"2024-09-21T06:26:38.962224+0000","last_clean":"2024-09-21T06:26:38.962224+0000","last_became_active":"2024-09-21T06:26:18.305062+0000","last_became_peered":"2024-09-21T06:26:18.305062+0000","last_unstale":"2024-09-21T06:26:38.962224+0000","last_undegraded":"2024-09-21T06:26:38.962224+0000","last_fullsized":"2024-09-21T06:26:38.962224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:07.896971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964110+0000","last_change":"2024-09-21T06:26:18.298857+0000","last_active":"2024-09-21T06:26:38.964110+0000","last_peered":"2024-09-21T06:26:38.964110+0000","last_clean":"2024-09-21T06:26:38.964110+0000","last_became_active":"2024-09-21T06:26:18.298439+0000","last_became_peered":"2024-09-21T06:26:18.298439+0000","last_unstale":"2024-09-21T06:26:38.964110+0000","last_undegraded":"2024-09-21T06:26:38.964110+0000","last_fullsized":"2024-09-21T06:26:38.964110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:24.695856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964685+0000","last_change":"2024-09-21T06:26:18.313029+0000","last_active":"2024-09-21T06:26:38.964685+0000","last_peered":"2024-09-21T06:26:38.964685+0000","last_clean":"2024-09-21T06:26:38.964685+0000","last_became_active":"2024-09-21T06:26:18.312627+0000","last_became_peered":"2024-09-21T06:26:18.312627+0000","last_unstale":"2024-09-21T06:26:38.964685+0000","last_undegraded":"2024-09-21T06:26:38.964685+0000","last_fullsized":"2024-09-21T06:26:38.964685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:23.086862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965223+0000","last_change":"2024-09-21T06:26:18.299082+0000","last_active":"2024-09-21T06:26:38.965223+0000","last_peered":"2024-09-21T06:26:38.965223+0000","last_clean":"2024-09-21T06:26:38.965223+0000","last_became_active":"2024-09-21T06:26:18.298279+0000","last_became_peered":"2024-09-21T06:26:18.298279+0000","last_unstale":"2024-09-21T06:26:38.965223+0000","last_undegraded":"2024-09-21T06:26:38.965223+0000","last_fullsized":"2024-09-21T06:26:38.965223+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:05.652407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963617+0000","last_change":"2024-09-21T06:26:18.298565+0000","last_active":"2024-09-21T06:26:38.963617+0000","last_peered":"2024-09-21T06:26:38.963617+0000","last_clean":"2024-09-21T06:26:38.963617+0000","last_became_active":"2024-09-21T06:26:18.298172+0000","last_became_peered":"2024-09-21T06:26:18.298172+0000","last_unstale":"2024-09-21T06:26:38.963617+0000","last_undegraded":"2024-09-21T06:26:38.963617+0000","last_fullsized":"2024-09-21T06:26:38.963617+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:33.045038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967371+0000","last_change":"2024-09-21T06:26:18.304901+0000","last_active":"2024-09-21T06:26:38.967371+0000","last_peered":"2024-09-21T06:26:38.967371+0000","last_clean":"2024-09-21T06:26:38.967371+0000","last_became_active":"2024-09-21T06:26:18.304521+0000","last_became_peered":"2024-09-21T06:26:18.304521+0000","last_unstale":"2024-09-21T06:26:38.967371+0000","last_undegraded":"2024-09-21T06:26:38.967371+0000","last_fullsized":"2024-09-21T06:26:38.967371+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:31.859554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.970297+0000","last_change":"2024-09-21T06:26:38.970119+0000","last_active":"2024-09-21T06:26:38.970297+0000","last_peered":"2024-09-21T06:26:38.970297+0000","last_clean":"2024-09-21T06:26:38.970297+0000","last_became_active":"2024-09-21T06:26:38.969521+0000","last_became_peered":"2024-09-21T06:26:38.969521+0000","last_unstale":"2024-09-21T06:26:38.970297+0000","last_undegraded":"2024-09-21T06:26:38.970297+0000","last_fullsized":"2024-09-21T06:26:38.970297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:54.407153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966009+0000","last_change":"2024-09-21T06:26:18.300178+0000","last_active":"2024-09-21T06:26:38.966009+0000","last_peered":"2024-09-21T06:26:38.966009+0000","last_clean":"2024-09-21T06:26:38.966009+0000","last_became_active":"2024-09-21T06:26:18.298651+0000","last_became_peered":"2024-09-21T06:26:18.298651+0000","last_unstale":"2024-09-21T06:26:38.966009+0000","last_undegraded":"2024-09-21T06:26:38.966009+0000","last_fullsized":"2024-09-21T06:26:38.966009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:07.261974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962238+0000","last_change":"2024-09-21T06:26:18.311310+0000","last_active":"2024-09-21T06:26:38.962238+0000","last_peered":"2024-09-21T06:26:38.962238+0000","last_clean":"2024-09-21T06:26:38.962238+0000","last_became_active":"2024-09-21T06:26:18.310671+0000","last_became_peered":"2024-09-21T06:26:18.310671+0000","last_unstale":"2024-09-21T06:26:38.962238+0000","last_undegraded":"2024-09-21T06:26:38.962238+0000","last_fullsized":"2024-09-21T06:26:38.962238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:52.060682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965742+0000","last_change":"2024-09-21T06:26:18.296958+0000","last_active":"2024-09-21T06:26:38.965742+0000","last_peered":"2024-09-21T06:26:38.965742+0000","last_clean":"2024-09-21T06:26:38.965742+0000","last_became_active":"2024-09-21T06:26:18.296081+0000","last_became_peered":"2024-09-21T06:26:18.296081+0000","last_unstale":"2024-09-21T06:26:38.965742+0000","last_undegraded":"2024-09-21T06:26:38.965742+0000","last_fullsized":"2024-09-21T06:26:38.965742+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:28.501906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966438+0000","last_change":"2024-09-21T06:26:18.301289+0000","last_active":"2024-09-21T06:26:38.966438+0000","last_peered":"2024-09-21T06:26:38.966438+0000","last_clean":"2024-09-21T06:26:38.966438+0000","last_became_active":"2024-09-21T06:26:18.300834+0000","last_became_peered":"2024-09-21T06:26:18.300834+0000","last_unstale":"2024-09-21T06:26:38.966438+0000","last_undegraded":"2024-09-21T06:26:38.966438+0000","last_fullsized":"2024-09-21T06:26:38.966438+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:31.206650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966259+0000","last_change":"2024-09-21T06:26:18.312436+0000","last_active":"2024-09-21T06:26:38.966259+0000","last_peered":"2024-09-21T06:26:38.966259+0000","last_clean":"2024-09-21T06:26:38.966259+0000","last_became_active":"2024-09-21T06:26:18.311230+0000","last_became_peered":"2024-09-21T06:26:18.311230+0000","last_unstale":"2024-09-21T06:26:38.966259+0000","last_undegraded":"2024-09-21T06:26:38.966259+0000","last_fullsized":"2024-09-21T06:26:38.966259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:07.163105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966586+0000","last_change":"2024-09-21T06:26:18.307775+0000","last_active":"2024-09-21T06:26:38.966586+0000","last_peered":"2024-09-21T06:26:38.966586+0000","last_clean":"2024-09-21T06:26:38.966586+0000","last_became_active":"2024-09-21T06:26:18.307326+0000","last_became_peered":"2024-09-21T06:26:18.307326+0000","last_unstale":"2024-09-21T06:26:38.966586+0000","last_undegraded":"2024-09-21T06:26:38.966586+0000","last_fullsized":"2024-09-21T06:26:38.966586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:18.213503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962147+0000","last_change":"2024-09-21T06:26:18.309004+0000","last_active":"2024-09-21T06:26:38.962147+0000","last_peered":"2024-09-21T06:26:38.962147+0000","last_clean":"2024-09-21T06:26:38.962147+0000","last_became_active":"2024-09-21T06:26:18.306098+0000","last_became_peered":"2024-09-21T06:26:18.306098+0000","last_unstale":"2024-09-21T06:26:38.962147+0000","last_undegraded":"2024-09-21T06:26:38.962147+0000","last_fullsized":"2024-09-21T06:26:38.962147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:09.102610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965512+0000","last_change":"2024-09-21T06:26:18.306699+0000","last_active":"2024-09-21T06:26:38.965512+0000","last_peered":"2024-09-21T06:26:38.965512+0000","last_clean":"2024-09-21T06:26:38.965512+0000","last_became_active":"2024-09-21T06:26:18.306352+0000","last_became_peered":"2024-09-21T06:26:18.306352+0000","last_unstale":"2024-09-21T06:26:38.965512+0000","last_undegraded":"2024-09-21T06:26:38.965512+0000","last_fullsized":"2024-09-21T06:26:38.965512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:47.992315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.968447+0000","last_change":"2024-09-21T06:26:18.301677+0000","last_active":"2024-09-21T06:26:38.968447+0000","last_peered":"2024-09-21T06:26:38.968447+0000","last_clean":"2024-09-21T06:26:38.968447+0000","last_became_active":"2024-09-21T06:26:18.301260+0000","last_became_peered":"2024-09-21T06:26:18.301260+0000","last_unstale":"2024-09-21T06:26:38.968447+0000","last_undegraded":"2024-09-21T06:26:38.968447+0000","last_fullsized":"2024-09-21T06:26:38.968447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:53.209062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.961797+0000","last_change":"2024-09-21T06:26:18.312004+0000","last_active":"2024-09-21T06:26:38.961797+0000","last_peered":"2024-09-21T06:26:38.961797+0000","last_clean":"2024-09-21T06:26:38.961797+0000","last_became_active":"2024-09-21T06:26:18.311602+0000","last_became_peered":"2024-09-21T06:26:18.311602+0000","last_unstale":"2024-09-21T06:26:38.961797+0000","last_undegraded":"2024-09-21T06:26:38.961797+0000","last_fullsized":"2024-09-21T06:26:38.961797+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:30.074887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965890+0000","last_change":"2024-09-21T06:26:18.296581+0000","last_active":"2024-09-21T06:26:38.965890+0000","last_peered":"2024-09-21T06:26:38.965890+0000","last_clean":"2024-09-21T06:26:38.965890+0000","last_became_active":"2024-09-21T06:26:18.296078+0000","last_became_peered":"2024-09-21T06:26:18.296078+0000","last_unstale":"2024-09-21T06:26:38.965890+0000","last_undegraded":"2024-09-21T06:26:38.965890+0000","last_fullsized":"2024-09-21T06:26:38.965890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:39.120626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966804+0000","last_change":"2024-09-21T06:26:18.307793+0000","last_active":"2024-09-21T06:26:38.966804+0000","last_peered":"2024-09-21T06:26:38.966804+0000","last_clean":"2024-09-21T06:26:38.966804+0000","last_became_active":"2024-09-21T06:26:18.307310+0000","last_became_peered":"2024-09-21T06:26:18.307310+0000","last_unstale":"2024-09-21T06:26:38.966804+0000","last_undegraded":"2024-09-21T06:26:38.966804+0000","last_fullsized":"2024-09-21T06:26:38.966804+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:11.761986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963619+0000","last_change":"2024-09-21T06:26:18.305700+0000","last_active":"2024-09-21T06:26:38.963619+0000","last_peered":"2024-09-21T06:26:38.963619+0000","last_clean":"2024-09-21T06:26:38.963619+0000","last_became_active":"2024-09-21T06:26:18.305319+0000","last_became_peered":"2024-09-21T06:26:18.305319+0000","last_unstale":"2024-09-21T06:26:38.963619+0000","last_undegraded":"2024-09-21T06:26:38.963619+0000","last_fullsized":"2024-09-21T06:26:38.963619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:52.479565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971092+0000","last_change":"2024-09-21T06:26:18.304111+0000","last_active":"2024-09-21T06:26:38.971092+0000","last_peered":"2024-09-21T06:26:38.971092+0000","last_clean":"2024-09-21T06:26:38.971092+0000","last_became_active":"2024-09-21T06:26:18.302716+0000","last_became_peered":"2024-09-21T06:26:18.302716+0000","last_unstale":"2024-09-21T06:26:38.971092+0000","last_undegraded":"2024-09-21T06:26:38.971092+0000","last_fullsized":"2024-09-21T06:26:38.971092+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:39.298737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964408+0000","last_change":"2024-09-21T06:26:18.310154+0000","last_active":"2024-09-21T06:26:38.964408+0000","last_peered":"2024-09-21T06:26:38.964408+0000","last_clean":"2024-09-21T06:26:38.964408+0000","last_became_active":"2024-09-21T06:26:18.309735+0000","last_became_peered":"2024-09-21T06:26:18.309735+0000","last_unstale":"2024-09-21T06:26:38.964408+0000","last_undegraded":"2024-09-21T06:26:38.964408+0000","last_fullsized":"2024-09-21T06:26:38.964408+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:42:37.535841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.968784+0000","last_change":"2024-09-21T06:26:18.312302+0000","last_active":"2024-09-21T06:26:38.968784+0000","last_peered":"2024-09-21T06:26:38.968784+0000","last_clean":"2024-09-21T06:26:38.968784+0000","last_became_active":"2024-09-21T06:26:18.311950+0000","last_became_peered":"2024-09-21T06:26:18.311950+0000","last_unstale":"2024-09-21T06:26:38.968784+0000","last_undegraded":"2024-09-21T06:26:38.968784+0000","last_fullsized":"2024-09-21T06:26:38.968784+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:03.899946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962182+0000","last_change":"2024-09-21T06:26:18.308291+0000","last_active":"2024-09-21T06:26:38.962182+0000","last_peered":"2024-09-21T06:26:38.962182+0000","last_clean":"2024-09-21T06:26:38.962182+0000","last_became_active":"2024-09-21T06:26:18.307907+0000","last_became_peered":"2024-09-21T06:26:18.307907+0000","last_unstale":"2024-09-21T06:26:38.962182+0000","last_undegraded":"2024-09-21T06:26:38.962182+0000","last_fullsized":"2024-09-21T06:26:38.962182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:17.418996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965105+0000","last_change":"2024-09-21T06:26:18.311774+0000","last_active":"2024-09-21T06:26:38.965105+0000","last_peered":"2024-09-21T06:26:38.965105+0000","last_clean":"2024-09-21T06:26:38.965105+0000","last_became_active":"2024-09-21T06:26:18.311373+0000","last_became_peered":"2024-09-21T06:26:18.311373+0000","last_unstale":"2024-09-21T06:26:38.965105+0000","last_undegraded":"2024-09-21T06:26:38.965105+0000","last_fullsized":"2024-09-21T06:26:38.965105+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:08.310931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.977753+0000","last_change":"2024-09-21T06:26:38.977655+0000","last_active":"2024-09-21T06:26:38.977753+0000","last_peered":"2024-09-21T06:26:38.977753+0000","last_clean":"2024-09-21T06:26:38.977753+0000","last_became_active":"2024-09-21T06:26:38.977309+0000","last_became_peered":"2024-09-21T06:26:38.977309+0000","last_unstale":"2024-09-21T06:26:38.977753+0000","last_undegraded":"2024-09-21T06:26:38.977753+0000","last_fullsized":"2024-09-21T06:26:38.977753+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:10.083264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967567+0000","last_change":"2024-09-21T06:26:18.302851+0000","last_active":"2024-09-21T06:26:38.967567+0000","last_peered":"2024-09-21T06:26:38.967567+0000","last_clean":"2024-09-21T06:26:38.967567+0000","last_became_active":"2024-09-21T06:26:18.302120+0000","last_became_peered":"2024-09-21T06:26:18.302120+0000","last_unstale":"2024-09-21T06:26:38.967567+0000","last_undegraded":"2024-09-21T06:26:38.967567+0000","last_fullsized":"2024-09-21T06:26:38.967567+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:18.442711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967011+0000","last_change":"2024-09-21T06:26:18.310447+0000","last_active":"2024-09-21T06:26:38.967011+0000","last_peered":"2024-09-21T06:26:38.967011+0000","last_clean":"2024-09-21T06:26:38.967011+0000","last_became_active":"2024-09-21T06:26:18.310079+0000","last_became_peered":"2024-09-21T06:26:18.310079+0000","last_unstale":"2024-09-21T06:26:38.967011+0000","last_undegraded":"2024-09-21T06:26:38.967011+0000","last_fullsized":"2024-09-21T06:26:38.967011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:14.364382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.961670+0000","last_change":"2024-09-21T06:26:18.307260+0000","last_active":"2024-09-21T06:26:38.961670+0000","last_peered":"2024-09-21T06:26:38.961670+0000","last_clean":"2024-09-21T06:26:38.961670+0000","last_became_active":"2024-09-21T06:26:18.306131+0000","last_became_peered":"2024-09-21T06:26:18.306131+0000","last_unstale":"2024-09-21T06:26:38.961670+0000","last_undegraded":"2024-09-21T06:26:38.961670+0000","last_fullsized":"2024-09-21T06:26:38.961670+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:14.746652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964110+0000","last_change":"2024-09-21T06:26:18.292714+0000","last_active":"2024-09-21T06:26:38.964110+0000","last_peered":"2024-09-21T06:26:38.964110+0000","last_clean":"2024-09-21T06:26:38.964110+0000","last_became_active":"2024-09-21T06:26:18.292322+0000","last_became_peered":"2024-09-21T06:26:18.292322+0000","last_unstale":"2024-09-21T06:26:38.964110+0000","last_undegraded":"2024-09-21T06:26:38.964110+0000","last_fullsized":"2024-09-21T06:26:38.964110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:51.017455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":86,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:27:22.843007+0000","last_change":"2024-09-21T06:26:16.269788+0000","last_active":"2024-09-21T06:27:22.843007+0000","last_peered":"2024-09-21T06:27:22.843007+0000","last_clean":"2024-09-21T06:27:22.843007+0000","last_became_active":"2024-09-21T06:26:16.269342+0000","last_became_peered":"2024-09-21T06:26:16.269342+0000","last_unstale":"2024-09-21T06:27:22.843007+0000","last_undegraded":"2024-09-21T06:27:22.843007+0000","last_fullsized":"2024-09-21T06:27:22.843007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:34.782237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.970505+0000","last_change":"2024-09-21T06:26:38.970396+0000","last_active":"2024-09-21T06:26:38.970505+0000","last_peered":"2024-09-21T06:26:38.970505+0000","last_clean":"2024-09-21T06:26:38.970505+0000","last_became_active":"2024-09-21T06:26:38.969976+0000","last_became_peered":"2024-09-21T06:26:38.969976+0000","last_unstale":"2024-09-21T06:26:38.970505+0000","last_undegraded":"2024-09-21T06:26:38.970505+0000","last_fullsized":"2024-09-21T06:26:38.970505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:44.540563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,3],"acting":[9,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964833+0000","last_change":"2024-09-21T06:26:16.272832+0000","last_active":"2024-09-21T06:26:38.964833+0000","last_peered":"2024-09-21T06:26:38.964833+0000","last_clean":"2024-09-21T06:26:38.964833+0000","last_became_active":"2024-09-21T06:26:16.272447+0000","last_became_peered":"2024-09-21T06:26:16.272447+0000","last_unstale":"2024-09-21T06:26:38.964833+0000","last_undegraded":"2024-09-21T06:26:38.964833+0000","last_fullsized":"2024-09-21T06:26:38.964833+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:22.836267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966506+0000","last_change":"2024-09-21T06:26:16.269067+0000","last_active":"2024-09-21T06:26:38.966506+0000","last_peered":"2024-09-21T06:26:38.966506+0000","last_clean":"2024-09-21T06:26:38.966506+0000","last_became_active":"2024-09-21T06:26:16.268524+0000","last_became_peered":"2024-09-21T06:26:16.268524+0000","last_unstale":"2024-09-21T06:26:38.966506+0000","last_undegraded":"2024-09-21T06:26:38.966506+0000","last_fullsized":"2024-09-21T06:26:38.966506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:32.224321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963670+0000","last_change":"2024-09-21T06:26:18.306489+0000","last_active":"2024-09-21T06:26:38.963670+0000","last_peered":"2024-09-21T06:26:38.963670+0000","last_clean":"2024-09-21T06:26:38.963670+0000","last_became_active":"2024-09-21T06:26:18.305883+0000","last_became_peered":"2024-09-21T06:26:18.305883+0000","last_unstale":"2024-09-21T06:26:38.963670+0000","last_undegraded":"2024-09-21T06:26:38.963670+0000","last_fullsized":"2024-09-21T06:26:38.963670+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:54.012308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971279+0000","last_change":"2024-09-21T06:26:16.269793+0000","last_active":"2024-09-21T06:26:38.971279+0000","last_peered":"2024-09-21T06:26:38.971279+0000","last_clean":"2024-09-21T06:26:38.971279+0000","last_became_active":"2024-09-21T06:26:16.269455+0000","last_became_peered":"2024-09-21T06:26:16.269455+0000","last_unstale":"2024-09-21T06:26:38.971279+0000","last_undegraded":"2024-09-21T06:26:38.971279+0000","last_fullsized":"2024-09-21T06:26:38.971279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:44.369742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965132+0000","last_change":"2024-09-21T06:26:18.297573+0000","last_active":"2024-09-21T06:26:38.965132+0000","last_peered":"2024-09-21T06:26:38.965132+0000","last_clean":"2024-09-21T06:26:38.965132+0000","last_became_active":"2024-09-21T06:26:18.297190+0000","last_became_peered":"2024-09-21T06:26:18.297190+0000","last_unstale":"2024-09-21T06:26:38.965132+0000","last_undegraded":"2024-09-21T06:26:38.965132+0000","last_fullsized":"2024-09-21T06:26:38.965132+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:28.055520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'4","reported_seq":139,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:27:23.843735+0000","last_change":"2024-09-21T06:26:16.273604+0000","last_active":"2024-09-21T06:27:23.843735+0000","last_peered":"2024-09-21T06:27:23.843735+0000","last_clean":"2024-09-21T06:27:23.843735+0000","last_became_active":"2024-09-21T06:26:16.273194+0000","last_became_peered":"2024-09-21T06:26:16.273194+0000","last_unstale":"2024-09-21T06:27:23.843735+0000","last_undegraded":"2024-09-21T06:27:23.843735+0000","last_fullsized":"2024-09-21T06:27:23.843735+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:08.218442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":112,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966787+0000","last_change":"2024-09-21T06:26:18.303960+0000","last_active":"2024-09-21T06:26:38.966787+0000","last_peered":"2024-09-21T06:26:38.966787+0000","last_clean":"2024-09-21T06:26:38.966787+0000","last_became_active":"2024-09-21T06:26:18.303550+0000","last_became_peered":"2024-09-21T06:26:18.303550+0000","last_unstale":"2024-09-21T06:26:38.966787+0000","last_undegraded":"2024-09-21T06:26:38.966787+0000","last_fullsized":"2024-09-21T06:26:38.966787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:47.331439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.978327+0000","last_change":"2024-09-21T06:26:38.978161+0000","last_active":"2024-09-21T06:26:38.978327+0000","last_peered":"2024-09-21T06:26:38.978327+0000","last_clean":"2024-09-21T06:26:38.978327+0000","last_became_active":"2024-09-21T06:26:38.970818+0000","last_became_peered":"2024-09-21T06:26:38.970818+0000","last_unstale":"2024-09-21T06:26:38.978327+0000","last_undegraded":"2024-09-21T06:26:38.978327+0000","last_fullsized":"2024-09-21T06:26:38.978327+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:55.273463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967598+0000","last_change":"2024-09-21T06:26:18.311643+0000","last_active":"2024-09-21T06:26:38.967598+0000","last_peered":"2024-09-21T06:26:38.967598+0000","last_clean":"2024-09-21T06:26:38.967598+0000","last_became_active":"2024-09-21T06:26:18.311246+0000","last_became_peered":"2024-09-21T06:26:18.311246+0000","last_unstale":"2024-09-21T06:26:38.967598+0000","last_undegraded":"2024-09-21T06:26:38.967598+0000","last_fullsized":"2024-09-21T06:26:38.967598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:00.342212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971107+0000","last_change":"2024-09-21T06:26:16.313648+0000","last_active":"2024-09-21T06:26:38.971107+0000","last_peered":"2024-09-21T06:26:38.971107+0000","last_clean":"2024-09-21T06:26:38.971107+0000","last_became_active":"2024-09-21T06:26:16.313337+0000","last_became_peered":"2024-09-21T06:26:16.313337+0000","last_unstale":"2024-09-21T06:26:38.971107+0000","last_undegraded":"2024-09-21T06:26:38.971107+0000","last_fullsized":"2024-09-21T06:26:38.971107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:12.095276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966410+0000","last_change":"2024-09-21T06:26:18.310168+0000","last_active":"2024-09-21T06:26:38.966410+0000","last_peered":"2024-09-21T06:26:38.966410+0000","last_clean":"2024-09-21T06:26:38.966410+0000","last_became_active":"2024-09-21T06:26:18.309756+0000","last_became_peered":"2024-09-21T06:26:18.309756+0000","last_unstale":"2024-09-21T06:26:38.966410+0000","last_undegraded":"2024-09-21T06:26:38.966410+0000","last_fullsized":"2024-09-21T06:26:38.966410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:07.203202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'32","reported_seq":177,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:27:23.843735+0000","last_change":"2024-09-21T06:26:16.270243+0000","last_active":"2024-09-21T06:27:23.843735+0000","last_peered":"2024-09-21T06:27:23.843735+0000","last_clean":"2024-09-21T06:27:23.843735+0000","last_became_active":"2024-09-21T06:26:16.269883+0000","last_became_peered":"2024-09-21T06:26:16.269883+0000","last_unstale":"2024-09-21T06:27:23.843735+0000","last_undegraded":"2024-09-21T06:27:23.843735+0000","last_fullsized":"2024-09-21T06:27:23.843735+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:55.906972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66448,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":122,"num_read_kb":125,"num_write":34,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964370+0000","last_change":"2024-09-21T06:26:18.305508+0000","last_active":"2024-09-21T06:26:38.964370+0000","last_peered":"2024-09-21T06:26:38.964370+0000","last_clean":"2024-09-21T06:26:38.964370+0000","last_became_active":"2024-09-21T06:26:18.305104+0000","last_became_peered":"2024-09-21T06:26:18.305104+0000","last_unstale":"2024-09-21T06:26:38.964370+0000","last_undegraded":"2024-09-21T06:26:38.964370+0000","last_fullsized":"2024-09-21T06:26:38.964370+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:14.727084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'9","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.969025+0000","last_change":"2024-09-21T06:26:16.268331+0000","last_active":"2024-09-21T06:26:38.969025+0000","last_peered":"2024-09-21T06:26:38.969025+0000","last_clean":"2024-09-21T06:26:38.969025+0000","last_became_active":"2024-09-21T06:26:16.267918+0000","last_became_peered":"2024-09-21T06:26:16.267918+0000","last_unstale":"2024-09-21T06:26:38.969025+0000","last_undegraded":"2024-09-21T06:26:38.969025+0000","last_fullsized":"2024-09-21T06:26:38.969025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:50.198883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965178+0000","last_change":"2024-09-21T06:26:18.298052+0000","last_active":"2024-09-21T06:26:38.965178+0000","last_peered":"2024-09-21T06:26:38.965178+0000","last_clean":"2024-09-21T06:26:38.965178+0000","last_became_active":"2024-09-21T06:26:18.297686+0000","last_became_peered":"2024-09-21T06:26:18.297686+0000","last_unstale":"2024-09-21T06:26:38.965178+0000","last_undegraded":"2024-09-21T06:26:38.965178+0000","last_fullsized":"2024-09-21T06:26:38.965178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:56.261608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.970277+0000","last_change":"2024-09-21T06:26:16.270917+0000","last_active":"2024-09-21T06:26:38.970277+0000","last_peered":"2024-09-21T06:26:38.970277+0000","last_clean":"2024-09-21T06:26:38.970277+0000","last_became_active":"2024-09-21T06:26:16.270530+0000","last_became_peered":"2024-09-21T06:26:16.270530+0000","last_unstale":"2024-09-21T06:26:38.970277+0000","last_undegraded":"2024-09-21T06:26:38.970277+0000","last_fullsized":"2024-09-21T06:26:38.970277+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:30.772991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965618+0000","last_change":"2024-09-21T06:26:18.302286+0000","last_active":"2024-09-21T06:26:38.965618+0000","last_peered":"2024-09-21T06:26:38.965618+0000","last_clean":"2024-09-21T06:26:38.965618+0000","last_became_active":"2024-09-21T06:26:18.301777+0000","last_became_peered":"2024-09-21T06:26:18.301777+0000","last_unstale":"2024-09-21T06:26:38.965618+0000","last_undegraded":"2024-09-21T06:26:38.965618+0000","last_fullsized":"2024-09-21T06:26:38.965618+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:31.339898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":86,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:27:20.840257+0000","last_change":"2024-09-21T06:26:16.267569+0000","last_active":"2024-09-21T06:27:20.840257+0000","last_peered":"2024-09-21T06:27:20.840257+0000","last_clean":"2024-09-21T06:27:20.840257+0000","last_became_active":"2024-09-21T06:26:16.267198+0000","last_became_peered":"2024-09-21T06:26:16.267198+0000","last_unstale":"2024-09-21T06:27:20.840257+0000","last_undegraded":"2024-09-21T06:27:20.840257+0000","last_fullsized":"2024-09-21T06:27:20.840257+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:16.323246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964474+0000","last_change":"2024-09-21T06:26:18.294473+0000","last_active":"2024-09-21T06:26:38.964474+0000","last_peered":"2024-09-21T06:26:38.964474+0000","last_clean":"2024-09-21T06:26:38.964474+0000","last_became_active":"2024-09-21T06:26:18.294010+0000","last_became_peered":"2024-09-21T06:26:18.294010+0000","last_unstale":"2024-09-21T06:26:38.964474+0000","last_undegraded":"2024-09-21T06:26:38.964474+0000","last_fullsized":"2024-09-21T06:26:38.964474+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:12.098589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'17","reported_seq":66,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.994281+0000","last_change":"2024-09-21T06:26:38.994178+0000","last_active":"2024-09-21T06:26:38.994281+0000","last_peered":"2024-09-21T06:26:38.994281+0000","last_clean":"2024-09-21T06:26:38.994281+0000","last_became_active":"2024-09-21T06:26:38.977865+0000","last_became_peered":"2024-09-21T06:26:38.977865+0000","last_unstale":"2024-09-21T06:26:38.994281+0000","last_undegraded":"2024-09-21T06:26:38.994281+0000","last_fullsized":"2024-09-21T06:26:38.994281+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:44.368499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.969981+0000","last_change":"2024-09-21T06:26:18.312319+0000","last_active":"2024-09-21T06:26:38.969981+0000","last_peered":"2024-09-21T06:26:38.969981+0000","last_clean":"2024-09-21T06:26:38.969981+0000","last_became_active":"2024-09-21T06:26:18.311949+0000","last_became_peered":"2024-09-21T06:26:18.311949+0000","last_unstale":"2024-09-21T06:26:38.969981+0000","last_undegraded":"2024-09-21T06:26:38.969981+0000","last_fullsized":"2024-09-21T06:26:38.969981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:49.729693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964667+0000","last_change":"2024-09-21T06:26:16.273771+0000","last_active":"2024-09-21T06:26:38.964667+0000","last_peered":"2024-09-21T06:26:38.964667+0000","last_clean":"2024-09-21T06:26:38.964667+0000","last_became_active":"2024-09-21T06:26:16.273293+0000","last_became_peered":"2024-09-21T06:26:16.273293+0000","last_unstale":"2024-09-21T06:26:38.964667+0000","last_undegraded":"2024-09-21T06:26:38.964667+0000","last_fullsized":"2024-09-21T06:26:38.964667+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:21.867844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.961892+0000","last_change":"2024-09-21T06:26:18.309204+0000","last_active":"2024-09-21T06:26:38.961892+0000","last_peered":"2024-09-21T06:26:38.961892+0000","last_clean":"2024-09-21T06:26:38.961892+0000","last_became_active":"2024-09-21T06:26:18.308838+0000","last_became_peered":"2024-09-21T06:26:18.308838+0000","last_unstale":"2024-09-21T06:26:38.961892+0000","last_undegraded":"2024-09-21T06:26:38.961892+0000","last_fullsized":"2024-09-21T06:26:38.961892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:14.011799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'5","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965404+0000","last_change":"2024-09-21T06:26:16.267965+0000","last_active":"2024-09-21T06:26:38.965404+0000","last_peered":"2024-09-21T06:26:38.965404+0000","last_clean":"2024-09-21T06:26:38.965404+0000","last_became_active":"2024-09-21T06:26:16.267548+0000","last_became_peered":"2024-09-21T06:26:16.267548+0000","last_unstale":"2024-09-21T06:26:38.965404+0000","last_undegraded":"2024-09-21T06:26:38.965404+0000","last_fullsized":"2024-09-21T06:26:38.965404+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:51.915817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965963+0000","last_change":"2024-09-21T06:26:18.306376+0000","last_active":"2024-09-21T06:26:38.965963+0000","last_peered":"2024-09-21T06:26:38.965963+0000","last_clean":"2024-09-21T06:26:38.965963+0000","last_became_active":"2024-09-21T06:26:18.305956+0000","last_became_peered":"2024-09-21T06:26:18.305956+0000","last_unstale":"2024-09-21T06:26:38.965963+0000","last_undegraded":"2024-09-21T06:26:38.965963+0000","last_fullsized":"2024-09-21T06:26:38.965963+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:27.229499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971383+0000","last_change":"2024-09-21T06:26:16.267201+0000","last_active":"2024-09-21T06:26:38.971383+0000","last_peered":"2024-09-21T06:26:38.971383+0000","last_clean":"2024-09-21T06:26:38.971383+0000","last_became_active":"2024-09-21T06:26:16.266832+0000","last_became_peered":"2024-09-21T06:26:16.266832+0000","last_unstale":"2024-09-21T06:26:38.971383+0000","last_undegraded":"2024-09-21T06:26:38.971383+0000","last_fullsized":"2024-09-21T06:26:38.971383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:48.626106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.984188+0000","last_change":"2024-09-21T06:26:38.984119+0000","last_active":"2024-09-21T06:26:38.984188+0000","last_peered":"2024-09-21T06:26:38.984188+0000","last_clean":"2024-09-21T06:26:38.984188+0000","last_became_active":"2024-09-21T06:26:38.972316+0000","last_became_peered":"2024-09-21T06:26:38.972316+0000","last_unstale":"2024-09-21T06:26:38.984188+0000","last_undegraded":"2024-09-21T06:26:38.984188+0000","last_fullsized":"2024-09-21T06:26:38.984188+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:22.788293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'6","reported_seq":85,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:27:19.838322+0000","last_change":"2024-09-21T06:26:16.572993+0000","last_active":"2024-09-21T06:27:19.838322+0000","last_peered":"2024-09-21T06:27:19.838322+0000","last_clean":"2024-09-21T06:27:19.838322+0000","last_became_active":"2024-09-21T06:26:16.572631+0000","last_became_peered":"2024-09-21T06:26:16.572631+0000","last_unstale":"2024-09-21T06:27:19.838322+0000","last_undegraded":"2024-09-21T06:27:19.838322+0000","last_fullsized":"2024-09-21T06:27:19.838322+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:05.276119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966079+0000","last_change":"2024-09-21T06:26:18.304685+0000","last_active":"2024-09-21T06:26:38.966079+0000","last_peered":"2024-09-21T06:26:38.966079+0000","last_clean":"2024-09-21T06:26:38.966079+0000","last_became_active":"2024-09-21T06:26:18.304325+0000","last_became_peered":"2024-09-21T06:26:18.304325+0000","last_unstale":"2024-09-21T06:26:38.966079+0000","last_undegraded":"2024-09-21T06:26:38.966079+0000","last_fullsized":"2024-09-21T06:26:38.966079+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:18.072602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965169+0000","last_change":"2024-09-21T06:25:04.875443+0000","last_active":"2024-09-21T06:26:38.965169+0000","last_peered":"2024-09-21T06:26:38.965169+0000","last_clean":"2024-09-21T06:26:38.965169+0000","last_became_active":"2024-09-21T06:25:04.869179+0000","last_became_peered":"2024-09-21T06:25:04.869179+0000","last_unstale":"2024-09-21T06:26:38.965169+0000","last_undegraded":"2024-09-21T06:26:38.965169+0000","last_fullsized":"2024-09-21T06:26:38.965169+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:21:37.191501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:21:37.191501+0000","last_clean_scrub_stamp":"2024-09-21T06:21:37.191501+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:19.981367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'6","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962414+0000","last_change":"2024-09-21T06:26:16.268440+0000","last_active":"2024-09-21T06:26:38.962414+0000","last_peered":"2024-09-21T06:26:38.962414+0000","last_clean":"2024-09-21T06:26:38.962414+0000","last_became_active":"2024-09-21T06:26:16.268078+0000","last_became_peered":"2024-09-21T06:26:16.268078+0000","last_unstale":"2024-09-21T06:26:38.962414+0000","last_undegraded":"2024-09-21T06:26:38.962414+0000","last_fullsized":"2024-09-21T06:26:38.962414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:55.696736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963878+0000","last_change":"2024-09-21T06:26:18.306410+0000","last_active":"2024-09-21T06:26:38.963878+0000","last_peered":"2024-09-21T06:26:38.963878+0000","last_clean":"2024-09-21T06:26:38.963878+0000","last_became_active":"2024-09-21T06:26:18.304718+0000","last_became_peered":"2024-09-21T06:26:18.304718+0000","last_unstale":"2024-09-21T06:26:38.963878+0000","last_undegraded":"2024-09-21T06:26:38.963878+0000","last_fullsized":"2024-09-21T06:26:38.963878+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:18.521867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964484+0000","last_change":"2024-09-21T06:26:16.270305+0000","last_active":"2024-09-21T06:26:38.964484+0000","last_peered":"2024-09-21T06:26:38.964484+0000","last_clean":"2024-09-21T06:26:38.964484+0000","last_became_active":"2024-09-21T06:26:16.269891+0000","last_became_peered":"2024-09-21T06:26:16.269891+0000","last_unstale":"2024-09-21T06:26:38.964484+0000","last_undegraded":"2024-09-21T06:26:38.964484+0000","last_fullsized":"2024-09-21T06:26:38.964484+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:48.575805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966049+0000","last_change":"2024-09-21T06:26:18.302404+0000","last_active":"2024-09-21T06:26:38.966049+0000","last_peered":"2024-09-21T06:26:38.966049+0000","last_clean":"2024-09-21T06:26:38.966049+0000","last_became_active":"2024-09-21T06:26:18.302036+0000","last_became_peered":"2024-09-21T06:26:18.302036+0000","last_unstale":"2024-09-21T06:26:38.966049+0000","last_undegraded":"2024-09-21T06:26:38.966049+0000","last_fullsized":"2024-09-21T06:26:38.966049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:36.688018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":86,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:27:23.843888+0000","last_change":"2024-09-21T06:26:16.310996+0000","last_active":"2024-09-21T06:27:23.843888+0000","last_peered":"2024-09-21T06:27:23.843888+0000","last_clean":"2024-09-21T06:27:23.843888+0000","last_became_active":"2024-09-21T06:26:16.310566+0000","last_became_peered":"2024-09-21T06:26:16.310566+0000","last_unstale":"2024-09-21T06:27:23.843888+0000","last_undegraded":"2024-09-21T06:27:23.843888+0000","last_fullsized":"2024-09-21T06:27:23.843888+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:27.569789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971180+0000","last_change":"2024-09-21T06:26:18.310343+0000","last_active":"2024-09-21T06:26:38.971180+0000","last_peered":"2024-09-21T06:26:38.971180+0000","last_clean":"2024-09-21T06:26:38.971180+0000","last_became_active":"2024-09-21T06:26:18.309979+0000","last_became_peered":"2024-09-21T06:26:18.309979+0000","last_unstale":"2024-09-21T06:26:38.971180+0000","last_undegraded":"2024-09-21T06:26:38.971180+0000","last_fullsized":"2024-09-21T06:26:38.971180+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:20.340822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'5","reported_seq":65,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:27:24.039089+0000","last_change":"2024-09-21T06:26:38.974313+0000","last_active":"2024-09-21T06:27:24.039089+0000","last_peered":"2024-09-21T06:27:24.039089+0000","last_clean":"2024-09-21T06:27:24.039089+0000","last_became_active":"2024-09-21T06:26:38.966498+0000","last_became_peered":"2024-09-21T06:26:38.966498+0000","last_unstale":"2024-09-21T06:27:24.039089+0000","last_undegraded":"2024-09-21T06:27:24.039089+0000","last_fullsized":"2024-09-21T06:27:24.039089+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:56.732330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":588,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964787+0000","last_change":"2024-09-21T06:26:18.312080+0000","last_active":"2024-09-21T06:26:38.964787+0000","last_peered":"2024-09-21T06:26:38.964787+0000","last_clean":"2024-09-21T06:26:38.964787+0000","last_became_active":"2024-09-21T06:26:18.311351+0000","last_became_peered":"2024-09-21T06:26:18.311351+0000","last_unstale":"2024-09-21T06:26:38.964787+0000","last_undegraded":"2024-09-21T06:26:38.964787+0000","last_fullsized":"2024-09-21T06:26:38.964787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:33.545677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965339+0000","last_change":"2024-09-21T06:26:16.311108+0000","last_active":"2024-09-21T06:26:38.965339+0000","last_peered":"2024-09-21T06:26:38.965339+0000","last_clean":"2024-09-21T06:26:38.965339+0000","last_became_active":"2024-09-21T06:26:16.310595+0000","last_became_peered":"2024-09-21T06:26:16.310595+0000","last_unstale":"2024-09-21T06:26:38.965339+0000","last_undegraded":"2024-09-21T06:26:38.965339+0000","last_fullsized":"2024-09-21T06:26:38.965339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:43.125242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964942+0000","last_change":"2024-09-21T06:26:18.300618+0000","last_active":"2024-09-21T06:26:38.964942+0000","last_peered":"2024-09-21T06:26:38.964942+0000","last_clean":"2024-09-21T06:26:38.964942+0000","last_became_active":"2024-09-21T06:26:18.300234+0000","last_became_peered":"2024-09-21T06:26:18.300234+0000","last_unstale":"2024-09-21T06:26:38.964942+0000","last_undegraded":"2024-09-21T06:26:38.964942+0000","last_fullsized":"2024-09-21T06:26:38.964942+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:53.224425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'4","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.982480+0000","last_change":"2024-09-21T06:26:38.981999+0000","last_active":"2024-09-21T06:26:38.982480+0000","last_peered":"2024-09-21T06:26:38.982480+0000","last_clean":"2024-09-21T06:26:38.982480+0000","last_became_active":"2024-09-21T06:26:38.969199+0000","last_became_peered":"2024-09-21T06:26:38.969199+0000","last_unstale":"2024-09-21T06:26:38.982480+0000","last_undegraded":"2024-09-21T06:26:38.982480+0000","last_fullsized":"2024-09-21T06:26:38.982480+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:17.389262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965217+0000","last_change":"2024-09-21T06:26:18.297693+0000","last_active":"2024-09-21T06:26:38.965217+0000","last_peered":"2024-09-21T06:26:38.965217+0000","last_clean":"2024-09-21T06:26:38.965217+0000","last_became_active":"2024-09-21T06:26:18.297335+0000","last_became_peered":"2024-09-21T06:26:18.297335+0000","last_unstale":"2024-09-21T06:26:38.965217+0000","last_undegraded":"2024-09-21T06:26:38.965217+0000","last_fullsized":"2024-09-21T06:26:38.965217+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:30.144220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'15","reported_seq":38,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:44.295312+0000","last_change":"2024-09-21T06:26:16.269854+0000","last_active":"2024-09-21T06:26:44.295312+0000","last_peered":"2024-09-21T06:26:44.295312+0000","last_clean":"2024-09-21T06:26:44.295312+0000","last_became_active":"2024-09-21T06:26:16.269415+0000","last_became_peered":"2024-09-21T06:26:16.269415+0000","last_unstale":"2024-09-21T06:26:44.295312+0000","last_undegraded":"2024-09-21T06:26:44.295312+0000","last_fullsized":"2024-09-21T06:26:44.295312+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:50.525916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964317+0000","last_change":"2024-09-21T06:26:18.306302+0000","last_active":"2024-09-21T06:26:38.964317+0000","last_peered":"2024-09-21T06:26:38.964317+0000","last_clean":"2024-09-21T06:26:38.964317+0000","last_became_active":"2024-09-21T06:26:18.305723+0000","last_became_peered":"2024-09-21T06:26:18.305723+0000","last_unstale":"2024-09-21T06:26:38.964317+0000","last_undegraded":"2024-09-21T06:26:38.964317+0000","last_fullsized":"2024-09-21T06:26:38.964317+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:30.051791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'7","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962517+0000","last_change":"2024-09-21T06:26:16.573081+0000","last_active":"2024-09-21T06:26:38.962517+0000","last_peered":"2024-09-21T06:26:38.962517+0000","last_clean":"2024-09-21T06:26:38.962517+0000","last_became_active":"2024-09-21T06:26:16.572680+0000","last_became_peered":"2024-09-21T06:26:16.572680+0000","last_unstale":"2024-09-21T06:26:38.962517+0000","last_undegraded":"2024-09-21T06:26:38.962517+0000","last_fullsized":"2024-09-21T06:26:38.962517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:04.698258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967148+0000","last_change":"2024-09-21T06:26:18.311610+0000","last_active":"2024-09-21T06:26:38.967148+0000","last_peered":"2024-09-21T06:26:38.967148+0000","last_clean":"2024-09-21T06:26:38.967148+0000","last_became_active":"2024-09-21T06:26:18.311239+0000","last_became_peered":"2024-09-21T06:26:18.311239+0000","last_unstale":"2024-09-21T06:26:38.967148+0000","last_undegraded":"2024-09-21T06:26:38.967148+0000","last_fullsized":"2024-09-21T06:26:38.967148+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:36.995768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965260+0000","last_change":"2024-09-21T06:26:16.313612+0000","last_active":"2024-09-21T06:26:38.965260+0000","last_peered":"2024-09-21T06:26:38.965260+0000","last_clean":"2024-09-21T06:26:38.965260+0000","last_became_active":"2024-09-21T06:26:16.313298+0000","last_became_peered":"2024-09-21T06:26:16.313298+0000","last_unstale":"2024-09-21T06:26:38.965260+0000","last_undegraded":"2024-09-21T06:26:38.965260+0000","last_fullsized":"2024-09-21T06:26:38.965260+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:45.035454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963931+0000","last_change":"2024-09-21T06:26:18.304772+0000","last_active":"2024-09-21T06:26:38.963931+0000","last_peered":"2024-09-21T06:26:38.963931+0000","last_clean":"2024-09-21T06:26:38.963931+0000","last_became_active":"2024-09-21T06:26:18.303909+0000","last_became_peered":"2024-09-21T06:26:18.303909+0000","last_unstale":"2024-09-21T06:26:38.963931+0000","last_undegraded":"2024-09-21T06:26:38.963931+0000","last_fullsized":"2024-09-21T06:26:38.963931+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:28.707169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963811+0000","last_change":"2024-09-21T06:26:16.267563+0000","last_active":"2024-09-21T06:26:38.963811+0000","last_peered":"2024-09-21T06:26:38.963811+0000","last_clean":"2024-09-21T06:26:38.963811+0000","last_became_active":"2024-09-21T06:26:16.267182+0000","last_became_peered":"2024-09-21T06:26:16.267182+0000","last_unstale":"2024-09-21T06:26:38.963811+0000","last_undegraded":"2024-09-21T06:26:38.963811+0000","last_fullsized":"2024-09-21T06:26:38.963811+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:16.042105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.961758+0000","last_change":"2024-09-21T06:26:18.310772+0000","last_active":"2024-09-21T06:26:38.961758+0000","last_peered":"2024-09-21T06:26:38.961758+0000","last_clean":"2024-09-21T06:26:38.961758+0000","last_became_active":"2024-09-21T06:26:18.310382+0000","last_became_peered":"2024-09-21T06:26:18.310382+0000","last_unstale":"2024-09-21T06:26:38.961758+0000","last_undegraded":"2024-09-21T06:26:38.961758+0000","last_fullsized":"2024-09-21T06:26:38.961758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:54:35.028081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967712+0000","last_change":"2024-09-21T06:26:16.270971+0000","last_active":"2024-09-21T06:26:38.967712+0000","last_peered":"2024-09-21T06:26:38.967712+0000","last_clean":"2024-09-21T06:26:38.967712+0000","last_became_active":"2024-09-21T06:26:16.270453+0000","last_became_peered":"2024-09-21T06:26:16.270453+0000","last_unstale":"2024-09-21T06:26:38.967712+0000","last_undegraded":"2024-09-21T06:26:38.967712+0000","last_fullsized":"2024-09-21T06:26:38.967712+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:34.687380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963945+0000","last_change":"2024-09-21T06:26:18.300568+0000","last_active":"2024-09-21T06:26:38.963945+0000","last_peered":"2024-09-21T06:26:38.963945+0000","last_clean":"2024-09-21T06:26:38.963945+0000","last_became_active":"2024-09-21T06:26:18.298864+0000","last_became_peered":"2024-09-21T06:26:18.298864+0000","last_unstale":"2024-09-21T06:26:38.963945+0000","last_undegraded":"2024-09-21T06:26:38.963945+0000","last_fullsized":"2024-09-21T06:26:38.963945+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:00.786225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964246+0000","last_change":"2024-09-21T06:26:16.274093+0000","last_active":"2024-09-21T06:26:38.964246+0000","last_peered":"2024-09-21T06:26:38.964246+0000","last_clean":"2024-09-21T06:26:38.964246+0000","last_became_active":"2024-09-21T06:26:16.273707+0000","last_became_peered":"2024-09-21T06:26:16.273707+0000","last_unstale":"2024-09-21T06:26:38.964246+0000","last_undegraded":"2024-09-21T06:26:38.964246+0000","last_fullsized":"2024-09-21T06:26:38.964246+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:26.710260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965837+0000","last_change":"2024-09-21T06:26:18.300140+0000","last_active":"2024-09-21T06:26:38.965837+0000","last_peered":"2024-09-21T06:26:38.965837+0000","last_clean":"2024-09-21T06:26:38.965837+0000","last_became_active":"2024-09-21T06:26:18.299543+0000","last_became_peered":"2024-09-21T06:26:18.299543+0000","last_unstale":"2024-09-21T06:26:38.965837+0000","last_undegraded":"2024-09-21T06:26:38.965837+0000","last_fullsized":"2024-09-21T06:26:38.965837+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:50.272247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.970973+0000","last_change":"2024-09-21T06:26:18.311528+0000","last_active":"2024-09-21T06:26:38.970973+0000","last_peered":"2024-09-21T06:26:38.970973+0000","last_clean":"2024-09-21T06:26:38.970973+0000","last_became_active":"2024-09-21T06:26:18.311144+0000","last_became_peered":"2024-09-21T06:26:18.311144+0000","last_unstale":"2024-09-21T06:26:38.970973+0000","last_undegraded":"2024-09-21T06:26:38.970973+0000","last_fullsized":"2024-09-21T06:26:38.970973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:05.554255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964467+0000","last_change":"2024-09-21T06:26:16.275378+0000","last_active":"2024-09-21T06:26:38.964467+0000","last_peered":"2024-09-21T06:26:38.964467+0000","last_clean":"2024-09-21T06:26:38.964467+0000","last_became_active":"2024-09-21T06:26:16.274990+0000","last_became_peered":"2024-09-21T06:26:16.274990+0000","last_unstale":"2024-09-21T06:26:38.964467+0000","last_undegraded":"2024-09-21T06:26:38.964467+0000","last_fullsized":"2024-09-21T06:26:38.964467+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:57.252993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966421+0000","last_change":"2024-09-21T06:26:18.300879+0000","last_active":"2024-09-21T06:26:38.966421+0000","last_peered":"2024-09-21T06:26:38.966421+0000","last_clean":"2024-09-21T06:26:38.966421+0000","last_became_active":"2024-09-21T06:26:18.300514+0000","last_became_peered":"2024-09-21T06:26:18.300514+0000","last_unstale":"2024-09-21T06:26:38.966421+0000","last_undegraded":"2024-09-21T06:26:38.966421+0000","last_fullsized":"2024-09-21T06:26:38.966421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:02.581145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'12","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964519+0000","last_change":"2024-09-21T06:26:16.274139+0000","last_active":"2024-09-21T06:26:38.964519+0000","last_peered":"2024-09-21T06:26:38.964519+0000","last_clean":"2024-09-21T06:26:38.964519+0000","last_became_active":"2024-09-21T06:26:16.273723+0000","last_became_peered":"2024-09-21T06:26:16.273723+0000","last_unstale":"2024-09-21T06:26:38.964519+0000","last_undegraded":"2024-09-21T06:26:38.964519+0000","last_fullsized":"2024-09-21T06:26:38.964519+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:24.366714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967496+0000","last_change":"2024-09-21T06:26:18.304602+0000","last_active":"2024-09-21T06:26:38.967496+0000","last_peered":"2024-09-21T06:26:38.967496+0000","last_clean":"2024-09-21T06:26:38.967496+0000","last_became_active":"2024-09-21T06:26:18.304259+0000","last_became_peered":"2024-09-21T06:26:18.304259+0000","last_unstale":"2024-09-21T06:26:38.967496+0000","last_undegraded":"2024-09-21T06:26:38.967496+0000","last_fullsized":"2024-09-21T06:26:38.967496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:16.428247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964281+0000","last_change":"2024-09-21T06:26:16.311107+0000","last_active":"2024-09-21T06:26:38.964281+0000","last_peered":"2024-09-21T06:26:38.964281+0000","last_clean":"2024-09-21T06:26:38.964281+0000","last_became_active":"2024-09-21T06:26:16.310692+0000","last_became_peered":"2024-09-21T06:26:16.310692+0000","last_unstale":"2024-09-21T06:26:38.964281+0000","last_undegraded":"2024-09-21T06:26:38.964281+0000","last_fullsized":"2024-09-21T06:26:38.964281+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:29.074606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964061+0000","last_change":"2024-09-21T06:26:18.300614+0000","last_active":"2024-09-21T06:26:38.964061+0000","last_peered":"2024-09-21T06:26:38.964061+0000","last_clean":"2024-09-21T06:26:38.964061+0000","last_became_active":"2024-09-21T06:26:18.300173+0000","last_became_peered":"2024-09-21T06:26:18.300173+0000","last_unstale":"2024-09-21T06:26:38.964061+0000","last_undegraded":"2024-09-21T06:26:38.964061+0000","last_fullsized":"2024-09-21T06:26:38.964061+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:49.040667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'13","reported_seq":112,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:27:22.035413+0000","last_change":"2024-09-21T06:26:38.986822+0000","last_active":"2024-09-21T06:27:22.035413+0000","last_peered":"2024-09-21T06:27:22.035413+0000","last_clean":"2024-09-21T06:27:22.035413+0000","last_became_active":"2024-09-21T06:26:38.972368+0000","last_became_peered":"2024-09-21T06:26:38.972368+0000","last_unstale":"2024-09-21T06:27:22.035413+0000","last_undegraded":"2024-09-21T06:27:22.035413+0000","last_fullsized":"2024-09-21T06:27:22.035413+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:53.273388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73652,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":579,"num_read_kb":372,"num_write":246,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1484,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":220956,"data_compressed":4914,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282590,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743450,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":860160,"data_stored":420766,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939680,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1007616,"data_stored":1077543,"data_compressed":43480,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103205,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":876544,"data_stored":419722,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299434,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":419199,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495663,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":1011913,"data_compressed":41842,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659189,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":419322,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855418,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":933888,"data_stored":1011788,"data_compressed":41842,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018942,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":864256,"data_stored":419686,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":419030,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378697,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":487182,"data_compressed":7539,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542222,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":929792,"data_stored":487355,"data_compressed":7539,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705746,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":876544,"data_stored":421052,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68872,"data_compressed":1638,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68699,"data_compressed":1638,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":68575,"data_compressed":1638,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:27:27.694 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T06:27:27.694 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T06:27:27.694 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T06:27:27.694 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T06:27:27.952 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:28.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:27 smithi071 ceph-mon[34844]: pgmap v299: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T06:27:28.073 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:27 smithi063 ceph-mon[31150]: pgmap v299: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T06:27:28.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:27 smithi175 ceph-mon[34510]: pgmap v299: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T06:27:28.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.451+0000 7f29ad36b640 1 -- 172.21.15.63:0/2171873119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29a81048a0 msgr2=0x7f29a8104cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:28.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.451+0000 7f29ad36b640 1 --2- 172.21.15.63:0/2171873119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29a81048a0 0x7f29a8104cb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2998009900 tx=0x7f299802a410 comp rx=0 tx=0).stop 2024-09-21T06:27:28.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.451+0000 7f29ad36b640 1 -- 172.21.15.63:0/2171873119 shutdown_connections 2024-09-21T06:27:28.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.451+0000 7f29ad36b640 1 --2- 172.21.15.63:0/2171873119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29a810de50 0x7f29a8110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:28.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.451+0000 7f29ad36b640 1 --2- 172.21.15.63:0/2171873119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29a81052d0 0x7f29a810d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:28.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.451+0000 7f29ad36b640 1 --2- 172.21.15.63:0/2171873119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29a81048a0 0x7f29a8104cb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:28.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.451+0000 7f29ad36b640 1 -- 172.21.15.63:0/2171873119 >> 172.21.15.63:0/2171873119 conn(0x7f29a8079760 msgr2=0x7f29a8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:28.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.451+0000 7f29ad36b640 1 -- 172.21.15.63:0/2171873119 shutdown_connections 2024-09-21T06:27:28.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.451+0000 7f29ad36b640 1 -- 172.21.15.63:0/2171873119 wait complete. 2024-09-21T06:27:28.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.451+0000 7f29ad36b640 1 Processor -- start 2024-09-21T06:27:28.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.452+0000 7f29ad36b640 1 -- start start 2024-09-21T06:27:28.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.452+0000 7f29ad36b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29a81048a0 0x7f29a819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:28.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.452+0000 7f29ad36b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29a81052d0 0x7f29a819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:28.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.452+0000 7f29ad36b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29a810de50 0x7f29a819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:28.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.452+0000 7f29ad36b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f29a8113ac0 con 0x7f29a81052d0 2024-09-21T06:27:28.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.452+0000 7f29ad36b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f29a8113940 con 0x7f29a81048a0 2024-09-21T06:27:28.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.452+0000 7f29ad36b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f29a8113c40 con 0x7f29a810de50 2024-09-21T06:27:28.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.452+0000 7f29a67fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29a81052d0 0x7f29a819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:28.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.452+0000 7f29a67fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29a81052d0 0x7f29a819aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46592/0 (socket says 172.21.15.63:46592) 2024-09-21T06:27:28.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.452+0000 7f29a67fc640 1 -- 172.21.15.63:0/1153345172 learned_addr learned my addr 172.21.15.63:0/1153345172 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:28.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.452+0000 7f29a6ffd640 1 --2- 172.21.15.63:0/1153345172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29a81048a0 0x7f29a819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:28.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.452+0000 7f29a77fe640 1 --2- 172.21.15.63:0/1153345172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29a810de50 0x7f29a819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:28.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.452+0000 7f29a67fc640 1 -- 172.21.15.63:0/1153345172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29a810de50 msgr2=0x7f29a819fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:28.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.452+0000 7f29a67fc640 1 --2- 172.21.15.63:0/1153345172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29a810de50 0x7f29a819fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:28.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.452+0000 7f29a67fc640 1 -- 172.21.15.63:0/1153345172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29a81048a0 msgr2=0x7f29a819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:28.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.452+0000 7f29a67fc640 1 --2- 172.21.15.63:0/1153345172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29a81048a0 0x7f29a819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:28.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.452+0000 7f29a67fc640 1 -- 172.21.15.63:0/1153345172 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a81a0480 con 0x7f29a81052d0 2024-09-21T06:27:28.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.452+0000 7f29a67fc640 1 --2- 172.21.15.63:0/1153345172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29a81052d0 0x7f29a819aab0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f299c00d740 tx=0x7f299c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:28.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.453+0000 7f298ffff640 1 -- 172.21.15.63:0/1153345172 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c017070 con 0x7f29a81052d0 2024-09-21T06:27:28.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.453+0000 7f29ad36b640 1 -- 172.21.15.63:0/1153345172 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29a81a0770 con 0x7f29a81052d0 2024-09-21T06:27:28.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.453+0000 7f298ffff640 1 -- 172.21.15.63:0/1153345172 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f299c00de50 con 0x7f29a81052d0 2024-09-21T06:27:28.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.453+0000 7f298ffff640 1 -- 172.21.15.63:0/1153345172 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c00f620 con 0x7f29a81052d0 2024-09-21T06:27:28.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.453+0000 7f29ad36b640 1 -- 172.21.15.63:0/1153345172 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a81a6ed0 con 0x7f29a81052d0 2024-09-21T06:27:28.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.454+0000 7f29ad36b640 1 -- 172.21.15.63:0/1153345172 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29a806c1b0 con 0x7f29a81052d0 2024-09-21T06:27:28.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.455+0000 7f298ffff640 1 -- 172.21.15.63:0/1153345172 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f299c01a070 con 0x7f29a81052d0 2024-09-21T06:27:28.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.456+0000 7f298ffff640 1 --2- 172.21.15.63:0/1153345172 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f29900b65f0 0x7f29900b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:28.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.457+0000 7f29a6ffd640 1 --2- 172.21.15.63:0/1153345172 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f29900b65f0 0x7f29900b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:28.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.457+0000 7f298ffff640 1 -- 172.21.15.63:0/1153345172 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f299c0e6ff0 con 0x7f29a81052d0 2024-09-21T06:27:28.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.457+0000 7f29a6ffd640 1 --2- 172.21.15.63:0/1153345172 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f29900b65f0 0x7f29900b8b00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2998000c00 tx=0x7f2998031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:28.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.460+0000 7f298ffff640 1 -- 172.21.15.63:0/1153345172 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f299c0ad600 con 0x7f29a81052d0 2024-09-21T06:27:28.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.689+0000 7f29ad36b640 1 -- 172.21.15.63:0/1153345172 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f29a8104cb0 con 0x7f29a81052d0 2024-09-21T06:27:28.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.689+0000 7f298ffff640 1 -- 172.21.15.63:0/1153345172 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f29a8104cb0 con 0x7f29a81052d0 2024-09-21T06:27:28.691 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:27:28.691 INFO:teuthology.orchestra.run.smithi063.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T06:27:28.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.692+0000 7f29ad36b640 1 -- 172.21.15.63:0/1153345172 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f29900b65f0 msgr2=0x7f29900b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:28.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.692+0000 7f29ad36b640 1 --2- 172.21.15.63:0/1153345172 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f29900b65f0 0x7f29900b8b00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2998000c00 tx=0x7f2998031400 comp rx=0 tx=0).stop 2024-09-21T06:27:28.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.692+0000 7f29ad36b640 1 -- 172.21.15.63:0/1153345172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29a81052d0 msgr2=0x7f29a819aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:28.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.692+0000 7f29ad36b640 1 --2- 172.21.15.63:0/1153345172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29a81052d0 0x7f29a819aab0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f299c00d740 tx=0x7f299c00dc00 comp rx=0 tx=0).stop 2024-09-21T06:27:28.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.692+0000 7f29ad36b640 1 -- 172.21.15.63:0/1153345172 shutdown_connections 2024-09-21T06:27:28.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.692+0000 7f29ad36b640 1 --2- 172.21.15.63:0/1153345172 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f29900b65f0 0x7f29900b8b00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:28.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.692+0000 7f29ad36b640 1 --2- 172.21.15.63:0/1153345172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29a810de50 0x7f29a819fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:28.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.692+0000 7f29ad36b640 1 --2- 172.21.15.63:0/1153345172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29a81052d0 0x7f29a819aab0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:28.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.692+0000 7f29ad36b640 1 --2- 172.21.15.63:0/1153345172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29a81048a0 0x7f29a819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:28.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.692+0000 7f29ad36b640 1 -- 172.21.15.63:0/1153345172 >> 172.21.15.63:0/1153345172 conn(0x7f29a8079760 msgr2=0x7f29a81008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:28.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.692+0000 7f29ad36b640 1 -- 172.21.15.63:0/1153345172 shutdown_connections 2024-09-21T06:27:28.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:28.692+0000 7f29ad36b640 1 -- 172.21.15.63:0/1153345172 wait complete. 2024-09-21T06:27:29.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:28 smithi071 ceph-mon[34844]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:27:29.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:28 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1153345172' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T06:27:29.059 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:28 smithi063 ceph-mon[31150]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:27:29.059 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:28 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1153345172' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T06:27:29.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:28 smithi175 ceph-mon[34510]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:27:29.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:28 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1153345172' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T06:27:29.371 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T06:27:29.372 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:27:29.627 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:30.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:29 smithi071 ceph-mon[34844]: pgmap v300: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:27:30.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:29 smithi063 ceph-mon[31150]: pgmap v300: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:27:30.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:29 smithi175 ceph-mon[34510]: pgmap v300: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:27:30.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.181+0000 7f346a2c6640 1 -- 172.21.15.63:0/2055777704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3464109e10 msgr2=0x7f3464110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:30.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.181+0000 7f346a2c6640 1 --2- 172.21.15.63:0/2055777704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3464109e10 0x7f3464110640 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f345c009ca0 tx=0x7f345c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:30.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.181+0000 7f346a2c6640 1 -- 172.21.15.63:0/2055777704 shutdown_connections 2024-09-21T06:27:30.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.181+0000 7f346a2c6640 1 --2- 172.21.15.63:0/2055777704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3464109e10 0x7f3464110640 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:30.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.181+0000 7f346a2c6640 1 --2- 172.21.15.63:0/2055777704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34641094c0 0x7f34641098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:30.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.181+0000 7f346a2c6640 1 --2- 172.21.15.63:0/2055777704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3464101fe0 0x7f34641023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:30.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.181+0000 7f346a2c6640 1 -- 172.21.15.63:0/2055777704 >> 172.21.15.63:0/2055777704 conn(0x7f3464077bc0 msgr2=0x7f3464078000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:30.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.181+0000 7f346a2c6640 1 -- 172.21.15.63:0/2055777704 shutdown_connections 2024-09-21T06:27:30.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.181+0000 7f346a2c6640 1 -- 172.21.15.63:0/2055777704 wait complete. 2024-09-21T06:27:30.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.182+0000 7f346a2c6640 1 Processor -- start 2024-09-21T06:27:30.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.182+0000 7f346a2c6640 1 -- start start 2024-09-21T06:27:30.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.182+0000 7f346a2c6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3464101fe0 0x7f346419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:30.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.182+0000 7f346a2c6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34641094c0 0x7f346419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:30.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.182+0000 7f346a2c6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3464109e10 0x7f346419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:30.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.182+0000 7f346a2c6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3464113a80 con 0x7f3464109e10 2024-09-21T06:27:30.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.182+0000 7f346a2c6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3464113900 con 0x7f3464101fe0 2024-09-21T06:27:30.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.182+0000 7f346a2c6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3464113c00 con 0x7f34641094c0 2024-09-21T06:27:30.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.182+0000 7f3468863640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3464109e10 0x7f346419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:30.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.182+0000 7f3468863640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3464109e10 0x7f346419fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46600/0 (socket says 172.21.15.63:46600) 2024-09-21T06:27:30.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.182+0000 7f3468863640 1 -- 172.21.15.63:0/4039577824 learned_addr learned my addr 172.21.15.63:0/4039577824 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:30.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.183+0000 7f34637fe640 1 --2- 172.21.15.63:0/4039577824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34641094c0 0x7f346419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:30.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.183+0000 7f3463fff640 1 --2- 172.21.15.63:0/4039577824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3464101fe0 0x7f346419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:30.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.183+0000 7f3468863640 1 -- 172.21.15.63:0/4039577824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34641094c0 msgr2=0x7f346419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:30.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.183+0000 7f3468863640 1 --2- 172.21.15.63:0/4039577824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34641094c0 0x7f346419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:30.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.183+0000 7f3468863640 1 -- 172.21.15.63:0/4039577824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3464101fe0 msgr2=0x7f346419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:30.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.183+0000 7f3468863640 1 --2- 172.21.15.63:0/4039577824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3464101fe0 0x7f346419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:30.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.183+0000 7f3468863640 1 -- 172.21.15.63:0/4039577824 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34641a0400 con 0x7f3464109e10 2024-09-21T06:27:30.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.183+0000 7f3463fff640 1 --2- 172.21.15.63:0/4039577824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3464101fe0 0x7f346419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:30.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.183+0000 7f3468863640 1 --2- 172.21.15.63:0/4039577824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3464109e10 0x7f346419fcd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f345c005cc0 tx=0x7f345c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:30.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.183+0000 7f34617fa640 1 -- 172.21.15.63:0/4039577824 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c003bf0 con 0x7f3464109e10 2024-09-21T06:27:30.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.183+0000 7f34617fa640 1 -- 172.21.15.63:0/4039577824 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f345c003d90 con 0x7f3464109e10 2024-09-21T06:27:30.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.183+0000 7f346a2c6640 1 -- 172.21.15.63:0/4039577824 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34641a0690 con 0x7f3464109e10 2024-09-21T06:27:30.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.183+0000 7f34617fa640 1 -- 172.21.15.63:0/4039577824 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c02fbc0 con 0x7f3464109e10 2024-09-21T06:27:30.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.183+0000 7f346a2c6640 1 -- 172.21.15.63:0/4039577824 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34641a6e50 con 0x7f3464109e10 2024-09-21T06:27:30.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.184+0000 7f346a2c6640 1 -- 172.21.15.63:0/4039577824 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f346406b970 con 0x7f3464109e10 2024-09-21T06:27:30.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.186+0000 7f34617fa640 1 -- 172.21.15.63:0/4039577824 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f345c02fd60 con 0x7f3464109e10 2024-09-21T06:27:30.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.187+0000 7f34617fa640 1 --2- 172.21.15.63:0/4039577824 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f344c0b65f0 0x7f344c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:30.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.187+0000 7f3463fff640 1 --2- 172.21.15.63:0/4039577824 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f344c0b65f0 0x7f344c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:30.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.187+0000 7f34617fa640 1 -- 172.21.15.63:0/4039577824 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f345c108b90 con 0x7f3464109e10 2024-09-21T06:27:30.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.187+0000 7f3463fff640 1 --2- 172.21.15.63:0/4039577824 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f344c0b65f0 0x7f344c0b8b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f34540058c0 tx=0x7f3454005ec0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:30.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.190+0000 7f34617fa640 1 -- 172.21.15.63:0/4039577824 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f345c0cf1e0 con 0x7f3464109e10 2024-09-21T06:27:30.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.421+0000 7f346a2c6640 1 -- 172.21.15.63:0/4039577824 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f346410bc90 con 0x7f3464109e10 2024-09-21T06:27:30.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.422+0000 7f34617fa640 1 -- 172.21.15.63:0/4039577824 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11969 (secure 0 0 0) 0x7f345c0d35c0 con 0x7f3464109e10 2024-09-21T06:27:30.424 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:27:30.424 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":28,"btime":"2024-09-21T06:26:30:754530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:26:30.006003+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24698,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24698":{"gid":24698,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3472481253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3472481253},{"type":"v1","addr":"172.21.15.71:6839","nonce":3472481253}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24698,"qdb_cluster":[14835,24676,24670,24694,24698]},"id":1}]} 2024-09-21T06:27:30.424 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 28 2024-09-21T06:27:30.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.424+0000 7f346a2c6640 1 -- 172.21.15.63:0/4039577824 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f344c0b65f0 msgr2=0x7f344c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:30.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.424+0000 7f346a2c6640 1 --2- 172.21.15.63:0/4039577824 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f344c0b65f0 0x7f344c0b8b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f34540058c0 tx=0x7f3454005ec0 comp rx=0 tx=0).stop 2024-09-21T06:27:30.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.425+0000 7f346a2c6640 1 -- 172.21.15.63:0/4039577824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3464109e10 msgr2=0x7f346419fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:30.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.425+0000 7f346a2c6640 1 --2- 172.21.15.63:0/4039577824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3464109e10 0x7f346419fcd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f345c005cc0 tx=0x7f345c02f380 comp rx=0 tx=0).stop 2024-09-21T06:27:30.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.425+0000 7f346a2c6640 1 -- 172.21.15.63:0/4039577824 shutdown_connections 2024-09-21T06:27:30.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.425+0000 7f346a2c6640 1 --2- 172.21.15.63:0/4039577824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3464109e10 0x7f346419fcd0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:30.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.425+0000 7f346a2c6640 1 --2- 172.21.15.63:0/4039577824 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f344c0b65f0 0x7f344c0b8b00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:30.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.425+0000 7f346a2c6640 1 --2- 172.21.15.63:0/4039577824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34641094c0 0x7f346419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:30.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.425+0000 7f346a2c6640 1 --2- 172.21.15.63:0/4039577824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3464101fe0 0x7f346419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:30.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.425+0000 7f346a2c6640 1 -- 172.21.15.63:0/4039577824 >> 172.21.15.63:0/4039577824 conn(0x7f3464077bc0 msgr2=0x7f3464107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:30.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.425+0000 7f346a2c6640 1 -- 172.21.15.63:0/4039577824 shutdown_connections 2024-09-21T06:27:30.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:30.425+0000 7f346a2c6640 1 -- 172.21.15.63:0/4039577824 wait complete. 2024-09-21T06:27:31.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:30 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/4039577824' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:27:31.040 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:30 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/4039577824' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:27:31.070 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:27:31.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:30 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/4039577824' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:27:31.328 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:31.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.842+0000 7fe510ab8640 1 -- 172.21.15.63:0/2164843488 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe50c1084e0 msgr2=0x7fe50c1088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:31.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.842+0000 7fe510ab8640 1 --2- 172.21.15.63:0/2164843488 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe50c1084e0 0x7fe50c1088f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe500009900 tx=0x7fe50002a410 comp rx=0 tx=0).stop 2024-09-21T06:27:31.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.842+0000 7fe510ab8640 1 -- 172.21.15.63:0/2164843488 shutdown_connections 2024-09-21T06:27:31.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.842+0000 7fe510ab8640 1 --2- 172.21.15.63:0/2164843488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe50c108e30 0x7fe50c10f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:31.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.842+0000 7fe510ab8640 1 --2- 172.21.15.63:0/2164843488 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe50c1084e0 0x7fe50c1088f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:31.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.842+0000 7fe510ab8640 1 --2- 172.21.15.63:0/2164843488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe50c103190 0x7fe50c1035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:31.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.842+0000 7fe510ab8640 1 -- 172.21.15.63:0/2164843488 >> 172.21.15.63:0/2164843488 conn(0x7fe50c079ec0 msgr2=0x7fe50c07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:31.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.843+0000 7fe510ab8640 1 -- 172.21.15.63:0/2164843488 shutdown_connections 2024-09-21T06:27:31.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.843+0000 7fe510ab8640 1 -- 172.21.15.63:0/2164843488 wait complete. 2024-09-21T06:27:31.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.843+0000 7fe510ab8640 1 Processor -- start 2024-09-21T06:27:31.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.843+0000 7fe510ab8640 1 -- start start 2024-09-21T06:27:31.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.844+0000 7fe510ab8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe50c103190 0x7fe50c19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:31.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.844+0000 7fe510ab8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe50c1084e0 0x7fe50c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:31.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.844+0000 7fe510ab8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe50c108e30 0x7fe50c19fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:31.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.844+0000 7fe510ab8640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c112af0 con 0x7fe50c1084e0 2024-09-21T06:27:31.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.844+0000 7fe510ab8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c112970 con 0x7fe50c103190 2024-09-21T06:27:31.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.844+0000 7fe510ab8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c112c70 con 0x7fe50c108e30 2024-09-21T06:27:31.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.844+0000 7fe509d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe50c1084e0 0x7fe50c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:31.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.844+0000 7fe509d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe50c1084e0 0x7fe50c19ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46610/0 (socket says 172.21.15.63:46610) 2024-09-21T06:27:31.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.844+0000 7fe509d9b640 1 -- 172.21.15.63:0/3690295217 learned_addr learned my addr 172.21.15.63:0/3690295217 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:31.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.844+0000 7fe50a59c640 1 --2- 172.21.15.63:0/3690295217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe50c103190 0x7fe50c19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:31.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.844+0000 7fe50ad9d640 1 --2- 172.21.15.63:0/3690295217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe50c108e30 0x7fe50c19fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:31.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.844+0000 7fe509d9b640 1 -- 172.21.15.63:0/3690295217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe50c108e30 msgr2=0x7fe50c19fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:31.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.844+0000 7fe509d9b640 1 --2- 172.21.15.63:0/3690295217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe50c108e30 0x7fe50c19fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:31.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.844+0000 7fe509d9b640 1 -- 172.21.15.63:0/3690295217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe50c103190 msgr2=0x7fe50c19a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:31.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.844+0000 7fe509d9b640 1 --2- 172.21.15.63:0/3690295217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe50c103190 0x7fe50c19a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:31.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.844+0000 7fe509d9b640 1 -- 172.21.15.63:0/3690295217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50c1a0520 con 0x7fe50c1084e0 2024-09-21T06:27:31.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.844+0000 7fe50ad9d640 1 --2- 172.21.15.63:0/3690295217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe50c108e30 0x7fe50c19fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:31.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.844+0000 7fe509d9b640 1 --2- 172.21.15.63:0/3690295217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe50c1084e0 0x7fe50c19ab50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe50002a930 tx=0x7fe500004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:31.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.845+0000 7fe4fb7fe640 1 -- 172.21.15.63:0/3690295217 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50003f030 con 0x7fe50c1084e0 2024-09-21T06:27:31.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.845+0000 7fe510ab8640 1 -- 172.21.15.63:0/3690295217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe50c1a07b0 con 0x7fe50c1084e0 2024-09-21T06:27:31.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.845+0000 7fe4fb7fe640 1 -- 172.21.15.63:0/3690295217 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe500003aa0 con 0x7fe50c1084e0 2024-09-21T06:27:31.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.845+0000 7fe4fb7fe640 1 -- 172.21.15.63:0/3690295217 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe500035070 con 0x7fe50c1084e0 2024-09-21T06:27:31.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.845+0000 7fe510ab8640 1 -- 172.21.15.63:0/3690295217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe50c1a6f70 con 0x7fe50c1084e0 2024-09-21T06:27:31.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.846+0000 7fe510ab8640 1 -- 172.21.15.63:0/3690295217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe50c103f10 con 0x7fe50c1084e0 2024-09-21T06:27:31.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.848+0000 7fe4fb7fe640 1 -- 172.21.15.63:0/3690295217 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fe500042030 con 0x7fe50c1084e0 2024-09-21T06:27:31.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.849+0000 7fe4fb7fe640 1 --2- 172.21.15.63:0/3690295217 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe4f40b65f0 0x7fe4f40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:31.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.849+0000 7fe50a59c640 1 --2- 172.21.15.63:0/3690295217 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe4f40b65f0 0x7fe4f40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:31.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.849+0000 7fe4fb7fe640 1 -- 172.21.15.63:0/3690295217 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fe500108070 con 0x7fe50c1084e0 2024-09-21T06:27:31.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.849+0000 7fe50a59c640 1 --2- 172.21.15.63:0/3690295217 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe4f40b65f0 0x7fe4f40b8b00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00bbe0 tx=0x7fe4fc00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:31.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:31.852+0000 7fe4fb7fe640 1 -- 172.21.15.63:0/3690295217 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe5000ce6c0 con 0x7fe50c1084e0 2024-09-21T06:27:32.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:31 smithi071 ceph-mon[34844]: pgmap v301: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:27:32.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:31 smithi063 ceph-mon[31150]: pgmap v301: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:27:32.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:32.083+0000 7fe510ab8640 1 -- 172.21.15.63:0/3690295217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe50c1035a0 con 0x7fe50c1084e0 2024-09-21T06:27:32.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:32.084+0000 7fe4fb7fe640 1 -- 172.21.15.63:0/3690295217 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11969 (secure 0 0 0) 0x7fe50c1035a0 con 0x7fe50c1084e0 2024-09-21T06:27:32.086 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:27:32.086 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":28,"btime":"2024-09-21T06:26:30:754530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:26:30.006003+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24698,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24698":{"gid":24698,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3472481253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3472481253},{"type":"v1","addr":"172.21.15.71:6839","nonce":3472481253}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24698,"qdb_cluster":[14835,24676,24670,24694,24698]},"id":1}]} 2024-09-21T06:27:32.086 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 28 2024-09-21T06:27:32.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:32.086+0000 7fe510ab8640 1 -- 172.21.15.63:0/3690295217 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe4f40b65f0 msgr2=0x7fe4f40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:32.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:32.086+0000 7fe510ab8640 1 --2- 172.21.15.63:0/3690295217 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe4f40b65f0 0x7fe4f40b8b00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00bbe0 tx=0x7fe4fc00b390 comp rx=0 tx=0).stop 2024-09-21T06:27:32.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:32.086+0000 7fe510ab8640 1 -- 172.21.15.63:0/3690295217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe50c1084e0 msgr2=0x7fe50c19ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:32.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:32.086+0000 7fe510ab8640 1 --2- 172.21.15.63:0/3690295217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe50c1084e0 0x7fe50c19ab50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe50002a930 tx=0x7fe500004270 comp rx=0 tx=0).stop 2024-09-21T06:27:32.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:32.086+0000 7fe510ab8640 1 -- 172.21.15.63:0/3690295217 shutdown_connections 2024-09-21T06:27:32.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:32.086+0000 7fe510ab8640 1 --2- 172.21.15.63:0/3690295217 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe4f40b65f0 0x7fe4f40b8b00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:32.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:32.086+0000 7fe510ab8640 1 --2- 172.21.15.63:0/3690295217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe50c108e30 0x7fe50c19fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:32.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:32.086+0000 7fe510ab8640 1 --2- 172.21.15.63:0/3690295217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe50c1084e0 0x7fe50c19ab50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:32.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:32.086+0000 7fe510ab8640 1 --2- 172.21.15.63:0/3690295217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe50c103190 0x7fe50c19a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:32.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:32.086+0000 7fe510ab8640 1 -- 172.21.15.63:0/3690295217 >> 172.21.15.63:0/3690295217 conn(0x7fe50c079ec0 msgr2=0x7fe50c104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:32.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:32.086+0000 7fe510ab8640 1 -- 172.21.15.63:0/3690295217 shutdown_connections 2024-09-21T06:27:32.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:32.086+0000 7fe510ab8640 1 -- 172.21.15.63:0/3690295217 wait complete. 2024-09-21T06:27:32.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:31 smithi175 ceph-mon[34510]: pgmap v301: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:27:32.732 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:32 smithi063 ceph-mon[31150]: pgmap v302: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:32.732 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:32 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3690295217' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:27:32.761 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:27:33.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:32 smithi071 ceph-mon[34844]: pgmap v302: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:33.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:32 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3690295217' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:27:33.018 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:33.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:32 smithi175 ceph-mon[34510]: pgmap v302: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:33.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:32 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3690295217' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:27:33.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.549+0000 7f1e7b4e8640 1 -- 172.21.15.63:0/1043092082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e74104a30 msgr2=0x7f1e74104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:33.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.549+0000 7f1e7b4e8640 1 --2- 172.21.15.63:0/1043092082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e74104a30 0x7f1e74104e40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1e70009900 tx=0x7f1e7002a410 comp rx=0 tx=0).stop 2024-09-21T06:27:33.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.549+0000 7f1e7b4e8640 1 -- 172.21.15.63:0/1043092082 shutdown_connections 2024-09-21T06:27:33.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.549+0000 7f1e7b4e8640 1 --2- 172.21.15.63:0/1043092082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e7410de60 0x7f1e74110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:33.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.549+0000 7f1e7b4e8640 1 --2- 172.21.15.63:0/1043092082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e74105380 0x7f1e7410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:33.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.549+0000 7f1e7b4e8640 1 --2- 172.21.15.63:0/1043092082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e74104a30 0x7f1e74104e40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:33.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.549+0000 7f1e7b4e8640 1 -- 172.21.15.63:0/1043092082 >> 172.21.15.63:0/1043092082 conn(0x7f1e74079760 msgr2=0x7f1e74079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:33.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.549+0000 7f1e7b4e8640 1 -- 172.21.15.63:0/1043092082 shutdown_connections 2024-09-21T06:27:33.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.549+0000 7f1e7b4e8640 1 -- 172.21.15.63:0/1043092082 wait complete. 2024-09-21T06:27:33.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.549+0000 7f1e7b4e8640 1 Processor -- start 2024-09-21T06:27:33.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.549+0000 7f1e7b4e8640 1 -- start start 2024-09-21T06:27:33.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.550+0000 7f1e7b4e8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e74104a30 0x7f1e74102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:33.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.550+0000 7f1e7b4e8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e74105380 0x7f1e74102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:33.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.550+0000 7f1e7b4e8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e7410de60 0x7f1e741031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:33.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.550+0000 7f1e7b4e8640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1e74113ac0 con 0x7f1e7410de60 2024-09-21T06:27:33.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.550+0000 7f1e7b4e8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1e74113940 con 0x7f1e74104a30 2024-09-21T06:27:33.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.550+0000 7f1e7b4e8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1e74113c40 con 0x7f1e74105380 2024-09-21T06:27:33.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.550+0000 7f1e79a85640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e7410de60 0x7f1e741031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:33.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.550+0000 7f1e79a85640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e7410de60 0x7f1e741031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46630/0 (socket says 172.21.15.63:46630) 2024-09-21T06:27:33.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.550+0000 7f1e79a85640 1 -- 172.21.15.63:0/927459658 learned_addr learned my addr 172.21.15.63:0/927459658 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:33.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.550+0000 7f1e79284640 1 --2- 172.21.15.63:0/927459658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e74104a30 0x7f1e74102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:33.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.550+0000 7f1e78a83640 1 --2- 172.21.15.63:0/927459658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e74105380 0x7f1e74102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:33.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.550+0000 7f1e79a85640 1 -- 172.21.15.63:0/927459658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e74105380 msgr2=0x7f1e74102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:33.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.550+0000 7f1e79a85640 1 --2- 172.21.15.63:0/927459658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e74105380 0x7f1e74102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:33.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.550+0000 7f1e79a85640 1 -- 172.21.15.63:0/927459658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e74104a30 msgr2=0x7f1e74102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:33.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.550+0000 7f1e79a85640 1 --2- 172.21.15.63:0/927459658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e74104a30 0x7f1e74102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:33.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.550+0000 7f1e79a85640 1 -- 172.21.15.63:0/927459658 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e741a87d0 con 0x7f1e7410de60 2024-09-21T06:27:33.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.550+0000 7f1e78a83640 1 --2- 172.21.15.63:0/927459658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e74105380 0x7f1e74102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:33.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.550+0000 7f1e79a85640 1 --2- 172.21.15.63:0/927459658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e7410de60 0x7f1e741031f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00eaa0 tx=0x7f1e6c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:33.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.550+0000 7f1e6a7fc640 1 -- 172.21.15.63:0/927459658 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c00cdb0 con 0x7f1e7410de60 2024-09-21T06:27:33.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.551+0000 7f1e6a7fc640 1 -- 172.21.15.63:0/927459658 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e6c005020 con 0x7f1e7410de60 2024-09-21T06:27:33.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.551+0000 7f1e6a7fc640 1 -- 172.21.15.63:0/927459658 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c0116d0 con 0x7f1e7410de60 2024-09-21T06:27:33.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.551+0000 7f1e7b4e8640 1 -- 172.21.15.63:0/927459658 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e741a8ac0 con 0x7f1e7410de60 2024-09-21T06:27:33.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.551+0000 7f1e7b4e8640 1 -- 172.21.15.63:0/927459658 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e741a8fb0 con 0x7f1e7410de60 2024-09-21T06:27:33.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.552+0000 7f1e7b4e8640 1 -- 172.21.15.63:0/927459658 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e7406c1f0 con 0x7f1e7410de60 2024-09-21T06:27:33.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.553+0000 7f1e6a7fc640 1 -- 172.21.15.63:0/927459658 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f1e6c0051d0 con 0x7f1e7410de60 2024-09-21T06:27:33.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.554+0000 7f1e6a7fc640 1 --2- 172.21.15.63:0/927459658 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1e600b65f0 0x7f1e600b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:33.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.554+0000 7f1e79284640 1 --2- 172.21.15.63:0/927459658 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1e600b65f0 0x7f1e600b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:33.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.554+0000 7f1e6a7fc640 1 -- 172.21.15.63:0/927459658 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f1e6c0e7bf0 con 0x7f1e7410de60 2024-09-21T06:27:33.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.555+0000 7f1e79284640 1 --2- 172.21.15.63:0/927459658 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1e600b65f0 0x7f1e600b8b00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1e70009230 tx=0x7f1e70031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:33.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.557+0000 7f1e6a7fc640 1 -- 172.21.15.63:0/927459658 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1e6c016030 con 0x7f1e7410de60 2024-09-21T06:27:33.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.745+0000 7f1e7b4e8640 1 -- 172.21.15.63:0/927459658 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e74104e40 con 0x7f1e7410de60 2024-09-21T06:27:33.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.747+0000 7f1e6a7fc640 1 -- 172.21.15.63:0/927459658 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+23049 (secure 0 0 0) 0x7f1e74104e40 con 0x7f1e7410de60 2024-09-21T06:27:33.750 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:27:33.750 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":77,"fsid":"140899c8-77e1-11ef-baf5-efdc52797490","created":"2024-09-21T06:17:48.089366+0000","modified":"2024-09-21T06:26:38.957699+0000","last_up_change":"2024-09-21T06:25:29.072128+0000","last_in_change":"2024-09-21T06:25:06.097647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:21:36.236868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:26:15.016085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:26:17.072883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df4162c1-dd66-4d11-99bc-0ae36ea130f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6803","nonce":2090653772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6805","nonce":2090653772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6809","nonce":2090653772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6807","nonce":2090653772}]},"public_addr":"172.21.15.63:6803/2090653772","cluster_addr":"172.21.15.63:6805/2090653772","heartbeat_back_addr":"172.21.15.63:6809/2090653772","heartbeat_front_addr":"172.21.15.63:6807/2090653772","state":["exists","up"]},{"osd":1,"uuid":"65a12def-9f66-4153-8f1a-2ebfbbfeba99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6801","nonce":1676297548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6803","nonce":1676297548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6807","nonce":1676297548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6805","nonce":1676297548}]},"public_addr":"172.21.15.71:6801/1676297548","cluster_addr":"172.21.15.71:6803/1676297548","heartbeat_back_addr":"172.21.15.71:6807/1676297548","heartbeat_front_addr":"172.21.15.71:6805/1676297548","state":["exists","up"]},{"osd":2,"uuid":"031daa9e-9d4a-4901-95e8-695db5671fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6801","nonce":2356865390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6803","nonce":2356865390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6807","nonce":2356865390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6805","nonce":2356865390}]},"public_addr":"172.21.15.175:6801/2356865390","cluster_addr":"172.21.15.175:6803/2356865390","heartbeat_back_addr":"172.21.15.175:6807/2356865390","heartbeat_front_addr":"172.21.15.175:6805/2356865390","state":["exists","up"]},{"osd":3,"uuid":"75d23a7a-c560-4b26-84a4-74d6772a37ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6811","nonce":31683339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6813","nonce":31683339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6817","nonce":31683339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6815","nonce":31683339}]},"public_addr":"172.21.15.63:6811/31683339","cluster_addr":"172.21.15.63:6813/31683339","heartbeat_back_addr":"172.21.15.63:6817/31683339","heartbeat_front_addr":"172.21.15.63:6815/31683339","state":["exists","up"]},{"osd":4,"uuid":"6aaefd09-93dd-4f21-9b3c-701a7ff97f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6809","nonce":829449898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6811","nonce":829449898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6815","nonce":829449898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6813","nonce":829449898}]},"public_addr":"172.21.15.71:6809/829449898","cluster_addr":"172.21.15.71:6811/829449898","heartbeat_back_addr":"172.21.15.71:6815/829449898","heartbeat_front_addr":"172.21.15.71:6813/829449898","state":["exists","up"]},{"osd":5,"uuid":"91f28121-c94e-4012-b74c-dd4597545e3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6809","nonce":3005600597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6811","nonce":3005600597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6815","nonce":3005600597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6813","nonce":3005600597}]},"public_addr":"172.21.15.175:6809/3005600597","cluster_addr":"172.21.15.175:6811/3005600597","heartbeat_back_addr":"172.21.15.175:6815/3005600597","heartbeat_front_addr":"172.21.15.175:6813/3005600597","state":["exists","up"]},{"osd":6,"uuid":"bda28014-4dca-40f1-bb23-3ef61605c1ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6819","nonce":4044730408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6821","nonce":4044730408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6825","nonce":4044730408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6823","nonce":4044730408}]},"public_addr":"172.21.15.63:6819/4044730408","cluster_addr":"172.21.15.63:6821/4044730408","heartbeat_back_addr":"172.21.15.63:6825/4044730408","heartbeat_front_addr":"172.21.15.63:6823/4044730408","state":["exists","up"]},{"osd":7,"uuid":"a9026588-ccdc-4e6c-b628-1ac8a7dbfa64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6817","nonce":2913027708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6819","nonce":2913027708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6823","nonce":2913027708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6821","nonce":2913027708}]},"public_addr":"172.21.15.71:6817/2913027708","cluster_addr":"172.21.15.71:6819/2913027708","heartbeat_back_addr":"172.21.15.71:6823/2913027708","heartbeat_front_addr":"172.21.15.71:6821/2913027708","state":["exists","up"]},{"osd":8,"uuid":"2e1dacea-483c-4587-8d19-5c77a7b98667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6817","nonce":2058692148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6819","nonce":2058692148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6823","nonce":2058692148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6821","nonce":2058692148}]},"public_addr":"172.21.15.175:6817/2058692148","cluster_addr":"172.21.15.175:6819/2058692148","heartbeat_back_addr":"172.21.15.175:6823/2058692148","heartbeat_front_addr":"172.21.15.175:6821/2058692148","state":["exists","up"]},{"osd":9,"uuid":"7077ba4d-1fce-4197-a556-8b6a859c6f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6827","nonce":3278012285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6829","nonce":3278012285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6833","nonce":3278012285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6831","nonce":3278012285}]},"public_addr":"172.21.15.63:6827/3278012285","cluster_addr":"172.21.15.63:6829/3278012285","heartbeat_back_addr":"172.21.15.63:6833/3278012285","heartbeat_front_addr":"172.21.15.63:6831/3278012285","state":["exists","up"]},{"osd":10,"uuid":"99965496-91ee-4eef-9f2e-8f9c8dc54f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6825","nonce":3297929438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6827","nonce":3297929438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6831","nonce":3297929438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6829","nonce":3297929438}]},"public_addr":"172.21.15.71:6825/3297929438","cluster_addr":"172.21.15.71:6827/3297929438","heartbeat_back_addr":"172.21.15.71:6831/3297929438","heartbeat_front_addr":"172.21.15.71:6829/3297929438","state":["exists","up"]},{"osd":11,"uuid":"1b26d1a8-91a4-4877-ad1c-18160a1b3b6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6825","nonce":1970094291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6827","nonce":1970094291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6831","nonce":1970094291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6829","nonce":1970094291}]},"public_addr":"172.21.15.175:6825/1970094291","cluster_addr":"172.21.15.175:6827/1970094291","heartbeat_back_addr":"172.21.15.175:6831/1970094291","heartbeat_front_addr":"172.21.15.175:6829/1970094291","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:20:43.732676+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:08.957775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:34.157788+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:00.134410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:25.502998+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:51.739501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:18.325642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:44.430626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:10.776017+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:36.482831+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:01.898216+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:27.644941+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/1652196301":"2024-09-22T06:19:37.776447+0000","172.21.15.63:6801/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/2740830999":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6801/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6801/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/2958589237":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/1398493582":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/3529491525":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/363262068":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6800/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/3928056461":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/128321401":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/39222803":"2024-09-22T06:19:37.776447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:27:33.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.749+0000 7f1e7b4e8640 1 -- 172.21.15.63:0/927459658 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1e600b65f0 msgr2=0x7f1e600b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:33.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.749+0000 7f1e7b4e8640 1 --2- 172.21.15.63:0/927459658 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1e600b65f0 0x7f1e600b8b00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1e70009230 tx=0x7f1e70031400 comp rx=0 tx=0).stop 2024-09-21T06:27:33.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.749+0000 7f1e7b4e8640 1 -- 172.21.15.63:0/927459658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e7410de60 msgr2=0x7f1e741031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:33.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.749+0000 7f1e7b4e8640 1 --2- 172.21.15.63:0/927459658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e7410de60 0x7f1e741031f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00eaa0 tx=0x7f1e6c00ef60 comp rx=0 tx=0).stop 2024-09-21T06:27:33.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.749+0000 7f1e7b4e8640 1 -- 172.21.15.63:0/927459658 shutdown_connections 2024-09-21T06:27:33.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.749+0000 7f1e7b4e8640 1 --2- 172.21.15.63:0/927459658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e7410de60 0x7f1e741031f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:33.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.749+0000 7f1e7b4e8640 1 --2- 172.21.15.63:0/927459658 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1e600b65f0 0x7f1e600b8b00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:33.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.749+0000 7f1e7b4e8640 1 --2- 172.21.15.63:0/927459658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e74105380 0x7f1e74102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:33.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.749+0000 7f1e7b4e8640 1 --2- 172.21.15.63:0/927459658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e74104a30 0x7f1e74102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:33.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.749+0000 7f1e7b4e8640 1 -- 172.21.15.63:0/927459658 >> 172.21.15.63:0/927459658 conn(0x7f1e74079760 msgr2=0x7f1e741008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:33.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.749+0000 7f1e7b4e8640 1 -- 172.21.15.63:0/927459658 shutdown_connections 2024-09-21T06:27:33.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:33.749+0000 7f1e7b4e8640 1 -- 172.21.15.63:0/927459658 wait complete. 2024-09-21T06:27:34.055 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:33 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/927459658' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:27:34.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:33 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/927459658' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:27:34.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:33 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/927459658' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:27:34.370 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:27:34.626 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:35.052 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:34 smithi063 ceph-mon[31150]: pgmap v303: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:35.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:34 smithi175 ceph-mon[34510]: pgmap v303: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:35.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.144+0000 7f7430836640 1 -- 172.21.15.63:0/231497219 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f742c108d10 msgr2=0x7f742c10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:35.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.144+0000 7f7430836640 1 --2- 172.21.15.63:0/231497219 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f742c108d10 0x7f742c10f540 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7424009ca0 tx=0x7f742402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:35.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.144+0000 7f7430836640 1 -- 172.21.15.63:0/231497219 shutdown_connections 2024-09-21T06:27:35.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.144+0000 7f7430836640 1 --2- 172.21.15.63:0/231497219 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f742c108d10 0x7f742c10f540 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:35.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.144+0000 7f7430836640 1 --2- 172.21.15.63:0/231497219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f742c1083c0 0x7f742c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:35.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.144+0000 7f7430836640 1 --2- 172.21.15.63:0/231497219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f742c102a80 0x7f742c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:35.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.144+0000 7f7430836640 1 -- 172.21.15.63:0/231497219 >> 172.21.15.63:0/231497219 conn(0x7f742c079740 msgr2=0x7f742c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:35.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.144+0000 7f7430836640 1 -- 172.21.15.63:0/231497219 shutdown_connections 2024-09-21T06:27:35.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.144+0000 7f7430836640 1 -- 172.21.15.63:0/231497219 wait complete. 2024-09-21T06:27:35.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.145+0000 7f7430836640 1 Processor -- start 2024-09-21T06:27:35.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.145+0000 7f7430836640 1 -- start start 2024-09-21T06:27:35.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.145+0000 7f7430836640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f742c102a80 0x7f742c19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:35.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.145+0000 7f7430836640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f742c1083c0 0x7f742c19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:35.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.145+0000 7f7430836640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f742c108d10 0x7f742c19fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:35.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.145+0000 7f7430836640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f742c112980 con 0x7f742c1083c0 2024-09-21T06:27:35.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.145+0000 7f7430836640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f742c112800 con 0x7f742c108d10 2024-09-21T06:27:35.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.145+0000 7f7430836640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f742c112b00 con 0x7f742c102a80 2024-09-21T06:27:35.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.145+0000 7f7429d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f742c1083c0 0x7f742c19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:35.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.145+0000 7f7429d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f742c1083c0 0x7f742c19a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46648/0 (socket says 172.21.15.63:46648) 2024-09-21T06:27:35.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.145+0000 7f7429d9b640 1 -- 172.21.15.63:0/4282391310 learned_addr learned my addr 172.21.15.63:0/4282391310 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:35.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.146+0000 7f742a59c640 1 --2- 172.21.15.63:0/4282391310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f742c102a80 0x7f742c19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:35.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.146+0000 7f742ad9d640 1 --2- 172.21.15.63:0/4282391310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f742c108d10 0x7f742c19fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:35.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.146+0000 7f7429d9b640 1 -- 172.21.15.63:0/4282391310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f742c102a80 msgr2=0x7f742c19a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:35.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.146+0000 7f7429d9b640 1 --2- 172.21.15.63:0/4282391310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f742c102a80 0x7f742c19a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:35.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.146+0000 7f7429d9b640 1 -- 172.21.15.63:0/4282391310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f742c108d10 msgr2=0x7f742c19fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:35.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.146+0000 7f7429d9b640 1 --2- 172.21.15.63:0/4282391310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f742c108d10 0x7f742c19fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:35.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.146+0000 7f7429d9b640 1 -- 172.21.15.63:0/4282391310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742c1a0390 con 0x7f742c1083c0 2024-09-21T06:27:35.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.146+0000 7f7429d9b640 1 --2- 172.21.15.63:0/4282391310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f742c1083c0 0x7f742c19a9c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f742000d740 tx=0x7f742000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:35.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.146+0000 7f741b7fe640 1 -- 172.21.15.63:0/4282391310 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7420017070 con 0x7f742c1083c0 2024-09-21T06:27:35.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.146+0000 7f741b7fe640 1 -- 172.21.15.63:0/4282391310 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f742000de50 con 0x7f742c1083c0 2024-09-21T06:27:35.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.146+0000 7f741b7fe640 1 -- 172.21.15.63:0/4282391310 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7420004ce0 con 0x7f742c1083c0 2024-09-21T06:27:35.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.146+0000 7f7430836640 1 -- 172.21.15.63:0/4282391310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742c1a0680 con 0x7f742c1083c0 2024-09-21T06:27:35.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.146+0000 7f7430836640 1 -- 172.21.15.63:0/4282391310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f742c1a6de0 con 0x7f742c1083c0 2024-09-21T06:27:35.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.147+0000 7f7430836640 1 -- 172.21.15.63:0/4282391310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f742c103d00 con 0x7f742c1083c0 2024-09-21T06:27:35.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.149+0000 7f741b7fe640 1 -- 172.21.15.63:0/4282391310 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f7420004e80 con 0x7f742c1083c0 2024-09-21T06:27:35.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.149+0000 7f741b7fe640 1 --2- 172.21.15.63:0/4282391310 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f74140b6670 0x7f74140b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:35.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.150+0000 7f742a59c640 1 --2- 172.21.15.63:0/4282391310 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f74140b6670 0x7f74140b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:35.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.150+0000 7f741b7fe640 1 -- 172.21.15.63:0/4282391310 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f74200e7230 con 0x7f742c1083c0 2024-09-21T06:27:35.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.150+0000 7f742a59c640 1 --2- 172.21.15.63:0/4282391310 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f74140b6670 0x7f74140b8b80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f741c00bbe0 tx=0x7f741c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:35.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.153+0000 7f741b7fe640 1 -- 172.21.15.63:0/4282391310 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f74200b1ce0 con 0x7f742c1083c0 2024-09-21T06:27:35.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:34 smithi071 ceph-mon[34844]: pgmap v303: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:35.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.381+0000 7f7430836640 1 -- 172.21.15.63:0/4282391310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f742c102e90 con 0x7f742c1083c0 2024-09-21T06:27:35.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.382+0000 7f741b7fe640 1 -- 172.21.15.63:0/4282391310 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11969 (secure 0 0 0) 0x7f742c102e90 con 0x7f742c1083c0 2024-09-21T06:27:35.386 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:27:35.387 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":28,"btime":"2024-09-21T06:26:30:754530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:26:30.006003+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24698,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24698":{"gid":24698,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3472481253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3472481253},{"type":"v1","addr":"172.21.15.71:6839","nonce":3472481253}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24698,"qdb_cluster":[14835,24676,24670,24694,24698]},"id":1}]} 2024-09-21T06:27:35.387 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 28 2024-09-21T06:27:35.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.384+0000 7f7430836640 1 -- 172.21.15.63:0/4282391310 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f74140b6670 msgr2=0x7f74140b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:35.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.384+0000 7f7430836640 1 --2- 172.21.15.63:0/4282391310 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f74140b6670 0x7f74140b8b80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f741c00bbe0 tx=0x7f741c00b390 comp rx=0 tx=0).stop 2024-09-21T06:27:35.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.384+0000 7f7430836640 1 -- 172.21.15.63:0/4282391310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f742c1083c0 msgr2=0x7f742c19a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:35.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.384+0000 7f7430836640 1 --2- 172.21.15.63:0/4282391310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f742c1083c0 0x7f742c19a9c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f742000d740 tx=0x7f742000dc00 comp rx=0 tx=0).stop 2024-09-21T06:27:35.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.384+0000 7f7430836640 1 -- 172.21.15.63:0/4282391310 shutdown_connections 2024-09-21T06:27:35.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.384+0000 7f7430836640 1 --2- 172.21.15.63:0/4282391310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f742c108d10 0x7f742c19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:35.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.384+0000 7f7430836640 1 --2- 172.21.15.63:0/4282391310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f742c1083c0 0x7f742c19a9c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:35.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.384+0000 7f7430836640 1 --2- 172.21.15.63:0/4282391310 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f74140b6670 0x7f74140b8b80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:35.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.384+0000 7f7430836640 1 --2- 172.21.15.63:0/4282391310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f742c102a80 0x7f742c19a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:35.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.384+0000 7f7430836640 1 -- 172.21.15.63:0/4282391310 >> 172.21.15.63:0/4282391310 conn(0x7f742c079740 msgr2=0x7f742c06bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:35.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.384+0000 7f7430836640 1 -- 172.21.15.63:0/4282391310 shutdown_connections 2024-09-21T06:27:35.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:35.384+0000 7f7430836640 1 -- 172.21.15.63:0/4282391310 wait complete. 2024-09-21T06:27:36.041 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:35 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/4282391310' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:27:36.069 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T06:26:18.960208+0000', 'modified': '2024-09-21T06:26:30.006003+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24698, 'mds_1': 24694, 'mds_2': 24676, 'mds_3': 24670, 'mds_4': 14835}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14823': {'gid': 14823, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.63:6839/2446248912', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6838', 'nonce': 2446248912}, {'type': 'v1', 'addr': '172.21.15.63:6839', 'nonce': 2446248912}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14835': {'gid': 14835, 'name': 'a', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.63:6841/1426680017', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6840', 'nonce': 1426680017}, {'type': 'v1', 'addr': '172.21.15.63:6841', 'nonce': 1426680017}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24608': {'gid': 24608, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6833/3879125360', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6832', 'nonce': 3879125360}, {'type': 'v1', 'addr': '172.21.15.71:6833', 'nonce': 3879125360}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24622': {'gid': 24622, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6833/825731342', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6832', 'nonce': 825731342}, {'type': 'v1', 'addr': '172.21.15.175:6833', 'nonce': 825731342}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24635': {'gid': 24635, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6835/946121091', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6834', 'nonce': 946121091}, {'type': 'v1', 'addr': '172.21.15.71:6835', 'nonce': 946121091}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24659': {'gid': 24659, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6837/1168849842', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6836', 'nonce': 1168849842}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 1168849842}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24670': {'gid': 24670, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.175:6835/3140987446', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 3140987446}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 3140987446}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24676': {'gid': 24676, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.175:6837/2825611591', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 2825611591}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 2825611591}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24694': {'gid': 24694, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.175:6839/3302221763', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 3302221763}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 3302221763}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24698': {'gid': 24698, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.71:6839/3472481253', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6838', 'nonce': 3472481253}, {'type': 'v1', 'addr': '172.21.15.71:6839', 'nonce': 3472481253}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24698, 'qdb_cluster': [14835, 24676, 24670, 24694, 24698]} 2024-09-21T06:27:36.070 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T06:27:36.070 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.a status 2024-09-21T06:27:36.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:35 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/4282391310' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:27:36.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:35 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/4282391310' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:27:36.328 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:36.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.836+0000 7f842722f640 1 -- 172.21.15.63:0/1464340488 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8420109e50 msgr2=0x7f8420110680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:36.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.836+0000 7f842722f640 1 --2- 172.21.15.63:0/1464340488 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8420109e50 0x7f8420110680 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8418009ca0 tx=0x7f841802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.836+0000 7f842722f640 1 -- 172.21.15.63:0/1464340488 shutdown_connections 2024-09-21T06:27:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.836+0000 7f842722f640 1 --2- 172.21.15.63:0/1464340488 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8420109e50 0x7f8420110680 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.836+0000 7f842722f640 1 --2- 172.21.15.63:0/1464340488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8420109500 0x7f8420109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.836+0000 7f842722f640 1 --2- 172.21.15.63:0/1464340488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8420101fc0 0x7f84201023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.836+0000 7f842722f640 1 -- 172.21.15.63:0/1464340488 >> 172.21.15.63:0/1464340488 conn(0x7f8420079f90 msgr2=0x7f842007a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.836+0000 7f842722f640 1 -- 172.21.15.63:0/1464340488 shutdown_connections 2024-09-21T06:27:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.836+0000 7f842722f640 1 -- 172.21.15.63:0/1464340488 wait complete. 2024-09-21T06:27:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.837+0000 7f842722f640 1 Processor -- start 2024-09-21T06:27:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.837+0000 7f842722f640 1 -- start start 2024-09-21T06:27:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.837+0000 7f842722f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8420101fc0 0x7f842019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.837+0000 7f842722f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8420109500 0x7f842019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.837+0000 7f842722f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8420109e50 0x7f842019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.837+0000 7f842722f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8420113b10 con 0x7f8420101fc0 2024-09-21T06:27:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.837+0000 7f842722f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8420113990 con 0x7f8420109500 2024-09-21T06:27:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.837+0000 7f842722f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8420113c90 con 0x7f8420109e50 2024-09-21T06:27:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.837+0000 7f8424fcb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8420101fc0 0x7f842019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.837+0000 7f8424fcb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8420101fc0 0x7f842019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36728/0 (socket says 172.21.15.63:36728) 2024-09-21T06:27:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.837+0000 7f8424fcb640 1 -- 172.21.15.63:0/3709265928 learned_addr learned my addr 172.21.15.63:0/3709265928 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.837+0000 7f841ffff640 1 --2- 172.21.15.63:0/3709265928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8420109500 0x7f842019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.837+0000 7f84257cc640 1 --2- 172.21.15.63:0/3709265928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8420109e50 0x7f842019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.837+0000 7f8424fcb640 1 -- 172.21.15.63:0/3709265928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8420109e50 msgr2=0x7f842019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.837+0000 7f8424fcb640 1 --2- 172.21.15.63:0/3709265928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8420109e50 0x7f842019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.837+0000 7f8424fcb640 1 -- 172.21.15.63:0/3709265928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8420109500 msgr2=0x7f842019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.837+0000 7f8424fcb640 1 --2- 172.21.15.63:0/3709265928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8420109500 0x7f842019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.837+0000 7f8424fcb640 1 -- 172.21.15.63:0/3709265928 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84201a0450 con 0x7f8420101fc0 2024-09-21T06:27:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.837+0000 7f84257cc640 1 --2- 172.21.15.63:0/3709265928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8420109e50 0x7f842019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.838+0000 7f8424fcb640 1 --2- 172.21.15.63:0/3709265928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8420101fc0 0x7f842019a4e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f841400d950 tx=0x7f841400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.838+0000 7f841dffb640 1 -- 172.21.15.63:0/3709265928 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414017030 con 0x7f8420101fc0 2024-09-21T06:27:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.838+0000 7f842722f640 1 -- 172.21.15.63:0/3709265928 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84201a0740 con 0x7f8420101fc0 2024-09-21T06:27:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.838+0000 7f841dffb640 1 -- 172.21.15.63:0/3709265928 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8414004020 con 0x7f8420101fc0 2024-09-21T06:27:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.838+0000 7f841dffb640 1 -- 172.21.15.63:0/3709265928 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84140047a0 con 0x7f8420101fc0 2024-09-21T06:27:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.838+0000 7f842722f640 1 -- 172.21.15.63:0/3709265928 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84201a6ea0 con 0x7f8420101fc0 2024-09-21T06:27:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.840+0000 7f841dffb640 1 -- 172.21.15.63:0/3709265928 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f8414009a30 con 0x7f8420101fc0 2024-09-21T06:27:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.841+0000 7f842d7a3740 1 Processor -- start 2024-09-21T06:27:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.841+0000 7f842d7a3740 1 -- start start 2024-09-21T06:27:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.841+0000 7f842d7a3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19957cf60 0x55a199922f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.841+0000 7f842d7a3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a1995540a0 0x55a199923440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.841+0000 7f842d7a3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a19955c280 0x55a199923980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.841+0000 7f842d7a3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a19989ac10 con 0x55a19957cf60 2024-09-21T06:27:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.841+0000 7f842d7a3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a19988a040 con 0x55a1995540a0 2024-09-21T06:27:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.841+0000 7f842d7a3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a19988de50 con 0x55a19955c280 2024-09-21T06:27:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.841+0000 7f84257cc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19957cf60 0x55a199922f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.841+0000 7f84257cc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19957cf60 0x55a199922f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36738/0 (socket says 172.21.15.63:36738) 2024-09-21T06:27:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.841+0000 7f84257cc640 1 -- 172.21.15.63:0/3541484455 learned_addr learned my addr 172.21.15.63:0/3541484455 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.841+0000 7f841ffff640 1 --2- 172.21.15.63:0/3541484455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a19955c280 0x55a199923980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.841+0000 7f8424fcb640 1 --2- 172.21.15.63:0/3541484455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a1995540a0 0x55a199923440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.841+0000 7f84257cc640 1 -- 172.21.15.63:0/3541484455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a19955c280 msgr2=0x55a199923980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.841+0000 7f84257cc640 1 --2- 172.21.15.63:0/3541484455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a19955c280 0x55a199923980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.841+0000 7f84257cc640 1 -- 172.21.15.63:0/3541484455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a1995540a0 msgr2=0x55a199923440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.841+0000 7f84257cc640 1 --2- 172.21.15.63:0/3541484455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a1995540a0 0x55a199923440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.841+0000 7f84257cc640 1 -- 172.21.15.63:0/3541484455 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1995e8540 con 0x55a19957cf60 2024-09-21T06:27:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.841+0000 7f8424fcb640 1 --2- 172.21.15.63:0/3541484455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a1995540a0 0x55a199923440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.842+0000 7f841dffb640 1 --2- 172.21.15.63:0/3709265928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f84100b65f0 0x7f84100b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.842+0000 7f84257cc640 1 --2- 172.21.15.63:0/3541484455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19957cf60 0x55a199922f00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8418006010 tx=0x7f8418009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9450265762cc3f78 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.842+0000 7f8424fcb640 1 --2- 172.21.15.63:0/3709265928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f84100b65f0 0x7f84100b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.842+0000 7f840affd640 1 -- 172.21.15.63:0/3541484455 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418031cf0 con 0x55a19957cf60 2024-09-21T06:27:36.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.842+0000 7f840affd640 1 -- 172.21.15.63:0/3541484455 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8418036070 con 0x55a19957cf60 2024-09-21T06:27:36.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.842+0000 7f841dffb640 1 -- 172.21.15.63:0/3709265928 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f84140e7040 con 0x7f8420101fc0 2024-09-21T06:27:36.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.842+0000 7f840affd640 1 -- 172.21.15.63:0/3541484455 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418004280 con 0x55a19957cf60 2024-09-21T06:27:36.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.843+0000 7f842d7a3740 1 -- 172.21.15.63:0/3541484455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19957cf60 msgr2=0x55a199922f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:36.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.843+0000 7f8424fcb640 1 --2- 172.21.15.63:0/3709265928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f84100b65f0 0x7f84100b8b00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55a199921b80 tx=0x7f8414094040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:36.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.843+0000 7f842d7a3740 1 --2- 172.21.15.63:0/3541484455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19957cf60 0x55a199922f00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8418006010 tx=0x7f8418009800 comp rx=0 tx=0).stop 2024-09-21T06:27:36.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.843+0000 7f842d7a3740 1 -- 172.21.15.63:0/3541484455 shutdown_connections 2024-09-21T06:27:36.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.843+0000 7f842d7a3740 1 --2- 172.21.15.63:0/3541484455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a19955c280 0x55a199923980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.843+0000 7f842d7a3740 1 --2- 172.21.15.63:0/3541484455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a1995540a0 0x55a199923440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.843+0000 7f842d7a3740 1 --2- 172.21.15.63:0/3541484455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19957cf60 0x55a199922f00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.843+0000 7f842d7a3740 1 -- 172.21.15.63:0/3541484455 >> 172.21.15.63:0/3541484455 conn(0x55a199571350 msgr2=0x55a199920df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:36.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.843+0000 7f842d7a3740 1 -- 172.21.15.63:0/3541484455 shutdown_connections 2024-09-21T06:27:36.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.843+0000 7f842d7a3740 1 -- 172.21.15.63:0/3541484455 wait complete. 2024-09-21T06:27:36.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.843+0000 7f842d7a3740 1 -- start start 2024-09-21T06:27:36.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.844+0000 7f842d7a3740 1 Processor -- start 2024-09-21T06:27:36.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.844+0000 7f842d7a3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1995540a0 0x55a19992e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.844+0000 7f842d7a3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19955c280 0x55a19992ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.844+0000 7f842d7a3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a19957cf60 0x55a19993aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.844+0000 7f842d7a3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a1996eb5f0 con 0x55a19955c280 2024-09-21T06:27:36.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.844+0000 7f842d7a3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a199825010 con 0x55a19957cf60 2024-09-21T06:27:36.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.844+0000 7f842d7a3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a1999316d0 con 0x55a1995540a0 2024-09-21T06:27:36.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.844+0000 7f842d7a3740 10 client.0 _ll_register_callbacks cb 0x55a199884340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:36.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.844+0000 7f841ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19955c280 0x55a19992ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.844+0000 7f841ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19955c280 0x55a19992ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36754/0 (socket says 172.21.15.63:36754) 2024-09-21T06:27:36.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.844+0000 7f841ffff640 1 -- 172.21.15.63:0/3367366272 learned_addr learned my addr 172.21.15.63:0/3367366272 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:36.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.844+0000 7f84257cc640 1 --2- 172.21.15.63:0/3367366272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a19957cf60 0x55a19993aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.844+0000 7f84257cc640 1 --2- 172.21.15.63:0/3367366272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1995540a0 0x55a19992e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.845+0000 7f841ffff640 1 -- 172.21.15.63:0/3367366272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1995540a0 msgr2=0x55a19992e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:36.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.845+0000 7f841ffff640 1 --2- 172.21.15.63:0/3367366272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1995540a0 0x55a19992e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.845+0000 7f841ffff640 1 -- 172.21.15.63:0/3367366272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a19957cf60 msgr2=0x55a19993aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.845+0000 7f841ffff640 1 --2- 172.21.15.63:0/3367366272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a19957cf60 0x55a19993aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.845+0000 7f841ffff640 1 -- 172.21.15.63:0/3367366272 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a199852a00 con 0x55a19955c280 2024-09-21T06:27:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.845+0000 7f84257cc640 1 --2- 172.21.15.63:0/3367366272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1995540a0 0x55a19992e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.845+0000 7f841ffff640 1 --2- 172.21.15.63:0/3367366272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19955c280 0x55a19992ec70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f840c012700 tx=0x7f840c012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c156388a01de4cb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.845+0000 7f83fffff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:27:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.845+0000 7f83fffff640 1 -- 172.21.15.63:0/3367366272 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c00f920 con 0x55a19955c280 2024-09-21T06:27:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.845+0000 7f83fffff640 1 -- 172.21.15.63:0/3367366272 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f840c00fac0 con 0x55a19955c280 2024-09-21T06:27:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.845+0000 7f842d7a3740 1 -- 172.21.15.63:0/3367366272 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8418036070 con 0x55a19955c280 2024-09-21T06:27:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.845+0000 7f83fffff640 1 -- 172.21.15.63:0/3367366272 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f840c00fcc0 con 0x55a19955c280 2024-09-21T06:27:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.845+0000 7f842d7a3740 10 client.15195 fetch_fsmap learned FSMap version 28 2024-09-21T06:27:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.845+0000 7f842d7a3740 1 -- 172.21.15.63:0/3367366272 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a19993d5c0 con 0x55a19955c280 2024-09-21T06:27:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.845+0000 7f83fffff640 1 -- 172.21.15.63:0/3367366272 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8418036070 con 0x55a19955c280 2024-09-21T06:27:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.846+0000 7f83fffff640 1 -- 172.21.15.63:0/3367366272 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f840c010550 con 0x55a19955c280 2024-09-21T06:27:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.846+0000 7f842d7a3740 10 client.15195 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:27:36.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.846+0000 7f842d7a3740 10 client.15195 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T06:27:36.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.846+0000 7f842d7a3740 20 client.15195 populate_metadata read hostname 'smithi063' 2024-09-21T06:27:36.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.846+0000 7f842d7a3740 1 --2- 172.21.15.63:0/3367366272 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55a19953b8e0 0x55a1999410c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.846+0000 7f842d7a3740 4 client.15195 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:27:36.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.846+0000 7f842d7a3740 1 -- 172.21.15.63:0/3367366272 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a19989cb60 con 0x55a19953b8e0 2024-09-21T06:27:36.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.846+0000 7f84257cc640 1 --2- 172.21.15.63:0/3367366272 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55a19953b8e0 0x55a1999410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.846+0000 7f83fffff640 10 client.15195 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:27:36.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.846+0000 7f84257cc640 1 --2- 172.21.15.63:0/3367366272 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55a19953b8e0 0x55a1999410c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d9e2eeb71bc45788 server_cookie=eee50ca743b2e474 in_seq=0 out_seq=0 2024-09-21T06:27:36.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.847+0000 7f83fffff640 1 -- 172.21.15.63:0/3367366272 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a19989cb60 con 0x55a19953b8e0 2024-09-21T06:27:36.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.847+0000 7f83fffff640 10 client.15195 handle_command_reply: tid=0 2024-09-21T06:27:36.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.847+0000 7f842d7a3740 1 client.15195 shutdown 2024-09-21T06:27:36.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.847+0000 7f842d7a3740 1 -- 172.21.15.63:0/3367366272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19955c280 msgr2=0x55a19992ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:36.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.847+0000 7f842d7a3740 1 --2- 172.21.15.63:0/3367366272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19955c280 0x55a19992ec70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f840c012700 tx=0x7f840c012bc0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.847+0000 7f842d7a3740 1 -- 172.21.15.63:0/3367366272 shutdown_connections 2024-09-21T06:27:36.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.847+0000 7f842d7a3740 1 --2- 172.21.15.63:0/3367366272 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55a19953b8e0 0x55a1999410c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.847+0000 7f842d7a3740 1 --2- 172.21.15.63:0/3367366272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a19957cf60 0x55a19993aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.847+0000 7f842d7a3740 1 --2- 172.21.15.63:0/3367366272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19955c280 0x55a19992ec70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.847+0000 7f83fffff640 0 client.15195 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:27:36.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.847+0000 7f842d7a3740 1 --2- 172.21.15.63:0/3367366272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1995540a0 0x55a19992e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.847+0000 7f842d7a3740 1 -- 172.21.15.63:0/3367366272 >> 172.21.15.63:0/3367366272 conn(0x55a199571350 msgr2=0x55a199923f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:36.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.848+0000 7f842d7a3740 1 -- 172.21.15.63:0/3367366272 shutdown_connections 2024-09-21T06:27:36.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.848+0000 7f842d7a3740 1 -- 172.21.15.63:0/3367366272 wait complete. 2024-09-21T06:27:36.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.848+0000 7f842d7a3740 20 client.15195 trim_cache size 0 max 16384 2024-09-21T06:27:36.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.866+0000 7f842d7a3740 1 Processor -- start 2024-09-21T06:27:36.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.866+0000 7f842d7a3740 1 -- start start 2024-09-21T06:27:36.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.866+0000 7f842d7a3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a1995540a0 0x55a19993a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.866+0000 7f842d7a3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a19955c280 0x55a19992cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.866+0000 7f842d7a3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a19957cf60 0x55a19992d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.866+0000 7f842d7a3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a19993f400 con 0x55a1995540a0 2024-09-21T06:27:36.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.866+0000 7f842d7a3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a19993fad0 con 0x55a19955c280 2024-09-21T06:27:36.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.866+0000 7f842d7a3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a1999401a0 con 0x55a19957cf60 2024-09-21T06:27:36.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.866+0000 7f84257cc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a1995540a0 0x55a19993a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.866+0000 7f84257cc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a1995540a0 0x55a19993a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36760/0 (socket says 172.21.15.63:36760) 2024-09-21T06:27:36.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.866+0000 7f84257cc640 1 -- 172.21.15.63:0/2941227892 learned_addr learned my addr 172.21.15.63:0/2941227892 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:36.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.866+0000 7f841ffff640 1 --2- 172.21.15.63:0/2941227892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a19955c280 0x55a19992cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.867+0000 7f84257cc640 1 --2- 172.21.15.63:0/2941227892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a19957cf60 0x55a19992d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.867+0000 7f84257cc640 1 -- 172.21.15.63:0/2941227892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a19957cf60 msgr2=0x55a19992d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:36.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.867+0000 7f84257cc640 1 --2- 172.21.15.63:0/2941227892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a19957cf60 0x55a19992d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.867+0000 7f84257cc640 1 -- 172.21.15.63:0/2941227892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a19955c280 msgr2=0x55a19992cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:36.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.867+0000 7f84257cc640 1 --2- 172.21.15.63:0/2941227892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a19955c280 0x55a19992cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.867+0000 7f84257cc640 1 -- 172.21.15.63:0/2941227892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1999251f0 con 0x55a1995540a0 2024-09-21T06:27:36.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.867+0000 7f84257cc640 1 --2- 172.21.15.63:0/2941227892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a1995540a0 0x55a19993a990 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8418009ca0 tx=0x7f8418005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1658ed6bf8a549 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:36.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.867+0000 7f840a7fc640 1 -- 172.21.15.63:0/2941227892 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418049040 con 0x55a1995540a0 2024-09-21T06:27:36.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.867+0000 7f840a7fc640 1 -- 172.21.15.63:0/2941227892 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8418036040 con 0x55a1995540a0 2024-09-21T06:27:36.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.867+0000 7f840a7fc640 1 -- 172.21.15.63:0/2941227892 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84180047a0 con 0x55a1995540a0 2024-09-21T06:27:36.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.868+0000 7f842d7a3740 1 -- 172.21.15.63:0/2941227892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a1995540a0 msgr2=0x55a19993a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:36.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.868+0000 7f842d7a3740 1 --2- 172.21.15.63:0/2941227892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a1995540a0 0x55a19993a990 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8418009ca0 tx=0x7f8418005d80 comp rx=0 tx=0).stop 2024-09-21T06:27:36.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.868+0000 7f842d7a3740 1 -- 172.21.15.63:0/2941227892 shutdown_connections 2024-09-21T06:27:36.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.868+0000 7f842d7a3740 1 --2- 172.21.15.63:0/2941227892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a19957cf60 0x55a19992d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.868+0000 7f842d7a3740 1 --2- 172.21.15.63:0/2941227892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a19955c280 0x55a19992cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.868+0000 7f842d7a3740 1 --2- 172.21.15.63:0/2941227892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a1995540a0 0x55a19993a990 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.868+0000 7f842d7a3740 1 -- 172.21.15.63:0/2941227892 >> 172.21.15.63:0/2941227892 conn(0x55a199571350 msgr2=0x55a19993ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:36.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.868+0000 7f842d7a3740 1 -- 172.21.15.63:0/2941227892 shutdown_connections 2024-09-21T06:27:36.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.868+0000 7f842d7a3740 1 -- 172.21.15.63:0/2941227892 wait complete. 2024-09-21T06:27:36.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.869+0000 7f842d7a3740 1 -- start start 2024-09-21T06:27:36.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.869+0000 7f842d7a3740 1 Processor -- start 2024-09-21T06:27:36.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.869+0000 7f842d7a3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a1995540a0 0x55a1999497d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.869+0000 7f842d7a3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19955c280 0x55a199949db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.869+0000 7f842d7a3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a19957cf60 0x55a199942ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.869+0000 7f842d7a3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a199940f40 con 0x55a19955c280 2024-09-21T06:27:36.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.869+0000 7f842d7a3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a199940870 con 0x55a1995540a0 2024-09-21T06:27:36.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.869+0000 7f842d7a3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a199941610 con 0x55a19957cf60 2024-09-21T06:27:36.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.869+0000 7f842d7a3740 10 client.0 _ll_register_callbacks cb 0x7f840c009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:36.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.869+0000 7f841ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19955c280 0x55a199949db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.869+0000 7f841ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19955c280 0x55a199949db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36776/0 (socket says 172.21.15.63:36776) 2024-09-21T06:27:36.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.869+0000 7f841ffff640 1 -- 172.21.15.63:0/3590635284 learned_addr learned my addr 172.21.15.63:0/3590635284 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:36.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.869+0000 7f84257cc640 1 --2- 172.21.15.63:0/3590635284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a1995540a0 0x55a1999497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.869+0000 7f84257cc640 1 --2- 172.21.15.63:0/3590635284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a19957cf60 0x55a199942ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.870+0000 7f841ffff640 1 -- 172.21.15.63:0/3590635284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a19957cf60 msgr2=0x55a199942ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:36.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.870+0000 7f841ffff640 1 --2- 172.21.15.63:0/3590635284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a19957cf60 0x55a199942ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.870+0000 7f841ffff640 1 -- 172.21.15.63:0/3590635284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a1995540a0 msgr2=0x55a1999497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:36.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.870+0000 7f841ffff640 1 --2- 172.21.15.63:0/3590635284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a1995540a0 0x55a1999497d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.870+0000 7f841ffff640 1 -- 172.21.15.63:0/3590635284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a199943630 con 0x55a19955c280 2024-09-21T06:27:36.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.870+0000 7f841ffff640 1 --2- 172.21.15.63:0/3590635284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19955c280 0x55a199949db0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f840c010b00 tx=0x7f840c0106e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b054d7f26311323 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:36.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.870+0000 7f83fffff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:27:36.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.870+0000 7f83fffff640 1 -- 172.21.15.63:0/3590635284 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c029040 con 0x55a19955c280 2024-09-21T06:27:36.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.870+0000 7f83fffff640 1 -- 172.21.15.63:0/3590635284 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f840c021020 con 0x55a19955c280 2024-09-21T06:27:36.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.870+0000 7f842d7a3740 1 -- 172.21.15.63:0/3590635284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8418036040 con 0x55a19955c280 2024-09-21T06:27:36.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.870+0000 7f83fffff640 1 -- 172.21.15.63:0/3590635284 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f840c010b80 con 0x55a19955c280 2024-09-21T06:27:36.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.870+0000 7f842d7a3740 10 client.15201 fetch_fsmap learned FSMap version 28 2024-09-21T06:27:36.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.870+0000 7f842d7a3740 1 -- 172.21.15.63:0/3590635284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a199949060 con 0x55a19955c280 2024-09-21T06:27:36.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.871+0000 7f83fffff640 1 -- 172.21.15.63:0/3590635284 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8418036040 con 0x55a19955c280 2024-09-21T06:27:36.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.871+0000 7f83fffff640 1 -- 172.21.15.63:0/3590635284 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f840c0035f0 con 0x55a19955c280 2024-09-21T06:27:36.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.871+0000 7f842d7a3740 10 client.15201 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:27:36.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.871+0000 7f842d7a3740 10 client.15201 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T06:27:36.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.871+0000 7f842d7a3740 20 client.15201 populate_metadata read hostname 'smithi063' 2024-09-21T06:27:36.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.871+0000 7f842d7a3740 1 --2- 172.21.15.63:0/3590635284 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55a199510c90 0x55a1999afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.871+0000 7f842d7a3740 4 client.15201 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:27:36.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.871+0000 7f842d7a3740 1 -- 172.21.15.63:0/3590635284 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "status"}) -- 0x55a199898610 con 0x55a199510c90 2024-09-21T06:27:36.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.871+0000 7f84257cc640 1 --2- 172.21.15.63:0/3590635284 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55a199510c90 0x55a1999afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.871+0000 7f83fffff640 10 client.15201 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:27:36.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.871+0000 7f84257cc640 1 --2- 172.21.15.63:0/3590635284 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55a199510c90 0x55a1999afa90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9e1b6a73bb688f41 server_cookie=187dbbcb6b71c619 in_seq=0 out_seq=0 2024-09-21T06:27:36.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.872+0000 7f83fffff640 1 -- 172.21.15.63:0/3590635284 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a199898610 con 0x55a199510c90 2024-09-21T06:27:36.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.872+0000 7f83fffff640 10 client.15201 handle_command_reply: tid=0 2024-09-21T06:27:36.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.872+0000 7f842d7a3740 1 client.15201 shutdown 2024-09-21T06:27:36.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.872+0000 7f842d7a3740 1 -- 172.21.15.63:0/3590635284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19955c280 msgr2=0x55a199949db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:36.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.872+0000 7f842d7a3740 1 --2- 172.21.15.63:0/3590635284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19955c280 0x55a199949db0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f840c010b00 tx=0x7f840c0106e0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.872+0000 7f842d7a3740 1 -- 172.21.15.63:0/3590635284 shutdown_connections 2024-09-21T06:27:36.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.872+0000 7f842d7a3740 1 --2- 172.21.15.63:0/3590635284 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55a199510c90 0x55a1999afa90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.872+0000 7f842d7a3740 1 --2- 172.21.15.63:0/3590635284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a19957cf60 0x55a199942ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.872+0000 7f842d7a3740 1 --2- 172.21.15.63:0/3590635284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a19955c280 0x55a199949db0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.872+0000 7f842d7a3740 1 --2- 172.21.15.63:0/3590635284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a1995540a0 0x55a1999497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.872+0000 7f83fffff640 0 client.15201 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:27:36.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.872+0000 7f842d7a3740 1 -- 172.21.15.63:0/3590635284 >> 172.21.15.63:0/3590635284 conn(0x55a199571350 msgr2=0x55a19992cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:36.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.872+0000 7f842d7a3740 1 -- 172.21.15.63:0/3590635284 shutdown_connections 2024-09-21T06:27:36.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.872+0000 7f842d7a3740 1 -- 172.21.15.63:0/3590635284 wait complete. 2024-09-21T06:27:36.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.872+0000 7f842d7a3740 20 client.15201 trim_cache size 0 max 16384 2024-09-21T06:27:36.879 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:27:36.879 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "140899c8-77e1-11ef-baf5-efdc52797490", 2024-09-21T06:27:36.879 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 4, 2024-09-21T06:27:36.879 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 14835, 2024-09-21T06:27:36.879 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-21T06:27:36.879 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-21T06:27:36.880 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-21T06:27:36.880 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 68.124614281000007, 2024-09-21T06:27:36.880 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 28, 2024-09-21T06:27:36.880 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 77, 2024-09-21T06:27:36.880 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:27:36.880 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 89.373545632000003 2024-09-21T06:27:36.880 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:27:36.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.873+0000 7f842722f640 1 -- 172.21.15.63:0/3709265928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f84100b65f0 msgr2=0x7f84100b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:36.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.873+0000 7f842722f640 1 --2- 172.21.15.63:0/3709265928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f84100b65f0 0x7f84100b8b00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55a199921b80 tx=0x7f8414094040 comp rx=0 tx=0).stop 2024-09-21T06:27:36.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.873+0000 7f842722f640 1 -- 172.21.15.63:0/3709265928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8420101fc0 msgr2=0x7f842019a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:36.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.873+0000 7f842722f640 1 --2- 172.21.15.63:0/3709265928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8420101fc0 0x7f842019a4e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f841400d950 tx=0x7f841400de10 comp rx=0 tx=0).stop 2024-09-21T06:27:36.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.873+0000 7f842722f640 1 -- 172.21.15.63:0/3709265928 shutdown_connections 2024-09-21T06:27:36.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.873+0000 7f842722f640 1 --2- 172.21.15.63:0/3709265928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f84100b65f0 0x7f84100b8b00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.873+0000 7f842722f640 1 --2- 172.21.15.63:0/3709265928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8420109e50 0x7f842019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.873+0000 7f842722f640 1 --2- 172.21.15.63:0/3709265928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8420109500 0x7f842019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.873+0000 7f842722f640 1 --2- 172.21.15.63:0/3709265928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8420101fc0 0x7f842019a4e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.873+0000 7f842722f640 1 -- 172.21.15.63:0/3709265928 >> 172.21.15.63:0/3709265928 conn(0x7f8420079f90 msgr2=0x7f84201074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:36.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.873+0000 7f842722f640 1 -- 172.21.15.63:0/3709265928 shutdown_connections 2024-09-21T06:27:36.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:36.873+0000 7f842722f640 1 -- 172.21.15.63:0/3709265928 wait complete. 2024-09-21T06:27:37.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:36 smithi063 ceph-mon[31150]: pgmap v304: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T06:27:37.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:36 smithi175 ceph-mon[34510]: pgmap v304: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T06:27:37.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:36 smithi071 ceph-mon[34844]: pgmap v304: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T06:27:37.539 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.f status 2024-09-21T06:27:37.796 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:38.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.294+0000 7fe27c810640 1 -- 172.21.15.63:0/2413764168 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe278103b60 msgr2=0x7fe278103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:38.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.294+0000 7fe27c810640 1 --2- 172.21.15.63:0/2413764168 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe278103b60 0x7fe278103f70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe268009900 tx=0x7fe26802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.294+0000 7fe27c810640 1 -- 172.21.15.63:0/2413764168 shutdown_connections 2024-09-21T06:27:38.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.294+0000 7fe27c810640 1 --2- 172.21.15.63:0/2413764168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe278109df0 0x7fe278110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.294+0000 7fe27c810640 1 --2- 172.21.15.63:0/2413764168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2781094a0 0x7fe2781098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.294+0000 7fe27c810640 1 --2- 172.21.15.63:0/2413764168 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe278103b60 0x7fe278103f70 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.294+0000 7fe27c810640 1 -- 172.21.15.63:0/2413764168 >> 172.21.15.63:0/2413764168 conn(0x7fe27807b850 msgr2=0x7fe27807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:38.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.294+0000 7fe27c810640 1 -- 172.21.15.63:0/2413764168 shutdown_connections 2024-09-21T06:27:38.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.294+0000 7fe27c810640 1 -- 172.21.15.63:0/2413764168 wait complete. 2024-09-21T06:27:38.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.295+0000 7fe27c810640 1 Processor -- start 2024-09-21T06:27:38.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.295+0000 7fe27c810640 1 -- start start 2024-09-21T06:27:38.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.296+0000 7fe27c810640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe278103b60 0x7fe27819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.296+0000 7fe27c810640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2781094a0 0x7fe27819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.296+0000 7fe27c810640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe278109df0 0x7fe27819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.296+0000 7fe27c810640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe278113ab0 con 0x7fe278109df0 2024-09-21T06:27:38.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.296+0000 7fe27c810640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe278113930 con 0x7fe2781094a0 2024-09-21T06:27:38.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.296+0000 7fe27c810640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe278113c30 con 0x7fe278103b60 2024-09-21T06:27:38.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.296+0000 7fe276d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe278109df0 0x7fe27819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.296+0000 7fe276d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe278109df0 0x7fe27819fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36790/0 (socket says 172.21.15.63:36790) 2024-09-21T06:27:38.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.296+0000 7fe276d9d640 1 -- 172.21.15.63:0/614162721 learned_addr learned my addr 172.21.15.63:0/614162721 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:38.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.296+0000 7fe27659c640 1 --2- 172.21.15.63:0/614162721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe278103b60 0x7fe27819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.296+0000 7fe275d9b640 1 --2- 172.21.15.63:0/614162721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2781094a0 0x7fe27819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.296+0000 7fe276d9d640 1 -- 172.21.15.63:0/614162721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe278103b60 msgr2=0x7fe27819a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:38.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.296+0000 7fe276d9d640 1 --2- 172.21.15.63:0/614162721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe278103b60 0x7fe27819a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.296+0000 7fe276d9d640 1 -- 172.21.15.63:0/614162721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2781094a0 msgr2=0x7fe27819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:38.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.296+0000 7fe276d9d640 1 --2- 172.21.15.63:0/614162721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2781094a0 0x7fe27819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.296+0000 7fe276d9d640 1 -- 172.21.15.63:0/614162721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2781a0410 con 0x7fe278109df0 2024-09-21T06:27:38.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.297+0000 7fe276d9d640 1 --2- 172.21.15.63:0/614162721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe278109df0 0x7fe27819fda0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe27000cad0 tx=0x7fe27000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:38.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.297+0000 7fe2677fe640 1 -- 172.21.15.63:0/614162721 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27000ad60 con 0x7fe278109df0 2024-09-21T06:27:38.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.297+0000 7fe2677fe640 1 -- 172.21.15.63:0/614162721 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe270005020 con 0x7fe278109df0 2024-09-21T06:27:38.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.297+0000 7fe27c810640 1 -- 172.21.15.63:0/614162721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2781a0700 con 0x7fe278109df0 2024-09-21T06:27:38.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.297+0000 7fe2677fe640 1 -- 172.21.15.63:0/614162721 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27000f6b0 con 0x7fe278109df0 2024-09-21T06:27:38.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.297+0000 7fe27c810640 1 -- 172.21.15.63:0/614162721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2780755f0 con 0x7fe278109df0 2024-09-21T06:27:38.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.300+0000 7fe282d84740 1 Processor -- start 2024-09-21T06:27:38.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.300+0000 7fe2677fe640 1 -- 172.21.15.63:0/614162721 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fe2700051d0 con 0x7fe278109df0 2024-09-21T06:27:38.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.301+0000 7fe282d84740 1 -- start start 2024-09-21T06:27:38.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.301+0000 7fe282d84740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3ce27f60 0x564f3d1cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.301+0000 7fe282d84740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3cdff0a0 0x564f3d1ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.301+0000 7fe282d84740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3ce07280 0x564f3d1ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.301+0000 7fe282d84740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564f3d145c10 con 0x564f3cdff0a0 2024-09-21T06:27:38.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.301+0000 7fe282d84740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564f3d135040 con 0x564f3ce07280 2024-09-21T06:27:38.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.301+0000 7fe282d84740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564f3d138e50 con 0x564f3ce27f60 2024-09-21T06:27:38.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.301+0000 7fe27659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3cdff0a0 0x564f3d1ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.301+0000 7fe27659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3cdff0a0 0x564f3d1ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36804/0 (socket says 172.21.15.63:36804) 2024-09-21T06:27:38.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.301+0000 7fe27659c640 1 -- 172.21.15.63:0/3188848524 learned_addr learned my addr 172.21.15.63:0/3188848524 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:38.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.301+0000 7fe275d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3ce27f60 0x564f3d1cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.301+0000 7fe275d9b640 1 --2- 172.21.15.63:0/3188848524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3ce07280 0x564f3d1ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.302+0000 7fe275d9b640 1 -- 172.21.15.63:0/3188848524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3ce07280 msgr2=0x564f3d1ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:38.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.302+0000 7fe275d9b640 1 --2- 172.21.15.63:0/3188848524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3ce07280 0x564f3d1ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.302+0000 7fe275d9b640 1 -- 172.21.15.63:0/3188848524 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3cdff0a0 msgr2=0x564f3d1ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:38.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.302+0000 7fe275d9b640 1 --2- 172.21.15.63:0/3188848524 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3cdff0a0 0x564f3d1ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.302+0000 7fe275d9b640 1 -- 172.21.15.63:0/3188848524 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f3ce93540 con 0x564f3ce27f60 2024-09-21T06:27:38.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.302+0000 7fe2677fe640 1 --2- 172.21.15.63:0/614162721 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe2600b6620 0x7fe2600b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.302+0000 7fe27659c640 1 --2- 172.21.15.63:0/614162721 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe2600b6620 0x7fe2600b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.302+0000 7fe275d9b640 1 --2- 172.21.15.63:0/3188848524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3ce27f60 0x564f3d1cdf00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe27806c760 tx=0x7fe26c00a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4410b37838dfe57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:38.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.302+0000 7fe2677fe640 1 -- 172.21.15.63:0/614162721 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fe2700e74e0 con 0x7fe278109df0 2024-09-21T06:27:38.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.302+0000 7fe264ff9640 1 -- 172.21.15.63:0/3188848524 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26c005020 con 0x564f3ce27f60 2024-09-21T06:27:38.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.302+0000 7fe264ff9640 1 -- 172.21.15.63:0/3188848524 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe26c0047a0 con 0x564f3ce27f60 2024-09-21T06:27:38.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.302+0000 7fe264ff9640 1 -- 172.21.15.63:0/3188848524 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26c00f9f0 con 0x564f3ce27f60 2024-09-21T06:27:38.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.303+0000 7fe282d84740 1 -- 172.21.15.63:0/3188848524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3ce27f60 msgr2=0x564f3d1cdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.303+0000 7fe282d84740 1 --2- 172.21.15.63:0/3188848524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3ce27f60 0x564f3d1cdf00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe27806c760 tx=0x7fe26c00a6c0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.303+0000 7fe27659c640 1 --2- 172.21.15.63:0/614162721 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe2600b6620 0x7fe2600b8b30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe2680096c0 tx=0x7fe268009650 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.304+0000 7fe282d84740 1 -- 172.21.15.63:0/3188848524 shutdown_connections 2024-09-21T06:27:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.304+0000 7fe282d84740 1 --2- 172.21.15.63:0/3188848524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3ce07280 0x564f3d1ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.304+0000 7fe282d84740 1 --2- 172.21.15.63:0/3188848524 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3cdff0a0 0x564f3d1ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.304+0000 7fe282d84740 1 --2- 172.21.15.63:0/3188848524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3ce27f60 0x564f3d1cdf00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.304+0000 7fe282d84740 1 -- 172.21.15.63:0/3188848524 >> 172.21.15.63:0/3188848524 conn(0x564f3ce1c350 msgr2=0x564f3d1cbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.304+0000 7fe282d84740 1 -- 172.21.15.63:0/3188848524 shutdown_connections 2024-09-21T06:27:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.304+0000 7fe282d84740 1 -- 172.21.15.63:0/3188848524 wait complete. 2024-09-21T06:27:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.304+0000 7fe282d84740 1 -- start start 2024-09-21T06:27:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.304+0000 7fe282d84740 1 Processor -- start 2024-09-21T06:27:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.305+0000 7fe282d84740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3cdff0a0 0x564f3d1d9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.305+0000 7fe282d84740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3ce07280 0x564f3d1d9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.305+0000 7fe282d84740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 0x564f3d1e5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.305+0000 7fe282d84740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564f3cf965f0 con 0x564f3ce27f60 2024-09-21T06:27:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.305+0000 7fe282d84740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564f3d0d0010 con 0x564f3ce07280 2024-09-21T06:27:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.305+0000 7fe282d84740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564f3d1dc6e0 con 0x564f3cdff0a0 2024-09-21T06:27:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.305+0000 7fe282d84740 10 client.0 _ll_register_callbacks cb 0x564f3d12f340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.305+0000 7fe276d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 0x564f3d1e5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.305+0000 7fe276d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 0x564f3d1e5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36818/0 (socket says 172.21.15.63:36818) 2024-09-21T06:27:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.305+0000 7fe275d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3ce07280 0x564f3d1d9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.305+0000 7fe276d9d640 1 -- 172.21.15.63:0/1829920048 learned_addr learned my addr 172.21.15.63:0/1829920048 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.305+0000 7fe27659c640 1 --2- 172.21.15.63:0/1829920048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3cdff0a0 0x564f3d1d9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.305+0000 7fe276d9d640 1 -- 172.21.15.63:0/1829920048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3cdff0a0 msgr2=0x564f3d1d9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.305+0000 7fe276d9d640 1 --2- 172.21.15.63:0/1829920048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3cdff0a0 0x564f3d1d9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.305+0000 7fe276d9d640 1 -- 172.21.15.63:0/1829920048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3ce07280 msgr2=0x564f3d1d9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:38.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.305+0000 7fe276d9d640 1 --2- 172.21.15.63:0/1829920048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3ce07280 0x564f3d1d9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.305+0000 7fe276d9d640 1 -- 172.21.15.63:0/1829920048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f3d0fda00 con 0x564f3ce27f60 2024-09-21T06:27:38.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.305+0000 7fe276d9d640 1 --2- 172.21.15.63:0/1829920048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 0x564f3d1e5a00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe2700a9a00 tx=0x7fe2700ad310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4cd517934141ac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:38.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.305+0000 7fe25dffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:27:38.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.306+0000 7fe25dffb640 1 -- 172.21.15.63:0/1829920048 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27001d040 con 0x564f3ce27f60 2024-09-21T06:27:38.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.306+0000 7fe25dffb640 1 -- 172.21.15.63:0/1829920048 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fe270094b70 con 0x564f3ce27f60 2024-09-21T06:27:38.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.306+0000 7fe282d84740 1 -- 172.21.15.63:0/1829920048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe26c0047a0 con 0x564f3ce27f60 2024-09-21T06:27:38.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.306+0000 7fe25dffb640 1 -- 172.21.15.63:0/1829920048 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe2700b1f10 con 0x564f3ce27f60 2024-09-21T06:27:38.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.306+0000 7fe282d84740 10 client.15213 fetch_fsmap learned FSMap version 28 2024-09-21T06:27:38.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.306+0000 7fe282d84740 1 -- 172.21.15.63:0/1829920048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564f3d1e86d0 con 0x564f3ce27f60 2024-09-21T06:27:38.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.306+0000 7fe25dffb640 1 -- 172.21.15.63:0/1829920048 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2700d4030 con 0x564f3ce27f60 2024-09-21T06:27:38.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.306+0000 7fe25dffb640 1 -- 172.21.15.63:0/1829920048 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe2700a8f30 con 0x564f3ce27f60 2024-09-21T06:27:38.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.306+0000 7fe282d84740 10 client.15213 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:27:38.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.306+0000 7fe282d84740 10 client.15213 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T06:27:38.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.306+0000 7fe282d84740 20 client.15213 populate_metadata read hostname 'smithi063' 2024-09-21T06:27:38.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.307+0000 7fe282d84740 1 --2- 172.21.15.63:0/1829920048 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x564f3cde68e0 0x564f3d1ec0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.307+0000 7fe282d84740 4 client.15213 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:27:38.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.307+0000 7fe282d84740 1 -- 172.21.15.63:0/1829920048 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe26c0047a0 con 0x564f3cde68e0 2024-09-21T06:27:38.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.307+0000 7fe27659c640 1 --2- 172.21.15.63:0/1829920048 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x564f3cde68e0 0x564f3d1ec0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.307+0000 7fe25dffb640 10 client.15213 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:27:38.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.307+0000 7fe27659c640 1 --2- 172.21.15.63:0/1829920048 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x564f3cde68e0 0x564f3d1ec0a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a2290d6fe1c0a441 server_cookie=7e2a35e191c802fd in_seq=0 out_seq=0 2024-09-21T06:27:38.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.308+0000 7fe25dffb640 1 -- 172.21.15.63:0/1829920048 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fe26c0047a0 con 0x564f3cde68e0 2024-09-21T06:27:38.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.308+0000 7fe25dffb640 10 client.15213 handle_command_reply: tid=0 2024-09-21T06:27:38.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.308+0000 7fe282d84740 1 client.15213 shutdown 2024-09-21T06:27:38.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.308+0000 7fe282d84740 1 -- 172.21.15.63:0/1829920048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 msgr2=0x564f3d1e5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:38.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.308+0000 7fe282d84740 1 --2- 172.21.15.63:0/1829920048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 0x564f3d1e5a00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe2700a9a00 tx=0x7fe2700ad310 comp rx=0 tx=0).stop 2024-09-21T06:27:38.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.309+0000 7fe282d84740 1 -- 172.21.15.63:0/1829920048 shutdown_connections 2024-09-21T06:27:38.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.309+0000 7fe282d84740 1 --2- 172.21.15.63:0/1829920048 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x564f3cde68e0 0x564f3d1ec0a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.309+0000 7fe282d84740 1 --2- 172.21.15.63:0/1829920048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 0x564f3d1e5a00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.309+0000 7fe282d84740 1 --2- 172.21.15.63:0/1829920048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3ce07280 0x564f3d1d9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.309+0000 7fe282d84740 1 --2- 172.21.15.63:0/1829920048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3cdff0a0 0x564f3d1d9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.309+0000 7fe282d84740 1 -- 172.21.15.63:0/1829920048 >> 172.21.15.63:0/1829920048 conn(0x564f3ce1c350 msgr2=0x564f3d1d1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:38.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.309+0000 7fe25dffb640 0 client.15213 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:27:38.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.309+0000 7fe282d84740 1 -- 172.21.15.63:0/1829920048 shutdown_connections 2024-09-21T06:27:38.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.309+0000 7fe282d84740 1 -- 172.21.15.63:0/1829920048 wait complete. 2024-09-21T06:27:38.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.309+0000 7fe282d84740 20 client.15213 trim_cache size 0 max 16384 2024-09-21T06:27:38.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.328+0000 7fe282d84740 1 Processor -- start 2024-09-21T06:27:38.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.328+0000 7fe282d84740 1 -- start start 2024-09-21T06:27:38.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.328+0000 7fe282d84740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3cdff0a0 0x564f3d1d4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.328+0000 7fe282d84740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3ce07280 0x564f3d1d4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.328+0000 7fe282d84740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 0x564f3d1e5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.328+0000 7fe282d84740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564f3d1ea3e0 con 0x564f3ce27f60 2024-09-21T06:27:38.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.328+0000 7fe282d84740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564f3d1eaab0 con 0x564f3ce07280 2024-09-21T06:27:38.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.328+0000 7fe282d84740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564f3d1eb180 con 0x564f3cdff0a0 2024-09-21T06:27:38.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.328+0000 7fe276d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 0x564f3d1e5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.328+0000 7fe276d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 0x564f3d1e5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36826/0 (socket says 172.21.15.63:36826) 2024-09-21T06:27:38.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.328+0000 7fe276d9d640 1 -- 172.21.15.63:0/2037919089 learned_addr learned my addr 172.21.15.63:0/2037919089 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:38.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.328+0000 7fe27659c640 1 --2- 172.21.15.63:0/2037919089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3cdff0a0 0x564f3d1d4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.328+0000 7fe275d9b640 1 --2- 172.21.15.63:0/2037919089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3ce07280 0x564f3d1d4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.328+0000 7fe276d9d640 1 -- 172.21.15.63:0/2037919089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3cdff0a0 msgr2=0x564f3d1d4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:38.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.328+0000 7fe276d9d640 1 --2- 172.21.15.63:0/2037919089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3cdff0a0 0x564f3d1d4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.328+0000 7fe276d9d640 1 -- 172.21.15.63:0/2037919089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3ce07280 msgr2=0x564f3d1d4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:38.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.328+0000 7fe276d9d640 1 --2- 172.21.15.63:0/2037919089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3ce07280 0x564f3d1d4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.328+0000 7fe276d9d640 1 -- 172.21.15.63:0/2037919089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f3d1dc0e0 con 0x564f3ce27f60 2024-09-21T06:27:38.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.328+0000 7fe27659c640 1 --2- 172.21.15.63:0/2037919089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3cdff0a0 0x564f3d1d4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:38.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.328+0000 7fe275d9b640 1 --2- 172.21.15.63:0/2037919089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3ce07280 0x564f3d1d4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:38.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.329+0000 7fe276d9d640 1 --2- 172.21.15.63:0/2037919089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 0x564f3d1e5970 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe2700ad130 tx=0x7fe2700a9400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb2c61f2712846b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:38.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.329+0000 7fe25ffff640 1 -- 172.21.15.63:0/2037919089 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27001d040 con 0x564f3ce27f60 2024-09-21T06:27:38.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.329+0000 7fe25ffff640 1 -- 172.21.15.63:0/2037919089 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2700c8020 con 0x564f3ce27f60 2024-09-21T06:27:38.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.329+0000 7fe25ffff640 1 -- 172.21.15.63:0/2037919089 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe270094e60 con 0x564f3ce27f60 2024-09-21T06:27:38.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.330+0000 7fe282d84740 1 -- 172.21.15.63:0/2037919089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 msgr2=0x564f3d1e5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:38.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.330+0000 7fe282d84740 1 --2- 172.21.15.63:0/2037919089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 0x564f3d1e5970 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe2700ad130 tx=0x7fe2700a9400 comp rx=0 tx=0).stop 2024-09-21T06:27:38.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.330+0000 7fe282d84740 1 -- 172.21.15.63:0/2037919089 shutdown_connections 2024-09-21T06:27:38.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.330+0000 7fe282d84740 1 --2- 172.21.15.63:0/2037919089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 0x564f3d1e5970 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.330+0000 7fe282d84740 1 --2- 172.21.15.63:0/2037919089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3ce07280 0x564f3d1d4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.330+0000 7fe282d84740 1 --2- 172.21.15.63:0/2037919089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3cdff0a0 0x564f3d1d4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.330+0000 7fe282d84740 1 -- 172.21.15.63:0/2037919089 >> 172.21.15.63:0/2037919089 conn(0x564f3ce1c350 msgr2=0x564f3d1d9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:38.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.330+0000 7fe282d84740 1 -- 172.21.15.63:0/2037919089 shutdown_connections 2024-09-21T06:27:38.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.330+0000 7fe282d84740 1 -- 172.21.15.63:0/2037919089 wait complete. 2024-09-21T06:27:38.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.330+0000 7fe282d84740 1 -- start start 2024-09-21T06:27:38.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.330+0000 7fe282d84740 1 Processor -- start 2024-09-21T06:27:38.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe282d84740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3cdff0a0 0x564f3d1f4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe282d84740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3ce07280 0x564f3d1ee190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe282d84740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 0x564f3d1ee830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe282d84740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564f3d1ebf20 con 0x564f3ce27f60 2024-09-21T06:27:38.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe282d84740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564f3d1eb850 con 0x564f3cdff0a0 2024-09-21T06:27:38.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe282d84740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564f3d1ec5f0 con 0x564f3ce07280 2024-09-21T06:27:38.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe276d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 0x564f3d1ee830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe276d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 0x564f3d1ee830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36838/0 (socket says 172.21.15.63:36838) 2024-09-21T06:27:38.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe276d9d640 1 -- 172.21.15.63:0/682087338 learned_addr learned my addr 172.21.15.63:0/682087338 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:38.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe282d84740 10 client.0 _ll_register_callbacks cb 0x7fe270007780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:38.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe275d9b640 1 --2- 172.21.15.63:0/682087338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3ce07280 0x564f3d1ee190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe27659c640 1 --2- 172.21.15.63:0/682087338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3cdff0a0 0x564f3d1f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe276d9d640 1 -- 172.21.15.63:0/682087338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3ce07280 msgr2=0x564f3d1ee190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:38.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe276d9d640 1 --2- 172.21.15.63:0/682087338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3ce07280 0x564f3d1ee190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe276d9d640 1 -- 172.21.15.63:0/682087338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3cdff0a0 msgr2=0x564f3d1f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:38.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe276d9d640 1 --2- 172.21.15.63:0/682087338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3cdff0a0 0x564f3d1f4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe276d9d640 1 -- 172.21.15.63:0/682087338 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f3d1eefc0 con 0x564f3ce27f60 2024-09-21T06:27:38.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe276d9d640 1 --2- 172.21.15.63:0/682087338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 0x564f3d1ee830 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe2700acc40 tx=0x7fe2700ac920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0f85b299eabf52 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:38.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe25dffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:27:38.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe25dffb640 1 -- 172.21.15.63:0/682087338 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27001d040 con 0x564f3ce27f60 2024-09-21T06:27:38.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe25dffb640 1 -- 172.21.15.63:0/682087338 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fe2700a8f90 con 0x564f3ce27f60 2024-09-21T06:27:38.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.331+0000 7fe282d84740 1 -- 172.21.15.63:0/682087338 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2700c8020 con 0x564f3ce27f60 2024-09-21T06:27:38.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.332+0000 7fe25dffb640 1 -- 172.21.15.63:0/682087338 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe270094b70 con 0x564f3ce27f60 2024-09-21T06:27:38.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.332+0000 7fe282d84740 10 client.15219 fetch_fsmap learned FSMap version 28 2024-09-21T06:27:38.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.332+0000 7fe282d84740 1 -- 172.21.15.63:0/682087338 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564f3d257570 con 0x564f3ce27f60 2024-09-21T06:27:38.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.332+0000 7fe25dffb640 1 -- 172.21.15.63:0/682087338 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2700c8020 con 0x564f3ce27f60 2024-09-21T06:27:38.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.332+0000 7fe25dffb640 1 -- 172.21.15.63:0/682087338 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe270004a40 con 0x564f3ce27f60 2024-09-21T06:27:38.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.332+0000 7fe282d84740 10 client.15219 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:27:38.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.332+0000 7fe282d84740 10 client.15219 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T06:27:38.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.332+0000 7fe282d84740 20 client.15219 populate_metadata read hostname 'smithi063' 2024-09-21T06:27:38.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.332+0000 7fe282d84740 1 --2- 172.21.15.63:0/682087338 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x564f3cdbbc90 0x564f3d25a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.332+0000 7fe282d84740 4 client.15219 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:27:38.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.332+0000 7fe282d84740 1 -- 172.21.15.63:0/682087338 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "status"}) -- 0x564f3d147b60 con 0x564f3cdbbc90 2024-09-21T06:27:38.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.333+0000 7fe27659c640 1 --2- 172.21.15.63:0/682087338 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x564f3cdbbc90 0x564f3d25a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.333+0000 7fe27659c640 1 --2- 172.21.15.63:0/682087338 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x564f3cdbbc90 0x564f3d25a720 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3bbd8743c101a63c server_cookie=3e9a333b00ccd0d in_seq=0 out_seq=0 2024-09-21T06:27:38.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.333+0000 7fe25dffb640 10 client.15219 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:27:38.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.333+0000 7fe25dffb640 1 -- 172.21.15.63:0/682087338 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x564f3d147b60 con 0x564f3cdbbc90 2024-09-21T06:27:38.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.333+0000 7fe25dffb640 10 client.15219 handle_command_reply: tid=0 2024-09-21T06:27:38.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.333+0000 7fe282d84740 1 client.15219 shutdown 2024-09-21T06:27:38.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.333+0000 7fe282d84740 1 -- 172.21.15.63:0/682087338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 msgr2=0x564f3d1ee830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:38.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.333+0000 7fe282d84740 1 --2- 172.21.15.63:0/682087338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 0x564f3d1ee830 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe2700acc40 tx=0x7fe2700ac920 comp rx=0 tx=0).stop 2024-09-21T06:27:38.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.333+0000 7fe282d84740 1 -- 172.21.15.63:0/682087338 shutdown_connections 2024-09-21T06:27:38.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.333+0000 7fe282d84740 1 --2- 172.21.15.63:0/682087338 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x564f3cdbbc90 0x564f3d25a720 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.333+0000 7fe282d84740 1 --2- 172.21.15.63:0/682087338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564f3ce27f60 0x564f3d1ee830 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.333+0000 7fe282d84740 1 --2- 172.21.15.63:0/682087338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3ce07280 0x564f3d1ee190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.333+0000 7fe282d84740 1 --2- 172.21.15.63:0/682087338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564f3cdff0a0 0x564f3d1f4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.333+0000 7fe282d84740 1 -- 172.21.15.63:0/682087338 >> 172.21.15.63:0/682087338 conn(0x564f3ce1c350 msgr2=0x564f3d1cb600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:38.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.333+0000 7fe25dffb640 0 client.15219 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:27:38.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.334+0000 7fe282d84740 1 -- 172.21.15.63:0/682087338 shutdown_connections 2024-09-21T06:27:38.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.334+0000 7fe282d84740 1 -- 172.21.15.63:0/682087338 wait complete. 2024-09-21T06:27:38.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.334+0000 7fe282d84740 20 client.15219 trim_cache size 0 max 16384 2024-09-21T06:27:38.340 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:27:38.340 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "140899c8-77e1-11ef-baf5-efdc52797490", 2024-09-21T06:27:38.341 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 3, 2024-09-21T06:27:38.341 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 24670, 2024-09-21T06:27:38.341 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-21T06:27:38.341 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-21T06:27:38.341 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-21T06:27:38.341 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 69.988983438999995, 2024-09-21T06:27:38.341 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 28, 2024-09-21T06:27:38.341 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 77, 2024-09-21T06:27:38.341 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:27:38.341 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 105.629261265 2024-09-21T06:27:38.341 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:27:38.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.334+0000 7fe27c810640 1 -- 172.21.15.63:0/614162721 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe2600b6620 msgr2=0x7fe2600b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:38.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.334+0000 7fe27c810640 1 --2- 172.21.15.63:0/614162721 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe2600b6620 0x7fe2600b8b30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe2680096c0 tx=0x7fe268009650 comp rx=0 tx=0).stop 2024-09-21T06:27:38.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.334+0000 7fe27c810640 1 -- 172.21.15.63:0/614162721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe278109df0 msgr2=0x7fe27819fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:38.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.334+0000 7fe27c810640 1 --2- 172.21.15.63:0/614162721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe278109df0 0x7fe27819fda0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe27000cad0 tx=0x7fe27000ced0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.334+0000 7fe27c810640 1 -- 172.21.15.63:0/614162721 shutdown_connections 2024-09-21T06:27:38.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.334+0000 7fe27c810640 1 --2- 172.21.15.63:0/614162721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe278109df0 0x7fe27819fda0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.334+0000 7fe27c810640 1 --2- 172.21.15.63:0/614162721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2781094a0 0x7fe27819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.334+0000 7fe27c810640 1 --2- 172.21.15.63:0/614162721 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe2600b6620 0x7fe2600b8b30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.334+0000 7fe27c810640 1 --2- 172.21.15.63:0/614162721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe278103b60 0x7fe27819a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.334+0000 7fe27c810640 1 -- 172.21.15.63:0/614162721 >> 172.21.15.63:0/614162721 conn(0x7fe27807b850 msgr2=0x7fe278107650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:38.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.335+0000 7fe27c810640 1 -- 172.21.15.63:0/614162721 shutdown_connections 2024-09-21T06:27:38.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:38.335+0000 7fe27c810640 1 -- 172.21.15.63:0/614162721 wait complete. 2024-09-21T06:27:39.095 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T06:27:39.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:38 smithi071 ceph-mon[34844]: pgmap v305: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:27:39.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:38 smithi063 ceph-mon[31150]: pgmap v305: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:27:39.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:38 smithi175 ceph-mon[34510]: pgmap v305: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:27:39.350 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:39.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.871+0000 7f204166d640 1 -- 172.21.15.63:0/2938923116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f203c104a10 msgr2=0x7f203c104e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:39.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.871+0000 7f204166d640 1 --2- 172.21.15.63:0/2938923116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f203c104a10 0x7f203c104e20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f202c009ca0 tx=0x7f202c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.871+0000 7f204166d640 1 -- 172.21.15.63:0/2938923116 shutdown_connections 2024-09-21T06:27:39.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.871+0000 7f204166d640 1 --2- 172.21.15.63:0/2938923116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f203c10de40 0x7f203c110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.871+0000 7f204166d640 1 --2- 172.21.15.63:0/2938923116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c105360 0x7f203c10d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.871+0000 7f204166d640 1 --2- 172.21.15.63:0/2938923116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f203c104a10 0x7f203c104e20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.871+0000 7f204166d640 1 -- 172.21.15.63:0/2938923116 >> 172.21.15.63:0/2938923116 conn(0x7f203c079720 msgr2=0x7f203c079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:39.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.871+0000 7f204166d640 1 -- 172.21.15.63:0/2938923116 shutdown_connections 2024-09-21T06:27:39.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.871+0000 7f204166d640 1 -- 172.21.15.63:0/2938923116 wait complete. 2024-09-21T06:27:39.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.872+0000 7f204166d640 1 Processor -- start 2024-09-21T06:27:39.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.872+0000 7f204166d640 1 -- start start 2024-09-21T06:27:39.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.872+0000 7f204166d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f203c104a10 0x7f203c102750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.872+0000 7f204166d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c105360 0x7f203c102c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.872+0000 7f204166d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f203c10de40 0x7f203c1031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.872+0000 7f204166d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f203c113a80 con 0x7f203c10de40 2024-09-21T06:27:39.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.872+0000 7f204166d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f203c113900 con 0x7f203c105360 2024-09-21T06:27:39.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.872+0000 7f204166d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f203c113c00 con 0x7f203c104a10 2024-09-21T06:27:39.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.872+0000 7f203b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f203c10de40 0x7f203c1031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.872+0000 7f203b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f203c10de40 0x7f203c1031d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36856/0 (socket says 172.21.15.63:36856) 2024-09-21T06:27:39.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.872+0000 7f203b7fe640 1 -- 172.21.15.63:0/1513535845 learned_addr learned my addr 172.21.15.63:0/1513535845 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:39.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.872+0000 7f203affd640 1 --2- 172.21.15.63:0/1513535845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f203c104a10 0x7f203c102750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.873+0000 7f203a7fc640 1 --2- 172.21.15.63:0/1513535845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c105360 0x7f203c102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.873+0000 7f203b7fe640 1 -- 172.21.15.63:0/1513535845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f203c104a10 msgr2=0x7f203c102750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:39.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.873+0000 7f203b7fe640 1 --2- 172.21.15.63:0/1513535845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f203c104a10 0x7f203c102750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.873+0000 7f203b7fe640 1 -- 172.21.15.63:0/1513535845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c105360 msgr2=0x7f203c102c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:39.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.873+0000 7f203b7fe640 1 --2- 172.21.15.63:0/1513535845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c105360 0x7f203c102c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.873+0000 7f203b7fe640 1 -- 172.21.15.63:0/1513535845 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203c1a86f0 con 0x7f203c10de40 2024-09-21T06:27:39.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.873+0000 7f203a7fc640 1 --2- 172.21.15.63:0/1513535845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c105360 0x7f203c102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:39.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.873+0000 7f203b7fe640 1 --2- 172.21.15.63:0/1513535845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f203c10de40 0x7f203c1031d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f203400d750 tx=0x7f203400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:39.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.873+0000 7f2033fff640 1 -- 172.21.15.63:0/1513535845 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2034017070 con 0x7f203c10de40 2024-09-21T06:27:39.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.873+0000 7f2033fff640 1 -- 172.21.15.63:0/1513535845 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20340054d0 con 0x7f203c10de40 2024-09-21T06:27:39.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.873+0000 7f204166d640 1 -- 172.21.15.63:0/1513535845 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f203c1a89e0 con 0x7f203c10de40 2024-09-21T06:27:39.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.873+0000 7f2033fff640 1 -- 172.21.15.63:0/1513535845 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2034004c60 con 0x7f203c10de40 2024-09-21T06:27:39.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.873+0000 7f204166d640 1 -- 172.21.15.63:0/1513535845 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f203c1a8ed0 con 0x7f203c10de40 2024-09-21T06:27:39.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.876+0000 7f2047be1740 1 Processor -- start 2024-09-21T06:27:39.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.876+0000 7f2033fff640 1 -- 172.21.15.63:0/1513535845 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f2034009bd0 con 0x7f203c10de40 2024-09-21T06:27:39.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.876+0000 7f2047be1740 1 -- start start 2024-09-21T06:27:39.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.877+0000 7f2047be1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68faadf60 0x55a68fe53f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.877+0000 7f2047be1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68fa850a0 0x55a68fe54440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.877+0000 7f2047be1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa8d280 0x55a68fe54980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.877+0000 7f2047be1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a68fdcbc10 con 0x55a68fa8d280 2024-09-21T06:27:39.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.877+0000 7f2047be1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a68fdbb040 con 0x55a68fa850a0 2024-09-21T06:27:39.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.877+0000 7f2047be1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a68fdbee50 con 0x55a68faadf60 2024-09-21T06:27:39.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.877+0000 7f203a7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa8d280 0x55a68fe54980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.877+0000 7f203a7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa8d280 0x55a68fe54980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36866/0 (socket says 172.21.15.63:36866) 2024-09-21T06:27:39.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.877+0000 7f203a7fc640 1 -- 172.21.15.63:0/51084843 learned_addr learned my addr 172.21.15.63:0/51084843 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:39.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.877+0000 7f203a7fc640 1 --2- 172.21.15.63:0/51084843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68faadf60 0x55a68fe53f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.877+0000 7f203affd640 1 --2- 172.21.15.63:0/51084843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68fa850a0 0x55a68fe54440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.877+0000 7f203a7fc640 1 -- 172.21.15.63:0/51084843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68faadf60 msgr2=0x55a68fe53f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:39.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.877+0000 7f203a7fc640 1 --2- 172.21.15.63:0/51084843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68faadf60 0x55a68fe53f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.877+0000 7f203a7fc640 1 -- 172.21.15.63:0/51084843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68fa850a0 msgr2=0x55a68fe54440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:39.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.877+0000 7f203a7fc640 1 --2- 172.21.15.63:0/51084843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68fa850a0 0x55a68fe54440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.877+0000 7f203a7fc640 1 -- 172.21.15.63:0/51084843 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a68fb19540 con 0x55a68fa8d280 2024-09-21T06:27:39.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.877+0000 7f203affd640 1 --2- 172.21.15.63:0/51084843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68fa850a0 0x55a68fe54440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:39.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.877+0000 7f2033fff640 1 --2- 172.21.15.63:0/1513535845 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f20280b65f0 0x7f20280b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.877+0000 7f203a7fc640 1 --2- 172.21.15.63:0/51084843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa8d280 0x55a68fe54980 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f20240148d0 tx=0x7f2024009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f3de8b21612914 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:39.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.878+0000 7f203affd640 1 --2- 172.21.15.63:0/1513535845 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f20280b65f0 0x7f20280b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.878+0000 7f2033fff640 1 -- 172.21.15.63:0/1513535845 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f20340e6fb0 con 0x7f203c10de40 2024-09-21T06:27:39.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.878+0000 7f20317fa640 1 -- 172.21.15.63:0/51084843 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2024004030 con 0x55a68fa8d280 2024-09-21T06:27:39.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.878+0000 7f20317fa640 1 -- 172.21.15.63:0/51084843 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f202400fc10 con 0x55a68fa8d280 2024-09-21T06:27:39.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.878+0000 7f20317fa640 1 -- 172.21.15.63:0/51084843 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20240035f0 con 0x55a68fa8d280 2024-09-21T06:27:39.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.879+0000 7f2047be1740 1 -- 172.21.15.63:0/51084843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa8d280 msgr2=0x55a68fe54980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:39.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.879+0000 7f203affd640 1 --2- 172.21.15.63:0/1513535845 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f20280b65f0 0x7f20280b8b00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f202c005e30 tx=0x7f202c009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:39.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.879+0000 7f2047be1740 1 --2- 172.21.15.63:0/51084843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa8d280 0x55a68fe54980 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f20240148d0 tx=0x7f2024009610 comp rx=0 tx=0).stop 2024-09-21T06:27:39.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.879+0000 7f2047be1740 1 -- 172.21.15.63:0/51084843 shutdown_connections 2024-09-21T06:27:39.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.879+0000 7f2047be1740 1 --2- 172.21.15.63:0/51084843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa8d280 0x55a68fe54980 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.879+0000 7f2047be1740 1 --2- 172.21.15.63:0/51084843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68fa850a0 0x55a68fe54440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.879+0000 7f2047be1740 1 --2- 172.21.15.63:0/51084843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68faadf60 0x55a68fe53f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.879+0000 7f2047be1740 1 -- 172.21.15.63:0/51084843 >> 172.21.15.63:0/51084843 conn(0x55a68faa2350 msgr2=0x55a68fe51df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:39.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.879+0000 7f2047be1740 1 -- 172.21.15.63:0/51084843 shutdown_connections 2024-09-21T06:27:39.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.879+0000 7f2047be1740 1 -- 172.21.15.63:0/51084843 wait complete. 2024-09-21T06:27:39.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.879+0000 7f2047be1740 1 -- start start 2024-09-21T06:27:39.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.879+0000 7f2047be1740 1 Processor -- start 2024-09-21T06:27:39.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.880+0000 7f2047be1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68fa850a0 0x55a68fe5f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.880+0000 7f2047be1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68fa8d280 0x55a68fe5fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.880+0000 7f2047be1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68faadf60 0x55a68fe6ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.880+0000 7f2047be1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a68fc1c5f0 con 0x55a68faadf60 2024-09-21T06:27:39.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.880+0000 7f2047be1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a68fd56010 con 0x55a68fa8d280 2024-09-21T06:27:39.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.880+0000 7f2047be1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a68fe626e0 con 0x55a68fa850a0 2024-09-21T06:27:39.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.880+0000 7f2047be1740 10 client.0 _ll_register_callbacks cb 0x55a68fdb5340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:39.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.880+0000 7f203b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68faadf60 0x55a68fe6ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.880+0000 7f203b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68faadf60 0x55a68fe6ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36880/0 (socket says 172.21.15.63:36880) 2024-09-21T06:27:39.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.880+0000 7f203b7fe640 1 -- 172.21.15.63:0/2460967200 learned_addr learned my addr 172.21.15.63:0/2460967200 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:39.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.880+0000 7f203a7fc640 1 --2- 172.21.15.63:0/2460967200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68fa8d280 0x55a68fe5fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.880+0000 7f203affd640 1 --2- 172.21.15.63:0/2460967200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68fa850a0 0x55a68fe5f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.880+0000 7f203b7fe640 1 -- 172.21.15.63:0/2460967200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68fa850a0 msgr2=0x55a68fe5f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:39.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.880+0000 7f203b7fe640 1 --2- 172.21.15.63:0/2460967200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68fa850a0 0x55a68fe5f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.880+0000 7f203b7fe640 1 -- 172.21.15.63:0/2460967200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68fa8d280 msgr2=0x55a68fe5fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:39.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.880+0000 7f203b7fe640 1 --2- 172.21.15.63:0/2460967200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68fa8d280 0x55a68fe5fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.880+0000 7f203b7fe640 1 -- 172.21.15.63:0/2460967200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a68fd83a00 con 0x55a68faadf60 2024-09-21T06:27:39.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.880+0000 7f203b7fe640 1 --2- 172.21.15.63:0/2460967200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68faadf60 0x55a68fe6ba00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2034009610 tx=0x7f20340e4ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fe994c3a0b8156 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:39.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.880+0000 7f20227fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:27:39.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.880+0000 7f20227fc640 1 -- 172.21.15.63:0/2460967200 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2034020070 con 0x55a68faadf60 2024-09-21T06:27:39.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.881+0000 7f20227fc640 1 -- 172.21.15.63:0/2460967200 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f20340a8850 con 0x55a68faadf60 2024-09-21T06:27:39.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.881+0000 7f2047be1740 1 -- 172.21.15.63:0/2460967200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f202400fc10 con 0x55a68faadf60 2024-09-21T06:27:39.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.881+0000 7f20227fc640 1 -- 172.21.15.63:0/2460967200 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f20340ad600 con 0x55a68faadf60 2024-09-21T06:27:39.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.881+0000 7f2047be1740 10 client.15231 fetch_fsmap learned FSMap version 28 2024-09-21T06:27:39.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.881+0000 7f2047be1740 1 -- 172.21.15.63:0/2460967200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a68fe6e660 con 0x55a68faadf60 2024-09-21T06:27:39.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.881+0000 7f20227fc640 1 -- 172.21.15.63:0/2460967200 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f202400fc10 con 0x55a68faadf60 2024-09-21T06:27:39.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.881+0000 7f20227fc640 1 -- 172.21.15.63:0/2460967200 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2034098110 con 0x55a68faadf60 2024-09-21T06:27:39.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.881+0000 7f2047be1740 10 client.15231 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:27:39.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.881+0000 7f2047be1740 10 client.15231 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:27:39.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.881+0000 7f2047be1740 20 client.15231 populate_metadata read hostname 'smithi063' 2024-09-21T06:27:39.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.881+0000 7f2047be1740 1 --2- 172.21.15.63:0/2460967200 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55a68fa6c8e0 0x55a68fe72080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.881+0000 7f2047be1740 4 client.15231 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:27:39.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.881+0000 7f2047be1740 1 -- 172.21.15.63:0/2460967200 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a68fdcdb60 con 0x55a68fa6c8e0 2024-09-21T06:27:39.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.881+0000 7f203affd640 1 --2- 172.21.15.63:0/2460967200 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55a68fa6c8e0 0x55a68fe72080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.882+0000 7f20227fc640 10 client.15231 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:27:39.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.882+0000 7f203affd640 1 --2- 172.21.15.63:0/2460967200 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55a68fa6c8e0 0x55a68fe72080 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4783399fd26c968e server_cookie=76c29612670c9ae9 in_seq=0 out_seq=0 2024-09-21T06:27:39.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.883+0000 7f20227fc640 1 -- 172.21.15.63:0/2460967200 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a68fdcdb60 con 0x55a68fa6c8e0 2024-09-21T06:27:39.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.883+0000 7f20227fc640 10 client.15231 handle_command_reply: tid=0 2024-09-21T06:27:39.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.883+0000 7f2047be1740 1 client.15231 shutdown 2024-09-21T06:27:39.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.883+0000 7f2047be1740 1 -- 172.21.15.63:0/2460967200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68faadf60 msgr2=0x55a68fe6ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:39.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.883+0000 7f2047be1740 1 --2- 172.21.15.63:0/2460967200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68faadf60 0x55a68fe6ba00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2034009610 tx=0x7f20340e4ce0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.883+0000 7f2047be1740 1 -- 172.21.15.63:0/2460967200 shutdown_connections 2024-09-21T06:27:39.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.883+0000 7f2047be1740 1 --2- 172.21.15.63:0/2460967200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68faadf60 0x55a68fe6ba00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.883+0000 7f2047be1740 1 --2- 172.21.15.63:0/2460967200 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55a68fa6c8e0 0x55a68fe72080 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.883+0000 7f20227fc640 0 client.15231 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:27:39.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.883+0000 7f2047be1740 1 --2- 172.21.15.63:0/2460967200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68fa8d280 0x55a68fe5fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.883+0000 7f2047be1740 1 --2- 172.21.15.63:0/2460967200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68fa850a0 0x55a68fe5f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.883+0000 7f2047be1740 1 -- 172.21.15.63:0/2460967200 >> 172.21.15.63:0/2460967200 conn(0x55a68faa2350 msgr2=0x55a68fe57090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:39.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.883+0000 7f2047be1740 1 -- 172.21.15.63:0/2460967200 shutdown_connections 2024-09-21T06:27:39.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.883+0000 7f2047be1740 1 -- 172.21.15.63:0/2460967200 wait complete. 2024-09-21T06:27:39.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.884+0000 7f2047be1740 20 client.15231 trim_cache size 0 max 16384 2024-09-21T06:27:39.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.902+0000 7f2047be1740 1 Processor -- start 2024-09-21T06:27:39.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.902+0000 7f2047be1740 1 -- start start 2024-09-21T06:27:39.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.903+0000 7f2047be1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa850a0 0x55a68fe6b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.903+0000 7f2047be1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68fa8d280 0x55a68fe6beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.903+0000 7f2047be1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68faadf60 0x55a68fe5f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.903+0000 7f2047be1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a68fe703c0 con 0x55a68fa850a0 2024-09-21T06:27:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.903+0000 7f2047be1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a68fe70a90 con 0x55a68faadf60 2024-09-21T06:27:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.903+0000 7f2047be1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a68fe71160 con 0x55a68fa8d280 2024-09-21T06:27:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.903+0000 7f203affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa850a0 0x55a68fe6b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.903+0000 7f203affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa850a0 0x55a68fe6b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36884/0 (socket says 172.21.15.63:36884) 2024-09-21T06:27:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.903+0000 7f203affd640 1 -- 172.21.15.63:0/4096667851 learned_addr learned my addr 172.21.15.63:0/4096667851 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.903+0000 7f203b7fe640 1 --2- 172.21.15.63:0/4096667851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68faadf60 0x55a68fe5f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.903+0000 7f203a7fc640 1 --2- 172.21.15.63:0/4096667851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68fa8d280 0x55a68fe6beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.903+0000 7f203affd640 1 -- 172.21.15.63:0/4096667851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68fa8d280 msgr2=0x55a68fe6beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.903+0000 7f203affd640 1 --2- 172.21.15.63:0/4096667851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68fa8d280 0x55a68fe6beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.903+0000 7f203affd640 1 -- 172.21.15.63:0/4096667851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68faadf60 msgr2=0x55a68fe5f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.903+0000 7f203affd640 1 --2- 172.21.15.63:0/4096667851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68faadf60 0x55a68fe5f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.903+0000 7f203affd640 1 -- 172.21.15.63:0/4096667851 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a68fe5b2b0 con 0x55a68fa850a0 2024-09-21T06:27:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.903+0000 7f203a7fc640 1 --2- 172.21.15.63:0/4096667851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68fa8d280 0x55a68fe6beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.903+0000 7f203b7fe640 1 --2- 172.21.15.63:0/4096667851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68faadf60 0x55a68fe5f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.903+0000 7f203affd640 1 --2- 172.21.15.63:0/4096667851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa850a0 0x55a68fe6b970 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f202c009ca0 tx=0x7f202c041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10a1621d6419536 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.903+0000 7f2030ff9640 1 -- 172.21.15.63:0/4096667851 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c003970 con 0x55a68fa850a0 2024-09-21T06:27:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.904+0000 7f2030ff9640 1 -- 172.21.15.63:0/4096667851 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f202c036050 con 0x55a68fa850a0 2024-09-21T06:27:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.904+0000 7f2030ff9640 1 -- 172.21.15.63:0/4096667851 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c02f8c0 con 0x55a68fa850a0 2024-09-21T06:27:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.904+0000 7f2047be1740 1 -- 172.21.15.63:0/4096667851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa850a0 msgr2=0x55a68fe6b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.904+0000 7f2047be1740 1 --2- 172.21.15.63:0/4096667851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa850a0 0x55a68fe6b970 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f202c009ca0 tx=0x7f202c041000 comp rx=0 tx=0).stop 2024-09-21T06:27:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.904+0000 7f2047be1740 1 -- 172.21.15.63:0/4096667851 shutdown_connections 2024-09-21T06:27:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.904+0000 7f2047be1740 1 --2- 172.21.15.63:0/4096667851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68faadf60 0x55a68fe5f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.904+0000 7f2047be1740 1 --2- 172.21.15.63:0/4096667851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68fa8d280 0x55a68fe6beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.904+0000 7f2047be1740 1 --2- 172.21.15.63:0/4096667851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa850a0 0x55a68fe6b970 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.904+0000 7f2047be1740 1 -- 172.21.15.63:0/4096667851 >> 172.21.15.63:0/4096667851 conn(0x55a68faa2350 msgr2=0x55a68fe5dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.905+0000 7f2047be1740 1 -- 172.21.15.63:0/4096667851 shutdown_connections 2024-09-21T06:27:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.905+0000 7f2047be1740 1 -- 172.21.15.63:0/4096667851 wait complete. 2024-09-21T06:27:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.905+0000 7f2047be1740 1 -- start start 2024-09-21T06:27:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.905+0000 7f2047be1740 1 Processor -- start 2024-09-21T06:27:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.905+0000 7f2047be1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68fa850a0 0x55a68fe74660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.905+0000 7f2047be1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa8d280 0x55a68fe74ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.905+0000 7f2047be1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68faadf60 0x55a68fe79d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.905+0000 7f2047be1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a68fe71f00 con 0x55a68fa8d280 2024-09-21T06:27:39.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.905+0000 7f2047be1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a68fe71830 con 0x55a68faadf60 2024-09-21T06:27:39.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.905+0000 7f2047be1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a68fe725d0 con 0x55a68fa850a0 2024-09-21T06:27:39.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.905+0000 7f2047be1740 10 client.0 _ll_register_callbacks cb 0x7f20340046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:39.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.905+0000 7f203a7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa8d280 0x55a68fe74ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.905+0000 7f203a7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa8d280 0x55a68fe74ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36892/0 (socket says 172.21.15.63:36892) 2024-09-21T06:27:39.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.906+0000 7f203a7fc640 1 -- 172.21.15.63:0/385067952 learned_addr learned my addr 172.21.15.63:0/385067952 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:39.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.906+0000 7f203affd640 1 --2- 172.21.15.63:0/385067952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68fa850a0 0x55a68fe74660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.906+0000 7f203b7fe640 1 --2- 172.21.15.63:0/385067952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68faadf60 0x55a68fe79d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.906+0000 7f203a7fc640 1 -- 172.21.15.63:0/385067952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68fa850a0 msgr2=0x55a68fe74660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:39.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.906+0000 7f203a7fc640 1 --2- 172.21.15.63:0/385067952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68fa850a0 0x55a68fe74660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.906+0000 7f203a7fc640 1 -- 172.21.15.63:0/385067952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68faadf60 msgr2=0x55a68fe79d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:39.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.906+0000 7f203a7fc640 1 --2- 172.21.15.63:0/385067952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68faadf60 0x55a68fe79d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.906+0000 7f203a7fc640 1 -- 172.21.15.63:0/385067952 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a68fe753f0 con 0x55a68fa8d280 2024-09-21T06:27:39.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.906+0000 7f203b7fe640 1 --2- 172.21.15.63:0/385067952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68faadf60 0x55a68fe79d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:39.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.906+0000 7f203a7fc640 1 --2- 172.21.15.63:0/385067952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa8d280 0x55a68fe74ba0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2024014f50 tx=0x7f2024009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9644b16116a24eb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:39.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.906+0000 7f20227fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:27:39.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.906+0000 7f20227fc640 1 -- 172.21.15.63:0/385067952 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2024005320 con 0x55a68fa8d280 2024-09-21T06:27:39.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.906+0000 7f20227fc640 1 -- 172.21.15.63:0/385067952 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f20240054c0 con 0x55a68fa8d280 2024-09-21T06:27:39.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.906+0000 7f2047be1740 1 -- 172.21.15.63:0/385067952 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f202c036050 con 0x55a68fa8d280 2024-09-21T06:27:39.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.906+0000 7f20227fc640 1 -- 172.21.15.63:0/385067952 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f202400f730 con 0x55a68fa8d280 2024-09-21T06:27:39.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.906+0000 7f2047be1740 10 client.15237 fetch_fsmap learned FSMap version 28 2024-09-21T06:27:39.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.906+0000 7f2047be1740 1 -- 172.21.15.63:0/385067952 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a68fedda00 con 0x55a68fa8d280 2024-09-21T06:27:39.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.907+0000 7f20227fc640 1 -- 172.21.15.63:0/385067952 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f202c036050 con 0x55a68fa8d280 2024-09-21T06:27:39.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.907+0000 7f20227fc640 1 -- 172.21.15.63:0/385067952 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2024003af0 con 0x55a68fa8d280 2024-09-21T06:27:39.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.907+0000 7f2047be1740 10 client.15237 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:27:39.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.907+0000 7f2047be1740 10 client.15237 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:27:39.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.907+0000 7f2047be1740 20 client.15237 populate_metadata read hostname 'smithi063' 2024-09-21T06:27:39.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.907+0000 7f2047be1740 1 --2- 172.21.15.63:0/385067952 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55a68fa41c90 0x55a68fee0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.907+0000 7f2047be1740 4 client.15237 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:27:39.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.907+0000 7f2047be1740 1 -- 172.21.15.63:0/385067952 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "status"}) -- 0x55a68fdc9610 con 0x55a68fa41c90 2024-09-21T06:27:39.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.907+0000 7f203affd640 1 --2- 172.21.15.63:0/385067952 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55a68fa41c90 0x55a68fee0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.908+0000 7f203affd640 1 --2- 172.21.15.63:0/385067952 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55a68fa41c90 0x55a68fee0f50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=72730f287605d8d9 server_cookie=f563ba1e77153629 in_seq=0 out_seq=0 2024-09-21T06:27:39.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.908+0000 7f20227fc640 10 client.15237 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:27:39.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.908+0000 7f20227fc640 1 -- 172.21.15.63:0/385067952 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a68fdc9610 con 0x55a68fa41c90 2024-09-21T06:27:39.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.908+0000 7f20227fc640 10 client.15237 handle_command_reply: tid=0 2024-09-21T06:27:39.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.908+0000 7f2047be1740 1 client.15237 shutdown 2024-09-21T06:27:39.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.908+0000 7f2047be1740 1 -- 172.21.15.63:0/385067952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa8d280 msgr2=0x55a68fe74ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:39.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.908+0000 7f2047be1740 1 --2- 172.21.15.63:0/385067952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa8d280 0x55a68fe74ba0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2024014f50 tx=0x7f2024009b90 comp rx=0 tx=0).stop 2024-09-21T06:27:39.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.908+0000 7f2047be1740 1 -- 172.21.15.63:0/385067952 shutdown_connections 2024-09-21T06:27:39.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.908+0000 7f2047be1740 1 --2- 172.21.15.63:0/385067952 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55a68fa41c90 0x55a68fee0f50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.908+0000 7f2047be1740 1 --2- 172.21.15.63:0/385067952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a68faadf60 0x55a68fe79d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.908+0000 7f2047be1740 1 --2- 172.21.15.63:0/385067952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a68fa8d280 0x55a68fe74ba0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.908+0000 7f2047be1740 1 --2- 172.21.15.63:0/385067952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a68fa850a0 0x55a68fe74660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.908+0000 7f2047be1740 1 -- 172.21.15.63:0/385067952 >> 172.21.15.63:0/385067952 conn(0x55a68faa2350 msgr2=0x55a68fe5df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:39.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.908+0000 7f20227fc640 0 client.15237 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:27:39.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.908+0000 7f2047be1740 1 -- 172.21.15.63:0/385067952 shutdown_connections 2024-09-21T06:27:39.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.908+0000 7f2047be1740 1 -- 172.21.15.63:0/385067952 wait complete. 2024-09-21T06:27:39.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.908+0000 7f2047be1740 20 client.15237 trim_cache size 0 max 16384 2024-09-21T06:27:39.915 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:27:39.916 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "140899c8-77e1-11ef-baf5-efdc52797490", 2024-09-21T06:27:39.916 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 2, 2024-09-21T06:27:39.916 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 24676, 2024-09-21T06:27:39.916 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-21T06:27:39.916 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-21T06:27:39.916 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-21T06:27:39.916 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 72.575086986000002, 2024-09-21T06:27:39.916 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 28, 2024-09-21T06:27:39.916 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 77, 2024-09-21T06:27:39.916 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:27:39.916 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 104.540914355 2024-09-21T06:27:39.916 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:27:39.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.909+0000 7f204166d640 1 -- 172.21.15.63:0/1513535845 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f20280b65f0 msgr2=0x7f20280b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:39.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.909+0000 7f204166d640 1 --2- 172.21.15.63:0/1513535845 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f20280b65f0 0x7f20280b8b00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f202c005e30 tx=0x7f202c009360 comp rx=0 tx=0).stop 2024-09-21T06:27:39.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.909+0000 7f204166d640 1 -- 172.21.15.63:0/1513535845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f203c10de40 msgr2=0x7f203c1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:39.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.909+0000 7f204166d640 1 --2- 172.21.15.63:0/1513535845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f203c10de40 0x7f203c1031d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f203400d750 tx=0x7f203400dc10 comp rx=0 tx=0).stop 2024-09-21T06:27:39.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.909+0000 7f204166d640 1 -- 172.21.15.63:0/1513535845 shutdown_connections 2024-09-21T06:27:39.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.909+0000 7f204166d640 1 --2- 172.21.15.63:0/1513535845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f203c10de40 0x7f203c1031d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.909+0000 7f204166d640 1 --2- 172.21.15.63:0/1513535845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c105360 0x7f203c102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.909+0000 7f204166d640 1 --2- 172.21.15.63:0/1513535845 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f20280b65f0 0x7f20280b8b00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.909+0000 7f204166d640 1 --2- 172.21.15.63:0/1513535845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f203c104a10 0x7f203c102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.909+0000 7f204166d640 1 -- 172.21.15.63:0/1513535845 >> 172.21.15.63:0/1513535845 conn(0x7f203c079720 msgr2=0x7f203c100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:39.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.909+0000 7f204166d640 1 -- 172.21.15.63:0/1513535845 shutdown_connections 2024-09-21T06:27:39.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:39.909+0000 7f204166d640 1 -- 172.21.15.63:0/1513535845 wait complete. 2024-09-21T06:27:40.680 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T06:27:40.939 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:41.208 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:40 smithi063 ceph-mon[31150]: pgmap v306: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:27:41.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:40 smithi071 ceph-mon[34844]: pgmap v306: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:27:41.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:40 smithi175 ceph-mon[34510]: pgmap v306: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:27:41.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.405+0000 7f7a1eb2d640 1 -- 172.21.15.63:0/2206832796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a18108d10 msgr2=0x7f7a1810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:41.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.405+0000 7f7a1eb2d640 1 --2- 172.21.15.63:0/2206832796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a18108d10 0x7f7a1810f540 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009ca0 tx=0x7f7a1002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.405+0000 7f7a1eb2d640 1 -- 172.21.15.63:0/2206832796 shutdown_connections 2024-09-21T06:27:41.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.405+0000 7f7a1eb2d640 1 --2- 172.21.15.63:0/2206832796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a18108d10 0x7f7a1810f540 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.405+0000 7f7a1eb2d640 1 --2- 172.21.15.63:0/2206832796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a181083c0 0x7f7a181087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.405+0000 7f7a1eb2d640 1 --2- 172.21.15.63:0/2206832796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a18102a80 0x7f7a18102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.405+0000 7f7a1eb2d640 1 -- 172.21.15.63:0/2206832796 >> 172.21.15.63:0/2206832796 conn(0x7f7a18079740 msgr2=0x7f7a18079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:41.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.405+0000 7f7a1eb2d640 1 -- 172.21.15.63:0/2206832796 shutdown_connections 2024-09-21T06:27:41.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.405+0000 7f7a1eb2d640 1 -- 172.21.15.63:0/2206832796 wait complete. 2024-09-21T06:27:41.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.405+0000 7f7a1eb2d640 1 Processor -- start 2024-09-21T06:27:41.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.405+0000 7f7a1eb2d640 1 -- start start 2024-09-21T06:27:41.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.406+0000 7f7a1eb2d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a18102a80 0x7f7a18199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.406+0000 7f7a1eb2d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a181083c0 0x7f7a181998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.406+0000 7f7a1eb2d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a18108d10 0x7f7a1819eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.406+0000 7f7a1eb2d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7a18112980 con 0x7f7a181083c0 2024-09-21T06:27:41.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.406+0000 7f7a1eb2d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7a18112800 con 0x7f7a18108d10 2024-09-21T06:27:41.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.406+0000 7f7a1eb2d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7a18112b00 con 0x7f7a18102a80 2024-09-21T06:27:41.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.406+0000 7f7a17fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a181083c0 0x7f7a181998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.406+0000 7f7a17fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a181083c0 0x7f7a181998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36916/0 (socket says 172.21.15.63:36916) 2024-09-21T06:27:41.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.406+0000 7f7a17fff640 1 -- 172.21.15.63:0/3150176387 learned_addr learned my addr 172.21.15.63:0/3150176387 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:41.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.406+0000 7f7a1d0ca640 1 --2- 172.21.15.63:0/3150176387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a18108d10 0x7f7a1819eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.406+0000 7f7a1c8c9640 1 --2- 172.21.15.63:0/3150176387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a18102a80 0x7f7a18199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.406+0000 7f7a17fff640 1 -- 172.21.15.63:0/3150176387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a18102a80 msgr2=0x7f7a18199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:41.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.406+0000 7f7a17fff640 1 --2- 172.21.15.63:0/3150176387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a18102a80 0x7f7a18199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.406+0000 7f7a17fff640 1 -- 172.21.15.63:0/3150176387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a18108d10 msgr2=0x7f7a1819eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:41.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.406+0000 7f7a17fff640 1 --2- 172.21.15.63:0/3150176387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a18108d10 0x7f7a1819eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.406+0000 7f7a17fff640 1 -- 172.21.15.63:0/3150176387 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1819f2a0 con 0x7f7a181083c0 2024-09-21T06:27:41.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.407+0000 7f7a17fff640 1 --2- 172.21.15.63:0/3150176387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a181083c0 0x7f7a181998d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7a0400d770 tx=0x7f7a0400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:41.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.407+0000 7f7a15ffb640 1 -- 172.21.15.63:0/3150176387 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a04017070 con 0x7f7a181083c0 2024-09-21T06:27:41.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.407+0000 7f7a1eb2d640 1 -- 172.21.15.63:0/3150176387 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a1819f590 con 0x7f7a181083c0 2024-09-21T06:27:41.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.407+0000 7f7a15ffb640 1 -- 172.21.15.63:0/3150176387 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a04009c30 con 0x7f7a181083c0 2024-09-21T06:27:41.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.407+0000 7f7a15ffb640 1 -- 172.21.15.63:0/3150176387 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0400f620 con 0x7f7a181083c0 2024-09-21T06:27:41.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.407+0000 7f7a1eb2d640 1 -- 172.21.15.63:0/3150176387 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a181a5cf0 con 0x7f7a181083c0 2024-09-21T06:27:41.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.409+0000 7f7a250a1740 1 Processor -- start 2024-09-21T06:27:41.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.409+0000 7f7a250a1740 1 -- start start 2024-09-21T06:27:41.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.410+0000 7f7a15ffb640 1 -- 172.21.15.63:0/3150176387 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f7a0401a070 con 0x7f7a181083c0 2024-09-21T06:27:41.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.410+0000 7f7a250a1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adabc2f60 0x564adaf68f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.410+0000 7f7a250a1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adab9a0a0 0x564adaf75270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.410+0000 7f7a250a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564adaba2280 0x564adaf69440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.410+0000 7f7a250a1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564adaee0c10 con 0x564adab9a0a0 2024-09-21T06:27:41.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.410+0000 7f7a250a1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564adaed0040 con 0x564adabc2f60 2024-09-21T06:27:41.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.410+0000 7f7a250a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564adaed3e50 con 0x564adaba2280 2024-09-21T06:27:41.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.410+0000 7f7a1c8c9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adab9a0a0 0x564adaf75270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.410+0000 7f7a1c8c9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adab9a0a0 0x564adaf75270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36922/0 (socket says 172.21.15.63:36922) 2024-09-21T06:27:41.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.410+0000 7f7a1c8c9640 1 -- 172.21.15.63:0/1373122841 learned_addr learned my addr 172.21.15.63:0/1373122841 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:41.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.410+0000 7f7a1d0ca640 1 --2- 172.21.15.63:0/1373122841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adabc2f60 0x564adaf68f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.410+0000 7f7a17fff640 1 --2- 172.21.15.63:0/1373122841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564adaba2280 0x564adaf69440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.410+0000 7f7a1c8c9640 1 -- 172.21.15.63:0/1373122841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564adaba2280 msgr2=0x564adaf69440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.410+0000 7f7a1c8c9640 1 --2- 172.21.15.63:0/1373122841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564adaba2280 0x564adaf69440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.410+0000 7f7a1c8c9640 1 -- 172.21.15.63:0/1373122841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adabc2f60 msgr2=0x564adaf68f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.410+0000 7f7a1c8c9640 1 --2- 172.21.15.63:0/1373122841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adabc2f60 0x564adaf68f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.410+0000 7f7a1c8c9640 1 -- 172.21.15.63:0/1373122841 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564adac2e540 con 0x564adab9a0a0 2024-09-21T06:27:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.410+0000 7f7a1d0ca640 1 --2- 172.21.15.63:0/1373122841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adabc2f60 0x564adaf68f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.411+0000 7f7a15ffb640 1 --2- 172.21.15.63:0/3150176387 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7a080b65f0 0x7f7a080b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.411+0000 7f7a1c8c9640 1 --2- 172.21.15.63:0/1373122841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adab9a0a0 0x564adaf75270 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c00bd50 tx=0x7f7a0c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff8682fbb21d20b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.411+0000 7f7a1d0ca640 1 --2- 172.21.15.63:0/3150176387 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7a080b65f0 0x7f7a080b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.411+0000 7f7a15ffb640 1 -- 172.21.15.63:0/3150176387 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f7a040e7010 con 0x7f7a181083c0 2024-09-21T06:27:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.411+0000 7f7a02ffd640 1 -- 172.21.15.63:0/1373122841 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c005220 con 0x564adab9a0a0 2024-09-21T06:27:41.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.411+0000 7f7a02ffd640 1 -- 172.21.15.63:0/1373122841 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a0c00be40 con 0x564adab9a0a0 2024-09-21T06:27:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.411+0000 7f7a02ffd640 1 -- 172.21.15.63:0/1373122841 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0117c0 con 0x564adab9a0a0 2024-09-21T06:27:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.412+0000 7f7a250a1740 1 -- 172.21.15.63:0/1373122841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adab9a0a0 msgr2=0x564adaf75270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.412+0000 7f7a250a1740 1 --2- 172.21.15.63:0/1373122841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adab9a0a0 0x564adaf75270 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c00bd50 tx=0x7f7a0c0107a0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.412+0000 7f7a1d0ca640 1 --2- 172.21.15.63:0/3150176387 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7a080b65f0 0x7f7a080b8b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7a10006010 tx=0x7f7a10009480 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.412+0000 7f7a250a1740 1 -- 172.21.15.63:0/1373122841 shutdown_connections 2024-09-21T06:27:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.412+0000 7f7a250a1740 1 --2- 172.21.15.63:0/1373122841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564adaba2280 0x564adaf69440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.412+0000 7f7a250a1740 1 --2- 172.21.15.63:0/1373122841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adab9a0a0 0x564adaf75270 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.412+0000 7f7a250a1740 1 --2- 172.21.15.63:0/1373122841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adabc2f60 0x564adaf68f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.412+0000 7f7a250a1740 1 -- 172.21.15.63:0/1373122841 >> 172.21.15.63:0/1373122841 conn(0x564adabb7350 msgr2=0x564adaf66df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.412+0000 7f7a250a1740 1 -- 172.21.15.63:0/1373122841 shutdown_connections 2024-09-21T06:27:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.412+0000 7f7a250a1740 1 -- 172.21.15.63:0/1373122841 wait complete. 2024-09-21T06:27:41.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.412+0000 7f7a250a1740 1 -- start start 2024-09-21T06:27:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.413+0000 7f7a250a1740 1 Processor -- start 2024-09-21T06:27:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.413+0000 7f7a250a1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adab9a0a0 0x564adaf72c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.413+0000 7f7a250a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564adaba2280 0x564adaf73230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.413+0000 7f7a250a1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adabc2f60 0x564adaf891a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.413+0000 7f7a250a1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564adad315f0 con 0x564adabc2f60 2024-09-21T06:27:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.413+0000 7f7a250a1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564adae6b010 con 0x564adab9a0a0 2024-09-21T06:27:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.413+0000 7f7a250a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564adaf69d00 con 0x564adaba2280 2024-09-21T06:27:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.413+0000 7f7a250a1740 10 client.0 _ll_register_callbacks cb 0x564adaeca340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.413+0000 7f7a1d0ca640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adabc2f60 0x564adaf891a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.413+0000 7f7a1d0ca640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adabc2f60 0x564adaf891a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36930/0 (socket says 172.21.15.63:36930) 2024-09-21T06:27:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.413+0000 7f7a1d0ca640 1 -- 172.21.15.63:0/377857778 learned_addr learned my addr 172.21.15.63:0/377857778 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.413+0000 7f7a1c8c9640 1 --2- 172.21.15.63:0/377857778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adab9a0a0 0x564adaf72c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.413+0000 7f7a17fff640 1 --2- 172.21.15.63:0/377857778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564adaba2280 0x564adaf73230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.413+0000 7f7a1d0ca640 1 -- 172.21.15.63:0/377857778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564adaba2280 msgr2=0x564adaf73230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.414+0000 7f7a1d0ca640 1 --2- 172.21.15.63:0/377857778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564adaba2280 0x564adaf73230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.414+0000 7f7a1d0ca640 1 -- 172.21.15.63:0/377857778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adab9a0a0 msgr2=0x564adaf72c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.414+0000 7f7a1d0ca640 1 --2- 172.21.15.63:0/377857778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adab9a0a0 0x564adaf72c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.414+0000 7f7a1d0ca640 1 -- 172.21.15.63:0/377857778 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564adae98a00 con 0x564adabc2f60 2024-09-21T06:27:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.414+0000 7f7a1d0ca640 1 --2- 172.21.15.63:0/377857778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adabc2f60 0x564adaf891a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009860 tx=0x7f7a1002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabcb6d0ec1d8e55 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.414+0000 7f79f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:27:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.414+0000 7f79f7fff640 1 -- 172.21.15.63:0/377857778 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a10003d00 con 0x564adabc2f60 2024-09-21T06:27:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.414+0000 7f79f7fff640 1 -- 172.21.15.63:0/377857778 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f7a10004040 con 0x564adabc2f60 2024-09-21T06:27:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.414+0000 7f7a250a1740 1 -- 172.21.15.63:0/377857778 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564adaee2b60 con 0x564adabc2f60 2024-09-21T06:27:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.414+0000 7f79f7fff640 1 -- 172.21.15.63:0/377857778 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7a10004240 con 0x564adabc2f60 2024-09-21T06:27:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.414+0000 7f7a250a1740 10 client.15249 fetch_fsmap learned FSMap version 28 2024-09-21T06:27:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.414+0000 7f7a250a1740 1 -- 172.21.15.63:0/377857778 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564adaf8bd50 con 0x564adabc2f60 2024-09-21T06:27:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.414+0000 7f79f7fff640 1 -- 172.21.15.63:0/377857778 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564adaee2b60 con 0x564adabc2f60 2024-09-21T06:27:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.414+0000 7f79f7fff640 1 -- 172.21.15.63:0/377857778 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7a10051070 con 0x564adabc2f60 2024-09-21T06:27:41.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.415+0000 7f7a250a1740 10 client.15249 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:27:41.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.415+0000 7f7a250a1740 10 client.15249 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:27:41.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.415+0000 7f7a250a1740 20 client.15249 populate_metadata read hostname 'smithi063' 2024-09-21T06:27:41.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.415+0000 7f7a250a1740 1 --2- 172.21.15.63:0/377857778 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564adab818e0 0x564adaf8f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.415+0000 7f7a250a1740 4 client.15249 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:27:41.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.415+0000 7f7a250a1740 1 -- 172.21.15.63:0/377857778 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564adaede610 con 0x564adab818e0 2024-09-21T06:27:41.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.415+0000 7f7a1c8c9640 1 --2- 172.21.15.63:0/377857778 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564adab818e0 0x564adaf8f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.415+0000 7f79f7fff640 10 client.15249 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:27:41.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.415+0000 7f7a1c8c9640 1 --2- 172.21.15.63:0/377857778 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564adab818e0 0x564adaf8f870 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1f9297eba41e1042 server_cookie=65a33057e2ea704a in_seq=0 out_seq=0 2024-09-21T06:27:41.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.416+0000 7f79f7fff640 1 -- 172.21.15.63:0/377857778 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564adaede610 con 0x564adab818e0 2024-09-21T06:27:41.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.416+0000 7f79f7fff640 10 client.15249 handle_command_reply: tid=0 2024-09-21T06:27:41.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.416+0000 7f7a250a1740 1 client.15249 shutdown 2024-09-21T06:27:41.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.417+0000 7f7a250a1740 1 -- 172.21.15.63:0/377857778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adabc2f60 msgr2=0x564adaf891a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:41.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.417+0000 7f7a250a1740 1 --2- 172.21.15.63:0/377857778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adabc2f60 0x564adaf891a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009860 tx=0x7f7a1002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.417+0000 7f7a250a1740 1 -- 172.21.15.63:0/377857778 shutdown_connections 2024-09-21T06:27:41.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.417+0000 7f7a250a1740 1 --2- 172.21.15.63:0/377857778 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564adab818e0 0x564adaf8f870 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.417+0000 7f7a250a1740 1 --2- 172.21.15.63:0/377857778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adabc2f60 0x564adaf891a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.417+0000 7f7a250a1740 1 --2- 172.21.15.63:0/377857778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564adaba2280 0x564adaf73230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.417+0000 7f7a250a1740 1 --2- 172.21.15.63:0/377857778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adab9a0a0 0x564adaf72c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.417+0000 7f7a250a1740 1 -- 172.21.15.63:0/377857778 >> 172.21.15.63:0/377857778 conn(0x564adabb7350 msgr2=0x564adaf6a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:41.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.417+0000 7f79f7fff640 0 client.15249 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:27:41.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.417+0000 7f7a250a1740 1 -- 172.21.15.63:0/377857778 shutdown_connections 2024-09-21T06:27:41.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.417+0000 7f7a250a1740 1 -- 172.21.15.63:0/377857778 wait complete. 2024-09-21T06:27:41.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.417+0000 7f7a250a1740 20 client.15249 trim_cache size 0 max 16384 2024-09-21T06:27:41.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.435+0000 7f7a250a1740 1 Processor -- start 2024-09-21T06:27:41.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.435+0000 7f7a250a1740 1 -- start start 2024-09-21T06:27:41.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.435+0000 7f7a250a1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adab9a0a0 0x564adaf68d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.435+0000 7f7a250a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564adaba2280 0x564adaf69290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.435+0000 7f7a250a1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adabc2f60 0x564adaf89150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.435+0000 7f7a250a1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564adaf8dbb0 con 0x564adabc2f60 2024-09-21T06:27:41.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.435+0000 7f7a250a1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564adaf8e280 con 0x564adab9a0a0 2024-09-21T06:27:41.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.435+0000 7f7a250a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564adaf8e950 con 0x564adaba2280 2024-09-21T06:27:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.436+0000 7f7a1d0ca640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adabc2f60 0x564adaf89150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.436+0000 7f7a1d0ca640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adabc2f60 0x564adaf89150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36942/0 (socket says 172.21.15.63:36942) 2024-09-21T06:27:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.436+0000 7f7a1d0ca640 1 -- 172.21.15.63:0/3341393098 learned_addr learned my addr 172.21.15.63:0/3341393098 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.436+0000 7f7a1c8c9640 1 --2- 172.21.15.63:0/3341393098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adab9a0a0 0x564adaf68d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.436+0000 7f7a17fff640 1 --2- 172.21.15.63:0/3341393098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564adaba2280 0x564adaf69290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.436+0000 7f7a1d0ca640 1 -- 172.21.15.63:0/3341393098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564adaba2280 msgr2=0x564adaf69290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.436+0000 7f7a1d0ca640 1 --2- 172.21.15.63:0/3341393098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564adaba2280 0x564adaf69290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.436+0000 7f7a1d0ca640 1 -- 172.21.15.63:0/3341393098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adab9a0a0 msgr2=0x564adaf68d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.436+0000 7f7a1d0ca640 1 --2- 172.21.15.63:0/3341393098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adab9a0a0 0x564adaf68d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.436+0000 7f7a1d0ca640 1 -- 172.21.15.63:0/3341393098 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564adaf6bcb0 con 0x564adabc2f60 2024-09-21T06:27:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.436+0000 7f7a1d0ca640 1 --2- 172.21.15.63:0/3341393098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adabc2f60 0x564adaf89150 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7a10005e20 tx=0x7f7a10005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498e5aa19b88293b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.436+0000 7f7a027fc640 1 -- 172.21.15.63:0/3341393098 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a10060070 con 0x564adabc2f60 2024-09-21T06:27:41.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.436+0000 7f7a027fc640 1 -- 172.21.15.63:0/3341393098 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a10036050 con 0x564adabc2f60 2024-09-21T06:27:41.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.436+0000 7f7a027fc640 1 -- 172.21.15.63:0/3341393098 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a1002f8c0 con 0x564adabc2f60 2024-09-21T06:27:41.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.437+0000 7f7a250a1740 1 -- 172.21.15.63:0/3341393098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adabc2f60 msgr2=0x564adaf89150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:41.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.437+0000 7f7a250a1740 1 --2- 172.21.15.63:0/3341393098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adabc2f60 0x564adaf89150 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7a10005e20 tx=0x7f7a10005c80 comp rx=0 tx=0).stop 2024-09-21T06:27:41.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.437+0000 7f7a250a1740 1 -- 172.21.15.63:0/3341393098 shutdown_connections 2024-09-21T06:27:41.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.437+0000 7f7a250a1740 1 --2- 172.21.15.63:0/3341393098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adabc2f60 0x564adaf89150 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.437+0000 7f7a250a1740 1 --2- 172.21.15.63:0/3341393098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564adaba2280 0x564adaf69290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.437+0000 7f7a250a1740 1 --2- 172.21.15.63:0/3341393098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adab9a0a0 0x564adaf68d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.437+0000 7f7a250a1740 1 -- 172.21.15.63:0/3341393098 >> 172.21.15.63:0/3341393098 conn(0x564adabb7350 msgr2=0x564adaf61ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:41.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.437+0000 7f7a250a1740 1 -- 172.21.15.63:0/3341393098 shutdown_connections 2024-09-21T06:27:41.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.437+0000 7f7a250a1740 1 -- 172.21.15.63:0/3341393098 wait complete. 2024-09-21T06:27:41.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.437+0000 7f7a250a1740 1 -- start start 2024-09-21T06:27:41.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.438+0000 7f7a250a1740 1 Processor -- start 2024-09-21T06:27:41.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.438+0000 7f7a250a1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adab9a0a0 0x564adaf98090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.438+0000 7f7a250a1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adaba2280 0x564adaf660c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.438+0000 7f7a250a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564adabc2f60 0x564adaf66600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.438+0000 7f7a250a1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564adaf8f6f0 con 0x564adab9a0a0 2024-09-21T06:27:41.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.438+0000 7f7a250a1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564adaf8f020 con 0x564adaba2280 2024-09-21T06:27:41.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.438+0000 7f7a250a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564adaf8fdc0 con 0x564adabc2f60 2024-09-21T06:27:41.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.438+0000 7f7a250a1740 10 client.0 _ll_register_callbacks cb 0x7f7a10009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:41.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.438+0000 7f7a1c8c9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adab9a0a0 0x564adaf98090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.438+0000 7f7a1c8c9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adab9a0a0 0x564adaf98090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36958/0 (socket says 172.21.15.63:36958) 2024-09-21T06:27:41.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.438+0000 7f7a1c8c9640 1 -- 172.21.15.63:0/654692784 learned_addr learned my addr 172.21.15.63:0/654692784 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:41.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.438+0000 7f7a1d0ca640 1 --2- 172.21.15.63:0/654692784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564adabc2f60 0x564adaf66600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.438+0000 7f7a17fff640 1 --2- 172.21.15.63:0/654692784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adaba2280 0x564adaf660c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.439+0000 7f7a1c8c9640 1 -- 172.21.15.63:0/654692784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564adabc2f60 msgr2=0x564adaf66600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:41.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.439+0000 7f7a1c8c9640 1 --2- 172.21.15.63:0/654692784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564adabc2f60 0x564adaf66600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.439+0000 7f7a1c8c9640 1 -- 172.21.15.63:0/654692784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adaba2280 msgr2=0x564adaf660c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:41.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.439+0000 7f7a1c8c9640 1 --2- 172.21.15.63:0/654692784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adaba2280 0x564adaf660c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.439+0000 7f7a1c8c9640 1 -- 172.21.15.63:0/654692784 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564adaf66b40 con 0x564adab9a0a0 2024-09-21T06:27:41.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.439+0000 7f7a1c8c9640 1 --2- 172.21.15.63:0/654692784 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adab9a0a0 0x564adaf98090 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c00bc70 tx=0x7f7a0c005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9fc223ba86a19d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:41.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.439+0000 7f79f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:27:41.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.439+0000 7f79f7fff640 1 -- 172.21.15.63:0/654692784 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c004020 con 0x564adab9a0a0 2024-09-21T06:27:41.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.439+0000 7f79f7fff640 1 -- 172.21.15.63:0/654692784 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f7a0c0041c0 con 0x564adab9a0a0 2024-09-21T06:27:41.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.439+0000 7f7a250a1740 1 -- 172.21.15.63:0/654692784 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a10036050 con 0x564adab9a0a0 2024-09-21T06:27:41.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.439+0000 7f79f7fff640 1 -- 172.21.15.63:0/654692784 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7a0c0043c0 con 0x564adab9a0a0 2024-09-21T06:27:41.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.439+0000 7f7a250a1740 10 client.15255 fetch_fsmap learned FSMap version 28 2024-09-21T06:27:41.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.439+0000 7f7a250a1740 1 -- 172.21.15.63:0/654692784 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564adaffad40 con 0x564adab9a0a0 2024-09-21T06:27:41.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.439+0000 7f79f7fff640 1 -- 172.21.15.63:0/654692784 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a10036050 con 0x564adab9a0a0 2024-09-21T06:27:41.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.440+0000 7f79f7fff640 1 -- 172.21.15.63:0/654692784 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7a0c011870 con 0x564adab9a0a0 2024-09-21T06:27:41.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.440+0000 7f7a250a1740 10 client.15255 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:27:41.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.440+0000 7f7a250a1740 10 client.15255 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:27:41.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.440+0000 7f7a250a1740 20 client.15255 populate_metadata read hostname 'smithi063' 2024-09-21T06:27:41.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.440+0000 7f7a250a1740 1 --2- 172.21.15.63:0/654692784 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564adab56c90 0x564adaffe300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.440+0000 7f7a250a1740 4 client.15255 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:27:41.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.440+0000 7f7a250a1740 1 -- 172.21.15.63:0/654692784 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "status"}) -- 0x564adaedba40 con 0x564adab56c90 2024-09-21T06:27:41.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.440+0000 7f7a17fff640 1 --2- 172.21.15.63:0/654692784 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564adab56c90 0x564adaffe300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.441+0000 7f7a17fff640 1 --2- 172.21.15.63:0/654692784 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564adab56c90 0x564adaffe300 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c673990d84bf8274 server_cookie=28f2b11b86c8f1c0 in_seq=0 out_seq=0 2024-09-21T06:27:41.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.441+0000 7f79f7fff640 10 client.15255 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:27:41.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.441+0000 7f79f7fff640 1 -- 172.21.15.63:0/654692784 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x564adaedba40 con 0x564adab56c90 2024-09-21T06:27:41.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.441+0000 7f79f7fff640 10 client.15255 handle_command_reply: tid=0 2024-09-21T06:27:41.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.441+0000 7f7a250a1740 1 client.15255 shutdown 2024-09-21T06:27:41.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.441+0000 7f7a250a1740 1 -- 172.21.15.63:0/654692784 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adab9a0a0 msgr2=0x564adaf98090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:41.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.441+0000 7f7a250a1740 1 --2- 172.21.15.63:0/654692784 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adab9a0a0 0x564adaf98090 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c00bc70 tx=0x7f7a0c005040 comp rx=0 tx=0).stop 2024-09-21T06:27:41.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.441+0000 7f7a250a1740 1 -- 172.21.15.63:0/654692784 shutdown_connections 2024-09-21T06:27:41.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.441+0000 7f7a250a1740 1 --2- 172.21.15.63:0/654692784 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564adab56c90 0x564adaffe300 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.441+0000 7f79f7fff640 0 client.15255 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:27:41.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.441+0000 7f7a250a1740 1 --2- 172.21.15.63:0/654692784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564adabc2f60 0x564adaf66600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.441+0000 7f7a250a1740 1 --2- 172.21.15.63:0/654692784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564adaba2280 0x564adaf660c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.441+0000 7f7a250a1740 1 --2- 172.21.15.63:0/654692784 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564adab9a0a0 0x564adaf98090 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.441+0000 7f7a250a1740 1 -- 172.21.15.63:0/654692784 >> 172.21.15.63:0/654692784 conn(0x564adabb7350 msgr2=0x564adaf61ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:41.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.441+0000 7f7a250a1740 1 -- 172.21.15.63:0/654692784 shutdown_connections 2024-09-21T06:27:41.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.441+0000 7f7a250a1740 1 -- 172.21.15.63:0/654692784 wait complete. 2024-09-21T06:27:41.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.441+0000 7f7a250a1740 20 client.15255 trim_cache size 0 max 16384 2024-09-21T06:27:41.448 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:27:41.448 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "140899c8-77e1-11ef-baf5-efdc52797490", 2024-09-21T06:27:41.448 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 1, 2024-09-21T06:27:41.448 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 24694, 2024-09-21T06:27:41.449 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-21T06:27:41.449 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-21T06:27:41.449 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-21T06:27:41.449 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 75.117833004999994, 2024-09-21T06:27:41.449 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 28, 2024-09-21T06:27:41.449 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 77, 2024-09-21T06:27:41.449 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:27:41.449 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 100.693445661 2024-09-21T06:27:41.449 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:27:41.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.442+0000 7f7a1eb2d640 1 -- 172.21.15.63:0/3150176387 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7a080b65f0 msgr2=0x7f7a080b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:41.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.442+0000 7f7a1eb2d640 1 --2- 172.21.15.63:0/3150176387 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7a080b65f0 0x7f7a080b8b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7a10006010 tx=0x7f7a10009480 comp rx=0 tx=0).stop 2024-09-21T06:27:41.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.442+0000 7f7a1eb2d640 1 -- 172.21.15.63:0/3150176387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a181083c0 msgr2=0x7f7a181998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:41.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.442+0000 7f7a1eb2d640 1 --2- 172.21.15.63:0/3150176387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a181083c0 0x7f7a181998d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7a0400d770 tx=0x7f7a0400dc30 comp rx=0 tx=0).stop 2024-09-21T06:27:41.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.442+0000 7f7a1eb2d640 1 -- 172.21.15.63:0/3150176387 shutdown_connections 2024-09-21T06:27:41.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.442+0000 7f7a1eb2d640 1 --2- 172.21.15.63:0/3150176387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a18108d10 0x7f7a1819eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.442+0000 7f7a1eb2d640 1 --2- 172.21.15.63:0/3150176387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a181083c0 0x7f7a181998d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.442+0000 7f7a1eb2d640 1 --2- 172.21.15.63:0/3150176387 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7a080b65f0 0x7f7a080b8b00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.442+0000 7f7a1eb2d640 1 --2- 172.21.15.63:0/3150176387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a18102a80 0x7f7a18199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.442+0000 7f7a1eb2d640 1 -- 172.21.15.63:0/3150176387 >> 172.21.15.63:0/3150176387 conn(0x7f7a18079740 msgr2=0x7f7a181043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:41.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.442+0000 7f7a1eb2d640 1 -- 172.21.15.63:0/3150176387 shutdown_connections 2024-09-21T06:27:41.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:41.442+0000 7f7a1eb2d640 1 -- 172.21.15.63:0/3150176387 wait complete. 2024-09-21T06:27:42.242 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T06:27:42.501 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:42.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.949+0000 7f9d18b18640 1 -- 172.21.15.63:0/3394811385 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1410de90 msgr2=0x7f9d14110380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:42.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.949+0000 7f9d18b18640 1 --2- 172.21.15.63:0/3394811385 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1410de90 0x7f9d14110380 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009ca0 tx=0x7f9d0c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.949+0000 7f9d18b18640 1 -- 172.21.15.63:0/3394811385 shutdown_connections 2024-09-21T06:27:42.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.949+0000 7f9d18b18640 1 --2- 172.21.15.63:0/3394811385 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1410de90 0x7f9d14110380 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.949+0000 7f9d18b18640 1 --2- 172.21.15.63:0/3394811385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d14105380 0x7f9d1410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.949+0000 7f9d18b18640 1 --2- 172.21.15.63:0/3394811385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d14104a30 0x7f9d14104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.949+0000 7f9d18b18640 1 -- 172.21.15.63:0/3394811385 >> 172.21.15.63:0/3394811385 conn(0x7f9d14079770 msgr2=0x7f9d14079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:42.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.949+0000 7f9d18b18640 1 -- 172.21.15.63:0/3394811385 shutdown_connections 2024-09-21T06:27:42.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.949+0000 7f9d18b18640 1 -- 172.21.15.63:0/3394811385 wait complete. 2024-09-21T06:27:42.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.950+0000 7f9d18b18640 1 Processor -- start 2024-09-21T06:27:42.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.950+0000 7f9d18b18640 1 -- start start 2024-09-21T06:27:42.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.950+0000 7f9d18b18640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d14104a30 0x7f9d14104180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.950+0000 7f9d18b18640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d14105380 0x7f9d14102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.950+0000 7f9d18b18640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1410de90 0x7f9d14102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.950+0000 7f9d18b18640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9d14113b40 con 0x7f9d1410de90 2024-09-21T06:27:42.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.950+0000 7f9d18b18640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9d141139c0 con 0x7f9d14104a30 2024-09-21T06:27:42.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.950+0000 7f9d18b18640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9d14113cc0 con 0x7f9d14105380 2024-09-21T06:27:42.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.951+0000 7f9d12d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1410de90 0x7f9d14102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.951+0000 7f9d12d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1410de90 0x7f9d14102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36982/0 (socket says 172.21.15.63:36982) 2024-09-21T06:27:42.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.951+0000 7f9d12d9d640 1 -- 172.21.15.63:0/2715722504 learned_addr learned my addr 172.21.15.63:0/2715722504 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.951+0000 7f9d11d9b640 1 --2- 172.21.15.63:0/2715722504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d14105380 0x7f9d14102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.951+0000 7f9d1259c640 1 --2- 172.21.15.63:0/2715722504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d14104a30 0x7f9d14104180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.951+0000 7f9d12d9d640 1 -- 172.21.15.63:0/2715722504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d14105380 msgr2=0x7f9d14102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.951+0000 7f9d12d9d640 1 --2- 172.21.15.63:0/2715722504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d14105380 0x7f9d14102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.951+0000 7f9d12d9d640 1 -- 172.21.15.63:0/2715722504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d14104a30 msgr2=0x7f9d14104180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.951+0000 7f9d12d9d640 1 --2- 172.21.15.63:0/2715722504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d14104a30 0x7f9d14104180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.951+0000 7f9d12d9d640 1 -- 172.21.15.63:0/2715722504 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d141034d0 con 0x7f9d1410de90 2024-09-21T06:27:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.951+0000 7f9d12d9d640 1 --2- 172.21.15.63:0/2715722504 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1410de90 0x7f9d14102cb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009430 tx=0x7f9d0c0317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.951+0000 7f9d037fe640 1 -- 172.21.15.63:0/2715722504 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c003b70 con 0x7f9d1410de90 2024-09-21T06:27:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.951+0000 7f9d037fe640 1 -- 172.21.15.63:0/2715722504 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d0c003d10 con 0x7f9d1410de90 2024-09-21T06:27:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.952+0000 7f9d037fe640 1 -- 172.21.15.63:0/2715722504 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c02fa30 con 0x7f9d1410de90 2024-09-21T06:27:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.952+0000 7f9d18b18640 1 -- 172.21.15.63:0/2715722504 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d141aceb0 con 0x7f9d1410de90 2024-09-21T06:27:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.952+0000 7f9d18b18640 1 -- 172.21.15.63:0/2715722504 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d141ad3b0 con 0x7f9d1410de90 2024-09-21T06:27:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.954+0000 7f9d037fe640 1 -- 172.21.15.63:0/2715722504 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f9d0c02fbd0 con 0x7f9d1410de90 2024-09-21T06:27:42.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.954+0000 7f9d1f08c740 1 Processor -- start 2024-09-21T06:27:42.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.955+0000 7f9d1f08c740 1 -- start start 2024-09-21T06:27:42.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.955+0000 7f9d1f08c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f56f60 0x55ef762fcf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.955+0000 7f9d1f08c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef75f2e0a0 0x55ef762fd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.955+0000 7f9d1f08c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef75f36280 0x55ef762fd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.955+0000 7f9d1f08c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ef76274c10 con 0x55ef75f56f60 2024-09-21T06:27:42.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.955+0000 7f9d1f08c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ef76264040 con 0x55ef75f2e0a0 2024-09-21T06:27:42.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.955+0000 7f9d1f08c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ef76267e50 con 0x55ef75f36280 2024-09-21T06:27:42.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.955+0000 7f9d11d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f56f60 0x55ef762fcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.955+0000 7f9d11d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f56f60 0x55ef762fcf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36990/0 (socket says 172.21.15.63:36990) 2024-09-21T06:27:42.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.955+0000 7f9d11d9b640 1 -- 172.21.15.63:0/902252300 learned_addr learned my addr 172.21.15.63:0/902252300 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:42.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.955+0000 7f9d1259c640 1 --2- 172.21.15.63:0/902252300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef75f2e0a0 0x55ef762fd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.955+0000 7f9d11d9b640 1 --2- 172.21.15.63:0/902252300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef75f36280 0x55ef762fd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.956+0000 7f9d037fe640 1 --2- 172.21.15.63:0/2715722504 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9cfc0b6670 0x7f9cfc0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.956+0000 7f9d11d9b640 1 -- 172.21.15.63:0/902252300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef75f36280 msgr2=0x55ef762fd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:42.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.956+0000 7f9d11d9b640 1 --2- 172.21.15.63:0/902252300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef75f36280 0x55ef762fd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.956+0000 7f9d11d9b640 1 -- 172.21.15.63:0/902252300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef75f2e0a0 msgr2=0x55ef762fd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:42.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.956+0000 7f9d11d9b640 1 --2- 172.21.15.63:0/902252300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef75f2e0a0 0x55ef762fd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.956+0000 7f9d11d9b640 1 -- 172.21.15.63:0/902252300 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef75fc2540 con 0x55ef75f56f60 2024-09-21T06:27:42.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.956+0000 7f9d1259c640 1 --2- 172.21.15.63:0/902252300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef75f2e0a0 0x55ef762fd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:27:42.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.956+0000 7f9d12d9d640 1 --2- 172.21.15.63:0/2715722504 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9cfc0b6670 0x7f9cfc0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.956+0000 7f9d11d9b640 1 --2- 172.21.15.63:0/902252300 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f56f60 0x55ef762fcf00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9d08005b90 tx=0x7f9d0800b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5163dc012073755f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:42.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.956+0000 7f9d037fe640 1 -- 172.21.15.63:0/2715722504 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f9d0c1087b0 con 0x7f9d1410de90 2024-09-21T06:27:42.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.956+0000 7f9d00ff9640 1 -- 172.21.15.63:0/902252300 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d080120d0 con 0x55ef75f56f60 2024-09-21T06:27:42.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.956+0000 7f9d00ff9640 1 -- 172.21.15.63:0/902252300 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d08005020 con 0x55ef75f56f60 2024-09-21T06:27:42.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.956+0000 7f9d00ff9640 1 -- 172.21.15.63:0/902252300 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d080044e0 con 0x55ef75f56f60 2024-09-21T06:27:42.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.957+0000 7f9d1f08c740 1 -- 172.21.15.63:0/902252300 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f56f60 msgr2=0x55ef762fcf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:42.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.957+0000 7f9d12d9d640 1 --2- 172.21.15.63:0/2715722504 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9cfc0b6670 0x7f9cfc0b8b80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c0b1c10 tx=0x7f9d0c0cad70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:42.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.957+0000 7f9d1f08c740 1 --2- 172.21.15.63:0/902252300 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f56f60 0x55ef762fcf00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9d08005b90 tx=0x7f9d0800b740 comp rx=0 tx=0).stop 2024-09-21T06:27:42.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.957+0000 7f9d1f08c740 1 -- 172.21.15.63:0/902252300 shutdown_connections 2024-09-21T06:27:42.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.957+0000 7f9d1f08c740 1 --2- 172.21.15.63:0/902252300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef75f36280 0x55ef762fd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.957+0000 7f9d1f08c740 1 --2- 172.21.15.63:0/902252300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef75f2e0a0 0x55ef762fd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.957+0000 7f9d1f08c740 1 --2- 172.21.15.63:0/902252300 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f56f60 0x55ef762fcf00 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.957+0000 7f9d1f08c740 1 -- 172.21.15.63:0/902252300 >> 172.21.15.63:0/902252300 conn(0x55ef75f4b350 msgr2=0x55ef762fadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:42.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.957+0000 7f9d1f08c740 1 -- 172.21.15.63:0/902252300 shutdown_connections 2024-09-21T06:27:42.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.957+0000 7f9d1f08c740 1 -- 172.21.15.63:0/902252300 wait complete. 2024-09-21T06:27:42.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.957+0000 7f9d1f08c740 1 -- start start 2024-09-21T06:27:42.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.958+0000 7f9d1f08c740 1 Processor -- start 2024-09-21T06:27:42.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.958+0000 7f9d1f08c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef75f2e0a0 0x55ef76308ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.958+0000 7f9d1f08c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f36280 0x55ef76309010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.958+0000 7f9d1f08c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef75f56f60 0x55ef763149d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.958+0000 7f9d1f08c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ef760c55f0 con 0x55ef75f36280 2024-09-21T06:27:42.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.958+0000 7f9d1f08c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ef761ff010 con 0x55ef75f2e0a0 2024-09-21T06:27:42.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.958+0000 7f9d1f08c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ef7630b6e0 con 0x55ef75f56f60 2024-09-21T06:27:42.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.958+0000 7f9d1f08c740 10 client.0 _ll_register_callbacks cb 0x55ef7625e340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:42.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.958+0000 7f9d1259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f36280 0x55ef76309010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.958+0000 7f9d1259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f36280 0x55ef76309010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36992/0 (socket says 172.21.15.63:36992) 2024-09-21T06:27:42.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.958+0000 7f9d1259c640 1 -- 172.21.15.63:0/567440921 learned_addr learned my addr 172.21.15.63:0/567440921 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:42.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.958+0000 7f9d11d9b640 1 --2- 172.21.15.63:0/567440921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef75f2e0a0 0x55ef76308ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.958+0000 7f9d11d9b640 1 --2- 172.21.15.63:0/567440921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef75f56f60 0x55ef763149d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.958+0000 7f9d1259c640 1 -- 172.21.15.63:0/567440921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef75f56f60 msgr2=0x55ef763149d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:42.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.958+0000 7f9d1259c640 1 --2- 172.21.15.63:0/567440921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef75f56f60 0x55ef763149d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.958+0000 7f9d1259c640 1 -- 172.21.15.63:0/567440921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef75f2e0a0 msgr2=0x55ef76308ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:42.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.958+0000 7f9d1259c640 1 --2- 172.21.15.63:0/567440921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef75f2e0a0 0x55ef76308ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.958+0000 7f9d1259c640 1 -- 172.21.15.63:0/567440921 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef7622ca00 con 0x55ef75f36280 2024-09-21T06:27:42.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.959+0000 7f9d1259c640 1 --2- 172.21.15.63:0/567440921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f36280 0x55ef76309010 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9d04012720 tx=0x7f9d04012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398066fb53d1357b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:42.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.959+0000 7f9cf9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:27:42.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.959+0000 7f9cf9ffb640 1 -- 172.21.15.63:0/567440921 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04004030 con 0x55ef75f36280 2024-09-21T06:27:42.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.959+0000 7f9cf9ffb640 1 -- 172.21.15.63:0/567440921 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f9d040041d0 con 0x55ef75f36280 2024-09-21T06:27:42.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.959+0000 7f9d1f08c740 1 -- 172.21.15.63:0/567440921 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d08005020 con 0x55ef75f36280 2024-09-21T06:27:42.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.959+0000 7f9cf9ffb640 1 -- 172.21.15.63:0/567440921 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9d04004410 con 0x55ef75f36280 2024-09-21T06:27:42.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.959+0000 7f9d1f08c740 10 client.15267 fetch_fsmap learned FSMap version 28 2024-09-21T06:27:42.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.959+0000 7f9d1f08c740 1 -- 172.21.15.63:0/567440921 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ef76317700 con 0x55ef75f36280 2024-09-21T06:27:42.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.959+0000 7f9cf9ffb640 1 -- 172.21.15.63:0/567440921 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d08005020 con 0x55ef75f36280 2024-09-21T06:27:42.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.959+0000 7f9cf9ffb640 1 -- 172.21.15.63:0/567440921 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9d04003b90 con 0x55ef75f36280 2024-09-21T06:27:42.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.959+0000 7f9d1f08c740 10 client.15267 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:27:42.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.959+0000 7f9d1f08c740 10 client.15267 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:27:42.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.959+0000 7f9d1f08c740 20 client.15267 populate_metadata read hostname 'smithi063' 2024-09-21T06:27:42.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.959+0000 7f9d1f08c740 1 --2- 172.21.15.63:0/567440921 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55ef75f158e0 0x55ef7631b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.959+0000 7f9d1f08c740 4 client.15267 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:27:42.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.959+0000 7f9d1f08c740 1 -- 172.21.15.63:0/567440921 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef76276b60 con 0x55ef75f158e0 2024-09-21T06:27:42.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.960+0000 7f9d11d9b640 1 --2- 172.21.15.63:0/567440921 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55ef75f158e0 0x55ef7631b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.960+0000 7f9cf9ffb640 10 client.15267 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:27:42.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.960+0000 7f9d11d9b640 1 --2- 172.21.15.63:0/567440921 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55ef75f158e0 0x55ef7631b150 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b91c3234efda6d63 server_cookie=51d0758f526bc480 in_seq=0 out_seq=0 2024-09-21T06:27:42.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.961+0000 7f9cf9ffb640 1 -- 172.21.15.63:0/567440921 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ef76276b60 con 0x55ef75f158e0 2024-09-21T06:27:42.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.961+0000 7f9cf9ffb640 10 client.15267 handle_command_reply: tid=0 2024-09-21T06:27:42.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.961+0000 7f9d1f08c740 1 client.15267 shutdown 2024-09-21T06:27:42.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.961+0000 7f9d1f08c740 1 -- 172.21.15.63:0/567440921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f36280 msgr2=0x55ef76309010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:42.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.961+0000 7f9d1f08c740 1 --2- 172.21.15.63:0/567440921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f36280 0x55ef76309010 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9d04012720 tx=0x7f9d04012be0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.961+0000 7f9d1f08c740 1 -- 172.21.15.63:0/567440921 shutdown_connections 2024-09-21T06:27:42.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.961+0000 7f9d1f08c740 1 --2- 172.21.15.63:0/567440921 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55ef75f158e0 0x55ef7631b150 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.961+0000 7f9d1f08c740 1 --2- 172.21.15.63:0/567440921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef75f56f60 0x55ef763149d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.961+0000 7f9d1f08c740 1 --2- 172.21.15.63:0/567440921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f36280 0x55ef76309010 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.961+0000 7f9d1f08c740 1 --2- 172.21.15.63:0/567440921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef75f2e0a0 0x55ef76308ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.961+0000 7f9cf9ffb640 0 client.15267 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:27:42.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.961+0000 7f9d1f08c740 1 -- 172.21.15.63:0/567440921 >> 172.21.15.63:0/567440921 conn(0x55ef75f4b350 msgr2=0x55ef763000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:42.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.961+0000 7f9d1f08c740 1 -- 172.21.15.63:0/567440921 shutdown_connections 2024-09-21T06:27:42.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.961+0000 7f9d1f08c740 1 -- 172.21.15.63:0/567440921 wait complete. 2024-09-21T06:27:42.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.961+0000 7f9d1f08c740 20 client.15267 trim_cache size 0 max 16384 2024-09-21T06:27:42.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.980+0000 7f9d1f08c740 1 Processor -- start 2024-09-21T06:27:42.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.980+0000 7f9d1f08c740 1 -- start start 2024-09-21T06:27:42.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.981+0000 7f9d1f08c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef75f158e0 0x55ef762fa750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.981+0000 7f9d1f08c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef75f2e0a0 0x55ef762fac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.981+0000 7f9d1f08c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f36280 0x55ef76302180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.981+0000 7f9d1f08c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ef76319490 con 0x55ef75f36280 2024-09-21T06:27:42.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.981+0000 7f9d1f08c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ef76319b60 con 0x55ef75f2e0a0 2024-09-21T06:27:42.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.981+0000 7f9d1f08c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ef7631a230 con 0x55ef75f158e0 2024-09-21T06:27:42.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.981+0000 7f9d11d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f36280 0x55ef76302180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.981+0000 7f9d11d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f36280 0x55ef76302180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37000/0 (socket says 172.21.15.63:37000) 2024-09-21T06:27:42.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.981+0000 7f9d11d9b640 1 -- 172.21.15.63:0/870202179 learned_addr learned my addr 172.21.15.63:0/870202179 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:42.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.981+0000 7f9d11d9b640 1 --2- 172.21.15.63:0/870202179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef75f158e0 0x55ef762fa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.981+0000 7f9d1259c640 1 --2- 172.21.15.63:0/870202179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef75f2e0a0 0x55ef762fac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.981+0000 7f9d11d9b640 1 -- 172.21.15.63:0/870202179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef75f158e0 msgr2=0x55ef762fa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:42.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.981+0000 7f9d11d9b640 1 --2- 172.21.15.63:0/870202179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef75f158e0 0x55ef762fa750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.981+0000 7f9d11d9b640 1 -- 172.21.15.63:0/870202179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef75f2e0a0 msgr2=0x55ef762fac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:42.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.981+0000 7f9d11d9b640 1 --2- 172.21.15.63:0/870202179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef75f2e0a0 0x55ef762fac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.981+0000 7f9d11d9b640 1 -- 172.21.15.63:0/870202179 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef762f5080 con 0x55ef75f36280 2024-09-21T06:27:42.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.981+0000 7f9d11d9b640 1 --2- 172.21.15.63:0/870202179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f36280 0x55ef76302180 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9d08018000 tx=0x7f9d0800bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a9db3b10494752 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:42.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.981+0000 7f9cfbfff640 1 -- 172.21.15.63:0/870202179 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08005350 con 0x55ef75f36280 2024-09-21T06:27:42.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.982+0000 7f9cfbfff640 1 -- 172.21.15.63:0/870202179 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d080054f0 con 0x55ef75f36280 2024-09-21T06:27:42.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.982+0000 7f9cfbfff640 1 -- 172.21.15.63:0/870202179 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d080106c0 con 0x55ef75f36280 2024-09-21T06:27:42.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.982+0000 7f9d1f08c740 1 -- 172.21.15.63:0/870202179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f36280 msgr2=0x55ef76302180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:42.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.982+0000 7f9d1f08c740 1 --2- 172.21.15.63:0/870202179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f36280 0x55ef76302180 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9d08018000 tx=0x7f9d0800bc50 comp rx=0 tx=0).stop 2024-09-21T06:27:42.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.982+0000 7f9d1f08c740 1 -- 172.21.15.63:0/870202179 shutdown_connections 2024-09-21T06:27:42.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.982+0000 7f9d1f08c740 1 --2- 172.21.15.63:0/870202179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f36280 0x55ef76302180 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.982+0000 7f9d1f08c740 1 --2- 172.21.15.63:0/870202179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef75f2e0a0 0x55ef762fac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.982+0000 7f9d1f08c740 1 --2- 172.21.15.63:0/870202179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef75f158e0 0x55ef762fa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.982+0000 7f9d1f08c740 1 -- 172.21.15.63:0/870202179 >> 172.21.15.63:0/870202179 conn(0x55ef75f4b350 msgr2=0x55ef762f5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.982+0000 7f9d1f08c740 1 -- 172.21.15.63:0/870202179 shutdown_connections 2024-09-21T06:27:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.983+0000 7f9d1f08c740 1 -- 172.21.15.63:0/870202179 wait complete. 2024-09-21T06:27:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.983+0000 7f9d1f08c740 1 -- start start 2024-09-21T06:27:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.983+0000 7f9d1f08c740 1 Processor -- start 2024-09-21T06:27:42.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.983+0000 7f9d1f08c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f158e0 0x55ef76323800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.983+0000 7f9d1f08c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef75f2e0a0 0x55ef76323de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.983+0000 7f9d1f08c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef75f36280 0x55ef763020f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.983+0000 7f9d1f08c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ef7631afd0 con 0x55ef75f158e0 2024-09-21T06:27:42.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.983+0000 7f9d1f08c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ef7631a900 con 0x55ef75f36280 2024-09-21T06:27:42.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.983+0000 7f9d1f08c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ef7631b6a0 con 0x55ef75f2e0a0 2024-09-21T06:27:42.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.983+0000 7f9d1f08c740 10 client.0 _ll_register_callbacks cb 0x7f9d04009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:42.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.983+0000 7f9d11d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f158e0 0x55ef76323800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.984+0000 7f9d11d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f158e0 0x55ef76323800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37004/0 (socket says 172.21.15.63:37004) 2024-09-21T06:27:42.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.984+0000 7f9d11d9b640 1 -- 172.21.15.63:0/2228373091 learned_addr learned my addr 172.21.15.63:0/2228373091 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:42.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.984+0000 7f9d1259c640 1 --2- 172.21.15.63:0/2228373091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef75f2e0a0 0x55ef76323de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.984+0000 7f9d11d9b640 1 -- 172.21.15.63:0/2228373091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef75f2e0a0 msgr2=0x55ef76323de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:42.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.984+0000 7f9d11d9b640 1 --2- 172.21.15.63:0/2228373091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef75f2e0a0 0x55ef76323de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.984+0000 7f9d11d9b640 1 -- 172.21.15.63:0/2228373091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef75f36280 msgr2=0x55ef763020f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:42.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.984+0000 7f9d11d9b640 1 --2- 172.21.15.63:0/2228373091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef75f36280 0x55ef763020f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.984+0000 7f9d11d9b640 1 -- 172.21.15.63:0/2228373091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef76302880 con 0x55ef75f158e0 2024-09-21T06:27:42.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.984+0000 7f9d11d9b640 1 --2- 172.21.15.63:0/2228373091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f158e0 0x55ef76323800 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9d08006010 tx=0x7f9d080056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65289c6185c4c8b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:42.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.984+0000 7f9cf9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:27:42.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.984+0000 7f9cf9ffb640 1 -- 172.21.15.63:0/2228373091 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08003800 con 0x55ef75f158e0 2024-09-21T06:27:42.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.984+0000 7f9cf9ffb640 1 -- 172.21.15.63:0/2228373091 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f9d080039a0 con 0x55ef75f158e0 2024-09-21T06:27:42.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.984+0000 7f9d1f08c740 1 -- 172.21.15.63:0/2228373091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d080054f0 con 0x55ef75f158e0 2024-09-21T06:27:42.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.984+0000 7f9cf9ffb640 1 -- 172.21.15.63:0/2228373091 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9d08003ba0 con 0x55ef75f158e0 2024-09-21T06:27:42.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.984+0000 7f9d1f08c740 10 client.15273 fetch_fsmap learned FSMap version 28 2024-09-21T06:27:42.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.984+0000 7f9d1f08c740 1 -- 172.21.15.63:0/2228373091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ef76320ee0 con 0x55ef75f158e0 2024-09-21T06:27:42.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.985+0000 7f9cf9ffb640 1 -- 172.21.15.63:0/2228373091 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d080054f0 con 0x55ef75f158e0 2024-09-21T06:27:42.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.985+0000 7f9cf9ffb640 1 -- 172.21.15.63:0/2228373091 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9d08029410 con 0x55ef75f158e0 2024-09-21T06:27:42.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.985+0000 7f9d1f08c740 10 client.15273 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:27:42.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.985+0000 7f9d1f08c740 10 client.15273 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:27:42.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.985+0000 7f9d1f08c740 20 client.15273 populate_metadata read hostname 'smithi063' 2024-09-21T06:27:42.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.985+0000 7f9d1f08c740 1 --2- 172.21.15.63:0/2228373091 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55ef75f56f60 0x55ef763890f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.985+0000 7f9d1f08c740 4 client.15273 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:27:42.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.985+0000 7f9d1f08c740 1 -- 172.21.15.63:0/2228373091 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "status"}) -- 0x55ef76272610 con 0x55ef75f56f60 2024-09-21T06:27:42.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.985+0000 7f9d1259c640 1 --2- 172.21.15.63:0/2228373091 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55ef75f56f60 0x55ef763890f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.986+0000 7f9cf9ffb640 10 client.15273 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:27:42.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.986+0000 7f9d1259c640 1 --2- 172.21.15.63:0/2228373091 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55ef75f56f60 0x55ef763890f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9885a513fa1d5bc6 server_cookie=c185a8ffd620ef59 in_seq=0 out_seq=0 2024-09-21T06:27:42.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.986+0000 7f9cf9ffb640 1 -- 172.21.15.63:0/2228373091 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55ef76272610 con 0x55ef75f56f60 2024-09-21T06:27:42.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.986+0000 7f9cf9ffb640 10 client.15273 handle_command_reply: tid=0 2024-09-21T06:27:42.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.986+0000 7f9d1f08c740 1 client.15273 shutdown 2024-09-21T06:27:42.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.986+0000 7f9d1f08c740 1 -- 172.21.15.63:0/2228373091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f158e0 msgr2=0x55ef76323800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:42.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.986+0000 7f9d1f08c740 1 --2- 172.21.15.63:0/2228373091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f158e0 0x55ef76323800 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9d08006010 tx=0x7f9d080056a0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.986+0000 7f9d1f08c740 1 -- 172.21.15.63:0/2228373091 shutdown_connections 2024-09-21T06:27:42.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.986+0000 7f9d1f08c740 1 --2- 172.21.15.63:0/2228373091 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55ef75f56f60 0x55ef763890f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.986+0000 7f9d1f08c740 1 --2- 172.21.15.63:0/2228373091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef75f36280 0x55ef763020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.986+0000 7f9d1f08c740 1 --2- 172.21.15.63:0/2228373091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef75f2e0a0 0x55ef76323de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.986+0000 7f9cf9ffb640 0 client.15273 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:27:42.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.986+0000 7f9d1f08c740 1 --2- 172.21.15.63:0/2228373091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef75f158e0 0x55ef76323800 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.986+0000 7f9d1f08c740 1 -- 172.21.15.63:0/2228373091 >> 172.21.15.63:0/2228373091 conn(0x55ef75f4b350 msgr2=0x55ef76303a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:42.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.986+0000 7f9d1f08c740 1 -- 172.21.15.63:0/2228373091 shutdown_connections 2024-09-21T06:27:42.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.986+0000 7f9d1f08c740 1 -- 172.21.15.63:0/2228373091 wait complete. 2024-09-21T06:27:42.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.986+0000 7f9d1f08c740 20 client.15273 trim_cache size 0 max 16384 2024-09-21T06:27:42.996 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:27:42.996 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "140899c8-77e1-11ef-baf5-efdc52797490", 2024-09-21T06:27:42.996 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2024-09-21T06:27:42.997 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 24698, 2024-09-21T06:27:42.997 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-21T06:27:42.997 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-21T06:27:42.997 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-21T06:27:42.997 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 83.702127762999993, 2024-09-21T06:27:42.997 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 28, 2024-09-21T06:27:42.997 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 77, 2024-09-21T06:27:42.997 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:27:42.997 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 92.765882925 2024-09-21T06:27:42.997 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:27:42.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.987+0000 7f9d18b18640 1 -- 172.21.15.63:0/2715722504 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9cfc0b6670 msgr2=0x7f9cfc0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:42.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.987+0000 7f9d18b18640 1 --2- 172.21.15.63:0/2715722504 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9cfc0b6670 0x7f9cfc0b8b80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c0b1c10 tx=0x7f9d0c0cad70 comp rx=0 tx=0).stop 2024-09-21T06:27:42.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.987+0000 7f9d18b18640 1 -- 172.21.15.63:0/2715722504 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1410de90 msgr2=0x7f9d14102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:42.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.987+0000 7f9d18b18640 1 --2- 172.21.15.63:0/2715722504 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1410de90 0x7f9d14102cb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009430 tx=0x7f9d0c0317c0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.987+0000 7f9d18b18640 1 -- 172.21.15.63:0/2715722504 shutdown_connections 2024-09-21T06:27:42.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.987+0000 7f9d18b18640 1 --2- 172.21.15.63:0/2715722504 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d1410de90 0x7f9d14102cb0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.987+0000 7f9d18b18640 1 --2- 172.21.15.63:0/2715722504 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9cfc0b6670 0x7f9cfc0b8b80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.987+0000 7f9d18b18640 1 --2- 172.21.15.63:0/2715722504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d14105380 0x7f9d14102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.987+0000 7f9d18b18640 1 --2- 172.21.15.63:0/2715722504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d14104a30 0x7f9d14104180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.987+0000 7f9d18b18640 1 -- 172.21.15.63:0/2715722504 >> 172.21.15.63:0/2715722504 conn(0x7f9d14079770 msgr2=0x7f9d14107990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:42.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.987+0000 7f9d18b18640 1 -- 172.21.15.63:0/2715722504 shutdown_connections 2024-09-21T06:27:42.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:42.987+0000 7f9d18b18640 1 -- 172.21.15.63:0/2715722504 wait complete. 2024-09-21T06:27:43.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:42 smithi071 ceph-mon[34844]: pgmap v307: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:43.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:42 smithi063 ceph-mon[31150]: pgmap v307: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:43.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:42 smithi175 ceph-mon[34510]: pgmap v307: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:43.767 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T06:27:43.767 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T06:27:43.782 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T06:27:43.782 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T06:27:44.041 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:44.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.523+0000 7f05e34b1640 1 -- 172.21.15.63:0/3015256129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05dc1094e0 msgr2=0x7f05dc1098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:44.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.523+0000 7f05e34b1640 1 --2- 172.21.15.63:0/3015256129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05dc1094e0 0x7f05dc1098f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f05cc009900 tx=0x7f05cc02a410 comp rx=0 tx=0).stop 2024-09-21T06:27:44.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.523+0000 7f05e34b1640 1 -- 172.21.15.63:0/3015256129 shutdown_connections 2024-09-21T06:27:44.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.523+0000 7f05e34b1640 1 --2- 172.21.15.63:0/3015256129 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05dc109e30 0x7f05dc110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:44.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.523+0000 7f05e34b1640 1 --2- 172.21.15.63:0/3015256129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05dc1094e0 0x7f05dc1098f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:44.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.523+0000 7f05e34b1640 1 --2- 172.21.15.63:0/3015256129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05dc103ba0 0x7f05dc103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:44.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.523+0000 7f05e34b1640 1 -- 172.21.15.63:0/3015256129 >> 172.21.15.63:0/3015256129 conn(0x7f05dc0ff630 msgr2=0x7f05dc101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:44.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.523+0000 7f05e34b1640 1 -- 172.21.15.63:0/3015256129 shutdown_connections 2024-09-21T06:27:44.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.523+0000 7f05e34b1640 1 -- 172.21.15.63:0/3015256129 wait complete. 2024-09-21T06:27:44.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.524+0000 7f05e34b1640 1 Processor -- start 2024-09-21T06:27:44.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.524+0000 7f05e34b1640 1 -- start start 2024-09-21T06:27:44.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.524+0000 7f05e34b1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05dc103ba0 0x7f05dc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:44.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.524+0000 7f05e34b1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05dc1094e0 0x7f05dc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:44.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.524+0000 7f05e34b1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05dc109e30 0x7f05dc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:44.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.524+0000 7f05e34b1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc113af0 con 0x7f05dc103ba0 2024-09-21T06:27:44.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.525+0000 7f05e34b1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc113970 con 0x7f05dc1094e0 2024-09-21T06:27:44.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.525+0000 7f05e34b1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc113c70 con 0x7f05dc109e30 2024-09-21T06:27:44.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.525+0000 7f05e124d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05dc103ba0 0x7f05dc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:44.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.525+0000 7f05e124d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05dc103ba0 0x7f05dc075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37020/0 (socket says 172.21.15.63:37020) 2024-09-21T06:27:44.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.525+0000 7f05e124d640 1 -- 172.21.15.63:0/102799520 learned_addr learned my addr 172.21.15.63:0/102799520 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:44.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.525+0000 7f05e1a4e640 1 --2- 172.21.15.63:0/102799520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05dc109e30 0x7f05dc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:44.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.525+0000 7f05e0a4c640 1 --2- 172.21.15.63:0/102799520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05dc1094e0 0x7f05dc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:44.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.525+0000 7f05e124d640 1 -- 172.21.15.63:0/102799520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05dc109e30 msgr2=0x7f05dc076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:44.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.525+0000 7f05e124d640 1 --2- 172.21.15.63:0/102799520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05dc109e30 0x7f05dc076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:44.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.525+0000 7f05e124d640 1 -- 172.21.15.63:0/102799520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05dc1094e0 msgr2=0x7f05dc075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:44.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.525+0000 7f05e124d640 1 --2- 172.21.15.63:0/102799520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05dc1094e0 0x7f05dc075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:44.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.525+0000 7f05e124d640 1 -- 172.21.15.63:0/102799520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05dc1a8780 con 0x7f05dc103ba0 2024-09-21T06:27:44.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.525+0000 7f05e1a4e640 1 --2- 172.21.15.63:0/102799520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05dc109e30 0x7f05dc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:44.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.525+0000 7f05e0a4c640 1 --2- 172.21.15.63:0/102799520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05dc1094e0 0x7f05dc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:44.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.525+0000 7f05e124d640 1 --2- 172.21.15.63:0/102799520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05dc103ba0 0x7f05dc075710 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f05d800d950 tx=0x7f05d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:44.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.525+0000 7f05d27fc640 1 -- 172.21.15.63:0/102799520 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8017070 con 0x7f05dc103ba0 2024-09-21T06:27:44.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.525+0000 7f05d27fc640 1 -- 172.21.15.63:0/102799520 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05d8009c30 con 0x7f05dc103ba0 2024-09-21T06:27:44.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.525+0000 7f05e34b1640 1 -- 172.21.15.63:0/102799520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05dc1a8a70 con 0x7f05dc103ba0 2024-09-21T06:27:44.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.525+0000 7f05d27fc640 1 -- 172.21.15.63:0/102799520 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d800f620 con 0x7f05dc103ba0 2024-09-21T06:27:44.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.525+0000 7f05e34b1640 1 -- 172.21.15.63:0/102799520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05dc1a8fb0 con 0x7f05dc103ba0 2024-09-21T06:27:44.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.526+0000 7f05e34b1640 1 -- 172.21.15.63:0/102799520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05dc103fb0 con 0x7f05dc103ba0 2024-09-21T06:27:44.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.528+0000 7f05d27fc640 1 -- 172.21.15.63:0/102799520 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f05d8010460 con 0x7f05dc103ba0 2024-09-21T06:27:44.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.529+0000 7f05d27fc640 1 --2- 172.21.15.63:0/102799520 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f05c80b65f0 0x7f05c80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:44.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.529+0000 7f05e0a4c640 1 --2- 172.21.15.63:0/102799520 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f05c80b65f0 0x7f05c80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:44.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.529+0000 7f05d27fc640 1 -- 172.21.15.63:0/102799520 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f05d80e72f0 con 0x7f05dc103ba0 2024-09-21T06:27:44.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.530+0000 7f05e0a4c640 1 --2- 172.21.15.63:0/102799520 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f05c80b65f0 0x7f05c80b8b00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f05cc000c00 tx=0x7f05cc031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:44.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.532+0000 7f05d27fc640 1 -- 172.21.15.63:0/102799520 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f05d80ad940 con 0x7f05dc103ba0 2024-09-21T06:27:44.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.736+0000 7f05e34b1640 1 -- 172.21.15.63:0/102799520 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f05dc063800 con 0x7f05c80b65f0 2024-09-21T06:27:44.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.738+0000 7f05d27fc640 1 -- 172.21.15.63:0/102799520 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f05dc063800 con 0x7f05c80b65f0 2024-09-21T06:27:44.739 INFO:teuthology.orchestra.run.smithi063.stdout:Backend: cephadm 2024-09-21T06:27:44.740 INFO:teuthology.orchestra.run.smithi063.stdout:Available: Yes 2024-09-21T06:27:44.740 INFO:teuthology.orchestra.run.smithi063.stdout:Paused: No 2024-09-21T06:27:44.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.740+0000 7f05e34b1640 1 -- 172.21.15.63:0/102799520 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f05c80b65f0 msgr2=0x7f05c80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:44.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.740+0000 7f05e34b1640 1 --2- 172.21.15.63:0/102799520 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f05c80b65f0 0x7f05c80b8b00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f05cc000c00 tx=0x7f05cc031400 comp rx=0 tx=0).stop 2024-09-21T06:27:44.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.740+0000 7f05e34b1640 1 -- 172.21.15.63:0/102799520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05dc103ba0 msgr2=0x7f05dc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:44.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.740+0000 7f05e34b1640 1 --2- 172.21.15.63:0/102799520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05dc103ba0 0x7f05dc075710 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f05d800d950 tx=0x7f05d800de10 comp rx=0 tx=0).stop 2024-09-21T06:27:44.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.740+0000 7f05e34b1640 1 -- 172.21.15.63:0/102799520 shutdown_connections 2024-09-21T06:27:44.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.740+0000 7f05e34b1640 1 --2- 172.21.15.63:0/102799520 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f05c80b65f0 0x7f05c80b8b00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:44.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.740+0000 7f05e34b1640 1 --2- 172.21.15.63:0/102799520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05dc109e30 0x7f05dc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:44.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.740+0000 7f05e34b1640 1 --2- 172.21.15.63:0/102799520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05dc1094e0 0x7f05dc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:44.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.740+0000 7f05e34b1640 1 --2- 172.21.15.63:0/102799520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05dc103ba0 0x7f05dc075710 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:44.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.740+0000 7f05e34b1640 1 -- 172.21.15.63:0/102799520 >> 172.21.15.63:0/102799520 conn(0x7f05dc0ff630 msgr2=0x7f05dc101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:44.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.741+0000 7f05e34b1640 1 -- 172.21.15.63:0/102799520 shutdown_connections 2024-09-21T06:27:44.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:44.741+0000 7f05e34b1640 1 -- 172.21.15.63:0/102799520 wait complete. 2024-09-21T06:27:45.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:44 smithi063 ceph-mon[31150]: pgmap v308: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:45.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:44 smithi071 ceph-mon[34844]: pgmap v308: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:45.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:44 smithi175 ceph-mon[34510]: pgmap v308: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:45.417 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T06:27:45.674 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:46.074 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:45 smithi063 ceph-mon[31150]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:46.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.165+0000 7f5d70701640 1 -- 172.21.15.63:0/1647553618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d68108d20 msgr2=0x7f5d6810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:46.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.165+0000 7f5d70701640 1 --2- 172.21.15.63:0/1647553618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d68108d20 0x7f5d6810f550 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5d60009ca0 tx=0x7f5d6002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.165+0000 7f5d70701640 1 -- 172.21.15.63:0/1647553618 shutdown_connections 2024-09-21T06:27:46.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.165+0000 7f5d70701640 1 --2- 172.21.15.63:0/1647553618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d68108d20 0x7f5d6810f550 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.165+0000 7f5d70701640 1 --2- 172.21.15.63:0/1647553618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d681083d0 0x7f5d681087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.165+0000 7f5d70701640 1 --2- 172.21.15.63:0/1647553618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d68102ae0 0x7f5d68102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.165+0000 7f5d70701640 1 -- 172.21.15.63:0/1647553618 >> 172.21.15.63:0/1647553618 conn(0x7f5d68079760 msgr2=0x7f5d68079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:46.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.166+0000 7f5d70701640 1 -- 172.21.15.63:0/1647553618 shutdown_connections 2024-09-21T06:27:46.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.166+0000 7f5d70701640 1 -- 172.21.15.63:0/1647553618 wait complete. 2024-09-21T06:27:46.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.166+0000 7f5d70701640 1 Processor -- start 2024-09-21T06:27:46.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.166+0000 7f5d70701640 1 -- start start 2024-09-21T06:27:46.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.166+0000 7f5d70701640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d68102ae0 0x7f5d6819a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.166+0000 7f5d70701640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d681083d0 0x7f5d6819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.166+0000 7f5d70701640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d68108d20 0x7f5d6819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.167+0000 7f5d70701640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5d68113aa0 con 0x7f5d681083d0 2024-09-21T06:27:46.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.167+0000 7f5d70701640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5d68113920 con 0x7f5d68102ae0 2024-09-21T06:27:46.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.167+0000 7f5d70701640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5d68113c20 con 0x7f5d68108d20 2024-09-21T06:27:46.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.167+0000 7f5d6dc9c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d681083d0 0x7f5d6819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.167+0000 7f5d6dc9c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d681083d0 0x7f5d6819a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37030/0 (socket says 172.21.15.63:37030) 2024-09-21T06:27:46.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.167+0000 7f5d6dc9c640 1 -- 172.21.15.63:0/3927427119 learned_addr learned my addr 172.21.15.63:0/3927427119 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:46.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.167+0000 7f5d6ec9e640 1 --2- 172.21.15.63:0/3927427119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d68108d20 0x7f5d6819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.167+0000 7f5d6e49d640 1 --2- 172.21.15.63:0/3927427119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d68102ae0 0x7f5d6819a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.167+0000 7f5d6dc9c640 1 -- 172.21.15.63:0/3927427119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d68108d20 msgr2=0x7f5d6819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:46.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.167+0000 7f5d6dc9c640 1 --2- 172.21.15.63:0/3927427119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d68108d20 0x7f5d6819fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.167+0000 7f5d6dc9c640 1 -- 172.21.15.63:0/3927427119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d68102ae0 msgr2=0x7f5d6819a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:46.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.167+0000 7f5d6dc9c640 1 --2- 172.21.15.63:0/3927427119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d68102ae0 0x7f5d6819a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.167+0000 7f5d6dc9c640 1 -- 172.21.15.63:0/3927427119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d681a0360 con 0x7f5d681083d0 2024-09-21T06:27:46.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.167+0000 7f5d6e49d640 1 --2- 172.21.15.63:0/3927427119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d68102ae0 0x7f5d6819a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:46.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.167+0000 7f5d6dc9c640 1 --2- 172.21.15.63:0/3927427119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d681083d0 0x7f5d6819a990 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c005fd0 tx=0x7f5d5c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:46.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.167+0000 7f5d5b7fe640 1 -- 172.21.15.63:0/3927427119 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c017070 con 0x7f5d681083d0 2024-09-21T06:27:46.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.167+0000 7f5d70701640 1 -- 172.21.15.63:0/3927427119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d681a0650 con 0x7f5d681083d0 2024-09-21T06:27:46.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.167+0000 7f5d5b7fe640 1 -- 172.21.15.63:0/3927427119 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d5c009c30 con 0x7f5d681083d0 2024-09-21T06:27:46.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.167+0000 7f5d5b7fe640 1 -- 172.21.15.63:0/3927427119 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c003d30 con 0x7f5d681083d0 2024-09-21T06:27:46.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.167+0000 7f5d70701640 1 -- 172.21.15.63:0/3927427119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d681a6db0 con 0x7f5d681083d0 2024-09-21T06:27:46.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.169+0000 7f5d70701640 1 -- 172.21.15.63:0/3927427119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d68103d10 con 0x7f5d681083d0 2024-09-21T06:27:46.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.171+0000 7f5d5b7fe640 1 -- 172.21.15.63:0/3927427119 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f5d5c003ed0 con 0x7f5d681083d0 2024-09-21T06:27:46.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.172+0000 7f5d5b7fe640 1 --2- 172.21.15.63:0/3927427119 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f5d540b65f0 0x7f5d540b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.172+0000 7f5d6e49d640 1 --2- 172.21.15.63:0/3927427119 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f5d540b65f0 0x7f5d540b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.172+0000 7f5d5b7fe640 1 -- 172.21.15.63:0/3927427119 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f5d5c0e7b20 con 0x7f5d681083d0 2024-09-21T06:27:46.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.173+0000 7f5d6e49d640 1 --2- 172.21.15.63:0/3927427119 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f5d540b65f0 0x7f5d540b8b00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009b50 tx=0x7f5d64005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:46.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.175+0000 7f5d5b7fe640 1 -- 172.21.15.63:0/3927427119 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5d5c020030 con 0x7f5d681083d0 2024-09-21T06:27:46.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:45 smithi071 ceph-mon[34844]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:46.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:45 smithi175 ceph-mon[34510]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:46.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.377+0000 7f5d70701640 1 -- 172.21.15.63:0/3927427119 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5d68063800 con 0x7f5d540b65f0 2024-09-21T06:27:46.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.390+0000 7f5d5b7fe640 1 -- 172.21.15.63:0/3927427119 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f5d68063800 con 0x7f5d540b65f0 2024-09-21T06:27:46.392 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T06:27:46.392 INFO:teuthology.orchestra.run.smithi063.stdout:mds.a smithi063 running (99s) 20s ago 98s 87.3M - 19.3.0-5120-g18432218 ddce307e1f32 e1f8a16f1e1e 2024-09-21T06:27:46.392 INFO:teuthology.orchestra.run.smithi063.stdout:mds.b smithi071 running (96s) 27s ago 96s 94.6M - 19.3.0-5120-g18432218 ddce307e1f32 0b826c7310b6 2024-09-21T06:27:46.392 INFO:teuthology.orchestra.run.smithi063.stdout:mds.c smithi175 running (111s) 27s ago 110s 85.8M - 19.3.0-5120-g18432218 ddce307e1f32 553dd633b676 2024-09-21T06:27:46.392 INFO:teuthology.orchestra.run.smithi063.stdout:mds.d smithi063 running (119s) 20s ago 118s 84.3M - 19.3.0-5120-g18432218 ddce307e1f32 c5701a61e3e7 2024-09-21T06:27:46.392 INFO:teuthology.orchestra.run.smithi063.stdout:mds.e smithi071 running (116s) 27s ago 116s 87.2M - 19.3.0-5120-g18432218 ddce307e1f32 a387471fdfc8 2024-09-21T06:27:46.392 INFO:teuthology.orchestra.run.smithi063.stdout:mds.f smithi175 running (114s) 27s ago 113s 85.0M - 19.3.0-5120-g18432218 ddce307e1f32 86ddb3c90101 2024-09-21T06:27:46.392 INFO:teuthology.orchestra.run.smithi063.stdout:mds.g smithi063 running (103s) 20s ago 101s 84.4M - 19.3.0-5120-g18432218 ddce307e1f32 6b8372c01d42 2024-09-21T06:27:46.392 INFO:teuthology.orchestra.run.smithi063.stdout:mds.h smithi071 running (108s) 27s ago 108s 85.4M - 19.3.0-5120-g18432218 ddce307e1f32 04dce2dea4f0 2024-09-21T06:27:46.392 INFO:teuthology.orchestra.run.smithi063.stdout:mds.i smithi175 running (106s) 27s ago 105s 85.9M - 19.3.0-5120-g18432218 ddce307e1f32 088fde11642f 2024-09-21T06:27:46.392 INFO:teuthology.orchestra.run.smithi063.stdout:mds.j smithi063 running (2m) 20s ago 2m 82.7M - 19.3.0-5120-g18432218 ddce307e1f32 251f166d66e0 2024-09-21T06:27:46.393 INFO:teuthology.orchestra.run.smithi063.stdout:mds.k smithi071 running (2m) 27s ago 2m 87.3M - 19.3.0-5120-g18432218 ddce307e1f32 eaccc093baab 2024-09-21T06:27:46.393 INFO:teuthology.orchestra.run.smithi063.stdout:mds.l smithi175 running (2m) 27s ago 2m 84.2M - 19.3.0-5120-g18432218 ddce307e1f32 bd5a6049237d 2024-09-21T06:27:46.393 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.x smithi063 *:9283,8765 running (9m) 20s ago 9m 586M - 19.3.0-5120-g18432218 ddce307e1f32 28d97f2ee4b5 2024-09-21T06:27:46.393 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.y smithi071 *:8443,8765 running (7m) 27s ago 7m 525M - 19.3.0-5120-g18432218 ddce307e1f32 c0bb7be67ac6 2024-09-21T06:27:46.393 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.z smithi175 *:8443,8765 running (7m) 27s ago 7m 524M - 19.3.0-5120-g18432218 ddce307e1f32 b37aec2f18e0 2024-09-21T06:27:46.393 INFO:teuthology.orchestra.run.smithi063.stdout:mon.a smithi063 running (9m) 20s ago 9m 121M 2048M 19.3.0-5120-g18432218 ddce307e1f32 13f6aeac32a8 2024-09-21T06:27:46.393 INFO:teuthology.orchestra.run.smithi063.stdout:mon.b smithi071 running (8m) 27s ago 8m 111M 2048M 19.3.0-5120-g18432218 ddce307e1f32 8bebf6bf5b39 2024-09-21T06:27:46.393 INFO:teuthology.orchestra.run.smithi063.stdout:mon.c smithi175 running (8m) 27s ago 8m 111M 2048M 19.3.0-5120-g18432218 ddce307e1f32 b6be838a86a3 2024-09-21T06:27:46.393 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (7m) 20s ago 7m 121M 4272M 19.3.0-5120-g18432218 ddce307e1f32 920b95280bc1 2024-09-21T06:27:46.393 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi071 running (6m) 27s ago 6m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 206727bf0f47 2024-09-21T06:27:46.393 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi175 running (6m) 27s ago 6m 125M 4272M 19.3.0-5120-g18432218 ddce307e1f32 650196df4631 2024-09-21T06:27:46.393 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi063 running (5m) 20s ago 5m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 fb96de5f9c8d 2024-09-21T06:27:46.393 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi071 running (5m) 27s ago 5m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 10d830f2ec45 2024-09-21T06:27:46.393 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi175 running (5m) 27s ago 5m 122M 4272M 19.3.0-5120-g18432218 ddce307e1f32 1757b98025ec 2024-09-21T06:27:46.394 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6 smithi063 running (4m) 20s ago 4m 114M 4272M 19.3.0-5120-g18432218 ddce307e1f32 f50a0927cc15 2024-09-21T06:27:46.394 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7 smithi071 running (4m) 27s ago 4m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 2617a90ed8f9 2024-09-21T06:27:46.394 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8 smithi175 running (3m) 27s ago 3m 120M 4272M 19.3.0-5120-g18432218 ddce307e1f32 64f817ea9af3 2024-09-21T06:27:46.394 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9 smithi063 running (3m) 20s ago 3m 119M 4272M 19.3.0-5120-g18432218 ddce307e1f32 dde69757cb0b 2024-09-21T06:27:46.394 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10 smithi071 running (2m) 27s ago 2m 122M 4272M 19.3.0-5120-g18432218 ddce307e1f32 f386418cbbed 2024-09-21T06:27:46.394 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11 smithi175 running (2m) 27s ago 2m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 0760c66bb064 2024-09-21T06:27:46.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.393+0000 7f5d70701640 1 -- 172.21.15.63:0/3927427119 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f5d540b65f0 msgr2=0x7f5d540b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:46.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.393+0000 7f5d70701640 1 --2- 172.21.15.63:0/3927427119 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f5d540b65f0 0x7f5d540b8b00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009b50 tx=0x7f5d64005f90 comp rx=0 tx=0).stop 2024-09-21T06:27:46.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.393+0000 7f5d70701640 1 -- 172.21.15.63:0/3927427119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d681083d0 msgr2=0x7f5d6819a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:46.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.393+0000 7f5d70701640 1 --2- 172.21.15.63:0/3927427119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d681083d0 0x7f5d6819a990 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c005fd0 tx=0x7f5d5c00dde0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.393+0000 7f5d70701640 1 -- 172.21.15.63:0/3927427119 shutdown_connections 2024-09-21T06:27:46.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.393+0000 7f5d70701640 1 --2- 172.21.15.63:0/3927427119 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f5d540b65f0 0x7f5d540b8b00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.393+0000 7f5d70701640 1 --2- 172.21.15.63:0/3927427119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d68108d20 0x7f5d6819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.393+0000 7f5d70701640 1 --2- 172.21.15.63:0/3927427119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d681083d0 0x7f5d6819a990 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.393+0000 7f5d70701640 1 --2- 172.21.15.63:0/3927427119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d68102ae0 0x7f5d6819a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.393+0000 7f5d70701640 1 -- 172.21.15.63:0/3927427119 >> 172.21.15.63:0/3927427119 conn(0x7f5d68079760 msgr2=0x7f5d681043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:46.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.393+0000 7f5d70701640 1 -- 172.21.15.63:0/3927427119 shutdown_connections 2024-09-21T06:27:46.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:46.393+0000 7f5d70701640 1 -- 172.21.15.63:0/3927427119 wait complete. 2024-09-21T06:27:47.026 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T06:27:47.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:46 smithi063 ceph-mon[31150]: pgmap v309: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T06:27:47.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:46 smithi063 ceph-mon[31150]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:47.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:46 smithi071 ceph-mon[34844]: pgmap v309: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T06:27:47.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:46 smithi071 ceph-mon[34844]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:47.282 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:47.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:46 smithi175 ceph-mon[34510]: pgmap v309: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T06:27:47.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:46 smithi175 ceph-mon[34510]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:47.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.775+0000 7f62df7aa640 1 -- 172.21.15.63:0/1963519973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62d810de10 msgr2=0x7f62d8110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:47.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.775+0000 7f62df7aa640 1 --2- 172.21.15.63:0/1963519973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62d810de10 0x7f62d8110300 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f62c8009ca0 tx=0x7f62c802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:47.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.775+0000 7f62df7aa640 1 -- 172.21.15.63:0/1963519973 shutdown_connections 2024-09-21T06:27:47.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.775+0000 7f62df7aa640 1 --2- 172.21.15.63:0/1963519973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62d810de10 0x7f62d8110300 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:47.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.775+0000 7f62df7aa640 1 --2- 172.21.15.63:0/1963519973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62d8105300 0x7f62d810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:47.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.775+0000 7f62df7aa640 1 --2- 172.21.15.63:0/1963519973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62d81049b0 0x7f62d8104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:47.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.775+0000 7f62df7aa640 1 -- 172.21.15.63:0/1963519973 >> 172.21.15.63:0/1963519973 conn(0x7f62d8079730 msgr2=0x7f62d8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:47.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.775+0000 7f62df7aa640 1 -- 172.21.15.63:0/1963519973 shutdown_connections 2024-09-21T06:27:47.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.775+0000 7f62df7aa640 1 -- 172.21.15.63:0/1963519973 wait complete. 2024-09-21T06:27:47.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.776+0000 7f62df7aa640 1 Processor -- start 2024-09-21T06:27:47.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.776+0000 7f62df7aa640 1 -- start start 2024-09-21T06:27:47.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.776+0000 7f62df7aa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62d81049b0 0x7f62d819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:47.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.776+0000 7f62df7aa640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62d8105300 0x7f62d819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:47.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.776+0000 7f62df7aa640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62d810de10 0x7f62d819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:47.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.777+0000 7f62df7aa640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f62d8113a90 con 0x7f62d810de10 2024-09-21T06:27:47.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.777+0000 7f62df7aa640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f62d8113910 con 0x7f62d8105300 2024-09-21T06:27:47.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.777+0000 7f62df7aa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f62d8113c10 con 0x7f62d81049b0 2024-09-21T06:27:47.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.777+0000 7f62ddd47640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62d810de10 0x7f62d819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:47.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.777+0000 7f62ddd47640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62d810de10 0x7f62d819fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55116/0 (socket says 172.21.15.63:55116) 2024-09-21T06:27:47.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.777+0000 7f62ddd47640 1 -- 172.21.15.63:0/625250014 learned_addr learned my addr 172.21.15.63:0/625250014 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:47.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.777+0000 7f62dd546640 1 --2- 172.21.15.63:0/625250014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62d81049b0 0x7f62d819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:47.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.777+0000 7f62dcd45640 1 --2- 172.21.15.63:0/625250014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62d8105300 0x7f62d819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:47.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.777+0000 7f62ddd47640 1 -- 172.21.15.63:0/625250014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62d81049b0 msgr2=0x7f62d819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:47.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.777+0000 7f62ddd47640 1 --2- 172.21.15.63:0/625250014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62d81049b0 0x7f62d819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:47.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.777+0000 7f62ddd47640 1 -- 172.21.15.63:0/625250014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62d8105300 msgr2=0x7f62d819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:47.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.777+0000 7f62ddd47640 1 --2- 172.21.15.63:0/625250014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62d8105300 0x7f62d819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:47.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.777+0000 7f62ddd47640 1 -- 172.21.15.63:0/625250014 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d81a0430 con 0x7f62d810de10 2024-09-21T06:27:47.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.777+0000 7f62ddd47640 1 --2- 172.21.15.63:0/625250014 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62d810de10 0x7f62d819fd00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f62c8005cc0 tx=0x7f62c8031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:47.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.777+0000 7f62d67fc640 1 -- 172.21.15.63:0/625250014 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c8003b70 con 0x7f62d810de10 2024-09-21T06:27:47.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.777+0000 7f62df7aa640 1 -- 172.21.15.63:0/625250014 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62d81a06c0 con 0x7f62d810de10 2024-09-21T06:27:47.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.777+0000 7f62d67fc640 1 -- 172.21.15.63:0/625250014 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62c80318f0 con 0x7f62d810de10 2024-09-21T06:27:47.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.777+0000 7f62d67fc640 1 -- 172.21.15.63:0/625250014 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c802f950 con 0x7f62d810de10 2024-09-21T06:27:47.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.778+0000 7f62df7aa640 1 -- 172.21.15.63:0/625250014 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62d81a6e80 con 0x7f62d810de10 2024-09-21T06:27:47.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.779+0000 7f62df7aa640 1 -- 172.21.15.63:0/625250014 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62d8104dc0 con 0x7f62d810de10 2024-09-21T06:27:47.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.780+0000 7f62d67fc640 1 -- 172.21.15.63:0/625250014 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f62c8004b40 con 0x7f62d810de10 2024-09-21T06:27:47.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.781+0000 7f62d67fc640 1 --2- 172.21.15.63:0/625250014 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f62c00b65f0 0x7f62c00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:47.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.781+0000 7f62dd546640 1 --2- 172.21.15.63:0/625250014 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f62c00b65f0 0x7f62c00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:47.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.781+0000 7f62d67fc640 1 -- 172.21.15.63:0/625250014 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f62c8108910 con 0x7f62d810de10 2024-09-21T06:27:47.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.782+0000 7f62dd546640 1 --2- 172.21.15.63:0/625250014 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f62c00b65f0 0x7f62c00b8b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f62d806bc60 tx=0x7f62d0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:47.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.784+0000 7f62d67fc640 1 -- 172.21.15.63:0/625250014 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f62c80cef60 con 0x7f62d810de10 2024-09-21T06:27:47.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.981+0000 7f62df7aa640 1 -- 172.21.15.63:0/625250014 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f62d8063800 con 0x7f62c00b65f0 2024-09-21T06:27:47.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.987+0000 7f62d67fc640 1 -- 172.21.15.63:0/625250014 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f62d8063800 con 0x7f62c00b65f0 2024-09-21T06:27:47.989 INFO:teuthology.orchestra.run.smithi063.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T06:27:47.989 INFO:teuthology.orchestra.run.smithi063.stdout:mds.all 12/12 29s ago 2m smithi063=a;smithi063=d;smithi063=g;smithi063=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-09-21T06:27:47.989 INFO:teuthology.orchestra.run.smithi063.stdout:mgr 3/3 29s ago 8m smithi063=x;smithi071=y;smithi175=z;count:3 2024-09-21T06:27:47.989 INFO:teuthology.orchestra.run.smithi063.stdout:mon 3/3 29s ago 8m smithi063:172.21.15.63=a;smithi071:172.21.15.71=b;smithi175:172.21.15.175=c;count:3 2024-09-21T06:27:47.990 INFO:teuthology.orchestra.run.smithi063.stdout:osd 12 29s ago - 2024-09-21T06:27:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.990+0000 7f62df7aa640 1 -- 172.21.15.63:0/625250014 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f62c00b65f0 msgr2=0x7f62c00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.990+0000 7f62df7aa640 1 --2- 172.21.15.63:0/625250014 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f62c00b65f0 0x7f62c00b8b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f62d806bc60 tx=0x7f62d0005f90 comp rx=0 tx=0).stop 2024-09-21T06:27:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.990+0000 7f62df7aa640 1 -- 172.21.15.63:0/625250014 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62d810de10 msgr2=0x7f62d819fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.990+0000 7f62df7aa640 1 --2- 172.21.15.63:0/625250014 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62d810de10 0x7f62d819fd00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f62c8005cc0 tx=0x7f62c8031700 comp rx=0 tx=0).stop 2024-09-21T06:27:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.990+0000 7f62df7aa640 1 -- 172.21.15.63:0/625250014 shutdown_connections 2024-09-21T06:27:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.990+0000 7f62df7aa640 1 --2- 172.21.15.63:0/625250014 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62d810de10 0x7f62d819fd00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.990+0000 7f62df7aa640 1 --2- 172.21.15.63:0/625250014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62d8105300 0x7f62d819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.990+0000 7f62df7aa640 1 --2- 172.21.15.63:0/625250014 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f62c00b65f0 0x7f62c00b8b00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.990+0000 7f62df7aa640 1 --2- 172.21.15.63:0/625250014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62d81049b0 0x7f62d819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.990+0000 7f62df7aa640 1 -- 172.21.15.63:0/625250014 >> 172.21.15.63:0/625250014 conn(0x7f62d8079730 msgr2=0x7f62d81007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.990+0000 7f62df7aa640 1 -- 172.21.15.63:0/625250014 shutdown_connections 2024-09-21T06:27:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:47.990+0000 7f62df7aa640 1 -- 172.21.15.63:0/625250014 wait complete. 2024-09-21T06:27:48.801 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T06:27:49.057 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:49.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:48 smithi063 ceph-mon[31150]: pgmap v310: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:27:49.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:48 smithi063 ceph-mon[31150]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:49.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:48 smithi071 ceph-mon[34844]: pgmap v310: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:27:49.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:48 smithi071 ceph-mon[34844]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:49.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:48 smithi175 ceph-mon[34510]: pgmap v310: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:27:49.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:48 smithi175 ceph-mon[34510]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:49.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.577+0000 7fa162d43640 1 -- 172.21.15.63:0/3311120043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa15c107b70 msgr2=0x7fa15c107f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:49.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.577+0000 7fa162d43640 1 --2- 172.21.15.63:0/3311120043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa15c107b70 0x7fa15c107f80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa150009900 tx=0x7fa15002a410 comp rx=0 tx=0).stop 2024-09-21T06:27:49.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.577+0000 7fa162d43640 1 -- 172.21.15.63:0/3311120043 shutdown_connections 2024-09-21T06:27:49.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.577+0000 7fa162d43640 1 --2- 172.21.15.63:0/3311120043 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa15c1084c0 0x7fa15c10ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.577+0000 7fa162d43640 1 --2- 172.21.15.63:0/3311120043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa15c107b70 0x7fa15c107f80 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.577+0000 7fa162d43640 1 --2- 172.21.15.63:0/3311120043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa15c102230 0x7fa15c102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.577+0000 7fa162d43640 1 -- 172.21.15.63:0/3311120043 >> 172.21.15.63:0/3311120043 conn(0x7fa15c079e40 msgr2=0x7fa15c07a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:49.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.577+0000 7fa162d43640 1 -- 172.21.15.63:0/3311120043 shutdown_connections 2024-09-21T06:27:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.577+0000 7fa162d43640 1 -- 172.21.15.63:0/3311120043 wait complete. 2024-09-21T06:27:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.578+0000 7fa162d43640 1 Processor -- start 2024-09-21T06:27:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.578+0000 7fa162d43640 1 -- start start 2024-09-21T06:27:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.578+0000 7fa162d43640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa15c102230 0x7fa15c199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.578+0000 7fa162d43640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa15c107b70 0x7fa15c199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.578+0000 7fa162d43640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa15c1084c0 0x7fa15c19ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.578+0000 7fa162d43640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c112220 con 0x7fa15c102230 2024-09-21T06:27:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.578+0000 7fa162d43640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c1120a0 con 0x7fa15c1084c0 2024-09-21T06:27:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.578+0000 7fa162d43640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c1123a0 con 0x7fa15c107b70 2024-09-21T06:27:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.578+0000 7fa160adf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa15c102230 0x7fa15c199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.578+0000 7fa160adf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa15c102230 0x7fa15c199600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55138/0 (socket says 172.21.15.63:55138) 2024-09-21T06:27:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.578+0000 7fa160adf640 1 -- 172.21.15.63:0/3925089276 learned_addr learned my addr 172.21.15.63:0/3925089276 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.579+0000 7fa15bfff640 1 --2- 172.21.15.63:0/3925089276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa15c107b70 0x7fa15c199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.579+0000 7fa160adf640 1 -- 172.21.15.63:0/3925089276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa15c107b70 msgr2=0x7fa15c199ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.579+0000 7fa160adf640 1 --2- 172.21.15.63:0/3925089276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa15c107b70 0x7fa15c199ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.579+0000 7fa160adf640 1 -- 172.21.15.63:0/3925089276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa15c1084c0 msgr2=0x7fa15c19ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.579+0000 7fa1612e0640 1 --2- 172.21.15.63:0/3925089276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa15c1084c0 0x7fa15c19ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.579+0000 7fa160adf640 1 --2- 172.21.15.63:0/3925089276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa15c1084c0 0x7fa15c19ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.579+0000 7fa160adf640 1 -- 172.21.15.63:0/3925089276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15c19f570 con 0x7fa15c102230 2024-09-21T06:27:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.579+0000 7fa160adf640 1 --2- 172.21.15.63:0/3925089276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa15c102230 0x7fa15c199600 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00b4a0 tx=0x7fa14c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.579+0000 7fa159ffb640 1 -- 172.21.15.63:0/3925089276 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14c014070 con 0x7fa15c102230 2024-09-21T06:27:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.579+0000 7fa159ffb640 1 -- 172.21.15.63:0/3925089276 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa14c010ac0 con 0x7fa15c102230 2024-09-21T06:27:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.579+0000 7fa162d43640 1 -- 172.21.15.63:0/3925089276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa15c19f860 con 0x7fa15c102230 2024-09-21T06:27:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.579+0000 7fa159ffb640 1 -- 172.21.15.63:0/3925089276 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14c017c30 con 0x7fa15c102230 2024-09-21T06:27:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.579+0000 7fa162d43640 1 -- 172.21.15.63:0/3925089276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa15c1a5fc0 con 0x7fa15c102230 2024-09-21T06:27:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.581+0000 7fa162d43640 1 -- 172.21.15.63:0/3925089276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa15c1026c0 con 0x7fa15c102230 2024-09-21T06:27:49.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.582+0000 7fa159ffb640 1 -- 172.21.15.63:0/3925089276 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fa14c017070 con 0x7fa15c102230 2024-09-21T06:27:49.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.583+0000 7fa159ffb640 1 --2- 172.21.15.63:0/3925089276 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa1440b65f0 0x7fa1440b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:49.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.583+0000 7fa15bfff640 1 --2- 172.21.15.63:0/3925089276 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa1440b65f0 0x7fa1440b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:49.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.583+0000 7fa159ffb640 1 -- 172.21.15.63:0/3925089276 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fa14c0e6950 con 0x7fa15c102230 2024-09-21T06:27:49.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.583+0000 7fa15bfff640 1 --2- 172.21.15.63:0/3925089276 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa1440b65f0 0x7fa1440b8b00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa150009230 tx=0x7fa150031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:49.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.587+0000 7fa159ffb640 1 -- 172.21.15.63:0/3925089276 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa14c0acfa0 con 0x7fa15c102230 2024-09-21T06:27:49.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.785+0000 7fa162d43640 1 -- 172.21.15.63:0/3925089276 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fa15c101470 con 0x7fa1440b65f0 2024-09-21T06:27:49.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.786+0000 7fa159ffb640 1 -- 172.21.15.63:0/3925089276 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fa15c101470 con 0x7fa1440b65f0 2024-09-21T06:27:49.788 INFO:teuthology.orchestra.run.smithi063.stdout:HOST ADDR LABELS STATUS 2024-09-21T06:27:49.788 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063 172.21.15.63 2024-09-21T06:27:49.788 INFO:teuthology.orchestra.run.smithi063.stdout:smithi071 172.21.15.71 2024-09-21T06:27:49.788 INFO:teuthology.orchestra.run.smithi063.stdout:smithi175 172.21.15.175 2024-09-21T06:27:49.789 INFO:teuthology.orchestra.run.smithi063.stdout:3 hosts in cluster 2024-09-21T06:27:49.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.789+0000 7fa162d43640 1 -- 172.21.15.63:0/3925089276 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa1440b65f0 msgr2=0x7fa1440b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:49.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.789+0000 7fa162d43640 1 --2- 172.21.15.63:0/3925089276 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa1440b65f0 0x7fa1440b8b00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa150009230 tx=0x7fa150031400 comp rx=0 tx=0).stop 2024-09-21T06:27:49.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.789+0000 7fa162d43640 1 -- 172.21.15.63:0/3925089276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa15c102230 msgr2=0x7fa15c199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:49.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.789+0000 7fa162d43640 1 --2- 172.21.15.63:0/3925089276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa15c102230 0x7fa15c199600 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00b4a0 tx=0x7fa14c00b960 comp rx=0 tx=0).stop 2024-09-21T06:27:49.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.789+0000 7fa162d43640 1 -- 172.21.15.63:0/3925089276 shutdown_connections 2024-09-21T06:27:49.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.789+0000 7fa162d43640 1 --2- 172.21.15.63:0/3925089276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa15c1084c0 0x7fa15c19ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.789+0000 7fa162d43640 1 --2- 172.21.15.63:0/3925089276 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa1440b65f0 0x7fa1440b8b00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.789+0000 7fa162d43640 1 --2- 172.21.15.63:0/3925089276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa15c107b70 0x7fa15c199ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.789+0000 7fa162d43640 1 --2- 172.21.15.63:0/3925089276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa15c102230 0x7fa15c199600 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.789+0000 7fa162d43640 1 -- 172.21.15.63:0/3925089276 >> 172.21.15.63:0/3925089276 conn(0x7fa15c079e40 msgr2=0x7fa15c100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:49.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.790+0000 7fa162d43640 1 -- 172.21.15.63:0/3925089276 shutdown_connections 2024-09-21T06:27:49.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:49.790+0000 7fa162d43640 1 -- 172.21.15.63:0/3925089276 wait complete. 2024-09-21T06:27:50.539 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T06:27:50.802 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:51.235 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:50 smithi063 ceph-mon[31150]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:51.235 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:50 smithi063 ceph-mon[31150]: pgmap v311: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:27:51.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.250+0000 7fa826c90640 1 -- 172.21.15.63:0/1346271721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa820103b60 msgr2=0x7fa820103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:51.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.250+0000 7fa826c90640 1 --2- 172.21.15.63:0/1346271721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa820103b60 0x7fa820103f70 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009900 tx=0x7fa81c02a410 comp rx=0 tx=0).stop 2024-09-21T06:27:51.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.250+0000 7fa826c90640 1 -- 172.21.15.63:0/1346271721 shutdown_connections 2024-09-21T06:27:51.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.250+0000 7fa826c90640 1 --2- 172.21.15.63:0/1346271721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa820109df0 0x7fa820110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:51.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.250+0000 7fa826c90640 1 --2- 172.21.15.63:0/1346271721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8201094a0 0x7fa8201098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:51.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.250+0000 7fa826c90640 1 --2- 172.21.15.63:0/1346271721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa820103b60 0x7fa820103f70 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:51.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.250+0000 7fa826c90640 1 -- 172.21.15.63:0/1346271721 >> 172.21.15.63:0/1346271721 conn(0x7fa82007b850 msgr2=0x7fa82007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:51.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.251+0000 7fa826c90640 1 -- 172.21.15.63:0/1346271721 shutdown_connections 2024-09-21T06:27:51.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.251+0000 7fa826c90640 1 -- 172.21.15.63:0/1346271721 wait complete. 2024-09-21T06:27:51.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.251+0000 7fa826c90640 1 Processor -- start 2024-09-21T06:27:51.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.251+0000 7fa826c90640 1 -- start start 2024-09-21T06:27:51.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.252+0000 7fa826c90640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa820103b60 0x7fa820075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:51.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.252+0000 7fa826c90640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8201094a0 0x7fa820075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:51.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.252+0000 7fa826c90640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa820109df0 0x7fa820076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:51.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.252+0000 7fa826c90640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa820113ab0 con 0x7fa820103b60 2024-09-21T06:27:51.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.252+0000 7fa826c90640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa820113930 con 0x7fa820109df0 2024-09-21T06:27:51.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.252+0000 7fa826c90640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa820113c30 con 0x7fa8201094a0 2024-09-21T06:27:51.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.252+0000 7fa824a2c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa820103b60 0x7fa820075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:51.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.252+0000 7fa824a2c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa820103b60 0x7fa820075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55158/0 (socket says 172.21.15.63:55158) 2024-09-21T06:27:51.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.252+0000 7fa824a2c640 1 -- 172.21.15.63:0/2569696841 learned_addr learned my addr 172.21.15.63:0/2569696841 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:51.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.252+0000 7fa82522d640 1 --2- 172.21.15.63:0/2569696841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa820109df0 0x7fa820076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:51.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.252+0000 7fa817fff640 1 --2- 172.21.15.63:0/2569696841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8201094a0 0x7fa820075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:51.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.252+0000 7fa824a2c640 1 -- 172.21.15.63:0/2569696841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8201094a0 msgr2=0x7fa820075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:51.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.252+0000 7fa824a2c640 1 --2- 172.21.15.63:0/2569696841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8201094a0 0x7fa820075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:51.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.252+0000 7fa824a2c640 1 -- 172.21.15.63:0/2569696841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa820109df0 msgr2=0x7fa820076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:51.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.252+0000 7fa824a2c640 1 --2- 172.21.15.63:0/2569696841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa820109df0 0x7fa820076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:51.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.252+0000 7fa824a2c640 1 -- 172.21.15.63:0/2569696841 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8201a87e0 con 0x7fa820103b60 2024-09-21T06:27:51.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.252+0000 7fa817fff640 1 --2- 172.21.15.63:0/2569696841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8201094a0 0x7fa820075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:51.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.252+0000 7fa824a2c640 1 --2- 172.21.15.63:0/2569696841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa820103b60 0x7fa820075710 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa81c005940 tx=0x7fa81c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:51.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.253+0000 7fa815ffb640 1 -- 172.21.15.63:0/2569696841 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c03f030 con 0x7fa820103b60 2024-09-21T06:27:51.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.253+0000 7fa815ffb640 1 -- 172.21.15.63:0/2569696841 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa81c003cb0 con 0x7fa820103b60 2024-09-21T06:27:51.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.253+0000 7fa826c90640 1 -- 172.21.15.63:0/2569696841 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8201a8a70 con 0x7fa820103b60 2024-09-21T06:27:51.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.253+0000 7fa815ffb640 1 -- 172.21.15.63:0/2569696841 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c035070 con 0x7fa820103b60 2024-09-21T06:27:51.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.253+0000 7fa826c90640 1 -- 172.21.15.63:0/2569696841 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8201a8f50 con 0x7fa820103b60 2024-09-21T06:27:51.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.254+0000 7fa826c90640 1 -- 172.21.15.63:0/2569696841 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa820103f70 con 0x7fa820103b60 2024-09-21T06:27:51.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.256+0000 7fa815ffb640 1 -- 172.21.15.63:0/2569696841 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fa81c042030 con 0x7fa820103b60 2024-09-21T06:27:51.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.256+0000 7fa815ffb640 1 --2- 172.21.15.63:0/2569696841 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa8080b65f0 0x7fa8080b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:51.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.257+0000 7fa817fff640 1 --2- 172.21.15.63:0/2569696841 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa8080b65f0 0x7fa8080b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:51.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.257+0000 7fa815ffb640 1 -- 172.21.15.63:0/2569696841 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fa81c1080a0 con 0x7fa820103b60 2024-09-21T06:27:51.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.257+0000 7fa817fff640 1 --2- 172.21.15.63:0/2569696841 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa8080b65f0 0x7fa8080b8b00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa8100058c0 tx=0x7fa810005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:51.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.260+0000 7fa815ffb640 1 -- 172.21.15.63:0/2569696841 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa81c0ce790 con 0x7fa820103b60 2024-09-21T06:27:51.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:50 smithi071 ceph-mon[34844]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:51.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:50 smithi071 ceph-mon[34844]: pgmap v311: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:27:51.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:50 smithi175 ceph-mon[34510]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:51.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:50 smithi175 ceph-mon[34510]: pgmap v311: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:27:51.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.455+0000 7fa826c90640 1 -- 172.21.15.63:0/2569696841 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fa820063800 con 0x7fa8080b65f0 2024-09-21T06:27:51.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.457+0000 7fa815ffb640 1 -- 172.21.15.63:0/2569696841 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fa820063800 con 0x7fa8080b65f0 2024-09-21T06:27:51.459 INFO:teuthology.orchestra.run.smithi063.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T06:27:51.459 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5344005B400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T06:27:51.459 INFO:teuthology.orchestra.run.smithi063.stdout:smithi071 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040172400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T06:27:51.459 INFO:teuthology.orchestra.run.smithi063.stdout:smithi175 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300M0400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T06:27:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.459+0000 7fa826c90640 1 -- 172.21.15.63:0/2569696841 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa8080b65f0 msgr2=0x7fa8080b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.459+0000 7fa826c90640 1 --2- 172.21.15.63:0/2569696841 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa8080b65f0 0x7fa8080b8b00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa8100058c0 tx=0x7fa810005850 comp rx=0 tx=0).stop 2024-09-21T06:27:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.459+0000 7fa826c90640 1 -- 172.21.15.63:0/2569696841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa820103b60 msgr2=0x7fa820075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.459+0000 7fa826c90640 1 --2- 172.21.15.63:0/2569696841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa820103b60 0x7fa820075710 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa81c005940 tx=0x7fa81c0042f0 comp rx=0 tx=0).stop 2024-09-21T06:27:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.459+0000 7fa826c90640 1 -- 172.21.15.63:0/2569696841 shutdown_connections 2024-09-21T06:27:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.459+0000 7fa826c90640 1 --2- 172.21.15.63:0/2569696841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa820109df0 0x7fa820076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.459+0000 7fa826c90640 1 --2- 172.21.15.63:0/2569696841 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa8080b65f0 0x7fa8080b8b00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.459+0000 7fa826c90640 1 --2- 172.21.15.63:0/2569696841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8201094a0 0x7fa820075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.459+0000 7fa826c90640 1 --2- 172.21.15.63:0/2569696841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa820103b60 0x7fa820075710 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.459+0000 7fa826c90640 1 -- 172.21.15.63:0/2569696841 >> 172.21.15.63:0/2569696841 conn(0x7fa82007b850 msgr2=0x7fa820107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.459+0000 7fa826c90640 1 -- 172.21.15.63:0/2569696841 shutdown_connections 2024-09-21T06:27:51.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:51.459+0000 7fa826c90640 1 -- 172.21.15.63:0/2569696841 wait complete. 2024-09-21T06:27:52.249 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:52 smithi063 ceph-mon[31150]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:52.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:52 smithi071 ceph-mon[34844]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:52.281 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T06:27:52.290 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T06:27:52.291 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T06:27:52.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:52 smithi175 ceph-mon[34510]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:52.549 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:53.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.028+0000 7ff284c4d640 1 -- 172.21.15.63:0/676384533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff280105290 msgr2=0x7ff28010d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:53.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.028+0000 7ff284c4d640 1 --2- 172.21.15.63:0/676384533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff280105290 0x7ff28010d8d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff268009900 tx=0x7ff26802a410 comp rx=0 tx=0).stop 2024-09-21T06:27:53.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.028+0000 7ff284c4d640 1 -- 172.21.15.63:0/676384533 shutdown_connections 2024-09-21T06:27:53.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.028+0000 7ff284c4d640 1 --2- 172.21.15.63:0/676384533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff28010de10 0x7ff2801102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.028+0000 7ff284c4d640 1 --2- 172.21.15.63:0/676384533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff280105290 0x7ff28010d8d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.028+0000 7ff284c4d640 1 --2- 172.21.15.63:0/676384533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff280104860 0x7ff280104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.028+0000 7ff284c4d640 1 -- 172.21.15.63:0/676384533 >> 172.21.15.63:0/676384533 conn(0x7ff280079730 msgr2=0x7ff280079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:53.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.028+0000 7ff284c4d640 1 -- 172.21.15.63:0/676384533 shutdown_connections 2024-09-21T06:27:53.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.028+0000 7ff284c4d640 1 -- 172.21.15.63:0/676384533 wait complete. 2024-09-21T06:27:53.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.029+0000 7ff284c4d640 1 Processor -- start 2024-09-21T06:27:53.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.029+0000 7ff284c4d640 1 -- start start 2024-09-21T06:27:53.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.029+0000 7ff284c4d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff280104860 0x7ff280102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:53.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.029+0000 7ff284c4d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff280105290 0x7ff280102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:53.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.029+0000 7ff284c4d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff28010de10 0x7ff2801031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:53.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.029+0000 7ff284c4d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff280113b20 con 0x7ff280105290 2024-09-21T06:27:53.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.029+0000 7ff284c4d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff2801139a0 con 0x7ff280104860 2024-09-21T06:27:53.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.029+0000 7ff284c4d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff280113ca0 con 0x7ff28010de10 2024-09-21T06:27:53.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.029+0000 7ff27dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff280105290 0x7ff280102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:53.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.029+0000 7ff27dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff280105290 0x7ff280102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55164/0 (socket says 172.21.15.63:55164) 2024-09-21T06:27:53.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.029+0000 7ff27dd9b640 1 -- 172.21.15.63:0/348607249 learned_addr learned my addr 172.21.15.63:0/348607249 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:53.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.029+0000 7ff27e59c640 1 --2- 172.21.15.63:0/348607249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff280104860 0x7ff280102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:53.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.029+0000 7ff27ed9d640 1 --2- 172.21.15.63:0/348607249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff28010de10 0x7ff2801031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:53.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.030+0000 7ff27dd9b640 1 -- 172.21.15.63:0/348607249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff28010de10 msgr2=0x7ff2801031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:53.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.030+0000 7ff27dd9b640 1 --2- 172.21.15.63:0/348607249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff28010de10 0x7ff2801031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.030+0000 7ff27dd9b640 1 -- 172.21.15.63:0/348607249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff280104860 msgr2=0x7ff280102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:53.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.030+0000 7ff27dd9b640 1 --2- 172.21.15.63:0/348607249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff280104860 0x7ff280102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.030+0000 7ff27dd9b640 1 -- 172.21.15.63:0/348607249 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2801a88d0 con 0x7ff280105290 2024-09-21T06:27:53.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.030+0000 7ff27ed9d640 1 --2- 172.21.15.63:0/348607249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff28010de10 0x7ff2801031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:53.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.030+0000 7ff27dd9b640 1 --2- 172.21.15.63:0/348607249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff280105290 0x7ff280102cb0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff26802a930 tx=0x7ff268004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:53.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.030+0000 7ff2777fe640 1 -- 172.21.15.63:0/348607249 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26803f030 con 0x7ff280105290 2024-09-21T06:27:53.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.030+0000 7ff2777fe640 1 -- 172.21.15.63:0/348607249 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff268003aa0 con 0x7ff280105290 2024-09-21T06:27:53.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.030+0000 7ff2777fe640 1 -- 172.21.15.63:0/348607249 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268035070 con 0x7ff280105290 2024-09-21T06:27:53.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.030+0000 7ff284c4d640 1 -- 172.21.15.63:0/348607249 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2801a8b60 con 0x7ff280105290 2024-09-21T06:27:53.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.030+0000 7ff284c4d640 1 -- 172.21.15.63:0/348607249 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2801a9070 con 0x7ff280105290 2024-09-21T06:27:53.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.031+0000 7ff284c4d640 1 -- 172.21.15.63:0/348607249 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff280104cf0 con 0x7ff280105290 2024-09-21T06:27:53.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.033+0000 7ff2777fe640 1 -- 172.21.15.63:0/348607249 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7ff268042030 con 0x7ff280105290 2024-09-21T06:27:53.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.034+0000 7ff2777fe640 1 --2- 172.21.15.63:0/348607249 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff26c0b6670 0x7ff26c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:53.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.034+0000 7ff27e59c640 1 --2- 172.21.15.63:0/348607249 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff26c0b6670 0x7ff26c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:53.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.034+0000 7ff2777fe640 1 -- 172.21.15.63:0/348607249 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ff268108150 con 0x7ff280105290 2024-09-21T06:27:53.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.035+0000 7ff27e59c640 1 --2- 172.21.15.63:0/348607249 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff26c0b6670 0x7ff26c0b8b80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff2801041c0 tx=0x7ff270009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:53.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.037+0000 7ff2777fe640 1 -- 172.21.15.63:0/348607249 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff2680ce7a0 con 0x7ff280105290 2024-09-21T06:27:53.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.264+0000 7ff284c4d640 1 -- 172.21.15.63:0/348607249 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff280103a70 con 0x7ff280105290 2024-09-21T06:27:53.266 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:53 smithi063 ceph-mon[31150]: pgmap v312: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:53.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.264+0000 7ff2777fe640 1 -- 172.21.15.63:0/348607249 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3125 (secure 0 0 0) 0x7ff280103a70 con 0x7ff280105290 2024-09-21T06:27:53.266 INFO:teuthology.orchestra.run.smithi063.stdout:e28 2024-09-21T06:27:53.266 INFO:teuthology.orchestra.run.smithi063.stdout:btime 2024-09-21T06:26:30:754530+0000 2024-09-21T06:27:53.267 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T06:27:53.267 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:27:53.267 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2024-09-21T06:27:53.267 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:27:53.267 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2024-09-21T06:27:53.267 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2024-09-21T06:27:53.267 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 28 2024-09-21T06:27:53.267 INFO:teuthology.orchestra.run.smithi063.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T06:27:53.267 INFO:teuthology.orchestra.run.smithi063.stdout:created 2024-09-21T06:26:18.960208+0000 2024-09-21T06:27:53.267 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2024-09-21T06:26:30.006003+0000 2024-09-21T06:27:53.267 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2024-09-21T06:27:53.267 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2024-09-21T06:27:53.267 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 300 2024-09-21T06:27:53.267 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2024-09-21T06:27:53.268 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2024-09-21T06:27:53.268 INFO:teuthology.orchestra.run.smithi063.stdout:max_xattr_size 65536 2024-09-21T06:27:53.268 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2024-09-21T06:27:53.268 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2024-09-21T06:27:53.268 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 0 2024-09-21T06:27:53.268 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:27:53.268 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 5 2024-09-21T06:27:53.268 INFO:teuthology.orchestra.run.smithi063.stdout:in 0,1,2,3,4 2024-09-21T06:27:53.268 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=24698,1=24694,2=24676,3=24670,4=14835} 2024-09-21T06:27:53.268 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2024-09-21T06:27:53.268 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2024-09-21T06:27:53.268 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2024-09-21T06:27:53.268 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2024-09-21T06:27:53.268 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2024-09-21T06:27:53.269 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data disabled 2024-09-21T06:27:53.269 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2024-09-21T06:27:53.269 INFO:teuthology.orchestra.run.smithi063.stdout:bal_rank_mask -1 2024-09-21T06:27:53.269 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 0 2024-09-21T06:27:53.269 INFO:teuthology.orchestra.run.smithi063.stdout:qdb_cluster leader: 24698 members: 14835,24676,24670,24694,24698 2024-09-21T06:27:53.269 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b{0:24698} state up:active seq 4 addr [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:27:53.269 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.h{0:24659} state up:standby-replay seq 1 addr [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:27:53.269 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.i{1:24694} state up:active seq 8 addr [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:27:53.269 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.e{1:24635} state up:standby-replay seq 1 addr [v2:172.21.15.71:6834/946121091,v1:172.21.15.71:6835/946121091] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:27:53.269 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.c{2:24676} state up:active seq 9 addr [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:27:53.269 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.l{2:24622} state up:standby-replay seq 1 addr [v2:172.21.15.175:6832/825731342,v1:172.21.15.175:6833/825731342] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:27:53.269 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.f{3:24670} state up:active seq 10 addr [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:27:53.269 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.k{3:24608} state up:standby-replay seq 1 addr [v2:172.21.15.71:6832/3879125360,v1:172.21.15.71:6833/3879125360] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:27:53.269 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a{4:14835} state up:active seq 7 addr [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:27:53.269 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.g{4:14823} state up:standby-replay seq 1 addr [v2:172.21.15.63:6838/2446248912,v1:172.21.15.63:6839/2446248912] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:27:53.270 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:27:53.270 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:27:53.270 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2024-09-21T06:27:53.270 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:27:53.270 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.j{-1:14748} state up:standby seq 1 addr [v2:172.21.15.63:6834/4115433943,v1:172.21.15.63:6835/4115433943] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:27:53.270 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.d{-1:14760} state up:standby seq 1 addr [v2:172.21.15.63:6836/3545415905,v1:172.21.15.63:6837/3545415905] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:27:53.271 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 28 2024-09-21T06:27:53.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.266+0000 7ff284c4d640 1 -- 172.21.15.63:0/348607249 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff26c0b6670 msgr2=0x7ff26c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:53.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.266+0000 7ff284c4d640 1 --2- 172.21.15.63:0/348607249 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff26c0b6670 0x7ff26c0b8b80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff2801041c0 tx=0x7ff270009110 comp rx=0 tx=0).stop 2024-09-21T06:27:53.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.266+0000 7ff284c4d640 1 -- 172.21.15.63:0/348607249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff280105290 msgr2=0x7ff280102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:53.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.266+0000 7ff284c4d640 1 --2- 172.21.15.63:0/348607249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff280105290 0x7ff280102cb0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff26802a930 tx=0x7ff268004270 comp rx=0 tx=0).stop 2024-09-21T06:27:53.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.266+0000 7ff284c4d640 1 -- 172.21.15.63:0/348607249 shutdown_connections 2024-09-21T06:27:53.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.266+0000 7ff284c4d640 1 --2- 172.21.15.63:0/348607249 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff26c0b6670 0x7ff26c0b8b80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.266+0000 7ff284c4d640 1 --2- 172.21.15.63:0/348607249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff28010de10 0x7ff2801031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.266+0000 7ff284c4d640 1 --2- 172.21.15.63:0/348607249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff280105290 0x7ff280102cb0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.266+0000 7ff284c4d640 1 --2- 172.21.15.63:0/348607249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff280104860 0x7ff280102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.266+0000 7ff284c4d640 1 -- 172.21.15.63:0/348607249 >> 172.21.15.63:0/348607249 conn(0x7ff280079730 msgr2=0x7ff2801009c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:53.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.267+0000 7ff284c4d640 1 -- 172.21.15.63:0/348607249 shutdown_connections 2024-09-21T06:27:53.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:53.267+0000 7ff284c4d640 1 -- 172.21.15.63:0/348607249 wait complete. 2024-09-21T06:27:53.272 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:53 smithi071 ceph-mon[34844]: pgmap v312: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:53.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:53 smithi175 ceph-mon[34510]: pgmap v312: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:54.064 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T06:27:54.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:54 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/348607249' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T06:27:54.330 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:54.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:54 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/348607249' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T06:27:54.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:54 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/348607249' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T06:27:54.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.780+0000 7f15f9bdb640 1 -- 172.21.15.63:0/2061528423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15f41083a0 msgr2=0x7f15f41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:54.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.780+0000 7f15f9bdb640 1 --2- 172.21.15.63:0/2061528423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15f41083a0 0x7f15f41087b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009900 tx=0x7f15dc02a410 comp rx=0 tx=0).stop 2024-09-21T06:27:54.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.780+0000 7f15f9bdb640 1 -- 172.21.15.63:0/2061528423 shutdown_connections 2024-09-21T06:27:54.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.780+0000 7f15f9bdb640 1 --2- 172.21.15.63:0/2061528423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f4108cf0 0x7f15f410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:54.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.780+0000 7f15f9bdb640 1 --2- 172.21.15.63:0/2061528423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15f41083a0 0x7f15f41087b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.780+0000 7f15f9bdb640 1 --2- 172.21.15.63:0/2061528423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15f4102a60 0x7f15f4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.780+0000 7f15f9bdb640 1 -- 172.21.15.63:0/2061528423 >> 172.21.15.63:0/2061528423 conn(0x7f15f4079730 msgr2=0x7f15f4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.780+0000 7f15f9bdb640 1 -- 172.21.15.63:0/2061528423 shutdown_connections 2024-09-21T06:27:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.780+0000 7f15f9bdb640 1 -- 172.21.15.63:0/2061528423 wait complete. 2024-09-21T06:27:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.781+0000 7f15f9bdb640 1 Processor -- start 2024-09-21T06:27:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.781+0000 7f15f9bdb640 1 -- start start 2024-09-21T06:27:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.781+0000 7f15f9bdb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15f4102a60 0x7f15f419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.781+0000 7f15f9bdb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15f41083a0 0x7f15f419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.781+0000 7f15f9bdb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f4108cf0 0x7f15f419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.781+0000 7f15f9bdb640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f15f4112960 con 0x7f15f41083a0 2024-09-21T06:27:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.781+0000 7f15f9bdb640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f15f41127e0 con 0x7f15f4108cf0 2024-09-21T06:27:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.782+0000 7f15f9bdb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f15f4112ae0 con 0x7f15f4102a60 2024-09-21T06:27:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.782+0000 7f15f2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15f41083a0 0x7f15f419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:54.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.782+0000 7f15f2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15f41083a0 0x7f15f419aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55184/0 (socket says 172.21.15.63:55184) 2024-09-21T06:27:54.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.782+0000 7f15f2ffd640 1 -- 172.21.15.63:0/4097261803 learned_addr learned my addr 172.21.15.63:0/4097261803 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:54.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.782+0000 7f15f37fe640 1 --2- 172.21.15.63:0/4097261803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15f4102a60 0x7f15f419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:54.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.782+0000 7f15f3fff640 1 --2- 172.21.15.63:0/4097261803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f4108cf0 0x7f15f419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:54.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.782+0000 7f15f2ffd640 1 -- 172.21.15.63:0/4097261803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15f4102a60 msgr2=0x7f15f419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:54.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.782+0000 7f15f2ffd640 1 --2- 172.21.15.63:0/4097261803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15f4102a60 0x7f15f419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:54.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.782+0000 7f15f2ffd640 1 -- 172.21.15.63:0/4097261803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f4108cf0 msgr2=0x7f15f419fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:54.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.782+0000 7f15f2ffd640 1 --2- 172.21.15.63:0/4097261803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f4108cf0 0x7f15f419fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:54.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.782+0000 7f15f2ffd640 1 -- 172.21.15.63:0/4097261803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f41a03f0 con 0x7f15f41083a0 2024-09-21T06:27:54.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.782+0000 7f15f2ffd640 1 --2- 172.21.15.63:0/4097261803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15f41083a0 0x7f15f419aa20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f15dc032fd0 tx=0x7f15dc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:54.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.782+0000 7f15f0ff9640 1 -- 172.21.15.63:0/4097261803 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15dc03f030 con 0x7f15f41083a0 2024-09-21T06:27:54.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.782+0000 7f15f9bdb640 1 -- 172.21.15.63:0/4097261803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15f41a0680 con 0x7f15f41083a0 2024-09-21T06:27:54.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.782+0000 7f15f0ff9640 1 -- 172.21.15.63:0/4097261803 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15dc004490 con 0x7f15f41083a0 2024-09-21T06:27:54.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.782+0000 7f15f0ff9640 1 -- 172.21.15.63:0/4097261803 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15dc035070 con 0x7f15f41083a0 2024-09-21T06:27:54.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.783+0000 7f15f9bdb640 1 -- 172.21.15.63:0/4097261803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15f41a6e40 con 0x7f15f41083a0 2024-09-21T06:27:54.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.783+0000 7f15f9bdb640 1 -- 172.21.15.63:0/4097261803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15f4102e70 con 0x7f15f41083a0 2024-09-21T06:27:54.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.785+0000 7f15f0ff9640 1 -- 172.21.15.63:0/4097261803 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f15dc042030 con 0x7f15f41083a0 2024-09-21T06:27:54.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.786+0000 7f15f0ff9640 1 --2- 172.21.15.63:0/4097261803 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f15e00b65f0 0x7f15e00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:54.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.786+0000 7f15f37fe640 1 --2- 172.21.15.63:0/4097261803 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f15e00b65f0 0x7f15e00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:54.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.786+0000 7f15f0ff9640 1 -- 172.21.15.63:0/4097261803 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f15dc107ed0 con 0x7f15f41083a0 2024-09-21T06:27:54.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.786+0000 7f15f37fe640 1 --2- 172.21.15.63:0/4097261803 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f15e00b65f0 0x7f15e00b8b00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f15e4005fd0 tx=0x7f15e4009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:54.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.791+0000 7f15f0ff9640 1 -- 172.21.15.63:0/4097261803 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f15dc0ce520 con 0x7f15f41083a0 2024-09-21T06:27:54.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.982+0000 7f15f9bdb640 1 -- 172.21.15.63:0/4097261803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f15f419b5b0 con 0x7f15f41083a0 2024-09-21T06:27:54.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.983+0000 7f15f0ff9640 1 -- 172.21.15.63:0/4097261803 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v77) ==== 56+0+5675 (secure 0 0 0) 0x7f15f419b5b0 con 0x7f15f41083a0 2024-09-21T06:27:54.985 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 77 2024-09-21T06:27:54.985 INFO:teuthology.orchestra.run.smithi063.stdout:fsid 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:27:54.985 INFO:teuthology.orchestra.run.smithi063.stdout:created 2024-09-21T06:17:48.089366+0000 2024-09-21T06:27:54.985 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2024-09-21T06:26:38.957699+0000 2024-09-21T06:27:54.985 INFO:teuthology.orchestra.run.smithi063.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T06:27:54.986 INFO:teuthology.orchestra.run.smithi063.stdout:crush_version 26 2024-09-21T06:27:54.986 INFO:teuthology.orchestra.run.smithi063.stdout:full_ratio 0.95 2024-09-21T06:27:54.986 INFO:teuthology.orchestra.run.smithi063.stdout:backfillfull_ratio 0.9 2024-09-21T06:27:54.986 INFO:teuthology.orchestra.run.smithi063.stdout:nearfull_ratio 0.85 2024-09-21T06:27:54.986 INFO:teuthology.orchestra.run.smithi063.stdout:require_min_compat_client luminous 2024-09-21T06:27:54.986 INFO:teuthology.orchestra.run.smithi063.stdout:min_compat_client luminous 2024-09-21T06:27:54.986 INFO:teuthology.orchestra.run.smithi063.stdout:require_osd_release squid 2024-09-21T06:27:54.986 INFO:teuthology.orchestra.run.smithi063.stdout:stretch_mode_enabled false 2024-09-21T06:27:54.986 INFO:teuthology.orchestra.run.smithi063.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T06:27:54.986 INFO:teuthology.orchestra.run.smithi063.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-21T06:27:54.986 INFO:teuthology.orchestra.run.smithi063.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-21T06:27:54.986 INFO:teuthology.orchestra.run.smithi063.stdout:max_osd 12 2024-09-21T06:27:54.986 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 up in weight 1 up_from 9 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6802/2090653772,v1:172.21.15.63:6803/2090653772] [v2:172.21.15.63:6804/2090653772,v1:172.21.15.63:6805/2090653772] exists,up df4162c1-dd66-4d11-99bc-0ae36ea130f0 2024-09-21T06:27:54.987 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 up in weight 1 up_from 14 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6800/1676297548,v1:172.21.15.71:6801/1676297548] [v2:172.21.15.71:6802/1676297548,v1:172.21.15.71:6803/1676297548] exists,up 65a12def-9f66-4153-8f1a-2ebfbbfeba99 2024-09-21T06:27:54.987 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 up in weight 1 up_from 19 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6800/2356865390,v1:172.21.15.175:6801/2356865390] [v2:172.21.15.175:6802/2356865390,v1:172.21.15.175:6803/2356865390] exists,up 031daa9e-9d4a-4901-95e8-695db5671fb4 2024-09-21T06:27:54.987 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 up in weight 1 up_from 25 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6810/31683339,v1:172.21.15.63:6811/31683339] [v2:172.21.15.63:6812/31683339,v1:172.21.15.63:6813/31683339] exists,up 75d23a7a-c560-4b26-84a4-74d6772a37ce 2024-09-21T06:27:54.987 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 up in weight 1 up_from 30 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6808/829449898,v1:172.21.15.71:6809/829449898] [v2:172.21.15.71:6810/829449898,v1:172.21.15.71:6811/829449898] exists,up 6aaefd09-93dd-4f21-9b3c-701a7ff97f61 2024-09-21T06:27:54.987 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 up in weight 1 up_from 35 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6808/3005600597,v1:172.21.15.175:6809/3005600597] [v2:172.21.15.175:6810/3005600597,v1:172.21.15.175:6811/3005600597] exists,up 91f28121-c94e-4012-b74c-dd4597545e3e 2024-09-21T06:27:54.987 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6 up in weight 1 up_from 41 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6818/4044730408,v1:172.21.15.63:6819/4044730408] [v2:172.21.15.63:6820/4044730408,v1:172.21.15.63:6821/4044730408] exists,up bda28014-4dca-40f1-bb23-3ef61605c1ca 2024-09-21T06:27:54.987 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7 up in weight 1 up_from 46 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6816/2913027708,v1:172.21.15.71:6817/2913027708] [v2:172.21.15.71:6818/2913027708,v1:172.21.15.71:6819/2913027708] exists,up a9026588-ccdc-4e6c-b628-1ac8a7dbfa64 2024-09-21T06:27:54.987 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8 up in weight 1 up_from 52 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6816/2058692148,v1:172.21.15.175:6817/2058692148] [v2:172.21.15.175:6818/2058692148,v1:172.21.15.175:6819/2058692148] exists,up 2e1dacea-483c-4587-8d19-5c77a7b98667 2024-09-21T06:27:54.987 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9 up in weight 1 up_from 58 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6826/3278012285,v1:172.21.15.63:6827/3278012285] [v2:172.21.15.63:6828/3278012285,v1:172.21.15.63:6829/3278012285] exists,up 7077ba4d-1fce-4197-a556-8b6a859c6f82 2024-09-21T06:27:54.987 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10 up in weight 1 up_from 63 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6824/3297929438,v1:172.21.15.71:6825/3297929438] [v2:172.21.15.71:6826/3297929438,v1:172.21.15.71:6827/3297929438] exists,up 99965496-91ee-4eef-9f2e-8f9c8dc54f39 2024-09-21T06:27:54.987 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11 up in weight 1 up_from 69 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6824/1970094291,v1:172.21.15.175:6825/1970094291] [v2:172.21.15.175:6826/1970094291,v1:172.21.15.175:6827/1970094291] exists,up 1b26d1a8-91a4-4877-ad1c-18160a1b3b6c 2024-09-21T06:27:54.987 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 2.2 [7,11] 2024-09-21T06:27:54.987 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 2.5 [8,11] 2024-09-21T06:27:54.988 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 2.10 [2,4] 2024-09-21T06:27:54.988 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 2.16 [2,4] 2024-09-21T06:27:54.988 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 2.1f [8,1] 2024-09-21T06:27:54.988 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 3.c [3,9] 2024-09-21T06:27:54.988 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 3.1b [5,9,4,6] 2024-09-21T06:27:54.988 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 3.23 [4,8] 2024-09-21T06:27:54.988 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 3.36 [4,9] 2024-09-21T06:27:54.988 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:0/1652196301 expires 2024-09-22T06:19:37.776447+0000 2024-09-21T06:27:54.988 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:6801/1479125434 expires 2024-09-22T06:19:37.776447+0000 2024-09-21T06:27:54.988 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:0/2740830999 expires 2024-09-22T06:18:10.293119+0000 2024-09-21T06:27:54.988 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:6800/63967018 expires 2024-09-22T06:18:10.293119+0000 2024-09-21T06:27:54.988 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:6801/152956176 expires 2024-09-22T06:18:36.864948+0000 2024-09-21T06:27:54.988 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:6801/63967018 expires 2024-09-22T06:18:10.293119+0000 2024-09-21T06:27:54.988 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:0/2958589237 expires 2024-09-22T06:18:36.864948+0000 2024-09-21T06:27:54.989 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:0/1398493582 expires 2024-09-22T06:18:36.864948+0000 2024-09-21T06:27:54.989 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:0/3529491525 expires 2024-09-22T06:18:10.293119+0000 2024-09-21T06:27:54.989 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:0/363262068 expires 2024-09-22T06:18:10.293119+0000 2024-09-21T06:27:54.989 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:6800/152956176 expires 2024-09-22T06:18:36.864948+0000 2024-09-21T06:27:54.989 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:6800/1479125434 expires 2024-09-22T06:19:37.776447+0000 2024-09-21T06:27:54.989 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:0/3928056461 expires 2024-09-22T06:18:36.864948+0000 2024-09-21T06:27:54.989 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:0/128321401 expires 2024-09-22T06:19:37.776447+0000 2024-09-21T06:27:54.989 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:0/39222803 expires 2024-09-22T06:19:37.776447+0000 2024-09-21T06:27:54.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.986+0000 7f15f9bdb640 1 -- 172.21.15.63:0/4097261803 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f15e00b65f0 msgr2=0x7f15e00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:54.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.986+0000 7f15f9bdb640 1 --2- 172.21.15.63:0/4097261803 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f15e00b65f0 0x7f15e00b8b00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f15e4005fd0 tx=0x7f15e4009680 comp rx=0 tx=0).stop 2024-09-21T06:27:54.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.986+0000 7f15f9bdb640 1 -- 172.21.15.63:0/4097261803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15f41083a0 msgr2=0x7f15f419aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:54.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.986+0000 7f15f9bdb640 1 --2- 172.21.15.63:0/4097261803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15f41083a0 0x7f15f419aa20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f15dc032fd0 tx=0x7f15dc004270 comp rx=0 tx=0).stop 2024-09-21T06:27:54.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.986+0000 7f15f9bdb640 1 -- 172.21.15.63:0/4097261803 shutdown_connections 2024-09-21T06:27:54.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.986+0000 7f15f9bdb640 1 --2- 172.21.15.63:0/4097261803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f4108cf0 0x7f15f419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:54.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.986+0000 7f15f9bdb640 1 --2- 172.21.15.63:0/4097261803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15f41083a0 0x7f15f419aa20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:54.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.986+0000 7f15f9bdb640 1 --2- 172.21.15.63:0/4097261803 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f15e00b65f0 0x7f15e00b8b00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:54.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.986+0000 7f15f9bdb640 1 --2- 172.21.15.63:0/4097261803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15f4102a60 0x7f15f419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:54.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.986+0000 7f15f9bdb640 1 -- 172.21.15.63:0/4097261803 >> 172.21.15.63:0/4097261803 conn(0x7f15f4079730 msgr2=0x7f15f406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:54.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.986+0000 7f15f9bdb640 1 -- 172.21.15.63:0/4097261803 shutdown_connections 2024-09-21T06:27:54.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:54.986+0000 7f15f9bdb640 1 -- 172.21.15.63:0/4097261803 wait complete. 2024-09-21T06:27:55.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:55 smithi063 ceph-mon[31150]: pgmap v313: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:55.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:55 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/4097261803' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T06:27:55.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:55 smithi071 ceph-mon[34844]: pgmap v313: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:55.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:55 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/4097261803' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T06:27:55.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:55 smithi175 ceph-mon[34510]: pgmap v313: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:27:55.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:55 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/4097261803' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T06:27:55.761 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T06:27:55.866 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:27:56.145 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:56.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.608+0000 7ff78fe30640 1 -- 172.21.15.63:0/1546345202 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff788076100 msgr2=0x7ff78810fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:56.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.608+0000 7ff78fe30640 1 --2- 172.21.15.63:0/1546345202 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff788076100 0x7ff78810fb80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff778009900 tx=0x7ff77802a410 comp rx=0 tx=0).stop 2024-09-21T06:27:56.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.608+0000 7ff78fe30640 1 -- 172.21.15.63:0/1546345202 shutdown_connections 2024-09-21T06:27:56.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.608+0000 7ff78fe30640 1 --2- 172.21.15.63:0/1546345202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7881100c0 0x7ff788112500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.608+0000 7ff78fe30640 1 --2- 172.21.15.63:0/1546345202 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff788076100 0x7ff78810fb80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.608+0000 7ff78fe30640 1 --2- 172.21.15.63:0/1546345202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7880757b0 0x7ff788075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.608+0000 7ff78fe30640 1 -- 172.21.15.63:0/1546345202 >> 172.21.15.63:0/1546345202 conn(0x7ff78807b850 msgr2=0x7ff78807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.608+0000 7ff78fe30640 1 -- 172.21.15.63:0/1546345202 shutdown_connections 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.608+0000 7ff78fe30640 1 -- 172.21.15.63:0/1546345202 wait complete. 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.608+0000 7ff78fe30640 1 Processor -- start 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.609+0000 7ff78fe30640 1 -- start start 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.609+0000 7ff78fe30640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7880757b0 0x7ff78819c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.609+0000 7ff78fe30640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff788076100 0x7ff78819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.609+0000 7ff78fe30640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7881100c0 0x7ff7881a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.609+0000 7ff78fe30640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff788115c70 con 0x7ff788076100 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.609+0000 7ff78fe30640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff788115af0 con 0x7ff7880757b0 2024-09-21T06:27:56.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.609+0000 7ff78fe30640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff788115df0 con 0x7ff7881100c0 2024-09-21T06:27:56.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.609+0000 7ff78d3cb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff788076100 0x7ff78819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:56.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.609+0000 7ff78d3cb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff788076100 0x7ff78819cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42480/0 (socket says 172.21.15.63:42480) 2024-09-21T06:27:56.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.609+0000 7ff78d3cb640 1 -- 172.21.15.63:0/3825754673 learned_addr learned my addr 172.21.15.63:0/3825754673 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:56.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.609+0000 7ff78dbcc640 1 --2- 172.21.15.63:0/3825754673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7880757b0 0x7ff78819c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:56.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.609+0000 7ff78e3cd640 1 --2- 172.21.15.63:0/3825754673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7881100c0 0x7ff7881a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:56.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.609+0000 7ff78d3cb640 1 -- 172.21.15.63:0/3825754673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7881100c0 msgr2=0x7ff7881a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:56.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.609+0000 7ff78d3cb640 1 --2- 172.21.15.63:0/3825754673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7881100c0 0x7ff7881a1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:56.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.609+0000 7ff78d3cb640 1 -- 172.21.15.63:0/3825754673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7880757b0 msgr2=0x7ff78819c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:56.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.609+0000 7ff78d3cb640 1 --2- 172.21.15.63:0/3825754673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7880757b0 0x7ff78819c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:56.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.609+0000 7ff78d3cb640 1 -- 172.21.15.63:0/3825754673 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7881a2590 con 0x7ff788076100 2024-09-21T06:27:56.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.610+0000 7ff78d3cb640 1 --2- 172.21.15.63:0/3825754673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff788076100 0x7ff78819cc80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff778032fd0 tx=0x7ff778004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:56.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.610+0000 7ff77effd640 1 -- 172.21.15.63:0/3825754673 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77803f030 con 0x7ff788076100 2024-09-21T06:27:56.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.610+0000 7ff77effd640 1 -- 172.21.15.63:0/3825754673 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff778004490 con 0x7ff788076100 2024-09-21T06:27:56.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.610+0000 7ff78fe30640 1 -- 172.21.15.63:0/3825754673 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7881a2820 con 0x7ff788076100 2024-09-21T06:27:56.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.610+0000 7ff77effd640 1 -- 172.21.15.63:0/3825754673 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff778035070 con 0x7ff788076100 2024-09-21T06:27:56.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.610+0000 7ff78fe30640 1 -- 172.21.15.63:0/3825754673 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7881a2d00 con 0x7ff788076100 2024-09-21T06:27:56.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.611+0000 7ff78fe30640 1 -- 172.21.15.63:0/3825754673 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff788075bc0 con 0x7ff788076100 2024-09-21T06:27:56.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.613+0000 7ff77effd640 1 -- 172.21.15.63:0/3825754673 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7ff778042030 con 0x7ff788076100 2024-09-21T06:27:56.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.613+0000 7ff77effd640 1 --2- 172.21.15.63:0/3825754673 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7740b6620 0x7ff7740b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:56.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.614+0000 7ff78dbcc640 1 --2- 172.21.15.63:0/3825754673 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7740b6620 0x7ff7740b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:56.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.614+0000 7ff77effd640 1 -- 172.21.15.63:0/3825754673 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ff778107ed0 con 0x7ff788076100 2024-09-21T06:27:56.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.614+0000 7ff78dbcc640 1 --2- 172.21.15.63:0/3825754673 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7740b6620 0x7ff7740b8b30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff784005fd0 tx=0x7ff78400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:56.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.617+0000 7ff77effd640 1 -- 172.21.15.63:0/3825754673 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff7780ce520 con 0x7ff788076100 2024-09-21T06:27:56.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.842+0000 7ff78fe30640 1 -- 172.21.15.63:0/3825754673 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff78819d810 con 0x7ff788076100 2024-09-21T06:27:56.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.843+0000 7ff77effd640 1 -- 172.21.15.63:0/3825754673 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11969 (secure 0 0 0) 0x7ff78819d810 con 0x7ff788076100 2024-09-21T06:27:56.845 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:27:56.845 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":28,"btime":"2024-09-21T06:26:30:754530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:26:30.006003+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24698,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24698":{"gid":24698,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3472481253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3472481253},{"type":"v1","addr":"172.21.15.71:6839","nonce":3472481253}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24698,"qdb_cluster":[14835,24676,24670,24694,24698]},"id":1}]} 2024-09-21T06:27:56.845 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 28 2024-09-21T06:27:56.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.845+0000 7ff78fe30640 1 -- 172.21.15.63:0/3825754673 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7740b6620 msgr2=0x7ff7740b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:56.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.845+0000 7ff78fe30640 1 --2- 172.21.15.63:0/3825754673 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7740b6620 0x7ff7740b8b30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff784005fd0 tx=0x7ff78400b390 comp rx=0 tx=0).stop 2024-09-21T06:27:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.845+0000 7ff78fe30640 1 -- 172.21.15.63:0/3825754673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff788076100 msgr2=0x7ff78819cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.845+0000 7ff78fe30640 1 --2- 172.21.15.63:0/3825754673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff788076100 0x7ff78819cc80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff778032fd0 tx=0x7ff778004270 comp rx=0 tx=0).stop 2024-09-21T06:27:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.845+0000 7ff78fe30640 1 -- 172.21.15.63:0/3825754673 shutdown_connections 2024-09-21T06:27:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.845+0000 7ff78fe30640 1 --2- 172.21.15.63:0/3825754673 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7740b6620 0x7ff7740b8b30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.845+0000 7ff78fe30640 1 --2- 172.21.15.63:0/3825754673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7881100c0 0x7ff7881a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.845+0000 7ff78fe30640 1 --2- 172.21.15.63:0/3825754673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff788076100 0x7ff78819cc80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.845+0000 7ff78fe30640 1 --2- 172.21.15.63:0/3825754673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7880757b0 0x7ff78819c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.845+0000 7ff78fe30640 1 -- 172.21.15.63:0/3825754673 >> 172.21.15.63:0/3825754673 conn(0x7ff78807b850 msgr2=0x7ff788100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.845+0000 7ff78fe30640 1 -- 172.21.15.63:0/3825754673 shutdown_connections 2024-09-21T06:27:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:56.845+0000 7ff78fe30640 1 -- 172.21.15.63:0/3825754673 wait complete. 2024-09-21T06:27:57.163 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:57 smithi063 ceph-mon[31150]: pgmap v314: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T06:27:57.163 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:57 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3825754673' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:27:57.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:57 smithi071 ceph-mon[34844]: pgmap v314: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T06:27:57.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:57 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3825754673' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:27:57.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:57 smithi175 ceph-mon[34510]: pgmap v314: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T06:27:57.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:57 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3825754673' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:27:57.476 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:27:57.735 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:58.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.216+0000 7efcc6832640 1 -- 172.21.15.63:0/2036481447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcc0108cf0 msgr2=0x7efcc010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:58.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.216+0000 7efcc6832640 1 --2- 172.21.15.63:0/2036481447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcc0108cf0 0x7efcc010f520 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efcb8009ca0 tx=0x7efcb802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.216+0000 7efcc6832640 1 -- 172.21.15.63:0/2036481447 shutdown_connections 2024-09-21T06:27:58.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.216+0000 7efcc6832640 1 --2- 172.21.15.63:0/2036481447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcc0108cf0 0x7efcc010f520 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.216+0000 7efcc6832640 1 --2- 172.21.15.63:0/2036481447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcc01083a0 0x7efcc01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.216+0000 7efcc6832640 1 --2- 172.21.15.63:0/2036481447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc0102a60 0x7efcc0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.216+0000 7efcc6832640 1 -- 172.21.15.63:0/2036481447 >> 172.21.15.63:0/2036481447 conn(0x7efcc0079730 msgr2=0x7efcc0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:58.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.216+0000 7efcc6832640 1 -- 172.21.15.63:0/2036481447 shutdown_connections 2024-09-21T06:27:58.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.217+0000 7efcc6832640 1 -- 172.21.15.63:0/2036481447 wait complete. 2024-09-21T06:27:58.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.217+0000 7efcc6832640 1 Processor -- start 2024-09-21T06:27:58.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.217+0000 7efcc6832640 1 -- start start 2024-09-21T06:27:58.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.217+0000 7efcc6832640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcc0102a60 0x7efcc019b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:58.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.217+0000 7efcc6832640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc01083a0 0x7efcc019b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:58.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.217+0000 7efcc6832640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcc0108cf0 0x7efcc019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:58.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.217+0000 7efcc6832640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7efcc0112960 con 0x7efcc0102a60 2024-09-21T06:27:58.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.217+0000 7efcc6832640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efcc01127e0 con 0x7efcc0108cf0 2024-09-21T06:27:58.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.218+0000 7efcc6832640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efcc0112ae0 con 0x7efcc01083a0 2024-09-21T06:27:58.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.218+0000 7efcbffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcc0102a60 0x7efcc019b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:58.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.218+0000 7efcbffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcc0102a60 0x7efcc019b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42496/0 (socket says 172.21.15.63:42496) 2024-09-21T06:27:58.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.218+0000 7efcbffff640 1 -- 172.21.15.63:0/748589751 learned_addr learned my addr 172.21.15.63:0/748589751 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:58.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.218+0000 7efcb7fff640 1 --2- 172.21.15.63:0/748589751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc01083a0 0x7efcc019b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:58.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.218+0000 7efcc4dcf640 1 --2- 172.21.15.63:0/748589751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcc0108cf0 0x7efcc019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:58.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.218+0000 7efcbffff640 1 -- 172.21.15.63:0/748589751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc01083a0 msgr2=0x7efcc019b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:58.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.218+0000 7efcbffff640 1 --2- 172.21.15.63:0/748589751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc01083a0 0x7efcc019b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.218+0000 7efcbffff640 1 -- 172.21.15.63:0/748589751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcc0108cf0 msgr2=0x7efcc019bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:58.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.218+0000 7efcbffff640 1 --2- 172.21.15.63:0/748589751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcc0108cf0 0x7efcc019bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.218+0000 7efcbffff640 1 -- 172.21.15.63:0/748589751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc01a6490 con 0x7efcc0102a60 2024-09-21T06:27:58.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.218+0000 7efcb7fff640 1 --2- 172.21.15.63:0/748589751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc01083a0 0x7efcc019b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:58.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.218+0000 7efcc4dcf640 1 --2- 172.21.15.63:0/748589751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcc0108cf0 0x7efcc019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:58.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.218+0000 7efcbffff640 1 --2- 172.21.15.63:0/748589751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcc0102a60 0x7efcc019b290 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7efcb000d770 tx=0x7efcb000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:58.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.218+0000 7efcbdffb640 1 -- 172.21.15.63:0/748589751 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb0017070 con 0x7efcc0102a60 2024-09-21T06:27:58.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.218+0000 7efcbdffb640 1 -- 172.21.15.63:0/748589751 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcb00054d0 con 0x7efcc0102a60 2024-09-21T06:27:58.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.218+0000 7efcc6832640 1 -- 172.21.15.63:0/748589751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc01a6780 con 0x7efcc0102a60 2024-09-21T06:27:58.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.218+0000 7efcbdffb640 1 -- 172.21.15.63:0/748589751 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb0004c30 con 0x7efcc0102a60 2024-09-21T06:27:58.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.218+0000 7efcc6832640 1 -- 172.21.15.63:0/748589751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc01a6cc0 con 0x7efcc0102a60 2024-09-21T06:27:58.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.220+0000 7efcc6832640 1 -- 172.21.15.63:0/748589751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc0102e70 con 0x7efcc0102a60 2024-09-21T06:27:58.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.221+0000 7efcbdffb640 1 -- 172.21.15.63:0/748589751 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7efcb0004dd0 con 0x7efcc0102a60 2024-09-21T06:27:58.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.222+0000 7efcbdffb640 1 --2- 172.21.15.63:0/748589751 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efcac0b66a0 0x7efcac0b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:58.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.222+0000 7efcb7fff640 1 --2- 172.21.15.63:0/748589751 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efcac0b66a0 0x7efcac0b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:58.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.222+0000 7efcbdffb640 1 -- 172.21.15.63:0/748589751 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7efcb00e70c0 con 0x7efcc0102a60 2024-09-21T06:27:58.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.222+0000 7efcb7fff640 1 --2- 172.21.15.63:0/748589751 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efcac0b66a0 0x7efcac0b8bb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efca8005e10 tx=0x7efca8005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:58.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.226+0000 7efcbdffb640 1 -- 172.21.15.63:0/748589751 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efcb00ad710 con 0x7efcc0102a60 2024-09-21T06:27:58.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.452+0000 7efcc6832640 1 -- 172.21.15.63:0/748589751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efcc002e640 con 0x7efcc0102a60 2024-09-21T06:27:58.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.453+0000 7efcbdffb640 1 -- 172.21.15.63:0/748589751 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11969 (secure 0 0 0) 0x7efcb00b1af0 con 0x7efcc0102a60 2024-09-21T06:27:58.455 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:27:58.455 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":28,"btime":"2024-09-21T06:26:30:754530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:26:30.006003+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24698,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24698":{"gid":24698,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3472481253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3472481253},{"type":"v1","addr":"172.21.15.71:6839","nonce":3472481253}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24698,"qdb_cluster":[14835,24676,24670,24694,24698]},"id":1}]} 2024-09-21T06:27:58.455 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 28 2024-09-21T06:27:58.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.455+0000 7efcc6832640 1 -- 172.21.15.63:0/748589751 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efcac0b66a0 msgr2=0x7efcac0b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:58.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.455+0000 7efcc6832640 1 --2- 172.21.15.63:0/748589751 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efcac0b66a0 0x7efcac0b8bb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efca8005e10 tx=0x7efca8005da0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.455+0000 7efcc6832640 1 -- 172.21.15.63:0/748589751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcc0102a60 msgr2=0x7efcc019b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:58.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.455+0000 7efcc6832640 1 --2- 172.21.15.63:0/748589751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcc0102a60 0x7efcc019b290 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7efcb000d770 tx=0x7efcb000dc30 comp rx=0 tx=0).stop 2024-09-21T06:27:58.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.455+0000 7efcc6832640 1 -- 172.21.15.63:0/748589751 shutdown_connections 2024-09-21T06:27:58.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.455+0000 7efcc6832640 1 --2- 172.21.15.63:0/748589751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcc0108cf0 0x7efcc019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.455+0000 7efcc6832640 1 --2- 172.21.15.63:0/748589751 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efcac0b66a0 0x7efcac0b8bb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.455+0000 7efcc6832640 1 --2- 172.21.15.63:0/748589751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc01083a0 0x7efcc019b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.455+0000 7efcc6832640 1 --2- 172.21.15.63:0/748589751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcc0102a60 0x7efcc019b290 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.455+0000 7efcc6832640 1 -- 172.21.15.63:0/748589751 >> 172.21.15.63:0/748589751 conn(0x7efcc0079730 msgr2=0x7efcc0104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:58.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.455+0000 7efcc6832640 1 -- 172.21.15.63:0/748589751 shutdown_connections 2024-09-21T06:27:58.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:58.455+0000 7efcc6832640 1 -- 172.21.15.63:0/748589751 wait complete. 2024-09-21T06:27:59.110 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:27:59.135 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:59 smithi063 ceph-mon[31150]: pgmap v315: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:27:59.135 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:27:59 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/748589751' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:27:59.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:59 smithi175 ceph-mon[34510]: pgmap v315: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:27:59.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:27:59 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/748589751' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:27:59.368 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:59.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:59 smithi071 ceph-mon[34844]: pgmap v315: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:27:59.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:27:59 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/748589751' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:27:59.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.868+0000 7fd4a2377640 1 -- 172.21.15.63:0/4147964255 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd49c102a60 msgr2=0x7fd49c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:59.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.868+0000 7fd4a2377640 1 --2- 172.21.15.63:0/4147964255 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd49c102a60 0x7fd49c102e70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd48c009900 tx=0x7fd48c02a410 comp rx=0 tx=0).stop 2024-09-21T06:27:59.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.868+0000 7fd4a2377640 1 -- 172.21.15.63:0/4147964255 shutdown_connections 2024-09-21T06:27:59.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.868+0000 7fd4a2377640 1 --2- 172.21.15.63:0/4147964255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd49c108cf0 0x7fd49c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.868+0000 7fd4a2377640 1 --2- 172.21.15.63:0/4147964255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd49c1083a0 0x7fd49c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.868+0000 7fd4a2377640 1 --2- 172.21.15.63:0/4147964255 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd49c102a60 0x7fd49c102e70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.868+0000 7fd4a2377640 1 -- 172.21.15.63:0/4147964255 >> 172.21.15.63:0/4147964255 conn(0x7fd49c079730 msgr2=0x7fd49c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:59.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.868+0000 7fd4a2377640 1 -- 172.21.15.63:0/4147964255 shutdown_connections 2024-09-21T06:27:59.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.868+0000 7fd4a2377640 1 -- 172.21.15.63:0/4147964255 wait complete. 2024-09-21T06:27:59.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.869+0000 7fd4a2377640 1 Processor -- start 2024-09-21T06:27:59.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.869+0000 7fd4a2377640 1 -- start start 2024-09-21T06:27:59.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.869+0000 7fd4a2377640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd49c102a60 0x7fd49c1991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:59.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.869+0000 7fd4a2377640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd49c1083a0 0x7fd49c199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.869+0000 7fd4a2377640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd49c108cf0 0x7fd49c199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.869+0000 7fd4a2377640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd49c112a40 con 0x7fd49c108cf0 2024-09-21T06:27:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.869+0000 7fd4a2377640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd49c1128c0 con 0x7fd49c102a60 2024-09-21T06:27:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.869+0000 7fd4a2377640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd49c112bc0 con 0x7fd49c1083a0 2024-09-21T06:27:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.869+0000 7fd4a0914640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd49c108cf0 0x7fd49c199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.869+0000 7fd4a0914640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd49c108cf0 0x7fd49c199c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42516/0 (socket says 172.21.15.63:42516) 2024-09-21T06:27:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.869+0000 7fd4a0914640 1 -- 172.21.15.63:0/2760573264 learned_addr learned my addr 172.21.15.63:0/2760573264 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:27:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.869+0000 7fd49bfff640 1 --2- 172.21.15.63:0/2760573264 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd49c102a60 0x7fd49c1991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.869+0000 7fd493fff640 1 --2- 172.21.15.63:0/2760573264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd49c1083a0 0x7fd49c199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.870+0000 7fd4a0914640 1 -- 172.21.15.63:0/2760573264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd49c1083a0 msgr2=0x7fd49c199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.870+0000 7fd4a0914640 1 --2- 172.21.15.63:0/2760573264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd49c1083a0 0x7fd49c199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.870+0000 7fd4a0914640 1 -- 172.21.15.63:0/2760573264 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd49c102a60 msgr2=0x7fd49c1991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.870+0000 7fd4a0914640 1 --2- 172.21.15.63:0/2760573264 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd49c102a60 0x7fd49c1991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.870+0000 7fd4a0914640 1 -- 172.21.15.63:0/2760573264 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49c1a8890 con 0x7fd49c108cf0 2024-09-21T06:27:59.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.870+0000 7fd4a0914640 1 --2- 172.21.15.63:0/2760573264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd49c108cf0 0x7fd49c199c60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd49400b970 tx=0x7fd49400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:59.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.870+0000 7fd499ffb640 1 -- 172.21.15.63:0/2760573264 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd494019070 con 0x7fd49c108cf0 2024-09-21T06:27:59.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.870+0000 7fd499ffb640 1 -- 172.21.15.63:0/2760573264 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd494014440 con 0x7fd49c108cf0 2024-09-21T06:27:59.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.870+0000 7fd4a2377640 1 -- 172.21.15.63:0/2760573264 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd49c1a8b80 con 0x7fd49c108cf0 2024-09-21T06:27:59.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.870+0000 7fd499ffb640 1 -- 172.21.15.63:0/2760573264 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4940075d0 con 0x7fd49c108cf0 2024-09-21T06:27:59.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.870+0000 7fd4a2377640 1 -- 172.21.15.63:0/2760573264 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd49c1a9140 con 0x7fd49c108cf0 2024-09-21T06:27:59.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.871+0000 7fd4a2377640 1 -- 172.21.15.63:0/2760573264 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd49c102ef0 con 0x7fd49c108cf0 2024-09-21T06:27:59.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.873+0000 7fd499ffb640 1 -- 172.21.15.63:0/2760573264 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fd49401c070 con 0x7fd49c108cf0 2024-09-21T06:27:59.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.873+0000 7fd499ffb640 1 --2- 172.21.15.63:0/2760573264 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd4880b6670 0x7fd4880b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:59.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.874+0000 7fd49bfff640 1 --2- 172.21.15.63:0/2760573264 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd4880b6670 0x7fd4880b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:59.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.874+0000 7fd499ffb640 1 -- 172.21.15.63:0/2760573264 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fd4940e6e00 con 0x7fd49c108cf0 2024-09-21T06:27:59.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.874+0000 7fd49bfff640 1 --2- 172.21.15.63:0/2760573264 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd4880b6670 0x7fd4880b8b80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd48c000c00 tx=0x7fd48c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:59.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:27:59.876+0000 7fd499ffb640 1 -- 172.21.15.63:0/2760573264 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd4940b1830 con 0x7fd49c108cf0 2024-09-21T06:28:00.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:00.064+0000 7fd4a2377640 1 -- 172.21.15.63:0/2760573264 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd49c06b270 con 0x7fd49c108cf0 2024-09-21T06:28:00.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:00.065+0000 7fd499ffb640 1 -- 172.21.15.63:0/2760573264 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+23049 (secure 0 0 0) 0x7fd49c06b270 con 0x7fd49c108cf0 2024-09-21T06:28:00.067 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:28:00.067 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":77,"fsid":"140899c8-77e1-11ef-baf5-efdc52797490","created":"2024-09-21T06:17:48.089366+0000","modified":"2024-09-21T06:26:38.957699+0000","last_up_change":"2024-09-21T06:25:29.072128+0000","last_in_change":"2024-09-21T06:25:06.097647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:21:36.236868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:26:15.016085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:26:17.072883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df4162c1-dd66-4d11-99bc-0ae36ea130f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6803","nonce":2090653772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6805","nonce":2090653772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6809","nonce":2090653772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6807","nonce":2090653772}]},"public_addr":"172.21.15.63:6803/2090653772","cluster_addr":"172.21.15.63:6805/2090653772","heartbeat_back_addr":"172.21.15.63:6809/2090653772","heartbeat_front_addr":"172.21.15.63:6807/2090653772","state":["exists","up"]},{"osd":1,"uuid":"65a12def-9f66-4153-8f1a-2ebfbbfeba99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6801","nonce":1676297548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6803","nonce":1676297548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6807","nonce":1676297548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6805","nonce":1676297548}]},"public_addr":"172.21.15.71:6801/1676297548","cluster_addr":"172.21.15.71:6803/1676297548","heartbeat_back_addr":"172.21.15.71:6807/1676297548","heartbeat_front_addr":"172.21.15.71:6805/1676297548","state":["exists","up"]},{"osd":2,"uuid":"031daa9e-9d4a-4901-95e8-695db5671fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6801","nonce":2356865390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6803","nonce":2356865390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6807","nonce":2356865390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6805","nonce":2356865390}]},"public_addr":"172.21.15.175:6801/2356865390","cluster_addr":"172.21.15.175:6803/2356865390","heartbeat_back_addr":"172.21.15.175:6807/2356865390","heartbeat_front_addr":"172.21.15.175:6805/2356865390","state":["exists","up"]},{"osd":3,"uuid":"75d23a7a-c560-4b26-84a4-74d6772a37ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6811","nonce":31683339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6813","nonce":31683339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6817","nonce":31683339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6815","nonce":31683339}]},"public_addr":"172.21.15.63:6811/31683339","cluster_addr":"172.21.15.63:6813/31683339","heartbeat_back_addr":"172.21.15.63:6817/31683339","heartbeat_front_addr":"172.21.15.63:6815/31683339","state":["exists","up"]},{"osd":4,"uuid":"6aaefd09-93dd-4f21-9b3c-701a7ff97f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6809","nonce":829449898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6811","nonce":829449898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6815","nonce":829449898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6813","nonce":829449898}]},"public_addr":"172.21.15.71:6809/829449898","cluster_addr":"172.21.15.71:6811/829449898","heartbeat_back_addr":"172.21.15.71:6815/829449898","heartbeat_front_addr":"172.21.15.71:6813/829449898","state":["exists","up"]},{"osd":5,"uuid":"91f28121-c94e-4012-b74c-dd4597545e3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6809","nonce":3005600597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6811","nonce":3005600597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6815","nonce":3005600597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6813","nonce":3005600597}]},"public_addr":"172.21.15.175:6809/3005600597","cluster_addr":"172.21.15.175:6811/3005600597","heartbeat_back_addr":"172.21.15.175:6815/3005600597","heartbeat_front_addr":"172.21.15.175:6813/3005600597","state":["exists","up"]},{"osd":6,"uuid":"bda28014-4dca-40f1-bb23-3ef61605c1ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6819","nonce":4044730408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6821","nonce":4044730408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6825","nonce":4044730408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6823","nonce":4044730408}]},"public_addr":"172.21.15.63:6819/4044730408","cluster_addr":"172.21.15.63:6821/4044730408","heartbeat_back_addr":"172.21.15.63:6825/4044730408","heartbeat_front_addr":"172.21.15.63:6823/4044730408","state":["exists","up"]},{"osd":7,"uuid":"a9026588-ccdc-4e6c-b628-1ac8a7dbfa64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6817","nonce":2913027708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6819","nonce":2913027708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6823","nonce":2913027708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6821","nonce":2913027708}]},"public_addr":"172.21.15.71:6817/2913027708","cluster_addr":"172.21.15.71:6819/2913027708","heartbeat_back_addr":"172.21.15.71:6823/2913027708","heartbeat_front_addr":"172.21.15.71:6821/2913027708","state":["exists","up"]},{"osd":8,"uuid":"2e1dacea-483c-4587-8d19-5c77a7b98667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6817","nonce":2058692148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6819","nonce":2058692148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6823","nonce":2058692148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6821","nonce":2058692148}]},"public_addr":"172.21.15.175:6817/2058692148","cluster_addr":"172.21.15.175:6819/2058692148","heartbeat_back_addr":"172.21.15.175:6823/2058692148","heartbeat_front_addr":"172.21.15.175:6821/2058692148","state":["exists","up"]},{"osd":9,"uuid":"7077ba4d-1fce-4197-a556-8b6a859c6f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6827","nonce":3278012285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6829","nonce":3278012285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6833","nonce":3278012285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6831","nonce":3278012285}]},"public_addr":"172.21.15.63:6827/3278012285","cluster_addr":"172.21.15.63:6829/3278012285","heartbeat_back_addr":"172.21.15.63:6833/3278012285","heartbeat_front_addr":"172.21.15.63:6831/3278012285","state":["exists","up"]},{"osd":10,"uuid":"99965496-91ee-4eef-9f2e-8f9c8dc54f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6825","nonce":3297929438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6827","nonce":3297929438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6831","nonce":3297929438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6829","nonce":3297929438}]},"public_addr":"172.21.15.71:6825/3297929438","cluster_addr":"172.21.15.71:6827/3297929438","heartbeat_back_addr":"172.21.15.71:6831/3297929438","heartbeat_front_addr":"172.21.15.71:6829/3297929438","state":["exists","up"]},{"osd":11,"uuid":"1b26d1a8-91a4-4877-ad1c-18160a1b3b6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6825","nonce":1970094291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6827","nonce":1970094291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6831","nonce":1970094291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6829","nonce":1970094291}]},"public_addr":"172.21.15.175:6825/1970094291","cluster_addr":"172.21.15.175:6827/1970094291","heartbeat_back_addr":"172.21.15.175:6831/1970094291","heartbeat_front_addr":"172.21.15.175:6829/1970094291","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:20:43.732676+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:08.957775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:34.157788+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:00.134410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:25.502998+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:51.739501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:18.325642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:44.430626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:10.776017+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:36.482831+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:01.898216+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:27.644941+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/1652196301":"2024-09-22T06:19:37.776447+0000","172.21.15.63:6801/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/2740830999":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6801/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6801/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/2958589237":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/1398493582":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/3529491525":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/363262068":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6800/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/3928056461":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/128321401":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/39222803":"2024-09-22T06:19:37.776447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:28:00.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:00.068+0000 7fd4a2377640 1 -- 172.21.15.63:0/2760573264 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd4880b6670 msgr2=0x7fd4880b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:00.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:00.068+0000 7fd4a2377640 1 --2- 172.21.15.63:0/2760573264 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd4880b6670 0x7fd4880b8b80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd48c000c00 tx=0x7fd48c031400 comp rx=0 tx=0).stop 2024-09-21T06:28:00.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:00.068+0000 7fd4a2377640 1 -- 172.21.15.63:0/2760573264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd49c108cf0 msgr2=0x7fd49c199c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:00.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:00.068+0000 7fd4a2377640 1 --2- 172.21.15.63:0/2760573264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd49c108cf0 0x7fd49c199c60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd49400b970 tx=0x7fd49400bd70 comp rx=0 tx=0).stop 2024-09-21T06:28:00.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:00.068+0000 7fd4a2377640 1 -- 172.21.15.63:0/2760573264 shutdown_connections 2024-09-21T06:28:00.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:00.068+0000 7fd4a2377640 1 --2- 172.21.15.63:0/2760573264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd49c108cf0 0x7fd49c199c60 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:00.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:00.068+0000 7fd4a2377640 1 --2- 172.21.15.63:0/2760573264 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd4880b6670 0x7fd4880b8b80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:00.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:00.068+0000 7fd4a2377640 1 --2- 172.21.15.63:0/2760573264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd49c1083a0 0x7fd49c199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:00.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:00.068+0000 7fd4a2377640 1 --2- 172.21.15.63:0/2760573264 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd49c102a60 0x7fd49c1991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:00.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:00.068+0000 7fd4a2377640 1 -- 172.21.15.63:0/2760573264 >> 172.21.15.63:0/2760573264 conn(0x7fd49c079730 msgr2=0x7fd49c1014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:00.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:00.068+0000 7fd4a2377640 1 -- 172.21.15.63:0/2760573264 shutdown_connections 2024-09-21T06:28:00.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:00.068+0000 7fd4a2377640 1 -- 172.21.15.63:0/2760573264 wait complete. 2024-09-21T06:28:00.704 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T06:26:18.960208+0000', 'modified': '2024-09-21T06:26:30.006003+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24698, 'mds_1': 24694, 'mds_2': 24676, 'mds_3': 24670, 'mds_4': 14835}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14823': {'gid': 14823, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.63:6839/2446248912', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6838', 'nonce': 2446248912}, {'type': 'v1', 'addr': '172.21.15.63:6839', 'nonce': 2446248912}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14835': {'gid': 14835, 'name': 'a', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.63:6841/1426680017', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6840', 'nonce': 1426680017}, {'type': 'v1', 'addr': '172.21.15.63:6841', 'nonce': 1426680017}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24608': {'gid': 24608, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6833/3879125360', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6832', 'nonce': 3879125360}, {'type': 'v1', 'addr': '172.21.15.71:6833', 'nonce': 3879125360}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24622': {'gid': 24622, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6833/825731342', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6832', 'nonce': 825731342}, {'type': 'v1', 'addr': '172.21.15.175:6833', 'nonce': 825731342}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24635': {'gid': 24635, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6835/946121091', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6834', 'nonce': 946121091}, {'type': 'v1', 'addr': '172.21.15.71:6835', 'nonce': 946121091}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24659': {'gid': 24659, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6837/1168849842', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6836', 'nonce': 1168849842}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 1168849842}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24670': {'gid': 24670, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.175:6835/3140987446', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 3140987446}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 3140987446}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24676': {'gid': 24676, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.175:6837/2825611591', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 2825611591}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 2825611591}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24694': {'gid': 24694, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.175:6839/3302221763', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 3302221763}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 3302221763}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24698': {'gid': 24698, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.71:6839/3472481253', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6838', 'nonce': 3472481253}, {'type': 'v1', 'addr': '172.21.15.71:6839', 'nonce': 3472481253}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24698, 'qdb_cluster': [14835, 24676, 24670, 24694, 24698]} 2024-09-21T06:28:00.704 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T06:28:00.704 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.a status 2024-09-21T06:28:01.000 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:01.283 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:01 smithi063 ceph-mon[31150]: pgmap v316: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:28:01.283 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:01 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2760573264' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:28:01.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:01 smithi175 ceph-mon[34510]: pgmap v316: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:28:01.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:01 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2760573264' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:28:01.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.487+0000 7eff85207640 1 -- 172.21.15.63:0/1069236046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff801083c0 msgr2=0x7eff801087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.487+0000 7eff85207640 1 --2- 172.21.15.63:0/1069236046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff801083c0 0x7eff801087d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7eff74009900 tx=0x7eff7402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:01.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.487+0000 7eff85207640 1 -- 172.21.15.63:0/1069236046 shutdown_connections 2024-09-21T06:28:01.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.487+0000 7eff85207640 1 --2- 172.21.15.63:0/1069236046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff80108d10 0x7eff8010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.487+0000 7eff85207640 1 --2- 172.21.15.63:0/1069236046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff801083c0 0x7eff801087d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.487+0000 7eff85207640 1 --2- 172.21.15.63:0/1069236046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff80102a80 0x7eff80102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.487+0000 7eff85207640 1 -- 172.21.15.63:0/1069236046 >> 172.21.15.63:0/1069236046 conn(0x7eff80079740 msgr2=0x7eff80079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:01.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.487+0000 7eff85207640 1 -- 172.21.15.63:0/1069236046 shutdown_connections 2024-09-21T06:28:01.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.487+0000 7eff85207640 1 -- 172.21.15.63:0/1069236046 wait complete. 2024-09-21T06:28:01.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.488+0000 7eff85207640 1 Processor -- start 2024-09-21T06:28:01.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.488+0000 7eff85207640 1 -- start start 2024-09-21T06:28:01.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.489+0000 7eff85207640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff80102a80 0x7eff8019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.489+0000 7eff85207640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff801083c0 0x7eff8019ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.489+0000 7eff85207640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff80108d10 0x7eff8019fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.489+0000 7eff85207640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7eff80113ac0 con 0x7eff80108d10 2024-09-21T06:28:01.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.489+0000 7eff85207640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7eff80113940 con 0x7eff801083c0 2024-09-21T06:28:01.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.489+0000 7eff85207640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff80113c40 con 0x7eff80102a80 2024-09-21T06:28:01.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.489+0000 7eff7f59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff80108d10 0x7eff8019fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.489+0000 7eff7f59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff80108d10 0x7eff8019fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42528/0 (socket says 172.21.15.63:42528) 2024-09-21T06:28:01.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.489+0000 7eff7f59e640 1 -- 172.21.15.63:0/563385373 learned_addr learned my addr 172.21.15.63:0/563385373 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:01.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.489+0000 7eff7ed9d640 1 --2- 172.21.15.63:0/563385373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff80102a80 0x7eff8019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.489+0000 7eff7e59c640 1 --2- 172.21.15.63:0/563385373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff801083c0 0x7eff8019ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.489+0000 7eff7f59e640 1 -- 172.21.15.63:0/563385373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff80102a80 msgr2=0x7eff8019a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.489+0000 7eff7f59e640 1 --2- 172.21.15.63:0/563385373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff80102a80 0x7eff8019a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.489+0000 7eff7f59e640 1 -- 172.21.15.63:0/563385373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff801083c0 msgr2=0x7eff8019ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.489+0000 7eff7f59e640 1 --2- 172.21.15.63:0/563385373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff801083c0 0x7eff8019ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.489+0000 7eff7f59e640 1 -- 172.21.15.63:0/563385373 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff801a0560 con 0x7eff80108d10 2024-09-21T06:28:01.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.489+0000 7eff7e59c640 1 --2- 172.21.15.63:0/563385373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff801083c0 0x7eff8019ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:01.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.489+0000 7eff7f59e640 1 --2- 172.21.15.63:0/563385373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff80108d10 0x7eff8019fef0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7eff7800b970 tx=0x7eff7800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:01.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.489+0000 7eff67fff640 1 -- 172.21.15.63:0/563385373 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff78019070 con 0x7eff80108d10 2024-09-21T06:28:01.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.490+0000 7eff85207640 1 -- 172.21.15.63:0/563385373 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff801a0850 con 0x7eff80108d10 2024-09-21T06:28:01.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.490+0000 7eff67fff640 1 -- 172.21.15.63:0/563385373 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff78014440 con 0x7eff80108d10 2024-09-21T06:28:01.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.490+0000 7eff67fff640 1 -- 172.21.15.63:0/563385373 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff780075d0 con 0x7eff80108d10 2024-09-21T06:28:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.490+0000 7eff85207640 1 -- 172.21.15.63:0/563385373 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff801a7070 con 0x7eff80108d10 2024-09-21T06:28:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.492+0000 7eff8b77b740 1 Processor -- start 2024-09-21T06:28:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.492+0000 7eff67fff640 1 -- 172.21.15.63:0/563385373 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7eff7801c070 con 0x7eff80108d10 2024-09-21T06:28:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.493+0000 7eff8b77b740 1 -- start start 2024-09-21T06:28:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.493+0000 7eff8b77b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a103f60 0x563a7a4a9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.493+0000 7eff8b77b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7a0db0a0 0x563a7a4aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.493+0000 7eff8b77b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0e3280 0x563a7a4aa980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.493+0000 7eff8b77b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563a7a421c10 con 0x563a7a0e3280 2024-09-21T06:28:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.493+0000 7eff8b77b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563a7a411040 con 0x563a7a103f60 2024-09-21T06:28:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.493+0000 7eff8b77b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563a7a414e50 con 0x563a7a0db0a0 2024-09-21T06:28:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.493+0000 7eff7e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0e3280 0x563a7a4aa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.493+0000 7eff7e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0e3280 0x563a7a4aa980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42542/0 (socket says 172.21.15.63:42542) 2024-09-21T06:28:01.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.493+0000 7eff7e59c640 1 -- 172.21.15.63:0/542114797 learned_addr learned my addr 172.21.15.63:0/542114797 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:01.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.493+0000 7eff7e59c640 1 --2- 172.21.15.63:0/542114797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a103f60 0x563a7a4a9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.493+0000 7eff7ed9d640 1 --2- 172.21.15.63:0/542114797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7a0db0a0 0x563a7a4aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.493+0000 7eff7e59c640 1 -- 172.21.15.63:0/542114797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7a0db0a0 msgr2=0x563a7a4aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:01.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.493+0000 7eff7e59c640 1 --2- 172.21.15.63:0/542114797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7a0db0a0 0x563a7a4aa440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.493+0000 7eff7e59c640 1 -- 172.21.15.63:0/542114797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a103f60 msgr2=0x563a7a4a9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:01.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.493+0000 7eff7e59c640 1 --2- 172.21.15.63:0/542114797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a103f60 0x563a7a4a9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.493+0000 7eff7e59c640 1 -- 172.21.15.63:0/542114797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a7a16f540 con 0x563a7a0e3280 2024-09-21T06:28:01.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.494+0000 7eff67fff640 1 --2- 172.21.15.63:0/563385373 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7eff680b6620 0x7eff680b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.494+0000 7eff7e59c640 1 --2- 172.21.15.63:0/542114797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0e3280 0x563a7a4aa980 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7eff8006b6c0 tx=0x7eff74005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c530b4a9ec8a91e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:01.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.494+0000 7eff7ed9d640 1 --2- 172.21.15.63:0/563385373 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7eff680b6620 0x7eff680b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.494+0000 7eff67fff640 1 -- 172.21.15.63:0/563385373 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7eff780e6a10 con 0x7eff80108d10 2024-09-21T06:28:01.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.494+0000 7eff657fa640 1 -- 172.21.15.63:0/542114797 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74035050 con 0x563a7a0e3280 2024-09-21T06:28:01.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.494+0000 7eff657fa640 1 -- 172.21.15.63:0/542114797 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff740054d0 con 0x563a7a0e3280 2024-09-21T06:28:01.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.494+0000 7eff657fa640 1 -- 172.21.15.63:0/542114797 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff740049e0 con 0x563a7a0e3280 2024-09-21T06:28:01.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.496+0000 7eff8b77b740 1 -- 172.21.15.63:0/542114797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0e3280 msgr2=0x563a7a4aa980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.496+0000 7eff7ed9d640 1 --2- 172.21.15.63:0/563385373 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7eff680b6620 0x7eff680b8b30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x563a7a4a8b80 tx=0x7eff7000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:01.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.496+0000 7eff8b77b740 1 --2- 172.21.15.63:0/542114797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0e3280 0x563a7a4aa980 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7eff8006b6c0 tx=0x7eff74005a20 comp rx=0 tx=0).stop 2024-09-21T06:28:01.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.496+0000 7eff8b77b740 1 -- 172.21.15.63:0/542114797 shutdown_connections 2024-09-21T06:28:01.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.496+0000 7eff8b77b740 1 --2- 172.21.15.63:0/542114797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0e3280 0x563a7a4aa980 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.496+0000 7eff8b77b740 1 --2- 172.21.15.63:0/542114797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7a0db0a0 0x563a7a4aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.496+0000 7eff8b77b740 1 --2- 172.21.15.63:0/542114797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a103f60 0x563a7a4a9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.496+0000 7eff8b77b740 1 -- 172.21.15.63:0/542114797 >> 172.21.15.63:0/542114797 conn(0x563a7a0f8350 msgr2=0x563a7a4a7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:01.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.496+0000 7eff8b77b740 1 -- 172.21.15.63:0/542114797 shutdown_connections 2024-09-21T06:28:01.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.496+0000 7eff8b77b740 1 -- 172.21.15.63:0/542114797 wait complete. 2024-09-21T06:28:01.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.496+0000 7eff8b77b740 1 -- start start 2024-09-21T06:28:01.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.497+0000 7eff8b77b740 1 Processor -- start 2024-09-21T06:28:01.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.497+0000 7eff8b77b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7a0db0a0 0x563a7a4b5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.497+0000 7eff8b77b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0e3280 0x563a7a4b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.497+0000 7eff8b77b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a103f60 0x563a7a4c1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.497+0000 7eff8b77b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563a7a2725f0 con 0x563a7a0e3280 2024-09-21T06:28:01.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.497+0000 7eff8b77b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563a7a3ac010 con 0x563a7a103f60 2024-09-21T06:28:01.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.497+0000 7eff8b77b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563a7a4b8680 con 0x563a7a0db0a0 2024-09-21T06:28:01.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.497+0000 7eff8b77b740 10 client.0 _ll_register_callbacks cb 0x563a7a40b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:01.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.497+0000 7eff7e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0e3280 0x563a7a4b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.497+0000 7eff7e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0e3280 0x563a7a4b5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42552/0 (socket says 172.21.15.63:42552) 2024-09-21T06:28:01.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.497+0000 7eff7e59c640 1 -- 172.21.15.63:0/114744640 learned_addr learned my addr 172.21.15.63:0/114744640 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:01.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.497+0000 7eff7f59e640 1 --2- 172.21.15.63:0/114744640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a103f60 0x563a7a4c1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.497+0000 7eff7ed9d640 1 --2- 172.21.15.63:0/114744640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7a0db0a0 0x563a7a4b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.497+0000 7eff7e59c640 1 -- 172.21.15.63:0/114744640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7a0db0a0 msgr2=0x563a7a4b5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:01.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.497+0000 7eff7e59c640 1 --2- 172.21.15.63:0/114744640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7a0db0a0 0x563a7a4b5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.497+0000 7eff7e59c640 1 -- 172.21.15.63:0/114744640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a103f60 msgr2=0x563a7a4c1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:01.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.497+0000 7eff7e59c640 1 --2- 172.21.15.63:0/114744640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a103f60 0x563a7a4c1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.497+0000 7eff7e59c640 1 -- 172.21.15.63:0/114744640 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a7a3d9a00 con 0x563a7a0e3280 2024-09-21T06:28:01.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.498+0000 7eff7e59c640 1 --2- 172.21.15.63:0/114744640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0e3280 0x563a7a4b5d50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7eff74005ab0 tx=0x7eff74005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d331658b534125f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:01.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.498+0000 7eff62ff5640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:28:01.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.498+0000 7eff62ff5640 1 -- 172.21.15.63:0/114744640 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7404e060 con 0x563a7a0e3280 2024-09-21T06:28:01.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.498+0000 7eff62ff5640 1 -- 172.21.15.63:0/114744640 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7eff74005680 con 0x563a7a0e3280 2024-09-21T06:28:01.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.498+0000 7eff8b77b740 1 -- 172.21.15.63:0/114744640 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff740054d0 con 0x563a7a0e3280 2024-09-21T06:28:01.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.498+0000 7eff62ff5640 1 -- 172.21.15.63:0/114744640 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff74035070 con 0x563a7a0e3280 2024-09-21T06:28:01.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.498+0000 7eff8b77b740 10 client.15345 fetch_fsmap learned FSMap version 28 2024-09-21T06:28:01.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.498+0000 7eff8b77b740 1 -- 172.21.15.63:0/114744640 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563a7a4c4540 con 0x563a7a0e3280 2024-09-21T06:28:01.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.498+0000 7eff62ff5640 1 -- 172.21.15.63:0/114744640 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff740054d0 con 0x563a7a0e3280 2024-09-21T06:28:01.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.499+0000 7eff62ff5640 1 -- 172.21.15.63:0/114744640 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7eff7403db90 con 0x563a7a0e3280 2024-09-21T06:28:01.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.499+0000 7eff8b77b740 10 client.15345 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:28:01.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.499+0000 7eff8b77b740 10 client.15345 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T06:28:01.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.499+0000 7eff8b77b740 20 client.15345 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:01.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.499+0000 7eff8b77b740 1 --2- 172.21.15.63:0/114744640 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x563a7a0c28e0 0x563a7a4c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.499+0000 7eff8b77b740 4 client.15345 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:01.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.499+0000 7eff8b77b740 1 -- 172.21.15.63:0/114744640 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a7a423b60 con 0x563a7a0c28e0 2024-09-21T06:28:01.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.499+0000 7eff7ed9d640 1 --2- 172.21.15.63:0/114744640 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x563a7a0c28e0 0x563a7a4c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.499+0000 7eff62ff5640 10 client.15345 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:28:01.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.499+0000 7eff7ed9d640 1 --2- 172.21.15.63:0/114744640 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x563a7a0c28e0 0x563a7a4c7a10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ddc1fc74de464cc7 server_cookie=e16b199af7132f9 in_seq=0 out_seq=0 2024-09-21T06:28:01.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.500+0000 7eff62ff5640 1 -- 172.21.15.63:0/114744640 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563a7a423b60 con 0x563a7a0c28e0 2024-09-21T06:28:01.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.500+0000 7eff62ff5640 10 client.15345 handle_command_reply: tid=0 2024-09-21T06:28:01.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.500+0000 7eff8b77b740 1 client.15345 shutdown 2024-09-21T06:28:01.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.500+0000 7eff8b77b740 1 -- 172.21.15.63:0/114744640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0e3280 msgr2=0x563a7a4b5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.500+0000 7eff8b77b740 1 --2- 172.21.15.63:0/114744640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0e3280 0x563a7a4b5d50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7eff74005ab0 tx=0x7eff74005f00 comp rx=0 tx=0).stop 2024-09-21T06:28:01.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.500+0000 7eff8b77b740 1 -- 172.21.15.63:0/114744640 shutdown_connections 2024-09-21T06:28:01.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.500+0000 7eff8b77b740 1 --2- 172.21.15.63:0/114744640 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x563a7a0c28e0 0x563a7a4c7a10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.500+0000 7eff8b77b740 1 --2- 172.21.15.63:0/114744640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a103f60 0x563a7a4c1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.500+0000 7eff8b77b740 1 --2- 172.21.15.63:0/114744640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0e3280 0x563a7a4b5d50 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.500+0000 7eff8b77b740 1 --2- 172.21.15.63:0/114744640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7a0db0a0 0x563a7a4b5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.500+0000 7eff8b77b740 1 -- 172.21.15.63:0/114744640 >> 172.21.15.63:0/114744640 conn(0x563a7a0f8350 msgr2=0x563a7a4ad0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:01.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.500+0000 7eff62ff5640 0 client.15345 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:28:01.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.500+0000 7eff8b77b740 1 -- 172.21.15.63:0/114744640 shutdown_connections 2024-09-21T06:28:01.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.500+0000 7eff8b77b740 1 -- 172.21.15.63:0/114744640 wait complete. 2024-09-21T06:28:01.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.501+0000 7eff8b77b740 20 client.15345 trim_cache size 0 max 16384 2024-09-21T06:28:01.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:01 smithi071 ceph-mon[34844]: pgmap v316: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:28:01.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:01 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2760573264' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:28:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.519+0000 7eff8b77b740 1 Processor -- start 2024-09-21T06:28:01.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.519+0000 7eff8b77b740 1 -- start start 2024-09-21T06:28:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.519+0000 7eff8b77b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7a0db0a0 0x563a7a4c18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.519+0000 7eff8b77b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a0e3280 0x563a7a4c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.519+0000 7eff8b77b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a103f60 0x563a7a4b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.519+0000 7eff8b77b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563a7a4c5d50 con 0x563a7a103f60 2024-09-21T06:28:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.519+0000 7eff8b77b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563a7a4c6420 con 0x563a7a0e3280 2024-09-21T06:28:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.519+0000 7eff8b77b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563a7a4c6af0 con 0x563a7a0db0a0 2024-09-21T06:28:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.519+0000 7eff7f59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a103f60 0x563a7a4b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.519+0000 7eff7f59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a103f60 0x563a7a4b2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42562/0 (socket says 172.21.15.63:42562) 2024-09-21T06:28:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.519+0000 7eff7f59e640 1 -- 172.21.15.63:0/4030623227 learned_addr learned my addr 172.21.15.63:0/4030623227 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.519+0000 7eff7e59c640 1 --2- 172.21.15.63:0/4030623227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a0e3280 0x563a7a4c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.519+0000 7eff7ed9d640 1 --2- 172.21.15.63:0/4030623227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7a0db0a0 0x563a7a4c18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.519+0000 7eff7f59e640 1 -- 172.21.15.63:0/4030623227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7a0db0a0 msgr2=0x563a7a4c18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:01.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.519+0000 7eff7f59e640 1 --2- 172.21.15.63:0/4030623227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7a0db0a0 0x563a7a4c18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.519+0000 7eff7f59e640 1 -- 172.21.15.63:0/4030623227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a0e3280 msgr2=0x563a7a4c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:01.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.519+0000 7eff7f59e640 1 --2- 172.21.15.63:0/4030623227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a0e3280 0x563a7a4c1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.519+0000 7eff7f59e640 1 -- 172.21.15.63:0/4030623227 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a7a410fd0 con 0x563a7a103f60 2024-09-21T06:28:01.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.519+0000 7eff7e59c640 1 --2- 172.21.15.63:0/4030623227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a0e3280 0x563a7a4c1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:01.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.520+0000 7eff7f59e640 1 --2- 172.21.15.63:0/4030623227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a103f60 0x563a7a4b2960 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7eff780e4310 tx=0x7eff780d0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21a486aceaa21c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:01.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.520+0000 7eff64ff9640 1 -- 172.21.15.63:0/4030623227 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff780ac470 con 0x563a7a103f60 2024-09-21T06:28:01.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.520+0000 7eff64ff9640 1 -- 172.21.15.63:0/4030623227 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff780ad060 con 0x563a7a103f60 2024-09-21T06:28:01.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.520+0000 7eff64ff9640 1 -- 172.21.15.63:0/4030623227 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff78014930 con 0x563a7a103f60 2024-09-21T06:28:01.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.521+0000 7eff8b77b740 1 -- 172.21.15.63:0/4030623227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a103f60 msgr2=0x563a7a4b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.521+0000 7eff8b77b740 1 --2- 172.21.15.63:0/4030623227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a103f60 0x563a7a4b2960 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7eff780e4310 tx=0x7eff780d0040 comp rx=0 tx=0).stop 2024-09-21T06:28:01.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.521+0000 7eff8b77b740 1 -- 172.21.15.63:0/4030623227 shutdown_connections 2024-09-21T06:28:01.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.521+0000 7eff8b77b740 1 --2- 172.21.15.63:0/4030623227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a103f60 0x563a7a4b2960 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.521+0000 7eff8b77b740 1 --2- 172.21.15.63:0/4030623227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a0e3280 0x563a7a4c1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.521+0000 7eff8b77b740 1 --2- 172.21.15.63:0/4030623227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7a0db0a0 0x563a7a4c18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.521+0000 7eff8b77b740 1 -- 172.21.15.63:0/4030623227 >> 172.21.15.63:0/4030623227 conn(0x563a7a0f8350 msgr2=0x563a7a4a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:01.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.521+0000 7eff8b77b740 1 -- 172.21.15.63:0/4030623227 shutdown_connections 2024-09-21T06:28:01.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.521+0000 7eff8b77b740 1 -- 172.21.15.63:0/4030623227 wait complete. 2024-09-21T06:28:01.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.521+0000 7eff8b77b740 1 -- start start 2024-09-21T06:28:01.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.521+0000 7eff8b77b740 1 Processor -- start 2024-09-21T06:28:01.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.521+0000 7eff8b77b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0db0a0 0x563a7a4c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.521+0000 7eff8b77b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a0e3280 0x563a7a4ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.521+0000 7eff8b77b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7a103f60 0x563a7a4ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.521+0000 7eff8b77b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563a7a4c7890 con 0x563a7a0db0a0 2024-09-21T06:28:01.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.522+0000 7eff8b77b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563a7a4c71c0 con 0x563a7a0e3280 2024-09-21T06:28:01.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.522+0000 7eff8b77b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563a7a4c7f60 con 0x563a7a103f60 2024-09-21T06:28:01.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.522+0000 7eff8b77b740 10 client.0 _ll_register_callbacks cb 0x7eff74031ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:01.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.522+0000 7eff7ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0db0a0 0x563a7a4c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.522+0000 7eff7ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0db0a0 0x563a7a4c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42570/0 (socket says 172.21.15.63:42570) 2024-09-21T06:28:01.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.522+0000 7eff7ed9d640 1 -- 172.21.15.63:0/84346665 learned_addr learned my addr 172.21.15.63:0/84346665 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:01.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.522+0000 7eff7e59c640 1 --2- 172.21.15.63:0/84346665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a0e3280 0x563a7a4ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.522+0000 7eff7f59e640 1 --2- 172.21.15.63:0/84346665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7a103f60 0x563a7a4ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.522+0000 7eff7ed9d640 1 -- 172.21.15.63:0/84346665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7a103f60 msgr2=0x563a7a4ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.522+0000 7eff7ed9d640 1 --2- 172.21.15.63:0/84346665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7a103f60 0x563a7a4ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.522+0000 7eff7ed9d640 1 -- 172.21.15.63:0/84346665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a0e3280 msgr2=0x563a7a4ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.522+0000 7eff7ed9d640 1 --2- 172.21.15.63:0/84346665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a0e3280 0x563a7a4ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.522+0000 7eff7ed9d640 1 -- 172.21.15.63:0/84346665 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a7a4cf8a0 con 0x563a7a0db0a0 2024-09-21T06:28:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.522+0000 7eff7ed9d640 1 --2- 172.21.15.63:0/84346665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0db0a0 0x563a7a4c9f10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7eff7000aee0 tx=0x7eff70015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6e8ae0dd05a8e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.522+0000 7eff62ff5640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:28:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.522+0000 7eff62ff5640 1 -- 172.21.15.63:0/84346665 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70033060 con 0x563a7a0db0a0 2024-09-21T06:28:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.522+0000 7eff62ff5640 1 -- 172.21.15.63:0/84346665 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7eff70016030 con 0x563a7a0db0a0 2024-09-21T06:28:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.522+0000 7eff8b77b740 1 -- 172.21.15.63:0/84346665 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff780ad060 con 0x563a7a0db0a0 2024-09-21T06:28:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.523+0000 7eff62ff5640 1 -- 172.21.15.63:0/84346665 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff7002a030 con 0x563a7a0db0a0 2024-09-21T06:28:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.523+0000 7eff8b77b740 10 client.15351 fetch_fsmap learned FSMap version 28 2024-09-21T06:28:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.523+0000 7eff8b77b740 1 -- 172.21.15.63:0/84346665 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563a7a533400 con 0x563a7a0db0a0 2024-09-21T06:28:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.523+0000 7eff62ff5640 1 -- 172.21.15.63:0/84346665 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff780ad060 con 0x563a7a0db0a0 2024-09-21T06:28:01.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.523+0000 7eff62ff5640 1 -- 172.21.15.63:0/84346665 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7eff70028510 con 0x563a7a0db0a0 2024-09-21T06:28:01.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.523+0000 7eff8b77b740 10 client.15351 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:28:01.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.523+0000 7eff8b77b740 10 client.15351 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T06:28:01.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.523+0000 7eff8b77b740 20 client.15351 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:01.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.523+0000 7eff8b77b740 1 --2- 172.21.15.63:0/84346665 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x563a7a097c90 0x563a7a536ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.523+0000 7eff8b77b740 4 client.15351 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:28:01.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.523+0000 7eff8b77b740 1 -- 172.21.15.63:0/84346665 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "status"}) -- 0x563a7a41f610 con 0x563a7a097c90 2024-09-21T06:28:01.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.523+0000 7eff7e59c640 1 --2- 172.21.15.63:0/84346665 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x563a7a097c90 0x563a7a536ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.524+0000 7eff62ff5640 10 client.15351 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:28:01.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.524+0000 7eff7e59c640 1 --2- 172.21.15.63:0/84346665 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x563a7a097c90 0x563a7a536ce0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6cb583634eb59d04 server_cookie=304b4034779c2183 in_seq=0 out_seq=0 2024-09-21T06:28:01.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.524+0000 7eff62ff5640 1 -- 172.21.15.63:0/84346665 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x563a7a41f610 con 0x563a7a097c90 2024-09-21T06:28:01.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.524+0000 7eff62ff5640 10 client.15351 handle_command_reply: tid=0 2024-09-21T06:28:01.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.524+0000 7eff8b77b740 1 client.15351 shutdown 2024-09-21T06:28:01.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.524+0000 7eff8b77b740 1 -- 172.21.15.63:0/84346665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0db0a0 msgr2=0x563a7a4c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.524+0000 7eff8b77b740 1 --2- 172.21.15.63:0/84346665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0db0a0 0x563a7a4c9f10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7eff7000aee0 tx=0x7eff70015000 comp rx=0 tx=0).stop 2024-09-21T06:28:01.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.524+0000 7eff8b77b740 1 -- 172.21.15.63:0/84346665 shutdown_connections 2024-09-21T06:28:01.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.524+0000 7eff8b77b740 1 --2- 172.21.15.63:0/84346665 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x563a7a097c90 0x563a7a536ce0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.524+0000 7eff8b77b740 1 --2- 172.21.15.63:0/84346665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7a103f60 0x563a7a4ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.524+0000 7eff8b77b740 1 --2- 172.21.15.63:0/84346665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a7a0e3280 0x563a7a4ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.524+0000 7eff62ff5640 0 client.15351 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:28:01.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.524+0000 7eff8b77b740 1 --2- 172.21.15.63:0/84346665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563a7a0db0a0 0x563a7a4c9f10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.524+0000 7eff8b77b740 1 -- 172.21.15.63:0/84346665 >> 172.21.15.63:0/84346665 conn(0x563a7a0f8350 msgr2=0x563a7a4a63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:01.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.524+0000 7eff8b77b740 1 -- 172.21.15.63:0/84346665 shutdown_connections 2024-09-21T06:28:01.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.524+0000 7eff8b77b740 1 -- 172.21.15.63:0/84346665 wait complete. 2024-09-21T06:28:01.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.524+0000 7eff8b77b740 20 client.15351 trim_cache size 0 max 16384 2024-09-21T06:28:01.532 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:28:01.532 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "140899c8-77e1-11ef-baf5-efdc52797490", 2024-09-21T06:28:01.532 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 4, 2024-09-21T06:28:01.532 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 14835, 2024-09-21T06:28:01.532 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-21T06:28:01.532 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-21T06:28:01.532 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-21T06:28:01.532 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 92.776754363999999, 2024-09-21T06:28:01.532 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 28, 2024-09-21T06:28:01.532 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 77, 2024-09-21T06:28:01.532 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:28:01.532 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 114.02568605899999 2024-09-21T06:28:01.532 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:28:01.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.525+0000 7eff85207640 1 -- 172.21.15.63:0/563385373 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7eff680b6620 msgr2=0x7eff680b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.525+0000 7eff85207640 1 --2- 172.21.15.63:0/563385373 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7eff680b6620 0x7eff680b8b30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x563a7a4a8b80 tx=0x7eff7000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.525+0000 7eff85207640 1 -- 172.21.15.63:0/563385373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff80108d10 msgr2=0x7eff8019fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.525+0000 7eff85207640 1 --2- 172.21.15.63:0/563385373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff80108d10 0x7eff8019fef0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7eff7800b970 tx=0x7eff7800bd70 comp rx=0 tx=0).stop 2024-09-21T06:28:01.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.525+0000 7eff85207640 1 -- 172.21.15.63:0/563385373 shutdown_connections 2024-09-21T06:28:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.525+0000 7eff85207640 1 --2- 172.21.15.63:0/563385373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff80108d10 0x7eff8019fef0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.525+0000 7eff85207640 1 --2- 172.21.15.63:0/563385373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff801083c0 0x7eff8019ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.525+0000 7eff85207640 1 --2- 172.21.15.63:0/563385373 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7eff680b6620 0x7eff680b8b30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.525+0000 7eff85207640 1 --2- 172.21.15.63:0/563385373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff80102a80 0x7eff8019a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.525+0000 7eff85207640 1 -- 172.21.15.63:0/563385373 >> 172.21.15.63:0/563385373 conn(0x7eff80079740 msgr2=0x7eff801053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.525+0000 7eff85207640 1 -- 172.21.15.63:0/563385373 shutdown_connections 2024-09-21T06:28:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:01.525+0000 7eff85207640 1 -- 172.21.15.63:0/563385373 wait complete. 2024-09-21T06:28:02.333 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.f status 2024-09-21T06:28:02.591 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:03.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.123+0000 7f4fa84d7640 1 -- 172.21.15.63:0/3979516804 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fa0102ae0 msgr2=0x7f4fa0102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.123+0000 7f4fa84d7640 1 --2- 172.21.15.63:0/3979516804 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fa0102ae0 0x7f4fa0102ef0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4f94009900 tx=0x7f4f9402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.123+0000 7f4fa84d7640 1 -- 172.21.15.63:0/3979516804 shutdown_connections 2024-09-21T06:28:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.123+0000 7f4fa84d7640 1 --2- 172.21.15.63:0/3979516804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fa0108d20 0x7f4fa010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.123+0000 7f4fa84d7640 1 --2- 172.21.15.63:0/3979516804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa01083d0 0x7f4fa01087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.123+0000 7f4fa84d7640 1 --2- 172.21.15.63:0/3979516804 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fa0102ae0 0x7f4fa0102ef0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.123+0000 7f4fa84d7640 1 -- 172.21.15.63:0/3979516804 >> 172.21.15.63:0/3979516804 conn(0x7f4fa0079760 msgr2=0x7f4fa0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.124+0000 7f4fa84d7640 1 -- 172.21.15.63:0/3979516804 shutdown_connections 2024-09-21T06:28:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.124+0000 7f4fa84d7640 1 -- 172.21.15.63:0/3979516804 wait complete. 2024-09-21T06:28:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.124+0000 7f4fa84d7640 1 Processor -- start 2024-09-21T06:28:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.124+0000 7f4fa84d7640 1 -- start start 2024-09-21T06:28:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.124+0000 7f4fa84d7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fa0102ae0 0x7f4fa010ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4fa84d7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fa01083d0 0x7f4fa0110520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4fa84d7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa0108d20 0x7f4fa0110a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4fa84d7640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa0113ab0 con 0x7f4fa01083d0 2024-09-21T06:28:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4fa84d7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa0113930 con 0x7f4fa0102ae0 2024-09-21T06:28:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4fa84d7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa0113c30 con 0x7f4fa0108d20 2024-09-21T06:28:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4fa5a72640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fa01083d0 0x7f4fa0110520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4fa5a72640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fa01083d0 0x7f4fa0110520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42596/0 (socket says 172.21.15.63:42596) 2024-09-21T06:28:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4fa5a72640 1 -- 172.21.15.63:0/1669204131 learned_addr learned my addr 172.21.15.63:0/1669204131 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4fa6a74640 1 --2- 172.21.15.63:0/1669204131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa0108d20 0x7f4fa0110a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4fa6273640 1 --2- 172.21.15.63:0/1669204131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fa0102ae0 0x7f4fa010ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4fa5a72640 1 -- 172.21.15.63:0/1669204131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa0108d20 msgr2=0x7f4fa0110a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4fa5a72640 1 --2- 172.21.15.63:0/1669204131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa0108d20 0x7f4fa0110a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4fa5a72640 1 -- 172.21.15.63:0/1669204131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fa0102ae0 msgr2=0x7f4fa010ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:03.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4fa5a72640 1 --2- 172.21.15.63:0/1669204131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fa0102ae0 0x7f4fa010ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4fa5a72640 1 -- 172.21.15.63:0/1669204131 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa01a8780 con 0x7f4fa01083d0 2024-09-21T06:28:03.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4fa6273640 1 --2- 172.21.15.63:0/1669204131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fa0102ae0 0x7f4fa010ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:03.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4fa6a74640 1 --2- 172.21.15.63:0/1669204131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa0108d20 0x7f4fa0110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:03.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4fa5a72640 1 --2- 172.21.15.63:0/1669204131 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fa01083d0 0x7f4fa0110520 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00c970 tx=0x7f4f9c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:03.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4f937fe640 1 -- 172.21.15.63:0/1669204131 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c007bb0 con 0x7f4fa01083d0 2024-09-21T06:28:03.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4fa84d7640 1 -- 172.21.15.63:0/1669204131 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa01a8a70 con 0x7f4fa01083d0 2024-09-21T06:28:03.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4f937fe640 1 -- 172.21.15.63:0/1669204131 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f9c007d50 con 0x7f4fa01083d0 2024-09-21T06:28:03.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.125+0000 7f4f937fe640 1 -- 172.21.15.63:0/1669204131 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c00f450 con 0x7f4fa01083d0 2024-09-21T06:28:03.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.126+0000 7f4fa84d7640 1 -- 172.21.15.63:0/1669204131 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fa01a9000 con 0x7f4fa01083d0 2024-09-21T06:28:03.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.129+0000 7f4faea4b740 1 Processor -- start 2024-09-21T06:28:03.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.129+0000 7f4faea4b740 1 -- start start 2024-09-21T06:28:03.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.129+0000 7f4faea4b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9cef60 0x55f07fd74f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:03.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.129+0000 7f4faea4b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 0x55f07fd75440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:03.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.129+0000 7f4faea4b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9ae280 0x55f07fd75980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:03.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.129+0000 7f4faea4b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f07fcecc10 con 0x55f07f9a60a0 2024-09-21T06:28:03.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.129+0000 7f4faea4b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f07fcdc040 con 0x55f07f9ae280 2024-09-21T06:28:03.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.129+0000 7f4faea4b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f07fcdfe50 con 0x55f07f9cef60 2024-09-21T06:28:03.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.129+0000 7f4f937fe640 1 -- 172.21.15.63:0/1669204131 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f4f9c004ec0 con 0x7f4fa01083d0 2024-09-21T06:28:03.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.129+0000 7f4fa6273640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 0x55f07fd75440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:03.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.129+0000 7f4fa6273640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 0x55f07fd75440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42602/0 (socket says 172.21.15.63:42602) 2024-09-21T06:28:03.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.129+0000 7f4fa6273640 1 -- 172.21.15.63:0/3661779429 learned_addr learned my addr 172.21.15.63:0/3661779429 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:03.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.129+0000 7f4fa6a74640 1 --2- 172.21.15.63:0/3661779429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9cef60 0x55f07fd74f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:03.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.130+0000 7f4fa5a72640 1 --2- 172.21.15.63:0/3661779429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9ae280 0x55f07fd75980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:03.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.130+0000 7f4fa6273640 1 -- 172.21.15.63:0/3661779429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9cef60 msgr2=0x55f07fd74f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:03.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.130+0000 7f4fa6273640 1 --2- 172.21.15.63:0/3661779429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9cef60 0x55f07fd74f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.130+0000 7f4fa6273640 1 -- 172.21.15.63:0/3661779429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9ae280 msgr2=0x55f07fd75980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:03.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.130+0000 7f4fa6273640 1 --2- 172.21.15.63:0/3661779429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9ae280 0x55f07fd75980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.130+0000 7f4fa6273640 1 -- 172.21.15.63:0/3661779429 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f07fa3a540 con 0x55f07f9a60a0 2024-09-21T06:28:03.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.130+0000 7f4fa5a72640 1 --2- 172.21.15.63:0/3661779429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9ae280 0x55f07fd75980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:03.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.130+0000 7f4fa6273640 1 --2- 172.21.15.63:0/3661779429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 0x55f07fd75440 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4f940096c0 tx=0x7f4f94031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bf04d494b2d814 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:03.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.130+0000 7f4f90ff9640 1 -- 172.21.15.63:0/3661779429 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9403f070 con 0x55f07f9a60a0 2024-09-21T06:28:03.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.130+0000 7f4f90ff9640 1 -- 172.21.15.63:0/3661779429 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f940316a0 con 0x55f07f9a60a0 2024-09-21T06:28:03.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.130+0000 7f4f90ff9640 1 -- 172.21.15.63:0/3661779429 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f94035070 con 0x55f07f9a60a0 2024-09-21T06:28:03.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.130+0000 7f4f937fe640 1 --2- 172.21.15.63:0/1669204131 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4f8c0b65f0 0x7f4f8c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:03.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.131+0000 7f4fa6a74640 1 --2- 172.21.15.63:0/1669204131 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4f8c0b65f0 0x7f4f8c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:03.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.131+0000 7f4f937fe640 1 -- 172.21.15.63:0/1669204131 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f4f9c0e73a0 con 0x7f4fa01083d0 2024-09-21T06:28:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.131+0000 7f4faea4b740 1 -- 172.21.15.63:0/3661779429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 msgr2=0x55f07fd75440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.131+0000 7f4faea4b740 1 --2- 172.21.15.63:0/3661779429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 0x55f07fd75440 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4f940096c0 tx=0x7f4f94031e60 comp rx=0 tx=0).stop 2024-09-21T06:28:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.131+0000 7f4fa6a74640 1 --2- 172.21.15.63:0/1669204131 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4f8c0b65f0 0x7f4f8c0b8b00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800af80 tx=0x7f4f9800a730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.131+0000 7f4faea4b740 1 -- 172.21.15.63:0/3661779429 shutdown_connections 2024-09-21T06:28:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.131+0000 7f4faea4b740 1 --2- 172.21.15.63:0/3661779429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9ae280 0x55f07fd75980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.131+0000 7f4faea4b740 1 --2- 172.21.15.63:0/3661779429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 0x55f07fd75440 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.131+0000 7f4faea4b740 1 --2- 172.21.15.63:0/3661779429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9cef60 0x55f07fd74f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.131+0000 7f4faea4b740 1 -- 172.21.15.63:0/3661779429 >> 172.21.15.63:0/3661779429 conn(0x55f07f9c3350 msgr2=0x55f07fd72df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.132+0000 7f4faea4b740 1 -- 172.21.15.63:0/3661779429 shutdown_connections 2024-09-21T06:28:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.132+0000 7f4faea4b740 1 -- 172.21.15.63:0/3661779429 wait complete. 2024-09-21T06:28:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.132+0000 7f4faea4b740 1 -- start start 2024-09-21T06:28:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.132+0000 7f4faea4b740 1 Processor -- start 2024-09-21T06:28:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.132+0000 7f4faea4b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9a60a0 0x55f07fd80980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.132+0000 7f4faea4b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9ae280 0x55f07fd80ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.132+0000 7f4faea4b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9cef60 0x55f07fd8c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.132+0000 7f4faea4b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f07fb3d5f0 con 0x55f07f9cef60 2024-09-21T06:28:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.132+0000 7f4faea4b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f07fc77010 con 0x55f07f9a60a0 2024-09-21T06:28:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.132+0000 7f4faea4b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f07fd83680 con 0x55f07f9ae280 2024-09-21T06:28:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.132+0000 7f4faea4b740 10 client.0 _ll_register_callbacks cb 0x55f07fcd6340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.133+0000 7f4fa6a74640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9cef60 0x55f07fd8c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.133+0000 7f4fa5a72640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9ae280 0x55f07fd80ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.133+0000 7f4fa6a74640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9cef60 0x55f07fd8c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42614/0 (socket says 172.21.15.63:42614) 2024-09-21T06:28:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.133+0000 7f4fa6a74640 1 -- 172.21.15.63:0/2445774603 learned_addr learned my addr 172.21.15.63:0/2445774603 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.133+0000 7f4fa6273640 1 --2- 172.21.15.63:0/2445774603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9a60a0 0x55f07fd80980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.133+0000 7f4fa6a74640 1 -- 172.21.15.63:0/2445774603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9ae280 msgr2=0x55f07fd80ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.133+0000 7f4fa6a74640 1 --2- 172.21.15.63:0/2445774603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9ae280 0x55f07fd80ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.133+0000 7f4fa6a74640 1 -- 172.21.15.63:0/2445774603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9a60a0 msgr2=0x55f07fd80980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.133+0000 7f4fa6a74640 1 --2- 172.21.15.63:0/2445774603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9a60a0 0x55f07fd80980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.133+0000 7f4fa6a74640 1 -- 172.21.15.63:0/2445774603 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f07fca4a00 con 0x55f07f9cef60 2024-09-21T06:28:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.133+0000 7f4fa5a72640 1 --2- 172.21.15.63:0/2445774603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9ae280 0x55f07fd80ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.133+0000 7f4fa6a74640 1 --2- 172.21.15.63:0/2445774603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9cef60 0x55f07fd8c970 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800fe90 tx=0x7f4f98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10a36cc67013f67 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.133+0000 7f4f89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:28:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.134+0000 7f4f89ffb640 1 -- 172.21.15.63:0/2445774603 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f98029060 con 0x55f07f9cef60 2024-09-21T06:28:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.134+0000 7f4f89ffb640 1 -- 172.21.15.63:0/2445774603 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f4f9801a670 con 0x55f07f9cef60 2024-09-21T06:28:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.134+0000 7f4faea4b740 1 -- 172.21.15.63:0/2445774603 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f940316a0 con 0x55f07f9cef60 2024-09-21T06:28:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.134+0000 7f4f89ffb640 1 -- 172.21.15.63:0/2445774603 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4f9801ce10 con 0x55f07f9cef60 2024-09-21T06:28:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.134+0000 7f4faea4b740 10 client.15363 fetch_fsmap learned FSMap version 28 2024-09-21T06:28:03.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.134+0000 7f4faea4b740 1 -- 172.21.15.63:0/2445774603 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f07fd8f5b0 con 0x55f07f9cef60 2024-09-21T06:28:03.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.134+0000 7f4f89ffb640 1 -- 172.21.15.63:0/2445774603 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f940316a0 con 0x55f07f9cef60 2024-09-21T06:28:03.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.134+0000 7f4f89ffb640 1 -- 172.21.15.63:0/2445774603 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4f98018040 con 0x55f07f9cef60 2024-09-21T06:28:03.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.134+0000 7f4faea4b740 10 client.15363 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:28:03.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.134+0000 7f4faea4b740 10 client.15363 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T06:28:03.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.134+0000 7f4faea4b740 20 client.15363 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:03.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.134+0000 7f4faea4b740 1 --2- 172.21.15.63:0/2445774603 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55f07f98d8e0 0x55f07fd93060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:03.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.134+0000 7f4faea4b740 4 client.15363 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:03.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.134+0000 7f4faea4b740 1 -- 172.21.15.63:0/2445774603 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f07fceeb60 con 0x55f07f98d8e0 2024-09-21T06:28:03.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.135+0000 7f4fa6273640 1 --2- 172.21.15.63:0/2445774603 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55f07f98d8e0 0x55f07fd93060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:03.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.135+0000 7f4f89ffb640 10 client.15363 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:28:03.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.135+0000 7f4fa6273640 1 --2- 172.21.15.63:0/2445774603 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55f07f98d8e0 0x55f07fd93060 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6e8643152724dcaf server_cookie=37d31ec92bc8bf4f in_seq=0 out_seq=0 2024-09-21T06:28:03.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.136+0000 7f4f89ffb640 1 -- 172.21.15.63:0/2445774603 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f07fceeb60 con 0x55f07f98d8e0 2024-09-21T06:28:03.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.136+0000 7f4f89ffb640 10 client.15363 handle_command_reply: tid=0 2024-09-21T06:28:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.136+0000 7f4faea4b740 1 client.15363 shutdown 2024-09-21T06:28:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.136+0000 7f4faea4b740 1 -- 172.21.15.63:0/2445774603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9cef60 msgr2=0x55f07fd8c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.136+0000 7f4faea4b740 1 --2- 172.21.15.63:0/2445774603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9cef60 0x55f07fd8c970 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800fe90 tx=0x7f4f98004a40 comp rx=0 tx=0).stop 2024-09-21T06:28:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.136+0000 7f4faea4b740 1 -- 172.21.15.63:0/2445774603 shutdown_connections 2024-09-21T06:28:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.136+0000 7f4faea4b740 1 --2- 172.21.15.63:0/2445774603 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55f07f98d8e0 0x55f07fd93060 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.136+0000 7f4faea4b740 1 --2- 172.21.15.63:0/2445774603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9cef60 0x55f07fd8c970 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.136+0000 7f4faea4b740 1 --2- 172.21.15.63:0/2445774603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9ae280 0x55f07fd80ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.136+0000 7f4f89ffb640 0 client.15363 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:28:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.136+0000 7f4faea4b740 1 --2- 172.21.15.63:0/2445774603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9a60a0 0x55f07fd80980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.136+0000 7f4faea4b740 1 -- 172.21.15.63:0/2445774603 >> 172.21.15.63:0/2445774603 conn(0x55f07f9c3350 msgr2=0x55f07fd78090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.136+0000 7f4faea4b740 1 -- 172.21.15.63:0/2445774603 shutdown_connections 2024-09-21T06:28:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.136+0000 7f4faea4b740 1 -- 172.21.15.63:0/2445774603 wait complete. 2024-09-21T06:28:03.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.136+0000 7f4faea4b740 20 client.15363 trim_cache size 0 max 16384 2024-09-21T06:28:03.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.154+0000 7f4faea4b740 1 Processor -- start 2024-09-21T06:28:03.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.155+0000 7f4faea4b740 1 -- start start 2024-09-21T06:28:03.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.155+0000 7f4faea4b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 0x55f07fd6dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:03.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.155+0000 7f4faea4b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9ae280 0x55f07fd8c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:03.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.155+0000 7f4faea4b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9cef60 0x55f07fd8ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:03.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.155+0000 7f4faea4b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f07fd913a0 con 0x55f07f9a60a0 2024-09-21T06:28:03.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.155+0000 7f4faea4b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f07fd91a70 con 0x55f07f9cef60 2024-09-21T06:28:03.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.155+0000 7f4faea4b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f07fd92140 con 0x55f07f9ae280 2024-09-21T06:28:03.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.155+0000 7f4fa6273640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 0x55f07fd6dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:03.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.155+0000 7f4fa6273640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 0x55f07fd6dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42630/0 (socket says 172.21.15.63:42630) 2024-09-21T06:28:03.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.155+0000 7f4fa6273640 1 -- 172.21.15.63:0/2815387623 learned_addr learned my addr 172.21.15.63:0/2815387623 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:03.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.155+0000 7f4fa5a72640 1 --2- 172.21.15.63:0/2815387623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9ae280 0x55f07fd8c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:03.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.155+0000 7f4fa6a74640 1 --2- 172.21.15.63:0/2815387623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9cef60 0x55f07fd8ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:03.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.155+0000 7f4fa6273640 1 -- 172.21.15.63:0/2815387623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9ae280 msgr2=0x55f07fd8c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:03.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.155+0000 7f4fa6273640 1 --2- 172.21.15.63:0/2815387623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9ae280 0x55f07fd8c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.155+0000 7f4fa6273640 1 -- 172.21.15.63:0/2815387623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9cef60 msgr2=0x55f07fd8ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:03.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.155+0000 7f4fa6273640 1 --2- 172.21.15.63:0/2815387623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9cef60 0x55f07fd8ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.155+0000 7f4fa6273640 1 -- 172.21.15.63:0/2815387623 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f07fd77790 con 0x55f07f9a60a0 2024-09-21T06:28:03.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.155+0000 7f4fa6a74640 1 --2- 172.21.15.63:0/2815387623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9cef60 0x55f07fd8ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:03.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.156+0000 7f4fa6273640 1 --2- 172.21.15.63:0/2815387623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 0x55f07fd6dad0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4f94009900 tx=0x7f4f9402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac6b7368d359c36 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:03.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.156+0000 7f4f8bfff640 1 -- 172.21.15.63:0/2815387623 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f94035050 con 0x55f07f9a60a0 2024-09-21T06:28:03.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.156+0000 7f4f8bfff640 1 -- 172.21.15.63:0/2815387623 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f940318d0 con 0x55f07f9a60a0 2024-09-21T06:28:03.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.156+0000 7f4f8bfff640 1 -- 172.21.15.63:0/2815387623 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9403f040 con 0x55f07f9a60a0 2024-09-21T06:28:03.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.157+0000 7f4faea4b740 1 -- 172.21.15.63:0/2815387623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 msgr2=0x55f07fd6dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:03.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.157+0000 7f4faea4b740 1 --2- 172.21.15.63:0/2815387623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 0x55f07fd6dad0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4f94009900 tx=0x7f4f9402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:03.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.157+0000 7f4faea4b740 1 -- 172.21.15.63:0/2815387623 shutdown_connections 2024-09-21T06:28:03.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.157+0000 7f4faea4b740 1 --2- 172.21.15.63:0/2815387623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9cef60 0x55f07fd8ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.157+0000 7f4faea4b740 1 --2- 172.21.15.63:0/2815387623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9ae280 0x55f07fd8c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.157+0000 7f4faea4b740 1 --2- 172.21.15.63:0/2815387623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 0x55f07fd6dad0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.157+0000 7f4faea4b740 1 -- 172.21.15.63:0/2815387623 >> 172.21.15.63:0/2815387623 conn(0x55f07f9c3350 msgr2=0x55f07fd7b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:03.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.157+0000 7f4faea4b740 1 -- 172.21.15.63:0/2815387623 shutdown_connections 2024-09-21T06:28:03.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.157+0000 7f4faea4b740 1 -- 172.21.15.63:0/2815387623 wait complete. 2024-09-21T06:28:03.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.157+0000 7f4faea4b740 1 -- start start 2024-09-21T06:28:03.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.157+0000 7f4faea4b740 1 Processor -- start 2024-09-21T06:28:03.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.157+0000 7f4faea4b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 0x55f07fd9bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:03.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.157+0000 7f4faea4b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9ae280 0x55f07fd950a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:03.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.157+0000 7f4faea4b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9cef60 0x55f07fd956f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:03.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.157+0000 7f4faea4b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f07fd92ee0 con 0x55f07f9a60a0 2024-09-21T06:28:03.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.157+0000 7f4faea4b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f07fd92810 con 0x55f07f9cef60 2024-09-21T06:28:03.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.158+0000 7f4faea4b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f07fd935b0 con 0x55f07f9ae280 2024-09-21T06:28:03.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.158+0000 7f4faea4b740 10 client.0 _ll_register_callbacks cb 0x7f4f9800abd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:03.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.158+0000 7f4fa6273640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 0x55f07fd9bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:03.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.158+0000 7f4fa6273640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 0x55f07fd9bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42644/0 (socket says 172.21.15.63:42644) 2024-09-21T06:28:03.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.158+0000 7f4fa6273640 1 -- 172.21.15.63:0/4205637254 learned_addr learned my addr 172.21.15.63:0/4205637254 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:03.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.158+0000 7f4fa5a72640 1 --2- 172.21.15.63:0/4205637254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9ae280 0x55f07fd950a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:03.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.158+0000 7f4fa6a74640 1 --2- 172.21.15.63:0/4205637254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9cef60 0x55f07fd956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:03.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.158+0000 7f4fa6273640 1 -- 172.21.15.63:0/4205637254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9ae280 msgr2=0x55f07fd950a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:03.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.158+0000 7f4fa6273640 1 --2- 172.21.15.63:0/4205637254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9ae280 0x55f07fd950a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.158+0000 7f4fa6273640 1 -- 172.21.15.63:0/4205637254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9cef60 msgr2=0x55f07fd956f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:03.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.158+0000 7f4fa6273640 1 --2- 172.21.15.63:0/4205637254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9cef60 0x55f07fd956f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.158+0000 7f4fa6273640 1 -- 172.21.15.63:0/4205637254 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f07fd95e80 con 0x55f07f9a60a0 2024-09-21T06:28:03.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.158+0000 7f4fa6a74640 1 --2- 172.21.15.63:0/4205637254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9cef60 0x55f07fd956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:03.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.158+0000 7f4fa6273640 1 --2- 172.21.15.63:0/4205637254 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 0x55f07fd9bbf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4f9402a930 tx=0x7f4f94031720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3218498de8a9a3bb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:03.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.158+0000 7f4f89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:28:03.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.158+0000 7f4f89ffb640 1 -- 172.21.15.63:0/4205637254 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f94035070 con 0x55f07f9a60a0 2024-09-21T06:28:03.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.158+0000 7f4faea4b740 1 -- 172.21.15.63:0/4205637254 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f940318d0 con 0x55f07f9a60a0 2024-09-21T06:28:03.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.158+0000 7f4f89ffb640 1 -- 172.21.15.63:0/4205637254 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f4f94004240 con 0x55f07f9a60a0 2024-09-21T06:28:03.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.159+0000 7f4f89ffb640 1 -- 172.21.15.63:0/4205637254 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4f94063050 con 0x55f07f9a60a0 2024-09-21T06:28:03.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.159+0000 7f4faea4b740 10 client.15369 fetch_fsmap learned FSMap version 28 2024-09-21T06:28:03.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.159+0000 7f4faea4b740 1 -- 172.21.15.63:0/4205637254 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f07fdfe590 con 0x55f07f9a60a0 2024-09-21T06:28:03.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.159+0000 7f4f89ffb640 1 -- 172.21.15.63:0/4205637254 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f940318d0 con 0x55f07f9a60a0 2024-09-21T06:28:03.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.159+0000 7f4f89ffb640 1 -- 172.21.15.63:0/4205637254 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4f94003820 con 0x55f07f9a60a0 2024-09-21T06:28:03.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.159+0000 7f4faea4b740 10 client.15369 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:28:03.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.159+0000 7f4faea4b740 10 client.15369 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T06:28:03.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.159+0000 7f4faea4b740 20 client.15369 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:03.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.159+0000 7f4faea4b740 1 --2- 172.21.15.63:0/4205637254 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55f07f962c90 0x55f07fe017a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:03.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.159+0000 7f4faea4b740 4 client.15369 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:28:03.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.159+0000 7f4faea4b740 1 -- 172.21.15.63:0/4205637254 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "status"}) -- 0x55f07fcea610 con 0x55f07f962c90 2024-09-21T06:28:03.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.159+0000 7f4fa5a72640 1 --2- 172.21.15.63:0/4205637254 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55f07f962c90 0x55f07fe017a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:03.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.160+0000 7f4f89ffb640 10 client.15369 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:28:03.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.160+0000 7f4fa5a72640 1 --2- 172.21.15.63:0/4205637254 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55f07f962c90 0x55f07fe017a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b890e1c8fd6de99c server_cookie=479519f47d62ee33 in_seq=0 out_seq=0 2024-09-21T06:28:03.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.160+0000 7f4f89ffb640 1 -- 172.21.15.63:0/4205637254 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f07fcea610 con 0x55f07f962c90 2024-09-21T06:28:03.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.160+0000 7f4f89ffb640 10 client.15369 handle_command_reply: tid=0 2024-09-21T06:28:03.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.160+0000 7f4faea4b740 1 client.15369 shutdown 2024-09-21T06:28:03.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.160+0000 7f4faea4b740 1 -- 172.21.15.63:0/4205637254 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 msgr2=0x55f07fd9bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:03.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.160+0000 7f4faea4b740 1 --2- 172.21.15.63:0/4205637254 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 0x55f07fd9bbf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4f9402a930 tx=0x7f4f94031720 comp rx=0 tx=0).stop 2024-09-21T06:28:03.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.160+0000 7f4faea4b740 1 -- 172.21.15.63:0/4205637254 shutdown_connections 2024-09-21T06:28:03.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.160+0000 7f4faea4b740 1 --2- 172.21.15.63:0/4205637254 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55f07f962c90 0x55f07fe017a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.160+0000 7f4faea4b740 1 --2- 172.21.15.63:0/4205637254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f07f9cef60 0x55f07fd956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.160+0000 7f4faea4b740 1 --2- 172.21.15.63:0/4205637254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f07f9ae280 0x55f07fd950a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.160+0000 7f4faea4b740 1 --2- 172.21.15.63:0/4205637254 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f07f9a60a0 0x55f07fd9bbf0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.160+0000 7f4faea4b740 1 -- 172.21.15.63:0/4205637254 >> 172.21.15.63:0/4205637254 conn(0x55f07f9c3350 msgr2=0x55f07fd72600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:03.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.160+0000 7f4f89ffb640 0 client.15369 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:28:03.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.160+0000 7f4faea4b740 1 -- 172.21.15.63:0/4205637254 shutdown_connections 2024-09-21T06:28:03.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.160+0000 7f4faea4b740 1 -- 172.21.15.63:0/4205637254 wait complete. 2024-09-21T06:28:03.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.160+0000 7f4faea4b740 20 client.15369 trim_cache size 0 max 16384 2024-09-21T06:28:03.168 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:28:03.168 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "140899c8-77e1-11ef-baf5-efdc52797490", 2024-09-21T06:28:03.168 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 3, 2024-09-21T06:28:03.168 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 24670, 2024-09-21T06:28:03.168 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-21T06:28:03.168 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-21T06:28:03.168 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-21T06:28:03.168 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 94.815824402999993, 2024-09-21T06:28:03.168 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 28, 2024-09-21T06:28:03.168 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 77, 2024-09-21T06:28:03.169 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:28:03.169 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 130.45610182300001 2024-09-21T06:28:03.169 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:28:03.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.161+0000 7f4fa84d7640 1 -- 172.21.15.63:0/1669204131 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4f8c0b65f0 msgr2=0x7f4f8c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.161+0000 7f4fa84d7640 1 --2- 172.21.15.63:0/1669204131 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4f8c0b65f0 0x7f4f8c0b8b00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800af80 tx=0x7f4f9800a730 comp rx=0 tx=0).stop 2024-09-21T06:28:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.161+0000 7f4fa84d7640 1 -- 172.21.15.63:0/1669204131 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fa01083d0 msgr2=0x7f4fa0110520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.161+0000 7f4fa84d7640 1 --2- 172.21.15.63:0/1669204131 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fa01083d0 0x7f4fa0110520 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00c970 tx=0x7f4f9c00ce30 comp rx=0 tx=0).stop 2024-09-21T06:28:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.161+0000 7f4fa84d7640 1 -- 172.21.15.63:0/1669204131 shutdown_connections 2024-09-21T06:28:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.161+0000 7f4fa84d7640 1 --2- 172.21.15.63:0/1669204131 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4f8c0b65f0 0x7f4f8c0b8b00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.161+0000 7f4fa84d7640 1 --2- 172.21.15.63:0/1669204131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa0108d20 0x7f4fa0110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.161+0000 7f4fa84d7640 1 --2- 172.21.15.63:0/1669204131 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fa01083d0 0x7f4fa0110520 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.161+0000 7f4fa84d7640 1 --2- 172.21.15.63:0/1669204131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fa0102ae0 0x7f4fa010ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.161+0000 7f4fa84d7640 1 -- 172.21.15.63:0/1669204131 >> 172.21.15.63:0/1669204131 conn(0x7f4fa0079760 msgr2=0x7f4fa01014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.161+0000 7f4fa84d7640 1 -- 172.21.15.63:0/1669204131 shutdown_connections 2024-09-21T06:28:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:03.161+0000 7f4fa84d7640 1 -- 172.21.15.63:0/1669204131 wait complete. 2024-09-21T06:28:03.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:03 smithi063 ceph-mon[31150]: pgmap v317: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:28:03.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:03 smithi175 ceph-mon[34510]: pgmap v317: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:28:03.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:03 smithi071 ceph-mon[34844]: pgmap v317: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:28:03.950 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T06:28:04.206 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:04.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.675+0000 7fb534c7d640 1 -- 172.21.15.63:0/534222582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb530108d20 msgr2=0x7fb53010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:04.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.675+0000 7fb534c7d640 1 --2- 172.21.15.63:0/534222582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb530108d20 0x7fb53010f550 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb528009ca0 tx=0x7fb52802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.675+0000 7fb534c7d640 1 -- 172.21.15.63:0/534222582 shutdown_connections 2024-09-21T06:28:04.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.675+0000 7fb534c7d640 1 --2- 172.21.15.63:0/534222582 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb530108d20 0x7fb53010f550 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.675+0000 7fb534c7d640 1 --2- 172.21.15.63:0/534222582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5301083d0 0x7fb5301087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.675+0000 7fb534c7d640 1 --2- 172.21.15.63:0/534222582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb530102a90 0x7fb530102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.675+0000 7fb534c7d640 1 -- 172.21.15.63:0/534222582 >> 172.21.15.63:0/534222582 conn(0x7fb530079750 msgr2=0x7fb530079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:04.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.675+0000 7fb534c7d640 1 -- 172.21.15.63:0/534222582 shutdown_connections 2024-09-21T06:28:04.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.675+0000 7fb534c7d640 1 -- 172.21.15.63:0/534222582 wait complete. 2024-09-21T06:28:04.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.676+0000 7fb534c7d640 1 Processor -- start 2024-09-21T06:28:04.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.676+0000 7fb534c7d640 1 -- start start 2024-09-21T06:28:04.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.677+0000 7fb534c7d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb530102a90 0x7fb53019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.677+0000 7fb534c7d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5301083d0 0x7fb53019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.677+0000 7fb534c7d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb530108d20 0x7fb53019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.677+0000 7fb534c7d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb530113ab0 con 0x7fb530108d20 2024-09-21T06:28:04.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.677+0000 7fb534c7d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb530113930 con 0x7fb530102a90 2024-09-21T06:28:04.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.677+0000 7fb534c7d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb530113c30 con 0x7fb5301083d0 2024-09-21T06:28:04.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.677+0000 7fb52ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb530108d20 0x7fb53019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.677+0000 7fb52ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb530108d20 0x7fb53019fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42660/0 (socket says 172.21.15.63:42660) 2024-09-21T06:28:04.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.677+0000 7fb52ed9d640 1 -- 172.21.15.63:0/3617998670 learned_addr learned my addr 172.21.15.63:0/3617998670 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:04.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.677+0000 7fb52dd9b640 1 --2- 172.21.15.63:0/3617998670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5301083d0 0x7fb53019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.677+0000 7fb52e59c640 1 --2- 172.21.15.63:0/3617998670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb530102a90 0x7fb53019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.677+0000 7fb52ed9d640 1 -- 172.21.15.63:0/3617998670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5301083d0 msgr2=0x7fb53019a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:04.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.677+0000 7fb52ed9d640 1 --2- 172.21.15.63:0/3617998670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5301083d0 0x7fb53019a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.677+0000 7fb52ed9d640 1 -- 172.21.15.63:0/3617998670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb530102a90 msgr2=0x7fb53019a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:04.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.677+0000 7fb52ed9d640 1 --2- 172.21.15.63:0/3617998670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb530102a90 0x7fb53019a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.677+0000 7fb52ed9d640 1 -- 172.21.15.63:0/3617998670 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5301a02b0 con 0x7fb530108d20 2024-09-21T06:28:04.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.677+0000 7fb52e59c640 1 --2- 172.21.15.63:0/3617998670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb530102a90 0x7fb53019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:04.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.677+0000 7fb52ed9d640 1 --2- 172.21.15.63:0/3617998670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb530108d20 0x7fb53019fc40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb528005cc0 tx=0x7fb52802f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:04.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.678+0000 7fb5277fe640 1 -- 172.21.15.63:0/3617998670 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb528003cf0 con 0x7fb530108d20 2024-09-21T06:28:04.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.678+0000 7fb534c7d640 1 -- 172.21.15.63:0/3617998670 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5301a0540 con 0x7fb530108d20 2024-09-21T06:28:04.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.678+0000 7fb5277fe640 1 -- 172.21.15.63:0/3617998670 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5280044f0 con 0x7fb530108d20 2024-09-21T06:28:04.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.678+0000 7fb5277fe640 1 -- 172.21.15.63:0/3617998670 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52802fd10 con 0x7fb530108d20 2024-09-21T06:28:04.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.678+0000 7fb534c7d640 1 -- 172.21.15.63:0/3617998670 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5301a6dc0 con 0x7fb530108d20 2024-09-21T06:28:04.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.680+0000 7fb53b1f1740 1 Processor -- start 2024-09-21T06:28:04.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.680+0000 7fb5277fe640 1 -- 172.21.15.63:0/3617998670 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fb5280305c0 con 0x7fb530108d20 2024-09-21T06:28:04.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.681+0000 7fb53b1f1740 1 -- start start 2024-09-21T06:28:04.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.681+0000 7fb53b1f1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf4306f60 0x555cf46acf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.681+0000 7fb53b1f1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf42de0a0 0x555cf46ad440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.681+0000 7fb53b1f1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42e6280 0x555cf46ad980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.681+0000 7fb53b1f1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555cf4624c10 con 0x555cf42e6280 2024-09-21T06:28:04.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.681+0000 7fb53b1f1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555cf4614040 con 0x555cf4306f60 2024-09-21T06:28:04.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.681+0000 7fb53b1f1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555cf4617e50 con 0x555cf42de0a0 2024-09-21T06:28:04.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.681+0000 7fb52dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42e6280 0x555cf46ad980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.681+0000 7fb52dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42e6280 0x555cf46ad980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42676/0 (socket says 172.21.15.63:42676) 2024-09-21T06:28:04.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.681+0000 7fb52e59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf42de0a0 0x555cf46ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.681+0000 7fb52dd9b640 1 -- 172.21.15.63:0/860239471 learned_addr learned my addr 172.21.15.63:0/860239471 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:04.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.681+0000 7fb52dd9b640 1 --2- 172.21.15.63:0/860239471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf4306f60 0x555cf46acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.681+0000 7fb52dd9b640 1 -- 172.21.15.63:0/860239471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf42de0a0 msgr2=0x555cf46ad440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:04.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.681+0000 7fb52dd9b640 1 --2- 172.21.15.63:0/860239471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf42de0a0 0x555cf46ad440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.681+0000 7fb52dd9b640 1 -- 172.21.15.63:0/860239471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf4306f60 msgr2=0x555cf46acf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:04.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.681+0000 7fb52dd9b640 1 --2- 172.21.15.63:0/860239471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf4306f60 0x555cf46acf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.681+0000 7fb52dd9b640 1 -- 172.21.15.63:0/860239471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cf4372540 con 0x555cf42e6280 2024-09-21T06:28:04.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.682+0000 7fb5277fe640 1 --2- 172.21.15.63:0/3617998670 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb51c0b6620 0x7fb51c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.682+0000 7fb52dd9b640 1 --2- 172.21.15.63:0/860239471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42e6280 0x555cf46ad980 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb520013910 tx=0x7fb52000e430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed7e2c963750c09 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:04.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.682+0000 7fb52e59c640 1 --2- 172.21.15.63:0/3617998670 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb51c0b6620 0x7fb51c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.682+0000 7fb5277fe640 1 -- 172.21.15.63:0/3617998670 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fb528108d50 con 0x7fb530108d20 2024-09-21T06:28:04.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.682+0000 7fb524ff9640 1 -- 172.21.15.63:0/860239471 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52000b8f0 con 0x555cf42e6280 2024-09-21T06:28:04.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.682+0000 7fb524ff9640 1 -- 172.21.15.63:0/860239471 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb520005020 con 0x555cf42e6280 2024-09-21T06:28:04.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.682+0000 7fb524ff9640 1 -- 172.21.15.63:0/860239471 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb520004a00 con 0x555cf42e6280 2024-09-21T06:28:04.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.683+0000 7fb53b1f1740 1 -- 172.21.15.63:0/860239471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42e6280 msgr2=0x555cf46ad980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:04.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.683+0000 7fb52e59c640 1 --2- 172.21.15.63:0/3617998670 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb51c0b6620 0x7fb51c0b8b30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x555cf46abb80 tx=0x7fb51800b470 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:04.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.683+0000 7fb53b1f1740 1 --2- 172.21.15.63:0/860239471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42e6280 0x555cf46ad980 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb520013910 tx=0x7fb52000e430 comp rx=0 tx=0).stop 2024-09-21T06:28:04.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.683+0000 7fb53b1f1740 1 -- 172.21.15.63:0/860239471 shutdown_connections 2024-09-21T06:28:04.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.683+0000 7fb53b1f1740 1 --2- 172.21.15.63:0/860239471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42e6280 0x555cf46ad980 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.683+0000 7fb53b1f1740 1 --2- 172.21.15.63:0/860239471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf42de0a0 0x555cf46ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.683+0000 7fb53b1f1740 1 --2- 172.21.15.63:0/860239471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf4306f60 0x555cf46acf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.683+0000 7fb53b1f1740 1 -- 172.21.15.63:0/860239471 >> 172.21.15.63:0/860239471 conn(0x555cf42fb350 msgr2=0x555cf46aadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:04.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.683+0000 7fb53b1f1740 1 -- 172.21.15.63:0/860239471 shutdown_connections 2024-09-21T06:28:04.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.683+0000 7fb53b1f1740 1 -- 172.21.15.63:0/860239471 wait complete. 2024-09-21T06:28:04.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.684+0000 7fb53b1f1740 1 -- start start 2024-09-21T06:28:04.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.684+0000 7fb53b1f1740 1 Processor -- start 2024-09-21T06:28:04.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.684+0000 7fb53b1f1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42de0a0 0x555cf46bce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.684+0000 7fb53b1f1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf42e6280 0x555cf46bd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.684+0000 7fb53b1f1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf4306f60 0x555cf46c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.684+0000 7fb53b1f1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555cf44755f0 con 0x555cf42de0a0 2024-09-21T06:28:04.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.684+0000 7fb53b1f1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555cf45af010 con 0x555cf42e6280 2024-09-21T06:28:04.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.684+0000 7fb53b1f1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555cf46bf9e0 con 0x555cf4306f60 2024-09-21T06:28:04.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.684+0000 7fb53b1f1740 10 client.0 _ll_register_callbacks cb 0x555cf460e340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:04.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.684+0000 7fb52e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42de0a0 0x555cf46bce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.684+0000 7fb52e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42de0a0 0x555cf46bce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42692/0 (socket says 172.21.15.63:42692) 2024-09-21T06:28:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.684+0000 7fb52e59c640 1 -- 172.21.15.63:0/4035710502 learned_addr learned my addr 172.21.15.63:0/4035710502 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.684+0000 7fb52dd9b640 1 --2- 172.21.15.63:0/4035710502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf42e6280 0x555cf46bd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.684+0000 7fb52ed9d640 1 --2- 172.21.15.63:0/4035710502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf4306f60 0x555cf46c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.684+0000 7fb52e59c640 1 -- 172.21.15.63:0/4035710502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf4306f60 msgr2=0x555cf46c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.685+0000 7fb52e59c640 1 --2- 172.21.15.63:0/4035710502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf4306f60 0x555cf46c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.685+0000 7fb52e59c640 1 -- 172.21.15.63:0/4035710502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf42e6280 msgr2=0x555cf46bd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.685+0000 7fb52e59c640 1 --2- 172.21.15.63:0/4035710502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf42e6280 0x555cf46bd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.685+0000 7fb52e59c640 1 -- 172.21.15.63:0/4035710502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cf45dca00 con 0x555cf42de0a0 2024-09-21T06:28:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.685+0000 7fb52ed9d640 1 --2- 172.21.15.63:0/4035710502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf4306f60 0x555cf46c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.685+0000 7fb52e59c640 1 --2- 172.21.15.63:0/4035710502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42de0a0 0x555cf46bce20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb51801bce0 tx=0x7fb5180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc037079db90636f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.685+0000 7fb515ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:28:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.685+0000 7fb515ffb640 1 -- 172.21.15.63:0/4035710502 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51800ecc0 con 0x555cf42de0a0 2024-09-21T06:28:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.685+0000 7fb53b1f1740 1 -- 172.21.15.63:0/4035710502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb520005020 con 0x555cf42de0a0 2024-09-21T06:28:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.685+0000 7fb515ffb640 1 -- 172.21.15.63:0/4035710502 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fb518027480 con 0x555cf42de0a0 2024-09-21T06:28:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.685+0000 7fb515ffb640 1 -- 172.21.15.63:0/4035710502 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb51800ee60 con 0x555cf42de0a0 2024-09-21T06:28:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.685+0000 7fb53b1f1740 10 client.15381 fetch_fsmap learned FSMap version 28 2024-09-21T06:28:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.685+0000 7fb53b1f1740 1 -- 172.21.15.63:0/4035710502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555cf46cb9c0 con 0x555cf42de0a0 2024-09-21T06:28:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.685+0000 7fb515ffb640 1 -- 172.21.15.63:0/4035710502 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb520005020 con 0x555cf42de0a0 2024-09-21T06:28:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.686+0000 7fb515ffb640 1 -- 172.21.15.63:0/4035710502 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb51801c610 con 0x555cf42de0a0 2024-09-21T06:28:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.686+0000 7fb53b1f1740 10 client.15381 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:28:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.686+0000 7fb53b1f1740 10 client.15381 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:28:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.686+0000 7fb53b1f1740 20 client.15381 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.686+0000 7fb53b1f1740 1 --2- 172.21.15.63:0/4035710502 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x555cf42c58e0 0x555cf46cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.686+0000 7fb53b1f1740 4 client.15381 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.686+0000 7fb53b1f1740 1 -- 172.21.15.63:0/4035710502 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cf4626b60 con 0x555cf42c58e0 2024-09-21T06:28:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.686+0000 7fb52dd9b640 1 --2- 172.21.15.63:0/4035710502 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x555cf42c58e0 0x555cf46cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.686+0000 7fb52dd9b640 1 --2- 172.21.15.63:0/4035710502 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x555cf42c58e0 0x555cf46cf420 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9f46123de5996ed7 server_cookie=4bbfe410172d70ec in_seq=0 out_seq=0 2024-09-21T06:28:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.686+0000 7fb515ffb640 10 client.15381 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:28:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.687+0000 7fb515ffb640 1 -- 172.21.15.63:0/4035710502 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555cf4626b60 con 0x555cf42c58e0 2024-09-21T06:28:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.687+0000 7fb515ffb640 10 client.15381 handle_command_reply: tid=0 2024-09-21T06:28:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.687+0000 7fb53b1f1740 1 client.15381 shutdown 2024-09-21T06:28:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.687+0000 7fb53b1f1740 1 -- 172.21.15.63:0/4035710502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42de0a0 msgr2=0x555cf46bce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.687+0000 7fb53b1f1740 1 --2- 172.21.15.63:0/4035710502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42de0a0 0x555cf46bce20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb51801bce0 tx=0x7fb5180046c0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.687+0000 7fb53b1f1740 1 -- 172.21.15.63:0/4035710502 shutdown_connections 2024-09-21T06:28:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.687+0000 7fb53b1f1740 1 --2- 172.21.15.63:0/4035710502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf4306f60 0x555cf46c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.687+0000 7fb53b1f1740 1 --2- 172.21.15.63:0/4035710502 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x555cf42c58e0 0x555cf46cf420 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.687+0000 7fb53b1f1740 1 --2- 172.21.15.63:0/4035710502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf42e6280 0x555cf46bd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.687+0000 7fb53b1f1740 1 --2- 172.21.15.63:0/4035710502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42de0a0 0x555cf46bce20 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.687+0000 7fb515ffb640 0 client.15381 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:28:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.687+0000 7fb53b1f1740 1 -- 172.21.15.63:0/4035710502 >> 172.21.15.63:0/4035710502 conn(0x555cf42fb350 msgr2=0x555cf46ae8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:04.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.688+0000 7fb53b1f1740 1 -- 172.21.15.63:0/4035710502 shutdown_connections 2024-09-21T06:28:04.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.688+0000 7fb53b1f1740 1 -- 172.21.15.63:0/4035710502 wait complete. 2024-09-21T06:28:04.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.688+0000 7fb53b1f1740 20 client.15381 trim_cache size 0 max 16384 2024-09-21T06:28:04.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.706+0000 7fb53b1f1740 1 Processor -- start 2024-09-21T06:28:04.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.706+0000 7fb53b1f1740 1 -- start start 2024-09-21T06:28:04.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.706+0000 7fb53b1f1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42de0a0 0x555cf46cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.706+0000 7fb53b1f1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf42e6280 0x555cf46b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.706+0000 7fb53b1f1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf4306f60 0x555cf46bce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.706+0000 7fb53b1f1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555cf46cd760 con 0x555cf42de0a0 2024-09-21T06:28:04.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.706+0000 7fb53b1f1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555cf46cde30 con 0x555cf42e6280 2024-09-21T06:28:04.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.706+0000 7fb53b1f1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555cf46ce500 con 0x555cf4306f60 2024-09-21T06:28:04.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.706+0000 7fb52e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42de0a0 0x555cf46cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.706+0000 7fb52e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42de0a0 0x555cf46cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42698/0 (socket says 172.21.15.63:42698) 2024-09-21T06:28:04.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.706+0000 7fb52e59c640 1 -- 172.21.15.63:0/2078293088 learned_addr learned my addr 172.21.15.63:0/2078293088 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:04.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.706+0000 7fb52ed9d640 1 --2- 172.21.15.63:0/2078293088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf4306f60 0x555cf46bce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.706+0000 7fb52dd9b640 1 --2- 172.21.15.63:0/2078293088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf42e6280 0x555cf46b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.707+0000 7fb52e59c640 1 -- 172.21.15.63:0/2078293088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf4306f60 msgr2=0x555cf46bce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:04.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.707+0000 7fb52e59c640 1 --2- 172.21.15.63:0/2078293088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf4306f60 0x555cf46bce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.707+0000 7fb52e59c640 1 -- 172.21.15.63:0/2078293088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf42e6280 msgr2=0x555cf46b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:04.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.707+0000 7fb52e59c640 1 --2- 172.21.15.63:0/2078293088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf42e6280 0x555cf46b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.707+0000 7fb52e59c640 1 -- 172.21.15.63:0/2078293088 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cf46add40 con 0x555cf42de0a0 2024-09-21T06:28:04.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.707+0000 7fb52ed9d640 1 --2- 172.21.15.63:0/2078293088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf4306f60 0x555cf46bce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:04.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.707+0000 7fb52dd9b640 1 --2- 172.21.15.63:0/2078293088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf42e6280 0x555cf46b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:04.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.707+0000 7fb52e59c640 1 --2- 172.21.15.63:0/2078293088 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42de0a0 0x555cf46cdfb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb51801b730 tx=0x7fb51801b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95d059bcec5907c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:04.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.707+0000 7fb517fff640 1 -- 172.21.15.63:0/2078293088 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51803f070 con 0x555cf42de0a0 2024-09-21T06:28:04.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.707+0000 7fb517fff640 1 -- 172.21.15.63:0/2078293088 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb518036050 con 0x555cf42de0a0 2024-09-21T06:28:04.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.707+0000 7fb517fff640 1 -- 172.21.15.63:0/2078293088 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb518034030 con 0x555cf42de0a0 2024-09-21T06:28:04.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.708+0000 7fb53b1f1740 1 -- 172.21.15.63:0/2078293088 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42de0a0 msgr2=0x555cf46cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:04.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.708+0000 7fb53b1f1740 1 --2- 172.21.15.63:0/2078293088 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42de0a0 0x555cf46cdfb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb51801b730 tx=0x7fb51801b9f0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.708+0000 7fb53b1f1740 1 -- 172.21.15.63:0/2078293088 shutdown_connections 2024-09-21T06:28:04.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.708+0000 7fb53b1f1740 1 --2- 172.21.15.63:0/2078293088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf4306f60 0x555cf46bce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.708+0000 7fb53b1f1740 1 --2- 172.21.15.63:0/2078293088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf42e6280 0x555cf46b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.708+0000 7fb53b1f1740 1 --2- 172.21.15.63:0/2078293088 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42de0a0 0x555cf46cdfb0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.708+0000 7fb53b1f1740 1 -- 172.21.15.63:0/2078293088 >> 172.21.15.63:0/2078293088 conn(0x555cf42fb350 msgr2=0x555cf46c8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:04.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.708+0000 7fb53b1f1740 1 -- 172.21.15.63:0/2078293088 shutdown_connections 2024-09-21T06:28:04.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.708+0000 7fb53b1f1740 1 -- 172.21.15.63:0/2078293088 wait complete. 2024-09-21T06:28:04.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.708+0000 7fb53b1f1740 1 -- start start 2024-09-21T06:28:04.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.708+0000 7fb53b1f1740 1 Processor -- start 2024-09-21T06:28:04.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.709+0000 7fb53b1f1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf42de0a0 0x555cf46d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.709+0000 7fb53b1f1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42e6280 0x555cf46d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.709+0000 7fb53b1f1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf4306f60 0x555cf46d7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.709+0000 7fb53b1f1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555cf46cf2a0 con 0x555cf42e6280 2024-09-21T06:28:04.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.709+0000 7fb53b1f1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555cf46cebd0 con 0x555cf4306f60 2024-09-21T06:28:04.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.709+0000 7fb53b1f1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555cf46cf970 con 0x555cf42de0a0 2024-09-21T06:28:04.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.709+0000 7fb53b1f1740 10 client.0 _ll_register_callbacks cb 0x7fb51800ba30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:04.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.709+0000 7fb52dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42e6280 0x555cf46d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.709+0000 7fb52e59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf42de0a0 0x555cf46d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.709+0000 7fb52e59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf42de0a0 0x555cf46d1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:56326/0 (socket says 172.21.15.63:56326) 2024-09-21T06:28:04.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.709+0000 7fb52e59c640 1 -- 172.21.15.63:0/230069755 learned_addr learned my addr 172.21.15.63:0/230069755 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:04.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.709+0000 7fb52ed9d640 1 --2- 172.21.15.63:0/230069755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf4306f60 0x555cf46d7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.709+0000 7fb52dd9b640 1 -- 172.21.15.63:0/230069755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf42de0a0 msgr2=0x555cf46d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:04.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.709+0000 7fb52dd9b640 1 --2- 172.21.15.63:0/230069755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf42de0a0 0x555cf46d1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.709+0000 7fb52dd9b640 1 -- 172.21.15.63:0/230069755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf4306f60 msgr2=0x555cf46d7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:04.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.709+0000 7fb52dd9b640 1 --2- 172.21.15.63:0/230069755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf4306f60 0x555cf46d7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.709+0000 7fb52dd9b640 1 -- 172.21.15.63:0/230069755 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cf46d2630 con 0x555cf42e6280 2024-09-21T06:28:04.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.709+0000 7fb52dd9b640 1 --2- 172.21.15.63:0/230069755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42e6280 0x555cf46d1e40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb52000edc0 tx=0x7fb520001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b2e5a9073f4884 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:04.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.709+0000 7fb515ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:28:04.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.710+0000 7fb515ffb640 1 -- 172.21.15.63:0/230069755 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52000baf0 con 0x555cf42e6280 2024-09-21T06:28:04.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.710+0000 7fb515ffb640 1 -- 172.21.15.63:0/230069755 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fb52000bc90 con 0x555cf42e6280 2024-09-21T06:28:04.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.710+0000 7fb53b1f1740 1 -- 172.21.15.63:0/230069755 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb518036050 con 0x555cf42e6280 2024-09-21T06:28:04.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.710+0000 7fb515ffb640 1 -- 172.21.15.63:0/230069755 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb520038050 con 0x555cf42e6280 2024-09-21T06:28:04.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.710+0000 7fb53b1f1740 10 client.15387 fetch_fsmap learned FSMap version 28 2024-09-21T06:28:04.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.710+0000 7fb53b1f1740 1 -- 172.21.15.63:0/230069755 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555cf473add0 con 0x555cf42e6280 2024-09-21T06:28:04.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.710+0000 7fb515ffb640 1 -- 172.21.15.63:0/230069755 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb518036050 con 0x555cf42e6280 2024-09-21T06:28:04.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.710+0000 7fb515ffb640 1 -- 172.21.15.63:0/230069755 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb5200048c0 con 0x555cf42e6280 2024-09-21T06:28:04.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.710+0000 7fb53b1f1740 10 client.15387 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:28:04.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.710+0000 7fb53b1f1740 10 client.15387 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:28:04.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.710+0000 7fb53b1f1740 20 client.15387 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:04.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.710+0000 7fb53b1f1740 1 --2- 172.21.15.63:0/230069755 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x555cf429ac90 0x555cf473e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.710+0000 7fb53b1f1740 4 client.15387 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:28:04.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.710+0000 7fb53b1f1740 1 -- 172.21.15.63:0/230069755 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "status"}) -- 0x555cf4622610 con 0x555cf429ac90 2024-09-21T06:28:04.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.711+0000 7fb52e59c640 1 --2- 172.21.15.63:0/230069755 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x555cf429ac90 0x555cf473e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.711+0000 7fb515ffb640 10 client.15387 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:28:04.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.711+0000 7fb52e59c640 1 --2- 172.21.15.63:0/230069755 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x555cf429ac90 0x555cf473e2e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cbc389a575f8dbd7 server_cookie=a4ff08ed334c91f1 in_seq=0 out_seq=0 2024-09-21T06:28:04.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.711+0000 7fb515ffb640 1 -- 172.21.15.63:0/230069755 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x555cf4622610 con 0x555cf429ac90 2024-09-21T06:28:04.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.711+0000 7fb515ffb640 10 client.15387 handle_command_reply: tid=0 2024-09-21T06:28:04.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.711+0000 7fb53b1f1740 1 client.15387 shutdown 2024-09-21T06:28:04.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb53b1f1740 1 -- 172.21.15.63:0/230069755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42e6280 msgr2=0x555cf46d1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:04.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb53b1f1740 1 --2- 172.21.15.63:0/230069755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42e6280 0x555cf46d1e40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb52000edc0 tx=0x7fb520001e50 comp rx=0 tx=0).stop 2024-09-21T06:28:04.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb53b1f1740 1 -- 172.21.15.63:0/230069755 shutdown_connections 2024-09-21T06:28:04.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb53b1f1740 1 --2- 172.21.15.63:0/230069755 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x555cf429ac90 0x555cf473e2e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb53b1f1740 1 --2- 172.21.15.63:0/230069755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555cf4306f60 0x555cf46d7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb53b1f1740 1 --2- 172.21.15.63:0/230069755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555cf42e6280 0x555cf46d1e40 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb53b1f1740 1 --2- 172.21.15.63:0/230069755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cf42de0a0 0x555cf46d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb53b1f1740 1 -- 172.21.15.63:0/230069755 >> 172.21.15.63:0/230069755 conn(0x555cf42fb350 msgr2=0x555cf46bce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:04.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb515ffb640 0 client.15387 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:28:04.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb53b1f1740 1 -- 172.21.15.63:0/230069755 shutdown_connections 2024-09-21T06:28:04.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb53b1f1740 1 -- 172.21.15.63:0/230069755 wait complete. 2024-09-21T06:28:04.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb53b1f1740 20 client.15387 trim_cache size 0 max 16384 2024-09-21T06:28:04.721 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:28:04.721 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "140899c8-77e1-11ef-baf5-efdc52797490", 2024-09-21T06:28:04.721 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 2, 2024-09-21T06:28:04.721 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 24676, 2024-09-21T06:28:04.721 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-21T06:28:04.721 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-21T06:28:04.722 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-21T06:28:04.722 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 97.378507401999997, 2024-09-21T06:28:04.722 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 28, 2024-09-21T06:28:04.722 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 77, 2024-09-21T06:28:04.722 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:28:04.722 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 129.344335048 2024-09-21T06:28:04.722 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:28:04.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb534c7d640 1 -- 172.21.15.63:0/3617998670 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb51c0b6620 msgr2=0x7fb51c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:04.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb534c7d640 1 --2- 172.21.15.63:0/3617998670 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb51c0b6620 0x7fb51c0b8b30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x555cf46abb80 tx=0x7fb51800b470 comp rx=0 tx=0).stop 2024-09-21T06:28:04.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb534c7d640 1 -- 172.21.15.63:0/3617998670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb530108d20 msgr2=0x7fb53019fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:04.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb534c7d640 1 --2- 172.21.15.63:0/3617998670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb530108d20 0x7fb53019fc40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb528005cc0 tx=0x7fb52802f470 comp rx=0 tx=0).stop 2024-09-21T06:28:04.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb534c7d640 1 -- 172.21.15.63:0/3617998670 shutdown_connections 2024-09-21T06:28:04.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb534c7d640 1 --2- 172.21.15.63:0/3617998670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb530108d20 0x7fb53019fc40 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb534c7d640 1 --2- 172.21.15.63:0/3617998670 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb51c0b6620 0x7fb51c0b8b30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb534c7d640 1 --2- 172.21.15.63:0/3617998670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5301083d0 0x7fb53019a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb534c7d640 1 --2- 172.21.15.63:0/3617998670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb530102a90 0x7fb53019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb534c7d640 1 -- 172.21.15.63:0/3617998670 >> 172.21.15.63:0/3617998670 conn(0x7fb530079750 msgr2=0x7fb530105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:04.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.712+0000 7fb534c7d640 1 -- 172.21.15.63:0/3617998670 shutdown_connections 2024-09-21T06:28:04.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:04.713+0000 7fb534c7d640 1 -- 172.21.15.63:0/3617998670 wait complete. 2024-09-21T06:28:05.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:05 smithi063 ceph-mon[31150]: pgmap v318: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:28:05.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:05 smithi175 ceph-mon[34510]: pgmap v318: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:28:05.479 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T06:28:05.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:05 smithi071 ceph-mon[34844]: pgmap v318: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:28:05.738 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:06.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.247+0000 7f0877c69640 1 -- 172.21.15.63:0/1899713165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0870107630 msgr2=0x7f0870107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:06.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.247+0000 7f0877c69640 1 --2- 172.21.15.63:0/1899713165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0870107630 0x7f0870107a40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f086c009900 tx=0x7f086c02a410 comp rx=0 tx=0).stop 2024-09-21T06:28:06.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.247+0000 7f0877c69640 1 -- 172.21.15.63:0/1899713165 shutdown_connections 2024-09-21T06:28:06.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.247+0000 7f0877c69640 1 --2- 172.21.15.63:0/1899713165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08701038f0 0x7f087010f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.247+0000 7f0877c69640 1 --2- 172.21.15.63:0/1899713165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0870102fa0 0x7f08701033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.247+0000 7f0877c69640 1 --2- 172.21.15.63:0/1899713165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0870107630 0x7f0870107a40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.247+0000 7f0877c69640 1 -- 172.21.15.63:0/1899713165 >> 172.21.15.63:0/1899713165 conn(0x7f0870079e40 msgr2=0x7f087007a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:06.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.247+0000 7f0877c69640 1 -- 172.21.15.63:0/1899713165 shutdown_connections 2024-09-21T06:28:06.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.247+0000 7f0877c69640 1 -- 172.21.15.63:0/1899713165 wait complete. 2024-09-21T06:28:06.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.248+0000 7f0877c69640 1 Processor -- start 2024-09-21T06:28:06.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.248+0000 7f0877c69640 1 -- start start 2024-09-21T06:28:06.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.248+0000 7f0877c69640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0870102fa0 0x7f08700fee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:06.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.248+0000 7f0877c69640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08701038f0 0x7f08700ff3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:06.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.248+0000 7f0877c69640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0870107630 0x7f08700ff8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:06.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.248+0000 7f0877c69640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f08701129e0 con 0x7f0870102fa0 2024-09-21T06:28:06.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.248+0000 7f0877c69640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0870112860 con 0x7f08701038f0 2024-09-21T06:28:06.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.248+0000 7f0877c69640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0870112b60 con 0x7f0870107630 2024-09-21T06:28:06.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.248+0000 7f0875a05640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0870102fa0 0x7f08700fee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:06.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.248+0000 7f0875a05640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0870102fa0 0x7f08700fee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42726/0 (socket says 172.21.15.63:42726) 2024-09-21T06:28:06.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.248+0000 7f0875a05640 1 -- 172.21.15.63:0/1779692861 learned_addr learned my addr 172.21.15.63:0/1779692861 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:06.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.248+0000 7f0876206640 1 --2- 172.21.15.63:0/1779692861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0870107630 0x7f08700ff8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:06.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.248+0000 7f0875204640 1 --2- 172.21.15.63:0/1779692861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08701038f0 0x7f08700ff3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:06.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.249+0000 7f0875a05640 1 -- 172.21.15.63:0/1779692861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0870107630 msgr2=0x7f08700ff8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:06.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.249+0000 7f0875a05640 1 --2- 172.21.15.63:0/1779692861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0870107630 0x7f08700ff8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.249+0000 7f0875a05640 1 -- 172.21.15.63:0/1779692861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08701038f0 msgr2=0x7f08700ff3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:06.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.249+0000 7f0875a05640 1 --2- 172.21.15.63:0/1779692861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08701038f0 0x7f08700ff3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.249+0000 7f0875a05640 1 -- 172.21.15.63:0/1779692861 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08701a8860 con 0x7f0870102fa0 2024-09-21T06:28:06.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.249+0000 7f0875204640 1 --2- 172.21.15.63:0/1779692861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08701038f0 0x7f08700ff3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:06.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.249+0000 7f0875a05640 1 --2- 172.21.15.63:0/1779692861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0870102fa0 0x7f08700fee70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f086c005940 tx=0x7f086c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:06.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.249+0000 7f0866ffd640 1 -- 172.21.15.63:0/1779692861 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c03f030 con 0x7f0870102fa0 2024-09-21T06:28:06.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.249+0000 7f0866ffd640 1 -- 172.21.15.63:0/1779692861 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f086c003aa0 con 0x7f0870102fa0 2024-09-21T06:28:06.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.249+0000 7f0877c69640 1 -- 172.21.15.63:0/1779692861 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08701a8af0 con 0x7f0870102fa0 2024-09-21T06:28:06.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.249+0000 7f0866ffd640 1 -- 172.21.15.63:0/1779692861 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c035070 con 0x7f0870102fa0 2024-09-21T06:28:06.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.249+0000 7f0877c69640 1 -- 172.21.15.63:0/1779692861 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08701a8fd0 con 0x7f0870102fa0 2024-09-21T06:28:06.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.252+0000 7f087e1dd740 1 Processor -- start 2024-09-21T06:28:06.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.252+0000 7f087e1dd740 1 -- start start 2024-09-21T06:28:06.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.252+0000 7f0866ffd640 1 -- 172.21.15.63:0/1779692861 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f086c042030 con 0x7f0870102fa0 2024-09-21T06:28:06.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.252+0000 7f087e1dd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5caff60 0x55ced6055f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:06.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.252+0000 7f087e1dd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5c870a0 0x55ced6056440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:06.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.252+0000 7f087e1dd740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c8f280 0x55ced6056980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:06.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.252+0000 7f087e1dd740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ced5fcdc10 con 0x55ced5c8f280 2024-09-21T06:28:06.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.252+0000 7f087e1dd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ced5fbd040 con 0x55ced5caff60 2024-09-21T06:28:06.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.252+0000 7f087e1dd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ced5fc0e50 con 0x55ced5c870a0 2024-09-21T06:28:06.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.252+0000 7f0875204640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c8f280 0x55ced6056980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:06.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.252+0000 7f0875204640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c8f280 0x55ced6056980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42734/0 (socket says 172.21.15.63:42734) 2024-09-21T06:28:06.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.252+0000 7f0875204640 1 -- 172.21.15.63:0/2634706714 learned_addr learned my addr 172.21.15.63:0/2634706714 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:06.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.253+0000 7f0876206640 1 --2- 172.21.15.63:0/2634706714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5caff60 0x55ced6055f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:06.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.253+0000 7f0875a05640 1 --2- 172.21.15.63:0/2634706714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5c870a0 0x55ced6056440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:06.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.253+0000 7f0875204640 1 -- 172.21.15.63:0/2634706714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5c870a0 msgr2=0x55ced6056440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:06.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.253+0000 7f0875204640 1 --2- 172.21.15.63:0/2634706714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5c870a0 0x55ced6056440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.253+0000 7f0875204640 1 -- 172.21.15.63:0/2634706714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5caff60 msgr2=0x55ced6055f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:06.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.253+0000 7f0875204640 1 --2- 172.21.15.63:0/2634706714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5caff60 0x55ced6055f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.253+0000 7f0875204640 1 -- 172.21.15.63:0/2634706714 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ced5d1b540 con 0x55ced5c8f280 2024-09-21T06:28:06.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.253+0000 7f0875204640 1 --2- 172.21.15.63:0/2634706714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c8f280 0x55ced6056980 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f086000cbf0 tx=0x7f086000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32c92ec9a15496f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:06.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.253+0000 7f0866ffd640 1 --2- 172.21.15.63:0/1779692861 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f085c0b65f0 0x7f085c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:06.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.253+0000 7f085bfff640 1 -- 172.21.15.63:0/2634706714 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860005220 con 0x55ced5c8f280 2024-09-21T06:28:06.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.253+0000 7f085bfff640 1 -- 172.21.15.63:0/2634706714 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0860016070 con 0x55ced5c8f280 2024-09-21T06:28:06.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.253+0000 7f085bfff640 1 -- 172.21.15.63:0/2634706714 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860010690 con 0x55ced5c8f280 2024-09-21T06:28:06.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.253+0000 7f0876206640 1 --2- 172.21.15.63:0/1779692861 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f085c0b65f0 0x7f085c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:06.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.253+0000 7f0866ffd640 1 -- 172.21.15.63:0/1779692861 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f086c107cf0 con 0x7f0870102fa0 2024-09-21T06:28:06.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.254+0000 7f087e1dd740 1 -- 172.21.15.63:0/2634706714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c8f280 msgr2=0x55ced6056980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:06.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.254+0000 7f0876206640 1 --2- 172.21.15.63:0/1779692861 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f085c0b65f0 0x7f085c0b8b00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0868005fd0 tx=0x7f0868009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:06.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.254+0000 7f087e1dd740 1 --2- 172.21.15.63:0/2634706714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c8f280 0x55ced6056980 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f086000cbf0 tx=0x7f086000e720 comp rx=0 tx=0).stop 2024-09-21T06:28:06.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.254+0000 7f087e1dd740 1 -- 172.21.15.63:0/2634706714 shutdown_connections 2024-09-21T06:28:06.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.254+0000 7f087e1dd740 1 --2- 172.21.15.63:0/2634706714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c8f280 0x55ced6056980 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.254+0000 7f087e1dd740 1 --2- 172.21.15.63:0/2634706714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5c870a0 0x55ced6056440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.254+0000 7f087e1dd740 1 --2- 172.21.15.63:0/2634706714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5caff60 0x55ced6055f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.254+0000 7f087e1dd740 1 -- 172.21.15.63:0/2634706714 >> 172.21.15.63:0/2634706714 conn(0x55ced5ca4350 msgr2=0x55ced6053df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:06.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.254+0000 7f087e1dd740 1 -- 172.21.15.63:0/2634706714 shutdown_connections 2024-09-21T06:28:06.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.254+0000 7f087e1dd740 1 -- 172.21.15.63:0/2634706714 wait complete. 2024-09-21T06:28:06.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.255+0000 7f087e1dd740 1 -- start start 2024-09-21T06:28:06.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.255+0000 7f087e1dd740 1 Processor -- start 2024-09-21T06:28:06.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.255+0000 7f087e1dd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5c870a0 0x55ced6061990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:06.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.255+0000 7f087e1dd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5c8f280 0x55ced6061ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:06.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.255+0000 7f087e1dd740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5caff60 0x55ced606da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:06.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.255+0000 7f087e1dd740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ced5e1e5f0 con 0x55ced5caff60 2024-09-21T06:28:06.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.255+0000 7f087e1dd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ced5f58010 con 0x55ced5c870a0 2024-09-21T06:28:06.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.255+0000 7f087e1dd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ced60646e0 con 0x55ced5c8f280 2024-09-21T06:28:06.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.256+0000 7f0876206640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5caff60 0x55ced606da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:06.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.256+0000 7f0876206640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5caff60 0x55ced606da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42746/0 (socket says 172.21.15.63:42746) 2024-09-21T06:28:06.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.256+0000 7f0875a05640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5c870a0 0x55ced6061990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:06.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.256+0000 7f0876206640 1 -- 172.21.15.63:0/3204454955 learned_addr learned my addr 172.21.15.63:0/3204454955 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:06.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.256+0000 7f0875204640 1 --2- 172.21.15.63:0/3204454955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5c8f280 0x55ced6061ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:06.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.256+0000 7f087e1dd740 10 client.0 _ll_register_callbacks cb 0x55ced5fb7340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:06.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.256+0000 7f0876206640 1 -- 172.21.15.63:0/3204454955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5c8f280 msgr2=0x55ced6061ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:06.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.256+0000 7f0876206640 1 --2- 172.21.15.63:0/3204454955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5c8f280 0x55ced6061ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.256+0000 7f0876206640 1 -- 172.21.15.63:0/3204454955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5c870a0 msgr2=0x55ced6061990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:06.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.256+0000 7f0876206640 1 --2- 172.21.15.63:0/3204454955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5c870a0 0x55ced6061990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.256+0000 7f0876206640 1 -- 172.21.15.63:0/3204454955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ced5f85a00 con 0x55ced5caff60 2024-09-21T06:28:06.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.256+0000 7f0875204640 1 --2- 172.21.15.63:0/3204454955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5c8f280 0x55ced6061ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:06.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.256+0000 7f0876206640 1 --2- 172.21.15.63:0/3204454955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5caff60 0x55ced606da00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0868003f70 tx=0x7f0868004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c2038373e30c78 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:06.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.256+0000 7f08597fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:28:06.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.256+0000 7f08597fa640 1 -- 172.21.15.63:0/3204454955 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086802d060 con 0x55ced5caff60 2024-09-21T06:28:06.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.256+0000 7f08597fa640 1 -- 172.21.15.63:0/3204454955 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f0868018070 con 0x55ced5caff60 2024-09-21T06:28:06.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.256+0000 7f087e1dd740 1 -- 172.21.15.63:0/3204454955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0860016070 con 0x55ced5caff60 2024-09-21T06:28:06.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.257+0000 7f08597fa640 1 -- 172.21.15.63:0/3204454955 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0868020820 con 0x55ced5caff60 2024-09-21T06:28:06.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.257+0000 7f087e1dd740 10 client.15399 fetch_fsmap learned FSMap version 28 2024-09-21T06:28:06.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.257+0000 7f087e1dd740 1 -- 172.21.15.63:0/3204454955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ced6070640 con 0x55ced5caff60 2024-09-21T06:28:06.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.257+0000 7f08597fa640 1 -- 172.21.15.63:0/3204454955 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0860016070 con 0x55ced5caff60 2024-09-21T06:28:06.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.257+0000 7f08597fa640 1 -- 172.21.15.63:0/3204454955 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0868032bd0 con 0x55ced5caff60 2024-09-21T06:28:06.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.257+0000 7f087e1dd740 10 client.15399 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:28:06.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.257+0000 7f087e1dd740 10 client.15399 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:28:06.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.257+0000 7f087e1dd740 20 client.15399 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:06.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.257+0000 7f087e1dd740 1 --2- 172.21.15.63:0/3204454955 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55ced5c6e8e0 0x55ced6074100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:06.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.257+0000 7f087e1dd740 4 client.15399 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:06.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.257+0000 7f087e1dd740 1 -- 172.21.15.63:0/3204454955 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ced5fcfb60 con 0x55ced5c6e8e0 2024-09-21T06:28:06.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.257+0000 7f0875a05640 1 --2- 172.21.15.63:0/3204454955 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55ced5c6e8e0 0x55ced6074100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:06.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.258+0000 7f0875a05640 1 --2- 172.21.15.63:0/3204454955 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55ced5c6e8e0 0x55ced6074100 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=652190e368d9ba98 server_cookie=af078e3d75fb5701 in_seq=0 out_seq=0 2024-09-21T06:28:06.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.258+0000 7f08597fa640 10 client.15399 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:28:06.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.259+0000 7f08597fa640 1 -- 172.21.15.63:0/3204454955 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ced5fcfb60 con 0x55ced5c6e8e0 2024-09-21T06:28:06.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.259+0000 7f08597fa640 10 client.15399 handle_command_reply: tid=0 2024-09-21T06:28:06.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.259+0000 7f087e1dd740 1 client.15399 shutdown 2024-09-21T06:28:06.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.259+0000 7f087e1dd740 1 -- 172.21.15.63:0/3204454955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5caff60 msgr2=0x55ced606da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:06.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.259+0000 7f087e1dd740 1 --2- 172.21.15.63:0/3204454955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5caff60 0x55ced606da00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0868003f70 tx=0x7f0868004ab0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.259+0000 7f087e1dd740 1 -- 172.21.15.63:0/3204454955 shutdown_connections 2024-09-21T06:28:06.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.259+0000 7f087e1dd740 1 --2- 172.21.15.63:0/3204454955 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55ced5c6e8e0 0x55ced6074100 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.259+0000 7f087e1dd740 1 --2- 172.21.15.63:0/3204454955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5caff60 0x55ced606da00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.259+0000 7f087e1dd740 1 --2- 172.21.15.63:0/3204454955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5c8f280 0x55ced6061ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.259+0000 7f08597fa640 0 client.15399 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:28:06.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.259+0000 7f087e1dd740 1 --2- 172.21.15.63:0/3204454955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5c870a0 0x55ced6061990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.259+0000 7f087e1dd740 1 -- 172.21.15.63:0/3204454955 >> 172.21.15.63:0/3204454955 conn(0x55ced5ca4350 msgr2=0x55ced6059090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:06.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.259+0000 7f087e1dd740 1 -- 172.21.15.63:0/3204454955 shutdown_connections 2024-09-21T06:28:06.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.259+0000 7f087e1dd740 1 -- 172.21.15.63:0/3204454955 wait complete. 2024-09-21T06:28:06.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.259+0000 7f087e1dd740 20 client.15399 trim_cache size 0 max 16384 2024-09-21T06:28:06.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.277+0000 7f087e1dd740 1 Processor -- start 2024-09-21T06:28:06.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.277+0000 7f087e1dd740 1 -- start start 2024-09-21T06:28:06.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f087e1dd740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c870a0 0x55ced605c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:06.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f087e1dd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5c8f280 0x55ced606d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:06.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f087e1dd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5caff60 0x55ced606deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:06.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f087e1dd740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ced6072440 con 0x55ced5c870a0 2024-09-21T06:28:06.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f087e1dd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ced6072b10 con 0x55ced5c8f280 2024-09-21T06:28:06.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f087e1dd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ced60731e0 con 0x55ced5caff60 2024-09-21T06:28:06.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f0875a05640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c870a0 0x55ced605c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:06.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f0875a05640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c870a0 0x55ced605c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42756/0 (socket says 172.21.15.63:42756) 2024-09-21T06:28:06.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f0875a05640 1 -- 172.21.15.63:0/3098837055 learned_addr learned my addr 172.21.15.63:0/3098837055 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:06.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f0876206640 1 --2- 172.21.15.63:0/3098837055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5caff60 0x55ced606deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:06.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f0875204640 1 --2- 172.21.15.63:0/3098837055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5c8f280 0x55ced606d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:06.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f0875a05640 1 -- 172.21.15.63:0/3098837055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5caff60 msgr2=0x55ced606deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:06.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f0875a05640 1 --2- 172.21.15.63:0/3098837055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5caff60 0x55ced606deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f0875a05640 1 -- 172.21.15.63:0/3098837055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5c8f280 msgr2=0x55ced606d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:06.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f0875a05640 1 --2- 172.21.15.63:0/3098837055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5c8f280 0x55ced606d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f0875a05640 1 -- 172.21.15.63:0/3098837055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ced6062720 con 0x55ced5c870a0 2024-09-21T06:28:06.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f0876206640 1 --2- 172.21.15.63:0/3098837055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5caff60 0x55ced606deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:06.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f0875a05640 1 --2- 172.21.15.63:0/3098837055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c870a0 0x55ced605c020 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f086c031a70 tx=0x7f086c10a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d22646b25547986 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:06.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f085b7fe640 1 -- 172.21.15.63:0/3098837055 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c049040 con 0x55ced5c870a0 2024-09-21T06:28:06.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f085b7fe640 1 -- 172.21.15.63:0/3098837055 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f086c0b50b0 con 0x55ced5c870a0 2024-09-21T06:28:06.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.278+0000 7f085b7fe640 1 -- 172.21.15.63:0/3098837055 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c0d7660 con 0x55ced5c870a0 2024-09-21T06:28:06.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.279+0000 7f087e1dd740 1 -- 172.21.15.63:0/3098837055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c870a0 msgr2=0x55ced605c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:06.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.279+0000 7f087e1dd740 1 --2- 172.21.15.63:0/3098837055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c870a0 0x55ced605c020 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f086c031a70 tx=0x7f086c10a1e0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.279+0000 7f087e1dd740 1 -- 172.21.15.63:0/3098837055 shutdown_connections 2024-09-21T06:28:06.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.279+0000 7f087e1dd740 1 --2- 172.21.15.63:0/3098837055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5caff60 0x55ced606deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.279+0000 7f087e1dd740 1 --2- 172.21.15.63:0/3098837055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5c8f280 0x55ced606d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.279+0000 7f087e1dd740 1 --2- 172.21.15.63:0/3098837055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c870a0 0x55ced605c020 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.279+0000 7f087e1dd740 1 -- 172.21.15.63:0/3098837055 >> 172.21.15.63:0/3098837055 conn(0x55ced5ca4350 msgr2=0x55ced605c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:06.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.279+0000 7f087e1dd740 1 -- 172.21.15.63:0/3098837055 shutdown_connections 2024-09-21T06:28:06.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.279+0000 7f087e1dd740 1 -- 172.21.15.63:0/3098837055 wait complete. 2024-09-21T06:28:06.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.280+0000 7f087e1dd740 1 -- start start 2024-09-21T06:28:06.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.280+0000 7f087e1dd740 1 Processor -- start 2024-09-21T06:28:06.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.280+0000 7f087e1dd740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c870a0 0x55ced607c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:06.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.280+0000 7f087e1dd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5c8f280 0x55ced6075e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:06.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.280+0000 7f087e1dd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5caff60 0x55ced60763d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:06.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.280+0000 7f087e1dd740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ced6073f80 con 0x55ced5c870a0 2024-09-21T06:28:06.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.280+0000 7f087e1dd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ced60738b0 con 0x55ced5c8f280 2024-09-21T06:28:06.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.280+0000 7f087e1dd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ced6074650 con 0x55ced5caff60 2024-09-21T06:28:06.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.280+0000 7f087e1dd740 10 client.0 _ll_register_callbacks cb 0x7f0868009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:06.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.280+0000 7f0875a05640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c870a0 0x55ced607c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:06.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.280+0000 7f0875a05640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c870a0 0x55ced607c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42762/0 (socket says 172.21.15.63:42762) 2024-09-21T06:28:06.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.280+0000 7f0875a05640 1 -- 172.21.15.63:0/2231456849 learned_addr learned my addr 172.21.15.63:0/2231456849 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:06.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.280+0000 7f0875204640 1 --2- 172.21.15.63:0/2231456849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5c8f280 0x55ced6075e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:06.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.281+0000 7f0876206640 1 --2- 172.21.15.63:0/2231456849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5caff60 0x55ced60763d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:06.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.281+0000 7f0875a05640 1 -- 172.21.15.63:0/2231456849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5caff60 msgr2=0x55ced60763d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:06.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.281+0000 7f0875a05640 1 --2- 172.21.15.63:0/2231456849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5caff60 0x55ced60763d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.281+0000 7f0875a05640 1 -- 172.21.15.63:0/2231456849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5c8f280 msgr2=0x55ced6075e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:06.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.281+0000 7f0875a05640 1 --2- 172.21.15.63:0/2231456849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5c8f280 0x55ced6075e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.281+0000 7f0875a05640 1 -- 172.21.15.63:0/2231456849 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ced60769c0 con 0x55ced5c870a0 2024-09-21T06:28:06.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.281+0000 7f0876206640 1 --2- 172.21.15.63:0/2231456849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5caff60 0x55ced60763d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:06.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.281+0000 7f0875204640 1 --2- 172.21.15.63:0/2231456849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5c8f280 0x55ced6075e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:06.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.281+0000 7f0875a05640 1 --2- 172.21.15.63:0/2231456849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c870a0 0x55ced607c9e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f086c032af0 tx=0x7f086c0c9430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5d194eb6f6b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:06.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.281+0000 7f08597fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:28:06.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.281+0000 7f08597fa640 1 -- 172.21.15.63:0/2231456849 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c0d2070 con 0x55ced5c870a0 2024-09-21T06:28:06.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.281+0000 7f08597fa640 1 -- 172.21.15.63:0/2231456849 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f086c03bcc0 con 0x55ced5c870a0 2024-09-21T06:28:06.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.281+0000 7f087e1dd740 1 -- 172.21.15.63:0/2231456849 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f086c0b50b0 con 0x55ced5c870a0 2024-09-21T06:28:06.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.281+0000 7f08597fa640 1 -- 172.21.15.63:0/2231456849 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f086c049040 con 0x55ced5c870a0 2024-09-21T06:28:06.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.281+0000 7f087e1dd740 10 client.15405 fetch_fsmap learned FSMap version 28 2024-09-21T06:28:06.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.281+0000 7f087e1dd740 1 -- 172.21.15.63:0/2231456849 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ced607c3c0 con 0x55ced5c870a0 2024-09-21T06:28:06.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.281+0000 7f08597fa640 1 -- 172.21.15.63:0/2231456849 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f086c0b50b0 con 0x55ced5c870a0 2024-09-21T06:28:06.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.282+0000 7f08597fa640 1 -- 172.21.15.63:0/2231456849 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f086c0f10c0 con 0x55ced5c870a0 2024-09-21T06:28:06.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.282+0000 7f087e1dd740 10 client.15405 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:28:06.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.282+0000 7f087e1dd740 10 client.15405 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:28:06.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.282+0000 7f087e1dd740 20 client.15405 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:06.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.282+0000 7f087e1dd740 1 --2- 172.21.15.63:0/2231456849 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55ced5c43c90 0x55ced60e29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:06.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.282+0000 7f087e1dd740 4 client.15405 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:28:06.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.282+0000 7f087e1dd740 1 -- 172.21.15.63:0/2231456849 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "status"}) -- 0x55ced5fcb610 con 0x55ced5c43c90 2024-09-21T06:28:06.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.282+0000 7f0875204640 1 --2- 172.21.15.63:0/2231456849 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55ced5c43c90 0x55ced60e29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:06.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.282+0000 7f08597fa640 10 client.15405 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:28:06.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.282+0000 7f0875204640 1 --2- 172.21.15.63:0/2231456849 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55ced5c43c90 0x55ced60e29d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=edfa6efbf1320a3 server_cookie=760eeb5c42c21f95 in_seq=0 out_seq=0 2024-09-21T06:28:06.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.283+0000 7f08597fa640 1 -- 172.21.15.63:0/2231456849 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ced5fcb610 con 0x55ced5c43c90 2024-09-21T06:28:06.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.283+0000 7f08597fa640 10 client.15405 handle_command_reply: tid=0 2024-09-21T06:28:06.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.283+0000 7f087e1dd740 1 client.15405 shutdown 2024-09-21T06:28:06.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.283+0000 7f087e1dd740 1 -- 172.21.15.63:0/2231456849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c870a0 msgr2=0x55ced607c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:06.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.283+0000 7f087e1dd740 1 --2- 172.21.15.63:0/2231456849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c870a0 0x55ced607c9e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f086c032af0 tx=0x7f086c0c9430 comp rx=0 tx=0).stop 2024-09-21T06:28:06.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.283+0000 7f087e1dd740 1 -- 172.21.15.63:0/2231456849 shutdown_connections 2024-09-21T06:28:06.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.283+0000 7f087e1dd740 1 --2- 172.21.15.63:0/2231456849 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55ced5c43c90 0x55ced60e29d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.283+0000 7f087e1dd740 1 --2- 172.21.15.63:0/2231456849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ced5caff60 0x55ced60763d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.283+0000 7f087e1dd740 1 --2- 172.21.15.63:0/2231456849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ced5c8f280 0x55ced6075e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.283+0000 7f087e1dd740 1 --2- 172.21.15.63:0/2231456849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ced5c870a0 0x55ced607c9e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.283+0000 7f08597fa640 0 client.15405 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:28:06.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.283+0000 7f087e1dd740 1 -- 172.21.15.63:0/2231456849 >> 172.21.15.63:0/2231456849 conn(0x55ced5ca4350 msgr2=0x55ced6053600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:06.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.283+0000 7f087e1dd740 1 -- 172.21.15.63:0/2231456849 shutdown_connections 2024-09-21T06:28:06.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.283+0000 7f087e1dd740 1 -- 172.21.15.63:0/2231456849 wait complete. 2024-09-21T06:28:06.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.283+0000 7f087e1dd740 20 client.15405 trim_cache size 0 max 16384 2024-09-21T06:28:06.294 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:28:06.294 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "140899c8-77e1-11ef-baf5-efdc52797490", 2024-09-21T06:28:06.294 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 1, 2024-09-21T06:28:06.294 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 24694, 2024-09-21T06:28:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-21T06:28:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-21T06:28:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-21T06:28:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 99.959794036000005, 2024-09-21T06:28:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 28, 2024-09-21T06:28:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 77, 2024-09-21T06:28:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:28:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 125.535408725 2024-09-21T06:28:06.295 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:28:06.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.284+0000 7f0877c69640 1 -- 172.21.15.63:0/1779692861 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f085c0b65f0 msgr2=0x7f085c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:06.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.284+0000 7f0877c69640 1 --2- 172.21.15.63:0/1779692861 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f085c0b65f0 0x7f085c0b8b00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0868005fd0 tx=0x7f0868009500 comp rx=0 tx=0).stop 2024-09-21T06:28:06.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.284+0000 7f0877c69640 1 -- 172.21.15.63:0/1779692861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0870102fa0 msgr2=0x7f08700fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:06.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.284+0000 7f0877c69640 1 --2- 172.21.15.63:0/1779692861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0870102fa0 0x7f08700fee70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f086c005940 tx=0x7f086c004270 comp rx=0 tx=0).stop 2024-09-21T06:28:06.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.284+0000 7f0877c69640 1 -- 172.21.15.63:0/1779692861 shutdown_connections 2024-09-21T06:28:06.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.284+0000 7f0877c69640 1 --2- 172.21.15.63:0/1779692861 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f085c0b65f0 0x7f085c0b8b00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.284+0000 7f0877c69640 1 --2- 172.21.15.63:0/1779692861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0870107630 0x7f08700ff8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.284+0000 7f0877c69640 1 --2- 172.21.15.63:0/1779692861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08701038f0 0x7f08700ff3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.284+0000 7f0877c69640 1 --2- 172.21.15.63:0/1779692861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0870102fa0 0x7f08700fee70 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:06.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.284+0000 7f0877c69640 1 -- 172.21.15.63:0/1779692861 >> 172.21.15.63:0/1779692861 conn(0x7f0870079e40 msgr2=0x7f08701011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:06.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.284+0000 7f0877c69640 1 -- 172.21.15.63:0/1779692861 shutdown_connections 2024-09-21T06:28:06.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:06.284+0000 7f0877c69640 1 -- 172.21.15.63:0/1779692861 wait complete. 2024-09-21T06:28:07.052 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T06:28:07.311 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:07.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:07 smithi063 ceph-mon[31150]: pgmap v319: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T06:28:07.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:07 smithi175 ceph-mon[34510]: pgmap v319: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T06:28:07.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:07 smithi071 ceph-mon[34844]: pgmap v319: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T06:28:07.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.762+0000 7f3a31888640 1 -- 172.21.15.63:0/1832433949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a2c1094c0 msgr2=0x7f3a2c1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:07.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.762+0000 7f3a31888640 1 --2- 172.21.15.63:0/1832433949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a2c1094c0 0x7f3a2c1098d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009900 tx=0x7f3a1402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:07.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.762+0000 7f3a31888640 1 -- 172.21.15.63:0/1832433949 shutdown_connections 2024-09-21T06:28:07.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.762+0000 7f3a31888640 1 --2- 172.21.15.63:0/1832433949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a2c109e10 0x7f3a2c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.762+0000 7f3a31888640 1 --2- 172.21.15.63:0/1832433949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a2c1094c0 0x7f3a2c1098d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.762+0000 7f3a31888640 1 --2- 172.21.15.63:0/1832433949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a2c101f80 0x7f3a2c102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.762+0000 7f3a31888640 1 -- 172.21.15.63:0/1832433949 >> 172.21.15.63:0/1832433949 conn(0x7f3a2c077cf0 msgr2=0x7f3a2c078130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:07.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.762+0000 7f3a31888640 1 -- 172.21.15.63:0/1832433949 shutdown_connections 2024-09-21T06:28:07.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.762+0000 7f3a31888640 1 -- 172.21.15.63:0/1832433949 wait complete. 2024-09-21T06:28:07.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.763+0000 7f3a31888640 1 Processor -- start 2024-09-21T06:28:07.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.763+0000 7f3a31888640 1 -- start start 2024-09-21T06:28:07.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a31888640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a2c101f80 0x7f3a2c19a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a31888640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a2c1094c0 0x7f3a2c19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a31888640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a2c109e10 0x7f3a2c19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a31888640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c113ad0 con 0x7f3a2c101f80 2024-09-21T06:28:07.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a31888640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c113950 con 0x7f3a2c1094c0 2024-09-21T06:28:07.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a31888640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c113c50 con 0x7f3a2c109e10 2024-09-21T06:28:07.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a2affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a2c101f80 0x7f3a2c19a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a2affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a2c101f80 0x7f3a2c19a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44422/0 (socket says 172.21.15.63:44422) 2024-09-21T06:28:07.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a2affd640 1 -- 172.21.15.63:0/3615218523 learned_addr learned my addr 172.21.15.63:0/3615218523 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:07.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a2a7fc640 1 --2- 172.21.15.63:0/3615218523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a2c1094c0 0x7f3a2c19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a2b7fe640 1 --2- 172.21.15.63:0/3615218523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a2c109e10 0x7f3a2c19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a2affd640 1 -- 172.21.15.63:0/3615218523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a2c109e10 msgr2=0x7f3a2c19fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:07.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a2affd640 1 --2- 172.21.15.63:0/3615218523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a2c109e10 0x7f3a2c19fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a2affd640 1 -- 172.21.15.63:0/3615218523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a2c1094c0 msgr2=0x7f3a2c19aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:07.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a2affd640 1 --2- 172.21.15.63:0/3615218523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a2c1094c0 0x7f3a2c19aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a2affd640 1 -- 172.21.15.63:0/3615218523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2c1a03f0 con 0x7f3a2c101f80 2024-09-21T06:28:07.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a2b7fe640 1 --2- 172.21.15.63:0/3615218523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a2c109e10 0x7f3a2c19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:07.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a2affd640 1 --2- 172.21.15.63:0/3615218523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a2c101f80 0x7f3a2c19a540 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400c920 tx=0x7f3a2400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:07.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a30886640 1 -- 172.21.15.63:0/3615218523 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24007c70 con 0x7f3a2c101f80 2024-09-21T06:28:07.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a30886640 1 -- 172.21.15.63:0/3615218523 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a24007e10 con 0x7f3a2c101f80 2024-09-21T06:28:07.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.764+0000 7f3a31888640 1 -- 172.21.15.63:0/3615218523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a2c1a06e0 con 0x7f3a2c101f80 2024-09-21T06:28:07.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.765+0000 7f3a30886640 1 -- 172.21.15.63:0/3615218523 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24018820 con 0x7f3a2c101f80 2024-09-21T06:28:07.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.765+0000 7f3a31888640 1 -- 172.21.15.63:0/3615218523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a2c1a6f00 con 0x7f3a2c101f80 2024-09-21T06:28:07.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.767+0000 7f3a30886640 1 -- 172.21.15.63:0/3615218523 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f3a2400f450 con 0x7f3a2c101f80 2024-09-21T06:28:07.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.767+0000 7f3a37dfc740 1 Processor -- start 2024-09-21T06:28:07.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.767+0000 7f3a37dfc740 1 -- start start 2024-09-21T06:28:07.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a37dfc740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6cbf60 0x55f16fa71f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a37dfc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6a30a0 0x55f16fa72440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a37dfc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6ab280 0x55f16fa72980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a37dfc740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f16f9e9c10 con 0x55f16f6cbf60 2024-09-21T06:28:07.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a37dfc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f16f9d9040 con 0x55f16f6a30a0 2024-09-21T06:28:07.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a37dfc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f16f9dce50 con 0x55f16f6ab280 2024-09-21T06:28:07.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a2b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6cbf60 0x55f16fa71f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a2b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6cbf60 0x55f16fa71f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44428/0 (socket says 172.21.15.63:44428) 2024-09-21T06:28:07.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a2b7fe640 1 -- 172.21.15.63:0/714206718 learned_addr learned my addr 172.21.15.63:0/714206718 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:07.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a30886640 1 --2- 172.21.15.63:0/3615218523 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3a180b66a0 0x7f3a180b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a2a7fc640 1 --2- 172.21.15.63:0/714206718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6ab280 0x55f16fa72980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a2affd640 1 --2- 172.21.15.63:0/714206718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6a30a0 0x55f16fa72440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a2b7fe640 1 -- 172.21.15.63:0/714206718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6ab280 msgr2=0x55f16fa72980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:07.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a2b7fe640 1 --2- 172.21.15.63:0/714206718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6ab280 0x55f16fa72980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a2b7fe640 1 -- 172.21.15.63:0/714206718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6a30a0 msgr2=0x55f16fa72440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:07.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a2b7fe640 1 --2- 172.21.15.63:0/714206718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6a30a0 0x55f16fa72440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a2b7fe640 1 -- 172.21.15.63:0/714206718 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f16f737540 con 0x55f16f6cbf60 2024-09-21T06:28:07.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a30886640 1 -- 172.21.15.63:0/3615218523 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f3a240e7760 con 0x7f3a2c101f80 2024-09-21T06:28:07.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a2affd640 1 --2- 172.21.15.63:0/714206718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6a30a0 0x55f16fa72440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:07.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a2a7fc640 1 --2- 172.21.15.63:0/714206718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6ab280 0x55f16fa72980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:07.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.768+0000 7f3a2b7fe640 1 --2- 172.21.15.63:0/3615218523 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3a180b66a0 0x7f3a180b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.769+0000 7f3a2b7fe640 1 --2- 172.21.15.63:0/714206718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6cbf60 0x55f16fa71f00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c008ed0 tx=0x7f3a1c00d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53610968c1decf7a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:07.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.769+0000 7f3a21ffb640 1 -- 172.21.15.63:0/714206718 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c011e60 con 0x55f16f6cbf60 2024-09-21T06:28:07.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.769+0000 7f3a21ffb640 1 -- 172.21.15.63:0/714206718 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a1c01ad90 con 0x55f16f6cbf60 2024-09-21T06:28:07.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.769+0000 7f3a21ffb640 1 -- 172.21.15.63:0/714206718 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c019c20 con 0x55f16f6cbf60 2024-09-21T06:28:07.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.769+0000 7f3a2b7fe640 1 --2- 172.21.15.63:0/3615218523 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3a180b66a0 0x7f3a180b8bb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c01e000 tx=0x7f3a1c01f000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:07.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.770+0000 7f3a37dfc740 1 -- 172.21.15.63:0/714206718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6cbf60 msgr2=0x55f16fa71f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:07.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.770+0000 7f3a37dfc740 1 --2- 172.21.15.63:0/714206718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6cbf60 0x55f16fa71f00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c008ed0 tx=0x7f3a1c00d710 comp rx=0 tx=0).stop 2024-09-21T06:28:07.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.770+0000 7f3a37dfc740 1 -- 172.21.15.63:0/714206718 shutdown_connections 2024-09-21T06:28:07.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.770+0000 7f3a37dfc740 1 --2- 172.21.15.63:0/714206718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6ab280 0x55f16fa72980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.770+0000 7f3a37dfc740 1 --2- 172.21.15.63:0/714206718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6a30a0 0x55f16fa72440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.770+0000 7f3a37dfc740 1 --2- 172.21.15.63:0/714206718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6cbf60 0x55f16fa71f00 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.770+0000 7f3a37dfc740 1 -- 172.21.15.63:0/714206718 >> 172.21.15.63:0/714206718 conn(0x55f16f6c0350 msgr2=0x55f16fa6fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:07.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.770+0000 7f3a37dfc740 1 -- 172.21.15.63:0/714206718 shutdown_connections 2024-09-21T06:28:07.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.770+0000 7f3a37dfc740 1 -- 172.21.15.63:0/714206718 wait complete. 2024-09-21T06:28:07.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.770+0000 7f3a37dfc740 1 -- start start 2024-09-21T06:28:07.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.771+0000 7f3a37dfc740 1 Processor -- start 2024-09-21T06:28:07.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.771+0000 7f3a37dfc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6a30a0 0x55f16fa7da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.771+0000 7f3a37dfc740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6ab280 0x55f16fa7df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.771+0000 7f3a37dfc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6cbf60 0x55f16fa899d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.771+0000 7f3a37dfc740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f16f83a5f0 con 0x55f16f6ab280 2024-09-21T06:28:07.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.771+0000 7f3a37dfc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f16f974010 con 0x55f16f6a30a0 2024-09-21T06:28:07.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.771+0000 7f3a37dfc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f16fa806e0 con 0x55f16f6cbf60 2024-09-21T06:28:07.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.771+0000 7f3a37dfc740 10 client.0 _ll_register_callbacks cb 0x55f16f9d3340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:07.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.771+0000 7f3a2a7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6ab280 0x55f16fa7df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.771+0000 7f3a2a7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6ab280 0x55f16fa7df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44442/0 (socket says 172.21.15.63:44442) 2024-09-21T06:28:07.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.771+0000 7f3a2a7fc640 1 -- 172.21.15.63:0/1355772730 learned_addr learned my addr 172.21.15.63:0/1355772730 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:07.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.771+0000 7f3a2affd640 1 --2- 172.21.15.63:0/1355772730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6a30a0 0x55f16fa7da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.771+0000 7f3a2b7fe640 1 --2- 172.21.15.63:0/1355772730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6cbf60 0x55f16fa899d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.771+0000 7f3a2a7fc640 1 -- 172.21.15.63:0/1355772730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6cbf60 msgr2=0x55f16fa899d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:07.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.771+0000 7f3a2a7fc640 1 --2- 172.21.15.63:0/1355772730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6cbf60 0x55f16fa899d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.771+0000 7f3a2a7fc640 1 -- 172.21.15.63:0/1355772730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6a30a0 msgr2=0x55f16fa7da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:07.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.771+0000 7f3a2a7fc640 1 --2- 172.21.15.63:0/1355772730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6a30a0 0x55f16fa7da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.771+0000 7f3a2a7fc640 1 -- 172.21.15.63:0/1355772730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f16f9a1a00 con 0x55f16f6ab280 2024-09-21T06:28:07.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.772+0000 7f3a2a7fc640 1 --2- 172.21.15.63:0/1355772730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6ab280 0x55f16fa7df80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3a140096c0 tx=0x7f3a14031810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a607ba17f5c4fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:07.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.772+0000 7f3a0affd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:28:07.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.772+0000 7f3a0affd640 1 -- 172.21.15.63:0/1355772730 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14035070 con 0x55f16f6ab280 2024-09-21T06:28:07.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.772+0000 7f3a0affd640 1 -- 172.21.15.63:0/1355772730 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f3a14004240 con 0x55f16f6ab280 2024-09-21T06:28:07.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.772+0000 7f3a37dfc740 1 -- 172.21.15.63:0/1355772730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a1c01ad90 con 0x55f16f6ab280 2024-09-21T06:28:07.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.772+0000 7f3a0affd640 1 -- 172.21.15.63:0/1355772730 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3a14004440 con 0x55f16f6ab280 2024-09-21T06:28:07.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.772+0000 7f3a37dfc740 10 client.15417 fetch_fsmap learned FSMap version 28 2024-09-21T06:28:07.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.772+0000 7f3a37dfc740 1 -- 172.21.15.63:0/1355772730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f16fa8c590 con 0x55f16f6ab280 2024-09-21T06:28:07.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.772+0000 7f3a0affd640 1 -- 172.21.15.63:0/1355772730 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a1c01ad90 con 0x55f16f6ab280 2024-09-21T06:28:07.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.772+0000 7f3a0affd640 1 -- 172.21.15.63:0/1355772730 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3a14004ca0 con 0x55f16f6ab280 2024-09-21T06:28:07.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.773+0000 7f3a37dfc740 10 client.15417 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:28:07.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.773+0000 7f3a37dfc740 10 client.15417 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:28:07.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.773+0000 7f3a37dfc740 20 client.15417 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:07.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.773+0000 7f3a37dfc740 1 --2- 172.21.15.63:0/1355772730 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f16f68a8e0 0x55f16fa8ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.773+0000 7f3a37dfc740 4 client.15417 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:07.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.773+0000 7f3a37dfc740 1 -- 172.21.15.63:0/1355772730 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f16f9ebb60 con 0x55f16f68a8e0 2024-09-21T06:28:07.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.773+0000 7f3a2affd640 1 --2- 172.21.15.63:0/1355772730 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f16f68a8e0 0x55f16fa8ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.773+0000 7f3a2affd640 1 --2- 172.21.15.63:0/1355772730 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f16f68a8e0 0x55f16fa8ff60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3b020e731c310fd server_cookie=ac4cbbfb1262857b in_seq=0 out_seq=0 2024-09-21T06:28:07.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.773+0000 7f3a0affd640 10 client.15417 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:07.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.774+0000 7f3a0affd640 1 -- 172.21.15.63:0/1355772730 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f16f9ebb60 con 0x55f16f68a8e0 2024-09-21T06:28:07.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.774+0000 7f3a0affd640 10 client.15417 handle_command_reply: tid=0 2024-09-21T06:28:07.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.774+0000 7f3a37dfc740 1 client.15417 shutdown 2024-09-21T06:28:07.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.774+0000 7f3a37dfc740 1 -- 172.21.15.63:0/1355772730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6ab280 msgr2=0x55f16fa7df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:07.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.774+0000 7f3a37dfc740 1 --2- 172.21.15.63:0/1355772730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6ab280 0x55f16fa7df80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3a140096c0 tx=0x7f3a14031810 comp rx=0 tx=0).stop 2024-09-21T06:28:07.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.774+0000 7f3a37dfc740 1 -- 172.21.15.63:0/1355772730 shutdown_connections 2024-09-21T06:28:07.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.774+0000 7f3a37dfc740 1 --2- 172.21.15.63:0/1355772730 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f16f68a8e0 0x55f16fa8ff60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.774+0000 7f3a37dfc740 1 --2- 172.21.15.63:0/1355772730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6cbf60 0x55f16fa899d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.774+0000 7f3a37dfc740 1 --2- 172.21.15.63:0/1355772730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6ab280 0x55f16fa7df80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.774+0000 7f3a37dfc740 1 --2- 172.21.15.63:0/1355772730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6a30a0 0x55f16fa7da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.774+0000 7f3a0affd640 0 client.15417 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:07.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.774+0000 7f3a37dfc740 1 -- 172.21.15.63:0/1355772730 >> 172.21.15.63:0/1355772730 conn(0x55f16f6c0350 msgr2=0x55f16fa750e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:07.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.775+0000 7f3a37dfc740 1 -- 172.21.15.63:0/1355772730 shutdown_connections 2024-09-21T06:28:07.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.775+0000 7f3a37dfc740 1 -- 172.21.15.63:0/1355772730 wait complete. 2024-09-21T06:28:07.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.775+0000 7f3a37dfc740 20 client.15417 trim_cache size 0 max 16384 2024-09-21T06:28:07.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.793+0000 7f3a37dfc740 1 Processor -- start 2024-09-21T06:28:07.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.793+0000 7f3a37dfc740 1 -- start start 2024-09-21T06:28:07.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.793+0000 7f3a37dfc740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6a30a0 0x55f16fa7da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.793+0000 7f3a37dfc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6ab280 0x55f16fa7df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.793+0000 7f3a37dfc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6cbf60 0x55f16fa789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.793+0000 7f3a37dfc740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f16fa8e2a0 con 0x55f16f6a30a0 2024-09-21T06:28:07.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.793+0000 7f3a37dfc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f16fa8e970 con 0x55f16f6ab280 2024-09-21T06:28:07.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.793+0000 7f3a37dfc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f16fa8f040 con 0x55f16f6cbf60 2024-09-21T06:28:07.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.793+0000 7f3a2affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6a30a0 0x55f16fa7da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.793+0000 7f3a2affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6a30a0 0x55f16fa7da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44444/0 (socket says 172.21.15.63:44444) 2024-09-21T06:28:07.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.793+0000 7f3a2affd640 1 -- 172.21.15.63:0/1925037157 learned_addr learned my addr 172.21.15.63:0/1925037157 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:07.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.794+0000 7f3a2b7fe640 1 --2- 172.21.15.63:0/1925037157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6cbf60 0x55f16fa789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.794+0000 7f3a2a7fc640 1 --2- 172.21.15.63:0/1925037157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6ab280 0x55f16fa7df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.794+0000 7f3a2affd640 1 -- 172.21.15.63:0/1925037157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6cbf60 msgr2=0x55f16fa789f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:07.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.794+0000 7f3a2affd640 1 --2- 172.21.15.63:0/1925037157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6cbf60 0x55f16fa789f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.794+0000 7f3a2affd640 1 -- 172.21.15.63:0/1925037157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6ab280 msgr2=0x55f16fa7df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:07.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.794+0000 7f3a2affd640 1 --2- 172.21.15.63:0/1925037157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6ab280 0x55f16fa7df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.794+0000 7f3a2affd640 1 -- 172.21.15.63:0/1925037157 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f16fa7eb00 con 0x55f16f6a30a0 2024-09-21T06:28:07.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.794+0000 7f3a2affd640 1 --2- 172.21.15.63:0/1925037157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6a30a0 0x55f16fa7da20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3a2401f000 tx=0x7f3a2400fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9615d1248ef146 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:07.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.794+0000 7f3a217fa640 1 -- 172.21.15.63:0/1925037157 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24098020 con 0x55f16f6a30a0 2024-09-21T06:28:07.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.794+0000 7f3a217fa640 1 -- 172.21.15.63:0/1925037157 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a240b70d0 con 0x55f16f6a30a0 2024-09-21T06:28:07.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.794+0000 7f3a217fa640 1 -- 172.21.15.63:0/1925037157 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a240e7bd0 con 0x55f16f6a30a0 2024-09-21T06:28:07.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.795+0000 7f3a37dfc740 1 -- 172.21.15.63:0/1925037157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6a30a0 msgr2=0x55f16fa7da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:07.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.795+0000 7f3a37dfc740 1 --2- 172.21.15.63:0/1925037157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6a30a0 0x55f16fa7da20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3a2401f000 tx=0x7f3a2400fe60 comp rx=0 tx=0).stop 2024-09-21T06:28:07.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.795+0000 7f3a37dfc740 1 -- 172.21.15.63:0/1925037157 shutdown_connections 2024-09-21T06:28:07.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.795+0000 7f3a37dfc740 1 --2- 172.21.15.63:0/1925037157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6cbf60 0x55f16fa789f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.795+0000 7f3a37dfc740 1 --2- 172.21.15.63:0/1925037157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6ab280 0x55f16fa7df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.795+0000 7f3a37dfc740 1 --2- 172.21.15.63:0/1925037157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6a30a0 0x55f16fa7da20 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.795+0000 7f3a37dfc740 1 -- 172.21.15.63:0/1925037157 >> 172.21.15.63:0/1925037157 conn(0x55f16f6c0350 msgr2=0x55f16fa89b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:07.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.795+0000 7f3a37dfc740 1 -- 172.21.15.63:0/1925037157 shutdown_connections 2024-09-21T06:28:07.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.795+0000 7f3a37dfc740 1 -- 172.21.15.63:0/1925037157 wait complete. 2024-09-21T06:28:07.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.795+0000 7f3a37dfc740 1 -- start start 2024-09-21T06:28:07.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.796+0000 7f3a37dfc740 1 Processor -- start 2024-09-21T06:28:07.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.796+0000 7f3a37dfc740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6a30a0 0x55f16fa98ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.796+0000 7f3a37dfc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6ab280 0x55f16fa75000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.796+0000 7f3a37dfc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6cbf60 0x55f16fa755e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.796+0000 7f3a37dfc740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f16fa8fde0 con 0x55f16f6a30a0 2024-09-21T06:28:07.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.796+0000 7f3a37dfc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f16fa8f710 con 0x55f16f6ab280 2024-09-21T06:28:07.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.796+0000 7f3a37dfc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f16fa904b0 con 0x55f16f6cbf60 2024-09-21T06:28:07.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.796+0000 7f3a37dfc740 10 client.0 _ll_register_callbacks cb 0x7f3a14009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:07.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.796+0000 7f3a2affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6a30a0 0x55f16fa98ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.796+0000 7f3a2affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6a30a0 0x55f16fa98ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44454/0 (socket says 172.21.15.63:44454) 2024-09-21T06:28:07.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.796+0000 7f3a2affd640 1 -- 172.21.15.63:0/3739166573 learned_addr learned my addr 172.21.15.63:0/3739166573 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:07.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.796+0000 7f3a2a7fc640 1 --2- 172.21.15.63:0/3739166573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6ab280 0x55f16fa75000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.796+0000 7f3a2b7fe640 1 --2- 172.21.15.63:0/3739166573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6cbf60 0x55f16fa755e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.796+0000 7f3a2affd640 1 -- 172.21.15.63:0/3739166573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6cbf60 msgr2=0x55f16fa755e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:07.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.796+0000 7f3a2affd640 1 --2- 172.21.15.63:0/3739166573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6cbf60 0x55f16fa755e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.796+0000 7f3a2affd640 1 -- 172.21.15.63:0/3739166573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6ab280 msgr2=0x55f16fa75000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:07.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.796+0000 7f3a2affd640 1 --2- 172.21.15.63:0/3739166573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6ab280 0x55f16fa75000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.796+0000 7f3a2affd640 1 -- 172.21.15.63:0/3739166573 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f16fa75d70 con 0x55f16f6a30a0 2024-09-21T06:28:07.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.796+0000 7f3a2affd640 1 --2- 172.21.15.63:0/3739166573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6a30a0 0x55f16fa98ab0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3a240ad570 tx=0x7f3a240a9d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58fc33fec7bee1c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:07.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.796+0000 7f3a0affd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:28:07.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.797+0000 7f3a0affd640 1 -- 172.21.15.63:0/3739166573 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a240d4070 con 0x55f16f6a30a0 2024-09-21T06:28:07.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.797+0000 7f3a0affd640 1 -- 172.21.15.63:0/3739166573 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f3a240a9920 con 0x55f16f6a30a0 2024-09-21T06:28:07.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.797+0000 7f3a37dfc740 1 -- 172.21.15.63:0/3739166573 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a240b70d0 con 0x55f16f6a30a0 2024-09-21T06:28:07.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.797+0000 7f3a0affd640 1 -- 172.21.15.63:0/3739166573 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3a24098070 con 0x55f16f6a30a0 2024-09-21T06:28:07.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.797+0000 7f3a37dfc740 10 client.15423 fetch_fsmap learned FSMap version 28 2024-09-21T06:28:07.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.797+0000 7f3a37dfc740 1 -- 172.21.15.63:0/3739166573 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f16fafb430 con 0x55f16f6a30a0 2024-09-21T06:28:07.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.797+0000 7f3a0affd640 1 -- 172.21.15.63:0/3739166573 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a240b70d0 con 0x55f16f6a30a0 2024-09-21T06:28:07.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.797+0000 7f3a0affd640 1 -- 172.21.15.63:0/3739166573 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3a240a9000 con 0x55f16f6a30a0 2024-09-21T06:28:07.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.797+0000 7f3a37dfc740 10 client.15423 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:28:07.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.797+0000 7f3a37dfc740 10 client.15423 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:28:07.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.797+0000 7f3a37dfc740 20 client.15423 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:07.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.797+0000 7f3a37dfc740 1 --2- 172.21.15.63:0/3739166573 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f16f65fc90 0x55f16fafe6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.797+0000 7f3a37dfc740 4 client.15423 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:28:07.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.797+0000 7f3a37dfc740 1 -- 172.21.15.63:0/3739166573 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "status"}) -- 0x55f16f9e7610 con 0x55f16f65fc90 2024-09-21T06:28:07.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.798+0000 7f3a2a7fc640 1 --2- 172.21.15.63:0/3739166573 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f16f65fc90 0x55f16fafe6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.798+0000 7f3a2a7fc640 1 --2- 172.21.15.63:0/3739166573 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f16f65fc90 0x55f16fafe6b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca0f9a7f6495471c server_cookie=20d47a86381ea1b5 in_seq=0 out_seq=0 2024-09-21T06:28:07.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.798+0000 7f3a0affd640 10 client.15423 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:07.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.798+0000 7f3a0affd640 1 -- 172.21.15.63:0/3739166573 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55f16f9e7610 con 0x55f16f65fc90 2024-09-21T06:28:07.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.798+0000 7f3a0affd640 10 client.15423 handle_command_reply: tid=0 2024-09-21T06:28:07.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.798+0000 7f3a37dfc740 1 client.15423 shutdown 2024-09-21T06:28:07.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.799+0000 7f3a37dfc740 1 -- 172.21.15.63:0/3739166573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6a30a0 msgr2=0x55f16fa98ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:07.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.799+0000 7f3a37dfc740 1 --2- 172.21.15.63:0/3739166573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6a30a0 0x55f16fa98ab0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3a240ad570 tx=0x7f3a240a9d00 comp rx=0 tx=0).stop 2024-09-21T06:28:07.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.799+0000 7f3a37dfc740 1 -- 172.21.15.63:0/3739166573 shutdown_connections 2024-09-21T06:28:07.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.799+0000 7f3a37dfc740 1 --2- 172.21.15.63:0/3739166573 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f16f65fc90 0x55f16fafe6b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.799+0000 7f3a37dfc740 1 --2- 172.21.15.63:0/3739166573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f16f6cbf60 0x55f16fa755e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.799+0000 7f3a37dfc740 1 --2- 172.21.15.63:0/3739166573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f16f6ab280 0x55f16fa75000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.799+0000 7f3a0affd640 0 client.15423 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:07.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.799+0000 7f3a37dfc740 1 --2- 172.21.15.63:0/3739166573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f16f6a30a0 0x55f16fa98ab0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.799+0000 7f3a37dfc740 1 -- 172.21.15.63:0/3739166573 >> 172.21.15.63:0/3739166573 conn(0x55f16f6c0350 msgr2=0x55f16fa7da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:07.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.799+0000 7f3a37dfc740 1 -- 172.21.15.63:0/3739166573 shutdown_connections 2024-09-21T06:28:07.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.799+0000 7f3a37dfc740 1 -- 172.21.15.63:0/3739166573 wait complete. 2024-09-21T06:28:07.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.799+0000 7f3a37dfc740 20 client.15423 trim_cache size 0 max 16384 2024-09-21T06:28:07.807 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:28:07.807 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "140899c8-77e1-11ef-baf5-efdc52797490", 2024-09-21T06:28:07.807 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2024-09-21T06:28:07.807 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 24698, 2024-09-21T06:28:07.807 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-21T06:28:07.807 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-21T06:28:07.808 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-21T06:28:07.808 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 108.514681803, 2024-09-21T06:28:07.808 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 28, 2024-09-21T06:28:07.808 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 77, 2024-09-21T06:28:07.808 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:28:07.808 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 117.57843563199999 2024-09-21T06:28:07.808 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:28:07.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.799+0000 7f3a31888640 1 -- 172.21.15.63:0/3615218523 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3a180b66a0 msgr2=0x7f3a180b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:07.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.799+0000 7f3a31888640 1 --2- 172.21.15.63:0/3615218523 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3a180b66a0 0x7f3a180b8bb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c01e000 tx=0x7f3a1c01f000 comp rx=0 tx=0).stop 2024-09-21T06:28:07.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.799+0000 7f3a31888640 1 -- 172.21.15.63:0/3615218523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a2c101f80 msgr2=0x7f3a2c19a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:07.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.799+0000 7f3a31888640 1 --2- 172.21.15.63:0/3615218523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a2c101f80 0x7f3a2c19a540 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400c920 tx=0x7f3a2400cde0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.800+0000 7f3a31888640 1 -- 172.21.15.63:0/3615218523 shutdown_connections 2024-09-21T06:28:07.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.800+0000 7f3a31888640 1 --2- 172.21.15.63:0/3615218523 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3a180b66a0 0x7f3a180b8bb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.800+0000 7f3a31888640 1 --2- 172.21.15.63:0/3615218523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a2c109e10 0x7f3a2c19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.800+0000 7f3a31888640 1 --2- 172.21.15.63:0/3615218523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a2c1094c0 0x7f3a2c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.800+0000 7f3a31888640 1 --2- 172.21.15.63:0/3615218523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3a2c101f80 0x7f3a2c19a540 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.800+0000 7f3a31888640 1 -- 172.21.15.63:0/3615218523 >> 172.21.15.63:0/3615218523 conn(0x7f3a2c077cf0 msgr2=0x7f3a2c107620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:07.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.800+0000 7f3a31888640 1 -- 172.21.15.63:0/3615218523 shutdown_connections 2024-09-21T06:28:07.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:07.800+0000 7f3a31888640 1 -- 172.21.15.63:0/3615218523 wait complete. 2024-09-21T06:28:08.607 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T06:28:08.647 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T06:28:08.647 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-21T06:28:08.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:28:08.647 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-21T06:28:08.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:28:08.665 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-09-21T06:28:08.733 INFO:teuthology.orchestra.run.smithi063.stderr:Cannot find device "ceph-brx" 2024-09-21T06:28:08.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:28:08.735 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-21T06:28:08.735 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T06:28:08.735 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:28:08.736 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T06:28:09.031 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:09.296 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:09 smithi063 ceph-mon[31150]: pgmap v320: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:28:09.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:09 smithi175 ceph-mon[34510]: pgmap v320: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:28:09.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.489+0000 7f634758c640 1 -- 172.21.15.63:0/390223223 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6340105330 msgr2=0x7f634010d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:09.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.489+0000 7f634758c640 1 --2- 172.21.15.63:0/390223223 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6340105330 0x7f634010d880 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6334009900 tx=0x7f633402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:28:09.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.489+0000 7f634758c640 1 -- 172.21.15.63:0/390223223 shutdown_connections 2024-09-21T06:28:09.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.489+0000 7f634758c640 1 --2- 172.21.15.63:0/390223223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f634010de40 0x7f6340110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:09.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.489+0000 7f634758c640 1 --2- 172.21.15.63:0/390223223 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6340105330 0x7f634010d880 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:09.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.489+0000 7f634758c640 1 --2- 172.21.15.63:0/390223223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63401049e0 0x7f6340104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:09.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.489+0000 7f634758c640 1 -- 172.21.15.63:0/390223223 >> 172.21.15.63:0/390223223 conn(0x7f6340079730 msgr2=0x7f6340079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:09.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.489+0000 7f634758c640 1 -- 172.21.15.63:0/390223223 shutdown_connections 2024-09-21T06:28:09.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.489+0000 7f634758c640 1 -- 172.21.15.63:0/390223223 wait complete. 2024-09-21T06:28:09.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.490+0000 7f634758c640 1 Processor -- start 2024-09-21T06:28:09.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.490+0000 7f634758c640 1 -- start start 2024-09-21T06:28:09.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.490+0000 7f634758c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63401049e0 0x7f634019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:09.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.490+0000 7f634758c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6340105330 0x7f634019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:09.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.490+0000 7f634758c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f634010de40 0x7f634019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:09.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.490+0000 7f634758c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6340113a60 con 0x7f634010de40 2024-09-21T06:28:09.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.490+0000 7f634758c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f63401138e0 con 0x7f63401049e0 2024-09-21T06:28:09.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.490+0000 7f634758c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6340113be0 con 0x7f6340105330 2024-09-21T06:28:09.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.490+0000 7f6345b29640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f634010de40 0x7f634019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:09.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.490+0000 7f6345b29640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f634010de40 0x7f634019fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44464/0 (socket says 172.21.15.63:44464) 2024-09-21T06:28:09.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.490+0000 7f6345b29640 1 -- 172.21.15.63:0/4028858283 learned_addr learned my addr 172.21.15.63:0/4028858283 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:09.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.491+0000 7f6344b27640 1 --2- 172.21.15.63:0/4028858283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6340105330 0x7f634019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:09.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.491+0000 7f6345328640 1 --2- 172.21.15.63:0/4028858283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63401049e0 0x7f634019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:09.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.491+0000 7f6345b29640 1 -- 172.21.15.63:0/4028858283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6340105330 msgr2=0x7f634019aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:09.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.491+0000 7f6345b29640 1 --2- 172.21.15.63:0/4028858283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6340105330 0x7f634019aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:09.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.491+0000 7f6345b29640 1 -- 172.21.15.63:0/4028858283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63401049e0 msgr2=0x7f634019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:09.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.491+0000 7f6345b29640 1 --2- 172.21.15.63:0/4028858283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63401049e0 0x7f634019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:09.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.491+0000 7f6345b29640 1 -- 172.21.15.63:0/4028858283 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63401a03c0 con 0x7f634010de40 2024-09-21T06:28:09.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.491+0000 7f6345b29640 1 --2- 172.21.15.63:0/4028858283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f634010de40 0x7f634019fd50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f633800c970 tx=0x7f633800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:09.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.491+0000 7f633e7fc640 1 -- 172.21.15.63:0/4028858283 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338007bb0 con 0x7f634010de40 2024-09-21T06:28:09.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.491+0000 7f633e7fc640 1 -- 172.21.15.63:0/4028858283 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6338007d50 con 0x7f634010de40 2024-09-21T06:28:09.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.491+0000 7f634758c640 1 -- 172.21.15.63:0/4028858283 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63401a06b0 con 0x7f634010de40 2024-09-21T06:28:09.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.491+0000 7f633e7fc640 1 -- 172.21.15.63:0/4028858283 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338018770 con 0x7f634010de40 2024-09-21T06:28:09.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.491+0000 7f634758c640 1 -- 172.21.15.63:0/4028858283 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63401a0b70 con 0x7f634010de40 2024-09-21T06:28:09.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.492+0000 7f634758c640 1 -- 172.21.15.63:0/4028858283 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f634006c280 con 0x7f634010de40 2024-09-21T06:28:09.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.494+0000 7f633e7fc640 1 -- 172.21.15.63:0/4028858283 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f633800f990 con 0x7f634010de40 2024-09-21T06:28:09.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.495+0000 7f633e7fc640 1 --2- 172.21.15.63:0/4028858283 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f63280b6620 0x7f63280b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:09.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.495+0000 7f6345328640 1 --2- 172.21.15.63:0/4028858283 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f63280b6620 0x7f63280b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:09.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.495+0000 7f633e7fc640 1 -- 172.21.15.63:0/4028858283 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f63380e75b0 con 0x7f634010de40 2024-09-21T06:28:09.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.495+0000 7f6345328640 1 --2- 172.21.15.63:0/4028858283 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f63280b6620 0x7f63280b8b30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6330005c40 tx=0x7f633000a590 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:09.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.498+0000 7f633e7fc640 1 -- 172.21.15.63:0/4028858283 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6338014030 con 0x7f634010de40 2024-09-21T06:28:09.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:09 smithi071 ceph-mon[34844]: pgmap v320: 97 pgs: 97 active+clean; 649 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:28:09.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.726+0000 7f634758c640 1 -- 172.21.15.63:0/4028858283 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6340104df0 con 0x7f634010de40 2024-09-21T06:28:09.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.726+0000 7f633e7fc640 1 -- 172.21.15.63:0/4028858283 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7f63380adc90 con 0x7f634010de40 2024-09-21T06:28:09.728 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:28:09.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.728+0000 7f634758c640 1 -- 172.21.15.63:0/4028858283 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f63280b6620 msgr2=0x7f63280b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:09.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.728+0000 7f634758c640 1 --2- 172.21.15.63:0/4028858283 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f63280b6620 0x7f63280b8b30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6330005c40 tx=0x7f633000a590 comp rx=0 tx=0).stop 2024-09-21T06:28:09.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.728+0000 7f634758c640 1 -- 172.21.15.63:0/4028858283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f634010de40 msgr2=0x7f634019fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:09.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.728+0000 7f634758c640 1 --2- 172.21.15.63:0/4028858283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f634010de40 0x7f634019fd50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f633800c970 tx=0x7f633800ce30 comp rx=0 tx=0).stop 2024-09-21T06:28:09.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.729+0000 7f634758c640 1 -- 172.21.15.63:0/4028858283 shutdown_connections 2024-09-21T06:28:09.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.729+0000 7f634758c640 1 --2- 172.21.15.63:0/4028858283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f634010de40 0x7f634019fd50 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:09.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.729+0000 7f634758c640 1 --2- 172.21.15.63:0/4028858283 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f63280b6620 0x7f63280b8b30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:09.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.729+0000 7f634758c640 1 --2- 172.21.15.63:0/4028858283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6340105330 0x7f634019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:09.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.729+0000 7f634758c640 1 --2- 172.21.15.63:0/4028858283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63401049e0 0x7f634019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:09.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.729+0000 7f634758c640 1 -- 172.21.15.63:0/4028858283 >> 172.21.15.63:0/4028858283 conn(0x7f6340079730 msgr2=0x7f6340106850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:09.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.729+0000 7f634758c640 1 -- 172.21.15.63:0/4028858283 shutdown_connections 2024-09-21T06:28:09.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:09.729+0000 7f634758c640 1 -- 172.21.15.63:0/4028858283 wait complete. 2024-09-21T06:28:10.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:10 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/4028858283' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T06:28:10.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:10 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/4028858283' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T06:28:10.442 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T06:28:10.443 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:28:10.443 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2024-09-21T06:28:10.443 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:28:10.443 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:28:10.443 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T06:28:10.443 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T06:28:10.443 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:28:10.443 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:28:10.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:28:10.443 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2024-09-21T06:28:10.460 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:28:10.460 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:28:10.461 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:28:10.461 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:28:10.462 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-09-21T06:28:10.462 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:28:10.462 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:28:10.462 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:28:10.462 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2024-09-21T06:28:10.462 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:28:10.463 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:28:10.463 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2024-09-21T06:28:10.463 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:28:10.463 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:28:10.463 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:28:10.463 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:28:10.463 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:28:10.464 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42130sec preferred_lft 42130sec 2024-09-21T06:28:10.464 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link noprefixroute 2024-09-21T06:28:10.464 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:28:10.465 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T06:28:10.465 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:28:10.465 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-21T06:28:10.465 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add name ceph-brx type bridge 2024-09-21T06:28:10.466 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr flush dev ceph-brx 2024-09-21T06:28:10.466 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set ceph-brx up 2024-09-21T06:28:10.466 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T06:28:10.466 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-21T06:28:10.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:10 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/4028858283' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T06:28:10.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:28:10.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:28:10.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:28:10.676 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:28:10.702 INFO:teuthology.orchestra.run.smithi063.stdout:1 2024-09-21T06:28:10.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:28:10.703 DEBUG:teuthology.orchestra.run.smithi063:> route 2024-09-21T06:28:10.782 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2024-09-21T06:28:10.782 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:28:10.782 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:28:10.782 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:28:10.782 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:28:10.783 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:28:10.783 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-21T06:28:10.783 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:28:10.783 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:28:10.783 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:28:10.783 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-21T06:28:10.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:28:11.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:28:11.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:28:11.099 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-21T06:28:11.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:28:11.116 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list-id 2024-09-21T06:28:11.173 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:28:11.173 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-21T06:28:11.173 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:28:11.173 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T06:28:11.173 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-21T06:28:11.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:28:11.273 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:11 smithi063 ceph-mon[31150]: pgmap v321: 97 pgs: 97 active+clean; 649 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-21T06:28:11.274 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:11 smithi063 ceph-mon[31150]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T06:28:11.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:28:11.296 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T06:28:11.296 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:28:11.296 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-21T06:28:11.297 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T06:28:11.297 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T06:28:11.297 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T06:28:11.297 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T06:28:11.297 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T06:28:11.297 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-21T06:28:11.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:28:11.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:11 smithi175 ceph-mon[34510]: pgmap v321: 97 pgs: 97 active+clean; 649 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-21T06:28:11.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:11 smithi175 ceph-mon[34510]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T06:28:11.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:28:11.425 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:28:11.425 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-21T06:28:11.425 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.0 up 2024-09-21T06:28:11.425 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T06:28:11.426 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-21T06:28:11.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:28:11.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:28:11.504 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:28:11.505 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:28:11.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:11 smithi071 ceph-mon[34844]: pgmap v321: 97 pgs: 97 active+clean; 649 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-21T06:28:11.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:11 smithi071 ceph-mon[34844]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T06:28:11.520 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:28:11.520 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:28:11.520 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:28:11.576 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-21T06:28:11.576 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-21T06:28:11.576 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/5340b01f-481e-4db9-84fa-0125b1b9d150 2024-09-21T06:28:11.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:28:11.577 DEBUG:teuthology.orchestra.run.smithi063:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/5340b01f-481e-4db9-84fa-0125b1b9d150 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-21T06:28:11.683 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-21T06:28:11.684 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-21T06:28:11.831 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-21T06:28:11.831 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-21T06:28:11.831 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.71:3300,172.21.15.175:3300" 2024-09-21T06:28:11.831 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: trying mount with new device syntax: 0@140899c8-77e1-11ef-baf5-efdc52797490.cephfs=/volumes/qa/sv_1/5340b01f-481e-4db9-84fa-0125b1b9d150 2024-09-21T06:28:11.831 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.63:3300/172.21.15.71:3300/172.21.15.175:3300" will pass to kernel 2024-09-21T06:28:11.832 INFO:teuthology.orchestra.run.smithi063.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:28:11.832 INFO:teuthology.orchestra.run.smithi063.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:28:11.832 INFO:teuthology.orchestra.run.smithi063.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:28:11.832 INFO:teuthology.orchestra.run.smithi063.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:28:11.832 INFO:teuthology.orchestra.run.smithi063.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:28:11.834 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:28:11.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:28:11.834 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:28:11.864 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:28:11.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:28:11.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:28:11.962 INFO:teuthology.orchestra.run.smithi063.stdout:client15432 2024-09-21T06:28:11.963 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:28:11.963 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:28:11.981 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:28:12.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:28:12.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:28:12.079 INFO:teuthology.orchestra.run.smithi063.stdout:client15432 2024-09-21T06:28:12.079 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:28:12.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:28:12.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:28:12.137 INFO:teuthology.orchestra.run.smithi063.stdout:client15432 2024-09-21T06:28:12.137 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/140899c8-77e1-11ef-baf5-efdc52797490.client15432/status') 2024-09-21T06:28:12.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:28:12.197 INFO:teuthology.orchestra.run.smithi063.stdout:instance: client.15432 (3)192.168.0.1:0/1517247081 2024-09-21T06:28:12.197 INFO:teuthology.orchestra.run.smithi063.stdout:blocklisted: false 2024-09-21T06:28:12.198 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records in 2024-09-21T06:28:12.198 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records out 2024-09-21T06:28:12.198 INFO:teuthology.orchestra.run.smithi063.stderr:70 bytes copied, 2.3489e-05 s, 3.0 MB/s 2024-09-21T06:28:12.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:28:12.205 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T06:28:12.214 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T06:28:12.214 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T06:28:12.214 DEBUG:teuthology.orchestra.run.smithi063:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-21T06:28:12.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.328+0000 7f920f7e6640 1 -- 172.21.15.63:0/2461079496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9208105280 msgr2=0x7f920810d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:12.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.328+0000 7f920f7e6640 1 --2- 172.21.15.63:0/2461079496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9208105280 0x7f920810d7c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9204009900 tx=0x7f920402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:12.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.328+0000 7f920f7e6640 1 -- 172.21.15.63:0/2461079496 shutdown_connections 2024-09-21T06:28:12.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.328+0000 7f920f7e6640 1 --2- 172.21.15.63:0/2461079496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f920810dd90 0x7f9208110280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:12.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.328+0000 7f920f7e6640 1 --2- 172.21.15.63:0/2461079496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9208105280 0x7f920810d7c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:12.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.328+0000 7f920f7e6640 1 --2- 172.21.15.63:0/2461079496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9208104930 0x7f9208104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:12.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.328+0000 7f920f7e6640 1 -- 172.21.15.63:0/2461079496 >> 172.21.15.63:0/2461079496 conn(0x7f92080fe3c0 msgr2=0x7f9208100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:12.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.328+0000 7f920f7e6640 1 -- 172.21.15.63:0/2461079496 shutdown_connections 2024-09-21T06:28:12.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.328+0000 7f920f7e6640 1 -- 172.21.15.63:0/2461079496 wait complete. 2024-09-21T06:28:12.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.329+0000 7f920f7e6640 1 Processor -- start 2024-09-21T06:28:12.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.329+0000 7f920f7e6640 1 -- start start 2024-09-21T06:28:12.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.329+0000 7f920f7e6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9208104930 0x7f9208102660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:12.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.329+0000 7f920f7e6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9208105280 0x7f9208102ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:12.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.329+0000 7f920f7e6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f920810dd90 0x7f92081030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:12.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.329+0000 7f920f7e6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f92081139f0 con 0x7f920810dd90 2024-09-21T06:28:12.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.329+0000 7f920f7e6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9208113870 con 0x7f9208104930 2024-09-21T06:28:12.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.329+0000 7f920f7e6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9208113b70 con 0x7f9208105280 2024-09-21T06:28:12.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.329+0000 7f920dd83640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f920810dd90 0x7f92081030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:12.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.329+0000 7f920dd83640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f920810dd90 0x7f92081030e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44486/0 (socket says 172.21.15.63:44486) 2024-09-21T06:28:12.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.329+0000 7f920dd83640 1 -- 172.21.15.63:0/3173610209 learned_addr learned my addr 172.21.15.63:0/3173610209 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:12.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.330+0000 7f920cd81640 1 --2- 172.21.15.63:0/3173610209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9208105280 0x7f9208102ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:12.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.330+0000 7f920d582640 1 --2- 172.21.15.63:0/3173610209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9208104930 0x7f9208102660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:12.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.330+0000 7f920dd83640 1 -- 172.21.15.63:0/3173610209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9208105280 msgr2=0x7f9208102ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:12.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.330+0000 7f920dd83640 1 --2- 172.21.15.63:0/3173610209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9208105280 0x7f9208102ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:12.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.330+0000 7f920dd83640 1 -- 172.21.15.63:0/3173610209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9208104930 msgr2=0x7f9208102660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:12.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.330+0000 7f920dd83640 1 --2- 172.21.15.63:0/3173610209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9208104930 0x7f9208102660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:12.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.330+0000 7f920dd83640 1 -- 172.21.15.63:0/3173610209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92081a8700 con 0x7f920810dd90 2024-09-21T06:28:12.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.330+0000 7f920cd81640 1 --2- 172.21.15.63:0/3173610209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9208105280 0x7f9208102ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:12.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.330+0000 7f920dd83640 1 --2- 172.21.15.63:0/3173610209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f920810dd90 0x7f92081030e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f920000eb10 tx=0x7f920000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:12.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.330+0000 7f91fe7fc640 1 -- 172.21.15.63:0/3173610209 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200004b20 con 0x7f920810dd90 2024-09-21T06:28:12.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.330+0000 7f920f7e6640 1 -- 172.21.15.63:0/3173610209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92081a89f0 con 0x7f920810dd90 2024-09-21T06:28:12.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.330+0000 7f91fe7fc640 1 -- 172.21.15.63:0/3173610209 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9200004cc0 con 0x7f920810dd90 2024-09-21T06:28:12.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.330+0000 7f91fe7fc640 1 -- 172.21.15.63:0/3173610209 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200010670 con 0x7f920810dd90 2024-09-21T06:28:12.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.330+0000 7f920f7e6640 1 -- 172.21.15.63:0/3173610209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92081a8f10 con 0x7f920810dd90 2024-09-21T06:28:12.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.331+0000 7f920f7e6640 1 -- 172.21.15.63:0/3173610209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f920806c080 con 0x7f920810dd90 2024-09-21T06:28:12.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.333+0000 7f91fe7fc640 1 -- 172.21.15.63:0/3173610209 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f9200004fe0 con 0x7f920810dd90 2024-09-21T06:28:12.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.333+0000 7f91fe7fc640 1 --2- 172.21.15.63:0/3173610209 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f91f40b6590 0x7f91f40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:12.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.334+0000 7f920d582640 1 --2- 172.21.15.63:0/3173610209 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f91f40b6590 0x7f91f40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:12.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.334+0000 7f91fe7fc640 1 -- 172.21.15.63:0/3173610209 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f92000e7ca0 con 0x7f920810dd90 2024-09-21T06:28:12.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.334+0000 7f920d582640 1 --2- 172.21.15.63:0/3173610209 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f91f40b6590 0x7f91f40b8aa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f92081040b0 tx=0x7f91f8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:12.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.336+0000 7f91fe7fc640 1 -- 172.21.15.63:0/3173610209 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9200056710 con 0x7f920810dd90 2024-09-21T06:28:12.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:12.567+0000 7f920f7e6640 1 -- 172.21.15.63:0/3173610209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f9208103960 con 0x7f920810dd90 2024-09-21T06:28:13.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.062+0000 7f91fe7fc640 1 -- 172.21.15.63:0/3173610209 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v29) ==== 117+0+0 (secure 0 0 0) 0x7f9208103960 con 0x7f920810dd90 2024-09-21T06:28:13.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.065+0000 7f920f7e6640 1 -- 172.21.15.63:0/3173610209 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f91f40b6590 msgr2=0x7f91f40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:13.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.065+0000 7f920f7e6640 1 --2- 172.21.15.63:0/3173610209 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f91f40b6590 0x7f91f40b8aa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f92081040b0 tx=0x7f91f8005f90 comp rx=0 tx=0).stop 2024-09-21T06:28:13.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.065+0000 7f920f7e6640 1 -- 172.21.15.63:0/3173610209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f920810dd90 msgr2=0x7f92081030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:13.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.065+0000 7f920f7e6640 1 --2- 172.21.15.63:0/3173610209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f920810dd90 0x7f92081030e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f920000eb10 tx=0x7f920000c2d0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.065+0000 7f920f7e6640 1 -- 172.21.15.63:0/3173610209 shutdown_connections 2024-09-21T06:28:13.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.065+0000 7f920f7e6640 1 --2- 172.21.15.63:0/3173610209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f920810dd90 0x7f92081030e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.065+0000 7f920f7e6640 1 --2- 172.21.15.63:0/3173610209 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f91f40b6590 0x7f91f40b8aa0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.065+0000 7f920f7e6640 1 --2- 172.21.15.63:0/3173610209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9208105280 0x7f9208102ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.065+0000 7f920f7e6640 1 --2- 172.21.15.63:0/3173610209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9208104930 0x7f9208102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.065+0000 7f920f7e6640 1 -- 172.21.15.63:0/3173610209 >> 172.21.15.63:0/3173610209 conn(0x7f92080fe3c0 msgr2=0x7f92081078a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:13.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.065+0000 7f920f7e6640 1 -- 172.21.15.63:0/3173610209 shutdown_connections 2024-09-21T06:28:13.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.065+0000 7f920f7e6640 1 -- 172.21.15.63:0/3173610209 wait complete. 2024-09-21T06:28:13.080 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T06:28:13.091 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-21T06:28:13.122 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:28:13.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.238+0000 7ff9d9dba640 1 -- 172.21.15.63:0/337841186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9d4102980 msgr2=0x7ff9d4102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:13.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.238+0000 7ff9d9dba640 1 --2- 172.21.15.63:0/337841186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9d4102980 0x7ff9d4102d90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009900 tx=0x7ff9c402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:13.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.238+0000 7ff9d9dba640 1 -- 172.21.15.63:0/337841186 shutdown_connections 2024-09-21T06:28:13.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.238+0000 7ff9d9dba640 1 --2- 172.21.15.63:0/337841186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9d4108c00 0x7ff9d410f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.238+0000 7ff9d9dba640 1 --2- 172.21.15.63:0/337841186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9d41082b0 0x7ff9d41086c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.238+0000 7ff9d9dba640 1 --2- 172.21.15.63:0/337841186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9d4102980 0x7ff9d4102d90 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.238+0000 7ff9d9dba640 1 -- 172.21.15.63:0/337841186 >> 172.21.15.63:0/337841186 conn(0x7ff9d40fe380 msgr2=0x7ff9d41007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:13.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.238+0000 7ff9d9dba640 1 -- 172.21.15.63:0/337841186 shutdown_connections 2024-09-21T06:28:13.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.238+0000 7ff9d9dba640 1 -- 172.21.15.63:0/337841186 wait complete. 2024-09-21T06:28:13.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.239+0000 7ff9d9dba640 1 Processor -- start 2024-09-21T06:28:13.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.239+0000 7ff9d9dba640 1 -- start start 2024-09-21T06:28:13.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.239+0000 7ff9d9dba640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9d4102980 0x7ff9d419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:13.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.239+0000 7ff9d9dba640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9d41082b0 0x7ff9d419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:13.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.239+0000 7ff9d9dba640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9d4108c00 0x7ff9d419fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:13.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.239+0000 7ff9d9dba640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d41128c0 con 0x7ff9d4108c00 2024-09-21T06:28:13.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.239+0000 7ff9d9dba640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d4112740 con 0x7ff9d41082b0 2024-09-21T06:28:13.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.239+0000 7ff9d9dba640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d4112a40 con 0x7ff9d4102980 2024-09-21T06:28:13.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.239+0000 7ff9d3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9d4108c00 0x7ff9d419fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:13.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.240+0000 7ff9d3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9d4108c00 0x7ff9d419fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44504/0 (socket says 172.21.15.63:44504) 2024-09-21T06:28:13.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.240+0000 7ff9d3fff640 1 -- 172.21.15.63:0/909022816 learned_addr learned my addr 172.21.15.63:0/909022816 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:13.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.240+0000 7ff9d37fe640 1 --2- 172.21.15.63:0/909022816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9d4102980 0x7ff9d419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:13.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.240+0000 7ff9caffd640 1 --2- 172.21.15.63:0/909022816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9d41082b0 0x7ff9d419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:13.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.240+0000 7ff9d3fff640 1 -- 172.21.15.63:0/909022816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9d4102980 msgr2=0x7ff9d419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:13.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.240+0000 7ff9d3fff640 1 --2- 172.21.15.63:0/909022816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9d4102980 0x7ff9d419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.240+0000 7ff9d3fff640 1 -- 172.21.15.63:0/909022816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9d41082b0 msgr2=0x7ff9d419a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:13.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.240+0000 7ff9d3fff640 1 --2- 172.21.15.63:0/909022816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9d41082b0 0x7ff9d419a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.240+0000 7ff9d3fff640 1 -- 172.21.15.63:0/909022816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d41a0320 con 0x7ff9d4108c00 2024-09-21T06:28:13.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.240+0000 7ff9caffd640 1 --2- 172.21.15.63:0/909022816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9d41082b0 0x7ff9d419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:13.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.240+0000 7ff9d3fff640 1 --2- 172.21.15.63:0/909022816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9d4108c00 0x7ff9d419fc20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00eb10 tx=0x7ff9cc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:13.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.240+0000 7ff9d17fa640 1 -- 172.21.15.63:0/909022816 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc004b20 con 0x7ff9d4108c00 2024-09-21T06:28:13.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.240+0000 7ff9d9dba640 1 -- 172.21.15.63:0/909022816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d41a0610 con 0x7ff9d4108c00 2024-09-21T06:28:13.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.240+0000 7ff9d17fa640 1 -- 172.21.15.63:0/909022816 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9cc004cc0 con 0x7ff9d4108c00 2024-09-21T06:28:13.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.240+0000 7ff9d17fa640 1 -- 172.21.15.63:0/909022816 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc010670 con 0x7ff9d4108c00 2024-09-21T06:28:13.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.240+0000 7ff9d9dba640 1 -- 172.21.15.63:0/909022816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d41a6da0 con 0x7ff9d4108c00 2024-09-21T06:28:13.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.241+0000 7ff9d9dba640 1 -- 172.21.15.63:0/909022816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9d4103bf0 con 0x7ff9d4108c00 2024-09-21T06:28:13.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.243+0000 7ff9d17fa640 1 -- 172.21.15.63:0/909022816 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7ff9cc005000 con 0x7ff9d4108c00 2024-09-21T06:28:13.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.244+0000 7ff9d17fa640 1 --2- 172.21.15.63:0/909022816 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff9c00b6560 0x7ff9c00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:13.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.244+0000 7ff9d37fe640 1 --2- 172.21.15.63:0/909022816 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff9c00b6560 0x7ff9c00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:13.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.244+0000 7ff9d17fa640 1 -- 172.21.15.63:0/909022816 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ff9cc0e7c60 con 0x7ff9d4108c00 2024-09-21T06:28:13.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.245+0000 7ff9d37fe640 1 --2- 172.21.15.63:0/909022816 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff9c00b6560 0x7ff9c00b8a70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4031440 tx=0x7ff9c4009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:13.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.247+0000 7ff9d17fa640 1 -- 172.21.15.63:0/909022816 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff9cc056710 con 0x7ff9d4108c00 2024-09-21T06:28:13.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:13 smithi063 ceph-mon[31150]: pgmap v322: 97 pgs: 97 active+clean; 649 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T06:28:13.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:13 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3173610209' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T06:28:13.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:13 smithi175 ceph-mon[34510]: pgmap v322: 97 pgs: 97 active+clean; 649 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T06:28:13.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:13 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3173610209' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T06:28:13.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.437+0000 7ff9d9dba640 1 -- 172.21.15.63:0/909022816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9d419b510 con 0x7ff9d4108c00 2024-09-21T06:28:13.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.438+0000 7ff9d17fa640 1 -- 172.21.15.63:0/909022816 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+23049 (secure 0 0 0) 0x7ff9cc0ae410 con 0x7ff9d4108c00 2024-09-21T06:28:13.440 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:28:13.440 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":77,"fsid":"140899c8-77e1-11ef-baf5-efdc52797490","created":"2024-09-21T06:17:48.089366+0000","modified":"2024-09-21T06:26:38.957699+0000","last_up_change":"2024-09-21T06:25:29.072128+0000","last_in_change":"2024-09-21T06:25:06.097647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:21:36.236868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:26:15.016085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:26:17.072883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df4162c1-dd66-4d11-99bc-0ae36ea130f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6803","nonce":2090653772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6805","nonce":2090653772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6809","nonce":2090653772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6807","nonce":2090653772}]},"public_addr":"172.21.15.63:6803/2090653772","cluster_addr":"172.21.15.63:6805/2090653772","heartbeat_back_addr":"172.21.15.63:6809/2090653772","heartbeat_front_addr":"172.21.15.63:6807/2090653772","state":["exists","up"]},{"osd":1,"uuid":"65a12def-9f66-4153-8f1a-2ebfbbfeba99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6801","nonce":1676297548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6803","nonce":1676297548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6807","nonce":1676297548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6805","nonce":1676297548}]},"public_addr":"172.21.15.71:6801/1676297548","cluster_addr":"172.21.15.71:6803/1676297548","heartbeat_back_addr":"172.21.15.71:6807/1676297548","heartbeat_front_addr":"172.21.15.71:6805/1676297548","state":["exists","up"]},{"osd":2,"uuid":"031daa9e-9d4a-4901-95e8-695db5671fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6801","nonce":2356865390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6803","nonce":2356865390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6807","nonce":2356865390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6805","nonce":2356865390}]},"public_addr":"172.21.15.175:6801/2356865390","cluster_addr":"172.21.15.175:6803/2356865390","heartbeat_back_addr":"172.21.15.175:6807/2356865390","heartbeat_front_addr":"172.21.15.175:6805/2356865390","state":["exists","up"]},{"osd":3,"uuid":"75d23a7a-c560-4b26-84a4-74d6772a37ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6811","nonce":31683339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6813","nonce":31683339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6817","nonce":31683339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6815","nonce":31683339}]},"public_addr":"172.21.15.63:6811/31683339","cluster_addr":"172.21.15.63:6813/31683339","heartbeat_back_addr":"172.21.15.63:6817/31683339","heartbeat_front_addr":"172.21.15.63:6815/31683339","state":["exists","up"]},{"osd":4,"uuid":"6aaefd09-93dd-4f21-9b3c-701a7ff97f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6809","nonce":829449898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6811","nonce":829449898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6815","nonce":829449898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6813","nonce":829449898}]},"public_addr":"172.21.15.71:6809/829449898","cluster_addr":"172.21.15.71:6811/829449898","heartbeat_back_addr":"172.21.15.71:6815/829449898","heartbeat_front_addr":"172.21.15.71:6813/829449898","state":["exists","up"]},{"osd":5,"uuid":"91f28121-c94e-4012-b74c-dd4597545e3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6809","nonce":3005600597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6811","nonce":3005600597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6815","nonce":3005600597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6813","nonce":3005600597}]},"public_addr":"172.21.15.175:6809/3005600597","cluster_addr":"172.21.15.175:6811/3005600597","heartbeat_back_addr":"172.21.15.175:6815/3005600597","heartbeat_front_addr":"172.21.15.175:6813/3005600597","state":["exists","up"]},{"osd":6,"uuid":"bda28014-4dca-40f1-bb23-3ef61605c1ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6819","nonce":4044730408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6821","nonce":4044730408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6825","nonce":4044730408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6823","nonce":4044730408}]},"public_addr":"172.21.15.63:6819/4044730408","cluster_addr":"172.21.15.63:6821/4044730408","heartbeat_back_addr":"172.21.15.63:6825/4044730408","heartbeat_front_addr":"172.21.15.63:6823/4044730408","state":["exists","up"]},{"osd":7,"uuid":"a9026588-ccdc-4e6c-b628-1ac8a7dbfa64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6817","nonce":2913027708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6819","nonce":2913027708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6823","nonce":2913027708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6821","nonce":2913027708}]},"public_addr":"172.21.15.71:6817/2913027708","cluster_addr":"172.21.15.71:6819/2913027708","heartbeat_back_addr":"172.21.15.71:6823/2913027708","heartbeat_front_addr":"172.21.15.71:6821/2913027708","state":["exists","up"]},{"osd":8,"uuid":"2e1dacea-483c-4587-8d19-5c77a7b98667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6817","nonce":2058692148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6819","nonce":2058692148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6823","nonce":2058692148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6821","nonce":2058692148}]},"public_addr":"172.21.15.175:6817/2058692148","cluster_addr":"172.21.15.175:6819/2058692148","heartbeat_back_addr":"172.21.15.175:6823/2058692148","heartbeat_front_addr":"172.21.15.175:6821/2058692148","state":["exists","up"]},{"osd":9,"uuid":"7077ba4d-1fce-4197-a556-8b6a859c6f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6827","nonce":3278012285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6829","nonce":3278012285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6833","nonce":3278012285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6831","nonce":3278012285}]},"public_addr":"172.21.15.63:6827/3278012285","cluster_addr":"172.21.15.63:6829/3278012285","heartbeat_back_addr":"172.21.15.63:6833/3278012285","heartbeat_front_addr":"172.21.15.63:6831/3278012285","state":["exists","up"]},{"osd":10,"uuid":"99965496-91ee-4eef-9f2e-8f9c8dc54f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6825","nonce":3297929438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6827","nonce":3297929438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6831","nonce":3297929438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6829","nonce":3297929438}]},"public_addr":"172.21.15.71:6825/3297929438","cluster_addr":"172.21.15.71:6827/3297929438","heartbeat_back_addr":"172.21.15.71:6831/3297929438","heartbeat_front_addr":"172.21.15.71:6829/3297929438","state":["exists","up"]},{"osd":11,"uuid":"1b26d1a8-91a4-4877-ad1c-18160a1b3b6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6825","nonce":1970094291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6827","nonce":1970094291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6831","nonce":1970094291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6829","nonce":1970094291}]},"public_addr":"172.21.15.175:6825/1970094291","cluster_addr":"172.21.15.175:6827/1970094291","heartbeat_back_addr":"172.21.15.175:6831/1970094291","heartbeat_front_addr":"172.21.15.175:6829/1970094291","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:20:43.732676+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:08.957775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:34.157788+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:00.134410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:25.502998+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:51.739501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:18.325642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:44.430626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:10.776017+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:36.482831+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:01.898216+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:27.644941+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/1652196301":"2024-09-22T06:19:37.776447+0000","172.21.15.63:6801/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/2740830999":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6801/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6801/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/2958589237":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/1398493582":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/3529491525":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/363262068":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6800/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/3928056461":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/128321401":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/39222803":"2024-09-22T06:19:37.776447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:28:13.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.440+0000 7ff9d9dba640 1 -- 172.21.15.63:0/909022816 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff9c00b6560 msgr2=0x7ff9c00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:13.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.440+0000 7ff9d9dba640 1 --2- 172.21.15.63:0/909022816 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff9c00b6560 0x7ff9c00b8a70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4031440 tx=0x7ff9c4009560 comp rx=0 tx=0).stop 2024-09-21T06:28:13.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.440+0000 7ff9d9dba640 1 -- 172.21.15.63:0/909022816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9d4108c00 msgr2=0x7ff9d419fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:13.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.440+0000 7ff9d9dba640 1 --2- 172.21.15.63:0/909022816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9d4108c00 0x7ff9d419fc20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00eb10 tx=0x7ff9cc00c2d0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.440+0000 7ff9d9dba640 1 -- 172.21.15.63:0/909022816 shutdown_connections 2024-09-21T06:28:13.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.441+0000 7ff9d9dba640 1 --2- 172.21.15.63:0/909022816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9d4108c00 0x7ff9d419fc20 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.441+0000 7ff9d9dba640 1 --2- 172.21.15.63:0/909022816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9d41082b0 0x7ff9d419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.441+0000 7ff9d9dba640 1 --2- 172.21.15.63:0/909022816 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff9c00b6560 0x7ff9c00b8a70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.441+0000 7ff9d9dba640 1 --2- 172.21.15.63:0/909022816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9d4102980 0x7ff9d419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.441+0000 7ff9d9dba640 1 -- 172.21.15.63:0/909022816 >> 172.21.15.63:0/909022816 conn(0x7ff9d40fe380 msgr2=0x7ff9d406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:13.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.441+0000 7ff9d9dba640 1 -- 172.21.15.63:0/909022816 shutdown_connections 2024-09-21T06:28:13.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.441+0000 7ff9d9dba640 1 -- 172.21.15.63:0/909022816 wait complete. 2024-09-21T06:28:13.455 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:21:36.236868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T06:26:15.016085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T06:26:17.072883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:28:13.456 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:28:13.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:13 smithi071 ceph-mon[34844]: pgmap v322: 97 pgs: 97 active+clean; 649 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T06:28:13.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:13 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3173610209' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T06:28:13.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.571+0000 7efec9189640 1 -- 172.21.15.63:0/4039365928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efec4104910 msgr2=0x7efec4104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:13.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.571+0000 7efec9189640 1 --2- 172.21.15.63:0/4039365928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efec4104910 0x7efec4104d20 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009900 tx=0x7efeb402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:13.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.571+0000 7efec9189640 1 -- 172.21.15.63:0/4039365928 shutdown_connections 2024-09-21T06:28:13.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.571+0000 7efec9189640 1 --2- 172.21.15.63:0/4039365928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efec410dd70 0x7efec4110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.571+0000 7efec9189640 1 --2- 172.21.15.63:0/4039365928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efec4105260 0x7efec410d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.571+0000 7efec9189640 1 --2- 172.21.15.63:0/4039365928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efec4104910 0x7efec4104d20 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.571+0000 7efec9189640 1 -- 172.21.15.63:0/4039365928 >> 172.21.15.63:0/4039365928 conn(0x7efec40fe400 msgr2=0x7efec4100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:13.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.571+0000 7efec9189640 1 -- 172.21.15.63:0/4039365928 shutdown_connections 2024-09-21T06:28:13.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.571+0000 7efec9189640 1 -- 172.21.15.63:0/4039365928 wait complete. 2024-09-21T06:28:13.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.572+0000 7efec9189640 1 Processor -- start 2024-09-21T06:28:13.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.572+0000 7efec9189640 1 -- start start 2024-09-21T06:28:13.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.572+0000 7efec9189640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efec4104910 0x7efec419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:13.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.572+0000 7efec9189640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efec4105260 0x7efec419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:13.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.572+0000 7efec9189640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efec410dd70 0x7efec419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:13.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.572+0000 7efec9189640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7efec41139f0 con 0x7efec4105260 2024-09-21T06:28:13.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.572+0000 7efec9189640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efec4113870 con 0x7efec410dd70 2024-09-21T06:28:13.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.572+0000 7efec9189640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efec4113b70 con 0x7efec4104910 2024-09-21T06:28:13.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.572+0000 7efec259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efec4105260 0x7efec419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:13.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.572+0000 7efec259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efec4105260 0x7efec419a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44520/0 (socket says 172.21.15.63:44520) 2024-09-21T06:28:13.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.572+0000 7efec259c640 1 -- 172.21.15.63:0/3936611216 learned_addr learned my addr 172.21.15.63:0/3936611216 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:13.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.572+0000 7efec359e640 1 --2- 172.21.15.63:0/3936611216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efec410dd70 0x7efec419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:13.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.572+0000 7efec2d9d640 1 --2- 172.21.15.63:0/3936611216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efec4104910 0x7efec419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:13.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.573+0000 7efec259c640 1 -- 172.21.15.63:0/3936611216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efec4104910 msgr2=0x7efec419a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:13.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.573+0000 7efec259c640 1 --2- 172.21.15.63:0/3936611216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efec4104910 0x7efec419a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.573+0000 7efec259c640 1 -- 172.21.15.63:0/3936611216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efec410dd70 msgr2=0x7efec419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:13.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.573+0000 7efec259c640 1 --2- 172.21.15.63:0/3936611216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efec410dd70 0x7efec419fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.573+0000 7efec259c640 1 -- 172.21.15.63:0/3936611216 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec41a0340 con 0x7efec4105260 2024-09-21T06:28:13.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.573+0000 7efec259c640 1 --2- 172.21.15.63:0/3936611216 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efec4105260 0x7efec419a9b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7efeb800e9c0 tx=0x7efeb800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:13.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.573+0000 7efeabfff640 1 -- 172.21.15.63:0/3936611216 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb800ccc0 con 0x7efec4105260 2024-09-21T06:28:13.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.573+0000 7efec9189640 1 -- 172.21.15.63:0/3936611216 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec41a0630 con 0x7efec4105260 2024-09-21T06:28:13.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.573+0000 7efec9189640 1 -- 172.21.15.63:0/3936611216 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec41a6dc0 con 0x7efec4105260 2024-09-21T06:28:13.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.573+0000 7efeabfff640 1 -- 172.21.15.63:0/3936611216 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efeb80054d0 con 0x7efec4105260 2024-09-21T06:28:13.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.573+0000 7efeabfff640 1 -- 172.21.15.63:0/3936611216 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb8010430 con 0x7efec4105260 2024-09-21T06:28:13.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.574+0000 7efec9189640 1 -- 172.21.15.63:0/3936611216 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb00052c0 con 0x7efec4105260 2024-09-21T06:28:13.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.576+0000 7efeabfff640 1 -- 172.21.15.63:0/3936611216 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7efeb80046c0 con 0x7efec4105260 2024-09-21T06:28:13.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.577+0000 7efeabfff640 1 --2- 172.21.15.63:0/3936611216 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efeac0b6560 0x7efeac0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:13.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.577+0000 7efec2d9d640 1 --2- 172.21.15.63:0/3936611216 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efeac0b6560 0x7efeac0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:13.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.577+0000 7efeabfff640 1 -- 172.21.15.63:0/3936611216 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7efeb80e7810 con 0x7efec4105260 2024-09-21T06:28:13.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.577+0000 7efec2d9d640 1 --2- 172.21.15.63:0/3936611216 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efeac0b6560 0x7efeac0b8a70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efeb4031440 tx=0x7efeb4009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:13.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.580+0000 7efeabfff640 1 -- 172.21.15.63:0/3936611216 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efeb8056710 con 0x7efec4105260 2024-09-21T06:28:13.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.769+0000 7efec9189640 1 -- 172.21.15.63:0/3936611216 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efeb0005880 con 0x7efec4105260 2024-09-21T06:28:13.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.769+0000 7efeabfff640 1 -- 172.21.15.63:0/3936611216 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7efeb80adfc0 con 0x7efec4105260 2024-09-21T06:28:13.771 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-09-21T06:28:13.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.772+0000 7efec9189640 1 -- 172.21.15.63:0/3936611216 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efeac0b6560 msgr2=0x7efeac0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:13.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.772+0000 7efec9189640 1 --2- 172.21.15.63:0/3936611216 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efeac0b6560 0x7efeac0b8a70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efeb4031440 tx=0x7efeb4009560 comp rx=0 tx=0).stop 2024-09-21T06:28:13.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.772+0000 7efec9189640 1 -- 172.21.15.63:0/3936611216 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efec4105260 msgr2=0x7efec419a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:13.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.772+0000 7efec9189640 1 --2- 172.21.15.63:0/3936611216 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efec4105260 0x7efec419a9b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7efeb800e9c0 tx=0x7efeb800ee80 comp rx=0 tx=0).stop 2024-09-21T06:28:13.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.772+0000 7efec9189640 1 -- 172.21.15.63:0/3936611216 shutdown_connections 2024-09-21T06:28:13.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.772+0000 7efec9189640 1 --2- 172.21.15.63:0/3936611216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efec410dd70 0x7efec419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.772+0000 7efec9189640 1 --2- 172.21.15.63:0/3936611216 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efec4105260 0x7efec419a9b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.772+0000 7efec9189640 1 --2- 172.21.15.63:0/3936611216 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efeac0b6560 0x7efeac0b8a70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.772+0000 7efec9189640 1 --2- 172.21.15.63:0/3936611216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efec4104910 0x7efec419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.772+0000 7efec9189640 1 -- 172.21.15.63:0/3936611216 >> 172.21.15.63:0/3936611216 conn(0x7efec40fe400 msgr2=0x7efec4107880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:13.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.772+0000 7efec9189640 1 -- 172.21.15.63:0/3936611216 shutdown_connections 2024-09-21T06:28:13.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.772+0000 7efec9189640 1 -- 172.21.15.63:0/3936611216 wait complete. 2024-09-21T06:28:13.785 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T06:28:13.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.900+0000 7fd929c06640 1 -- 172.21.15.63:0/3245056124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9241029c0 msgr2=0x7fd924102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:13.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.900+0000 7fd929c06640 1 --2- 172.21.15.63:0/3245056124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9241029c0 0x7fd924102dd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd914009900 tx=0x7fd91402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:13.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.900+0000 7fd929c06640 1 -- 172.21.15.63:0/3245056124 shutdown_connections 2024-09-21T06:28:13.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.900+0000 7fd929c06640 1 --2- 172.21.15.63:0/3245056124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd924108c40 0x7fd92410f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.900+0000 7fd929c06640 1 --2- 172.21.15.63:0/3245056124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9241082f0 0x7fd924108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.900+0000 7fd929c06640 1 --2- 172.21.15.63:0/3245056124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9241029c0 0x7fd924102dd0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.900+0000 7fd929c06640 1 -- 172.21.15.63:0/3245056124 >> 172.21.15.63:0/3245056124 conn(0x7fd9240fe400 msgr2=0x7fd924100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:13.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.900+0000 7fd929c06640 1 -- 172.21.15.63:0/3245056124 shutdown_connections 2024-09-21T06:28:13.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.900+0000 7fd929c06640 1 -- 172.21.15.63:0/3245056124 wait complete. 2024-09-21T06:28:13.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.901+0000 7fd929c06640 1 Processor -- start 2024-09-21T06:28:13.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.901+0000 7fd929c06640 1 -- start start 2024-09-21T06:28:13.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.901+0000 7fd929c06640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9241029c0 0x7fd92419b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:13.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.901+0000 7fd929c06640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9241082f0 0x7fd92419b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:13.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.901+0000 7fd929c06640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd924108c40 0x7fd92419bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:13.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.901+0000 7fd929c06640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd924112900 con 0x7fd9241082f0 2024-09-21T06:28:13.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.901+0000 7fd929c06640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd924112780 con 0x7fd9241029c0 2024-09-21T06:28:13.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.901+0000 7fd929c06640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd924112a80 con 0x7fd924108c40 2024-09-21T06:28:13.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.901+0000 7fd91affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9241082f0 0x7fd92419b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:13.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.901+0000 7fd91affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9241082f0 0x7fd92419b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44536/0 (socket says 172.21.15.63:44536) 2024-09-21T06:28:13.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.902+0000 7fd91affd640 1 -- 172.21.15.63:0/2228475549 learned_addr learned my addr 172.21.15.63:0/2228475549 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:13.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.902+0000 7fd923fff640 1 --2- 172.21.15.63:0/2228475549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd924108c40 0x7fd92419bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:13.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.902+0000 7fd9237fe640 1 --2- 172.21.15.63:0/2228475549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9241029c0 0x7fd92419b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:13.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.902+0000 7fd91affd640 1 -- 172.21.15.63:0/2228475549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd924108c40 msgr2=0x7fd92419bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:13.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.902+0000 7fd91affd640 1 --2- 172.21.15.63:0/2228475549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd924108c40 0x7fd92419bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.902+0000 7fd91affd640 1 -- 172.21.15.63:0/2228475549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9241029c0 msgr2=0x7fd92419b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:13.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.902+0000 7fd91affd640 1 --2- 172.21.15.63:0/2228475549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9241029c0 0x7fd92419b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.902+0000 7fd91affd640 1 -- 172.21.15.63:0/2228475549 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9241a64c0 con 0x7fd9241082f0 2024-09-21T06:28:13.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.902+0000 7fd9237fe640 1 --2- 172.21.15.63:0/2228475549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9241029c0 0x7fd92419b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:13.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.902+0000 7fd923fff640 1 --2- 172.21.15.63:0/2228475549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd924108c40 0x7fd92419bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:13.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.902+0000 7fd91affd640 1 --2- 172.21.15.63:0/2228475549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9241082f0 0x7fd92419b770 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00c970 tx=0x7fd90c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:13.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.902+0000 7fd9217fa640 1 -- 172.21.15.63:0/2228475549 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c007bb0 con 0x7fd9241082f0 2024-09-21T06:28:13.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.902+0000 7fd9217fa640 1 -- 172.21.15.63:0/2228475549 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd90c007d50 con 0x7fd9241082f0 2024-09-21T06:28:13.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.902+0000 7fd929c06640 1 -- 172.21.15.63:0/2228475549 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9241a67b0 con 0x7fd9241082f0 2024-09-21T06:28:13.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.902+0000 7fd9217fa640 1 -- 172.21.15.63:0/2228475549 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c00f450 con 0x7fd9241082f0 2024-09-21T06:28:13.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.902+0000 7fd929c06640 1 -- 172.21.15.63:0/2228475549 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9241a6d00 con 0x7fd9241082f0 2024-09-21T06:28:13.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.903+0000 7fd929c06640 1 -- 172.21.15.63:0/2228475549 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd924103c30 con 0x7fd9241082f0 2024-09-21T06:28:13.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.905+0000 7fd9217fa640 1 -- 172.21.15.63:0/2228475549 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fd90c004eb0 con 0x7fd9241082f0 2024-09-21T06:28:13.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.907+0000 7fd9217fa640 1 --2- 172.21.15.63:0/2228475549 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd9100b6560 0x7fd9100b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:13.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.907+0000 7fd9237fe640 1 --2- 172.21.15.63:0/2228475549 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd9100b6560 0x7fd9100b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:13.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.907+0000 7fd9217fa640 1 -- 172.21.15.63:0/2228475549 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fd90c0e7640 con 0x7fd9241082f0 2024-09-21T06:28:13.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.907+0000 7fd9237fe640 1 --2- 172.21.15.63:0/2228475549 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd9100b6560 0x7fd9100b8a70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd914000c00 tx=0x7fd914009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:13.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:13.910+0000 7fd9217fa640 1 -- 172.21.15.63:0/2228475549 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd90c014030 con 0x7fd9241082f0 2024-09-21T06:28:14.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.098+0000 7fd929c06640 1 -- 172.21.15.63:0/2228475549 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd92402e640 con 0x7fd9241082f0 2024-09-21T06:28:14.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.098+0000 7fd9217fa640 1 -- 172.21.15.63:0/2228475549 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) ==== 104+0+11 (secure 0 0 0) 0x7fd90c0addf0 con 0x7fd9241082f0 2024-09-21T06:28:14.100 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-09-21T06:28:14.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.101+0000 7fd929c06640 1 -- 172.21.15.63:0/2228475549 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd9100b6560 msgr2=0x7fd9100b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:14.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.101+0000 7fd929c06640 1 --2- 172.21.15.63:0/2228475549 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd9100b6560 0x7fd9100b8a70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd914000c00 tx=0x7fd914009680 comp rx=0 tx=0).stop 2024-09-21T06:28:14.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.101+0000 7fd929c06640 1 -- 172.21.15.63:0/2228475549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9241082f0 msgr2=0x7fd92419b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:14.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.101+0000 7fd929c06640 1 --2- 172.21.15.63:0/2228475549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9241082f0 0x7fd92419b770 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00c970 tx=0x7fd90c00ce30 comp rx=0 tx=0).stop 2024-09-21T06:28:14.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.101+0000 7fd929c06640 1 -- 172.21.15.63:0/2228475549 shutdown_connections 2024-09-21T06:28:14.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.101+0000 7fd929c06640 1 --2- 172.21.15.63:0/2228475549 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd9100b6560 0x7fd9100b8a70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.101+0000 7fd929c06640 1 --2- 172.21.15.63:0/2228475549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd924108c40 0x7fd92419bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.101+0000 7fd929c06640 1 --2- 172.21.15.63:0/2228475549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9241082f0 0x7fd92419b770 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.101+0000 7fd929c06640 1 --2- 172.21.15.63:0/2228475549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9241029c0 0x7fd92419b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.101+0000 7fd929c06640 1 -- 172.21.15.63:0/2228475549 >> 172.21.15.63:0/2228475549 conn(0x7fd9240fe400 msgr2=0x7fd924100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:14.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.101+0000 7fd929c06640 1 -- 172.21.15.63:0/2228475549 shutdown_connections 2024-09-21T06:28:14.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.101+0000 7fd929c06640 1 -- 172.21.15.63:0/2228475549 wait complete. 2024-09-21T06:28:14.114 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T06:28:14.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.229+0000 7fb96acec640 1 -- 172.21.15.63:0/3575562934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9641093e0 msgr2=0x7fb9641097f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:14.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.229+0000 7fb96acec640 1 --2- 172.21.15.63:0/3575562934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9641093e0 0x7fb9641097f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb950009900 tx=0x7fb95002a410 comp rx=0 tx=0).stop 2024-09-21T06:28:14.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.229+0000 7fb96acec640 1 -- 172.21.15.63:0/3575562934 shutdown_connections 2024-09-21T06:28:14.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.229+0000 7fb96acec640 1 --2- 172.21.15.63:0/3575562934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb964109d30 0x7fb964110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.229+0000 7fb96acec640 1 --2- 172.21.15.63:0/3575562934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9641093e0 0x7fb9641097f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.229+0000 7fb96acec640 1 --2- 172.21.15.63:0/3575562934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb964103ab0 0x7fb964103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.229+0000 7fb96acec640 1 -- 172.21.15.63:0/3575562934 >> 172.21.15.63:0/3575562934 conn(0x7fb9640ff4d0 msgr2=0x7fb964101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:14.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.230+0000 7fb96acec640 1 -- 172.21.15.63:0/3575562934 shutdown_connections 2024-09-21T06:28:14.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.230+0000 7fb96acec640 1 -- 172.21.15.63:0/3575562934 wait complete. 2024-09-21T06:28:14.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.230+0000 7fb96acec640 1 Processor -- start 2024-09-21T06:28:14.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.230+0000 7fb96acec640 1 -- start start 2024-09-21T06:28:14.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.230+0000 7fb96acec640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb964103ab0 0x7fb964075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:14.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb96acec640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9641093e0 0x7fb964075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:14.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb96acec640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb964109d30 0x7fb964076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb96acec640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb9641139f0 con 0x7fb9641093e0 2024-09-21T06:28:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb96acec640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb964113870 con 0x7fb964109d30 2024-09-21T06:28:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb96acec640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb964113b70 con 0x7fb964103ab0 2024-09-21T06:28:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb963fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9641093e0 0x7fb964075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb963fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9641093e0 0x7fb964075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44550/0 (socket says 172.21.15.63:44550) 2024-09-21T06:28:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb963fff640 1 -- 172.21.15.63:0/597843236 learned_addr learned my addr 172.21.15.63:0/597843236 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb969289640 1 --2- 172.21.15.63:0/597843236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb964109d30 0x7fb964076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb968a88640 1 --2- 172.21.15.63:0/597843236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb964103ab0 0x7fb964075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb963fff640 1 -- 172.21.15.63:0/597843236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb964103ab0 msgr2=0x7fb964075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb963fff640 1 --2- 172.21.15.63:0/597843236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb964103ab0 0x7fb964075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb963fff640 1 -- 172.21.15.63:0/597843236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb964109d30 msgr2=0x7fb964076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb963fff640 1 --2- 172.21.15.63:0/597843236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb964109d30 0x7fb964076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb963fff640 1 -- 172.21.15.63:0/597843236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9641a8700 con 0x7fb9641093e0 2024-09-21T06:28:14.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb968a88640 1 --2- 172.21.15.63:0/597843236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb964103ab0 0x7fb964075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:14.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb963fff640 1 --2- 172.21.15.63:0/597843236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9641093e0 0x7fb964075c50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb95002a930 tx=0x7fb950004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:14.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb961ffb640 1 -- 172.21.15.63:0/597843236 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95003f030 con 0x7fb9641093e0 2024-09-21T06:28:14.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb961ffb640 1 -- 172.21.15.63:0/597843236 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb950003aa0 con 0x7fb9641093e0 2024-09-21T06:28:14.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb96acec640 1 -- 172.21.15.63:0/597843236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9641a8990 con 0x7fb9641093e0 2024-09-21T06:28:14.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.231+0000 7fb961ffb640 1 -- 172.21.15.63:0/597843236 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb950035070 con 0x7fb9641093e0 2024-09-21T06:28:14.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.232+0000 7fb96acec640 1 -- 172.21.15.63:0/597843236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9641a8e80 con 0x7fb9641093e0 2024-09-21T06:28:14.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.233+0000 7fb96acec640 1 -- 172.21.15.63:0/597843236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb964103ec0 con 0x7fb9641093e0 2024-09-21T06:28:14.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.234+0000 7fb961ffb640 1 -- 172.21.15.63:0/597843236 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fb950042030 con 0x7fb9641093e0 2024-09-21T06:28:14.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.236+0000 7fb961ffb640 1 --2- 172.21.15.63:0/597843236 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb9540b6590 0x7fb9540b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:14.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.236+0000 7fb968a88640 1 --2- 172.21.15.63:0/597843236 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb9540b6590 0x7fb9540b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:14.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.236+0000 7fb961ffb640 1 -- 172.21.15.63:0/597843236 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fb950107f50 con 0x7fb9641093e0 2024-09-21T06:28:14.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.236+0000 7fb968a88640 1 --2- 172.21.15.63:0/597843236 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb9540b6590 0x7fb9540b8aa0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb958005fd0 tx=0x7fb958005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:14.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.239+0000 7fb961ffb640 1 -- 172.21.15.63:0/597843236 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb9500ce700 con 0x7fb9641093e0 2024-09-21T06:28:14.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:14 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3173610209' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T06:28:14.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:14 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:28:14.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:14 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/909022816' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:28:14.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:14 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3936611216' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:28:14.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:14 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3173610209' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T06:28:14.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:14 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:28:14.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:14 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/909022816' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:28:14.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:14 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3936611216' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:28:14.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.428+0000 7fb96acec640 1 -- 172.21.15.63:0/597843236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb96402e640 con 0x7fb9641093e0 2024-09-21T06:28:14.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.428+0000 7fb961ffb640 1 -- 172.21.15.63:0/597843236 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) ==== 100+0+11 (secure 0 0 0) 0x7fb9500d2ae0 con 0x7fb9641093e0 2024-09-21T06:28:14.430 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-09-21T06:28:14.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.430+0000 7fb96acec640 1 -- 172.21.15.63:0/597843236 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb9540b6590 msgr2=0x7fb9540b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:14.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.430+0000 7fb96acec640 1 --2- 172.21.15.63:0/597843236 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb9540b6590 0x7fb9540b8aa0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb958005fd0 tx=0x7fb958005850 comp rx=0 tx=0).stop 2024-09-21T06:28:14.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.430+0000 7fb96acec640 1 -- 172.21.15.63:0/597843236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9641093e0 msgr2=0x7fb964075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:14.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.430+0000 7fb96acec640 1 --2- 172.21.15.63:0/597843236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9641093e0 0x7fb964075c50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb95002a930 tx=0x7fb950004270 comp rx=0 tx=0).stop 2024-09-21T06:28:14.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.430+0000 7fb96acec640 1 -- 172.21.15.63:0/597843236 shutdown_connections 2024-09-21T06:28:14.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.430+0000 7fb96acec640 1 --2- 172.21.15.63:0/597843236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb964109d30 0x7fb964076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.430+0000 7fb96acec640 1 --2- 172.21.15.63:0/597843236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9641093e0 0x7fb964075c50 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.430+0000 7fb96acec640 1 --2- 172.21.15.63:0/597843236 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb9540b6590 0x7fb9540b8aa0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.430+0000 7fb96acec640 1 --2- 172.21.15.63:0/597843236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb964103ab0 0x7fb964075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.430+0000 7fb96acec640 1 -- 172.21.15.63:0/597843236 >> 172.21.15.63:0/597843236 conn(0x7fb9640ff4d0 msgr2=0x7fb9641018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:14.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.430+0000 7fb96acec640 1 -- 172.21.15.63:0/597843236 shutdown_connections 2024-09-21T06:28:14.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:14.430+0000 7fb96acec640 1 -- 172.21.15.63:0/597843236 wait complete. 2024-09-21T06:28:14.444 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-21T06:28:14.444 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:28:14.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:14 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3173610209' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T06:28:14.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:14 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:28:14.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:14 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/909022816' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:28:14.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:14 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3936611216' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:28:14.702 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:15.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:15 smithi063 ceph-mon[31150]: pgmap v323: 97 pgs: 97 active+clean; 649 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-21T06:28:15.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:15 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2228475549' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:28:15.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:15 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/597843236' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:28:15.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.207+0000 7f2c3a48d640 1 -- 172.21.15.63:0/343345124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c34102a60 msgr2=0x7f2c34102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:15.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.207+0000 7f2c3a48d640 1 --2- 172.21.15.63:0/343345124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c34102a60 0x7f2c34102e70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2c24009900 tx=0x7f2c2402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:15.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.207+0000 7f2c3a48d640 1 -- 172.21.15.63:0/343345124 shutdown_connections 2024-09-21T06:28:15.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.207+0000 7f2c3a48d640 1 --2- 172.21.15.63:0/343345124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c34108cf0 0x7f2c3410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.207+0000 7f2c3a48d640 1 --2- 172.21.15.63:0/343345124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c341083a0 0x7f2c341087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.207+0000 7f2c3a48d640 1 --2- 172.21.15.63:0/343345124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c34102a60 0x7f2c34102e70 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.207+0000 7f2c3a48d640 1 -- 172.21.15.63:0/343345124 >> 172.21.15.63:0/343345124 conn(0x7f2c34079730 msgr2=0x7f2c34079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:15.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.207+0000 7f2c3a48d640 1 -- 172.21.15.63:0/343345124 shutdown_connections 2024-09-21T06:28:15.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.207+0000 7f2c3a48d640 1 -- 172.21.15.63:0/343345124 wait complete. 2024-09-21T06:28:15.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.208+0000 7f2c3a48d640 1 Processor -- start 2024-09-21T06:28:15.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.208+0000 7f2c3a48d640 1 -- start start 2024-09-21T06:28:15.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.209+0000 7f2c3a48d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c34102a60 0x7f2c3419c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:15.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.209+0000 7f2c3a48d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c341083a0 0x7f2c3419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:15.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.209+0000 7f2c3a48d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c34108cf0 0x7f2c341a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:15.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.209+0000 7f2c3a48d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2c34112960 con 0x7f2c341083a0 2024-09-21T06:28:15.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.209+0000 7f2c3a48d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2c341127e0 con 0x7f2c34108cf0 2024-09-21T06:28:15.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.209+0000 7f2c3a48d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2c34112ae0 con 0x7f2c34102a60 2024-09-21T06:28:15.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.209+0000 7f2c337fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c341083a0 0x7f2c3419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:15.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.209+0000 7f2c337fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c341083a0 0x7f2c3419cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44570/0 (socket says 172.21.15.63:44570) 2024-09-21T06:28:15.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.209+0000 7f2c337fe640 1 -- 172.21.15.63:0/1060010637 learned_addr learned my addr 172.21.15.63:0/1060010637 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:15.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.209+0000 7f2c33fff640 1 --2- 172.21.15.63:0/1060010637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c34102a60 0x7f2c3419c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:15.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.209+0000 7f2c38a2a640 1 --2- 172.21.15.63:0/1060010637 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c34108cf0 0x7f2c341a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:15.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.209+0000 7f2c337fe640 1 -- 172.21.15.63:0/1060010637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c34102a60 msgr2=0x7f2c3419c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:15.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.209+0000 7f2c337fe640 1 --2- 172.21.15.63:0/1060010637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c34102a60 0x7f2c3419c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.209+0000 7f2c337fe640 1 -- 172.21.15.63:0/1060010637 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c34108cf0 msgr2=0x7f2c341a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:15.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.209+0000 7f2c337fe640 1 --2- 172.21.15.63:0/1060010637 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c34108cf0 0x7f2c341a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.209+0000 7f2c337fe640 1 -- 172.21.15.63:0/1060010637 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c341a2630 con 0x7f2c341083a0 2024-09-21T06:28:15.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.209+0000 7f2c337fe640 1 --2- 172.21.15.63:0/1060010637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c341083a0 0x7f2c3419cc60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2c28005fd0 tx=0x7f2c2800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:15.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.210+0000 7f2c317fa640 1 -- 172.21.15.63:0/1060010637 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28017070 con 0x7f2c341083a0 2024-09-21T06:28:15.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.210+0000 7f2c317fa640 1 -- 172.21.15.63:0/1060010637 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c28009c30 con 0x7f2c341083a0 2024-09-21T06:28:15.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.210+0000 7f2c3a48d640 1 -- 172.21.15.63:0/1060010637 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c341a2920 con 0x7f2c341083a0 2024-09-21T06:28:15.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.210+0000 7f2c317fa640 1 -- 172.21.15.63:0/1060010637 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28003d30 con 0x7f2c341083a0 2024-09-21T06:28:15.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.210+0000 7f2c3a48d640 1 -- 172.21.15.63:0/1060010637 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c341a9080 con 0x7f2c341083a0 2024-09-21T06:28:15.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.211+0000 7f2c3a48d640 1 -- 172.21.15.63:0/1060010637 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c34102e70 con 0x7f2c341083a0 2024-09-21T06:28:15.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.213+0000 7f2c317fa640 1 -- 172.21.15.63:0/1060010637 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f2c28003ed0 con 0x7f2c341083a0 2024-09-21T06:28:15.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.213+0000 7f2c317fa640 1 --2- 172.21.15.63:0/1060010637 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2c1c0b6560 0x7f2c1c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:15.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.214+0000 7f2c33fff640 1 --2- 172.21.15.63:0/1060010637 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2c1c0b6560 0x7f2c1c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:15.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.214+0000 7f2c317fa640 1 -- 172.21.15.63:0/1060010637 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f2c280e78b0 con 0x7f2c341083a0 2024-09-21T06:28:15.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.214+0000 7f2c33fff640 1 --2- 172.21.15.63:0/1060010637 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2c1c0b6560 0x7f2c1c0b8a70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2c24031440 tx=0x7f2c24009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:15.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.217+0000 7f2c317fa640 1 -- 172.21.15.63:0/1060010637 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2c28020030 con 0x7f2c341083a0 2024-09-21T06:28:15.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:15 smithi175 ceph-mon[34510]: pgmap v323: 97 pgs: 97 active+clean; 649 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-21T06:28:15.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:15 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2228475549' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:28:15.351 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:15 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/597843236' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:28:15.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.442+0000 7f2c3a48d640 1 -- 172.21.15.63:0/1060010637 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c341a92e0 con 0x7f2c341083a0 2024-09-21T06:28:15.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.443+0000 7f2c317fa640 1 -- 172.21.15.63:0/1060010637 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11969 (secure 0 0 0) 0x7f2c28009de0 con 0x7f2c341083a0 2024-09-21T06:28:15.445 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:28:15.445 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"btime":"2024-09-21T06:28:13:055252+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:28:12.568978+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24698,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24698":{"gid":24698,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3472481253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3472481253},{"type":"v1","addr":"172.21.15.71:6839","nonce":3472481253}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24698,"qdb_cluster":[24698,24694,24670,24676,14835]},"id":1}]} 2024-09-21T06:28:15.445 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 29 2024-09-21T06:28:15.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.445+0000 7f2c3a48d640 1 -- 172.21.15.63:0/1060010637 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2c1c0b6560 msgr2=0x7f2c1c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:15.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.445+0000 7f2c3a48d640 1 --2- 172.21.15.63:0/1060010637 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2c1c0b6560 0x7f2c1c0b8a70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2c24031440 tx=0x7f2c24009560 comp rx=0 tx=0).stop 2024-09-21T06:28:15.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.445+0000 7f2c3a48d640 1 -- 172.21.15.63:0/1060010637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c341083a0 msgr2=0x7f2c3419cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:15.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.445+0000 7f2c3a48d640 1 --2- 172.21.15.63:0/1060010637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c341083a0 0x7f2c3419cc60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2c28005fd0 tx=0x7f2c2800dde0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.445+0000 7f2c3a48d640 1 -- 172.21.15.63:0/1060010637 shutdown_connections 2024-09-21T06:28:15.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.445+0000 7f2c3a48d640 1 --2- 172.21.15.63:0/1060010637 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c34108cf0 0x7f2c341a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.445+0000 7f2c3a48d640 1 --2- 172.21.15.63:0/1060010637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c341083a0 0x7f2c3419cc60 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.445+0000 7f2c3a48d640 1 --2- 172.21.15.63:0/1060010637 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2c1c0b6560 0x7f2c1c0b8a70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.445+0000 7f2c3a48d640 1 --2- 172.21.15.63:0/1060010637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c34102a60 0x7f2c3419c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.445+0000 7f2c3a48d640 1 -- 172.21.15.63:0/1060010637 >> 172.21.15.63:0/1060010637 conn(0x7f2c34079730 msgr2=0x7f2c3406ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:15.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.445+0000 7f2c3a48d640 1 -- 172.21.15.63:0/1060010637 shutdown_connections 2024-09-21T06:28:15.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:15.445+0000 7f2c3a48d640 1 -- 172.21.15.63:0/1060010637 wait complete. 2024-09-21T06:28:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:15 smithi071 ceph-mon[34844]: pgmap v323: 97 pgs: 97 active+clean; 649 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-21T06:28:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:15 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2228475549' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:28:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:15 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/597843236' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:28:16.120 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:16 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1060010637' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:16.149 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-21T06:28:16.149 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-21T06:28:16.150 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:28:16.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.265+0000 7fa2a767e640 1 -- 172.21.15.63:0/241968267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2a01082b0 msgr2=0x7fa2a01086c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:16.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.265+0000 7fa2a767e640 1 --2- 172.21.15.63:0/241968267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2a01082b0 0x7fa2a01086c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa290009900 tx=0x7fa29002a410 comp rx=0 tx=0).stop 2024-09-21T06:28:16.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.265+0000 7fa2a767e640 1 -- 172.21.15.63:0/241968267 shutdown_connections 2024-09-21T06:28:16.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.265+0000 7fa2a767e640 1 --2- 172.21.15.63:0/241968267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2a0108c00 0x7fa2a010f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.265+0000 7fa2a767e640 1 --2- 172.21.15.63:0/241968267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2a01082b0 0x7fa2a01086c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.265+0000 7fa2a767e640 1 --2- 172.21.15.63:0/241968267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a0102980 0x7fa2a0102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.265+0000 7fa2a767e640 1 -- 172.21.15.63:0/241968267 >> 172.21.15.63:0/241968267 conn(0x7fa2a00fe380 msgr2=0x7fa2a01007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:16.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.265+0000 7fa2a767e640 1 -- 172.21.15.63:0/241968267 shutdown_connections 2024-09-21T06:28:16.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.265+0000 7fa2a767e640 1 -- 172.21.15.63:0/241968267 wait complete. 2024-09-21T06:28:16.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.266+0000 7fa2a767e640 1 Processor -- start 2024-09-21T06:28:16.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.266+0000 7fa2a767e640 1 -- start start 2024-09-21T06:28:16.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.266+0000 7fa2a767e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2a0102980 0x7fa2a0199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:16.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.266+0000 7fa2a767e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2a01082b0 0x7fa2a01998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:16.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.266+0000 7fa2a767e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a0108c00 0x7fa2a019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:16.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.266+0000 7fa2a767e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a01128c0 con 0x7fa2a0102980 2024-09-21T06:28:16.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.266+0000 7fa2a767e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a0112740 con 0x7fa2a01082b0 2024-09-21T06:28:16.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.266+0000 7fa2a767e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a0112a40 con 0x7fa2a0108c00 2024-09-21T06:28:16.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.266+0000 7fa2a541a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2a0102980 0x7fa2a0199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:16.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.266+0000 7fa2a541a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2a0102980 0x7fa2a0199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44592/0 (socket says 172.21.15.63:44592) 2024-09-21T06:28:16.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.266+0000 7fa2a541a640 1 -- 172.21.15.63:0/3274138696 learned_addr learned my addr 172.21.15.63:0/3274138696 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:16.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.267+0000 7fa2a5c1b640 1 --2- 172.21.15.63:0/3274138696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a0108c00 0x7fa2a019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:16.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.267+0000 7fa2a4c19640 1 --2- 172.21.15.63:0/3274138696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2a01082b0 0x7fa2a01998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:16.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.267+0000 7fa2a541a640 1 -- 172.21.15.63:0/3274138696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a0108c00 msgr2=0x7fa2a019eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:16.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.267+0000 7fa2a541a640 1 --2- 172.21.15.63:0/3274138696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a0108c00 0x7fa2a019eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.267+0000 7fa2a541a640 1 -- 172.21.15.63:0/3274138696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2a01082b0 msgr2=0x7fa2a01998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:16.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.267+0000 7fa2a541a640 1 --2- 172.21.15.63:0/3274138696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2a01082b0 0x7fa2a01998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.267+0000 7fa2a541a640 1 -- 172.21.15.63:0/3274138696 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a019f1c0 con 0x7fa2a0102980 2024-09-21T06:28:16.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.267+0000 7fa2a5c1b640 1 --2- 172.21.15.63:0/3274138696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a0108c00 0x7fa2a019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:16.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.267+0000 7fa2a541a640 1 --2- 172.21.15.63:0/3274138696 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2a0102980 0x7fa2a0199320 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00d770 tx=0x7fa29c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:16.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.267+0000 7fa2967fc640 1 -- 172.21.15.63:0/3274138696 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c017070 con 0x7fa2a0102980 2024-09-21T06:28:16.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.267+0000 7fa2967fc640 1 -- 172.21.15.63:0/3274138696 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa29c0054d0 con 0x7fa2a0102980 2024-09-21T06:28:16.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.267+0000 7fa2967fc640 1 -- 172.21.15.63:0/3274138696 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c004c30 con 0x7fa2a0102980 2024-09-21T06:28:16.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.267+0000 7fa2a767e640 1 -- 172.21.15.63:0/3274138696 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a019f4b0 con 0x7fa2a0102980 2024-09-21T06:28:16.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.267+0000 7fa2a767e640 1 -- 172.21.15.63:0/3274138696 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a01a5cd0 con 0x7fa2a0102980 2024-09-21T06:28:16.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.268+0000 7fa2a767e640 1 -- 172.21.15.63:0/3274138696 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a0102d90 con 0x7fa2a0102980 2024-09-21T06:28:16.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.270+0000 7fa2967fc640 1 -- 172.21.15.63:0/3274138696 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fa29c004e10 con 0x7fa2a0102980 2024-09-21T06:28:16.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.270+0000 7fa2967fc640 1 --2- 172.21.15.63:0/3274138696 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa28c0b65e0 0x7fa28c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:16.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.271+0000 7fa2a4c19640 1 --2- 172.21.15.63:0/3274138696 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa28c0b65e0 0x7fa28c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:16.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.271+0000 7fa2967fc640 1 -- 172.21.15.63:0/3274138696 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fa29c0e6fa0 con 0x7fa2a0102980 2024-09-21T06:28:16.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.271+0000 7fa2a4c19640 1 --2- 172.21.15.63:0/3274138696 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa28c0b65e0 0x7fa28c0b8af0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa290006010 tx=0x7fa290000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:16.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.275+0000 7fa2967fc640 1 -- 172.21.15.63:0/3274138696 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa29c0ad750 con 0x7fa2a0102980 2024-09-21T06:28:16.355 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:16 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1060010637' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:16.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.465+0000 7fa2a767e640 1 -- 172.21.15.63:0/3274138696 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa2a0063800 con 0x7fa28c0b65e0 2024-09-21T06:28:16.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.469+0000 7fa2967fc640 1 -- 172.21.15.63:0/3274138696 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259272 (secure 0 0 0) 0x7fa2a0063800 con 0x7fa28c0b65e0 2024-09-21T06:28:16.475 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:28:16.476 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T06:28:16.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.472+0000 7fa2a767e640 1 -- 172.21.15.63:0/3274138696 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa28c0b65e0 msgr2=0x7fa28c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:16.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.472+0000 7fa2a767e640 1 --2- 172.21.15.63:0/3274138696 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa28c0b65e0 0x7fa28c0b8af0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa290006010 tx=0x7fa290000bc0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.472+0000 7fa2a767e640 1 -- 172.21.15.63:0/3274138696 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2a0102980 msgr2=0x7fa2a0199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:16.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.472+0000 7fa2a767e640 1 --2- 172.21.15.63:0/3274138696 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2a0102980 0x7fa2a0199320 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00d770 tx=0x7fa29c00dc30 comp rx=0 tx=0).stop 2024-09-21T06:28:16.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.472+0000 7fa2a767e640 1 -- 172.21.15.63:0/3274138696 shutdown_connections 2024-09-21T06:28:16.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.472+0000 7fa2a767e640 1 --2- 172.21.15.63:0/3274138696 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa28c0b65e0 0x7fa28c0b8af0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.472+0000 7fa2a767e640 1 --2- 172.21.15.63:0/3274138696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a0108c00 0x7fa2a019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.472+0000 7fa2a767e640 1 --2- 172.21.15.63:0/3274138696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2a01082b0 0x7fa2a01998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.472+0000 7fa2a767e640 1 --2- 172.21.15.63:0/3274138696 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2a0102980 0x7fa2a0199320 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.472+0000 7fa2a767e640 1 -- 172.21.15.63:0/3274138696 >> 172.21.15.63:0/3274138696 conn(0x7fa2a00fe380 msgr2=0x7fa2a01058f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:16.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.473+0000 7fa2a767e640 1 -- 172.21.15.63:0/3274138696 shutdown_connections 2024-09-21T06:28:16.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.473+0000 7fa2a767e640 1 -- 172.21.15.63:0/3274138696 wait complete. 2024-09-21T06:28:16.486 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-09-21T06:28:15.896931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665401,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1164,"num_read_kb":696,"num_write":387,"num_write_kb":2308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":2953441,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":818,"ondisk_log_size":818,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380572,"kb_used_data":10524,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561252,"statfs":{"total":1151940427776,"available":1151550722048,"internally_reserved":0,"allocated":10776576,"data_stored":7017075,"data_compressed":183549,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1147,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":75,"num_write":16,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003565"},"pg_stats":[{"pgid":"3.3f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.282041+0000","last_change":"2024-09-21T06:26:18.307729+0000","last_active":"2024-09-21T06:28:08.282041+0000","last_peered":"2024-09-21T06:28:08.282041+0000","last_clean":"2024-09-21T06:28:08.282041+0000","last_became_active":"2024-09-21T06:26:18.306345+0000","last_became_peered":"2024-09-21T06:26:18.306345+0000","last_unstale":"2024-09-21T06:28:08.282041+0000","last_undegraded":"2024-09-21T06:28:08.282041+0000","last_fullsized":"2024-09-21T06:28:08.282041+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:58.409506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.286762+0000","last_change":"2024-09-21T06:26:18.302982+0000","last_active":"2024-09-21T06:28:08.286762+0000","last_peered":"2024-09-21T06:28:08.286762+0000","last_clean":"2024-09-21T06:28:08.286762+0000","last_became_active":"2024-09-21T06:26:18.302636+0000","last_became_peered":"2024-09-21T06:26:18.302636+0000","last_unstale":"2024-09-21T06:28:08.286762+0000","last_undegraded":"2024-09-21T06:28:08.286762+0000","last_fullsized":"2024-09-21T06:28:08.286762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:28.165964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.285733+0000","last_change":"2024-09-21T06:26:18.305293+0000","last_active":"2024-09-21T06:28:08.285733+0000","last_peered":"2024-09-21T06:28:08.285733+0000","last_clean":"2024-09-21T06:28:08.285733+0000","last_became_active":"2024-09-21T06:26:18.304689+0000","last_became_peered":"2024-09-21T06:26:18.304689+0000","last_unstale":"2024-09-21T06:28:08.285733+0000","last_undegraded":"2024-09-21T06:28:08.285733+0000","last_fullsized":"2024-09-21T06:28:08.285733+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:37.442558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.290851+0000","last_change":"2024-09-21T06:26:18.306443+0000","last_active":"2024-09-21T06:28:08.290851+0000","last_peered":"2024-09-21T06:28:08.290851+0000","last_clean":"2024-09-21T06:28:08.290851+0000","last_became_active":"2024-09-21T06:26:18.305062+0000","last_became_peered":"2024-09-21T06:26:18.305062+0000","last_unstale":"2024-09-21T06:28:08.290851+0000","last_undegraded":"2024-09-21T06:28:08.290851+0000","last_fullsized":"2024-09-21T06:28:08.290851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:07.896971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.257044+0000","last_change":"2024-09-21T06:26:18.298857+0000","last_active":"2024-09-21T06:28:08.257044+0000","last_peered":"2024-09-21T06:28:08.257044+0000","last_clean":"2024-09-21T06:28:08.257044+0000","last_became_active":"2024-09-21T06:26:18.298439+0000","last_became_peered":"2024-09-21T06:26:18.298439+0000","last_unstale":"2024-09-21T06:28:08.257044+0000","last_undegraded":"2024-09-21T06:28:08.257044+0000","last_fullsized":"2024-09-21T06:28:08.257044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:24.695856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.282750+0000","last_change":"2024-09-21T06:26:18.313029+0000","last_active":"2024-09-21T06:28:08.282750+0000","last_peered":"2024-09-21T06:28:08.282750+0000","last_clean":"2024-09-21T06:28:08.282750+0000","last_became_active":"2024-09-21T06:26:18.312627+0000","last_became_peered":"2024-09-21T06:26:18.312627+0000","last_unstale":"2024-09-21T06:28:08.282750+0000","last_undegraded":"2024-09-21T06:28:08.282750+0000","last_fullsized":"2024-09-21T06:28:08.282750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:23.086862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.275181+0000","last_change":"2024-09-21T06:26:18.299082+0000","last_active":"2024-09-21T06:28:08.275181+0000","last_peered":"2024-09-21T06:28:08.275181+0000","last_clean":"2024-09-21T06:28:08.275181+0000","last_became_active":"2024-09-21T06:26:18.298279+0000","last_became_peered":"2024-09-21T06:26:18.298279+0000","last_unstale":"2024-09-21T06:28:08.275181+0000","last_undegraded":"2024-09-21T06:28:08.275181+0000","last_fullsized":"2024-09-21T06:28:08.275181+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:05.652407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.277890+0000","last_change":"2024-09-21T06:26:18.298565+0000","last_active":"2024-09-21T06:28:08.277890+0000","last_peered":"2024-09-21T06:28:08.277890+0000","last_clean":"2024-09-21T06:28:08.277890+0000","last_became_active":"2024-09-21T06:26:18.298172+0000","last_became_peered":"2024-09-21T06:26:18.298172+0000","last_unstale":"2024-09-21T06:28:08.277890+0000","last_undegraded":"2024-09-21T06:28:08.277890+0000","last_fullsized":"2024-09-21T06:28:08.277890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:33.045038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289221+0000","last_change":"2024-09-21T06:26:18.304901+0000","last_active":"2024-09-21T06:28:08.289221+0000","last_peered":"2024-09-21T06:28:08.289221+0000","last_clean":"2024-09-21T06:28:08.289221+0000","last_became_active":"2024-09-21T06:26:18.304521+0000","last_became_peered":"2024-09-21T06:26:18.304521+0000","last_unstale":"2024-09-21T06:28:08.289221+0000","last_undegraded":"2024-09-21T06:28:08.289221+0000","last_fullsized":"2024-09-21T06:28:08.289221+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:31.859554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"77'16","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.273540+0000","last_change":"2024-09-21T06:26:38.970119+0000","last_active":"2024-09-21T06:28:08.273540+0000","last_peered":"2024-09-21T06:28:08.273540+0000","last_clean":"2024-09-21T06:28:08.273540+0000","last_became_active":"2024-09-21T06:26:38.969521+0000","last_became_peered":"2024-09-21T06:26:38.969521+0000","last_unstale":"2024-09-21T06:28:08.273540+0000","last_undegraded":"2024-09-21T06:28:08.273540+0000","last_fullsized":"2024-09-21T06:28:08.273540+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:54.407153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289151+0000","last_change":"2024-09-21T06:26:18.300178+0000","last_active":"2024-09-21T06:28:08.289151+0000","last_peered":"2024-09-21T06:28:08.289151+0000","last_clean":"2024-09-21T06:28:08.289151+0000","last_became_active":"2024-09-21T06:26:18.298651+0000","last_became_peered":"2024-09-21T06:26:18.298651+0000","last_unstale":"2024-09-21T06:28:08.289151+0000","last_undegraded":"2024-09-21T06:28:08.289151+0000","last_fullsized":"2024-09-21T06:28:08.289151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:07.261974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.290634+0000","last_change":"2024-09-21T06:26:18.311310+0000","last_active":"2024-09-21T06:28:08.290634+0000","last_peered":"2024-09-21T06:28:08.290634+0000","last_clean":"2024-09-21T06:28:08.290634+0000","last_became_active":"2024-09-21T06:26:18.310671+0000","last_became_peered":"2024-09-21T06:26:18.310671+0000","last_unstale":"2024-09-21T06:28:08.290634+0000","last_undegraded":"2024-09-21T06:28:08.290634+0000","last_fullsized":"2024-09-21T06:28:08.290634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:52.060682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.278346+0000","last_change":"2024-09-21T06:26:18.296958+0000","last_active":"2024-09-21T06:28:08.278346+0000","last_peered":"2024-09-21T06:28:08.278346+0000","last_clean":"2024-09-21T06:28:08.278346+0000","last_became_active":"2024-09-21T06:26:18.296081+0000","last_became_peered":"2024-09-21T06:26:18.296081+0000","last_unstale":"2024-09-21T06:28:08.278346+0000","last_undegraded":"2024-09-21T06:28:08.278346+0000","last_fullsized":"2024-09-21T06:28:08.278346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:28.501906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.287036+0000","last_change":"2024-09-21T06:26:18.301289+0000","last_active":"2024-09-21T06:28:08.287036+0000","last_peered":"2024-09-21T06:28:08.287036+0000","last_clean":"2024-09-21T06:28:08.287036+0000","last_became_active":"2024-09-21T06:26:18.300834+0000","last_became_peered":"2024-09-21T06:26:18.300834+0000","last_unstale":"2024-09-21T06:28:08.287036+0000","last_undegraded":"2024-09-21T06:28:08.287036+0000","last_fullsized":"2024-09-21T06:28:08.287036+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:31.206650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.281800+0000","last_change":"2024-09-21T06:26:18.312436+0000","last_active":"2024-09-21T06:28:08.281800+0000","last_peered":"2024-09-21T06:28:08.281800+0000","last_clean":"2024-09-21T06:28:08.281800+0000","last_became_active":"2024-09-21T06:26:18.311230+0000","last_became_peered":"2024-09-21T06:26:18.311230+0000","last_unstale":"2024-09-21T06:28:08.281800+0000","last_undegraded":"2024-09-21T06:28:08.281800+0000","last_fullsized":"2024-09-21T06:28:08.281800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:07.163105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.288018+0000","last_change":"2024-09-21T06:26:18.307775+0000","last_active":"2024-09-21T06:28:08.288018+0000","last_peered":"2024-09-21T06:28:08.288018+0000","last_clean":"2024-09-21T06:28:08.288018+0000","last_became_active":"2024-09-21T06:26:18.307326+0000","last_became_peered":"2024-09-21T06:26:18.307326+0000","last_unstale":"2024-09-21T06:28:08.288018+0000","last_undegraded":"2024-09-21T06:28:08.288018+0000","last_fullsized":"2024-09-21T06:28:08.288018+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:18.213503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.282030+0000","last_change":"2024-09-21T06:26:18.309004+0000","last_active":"2024-09-21T06:28:08.282030+0000","last_peered":"2024-09-21T06:28:08.282030+0000","last_clean":"2024-09-21T06:28:08.282030+0000","last_became_active":"2024-09-21T06:26:18.306098+0000","last_became_peered":"2024-09-21T06:26:18.306098+0000","last_unstale":"2024-09-21T06:28:08.282030+0000","last_undegraded":"2024-09-21T06:28:08.282030+0000","last_fullsized":"2024-09-21T06:28:08.282030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:09.102610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.278891+0000","last_change":"2024-09-21T06:26:18.306699+0000","last_active":"2024-09-21T06:28:08.278891+0000","last_peered":"2024-09-21T06:28:08.278891+0000","last_clean":"2024-09-21T06:28:08.278891+0000","last_became_active":"2024-09-21T06:26:18.306352+0000","last_became_peered":"2024-09-21T06:26:18.306352+0000","last_unstale":"2024-09-21T06:28:08.278891+0000","last_undegraded":"2024-09-21T06:28:08.278891+0000","last_fullsized":"2024-09-21T06:28:08.278891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:47.992315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.264597+0000","last_change":"2024-09-21T06:26:18.301677+0000","last_active":"2024-09-21T06:28:08.264597+0000","last_peered":"2024-09-21T06:28:08.264597+0000","last_clean":"2024-09-21T06:28:08.264597+0000","last_became_active":"2024-09-21T06:26:18.301260+0000","last_became_peered":"2024-09-21T06:26:18.301260+0000","last_unstale":"2024-09-21T06:28:08.264597+0000","last_undegraded":"2024-09-21T06:28:08.264597+0000","last_fullsized":"2024-09-21T06:28:08.264597+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:53.209062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.288730+0000","last_change":"2024-09-21T06:26:18.312004+0000","last_active":"2024-09-21T06:28:08.288730+0000","last_peered":"2024-09-21T06:28:08.288730+0000","last_clean":"2024-09-21T06:28:08.288730+0000","last_became_active":"2024-09-21T06:26:18.311602+0000","last_became_peered":"2024-09-21T06:26:18.311602+0000","last_unstale":"2024-09-21T06:28:08.288730+0000","last_undegraded":"2024-09-21T06:28:08.288730+0000","last_fullsized":"2024-09-21T06:28:08.288730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:30.074887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.287829+0000","last_change":"2024-09-21T06:26:18.296581+0000","last_active":"2024-09-21T06:28:08.287829+0000","last_peered":"2024-09-21T06:28:08.287829+0000","last_clean":"2024-09-21T06:28:08.287829+0000","last_became_active":"2024-09-21T06:26:18.296078+0000","last_became_peered":"2024-09-21T06:26:18.296078+0000","last_unstale":"2024-09-21T06:28:08.287829+0000","last_undegraded":"2024-09-21T06:28:08.287829+0000","last_fullsized":"2024-09-21T06:28:08.287829+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:39.120626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.288126+0000","last_change":"2024-09-21T06:26:18.307793+0000","last_active":"2024-09-21T06:28:08.288126+0000","last_peered":"2024-09-21T06:28:08.288126+0000","last_clean":"2024-09-21T06:28:08.288126+0000","last_became_active":"2024-09-21T06:26:18.307310+0000","last_became_peered":"2024-09-21T06:26:18.307310+0000","last_unstale":"2024-09-21T06:28:08.288126+0000","last_undegraded":"2024-09-21T06:28:08.288126+0000","last_fullsized":"2024-09-21T06:28:08.288126+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:11.761986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.269182+0000","last_change":"2024-09-21T06:26:18.305700+0000","last_active":"2024-09-21T06:28:08.269182+0000","last_peered":"2024-09-21T06:28:08.269182+0000","last_clean":"2024-09-21T06:28:08.269182+0000","last_became_active":"2024-09-21T06:26:18.305319+0000","last_became_peered":"2024-09-21T06:26:18.305319+0000","last_unstale":"2024-09-21T06:28:08.269182+0000","last_undegraded":"2024-09-21T06:28:08.269182+0000","last_fullsized":"2024-09-21T06:28:08.269182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:52.479565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.273399+0000","last_change":"2024-09-21T06:26:18.304111+0000","last_active":"2024-09-21T06:28:08.273399+0000","last_peered":"2024-09-21T06:28:08.273399+0000","last_clean":"2024-09-21T06:28:08.273399+0000","last_became_active":"2024-09-21T06:26:18.302716+0000","last_became_peered":"2024-09-21T06:26:18.302716+0000","last_unstale":"2024-09-21T06:28:08.273399+0000","last_undegraded":"2024-09-21T06:28:08.273399+0000","last_fullsized":"2024-09-21T06:28:08.273399+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:39.298737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.263420+0000","last_change":"2024-09-21T06:26:18.310154+0000","last_active":"2024-09-21T06:28:08.263420+0000","last_peered":"2024-09-21T06:28:08.263420+0000","last_clean":"2024-09-21T06:28:08.263420+0000","last_became_active":"2024-09-21T06:26:18.309735+0000","last_became_peered":"2024-09-21T06:26:18.309735+0000","last_unstale":"2024-09-21T06:28:08.263420+0000","last_undegraded":"2024-09-21T06:28:08.263420+0000","last_fullsized":"2024-09-21T06:28:08.263420+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:42:37.535841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.273261+0000","last_change":"2024-09-21T06:26:18.312302+0000","last_active":"2024-09-21T06:28:08.273261+0000","last_peered":"2024-09-21T06:28:08.273261+0000","last_clean":"2024-09-21T06:28:08.273261+0000","last_became_active":"2024-09-21T06:26:18.311950+0000","last_became_peered":"2024-09-21T06:26:18.311950+0000","last_unstale":"2024-09-21T06:28:08.273261+0000","last_undegraded":"2024-09-21T06:28:08.273261+0000","last_fullsized":"2024-09-21T06:28:08.273261+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:03.899946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.264724+0000","last_change":"2024-09-21T06:26:18.308291+0000","last_active":"2024-09-21T06:28:08.264724+0000","last_peered":"2024-09-21T06:28:08.264724+0000","last_clean":"2024-09-21T06:28:08.264724+0000","last_became_active":"2024-09-21T06:26:18.307907+0000","last_became_peered":"2024-09-21T06:26:18.307907+0000","last_unstale":"2024-09-21T06:28:08.264724+0000","last_undegraded":"2024-09-21T06:28:08.264724+0000","last_fullsized":"2024-09-21T06:28:08.264724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:17.418996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.278413+0000","last_change":"2024-09-21T06:26:18.311774+0000","last_active":"2024-09-21T06:28:08.278413+0000","last_peered":"2024-09-21T06:28:08.278413+0000","last_clean":"2024-09-21T06:28:08.278413+0000","last_became_active":"2024-09-21T06:26:18.311373+0000","last_became_peered":"2024-09-21T06:26:18.311373+0000","last_unstale":"2024-09-21T06:28:08.278413+0000","last_undegraded":"2024-09-21T06:28:08.278413+0000","last_fullsized":"2024-09-21T06:28:08.278413+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:08.310931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'7","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.278709+0000","last_change":"2024-09-21T06:26:38.977655+0000","last_active":"2024-09-21T06:28:08.278709+0000","last_peered":"2024-09-21T06:28:08.278709+0000","last_clean":"2024-09-21T06:28:08.278709+0000","last_became_active":"2024-09-21T06:26:38.977309+0000","last_became_peered":"2024-09-21T06:26:38.977309+0000","last_unstale":"2024-09-21T06:28:08.278709+0000","last_undegraded":"2024-09-21T06:28:08.278709+0000","last_fullsized":"2024-09-21T06:28:08.278709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:10.083264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.269694+0000","last_change":"2024-09-21T06:26:18.302851+0000","last_active":"2024-09-21T06:28:08.269694+0000","last_peered":"2024-09-21T06:28:08.269694+0000","last_clean":"2024-09-21T06:28:08.269694+0000","last_became_active":"2024-09-21T06:26:18.302120+0000","last_became_peered":"2024-09-21T06:26:18.302120+0000","last_unstale":"2024-09-21T06:28:08.269694+0000","last_undegraded":"2024-09-21T06:28:08.269694+0000","last_fullsized":"2024-09-21T06:28:08.269694+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:18.442711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"77'12","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289384+0000","last_change":"2024-09-21T06:26:18.310447+0000","last_active":"2024-09-21T06:28:08.289384+0000","last_peered":"2024-09-21T06:28:08.289384+0000","last_clean":"2024-09-21T06:28:08.289384+0000","last_became_active":"2024-09-21T06:26:18.310079+0000","last_became_peered":"2024-09-21T06:26:18.310079+0000","last_unstale":"2024-09-21T06:28:08.289384+0000","last_undegraded":"2024-09-21T06:28:08.289384+0000","last_fullsized":"2024-09-21T06:28:08.289384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:14.364382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.273523+0000","last_change":"2024-09-21T06:26:18.307260+0000","last_active":"2024-09-21T06:28:08.273523+0000","last_peered":"2024-09-21T06:28:08.273523+0000","last_clean":"2024-09-21T06:28:08.273523+0000","last_became_active":"2024-09-21T06:26:18.306131+0000","last_became_peered":"2024-09-21T06:26:18.306131+0000","last_unstale":"2024-09-21T06:28:08.273523+0000","last_undegraded":"2024-09-21T06:28:08.273523+0000","last_fullsized":"2024-09-21T06:28:08.273523+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:14.746652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.261790+0000","last_change":"2024-09-21T06:26:18.292714+0000","last_active":"2024-09-21T06:28:08.261790+0000","last_peered":"2024-09-21T06:28:08.261790+0000","last_clean":"2024-09-21T06:28:08.261790+0000","last_became_active":"2024-09-21T06:26:18.292322+0000","last_became_peered":"2024-09-21T06:26:18.292322+0000","last_unstale":"2024-09-21T06:28:08.261790+0000","last_undegraded":"2024-09-21T06:28:08.261790+0000","last_fullsized":"2024-09-21T06:28:08.261790+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:51.017455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":136,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:12.922240+0000","last_change":"2024-09-21T06:26:16.269788+0000","last_active":"2024-09-21T06:28:12.922240+0000","last_peered":"2024-09-21T06:28:12.922240+0000","last_clean":"2024-09-21T06:28:12.922240+0000","last_became_active":"2024-09-21T06:26:16.269342+0000","last_became_peered":"2024-09-21T06:26:16.269342+0000","last_unstale":"2024-09-21T06:28:12.922240+0000","last_undegraded":"2024-09-21T06:28:12.922240+0000","last_fullsized":"2024-09-21T06:28:12.922240+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:34.782237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'8","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.272099+0000","last_change":"2024-09-21T06:26:38.970396+0000","last_active":"2024-09-21T06:28:08.272099+0000","last_peered":"2024-09-21T06:28:08.272099+0000","last_clean":"2024-09-21T06:28:08.272099+0000","last_became_active":"2024-09-21T06:26:38.969976+0000","last_became_peered":"2024-09-21T06:26:38.969976+0000","last_unstale":"2024-09-21T06:28:08.272099+0000","last_undegraded":"2024-09-21T06:28:08.272099+0000","last_fullsized":"2024-09-21T06:28:08.272099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:44.540563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,3],"acting":[9,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964833+0000","last_change":"2024-09-21T06:26:16.272832+0000","last_active":"2024-09-21T06:26:38.964833+0000","last_peered":"2024-09-21T06:26:38.964833+0000","last_clean":"2024-09-21T06:26:38.964833+0000","last_became_active":"2024-09-21T06:26:16.272447+0000","last_became_peered":"2024-09-21T06:26:16.272447+0000","last_unstale":"2024-09-21T06:26:38.964833+0000","last_undegraded":"2024-09-21T06:26:38.964833+0000","last_fullsized":"2024-09-21T06:26:38.964833+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:22.836267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966506+0000","last_change":"2024-09-21T06:26:16.269067+0000","last_active":"2024-09-21T06:26:38.966506+0000","last_peered":"2024-09-21T06:26:38.966506+0000","last_clean":"2024-09-21T06:26:38.966506+0000","last_became_active":"2024-09-21T06:26:16.268524+0000","last_became_peered":"2024-09-21T06:26:16.268524+0000","last_unstale":"2024-09-21T06:26:38.966506+0000","last_undegraded":"2024-09-21T06:26:38.966506+0000","last_fullsized":"2024-09-21T06:26:38.966506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:32.224321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.266305+0000","last_change":"2024-09-21T06:26:18.306489+0000","last_active":"2024-09-21T06:28:08.266305+0000","last_peered":"2024-09-21T06:28:08.266305+0000","last_clean":"2024-09-21T06:28:08.266305+0000","last_became_active":"2024-09-21T06:26:18.305883+0000","last_became_peered":"2024-09-21T06:26:18.305883+0000","last_unstale":"2024-09-21T06:28:08.266305+0000","last_undegraded":"2024-09-21T06:28:08.266305+0000","last_fullsized":"2024-09-21T06:28:08.266305+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:54.012308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971279+0000","last_change":"2024-09-21T06:26:16.269793+0000","last_active":"2024-09-21T06:26:38.971279+0000","last_peered":"2024-09-21T06:26:38.971279+0000","last_clean":"2024-09-21T06:26:38.971279+0000","last_became_active":"2024-09-21T06:26:16.269455+0000","last_became_peered":"2024-09-21T06:26:16.269455+0000","last_unstale":"2024-09-21T06:26:38.971279+0000","last_undegraded":"2024-09-21T06:26:38.971279+0000","last_fullsized":"2024-09-21T06:26:38.971279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:44.369742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.279312+0000","last_change":"2024-09-21T06:26:18.297573+0000","last_active":"2024-09-21T06:28:08.279312+0000","last_peered":"2024-09-21T06:28:08.279312+0000","last_clean":"2024-09-21T06:28:08.279312+0000","last_became_active":"2024-09-21T06:26:18.297190+0000","last_became_peered":"2024-09-21T06:26:18.297190+0000","last_unstale":"2024-09-21T06:28:08.279312+0000","last_undegraded":"2024-09-21T06:28:08.279312+0000","last_fullsized":"2024-09-21T06:28:08.279312+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:28.055520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'5","reported_seq":240,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:13.923171+0000","last_change":"2024-09-21T06:26:16.273604+0000","last_active":"2024-09-21T06:28:13.923171+0000","last_peered":"2024-09-21T06:28:13.923171+0000","last_clean":"2024-09-21T06:28:13.923171+0000","last_became_active":"2024-09-21T06:26:16.273194+0000","last_became_peered":"2024-09-21T06:26:16.273194+0000","last_unstale":"2024-09-21T06:28:13.923171+0000","last_undegraded":"2024-09-21T06:28:13.923171+0000","last_fullsized":"2024-09-21T06:28:13.923171+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:08.218442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":212,"num_read_kb":212,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289113+0000","last_change":"2024-09-21T06:26:18.303960+0000","last_active":"2024-09-21T06:28:08.289113+0000","last_peered":"2024-09-21T06:28:08.289113+0000","last_clean":"2024-09-21T06:28:08.289113+0000","last_became_active":"2024-09-21T06:26:18.303550+0000","last_became_peered":"2024-09-21T06:26:18.303550+0000","last_unstale":"2024-09-21T06:28:08.289113+0000","last_undegraded":"2024-09-21T06:28:08.289113+0000","last_fullsized":"2024-09-21T06:28:08.289113+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:47.331439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.978327+0000","last_change":"2024-09-21T06:26:38.978161+0000","last_active":"2024-09-21T06:26:38.978327+0000","last_peered":"2024-09-21T06:26:38.978327+0000","last_clean":"2024-09-21T06:26:38.978327+0000","last_became_active":"2024-09-21T06:26:38.970818+0000","last_became_peered":"2024-09-21T06:26:38.970818+0000","last_unstale":"2024-09-21T06:26:38.978327+0000","last_undegraded":"2024-09-21T06:26:38.978327+0000","last_fullsized":"2024-09-21T06:26:38.978327+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:55.273463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.282065+0000","last_change":"2024-09-21T06:26:18.311643+0000","last_active":"2024-09-21T06:28:08.282065+0000","last_peered":"2024-09-21T06:28:08.282065+0000","last_clean":"2024-09-21T06:28:08.282065+0000","last_became_active":"2024-09-21T06:26:18.311246+0000","last_became_peered":"2024-09-21T06:26:18.311246+0000","last_unstale":"2024-09-21T06:28:08.282065+0000","last_undegraded":"2024-09-21T06:28:08.282065+0000","last_fullsized":"2024-09-21T06:28:08.282065+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:00.342212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971107+0000","last_change":"2024-09-21T06:26:16.313648+0000","last_active":"2024-09-21T06:26:38.971107+0000","last_peered":"2024-09-21T06:26:38.971107+0000","last_clean":"2024-09-21T06:26:38.971107+0000","last_became_active":"2024-09-21T06:26:16.313337+0000","last_became_peered":"2024-09-21T06:26:16.313337+0000","last_unstale":"2024-09-21T06:26:38.971107+0000","last_undegraded":"2024-09-21T06:26:38.971107+0000","last_fullsized":"2024-09-21T06:26:38.971107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:12.095276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289994+0000","last_change":"2024-09-21T06:26:18.310168+0000","last_active":"2024-09-21T06:28:08.289994+0000","last_peered":"2024-09-21T06:28:08.289994+0000","last_clean":"2024-09-21T06:28:08.289994+0000","last_became_active":"2024-09-21T06:26:18.309756+0000","last_became_peered":"2024-09-21T06:26:18.309756+0000","last_unstale":"2024-09-21T06:28:08.289994+0000","last_undegraded":"2024-09-21T06:28:08.289994+0000","last_fullsized":"2024-09-21T06:28:08.289994+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:07.203202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'36","reported_seq":283,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:13.923134+0000","last_change":"2024-09-21T06:26:16.270243+0000","last_active":"2024-09-21T06:28:13.923134+0000","last_peered":"2024-09-21T06:28:13.923134+0000","last_clean":"2024-09-21T06:28:13.923134+0000","last_became_active":"2024-09-21T06:26:16.269883+0000","last_became_peered":"2024-09-21T06:26:16.269883+0000","last_unstale":"2024-09-21T06:28:13.923134+0000","last_undegraded":"2024-09-21T06:28:13.923134+0000","last_fullsized":"2024-09-21T06:28:13.923134+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:55.906972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67005,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":224,"num_read_kb":177,"num_write":38,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.284918+0000","last_change":"2024-09-21T06:26:18.305508+0000","last_active":"2024-09-21T06:28:08.284918+0000","last_peered":"2024-09-21T06:28:08.284918+0000","last_clean":"2024-09-21T06:28:08.284918+0000","last_became_active":"2024-09-21T06:26:18.305104+0000","last_became_peered":"2024-09-21T06:26:18.305104+0000","last_unstale":"2024-09-21T06:28:08.284918+0000","last_undegraded":"2024-09-21T06:28:08.284918+0000","last_fullsized":"2024-09-21T06:28:08.284918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:14.727084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'9","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.969025+0000","last_change":"2024-09-21T06:26:16.268331+0000","last_active":"2024-09-21T06:26:38.969025+0000","last_peered":"2024-09-21T06:26:38.969025+0000","last_clean":"2024-09-21T06:26:38.969025+0000","last_became_active":"2024-09-21T06:26:16.267918+0000","last_became_peered":"2024-09-21T06:26:16.267918+0000","last_unstale":"2024-09-21T06:26:38.969025+0000","last_undegraded":"2024-09-21T06:26:38.969025+0000","last_fullsized":"2024-09-21T06:26:38.969025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:50.198883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.277857+0000","last_change":"2024-09-21T06:26:18.298052+0000","last_active":"2024-09-21T06:28:08.277857+0000","last_peered":"2024-09-21T06:28:08.277857+0000","last_clean":"2024-09-21T06:28:08.277857+0000","last_became_active":"2024-09-21T06:26:18.297686+0000","last_became_peered":"2024-09-21T06:26:18.297686+0000","last_unstale":"2024-09-21T06:28:08.277857+0000","last_undegraded":"2024-09-21T06:28:08.277857+0000","last_fullsized":"2024-09-21T06:28:08.277857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:56.261608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.970277+0000","last_change":"2024-09-21T06:26:16.270917+0000","last_active":"2024-09-21T06:26:38.970277+0000","last_peered":"2024-09-21T06:26:38.970277+0000","last_clean":"2024-09-21T06:26:38.970277+0000","last_became_active":"2024-09-21T06:26:16.270530+0000","last_became_peered":"2024-09-21T06:26:16.270530+0000","last_unstale":"2024-09-21T06:26:38.970277+0000","last_undegraded":"2024-09-21T06:26:38.970277+0000","last_fullsized":"2024-09-21T06:26:38.970277+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:30.772991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.285302+0000","last_change":"2024-09-21T06:26:18.302286+0000","last_active":"2024-09-21T06:28:08.285302+0000","last_peered":"2024-09-21T06:28:08.285302+0000","last_clean":"2024-09-21T06:28:08.285302+0000","last_became_active":"2024-09-21T06:26:18.301777+0000","last_became_peered":"2024-09-21T06:26:18.301777+0000","last_unstale":"2024-09-21T06:28:08.285302+0000","last_undegraded":"2024-09-21T06:28:08.285302+0000","last_fullsized":"2024-09-21T06:28:08.285302+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:31.339898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'7","reported_seq":138,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:10.919997+0000","last_change":"2024-09-21T06:26:16.267569+0000","last_active":"2024-09-21T06:28:10.919997+0000","last_peered":"2024-09-21T06:28:10.919997+0000","last_clean":"2024-09-21T06:28:10.919997+0000","last_became_active":"2024-09-21T06:26:16.267198+0000","last_became_peered":"2024-09-21T06:26:16.267198+0000","last_unstale":"2024-09-21T06:28:10.919997+0000","last_undegraded":"2024-09-21T06:28:10.919997+0000","last_fullsized":"2024-09-21T06:28:10.919997+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:16.323246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.276222+0000","last_change":"2024-09-21T06:26:18.294473+0000","last_active":"2024-09-21T06:28:08.276222+0000","last_peered":"2024-09-21T06:28:08.276222+0000","last_clean":"2024-09-21T06:28:08.276222+0000","last_became_active":"2024-09-21T06:26:18.294010+0000","last_became_peered":"2024-09-21T06:26:18.294010+0000","last_unstale":"2024-09-21T06:28:08.276222+0000","last_undegraded":"2024-09-21T06:28:08.276222+0000","last_fullsized":"2024-09-21T06:28:08.276222+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:12.098589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'17","reported_seq":66,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.994281+0000","last_change":"2024-09-21T06:26:38.994178+0000","last_active":"2024-09-21T06:26:38.994281+0000","last_peered":"2024-09-21T06:26:38.994281+0000","last_clean":"2024-09-21T06:26:38.994281+0000","last_became_active":"2024-09-21T06:26:38.977865+0000","last_became_peered":"2024-09-21T06:26:38.977865+0000","last_unstale":"2024-09-21T06:26:38.994281+0000","last_undegraded":"2024-09-21T06:26:38.994281+0000","last_fullsized":"2024-09-21T06:26:38.994281+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:44.368499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.290725+0000","last_change":"2024-09-21T06:26:18.312319+0000","last_active":"2024-09-21T06:28:08.290725+0000","last_peered":"2024-09-21T06:28:08.290725+0000","last_clean":"2024-09-21T06:28:08.290725+0000","last_became_active":"2024-09-21T06:26:18.311949+0000","last_became_peered":"2024-09-21T06:26:18.311949+0000","last_unstale":"2024-09-21T06:28:08.290725+0000","last_undegraded":"2024-09-21T06:28:08.290725+0000","last_fullsized":"2024-09-21T06:28:08.290725+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:49.729693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964667+0000","last_change":"2024-09-21T06:26:16.273771+0000","last_active":"2024-09-21T06:26:38.964667+0000","last_peered":"2024-09-21T06:26:38.964667+0000","last_clean":"2024-09-21T06:26:38.964667+0000","last_became_active":"2024-09-21T06:26:16.273293+0000","last_became_peered":"2024-09-21T06:26:16.273293+0000","last_unstale":"2024-09-21T06:26:38.964667+0000","last_undegraded":"2024-09-21T06:26:38.964667+0000","last_fullsized":"2024-09-21T06:26:38.964667+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:21.867844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289127+0000","last_change":"2024-09-21T06:26:18.309204+0000","last_active":"2024-09-21T06:28:08.289127+0000","last_peered":"2024-09-21T06:28:08.289127+0000","last_clean":"2024-09-21T06:28:08.289127+0000","last_became_active":"2024-09-21T06:26:18.308838+0000","last_became_peered":"2024-09-21T06:26:18.308838+0000","last_unstale":"2024-09-21T06:28:08.289127+0000","last_undegraded":"2024-09-21T06:28:08.289127+0000","last_fullsized":"2024-09-21T06:28:08.289127+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:14.011799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'5","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965404+0000","last_change":"2024-09-21T06:26:16.267965+0000","last_active":"2024-09-21T06:26:38.965404+0000","last_peered":"2024-09-21T06:26:38.965404+0000","last_clean":"2024-09-21T06:26:38.965404+0000","last_became_active":"2024-09-21T06:26:16.267548+0000","last_became_peered":"2024-09-21T06:26:16.267548+0000","last_unstale":"2024-09-21T06:26:38.965404+0000","last_undegraded":"2024-09-21T06:26:38.965404+0000","last_fullsized":"2024-09-21T06:26:38.965404+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:51.915817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.277230+0000","last_change":"2024-09-21T06:26:18.306376+0000","last_active":"2024-09-21T06:28:08.277230+0000","last_peered":"2024-09-21T06:28:08.277230+0000","last_clean":"2024-09-21T06:28:08.277230+0000","last_became_active":"2024-09-21T06:26:18.305956+0000","last_became_peered":"2024-09-21T06:26:18.305956+0000","last_unstale":"2024-09-21T06:28:08.277230+0000","last_undegraded":"2024-09-21T06:28:08.277230+0000","last_fullsized":"2024-09-21T06:28:08.277230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:27.229499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971383+0000","last_change":"2024-09-21T06:26:16.267201+0000","last_active":"2024-09-21T06:26:38.971383+0000","last_peered":"2024-09-21T06:26:38.971383+0000","last_clean":"2024-09-21T06:26:38.971383+0000","last_became_active":"2024-09-21T06:26:16.266832+0000","last_became_peered":"2024-09-21T06:26:16.266832+0000","last_unstale":"2024-09-21T06:26:38.971383+0000","last_undegraded":"2024-09-21T06:26:38.971383+0000","last_fullsized":"2024-09-21T06:26:38.971383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:48.626106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'7","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.275329+0000","last_change":"2024-09-21T06:26:38.984119+0000","last_active":"2024-09-21T06:28:08.275329+0000","last_peered":"2024-09-21T06:28:08.275329+0000","last_clean":"2024-09-21T06:28:08.275329+0000","last_became_active":"2024-09-21T06:26:38.972316+0000","last_became_peered":"2024-09-21T06:26:38.972316+0000","last_unstale":"2024-09-21T06:28:08.275329+0000","last_undegraded":"2024-09-21T06:28:08.275329+0000","last_fullsized":"2024-09-21T06:28:08.275329+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:22.788293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'7","reported_seq":137,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:09.917830+0000","last_change":"2024-09-21T06:26:16.572993+0000","last_active":"2024-09-21T06:28:09.917830+0000","last_peered":"2024-09-21T06:28:09.917830+0000","last_clean":"2024-09-21T06:28:09.917830+0000","last_became_active":"2024-09-21T06:26:16.572631+0000","last_became_peered":"2024-09-21T06:26:16.572631+0000","last_unstale":"2024-09-21T06:28:09.917830+0000","last_undegraded":"2024-09-21T06:28:09.917830+0000","last_fullsized":"2024-09-21T06:28:09.917830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:05.276119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289284+0000","last_change":"2024-09-21T06:26:18.304685+0000","last_active":"2024-09-21T06:28:08.289284+0000","last_peered":"2024-09-21T06:28:08.289284+0000","last_clean":"2024-09-21T06:28:08.289284+0000","last_became_active":"2024-09-21T06:26:18.304325+0000","last_became_peered":"2024-09-21T06:26:18.304325+0000","last_unstale":"2024-09-21T06:28:08.289284+0000","last_undegraded":"2024-09-21T06:28:08.289284+0000","last_fullsized":"2024-09-21T06:28:08.289284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:18.072602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":99,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965252+0000","last_change":"2024-09-21T06:25:04.875443+0000","last_active":"2024-09-21T06:26:38.965252+0000","last_peered":"2024-09-21T06:26:38.965252+0000","last_clean":"2024-09-21T06:26:38.965252+0000","last_became_active":"2024-09-21T06:25:04.869179+0000","last_became_peered":"2024-09-21T06:25:04.869179+0000","last_unstale":"2024-09-21T06:26:38.965252+0000","last_undegraded":"2024-09-21T06:26:38.965252+0000","last_fullsized":"2024-09-21T06:26:38.965252+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:21:37.191501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:21:37.191501+0000","last_clean_scrub_stamp":"2024-09-21T06:21:37.191501+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:19.981367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'6","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962414+0000","last_change":"2024-09-21T06:26:16.268440+0000","last_active":"2024-09-21T06:26:38.962414+0000","last_peered":"2024-09-21T06:26:38.962414+0000","last_clean":"2024-09-21T06:26:38.962414+0000","last_became_active":"2024-09-21T06:26:16.268078+0000","last_became_peered":"2024-09-21T06:26:16.268078+0000","last_unstale":"2024-09-21T06:26:38.962414+0000","last_undegraded":"2024-09-21T06:26:38.962414+0000","last_fullsized":"2024-09-21T06:26:38.962414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:55.696736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.273786+0000","last_change":"2024-09-21T06:26:18.306410+0000","last_active":"2024-09-21T06:28:08.273786+0000","last_peered":"2024-09-21T06:28:08.273786+0000","last_clean":"2024-09-21T06:28:08.273786+0000","last_became_active":"2024-09-21T06:26:18.304718+0000","last_became_peered":"2024-09-21T06:26:18.304718+0000","last_unstale":"2024-09-21T06:28:08.273786+0000","last_undegraded":"2024-09-21T06:28:08.273786+0000","last_fullsized":"2024-09-21T06:28:08.273786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:18.521867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964484+0000","last_change":"2024-09-21T06:26:16.270305+0000","last_active":"2024-09-21T06:26:38.964484+0000","last_peered":"2024-09-21T06:26:38.964484+0000","last_clean":"2024-09-21T06:26:38.964484+0000","last_became_active":"2024-09-21T06:26:16.269891+0000","last_became_peered":"2024-09-21T06:26:16.269891+0000","last_unstale":"2024-09-21T06:26:38.964484+0000","last_undegraded":"2024-09-21T06:26:38.964484+0000","last_fullsized":"2024-09-21T06:26:38.964484+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:48.575805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.281410+0000","last_change":"2024-09-21T06:26:18.302404+0000","last_active":"2024-09-21T06:28:08.281410+0000","last_peered":"2024-09-21T06:28:08.281410+0000","last_clean":"2024-09-21T06:28:08.281410+0000","last_became_active":"2024-09-21T06:26:18.302036+0000","last_became_peered":"2024-09-21T06:26:18.302036+0000","last_unstale":"2024-09-21T06:28:08.281410+0000","last_undegraded":"2024-09-21T06:28:08.281410+0000","last_fullsized":"2024-09-21T06:28:08.281410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:36.688018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'6","reported_seq":137,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:13.923815+0000","last_change":"2024-09-21T06:26:16.310996+0000","last_active":"2024-09-21T06:28:13.923815+0000","last_peered":"2024-09-21T06:28:13.923815+0000","last_clean":"2024-09-21T06:28:13.923815+0000","last_became_active":"2024-09-21T06:26:16.310566+0000","last_became_peered":"2024-09-21T06:26:16.310566+0000","last_unstale":"2024-09-21T06:28:13.923815+0000","last_undegraded":"2024-09-21T06:28:13.923815+0000","last_fullsized":"2024-09-21T06:28:13.923815+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:27.569789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.290666+0000","last_change":"2024-09-21T06:26:18.310343+0000","last_active":"2024-09-21T06:28:08.290666+0000","last_peered":"2024-09-21T06:28:08.290666+0000","last_clean":"2024-09-21T06:28:08.290666+0000","last_became_active":"2024-09-21T06:26:18.309979+0000","last_became_peered":"2024-09-21T06:26:18.309979+0000","last_unstale":"2024-09-21T06:28:08.290666+0000","last_undegraded":"2024-09-21T06:28:08.290666+0000","last_fullsized":"2024-09-21T06:28:08.290666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:20.340822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'6","reported_seq":116,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:13.113157+0000","last_change":"2024-09-21T06:26:38.974313+0000","last_active":"2024-09-21T06:28:13.113157+0000","last_peered":"2024-09-21T06:28:13.113157+0000","last_clean":"2024-09-21T06:28:13.113157+0000","last_became_active":"2024-09-21T06:26:38.966498+0000","last_became_peered":"2024-09-21T06:26:38.966498+0000","last_unstale":"2024-09-21T06:28:13.113157+0000","last_undegraded":"2024-09-21T06:28:13.113157+0000","last_fullsized":"2024-09-21T06:28:13.113157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:56.732330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":588,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.282499+0000","last_change":"2024-09-21T06:26:18.312080+0000","last_active":"2024-09-21T06:28:08.282499+0000","last_peered":"2024-09-21T06:28:08.282499+0000","last_clean":"2024-09-21T06:28:08.282499+0000","last_became_active":"2024-09-21T06:26:18.311351+0000","last_became_peered":"2024-09-21T06:26:18.311351+0000","last_unstale":"2024-09-21T06:28:08.282499+0000","last_undegraded":"2024-09-21T06:28:08.282499+0000","last_fullsized":"2024-09-21T06:28:08.282499+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:33.545677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965339+0000","last_change":"2024-09-21T06:26:16.311108+0000","last_active":"2024-09-21T06:26:38.965339+0000","last_peered":"2024-09-21T06:26:38.965339+0000","last_clean":"2024-09-21T06:26:38.965339+0000","last_became_active":"2024-09-21T06:26:16.310595+0000","last_became_peered":"2024-09-21T06:26:16.310595+0000","last_unstale":"2024-09-21T06:26:38.965339+0000","last_undegraded":"2024-09-21T06:26:38.965339+0000","last_fullsized":"2024-09-21T06:26:38.965339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:43.125242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.277932+0000","last_change":"2024-09-21T06:26:18.300618+0000","last_active":"2024-09-21T06:28:08.277932+0000","last_peered":"2024-09-21T06:28:08.277932+0000","last_clean":"2024-09-21T06:28:08.277932+0000","last_became_active":"2024-09-21T06:26:18.300234+0000","last_became_peered":"2024-09-21T06:26:18.300234+0000","last_unstale":"2024-09-21T06:28:08.277932+0000","last_undegraded":"2024-09-21T06:28:08.277932+0000","last_fullsized":"2024-09-21T06:28:08.277932+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:53.224425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'4","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.982480+0000","last_change":"2024-09-21T06:26:38.981999+0000","last_active":"2024-09-21T06:26:38.982480+0000","last_peered":"2024-09-21T06:26:38.982480+0000","last_clean":"2024-09-21T06:26:38.982480+0000","last_became_active":"2024-09-21T06:26:38.969199+0000","last_became_peered":"2024-09-21T06:26:38.969199+0000","last_unstale":"2024-09-21T06:26:38.982480+0000","last_undegraded":"2024-09-21T06:26:38.982480+0000","last_fullsized":"2024-09-21T06:26:38.982480+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:17.389262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.276443+0000","last_change":"2024-09-21T06:26:18.297693+0000","last_active":"2024-09-21T06:28:08.276443+0000","last_peered":"2024-09-21T06:28:08.276443+0000","last_clean":"2024-09-21T06:28:08.276443+0000","last_became_active":"2024-09-21T06:26:18.297335+0000","last_became_peered":"2024-09-21T06:26:18.297335+0000","last_unstale":"2024-09-21T06:28:08.276443+0000","last_undegraded":"2024-09-21T06:28:08.276443+0000","last_fullsized":"2024-09-21T06:28:08.276443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:30.144220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'17","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.307206+0000","last_change":"2024-09-21T06:26:16.269854+0000","last_active":"2024-09-21T06:28:08.307206+0000","last_peered":"2024-09-21T06:28:08.307206+0000","last_clean":"2024-09-21T06:28:08.307206+0000","last_became_active":"2024-09-21T06:26:16.269415+0000","last_became_peered":"2024-09-21T06:26:16.269415+0000","last_unstale":"2024-09-21T06:28:08.307206+0000","last_undegraded":"2024-09-21T06:28:08.307206+0000","last_fullsized":"2024-09-21T06:28:08.307206+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:50.525916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.270328+0000","last_change":"2024-09-21T06:26:18.306302+0000","last_active":"2024-09-21T06:28:08.270328+0000","last_peered":"2024-09-21T06:28:08.270328+0000","last_clean":"2024-09-21T06:28:08.270328+0000","last_became_active":"2024-09-21T06:26:18.305723+0000","last_became_peered":"2024-09-21T06:26:18.305723+0000","last_unstale":"2024-09-21T06:28:08.270328+0000","last_undegraded":"2024-09-21T06:28:08.270328+0000","last_fullsized":"2024-09-21T06:28:08.270328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:30.051791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'7","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962517+0000","last_change":"2024-09-21T06:26:16.573081+0000","last_active":"2024-09-21T06:26:38.962517+0000","last_peered":"2024-09-21T06:26:38.962517+0000","last_clean":"2024-09-21T06:26:38.962517+0000","last_became_active":"2024-09-21T06:26:16.572680+0000","last_became_peered":"2024-09-21T06:26:16.572680+0000","last_unstale":"2024-09-21T06:26:38.962517+0000","last_undegraded":"2024-09-21T06:26:38.962517+0000","last_fullsized":"2024-09-21T06:26:38.962517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:04.698258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.282159+0000","last_change":"2024-09-21T06:26:18.311610+0000","last_active":"2024-09-21T06:28:08.282159+0000","last_peered":"2024-09-21T06:28:08.282159+0000","last_clean":"2024-09-21T06:28:08.282159+0000","last_became_active":"2024-09-21T06:26:18.311239+0000","last_became_peered":"2024-09-21T06:26:18.311239+0000","last_unstale":"2024-09-21T06:28:08.282159+0000","last_undegraded":"2024-09-21T06:28:08.282159+0000","last_fullsized":"2024-09-21T06:28:08.282159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:36.995768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965260+0000","last_change":"2024-09-21T06:26:16.313612+0000","last_active":"2024-09-21T06:26:38.965260+0000","last_peered":"2024-09-21T06:26:38.965260+0000","last_clean":"2024-09-21T06:26:38.965260+0000","last_became_active":"2024-09-21T06:26:16.313298+0000","last_became_peered":"2024-09-21T06:26:16.313298+0000","last_unstale":"2024-09-21T06:26:38.965260+0000","last_undegraded":"2024-09-21T06:26:38.965260+0000","last_fullsized":"2024-09-21T06:26:38.965260+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:45.035454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.235394+0000","last_change":"2024-09-21T06:26:18.304772+0000","last_active":"2024-09-21T06:28:08.235394+0000","last_peered":"2024-09-21T06:28:08.235394+0000","last_clean":"2024-09-21T06:28:08.235394+0000","last_became_active":"2024-09-21T06:26:18.303909+0000","last_became_peered":"2024-09-21T06:26:18.303909+0000","last_unstale":"2024-09-21T06:28:08.235394+0000","last_undegraded":"2024-09-21T06:28:08.235394+0000","last_fullsized":"2024-09-21T06:28:08.235394+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:28.707169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963811+0000","last_change":"2024-09-21T06:26:16.267563+0000","last_active":"2024-09-21T06:26:38.963811+0000","last_peered":"2024-09-21T06:26:38.963811+0000","last_clean":"2024-09-21T06:26:38.963811+0000","last_became_active":"2024-09-21T06:26:16.267182+0000","last_became_peered":"2024-09-21T06:26:16.267182+0000","last_unstale":"2024-09-21T06:26:38.963811+0000","last_undegraded":"2024-09-21T06:26:38.963811+0000","last_fullsized":"2024-09-21T06:26:38.963811+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:16.042105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.278136+0000","last_change":"2024-09-21T06:26:18.310772+0000","last_active":"2024-09-21T06:28:08.278136+0000","last_peered":"2024-09-21T06:28:08.278136+0000","last_clean":"2024-09-21T06:28:08.278136+0000","last_became_active":"2024-09-21T06:26:18.310382+0000","last_became_peered":"2024-09-21T06:26:18.310382+0000","last_unstale":"2024-09-21T06:28:08.278136+0000","last_undegraded":"2024-09-21T06:28:08.278136+0000","last_fullsized":"2024-09-21T06:28:08.278136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:54:35.028081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967712+0000","last_change":"2024-09-21T06:26:16.270971+0000","last_active":"2024-09-21T06:26:38.967712+0000","last_peered":"2024-09-21T06:26:38.967712+0000","last_clean":"2024-09-21T06:26:38.967712+0000","last_became_active":"2024-09-21T06:26:16.270453+0000","last_became_peered":"2024-09-21T06:26:16.270453+0000","last_unstale":"2024-09-21T06:26:38.967712+0000","last_undegraded":"2024-09-21T06:26:38.967712+0000","last_fullsized":"2024-09-21T06:26:38.967712+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:34.687380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.277706+0000","last_change":"2024-09-21T06:26:18.300568+0000","last_active":"2024-09-21T06:28:08.277706+0000","last_peered":"2024-09-21T06:28:08.277706+0000","last_clean":"2024-09-21T06:28:08.277706+0000","last_became_active":"2024-09-21T06:26:18.298864+0000","last_became_peered":"2024-09-21T06:26:18.298864+0000","last_unstale":"2024-09-21T06:28:08.277706+0000","last_undegraded":"2024-09-21T06:28:08.277706+0000","last_fullsized":"2024-09-21T06:28:08.277706+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:00.786225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964246+0000","last_change":"2024-09-21T06:26:16.274093+0000","last_active":"2024-09-21T06:26:38.964246+0000","last_peered":"2024-09-21T06:26:38.964246+0000","last_clean":"2024-09-21T06:26:38.964246+0000","last_became_active":"2024-09-21T06:26:16.273707+0000","last_became_peered":"2024-09-21T06:26:16.273707+0000","last_unstale":"2024-09-21T06:26:38.964246+0000","last_undegraded":"2024-09-21T06:26:38.964246+0000","last_fullsized":"2024-09-21T06:26:38.964246+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:26.710260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289024+0000","last_change":"2024-09-21T06:26:18.300140+0000","last_active":"2024-09-21T06:28:08.289024+0000","last_peered":"2024-09-21T06:28:08.289024+0000","last_clean":"2024-09-21T06:28:08.289024+0000","last_became_active":"2024-09-21T06:26:18.299543+0000","last_became_peered":"2024-09-21T06:26:18.299543+0000","last_unstale":"2024-09-21T06:28:08.289024+0000","last_undegraded":"2024-09-21T06:28:08.289024+0000","last_fullsized":"2024-09-21T06:28:08.289024+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:50.272247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.291190+0000","last_change":"2024-09-21T06:26:18.311528+0000","last_active":"2024-09-21T06:28:08.291190+0000","last_peered":"2024-09-21T06:28:08.291190+0000","last_clean":"2024-09-21T06:28:08.291190+0000","last_became_active":"2024-09-21T06:26:18.311144+0000","last_became_peered":"2024-09-21T06:26:18.311144+0000","last_unstale":"2024-09-21T06:28:08.291190+0000","last_undegraded":"2024-09-21T06:28:08.291190+0000","last_fullsized":"2024-09-21T06:28:08.291190+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:05.554255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964467+0000","last_change":"2024-09-21T06:26:16.275378+0000","last_active":"2024-09-21T06:26:38.964467+0000","last_peered":"2024-09-21T06:26:38.964467+0000","last_clean":"2024-09-21T06:26:38.964467+0000","last_became_active":"2024-09-21T06:26:16.274990+0000","last_became_peered":"2024-09-21T06:26:16.274990+0000","last_unstale":"2024-09-21T06:26:38.964467+0000","last_undegraded":"2024-09-21T06:26:38.964467+0000","last_fullsized":"2024-09-21T06:26:38.964467+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:57.252993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289055+0000","last_change":"2024-09-21T06:26:18.300879+0000","last_active":"2024-09-21T06:28:08.289055+0000","last_peered":"2024-09-21T06:28:08.289055+0000","last_clean":"2024-09-21T06:28:08.289055+0000","last_became_active":"2024-09-21T06:26:18.300514+0000","last_became_peered":"2024-09-21T06:26:18.300514+0000","last_unstale":"2024-09-21T06:28:08.289055+0000","last_undegraded":"2024-09-21T06:28:08.289055+0000","last_fullsized":"2024-09-21T06:28:08.289055+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:02.581145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'13","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964587+0000","last_change":"2024-09-21T06:26:16.274139+0000","last_active":"2024-09-21T06:26:38.964587+0000","last_peered":"2024-09-21T06:26:38.964587+0000","last_clean":"2024-09-21T06:26:38.964587+0000","last_became_active":"2024-09-21T06:26:16.273723+0000","last_became_peered":"2024-09-21T06:26:16.273723+0000","last_unstale":"2024-09-21T06:26:38.964587+0000","last_undegraded":"2024-09-21T06:26:38.964587+0000","last_fullsized":"2024-09-21T06:26:38.964587+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:24.366714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.285338+0000","last_change":"2024-09-21T06:26:18.304602+0000","last_active":"2024-09-21T06:28:08.285338+0000","last_peered":"2024-09-21T06:28:08.285338+0000","last_clean":"2024-09-21T06:28:08.285338+0000","last_became_active":"2024-09-21T06:26:18.304259+0000","last_became_peered":"2024-09-21T06:26:18.304259+0000","last_unstale":"2024-09-21T06:28:08.285338+0000","last_undegraded":"2024-09-21T06:28:08.285338+0000","last_fullsized":"2024-09-21T06:28:08.285338+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:16.428247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964281+0000","last_change":"2024-09-21T06:26:16.311107+0000","last_active":"2024-09-21T06:26:38.964281+0000","last_peered":"2024-09-21T06:26:38.964281+0000","last_clean":"2024-09-21T06:26:38.964281+0000","last_became_active":"2024-09-21T06:26:16.310692+0000","last_became_peered":"2024-09-21T06:26:16.310692+0000","last_unstale":"2024-09-21T06:26:38.964281+0000","last_undegraded":"2024-09-21T06:26:38.964281+0000","last_fullsized":"2024-09-21T06:26:38.964281+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:29.074606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.273825+0000","last_change":"2024-09-21T06:26:18.300614+0000","last_active":"2024-09-21T06:28:08.273825+0000","last_peered":"2024-09-21T06:28:08.273825+0000","last_clean":"2024-09-21T06:28:08.273825+0000","last_became_active":"2024-09-21T06:26:18.300173+0000","last_became_peered":"2024-09-21T06:26:18.300173+0000","last_unstale":"2024-09-21T06:28:08.273825+0000","last_undegraded":"2024-09-21T06:28:08.273825+0000","last_fullsized":"2024-09-21T06:28:08.273825+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:49.040667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'14","reported_seq":163,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:12.110097+0000","last_change":"2024-09-21T06:26:38.986822+0000","last_active":"2024-09-21T06:28:12.110097+0000","last_peered":"2024-09-21T06:28:12.110097+0000","last_clean":"2024-09-21T06:28:12.110097+0000","last_became_active":"2024-09-21T06:26:38.972368+0000","last_became_peered":"2024-09-21T06:26:38.972368+0000","last_unstale":"2024-09-21T06:28:12.110097+0000","last_undegraded":"2024-09-21T06:28:12.110097+0000","last_fullsized":"2024-09-21T06:28:12.110097+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:53.273388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74799,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1083,"num_read_kb":627,"num_write":262,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1484,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":223473,"data_compressed":4914,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282590,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743460,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":421215,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939690,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1007616,"data_stored":1078241,"data_compressed":43480,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103215,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":876544,"data_stored":419722,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299444,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":419199,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495673,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":1012054,"data_compressed":41842,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659199,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":419630,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855428,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":1011788,"data_compressed":41842,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018952,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":864256,"data_stored":419827,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182476,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":419030,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378707,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":487572,"data_compressed":7539,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542232,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":929792,"data_stored":487604,"data_compressed":7539,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705756,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":876544,"data_stored":421193,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":69121,"data_compressed":1638,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":69089,"data_compressed":1638,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":69273,"data_compressed":1638,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:28:16.490 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:28:16.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:16 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1060010637' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.640+0000 7fe6abade640 1 -- 172.21.15.63:0/1798198165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6a4106200 msgr2=0x7fe6a4106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.640+0000 7fe6abade640 1 --2- 172.21.15.63:0/1798198165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6a4106200 0x7fe6a4106610 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe694009900 tx=0x7fe69402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.640+0000 7fe6abade640 1 -- 172.21.15.63:0/1798198165 shutdown_connections 2024-09-21T06:28:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.640+0000 7fe6abade640 1 --2- 172.21.15.63:0/1798198165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6a4106b50 0x7fe6a41105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.640+0000 7fe6abade640 1 --2- 172.21.15.63:0/1798198165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6a4106200 0x7fe6a4106610 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.640+0000 7fe6abade640 1 --2- 172.21.15.63:0/1798198165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6a4101f30 0x7fe6a4102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.640+0000 7fe6abade640 1 -- 172.21.15.63:0/1798198165 >> 172.21.15.63:0/1798198165 conn(0x7fe6a4079d00 msgr2=0x7fe6a407a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:16.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.640+0000 7fe6abade640 1 -- 172.21.15.63:0/1798198165 shutdown_connections 2024-09-21T06:28:16.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.640+0000 7fe6abade640 1 -- 172.21.15.63:0/1798198165 wait complete. 2024-09-21T06:28:16.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.640+0000 7fe6abade640 1 Processor -- start 2024-09-21T06:28:16.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.640+0000 7fe6abade640 1 -- start start 2024-09-21T06:28:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.641+0000 7fe6abade640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6a4101f30 0x7fe6a419c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.641+0000 7fe6abade640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6a4106200 0x7fe6a419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.641+0000 7fe6abade640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6a4106b50 0x7fe6a41a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.641+0000 7fe6abade640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a41139f0 con 0x7fe6a4106200 2024-09-21T06:28:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.641+0000 7fe6abade640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a4113870 con 0x7fe6a4101f30 2024-09-21T06:28:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.641+0000 7fe6abade640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a4113b70 con 0x7fe6a4106b50 2024-09-21T06:28:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.641+0000 7fe6a9079640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6a4106200 0x7fe6a419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.641+0000 7fe6a9079640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6a4106200 0x7fe6a419cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37584/0 (socket says 172.21.15.63:37584) 2024-09-21T06:28:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.641+0000 7fe6a9079640 1 -- 172.21.15.63:0/1220901490 learned_addr learned my addr 172.21.15.63:0/1220901490 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.641+0000 7fe6a987a640 1 --2- 172.21.15.63:0/1220901490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6a4101f30 0x7fe6a419c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.641+0000 7fe6aa07b640 1 --2- 172.21.15.63:0/1220901490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6a4106b50 0x7fe6a41a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.641+0000 7fe6a9079640 1 -- 172.21.15.63:0/1220901490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6a4106b50 msgr2=0x7fe6a41a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.641+0000 7fe6a9079640 1 --2- 172.21.15.63:0/1220901490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6a4106b50 0x7fe6a41a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.641+0000 7fe6a9079640 1 -- 172.21.15.63:0/1220901490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6a4101f30 msgr2=0x7fe6a419c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.641+0000 7fe6a9079640 1 --2- 172.21.15.63:0/1220901490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6a4101f30 0x7fe6a419c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.641+0000 7fe6a9079640 1 -- 172.21.15.63:0/1220901490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a41a2520 con 0x7fe6a4106200 2024-09-21T06:28:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.641+0000 7fe6aa07b640 1 --2- 172.21.15.63:0/1220901490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6a4106b50 0x7fe6a41a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.641+0000 7fe6a987a640 1 --2- 172.21.15.63:0/1220901490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6a4101f30 0x7fe6a419c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.641+0000 7fe6a9079640 1 --2- 172.21.15.63:0/1220901490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6a4106200 0x7fe6a419cb90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe694006010 tx=0x7fe694004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.642+0000 7fe69affd640 1 -- 172.21.15.63:0/1220901490 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69403f030 con 0x7fe6a4106200 2024-09-21T06:28:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.642+0000 7fe69affd640 1 -- 172.21.15.63:0/1220901490 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe694003aa0 con 0x7fe6a4106200 2024-09-21T06:28:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.642+0000 7fe6abade640 1 -- 172.21.15.63:0/1220901490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a41a27b0 con 0x7fe6a4106200 2024-09-21T06:28:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.642+0000 7fe69affd640 1 -- 172.21.15.63:0/1220901490 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe694035070 con 0x7fe6a4106200 2024-09-21T06:28:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.642+0000 7fe6abade640 1 -- 172.21.15.63:0/1220901490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a41a8fa0 con 0x7fe6a4106200 2024-09-21T06:28:16.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.643+0000 7fe6abade640 1 -- 172.21.15.63:0/1220901490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a406b6e0 con 0x7fe6a4106200 2024-09-21T06:28:16.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.645+0000 7fe69affd640 1 -- 172.21.15.63:0/1220901490 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fe694042030 con 0x7fe6a4106200 2024-09-21T06:28:16.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.646+0000 7fe69affd640 1 --2- 172.21.15.63:0/1220901490 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe6900b6560 0x7fe6900b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:16.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.646+0000 7fe6a987a640 1 --2- 172.21.15.63:0/1220901490 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe6900b6560 0x7fe6900b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:16.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.646+0000 7fe69affd640 1 -- 172.21.15.63:0/1220901490 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fe694107e10 con 0x7fe6a4106200 2024-09-21T06:28:16.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.646+0000 7fe6a987a640 1 --2- 172.21.15.63:0/1220901490 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe6900b6560 0x7fe6900b8a70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe6a00058c0 tx=0x7fe6a0005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:16.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.649+0000 7fe69affd640 1 -- 172.21.15.63:0/1220901490 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe6940ce5c0 con 0x7fe6a4106200 2024-09-21T06:28:16.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.835+0000 7fe6abade640 1 -- 172.21.15.63:0/1220901490 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6a406a870 con 0x7fe6900b6560 2024-09-21T06:28:16.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.839+0000 7fe69affd640 1 -- 172.21.15.63:0/1220901490 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259272 (secure 0 0 0) 0x7fe6a406a870 con 0x7fe6900b6560 2024-09-21T06:28:16.844 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:28:16.845 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T06:28:16.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.842+0000 7fe6abade640 1 -- 172.21.15.63:0/1220901490 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe6900b6560 msgr2=0x7fe6900b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:16.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.842+0000 7fe6abade640 1 --2- 172.21.15.63:0/1220901490 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe6900b6560 0x7fe6900b8a70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe6a00058c0 tx=0x7fe6a0005850 comp rx=0 tx=0).stop 2024-09-21T06:28:16.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.842+0000 7fe6abade640 1 -- 172.21.15.63:0/1220901490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6a4106200 msgr2=0x7fe6a419cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:16.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.842+0000 7fe6abade640 1 --2- 172.21.15.63:0/1220901490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6a4106200 0x7fe6a419cb90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe694006010 tx=0x7fe694004060 comp rx=0 tx=0).stop 2024-09-21T06:28:16.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.843+0000 7fe6abade640 1 -- 172.21.15.63:0/1220901490 shutdown_connections 2024-09-21T06:28:16.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.843+0000 7fe6abade640 1 --2- 172.21.15.63:0/1220901490 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe6900b6560 0x7fe6900b8a70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.843+0000 7fe6abade640 1 --2- 172.21.15.63:0/1220901490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6a4106b50 0x7fe6a41a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.843+0000 7fe6abade640 1 --2- 172.21.15.63:0/1220901490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6a4106200 0x7fe6a419cb90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.843+0000 7fe6abade640 1 --2- 172.21.15.63:0/1220901490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6a4101f30 0x7fe6a419c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.843+0000 7fe6abade640 1 -- 172.21.15.63:0/1220901490 >> 172.21.15.63:0/1220901490 conn(0x7fe6a4079d00 msgr2=0x7fe6a406a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:16.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.843+0000 7fe6abade640 1 -- 172.21.15.63:0/1220901490 shutdown_connections 2024-09-21T06:28:16.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:16.843+0000 7fe6abade640 1 -- 172.21.15.63:0/1220901490 wait complete. 2024-09-21T06:28:16.856 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-09-21T06:28:15.896931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665401,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1164,"num_read_kb":696,"num_write":387,"num_write_kb":2308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":2953441,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":818,"ondisk_log_size":818,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380572,"kb_used_data":10524,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561252,"statfs":{"total":1151940427776,"available":1151550722048,"internally_reserved":0,"allocated":10776576,"data_stored":7017075,"data_compressed":183549,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1147,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":75,"num_write":16,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003565"},"pg_stats":[{"pgid":"3.3f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.282041+0000","last_change":"2024-09-21T06:26:18.307729+0000","last_active":"2024-09-21T06:28:08.282041+0000","last_peered":"2024-09-21T06:28:08.282041+0000","last_clean":"2024-09-21T06:28:08.282041+0000","last_became_active":"2024-09-21T06:26:18.306345+0000","last_became_peered":"2024-09-21T06:26:18.306345+0000","last_unstale":"2024-09-21T06:28:08.282041+0000","last_undegraded":"2024-09-21T06:28:08.282041+0000","last_fullsized":"2024-09-21T06:28:08.282041+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:58.409506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.286762+0000","last_change":"2024-09-21T06:26:18.302982+0000","last_active":"2024-09-21T06:28:08.286762+0000","last_peered":"2024-09-21T06:28:08.286762+0000","last_clean":"2024-09-21T06:28:08.286762+0000","last_became_active":"2024-09-21T06:26:18.302636+0000","last_became_peered":"2024-09-21T06:26:18.302636+0000","last_unstale":"2024-09-21T06:28:08.286762+0000","last_undegraded":"2024-09-21T06:28:08.286762+0000","last_fullsized":"2024-09-21T06:28:08.286762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:28.165964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.285733+0000","last_change":"2024-09-21T06:26:18.305293+0000","last_active":"2024-09-21T06:28:08.285733+0000","last_peered":"2024-09-21T06:28:08.285733+0000","last_clean":"2024-09-21T06:28:08.285733+0000","last_became_active":"2024-09-21T06:26:18.304689+0000","last_became_peered":"2024-09-21T06:26:18.304689+0000","last_unstale":"2024-09-21T06:28:08.285733+0000","last_undegraded":"2024-09-21T06:28:08.285733+0000","last_fullsized":"2024-09-21T06:28:08.285733+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:37.442558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.290851+0000","last_change":"2024-09-21T06:26:18.306443+0000","last_active":"2024-09-21T06:28:08.290851+0000","last_peered":"2024-09-21T06:28:08.290851+0000","last_clean":"2024-09-21T06:28:08.290851+0000","last_became_active":"2024-09-21T06:26:18.305062+0000","last_became_peered":"2024-09-21T06:26:18.305062+0000","last_unstale":"2024-09-21T06:28:08.290851+0000","last_undegraded":"2024-09-21T06:28:08.290851+0000","last_fullsized":"2024-09-21T06:28:08.290851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:07.896971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.257044+0000","last_change":"2024-09-21T06:26:18.298857+0000","last_active":"2024-09-21T06:28:08.257044+0000","last_peered":"2024-09-21T06:28:08.257044+0000","last_clean":"2024-09-21T06:28:08.257044+0000","last_became_active":"2024-09-21T06:26:18.298439+0000","last_became_peered":"2024-09-21T06:26:18.298439+0000","last_unstale":"2024-09-21T06:28:08.257044+0000","last_undegraded":"2024-09-21T06:28:08.257044+0000","last_fullsized":"2024-09-21T06:28:08.257044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:24.695856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.282750+0000","last_change":"2024-09-21T06:26:18.313029+0000","last_active":"2024-09-21T06:28:08.282750+0000","last_peered":"2024-09-21T06:28:08.282750+0000","last_clean":"2024-09-21T06:28:08.282750+0000","last_became_active":"2024-09-21T06:26:18.312627+0000","last_became_peered":"2024-09-21T06:26:18.312627+0000","last_unstale":"2024-09-21T06:28:08.282750+0000","last_undegraded":"2024-09-21T06:28:08.282750+0000","last_fullsized":"2024-09-21T06:28:08.282750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:23.086862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.275181+0000","last_change":"2024-09-21T06:26:18.299082+0000","last_active":"2024-09-21T06:28:08.275181+0000","last_peered":"2024-09-21T06:28:08.275181+0000","last_clean":"2024-09-21T06:28:08.275181+0000","last_became_active":"2024-09-21T06:26:18.298279+0000","last_became_peered":"2024-09-21T06:26:18.298279+0000","last_unstale":"2024-09-21T06:28:08.275181+0000","last_undegraded":"2024-09-21T06:28:08.275181+0000","last_fullsized":"2024-09-21T06:28:08.275181+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:05.652407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.277890+0000","last_change":"2024-09-21T06:26:18.298565+0000","last_active":"2024-09-21T06:28:08.277890+0000","last_peered":"2024-09-21T06:28:08.277890+0000","last_clean":"2024-09-21T06:28:08.277890+0000","last_became_active":"2024-09-21T06:26:18.298172+0000","last_became_peered":"2024-09-21T06:26:18.298172+0000","last_unstale":"2024-09-21T06:28:08.277890+0000","last_undegraded":"2024-09-21T06:28:08.277890+0000","last_fullsized":"2024-09-21T06:28:08.277890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:33.045038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289221+0000","last_change":"2024-09-21T06:26:18.304901+0000","last_active":"2024-09-21T06:28:08.289221+0000","last_peered":"2024-09-21T06:28:08.289221+0000","last_clean":"2024-09-21T06:28:08.289221+0000","last_became_active":"2024-09-21T06:26:18.304521+0000","last_became_peered":"2024-09-21T06:26:18.304521+0000","last_unstale":"2024-09-21T06:28:08.289221+0000","last_undegraded":"2024-09-21T06:28:08.289221+0000","last_fullsized":"2024-09-21T06:28:08.289221+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:31.859554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"77'16","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.273540+0000","last_change":"2024-09-21T06:26:38.970119+0000","last_active":"2024-09-21T06:28:08.273540+0000","last_peered":"2024-09-21T06:28:08.273540+0000","last_clean":"2024-09-21T06:28:08.273540+0000","last_became_active":"2024-09-21T06:26:38.969521+0000","last_became_peered":"2024-09-21T06:26:38.969521+0000","last_unstale":"2024-09-21T06:28:08.273540+0000","last_undegraded":"2024-09-21T06:28:08.273540+0000","last_fullsized":"2024-09-21T06:28:08.273540+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:54.407153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289151+0000","last_change":"2024-09-21T06:26:18.300178+0000","last_active":"2024-09-21T06:28:08.289151+0000","last_peered":"2024-09-21T06:28:08.289151+0000","last_clean":"2024-09-21T06:28:08.289151+0000","last_became_active":"2024-09-21T06:26:18.298651+0000","last_became_peered":"2024-09-21T06:26:18.298651+0000","last_unstale":"2024-09-21T06:28:08.289151+0000","last_undegraded":"2024-09-21T06:28:08.289151+0000","last_fullsized":"2024-09-21T06:28:08.289151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:07.261974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.290634+0000","last_change":"2024-09-21T06:26:18.311310+0000","last_active":"2024-09-21T06:28:08.290634+0000","last_peered":"2024-09-21T06:28:08.290634+0000","last_clean":"2024-09-21T06:28:08.290634+0000","last_became_active":"2024-09-21T06:26:18.310671+0000","last_became_peered":"2024-09-21T06:26:18.310671+0000","last_unstale":"2024-09-21T06:28:08.290634+0000","last_undegraded":"2024-09-21T06:28:08.290634+0000","last_fullsized":"2024-09-21T06:28:08.290634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:52.060682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.278346+0000","last_change":"2024-09-21T06:26:18.296958+0000","last_active":"2024-09-21T06:28:08.278346+0000","last_peered":"2024-09-21T06:28:08.278346+0000","last_clean":"2024-09-21T06:28:08.278346+0000","last_became_active":"2024-09-21T06:26:18.296081+0000","last_became_peered":"2024-09-21T06:26:18.296081+0000","last_unstale":"2024-09-21T06:28:08.278346+0000","last_undegraded":"2024-09-21T06:28:08.278346+0000","last_fullsized":"2024-09-21T06:28:08.278346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:28.501906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.287036+0000","last_change":"2024-09-21T06:26:18.301289+0000","last_active":"2024-09-21T06:28:08.287036+0000","last_peered":"2024-09-21T06:28:08.287036+0000","last_clean":"2024-09-21T06:28:08.287036+0000","last_became_active":"2024-09-21T06:26:18.300834+0000","last_became_peered":"2024-09-21T06:26:18.300834+0000","last_unstale":"2024-09-21T06:28:08.287036+0000","last_undegraded":"2024-09-21T06:28:08.287036+0000","last_fullsized":"2024-09-21T06:28:08.287036+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:31.206650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.281800+0000","last_change":"2024-09-21T06:26:18.312436+0000","last_active":"2024-09-21T06:28:08.281800+0000","last_peered":"2024-09-21T06:28:08.281800+0000","last_clean":"2024-09-21T06:28:08.281800+0000","last_became_active":"2024-09-21T06:26:18.311230+0000","last_became_peered":"2024-09-21T06:26:18.311230+0000","last_unstale":"2024-09-21T06:28:08.281800+0000","last_undegraded":"2024-09-21T06:28:08.281800+0000","last_fullsized":"2024-09-21T06:28:08.281800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:07.163105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.288018+0000","last_change":"2024-09-21T06:26:18.307775+0000","last_active":"2024-09-21T06:28:08.288018+0000","last_peered":"2024-09-21T06:28:08.288018+0000","last_clean":"2024-09-21T06:28:08.288018+0000","last_became_active":"2024-09-21T06:26:18.307326+0000","last_became_peered":"2024-09-21T06:26:18.307326+0000","last_unstale":"2024-09-21T06:28:08.288018+0000","last_undegraded":"2024-09-21T06:28:08.288018+0000","last_fullsized":"2024-09-21T06:28:08.288018+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:18.213503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.282030+0000","last_change":"2024-09-21T06:26:18.309004+0000","last_active":"2024-09-21T06:28:08.282030+0000","last_peered":"2024-09-21T06:28:08.282030+0000","last_clean":"2024-09-21T06:28:08.282030+0000","last_became_active":"2024-09-21T06:26:18.306098+0000","last_became_peered":"2024-09-21T06:26:18.306098+0000","last_unstale":"2024-09-21T06:28:08.282030+0000","last_undegraded":"2024-09-21T06:28:08.282030+0000","last_fullsized":"2024-09-21T06:28:08.282030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:09.102610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.278891+0000","last_change":"2024-09-21T06:26:18.306699+0000","last_active":"2024-09-21T06:28:08.278891+0000","last_peered":"2024-09-21T06:28:08.278891+0000","last_clean":"2024-09-21T06:28:08.278891+0000","last_became_active":"2024-09-21T06:26:18.306352+0000","last_became_peered":"2024-09-21T06:26:18.306352+0000","last_unstale":"2024-09-21T06:28:08.278891+0000","last_undegraded":"2024-09-21T06:28:08.278891+0000","last_fullsized":"2024-09-21T06:28:08.278891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:47.992315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.264597+0000","last_change":"2024-09-21T06:26:18.301677+0000","last_active":"2024-09-21T06:28:08.264597+0000","last_peered":"2024-09-21T06:28:08.264597+0000","last_clean":"2024-09-21T06:28:08.264597+0000","last_became_active":"2024-09-21T06:26:18.301260+0000","last_became_peered":"2024-09-21T06:26:18.301260+0000","last_unstale":"2024-09-21T06:28:08.264597+0000","last_undegraded":"2024-09-21T06:28:08.264597+0000","last_fullsized":"2024-09-21T06:28:08.264597+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:53.209062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.288730+0000","last_change":"2024-09-21T06:26:18.312004+0000","last_active":"2024-09-21T06:28:08.288730+0000","last_peered":"2024-09-21T06:28:08.288730+0000","last_clean":"2024-09-21T06:28:08.288730+0000","last_became_active":"2024-09-21T06:26:18.311602+0000","last_became_peered":"2024-09-21T06:26:18.311602+0000","last_unstale":"2024-09-21T06:28:08.288730+0000","last_undegraded":"2024-09-21T06:28:08.288730+0000","last_fullsized":"2024-09-21T06:28:08.288730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:30.074887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.287829+0000","last_change":"2024-09-21T06:26:18.296581+0000","last_active":"2024-09-21T06:28:08.287829+0000","last_peered":"2024-09-21T06:28:08.287829+0000","last_clean":"2024-09-21T06:28:08.287829+0000","last_became_active":"2024-09-21T06:26:18.296078+0000","last_became_peered":"2024-09-21T06:26:18.296078+0000","last_unstale":"2024-09-21T06:28:08.287829+0000","last_undegraded":"2024-09-21T06:28:08.287829+0000","last_fullsized":"2024-09-21T06:28:08.287829+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:39.120626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.288126+0000","last_change":"2024-09-21T06:26:18.307793+0000","last_active":"2024-09-21T06:28:08.288126+0000","last_peered":"2024-09-21T06:28:08.288126+0000","last_clean":"2024-09-21T06:28:08.288126+0000","last_became_active":"2024-09-21T06:26:18.307310+0000","last_became_peered":"2024-09-21T06:26:18.307310+0000","last_unstale":"2024-09-21T06:28:08.288126+0000","last_undegraded":"2024-09-21T06:28:08.288126+0000","last_fullsized":"2024-09-21T06:28:08.288126+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:11.761986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.269182+0000","last_change":"2024-09-21T06:26:18.305700+0000","last_active":"2024-09-21T06:28:08.269182+0000","last_peered":"2024-09-21T06:28:08.269182+0000","last_clean":"2024-09-21T06:28:08.269182+0000","last_became_active":"2024-09-21T06:26:18.305319+0000","last_became_peered":"2024-09-21T06:26:18.305319+0000","last_unstale":"2024-09-21T06:28:08.269182+0000","last_undegraded":"2024-09-21T06:28:08.269182+0000","last_fullsized":"2024-09-21T06:28:08.269182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:52.479565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.273399+0000","last_change":"2024-09-21T06:26:18.304111+0000","last_active":"2024-09-21T06:28:08.273399+0000","last_peered":"2024-09-21T06:28:08.273399+0000","last_clean":"2024-09-21T06:28:08.273399+0000","last_became_active":"2024-09-21T06:26:18.302716+0000","last_became_peered":"2024-09-21T06:26:18.302716+0000","last_unstale":"2024-09-21T06:28:08.273399+0000","last_undegraded":"2024-09-21T06:28:08.273399+0000","last_fullsized":"2024-09-21T06:28:08.273399+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:39.298737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.263420+0000","last_change":"2024-09-21T06:26:18.310154+0000","last_active":"2024-09-21T06:28:08.263420+0000","last_peered":"2024-09-21T06:28:08.263420+0000","last_clean":"2024-09-21T06:28:08.263420+0000","last_became_active":"2024-09-21T06:26:18.309735+0000","last_became_peered":"2024-09-21T06:26:18.309735+0000","last_unstale":"2024-09-21T06:28:08.263420+0000","last_undegraded":"2024-09-21T06:28:08.263420+0000","last_fullsized":"2024-09-21T06:28:08.263420+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:42:37.535841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.273261+0000","last_change":"2024-09-21T06:26:18.312302+0000","last_active":"2024-09-21T06:28:08.273261+0000","last_peered":"2024-09-21T06:28:08.273261+0000","last_clean":"2024-09-21T06:28:08.273261+0000","last_became_active":"2024-09-21T06:26:18.311950+0000","last_became_peered":"2024-09-21T06:26:18.311950+0000","last_unstale":"2024-09-21T06:28:08.273261+0000","last_undegraded":"2024-09-21T06:28:08.273261+0000","last_fullsized":"2024-09-21T06:28:08.273261+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:03.899946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.264724+0000","last_change":"2024-09-21T06:26:18.308291+0000","last_active":"2024-09-21T06:28:08.264724+0000","last_peered":"2024-09-21T06:28:08.264724+0000","last_clean":"2024-09-21T06:28:08.264724+0000","last_became_active":"2024-09-21T06:26:18.307907+0000","last_became_peered":"2024-09-21T06:26:18.307907+0000","last_unstale":"2024-09-21T06:28:08.264724+0000","last_undegraded":"2024-09-21T06:28:08.264724+0000","last_fullsized":"2024-09-21T06:28:08.264724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:17.418996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.278413+0000","last_change":"2024-09-21T06:26:18.311774+0000","last_active":"2024-09-21T06:28:08.278413+0000","last_peered":"2024-09-21T06:28:08.278413+0000","last_clean":"2024-09-21T06:28:08.278413+0000","last_became_active":"2024-09-21T06:26:18.311373+0000","last_became_peered":"2024-09-21T06:26:18.311373+0000","last_unstale":"2024-09-21T06:28:08.278413+0000","last_undegraded":"2024-09-21T06:28:08.278413+0000","last_fullsized":"2024-09-21T06:28:08.278413+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:08.310931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'7","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.278709+0000","last_change":"2024-09-21T06:26:38.977655+0000","last_active":"2024-09-21T06:28:08.278709+0000","last_peered":"2024-09-21T06:28:08.278709+0000","last_clean":"2024-09-21T06:28:08.278709+0000","last_became_active":"2024-09-21T06:26:38.977309+0000","last_became_peered":"2024-09-21T06:26:38.977309+0000","last_unstale":"2024-09-21T06:28:08.278709+0000","last_undegraded":"2024-09-21T06:28:08.278709+0000","last_fullsized":"2024-09-21T06:28:08.278709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:10.083264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.269694+0000","last_change":"2024-09-21T06:26:18.302851+0000","last_active":"2024-09-21T06:28:08.269694+0000","last_peered":"2024-09-21T06:28:08.269694+0000","last_clean":"2024-09-21T06:28:08.269694+0000","last_became_active":"2024-09-21T06:26:18.302120+0000","last_became_peered":"2024-09-21T06:26:18.302120+0000","last_unstale":"2024-09-21T06:28:08.269694+0000","last_undegraded":"2024-09-21T06:28:08.269694+0000","last_fullsized":"2024-09-21T06:28:08.269694+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:18.442711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"77'12","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289384+0000","last_change":"2024-09-21T06:26:18.310447+0000","last_active":"2024-09-21T06:28:08.289384+0000","last_peered":"2024-09-21T06:28:08.289384+0000","last_clean":"2024-09-21T06:28:08.289384+0000","last_became_active":"2024-09-21T06:26:18.310079+0000","last_became_peered":"2024-09-21T06:26:18.310079+0000","last_unstale":"2024-09-21T06:28:08.289384+0000","last_undegraded":"2024-09-21T06:28:08.289384+0000","last_fullsized":"2024-09-21T06:28:08.289384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:14.364382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.273523+0000","last_change":"2024-09-21T06:26:18.307260+0000","last_active":"2024-09-21T06:28:08.273523+0000","last_peered":"2024-09-21T06:28:08.273523+0000","last_clean":"2024-09-21T06:28:08.273523+0000","last_became_active":"2024-09-21T06:26:18.306131+0000","last_became_peered":"2024-09-21T06:26:18.306131+0000","last_unstale":"2024-09-21T06:28:08.273523+0000","last_undegraded":"2024-09-21T06:28:08.273523+0000","last_fullsized":"2024-09-21T06:28:08.273523+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:14.746652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.261790+0000","last_change":"2024-09-21T06:26:18.292714+0000","last_active":"2024-09-21T06:28:08.261790+0000","last_peered":"2024-09-21T06:28:08.261790+0000","last_clean":"2024-09-21T06:28:08.261790+0000","last_became_active":"2024-09-21T06:26:18.292322+0000","last_became_peered":"2024-09-21T06:26:18.292322+0000","last_unstale":"2024-09-21T06:28:08.261790+0000","last_undegraded":"2024-09-21T06:28:08.261790+0000","last_fullsized":"2024-09-21T06:28:08.261790+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:51.017455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":136,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:12.922240+0000","last_change":"2024-09-21T06:26:16.269788+0000","last_active":"2024-09-21T06:28:12.922240+0000","last_peered":"2024-09-21T06:28:12.922240+0000","last_clean":"2024-09-21T06:28:12.922240+0000","last_became_active":"2024-09-21T06:26:16.269342+0000","last_became_peered":"2024-09-21T06:26:16.269342+0000","last_unstale":"2024-09-21T06:28:12.922240+0000","last_undegraded":"2024-09-21T06:28:12.922240+0000","last_fullsized":"2024-09-21T06:28:12.922240+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:34.782237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'8","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.272099+0000","last_change":"2024-09-21T06:26:38.970396+0000","last_active":"2024-09-21T06:28:08.272099+0000","last_peered":"2024-09-21T06:28:08.272099+0000","last_clean":"2024-09-21T06:28:08.272099+0000","last_became_active":"2024-09-21T06:26:38.969976+0000","last_became_peered":"2024-09-21T06:26:38.969976+0000","last_unstale":"2024-09-21T06:28:08.272099+0000","last_undegraded":"2024-09-21T06:28:08.272099+0000","last_fullsized":"2024-09-21T06:28:08.272099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:44.540563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,3],"acting":[9,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964833+0000","last_change":"2024-09-21T06:26:16.272832+0000","last_active":"2024-09-21T06:26:38.964833+0000","last_peered":"2024-09-21T06:26:38.964833+0000","last_clean":"2024-09-21T06:26:38.964833+0000","last_became_active":"2024-09-21T06:26:16.272447+0000","last_became_peered":"2024-09-21T06:26:16.272447+0000","last_unstale":"2024-09-21T06:26:38.964833+0000","last_undegraded":"2024-09-21T06:26:38.964833+0000","last_fullsized":"2024-09-21T06:26:38.964833+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:22.836267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966506+0000","last_change":"2024-09-21T06:26:16.269067+0000","last_active":"2024-09-21T06:26:38.966506+0000","last_peered":"2024-09-21T06:26:38.966506+0000","last_clean":"2024-09-21T06:26:38.966506+0000","last_became_active":"2024-09-21T06:26:16.268524+0000","last_became_peered":"2024-09-21T06:26:16.268524+0000","last_unstale":"2024-09-21T06:26:38.966506+0000","last_undegraded":"2024-09-21T06:26:38.966506+0000","last_fullsized":"2024-09-21T06:26:38.966506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:32.224321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.266305+0000","last_change":"2024-09-21T06:26:18.306489+0000","last_active":"2024-09-21T06:28:08.266305+0000","last_peered":"2024-09-21T06:28:08.266305+0000","last_clean":"2024-09-21T06:28:08.266305+0000","last_became_active":"2024-09-21T06:26:18.305883+0000","last_became_peered":"2024-09-21T06:26:18.305883+0000","last_unstale":"2024-09-21T06:28:08.266305+0000","last_undegraded":"2024-09-21T06:28:08.266305+0000","last_fullsized":"2024-09-21T06:28:08.266305+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:54.012308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971279+0000","last_change":"2024-09-21T06:26:16.269793+0000","last_active":"2024-09-21T06:26:38.971279+0000","last_peered":"2024-09-21T06:26:38.971279+0000","last_clean":"2024-09-21T06:26:38.971279+0000","last_became_active":"2024-09-21T06:26:16.269455+0000","last_became_peered":"2024-09-21T06:26:16.269455+0000","last_unstale":"2024-09-21T06:26:38.971279+0000","last_undegraded":"2024-09-21T06:26:38.971279+0000","last_fullsized":"2024-09-21T06:26:38.971279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:44.369742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.279312+0000","last_change":"2024-09-21T06:26:18.297573+0000","last_active":"2024-09-21T06:28:08.279312+0000","last_peered":"2024-09-21T06:28:08.279312+0000","last_clean":"2024-09-21T06:28:08.279312+0000","last_became_active":"2024-09-21T06:26:18.297190+0000","last_became_peered":"2024-09-21T06:26:18.297190+0000","last_unstale":"2024-09-21T06:28:08.279312+0000","last_undegraded":"2024-09-21T06:28:08.279312+0000","last_fullsized":"2024-09-21T06:28:08.279312+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:28.055520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'5","reported_seq":240,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:13.923171+0000","last_change":"2024-09-21T06:26:16.273604+0000","last_active":"2024-09-21T06:28:13.923171+0000","last_peered":"2024-09-21T06:28:13.923171+0000","last_clean":"2024-09-21T06:28:13.923171+0000","last_became_active":"2024-09-21T06:26:16.273194+0000","last_became_peered":"2024-09-21T06:26:16.273194+0000","last_unstale":"2024-09-21T06:28:13.923171+0000","last_undegraded":"2024-09-21T06:28:13.923171+0000","last_fullsized":"2024-09-21T06:28:13.923171+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:08.218442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":212,"num_read_kb":212,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289113+0000","last_change":"2024-09-21T06:26:18.303960+0000","last_active":"2024-09-21T06:28:08.289113+0000","last_peered":"2024-09-21T06:28:08.289113+0000","last_clean":"2024-09-21T06:28:08.289113+0000","last_became_active":"2024-09-21T06:26:18.303550+0000","last_became_peered":"2024-09-21T06:26:18.303550+0000","last_unstale":"2024-09-21T06:28:08.289113+0000","last_undegraded":"2024-09-21T06:28:08.289113+0000","last_fullsized":"2024-09-21T06:28:08.289113+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:47.331439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.978327+0000","last_change":"2024-09-21T06:26:38.978161+0000","last_active":"2024-09-21T06:26:38.978327+0000","last_peered":"2024-09-21T06:26:38.978327+0000","last_clean":"2024-09-21T06:26:38.978327+0000","last_became_active":"2024-09-21T06:26:38.970818+0000","last_became_peered":"2024-09-21T06:26:38.970818+0000","last_unstale":"2024-09-21T06:26:38.978327+0000","last_undegraded":"2024-09-21T06:26:38.978327+0000","last_fullsized":"2024-09-21T06:26:38.978327+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:55.273463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.282065+0000","last_change":"2024-09-21T06:26:18.311643+0000","last_active":"2024-09-21T06:28:08.282065+0000","last_peered":"2024-09-21T06:28:08.282065+0000","last_clean":"2024-09-21T06:28:08.282065+0000","last_became_active":"2024-09-21T06:26:18.311246+0000","last_became_peered":"2024-09-21T06:26:18.311246+0000","last_unstale":"2024-09-21T06:28:08.282065+0000","last_undegraded":"2024-09-21T06:28:08.282065+0000","last_fullsized":"2024-09-21T06:28:08.282065+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:00.342212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971107+0000","last_change":"2024-09-21T06:26:16.313648+0000","last_active":"2024-09-21T06:26:38.971107+0000","last_peered":"2024-09-21T06:26:38.971107+0000","last_clean":"2024-09-21T06:26:38.971107+0000","last_became_active":"2024-09-21T06:26:16.313337+0000","last_became_peered":"2024-09-21T06:26:16.313337+0000","last_unstale":"2024-09-21T06:26:38.971107+0000","last_undegraded":"2024-09-21T06:26:38.971107+0000","last_fullsized":"2024-09-21T06:26:38.971107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:12.095276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289994+0000","last_change":"2024-09-21T06:26:18.310168+0000","last_active":"2024-09-21T06:28:08.289994+0000","last_peered":"2024-09-21T06:28:08.289994+0000","last_clean":"2024-09-21T06:28:08.289994+0000","last_became_active":"2024-09-21T06:26:18.309756+0000","last_became_peered":"2024-09-21T06:26:18.309756+0000","last_unstale":"2024-09-21T06:28:08.289994+0000","last_undegraded":"2024-09-21T06:28:08.289994+0000","last_fullsized":"2024-09-21T06:28:08.289994+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:07.203202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'36","reported_seq":283,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:13.923134+0000","last_change":"2024-09-21T06:26:16.270243+0000","last_active":"2024-09-21T06:28:13.923134+0000","last_peered":"2024-09-21T06:28:13.923134+0000","last_clean":"2024-09-21T06:28:13.923134+0000","last_became_active":"2024-09-21T06:26:16.269883+0000","last_became_peered":"2024-09-21T06:26:16.269883+0000","last_unstale":"2024-09-21T06:28:13.923134+0000","last_undegraded":"2024-09-21T06:28:13.923134+0000","last_fullsized":"2024-09-21T06:28:13.923134+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:55.906972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67005,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":224,"num_read_kb":177,"num_write":38,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.284918+0000","last_change":"2024-09-21T06:26:18.305508+0000","last_active":"2024-09-21T06:28:08.284918+0000","last_peered":"2024-09-21T06:28:08.284918+0000","last_clean":"2024-09-21T06:28:08.284918+0000","last_became_active":"2024-09-21T06:26:18.305104+0000","last_became_peered":"2024-09-21T06:26:18.305104+0000","last_unstale":"2024-09-21T06:28:08.284918+0000","last_undegraded":"2024-09-21T06:28:08.284918+0000","last_fullsized":"2024-09-21T06:28:08.284918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:14.727084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'9","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.969025+0000","last_change":"2024-09-21T06:26:16.268331+0000","last_active":"2024-09-21T06:26:38.969025+0000","last_peered":"2024-09-21T06:26:38.969025+0000","last_clean":"2024-09-21T06:26:38.969025+0000","last_became_active":"2024-09-21T06:26:16.267918+0000","last_became_peered":"2024-09-21T06:26:16.267918+0000","last_unstale":"2024-09-21T06:26:38.969025+0000","last_undegraded":"2024-09-21T06:26:38.969025+0000","last_fullsized":"2024-09-21T06:26:38.969025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:50.198883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.277857+0000","last_change":"2024-09-21T06:26:18.298052+0000","last_active":"2024-09-21T06:28:08.277857+0000","last_peered":"2024-09-21T06:28:08.277857+0000","last_clean":"2024-09-21T06:28:08.277857+0000","last_became_active":"2024-09-21T06:26:18.297686+0000","last_became_peered":"2024-09-21T06:26:18.297686+0000","last_unstale":"2024-09-21T06:28:08.277857+0000","last_undegraded":"2024-09-21T06:28:08.277857+0000","last_fullsized":"2024-09-21T06:28:08.277857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:56.261608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.970277+0000","last_change":"2024-09-21T06:26:16.270917+0000","last_active":"2024-09-21T06:26:38.970277+0000","last_peered":"2024-09-21T06:26:38.970277+0000","last_clean":"2024-09-21T06:26:38.970277+0000","last_became_active":"2024-09-21T06:26:16.270530+0000","last_became_peered":"2024-09-21T06:26:16.270530+0000","last_unstale":"2024-09-21T06:26:38.970277+0000","last_undegraded":"2024-09-21T06:26:38.970277+0000","last_fullsized":"2024-09-21T06:26:38.970277+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:30.772991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.285302+0000","last_change":"2024-09-21T06:26:18.302286+0000","last_active":"2024-09-21T06:28:08.285302+0000","last_peered":"2024-09-21T06:28:08.285302+0000","last_clean":"2024-09-21T06:28:08.285302+0000","last_became_active":"2024-09-21T06:26:18.301777+0000","last_became_peered":"2024-09-21T06:26:18.301777+0000","last_unstale":"2024-09-21T06:28:08.285302+0000","last_undegraded":"2024-09-21T06:28:08.285302+0000","last_fullsized":"2024-09-21T06:28:08.285302+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:31.339898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'7","reported_seq":138,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:10.919997+0000","last_change":"2024-09-21T06:26:16.267569+0000","last_active":"2024-09-21T06:28:10.919997+0000","last_peered":"2024-09-21T06:28:10.919997+0000","last_clean":"2024-09-21T06:28:10.919997+0000","last_became_active":"2024-09-21T06:26:16.267198+0000","last_became_peered":"2024-09-21T06:26:16.267198+0000","last_unstale":"2024-09-21T06:28:10.919997+0000","last_undegraded":"2024-09-21T06:28:10.919997+0000","last_fullsized":"2024-09-21T06:28:10.919997+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:16.323246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.276222+0000","last_change":"2024-09-21T06:26:18.294473+0000","last_active":"2024-09-21T06:28:08.276222+0000","last_peered":"2024-09-21T06:28:08.276222+0000","last_clean":"2024-09-21T06:28:08.276222+0000","last_became_active":"2024-09-21T06:26:18.294010+0000","last_became_peered":"2024-09-21T06:26:18.294010+0000","last_unstale":"2024-09-21T06:28:08.276222+0000","last_undegraded":"2024-09-21T06:28:08.276222+0000","last_fullsized":"2024-09-21T06:28:08.276222+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:12.098589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'17","reported_seq":66,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.994281+0000","last_change":"2024-09-21T06:26:38.994178+0000","last_active":"2024-09-21T06:26:38.994281+0000","last_peered":"2024-09-21T06:26:38.994281+0000","last_clean":"2024-09-21T06:26:38.994281+0000","last_became_active":"2024-09-21T06:26:38.977865+0000","last_became_peered":"2024-09-21T06:26:38.977865+0000","last_unstale":"2024-09-21T06:26:38.994281+0000","last_undegraded":"2024-09-21T06:26:38.994281+0000","last_fullsized":"2024-09-21T06:26:38.994281+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:44.368499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.290725+0000","last_change":"2024-09-21T06:26:18.312319+0000","last_active":"2024-09-21T06:28:08.290725+0000","last_peered":"2024-09-21T06:28:08.290725+0000","last_clean":"2024-09-21T06:28:08.290725+0000","last_became_active":"2024-09-21T06:26:18.311949+0000","last_became_peered":"2024-09-21T06:26:18.311949+0000","last_unstale":"2024-09-21T06:28:08.290725+0000","last_undegraded":"2024-09-21T06:28:08.290725+0000","last_fullsized":"2024-09-21T06:28:08.290725+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:49.729693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964667+0000","last_change":"2024-09-21T06:26:16.273771+0000","last_active":"2024-09-21T06:26:38.964667+0000","last_peered":"2024-09-21T06:26:38.964667+0000","last_clean":"2024-09-21T06:26:38.964667+0000","last_became_active":"2024-09-21T06:26:16.273293+0000","last_became_peered":"2024-09-21T06:26:16.273293+0000","last_unstale":"2024-09-21T06:26:38.964667+0000","last_undegraded":"2024-09-21T06:26:38.964667+0000","last_fullsized":"2024-09-21T06:26:38.964667+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:21.867844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289127+0000","last_change":"2024-09-21T06:26:18.309204+0000","last_active":"2024-09-21T06:28:08.289127+0000","last_peered":"2024-09-21T06:28:08.289127+0000","last_clean":"2024-09-21T06:28:08.289127+0000","last_became_active":"2024-09-21T06:26:18.308838+0000","last_became_peered":"2024-09-21T06:26:18.308838+0000","last_unstale":"2024-09-21T06:28:08.289127+0000","last_undegraded":"2024-09-21T06:28:08.289127+0000","last_fullsized":"2024-09-21T06:28:08.289127+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:14.011799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'5","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965404+0000","last_change":"2024-09-21T06:26:16.267965+0000","last_active":"2024-09-21T06:26:38.965404+0000","last_peered":"2024-09-21T06:26:38.965404+0000","last_clean":"2024-09-21T06:26:38.965404+0000","last_became_active":"2024-09-21T06:26:16.267548+0000","last_became_peered":"2024-09-21T06:26:16.267548+0000","last_unstale":"2024-09-21T06:26:38.965404+0000","last_undegraded":"2024-09-21T06:26:38.965404+0000","last_fullsized":"2024-09-21T06:26:38.965404+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:51.915817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.277230+0000","last_change":"2024-09-21T06:26:18.306376+0000","last_active":"2024-09-21T06:28:08.277230+0000","last_peered":"2024-09-21T06:28:08.277230+0000","last_clean":"2024-09-21T06:28:08.277230+0000","last_became_active":"2024-09-21T06:26:18.305956+0000","last_became_peered":"2024-09-21T06:26:18.305956+0000","last_unstale":"2024-09-21T06:28:08.277230+0000","last_undegraded":"2024-09-21T06:28:08.277230+0000","last_fullsized":"2024-09-21T06:28:08.277230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:27.229499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971383+0000","last_change":"2024-09-21T06:26:16.267201+0000","last_active":"2024-09-21T06:26:38.971383+0000","last_peered":"2024-09-21T06:26:38.971383+0000","last_clean":"2024-09-21T06:26:38.971383+0000","last_became_active":"2024-09-21T06:26:16.266832+0000","last_became_peered":"2024-09-21T06:26:16.266832+0000","last_unstale":"2024-09-21T06:26:38.971383+0000","last_undegraded":"2024-09-21T06:26:38.971383+0000","last_fullsized":"2024-09-21T06:26:38.971383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:48.626106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'7","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.275329+0000","last_change":"2024-09-21T06:26:38.984119+0000","last_active":"2024-09-21T06:28:08.275329+0000","last_peered":"2024-09-21T06:28:08.275329+0000","last_clean":"2024-09-21T06:28:08.275329+0000","last_became_active":"2024-09-21T06:26:38.972316+0000","last_became_peered":"2024-09-21T06:26:38.972316+0000","last_unstale":"2024-09-21T06:28:08.275329+0000","last_undegraded":"2024-09-21T06:28:08.275329+0000","last_fullsized":"2024-09-21T06:28:08.275329+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:22.788293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'7","reported_seq":137,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:09.917830+0000","last_change":"2024-09-21T06:26:16.572993+0000","last_active":"2024-09-21T06:28:09.917830+0000","last_peered":"2024-09-21T06:28:09.917830+0000","last_clean":"2024-09-21T06:28:09.917830+0000","last_became_active":"2024-09-21T06:26:16.572631+0000","last_became_peered":"2024-09-21T06:26:16.572631+0000","last_unstale":"2024-09-21T06:28:09.917830+0000","last_undegraded":"2024-09-21T06:28:09.917830+0000","last_fullsized":"2024-09-21T06:28:09.917830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:05.276119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289284+0000","last_change":"2024-09-21T06:26:18.304685+0000","last_active":"2024-09-21T06:28:08.289284+0000","last_peered":"2024-09-21T06:28:08.289284+0000","last_clean":"2024-09-21T06:28:08.289284+0000","last_became_active":"2024-09-21T06:26:18.304325+0000","last_became_peered":"2024-09-21T06:26:18.304325+0000","last_unstale":"2024-09-21T06:28:08.289284+0000","last_undegraded":"2024-09-21T06:28:08.289284+0000","last_fullsized":"2024-09-21T06:28:08.289284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:18.072602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":99,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965252+0000","last_change":"2024-09-21T06:25:04.875443+0000","last_active":"2024-09-21T06:26:38.965252+0000","last_peered":"2024-09-21T06:26:38.965252+0000","last_clean":"2024-09-21T06:26:38.965252+0000","last_became_active":"2024-09-21T06:25:04.869179+0000","last_became_peered":"2024-09-21T06:25:04.869179+0000","last_unstale":"2024-09-21T06:26:38.965252+0000","last_undegraded":"2024-09-21T06:26:38.965252+0000","last_fullsized":"2024-09-21T06:26:38.965252+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:21:37.191501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:21:37.191501+0000","last_clean_scrub_stamp":"2024-09-21T06:21:37.191501+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:19.981367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'6","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962414+0000","last_change":"2024-09-21T06:26:16.268440+0000","last_active":"2024-09-21T06:26:38.962414+0000","last_peered":"2024-09-21T06:26:38.962414+0000","last_clean":"2024-09-21T06:26:38.962414+0000","last_became_active":"2024-09-21T06:26:16.268078+0000","last_became_peered":"2024-09-21T06:26:16.268078+0000","last_unstale":"2024-09-21T06:26:38.962414+0000","last_undegraded":"2024-09-21T06:26:38.962414+0000","last_fullsized":"2024-09-21T06:26:38.962414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:55.696736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.273786+0000","last_change":"2024-09-21T06:26:18.306410+0000","last_active":"2024-09-21T06:28:08.273786+0000","last_peered":"2024-09-21T06:28:08.273786+0000","last_clean":"2024-09-21T06:28:08.273786+0000","last_became_active":"2024-09-21T06:26:18.304718+0000","last_became_peered":"2024-09-21T06:26:18.304718+0000","last_unstale":"2024-09-21T06:28:08.273786+0000","last_undegraded":"2024-09-21T06:28:08.273786+0000","last_fullsized":"2024-09-21T06:28:08.273786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:18.521867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964484+0000","last_change":"2024-09-21T06:26:16.270305+0000","last_active":"2024-09-21T06:26:38.964484+0000","last_peered":"2024-09-21T06:26:38.964484+0000","last_clean":"2024-09-21T06:26:38.964484+0000","last_became_active":"2024-09-21T06:26:16.269891+0000","last_became_peered":"2024-09-21T06:26:16.269891+0000","last_unstale":"2024-09-21T06:26:38.964484+0000","last_undegraded":"2024-09-21T06:26:38.964484+0000","last_fullsized":"2024-09-21T06:26:38.964484+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:48.575805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.281410+0000","last_change":"2024-09-21T06:26:18.302404+0000","last_active":"2024-09-21T06:28:08.281410+0000","last_peered":"2024-09-21T06:28:08.281410+0000","last_clean":"2024-09-21T06:28:08.281410+0000","last_became_active":"2024-09-21T06:26:18.302036+0000","last_became_peered":"2024-09-21T06:26:18.302036+0000","last_unstale":"2024-09-21T06:28:08.281410+0000","last_undegraded":"2024-09-21T06:28:08.281410+0000","last_fullsized":"2024-09-21T06:28:08.281410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:36.688018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'6","reported_seq":137,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:13.923815+0000","last_change":"2024-09-21T06:26:16.310996+0000","last_active":"2024-09-21T06:28:13.923815+0000","last_peered":"2024-09-21T06:28:13.923815+0000","last_clean":"2024-09-21T06:28:13.923815+0000","last_became_active":"2024-09-21T06:26:16.310566+0000","last_became_peered":"2024-09-21T06:26:16.310566+0000","last_unstale":"2024-09-21T06:28:13.923815+0000","last_undegraded":"2024-09-21T06:28:13.923815+0000","last_fullsized":"2024-09-21T06:28:13.923815+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:27.569789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.290666+0000","last_change":"2024-09-21T06:26:18.310343+0000","last_active":"2024-09-21T06:28:08.290666+0000","last_peered":"2024-09-21T06:28:08.290666+0000","last_clean":"2024-09-21T06:28:08.290666+0000","last_became_active":"2024-09-21T06:26:18.309979+0000","last_became_peered":"2024-09-21T06:26:18.309979+0000","last_unstale":"2024-09-21T06:28:08.290666+0000","last_undegraded":"2024-09-21T06:28:08.290666+0000","last_fullsized":"2024-09-21T06:28:08.290666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:20.340822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'6","reported_seq":116,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:13.113157+0000","last_change":"2024-09-21T06:26:38.974313+0000","last_active":"2024-09-21T06:28:13.113157+0000","last_peered":"2024-09-21T06:28:13.113157+0000","last_clean":"2024-09-21T06:28:13.113157+0000","last_became_active":"2024-09-21T06:26:38.966498+0000","last_became_peered":"2024-09-21T06:26:38.966498+0000","last_unstale":"2024-09-21T06:28:13.113157+0000","last_undegraded":"2024-09-21T06:28:13.113157+0000","last_fullsized":"2024-09-21T06:28:13.113157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:56.732330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":588,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.282499+0000","last_change":"2024-09-21T06:26:18.312080+0000","last_active":"2024-09-21T06:28:08.282499+0000","last_peered":"2024-09-21T06:28:08.282499+0000","last_clean":"2024-09-21T06:28:08.282499+0000","last_became_active":"2024-09-21T06:26:18.311351+0000","last_became_peered":"2024-09-21T06:26:18.311351+0000","last_unstale":"2024-09-21T06:28:08.282499+0000","last_undegraded":"2024-09-21T06:28:08.282499+0000","last_fullsized":"2024-09-21T06:28:08.282499+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:33.545677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965339+0000","last_change":"2024-09-21T06:26:16.311108+0000","last_active":"2024-09-21T06:26:38.965339+0000","last_peered":"2024-09-21T06:26:38.965339+0000","last_clean":"2024-09-21T06:26:38.965339+0000","last_became_active":"2024-09-21T06:26:16.310595+0000","last_became_peered":"2024-09-21T06:26:16.310595+0000","last_unstale":"2024-09-21T06:26:38.965339+0000","last_undegraded":"2024-09-21T06:26:38.965339+0000","last_fullsized":"2024-09-21T06:26:38.965339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:43.125242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.277932+0000","last_change":"2024-09-21T06:26:18.300618+0000","last_active":"2024-09-21T06:28:08.277932+0000","last_peered":"2024-09-21T06:28:08.277932+0000","last_clean":"2024-09-21T06:28:08.277932+0000","last_became_active":"2024-09-21T06:26:18.300234+0000","last_became_peered":"2024-09-21T06:26:18.300234+0000","last_unstale":"2024-09-21T06:28:08.277932+0000","last_undegraded":"2024-09-21T06:28:08.277932+0000","last_fullsized":"2024-09-21T06:28:08.277932+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:53.224425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'4","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.982480+0000","last_change":"2024-09-21T06:26:38.981999+0000","last_active":"2024-09-21T06:26:38.982480+0000","last_peered":"2024-09-21T06:26:38.982480+0000","last_clean":"2024-09-21T06:26:38.982480+0000","last_became_active":"2024-09-21T06:26:38.969199+0000","last_became_peered":"2024-09-21T06:26:38.969199+0000","last_unstale":"2024-09-21T06:26:38.982480+0000","last_undegraded":"2024-09-21T06:26:38.982480+0000","last_fullsized":"2024-09-21T06:26:38.982480+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:17.389262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.276443+0000","last_change":"2024-09-21T06:26:18.297693+0000","last_active":"2024-09-21T06:28:08.276443+0000","last_peered":"2024-09-21T06:28:08.276443+0000","last_clean":"2024-09-21T06:28:08.276443+0000","last_became_active":"2024-09-21T06:26:18.297335+0000","last_became_peered":"2024-09-21T06:26:18.297335+0000","last_unstale":"2024-09-21T06:28:08.276443+0000","last_undegraded":"2024-09-21T06:28:08.276443+0000","last_fullsized":"2024-09-21T06:28:08.276443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:30.144220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'17","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.307206+0000","last_change":"2024-09-21T06:26:16.269854+0000","last_active":"2024-09-21T06:28:08.307206+0000","last_peered":"2024-09-21T06:28:08.307206+0000","last_clean":"2024-09-21T06:28:08.307206+0000","last_became_active":"2024-09-21T06:26:16.269415+0000","last_became_peered":"2024-09-21T06:26:16.269415+0000","last_unstale":"2024-09-21T06:28:08.307206+0000","last_undegraded":"2024-09-21T06:28:08.307206+0000","last_fullsized":"2024-09-21T06:28:08.307206+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:50.525916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.270328+0000","last_change":"2024-09-21T06:26:18.306302+0000","last_active":"2024-09-21T06:28:08.270328+0000","last_peered":"2024-09-21T06:28:08.270328+0000","last_clean":"2024-09-21T06:28:08.270328+0000","last_became_active":"2024-09-21T06:26:18.305723+0000","last_became_peered":"2024-09-21T06:26:18.305723+0000","last_unstale":"2024-09-21T06:28:08.270328+0000","last_undegraded":"2024-09-21T06:28:08.270328+0000","last_fullsized":"2024-09-21T06:28:08.270328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:30.051791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'7","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962517+0000","last_change":"2024-09-21T06:26:16.573081+0000","last_active":"2024-09-21T06:26:38.962517+0000","last_peered":"2024-09-21T06:26:38.962517+0000","last_clean":"2024-09-21T06:26:38.962517+0000","last_became_active":"2024-09-21T06:26:16.572680+0000","last_became_peered":"2024-09-21T06:26:16.572680+0000","last_unstale":"2024-09-21T06:26:38.962517+0000","last_undegraded":"2024-09-21T06:26:38.962517+0000","last_fullsized":"2024-09-21T06:26:38.962517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:04.698258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.282159+0000","last_change":"2024-09-21T06:26:18.311610+0000","last_active":"2024-09-21T06:28:08.282159+0000","last_peered":"2024-09-21T06:28:08.282159+0000","last_clean":"2024-09-21T06:28:08.282159+0000","last_became_active":"2024-09-21T06:26:18.311239+0000","last_became_peered":"2024-09-21T06:26:18.311239+0000","last_unstale":"2024-09-21T06:28:08.282159+0000","last_undegraded":"2024-09-21T06:28:08.282159+0000","last_fullsized":"2024-09-21T06:28:08.282159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:36.995768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965260+0000","last_change":"2024-09-21T06:26:16.313612+0000","last_active":"2024-09-21T06:26:38.965260+0000","last_peered":"2024-09-21T06:26:38.965260+0000","last_clean":"2024-09-21T06:26:38.965260+0000","last_became_active":"2024-09-21T06:26:16.313298+0000","last_became_peered":"2024-09-21T06:26:16.313298+0000","last_unstale":"2024-09-21T06:26:38.965260+0000","last_undegraded":"2024-09-21T06:26:38.965260+0000","last_fullsized":"2024-09-21T06:26:38.965260+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:45.035454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.235394+0000","last_change":"2024-09-21T06:26:18.304772+0000","last_active":"2024-09-21T06:28:08.235394+0000","last_peered":"2024-09-21T06:28:08.235394+0000","last_clean":"2024-09-21T06:28:08.235394+0000","last_became_active":"2024-09-21T06:26:18.303909+0000","last_became_peered":"2024-09-21T06:26:18.303909+0000","last_unstale":"2024-09-21T06:28:08.235394+0000","last_undegraded":"2024-09-21T06:28:08.235394+0000","last_fullsized":"2024-09-21T06:28:08.235394+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:28.707169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963811+0000","last_change":"2024-09-21T06:26:16.267563+0000","last_active":"2024-09-21T06:26:38.963811+0000","last_peered":"2024-09-21T06:26:38.963811+0000","last_clean":"2024-09-21T06:26:38.963811+0000","last_became_active":"2024-09-21T06:26:16.267182+0000","last_became_peered":"2024-09-21T06:26:16.267182+0000","last_unstale":"2024-09-21T06:26:38.963811+0000","last_undegraded":"2024-09-21T06:26:38.963811+0000","last_fullsized":"2024-09-21T06:26:38.963811+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:16.042105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.278136+0000","last_change":"2024-09-21T06:26:18.310772+0000","last_active":"2024-09-21T06:28:08.278136+0000","last_peered":"2024-09-21T06:28:08.278136+0000","last_clean":"2024-09-21T06:28:08.278136+0000","last_became_active":"2024-09-21T06:26:18.310382+0000","last_became_peered":"2024-09-21T06:26:18.310382+0000","last_unstale":"2024-09-21T06:28:08.278136+0000","last_undegraded":"2024-09-21T06:28:08.278136+0000","last_fullsized":"2024-09-21T06:28:08.278136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:54:35.028081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967712+0000","last_change":"2024-09-21T06:26:16.270971+0000","last_active":"2024-09-21T06:26:38.967712+0000","last_peered":"2024-09-21T06:26:38.967712+0000","last_clean":"2024-09-21T06:26:38.967712+0000","last_became_active":"2024-09-21T06:26:16.270453+0000","last_became_peered":"2024-09-21T06:26:16.270453+0000","last_unstale":"2024-09-21T06:26:38.967712+0000","last_undegraded":"2024-09-21T06:26:38.967712+0000","last_fullsized":"2024-09-21T06:26:38.967712+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:34.687380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.277706+0000","last_change":"2024-09-21T06:26:18.300568+0000","last_active":"2024-09-21T06:28:08.277706+0000","last_peered":"2024-09-21T06:28:08.277706+0000","last_clean":"2024-09-21T06:28:08.277706+0000","last_became_active":"2024-09-21T06:26:18.298864+0000","last_became_peered":"2024-09-21T06:26:18.298864+0000","last_unstale":"2024-09-21T06:28:08.277706+0000","last_undegraded":"2024-09-21T06:28:08.277706+0000","last_fullsized":"2024-09-21T06:28:08.277706+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:00.786225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964246+0000","last_change":"2024-09-21T06:26:16.274093+0000","last_active":"2024-09-21T06:26:38.964246+0000","last_peered":"2024-09-21T06:26:38.964246+0000","last_clean":"2024-09-21T06:26:38.964246+0000","last_became_active":"2024-09-21T06:26:16.273707+0000","last_became_peered":"2024-09-21T06:26:16.273707+0000","last_unstale":"2024-09-21T06:26:38.964246+0000","last_undegraded":"2024-09-21T06:26:38.964246+0000","last_fullsized":"2024-09-21T06:26:38.964246+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:26.710260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289024+0000","last_change":"2024-09-21T06:26:18.300140+0000","last_active":"2024-09-21T06:28:08.289024+0000","last_peered":"2024-09-21T06:28:08.289024+0000","last_clean":"2024-09-21T06:28:08.289024+0000","last_became_active":"2024-09-21T06:26:18.299543+0000","last_became_peered":"2024-09-21T06:26:18.299543+0000","last_unstale":"2024-09-21T06:28:08.289024+0000","last_undegraded":"2024-09-21T06:28:08.289024+0000","last_fullsized":"2024-09-21T06:28:08.289024+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:50.272247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.291190+0000","last_change":"2024-09-21T06:26:18.311528+0000","last_active":"2024-09-21T06:28:08.291190+0000","last_peered":"2024-09-21T06:28:08.291190+0000","last_clean":"2024-09-21T06:28:08.291190+0000","last_became_active":"2024-09-21T06:26:18.311144+0000","last_became_peered":"2024-09-21T06:26:18.311144+0000","last_unstale":"2024-09-21T06:28:08.291190+0000","last_undegraded":"2024-09-21T06:28:08.291190+0000","last_fullsized":"2024-09-21T06:28:08.291190+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:05.554255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964467+0000","last_change":"2024-09-21T06:26:16.275378+0000","last_active":"2024-09-21T06:26:38.964467+0000","last_peered":"2024-09-21T06:26:38.964467+0000","last_clean":"2024-09-21T06:26:38.964467+0000","last_became_active":"2024-09-21T06:26:16.274990+0000","last_became_peered":"2024-09-21T06:26:16.274990+0000","last_unstale":"2024-09-21T06:26:38.964467+0000","last_undegraded":"2024-09-21T06:26:38.964467+0000","last_fullsized":"2024-09-21T06:26:38.964467+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:57.252993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289055+0000","last_change":"2024-09-21T06:26:18.300879+0000","last_active":"2024-09-21T06:28:08.289055+0000","last_peered":"2024-09-21T06:28:08.289055+0000","last_clean":"2024-09-21T06:28:08.289055+0000","last_became_active":"2024-09-21T06:26:18.300514+0000","last_became_peered":"2024-09-21T06:26:18.300514+0000","last_unstale":"2024-09-21T06:28:08.289055+0000","last_undegraded":"2024-09-21T06:28:08.289055+0000","last_fullsized":"2024-09-21T06:28:08.289055+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:02.581145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'13","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964587+0000","last_change":"2024-09-21T06:26:16.274139+0000","last_active":"2024-09-21T06:26:38.964587+0000","last_peered":"2024-09-21T06:26:38.964587+0000","last_clean":"2024-09-21T06:26:38.964587+0000","last_became_active":"2024-09-21T06:26:16.273723+0000","last_became_peered":"2024-09-21T06:26:16.273723+0000","last_unstale":"2024-09-21T06:26:38.964587+0000","last_undegraded":"2024-09-21T06:26:38.964587+0000","last_fullsized":"2024-09-21T06:26:38.964587+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:24.366714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.285338+0000","last_change":"2024-09-21T06:26:18.304602+0000","last_active":"2024-09-21T06:28:08.285338+0000","last_peered":"2024-09-21T06:28:08.285338+0000","last_clean":"2024-09-21T06:28:08.285338+0000","last_became_active":"2024-09-21T06:26:18.304259+0000","last_became_peered":"2024-09-21T06:26:18.304259+0000","last_unstale":"2024-09-21T06:28:08.285338+0000","last_undegraded":"2024-09-21T06:28:08.285338+0000","last_fullsized":"2024-09-21T06:28:08.285338+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:16.428247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964281+0000","last_change":"2024-09-21T06:26:16.311107+0000","last_active":"2024-09-21T06:26:38.964281+0000","last_peered":"2024-09-21T06:26:38.964281+0000","last_clean":"2024-09-21T06:26:38.964281+0000","last_became_active":"2024-09-21T06:26:16.310692+0000","last_became_peered":"2024-09-21T06:26:16.310692+0000","last_unstale":"2024-09-21T06:26:38.964281+0000","last_undegraded":"2024-09-21T06:26:38.964281+0000","last_fullsized":"2024-09-21T06:26:38.964281+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:29.074606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.273825+0000","last_change":"2024-09-21T06:26:18.300614+0000","last_active":"2024-09-21T06:28:08.273825+0000","last_peered":"2024-09-21T06:28:08.273825+0000","last_clean":"2024-09-21T06:28:08.273825+0000","last_became_active":"2024-09-21T06:26:18.300173+0000","last_became_peered":"2024-09-21T06:26:18.300173+0000","last_unstale":"2024-09-21T06:28:08.273825+0000","last_undegraded":"2024-09-21T06:28:08.273825+0000","last_fullsized":"2024-09-21T06:28:08.273825+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:49.040667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'14","reported_seq":163,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:12.110097+0000","last_change":"2024-09-21T06:26:38.986822+0000","last_active":"2024-09-21T06:28:12.110097+0000","last_peered":"2024-09-21T06:28:12.110097+0000","last_clean":"2024-09-21T06:28:12.110097+0000","last_became_active":"2024-09-21T06:26:38.972368+0000","last_became_peered":"2024-09-21T06:26:38.972368+0000","last_unstale":"2024-09-21T06:28:12.110097+0000","last_undegraded":"2024-09-21T06:28:12.110097+0000","last_fullsized":"2024-09-21T06:28:12.110097+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:53.273388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74799,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1083,"num_read_kb":627,"num_write":262,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1484,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":223473,"data_compressed":4914,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282590,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743460,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":421215,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939690,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1007616,"data_stored":1078241,"data_compressed":43480,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103215,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":876544,"data_stored":419722,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299444,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":419199,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495673,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":1012054,"data_compressed":41842,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659199,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":419630,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855428,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":1011788,"data_compressed":41842,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018952,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":864256,"data_stored":419827,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182476,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":419030,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378707,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":487572,"data_compressed":7539,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542232,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":929792,"data_stored":487604,"data_compressed":7539,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705756,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":876544,"data_stored":421193,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":69121,"data_compressed":1638,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":69089,"data_compressed":1638,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":69273,"data_compressed":1638,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:28:16.860 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-21T06:28:16.860 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:28:17.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.010+0000 7fd69fc06640 1 -- 172.21.15.63:0/1455022073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6981047c0 msgr2=0x7fd698104bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:17.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.010+0000 7fd69fc06640 1 --2- 172.21.15.63:0/1455022073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6981047c0 0x7fd698104bd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd694009900 tx=0x7fd69402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:17.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.010+0000 7fd69fc06640 1 -- 172.21.15.63:0/1455022073 shutdown_connections 2024-09-21T06:28:17.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.010+0000 7fd69fc06640 1 --2- 172.21.15.63:0/1455022073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd69810dd70 0x7fd698110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:17.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.010+0000 7fd69fc06640 1 --2- 172.21.15.63:0/1455022073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6981051f0 0x7fd69810d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:17.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.010+0000 7fd69fc06640 1 --2- 172.21.15.63:0/1455022073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6981047c0 0x7fd698104bd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:17.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.010+0000 7fd69fc06640 1 -- 172.21.15.63:0/1455022073 >> 172.21.15.63:0/1455022073 conn(0x7fd6980fe3b0 msgr2=0x7fd698100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:17.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.010+0000 7fd69fc06640 1 -- 172.21.15.63:0/1455022073 shutdown_connections 2024-09-21T06:28:17.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.010+0000 7fd69fc06640 1 -- 172.21.15.63:0/1455022073 wait complete. 2024-09-21T06:28:17.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.011+0000 7fd69fc06640 1 Processor -- start 2024-09-21T06:28:17.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.011+0000 7fd69fc06640 1 -- start start 2024-09-21T06:28:17.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.011+0000 7fd69fc06640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6981047c0 0x7fd69819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:17.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.011+0000 7fd69fc06640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6981051f0 0x7fd69819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:17.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.011+0000 7fd69fc06640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd69810dd70 0x7fd69819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:17.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.011+0000 7fd69fc06640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd6981139d0 con 0x7fd69810dd70 2024-09-21T06:28:17.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.011+0000 7fd69fc06640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd698113850 con 0x7fd6981051f0 2024-09-21T06:28:17.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.011+0000 7fd69fc06640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd698113b50 con 0x7fd6981047c0 2024-09-21T06:28:17.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.011+0000 7fd69e1a3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd69810dd70 0x7fd69819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:17.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.011+0000 7fd69e1a3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd69810dd70 0x7fd69819fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37610/0 (socket says 172.21.15.63:37610) 2024-09-21T06:28:17.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.011+0000 7fd69e1a3640 1 -- 172.21.15.63:0/3632631041 learned_addr learned my addr 172.21.15.63:0/3632631041 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:17.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.011+0000 7fd69d9a2640 1 --2- 172.21.15.63:0/3632631041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6981047c0 0x7fd69819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:17.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.011+0000 7fd69d1a1640 1 --2- 172.21.15.63:0/3632631041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6981051f0 0x7fd69819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:17.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.011+0000 7fd69e1a3640 1 -- 172.21.15.63:0/3632631041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6981047c0 msgr2=0x7fd69819a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:17.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.011+0000 7fd69e1a3640 1 --2- 172.21.15.63:0/3632631041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6981047c0 0x7fd69819a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:17.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.011+0000 7fd69e1a3640 1 -- 172.21.15.63:0/3632631041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6981051f0 msgr2=0x7fd69819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:17.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.011+0000 7fd69e1a3640 1 --2- 172.21.15.63:0/3632631041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6981051f0 0x7fd69819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:17.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.011+0000 7fd69e1a3640 1 -- 172.21.15.63:0/3632631041 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6981a03c0 con 0x7fd69810dd70 2024-09-21T06:28:17.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.012+0000 7fd69e1a3640 1 --2- 172.21.15.63:0/3632631041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd69810dd70 0x7fd69819fcc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd69000eaa0 tx=0x7fd69000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:17.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.012+0000 7fd68effd640 1 -- 172.21.15.63:0/3632631041 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69000cdb0 con 0x7fd69810dd70 2024-09-21T06:28:17.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.012+0000 7fd68effd640 1 -- 172.21.15.63:0/3632631041 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd690005020 con 0x7fd69810dd70 2024-09-21T06:28:17.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.012+0000 7fd69fc06640 1 -- 172.21.15.63:0/3632631041 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6981a06b0 con 0x7fd69810dd70 2024-09-21T06:28:17.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.012+0000 7fd68effd640 1 -- 172.21.15.63:0/3632631041 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6900116d0 con 0x7fd69810dd70 2024-09-21T06:28:17.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.012+0000 7fd69fc06640 1 -- 172.21.15.63:0/3632631041 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6981a6e40 con 0x7fd69810dd70 2024-09-21T06:28:17.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.013+0000 7fd69fc06640 1 -- 172.21.15.63:0/3632631041 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd698104bd0 con 0x7fd69810dd70 2024-09-21T06:28:17.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.014+0000 7fd68effd640 1 -- 172.21.15.63:0/3632631041 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fd6900051d0 con 0x7fd69810dd70 2024-09-21T06:28:17.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.015+0000 7fd68effd640 1 --2- 172.21.15.63:0/3632631041 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd6840b6560 0x7fd6840b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:17.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.016+0000 7fd69d9a2640 1 --2- 172.21.15.63:0/3632631041 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd6840b6560 0x7fd6840b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:17.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.016+0000 7fd68effd640 1 -- 172.21.15.63:0/3632631041 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fd6900e74a0 con 0x7fd69810dd70 2024-09-21T06:28:17.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.016+0000 7fd69d9a2640 1 --2- 172.21.15.63:0/3632631041 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd6840b6560 0x7fd6840b8a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd694031440 tx=0x7fd694009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:17.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.020+0000 7fd68effd640 1 -- 172.21.15.63:0/3632631041 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd690016030 con 0x7fd69810dd70 2024-09-21T06:28:17.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.204+0000 7fd69fc06640 1 -- 172.21.15.63:0/3632631041 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd698107fe0 con 0x7fd6840b6560 2024-09-21T06:28:17.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.208+0000 7fd68effd640 1 -- 172.21.15.63:0/3632631041 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259272 (secure 0 0 0) 0x7fd698107fe0 con 0x7fd6840b6560 2024-09-21T06:28:17.213 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:28:17.214 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T06:28:17.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.211+0000 7fd69fc06640 1 -- 172.21.15.63:0/3632631041 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd6840b6560 msgr2=0x7fd6840b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:17.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.211+0000 7fd69fc06640 1 --2- 172.21.15.63:0/3632631041 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd6840b6560 0x7fd6840b8a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd694031440 tx=0x7fd694009560 comp rx=0 tx=0).stop 2024-09-21T06:28:17.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.211+0000 7fd69fc06640 1 -- 172.21.15.63:0/3632631041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd69810dd70 msgr2=0x7fd69819fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:17.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.211+0000 7fd69fc06640 1 --2- 172.21.15.63:0/3632631041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd69810dd70 0x7fd69819fcc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd69000eaa0 tx=0x7fd69000ef60 comp rx=0 tx=0).stop 2024-09-21T06:28:17.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.211+0000 7fd69fc06640 1 -- 172.21.15.63:0/3632631041 shutdown_connections 2024-09-21T06:28:17.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.211+0000 7fd69fc06640 1 --2- 172.21.15.63:0/3632631041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd69810dd70 0x7fd69819fcc0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:17.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.211+0000 7fd69fc06640 1 --2- 172.21.15.63:0/3632631041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6981051f0 0x7fd69819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:17.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.211+0000 7fd69fc06640 1 --2- 172.21.15.63:0/3632631041 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd6840b6560 0x7fd6840b8a70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:17.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.211+0000 7fd69fc06640 1 --2- 172.21.15.63:0/3632631041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6981047c0 0x7fd69819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:17.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.211+0000 7fd69fc06640 1 -- 172.21.15.63:0/3632631041 >> 172.21.15.63:0/3632631041 conn(0x7fd6980fe3b0 msgr2=0x7fd6981078d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:17.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.212+0000 7fd69fc06640 1 -- 172.21.15.63:0/3632631041 shutdown_connections 2024-09-21T06:28:17.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.212+0000 7fd69fc06640 1 -- 172.21.15.63:0/3632631041 wait complete. 2024-09-21T06:28:17.224 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:17 smithi063 ceph-mon[31150]: pgmap v324: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-21T06:28:17.224 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:17 smithi063 ceph-mon[31150]: from='client.15474 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:28:17.225 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-09-21T06:28:15.896931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665401,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1164,"num_read_kb":696,"num_write":387,"num_write_kb":2308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":2953441,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":818,"ondisk_log_size":818,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380572,"kb_used_data":10524,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561252,"statfs":{"total":1151940427776,"available":1151550722048,"internally_reserved":0,"allocated":10776576,"data_stored":7017075,"data_compressed":183549,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1147,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":75,"num_write":16,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003565"},"pg_stats":[{"pgid":"3.3f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.282041+0000","last_change":"2024-09-21T06:26:18.307729+0000","last_active":"2024-09-21T06:28:08.282041+0000","last_peered":"2024-09-21T06:28:08.282041+0000","last_clean":"2024-09-21T06:28:08.282041+0000","last_became_active":"2024-09-21T06:26:18.306345+0000","last_became_peered":"2024-09-21T06:26:18.306345+0000","last_unstale":"2024-09-21T06:28:08.282041+0000","last_undegraded":"2024-09-21T06:28:08.282041+0000","last_fullsized":"2024-09-21T06:28:08.282041+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:58.409506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.286762+0000","last_change":"2024-09-21T06:26:18.302982+0000","last_active":"2024-09-21T06:28:08.286762+0000","last_peered":"2024-09-21T06:28:08.286762+0000","last_clean":"2024-09-21T06:28:08.286762+0000","last_became_active":"2024-09-21T06:26:18.302636+0000","last_became_peered":"2024-09-21T06:26:18.302636+0000","last_unstale":"2024-09-21T06:28:08.286762+0000","last_undegraded":"2024-09-21T06:28:08.286762+0000","last_fullsized":"2024-09-21T06:28:08.286762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:28.165964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.285733+0000","last_change":"2024-09-21T06:26:18.305293+0000","last_active":"2024-09-21T06:28:08.285733+0000","last_peered":"2024-09-21T06:28:08.285733+0000","last_clean":"2024-09-21T06:28:08.285733+0000","last_became_active":"2024-09-21T06:26:18.304689+0000","last_became_peered":"2024-09-21T06:26:18.304689+0000","last_unstale":"2024-09-21T06:28:08.285733+0000","last_undegraded":"2024-09-21T06:28:08.285733+0000","last_fullsized":"2024-09-21T06:28:08.285733+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:37.442558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.290851+0000","last_change":"2024-09-21T06:26:18.306443+0000","last_active":"2024-09-21T06:28:08.290851+0000","last_peered":"2024-09-21T06:28:08.290851+0000","last_clean":"2024-09-21T06:28:08.290851+0000","last_became_active":"2024-09-21T06:26:18.305062+0000","last_became_peered":"2024-09-21T06:26:18.305062+0000","last_unstale":"2024-09-21T06:28:08.290851+0000","last_undegraded":"2024-09-21T06:28:08.290851+0000","last_fullsized":"2024-09-21T06:28:08.290851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:07.896971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.257044+0000","last_change":"2024-09-21T06:26:18.298857+0000","last_active":"2024-09-21T06:28:08.257044+0000","last_peered":"2024-09-21T06:28:08.257044+0000","last_clean":"2024-09-21T06:28:08.257044+0000","last_became_active":"2024-09-21T06:26:18.298439+0000","last_became_peered":"2024-09-21T06:26:18.298439+0000","last_unstale":"2024-09-21T06:28:08.257044+0000","last_undegraded":"2024-09-21T06:28:08.257044+0000","last_fullsized":"2024-09-21T06:28:08.257044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:24.695856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.282750+0000","last_change":"2024-09-21T06:26:18.313029+0000","last_active":"2024-09-21T06:28:08.282750+0000","last_peered":"2024-09-21T06:28:08.282750+0000","last_clean":"2024-09-21T06:28:08.282750+0000","last_became_active":"2024-09-21T06:26:18.312627+0000","last_became_peered":"2024-09-21T06:26:18.312627+0000","last_unstale":"2024-09-21T06:28:08.282750+0000","last_undegraded":"2024-09-21T06:28:08.282750+0000","last_fullsized":"2024-09-21T06:28:08.282750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:23.086862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.275181+0000","last_change":"2024-09-21T06:26:18.299082+0000","last_active":"2024-09-21T06:28:08.275181+0000","last_peered":"2024-09-21T06:28:08.275181+0000","last_clean":"2024-09-21T06:28:08.275181+0000","last_became_active":"2024-09-21T06:26:18.298279+0000","last_became_peered":"2024-09-21T06:26:18.298279+0000","last_unstale":"2024-09-21T06:28:08.275181+0000","last_undegraded":"2024-09-21T06:28:08.275181+0000","last_fullsized":"2024-09-21T06:28:08.275181+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:05.652407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.277890+0000","last_change":"2024-09-21T06:26:18.298565+0000","last_active":"2024-09-21T06:28:08.277890+0000","last_peered":"2024-09-21T06:28:08.277890+0000","last_clean":"2024-09-21T06:28:08.277890+0000","last_became_active":"2024-09-21T06:26:18.298172+0000","last_became_peered":"2024-09-21T06:26:18.298172+0000","last_unstale":"2024-09-21T06:28:08.277890+0000","last_undegraded":"2024-09-21T06:28:08.277890+0000","last_fullsized":"2024-09-21T06:28:08.277890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:33.045038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289221+0000","last_change":"2024-09-21T06:26:18.304901+0000","last_active":"2024-09-21T06:28:08.289221+0000","last_peered":"2024-09-21T06:28:08.289221+0000","last_clean":"2024-09-21T06:28:08.289221+0000","last_became_active":"2024-09-21T06:26:18.304521+0000","last_became_peered":"2024-09-21T06:26:18.304521+0000","last_unstale":"2024-09-21T06:28:08.289221+0000","last_undegraded":"2024-09-21T06:28:08.289221+0000","last_fullsized":"2024-09-21T06:28:08.289221+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:31.859554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"77'16","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.273540+0000","last_change":"2024-09-21T06:26:38.970119+0000","last_active":"2024-09-21T06:28:08.273540+0000","last_peered":"2024-09-21T06:28:08.273540+0000","last_clean":"2024-09-21T06:28:08.273540+0000","last_became_active":"2024-09-21T06:26:38.969521+0000","last_became_peered":"2024-09-21T06:26:38.969521+0000","last_unstale":"2024-09-21T06:28:08.273540+0000","last_undegraded":"2024-09-21T06:28:08.273540+0000","last_fullsized":"2024-09-21T06:28:08.273540+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:54.407153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289151+0000","last_change":"2024-09-21T06:26:18.300178+0000","last_active":"2024-09-21T06:28:08.289151+0000","last_peered":"2024-09-21T06:28:08.289151+0000","last_clean":"2024-09-21T06:28:08.289151+0000","last_became_active":"2024-09-21T06:26:18.298651+0000","last_became_peered":"2024-09-21T06:26:18.298651+0000","last_unstale":"2024-09-21T06:28:08.289151+0000","last_undegraded":"2024-09-21T06:28:08.289151+0000","last_fullsized":"2024-09-21T06:28:08.289151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:07.261974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.290634+0000","last_change":"2024-09-21T06:26:18.311310+0000","last_active":"2024-09-21T06:28:08.290634+0000","last_peered":"2024-09-21T06:28:08.290634+0000","last_clean":"2024-09-21T06:28:08.290634+0000","last_became_active":"2024-09-21T06:26:18.310671+0000","last_became_peered":"2024-09-21T06:26:18.310671+0000","last_unstale":"2024-09-21T06:28:08.290634+0000","last_undegraded":"2024-09-21T06:28:08.290634+0000","last_fullsized":"2024-09-21T06:28:08.290634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:52.060682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.278346+0000","last_change":"2024-09-21T06:26:18.296958+0000","last_active":"2024-09-21T06:28:08.278346+0000","last_peered":"2024-09-21T06:28:08.278346+0000","last_clean":"2024-09-21T06:28:08.278346+0000","last_became_active":"2024-09-21T06:26:18.296081+0000","last_became_peered":"2024-09-21T06:26:18.296081+0000","last_unstale":"2024-09-21T06:28:08.278346+0000","last_undegraded":"2024-09-21T06:28:08.278346+0000","last_fullsized":"2024-09-21T06:28:08.278346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:28.501906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.287036+0000","last_change":"2024-09-21T06:26:18.301289+0000","last_active":"2024-09-21T06:28:08.287036+0000","last_peered":"2024-09-21T06:28:08.287036+0000","last_clean":"2024-09-21T06:28:08.287036+0000","last_became_active":"2024-09-21T06:26:18.300834+0000","last_became_peered":"2024-09-21T06:26:18.300834+0000","last_unstale":"2024-09-21T06:28:08.287036+0000","last_undegraded":"2024-09-21T06:28:08.287036+0000","last_fullsized":"2024-09-21T06:28:08.287036+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:31.206650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.281800+0000","last_change":"2024-09-21T06:26:18.312436+0000","last_active":"2024-09-21T06:28:08.281800+0000","last_peered":"2024-09-21T06:28:08.281800+0000","last_clean":"2024-09-21T06:28:08.281800+0000","last_became_active":"2024-09-21T06:26:18.311230+0000","last_became_peered":"2024-09-21T06:26:18.311230+0000","last_unstale":"2024-09-21T06:28:08.281800+0000","last_undegraded":"2024-09-21T06:28:08.281800+0000","last_fullsized":"2024-09-21T06:28:08.281800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:07.163105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.288018+0000","last_change":"2024-09-21T06:26:18.307775+0000","last_active":"2024-09-21T06:28:08.288018+0000","last_peered":"2024-09-21T06:28:08.288018+0000","last_clean":"2024-09-21T06:28:08.288018+0000","last_became_active":"2024-09-21T06:26:18.307326+0000","last_became_peered":"2024-09-21T06:26:18.307326+0000","last_unstale":"2024-09-21T06:28:08.288018+0000","last_undegraded":"2024-09-21T06:28:08.288018+0000","last_fullsized":"2024-09-21T06:28:08.288018+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:18.213503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.282030+0000","last_change":"2024-09-21T06:26:18.309004+0000","last_active":"2024-09-21T06:28:08.282030+0000","last_peered":"2024-09-21T06:28:08.282030+0000","last_clean":"2024-09-21T06:28:08.282030+0000","last_became_active":"2024-09-21T06:26:18.306098+0000","last_became_peered":"2024-09-21T06:26:18.306098+0000","last_unstale":"2024-09-21T06:28:08.282030+0000","last_undegraded":"2024-09-21T06:28:08.282030+0000","last_fullsized":"2024-09-21T06:28:08.282030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:09.102610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.278891+0000","last_change":"2024-09-21T06:26:18.306699+0000","last_active":"2024-09-21T06:28:08.278891+0000","last_peered":"2024-09-21T06:28:08.278891+0000","last_clean":"2024-09-21T06:28:08.278891+0000","last_became_active":"2024-09-21T06:26:18.306352+0000","last_became_peered":"2024-09-21T06:26:18.306352+0000","last_unstale":"2024-09-21T06:28:08.278891+0000","last_undegraded":"2024-09-21T06:28:08.278891+0000","last_fullsized":"2024-09-21T06:28:08.278891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:47.992315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.264597+0000","last_change":"2024-09-21T06:26:18.301677+0000","last_active":"2024-09-21T06:28:08.264597+0000","last_peered":"2024-09-21T06:28:08.264597+0000","last_clean":"2024-09-21T06:28:08.264597+0000","last_became_active":"2024-09-21T06:26:18.301260+0000","last_became_peered":"2024-09-21T06:26:18.301260+0000","last_unstale":"2024-09-21T06:28:08.264597+0000","last_undegraded":"2024-09-21T06:28:08.264597+0000","last_fullsized":"2024-09-21T06:28:08.264597+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:53.209062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.288730+0000","last_change":"2024-09-21T06:26:18.312004+0000","last_active":"2024-09-21T06:28:08.288730+0000","last_peered":"2024-09-21T06:28:08.288730+0000","last_clean":"2024-09-21T06:28:08.288730+0000","last_became_active":"2024-09-21T06:26:18.311602+0000","last_became_peered":"2024-09-21T06:26:18.311602+0000","last_unstale":"2024-09-21T06:28:08.288730+0000","last_undegraded":"2024-09-21T06:28:08.288730+0000","last_fullsized":"2024-09-21T06:28:08.288730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:30.074887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.287829+0000","last_change":"2024-09-21T06:26:18.296581+0000","last_active":"2024-09-21T06:28:08.287829+0000","last_peered":"2024-09-21T06:28:08.287829+0000","last_clean":"2024-09-21T06:28:08.287829+0000","last_became_active":"2024-09-21T06:26:18.296078+0000","last_became_peered":"2024-09-21T06:26:18.296078+0000","last_unstale":"2024-09-21T06:28:08.287829+0000","last_undegraded":"2024-09-21T06:28:08.287829+0000","last_fullsized":"2024-09-21T06:28:08.287829+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:39.120626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.288126+0000","last_change":"2024-09-21T06:26:18.307793+0000","last_active":"2024-09-21T06:28:08.288126+0000","last_peered":"2024-09-21T06:28:08.288126+0000","last_clean":"2024-09-21T06:28:08.288126+0000","last_became_active":"2024-09-21T06:26:18.307310+0000","last_became_peered":"2024-09-21T06:26:18.307310+0000","last_unstale":"2024-09-21T06:28:08.288126+0000","last_undegraded":"2024-09-21T06:28:08.288126+0000","last_fullsized":"2024-09-21T06:28:08.288126+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:11.761986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.269182+0000","last_change":"2024-09-21T06:26:18.305700+0000","last_active":"2024-09-21T06:28:08.269182+0000","last_peered":"2024-09-21T06:28:08.269182+0000","last_clean":"2024-09-21T06:28:08.269182+0000","last_became_active":"2024-09-21T06:26:18.305319+0000","last_became_peered":"2024-09-21T06:26:18.305319+0000","last_unstale":"2024-09-21T06:28:08.269182+0000","last_undegraded":"2024-09-21T06:28:08.269182+0000","last_fullsized":"2024-09-21T06:28:08.269182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:52.479565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.273399+0000","last_change":"2024-09-21T06:26:18.304111+0000","last_active":"2024-09-21T06:28:08.273399+0000","last_peered":"2024-09-21T06:28:08.273399+0000","last_clean":"2024-09-21T06:28:08.273399+0000","last_became_active":"2024-09-21T06:26:18.302716+0000","last_became_peered":"2024-09-21T06:26:18.302716+0000","last_unstale":"2024-09-21T06:28:08.273399+0000","last_undegraded":"2024-09-21T06:28:08.273399+0000","last_fullsized":"2024-09-21T06:28:08.273399+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:39.298737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.263420+0000","last_change":"2024-09-21T06:26:18.310154+0000","last_active":"2024-09-21T06:28:08.263420+0000","last_peered":"2024-09-21T06:28:08.263420+0000","last_clean":"2024-09-21T06:28:08.263420+0000","last_became_active":"2024-09-21T06:26:18.309735+0000","last_became_peered":"2024-09-21T06:26:18.309735+0000","last_unstale":"2024-09-21T06:28:08.263420+0000","last_undegraded":"2024-09-21T06:28:08.263420+0000","last_fullsized":"2024-09-21T06:28:08.263420+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:42:37.535841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.273261+0000","last_change":"2024-09-21T06:26:18.312302+0000","last_active":"2024-09-21T06:28:08.273261+0000","last_peered":"2024-09-21T06:28:08.273261+0000","last_clean":"2024-09-21T06:28:08.273261+0000","last_became_active":"2024-09-21T06:26:18.311950+0000","last_became_peered":"2024-09-21T06:26:18.311950+0000","last_unstale":"2024-09-21T06:28:08.273261+0000","last_undegraded":"2024-09-21T06:28:08.273261+0000","last_fullsized":"2024-09-21T06:28:08.273261+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:03.899946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.264724+0000","last_change":"2024-09-21T06:26:18.308291+0000","last_active":"2024-09-21T06:28:08.264724+0000","last_peered":"2024-09-21T06:28:08.264724+0000","last_clean":"2024-09-21T06:28:08.264724+0000","last_became_active":"2024-09-21T06:26:18.307907+0000","last_became_peered":"2024-09-21T06:26:18.307907+0000","last_unstale":"2024-09-21T06:28:08.264724+0000","last_undegraded":"2024-09-21T06:28:08.264724+0000","last_fullsized":"2024-09-21T06:28:08.264724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:17.418996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.278413+0000","last_change":"2024-09-21T06:26:18.311774+0000","last_active":"2024-09-21T06:28:08.278413+0000","last_peered":"2024-09-21T06:28:08.278413+0000","last_clean":"2024-09-21T06:28:08.278413+0000","last_became_active":"2024-09-21T06:26:18.311373+0000","last_became_peered":"2024-09-21T06:26:18.311373+0000","last_unstale":"2024-09-21T06:28:08.278413+0000","last_undegraded":"2024-09-21T06:28:08.278413+0000","last_fullsized":"2024-09-21T06:28:08.278413+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:08.310931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'7","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.278709+0000","last_change":"2024-09-21T06:26:38.977655+0000","last_active":"2024-09-21T06:28:08.278709+0000","last_peered":"2024-09-21T06:28:08.278709+0000","last_clean":"2024-09-21T06:28:08.278709+0000","last_became_active":"2024-09-21T06:26:38.977309+0000","last_became_peered":"2024-09-21T06:26:38.977309+0000","last_unstale":"2024-09-21T06:28:08.278709+0000","last_undegraded":"2024-09-21T06:28:08.278709+0000","last_fullsized":"2024-09-21T06:28:08.278709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:10.083264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.269694+0000","last_change":"2024-09-21T06:26:18.302851+0000","last_active":"2024-09-21T06:28:08.269694+0000","last_peered":"2024-09-21T06:28:08.269694+0000","last_clean":"2024-09-21T06:28:08.269694+0000","last_became_active":"2024-09-21T06:26:18.302120+0000","last_became_peered":"2024-09-21T06:26:18.302120+0000","last_unstale":"2024-09-21T06:28:08.269694+0000","last_undegraded":"2024-09-21T06:28:08.269694+0000","last_fullsized":"2024-09-21T06:28:08.269694+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:18.442711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"77'12","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289384+0000","last_change":"2024-09-21T06:26:18.310447+0000","last_active":"2024-09-21T06:28:08.289384+0000","last_peered":"2024-09-21T06:28:08.289384+0000","last_clean":"2024-09-21T06:28:08.289384+0000","last_became_active":"2024-09-21T06:26:18.310079+0000","last_became_peered":"2024-09-21T06:26:18.310079+0000","last_unstale":"2024-09-21T06:28:08.289384+0000","last_undegraded":"2024-09-21T06:28:08.289384+0000","last_fullsized":"2024-09-21T06:28:08.289384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:14.364382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.273523+0000","last_change":"2024-09-21T06:26:18.307260+0000","last_active":"2024-09-21T06:28:08.273523+0000","last_peered":"2024-09-21T06:28:08.273523+0000","last_clean":"2024-09-21T06:28:08.273523+0000","last_became_active":"2024-09-21T06:26:18.306131+0000","last_became_peered":"2024-09-21T06:26:18.306131+0000","last_unstale":"2024-09-21T06:28:08.273523+0000","last_undegraded":"2024-09-21T06:28:08.273523+0000","last_fullsized":"2024-09-21T06:28:08.273523+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:14.746652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.261790+0000","last_change":"2024-09-21T06:26:18.292714+0000","last_active":"2024-09-21T06:28:08.261790+0000","last_peered":"2024-09-21T06:28:08.261790+0000","last_clean":"2024-09-21T06:28:08.261790+0000","last_became_active":"2024-09-21T06:26:18.292322+0000","last_became_peered":"2024-09-21T06:26:18.292322+0000","last_unstale":"2024-09-21T06:28:08.261790+0000","last_undegraded":"2024-09-21T06:28:08.261790+0000","last_fullsized":"2024-09-21T06:28:08.261790+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:51.017455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":136,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:12.922240+0000","last_change":"2024-09-21T06:26:16.269788+0000","last_active":"2024-09-21T06:28:12.922240+0000","last_peered":"2024-09-21T06:28:12.922240+0000","last_clean":"2024-09-21T06:28:12.922240+0000","last_became_active":"2024-09-21T06:26:16.269342+0000","last_became_peered":"2024-09-21T06:26:16.269342+0000","last_unstale":"2024-09-21T06:28:12.922240+0000","last_undegraded":"2024-09-21T06:28:12.922240+0000","last_fullsized":"2024-09-21T06:28:12.922240+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:34.782237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'8","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.272099+0000","last_change":"2024-09-21T06:26:38.970396+0000","last_active":"2024-09-21T06:28:08.272099+0000","last_peered":"2024-09-21T06:28:08.272099+0000","last_clean":"2024-09-21T06:28:08.272099+0000","last_became_active":"2024-09-21T06:26:38.969976+0000","last_became_peered":"2024-09-21T06:26:38.969976+0000","last_unstale":"2024-09-21T06:28:08.272099+0000","last_undegraded":"2024-09-21T06:28:08.272099+0000","last_fullsized":"2024-09-21T06:28:08.272099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:44.540563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,3],"acting":[9,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964833+0000","last_change":"2024-09-21T06:26:16.272832+0000","last_active":"2024-09-21T06:26:38.964833+0000","last_peered":"2024-09-21T06:26:38.964833+0000","last_clean":"2024-09-21T06:26:38.964833+0000","last_became_active":"2024-09-21T06:26:16.272447+0000","last_became_peered":"2024-09-21T06:26:16.272447+0000","last_unstale":"2024-09-21T06:26:38.964833+0000","last_undegraded":"2024-09-21T06:26:38.964833+0000","last_fullsized":"2024-09-21T06:26:38.964833+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:22.836267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.966506+0000","last_change":"2024-09-21T06:26:16.269067+0000","last_active":"2024-09-21T06:26:38.966506+0000","last_peered":"2024-09-21T06:26:38.966506+0000","last_clean":"2024-09-21T06:26:38.966506+0000","last_became_active":"2024-09-21T06:26:16.268524+0000","last_became_peered":"2024-09-21T06:26:16.268524+0000","last_unstale":"2024-09-21T06:26:38.966506+0000","last_undegraded":"2024-09-21T06:26:38.966506+0000","last_fullsized":"2024-09-21T06:26:38.966506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:32.224321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.266305+0000","last_change":"2024-09-21T06:26:18.306489+0000","last_active":"2024-09-21T06:28:08.266305+0000","last_peered":"2024-09-21T06:28:08.266305+0000","last_clean":"2024-09-21T06:28:08.266305+0000","last_became_active":"2024-09-21T06:26:18.305883+0000","last_became_peered":"2024-09-21T06:26:18.305883+0000","last_unstale":"2024-09-21T06:28:08.266305+0000","last_undegraded":"2024-09-21T06:28:08.266305+0000","last_fullsized":"2024-09-21T06:28:08.266305+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:54.012308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971279+0000","last_change":"2024-09-21T06:26:16.269793+0000","last_active":"2024-09-21T06:26:38.971279+0000","last_peered":"2024-09-21T06:26:38.971279+0000","last_clean":"2024-09-21T06:26:38.971279+0000","last_became_active":"2024-09-21T06:26:16.269455+0000","last_became_peered":"2024-09-21T06:26:16.269455+0000","last_unstale":"2024-09-21T06:26:38.971279+0000","last_undegraded":"2024-09-21T06:26:38.971279+0000","last_fullsized":"2024-09-21T06:26:38.971279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:44.369742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.279312+0000","last_change":"2024-09-21T06:26:18.297573+0000","last_active":"2024-09-21T06:28:08.279312+0000","last_peered":"2024-09-21T06:28:08.279312+0000","last_clean":"2024-09-21T06:28:08.279312+0000","last_became_active":"2024-09-21T06:26:18.297190+0000","last_became_peered":"2024-09-21T06:26:18.297190+0000","last_unstale":"2024-09-21T06:28:08.279312+0000","last_undegraded":"2024-09-21T06:28:08.279312+0000","last_fullsized":"2024-09-21T06:28:08.279312+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:28.055520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'5","reported_seq":240,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:13.923171+0000","last_change":"2024-09-21T06:26:16.273604+0000","last_active":"2024-09-21T06:28:13.923171+0000","last_peered":"2024-09-21T06:28:13.923171+0000","last_clean":"2024-09-21T06:28:13.923171+0000","last_became_active":"2024-09-21T06:26:16.273194+0000","last_became_peered":"2024-09-21T06:26:16.273194+0000","last_unstale":"2024-09-21T06:28:13.923171+0000","last_undegraded":"2024-09-21T06:28:13.923171+0000","last_fullsized":"2024-09-21T06:28:13.923171+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:08.218442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":212,"num_read_kb":212,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289113+0000","last_change":"2024-09-21T06:26:18.303960+0000","last_active":"2024-09-21T06:28:08.289113+0000","last_peered":"2024-09-21T06:28:08.289113+0000","last_clean":"2024-09-21T06:28:08.289113+0000","last_became_active":"2024-09-21T06:26:18.303550+0000","last_became_peered":"2024-09-21T06:26:18.303550+0000","last_unstale":"2024-09-21T06:28:08.289113+0000","last_undegraded":"2024-09-21T06:28:08.289113+0000","last_fullsized":"2024-09-21T06:28:08.289113+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:47.331439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.978327+0000","last_change":"2024-09-21T06:26:38.978161+0000","last_active":"2024-09-21T06:26:38.978327+0000","last_peered":"2024-09-21T06:26:38.978327+0000","last_clean":"2024-09-21T06:26:38.978327+0000","last_became_active":"2024-09-21T06:26:38.970818+0000","last_became_peered":"2024-09-21T06:26:38.970818+0000","last_unstale":"2024-09-21T06:26:38.978327+0000","last_undegraded":"2024-09-21T06:26:38.978327+0000","last_fullsized":"2024-09-21T06:26:38.978327+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:55.273463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.282065+0000","last_change":"2024-09-21T06:26:18.311643+0000","last_active":"2024-09-21T06:28:08.282065+0000","last_peered":"2024-09-21T06:28:08.282065+0000","last_clean":"2024-09-21T06:28:08.282065+0000","last_became_active":"2024-09-21T06:26:18.311246+0000","last_became_peered":"2024-09-21T06:26:18.311246+0000","last_unstale":"2024-09-21T06:28:08.282065+0000","last_undegraded":"2024-09-21T06:28:08.282065+0000","last_fullsized":"2024-09-21T06:28:08.282065+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:00.342212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971107+0000","last_change":"2024-09-21T06:26:16.313648+0000","last_active":"2024-09-21T06:26:38.971107+0000","last_peered":"2024-09-21T06:26:38.971107+0000","last_clean":"2024-09-21T06:26:38.971107+0000","last_became_active":"2024-09-21T06:26:16.313337+0000","last_became_peered":"2024-09-21T06:26:16.313337+0000","last_unstale":"2024-09-21T06:26:38.971107+0000","last_undegraded":"2024-09-21T06:26:38.971107+0000","last_fullsized":"2024-09-21T06:26:38.971107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:12.095276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289994+0000","last_change":"2024-09-21T06:26:18.310168+0000","last_active":"2024-09-21T06:28:08.289994+0000","last_peered":"2024-09-21T06:28:08.289994+0000","last_clean":"2024-09-21T06:28:08.289994+0000","last_became_active":"2024-09-21T06:26:18.309756+0000","last_became_peered":"2024-09-21T06:26:18.309756+0000","last_unstale":"2024-09-21T06:28:08.289994+0000","last_undegraded":"2024-09-21T06:28:08.289994+0000","last_fullsized":"2024-09-21T06:28:08.289994+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:07.203202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'36","reported_seq":283,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:13.923134+0000","last_change":"2024-09-21T06:26:16.270243+0000","last_active":"2024-09-21T06:28:13.923134+0000","last_peered":"2024-09-21T06:28:13.923134+0000","last_clean":"2024-09-21T06:28:13.923134+0000","last_became_active":"2024-09-21T06:26:16.269883+0000","last_became_peered":"2024-09-21T06:26:16.269883+0000","last_unstale":"2024-09-21T06:28:13.923134+0000","last_undegraded":"2024-09-21T06:28:13.923134+0000","last_fullsized":"2024-09-21T06:28:13.923134+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:55.906972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67005,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":224,"num_read_kb":177,"num_write":38,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.284918+0000","last_change":"2024-09-21T06:26:18.305508+0000","last_active":"2024-09-21T06:28:08.284918+0000","last_peered":"2024-09-21T06:28:08.284918+0000","last_clean":"2024-09-21T06:28:08.284918+0000","last_became_active":"2024-09-21T06:26:18.305104+0000","last_became_peered":"2024-09-21T06:26:18.305104+0000","last_unstale":"2024-09-21T06:28:08.284918+0000","last_undegraded":"2024-09-21T06:28:08.284918+0000","last_fullsized":"2024-09-21T06:28:08.284918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:14.727084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'9","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.969025+0000","last_change":"2024-09-21T06:26:16.268331+0000","last_active":"2024-09-21T06:26:38.969025+0000","last_peered":"2024-09-21T06:26:38.969025+0000","last_clean":"2024-09-21T06:26:38.969025+0000","last_became_active":"2024-09-21T06:26:16.267918+0000","last_became_peered":"2024-09-21T06:26:16.267918+0000","last_unstale":"2024-09-21T06:26:38.969025+0000","last_undegraded":"2024-09-21T06:26:38.969025+0000","last_fullsized":"2024-09-21T06:26:38.969025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:50.198883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.277857+0000","last_change":"2024-09-21T06:26:18.298052+0000","last_active":"2024-09-21T06:28:08.277857+0000","last_peered":"2024-09-21T06:28:08.277857+0000","last_clean":"2024-09-21T06:28:08.277857+0000","last_became_active":"2024-09-21T06:26:18.297686+0000","last_became_peered":"2024-09-21T06:26:18.297686+0000","last_unstale":"2024-09-21T06:28:08.277857+0000","last_undegraded":"2024-09-21T06:28:08.277857+0000","last_fullsized":"2024-09-21T06:28:08.277857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:56.261608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.970277+0000","last_change":"2024-09-21T06:26:16.270917+0000","last_active":"2024-09-21T06:26:38.970277+0000","last_peered":"2024-09-21T06:26:38.970277+0000","last_clean":"2024-09-21T06:26:38.970277+0000","last_became_active":"2024-09-21T06:26:16.270530+0000","last_became_peered":"2024-09-21T06:26:16.270530+0000","last_unstale":"2024-09-21T06:26:38.970277+0000","last_undegraded":"2024-09-21T06:26:38.970277+0000","last_fullsized":"2024-09-21T06:26:38.970277+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:30.772991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.285302+0000","last_change":"2024-09-21T06:26:18.302286+0000","last_active":"2024-09-21T06:28:08.285302+0000","last_peered":"2024-09-21T06:28:08.285302+0000","last_clean":"2024-09-21T06:28:08.285302+0000","last_became_active":"2024-09-21T06:26:18.301777+0000","last_became_peered":"2024-09-21T06:26:18.301777+0000","last_unstale":"2024-09-21T06:28:08.285302+0000","last_undegraded":"2024-09-21T06:28:08.285302+0000","last_fullsized":"2024-09-21T06:28:08.285302+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:31.339898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'7","reported_seq":138,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:10.919997+0000","last_change":"2024-09-21T06:26:16.267569+0000","last_active":"2024-09-21T06:28:10.919997+0000","last_peered":"2024-09-21T06:28:10.919997+0000","last_clean":"2024-09-21T06:28:10.919997+0000","last_became_active":"2024-09-21T06:26:16.267198+0000","last_became_peered":"2024-09-21T06:26:16.267198+0000","last_unstale":"2024-09-21T06:28:10.919997+0000","last_undegraded":"2024-09-21T06:28:10.919997+0000","last_fullsized":"2024-09-21T06:28:10.919997+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:16.323246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.276222+0000","last_change":"2024-09-21T06:26:18.294473+0000","last_active":"2024-09-21T06:28:08.276222+0000","last_peered":"2024-09-21T06:28:08.276222+0000","last_clean":"2024-09-21T06:28:08.276222+0000","last_became_active":"2024-09-21T06:26:18.294010+0000","last_became_peered":"2024-09-21T06:26:18.294010+0000","last_unstale":"2024-09-21T06:28:08.276222+0000","last_undegraded":"2024-09-21T06:28:08.276222+0000","last_fullsized":"2024-09-21T06:28:08.276222+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:12.098589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'17","reported_seq":66,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.994281+0000","last_change":"2024-09-21T06:26:38.994178+0000","last_active":"2024-09-21T06:26:38.994281+0000","last_peered":"2024-09-21T06:26:38.994281+0000","last_clean":"2024-09-21T06:26:38.994281+0000","last_became_active":"2024-09-21T06:26:38.977865+0000","last_became_peered":"2024-09-21T06:26:38.977865+0000","last_unstale":"2024-09-21T06:26:38.994281+0000","last_undegraded":"2024-09-21T06:26:38.994281+0000","last_fullsized":"2024-09-21T06:26:38.994281+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:44.368499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.290725+0000","last_change":"2024-09-21T06:26:18.312319+0000","last_active":"2024-09-21T06:28:08.290725+0000","last_peered":"2024-09-21T06:28:08.290725+0000","last_clean":"2024-09-21T06:28:08.290725+0000","last_became_active":"2024-09-21T06:26:18.311949+0000","last_became_peered":"2024-09-21T06:26:18.311949+0000","last_unstale":"2024-09-21T06:28:08.290725+0000","last_undegraded":"2024-09-21T06:28:08.290725+0000","last_fullsized":"2024-09-21T06:28:08.290725+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:49.729693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964667+0000","last_change":"2024-09-21T06:26:16.273771+0000","last_active":"2024-09-21T06:26:38.964667+0000","last_peered":"2024-09-21T06:26:38.964667+0000","last_clean":"2024-09-21T06:26:38.964667+0000","last_became_active":"2024-09-21T06:26:16.273293+0000","last_became_peered":"2024-09-21T06:26:16.273293+0000","last_unstale":"2024-09-21T06:26:38.964667+0000","last_undegraded":"2024-09-21T06:26:38.964667+0000","last_fullsized":"2024-09-21T06:26:38.964667+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:21.867844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289127+0000","last_change":"2024-09-21T06:26:18.309204+0000","last_active":"2024-09-21T06:28:08.289127+0000","last_peered":"2024-09-21T06:28:08.289127+0000","last_clean":"2024-09-21T06:28:08.289127+0000","last_became_active":"2024-09-21T06:26:18.308838+0000","last_became_peered":"2024-09-21T06:26:18.308838+0000","last_unstale":"2024-09-21T06:28:08.289127+0000","last_undegraded":"2024-09-21T06:28:08.289127+0000","last_fullsized":"2024-09-21T06:28:08.289127+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:14.011799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'5","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965404+0000","last_change":"2024-09-21T06:26:16.267965+0000","last_active":"2024-09-21T06:26:38.965404+0000","last_peered":"2024-09-21T06:26:38.965404+0000","last_clean":"2024-09-21T06:26:38.965404+0000","last_became_active":"2024-09-21T06:26:16.267548+0000","last_became_peered":"2024-09-21T06:26:16.267548+0000","last_unstale":"2024-09-21T06:26:38.965404+0000","last_undegraded":"2024-09-21T06:26:38.965404+0000","last_fullsized":"2024-09-21T06:26:38.965404+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:51.915817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.277230+0000","last_change":"2024-09-21T06:26:18.306376+0000","last_active":"2024-09-21T06:28:08.277230+0000","last_peered":"2024-09-21T06:28:08.277230+0000","last_clean":"2024-09-21T06:28:08.277230+0000","last_became_active":"2024-09-21T06:26:18.305956+0000","last_became_peered":"2024-09-21T06:26:18.305956+0000","last_unstale":"2024-09-21T06:28:08.277230+0000","last_undegraded":"2024-09-21T06:28:08.277230+0000","last_fullsized":"2024-09-21T06:28:08.277230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:27.229499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.971383+0000","last_change":"2024-09-21T06:26:16.267201+0000","last_active":"2024-09-21T06:26:38.971383+0000","last_peered":"2024-09-21T06:26:38.971383+0000","last_clean":"2024-09-21T06:26:38.971383+0000","last_became_active":"2024-09-21T06:26:16.266832+0000","last_became_peered":"2024-09-21T06:26:16.266832+0000","last_unstale":"2024-09-21T06:26:38.971383+0000","last_undegraded":"2024-09-21T06:26:38.971383+0000","last_fullsized":"2024-09-21T06:26:38.971383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:48.626106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'7","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.275329+0000","last_change":"2024-09-21T06:26:38.984119+0000","last_active":"2024-09-21T06:28:08.275329+0000","last_peered":"2024-09-21T06:28:08.275329+0000","last_clean":"2024-09-21T06:28:08.275329+0000","last_became_active":"2024-09-21T06:26:38.972316+0000","last_became_peered":"2024-09-21T06:26:38.972316+0000","last_unstale":"2024-09-21T06:28:08.275329+0000","last_undegraded":"2024-09-21T06:28:08.275329+0000","last_fullsized":"2024-09-21T06:28:08.275329+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:22.788293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'7","reported_seq":137,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:09.917830+0000","last_change":"2024-09-21T06:26:16.572993+0000","last_active":"2024-09-21T06:28:09.917830+0000","last_peered":"2024-09-21T06:28:09.917830+0000","last_clean":"2024-09-21T06:28:09.917830+0000","last_became_active":"2024-09-21T06:26:16.572631+0000","last_became_peered":"2024-09-21T06:26:16.572631+0000","last_unstale":"2024-09-21T06:28:09.917830+0000","last_undegraded":"2024-09-21T06:28:09.917830+0000","last_fullsized":"2024-09-21T06:28:09.917830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:05.276119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289284+0000","last_change":"2024-09-21T06:26:18.304685+0000","last_active":"2024-09-21T06:28:08.289284+0000","last_peered":"2024-09-21T06:28:08.289284+0000","last_clean":"2024-09-21T06:28:08.289284+0000","last_became_active":"2024-09-21T06:26:18.304325+0000","last_became_peered":"2024-09-21T06:26:18.304325+0000","last_unstale":"2024-09-21T06:28:08.289284+0000","last_undegraded":"2024-09-21T06:28:08.289284+0000","last_fullsized":"2024-09-21T06:28:08.289284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:18.072602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":99,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965252+0000","last_change":"2024-09-21T06:25:04.875443+0000","last_active":"2024-09-21T06:26:38.965252+0000","last_peered":"2024-09-21T06:26:38.965252+0000","last_clean":"2024-09-21T06:26:38.965252+0000","last_became_active":"2024-09-21T06:25:04.869179+0000","last_became_peered":"2024-09-21T06:25:04.869179+0000","last_unstale":"2024-09-21T06:26:38.965252+0000","last_undegraded":"2024-09-21T06:26:38.965252+0000","last_fullsized":"2024-09-21T06:26:38.965252+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:21:37.191501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:21:37.191501+0000","last_clean_scrub_stamp":"2024-09-21T06:21:37.191501+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:19.981367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'6","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962414+0000","last_change":"2024-09-21T06:26:16.268440+0000","last_active":"2024-09-21T06:26:38.962414+0000","last_peered":"2024-09-21T06:26:38.962414+0000","last_clean":"2024-09-21T06:26:38.962414+0000","last_became_active":"2024-09-21T06:26:16.268078+0000","last_became_peered":"2024-09-21T06:26:16.268078+0000","last_unstale":"2024-09-21T06:26:38.962414+0000","last_undegraded":"2024-09-21T06:26:38.962414+0000","last_fullsized":"2024-09-21T06:26:38.962414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:55.696736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.273786+0000","last_change":"2024-09-21T06:26:18.306410+0000","last_active":"2024-09-21T06:28:08.273786+0000","last_peered":"2024-09-21T06:28:08.273786+0000","last_clean":"2024-09-21T06:28:08.273786+0000","last_became_active":"2024-09-21T06:26:18.304718+0000","last_became_peered":"2024-09-21T06:26:18.304718+0000","last_unstale":"2024-09-21T06:28:08.273786+0000","last_undegraded":"2024-09-21T06:28:08.273786+0000","last_fullsized":"2024-09-21T06:28:08.273786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:18.521867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964484+0000","last_change":"2024-09-21T06:26:16.270305+0000","last_active":"2024-09-21T06:26:38.964484+0000","last_peered":"2024-09-21T06:26:38.964484+0000","last_clean":"2024-09-21T06:26:38.964484+0000","last_became_active":"2024-09-21T06:26:16.269891+0000","last_became_peered":"2024-09-21T06:26:16.269891+0000","last_unstale":"2024-09-21T06:26:38.964484+0000","last_undegraded":"2024-09-21T06:26:38.964484+0000","last_fullsized":"2024-09-21T06:26:38.964484+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:48.575805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.281410+0000","last_change":"2024-09-21T06:26:18.302404+0000","last_active":"2024-09-21T06:28:08.281410+0000","last_peered":"2024-09-21T06:28:08.281410+0000","last_clean":"2024-09-21T06:28:08.281410+0000","last_became_active":"2024-09-21T06:26:18.302036+0000","last_became_peered":"2024-09-21T06:26:18.302036+0000","last_unstale":"2024-09-21T06:28:08.281410+0000","last_undegraded":"2024-09-21T06:28:08.281410+0000","last_fullsized":"2024-09-21T06:28:08.281410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:36.688018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'6","reported_seq":137,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:13.923815+0000","last_change":"2024-09-21T06:26:16.310996+0000","last_active":"2024-09-21T06:28:13.923815+0000","last_peered":"2024-09-21T06:28:13.923815+0000","last_clean":"2024-09-21T06:28:13.923815+0000","last_became_active":"2024-09-21T06:26:16.310566+0000","last_became_peered":"2024-09-21T06:26:16.310566+0000","last_unstale":"2024-09-21T06:28:13.923815+0000","last_undegraded":"2024-09-21T06:28:13.923815+0000","last_fullsized":"2024-09-21T06:28:13.923815+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:27.569789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.290666+0000","last_change":"2024-09-21T06:26:18.310343+0000","last_active":"2024-09-21T06:28:08.290666+0000","last_peered":"2024-09-21T06:28:08.290666+0000","last_clean":"2024-09-21T06:28:08.290666+0000","last_became_active":"2024-09-21T06:26:18.309979+0000","last_became_peered":"2024-09-21T06:26:18.309979+0000","last_unstale":"2024-09-21T06:28:08.290666+0000","last_undegraded":"2024-09-21T06:28:08.290666+0000","last_fullsized":"2024-09-21T06:28:08.290666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:20.340822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'6","reported_seq":116,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:13.113157+0000","last_change":"2024-09-21T06:26:38.974313+0000","last_active":"2024-09-21T06:28:13.113157+0000","last_peered":"2024-09-21T06:28:13.113157+0000","last_clean":"2024-09-21T06:28:13.113157+0000","last_became_active":"2024-09-21T06:26:38.966498+0000","last_became_peered":"2024-09-21T06:26:38.966498+0000","last_unstale":"2024-09-21T06:28:13.113157+0000","last_undegraded":"2024-09-21T06:28:13.113157+0000","last_fullsized":"2024-09-21T06:28:13.113157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:56.732330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":588,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.282499+0000","last_change":"2024-09-21T06:26:18.312080+0000","last_active":"2024-09-21T06:28:08.282499+0000","last_peered":"2024-09-21T06:28:08.282499+0000","last_clean":"2024-09-21T06:28:08.282499+0000","last_became_active":"2024-09-21T06:26:18.311351+0000","last_became_peered":"2024-09-21T06:26:18.311351+0000","last_unstale":"2024-09-21T06:28:08.282499+0000","last_undegraded":"2024-09-21T06:28:08.282499+0000","last_fullsized":"2024-09-21T06:28:08.282499+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:33.545677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965339+0000","last_change":"2024-09-21T06:26:16.311108+0000","last_active":"2024-09-21T06:26:38.965339+0000","last_peered":"2024-09-21T06:26:38.965339+0000","last_clean":"2024-09-21T06:26:38.965339+0000","last_became_active":"2024-09-21T06:26:16.310595+0000","last_became_peered":"2024-09-21T06:26:16.310595+0000","last_unstale":"2024-09-21T06:26:38.965339+0000","last_undegraded":"2024-09-21T06:26:38.965339+0000","last_fullsized":"2024-09-21T06:26:38.965339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:43.125242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.277932+0000","last_change":"2024-09-21T06:26:18.300618+0000","last_active":"2024-09-21T06:28:08.277932+0000","last_peered":"2024-09-21T06:28:08.277932+0000","last_clean":"2024-09-21T06:28:08.277932+0000","last_became_active":"2024-09-21T06:26:18.300234+0000","last_became_peered":"2024-09-21T06:26:18.300234+0000","last_unstale":"2024-09-21T06:28:08.277932+0000","last_undegraded":"2024-09-21T06:28:08.277932+0000","last_fullsized":"2024-09-21T06:28:08.277932+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:53.224425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'4","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.982480+0000","last_change":"2024-09-21T06:26:38.981999+0000","last_active":"2024-09-21T06:26:38.982480+0000","last_peered":"2024-09-21T06:26:38.982480+0000","last_clean":"2024-09-21T06:26:38.982480+0000","last_became_active":"2024-09-21T06:26:38.969199+0000","last_became_peered":"2024-09-21T06:26:38.969199+0000","last_unstale":"2024-09-21T06:26:38.982480+0000","last_undegraded":"2024-09-21T06:26:38.982480+0000","last_fullsized":"2024-09-21T06:26:38.982480+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:17.389262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.276443+0000","last_change":"2024-09-21T06:26:18.297693+0000","last_active":"2024-09-21T06:28:08.276443+0000","last_peered":"2024-09-21T06:28:08.276443+0000","last_clean":"2024-09-21T06:28:08.276443+0000","last_became_active":"2024-09-21T06:26:18.297335+0000","last_became_peered":"2024-09-21T06:26:18.297335+0000","last_unstale":"2024-09-21T06:28:08.276443+0000","last_undegraded":"2024-09-21T06:28:08.276443+0000","last_fullsized":"2024-09-21T06:28:08.276443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:30.144220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'17","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.307206+0000","last_change":"2024-09-21T06:26:16.269854+0000","last_active":"2024-09-21T06:28:08.307206+0000","last_peered":"2024-09-21T06:28:08.307206+0000","last_clean":"2024-09-21T06:28:08.307206+0000","last_became_active":"2024-09-21T06:26:16.269415+0000","last_became_peered":"2024-09-21T06:26:16.269415+0000","last_unstale":"2024-09-21T06:28:08.307206+0000","last_undegraded":"2024-09-21T06:28:08.307206+0000","last_fullsized":"2024-09-21T06:28:08.307206+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:50.525916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.270328+0000","last_change":"2024-09-21T06:26:18.306302+0000","last_active":"2024-09-21T06:28:08.270328+0000","last_peered":"2024-09-21T06:28:08.270328+0000","last_clean":"2024-09-21T06:28:08.270328+0000","last_became_active":"2024-09-21T06:26:18.305723+0000","last_became_peered":"2024-09-21T06:26:18.305723+0000","last_unstale":"2024-09-21T06:28:08.270328+0000","last_undegraded":"2024-09-21T06:28:08.270328+0000","last_fullsized":"2024-09-21T06:28:08.270328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:30.051791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'7","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.962517+0000","last_change":"2024-09-21T06:26:16.573081+0000","last_active":"2024-09-21T06:26:38.962517+0000","last_peered":"2024-09-21T06:26:38.962517+0000","last_clean":"2024-09-21T06:26:38.962517+0000","last_became_active":"2024-09-21T06:26:16.572680+0000","last_became_peered":"2024-09-21T06:26:16.572680+0000","last_unstale":"2024-09-21T06:26:38.962517+0000","last_undegraded":"2024-09-21T06:26:38.962517+0000","last_fullsized":"2024-09-21T06:26:38.962517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:04.698258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.282159+0000","last_change":"2024-09-21T06:26:18.311610+0000","last_active":"2024-09-21T06:28:08.282159+0000","last_peered":"2024-09-21T06:28:08.282159+0000","last_clean":"2024-09-21T06:28:08.282159+0000","last_became_active":"2024-09-21T06:26:18.311239+0000","last_became_peered":"2024-09-21T06:26:18.311239+0000","last_unstale":"2024-09-21T06:28:08.282159+0000","last_undegraded":"2024-09-21T06:28:08.282159+0000","last_fullsized":"2024-09-21T06:28:08.282159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:36.995768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.965260+0000","last_change":"2024-09-21T06:26:16.313612+0000","last_active":"2024-09-21T06:26:38.965260+0000","last_peered":"2024-09-21T06:26:38.965260+0000","last_clean":"2024-09-21T06:26:38.965260+0000","last_became_active":"2024-09-21T06:26:16.313298+0000","last_became_peered":"2024-09-21T06:26:16.313298+0000","last_unstale":"2024-09-21T06:26:38.965260+0000","last_undegraded":"2024-09-21T06:26:38.965260+0000","last_fullsized":"2024-09-21T06:26:38.965260+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:45.035454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.235394+0000","last_change":"2024-09-21T06:26:18.304772+0000","last_active":"2024-09-21T06:28:08.235394+0000","last_peered":"2024-09-21T06:28:08.235394+0000","last_clean":"2024-09-21T06:28:08.235394+0000","last_became_active":"2024-09-21T06:26:18.303909+0000","last_became_peered":"2024-09-21T06:26:18.303909+0000","last_unstale":"2024-09-21T06:28:08.235394+0000","last_undegraded":"2024-09-21T06:28:08.235394+0000","last_fullsized":"2024-09-21T06:28:08.235394+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:28.707169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.963811+0000","last_change":"2024-09-21T06:26:16.267563+0000","last_active":"2024-09-21T06:26:38.963811+0000","last_peered":"2024-09-21T06:26:38.963811+0000","last_clean":"2024-09-21T06:26:38.963811+0000","last_became_active":"2024-09-21T06:26:16.267182+0000","last_became_peered":"2024-09-21T06:26:16.267182+0000","last_unstale":"2024-09-21T06:26:38.963811+0000","last_undegraded":"2024-09-21T06:26:38.963811+0000","last_fullsized":"2024-09-21T06:26:38.963811+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:16.042105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.278136+0000","last_change":"2024-09-21T06:26:18.310772+0000","last_active":"2024-09-21T06:28:08.278136+0000","last_peered":"2024-09-21T06:28:08.278136+0000","last_clean":"2024-09-21T06:28:08.278136+0000","last_became_active":"2024-09-21T06:26:18.310382+0000","last_became_peered":"2024-09-21T06:26:18.310382+0000","last_unstale":"2024-09-21T06:28:08.278136+0000","last_undegraded":"2024-09-21T06:28:08.278136+0000","last_fullsized":"2024-09-21T06:28:08.278136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:54:35.028081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.967712+0000","last_change":"2024-09-21T06:26:16.270971+0000","last_active":"2024-09-21T06:26:38.967712+0000","last_peered":"2024-09-21T06:26:38.967712+0000","last_clean":"2024-09-21T06:26:38.967712+0000","last_became_active":"2024-09-21T06:26:16.270453+0000","last_became_peered":"2024-09-21T06:26:16.270453+0000","last_unstale":"2024-09-21T06:26:38.967712+0000","last_undegraded":"2024-09-21T06:26:38.967712+0000","last_fullsized":"2024-09-21T06:26:38.967712+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:34.687380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.277706+0000","last_change":"2024-09-21T06:26:18.300568+0000","last_active":"2024-09-21T06:28:08.277706+0000","last_peered":"2024-09-21T06:28:08.277706+0000","last_clean":"2024-09-21T06:28:08.277706+0000","last_became_active":"2024-09-21T06:26:18.298864+0000","last_became_peered":"2024-09-21T06:26:18.298864+0000","last_unstale":"2024-09-21T06:28:08.277706+0000","last_undegraded":"2024-09-21T06:28:08.277706+0000","last_fullsized":"2024-09-21T06:28:08.277706+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:00.786225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964246+0000","last_change":"2024-09-21T06:26:16.274093+0000","last_active":"2024-09-21T06:26:38.964246+0000","last_peered":"2024-09-21T06:26:38.964246+0000","last_clean":"2024-09-21T06:26:38.964246+0000","last_became_active":"2024-09-21T06:26:16.273707+0000","last_became_peered":"2024-09-21T06:26:16.273707+0000","last_unstale":"2024-09-21T06:26:38.964246+0000","last_undegraded":"2024-09-21T06:26:38.964246+0000","last_fullsized":"2024-09-21T06:26:38.964246+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:26.710260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289024+0000","last_change":"2024-09-21T06:26:18.300140+0000","last_active":"2024-09-21T06:28:08.289024+0000","last_peered":"2024-09-21T06:28:08.289024+0000","last_clean":"2024-09-21T06:28:08.289024+0000","last_became_active":"2024-09-21T06:26:18.299543+0000","last_became_peered":"2024-09-21T06:26:18.299543+0000","last_unstale":"2024-09-21T06:28:08.289024+0000","last_undegraded":"2024-09-21T06:28:08.289024+0000","last_fullsized":"2024-09-21T06:28:08.289024+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:50.272247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.291190+0000","last_change":"2024-09-21T06:26:18.311528+0000","last_active":"2024-09-21T06:28:08.291190+0000","last_peered":"2024-09-21T06:28:08.291190+0000","last_clean":"2024-09-21T06:28:08.291190+0000","last_became_active":"2024-09-21T06:26:18.311144+0000","last_became_peered":"2024-09-21T06:26:18.311144+0000","last_unstale":"2024-09-21T06:28:08.291190+0000","last_undegraded":"2024-09-21T06:28:08.291190+0000","last_fullsized":"2024-09-21T06:28:08.291190+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:05.554255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'5","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964467+0000","last_change":"2024-09-21T06:26:16.275378+0000","last_active":"2024-09-21T06:26:38.964467+0000","last_peered":"2024-09-21T06:26:38.964467+0000","last_clean":"2024-09-21T06:26:38.964467+0000","last_became_active":"2024-09-21T06:26:16.274990+0000","last_became_peered":"2024-09-21T06:26:16.274990+0000","last_unstale":"2024-09-21T06:26:38.964467+0000","last_undegraded":"2024-09-21T06:26:38.964467+0000","last_fullsized":"2024-09-21T06:26:38.964467+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:57.252993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.289055+0000","last_change":"2024-09-21T06:26:18.300879+0000","last_active":"2024-09-21T06:28:08.289055+0000","last_peered":"2024-09-21T06:28:08.289055+0000","last_clean":"2024-09-21T06:28:08.289055+0000","last_became_active":"2024-09-21T06:26:18.300514+0000","last_became_peered":"2024-09-21T06:26:18.300514+0000","last_unstale":"2024-09-21T06:28:08.289055+0000","last_undegraded":"2024-09-21T06:28:08.289055+0000","last_fullsized":"2024-09-21T06:28:08.289055+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:02.581145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'13","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964587+0000","last_change":"2024-09-21T06:26:16.274139+0000","last_active":"2024-09-21T06:26:38.964587+0000","last_peered":"2024-09-21T06:26:38.964587+0000","last_clean":"2024-09-21T06:26:38.964587+0000","last_became_active":"2024-09-21T06:26:16.273723+0000","last_became_peered":"2024-09-21T06:26:16.273723+0000","last_unstale":"2024-09-21T06:26:38.964587+0000","last_undegraded":"2024-09-21T06:26:38.964587+0000","last_fullsized":"2024-09-21T06:26:38.964587+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:24.366714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.285338+0000","last_change":"2024-09-21T06:26:18.304602+0000","last_active":"2024-09-21T06:28:08.285338+0000","last_peered":"2024-09-21T06:28:08.285338+0000","last_clean":"2024-09-21T06:28:08.285338+0000","last_became_active":"2024-09-21T06:26:18.304259+0000","last_became_peered":"2024-09-21T06:26:18.304259+0000","last_unstale":"2024-09-21T06:28:08.285338+0000","last_undegraded":"2024-09-21T06:28:08.285338+0000","last_fullsized":"2024-09-21T06:28:08.285338+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:16.428247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:26:38.964281+0000","last_change":"2024-09-21T06:26:16.311107+0000","last_active":"2024-09-21T06:26:38.964281+0000","last_peered":"2024-09-21T06:26:38.964281+0000","last_clean":"2024-09-21T06:26:38.964281+0000","last_became_active":"2024-09-21T06:26:16.310692+0000","last_became_peered":"2024-09-21T06:26:16.310692+0000","last_unstale":"2024-09-21T06:26:38.964281+0000","last_undegraded":"2024-09-21T06:26:38.964281+0000","last_fullsized":"2024-09-21T06:26:38.964281+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:29.074606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:08.273825+0000","last_change":"2024-09-21T06:26:18.300614+0000","last_active":"2024-09-21T06:28:08.273825+0000","last_peered":"2024-09-21T06:28:08.273825+0000","last_clean":"2024-09-21T06:28:08.273825+0000","last_became_active":"2024-09-21T06:26:18.300173+0000","last_became_peered":"2024-09-21T06:26:18.300173+0000","last_unstale":"2024-09-21T06:28:08.273825+0000","last_undegraded":"2024-09-21T06:28:08.273825+0000","last_fullsized":"2024-09-21T06:28:08.273825+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:17.267746+0000","last_clean_scrub_stamp":"2024-09-21T06:26:17.267746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:49.040667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'14","reported_seq":163,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:28:12.110097+0000","last_change":"2024-09-21T06:26:38.986822+0000","last_active":"2024-09-21T06:28:12.110097+0000","last_peered":"2024-09-21T06:28:12.110097+0000","last_clean":"2024-09-21T06:28:12.110097+0000","last_became_active":"2024-09-21T06:26:38.972368+0000","last_became_peered":"2024-09-21T06:26:38.972368+0000","last_unstale":"2024-09-21T06:28:12.110097+0000","last_undegraded":"2024-09-21T06:28:12.110097+0000","last_fullsized":"2024-09-21T06:28:12.110097+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:26:15.249319+0000","last_clean_scrub_stamp":"2024-09-21T06:26:15.249319+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:53.273388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74799,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1083,"num_read_kb":627,"num_write":262,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1484,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":223473,"data_compressed":4914,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282590,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743460,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":421215,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939690,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1007616,"data_stored":1078241,"data_compressed":43480,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103215,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":876544,"data_stored":419722,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299444,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":419199,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495673,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":1012054,"data_compressed":41842,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659199,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":419630,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855428,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":1011788,"data_compressed":41842,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018952,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":864256,"data_stored":419827,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182476,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":419030,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378707,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":487572,"data_compressed":7539,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542232,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":929792,"data_stored":487604,"data_compressed":7539,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705756,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":876544,"data_stored":421193,"data_compressed":5901,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34295,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35941,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":69121,"data_compressed":1638,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":69089,"data_compressed":1638,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":69273,"data_compressed":1638,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:28:17.229 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:28:17.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:17 smithi175 ceph-mon[34510]: pgmap v324: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-21T06:28:17.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:17 smithi175 ceph-mon[34510]: from='client.15474 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:28:17.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:17 smithi071 ceph-mon[34844]: pgmap v324: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-21T06:28:17.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:17 smithi071 ceph-mon[34844]: from='client.15474 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:28:17.523 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:17.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.989+0000 7fd76a0df640 1 -- 172.21.15.63:0/3460943597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd76410c020 msgr2=0x7fd764112850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:17.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.989+0000 7fd76a0df640 1 --2- 172.21.15.63:0/3460943597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd76410c020 0x7fd764112850 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009ca0 tx=0x7fd75c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:17.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.989+0000 7fd76a0df640 1 -- 172.21.15.63:0/3460943597 shutdown_connections 2024-09-21T06:28:17.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.989+0000 7fd76a0df640 1 --2- 172.21.15.63:0/3460943597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd76410c020 0x7fd764112850 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:17.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.989+0000 7fd76a0df640 1 --2- 172.21.15.63:0/3460943597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd76410b6d0 0x7fd76410bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:17.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.989+0000 7fd76a0df640 1 --2- 172.21.15.63:0/3460943597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd764105d90 0x7fd7641061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:17.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.989+0000 7fd76a0df640 1 -- 172.21.15.63:0/3460943597 >> 172.21.15.63:0/3460943597 conn(0x7fd764101860 msgr2=0x7fd764103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:17.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.989+0000 7fd76a0df640 1 -- 172.21.15.63:0/3460943597 shutdown_connections 2024-09-21T06:28:17.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.989+0000 7fd76a0df640 1 -- 172.21.15.63:0/3460943597 wait complete. 2024-09-21T06:28:17.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.990+0000 7fd76a0df640 1 Processor -- start 2024-09-21T06:28:17.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.990+0000 7fd76a0df640 1 -- start start 2024-09-21T06:28:17.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.990+0000 7fd76a0df640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd764105d90 0x7fd76419c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:17.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.990+0000 7fd76a0df640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd76410b6d0 0x7fd76419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:17.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.990+0000 7fd76a0df640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd76410c020 0x7fd7641a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:17.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.990+0000 7fd76a0df640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd764115d30 con 0x7fd76410c020 2024-09-21T06:28:17.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.990+0000 7fd76a0df640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd764115bb0 con 0x7fd764105d90 2024-09-21T06:28:17.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.990+0000 7fd76a0df640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd764115eb0 con 0x7fd76410b6d0 2024-09-21T06:28:17.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.990+0000 7fd763fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd76410c020 0x7fd7641a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:17.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.990+0000 7fd763fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd76410c020 0x7fd7641a1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37632/0 (socket says 172.21.15.63:37632) 2024-09-21T06:28:17.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.990+0000 7fd763fff640 1 -- 172.21.15.63:0/807330166 learned_addr learned my addr 172.21.15.63:0/807330166 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:17.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.990+0000 7fd762ffd640 1 --2- 172.21.15.63:0/807330166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd76410b6d0 0x7fd76419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:17.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.990+0000 7fd7637fe640 1 --2- 172.21.15.63:0/807330166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd764105d90 0x7fd76419c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:17.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.991+0000 7fd763fff640 1 -- 172.21.15.63:0/807330166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd76410b6d0 msgr2=0x7fd76419cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:17.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.991+0000 7fd763fff640 1 --2- 172.21.15.63:0/807330166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd76410b6d0 0x7fd76419cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:17.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.991+0000 7fd763fff640 1 -- 172.21.15.63:0/807330166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd764105d90 msgr2=0x7fd76419c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:17.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.991+0000 7fd763fff640 1 --2- 172.21.15.63:0/807330166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd764105d90 0x7fd76419c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:17.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.991+0000 7fd763fff640 1 -- 172.21.15.63:0/807330166 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7641a2610 con 0x7fd76410c020 2024-09-21T06:28:17.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.991+0000 7fd763fff640 1 --2- 172.21.15.63:0/807330166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd76410c020 0x7fd7641a1ee0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009430 tx=0x7fd75c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:17.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.991+0000 7fd760ff9640 1 -- 172.21.15.63:0/807330166 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c003c30 con 0x7fd76410c020 2024-09-21T06:28:17.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.991+0000 7fd760ff9640 1 -- 172.21.15.63:0/807330166 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd75c003dd0 con 0x7fd76410c020 2024-09-21T06:28:17.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.991+0000 7fd76a0df640 1 -- 172.21.15.63:0/807330166 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7641a28a0 con 0x7fd76410c020 2024-09-21T06:28:17.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.991+0000 7fd760ff9640 1 -- 172.21.15.63:0/807330166 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c02faa0 con 0x7fd76410c020 2024-09-21T06:28:17.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.991+0000 7fd76a0df640 1 -- 172.21.15.63:0/807330166 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7641a9060 con 0x7fd76410c020 2024-09-21T06:28:17.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.992+0000 7fd76a0df640 1 -- 172.21.15.63:0/807330166 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7641061a0 con 0x7fd76410c020 2024-09-21T06:28:17.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.994+0000 7fd760ff9640 1 -- 172.21.15.63:0/807330166 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fd75c02fc40 con 0x7fd76410c020 2024-09-21T06:28:17.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.994+0000 7fd760ff9640 1 --2- 172.21.15.63:0/807330166 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd74c0b6560 0x7fd74c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:17.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.995+0000 7fd7637fe640 1 --2- 172.21.15.63:0/807330166 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd74c0b6560 0x7fd74c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:17.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.995+0000 7fd760ff9640 1 -- 172.21.15.63:0/807330166 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fd75c108900 con 0x7fd76410c020 2024-09-21T06:28:17.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.995+0000 7fd7637fe640 1 --2- 172.21.15.63:0/807330166 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd74c0b6560 0x7fd74c0b8a70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd75400bbe0 tx=0x7fd75400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:17.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:17.998+0000 7fd760ff9640 1 -- 172.21.15.63:0/807330166 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd75c0cf140 con 0x7fd76410c020 2024-09-21T06:28:18.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:18.223+0000 7fd76a0df640 1 -- 172.21.15.63:0/807330166 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd76419d7d0 con 0x7fd76410c020 2024-09-21T06:28:18.226 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:18 smithi063 ceph-mon[31150]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:28:18.226 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:18 smithi063 ceph-mon[31150]: from='client.15486 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:28:18.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:18.223+0000 7fd760ff9640 1 -- 172.21.15.63:0/807330166 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11969 (secure 0 0 0) 0x7fd76419d7d0 con 0x7fd76410c020 2024-09-21T06:28:18.227 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:28:18.227 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"btime":"2024-09-21T06:28:13:055252+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:28:12.568978+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24698,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24698":{"gid":24698,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3472481253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3472481253},{"type":"v1","addr":"172.21.15.71:6839","nonce":3472481253}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24698,"qdb_cluster":[24698,24694,24670,24676,14835]},"id":1}]} 2024-09-21T06:28:18.228 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 29 2024-09-21T06:28:18.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:18.225+0000 7fd76a0df640 1 -- 172.21.15.63:0/807330166 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd74c0b6560 msgr2=0x7fd74c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:18.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:18.225+0000 7fd76a0df640 1 --2- 172.21.15.63:0/807330166 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd74c0b6560 0x7fd74c0b8a70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd75400bbe0 tx=0x7fd75400b390 comp rx=0 tx=0).stop 2024-09-21T06:28:18.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:18.225+0000 7fd76a0df640 1 -- 172.21.15.63:0/807330166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd76410c020 msgr2=0x7fd7641a1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:18.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:18.225+0000 7fd76a0df640 1 --2- 172.21.15.63:0/807330166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd76410c020 0x7fd7641a1ee0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009430 tx=0x7fd75c0319f0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:18.226+0000 7fd76a0df640 1 -- 172.21.15.63:0/807330166 shutdown_connections 2024-09-21T06:28:18.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:18.226+0000 7fd76a0df640 1 --2- 172.21.15.63:0/807330166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd76410c020 0x7fd7641a1ee0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:18.226+0000 7fd76a0df640 1 --2- 172.21.15.63:0/807330166 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd74c0b6560 0x7fd74c0b8a70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:18.226+0000 7fd76a0df640 1 --2- 172.21.15.63:0/807330166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd76410b6d0 0x7fd76419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:18.226+0000 7fd76a0df640 1 --2- 172.21.15.63:0/807330166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd764105d90 0x7fd76419c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:18.226+0000 7fd76a0df640 1 -- 172.21.15.63:0/807330166 >> 172.21.15.63:0/807330166 conn(0x7fd764101860 msgr2=0x7fd764109c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:18.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:18.226+0000 7fd76a0df640 1 -- 172.21.15.63:0/807330166 shutdown_connections 2024-09-21T06:28:18.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:18.226+0000 7fd76a0df640 1 -- 172.21.15.63:0/807330166 wait complete. 2024-09-21T06:28:18.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:18 smithi175 ceph-mon[34510]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:28:18.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:18 smithi175 ceph-mon[34510]: from='client.15486 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:28:18.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:18 smithi071 ceph-mon[34844]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:28:18.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:18 smithi071 ceph-mon[34844]: from='client.15486 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:28:19.015 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:28:19.278 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:19.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:19 smithi063 ceph-mon[31150]: pgmap v325: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-21T06:28:19.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:19 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/807330166' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:19.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:19 smithi175 ceph-mon[34510]: pgmap v325: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-21T06:28:19.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:19 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/807330166' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:19.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:19 smithi071 ceph-mon[34844]: pgmap v325: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-21T06:28:19.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:19 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/807330166' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:19.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.951+0000 7f0c62ac1640 1 -- 172.21.15.63:0/4133986634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c5c108d30 msgr2=0x7f0c5c10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.951+0000 7f0c62ac1640 1 --2- 172.21.15.63:0/4133986634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c5c108d30 0x7f0c5c10f560 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009ca0 tx=0x7f0c5402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.951+0000 7f0c62ac1640 1 -- 172.21.15.63:0/4133986634 shutdown_connections 2024-09-21T06:28:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.951+0000 7f0c62ac1640 1 --2- 172.21.15.63:0/4133986634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c5c108d30 0x7f0c5c10f560 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.951+0000 7f0c62ac1640 1 --2- 172.21.15.63:0/4133986634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c5c1083e0 0x7f0c5c1087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.951+0000 7f0c62ac1640 1 --2- 172.21.15.63:0/4133986634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c5c102aa0 0x7f0c5c102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.951+0000 7f0c62ac1640 1 -- 172.21.15.63:0/4133986634 >> 172.21.15.63:0/4133986634 conn(0x7f0c5c079750 msgr2=0x7f0c5c079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.951+0000 7f0c62ac1640 1 -- 172.21.15.63:0/4133986634 shutdown_connections 2024-09-21T06:28:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.951+0000 7f0c62ac1640 1 -- 172.21.15.63:0/4133986634 wait complete. 2024-09-21T06:28:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.952+0000 7f0c62ac1640 1 Processor -- start 2024-09-21T06:28:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.952+0000 7f0c62ac1640 1 -- start start 2024-09-21T06:28:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.952+0000 7f0c62ac1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c5c102aa0 0x7f0c5c19b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.952+0000 7f0c62ac1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c5c1083e0 0x7f0c5c19b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.952+0000 7f0c62ac1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c5c108d30 0x7f0c5c19bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.952+0000 7f0c62ac1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c1129f0 con 0x7f0c5c102aa0 2024-09-21T06:28:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.952+0000 7f0c62ac1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c112870 con 0x7f0c5c108d30 2024-09-21T06:28:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.952+0000 7f0c62ac1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c112b70 con 0x7f0c5c1083e0 2024-09-21T06:28:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.952+0000 7f0c6085d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c5c102aa0 0x7f0c5c19b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.952+0000 7f0c6085d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c5c102aa0 0x7f0c5c19b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37646/0 (socket says 172.21.15.63:37646) 2024-09-21T06:28:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.952+0000 7f0c6085d640 1 -- 172.21.15.63:0/2929046062 learned_addr learned my addr 172.21.15.63:0/2929046062 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.952+0000 7f0c6105e640 1 --2- 172.21.15.63:0/2929046062 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c5c108d30 0x7f0c5c19bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.952+0000 7f0c5bfff640 1 --2- 172.21.15.63:0/2929046062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c5c1083e0 0x7f0c5c19b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.953+0000 7f0c6085d640 1 -- 172.21.15.63:0/2929046062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c5c1083e0 msgr2=0x7f0c5c19b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.953+0000 7f0c6085d640 1 --2- 172.21.15.63:0/2929046062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c5c1083e0 0x7f0c5c19b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.953+0000 7f0c6085d640 1 -- 172.21.15.63:0/2929046062 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c5c108d30 msgr2=0x7f0c5c19bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.953+0000 7f0c6085d640 1 --2- 172.21.15.63:0/2929046062 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c5c108d30 0x7f0c5c19bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.953+0000 7f0c6085d640 1 -- 172.21.15.63:0/2929046062 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5c1a64f0 con 0x7f0c5c102aa0 2024-09-21T06:28:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.953+0000 7f0c6105e640 1 --2- 172.21.15.63:0/2929046062 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c5c108d30 0x7f0c5c19bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.953+0000 7f0c6085d640 1 --2- 172.21.15.63:0/2929046062 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c5c102aa0 0x7f0c5c19b260 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00d950 tx=0x7f0c4c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.953+0000 7f0c59ffb640 1 -- 172.21.15.63:0/2929046062 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c017070 con 0x7f0c5c102aa0 2024-09-21T06:28:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.953+0000 7f0c62ac1640 1 -- 172.21.15.63:0/2929046062 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c5c1a67e0 con 0x7f0c5c102aa0 2024-09-21T06:28:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.953+0000 7f0c59ffb640 1 -- 172.21.15.63:0/2929046062 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c4c009c30 con 0x7f0c5c102aa0 2024-09-21T06:28:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.953+0000 7f0c59ffb640 1 -- 172.21.15.63:0/2929046062 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c00f620 con 0x7f0c5c102aa0 2024-09-21T06:28:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.953+0000 7f0c62ac1640 1 -- 172.21.15.63:0/2929046062 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c5c1a6d70 con 0x7f0c5c102aa0 2024-09-21T06:28:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.954+0000 7f0c62ac1640 1 -- 172.21.15.63:0/2929046062 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c5c102eb0 con 0x7f0c5c102aa0 2024-09-21T06:28:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.956+0000 7f0c59ffb640 1 -- 172.21.15.63:0/2929046062 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f0c4c010460 con 0x7f0c5c102aa0 2024-09-21T06:28:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.956+0000 7f0c59ffb640 1 --2- 172.21.15.63:0/2929046062 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0c440b6590 0x7f0c440b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.957+0000 7f0c5bfff640 1 --2- 172.21.15.63:0/2929046062 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0c440b6590 0x7f0c440b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.957+0000 7f0c59ffb640 1 -- 172.21.15.63:0/2929046062 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f0c4c0e70a0 con 0x7f0c5c102aa0 2024-09-21T06:28:19.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.957+0000 7f0c5bfff640 1 --2- 172.21.15.63:0/2929046062 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0c440b6590 0x7f0c440b8aa0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0c50005fd0 tx=0x7f0c50005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:19.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:19.961+0000 7f0c59ffb640 1 -- 172.21.15.63:0/2929046062 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0c4c0ad8f0 con 0x7f0c5c102aa0 2024-09-21T06:28:20.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.149+0000 7f0c62ac1640 1 -- 172.21.15.63:0/2929046062 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c5c10a590 con 0x7f0c5c102aa0 2024-09-21T06:28:20.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.150+0000 7f0c59ffb640 1 -- 172.21.15.63:0/2929046062 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+23049 (secure 0 0 0) 0x7f0c4c009de0 con 0x7f0c5c102aa0 2024-09-21T06:28:20.152 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:28:20.153 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":77,"fsid":"140899c8-77e1-11ef-baf5-efdc52797490","created":"2024-09-21T06:17:48.089366+0000","modified":"2024-09-21T06:26:38.957699+0000","last_up_change":"2024-09-21T06:25:29.072128+0000","last_in_change":"2024-09-21T06:25:06.097647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:21:36.236868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:26:15.016085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:26:17.072883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df4162c1-dd66-4d11-99bc-0ae36ea130f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6803","nonce":2090653772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6805","nonce":2090653772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6809","nonce":2090653772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6807","nonce":2090653772}]},"public_addr":"172.21.15.63:6803/2090653772","cluster_addr":"172.21.15.63:6805/2090653772","heartbeat_back_addr":"172.21.15.63:6809/2090653772","heartbeat_front_addr":"172.21.15.63:6807/2090653772","state":["exists","up"]},{"osd":1,"uuid":"65a12def-9f66-4153-8f1a-2ebfbbfeba99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6801","nonce":1676297548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6803","nonce":1676297548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6807","nonce":1676297548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6805","nonce":1676297548}]},"public_addr":"172.21.15.71:6801/1676297548","cluster_addr":"172.21.15.71:6803/1676297548","heartbeat_back_addr":"172.21.15.71:6807/1676297548","heartbeat_front_addr":"172.21.15.71:6805/1676297548","state":["exists","up"]},{"osd":2,"uuid":"031daa9e-9d4a-4901-95e8-695db5671fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6801","nonce":2356865390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6803","nonce":2356865390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6807","nonce":2356865390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6805","nonce":2356865390}]},"public_addr":"172.21.15.175:6801/2356865390","cluster_addr":"172.21.15.175:6803/2356865390","heartbeat_back_addr":"172.21.15.175:6807/2356865390","heartbeat_front_addr":"172.21.15.175:6805/2356865390","state":["exists","up"]},{"osd":3,"uuid":"75d23a7a-c560-4b26-84a4-74d6772a37ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6811","nonce":31683339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6813","nonce":31683339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6817","nonce":31683339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6815","nonce":31683339}]},"public_addr":"172.21.15.63:6811/31683339","cluster_addr":"172.21.15.63:6813/31683339","heartbeat_back_addr":"172.21.15.63:6817/31683339","heartbeat_front_addr":"172.21.15.63:6815/31683339","state":["exists","up"]},{"osd":4,"uuid":"6aaefd09-93dd-4f21-9b3c-701a7ff97f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6809","nonce":829449898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6811","nonce":829449898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6815","nonce":829449898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6813","nonce":829449898}]},"public_addr":"172.21.15.71:6809/829449898","cluster_addr":"172.21.15.71:6811/829449898","heartbeat_back_addr":"172.21.15.71:6815/829449898","heartbeat_front_addr":"172.21.15.71:6813/829449898","state":["exists","up"]},{"osd":5,"uuid":"91f28121-c94e-4012-b74c-dd4597545e3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6809","nonce":3005600597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6811","nonce":3005600597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6815","nonce":3005600597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6813","nonce":3005600597}]},"public_addr":"172.21.15.175:6809/3005600597","cluster_addr":"172.21.15.175:6811/3005600597","heartbeat_back_addr":"172.21.15.175:6815/3005600597","heartbeat_front_addr":"172.21.15.175:6813/3005600597","state":["exists","up"]},{"osd":6,"uuid":"bda28014-4dca-40f1-bb23-3ef61605c1ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6819","nonce":4044730408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6821","nonce":4044730408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6825","nonce":4044730408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6823","nonce":4044730408}]},"public_addr":"172.21.15.63:6819/4044730408","cluster_addr":"172.21.15.63:6821/4044730408","heartbeat_back_addr":"172.21.15.63:6825/4044730408","heartbeat_front_addr":"172.21.15.63:6823/4044730408","state":["exists","up"]},{"osd":7,"uuid":"a9026588-ccdc-4e6c-b628-1ac8a7dbfa64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6817","nonce":2913027708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6819","nonce":2913027708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6823","nonce":2913027708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6821","nonce":2913027708}]},"public_addr":"172.21.15.71:6817/2913027708","cluster_addr":"172.21.15.71:6819/2913027708","heartbeat_back_addr":"172.21.15.71:6823/2913027708","heartbeat_front_addr":"172.21.15.71:6821/2913027708","state":["exists","up"]},{"osd":8,"uuid":"2e1dacea-483c-4587-8d19-5c77a7b98667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6817","nonce":2058692148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6819","nonce":2058692148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6823","nonce":2058692148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6821","nonce":2058692148}]},"public_addr":"172.21.15.175:6817/2058692148","cluster_addr":"172.21.15.175:6819/2058692148","heartbeat_back_addr":"172.21.15.175:6823/2058692148","heartbeat_front_addr":"172.21.15.175:6821/2058692148","state":["exists","up"]},{"osd":9,"uuid":"7077ba4d-1fce-4197-a556-8b6a859c6f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6827","nonce":3278012285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6829","nonce":3278012285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6833","nonce":3278012285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6831","nonce":3278012285}]},"public_addr":"172.21.15.63:6827/3278012285","cluster_addr":"172.21.15.63:6829/3278012285","heartbeat_back_addr":"172.21.15.63:6833/3278012285","heartbeat_front_addr":"172.21.15.63:6831/3278012285","state":["exists","up"]},{"osd":10,"uuid":"99965496-91ee-4eef-9f2e-8f9c8dc54f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6825","nonce":3297929438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6827","nonce":3297929438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6831","nonce":3297929438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6829","nonce":3297929438}]},"public_addr":"172.21.15.71:6825/3297929438","cluster_addr":"172.21.15.71:6827/3297929438","heartbeat_back_addr":"172.21.15.71:6831/3297929438","heartbeat_front_addr":"172.21.15.71:6829/3297929438","state":["exists","up"]},{"osd":11,"uuid":"1b26d1a8-91a4-4877-ad1c-18160a1b3b6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6825","nonce":1970094291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6827","nonce":1970094291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6831","nonce":1970094291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6829","nonce":1970094291}]},"public_addr":"172.21.15.175:6825/1970094291","cluster_addr":"172.21.15.175:6827/1970094291","heartbeat_back_addr":"172.21.15.175:6831/1970094291","heartbeat_front_addr":"172.21.15.175:6829/1970094291","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:20:43.732676+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:08.957775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:34.157788+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:00.134410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:25.502998+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:51.739501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:18.325642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:44.430626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:10.776017+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:36.482831+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:01.898216+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:27.644941+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/1652196301":"2024-09-22T06:19:37.776447+0000","172.21.15.63:6801/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/2740830999":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6801/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6801/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/2958589237":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/1398493582":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/3529491525":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/363262068":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6800/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/3928056461":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/128321401":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/39222803":"2024-09-22T06:19:37.776447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:28:20.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.153+0000 7f0c62ac1640 1 -- 172.21.15.63:0/2929046062 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0c440b6590 msgr2=0x7f0c440b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:20.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.153+0000 7f0c62ac1640 1 --2- 172.21.15.63:0/2929046062 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0c440b6590 0x7f0c440b8aa0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0c50005fd0 tx=0x7f0c50005850 comp rx=0 tx=0).stop 2024-09-21T06:28:20.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.153+0000 7f0c62ac1640 1 -- 172.21.15.63:0/2929046062 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c5c102aa0 msgr2=0x7f0c5c19b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:20.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.153+0000 7f0c62ac1640 1 --2- 172.21.15.63:0/2929046062 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c5c102aa0 0x7f0c5c19b260 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00d950 tx=0x7f0c4c00de10 comp rx=0 tx=0).stop 2024-09-21T06:28:20.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.153+0000 7f0c62ac1640 1 -- 172.21.15.63:0/2929046062 shutdown_connections 2024-09-21T06:28:20.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.153+0000 7f0c62ac1640 1 --2- 172.21.15.63:0/2929046062 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c5c108d30 0x7f0c5c19bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.153+0000 7f0c62ac1640 1 --2- 172.21.15.63:0/2929046062 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0c440b6590 0x7f0c440b8aa0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.153+0000 7f0c62ac1640 1 --2- 172.21.15.63:0/2929046062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c5c1083e0 0x7f0c5c19b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.153+0000 7f0c62ac1640 1 --2- 172.21.15.63:0/2929046062 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c5c102aa0 0x7f0c5c19b260 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.153+0000 7f0c62ac1640 1 -- 172.21.15.63:0/2929046062 >> 172.21.15.63:0/2929046062 conn(0x7f0c5c079750 msgr2=0x7f0c5c1063d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:20.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.153+0000 7f0c62ac1640 1 -- 172.21.15.63:0/2929046062 shutdown_connections 2024-09-21T06:28:20.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.153+0000 7f0c62ac1640 1 -- 172.21.15.63:0/2929046062 wait complete. 2024-09-21T06:28:20.839 DEBUG:tasks.fwd_scrub:Yielding 2024-09-21T06:28:20.839 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T06:28:20.849 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T06:28:20.849 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T06:28:20.849 DEBUG:teuthology.orchestra.run.smithi063:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-21T06:28:20.849 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-21T06:28:20.850 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:28:20.850 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:28:20.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.968+0000 7f485d606640 1 -- 172.21.15.63:0/1358495440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48581029b0 msgr2=0x7f4858102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:20.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.968+0000 7f485d606640 1 --2- 172.21.15.63:0/1358495440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48581029b0 0x7f4858102dc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4848009900 tx=0x7f484802a410 comp rx=0 tx=0).stop 2024-09-21T06:28:20.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.968+0000 7f485d606640 1 -- 172.21.15.63:0/1358495440 shutdown_connections 2024-09-21T06:28:20.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.968+0000 7f485d606640 1 --2- 172.21.15.63:0/1358495440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4858108c30 0x7f485810f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.968+0000 7f485d606640 1 --2- 172.21.15.63:0/1358495440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48581082e0 0x7f48581086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.968+0000 7f485d606640 1 --2- 172.21.15.63:0/1358495440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48581029b0 0x7f4858102dc0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.968+0000 7f485d606640 1 -- 172.21.15.63:0/1358495440 >> 172.21.15.63:0/1358495440 conn(0x7f485807a740 msgr2=0x7f485807ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:20.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.968+0000 7f485d606640 1 -- 172.21.15.63:0/1358495440 shutdown_connections 2024-09-21T06:28:20.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.968+0000 7f485d606640 1 -- 172.21.15.63:0/1358495440 wait complete. 2024-09-21T06:28:20.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.969+0000 7f485d606640 1 Processor -- start 2024-09-21T06:28:20.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.969+0000 7f485d606640 1 -- start start 2024-09-21T06:28:20.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.969+0000 7f485d606640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48581029b0 0x7f485819c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:20.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.969+0000 7f485d606640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48581082e0 0x7f485819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:20.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.969+0000 7f485d606640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4858108c30 0x7f48581a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:20.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.969+0000 7f485d606640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f48581128f0 con 0x7f48581082e0 2024-09-21T06:28:20.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.969+0000 7f485d606640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4858112770 con 0x7f48581029b0 2024-09-21T06:28:20.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.969+0000 7f485d606640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4858112a70 con 0x7f4858108c30 2024-09-21T06:28:20.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.969+0000 7f48567fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48581082e0 0x7f485819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:20.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.970+0000 7f48567fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48581082e0 0x7f485819cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37668/0 (socket says 172.21.15.63:37668) 2024-09-21T06:28:20.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.970+0000 7f48567fc640 1 -- 172.21.15.63:0/135740130 learned_addr learned my addr 172.21.15.63:0/135740130 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:20.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.970+0000 7f4856ffd640 1 --2- 172.21.15.63:0/135740130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48581029b0 0x7f485819c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:20.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.970+0000 7f48577fe640 1 --2- 172.21.15.63:0/135740130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4858108c30 0x7f48581a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:20.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.970+0000 7f48567fc640 1 -- 172.21.15.63:0/135740130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4858108c30 msgr2=0x7f48581a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:20.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.970+0000 7f48567fc640 1 --2- 172.21.15.63:0/135740130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4858108c30 0x7f48581a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.970+0000 7f48567fc640 1 -- 172.21.15.63:0/135740130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48581029b0 msgr2=0x7f485819c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:20.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.970+0000 7f48567fc640 1 --2- 172.21.15.63:0/135740130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48581029b0 0x7f485819c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.970+0000 7f48567fc640 1 -- 172.21.15.63:0/135740130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48581a2580 con 0x7f48581082e0 2024-09-21T06:28:20.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.970+0000 7f48567fc640 1 --2- 172.21.15.63:0/135740130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48581082e0 0x7f485819cbf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f484c00d750 tx=0x7f484c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:20.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.970+0000 7f483ffff640 1 -- 172.21.15.63:0/135740130 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c017070 con 0x7f48581082e0 2024-09-21T06:28:20.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.970+0000 7f485d606640 1 -- 172.21.15.63:0/135740130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48581a2870 con 0x7f48581082e0 2024-09-21T06:28:20.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.970+0000 7f483ffff640 1 -- 172.21.15.63:0/135740130 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f484c0054d0 con 0x7f48581082e0 2024-09-21T06:28:20.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.970+0000 7f483ffff640 1 -- 172.21.15.63:0/135740130 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c004c30 con 0x7f48581082e0 2024-09-21T06:28:20.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.970+0000 7f485d606640 1 -- 172.21.15.63:0/135740130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48581a9000 con 0x7f48581082e0 2024-09-21T06:28:20.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.972+0000 7f485d606640 1 -- 172.21.15.63:0/135740130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4858102dc0 con 0x7f48581082e0 2024-09-21T06:28:20.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.973+0000 7f483ffff640 1 -- 172.21.15.63:0/135740130 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f484c004dd0 con 0x7f48581082e0 2024-09-21T06:28:20.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.974+0000 7f483ffff640 1 --2- 172.21.15.63:0/135740130 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f48400b6560 0x7f48400b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:20.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.974+0000 7f483ffff640 1 -- 172.21.15.63:0/135740130 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f484c0e6db0 con 0x7f48581082e0 2024-09-21T06:28:20.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.974+0000 7f4856ffd640 1 --2- 172.21.15.63:0/135740130 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f48400b6560 0x7f48400b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:20.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.974+0000 7f4856ffd640 1 --2- 172.21.15.63:0/135740130 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f48400b6560 0x7f48400b8a70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4848031440 tx=0x7f4848009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:20.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:20.978+0000 7f483ffff640 1 -- 172.21.15.63:0/135740130 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f484c0b1940 con 0x7f48581082e0 2024-09-21T06:28:21.167 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:21.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.272+0000 7f485d606640 1 -- 172.21.15.63:0/135740130 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f4858063800 con 0x7f48400b6560 2024-09-21T06:28:21.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:21 smithi175 ceph-mon[34510]: pgmap v326: 97 pgs: 97 active+clean; 654 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T06:28:21.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:21 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2929046062' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:28:21.438 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:21 smithi063 ceph-mon[31150]: pgmap v326: 97 pgs: 97 active+clean; 654 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T06:28:21.438 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:21 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2929046062' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:28:21.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.439+0000 7f483ffff640 1 -- 172.21.15.63:0/135740130 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4858063800 con 0x7f48400b6560 2024-09-21T06:28:21.440 INFO:teuthology.orchestra.run.smithi063.stdout:Schedule set for path / 2024-09-21T06:28:21.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.442+0000 7f485d606640 1 -- 172.21.15.63:0/135740130 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f48400b6560 msgr2=0x7f48400b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.442+0000 7f485d606640 1 --2- 172.21.15.63:0/135740130 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f48400b6560 0x7f48400b8a70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4848031440 tx=0x7f4848009560 comp rx=0 tx=0).stop 2024-09-21T06:28:21.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.442+0000 7f485d606640 1 -- 172.21.15.63:0/135740130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48581082e0 msgr2=0x7f485819cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.442+0000 7f485d606640 1 --2- 172.21.15.63:0/135740130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48581082e0 0x7f485819cbf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f484c00d750 tx=0x7f484c00dc10 comp rx=0 tx=0).stop 2024-09-21T06:28:21.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.442+0000 7f485d606640 1 -- 172.21.15.63:0/135740130 shutdown_connections 2024-09-21T06:28:21.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.442+0000 7f485d606640 1 --2- 172.21.15.63:0/135740130 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f48400b6560 0x7f48400b8a70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.442+0000 7f485d606640 1 --2- 172.21.15.63:0/135740130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4858108c30 0x7f48581a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.442+0000 7f485d606640 1 --2- 172.21.15.63:0/135740130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48581082e0 0x7f485819cbf0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.442+0000 7f485d606640 1 --2- 172.21.15.63:0/135740130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48581029b0 0x7f485819c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.442+0000 7f485d606640 1 -- 172.21.15.63:0/135740130 >> 172.21.15.63:0/135740130 conn(0x7f485807a740 msgr2=0x7f4858106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:21.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.442+0000 7f485d606640 1 -- 172.21.15.63:0/135740130 shutdown_connections 2024-09-21T06:28:21.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.442+0000 7f485d606640 1 -- 172.21.15.63:0/135740130 wait complete. 2024-09-21T06:28:21.456 DEBUG:teuthology.orchestra.run.smithi063:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-21T06:28:21.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:21 smithi071 ceph-mon[34844]: pgmap v326: 97 pgs: 97 active+clean; 654 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T06:28:21.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:21 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2929046062' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:28:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.572+0000 7f3aa9c94640 1 -- 172.21.15.63:0/1236076421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3aa4103b00 msgr2=0x7f3aa4103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.572+0000 7f3aa9c94640 1 --2- 172.21.15.63:0/1236076421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3aa4103b00 0x7f3aa4103f10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009900 tx=0x7f3a9402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.572+0000 7f3aa9c94640 1 -- 172.21.15.63:0/1236076421 shutdown_connections 2024-09-21T06:28:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.572+0000 7f3aa9c94640 1 --2- 172.21.15.63:0/1236076421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3aa4109d80 0x7f3aa41105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.572+0000 7f3aa9c94640 1 --2- 172.21.15.63:0/1236076421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3aa4109430 0x7f3aa4109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.572+0000 7f3aa9c94640 1 --2- 172.21.15.63:0/1236076421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3aa4103b00 0x7f3aa4103f10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.572+0000 7f3aa9c94640 1 -- 172.21.15.63:0/1236076421 >> 172.21.15.63:0/1236076421 conn(0x7f3aa40ff500 msgr2=0x7f3aa4101950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:21.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.572+0000 7f3aa9c94640 1 -- 172.21.15.63:0/1236076421 shutdown_connections 2024-09-21T06:28:21.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.572+0000 7f3aa9c94640 1 -- 172.21.15.63:0/1236076421 wait complete. 2024-09-21T06:28:21.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.572+0000 7f3aa9c94640 1 Processor -- start 2024-09-21T06:28:21.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.573+0000 7f3aa9c94640 1 -- start start 2024-09-21T06:28:21.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.573+0000 7f3aa9c94640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3aa4103b00 0x7f3aa4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.573+0000 7f3aa9c94640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3aa4109430 0x7f3aa4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.573+0000 7f3aa9c94640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3aa4109d80 0x7f3aa4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.573+0000 7f3aa9c94640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa4113a40 con 0x7f3aa4103b00 2024-09-21T06:28:21.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.573+0000 7f3aa9c94640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa41138c0 con 0x7f3aa4109430 2024-09-21T06:28:21.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.573+0000 7f3aa9c94640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa4113bc0 con 0x7f3aa4109d80 2024-09-21T06:28:21.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.573+0000 7f3aa37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3aa4103b00 0x7f3aa4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.573+0000 7f3aa37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3aa4103b00 0x7f3aa4075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37706/0 (socket says 172.21.15.63:37706) 2024-09-21T06:28:21.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.573+0000 7f3aa37fe640 1 -- 172.21.15.63:0/1747529007 learned_addr learned my addr 172.21.15.63:0/1747529007 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:21.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.573+0000 7f3aa2ffd640 1 --2- 172.21.15.63:0/1747529007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3aa4109430 0x7f3aa4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.573+0000 7f3aa3fff640 1 --2- 172.21.15.63:0/1747529007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3aa4109d80 0x7f3aa4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.573+0000 7f3aa37fe640 1 -- 172.21.15.63:0/1747529007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3aa4109d80 msgr2=0x7f3aa4076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.573+0000 7f3aa37fe640 1 --2- 172.21.15.63:0/1747529007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3aa4109d80 0x7f3aa4076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.573+0000 7f3aa37fe640 1 -- 172.21.15.63:0/1747529007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3aa4109430 msgr2=0x7f3aa4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.573+0000 7f3aa37fe640 1 --2- 172.21.15.63:0/1747529007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3aa4109430 0x7f3aa4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.574+0000 7f3aa37fe640 1 -- 172.21.15.63:0/1747529007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa41a8750 con 0x7f3aa4103b00 2024-09-21T06:28:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.574+0000 7f3aa2ffd640 1 --2- 172.21.15.63:0/1747529007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3aa4109430 0x7f3aa4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.574+0000 7f3aa37fe640 1 --2- 172.21.15.63:0/1747529007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3aa4103b00 0x7f3aa4075710 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3a94005940 tx=0x7f3a940040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.574+0000 7f3aa0ff9640 1 -- 172.21.15.63:0/1747529007 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9403f030 con 0x7f3aa4103b00 2024-09-21T06:28:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.574+0000 7f3aa0ff9640 1 -- 172.21.15.63:0/1747529007 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a940044c0 con 0x7f3aa4103b00 2024-09-21T06:28:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.574+0000 7f3aa9c94640 1 -- 172.21.15.63:0/1747529007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa41a89e0 con 0x7f3aa4103b00 2024-09-21T06:28:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.574+0000 7f3aa0ff9640 1 -- 172.21.15.63:0/1747529007 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a94035070 con 0x7f3aa4103b00 2024-09-21T06:28:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.574+0000 7f3aa9c94640 1 -- 172.21.15.63:0/1747529007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa41a8ed0 con 0x7f3aa4103b00 2024-09-21T06:28:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.575+0000 7f3aa9c94640 1 -- 172.21.15.63:0/1747529007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aa4103f10 con 0x7f3aa4103b00 2024-09-21T06:28:21.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.577+0000 7f3aa0ff9640 1 -- 172.21.15.63:0/1747529007 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f3a94042030 con 0x7f3aa4103b00 2024-09-21T06:28:21.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.577+0000 7f3aa0ff9640 1 --2- 172.21.15.63:0/1747529007 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3a8c0b6590 0x7f3a8c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.578+0000 7f3aa2ffd640 1 --2- 172.21.15.63:0/1747529007 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3a8c0b6590 0x7f3a8c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.578+0000 7f3aa0ff9640 1 -- 172.21.15.63:0/1747529007 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f3a941079c0 con 0x7f3aa4103b00 2024-09-21T06:28:21.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.578+0000 7f3aa2ffd640 1 --2- 172.21.15.63:0/1747529007 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3a8c0b6590 0x7f3a8c0b8aa0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4102d50 tx=0x7f3a98005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:21.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.580+0000 7f3aa0ff9640 1 -- 172.21.15.63:0/1747529007 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3a940d2550 con 0x7f3aa4103b00 2024-09-21T06:28:21.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.682+0000 7fb460828640 1 -- 172.21.15.63:0/2055968359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb45c108cf0 msgr2=0x7fb45c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.682+0000 7fb460828640 1 --2- 172.21.15.63:0/2055968359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb45c108cf0 0x7fb45c10f520 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb454009ca0 tx=0x7fb45402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.682+0000 7fb460828640 1 -- 172.21.15.63:0/2055968359 shutdown_connections 2024-09-21T06:28:21.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.682+0000 7fb460828640 1 --2- 172.21.15.63:0/2055968359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb45c108cf0 0x7fb45c10f520 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.682+0000 7fb460828640 1 --2- 172.21.15.63:0/2055968359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb45c1083a0 0x7fb45c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.682+0000 7fb460828640 1 --2- 172.21.15.63:0/2055968359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb45c102a60 0x7fb45c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.682+0000 7fb460828640 1 -- 172.21.15.63:0/2055968359 >> 172.21.15.63:0/2055968359 conn(0x7fb45c079730 msgr2=0x7fb45c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:21.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.682+0000 7fb460828640 1 -- 172.21.15.63:0/2055968359 shutdown_connections 2024-09-21T06:28:21.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.682+0000 7fb460828640 1 -- 172.21.15.63:0/2055968359 wait complete. 2024-09-21T06:28:21.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.683+0000 7fb460828640 1 Processor -- start 2024-09-21T06:28:21.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.683+0000 7fb460828640 1 -- start start 2024-09-21T06:28:21.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.684+0000 7fb460828640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb45c102a60 0x7fb45c19b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.684+0000 7fb460828640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb45c1083a0 0x7fb45c19b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.684+0000 7fb460828640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb45c108cf0 0x7fb45c19bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.684+0000 7fb460828640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c112960 con 0x7fb45c102a60 2024-09-21T06:28:21.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.684+0000 7fb460828640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c1127e0 con 0x7fb45c108cf0 2024-09-21T06:28:21.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.684+0000 7fb460828640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c112ae0 con 0x7fb45c1083a0 2024-09-21T06:28:21.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.684+0000 7fb45a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb45c102a60 0x7fb45c19b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.684+0000 7fb45a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb45c102a60 0x7fb45c19b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37726/0 (socket says 172.21.15.63:37726) 2024-09-21T06:28:21.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.684+0000 7fb45a59c640 1 -- 172.21.15.63:0/4275444332 learned_addr learned my addr 172.21.15.63:0/4275444332 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:21.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.684+0000 7fb459d9b640 1 --2- 172.21.15.63:0/4275444332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb45c1083a0 0x7fb45c19b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.684+0000 7fb45ad9d640 1 --2- 172.21.15.63:0/4275444332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb45c108cf0 0x7fb45c19bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.684+0000 7fb45a59c640 1 -- 172.21.15.63:0/4275444332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb45c1083a0 msgr2=0x7fb45c19b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.684+0000 7fb45a59c640 1 --2- 172.21.15.63:0/4275444332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb45c1083a0 0x7fb45c19b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.684+0000 7fb45a59c640 1 -- 172.21.15.63:0/4275444332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb45c108cf0 msgr2=0x7fb45c19bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.684+0000 7fb45a59c640 1 --2- 172.21.15.63:0/4275444332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb45c108cf0 0x7fb45c19bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.684+0000 7fb45a59c640 1 -- 172.21.15.63:0/4275444332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45c1a6530 con 0x7fb45c102a60 2024-09-21T06:28:21.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.684+0000 7fb45ad9d640 1 --2- 172.21.15.63:0/4275444332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb45c108cf0 0x7fb45c19bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:21.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.685+0000 7fb45a59c640 1 --2- 172.21.15.63:0/4275444332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb45c102a60 0x7fb45c19b270 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb44400e9f0 tx=0x7fb44400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:21.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.685+0000 7fb4537fe640 1 -- 172.21.15.63:0/4275444332 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44400cd80 con 0x7fb45c102a60 2024-09-21T06:28:21.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.685+0000 7fb4537fe640 1 -- 172.21.15.63:0/4275444332 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4440054d0 con 0x7fb45c102a60 2024-09-21T06:28:21.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.685+0000 7fb460828640 1 -- 172.21.15.63:0/4275444332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb45c1a6820 con 0x7fb45c102a60 2024-09-21T06:28:21.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.685+0000 7fb4537fe640 1 -- 172.21.15.63:0/4275444332 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444010690 con 0x7fb45c102a60 2024-09-21T06:28:21.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.685+0000 7fb460828640 1 -- 172.21.15.63:0/4275444332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb45c1a6d60 con 0x7fb45c102a60 2024-09-21T06:28:21.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.688+0000 7fb4537fe640 1 -- 172.21.15.63:0/4275444332 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fb444004e90 con 0x7fb45c102a60 2024-09-21T06:28:21.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.689+0000 7fb4537fe640 1 --2- 172.21.15.63:0/4275444332 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb4480b65e0 0x7fb4480b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.689+0000 7fb466d9c740 1 Processor -- start 2024-09-21T06:28:21.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.689+0000 7fb459d9b640 1 --2- 172.21.15.63:0/4275444332 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb4480b65e0 0x7fb4480b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.689+0000 7fb4537fe640 1 -- 172.21.15.63:0/4275444332 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fb4440e78d0 con 0x7fb45c102a60 2024-09-21T06:28:21.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.689+0000 7fb466d9c740 1 -- start start 2024-09-21T06:28:21.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.690+0000 7fb466d9c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e519350 0x55f70e8c0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.690+0000 7fb459d9b640 1 --2- 172.21.15.63:0/4275444332 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb4480b65e0 0x7fb4480b8af0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb45c105f80 tx=0x7fb44c00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:21.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.690+0000 7fb466d9c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4f0490 0x55f70e8c0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.690+0000 7fb466d9c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e4f8670 0x55f70e8c0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.690+0000 7fb466d9c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f70e836e60 con 0x55f70e519350 2024-09-21T06:28:21.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.690+0000 7fb466d9c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f70e826290 con 0x55f70e4f8670 2024-09-21T06:28:21.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.690+0000 7fb466d9c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f70e82a0a0 con 0x55f70e4f0490 2024-09-21T06:28:21.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.690+0000 7fb45a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e519350 0x55f70e8c0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.690+0000 7fb45a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e519350 0x55f70e8c0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37736/0 (socket says 172.21.15.63:37736) 2024-09-21T06:28:21.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.690+0000 7fb45a59c640 1 -- 172.21.15.63:0/2841002971 learned_addr learned my addr 172.21.15.63:0/2841002971 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:21.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.690+0000 7fb459d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4f0490 0x55f70e8c0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.690+0000 7fb45ad9d640 1 --2- 172.21.15.63:0/2841002971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e4f8670 0x55f70e8c0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.690+0000 7fb459d9b640 1 -- 172.21.15.63:0/2841002971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e4f8670 msgr2=0x55f70e8c0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:21.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.690+0000 7fb459d9b640 1 --2- 172.21.15.63:0/2841002971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e4f8670 0x55f70e8c0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.690+0000 7fb459d9b640 1 -- 172.21.15.63:0/2841002971 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e519350 msgr2=0x55f70e8c0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:21.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.690+0000 7fb459d9b640 1 --2- 172.21.15.63:0/2841002971 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e519350 0x55f70e8c0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.690+0000 7fb459d9b640 1 -- 172.21.15.63:0/2841002971 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70e584930 con 0x55f70e4f0490 2024-09-21T06:28:21.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.690+0000 7fb45a59c640 1 --2- 172.21.15.63:0/2841002971 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e519350 0x55f70e8c0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:21.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.691+0000 7fb459d9b640 1 --2- 172.21.15.63:0/2841002971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4f0490 0x55f70e8c0970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb44c005d00 tx=0x7fb44c013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73d31b928223aee6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:21.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.691+0000 7fb450ff9640 1 -- 172.21.15.63:0/2841002971 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c01e620 con 0x55f70e4f0490 2024-09-21T06:28:21.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.691+0000 7fb450ff9640 1 -- 172.21.15.63:0/2841002971 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb44c011e20 con 0x55f70e4f0490 2024-09-21T06:28:21.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.691+0000 7fb450ff9640 1 -- 172.21.15.63:0/2841002971 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c026b50 con 0x55f70e4f0490 2024-09-21T06:28:21.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.692+0000 7fb466d9c740 1 -- 172.21.15.63:0/2841002971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4f0490 msgr2=0x55f70e8c0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.692+0000 7fb466d9c740 1 --2- 172.21.15.63:0/2841002971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4f0490 0x55f70e8c0970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb44c005d00 tx=0x7fb44c013000 comp rx=0 tx=0).stop 2024-09-21T06:28:21.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.692+0000 7fb466d9c740 1 -- 172.21.15.63:0/2841002971 shutdown_connections 2024-09-21T06:28:21.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.692+0000 7fb466d9c740 1 --2- 172.21.15.63:0/2841002971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e4f8670 0x55f70e8c0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.692+0000 7fb466d9c740 1 --2- 172.21.15.63:0/2841002971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4f0490 0x55f70e8c0970 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.692+0000 7fb466d9c740 1 --2- 172.21.15.63:0/2841002971 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e519350 0x55f70e8c0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.692+0000 7fb466d9c740 1 -- 172.21.15.63:0/2841002971 >> 172.21.15.63:0/2841002971 conn(0x55f70e50d740 msgr2=0x55f70e8be320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:21.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.692+0000 7fb466d9c740 1 -- 172.21.15.63:0/2841002971 shutdown_connections 2024-09-21T06:28:21.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.692+0000 7fb466d9c740 1 -- 172.21.15.63:0/2841002971 wait complete. 2024-09-21T06:28:21.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.692+0000 7fb466d9c740 1 -- start start 2024-09-21T06:28:21.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.692+0000 7fb466d9c740 1 Processor -- start 2024-09-21T06:28:21.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.693+0000 7fb466d9c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e4f0490 0x55f70e8cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.693+0000 7fb466d9c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4f8670 0x55f70e8cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.693+0000 7fb466d9c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e519350 0x55f70e8d7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.693+0000 7fb466d9c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f70e687890 con 0x55f70e4f0490 2024-09-21T06:28:21.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.693+0000 7fb466d9c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f70e7c0d40 con 0x55f70e519350 2024-09-21T06:28:21.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.693+0000 7fb466d9c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f70e8cec10 con 0x55f70e4f8670 2024-09-21T06:28:21.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.693+0000 7fb466d9c740 10 client.0 _ll_register_callbacks cb 0x55f70e824c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:21.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.693+0000 7fb459d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4f8670 0x55f70e8cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.693+0000 7fb459d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4f8670 0x55f70e8cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:56666/0 (socket says 172.21.15.63:56666) 2024-09-21T06:28:21.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.693+0000 7fb459d9b640 1 -- 172.21.15.63:0/2656609830 learned_addr learned my addr 172.21.15.63:0/2656609830 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:21.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.693+0000 7fb45ad9d640 1 --2- 172.21.15.63:0/2656609830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e519350 0x55f70e8d7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.694+0000 7fb45a59c640 1 --2- 172.21.15.63:0/2656609830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e4f0490 0x55f70e8cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.694+0000 7fb459d9b640 1 -- 172.21.15.63:0/2656609830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e519350 msgr2=0x55f70e8d7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:21.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.694+0000 7fb459d9b640 1 --2- 172.21.15.63:0/2656609830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e519350 0x55f70e8d7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.694+0000 7fb459d9b640 1 -- 172.21.15.63:0/2656609830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e4f0490 msgr2=0x55f70e8cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:21.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.694+0000 7fb459d9b640 1 --2- 172.21.15.63:0/2656609830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e4f0490 0x55f70e8cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.694+0000 7fb459d9b640 1 -- 172.21.15.63:0/2656609830 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f70e8d8570 con 0x55f70e4f8670 2024-09-21T06:28:21.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.694+0000 7fb45a59c640 1 --2- 172.21.15.63:0/2656609830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e4f0490 0x55f70e8cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:21.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.695+0000 7fb459d9b640 1 --2- 172.21.15.63:0/2656609830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4f8670 0x55f70e8cc690 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb44c004740 tx=0x7fb44c010cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d44d04c0c7c6fd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:21.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.695+0000 7fb441ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:28:21.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.695+0000 7fb441ffb640 1 -- 172.21.15.63:0/2656609830 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c027e30 con 0x55f70e4f8670 2024-09-21T06:28:21.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.695+0000 7fb441ffb640 1 -- 172.21.15.63:0/2656609830 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fb44c01e420 con 0x55f70e4f8670 2024-09-21T06:28:21.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.695+0000 7fb466d9c740 1 -- 172.21.15.63:0/2656609830 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb44c011e20 con 0x55f70e4f8670 2024-09-21T06:28:21.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.695+0000 7fb441ffb640 1 -- 172.21.15.63:0/2656609830 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb44c03f050 con 0x55f70e4f8670 2024-09-21T06:28:21.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.695+0000 7fb466d9c740 10 client.25267 fetch_fsmap learned FSMap version 29 2024-09-21T06:28:21.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.695+0000 7fb466d9c740 1 -- 172.21.15.63:0/2656609830 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f70e8daea0 con 0x55f70e4f8670 2024-09-21T06:28:21.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.696+0000 7fb441ffb640 1 -- 172.21.15.63:0/2656609830 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb44c011e20 con 0x55f70e4f8670 2024-09-21T06:28:21.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.696+0000 7fb441ffb640 1 -- 172.21.15.63:0/2656609830 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb44c031780 con 0x55f70e4f8670 2024-09-21T06:28:21.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.696+0000 7fb466d9c740 10 client.25267 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:28:21.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.696+0000 7fb466d9c740 10 client.25267 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:21.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.696+0000 7fb466d9c740 20 client.25267 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:21.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.696+0000 7fb466d9c740 1 --2- 172.21.15.63:0/2656609830 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f70e4d7cd0 0x55f70e8de2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.696+0000 7fb466d9c740 4 client.25267 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:21.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.696+0000 7fb466d9c740 1 -- 172.21.15.63:0/2656609830 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f70e838db0 con 0x55f70e4d7cd0 2024-09-21T06:28:21.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.696+0000 7fb45a59c640 1 --2- 172.21.15.63:0/2656609830 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f70e4d7cd0 0x55f70e8de2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.697+0000 7fb45a59c640 1 --2- 172.21.15.63:0/2656609830 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f70e4d7cd0 0x55f70e8de2b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea3c7af7a86bf472 server_cookie=a1f3b7948766c1bd in_seq=0 out_seq=0 2024-09-21T06:28:21.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.697+0000 7fb441ffb640 10 client.25267 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:21.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.698+0000 7fb441ffb640 1 -- 172.21.15.63:0/2656609830 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f70e838db0 con 0x55f70e4d7cd0 2024-09-21T06:28:21.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.698+0000 7fb441ffb640 10 client.25267 handle_command_reply: tid=0 2024-09-21T06:28:21.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.698+0000 7fb466d9c740 1 client.25267 shutdown 2024-09-21T06:28:21.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.698+0000 7fb466d9c740 1 -- 172.21.15.63:0/2656609830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4f8670 msgr2=0x55f70e8cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.698+0000 7fb466d9c740 1 --2- 172.21.15.63:0/2656609830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4f8670 0x55f70e8cc690 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb44c004740 tx=0x7fb44c010cc0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.698+0000 7fb466d9c740 1 -- 172.21.15.63:0/2656609830 shutdown_connections 2024-09-21T06:28:21.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.698+0000 7fb466d9c740 1 --2- 172.21.15.63:0/2656609830 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f70e4d7cd0 0x55f70e8de2b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.698+0000 7fb466d9c740 1 --2- 172.21.15.63:0/2656609830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e519350 0x55f70e8d7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.698+0000 7fb466d9c740 1 --2- 172.21.15.63:0/2656609830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4f8670 0x55f70e8cc690 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.698+0000 7fb441ffb640 0 client.25267 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:21.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.698+0000 7fb466d9c740 1 --2- 172.21.15.63:0/2656609830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e4f0490 0x55f70e8cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.698+0000 7fb466d9c740 1 -- 172.21.15.63:0/2656609830 >> 172.21.15.63:0/2656609830 conn(0x55f70e50d740 msgr2=0x55f70e8c3610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:21.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.698+0000 7fb466d9c740 1 -- 172.21.15.63:0/2656609830 shutdown_connections 2024-09-21T06:28:21.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.698+0000 7fb466d9c740 1 -- 172.21.15.63:0/2656609830 wait complete. 2024-09-21T06:28:21.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.698+0000 7fb466d9c740 20 client.25267 trim_cache size 0 max 16384 2024-09-21T06:28:21.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.716+0000 7fb466d9c740 1 Processor -- start 2024-09-21T06:28:21.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.716+0000 7fb466d9c740 1 -- start start 2024-09-21T06:28:21.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.716+0000 7fb466d9c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4d7cd0 0x55f70e8d7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.716+0000 7fb466d9c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e4f0490 0x55f70e8c5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.716+0000 7fb466d9c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e4f8670 0x55f70e8c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.716+0000 7fb466d9c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c1af670 con 0x55f70e4f0490 2024-09-21T06:28:21.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.716+0000 7fb466d9c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c1b11b0 con 0x55f70e4f8670 2024-09-21T06:28:21.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.716+0000 7fb466d9c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c1afd40 con 0x55f70e4d7cd0 2024-09-21T06:28:21.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.716+0000 7fb459d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e4f0490 0x55f70e8c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.716+0000 7fb459d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e4f0490 0x55f70e8c5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37754/0 (socket says 172.21.15.63:37754) 2024-09-21T06:28:21.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.716+0000 7fb459d9b640 1 -- 172.21.15.63:0/2168981080 learned_addr learned my addr 172.21.15.63:0/2168981080 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:21.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.716+0000 7fb45a59c640 1 --2- 172.21.15.63:0/2168981080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4d7cd0 0x55f70e8d7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.716+0000 7fb45ad9d640 1 --2- 172.21.15.63:0/2168981080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e4f8670 0x55f70e8c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.717+0000 7fb459d9b640 1 -- 172.21.15.63:0/2168981080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4d7cd0 msgr2=0x55f70e8d7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:21.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.717+0000 7fb459d9b640 1 --2- 172.21.15.63:0/2168981080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4d7cd0 0x55f70e8d7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.717+0000 7fb459d9b640 1 -- 172.21.15.63:0/2168981080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e4f8670 msgr2=0x55f70e8c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:21.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.717+0000 7fb459d9b640 1 --2- 172.21.15.63:0/2168981080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e4f8670 0x55f70e8c5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.717+0000 7fb459d9b640 1 -- 172.21.15.63:0/2168981080 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70e8bda70 con 0x55f70e4f0490 2024-09-21T06:28:21.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.717+0000 7fb45ad9d640 1 --2- 172.21.15.63:0/2168981080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e4f8670 0x55f70e8c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:21.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.717+0000 7fb459d9b640 1 --2- 172.21.15.63:0/2168981080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e4f0490 0x55f70e8c5540 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0108d0 tx=0x7fb44c00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e459c545f5cdd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:21.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.717+0000 7fb443fff640 1 -- 172.21.15.63:0/2168981080 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c027c30 con 0x55f70e4f0490 2024-09-21T06:28:21.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.717+0000 7fb45a59c640 1 --2- 172.21.15.63:0/2168981080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4d7cd0 0x55f70e8d7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:21.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.717+0000 7fb443fff640 1 -- 172.21.15.63:0/2168981080 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb44c04a070 con 0x55f70e4f0490 2024-09-21T06:28:21.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.717+0000 7fb443fff640 1 -- 172.21.15.63:0/2168981080 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c026a40 con 0x55f70e4f0490 2024-09-21T06:28:21.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.718+0000 7fb466d9c740 1 -- 172.21.15.63:0/2168981080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e4f0490 msgr2=0x55f70e8c5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.718+0000 7fb466d9c740 1 --2- 172.21.15.63:0/2168981080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e4f0490 0x55f70e8c5540 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0108d0 tx=0x7fb44c00bf90 comp rx=0 tx=0).stop 2024-09-21T06:28:21.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.718+0000 7fb466d9c740 1 -- 172.21.15.63:0/2168981080 shutdown_connections 2024-09-21T06:28:21.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.718+0000 7fb466d9c740 1 --2- 172.21.15.63:0/2168981080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e4f8670 0x55f70e8c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.718+0000 7fb466d9c740 1 --2- 172.21.15.63:0/2168981080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e4f0490 0x55f70e8c5540 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.718+0000 7fb466d9c740 1 --2- 172.21.15.63:0/2168981080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4d7cd0 0x55f70e8d7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.718+0000 7fb466d9c740 1 -- 172.21.15.63:0/2168981080 >> 172.21.15.63:0/2168981080 conn(0x55f70e50d740 msgr2=0x55f70e8ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:21.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.718+0000 7fb466d9c740 1 -- 172.21.15.63:0/2168981080 shutdown_connections 2024-09-21T06:28:21.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.718+0000 7fb466d9c740 1 -- 172.21.15.63:0/2168981080 wait complete. 2024-09-21T06:28:21.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.719+0000 7fb466d9c740 1 -- start start 2024-09-21T06:28:21.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.719+0000 7fb466d9c740 1 Processor -- start 2024-09-21T06:28:21.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.719+0000 7fb466d9c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e4d7cd0 0x55f70e8dfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.719+0000 7fb466d9c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e4f0490 0x55f70e8dffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.719+0000 7fb466d9c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4f8670 0x55f70e947a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.719+0000 7fb466d9c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c1b0ae0 con 0x55f70e4f0490 2024-09-21T06:28:21.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.719+0000 7fb466d9c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c1b0410 con 0x55f70e4d7cd0 2024-09-21T06:28:21.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.719+0000 7fb466d9c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c1ad650 con 0x55f70e4f8670 2024-09-21T06:28:21.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.719+0000 7fb466d9c740 10 client.0 _ll_register_callbacks cb 0x7fb444009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:21.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.719+0000 7fb459d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e4f0490 0x55f70e8dffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.719+0000 7fb459d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e4f0490 0x55f70e8dffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37762/0 (socket says 172.21.15.63:37762) 2024-09-21T06:28:21.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.719+0000 7fb459d9b640 1 -- 172.21.15.63:0/975497264 learned_addr learned my addr 172.21.15.63:0/975497264 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:21.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.719+0000 7fb45a59c640 1 --2- 172.21.15.63:0/975497264 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e4d7cd0 0x55f70e8dfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.719+0000 7fb45ad9d640 1 --2- 172.21.15.63:0/975497264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4f8670 0x55f70e947a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.720+0000 7fb459d9b640 1 -- 172.21.15.63:0/975497264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4f8670 msgr2=0x55f70e947a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:21.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.720+0000 7fb459d9b640 1 --2- 172.21.15.63:0/975497264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4f8670 0x55f70e947a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.720+0000 7fb459d9b640 1 -- 172.21.15.63:0/975497264 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e4d7cd0 msgr2=0x55f70e8dfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:21.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.720+0000 7fb459d9b640 1 --2- 172.21.15.63:0/975497264 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e4d7cd0 0x55f70e8dfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.720+0000 7fb459d9b640 1 -- 172.21.15.63:0/975497264 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f70e947ff0 con 0x55f70e4f0490 2024-09-21T06:28:21.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.720+0000 7fb459d9b640 1 --2- 172.21.15.63:0/975497264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e4f0490 0x55f70e8dffd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb44c005920 tx=0x7fb44c005950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f295ec5c574d7335 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:21.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.720+0000 7fb441ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:28:21.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.720+0000 7fb441ffb640 1 -- 172.21.15.63:0/975497264 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0313f0 con 0x55f70e4f0490 2024-09-21T06:28:21.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.720+0000 7fb466d9c740 1 -- 172.21.15.63:0/975497264 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb44c04a070 con 0x55f70e4f0490 2024-09-21T06:28:21.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.720+0000 7fb441ffb640 1 -- 172.21.15.63:0/975497264 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fb44c031590 con 0x55f70e4f0490 2024-09-21T06:28:21.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.720+0000 7fb441ffb640 1 -- 172.21.15.63:0/975497264 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb44c031790 con 0x55f70e4f0490 2024-09-21T06:28:21.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.720+0000 7fb466d9c740 10 client.15531 fetch_fsmap learned FSMap version 29 2024-09-21T06:28:21.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.720+0000 7fb466d9c740 1 -- 172.21.15.63:0/975497264 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f70e949220 con 0x55f70e4f0490 2024-09-21T06:28:21.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.720+0000 7fb441ffb640 1 -- 172.21.15.63:0/975497264 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb44c04a070 con 0x55f70e4f0490 2024-09-21T06:28:21.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.721+0000 7fb441ffb640 1 -- 172.21.15.63:0/975497264 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb44c0271b0 con 0x55f70e4f0490 2024-09-21T06:28:21.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.721+0000 7fb466d9c740 10 client.15531 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:28:21.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.721+0000 7fb466d9c740 10 client.15531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:21.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.721+0000 7fb466d9c740 20 client.15531 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:21.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.721+0000 7fb466d9c740 1 --2- 172.21.15.63:0/975497264 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f70e519350 0x55f70e94b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.721+0000 7fb466d9c740 4 client.15531 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:28:21.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.721+0000 7fb466d9c740 1 -- 172.21.15.63:0/975497264 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f70e834860 con 0x55f70e519350 2024-09-21T06:28:21.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.721+0000 7fb45a59c640 1 --2- 172.21.15.63:0/975497264 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f70e519350 0x55f70e94b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.722+0000 7fb441ffb640 10 client.15531 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:21.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.722+0000 7fb45a59c640 1 --2- 172.21.15.63:0/975497264 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f70e519350 0x55f70e94b9c0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=262151cd127e36ab server_cookie=2f53c5190c137812 in_seq=0 out_seq=0 2024-09-21T06:28:21.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.723+0000 7fb441ffb640 1 -- 172.21.15.63:0/975497264 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f70e834860 con 0x55f70e519350 2024-09-21T06:28:21.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.723+0000 7fb441ffb640 10 client.15531 handle_command_reply: tid=0 2024-09-21T06:28:21.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.723+0000 7fb466d9c740 1 client.15531 shutdown 2024-09-21T06:28:21.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.723+0000 7fb466d9c740 1 -- 172.21.15.63:0/975497264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e4f0490 msgr2=0x55f70e8dffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.723+0000 7fb466d9c740 1 --2- 172.21.15.63:0/975497264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e4f0490 0x55f70e8dffd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb44c005920 tx=0x7fb44c005950 comp rx=0 tx=0).stop 2024-09-21T06:28:21.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.723+0000 7fb466d9c740 1 -- 172.21.15.63:0/975497264 shutdown_connections 2024-09-21T06:28:21.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.723+0000 7fb466d9c740 1 --2- 172.21.15.63:0/975497264 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f70e519350 0x55f70e94b9c0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.723+0000 7fb466d9c740 1 --2- 172.21.15.63:0/975497264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f70e4f8670 0x55f70e947a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.723+0000 7fb466d9c740 1 --2- 172.21.15.63:0/975497264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f70e4f0490 0x55f70e8dffd0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.723+0000 7fb441ffb640 0 client.15531 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.723+0000 7fb466d9c740 1 --2- 172.21.15.63:0/975497264 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f70e4d7cd0 0x55f70e8dfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.724+0000 7fb466d9c740 1 -- 172.21.15.63:0/975497264 >> 172.21.15.63:0/975497264 conn(0x55f70e50d740 msgr2=0x55f70e8c5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.724+0000 7fb466d9c740 1 -- 172.21.15.63:0/975497264 shutdown_connections 2024-09-21T06:28:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.724+0000 7fb466d9c740 1 -- 172.21.15.63:0/975497264 wait complete. 2024-09-21T06:28:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.724+0000 7fb466d9c740 20 client.15531 trim_cache size 0 max 16384 2024-09-21T06:28:21.729 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:28:21.729 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0, 2024-09-21T06:28:21.729 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_tag": "e7881878-4529-4e31-87c4-bfc71bc0cbfc", 2024-09-21T06:28:21.730 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": "asynchronous" 2024-09-21T06:28:21.730 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:28:21.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.724+0000 7fb460828640 1 -- 172.21.15.63:0/4275444332 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb4480b65e0 msgr2=0x7fb4480b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.724+0000 7fb460828640 1 --2- 172.21.15.63:0/4275444332 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb4480b65e0 0x7fb4480b8af0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb45c105f80 tx=0x7fb44c00b410 comp rx=0 tx=0).stop 2024-09-21T06:28:21.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.724+0000 7fb460828640 1 -- 172.21.15.63:0/4275444332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb45c102a60 msgr2=0x7fb45c19b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.724+0000 7fb460828640 1 --2- 172.21.15.63:0/4275444332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb45c102a60 0x7fb45c19b270 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb44400e9f0 tx=0x7fb44400edf0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.724+0000 7fb460828640 1 -- 172.21.15.63:0/4275444332 shutdown_connections 2024-09-21T06:28:21.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.724+0000 7fb460828640 1 --2- 172.21.15.63:0/4275444332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb45c108cf0 0x7fb45c19bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.724+0000 7fb460828640 1 --2- 172.21.15.63:0/4275444332 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb4480b65e0 0x7fb4480b8af0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.724+0000 7fb460828640 1 --2- 172.21.15.63:0/4275444332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb45c1083a0 0x7fb45c19b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.724+0000 7fb460828640 1 --2- 172.21.15.63:0/4275444332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb45c102a60 0x7fb45c19b270 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.724+0000 7fb460828640 1 -- 172.21.15.63:0/4275444332 >> 172.21.15.63:0/4275444332 conn(0x7fb45c079730 msgr2=0x7fb45c104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:21.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.725+0000 7fb460828640 1 -- 172.21.15.63:0/4275444332 shutdown_connections 2024-09-21T06:28:21.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.725+0000 7fb460828640 1 -- 172.21.15.63:0/4275444332 wait complete. 2024-09-21T06:28:21.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.804+0000 7f3aa9c94640 1 -- 172.21.15.63:0/1747529007 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f3aa40638a0 con 0x7f3a8c0b6590 2024-09-21T06:28:21.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.870+0000 7f3aa0ff9640 1 -- 172.21.15.63:0/1747529007 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f3aa40638a0 con 0x7f3a8c0b6590 2024-09-21T06:28:21.872 INFO:teuthology.orchestra.run.smithi063.stdout:Retention added to path / 2024-09-21T06:28:21.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.872+0000 7f3aa9c94640 1 -- 172.21.15.63:0/1747529007 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3a8c0b6590 msgr2=0x7f3a8c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.872+0000 7f3aa9c94640 1 --2- 172.21.15.63:0/1747529007 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3a8c0b6590 0x7f3a8c0b8aa0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4102d50 tx=0x7f3a98005f90 comp rx=0 tx=0).stop 2024-09-21T06:28:21.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.872+0000 7f3aa9c94640 1 -- 172.21.15.63:0/1747529007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3aa4103b00 msgr2=0x7f3aa4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.872+0000 7f3aa9c94640 1 --2- 172.21.15.63:0/1747529007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3aa4103b00 0x7f3aa4075710 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3a94005940 tx=0x7f3a940040c0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.872+0000 7f3aa9c94640 1 -- 172.21.15.63:0/1747529007 shutdown_connections 2024-09-21T06:28:21.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.872+0000 7f3aa9c94640 1 --2- 172.21.15.63:0/1747529007 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3a8c0b6590 0x7f3a8c0b8aa0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.872+0000 7f3aa9c94640 1 --2- 172.21.15.63:0/1747529007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3aa4109d80 0x7f3aa4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.872+0000 7f3aa9c94640 1 --2- 172.21.15.63:0/1747529007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3aa4109430 0x7f3aa4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.872+0000 7f3aa9c94640 1 --2- 172.21.15.63:0/1747529007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3aa4103b00 0x7f3aa4075710 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.872+0000 7f3aa9c94640 1 -- 172.21.15.63:0/1747529007 >> 172.21.15.63:0/1747529007 conn(0x7f3aa40ff500 msgr2=0x7f3aa4108ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:21.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.872+0000 7f3aa9c94640 1 -- 172.21.15.63:0/1747529007 shutdown_connections 2024-09-21T06:28:21.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:21.872+0000 7f3aa9c94640 1 -- 172.21.15.63:0/1747529007 wait complete. 2024-09-21T06:28:21.885 DEBUG:teuthology.orchestra.run.smithi063:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T06:28:22.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.002+0000 7f2245107640 1 -- 172.21.15.63:0/3900965327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2240104920 msgr2=0x7f2240104d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:22.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.002+0000 7f2245107640 1 --2- 172.21.15.63:0/3900965327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2240104920 0x7f2240104d30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2230009900 tx=0x7f223002a410 comp rx=0 tx=0).stop 2024-09-21T06:28:22.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.002+0000 7f2245107640 1 -- 172.21.15.63:0/3900965327 shutdown_connections 2024-09-21T06:28:22.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.002+0000 7f2245107640 1 --2- 172.21.15.63:0/3900965327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f224010dd80 0x7f2240110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.002+0000 7f2245107640 1 --2- 172.21.15.63:0/3900965327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2240105270 0x7f224010d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.002+0000 7f2245107640 1 --2- 172.21.15.63:0/3900965327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2240104920 0x7f2240104d30 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.002+0000 7f2245107640 1 -- 172.21.15.63:0/3900965327 >> 172.21.15.63:0/3900965327 conn(0x7f22400fe3b0 msgr2=0x7f2240100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:22.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.002+0000 7f2245107640 1 -- 172.21.15.63:0/3900965327 shutdown_connections 2024-09-21T06:28:22.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.002+0000 7f2245107640 1 -- 172.21.15.63:0/3900965327 wait complete. 2024-09-21T06:28:22.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.003+0000 7f2245107640 1 Processor -- start 2024-09-21T06:28:22.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.003+0000 7f2245107640 1 -- start start 2024-09-21T06:28:22.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.003+0000 7f2245107640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2240104920 0x7f224019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:22.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.003+0000 7f2245107640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2240105270 0x7f224019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:22.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.003+0000 7f2245107640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f224010dd80 0x7f224019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:22.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.003+0000 7f2245107640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f22401139e0 con 0x7f224010dd80 2024-09-21T06:28:22.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.003+0000 7f2245107640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2240113860 con 0x7f2240105270 2024-09-21T06:28:22.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.003+0000 7f2245107640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2240113b60 con 0x7f2240104920 2024-09-21T06:28:22.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.004+0000 7f223f59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f224010dd80 0x7f224019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:22.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.004+0000 7f223f59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f224010dd80 0x7f224019fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37774/0 (socket says 172.21.15.63:37774) 2024-09-21T06:28:22.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.004+0000 7f223f59e640 1 -- 172.21.15.63:0/3248438790 learned_addr learned my addr 172.21.15.63:0/3248438790 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:22.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.004+0000 7f223ed9d640 1 --2- 172.21.15.63:0/3248438790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2240104920 0x7f224019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:22.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.004+0000 7f223e59c640 1 --2- 172.21.15.63:0/3248438790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2240105270 0x7f224019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:22.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.004+0000 7f223f59e640 1 -- 172.21.15.63:0/3248438790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2240104920 msgr2=0x7f224019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:22.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.004+0000 7f223f59e640 1 --2- 172.21.15.63:0/3248438790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2240104920 0x7f224019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.004+0000 7f223f59e640 1 -- 172.21.15.63:0/3248438790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2240105270 msgr2=0x7f224019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:22.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.004+0000 7f223f59e640 1 --2- 172.21.15.63:0/3248438790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2240105270 0x7f224019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.004+0000 7f223f59e640 1 -- 172.21.15.63:0/3248438790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22401a0390 con 0x7f224010dd80 2024-09-21T06:28:22.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.004+0000 7f223f59e640 1 --2- 172.21.15.63:0/3248438790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f224010dd80 0x7f224019fc90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f223800cad0 tx=0x7f223800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:22.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.004+0000 7f2237fff640 1 -- 172.21.15.63:0/3248438790 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223800ae20 con 0x7f224010dd80 2024-09-21T06:28:22.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.004+0000 7f2237fff640 1 -- 172.21.15.63:0/3248438790 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2238005020 con 0x7f224010dd80 2024-09-21T06:28:22.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.004+0000 7f2237fff640 1 -- 172.21.15.63:0/3248438790 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223800f6b0 con 0x7f224010dd80 2024-09-21T06:28:22.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.004+0000 7f2245107640 1 -- 172.21.15.63:0/3248438790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22401a0680 con 0x7f224010dd80 2024-09-21T06:28:22.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.005+0000 7f2245107640 1 -- 172.21.15.63:0/3248438790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22401a6e10 con 0x7f224010dd80 2024-09-21T06:28:22.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.006+0000 7f2245107640 1 -- 172.21.15.63:0/3248438790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2240104d30 con 0x7f224010dd80 2024-09-21T06:28:22.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.008+0000 7f2237fff640 1 -- 172.21.15.63:0/3248438790 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f22380051d0 con 0x7f224010dd80 2024-09-21T06:28:22.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.009+0000 7f2237fff640 1 --2- 172.21.15.63:0/3248438790 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f222c0b6560 0x7f222c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:22.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.009+0000 7f223ed9d640 1 --2- 172.21.15.63:0/3248438790 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f222c0b6560 0x7f222c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:22.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.009+0000 7f2237fff640 1 -- 172.21.15.63:0/3248438790 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f22380e7800 con 0x7f224010dd80 2024-09-21T06:28:22.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.010+0000 7f223ed9d640 1 --2- 172.21.15.63:0/3248438790 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f222c0b6560 0x7f222c0b8a70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2230031440 tx=0x7f2230009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:22.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.012+0000 7f2237fff640 1 -- 172.21.15.63:0/3248438790 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2238014030 con 0x7f224010dd80 2024-09-21T06:28:22.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.110+0000 7f2237fff640 1 -- 172.21.15.63:0/3248438790 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 24) ==== 154586+0+0 (secure 0 0 0) 0x7f22380a9bd0 con 0x7f224010dd80 2024-09-21T06:28:22.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.231+0000 7f2245107640 1 -- 172.21.15.63:0/3248438790 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f2240106e90 con 0x7f222c0b6560 2024-09-21T06:28:22.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.238+0000 7f2237fff640 1 -- 172.21.15.63:0/3248438790 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f2240106e90 con 0x7f222c0b6560 2024-09-21T06:28:22.240 INFO:teuthology.orchestra.run.smithi063.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T06:28:21", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-21T06:28:22.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.240+0000 7f2245107640 1 -- 172.21.15.63:0/3248438790 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f222c0b6560 msgr2=0x7f222c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:22.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.240+0000 7f2245107640 1 --2- 172.21.15.63:0/3248438790 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f222c0b6560 0x7f222c0b8a70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2230031440 tx=0x7f2230009560 comp rx=0 tx=0).stop 2024-09-21T06:28:22.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.240+0000 7f2245107640 1 -- 172.21.15.63:0/3248438790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f224010dd80 msgr2=0x7f224019fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:22.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.240+0000 7f2245107640 1 --2- 172.21.15.63:0/3248438790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f224010dd80 0x7f224019fc90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f223800cad0 tx=0x7f223800cf90 comp rx=0 tx=0).stop 2024-09-21T06:28:22.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.240+0000 7f2245107640 1 -- 172.21.15.63:0/3248438790 shutdown_connections 2024-09-21T06:28:22.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.240+0000 7f2245107640 1 --2- 172.21.15.63:0/3248438790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f224010dd80 0x7f224019fc90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.240+0000 7f2245107640 1 --2- 172.21.15.63:0/3248438790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2240105270 0x7f224019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.240+0000 7f2245107640 1 --2- 172.21.15.63:0/3248438790 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f222c0b6560 0x7f222c0b8a70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.240+0000 7f2245107640 1 --2- 172.21.15.63:0/3248438790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2240104920 0x7f224019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.240+0000 7f2245107640 1 -- 172.21.15.63:0/3248438790 >> 172.21.15.63:0/3248438790 conn(0x7f22400fe3b0 msgr2=0x7f2240106780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:22.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.240+0000 7f2245107640 1 -- 172.21.15.63:0/3248438790 shutdown_connections 2024-09-21T06:28:22.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.240+0000 7f2245107640 1 -- 172.21.15.63:0/3248438790 wait complete. 2024-09-21T06:28:22.253 DEBUG:teuthology.orchestra.run.smithi063:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T06:28:22.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:22 smithi175 ceph-mon[34510]: from='client.15504 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:22.351 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:22 smithi063 ceph-mon[31150]: from='client.15504 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:22.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.369+0000 7fc6485ed640 1 -- 172.21.15.63:0/2839175871 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc64010dde0 msgr2=0x7fc6401102c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:22.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.369+0000 7fc6485ed640 1 --2- 172.21.15.63:0/2839175871 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc64010dde0 0x7fc6401102c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc638009ca0 tx=0x7fc63802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.369+0000 7fc6485ed640 1 -- 172.21.15.63:0/2839175871 shutdown_connections 2024-09-21T06:28:22.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.369+0000 7fc6485ed640 1 --2- 172.21.15.63:0/2839175871 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc64010dde0 0x7fc6401102c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.369+0000 7fc6485ed640 1 --2- 172.21.15.63:0/2839175871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc640105310 0x7fc64010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.369+0000 7fc6485ed640 1 --2- 172.21.15.63:0/2839175871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6401049c0 0x7fc640104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.369+0000 7fc6485ed640 1 -- 172.21.15.63:0/2839175871 >> 172.21.15.63:0/2839175871 conn(0x7fc6400fe410 msgr2=0x7fc640100860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:22.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.369+0000 7fc6485ed640 1 -- 172.21.15.63:0/2839175871 shutdown_connections 2024-09-21T06:28:22.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.369+0000 7fc6485ed640 1 -- 172.21.15.63:0/2839175871 wait complete. 2024-09-21T06:28:22.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.370+0000 7fc6485ed640 1 Processor -- start 2024-09-21T06:28:22.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.370+0000 7fc6485ed640 1 -- start start 2024-09-21T06:28:22.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.370+0000 7fc6485ed640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6401049c0 0x7fc64019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:22.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.370+0000 7fc6485ed640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc640105310 0x7fc64019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:22.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.370+0000 7fc6485ed640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc64010dde0 0x7fc64019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:22.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.370+0000 7fc6485ed640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc640113a30 con 0x7fc640105310 2024-09-21T06:28:22.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.370+0000 7fc6485ed640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc6401138b0 con 0x7fc64010dde0 2024-09-21T06:28:22.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.370+0000 7fc6485ed640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc640113bb0 con 0x7fc6401049c0 2024-09-21T06:28:22.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.370+0000 7fc645b88640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc640105310 0x7fc64019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:22.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.370+0000 7fc645b88640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc640105310 0x7fc64019a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37784/0 (socket says 172.21.15.63:37784) 2024-09-21T06:28:22.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.370+0000 7fc645b88640 1 -- 172.21.15.63:0/3856201032 learned_addr learned my addr 172.21.15.63:0/3856201032 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:22.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.371+0000 7fc646389640 1 --2- 172.21.15.63:0/3856201032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6401049c0 0x7fc64019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:22.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.371+0000 7fc646b8a640 1 --2- 172.21.15.63:0/3856201032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc64010dde0 0x7fc64019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:22.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.371+0000 7fc645b88640 1 -- 172.21.15.63:0/3856201032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6401049c0 msgr2=0x7fc64019a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:22.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.371+0000 7fc645b88640 1 --2- 172.21.15.63:0/3856201032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6401049c0 0x7fc64019a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.371+0000 7fc645b88640 1 -- 172.21.15.63:0/3856201032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc64010dde0 msgr2=0x7fc64019fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:22.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.371+0000 7fc645b88640 1 --2- 172.21.15.63:0/3856201032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc64010dde0 0x7fc64019fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.371+0000 7fc645b88640 1 -- 172.21.15.63:0/3856201032 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6401a0320 con 0x7fc640105310 2024-09-21T06:28:22.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.371+0000 7fc645b88640 1 --2- 172.21.15.63:0/3856201032 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc640105310 0x7fc64019a990 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc63000d950 tx=0x7fc63000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:22.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.371+0000 7fc6377fe640 1 -- 172.21.15.63:0/3856201032 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630017070 con 0x7fc640105310 2024-09-21T06:28:22.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.371+0000 7fc6485ed640 1 -- 172.21.15.63:0/3856201032 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6401a0610 con 0x7fc640105310 2024-09-21T06:28:22.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.371+0000 7fc6377fe640 1 -- 172.21.15.63:0/3856201032 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc630009c30 con 0x7fc640105310 2024-09-21T06:28:22.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.371+0000 7fc6377fe640 1 -- 172.21.15.63:0/3856201032 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6300047a0 con 0x7fc640105310 2024-09-21T06:28:22.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.371+0000 7fc6485ed640 1 -- 172.21.15.63:0/3856201032 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6401a6da0 con 0x7fc640105310 2024-09-21T06:28:22.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.373+0000 7fc6485ed640 1 -- 172.21.15.63:0/3856201032 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc640104dd0 con 0x7fc640105310 2024-09-21T06:28:22.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.374+0000 7fc6377fe640 1 -- 172.21.15.63:0/3856201032 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 24) ==== 154586+0+0 (secure 0 0 0) 0x7fc630004020 con 0x7fc640105310 2024-09-21T06:28:22.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.375+0000 7fc6377fe640 1 --2- 172.21.15.63:0/3856201032 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc62c0b65f0 0x7fc62c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:22.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.375+0000 7fc6377fe640 1 -- 172.21.15.63:0/3856201032 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fc6300e7270 con 0x7fc640105310 2024-09-21T06:28:22.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.375+0000 7fc646389640 1 --2- 172.21.15.63:0/3856201032 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc62c0b65f0 0x7fc62c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:22.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.375+0000 7fc646389640 1 --2- 172.21.15.63:0/3856201032 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc62c0b65f0 0x7fc62c0b8b00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00bbe0 tx=0x7fc63c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:22.382 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:28:22.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.379+0000 7fc6377fe640 1 -- 172.21.15.63:0/3856201032 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc630020020 con 0x7fc640105310 2024-09-21T06:28:22.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:22 smithi071 ceph-mon[34844]: from='client.15504 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:22.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.604+0000 7fc6485ed640 1 -- 172.21.15.63:0/3856201032 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fc6401015a0 con 0x7fc62c0b65f0 2024-09-21T06:28:22.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.612+0000 7fc6377fe640 1 -- 172.21.15.63:0/3856201032 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fc6401015a0 con 0x7fc62c0b65f0 2024-09-21T06:28:22.613 INFO:teuthology.orchestra.run.smithi063.stdout:/ 1m 6m3h 2024-09-21T06:28:22.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.614+0000 7fc6485ed640 1 -- 172.21.15.63:0/3856201032 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc62c0b65f0 msgr2=0x7fc62c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:22.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.614+0000 7fc6485ed640 1 --2- 172.21.15.63:0/3856201032 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc62c0b65f0 0x7fc62c0b8b00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00bbe0 tx=0x7fc63c00b390 comp rx=0 tx=0).stop 2024-09-21T06:28:22.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.614+0000 7fc6485ed640 1 -- 172.21.15.63:0/3856201032 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc640105310 msgr2=0x7fc64019a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:22.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.614+0000 7fc6485ed640 1 --2- 172.21.15.63:0/3856201032 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc640105310 0x7fc64019a990 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc63000d950 tx=0x7fc63000de10 comp rx=0 tx=0).stop 2024-09-21T06:28:22.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.614+0000 7fc6485ed640 1 -- 172.21.15.63:0/3856201032 shutdown_connections 2024-09-21T06:28:22.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.614+0000 7fc6485ed640 1 --2- 172.21.15.63:0/3856201032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc64010dde0 0x7fc64019fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.614+0000 7fc6485ed640 1 --2- 172.21.15.63:0/3856201032 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc640105310 0x7fc64019a990 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.614+0000 7fc6485ed640 1 --2- 172.21.15.63:0/3856201032 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc62c0b65f0 0x7fc62c0b8b00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.614+0000 7fc6485ed640 1 --2- 172.21.15.63:0/3856201032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6401049c0 0x7fc64019a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.614+0000 7fc6485ed640 1 -- 172.21.15.63:0/3856201032 >> 172.21.15.63:0/3856201032 conn(0x7fc6400fe410 msgr2=0x7fc640100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:22.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.614+0000 7fc6485ed640 1 -- 172.21.15.63:0/3856201032 shutdown_connections 2024-09-21T06:28:22.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:22.614+0000 7fc6485ed640 1 -- 172.21.15.63:0/3856201032 wait complete. 2024-09-21T06:28:22.628 DEBUG:teuthology.orchestra.run.smithi063:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-21T06:28:22.647 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:22.656 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-21T06:28:22.667 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-21T06:28:22.712 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T06:28:22.712 DEBUG:teuthology.orchestra.run.smithi063:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-21T06:28:22.715 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T06:28:22.749 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:28:22.749 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T06:28:22.749 INFO:tasks.workunit:timeout=3h 2024-09-21T06:28:22.749 INFO:tasks.workunit:cleanup=True 2024-09-21T06:28:22.750 DEBUG:teuthology.orchestra.run.smithi063:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T06:28:22.766 INFO:teuthology.orchestra.run.smithi063.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T06:28:22.766 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T06:28:22.766 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 60h/96d Inode: 1099511628283 Links: 2 2024-09-21T06:28:22.766 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:22.766 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T06:28:22.766 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-21 06:26:37.741084821 +0000 2024-09-21T06:28:22.766 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-21 06:26:37.741084821 +0000 2024-09-21T06:28:22.766 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-21 06:28:11.856287749 +0000 2024-09-21T06:28:22.766 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-21 06:26:37.741084821 +0000 2024-09-21T06:28:22.767 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T06:28:22.767 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T06:28:22.841 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:28:22.898 INFO:tasks.workunit.client.0.smithi063.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T06:28:23.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.107+0000 7fec44f1b640 1 -- 172.21.15.63:0/1067927246 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec40102a60 msgr2=0x7fec40102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.107+0000 7fec44f1b640 1 --2- 172.21.15.63:0/1067927246 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec40102a60 0x7fec40102e70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fec38009900 tx=0x7fec3802a410 comp rx=0 tx=0).stop 2024-09-21T06:28:23.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.107+0000 7fec44f1b640 1 -- 172.21.15.63:0/1067927246 shutdown_connections 2024-09-21T06:28:23.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.107+0000 7fec44f1b640 1 --2- 172.21.15.63:0/1067927246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec40108cf0 0x7fec4010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.107+0000 7fec44f1b640 1 --2- 172.21.15.63:0/1067927246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec401083a0 0x7fec401087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.107+0000 7fec44f1b640 1 --2- 172.21.15.63:0/1067927246 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec40102a60 0x7fec40102e70 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.107+0000 7fec44f1b640 1 -- 172.21.15.63:0/1067927246 >> 172.21.15.63:0/1067927246 conn(0x7fec40079730 msgr2=0x7fec40079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:23.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.107+0000 7fec44f1b640 1 -- 172.21.15.63:0/1067927246 shutdown_connections 2024-09-21T06:28:23.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.107+0000 7fec44f1b640 1 -- 172.21.15.63:0/1067927246 wait complete. 2024-09-21T06:28:23.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.108+0000 7fec44f1b640 1 Processor -- start 2024-09-21T06:28:23.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.108+0000 7fec44f1b640 1 -- start start 2024-09-21T06:28:23.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.109+0000 7fec44f1b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec40102a60 0x7fec4019b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.109+0000 7fec44f1b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec401083a0 0x7fec4019b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.109+0000 7fec44f1b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec40108cf0 0x7fec4019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.109+0000 7fec44f1b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fec401129b0 con 0x7fec40102a60 2024-09-21T06:28:23.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.109+0000 7fec44f1b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fec40112830 con 0x7fec40108cf0 2024-09-21T06:28:23.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.109+0000 7fec44f1b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fec40112b30 con 0x7fec401083a0 2024-09-21T06:28:23.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.109+0000 7fec3e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec40102a60 0x7fec4019b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.109+0000 7fec3e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec40102a60 0x7fec4019b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37800/0 (socket says 172.21.15.63:37800) 2024-09-21T06:28:23.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.109+0000 7fec3e59c640 1 -- 172.21.15.63:0/2469315682 learned_addr learned my addr 172.21.15.63:0/2469315682 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:23.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.109+0000 7fec3dd9b640 1 --2- 172.21.15.63:0/2469315682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec401083a0 0x7fec4019b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.109+0000 7fec3ed9d640 1 --2- 172.21.15.63:0/2469315682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec40108cf0 0x7fec4019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.109+0000 7fec3e59c640 1 -- 172.21.15.63:0/2469315682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec401083a0 msgr2=0x7fec4019b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.109+0000 7fec3e59c640 1 --2- 172.21.15.63:0/2469315682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec401083a0 0x7fec4019b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.109+0000 7fec3e59c640 1 -- 172.21.15.63:0/2469315682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec40108cf0 msgr2=0x7fec4019bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.109+0000 7fec3e59c640 1 --2- 172.21.15.63:0/2469315682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec40108cf0 0x7fec4019bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.109+0000 7fec3e59c640 1 -- 172.21.15.63:0/2469315682 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec401a65a0 con 0x7fec40102a60 2024-09-21T06:28:23.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.109+0000 7fec3dd9b640 1 --2- 172.21.15.63:0/2469315682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec401083a0 0x7fec4019b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:23.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.109+0000 7fec3e59c640 1 --2- 172.21.15.63:0/2469315682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec40102a60 0x7fec4019b2e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fec38005ab0 tx=0x7fec38003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:23.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.110+0000 7fec377fe640 1 -- 172.21.15.63:0/2469315682 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3803f070 con 0x7fec40102a60 2024-09-21T06:28:23.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.110+0000 7fec377fe640 1 -- 172.21.15.63:0/2469315682 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec38031b60 con 0x7fec40102a60 2024-09-21T06:28:23.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.110+0000 7fec377fe640 1 -- 172.21.15.63:0/2469315682 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec38035030 con 0x7fec40102a60 2024-09-21T06:28:23.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.110+0000 7fec44f1b640 1 -- 172.21.15.63:0/2469315682 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec401a6830 con 0x7fec40102a60 2024-09-21T06:28:23.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.110+0000 7fec44f1b640 1 -- 172.21.15.63:0/2469315682 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec401a6d10 con 0x7fec40102a60 2024-09-21T06:28:23.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.113+0000 7fec4b48f740 1 Processor -- start 2024-09-21T06:28:23.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.113+0000 7fec4b48f740 1 -- start start 2024-09-21T06:28:23.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.113+0000 7fec4b48f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4cc070 0x56339b873270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.113+0000 7fec4b48f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4a31b0 0x56339b8737b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.113+0000 7fec4b48f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4ab390 0x56339b873cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.113+0000 7fec377fe640 1 -- 172.21.15.63:0/2469315682 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 24) ==== 154586+0+0 (secure 0 0 0) 0x7fec38042070 con 0x7fec40102a60 2024-09-21T06:28:23.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.113+0000 7fec4b48f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56339b7e9e50 con 0x56339b4ab390 2024-09-21T06:28:23.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.113+0000 7fec4b48f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56339b7d9280 con 0x56339b4cc070 2024-09-21T06:28:23.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.113+0000 7fec4b48f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56339b7dd090 con 0x56339b4a31b0 2024-09-21T06:28:23.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.113+0000 7fec3dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4ab390 0x56339b873cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.113+0000 7fec3dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4ab390 0x56339b873cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37812/0 (socket says 172.21.15.63:37812) 2024-09-21T06:28:23.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.113+0000 7fec3dd9b640 1 -- 172.21.15.63:0/1792014679 learned_addr learned my addr 172.21.15.63:0/1792014679 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:23.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.113+0000 7fec3ed9d640 1 --2- 172.21.15.63:0/1792014679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4cc070 0x56339b873270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.113+0000 7fec3e59c640 1 --2- 172.21.15.63:0/1792014679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4a31b0 0x56339b8737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.114+0000 7fec3dd9b640 1 -- 172.21.15.63:0/1792014679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4a31b0 msgr2=0x56339b8737b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:23.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.114+0000 7fec3dd9b640 1 --2- 172.21.15.63:0/1792014679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4a31b0 0x56339b8737b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.114+0000 7fec3dd9b640 1 -- 172.21.15.63:0/1792014679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4cc070 msgr2=0x56339b873270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:23.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.114+0000 7fec3dd9b640 1 --2- 172.21.15.63:0/1792014679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4cc070 0x56339b873270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.114+0000 7fec3dd9b640 1 -- 172.21.15.63:0/1792014679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56339b537650 con 0x56339b4ab390 2024-09-21T06:28:23.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.114+0000 7fec3dd9b640 1 --2- 172.21.15.63:0/1792014679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4ab390 0x56339b873cf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fec28009cb0 tx=0x7fec280117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae4426a93f9161d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:23.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.114+0000 7fec377fe640 1 --2- 172.21.15.63:0/2469315682 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fec2c0b65f0 0x7fec2c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.114+0000 7fec34ff9640 1 -- 172.21.15.63:0/1792014679 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec28012450 con 0x56339b4ab390 2024-09-21T06:28:23.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.114+0000 7fec34ff9640 1 -- 172.21.15.63:0/1792014679 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec28012aa0 con 0x56339b4ab390 2024-09-21T06:28:23.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.114+0000 7fec34ff9640 1 -- 172.21.15.63:0/1792014679 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2800fb70 con 0x56339b4ab390 2024-09-21T06:28:23.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.114+0000 7fec3ed9d640 1 --2- 172.21.15.63:0/2469315682 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fec2c0b65f0 0x7fec2c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.114+0000 7fec377fe640 1 -- 172.21.15.63:0/2469315682 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fec38107de0 con 0x7fec40102a60 2024-09-21T06:28:23.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.115+0000 7fec4b48f740 1 -- 172.21.15.63:0/1792014679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4ab390 msgr2=0x56339b873cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.115+0000 7fec3ed9d640 1 --2- 172.21.15.63:0/2469315682 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fec2c0b65f0 0x7fec2c0b8b00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fec30005fd0 tx=0x7fec30009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:23.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.115+0000 7fec4b48f740 1 --2- 172.21.15.63:0/1792014679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4ab390 0x56339b873cf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fec28009cb0 tx=0x7fec280117b0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.115+0000 7fec4b48f740 1 -- 172.21.15.63:0/1792014679 shutdown_connections 2024-09-21T06:28:23.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.115+0000 7fec4b48f740 1 --2- 172.21.15.63:0/1792014679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4ab390 0x56339b873cf0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.115+0000 7fec4b48f740 1 --2- 172.21.15.63:0/1792014679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4a31b0 0x56339b8737b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.115+0000 7fec4b48f740 1 --2- 172.21.15.63:0/1792014679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4cc070 0x56339b873270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.115+0000 7fec4b48f740 1 -- 172.21.15.63:0/1792014679 >> 172.21.15.63:0/1792014679 conn(0x56339b4c0460 msgr2=0x56339b871160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:23.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.116+0000 7fec4b48f740 1 -- 172.21.15.63:0/1792014679 shutdown_connections 2024-09-21T06:28:23.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.116+0000 7fec4b48f740 1 -- 172.21.15.63:0/1792014679 wait complete. 2024-09-21T06:28:23.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.116+0000 7fec4b48f740 1 -- start start 2024-09-21T06:28:23.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.116+0000 7fec4b48f740 1 Processor -- start 2024-09-21T06:28:23.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.116+0000 7fec4b48f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4a31b0 0x56339b87e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.116+0000 7fec4b48f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4ab390 0x56339b87ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.116+0000 7fec4b48f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4cc070 0x56339b87f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.116+0000 7fec4b48f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56339b63a700 con 0x56339b4cc070 2024-09-21T06:28:23.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.116+0000 7fec4b48f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56339b774110 con 0x56339b4ab390 2024-09-21T06:28:23.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.116+0000 7fec4b48f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56339b881a50 con 0x56339b4a31b0 2024-09-21T06:28:23.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.116+0000 7fec4b48f740 10 client.0 _ll_register_callbacks cb 0x56339b78d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:23.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.117+0000 7fec3ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4cc070 0x56339b87f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.117+0000 7fec3ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4cc070 0x56339b87f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37820/0 (socket says 172.21.15.63:37820) 2024-09-21T06:28:23.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.117+0000 7fec3ed9d640 1 -- 172.21.15.63:0/3371429523 learned_addr learned my addr 172.21.15.63:0/3371429523 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:23.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.117+0000 7fec3dd9b640 1 --2- 172.21.15.63:0/3371429523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4ab390 0x56339b87ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.117+0000 7fec3e59c640 1 --2- 172.21.15.63:0/3371429523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4a31b0 0x56339b87e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.117+0000 7fec3ed9d640 1 -- 172.21.15.63:0/3371429523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4a31b0 msgr2=0x56339b87e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:23.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.117+0000 7fec3ed9d640 1 --2- 172.21.15.63:0/3371429523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4a31b0 0x56339b87e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.117+0000 7fec3ed9d640 1 -- 172.21.15.63:0/3371429523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4ab390 msgr2=0x56339b87ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:23.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.117+0000 7fec3ed9d640 1 --2- 172.21.15.63:0/3371429523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4ab390 0x56339b87ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.117+0000 7fec3ed9d640 1 -- 172.21.15.63:0/3371429523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56339b7a1c40 con 0x56339b4cc070 2024-09-21T06:28:23.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.117+0000 7fec3dd9b640 1 --2- 172.21.15.63:0/3371429523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4ab390 0x56339b87ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:23.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.117+0000 7fec3ed9d640 1 --2- 172.21.15.63:0/3371429523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4cc070 0x56339b87f2d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fec300099c0 tx=0x7fec30004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a616eb9fbd6a05 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:23.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.117+0000 7fec25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:28:23.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.117+0000 7fec25ffb640 1 -- 172.21.15.63:0/3371429523 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec30004b20 con 0x56339b4cc070 2024-09-21T06:28:23.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.118+0000 7fec4b48f740 1 -- 172.21.15.63:0/3371429523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec28012aa0 con 0x56339b4cc070 2024-09-21T06:28:23.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.118+0000 7fec25ffb640 1 -- 172.21.15.63:0/3371429523 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fec30004cc0 con 0x56339b4cc070 2024-09-21T06:28:23.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.118+0000 7fec25ffb640 1 -- 172.21.15.63:0/3371429523 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fec3000f7d0 con 0x56339b4cc070 2024-09-21T06:28:23.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.118+0000 7fec4b48f740 10 client.15555 fetch_fsmap learned FSMap version 29 2024-09-21T06:28:23.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.118+0000 7fec4b48f740 1 -- 172.21.15.63:0/3371429523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56339b895f70 con 0x56339b4cc070 2024-09-21T06:28:23.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.118+0000 7fec25ffb640 1 -- 172.21.15.63:0/3371429523 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec28012aa0 con 0x56339b4cc070 2024-09-21T06:28:23.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.118+0000 7fec25ffb640 1 -- 172.21.15.63:0/3371429523 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fec30026070 con 0x56339b4cc070 2024-09-21T06:28:23.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.118+0000 7fec4b48f740 10 client.15555 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:28:23.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.118+0000 7fec4b48f740 10 client.15555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:23.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.118+0000 7fec4b48f740 20 client.15555 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:23.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.118+0000 7fec4b48f740 1 --2- 172.21.15.63:0/3371429523 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x56339b48a9f0 0x56339b8995b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.118+0000 7fec4b48f740 4 client.15555 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:23.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.118+0000 7fec4b48f740 1 -- 172.21.15.63:0/3371429523 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56339b7ebda0 con 0x56339b48a9f0 2024-09-21T06:28:23.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.119+0000 7fec3e59c640 1 --2- 172.21.15.63:0/3371429523 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x56339b48a9f0 0x56339b8995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.119+0000 7fec25ffb640 10 client.15555 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:23.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.119+0000 7fec3e59c640 1 --2- 172.21.15.63:0/3371429523 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x56339b48a9f0 0x56339b8995b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3309142665f03e47 server_cookie=efc84882cd03c6f6 in_seq=0 out_seq=0 2024-09-21T06:28:23.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.120+0000 7fec25ffb640 1 -- 172.21.15.63:0/3371429523 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56339b7ebda0 con 0x56339b48a9f0 2024-09-21T06:28:23.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.120+0000 7fec25ffb640 10 client.15555 handle_command_reply: tid=0 2024-09-21T06:28:23.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.120+0000 7fec4b48f740 1 client.15555 shutdown 2024-09-21T06:28:23.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.120+0000 7fec4b48f740 1 -- 172.21.15.63:0/3371429523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4cc070 msgr2=0x56339b87f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.120+0000 7fec4b48f740 1 --2- 172.21.15.63:0/3371429523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4cc070 0x56339b87f2d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fec300099c0 tx=0x7fec30004ab0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.120+0000 7fec4b48f740 1 -- 172.21.15.63:0/3371429523 shutdown_connections 2024-09-21T06:28:23.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.120+0000 7fec4b48f740 1 --2- 172.21.15.63:0/3371429523 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x56339b48a9f0 0x56339b8995b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.120+0000 7fec4b48f740 1 --2- 172.21.15.63:0/3371429523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4cc070 0x56339b87f2d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.120+0000 7fec4b48f740 1 --2- 172.21.15.63:0/3371429523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4ab390 0x56339b87ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.120+0000 7fec4b48f740 1 --2- 172.21.15.63:0/3371429523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4a31b0 0x56339b87e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.120+0000 7fec4b48f740 1 -- 172.21.15.63:0/3371429523 >> 172.21.15.63:0/3371429523 conn(0x56339b4c0460 msgr2=0x56339b876400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:23.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.120+0000 7fec25ffb640 0 client.15555 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:23.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.120+0000 7fec4b48f740 1 -- 172.21.15.63:0/3371429523 shutdown_connections 2024-09-21T06:28:23.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.120+0000 7fec4b48f740 1 -- 172.21.15.63:0/3371429523 wait complete. 2024-09-21T06:28:23.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.120+0000 7fec4b48f740 20 client.15555 trim_cache size 0 max 16384 2024-09-21T06:28:23.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.143+0000 7fec4b48f740 1 Processor -- start 2024-09-21T06:28:23.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.144+0000 7fec4b48f740 1 -- start start 2024-09-21T06:28:23.146 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:23 smithi063 ceph-mon[31150]: scrub queued for path: / 2024-09-21T06:28:23.146 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:23 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:23.146 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:23 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:28:23.146 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:23 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:23.147 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:23 smithi063 ceph-mon[31150]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:23.147 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:23 smithi063 ceph-mon[31150]: pgmap v327: 97 pgs: 97 active+clean; 654 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-21T06:28:23.147 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:23 smithi063 ceph-mon[31150]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T06:28:23.147 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:23 smithi063 ceph-mon[31150]: from='client.15537 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:23.147 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:23 smithi063 ceph-mon[31150]: from='client.15543 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.144+0000 7fec4b48f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4a31b0 0x56339b880730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.144+0000 7fec4b48f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4ab390 0x56339b874960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.144+0000 7fec4b48f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4cc070 0x56339b87ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.144+0000 7fec4b48f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fec401ad420 con 0x56339b4a31b0 2024-09-21T06:28:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.144+0000 7fec4b48f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fec401aef60 con 0x56339b4ab390 2024-09-21T06:28:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.144+0000 7fec4b48f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fec401adaf0 con 0x56339b4cc070 2024-09-21T06:28:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.144+0000 7fec3dd9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4ab390 0x56339b874960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.144+0000 7fec3dd9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4ab390 0x56339b874960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:38736/0 (socket says 172.21.15.63:38736) 2024-09-21T06:28:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.144+0000 7fec3dd9b640 1 -- 172.21.15.63:0/1540704026 learned_addr learned my addr 172.21.15.63:0/1540704026 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:23.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.144+0000 7fec3e59c640 1 --2- 172.21.15.63:0/1540704026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4a31b0 0x56339b880730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.144+0000 7fec3ed9d640 1 --2- 172.21.15.63:0/1540704026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4cc070 0x56339b87ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.145+0000 7fec3dd9b640 1 -- 172.21.15.63:0/1540704026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4cc070 msgr2=0x56339b87ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:23.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.145+0000 7fec3dd9b640 1 --2- 172.21.15.63:0/1540704026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4cc070 0x56339b87ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.145+0000 7fec3dd9b640 1 -- 172.21.15.63:0/1540704026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4a31b0 msgr2=0x56339b880730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:23.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.145+0000 7fec3dd9b640 1 --2- 172.21.15.63:0/1540704026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4a31b0 0x56339b880730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.145+0000 7fec3dd9b640 1 -- 172.21.15.63:0/1540704026 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56339b8716a0 con 0x56339b4ab390 2024-09-21T06:28:23.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.145+0000 7fec3ed9d640 1 --2- 172.21.15.63:0/1540704026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4cc070 0x56339b87ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:23.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.145+0000 7fec3dd9b640 1 --2- 172.21.15.63:0/1540704026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4ab390 0x56339b874960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fec28009c80 tx=0x7fec28009650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6faad96934a54e23 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:23.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.145+0000 7fec27fff640 1 -- 172.21.15.63:0/1540704026 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec28029070 con 0x56339b4ab390 2024-09-21T06:28:23.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.145+0000 7fec27fff640 1 -- 172.21.15.63:0/1540704026 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec28009da0 con 0x56339b4ab390 2024-09-21T06:28:23.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.145+0000 7fec27fff640 1 -- 172.21.15.63:0/1540704026 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec280128f0 con 0x56339b4ab390 2024-09-21T06:28:23.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.146+0000 7fec4b48f740 1 -- 172.21.15.63:0/1540704026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4ab390 msgr2=0x56339b874960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.146+0000 7fec4b48f740 1 --2- 172.21.15.63:0/1540704026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4ab390 0x56339b874960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fec28009c80 tx=0x7fec28009650 comp rx=0 tx=0).stop 2024-09-21T06:28:23.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.146+0000 7fec4b48f740 1 -- 172.21.15.63:0/1540704026 shutdown_connections 2024-09-21T06:28:23.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.146+0000 7fec4b48f740 1 --2- 172.21.15.63:0/1540704026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4cc070 0x56339b87ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.146+0000 7fec4b48f740 1 --2- 172.21.15.63:0/1540704026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4ab390 0x56339b874960 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.146+0000 7fec4b48f740 1 --2- 172.21.15.63:0/1540704026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4a31b0 0x56339b880730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.146+0000 7fec4b48f740 1 -- 172.21.15.63:0/1540704026 >> 172.21.15.63:0/1540704026 conn(0x56339b4c0460 msgr2=0x56339b874250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:23.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.146+0000 7fec4b48f740 1 -- 172.21.15.63:0/1540704026 shutdown_connections 2024-09-21T06:28:23.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.146+0000 7fec4b48f740 1 -- 172.21.15.63:0/1540704026 wait complete. 2024-09-21T06:28:23.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.146+0000 7fec4b48f740 1 -- start start 2024-09-21T06:28:23.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.147+0000 7fec4b48f740 1 Processor -- start 2024-09-21T06:28:23.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.147+0000 7fec4b48f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4a31b0 0x56339b88aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.147+0000 7fec4b48f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4ab390 0x56339b88b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.147+0000 7fec4b48f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4cc070 0x56339b8fc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.147+0000 7fec4b48f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fec401ae890 con 0x56339b4a31b0 2024-09-21T06:28:23.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.147+0000 7fec4b48f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fec401ae1c0 con 0x56339b4cc070 2024-09-21T06:28:23.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.147+0000 7fec4b48f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fec401ab400 con 0x56339b4ab390 2024-09-21T06:28:23.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.147+0000 7fec4b48f740 10 client.0 _ll_register_callbacks cb 0x7fec30009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:23.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.147+0000 7fec3e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4a31b0 0x56339b88aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.147+0000 7fec3e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4a31b0 0x56339b88aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37848/0 (socket says 172.21.15.63:37848) 2024-09-21T06:28:23.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.147+0000 7fec3ed9d640 1 --2- 172.21.15.63:0/3138985895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4cc070 0x56339b8fc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.147+0000 7fec3e59c640 1 -- 172.21.15.63:0/3138985895 learned_addr learned my addr 172.21.15.63:0/3138985895 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:23.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.147+0000 7fec3dd9b640 1 --2- 172.21.15.63:0/3138985895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4ab390 0x56339b88b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.147+0000 7fec3e59c640 1 -- 172.21.15.63:0/3138985895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4ab390 msgr2=0x56339b88b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:23.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.147+0000 7fec3e59c640 1 --2- 172.21.15.63:0/3138985895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4ab390 0x56339b88b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.147+0000 7fec3e59c640 1 -- 172.21.15.63:0/3138985895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4cc070 msgr2=0x56339b8fc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:23.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.147+0000 7fec3e59c640 1 --2- 172.21.15.63:0/3138985895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4cc070 0x56339b8fc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.147+0000 7fec3e59c640 1 -- 172.21.15.63:0/3138985895 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56339b8fc6c0 con 0x56339b4a31b0 2024-09-21T06:28:23.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.147+0000 7fec3ed9d640 1 --2- 172.21.15.63:0/3138985895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4cc070 0x56339b8fc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:23.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.148+0000 7fec3e59c640 1 --2- 172.21.15.63:0/3138985895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4a31b0 0x56339b88aef0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fec380cafa0 tx=0x7fec3810b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05b19e79899b581 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:23.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.148+0000 7fec25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:28:23.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.148+0000 7fec25ffb640 1 -- 172.21.15.63:0/3138985895 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec38049040 con 0x56339b4a31b0 2024-09-21T06:28:23.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.148+0000 7fec25ffb640 1 -- 172.21.15.63:0/3138985895 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fec380c9fa0 con 0x56339b4a31b0 2024-09-21T06:28:23.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.148+0000 7fec4b48f740 1 -- 172.21.15.63:0/3138985895 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec28009da0 con 0x56339b4a31b0 2024-09-21T06:28:23.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.148+0000 7fec25ffb640 1 -- 172.21.15.63:0/3138985895 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fec380cdb00 con 0x56339b4a31b0 2024-09-21T06:28:23.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.148+0000 7fec4b48f740 10 client.15561 fetch_fsmap learned FSMap version 29 2024-09-21T06:28:23.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.148+0000 7fec4b48f740 1 -- 172.21.15.63:0/3138985895 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56339b903a50 con 0x56339b4a31b0 2024-09-21T06:28:23.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.148+0000 7fec25ffb640 1 -- 172.21.15.63:0/3138985895 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec28009da0 con 0x56339b4a31b0 2024-09-21T06:28:23.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.148+0000 7fec25ffb640 1 -- 172.21.15.63:0/3138985895 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fec3803b460 con 0x56339b4a31b0 2024-09-21T06:28:23.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.148+0000 7fec4b48f740 10 client.15561 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:28:23.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.149+0000 7fec4b48f740 10 client.15561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:23.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.149+0000 7fec4b48f740 20 client.15561 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:23.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.149+0000 7fec4b48f740 1 --2- 172.21.15.63:0/3138985895 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x56339b45fda0 0x56339b9061f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.149+0000 7fec4b48f740 4 client.15561 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:28:23.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.149+0000 7fec4b48f740 1 -- 172.21.15.63:0/3138985895 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56339b7e7850 con 0x56339b45fda0 2024-09-21T06:28:23.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.149+0000 7fec3dd9b640 1 --2- 172.21.15.63:0/3138985895 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x56339b45fda0 0x56339b9061f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.149+0000 7fec25ffb640 10 client.15561 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:23.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.149+0000 7fec3dd9b640 1 --2- 172.21.15.63:0/3138985895 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x56339b45fda0 0x56339b9061f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=821f663a2e658bc8 server_cookie=9042fc3afa717993 in_seq=0 out_seq=0 2024-09-21T06:28:23.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.150+0000 7fec25ffb640 1 -- 172.21.15.63:0/3138985895 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x56339b7e7850 con 0x56339b45fda0 2024-09-21T06:28:23.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.150+0000 7fec25ffb640 10 client.15561 handle_command_reply: tid=0 2024-09-21T06:28:23.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.150+0000 7fec4b48f740 1 client.15561 shutdown 2024-09-21T06:28:23.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.150+0000 7fec4b48f740 1 -- 172.21.15.63:0/3138985895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4a31b0 msgr2=0x56339b88aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.150+0000 7fec4b48f740 1 --2- 172.21.15.63:0/3138985895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4a31b0 0x56339b88aef0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fec380cafa0 tx=0x7fec3810b930 comp rx=0 tx=0).stop 2024-09-21T06:28:23.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.150+0000 7fec4b48f740 1 -- 172.21.15.63:0/3138985895 shutdown_connections 2024-09-21T06:28:23.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.150+0000 7fec4b48f740 1 --2- 172.21.15.63:0/3138985895 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x56339b45fda0 0x56339b9061f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.150+0000 7fec4b48f740 1 --2- 172.21.15.63:0/3138985895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56339b4cc070 0x56339b8fc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.150+0000 7fec4b48f740 1 --2- 172.21.15.63:0/3138985895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56339b4ab390 0x56339b88b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.150+0000 7fec4b48f740 1 --2- 172.21.15.63:0/3138985895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56339b4a31b0 0x56339b88aef0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.150+0000 7fec4b48f740 1 -- 172.21.15.63:0/3138985895 >> 172.21.15.63:0/3138985895 conn(0x56339b4c0460 msgr2=0x56339b880460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:23.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.150+0000 7fec25ffb640 0 client.15561 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:23.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.150+0000 7fec4b48f740 1 -- 172.21.15.63:0/3138985895 shutdown_connections 2024-09-21T06:28:23.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.150+0000 7fec4b48f740 1 -- 172.21.15.63:0/3138985895 wait complete. 2024-09-21T06:28:23.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.150+0000 7fec4b48f740 20 client.15561 trim_cache size 0 max 16384 2024-09-21T06:28:23.158 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:28:23.158 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:28:23.158 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": { 2024-09-21T06:28:23.158 INFO:teuthology.orchestra.run.smithi063.stdout: "e7881878-4529-4e31-87c4-bfc71bc0cbfc": { 2024-09-21T06:28:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:28:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: "tag": "e7881878-4529-4e31-87c4-bfc71bc0cbfc", 2024-09-21T06:28:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: "options": "recursive,force" 2024-09-21T06:28:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:28:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:28:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:28:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: "e7881878-4529-4e31-87c4-bfc71bc0cbfc": { 2024-09-21T06:28:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:28:21.722259+0000", 2024-09-21T06:28:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:28:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:28:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:28:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:28:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:28:23.160 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:28:23.160 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:28:23.160 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:28:23.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.151+0000 7fec44f1b640 1 -- 172.21.15.63:0/2469315682 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fec2c0b65f0 msgr2=0x7fec2c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.151+0000 7fec44f1b640 1 --2- 172.21.15.63:0/2469315682 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fec2c0b65f0 0x7fec2c0b8b00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fec30005fd0 tx=0x7fec30009500 comp rx=0 tx=0).stop 2024-09-21T06:28:23.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.151+0000 7fec44f1b640 1 -- 172.21.15.63:0/2469315682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec40102a60 msgr2=0x7fec4019b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.151+0000 7fec44f1b640 1 --2- 172.21.15.63:0/2469315682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec40102a60 0x7fec4019b2e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fec38005ab0 tx=0x7fec38003c10 comp rx=0 tx=0).stop 2024-09-21T06:28:23.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.151+0000 7fec44f1b640 1 -- 172.21.15.63:0/2469315682 shutdown_connections 2024-09-21T06:28:23.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.151+0000 7fec44f1b640 1 --2- 172.21.15.63:0/2469315682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec40108cf0 0x7fec4019bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.151+0000 7fec44f1b640 1 --2- 172.21.15.63:0/2469315682 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fec2c0b65f0 0x7fec2c0b8b00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.151+0000 7fec44f1b640 1 --2- 172.21.15.63:0/2469315682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec401083a0 0x7fec4019b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.151+0000 7fec44f1b640 1 --2- 172.21.15.63:0/2469315682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec40102a60 0x7fec4019b2e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.151+0000 7fec44f1b640 1 -- 172.21.15.63:0/2469315682 >> 172.21.15.63:0/2469315682 conn(0x7fec40079730 msgr2=0x7fec40101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:23.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.151+0000 7fec44f1b640 1 -- 172.21.15.63:0/2469315682 shutdown_connections 2024-09-21T06:28:23.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:23.151+0000 7fec44f1b640 1 -- 172.21.15.63:0/2469315682 wait complete. 2024-09-21T06:28:23.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:23 smithi175 ceph-mon[34510]: scrub queued for path: / 2024-09-21T06:28:23.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:23 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:23.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:23 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:28:23.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:23 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:23.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:23 smithi175 ceph-mon[34510]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:23.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:23 smithi175 ceph-mon[34510]: pgmap v327: 97 pgs: 97 active+clean; 654 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-21T06:28:23.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:23 smithi175 ceph-mon[34510]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T06:28:23.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:23 smithi175 ceph-mon[34510]: from='client.15537 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:23.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:23 smithi175 ceph-mon[34510]: from='client.15543 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:23.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:23 smithi071 ceph-mon[34844]: scrub queued for path: / 2024-09-21T06:28:23.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:23 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:23.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:23 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:28:23.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:23 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:23.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:23 smithi071 ceph-mon[34844]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:23.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:23 smithi071 ceph-mon[34844]: pgmap v327: 97 pgs: 97 active+clean; 654 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-21T06:28:23.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:23 smithi071 ceph-mon[34844]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T06:28:23.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:23 smithi071 ceph-mon[34844]: from='client.15537 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:23.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:23 smithi071 ceph-mon[34844]: from='client.15543 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:23.951 INFO:tasks.cephfs.filesystem:scrub status for tag:e7881878-4529-4e31-87c4-bfc71bc0cbfc - {'path': '/', 'tag': 'e7881878-4529-4e31-87c4-bfc71bc0cbfc', 'options': 'recursive,force'} 2024-09-21T06:28:25.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:25 smithi071 ceph-mon[34844]: pgmap v328: 97 pgs: 97 active+clean; 1.0 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 102 KiB/s wr, 48 op/s 2024-09-21T06:28:25.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:25 smithi063 ceph-mon[31150]: pgmap v328: 97 pgs: 97 active+clean; 1.0 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 102 KiB/s wr, 48 op/s 2024-09-21T06:28:25.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:25 smithi175 ceph-mon[34510]: pgmap v328: 97 pgs: 97 active+clean; 1.0 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 102 KiB/s wr, 48 op/s 2024-09-21T06:28:27.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:27 smithi175 ceph-mon[34510]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 175 KiB/s wr, 58 op/s 2024-09-21T06:28:27.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:27 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:27.376 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:27 smithi063 ceph-mon[31150]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 175 KiB/s wr, 58 op/s 2024-09-21T06:28:27.376 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:27 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:27.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:27 smithi071 ceph-mon[34844]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 175 KiB/s wr, 58 op/s 2024-09-21T06:28:27.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:27 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:29.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:28 smithi071 ceph-mon[34844]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 56 op/s 2024-09-21T06:28:29.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:28 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:29.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:28 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:29.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:28 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:29.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:28 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:29.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:28 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:29.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:28 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:29.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:28 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:29.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:28 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:29.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:28 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:29.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:28 smithi063 ceph-mon[31150]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 56 op/s 2024-09-21T06:28:29.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:28 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:29.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:28 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:29.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:28 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:29.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:28 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:29.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:28 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:29.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:28 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:29.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:28 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:29.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:28 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:29.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:28 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:28 smithi175 ceph-mon[34510]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 56 op/s 2024-09-21T06:28:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:28 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:28 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:28 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:28 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:28 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:28 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:28 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:28 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:28 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:28:31.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:30 smithi071 ceph-mon[34844]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 175 KiB/s wr, 58 op/s 2024-09-21T06:28:31.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:30 smithi063 ceph-mon[31150]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 175 KiB/s wr, 58 op/s 2024-09-21T06:28:31.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:30 smithi175 ceph-mon[34510]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 175 KiB/s wr, 58 op/s 2024-09-21T06:28:33.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:32 smithi071 ceph-mon[34844]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 56 op/s 2024-09-21T06:28:33.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:32 smithi063 ceph-mon[31150]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 56 op/s 2024-09-21T06:28:33.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:32 smithi175 ceph-mon[34510]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 56 op/s 2024-09-21T06:28:35.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:34 smithi071 ceph-mon[34844]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 56 op/s 2024-09-21T06:28:35.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:34 smithi063 ceph-mon[31150]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 56 op/s 2024-09-21T06:28:35.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:34 smithi175 ceph-mon[34510]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 56 op/s 2024-09-21T06:28:35.870 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.868+0000 7fa018157640 1 -- 172.21.15.63:0/1129874815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa010108c30 msgr2=0x7fa01010f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.868+0000 7fa018157640 1 --2- 172.21.15.63:0/1129874815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa010108c30 0x7fa01010f460 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa000009ca0 tx=0x7fa00002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.868+0000 7fa018157640 1 -- 172.21.15.63:0/1129874815 shutdown_connections 2024-09-21T06:28:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.868+0000 7fa018157640 1 --2- 172.21.15.63:0/1129874815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa010108c30 0x7fa01010f460 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.868+0000 7fa018157640 1 --2- 172.21.15.63:0/1129874815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0101082e0 0x7fa0101086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.868+0000 7fa018157640 1 --2- 172.21.15.63:0/1129874815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0101029b0 0x7fa010102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.868+0000 7fa018157640 1 -- 172.21.15.63:0/1129874815 >> 172.21.15.63:0/1129874815 conn(0x7fa01007a740 msgr2=0x7fa01007ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.868+0000 7fa018157640 1 -- 172.21.15.63:0/1129874815 shutdown_connections 2024-09-21T06:28:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.869+0000 7fa018157640 1 -- 172.21.15.63:0/1129874815 wait complete. 2024-09-21T06:28:35.873 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.869+0000 7fa018157640 1 Processor -- start 2024-09-21T06:28:35.873 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.869+0000 7fa018157640 1 -- start start 2024-09-21T06:28:35.873 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.870+0000 7fa018157640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0101029b0 0x7fa01019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:35.873 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.870+0000 7fa018157640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0101082e0 0x7fa01019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:35.873 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.870+0000 7fa018157640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa010108c30 0x7fa01019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:35.874 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.870+0000 7fa018157640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa010113a10 con 0x7fa0101029b0 2024-09-21T06:28:35.874 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.870+0000 7fa018157640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa010113890 con 0x7fa010108c30 2024-09-21T06:28:35.874 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.870+0000 7fa018157640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa010113b90 con 0x7fa0101082e0 2024-09-21T06:28:35.874 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.870+0000 7fa015ef3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0101029b0 0x7fa01019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:35.874 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.870+0000 7fa015ef3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0101029b0 0x7fa01019a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51158/0 (socket says 172.21.15.63:51158) 2024-09-21T06:28:35.874 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.870+0000 7fa015ef3640 1 -- 172.21.15.63:0/3876764990 learned_addr learned my addr 172.21.15.63:0/3876764990 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:35.874 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.870+0000 7fa0166f4640 1 --2- 172.21.15.63:0/3876764990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa010108c30 0x7fa01019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:35.874 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.870+0000 7fa0156f2640 1 --2- 172.21.15.63:0/3876764990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0101082e0 0x7fa01019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:35.874 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.870+0000 7fa015ef3640 1 -- 172.21.15.63:0/3876764990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0101082e0 msgr2=0x7fa01019a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:35.874 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.870+0000 7fa015ef3640 1 --2- 172.21.15.63:0/3876764990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0101082e0 0x7fa01019a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.874 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.870+0000 7fa015ef3640 1 -- 172.21.15.63:0/3876764990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa010108c30 msgr2=0x7fa01019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:35.874 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.870+0000 7fa015ef3640 1 --2- 172.21.15.63:0/3876764990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa010108c30 0x7fa01019fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.874 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.870+0000 7fa015ef3640 1 -- 172.21.15.63:0/3876764990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0101a02b0 con 0x7fa0101029b0 2024-09-21T06:28:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.870+0000 7fa0166f4640 1 --2- 172.21.15.63:0/3876764990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa010108c30 0x7fa01019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.870+0000 7fa015ef3640 1 --2- 172.21.15.63:0/3876764990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0101029b0 0x7fa01019a410 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa00800c920 tx=0x7fa00800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.871+0000 7fa00effd640 1 -- 172.21.15.63:0/3876764990 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa008007c70 con 0x7fa0101029b0 2024-09-21T06:28:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.871+0000 7fa00effd640 1 -- 172.21.15.63:0/3876764990 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa008007e10 con 0x7fa0101029b0 2024-09-21T06:28:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.871+0000 7fa018157640 1 -- 172.21.15.63:0/3876764990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0101a05a0 con 0x7fa0101029b0 2024-09-21T06:28:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.871+0000 7fa00effd640 1 -- 172.21.15.63:0/3876764990 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa008018820 con 0x7fa0101029b0 2024-09-21T06:28:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.871+0000 7fa018157640 1 -- 172.21.15.63:0/3876764990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0101a6dc0 con 0x7fa0101029b0 2024-09-21T06:28:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.873+0000 7fa00effd640 1 -- 172.21.15.63:0/3876764990 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 24) ==== 154586+0+0 (secure 0 0 0) 0x7fa00800f450 con 0x7fa0101029b0 2024-09-21T06:28:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.873+0000 7fa01f0c5740 1 Processor -- start 2024-09-21T06:28:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.874+0000 7fa01f0c5740 1 -- start start 2024-09-21T06:28:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.874+0000 7fa01f0c5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a90a1b0 0x55f04acaf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.874+0000 7fa01f0c5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e12f0 0x55f04acafef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.874+0000 7fa01f0c5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a8e94d0 0x55f04acb0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.874+0000 7fa01f0c5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f04ac246f0 con 0x55f04a8e12f0 2024-09-21T06:28:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.874+0000 7fa01f0c5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f04ac13b20 con 0x55f04a8e94d0 2024-09-21T06:28:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.874+0000 7fa01f0c5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f04ac17930 con 0x55f04a90a1b0 2024-09-21T06:28:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.874+0000 7fa015ef3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e12f0 0x55f04acafef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.874+0000 7fa0166f4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a90a1b0 0x55f04acaf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.874+0000 7fa0156f2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a8e94d0 0x55f04acb0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.874+0000 7fa015ef3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e12f0 0x55f04acafef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51172/0 (socket says 172.21.15.63:51172) 2024-09-21T06:28:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.874+0000 7fa015ef3640 1 -- 172.21.15.63:0/2628049302 learned_addr learned my addr 172.21.15.63:0/2628049302 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.874+0000 7fa0166f4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a90a1b0 0x55f04acaf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:40680/0 (socket says 172.21.15.63:40680) 2024-09-21T06:28:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.874+0000 7fa00effd640 1 --2- 172.21.15.63:0/3876764990 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9ff80b65f0 0x7f9ff80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.875+0000 7fa015ef3640 1 -- 172.21.15.63:0/2628049302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a90a1b0 msgr2=0x55f04acaf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.875+0000 7fa015ef3640 1 --2- 172.21.15.63:0/2628049302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a90a1b0 0x55f04acaf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.875+0000 7fa015ef3640 1 -- 172.21.15.63:0/2628049302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a8e94d0 msgr2=0x55f04acb0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.875+0000 7fa015ef3640 1 --2- 172.21.15.63:0/2628049302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a8e94d0 0x55f04acb0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.879 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.875+0000 7fa015ef3640 1 -- 172.21.15.63:0/2628049302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f04abd9530 con 0x55f04a8e12f0 2024-09-21T06:28:35.879 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.875+0000 7fa0156f2640 1 --2- 172.21.15.63:0/2628049302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a8e94d0 0x55f04acb0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:35.879 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.875+0000 7fa0166f4640 1 --2- 172.21.15.63:0/3876764990 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9ff80b65f0 0x7f9ff80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:35.879 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.875+0000 7fa00effd640 1 -- 172.21.15.63:0/3876764990 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fa0080e7800 con 0x7fa0101029b0 2024-09-21T06:28:35.879 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.875+0000 7fa015ef3640 1 --2- 172.21.15.63:0/2628049302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e12f0 0x55f04acafef0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa0080e5010 tx=0x7fa008071790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e68ae821bbea89 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:35.879 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.875+0000 7f9ff7fff640 1 -- 172.21.15.63:0/2628049302 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0080ad0a0 con 0x55f04a8e12f0 2024-09-21T06:28:35.879 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.875+0000 7f9ff7fff640 1 -- 172.21.15.63:0/2628049302 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0080a7e50 con 0x55f04a8e12f0 2024-09-21T06:28:35.879 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.875+0000 7f9ff7fff640 1 -- 172.21.15.63:0/2628049302 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0080876c0 con 0x55f04a8e12f0 2024-09-21T06:28:35.883 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.876+0000 7fa01f0c5740 1 -- 172.21.15.63:0/2628049302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e12f0 msgr2=0x55f04acafef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:35.883 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.876+0000 7fa0166f4640 1 --2- 172.21.15.63:0/3876764990 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9ff80b65f0 0x7f9ff80b8b00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa000005cc0 tx=0x7fa0000095c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:35.883 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.876+0000 7fa01f0c5740 1 --2- 172.21.15.63:0/2628049302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e12f0 0x55f04acafef0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa0080e5010 tx=0x7fa008071790 comp rx=0 tx=0).stop 2024-09-21T06:28:35.883 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.876+0000 7fa01f0c5740 1 -- 172.21.15.63:0/2628049302 shutdown_connections 2024-09-21T06:28:35.883 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.876+0000 7fa01f0c5740 1 --2- 172.21.15.63:0/2628049302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a8e94d0 0x55f04acb0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.876+0000 7fa01f0c5740 1 --2- 172.21.15.63:0/2628049302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e12f0 0x55f04acafef0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.876+0000 7fa01f0c5740 1 --2- 172.21.15.63:0/2628049302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a90a1b0 0x55f04acaf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.876+0000 7fa01f0c5740 1 -- 172.21.15.63:0/2628049302 >> 172.21.15.63:0/2628049302 conn(0x55f04a8fe300 msgr2=0x55f04acad8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.876+0000 7fa01f0c5740 1 -- 172.21.15.63:0/2628049302 shutdown_connections 2024-09-21T06:28:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.876+0000 7fa01f0c5740 1 -- 172.21.15.63:0/2628049302 wait complete. 2024-09-21T06:28:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.877+0000 7fa01f0c5740 1 -- start start 2024-09-21T06:28:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.877+0000 7fa01f0c5740 1 Processor -- start 2024-09-21T06:28:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.877+0000 7fa01f0c5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a8e12f0 0x55f04acbb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.877+0000 7fa01f0c5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 0x55f04acbb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.877+0000 7fa01f0c5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a90a1b0 0x55f04acc73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.877+0000 7fa01f0c5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f04ab4bab0 con 0x55f04a8e94d0 2024-09-21T06:28:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.877+0000 7fa01f0c5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f04abb9730 con 0x55f04a90a1b0 2024-09-21T06:28:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.877+0000 7fa01f0c5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f04acbe0d0 con 0x55f04a8e12f0 2024-09-21T06:28:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.877+0000 7fa01f0c5740 10 client.0 _ll_register_callbacks cb 0x55f04ac0d6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.877+0000 7fa0156f2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 0x55f04acbb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.877+0000 7fa0156f2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 0x55f04acbb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51184/0 (socket says 172.21.15.63:51184) 2024-09-21T06:28:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.877+0000 7fa0156f2640 1 -- 172.21.15.63:0/2251658613 learned_addr learned my addr 172.21.15.63:0/2251658613 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.877+0000 7fa015ef3640 1 --2- 172.21.15.63:0/2251658613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a8e12f0 0x55f04acbb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.878+0000 7fa0166f4640 1 --2- 172.21.15.63:0/2251658613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a90a1b0 0x55f04acc73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.878+0000 7fa0156f2640 1 -- 172.21.15.63:0/2251658613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a8e12f0 msgr2=0x55f04acbb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.878+0000 7fa0156f2640 1 --2- 172.21.15.63:0/2251658613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a8e12f0 0x55f04acbb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.878+0000 7fa0156f2640 1 -- 172.21.15.63:0/2251658613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a90a1b0 msgr2=0x55f04acc73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.878+0000 7fa0156f2640 1 --2- 172.21.15.63:0/2251658613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a90a1b0 0x55f04acc73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.878+0000 7fa0156f2640 1 -- 172.21.15.63:0/2251658613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f04a975790 con 0x55f04a8e94d0 2024-09-21T06:28:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.878+0000 7fa015ef3640 1 --2- 172.21.15.63:0/2251658613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a8e12f0 0x55f04acbb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.878+0000 7fa0156f2640 1 --2- 172.21.15.63:0/2251658613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 0x55f04acbb570 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa004012700 tx=0x7fa004012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f133dd654360ba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.878+0000 7f9ff57fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:28:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.878+0000 7f9ff57fa640 1 -- 172.21.15.63:0/2251658613 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004011bb0 con 0x55f04a8e94d0 2024-09-21T06:28:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.878+0000 7fa01f0c5740 1 -- 172.21.15.63:0/2251658613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0080a7e50 con 0x55f04a8e94d0 2024-09-21T06:28:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.878+0000 7f9ff57fa640 1 -- 172.21.15.63:0/2251658613 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fa004011d50 con 0x55f04a8e94d0 2024-09-21T06:28:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.878+0000 7f9ff57fa640 1 -- 172.21.15.63:0/2251658613 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa00400f460 con 0x55f04a8e94d0 2024-09-21T06:28:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.878+0000 7fa01f0c5740 10 client.15573 fetch_fsmap learned FSMap version 29 2024-09-21T06:28:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.878+0000 7fa01f0c5740 1 -- 172.21.15.63:0/2251658613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f04a9ee620 con 0x55f04a8e94d0 2024-09-21T06:28:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.879+0000 7f9ff57fa640 1 -- 172.21.15.63:0/2251658613 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0080a7e50 con 0x55f04a8e94d0 2024-09-21T06:28:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.879+0000 7f9ff57fa640 1 -- 172.21.15.63:0/2251658613 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa00401c760 con 0x55f04a8e94d0 2024-09-21T06:28:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.879+0000 7fa01f0c5740 10 client.15573 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:28:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.879+0000 7fa01f0c5740 10 client.15573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.879+0000 7fa01f0c5740 20 client.15573 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.879+0000 7fa01f0c5740 1 --2- 172.21.15.63:0/2251658613 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f04a8c8d80 0x55f04accd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.879+0000 7fa01f0c5740 4 client.15573 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.879+0000 7fa01f0c5740 1 -- 172.21.15.63:0/2251658613 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f04ac26640 con 0x55f04a8c8d80 2024-09-21T06:28:35.887 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.879+0000 7fa015ef3640 1 --2- 172.21.15.63:0/2251658613 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f04a8c8d80 0x55f04accd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:35.887 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.880+0000 7f9ff57fa640 10 client.15573 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:35.887 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.880+0000 7fa015ef3640 1 --2- 172.21.15.63:0/2251658613 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f04a8c8d80 0x55f04accd190 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47069d4bea68ab6c server_cookie=77f08eb9c494330a in_seq=0 out_seq=0 2024-09-21T06:28:35.887 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.880+0000 7f9ff57fa640 1 -- 172.21.15.63:0/2251658613 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f04ac26640 con 0x55f04a8c8d80 2024-09-21T06:28:35.887 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.880+0000 7f9ff57fa640 10 client.15573 handle_command_reply: tid=0 2024-09-21T06:28:35.887 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.880+0000 7fa01f0c5740 1 client.15573 shutdown 2024-09-21T06:28:35.887 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.881+0000 7fa01f0c5740 1 -- 172.21.15.63:0/2251658613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 msgr2=0x55f04acbb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:35.887 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.881+0000 7fa01f0c5740 1 --2- 172.21.15.63:0/2251658613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 0x55f04acbb570 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa004012700 tx=0x7fa004012bc0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.887 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.881+0000 7fa01f0c5740 1 -- 172.21.15.63:0/2251658613 shutdown_connections 2024-09-21T06:28:35.887 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.881+0000 7fa01f0c5740 1 --2- 172.21.15.63:0/2251658613 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f04a8c8d80 0x55f04accd190 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.887 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.881+0000 7fa01f0c5740 1 --2- 172.21.15.63:0/2251658613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a90a1b0 0x55f04acc73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.887 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.881+0000 7fa01f0c5740 1 --2- 172.21.15.63:0/2251658613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 0x55f04acbb570 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.887 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.881+0000 7f9ff57fa640 0 client.15573 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:35.887 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.881+0000 7fa01f0c5740 1 --2- 172.21.15.63:0/2251658613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a8e12f0 0x55f04acbb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.888 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.881+0000 7fa01f0c5740 1 -- 172.21.15.63:0/2251658613 >> 172.21.15.63:0/2251658613 conn(0x55f04a8fe300 msgr2=0x55f04acb09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:35.888 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.881+0000 7fa01f0c5740 1 -- 172.21.15.63:0/2251658613 shutdown_connections 2024-09-21T06:28:35.888 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.881+0000 7fa01f0c5740 1 -- 172.21.15.63:0/2251658613 wait complete. 2024-09-21T06:28:35.888 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.881+0000 7fa01f0c5740 20 client.15573 trim_cache size 0 max 16384 2024-09-21T06:28:35.898 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.896+0000 7fa01f0c5740 1 Processor -- start 2024-09-21T06:28:35.899 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.896+0000 7fa01f0c5740 1 -- start start 2024-09-21T06:28:35.899 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.896+0000 7fa01f0c5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a8e12f0 0x55f04acac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:35.899 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.896+0000 7fa01f0c5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 0x55f04acc72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:35.899 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.896+0000 7fa01f0c5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a90a1b0 0x55f04acb8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:35.899 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.896+0000 7fa01f0c5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101af600 con 0x55f04a8e94d0 2024-09-21T06:28:35.899 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.896+0000 7fa01f0c5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101b1140 con 0x55f04a8e12f0 2024-09-21T06:28:35.899 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.896+0000 7fa01f0c5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101afcd0 con 0x55f04a90a1b0 2024-09-21T06:28:35.899 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.896+0000 7fa0156f2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 0x55f04acc72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:35.899 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.896+0000 7fa0156f2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 0x55f04acc72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51186/0 (socket says 172.21.15.63:51186) 2024-09-21T06:28:35.899 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.896+0000 7fa0156f2640 1 -- 172.21.15.63:0/1035668381 learned_addr learned my addr 172.21.15.63:0/1035668381 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:35.899 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.896+0000 7fa015ef3640 1 --2- 172.21.15.63:0/1035668381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a8e12f0 0x55f04acac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:35.899 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.896+0000 7fa0166f4640 1 --2- 172.21.15.63:0/1035668381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a90a1b0 0x55f04acb8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:35.899 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.896+0000 7fa0156f2640 1 -- 172.21.15.63:0/1035668381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a90a1b0 msgr2=0x55f04acb8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:35.900 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.896+0000 7fa0156f2640 1 --2- 172.21.15.63:0/1035668381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a90a1b0 0x55f04acb8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.900 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.896+0000 7fa0156f2640 1 -- 172.21.15.63:0/1035668381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a8e12f0 msgr2=0x55f04acac5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:35.900 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.896+0000 7fa0156f2640 1 --2- 172.21.15.63:0/1035668381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a8e12f0 0x55f04acac5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.900 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.896+0000 7fa0156f2640 1 -- 172.21.15.63:0/1035668381 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f04acbb950 con 0x55f04a8e94d0 2024-09-21T06:28:35.900 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.896+0000 7fa015ef3640 1 --2- 172.21.15.63:0/1035668381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a8e12f0 0x55f04acac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:35.900 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.896+0000 7fa0156f2640 1 --2- 172.21.15.63:0/1035668381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 0x55f04acc72c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa004011e40 tx=0x7fa004011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f96fb10e41fae90 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:35.900 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.897+0000 7f9ff77fe640 1 -- 172.21.15.63:0/1035668381 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004029030 con 0x55f04a8e94d0 2024-09-21T06:28:35.900 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.897+0000 7f9ff77fe640 1 -- 172.21.15.63:0/1035668381 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa00401c420 con 0x55f04a8e94d0 2024-09-21T06:28:35.900 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.897+0000 7f9ff77fe640 1 -- 172.21.15.63:0/1035668381 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004003810 con 0x55f04a8e94d0 2024-09-21T06:28:35.903 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.897+0000 7fa01f0c5740 1 -- 172.21.15.63:0/1035668381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 msgr2=0x55f04acc72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:35.903 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.897+0000 7fa01f0c5740 1 --2- 172.21.15.63:0/1035668381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 0x55f04acc72c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa004011e40 tx=0x7fa004011e70 comp rx=0 tx=0).stop 2024-09-21T06:28:35.903 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.897+0000 7fa01f0c5740 1 -- 172.21.15.63:0/1035668381 shutdown_connections 2024-09-21T06:28:35.903 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.897+0000 7fa01f0c5740 1 --2- 172.21.15.63:0/1035668381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a90a1b0 0x55f04acb8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.904 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.897+0000 7fa01f0c5740 1 --2- 172.21.15.63:0/1035668381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 0x55f04acc72c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.904 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.897+0000 7fa01f0c5740 1 --2- 172.21.15.63:0/1035668381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a8e12f0 0x55f04acac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.904 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.897+0000 7fa01f0c5740 1 -- 172.21.15.63:0/1035668381 >> 172.21.15.63:0/1035668381 conn(0x55f04a8fe300 msgr2=0x55f04acabea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:35.904 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.898+0000 7fa01f0c5740 1 -- 172.21.15.63:0/1035668381 shutdown_connections 2024-09-21T06:28:35.904 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.898+0000 7fa01f0c5740 1 -- 172.21.15.63:0/1035668381 wait complete. 2024-09-21T06:28:35.904 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.898+0000 7fa01f0c5740 1 -- start start 2024-09-21T06:28:35.904 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.898+0000 7fa01f0c5740 1 Processor -- start 2024-09-21T06:28:35.904 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.898+0000 7fa01f0c5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a8e12f0 0x55f04acc0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:35.904 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.898+0000 7fa01f0c5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 0x55f04acc1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:35.904 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.898+0000 7fa01f0c5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a90a1b0 0x55f04ad2eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:35.904 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.898+0000 7fa01f0c5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101b0a70 con 0x55f04a8e94d0 2024-09-21T06:28:35.904 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.898+0000 7fa01f0c5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101b03a0 con 0x55f04a8e12f0 2024-09-21T06:28:35.904 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.898+0000 7fa01f0c5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101ad5e0 con 0x55f04a90a1b0 2024-09-21T06:28:35.905 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.898+0000 7fa01f0c5740 10 client.0 _ll_register_callbacks cb 0x7fa004009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:35.905 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.898+0000 7fa0156f2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 0x55f04acc1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:35.905 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.899+0000 7fa0156f2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 0x55f04acc1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51194/0 (socket says 172.21.15.63:51194) 2024-09-21T06:28:35.905 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.899+0000 7fa0156f2640 1 -- 172.21.15.63:0/3783356382 learned_addr learned my addr 172.21.15.63:0/3783356382 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:35.905 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.899+0000 7fa0166f4640 1 --2- 172.21.15.63:0/3783356382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a90a1b0 0x55f04ad2eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:35.905 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.899+0000 7fa015ef3640 1 --2- 172.21.15.63:0/3783356382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a8e12f0 0x55f04acc0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:35.905 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.899+0000 7fa0156f2640 1 -- 172.21.15.63:0/3783356382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a90a1b0 msgr2=0x55f04ad2eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:35.905 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.899+0000 7fa0156f2640 1 --2- 172.21.15.63:0/3783356382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a90a1b0 0x55f04ad2eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.905 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.899+0000 7fa0156f2640 1 -- 172.21.15.63:0/3783356382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a8e12f0 msgr2=0x55f04acc0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:35.905 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.899+0000 7fa0156f2640 1 --2- 172.21.15.63:0/3783356382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a8e12f0 0x55f04acc0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.905 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.899+0000 7fa0156f2640 1 -- 172.21.15.63:0/3783356382 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f04ad2f1d0 con 0x55f04a8e94d0 2024-09-21T06:28:35.905 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.899+0000 7fa015ef3640 1 --2- 172.21.15.63:0/3783356382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a8e12f0 0x55f04acc0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:35.905 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.899+0000 7fa0156f2640 1 --2- 172.21.15.63:0/3783356382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 0x55f04acc1360 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa004005450 tx=0x7fa004005480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b227a39dc834fd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:35.905 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.899+0000 7f9ff57fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:28:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.899+0000 7f9ff57fa640 1 -- 172.21.15.63:0/3783356382 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004029070 con 0x55f04a8e94d0 2024-09-21T06:28:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.899+0000 7f9ff57fa640 1 -- 172.21.15.63:0/3783356382 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fa00401c7e0 con 0x55f04a8e94d0 2024-09-21T06:28:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.899+0000 7fa01f0c5740 1 -- 172.21.15.63:0/3783356382 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa00401c420 con 0x55f04a8e94d0 2024-09-21T06:28:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.899+0000 7f9ff57fa640 1 -- 172.21.15.63:0/3783356382 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa00403f050 con 0x55f04a8e94d0 2024-09-21T06:28:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.899+0000 7fa01f0c5740 10 client.15579 fetch_fsmap learned FSMap version 29 2024-09-21T06:28:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.899+0000 7fa01f0c5740 1 -- 172.21.15.63:0/3783356382 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f04ad37650 con 0x55f04a8e94d0 2024-09-21T06:28:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.900+0000 7f9ff57fa640 1 -- 172.21.15.63:0/3783356382 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa00401c420 con 0x55f04a8e94d0 2024-09-21T06:28:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.900+0000 7f9ff57fa640 1 -- 172.21.15.63:0/3783356382 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa00400f600 con 0x55f04a8e94d0 2024-09-21T06:28:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.900+0000 7fa01f0c5740 10 client.15579 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:28:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.900+0000 7fa01f0c5740 10 client.15579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.900+0000 7fa01f0c5740 20 client.15579 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.900+0000 7fa01f0c5740 1 --2- 172.21.15.63:0/3783356382 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f04a89e1c0 0x55f04ad39d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.900+0000 7fa01f0c5740 4 client.15579 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:28:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.900+0000 7fa01f0c5740 1 -- 172.21.15.63:0/3783356382 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f04ac220f0 con 0x55f04a89e1c0 2024-09-21T06:28:35.907 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.900+0000 7fa015ef3640 1 --2- 172.21.15.63:0/3783356382 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f04a89e1c0 0x55f04ad39d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:35.907 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.901+0000 7fa015ef3640 1 --2- 172.21.15.63:0/3783356382 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f04a89e1c0 0x55f04ad39d50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb8a076bb7b5681 server_cookie=5e2faab61e242377 in_seq=0 out_seq=0 2024-09-21T06:28:35.907 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.901+0000 7f9ff57fa640 10 client.15579 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.912+0000 7f9ff57fa640 1 -- 172.21.15.63:0/3783356382 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f04ac220f0 con 0x55f04a89e1c0 2024-09-21T06:28:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.912+0000 7f9ff57fa640 10 client.15579 handle_command_reply: tid=0 2024-09-21T06:28:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.913+0000 7fa01f0c5740 1 client.15579 shutdown 2024-09-21T06:28:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.913+0000 7fa01f0c5740 1 -- 172.21.15.63:0/3783356382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 msgr2=0x55f04acc1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.913+0000 7fa01f0c5740 1 --2- 172.21.15.63:0/3783356382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 0x55f04acc1360 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa004005450 tx=0x7fa004005480 comp rx=0 tx=0).stop 2024-09-21T06:28:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.913+0000 7fa01f0c5740 1 -- 172.21.15.63:0/3783356382 shutdown_connections 2024-09-21T06:28:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.913+0000 7fa01f0c5740 1 --2- 172.21.15.63:0/3783356382 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55f04a89e1c0 0x55f04ad39d50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.913+0000 7fa01f0c5740 1 --2- 172.21.15.63:0/3783356382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f04a90a1b0 0x55f04ad2eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.913+0000 7fa01f0c5740 1 --2- 172.21.15.63:0/3783356382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f04a8e94d0 0x55f04acc1360 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.913+0000 7f9ff57fa640 0 client.15579 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.913+0000 7fa01f0c5740 1 --2- 172.21.15.63:0/3783356382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f04a8e12f0 0x55f04acc0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.913+0000 7fa01f0c5740 1 -- 172.21.15.63:0/3783356382 >> 172.21.15.63:0/3783356382 conn(0x55f04a8fe300 msgr2=0x55f04acad880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.913+0000 7fa01f0c5740 1 -- 172.21.15.63:0/3783356382 shutdown_connections 2024-09-21T06:28:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.913+0000 7fa01f0c5740 1 -- 172.21.15.63:0/3783356382 wait complete. 2024-09-21T06:28:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.913+0000 7fa01f0c5740 20 client.15579 trim_cache size 0 max 16384 2024-09-21T06:28:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout:{ 2024-09-21T06:28:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout: "message": "", 2024-09-21T06:28:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout: "return_code": 0 2024-09-21T06:28:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout:} 2024-09-21T06:28:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.914+0000 7fa018157640 1 -- 172.21.15.63:0/3876764990 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9ff80b65f0 msgr2=0x7f9ff80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.914+0000 7fa018157640 1 --2- 172.21.15.63:0/3876764990 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9ff80b65f0 0x7f9ff80b8b00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa000005cc0 tx=0x7fa0000095c0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.914+0000 7fa018157640 1 -- 172.21.15.63:0/3876764990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0101029b0 msgr2=0x7fa01019a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.914+0000 7fa018157640 1 --2- 172.21.15.63:0/3876764990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0101029b0 0x7fa01019a410 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa00800c920 tx=0x7fa00800cde0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.914+0000 7fa018157640 1 -- 172.21.15.63:0/3876764990 shutdown_connections 2024-09-21T06:28:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.914+0000 7fa018157640 1 --2- 172.21.15.63:0/3876764990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa010108c30 0x7fa01019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.914+0000 7fa018157640 1 --2- 172.21.15.63:0/3876764990 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9ff80b65f0 0x7f9ff80b8b00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.914+0000 7fa018157640 1 --2- 172.21.15.63:0/3876764990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0101082e0 0x7fa01019a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.914+0000 7fa018157640 1 --2- 172.21.15.63:0/3876764990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0101029b0 0x7fa01019a410 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.914+0000 7fa018157640 1 -- 172.21.15.63:0/3876764990 >> 172.21.15.63:0/3876764990 conn(0x7fa01007a740 msgr2=0x7fa010106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.914+0000 7fa018157640 1 -- 172.21.15.63:0/3876764990 shutdown_connections 2024-09-21T06:28:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:35.914+0000 7fa018157640 1 -- 172.21.15.63:0/3876764990 wait complete. 2024-09-21T06:28:36.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:35 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:28:36.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:35 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:28:36.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:35 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:28:37.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:36 smithi071 ceph-mon[34844]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 73 KiB/s wr, 20 op/s 2024-09-21T06:28:37.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:36 smithi063 ceph-mon[31150]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 73 KiB/s wr, 20 op/s 2024-09-21T06:28:37.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:36 smithi175 ceph-mon[34510]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 73 KiB/s wr, 20 op/s 2024-09-21T06:28:39.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:38 smithi071 ceph-mon[34844]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T06:28:39.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:38 smithi063 ceph-mon[31150]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T06:28:39.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:38 smithi175 ceph-mon[34510]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T06:28:41.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:40 smithi071 ceph-mon[34844]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 15 op/s 2024-09-21T06:28:41.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:40 smithi063 ceph-mon[31150]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 15 op/s 2024-09-21T06:28:41.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:40 smithi175 ceph-mon[34510]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 15 op/s 2024-09-21T06:28:43.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:42 smithi071 ceph-mon[34844]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-21T06:28:43.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:42 smithi063 ceph-mon[31150]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-21T06:28:43.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:42 smithi175 ceph-mon[34510]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-21T06:28:45.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:44 smithi071 ceph-mon[34844]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-21T06:28:45.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:44 smithi063 ceph-mon[31150]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-21T06:28:45.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:44 smithi175 ceph-mon[34510]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-21T06:28:47.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:46 smithi071 ceph-mon[34844]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-09-21T06:28:47.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:46 smithi063 ceph-mon[31150]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-09-21T06:28:47.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:46 smithi175 ceph-mon[34510]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-09-21T06:28:49.016 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.012+0000 7ffba0bad640 1 -- 172.21.15.63:0/3703407017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb9c103ae0 msgr2=0x7ffb9c103ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:49.016 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.012+0000 7ffba0bad640 1 --2- 172.21.15.63:0/3703407017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb9c103ae0 0x7ffb9c103ef0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009900 tx=0x7ffb8c02a410 comp rx=0 tx=0).stop 2024-09-21T06:28:49.016 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.013+0000 7ffba0bad640 1 -- 172.21.15.63:0/3703407017 shutdown_connections 2024-09-21T06:28:49.016 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.013+0000 7ffba0bad640 1 --2- 172.21.15.63:0/3703407017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb9c109d60 0x7ffb9c110590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.016 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.013+0000 7ffba0bad640 1 --2- 172.21.15.63:0/3703407017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb9c109410 0x7ffb9c109820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.016 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.013+0000 7ffba0bad640 1 --2- 172.21.15.63:0/3703407017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb9c103ae0 0x7ffb9c103ef0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.016 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.013+0000 7ffba0bad640 1 -- 172.21.15.63:0/3703407017 >> 172.21.15.63:0/3703407017 conn(0x7ffb9c0ff520 msgr2=0x7ffb9c101970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:49.016 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.013+0000 7ffba0bad640 1 -- 172.21.15.63:0/3703407017 shutdown_connections 2024-09-21T06:28:49.016 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.013+0000 7ffba0bad640 1 -- 172.21.15.63:0/3703407017 wait complete. 2024-09-21T06:28:49.018 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.014+0000 7ffba0bad640 1 Processor -- start 2024-09-21T06:28:49.018 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.014+0000 7ffba0bad640 1 -- start start 2024-09-21T06:28:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.014+0000 7ffba0bad640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb9c103ae0 0x7ffb9c19a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.014+0000 7ffba0bad640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb9c109410 0x7ffb9c19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.014+0000 7ffba0bad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb9c109d60 0x7ffb9c19fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.014+0000 7ffba0bad640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c113a80 con 0x7ffb9c109410 2024-09-21T06:28:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.014+0000 7ffba0bad640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c113900 con 0x7ffb9c103ae0 2024-09-21T06:28:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.014+0000 7ffba0bad640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c113c00 con 0x7ffb9c109d60 2024-09-21T06:28:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.014+0000 7ffb99d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb9c109410 0x7ffb9c19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.014+0000 7ffb99d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb9c109410 0x7ffb9c19ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50608/0 (socket says 172.21.15.63:50608) 2024-09-21T06:28:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.014+0000 7ffb99d9b640 1 -- 172.21.15.63:0/2646490205 learned_addr learned my addr 172.21.15.63:0/2646490205 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.014+0000 7ffb9a59c640 1 --2- 172.21.15.63:0/2646490205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb9c103ae0 0x7ffb9c19a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.015+0000 7ffb9ad9d640 1 --2- 172.21.15.63:0/2646490205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb9c109d60 0x7ffb9c19fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.015+0000 7ffb99d9b640 1 -- 172.21.15.63:0/2646490205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb9c109d60 msgr2=0x7ffb9c19fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:49.020 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.015+0000 7ffb99d9b640 1 --2- 172.21.15.63:0/2646490205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb9c109d60 0x7ffb9c19fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.020 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.015+0000 7ffb99d9b640 1 -- 172.21.15.63:0/2646490205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb9c103ae0 msgr2=0x7ffb9c19a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:49.020 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.015+0000 7ffb99d9b640 1 --2- 172.21.15.63:0/2646490205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb9c103ae0 0x7ffb9c19a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.020 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.015+0000 7ffb99d9b640 1 -- 172.21.15.63:0/2646490205 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb9c1a04b0 con 0x7ffb9c109410 2024-09-21T06:28:49.020 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.015+0000 7ffb99d9b640 1 --2- 172.21.15.63:0/2646490205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb9c109410 0x7ffb9c19ab20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000d950 tx=0x7ffb9000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:49.020 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.015+0000 7ffb8b7fe640 1 -- 172.21.15.63:0/2646490205 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb90017070 con 0x7ffb9c109410 2024-09-21T06:28:49.020 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.015+0000 7ffb8b7fe640 1 -- 172.21.15.63:0/2646490205 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb90009c30 con 0x7ffb9c109410 2024-09-21T06:28:49.020 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.015+0000 7ffba0bad640 1 -- 172.21.15.63:0/2646490205 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb9c1a07a0 con 0x7ffb9c109410 2024-09-21T06:28:49.020 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.015+0000 7ffb8b7fe640 1 -- 172.21.15.63:0/2646490205 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb900047a0 con 0x7ffb9c109410 2024-09-21T06:28:49.020 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.015+0000 7ffba0bad640 1 -- 172.21.15.63:0/2646490205 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb9c1a6f30 con 0x7ffb9c109410 2024-09-21T06:28:49.022 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.018+0000 7ffb8b7fe640 1 -- 172.21.15.63:0/2646490205 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 24) ==== 154586+0+0 (secure 0 0 0) 0x7ffb90004020 con 0x7ffb9c109410 2024-09-21T06:28:49.022 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.018+0000 7ffba7bfe740 1 Processor -- start 2024-09-21T06:28:49.022 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.018+0000 7ffba7bfe740 1 -- start start 2024-09-21T06:28:49.022 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.018+0000 7ffba7bfe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfdc41b0 0x5623d01699b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:49.023 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.018+0000 7ffba7bfe740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfd9b2f0 0x5623d0169ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:49.023 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.018+0000 7ffba7bfe740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfda34d0 0x5623d016a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:49.023 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.019+0000 7ffba7bfe740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5623d00de6f0 con 0x5623cfd9b2f0 2024-09-21T06:28:49.023 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.019+0000 7ffba7bfe740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5623d00cdb20 con 0x5623cfda34d0 2024-09-21T06:28:49.023 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.019+0000 7ffba7bfe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5623d00d1930 con 0x5623cfdc41b0 2024-09-21T06:28:49.023 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.019+0000 7ffb9a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfd9b2f0 0x5623d0169ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:49.023 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.019+0000 7ffb9a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfd9b2f0 0x5623d0169ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50612/0 (socket says 172.21.15.63:50612) 2024-09-21T06:28:49.023 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.019+0000 7ffb9a59c640 1 -- 172.21.15.63:0/209262592 learned_addr learned my addr 172.21.15.63:0/209262592 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:49.023 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.019+0000 7ffb9ad9d640 1 --2- 172.21.15.63:0/209262592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfdc41b0 0x5623d01699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:49.023 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.019+0000 7ffb99d9b640 1 --2- 172.21.15.63:0/209262592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfda34d0 0x5623d016a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:49.023 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.019+0000 7ffb9a59c640 1 -- 172.21.15.63:0/209262592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfdc41b0 msgr2=0x5623d01699b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:49.023 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.019+0000 7ffb9a59c640 1 --2- 172.21.15.63:0/209262592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfdc41b0 0x5623d01699b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.023 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.019+0000 7ffb9a59c640 1 -- 172.21.15.63:0/209262592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfda34d0 msgr2=0x5623d016a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.019+0000 7ffb9a59c640 1 --2- 172.21.15.63:0/209262592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfda34d0 0x5623d016a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.019+0000 7ffb9a59c640 1 -- 172.21.15.63:0/209262592 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623d0093530 con 0x5623cfd9b2f0 2024-09-21T06:28:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.019+0000 7ffb9a59c640 1 --2- 172.21.15.63:0/209262592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfd9b2f0 0x5623d0169ef0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009900 tx=0x7ffb8c032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66250dc07cebbdd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.019+0000 7ffb8b7fe640 1 --2- 172.21.15.63:0/2646490205 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffb840b65f0 0x7ffb840b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.020+0000 7ffb88ff9640 1 -- 172.21.15.63:0/209262592 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c040070 con 0x5623cfd9b2f0 2024-09-21T06:28:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.020+0000 7ffb9ad9d640 1 --2- 172.21.15.63:0/2646490205 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffb840b65f0 0x7ffb840b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.020+0000 7ffb88ff9640 1 -- 172.21.15.63:0/209262592 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb8c0316a0 con 0x5623cfd9b2f0 2024-09-21T06:28:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.020+0000 7ffb88ff9640 1 -- 172.21.15.63:0/209262592 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c035040 con 0x5623cfd9b2f0 2024-09-21T06:28:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.020+0000 7ffb8b7fe640 1 -- 172.21.15.63:0/2646490205 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ffb900e7270 con 0x7ffb9c109410 2024-09-21T06:28:49.028 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.021+0000 7ffb9ad9d640 1 --2- 172.21.15.63:0/2646490205 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffb840b65f0 0x7ffb840b8b00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009fd0 tx=0x7ffb9400e040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:49.028 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.021+0000 7ffba7bfe740 1 -- 172.21.15.63:0/209262592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfd9b2f0 msgr2=0x5623d0169ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:49.028 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.021+0000 7ffba7bfe740 1 --2- 172.21.15.63:0/209262592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfd9b2f0 0x5623d0169ef0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009900 tx=0x7ffb8c032e60 comp rx=0 tx=0).stop 2024-09-21T06:28:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.021+0000 7ffba7bfe740 1 -- 172.21.15.63:0/209262592 shutdown_connections 2024-09-21T06:28:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.021+0000 7ffba7bfe740 1 --2- 172.21.15.63:0/209262592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfda34d0 0x5623d016a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.021+0000 7ffba7bfe740 1 --2- 172.21.15.63:0/209262592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfd9b2f0 0x5623d0169ef0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.021+0000 7ffba7bfe740 1 --2- 172.21.15.63:0/209262592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfdc41b0 0x5623d01699b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.021+0000 7ffba7bfe740 1 -- 172.21.15.63:0/209262592 >> 172.21.15.63:0/209262592 conn(0x5623cfdb8300 msgr2=0x5623d01678a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.021+0000 7ffba7bfe740 1 -- 172.21.15.63:0/209262592 shutdown_connections 2024-09-21T06:28:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.021+0000 7ffba7bfe740 1 -- 172.21.15.63:0/209262592 wait complete. 2024-09-21T06:28:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.021+0000 7ffba7bfe740 1 -- start start 2024-09-21T06:28:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.021+0000 7ffba7bfe740 1 Processor -- start 2024-09-21T06:28:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffba7bfe740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfd9b2f0 0x5623d0179450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffba7bfe740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfda34d0 0x5623d0179990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffba7bfe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfdc41b0 0x5623d01857e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffba7bfe740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5623d0005ab0 con 0x5623cfd9b2f0 2024-09-21T06:28:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffba7bfe740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5623d0073730 con 0x5623cfda34d0 2024-09-21T06:28:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffba7bfe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5623d017c4b0 con 0x5623cfdc41b0 2024-09-21T06:28:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffba7bfe740 10 client.0 _ll_register_callbacks cb 0x5623d00c76b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffb9a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfd9b2f0 0x5623d0179450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffb9a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfd9b2f0 0x5623d0179450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50614/0 (socket says 172.21.15.63:50614) 2024-09-21T06:28:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffb9a59c640 1 -- 172.21.15.63:0/920537331 learned_addr learned my addr 172.21.15.63:0/920537331 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffb99d9b640 1 --2- 172.21.15.63:0/920537331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfda34d0 0x5623d0179990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffb9ad9d640 1 --2- 172.21.15.63:0/920537331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfdc41b0 0x5623d01857e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffb9a59c640 1 -- 172.21.15.63:0/920537331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfdc41b0 msgr2=0x5623d01857e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffb9a59c640 1 --2- 172.21.15.63:0/920537331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfdc41b0 0x5623d01857e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffb9a59c640 1 -- 172.21.15.63:0/920537331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfda34d0 msgr2=0x5623d0179990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffb9a59c640 1 --2- 172.21.15.63:0/920537331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfda34d0 0x5623d0179990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffb9a59c640 1 -- 172.21.15.63:0/920537331 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623cfe2f790 con 0x5623cfd9b2f0 2024-09-21T06:28:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffb9ad9d640 1 --2- 172.21.15.63:0/920537331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfdc41b0 0x5623d01857e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffb9a59c640 1 --2- 172.21.15.63:0/920537331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfd9b2f0 0x5623d0179450 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c02abf0 tx=0x7ffb8c0052a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd350906153431 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffb81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:28:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.022+0000 7ffb81ffb640 1 -- 172.21.15.63:0/920537331 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c035040 con 0x5623cfd9b2f0 2024-09-21T06:28:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.023+0000 7ffb81ffb640 1 -- 172.21.15.63:0/920537331 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ffb8c004230 con 0x5623cfd9b2f0 2024-09-21T06:28:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.023+0000 7ffba7bfe740 1 -- 172.21.15.63:0/920537331 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb8c0316a0 con 0x5623cfd9b2f0 2024-09-21T06:28:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.023+0000 7ffb81ffb640 1 -- 172.21.15.63:0/920537331 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffb8c040040 con 0x5623cfd9b2f0 2024-09-21T06:28:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.023+0000 7ffba7bfe740 10 client.15591 fetch_fsmap learned FSMap version 29 2024-09-21T06:28:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.023+0000 7ffba7bfe740 1 -- 172.21.15.63:0/920537331 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5623cfea8620 con 0x5623cfd9b2f0 2024-09-21T06:28:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.023+0000 7ffb81ffb640 1 -- 172.21.15.63:0/920537331 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb8c0316a0 con 0x5623cfd9b2f0 2024-09-21T06:28:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.023+0000 7ffb81ffb640 1 -- 172.21.15.63:0/920537331 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ffb8c004750 con 0x5623cfd9b2f0 2024-09-21T06:28:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.023+0000 7ffba7bfe740 10 client.15591 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:28:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.023+0000 7ffba7bfe740 10 client.15591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.023+0000 7ffba7bfe740 20 client.15591 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.023+0000 7ffba7bfe740 1 --2- 172.21.15.63:0/920537331 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5623cfd82d80 0x5623d018b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.023+0000 7ffba7bfe740 4 client.15591 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.023+0000 7ffba7bfe740 1 -- 172.21.15.63:0/920537331 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623d00e0640 con 0x5623cfd82d80 2024-09-21T06:28:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.024+0000 7ffb99d9b640 1 --2- 172.21.15.63:0/920537331 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5623cfd82d80 0x5623d018b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.024+0000 7ffb81ffb640 10 client.15591 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.024+0000 7ffb99d9b640 1 --2- 172.21.15.63:0/920537331 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5623cfd82d80 0x5623d018b370 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1416862155264071 server_cookie=1e2a13c44047a4e5 in_seq=0 out_seq=0 2024-09-21T06:28:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.025+0000 7ffb81ffb640 1 -- 172.21.15.63:0/920537331 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5623d00e0640 con 0x5623cfd82d80 2024-09-21T06:28:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.025+0000 7ffb81ffb640 10 client.15591 handle_command_reply: tid=0 2024-09-21T06:28:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.025+0000 7ffba7bfe740 1 client.15591 shutdown 2024-09-21T06:28:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.025+0000 7ffba7bfe740 1 -- 172.21.15.63:0/920537331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfd9b2f0 msgr2=0x5623d0179450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.025+0000 7ffba7bfe740 1 --2- 172.21.15.63:0/920537331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfd9b2f0 0x5623d0179450 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c02abf0 tx=0x7ffb8c0052a0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.033 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.025+0000 7ffba7bfe740 1 -- 172.21.15.63:0/920537331 shutdown_connections 2024-09-21T06:28:49.033 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.025+0000 7ffba7bfe740 1 --2- 172.21.15.63:0/920537331 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5623cfd82d80 0x5623d018b370 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.033 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.025+0000 7ffba7bfe740 1 --2- 172.21.15.63:0/920537331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfdc41b0 0x5623d01857e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.033 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.025+0000 7ffba7bfe740 1 --2- 172.21.15.63:0/920537331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfda34d0 0x5623d0179990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.033 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.025+0000 7ffb81ffb640 0 client.15591 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:49.033 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.025+0000 7ffba7bfe740 1 --2- 172.21.15.63:0/920537331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfd9b2f0 0x5623d0179450 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.033 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.025+0000 7ffba7bfe740 1 -- 172.21.15.63:0/920537331 >> 172.21.15.63:0/920537331 conn(0x5623cfdb8300 msgr2=0x5623d0165ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:49.033 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.025+0000 7ffba7bfe740 1 -- 172.21.15.63:0/920537331 shutdown_connections 2024-09-21T06:28:49.033 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.025+0000 7ffba7bfe740 1 -- 172.21.15.63:0/920537331 wait complete. 2024-09-21T06:28:49.033 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.025+0000 7ffba7bfe740 20 client.15591 trim_cache size 0 max 16384 2024-09-21T06:28:49.045 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.041+0000 7ffba7bfe740 1 Processor -- start 2024-09-21T06:28:49.045 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.041+0000 7ffba7bfe740 1 -- start start 2024-09-21T06:28:49.045 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.042+0000 7ffba7bfe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfd9b2f0 0x5623d0179930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:49.045 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.042+0000 7ffba7bfe740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfda34d0 0x5623d0167620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.042+0000 7ffba7bfe740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfdc41b0 0x5623d0185750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.042+0000 7ffba7bfe740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c1ad510 con 0x5623cfdc41b0 2024-09-21T06:28:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.042+0000 7ffba7bfe740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c1af050 con 0x5623cfda34d0 2024-09-21T06:28:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.042+0000 7ffba7bfe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c1adbe0 con 0x5623cfd9b2f0 2024-09-21T06:28:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.042+0000 7ffb9ad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfdc41b0 0x5623d0185750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.042+0000 7ffb9ad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfdc41b0 0x5623d0185750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50620/0 (socket says 172.21.15.63:50620) 2024-09-21T06:28:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.042+0000 7ffb9ad9d640 1 -- 172.21.15.63:0/4246769647 learned_addr learned my addr 172.21.15.63:0/4246769647 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.042+0000 7ffb9a59c640 1 --2- 172.21.15.63:0/4246769647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfd9b2f0 0x5623d0179930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.042+0000 7ffb99d9b640 1 --2- 172.21.15.63:0/4246769647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfda34d0 0x5623d0167620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.042+0000 7ffb9ad9d640 1 -- 172.21.15.63:0/4246769647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfd9b2f0 msgr2=0x5623d0179930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.042+0000 7ffb9ad9d640 1 --2- 172.21.15.63:0/4246769647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfd9b2f0 0x5623d0179930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.042+0000 7ffb9ad9d640 1 -- 172.21.15.63:0/4246769647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfda34d0 msgr2=0x5623d0167620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.042+0000 7ffb9ad9d640 1 --2- 172.21.15.63:0/4246769647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfda34d0 0x5623d0167620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.042+0000 7ffb9ad9d640 1 -- 172.21.15.63:0/4246769647 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623d017a710 con 0x5623cfdc41b0 2024-09-21T06:28:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.042+0000 7ffb9a59c640 1 --2- 172.21.15.63:0/4246769647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfd9b2f0 0x5623d0179930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.042+0000 7ffb99d9b640 1 --2- 172.21.15.63:0/4246769647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfda34d0 0x5623d0167620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.042+0000 7ffb9ad9d640 1 --2- 172.21.15.63:0/4246769647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfdc41b0 0x5623d0185750 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ffb94017890 tx=0x7ffb9400c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1803c90ce132cb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.043+0000 7ffb83fff640 1 -- 172.21.15.63:0/4246769647 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94026070 con 0x5623cfdc41b0 2024-09-21T06:28:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.043+0000 7ffb83fff640 1 -- 172.21.15.63:0/4246769647 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb94017e10 con 0x5623cfdc41b0 2024-09-21T06:28:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.043+0000 7ffb83fff640 1 -- 172.21.15.63:0/4246769647 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94021e60 con 0x5623cfdc41b0 2024-09-21T06:28:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.044+0000 7ffba7bfe740 1 -- 172.21.15.63:0/4246769647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfdc41b0 msgr2=0x5623d0185750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.044+0000 7ffba7bfe740 1 --2- 172.21.15.63:0/4246769647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfdc41b0 0x5623d0185750 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ffb94017890 tx=0x7ffb9400c050 comp rx=0 tx=0).stop 2024-09-21T06:28:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.044+0000 7ffba7bfe740 1 -- 172.21.15.63:0/4246769647 shutdown_connections 2024-09-21T06:28:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.044+0000 7ffba7bfe740 1 --2- 172.21.15.63:0/4246769647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfdc41b0 0x5623d0185750 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.044+0000 7ffba7bfe740 1 --2- 172.21.15.63:0/4246769647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfda34d0 0x5623d0167620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.044+0000 7ffba7bfe740 1 --2- 172.21.15.63:0/4246769647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfd9b2f0 0x5623d0179930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.044+0000 7ffba7bfe740 1 -- 172.21.15.63:0/4246769647 >> 172.21.15.63:0/4246769647 conn(0x5623cfdb8300 msgr2=0x5623d01740f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.044+0000 7ffba7bfe740 1 -- 172.21.15.63:0/4246769647 shutdown_connections 2024-09-21T06:28:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.044+0000 7ffba7bfe740 1 -- 172.21.15.63:0/4246769647 wait complete. 2024-09-21T06:28:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.044+0000 7ffba7bfe740 1 -- start start 2024-09-21T06:28:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.044+0000 7ffba7bfe740 1 Processor -- start 2024-09-21T06:28:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.044+0000 7ffba7bfe740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfd9b2f0 0x5623d018b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.044+0000 7ffba7bfe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfda34d0 0x5623d018bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.044+0000 7ffba7bfe740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfdc41b0 0x5623d01f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.044+0000 7ffba7bfe740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c1ae980 con 0x5623cfdc41b0 2024-09-21T06:28:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.044+0000 7ffba7bfe740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c1ae2b0 con 0x5623cfd9b2f0 2024-09-21T06:28:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.044+0000 7ffba7bfe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c1ab4f0 con 0x5623cfda34d0 2024-09-21T06:28:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.045+0000 7ffba7bfe740 10 client.0 _ll_register_callbacks cb 0x7ffb8c032db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.045+0000 7ffb9ad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfdc41b0 0x5623d01f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.045+0000 7ffb9ad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfdc41b0 0x5623d01f3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50630/0 (socket says 172.21.15.63:50630) 2024-09-21T06:28:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.045+0000 7ffb9ad9d640 1 -- 172.21.15.63:0/2978777229 learned_addr learned my addr 172.21.15.63:0/2978777229 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.045+0000 7ffb9a59c640 1 --2- 172.21.15.63:0/2978777229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfd9b2f0 0x5623d018b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.045+0000 7ffb99d9b640 1 --2- 172.21.15.63:0/2978777229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfda34d0 0x5623d018bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.045+0000 7ffb9ad9d640 1 -- 172.21.15.63:0/2978777229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfda34d0 msgr2=0x5623d018bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.045+0000 7ffb9ad9d640 1 --2- 172.21.15.63:0/2978777229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfda34d0 0x5623d018bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.045+0000 7ffb9ad9d640 1 -- 172.21.15.63:0/2978777229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfd9b2f0 msgr2=0x5623d018b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.045+0000 7ffb9ad9d640 1 --2- 172.21.15.63:0/2978777229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfd9b2f0 0x5623d018b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.045+0000 7ffb9ad9d640 1 -- 172.21.15.63:0/2978777229 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623d01f4020 con 0x5623cfdc41b0 2024-09-21T06:28:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.045+0000 7ffb9ad9d640 1 --2- 172.21.15.63:0/2978777229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfdc41b0 0x5623d01f3ae0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ffb94021c00 tx=0x7ffb94021620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7162bd50cd6ce8f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.045+0000 7ffb81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:28:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.045+0000 7ffb81ffb640 1 -- 172.21.15.63:0/2978777229 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9402e020 con 0x5623cfdc41b0 2024-09-21T06:28:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.045+0000 7ffb81ffb640 1 -- 172.21.15.63:0/2978777229 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ffb9402a3f0 con 0x5623cfdc41b0 2024-09-21T06:28:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.045+0000 7ffba7bfe740 1 -- 172.21.15.63:0/2978777229 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb94017e10 con 0x5623cfdc41b0 2024-09-21T06:28:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.046+0000 7ffb81ffb640 1 -- 172.21.15.63:0/2978777229 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffb94039050 con 0x5623cfdc41b0 2024-09-21T06:28:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.046+0000 7ffba7bfe740 10 client.15597 fetch_fsmap learned FSMap version 29 2024-09-21T06:28:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.046+0000 7ffba7bfe740 1 -- 172.21.15.63:0/2978777229 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5623d01f5100 con 0x5623cfdc41b0 2024-09-21T06:28:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.046+0000 7ffb81ffb640 1 -- 172.21.15.63:0/2978777229 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb94017e10 con 0x5623cfdc41b0 2024-09-21T06:28:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.046+0000 7ffb81ffb640 1 -- 172.21.15.63:0/2978777229 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ffb94029030 con 0x5623cfdc41b0 2024-09-21T06:28:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.046+0000 7ffba7bfe740 10 client.15597 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:28:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.046+0000 7ffba7bfe740 10 client.15597 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.046+0000 7ffba7bfe740 20 client.15597 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.046+0000 7ffba7bfe740 1 --2- 172.21.15.63:0/2978777229 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5623cfd581c0 0x5623d01f7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.046+0000 7ffba7bfe740 4 client.15597 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:28:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.046+0000 7ffba7bfe740 1 -- 172.21.15.63:0/2978777229 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5623d00dc0f0 con 0x5623cfd581c0 2024-09-21T06:28:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.046+0000 7ffb9a59c640 1 --2- 172.21.15.63:0/2978777229 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5623cfd581c0 0x5623d01f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.047+0000 7ffb81ffb640 10 client.15597 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.047+0000 7ffb9a59c640 1 --2- 172.21.15.63:0/2978777229 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5623cfd581c0 0x5623d01f7830 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8a06ca775fcf015 server_cookie=2f90f5b36da2947a in_seq=0 out_seq=0 2024-09-21T06:28:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.052+0000 7ffb81ffb640 1 -- 172.21.15.63:0/2978777229 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5623d00dc0f0 con 0x5623cfd581c0 2024-09-21T06:28:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.052+0000 7ffb81ffb640 10 client.15597 handle_command_reply: tid=0 2024-09-21T06:28:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.053+0000 7ffba7bfe740 1 client.15597 shutdown 2024-09-21T06:28:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.053+0000 7ffba7bfe740 1 -- 172.21.15.63:0/2978777229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfdc41b0 msgr2=0x5623d01f3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.053+0000 7ffba7bfe740 1 --2- 172.21.15.63:0/2978777229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfdc41b0 0x5623d01f3ae0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ffb94021c00 tx=0x7ffb94021620 comp rx=0 tx=0).stop 2024-09-21T06:28:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.053+0000 7ffba7bfe740 1 -- 172.21.15.63:0/2978777229 shutdown_connections 2024-09-21T06:28:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.053+0000 7ffba7bfe740 1 --2- 172.21.15.63:0/2978777229 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5623cfd581c0 0x5623d01f7830 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.053+0000 7ffba7bfe740 1 --2- 172.21.15.63:0/2978777229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623cfdc41b0 0x5623d01f3ae0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.053+0000 7ffba7bfe740 1 --2- 172.21.15.63:0/2978777229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623cfda34d0 0x5623d018bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.053+0000 7ffb81ffb640 0 client.15597 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.053+0000 7ffba7bfe740 1 --2- 172.21.15.63:0/2978777229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5623cfd9b2f0 0x5623d018b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.053+0000 7ffba7bfe740 1 -- 172.21.15.63:0/2978777229 >> 172.21.15.63:0/2978777229 conn(0x5623cfdb8300 msgr2=0x5623d016b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.053+0000 7ffba7bfe740 1 -- 172.21.15.63:0/2978777229 shutdown_connections 2024-09-21T06:28:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.053+0000 7ffba7bfe740 1 -- 172.21.15.63:0/2978777229 wait complete. 2024-09-21T06:28:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.053+0000 7ffba7bfe740 20 client.15597 trim_cache size 0 max 16384 2024-09-21T06:28:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout:{ 2024-09-21T06:28:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout: "message": "", 2024-09-21T06:28:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout: "return_code": 0 2024-09-21T06:28:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout:} 2024-09-21T06:28:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.054+0000 7ffba0bad640 1 -- 172.21.15.63:0/2646490205 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffb840b65f0 msgr2=0x7ffb840b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.054+0000 7ffba0bad640 1 --2- 172.21.15.63:0/2646490205 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffb840b65f0 0x7ffb840b8b00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009fd0 tx=0x7ffb9400e040 comp rx=0 tx=0).stop 2024-09-21T06:28:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.054+0000 7ffba0bad640 1 -- 172.21.15.63:0/2646490205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb9c109410 msgr2=0x7ffb9c19ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.054+0000 7ffba0bad640 1 --2- 172.21.15.63:0/2646490205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb9c109410 0x7ffb9c19ab20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000d950 tx=0x7ffb9000de10 comp rx=0 tx=0).stop 2024-09-21T06:28:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.054+0000 7ffba0bad640 1 -- 172.21.15.63:0/2646490205 shutdown_connections 2024-09-21T06:28:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.054+0000 7ffba0bad640 1 --2- 172.21.15.63:0/2646490205 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffb840b65f0 0x7ffb840b8b00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.054+0000 7ffba0bad640 1 --2- 172.21.15.63:0/2646490205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb9c109d60 0x7ffb9c19fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.054+0000 7ffba0bad640 1 --2- 172.21.15.63:0/2646490205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb9c109410 0x7ffb9c19ab20 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.054+0000 7ffba0bad640 1 --2- 172.21.15.63:0/2646490205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb9c103ae0 0x7ffb9c19a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.054+0000 7ffba0bad640 1 -- 172.21.15.63:0/2646490205 >> 172.21.15.63:0/2646490205 conn(0x7ffb9c0ff520 msgr2=0x7ffb9c101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.054+0000 7ffba0bad640 1 -- 172.21.15.63:0/2646490205 shutdown_connections 2024-09-21T06:28:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:28:49.054+0000 7ffba0bad640 1 -- 172.21.15.63:0/2646490205 wait complete. 2024-09-21T06:28:49.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:48 smithi071 ceph-mon[34844]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-21T06:28:49.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:48 smithi063 ceph-mon[31150]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-21T06:28:49.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:48 smithi175 ceph-mon[34510]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-21T06:28:51.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:50 smithi071 ceph-mon[34844]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-09-21T06:28:51.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:50 smithi063 ceph-mon[31150]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-09-21T06:28:51.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:50 smithi175 ceph-mon[34510]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-09-21T06:28:53.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:52 smithi071 ceph-mon[34844]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:28:53.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:52 smithi063 ceph-mon[31150]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:28:53.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:52 smithi175 ceph-mon[34510]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:28:53.953 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:28:54.269 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:54.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.854+0000 7fc828cb4640 1 -- 172.21.15.63:0/2656426899 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814004cb0 con 0x7fc8241083e0 2024-09-21T06:28:54.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.855+0000 7fc82bf1a640 1 -- 172.21.15.63:0/2656426899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8241083e0 msgr2=0x7fc8241087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:54.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.855+0000 7fc82bf1a640 1 --2- 172.21.15.63:0/2656426899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8241083e0 0x7fc8241087f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc81400d910 tx=0x7fc81402c380 comp rx=0 tx=0).stop 2024-09-21T06:28:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.855+0000 7fc82bf1a640 1 -- 172.21.15.63:0/2656426899 shutdown_connections 2024-09-21T06:28:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.855+0000 7fc82bf1a640 1 --2- 172.21.15.63:0/2656426899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc824108d30 0x7fc82410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.855+0000 7fc82bf1a640 1 --2- 172.21.15.63:0/2656426899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8241083e0 0x7fc8241087f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.855+0000 7fc82bf1a640 1 --2- 172.21.15.63:0/2656426899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc824102aa0 0x7fc824102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.855+0000 7fc82bf1a640 1 -- 172.21.15.63:0/2656426899 >> 172.21.15.63:0/2656426899 conn(0x7fc824079750 msgr2=0x7fc824079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.855+0000 7fc82bf1a640 1 -- 172.21.15.63:0/2656426899 shutdown_connections 2024-09-21T06:28:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.855+0000 7fc82bf1a640 1 -- 172.21.15.63:0/2656426899 wait complete. 2024-09-21T06:28:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.856+0000 7fc82bf1a640 1 Processor -- start 2024-09-21T06:28:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.856+0000 7fc82bf1a640 1 -- start start 2024-09-21T06:28:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.856+0000 7fc82bf1a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc824102aa0 0x7fc82410e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.856+0000 7fc82bf1a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8241083e0 0x7fc82410e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.857+0000 7fc82bf1a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc824108d30 0x7fc82419ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.857+0000 7fc82bf1a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc824111200 con 0x7fc824108d30 2024-09-21T06:28:54.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.857+0000 7fc82bf1a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc824111080 con 0x7fc824102aa0 2024-09-21T06:28:54.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.857+0000 7fc82bf1a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc824111380 con 0x7fc8241083e0 2024-09-21T06:28:54.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.857+0000 7fc82a4b7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc824108d30 0x7fc82419ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.857+0000 7fc82a4b7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc824108d30 0x7fc82419ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50654/0 (socket says 172.21.15.63:50654) 2024-09-21T06:28:54.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.857+0000 7fc82a4b7640 1 -- 172.21.15.63:0/3424784260 learned_addr learned my addr 172.21.15.63:0/3424784260 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:54.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.857+0000 7fc8294b5640 1 --2- 172.21.15.63:0/3424784260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8241083e0 0x7fc82410e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.857+0000 7fc829cb6640 1 --2- 172.21.15.63:0/3424784260 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc824102aa0 0x7fc82410e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.857+0000 7fc82a4b7640 1 -- 172.21.15.63:0/3424784260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8241083e0 msgr2=0x7fc82410e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:54.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.857+0000 7fc82a4b7640 1 --2- 172.21.15.63:0/3424784260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8241083e0 0x7fc82410e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.857+0000 7fc82a4b7640 1 -- 172.21.15.63:0/3424784260 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc824102aa0 msgr2=0x7fc82410e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:54.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.857+0000 7fc82a4b7640 1 --2- 172.21.15.63:0/3424784260 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc824102aa0 0x7fc82410e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.857+0000 7fc82a4b7640 1 -- 172.21.15.63:0/3424784260 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82419d130 con 0x7fc824108d30 2024-09-21T06:28:54.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.857+0000 7fc8294b5640 1 --2- 172.21.15.63:0/3424784260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8241083e0 0x7fc82410e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:54.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.857+0000 7fc82a4b7640 1 --2- 172.21.15.63:0/3424784260 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc824108d30 0x7fc82419ca00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00eb10 tx=0x7fc81c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:54.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.858+0000 7fc81affd640 1 -- 172.21.15.63:0/3424784260 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c004b20 con 0x7fc824108d30 2024-09-21T06:28:54.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.858+0000 7fc82bf1a640 1 -- 172.21.15.63:0/3424784260 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc82419d420 con 0x7fc824108d30 2024-09-21T06:28:54.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.858+0000 7fc82bf1a640 1 -- 172.21.15.63:0/3424784260 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8241a4cb0 con 0x7fc824108d30 2024-09-21T06:28:54.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.858+0000 7fc81affd640 1 -- 172.21.15.63:0/3424784260 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc81c004cc0 con 0x7fc824108d30 2024-09-21T06:28:54.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.858+0000 7fc81affd640 1 -- 172.21.15.63:0/3424784260 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c010720 con 0x7fc824108d30 2024-09-21T06:28:54.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.861+0000 7fc81affd640 1 -- 172.21.15.63:0/3424784260 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 24) ==== 154586+0+0 (secure 0 0 0) 0x7fc81c005000 con 0x7fc824108d30 2024-09-21T06:28:54.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.862+0000 7fc83248e740 1 Processor -- start 2024-09-21T06:28:54.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.862+0000 7fc83248e740 1 -- start start 2024-09-21T06:28:54.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.862+0000 7fc83248e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192601f070 0x5619263c6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.862+0000 7fc81affd640 1 --2- 172.21.15.63:0/3424784260 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc8100bee80 0x7fc8100c1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.862+0000 7fc83248e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ff61b0 0x5619263c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.863+0000 7fc8294b5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ff61b0 0x5619263c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.863+0000 7fc8294b5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ff61b0 0x5619263c67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50660/0 (socket says 172.21.15.63:50660) 2024-09-21T06:28:54.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.863+0000 7fc8294b5640 1 -- 172.21.15.63:0/4271161551 learned_addr learned my addr 172.21.15.63:0/4271161551 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:54.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.863+0000 7fc81affd640 1 -- 172.21.15.63:0/3424784260 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fc81c0e7920 con 0x7fc824108d30 2024-09-21T06:28:54.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.863+0000 7fc829cb6640 1 --2- 172.21.15.63:0/3424784260 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc8100bee80 0x7fc8100c1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.863+0000 7fc83248e740 1 --2- 172.21.15.63:0/4271161551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561925ffe390 0x5619263c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.863+0000 7fc83248e740 1 -- 172.21.15.63:0/4271161551 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56192633ce50 con 0x561925ff61b0 2024-09-21T06:28:54.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.863+0000 7fc83248e740 1 -- 172.21.15.63:0/4271161551 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56192632c280 con 0x56192601f070 2024-09-21T06:28:54.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.863+0000 7fc83248e740 1 -- 172.21.15.63:0/4271161551 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561926330090 con 0x561925ffe390 2024-09-21T06:28:54.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.864+0000 7fc829cb6640 1 --2- 172.21.15.63:0/3424784260 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc8100bee80 0x7fc8100c1390 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc820009bd0 tx=0x7fc820005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:54.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.864+0000 7fc82a4b7640 1 --2- 172.21.15.63:0/4271161551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561925ffe390 0x5619263c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.864+0000 7fc8294b5640 1 --2- 172.21.15.63:0/4271161551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192601f070 0x5619263c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.864+0000 7fc8294b5640 1 -- 172.21.15.63:0/4271161551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561925ffe390 msgr2=0x5619263c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:54.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.864+0000 7fc8294b5640 1 --2- 172.21.15.63:0/4271161551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561925ffe390 0x5619263c6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.864+0000 7fc8294b5640 1 -- 172.21.15.63:0/4271161551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192601f070 msgr2=0x5619263c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:54.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.864+0000 7fc8294b5640 1 --2- 172.21.15.63:0/4271161551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192601f070 0x5619263c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.864+0000 7fc8294b5640 1 -- 172.21.15.63:0/4271161551 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56192608a650 con 0x561925ff61b0 2024-09-21T06:28:54.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.865+0000 7fc8294b5640 1 --2- 172.21.15.63:0/4271161551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ff61b0 0x5619263c67b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc82406ab20 tx=0x7fc814005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965cf20286b7a200 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:54.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.865+0000 7fc80ffff640 1 -- 172.21.15.63:0/4271161551 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8140049b0 con 0x561925ff61b0 2024-09-21T06:28:54.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.865+0000 7fc80ffff640 1 -- 172.21.15.63:0/4271161551 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc814030070 con 0x561925ff61b0 2024-09-21T06:28:54.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.865+0000 7fc80ffff640 1 -- 172.21.15.63:0/4271161551 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8140054f0 con 0x561925ff61b0 2024-09-21T06:28:54.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.866+0000 7fc83248e740 1 -- 172.21.15.63:0/4271161551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ff61b0 msgr2=0x5619263c67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:54.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.866+0000 7fc83248e740 1 --2- 172.21.15.63:0/4271161551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ff61b0 0x5619263c67b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc82406ab20 tx=0x7fc814005e50 comp rx=0 tx=0).stop 2024-09-21T06:28:54.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.866+0000 7fc83248e740 1 -- 172.21.15.63:0/4271161551 shutdown_connections 2024-09-21T06:28:54.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.866+0000 7fc83248e740 1 --2- 172.21.15.63:0/4271161551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561925ffe390 0x5619263c6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.866+0000 7fc83248e740 1 --2- 172.21.15.63:0/4271161551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ff61b0 0x5619263c67b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.866+0000 7fc83248e740 1 --2- 172.21.15.63:0/4271161551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56192601f070 0x5619263c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.866+0000 7fc83248e740 1 -- 172.21.15.63:0/4271161551 >> 172.21.15.63:0/4271161551 conn(0x561926013460 msgr2=0x5619263c4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:54.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.867+0000 7fc83248e740 1 -- 172.21.15.63:0/4271161551 shutdown_connections 2024-09-21T06:28:54.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.867+0000 7fc83248e740 1 -- 172.21.15.63:0/4271161551 wait complete. 2024-09-21T06:28:54.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.867+0000 7fc83248e740 1 -- start start 2024-09-21T06:28:54.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.867+0000 7fc83248e740 1 Processor -- start 2024-09-21T06:28:54.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.868+0000 7fc83248e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561925ff61b0 0x5619263d1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.868+0000 7fc83248e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ffe390 0x5619263d1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.868+0000 7fc83248e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56192601f070 0x5619263d23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.868+0000 7fc83248e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56192618d700 con 0x561925ffe390 2024-09-21T06:28:54.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.868+0000 7fc83248e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5619262c7110 con 0x561925ff61b0 2024-09-21T06:28:54.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.868+0000 7fc83248e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5619263d49f0 con 0x56192601f070 2024-09-21T06:28:54.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.868+0000 7fc83248e740 10 client.0 _ll_register_callbacks cb 0x5619262e0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:54.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.868+0000 7fc829cb6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561925ff61b0 0x5619263d1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.868+0000 7fc829cb6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561925ff61b0 0x5619263d1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:59186/0 (socket says 172.21.15.63:59186) 2024-09-21T06:28:54.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.868+0000 7fc829cb6640 1 -- 172.21.15.63:0/1815805378 learned_addr learned my addr 172.21.15.63:0/1815805378 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:54.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.868+0000 7fc8294b5640 1 --2- 172.21.15.63:0/1815805378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ffe390 0x5619263d1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.868+0000 7fc82a4b7640 1 --2- 172.21.15.63:0/1815805378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56192601f070 0x5619263d23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.869+0000 7fc829cb6640 1 -- 172.21.15.63:0/1815805378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56192601f070 msgr2=0x5619263d23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:54.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.869+0000 7fc829cb6640 1 --2- 172.21.15.63:0/1815805378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56192601f070 0x5619263d23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.869+0000 7fc829cb6640 1 -- 172.21.15.63:0/1815805378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ffe390 msgr2=0x5619263d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:54.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.869+0000 7fc829cb6640 1 --2- 172.21.15.63:0/1815805378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ffe390 0x5619263d1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.869+0000 7fc829cb6640 1 -- 172.21.15.63:0/1815805378 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619262f4c40 con 0x561925ff61b0 2024-09-21T06:28:54.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.869+0000 7fc829cb6640 1 --2- 172.21.15.63:0/1815805378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561925ff61b0 0x5619263d1910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc82000ecd0 tx=0x7fc820004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=448c0151752662f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:54.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.869+0000 7fc80d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:28:54.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.869+0000 7fc80d7fa640 1 -- 172.21.15.63:0/1815805378 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82001ccb0 con 0x561925ff61b0 2024-09-21T06:28:54.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.869+0000 7fc80d7fa640 1 -- 172.21.15.63:0/1815805378 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fc820004020 con 0x561925ff61b0 2024-09-21T06:28:54.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.869+0000 7fc83248e740 1 -- 172.21.15.63:0/1815805378 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc814030070 con 0x561925ff61b0 2024-09-21T06:28:54.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.870+0000 7fc80d7fa640 1 -- 172.21.15.63:0/1815805378 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc82001ce50 con 0x561925ff61b0 2024-09-21T06:28:54.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.870+0000 7fc83248e740 10 client.25310 fetch_fsmap learned FSMap version 29 2024-09-21T06:28:54.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.870+0000 7fc83248e740 1 -- 172.21.15.63:0/1815805378 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5619263e0800 con 0x561925ff61b0 2024-09-21T06:28:54.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.870+0000 7fc80d7fa640 1 -- 172.21.15.63:0/1815805378 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc820004220 con 0x561925ff61b0 2024-09-21T06:28:54.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.870+0000 7fc80d7fa640 1 -- 172.21.15.63:0/1815805378 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc8200274c0 con 0x561925ff61b0 2024-09-21T06:28:54.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.870+0000 7fc83248e740 10 client.25310 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:28:54.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.870+0000 7fc83248e740 10 client.25310 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:54.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.870+0000 7fc83248e740 20 client.25310 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:54.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.870+0000 7fc83248e740 1 --2- 172.21.15.63:0/1815805378 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x561925fdd9f0 0x5619263e3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.870+0000 7fc83248e740 4 client.25310 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:54.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.870+0000 7fc83248e740 1 -- 172.21.15.63:0/1815805378 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc814030070 con 0x561925fdd9f0 2024-09-21T06:28:54.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.871+0000 7fc8294b5640 1 --2- 172.21.15.63:0/1815805378 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x561925fdd9f0 0x5619263e3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.871+0000 7fc80d7fa640 10 client.25310 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:54.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.871+0000 7fc8294b5640 1 --2- 172.21.15.63:0/1815805378 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x561925fdd9f0 0x5619263e3d90 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13c692fd549e8bb7 server_cookie=6eee05bf5dc061e3 in_seq=0 out_seq=0 2024-09-21T06:28:54.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.872+0000 7fc80d7fa640 1 -- 172.21.15.63:0/1815805378 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fc814030070 con 0x561925fdd9f0 2024-09-21T06:28:54.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.872+0000 7fc80d7fa640 10 client.25310 handle_command_reply: tid=0 2024-09-21T06:28:54.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.872+0000 7fc83248e740 1 client.25310 shutdown 2024-09-21T06:28:54.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.872+0000 7fc83248e740 1 -- 172.21.15.63:0/1815805378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561925ff61b0 msgr2=0x5619263d1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:54.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.872+0000 7fc83248e740 1 --2- 172.21.15.63:0/1815805378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561925ff61b0 0x5619263d1910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc82000ecd0 tx=0x7fc820004730 comp rx=0 tx=0).stop 2024-09-21T06:28:54.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.872+0000 7fc83248e740 1 -- 172.21.15.63:0/1815805378 shutdown_connections 2024-09-21T06:28:54.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.872+0000 7fc83248e740 1 --2- 172.21.15.63:0/1815805378 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x561925fdd9f0 0x5619263e3d90 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.872+0000 7fc83248e740 1 --2- 172.21.15.63:0/1815805378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56192601f070 0x5619263d23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.872+0000 7fc80d7fa640 0 client.25310 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:54.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.872+0000 7fc83248e740 1 --2- 172.21.15.63:0/1815805378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ffe390 0x5619263d1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.872+0000 7fc83248e740 1 --2- 172.21.15.63:0/1815805378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561925ff61b0 0x5619263d1910 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.872+0000 7fc83248e740 1 -- 172.21.15.63:0/1815805378 >> 172.21.15.63:0/1815805378 conn(0x561926013460 msgr2=0x5619263c9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:54.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.872+0000 7fc83248e740 1 -- 172.21.15.63:0/1815805378 shutdown_connections 2024-09-21T06:28:54.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.872+0000 7fc83248e740 1 -- 172.21.15.63:0/1815805378 wait complete. 2024-09-21T06:28:54.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.872+0000 7fc83248e740 20 client.25310 trim_cache size 0 max 16384 2024-09-21T06:28:54.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.903+0000 7fc83248e740 1 Processor -- start 2024-09-21T06:28:54.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.903+0000 7fc83248e740 1 -- start start 2024-09-21T06:28:54.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.903+0000 7fc83248e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561925fdd9f0 0x5619263d3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.903+0000 7fc83248e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561925ff61b0 0x5619263ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.903+0000 7fc83248e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ffe390 0x5619263cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.903+0000 7fc83248e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc80800e710 con 0x561925ffe390 2024-09-21T06:28:54.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.903+0000 7fc83248e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc808010250 con 0x561925ff61b0 2024-09-21T06:28:54.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.903+0000 7fc83248e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc80800ede0 con 0x561925fdd9f0 2024-09-21T06:28:54.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.904+0000 7fc82a4b7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ffe390 0x5619263cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.904+0000 7fc82a4b7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ffe390 0x5619263cf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50666/0 (socket says 172.21.15.63:50666) 2024-09-21T06:28:54.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.904+0000 7fc82a4b7640 1 -- 172.21.15.63:0/2429042114 learned_addr learned my addr 172.21.15.63:0/2429042114 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:54.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.904+0000 7fc829cb6640 1 --2- 172.21.15.63:0/2429042114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561925fdd9f0 0x5619263d3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.904+0000 7fc8294b5640 1 --2- 172.21.15.63:0/2429042114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561925ff61b0 0x5619263ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.904+0000 7fc82a4b7640 1 -- 172.21.15.63:0/2429042114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561925fdd9f0 msgr2=0x5619263d3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:54.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.904+0000 7fc82a4b7640 1 --2- 172.21.15.63:0/2429042114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561925fdd9f0 0x5619263d3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.904+0000 7fc82a4b7640 1 -- 172.21.15.63:0/2429042114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561925ff61b0 msgr2=0x5619263ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:54.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.904+0000 7fc82a4b7640 1 --2- 172.21.15.63:0/2429042114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561925ff61b0 0x5619263ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.904+0000 7fc82a4b7640 1 -- 172.21.15.63:0/2429042114 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619263c8560 con 0x561925ffe390 2024-09-21T06:28:54.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.904+0000 7fc82a4b7640 1 --2- 172.21.15.63:0/2429042114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ffe390 0x5619263cf040 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0e5220 tx=0x7fc81c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e9b2222db79820 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:54.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.905+0000 7fc80f7fe640 1 -- 172.21.15.63:0/2429042114 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c0acfe0 con 0x561925ffe390 2024-09-21T06:28:54.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.905+0000 7fc80f7fe640 1 -- 172.21.15.63:0/2429042114 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc81c0ad380 con 0x561925ffe390 2024-09-21T06:28:54.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.905+0000 7fc80f7fe640 1 -- 172.21.15.63:0/2429042114 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c0aeda0 con 0x561925ffe390 2024-09-21T06:28:54.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.906+0000 7fc83248e740 1 -- 172.21.15.63:0/2429042114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ffe390 msgr2=0x5619263cf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:54.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.906+0000 7fc83248e740 1 --2- 172.21.15.63:0/2429042114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ffe390 0x5619263cf040 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0e5220 tx=0x7fc81c00cee0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.907+0000 7fc83248e740 1 -- 172.21.15.63:0/2429042114 shutdown_connections 2024-09-21T06:28:54.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.907+0000 7fc83248e740 1 --2- 172.21.15.63:0/2429042114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ffe390 0x5619263cf040 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.907+0000 7fc83248e740 1 --2- 172.21.15.63:0/2429042114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561925ff61b0 0x5619263ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.907+0000 7fc83248e740 1 --2- 172.21.15.63:0/2429042114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561925fdd9f0 0x5619263d3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.907+0000 7fc83248e740 1 -- 172.21.15.63:0/2429042114 >> 172.21.15.63:0/2429042114 conn(0x561926013460 msgr2=0x5619263c7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:54.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.907+0000 7fc83248e740 1 -- 172.21.15.63:0/2429042114 shutdown_connections 2024-09-21T06:28:54.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.907+0000 7fc83248e740 1 -- 172.21.15.63:0/2429042114 wait complete. 2024-09-21T06:28:54.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.907+0000 7fc83248e740 1 -- start start 2024-09-21T06:28:54.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.907+0000 7fc83248e740 1 Processor -- start 2024-09-21T06:28:54.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.908+0000 7fc83248e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561925fdd9f0 0x5619263d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.908+0000 7fc83248e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ff61b0 0x5619263d6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.908+0000 7fc83248e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561925ffe390 0x561926447760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.908+0000 7fc83248e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc80800fb80 con 0x561925ff61b0 2024-09-21T06:28:54.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.908+0000 7fc83248e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc80800f4b0 con 0x561925fdd9f0 2024-09-21T06:28:54.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.908+0000 7fc83248e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc80800c6f0 con 0x561925ffe390 2024-09-21T06:28:54.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.908+0000 7fc83248e740 10 client.0 _ll_register_callbacks cb 0x7fc820009680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:54.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.908+0000 7fc829cb6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561925fdd9f0 0x5619263d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.908+0000 7fc829cb6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561925fdd9f0 0x5619263d6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:59202/0 (socket says 172.21.15.63:59202) 2024-09-21T06:28:54.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.908+0000 7fc829cb6640 1 -- 172.21.15.63:0/1948752647 learned_addr learned my addr 172.21.15.63:0/1948752647 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:54.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.908+0000 7fc8294b5640 1 --2- 172.21.15.63:0/1948752647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ff61b0 0x5619263d6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.909+0000 7fc82a4b7640 1 --2- 172.21.15.63:0/1948752647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561925ffe390 0x561926447760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.909+0000 7fc829cb6640 1 -- 172.21.15.63:0/1948752647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561925ffe390 msgr2=0x561926447760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:54.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.909+0000 7fc829cb6640 1 --2- 172.21.15.63:0/1948752647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561925ffe390 0x561926447760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.909+0000 7fc829cb6640 1 -- 172.21.15.63:0/1948752647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ff61b0 msgr2=0x5619263d6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:54.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.909+0000 7fc829cb6640 1 --2- 172.21.15.63:0/1948752647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ff61b0 0x5619263d6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.909+0000 7fc829cb6640 1 -- 172.21.15.63:0/1948752647 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561926447da0 con 0x561925fdd9f0 2024-09-21T06:28:54.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.909+0000 7fc82a4b7640 1 --2- 172.21.15.63:0/1948752647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561925ffe390 0x561926447760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:54.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.909+0000 7fc8294b5640 1 --2- 172.21.15.63:0/1948752647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ff61b0 0x5619263d6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:54.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.909+0000 7fc829cb6640 1 --2- 172.21.15.63:0/1948752647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561925fdd9f0 0x5619263d6590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x5619263c4bc0 tx=0x7fc8200276e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bf3e16660d906a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:54.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.909+0000 7fc80d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:28:54.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.910+0000 7fc80d7fa640 1 -- 172.21.15.63:0/1948752647 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820034050 con 0x561925fdd9f0 2024-09-21T06:28:54.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.910+0000 7fc80d7fa640 1 -- 172.21.15.63:0/1948752647 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fc82002c020 con 0x561925fdd9f0 2024-09-21T06:28:54.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.910+0000 7fc83248e740 1 -- 172.21.15.63:0/1948752647 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc81c0ad380 con 0x561925fdd9f0 2024-09-21T06:28:54.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.910+0000 7fc80d7fa640 1 -- 172.21.15.63:0/1948752647 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc82001ce50 con 0x561925fdd9f0 2024-09-21T06:28:54.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.910+0000 7fc83248e740 10 client.25316 fetch_fsmap learned FSMap version 29 2024-09-21T06:28:54.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.910+0000 7fc83248e740 1 -- 172.21.15.63:0/1948752647 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56192644f0e0 con 0x561925fdd9f0 2024-09-21T06:28:54.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.910+0000 7fc80d7fa640 1 -- 172.21.15.63:0/1948752647 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc82003e070 con 0x561925fdd9f0 2024-09-21T06:28:54.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.911+0000 7fc80d7fa640 1 -- 172.21.15.63:0/1948752647 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc820003ad0 con 0x561925fdd9f0 2024-09-21T06:28:54.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.911+0000 7fc83248e740 10 client.25316 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:28:54.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.911+0000 7fc83248e740 10 client.25316 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:54.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.911+0000 7fc83248e740 20 client.25316 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:54.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.911+0000 7fc83248e740 1 --2- 172.21.15.63:0/1948752647 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x56192601f070 0x561926451830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.911+0000 7fc83248e740 4 client.25316 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:28:54.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.911+0000 7fc83248e740 1 -- 172.21.15.63:0/1948752647 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fc81c0ad380 con 0x56192601f070 2024-09-21T06:28:54.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.911+0000 7fc8294b5640 1 --2- 172.21.15.63:0/1948752647 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x56192601f070 0x561926451830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.912+0000 7fc80d7fa640 10 client.25316 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:54.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.912+0000 7fc8294b5640 1 --2- 172.21.15.63:0/1948752647 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x56192601f070 0x561926451830 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a97a1af2793a34a server_cookie=a520ebd71435e7b8 in_seq=0 out_seq=0 2024-09-21T06:28:54.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.912+0000 7fc80d7fa640 1 -- 172.21.15.63:0/1948752647 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x7fc81c0ad380 con 0x56192601f070 2024-09-21T06:28:54.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.912+0000 7fc80d7fa640 10 client.25316 handle_command_reply: tid=0 2024-09-21T06:28:54.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.912+0000 7fc83248e740 1 client.25316 shutdown 2024-09-21T06:28:54.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.912+0000 7fc83248e740 1 -- 172.21.15.63:0/1948752647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561925fdd9f0 msgr2=0x5619263d6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:54.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.912+0000 7fc83248e740 1 --2- 172.21.15.63:0/1948752647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561925fdd9f0 0x5619263d6590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x5619263c4bc0 tx=0x7fc8200276e0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.913+0000 7fc83248e740 1 -- 172.21.15.63:0/1948752647 shutdown_connections 2024-09-21T06:28:54.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.913+0000 7fc83248e740 1 --2- 172.21.15.63:0/1948752647 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x56192601f070 0x561926451830 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.913+0000 7fc83248e740 1 --2- 172.21.15.63:0/1948752647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561925ffe390 0x561926447760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.913+0000 7fc83248e740 1 --2- 172.21.15.63:0/1948752647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561925ff61b0 0x5619263d6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.913+0000 7fc83248e740 1 --2- 172.21.15.63:0/1948752647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561925fdd9f0 0x5619263d6590 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.913+0000 7fc83248e740 1 -- 172.21.15.63:0/1948752647 >> 172.21.15.63:0/1948752647 conn(0x561926013460 msgr2=0x5619263dd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:54.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.913+0000 7fc80d7fa640 0 client.25316 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:28:54.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.913+0000 7fc83248e740 1 -- 172.21.15.63:0/1948752647 shutdown_connections 2024-09-21T06:28:54.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.913+0000 7fc83248e740 1 -- 172.21.15.63:0/1948752647 wait complete. 2024-09-21T06:28:54.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.913+0000 7fc83248e740 20 client.25316 trim_cache size 0 max 16384 2024-09-21T06:28:54.931 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:28:54.931 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "no active scrubs running", 2024-09-21T06:28:54.931 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": {}, 2024-09-21T06:28:54.931 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:28:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: "e7881878-4529-4e31-87c4-bfc71bc0cbfc": { 2024-09-21T06:28:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:28:21.722259+0000", 2024-09-21T06:28:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:28:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:28:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:28:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:28:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:28:54.933 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:28:54.933 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:28:54.933 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:28:54.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.914+0000 7fc82bf1a640 1 -- 172.21.15.63:0/3424784260 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc8100bee80 msgr2=0x7fc8100c1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:54.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.914+0000 7fc82bf1a640 1 --2- 172.21.15.63:0/3424784260 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc8100bee80 0x7fc8100c1390 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc820009bd0 tx=0x7fc820005f90 comp rx=0 tx=0).stop 2024-09-21T06:28:54.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.914+0000 7fc82bf1a640 1 -- 172.21.15.63:0/3424784260 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc824108d30 msgr2=0x7fc82419ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:54.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.914+0000 7fc82bf1a640 1 --2- 172.21.15.63:0/3424784260 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc824108d30 0x7fc82419ca00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00eb10 tx=0x7fc81c00c2d0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.914+0000 7fc82bf1a640 1 -- 172.21.15.63:0/3424784260 shutdown_connections 2024-09-21T06:28:54.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.914+0000 7fc82bf1a640 1 --2- 172.21.15.63:0/3424784260 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc824108d30 0x7fc82419ca00 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.914+0000 7fc82bf1a640 1 --2- 172.21.15.63:0/3424784260 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc8100bee80 0x7fc8100c1390 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.914+0000 7fc82bf1a640 1 --2- 172.21.15.63:0/3424784260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8241083e0 0x7fc82410e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.915+0000 7fc82bf1a640 1 --2- 172.21.15.63:0/3424784260 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc824102aa0 0x7fc82410e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.915+0000 7fc82bf1a640 1 -- 172.21.15.63:0/3424784260 >> 172.21.15.63:0/3424784260 conn(0x7fc824079750 msgr2=0x7fc824113970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:54.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.915+0000 7fc82bf1a640 1 -- 172.21.15.63:0/3424784260 shutdown_connections 2024-09-21T06:28:54.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:54.915+0000 7fc82bf1a640 1 -- 172.21.15.63:0/3424784260 wait complete. 2024-09-21T06:28:55.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:54 smithi071 ceph-mon[34844]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T06:28:55.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:54 smithi063 ceph-mon[31150]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T06:28:55.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:54 smithi175 ceph-mon[34510]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T06:28:55.623 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:28:55.623 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:28:55.957 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:56.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.473+0000 7fa056759640 1 -- 172.21.15.63:0/398373159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa050102a60 msgr2=0x7fa050102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:56.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.473+0000 7fa056759640 1 --2- 172.21.15.63:0/398373159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa050102a60 0x7fa050102e70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa040009900 tx=0x7fa04002a410 comp rx=0 tx=0).stop 2024-09-21T06:28:56.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.474+0000 7fa056759640 1 -- 172.21.15.63:0/398373159 shutdown_connections 2024-09-21T06:28:56.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.474+0000 7fa056759640 1 --2- 172.21.15.63:0/398373159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa050108cf0 0x7fa05010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.474+0000 7fa056759640 1 --2- 172.21.15.63:0/398373159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0501083a0 0x7fa0501087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.474+0000 7fa056759640 1 --2- 172.21.15.63:0/398373159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa050102a60 0x7fa050102e70 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.474+0000 7fa056759640 1 -- 172.21.15.63:0/398373159 >> 172.21.15.63:0/398373159 conn(0x7fa050079730 msgr2=0x7fa050079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:56.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.474+0000 7fa056759640 1 -- 172.21.15.63:0/398373159 shutdown_connections 2024-09-21T06:28:56.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.474+0000 7fa056759640 1 -- 172.21.15.63:0/398373159 wait complete. 2024-09-21T06:28:56.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.475+0000 7fa056759640 1 Processor -- start 2024-09-21T06:28:56.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.475+0000 7fa056759640 1 -- start start 2024-09-21T06:28:56.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.475+0000 7fa056759640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa050102a60 0x7fa050104410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.475+0000 7fa056759640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0501083a0 0x7fa050104950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.475+0000 7fa056759640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa050108cf0 0x7fa050104e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.475+0000 7fa056759640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa050112960 con 0x7fa050102a60 2024-09-21T06:28:56.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.475+0000 7fa056759640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa0501127e0 con 0x7fa0501083a0 2024-09-21T06:28:56.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.475+0000 7fa056759640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa050112ae0 con 0x7fa050108cf0 2024-09-21T06:28:56.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.475+0000 7fa04ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa050102a60 0x7fa050104410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:56.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.476+0000 7fa04ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa050102a60 0x7fa050104410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35286/0 (socket says 172.21.15.63:35286) 2024-09-21T06:28:56.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.476+0000 7fa04ffff640 1 -- 172.21.15.63:0/772235767 learned_addr learned my addr 172.21.15.63:0/772235767 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:56.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.476+0000 7fa04f7fe640 1 --2- 172.21.15.63:0/772235767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0501083a0 0x7fa050104950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:56.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.476+0000 7fa054cf6640 1 --2- 172.21.15.63:0/772235767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa050108cf0 0x7fa050104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:56.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.476+0000 7fa04ffff640 1 -- 172.21.15.63:0/772235767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa050108cf0 msgr2=0x7fa050104e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:56.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.476+0000 7fa04ffff640 1 --2- 172.21.15.63:0/772235767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa050108cf0 0x7fa050104e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.476+0000 7fa04ffff640 1 -- 172.21.15.63:0/772235767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0501083a0 msgr2=0x7fa050104950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:56.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.476+0000 7fa04ffff640 1 --2- 172.21.15.63:0/772235767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0501083a0 0x7fa050104950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.476+0000 7fa04ffff640 1 -- 172.21.15.63:0/772235767 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0501a8720 con 0x7fa050102a60 2024-09-21T06:28:56.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.476+0000 7fa04ffff640 1 --2- 172.21.15.63:0/772235767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa050102a60 0x7fa050104410 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa040005940 tx=0x7fa040004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:56.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.477+0000 7fa04d7fa640 1 -- 172.21.15.63:0/772235767 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04003f030 con 0x7fa050102a60 2024-09-21T06:28:56.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.477+0000 7fa056759640 1 -- 172.21.15.63:0/772235767 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0501a89b0 con 0x7fa050102a60 2024-09-21T06:28:56.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.477+0000 7fa04d7fa640 1 -- 172.21.15.63:0/772235767 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa040003aa0 con 0x7fa050102a60 2024-09-21T06:28:56.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.477+0000 7fa04d7fa640 1 -- 172.21.15.63:0/772235767 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa040035070 con 0x7fa050102a60 2024-09-21T06:28:56.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.477+0000 7fa056759640 1 -- 172.21.15.63:0/772235767 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0501a8ee0 con 0x7fa050102a60 2024-09-21T06:28:56.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.478+0000 7fa056759640 1 -- 172.21.15.63:0/772235767 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa050102e70 con 0x7fa050102a60 2024-09-21T06:28:56.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.481+0000 7fa04d7fa640 1 -- 172.21.15.63:0/772235767 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 24) ==== 154586+0+0 (secure 0 0 0) 0x7fa040042030 con 0x7fa050102a60 2024-09-21T06:28:56.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.482+0000 7fa04d7fa640 1 --2- 172.21.15.63:0/772235767 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa0380b6670 0x7fa0380b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.482+0000 7fa04f7fe640 1 --2- 172.21.15.63:0/772235767 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa0380b6670 0x7fa0380b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:56.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.482+0000 7fa04d7fa640 1 -- 172.21.15.63:0/772235767 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fa040107ed0 con 0x7fa050102a60 2024-09-21T06:28:56.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.483+0000 7fa04f7fe640 1 --2- 172.21.15.63:0/772235767 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa0380b6670 0x7fa0380b8b80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa050100c50 tx=0x7fa044005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:56.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.484+0000 7fa04d7fa640 1 -- 172.21.15.63:0/772235767 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa0400d2900 con 0x7fa050102a60 2024-09-21T06:28:56.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.844+0000 7fa056759640 1 -- 172.21.15.63:0/772235767 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa050105710 con 0x7fa050102a60 2024-09-21T06:28:56.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.845+0000 7fa04d7fa640 1 -- 172.21.15.63:0/772235767 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11969 (secure 0 0 0) 0x7fa050105710 con 0x7fa050102a60 2024-09-21T06:28:56.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:28:56.848 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"btime":"2024-09-21T06:28:13:055252+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:28:12.568978+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24698,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24698":{"gid":24698,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3472481253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3472481253},{"type":"v1","addr":"172.21.15.71:6839","nonce":3472481253}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24698,"qdb_cluster":[24698,24694,24670,24676,14835]},"id":1}]} 2024-09-21T06:28:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 29 2024-09-21T06:28:56.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.849+0000 7fa056759640 1 -- 172.21.15.63:0/772235767 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa0380b6670 msgr2=0x7fa0380b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:56.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.849+0000 7fa056759640 1 --2- 172.21.15.63:0/772235767 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa0380b6670 0x7fa0380b8b80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa050100c50 tx=0x7fa044005f90 comp rx=0 tx=0).stop 2024-09-21T06:28:56.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.849+0000 7fa056759640 1 -- 172.21.15.63:0/772235767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa050102a60 msgr2=0x7fa050104410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:56.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.849+0000 7fa056759640 1 --2- 172.21.15.63:0/772235767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa050102a60 0x7fa050104410 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa040005940 tx=0x7fa040004270 comp rx=0 tx=0).stop 2024-09-21T06:28:56.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.849+0000 7fa056759640 1 -- 172.21.15.63:0/772235767 shutdown_connections 2024-09-21T06:28:56.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.849+0000 7fa056759640 1 --2- 172.21.15.63:0/772235767 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa0380b6670 0x7fa0380b8b80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.849+0000 7fa056759640 1 --2- 172.21.15.63:0/772235767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa050108cf0 0x7fa050104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.849+0000 7fa056759640 1 --2- 172.21.15.63:0/772235767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0501083a0 0x7fa050104950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.849+0000 7fa056759640 1 --2- 172.21.15.63:0/772235767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa050102a60 0x7fa050104410 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.849+0000 7fa056759640 1 -- 172.21.15.63:0/772235767 >> 172.21.15.63:0/772235767 conn(0x7fa050079730 msgr2=0x7fa050106740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:56.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.849+0000 7fa056759640 1 -- 172.21.15.63:0/772235767 shutdown_connections 2024-09-21T06:28:56.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:56.849+0000 7fa056759640 1 -- 172.21.15.63:0/772235767 wait complete. 2024-09-21T06:28:57.172 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:56 smithi063 ceph-mon[31150]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T06:28:57.172 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:56 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/772235767' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:57.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:56 smithi071 ceph-mon[34844]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T06:28:57.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:56 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/772235767' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:57.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:56 smithi175 ceph-mon[34510]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T06:28:57.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:56 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/772235767' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:57.492 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T06:28:57.839 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:58.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.389+0000 7ff5a7e8a640 1 -- 172.21.15.63:0/3790521007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5a01021f0 msgr2=0x7ff5a0102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:58.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.389+0000 7ff5a7e8a640 1 --2- 172.21.15.63:0/3790521007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5a01021f0 0x7ff5a0102600 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00aa10 tx=0x7ff59c02b720 comp rx=0 tx=0).stop 2024-09-21T06:28:58.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.389+0000 7ff5a7e8a640 1 -- 172.21.15.63:0/3790521007 shutdown_connections 2024-09-21T06:28:58.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.389+0000 7ff5a7e8a640 1 --2- 172.21.15.63:0/3790521007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5a0108480 0x7ff5a010ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.389+0000 7ff5a7e8a640 1 --2- 172.21.15.63:0/3790521007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a0107b30 0x7ff5a0107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.390+0000 7ff5a7e8a640 1 --2- 172.21.15.63:0/3790521007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5a01021f0 0x7ff5a0102600 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.390+0000 7ff5a7e8a640 1 -- 172.21.15.63:0/3790521007 >> 172.21.15.63:0/3790521007 conn(0x7ff5a0077c60 msgr2=0x7ff5a00780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:58.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.390+0000 7ff5a7e8a640 1 -- 172.21.15.63:0/3790521007 shutdown_connections 2024-09-21T06:28:58.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.390+0000 7ff5a7e8a640 1 -- 172.21.15.63:0/3790521007 wait complete. 2024-09-21T06:28:58.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.391+0000 7ff5a7e8a640 1 Processor -- start 2024-09-21T06:28:58.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.391+0000 7ff5a7e8a640 1 -- start start 2024-09-21T06:28:58.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.391+0000 7ff5a7e8a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a01021f0 0x7ff5a019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.391+0000 7ff5a7e8a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5a0107b30 0x7ff5a019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.392+0000 7ff5a7e8a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5a0108480 0x7ff5a019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.392+0000 7ff5a7e8a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a01118c0 con 0x7ff5a0107b30 2024-09-21T06:28:58.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.392+0000 7ff5a7e8a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a0111740 con 0x7ff5a0108480 2024-09-21T06:28:58.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.392+0000 7ff5a7e8a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a0111a40 con 0x7ff5a01021f0 2024-09-21T06:28:58.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.392+0000 7ff5a5425640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5a0107b30 0x7ff5a019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.392+0000 7ff5a5425640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5a0107b30 0x7ff5a019aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35308/0 (socket says 172.21.15.63:35308) 2024-09-21T06:28:58.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.392+0000 7ff5a5425640 1 -- 172.21.15.63:0/1008497532 learned_addr learned my addr 172.21.15.63:0/1008497532 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:58.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.392+0000 7ff5a5c26640 1 --2- 172.21.15.63:0/1008497532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a01021f0 0x7ff5a019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.392+0000 7ff5a5425640 1 -- 172.21.15.63:0/1008497532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a01021f0 msgr2=0x7ff5a019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:58.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.392+0000 7ff5a5425640 1 --2- 172.21.15.63:0/1008497532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a01021f0 0x7ff5a019a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.392+0000 7ff5a5425640 1 -- 172.21.15.63:0/1008497532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5a0108480 msgr2=0x7ff5a019fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:58.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.392+0000 7ff5a5425640 1 --2- 172.21.15.63:0/1008497532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5a0108480 0x7ff5a019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.392+0000 7ff5a5425640 1 -- 172.21.15.63:0/1008497532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a01a0420 con 0x7ff5a0107b30 2024-09-21T06:28:58.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.392+0000 7ff5a5425640 1 --2- 172.21.15.63:0/1008497532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5a0107b30 0x7ff5a019aa50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff59000d950 tx=0x7ff59000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:58.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.393+0000 7ff596ffd640 1 -- 172.21.15.63:0/1008497532 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff590017070 con 0x7ff5a0107b30 2024-09-21T06:28:58.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.393+0000 7ff596ffd640 1 -- 172.21.15.63:0/1008497532 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff590009c30 con 0x7ff5a0107b30 2024-09-21T06:28:58.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.393+0000 7ff596ffd640 1 -- 172.21.15.63:0/1008497532 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff590003d00 con 0x7ff5a0107b30 2024-09-21T06:28:58.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.393+0000 7ff5a7e8a640 1 -- 172.21.15.63:0/1008497532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a01a0710 con 0x7ff5a0107b30 2024-09-21T06:28:58.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.393+0000 7ff5a7e8a640 1 -- 172.21.15.63:0/1008497532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a00fecc0 con 0x7ff5a0107b30 2024-09-21T06:28:58.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.395+0000 7ff5ae3fe740 1 Processor -- start 2024-09-21T06:28:58.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.396+0000 7ff5ae3fe740 1 -- start start 2024-09-21T06:28:58.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.396+0000 7ff5ae3fe740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56453198f070 0x564531d362c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.396+0000 7ff5ae3fe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645319661b0 0x564531d36800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.396+0000 7ff5ae3fe740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56453196e390 0x564531d36d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.396+0000 7ff5ae3fe740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564531cacea0 con 0x56453198f070 2024-09-21T06:28:58.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.396+0000 7ff5ae3fe740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564531c9c2d0 con 0x56453196e390 2024-09-21T06:28:58.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.396+0000 7ff5ae3fe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564531ca00e0 con 0x5645319661b0 2024-09-21T06:28:58.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.396+0000 7ff5a5c26640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645319661b0 0x564531d36800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.396+0000 7ff5a6427640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56453198f070 0x564531d362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.397+0000 7ff5a5c26640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645319661b0 0x564531d36800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:52548/0 (socket says 172.21.15.63:52548) 2024-09-21T06:28:58.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.397+0000 7ff5a5c26640 1 -- 172.21.15.63:0/4041648385 learned_addr learned my addr 172.21.15.63:0/4041648385 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:58.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.397+0000 7ff5a5c26640 1 -- 172.21.15.63:0/4041648385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56453196e390 msgr2=0x564531d36d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:28:58.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.397+0000 7ff5a5c26640 1 --2- 172.21.15.63:0/4041648385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56453196e390 0x564531d36d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.397+0000 7ff5a5c26640 1 -- 172.21.15.63:0/4041648385 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56453198f070 msgr2=0x564531d362c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:58.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.397+0000 7ff5a5c26640 1 --2- 172.21.15.63:0/4041648385 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56453198f070 0x564531d362c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.397+0000 7ff5a5c26640 1 -- 172.21.15.63:0/4041648385 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645319fa650 con 0x5645319661b0 2024-09-21T06:28:58.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.398+0000 7ff5a5c26640 1 --2- 172.21.15.63:0/4041648385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645319661b0 0x564531d36800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00aa10 tx=0x7ff59c030d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f276375f9485aaf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:58.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.398+0000 7ff58bfff640 1 -- 172.21.15.63:0/4041648385 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59c036040 con 0x5645319661b0 2024-09-21T06:28:58.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.398+0000 7ff58bfff640 1 -- 172.21.15.63:0/4041648385 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff59c030eb0 con 0x5645319661b0 2024-09-21T06:28:58.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.398+0000 7ff58bfff640 1 -- 172.21.15.63:0/4041648385 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59c005500 con 0x5645319661b0 2024-09-21T06:28:58.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.398+0000 7ff596ffd640 1 -- 172.21.15.63:0/1008497532 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 24) ==== 154586+0+0 (secure 0 0 0) 0x7ff590003ea0 con 0x7ff5a0107b30 2024-09-21T06:28:58.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.399+0000 7ff596ffd640 1 --2- 172.21.15.63:0/1008497532 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff58c0b6670 0x7ff58c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.399+0000 7ff596ffd640 1 -- 172.21.15.63:0/1008497532 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ff5900e72d0 con 0x7ff5a0107b30 2024-09-21T06:28:58.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.399+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/4041648385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645319661b0 msgr2=0x564531d36800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:58.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.399+0000 7ff5ae3fe740 1 --2- 172.21.15.63:0/4041648385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645319661b0 0x564531d36800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00aa10 tx=0x7ff59c030d40 comp rx=0 tx=0).stop 2024-09-21T06:28:58.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.399+0000 7ff5a6427640 1 --2- 172.21.15.63:0/1008497532 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff58c0b6670 0x7ff58c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.399+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/4041648385 shutdown_connections 2024-09-21T06:28:58.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.399+0000 7ff5ae3fe740 1 --2- 172.21.15.63:0/4041648385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56453196e390 0x564531d36d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.399+0000 7ff5ae3fe740 1 --2- 172.21.15.63:0/4041648385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645319661b0 0x564531d36800 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.399+0000 7ff5ae3fe740 1 --2- 172.21.15.63:0/4041648385 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56453198f070 0x564531d362c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.400+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/4041648385 >> 172.21.15.63:0/4041648385 conn(0x564531983460 msgr2=0x564531d341b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:58.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.400+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/4041648385 shutdown_connections 2024-09-21T06:28:58.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.400+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/4041648385 wait complete. 2024-09-21T06:28:58.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.400+0000 7ff5a6427640 1 --2- 172.21.15.63:0/1008497532 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff58c0b6670 0x7ff58c0b8b80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff598005fd0 tx=0x7ff5980098e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:58.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.400+0000 7ff5ae3fe740 1 -- start start 2024-09-21T06:28:58.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.401+0000 7ff5ae3fe740 1 Processor -- start 2024-09-21T06:28:58.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.401+0000 7ff5ae3fe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645319661b0 0x564531d419f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.401+0000 7ff5ae3fe740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56453196e390 0x564531d41f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.401+0000 7ff5ae3fe740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56453198f070 0x564531d4dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.402+0000 7ff5a6427640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56453198f070 0x564531d4dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.402+0000 7ff5a5425640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56453196e390 0x564531d41f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.402+0000 7ff5a6427640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56453198f070 0x564531d4dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35326/0 (socket says 172.21.15.63:35326) 2024-09-21T06:28:58.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.402+0000 7ff5a5c26640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645319661b0 0x564531d419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.402+0000 7ff5a6427640 1 -- 172.21.15.63:0/3599819863 learned_addr learned my addr 172.21.15.63:0/3599819863 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:58.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.402+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/3599819863 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564531afd700 con 0x56453198f070 2024-09-21T06:28:58.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.402+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/3599819863 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564531c37160 con 0x56453196e390 2024-09-21T06:28:58.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.402+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/3599819863 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564531d44a40 con 0x5645319661b0 2024-09-21T06:28:58.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.402+0000 7ff5a5c26640 1 -- 172.21.15.63:0/3599819863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56453196e390 msgr2=0x564531d41f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:58.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.402+0000 7ff5a5c26640 1 --2- 172.21.15.63:0/3599819863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56453196e390 0x564531d41f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.402+0000 7ff5a5c26640 1 -- 172.21.15.63:0/3599819863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56453198f070 msgr2=0x564531d4dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:58.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.402+0000 7ff5a5c26640 1 --2- 172.21.15.63:0/3599819863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56453198f070 0x564531d4dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.402+0000 7ff5a5c26640 1 -- 172.21.15.63:0/3599819863 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564531c64c90 con 0x5645319661b0 2024-09-21T06:28:58.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.402+0000 7ff5a6427640 1 --2- 172.21.15.63:0/3599819863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56453198f070 0x564531d4dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:58.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.403+0000 7ff5ae3fe740 10 client.0 _ll_register_callbacks cb 0x564531c509e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:58.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.403+0000 7ff5a5c26640 1 --2- 172.21.15.63:0/3599819863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645319661b0 0x564531d419f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff59c006010 tx=0x7ff59c0050e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64fc20fa35c32618 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:58.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.403+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/3599819863 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564531caedf0 con 0x5645319661b0 2024-09-21T06:28:58.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.403+0000 7ff5897fa640 10 client.25360 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:28:58.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.403+0000 7ff5897fa640 1 -- 172.21.15.63:0/3599819863 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59c04b070 con 0x5645319661b0 2024-09-21T06:28:58.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.403+0000 7ff5897fa640 1 -- 172.21.15.63:0/3599819863 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ff59c0307b0 con 0x5645319661b0 2024-09-21T06:28:58.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.403+0000 7ff5897fa640 1 -- 172.21.15.63:0/3599819863 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff59c036030 con 0x5645319661b0 2024-09-21T06:28:58.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.403+0000 7ff5ae3fe740 10 client.25360 fetch_fsmap learned FSMap version 29 2024-09-21T06:28:58.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.403+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/3599819863 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=29}) -- 0x564531d50360 con 0x5645319661b0 2024-09-21T06:28:58.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.404+0000 7ff5897fa640 1 -- 172.21.15.63:0/3599819863 <== mon.1 v2:172.21.15.175:3300/0 4 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff59c04e020 con 0x5645319661b0 2024-09-21T06:28:58.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.404+0000 7ff5ae3fe740 10 client.25360 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:28:58.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.404+0000 7ff5ae3fe740 10 client.25360 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:28:58.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.404+0000 7ff5ae3fe740 20 client.25360 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:58.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.404+0000 7ff5ae3fe740 1 --2- 172.21.15.63:0/3599819863 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x56453194d9f0 0x564531d53c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.404+0000 7ff5ae3fe740 4 client.25360 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:58.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.404+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/3599819863 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564531caa8a0 con 0x56453194d9f0 2024-09-21T06:28:58.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.404+0000 7ff5a5425640 1 --2- 172.21.15.63:0/3599819863 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x56453194d9f0 0x564531d53c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.405+0000 7ff5a5425640 1 --2- 172.21.15.63:0/3599819863 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x56453194d9f0 0x564531d53c90 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f88ec74be9455110 server_cookie=a2de4299d056811f in_seq=0 out_seq=0 2024-09-21T06:28:58.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.405+0000 7ff5897fa640 10 client.25360 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:28:58.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.406+0000 7ff5897fa640 1 -- 172.21.15.63:0/3599819863 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564531caa8a0 con 0x56453194d9f0 2024-09-21T06:28:58.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.406+0000 7ff5897fa640 10 client.25360 handle_command_reply: tid=0 2024-09-21T06:28:58.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.406+0000 7ff5ae3fe740 1 client.25360 shutdown 2024-09-21T06:28:58.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.406+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/3599819863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645319661b0 msgr2=0x564531d419f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:58.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.406+0000 7ff5ae3fe740 1 --2- 172.21.15.63:0/3599819863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645319661b0 0x564531d419f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff59c006010 tx=0x7ff59c0050e0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.406+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/3599819863 shutdown_connections 2024-09-21T06:28:58.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.406+0000 7ff5ae3fe740 1 --2- 172.21.15.63:0/3599819863 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x56453194d9f0 0x564531d53c90 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.407+0000 7ff5ae3fe740 1 --2- 172.21.15.63:0/3599819863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56453198f070 0x564531d4dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.407+0000 7ff5ae3fe740 1 --2- 172.21.15.63:0/3599819863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56453196e390 0x564531d41f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.407+0000 7ff5897fa640 0 client.25360 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:28:58.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.407+0000 7ff5ae3fe740 1 --2- 172.21.15.63:0/3599819863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645319661b0 0x564531d419f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.407+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/3599819863 >> 172.21.15.63:0/3599819863 conn(0x564531983460 msgr2=0x564531d394a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:58.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.407+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/3599819863 shutdown_connections 2024-09-21T06:28:58.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.407+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/3599819863 wait complete. 2024-09-21T06:28:58.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.407+0000 7ff5ae3fe740 20 client.25360 trim_cache size 0 max 16384 2024-09-21T06:28:58.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.420+0000 7ff5ae3fe740 1 Processor -- start 2024-09-21T06:28:58.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.420+0000 7ff5ae3fe740 1 -- start start 2024-09-21T06:28:58.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.421+0000 7ff5ae3fe740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56453194d9f0 0x564531d37a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.421+0000 7ff5ae3fe740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5645319661b0 0x564531d33760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.421+0000 7ff5ae3fe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56453196e390 0x564531d33ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.421+0000 7ff5ae3fe740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a01ad4b0 con 0x5645319661b0 2024-09-21T06:28:58.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.421+0000 7ff5ae3fe740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a01aeff0 con 0x56453194d9f0 2024-09-21T06:28:58.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.421+0000 7ff5ae3fe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a01adb80 con 0x56453196e390 2024-09-21T06:28:58.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.421+0000 7ff5a5425640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5645319661b0 0x564531d33760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.421+0000 7ff5a5c26640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56453194d9f0 0x564531d37a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.421+0000 7ff5a5425640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5645319661b0 0x564531d33760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35328/0 (socket says 172.21.15.63:35328) 2024-09-21T06:28:58.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.421+0000 7ff5a5425640 1 -- 172.21.15.63:0/818948893 learned_addr learned my addr 172.21.15.63:0/818948893 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:58.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.421+0000 7ff5a6427640 1 --2- 172.21.15.63:0/818948893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56453196e390 0x564531d33ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.421+0000 7ff5a5425640 1 -- 172.21.15.63:0/818948893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56453196e390 msgr2=0x564531d33ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:58.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.421+0000 7ff5a5425640 1 --2- 172.21.15.63:0/818948893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56453196e390 0x564531d33ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.421+0000 7ff5a5425640 1 -- 172.21.15.63:0/818948893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56453194d9f0 msgr2=0x564531d37a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:58.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.421+0000 7ff5a5425640 1 --2- 172.21.15.63:0/818948893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56453194d9f0 0x564531d37a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.421+0000 7ff5a5425640 1 -- 172.21.15.63:0/818948893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564531d42cb0 con 0x5645319661b0 2024-09-21T06:28:58.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.421+0000 7ff5a6427640 1 --2- 172.21.15.63:0/818948893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56453196e390 0x564531d33ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:58.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.422+0000 7ff5a5425640 1 --2- 172.21.15.63:0/818948893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5645319661b0 0x564531d33760 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff5900acf20 tx=0x7ff590003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919ca9ca422e14f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:58.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.422+0000 7ff58b7fe640 1 -- 172.21.15.63:0/818948893 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5900d4070 con 0x5645319661b0 2024-09-21T06:28:58.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.422+0000 7ff58b7fe640 1 -- 172.21.15.63:0/818948893 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5900b6c40 con 0x5645319661b0 2024-09-21T06:28:58.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.422+0000 7ff58b7fe640 1 -- 172.21.15.63:0/818948893 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff590020040 con 0x5645319661b0 2024-09-21T06:28:58.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.423+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/818948893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5645319661b0 msgr2=0x564531d33760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:58.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.423+0000 7ff5ae3fe740 1 --2- 172.21.15.63:0/818948893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5645319661b0 0x564531d33760 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff5900acf20 tx=0x7ff590003680 comp rx=0 tx=0).stop 2024-09-21T06:28:58.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.423+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/818948893 shutdown_connections 2024-09-21T06:28:58.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.423+0000 7ff5ae3fe740 1 --2- 172.21.15.63:0/818948893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56453196e390 0x564531d33ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.423+0000 7ff5ae3fe740 1 --2- 172.21.15.63:0/818948893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5645319661b0 0x564531d33760 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.423+0000 7ff5ae3fe740 1 --2- 172.21.15.63:0/818948893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56453194d9f0 0x564531d37a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.423+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/818948893 >> 172.21.15.63:0/818948893 conn(0x564531983460 msgr2=0x564531d372f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:58.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.423+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/818948893 shutdown_connections 2024-09-21T06:28:58.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.423+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/818948893 wait complete. 2024-09-21T06:28:58.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.423+0000 7ff5ae3fe740 1 -- start start 2024-09-21T06:28:58.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.424+0000 7ff5ae3fe740 1 Processor -- start 2024-09-21T06:28:58.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.424+0000 7ff5ae3fe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56453194d9f0 0x564531d457d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.424+0000 7ff5ae3fe740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5645319661b0 0x564531d45d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.424+0000 7ff5ae3fe740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56453196e390 0x564531db6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.424+0000 7ff5ae3fe740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a01ae920 con 0x5645319661b0 2024-09-21T06:28:58.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.424+0000 7ff5ae3fe740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a01ae250 con 0x56453196e390 2024-09-21T06:28:58.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.424+0000 7ff5ae3fe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a01ab490 con 0x56453194d9f0 2024-09-21T06:28:58.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.424+0000 7ff5ae3fe740 10 client.0 _ll_register_callbacks cb 0x7ff59c030c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:58.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.424+0000 7ff5a5425640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5645319661b0 0x564531d45d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.424+0000 7ff5a5425640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5645319661b0 0x564531d45d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35334/0 (socket says 172.21.15.63:35334) 2024-09-21T06:28:58.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.424+0000 7ff5a5425640 1 -- 172.21.15.63:0/812831545 learned_addr learned my addr 172.21.15.63:0/812831545 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:58.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.424+0000 7ff5a5c26640 1 --2- 172.21.15.63:0/812831545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56453194d9f0 0x564531d457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.425+0000 7ff5a6427640 1 --2- 172.21.15.63:0/812831545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56453196e390 0x564531db6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.425+0000 7ff5a5425640 1 -- 172.21.15.63:0/812831545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56453194d9f0 msgr2=0x564531d457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:58.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.425+0000 7ff5a5425640 1 --2- 172.21.15.63:0/812831545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56453194d9f0 0x564531d457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.425+0000 7ff5a5425640 1 -- 172.21.15.63:0/812831545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56453196e390 msgr2=0x564531db6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:58.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.425+0000 7ff5a5425640 1 --2- 172.21.15.63:0/812831545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56453196e390 0x564531db6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.425+0000 7ff5a5425640 1 -- 172.21.15.63:0/812831545 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564531db6da0 con 0x5645319661b0 2024-09-21T06:28:58.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.425+0000 7ff5a5c26640 1 --2- 172.21.15.63:0/812831545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56453194d9f0 0x564531d457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:58.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.425+0000 7ff5a5425640 1 --2- 172.21.15.63:0/812831545 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5645319661b0 0x564531d45d70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff5900ad160 tx=0x7ff5900b1dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d8866e2b6385ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:58.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.425+0000 7ff5897fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:28:58.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.425+0000 7ff5897fa640 1 -- 172.21.15.63:0/812831545 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff590020040 con 0x5645319661b0 2024-09-21T06:28:58.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.425+0000 7ff5897fa640 1 -- 172.21.15.63:0/812831545 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ff5900d0ba0 con 0x5645319661b0 2024-09-21T06:28:58.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.425+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/812831545 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5900b6c40 con 0x5645319661b0 2024-09-21T06:28:58.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.426+0000 7ff5897fa640 1 -- 172.21.15.63:0/812831545 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff5900d4040 con 0x5645319661b0 2024-09-21T06:28:58.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.426+0000 7ff5ae3fe740 10 client.15639 fetch_fsmap learned FSMap version 29 2024-09-21T06:28:58.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.426+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/812831545 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564531dbe190 con 0x5645319661b0 2024-09-21T06:28:58.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.426+0000 7ff5897fa640 1 -- 172.21.15.63:0/812831545 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff590004390 con 0x5645319661b0 2024-09-21T06:28:58.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.426+0000 7ff5897fa640 1 -- 172.21.15.63:0/812831545 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff5900a8b70 con 0x5645319661b0 2024-09-21T06:28:58.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.426+0000 7ff5ae3fe740 10 client.15639 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:28:58.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.426+0000 7ff5ae3fe740 10 client.15639 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:28:58.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.426+0000 7ff5ae3fe740 20 client.15639 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:58.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.426+0000 7ff5ae3fe740 1 --2- 172.21.15.63:0/812831545 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x56453198f070 0x564531dc0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.426+0000 7ff5ae3fe740 4 client.15639 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:28:58.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.426+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/812831545 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff5900b6c40 con 0x56453198f070 2024-09-21T06:28:58.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.426+0000 7ff5a5c26640 1 --2- 172.21.15.63:0/812831545 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x56453198f070 0x564531dc0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.427+0000 7ff5a5c26640 1 --2- 172.21.15.63:0/812831545 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x56453198f070 0x564531dc0870 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=df51bfa8e2b85769 server_cookie=ccf312a3a0d02ee in_seq=0 out_seq=0 2024-09-21T06:28:58.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.427+0000 7ff5897fa640 10 client.15639 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:28:58.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.428+0000 7ff5897fa640 1 -- 172.21.15.63:0/812831545 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff5900b6c40 con 0x56453198f070 2024-09-21T06:28:58.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.428+0000 7ff5897fa640 10 client.15639 handle_command_reply: tid=0 2024-09-21T06:28:58.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.428+0000 7ff5ae3fe740 1 client.15639 shutdown 2024-09-21T06:28:58.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.428+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/812831545 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5645319661b0 msgr2=0x564531d45d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:58.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.428+0000 7ff5ae3fe740 1 --2- 172.21.15.63:0/812831545 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5645319661b0 0x564531d45d70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff5900ad160 tx=0x7ff5900b1dc0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.429+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/812831545 shutdown_connections 2024-09-21T06:28:58.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.429+0000 7ff5ae3fe740 1 --2- 172.21.15.63:0/812831545 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x56453198f070 0x564531dc0870 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.429+0000 7ff5ae3fe740 1 --2- 172.21.15.63:0/812831545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56453196e390 0x564531db6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.429+0000 7ff5ae3fe740 1 --2- 172.21.15.63:0/812831545 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5645319661b0 0x564531d45d70 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.429+0000 7ff5ae3fe740 1 --2- 172.21.15.63:0/812831545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56453194d9f0 0x564531d457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.429+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/812831545 >> 172.21.15.63:0/812831545 conn(0x564531983460 msgr2=0x564531d3b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:58.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.429+0000 7ff5897fa640 0 client.15639 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:28:58.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.429+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/812831545 shutdown_connections 2024-09-21T06:28:58.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.429+0000 7ff5ae3fe740 1 -- 172.21.15.63:0/812831545 wait complete. 2024-09-21T06:28:58.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.429+0000 7ff5ae3fe740 20 client.15639 trim_cache size 0 max 16384 2024-09-21T06:28:58.434 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:28:58.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.430+0000 7ff5a7e8a640 1 -- 172.21.15.63:0/1008497532 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff58c0b6670 msgr2=0x7ff58c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:58.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.430+0000 7ff5a7e8a640 1 --2- 172.21.15.63:0/1008497532 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff58c0b6670 0x7ff58c0b8b80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff598005fd0 tx=0x7ff5980098e0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.430+0000 7ff5a7e8a640 1 -- 172.21.15.63:0/1008497532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5a0107b30 msgr2=0x7ff5a019aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:58.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.430+0000 7ff5a7e8a640 1 --2- 172.21.15.63:0/1008497532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5a0107b30 0x7ff5a019aa50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff59000d950 tx=0x7ff59000de10 comp rx=0 tx=0).stop 2024-09-21T06:28:58.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.430+0000 7ff5a7e8a640 1 -- 172.21.15.63:0/1008497532 shutdown_connections 2024-09-21T06:28:58.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.430+0000 7ff5a7e8a640 1 --2- 172.21.15.63:0/1008497532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5a0108480 0x7ff5a019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.430+0000 7ff5a7e8a640 1 --2- 172.21.15.63:0/1008497532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5a0107b30 0x7ff5a019aa50 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.430+0000 7ff5a7e8a640 1 --2- 172.21.15.63:0/1008497532 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff58c0b6670 0x7ff58c0b8b80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.430+0000 7ff5a7e8a640 1 --2- 172.21.15.63:0/1008497532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a01021f0 0x7ff5a019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.430+0000 7ff5a7e8a640 1 -- 172.21.15.63:0/1008497532 >> 172.21.15.63:0/1008497532 conn(0x7ff5a0077c60 msgr2=0x7ff5a0105dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:58.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.430+0000 7ff5a7e8a640 1 -- 172.21.15.63:0/1008497532 shutdown_connections 2024-09-21T06:28:58.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:58.430+0000 7ff5a7e8a640 1 -- 172.21.15.63:0/1008497532 wait complete. 2024-09-21T06:28:59.127 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T06:28:59.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:28:58 smithi071 ceph-mon[34844]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:28:59.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:28:58 smithi063 ceph-mon[31150]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:28:59.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:28:58 smithi175 ceph-mon[34510]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:28:59.397 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:59.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.943+0000 7f593506b640 1 -- 172.21.15.63:0/2440458081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5930105270 msgr2=0x7f593010d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:59.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.943+0000 7f593506b640 1 --2- 172.21.15.63:0/2440458081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5930105270 0x7f593010d8b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5924009900 tx=0x7f592402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:59.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.943+0000 7f593506b640 1 -- 172.21.15.63:0/2440458081 shutdown_connections 2024-09-21T06:28:59.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.943+0000 7f593506b640 1 --2- 172.21.15.63:0/2440458081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f593010ddf0 0x7f5930110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.943+0000 7f593506b640 1 --2- 172.21.15.63:0/2440458081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5930105270 0x7f593010d8b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.943+0000 7f593506b640 1 --2- 172.21.15.63:0/2440458081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5930104840 0x7f5930104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.943+0000 7f593506b640 1 -- 172.21.15.63:0/2440458081 >> 172.21.15.63:0/2440458081 conn(0x7f5930079730 msgr2=0x7f5930079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:59.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.943+0000 7f593506b640 1 -- 172.21.15.63:0/2440458081 shutdown_connections 2024-09-21T06:28:59.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.943+0000 7f593506b640 1 -- 172.21.15.63:0/2440458081 wait complete. 2024-09-21T06:28:59.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.944+0000 7f593506b640 1 Processor -- start 2024-09-21T06:28:59.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.945+0000 7f593506b640 1 -- start start 2024-09-21T06:28:59.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.945+0000 7f593506b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5930104840 0x7f593019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:59.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.945+0000 7f593506b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5930105270 0x7f593019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:59.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.945+0000 7f593506b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f593010ddf0 0x7f593019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:59.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.945+0000 7f593506b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5930113a70 con 0x7f5930105270 2024-09-21T06:28:59.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.945+0000 7f593506b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f59301138f0 con 0x7f593010ddf0 2024-09-21T06:28:59.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.945+0000 7f593506b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5930113bf0 con 0x7f5930104840 2024-09-21T06:28:59.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.945+0000 7f592f59e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f593010ddf0 0x7f593019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:59.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.945+0000 7f592e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5930105270 0x7f593019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:59.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.945+0000 7f592f59e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f593010ddf0 0x7f593019fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:40936/0 (socket says 172.21.15.63:40936) 2024-09-21T06:28:59.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.945+0000 7f592f59e640 1 -- 172.21.15.63:0/2713125839 learned_addr learned my addr 172.21.15.63:0/2713125839 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:59.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.945+0000 7f592ed9d640 1 --2- 172.21.15.63:0/2713125839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5930104840 0x7f593019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.946+0000 7f592f59e640 1 -- 172.21.15.63:0/2713125839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5930104840 msgr2=0x7f593019a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.946+0000 7f592f59e640 1 --2- 172.21.15.63:0/2713125839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5930104840 0x7f593019a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.946+0000 7f592f59e640 1 -- 172.21.15.63:0/2713125839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5930105270 msgr2=0x7f593019aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.946+0000 7f592f59e640 1 --2- 172.21.15.63:0/2713125839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5930105270 0x7f593019aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.946+0000 7f592f59e640 1 -- 172.21.15.63:0/2713125839 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59301a0490 con 0x7f593010ddf0 2024-09-21T06:28:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.946+0000 7f592f59e640 1 --2- 172.21.15.63:0/2713125839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f593010ddf0 0x7f593019fd60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f592800eb10 tx=0x7f592800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.946+0000 7f5917fff640 1 -- 172.21.15.63:0/2713125839 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5928004b20 con 0x7f593010ddf0 2024-09-21T06:28:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.946+0000 7f593506b640 1 -- 172.21.15.63:0/2713125839 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59301a0780 con 0x7f593010ddf0 2024-09-21T06:28:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.946+0000 7f5917fff640 1 -- 172.21.15.63:0/2713125839 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5928004cc0 con 0x7f593010ddf0 2024-09-21T06:28:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.946+0000 7f5917fff640 1 -- 172.21.15.63:0/2713125839 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5928010670 con 0x7f593010ddf0 2024-09-21T06:28:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.947+0000 7f593506b640 1 -- 172.21.15.63:0/2713125839 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5930102630 con 0x7f593010ddf0 2024-09-21T06:28:59.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.950+0000 7f593b5df740 1 Processor -- start 2024-09-21T06:28:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.950+0000 7f5917fff640 1 -- 172.21.15.63:0/2713125839 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 24) ==== 154586+0+0 (secure 0 0 0) 0x7f5928005020 con 0x7f593010ddf0 2024-09-21T06:28:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.950+0000 7f593b5df740 1 -- start start 2024-09-21T06:28:59.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.951+0000 7f593b5df740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220bedd070 0x56220c28ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:59.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.951+0000 7f593b5df740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220beb41b0 0x56220c28d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:59.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.951+0000 7f593b5df740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220bebc390 0x56220c28d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:59.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.951+0000 7f593b5df740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56220c1faea0 con 0x56220bebc390 2024-09-21T06:28:59.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.951+0000 7f593b5df740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56220c1ea2d0 con 0x56220bedd070 2024-09-21T06:28:59.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.951+0000 7f593b5df740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56220c1ee0e0 con 0x56220beb41b0 2024-09-21T06:28:59.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.951+0000 7f592e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220bebc390 0x56220c28d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:59.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.951+0000 7f592e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220bebc390 0x56220c28d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35356/0 (socket says 172.21.15.63:35356) 2024-09-21T06:28:59.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.951+0000 7f592e59c640 1 -- 172.21.15.63:0/2009409691 learned_addr learned my addr 172.21.15.63:0/2009409691 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:59.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.951+0000 7f592ed9d640 1 --2- 172.21.15.63:0/2009409691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220beb41b0 0x56220c28d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:59.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.951+0000 7f592e59c640 1 --2- 172.21.15.63:0/2009409691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220bedd070 0x56220c28ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.952+0000 7f592ed9d640 1 -- 172.21.15.63:0/2009409691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220bedd070 msgr2=0x56220c28ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.952+0000 7f5917fff640 1 --2- 172.21.15.63:0/2713125839 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f59180b6670 0x7f59180b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.952+0000 7f592ed9d640 1 --2- 172.21.15.63:0/2009409691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220bedd070 0x56220c28ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.952+0000 7f592ed9d640 1 -- 172.21.15.63:0/2009409691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220bebc390 msgr2=0x56220c28d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.952+0000 7f592ed9d640 1 --2- 172.21.15.63:0/2009409691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220bebc390 0x56220c28d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.952+0000 7f592ed9d640 1 -- 172.21.15.63:0/2009409691 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56220bf48650 con 0x56220beb41b0 2024-09-21T06:28:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.952+0000 7f592e59c640 1 --2- 172.21.15.63:0/2009409691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220bebc390 0x56220c28d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.952+0000 7f5917fff640 1 -- 172.21.15.63:0/2713125839 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f59280e7ab0 con 0x7f593010ddf0 2024-09-21T06:28:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.952+0000 7f592f59e640 1 --2- 172.21.15.63:0/2713125839 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f59180b6670 0x7f59180b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.953+0000 7f592ed9d640 1 --2- 172.21.15.63:0/2009409691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220beb41b0 0x56220c28d3f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5920009bf0 tx=0x7f5920011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0e8cd37c452c370 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:59.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.953+0000 7f59157fa640 1 -- 172.21.15.63:0/2009409691 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5920009da0 con 0x56220beb41b0 2024-09-21T06:28:59.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.953+0000 7f59157fa640 1 -- 172.21.15.63:0/2009409691 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5920005020 con 0x56220beb41b0 2024-09-21T06:28:59.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.953+0000 7f59157fa640 1 -- 172.21.15.63:0/2009409691 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5920004ad0 con 0x56220beb41b0 2024-09-21T06:28:59.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.953+0000 7f592f59e640 1 --2- 172.21.15.63:0/2713125839 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f59180b6670 0x7f59180b8b80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f59280e5900 tx=0x7f592800cee0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:59.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.954+0000 7f593b5df740 1 -- 172.21.15.63:0/2009409691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220beb41b0 msgr2=0x56220c28d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:59.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.954+0000 7f593b5df740 1 --2- 172.21.15.63:0/2009409691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220beb41b0 0x56220c28d3f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5920009bf0 tx=0x7f5920011810 comp rx=0 tx=0).stop 2024-09-21T06:28:59.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.954+0000 7f593b5df740 1 -- 172.21.15.63:0/2009409691 shutdown_connections 2024-09-21T06:28:59.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.954+0000 7f593b5df740 1 --2- 172.21.15.63:0/2009409691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220bebc390 0x56220c28d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.954+0000 7f593b5df740 1 --2- 172.21.15.63:0/2009409691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220beb41b0 0x56220c28d3f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.954+0000 7f593b5df740 1 --2- 172.21.15.63:0/2009409691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220bedd070 0x56220c28ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.954+0000 7f593b5df740 1 -- 172.21.15.63:0/2009409691 >> 172.21.15.63:0/2009409691 conn(0x56220bed1460 msgr2=0x56220c28ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.954+0000 7f593b5df740 1 -- 172.21.15.63:0/2009409691 shutdown_connections 2024-09-21T06:28:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.954+0000 7f593b5df740 1 -- 172.21.15.63:0/2009409691 wait complete. 2024-09-21T06:28:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.954+0000 7f593b5df740 1 -- start start 2024-09-21T06:28:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.955+0000 7f593b5df740 1 Processor -- start 2024-09-21T06:28:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.955+0000 7f593b5df740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220beb41b0 0x56220c2985f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.955+0000 7f593b5df740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220bebc390 0x56220c298b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.955+0000 7f593b5df740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220bedd070 0x56220c2a49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.955+0000 7f593b5df740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56220c04b700 con 0x56220bebc390 2024-09-21T06:28:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.955+0000 7f593b5df740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56220c185160 con 0x56220beb41b0 2024-09-21T06:28:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.955+0000 7f593b5df740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56220c29b690 con 0x56220bedd070 2024-09-21T06:28:59.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.955+0000 7f592e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220beb41b0 0x56220c2985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:59.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.955+0000 7f592e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220beb41b0 0x56220c2985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:40956/0 (socket says 172.21.15.63:40956) 2024-09-21T06:28:59.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.955+0000 7f592e59c640 1 -- 172.21.15.63:0/1517642102 learned_addr learned my addr 172.21.15.63:0/1517642102 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:59.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.955+0000 7f592ed9d640 1 --2- 172.21.15.63:0/1517642102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220bebc390 0x56220c298b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:59.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.955+0000 7f592e59c640 1 --2- 172.21.15.63:0/1517642102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220bedd070 0x56220c2a49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:59.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.955+0000 7f593b5df740 10 client.0 _ll_register_callbacks cb 0x56220c19e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:59.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.956+0000 7f592e59c640 1 -- 172.21.15.63:0/1517642102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220bedd070 msgr2=0x56220c2a49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:59.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.956+0000 7f592e59c640 1 --2- 172.21.15.63:0/1517642102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220bedd070 0x56220c2a49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.956+0000 7f592e59c640 1 -- 172.21.15.63:0/1517642102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220bebc390 msgr2=0x56220c298b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:59.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.956+0000 7f592e59c640 1 --2- 172.21.15.63:0/1517642102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220bebc390 0x56220c298b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.956+0000 7f592e59c640 1 -- 172.21.15.63:0/1517642102 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56220c1b2c90 con 0x56220beb41b0 2024-09-21T06:28:59.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.956+0000 7f592e59c640 1 --2- 172.21.15.63:0/1517642102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220beb41b0 0x56220c2985f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f592402a930 tx=0x7f5924031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a44e23d4faef104c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:59.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.956+0000 7f5912ff5640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:28:59.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.956+0000 7f5912ff5640 1 -- 172.21.15.63:0/1517642102 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5924041070 con 0x56220beb41b0 2024-09-21T06:28:59.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.956+0000 7f5912ff5640 1 -- 172.21.15.63:0/1517642102 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f5924031bd0 con 0x56220beb41b0 2024-09-21T06:28:59.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.956+0000 7f593b5df740 1 -- 172.21.15.63:0/1517642102 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5920005020 con 0x56220beb41b0 2024-09-21T06:28:59.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.956+0000 7f5912ff5640 1 -- 172.21.15.63:0/1517642102 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5924052050 con 0x56220beb41b0 2024-09-21T06:28:59.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.957+0000 7f593b5df740 10 client.25346 fetch_fsmap learned FSMap version 29 2024-09-21T06:28:59.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.957+0000 7f593b5df740 1 -- 172.21.15.63:0/1517642102 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56220c2a7430 con 0x56220beb41b0 2024-09-21T06:28:59.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.957+0000 7f5912ff5640 1 -- 172.21.15.63:0/1517642102 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5924005040 con 0x56220beb41b0 2024-09-21T06:28:59.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.957+0000 7f5912ff5640 1 -- 172.21.15.63:0/1517642102 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5924004870 con 0x56220beb41b0 2024-09-21T06:28:59.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.957+0000 7f593b5df740 10 client.25346 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:28:59.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.957+0000 7f593b5df740 10 client.25346 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:28:59.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.957+0000 7f593b5df740 20 client.25346 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:59.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.957+0000 7f593b5df740 1 --2- 172.21.15.63:0/1517642102 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56220be9b9f0 0x56220c2aa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:59.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.957+0000 7f593b5df740 4 client.25346 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:59.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.957+0000 7f593b5df740 1 -- 172.21.15.63:0/1517642102 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5920005020 con 0x56220be9b9f0 2024-09-21T06:28:59.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.958+0000 7f592ed9d640 1 --2- 172.21.15.63:0/1517642102 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56220be9b9f0 0x56220c2aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:59.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.958+0000 7f5912ff5640 10 client.25346 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:28:59.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.958+0000 7f592ed9d640 1 --2- 172.21.15.63:0/1517642102 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56220be9b9f0 0x56220c2aa920 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b2d78a9afe3e2671 server_cookie=60ba498b497e56f in_seq=0 out_seq=0 2024-09-21T06:28:59.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.959+0000 7f5912ff5640 1 -- 172.21.15.63:0/1517642102 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f5920005020 con 0x56220be9b9f0 2024-09-21T06:28:59.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.959+0000 7f5912ff5640 10 client.25346 handle_command_reply: tid=0 2024-09-21T06:28:59.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.959+0000 7f593b5df740 1 client.25346 shutdown 2024-09-21T06:28:59.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.959+0000 7f593b5df740 1 -- 172.21.15.63:0/1517642102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220beb41b0 msgr2=0x56220c2985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:59.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.959+0000 7f593b5df740 1 --2- 172.21.15.63:0/1517642102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220beb41b0 0x56220c2985f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f592402a930 tx=0x7f5924031400 comp rx=0 tx=0).stop 2024-09-21T06:28:59.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.959+0000 7f593b5df740 1 -- 172.21.15.63:0/1517642102 shutdown_connections 2024-09-21T06:28:59.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.959+0000 7f593b5df740 1 --2- 172.21.15.63:0/1517642102 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56220be9b9f0 0x56220c2aa920 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.959+0000 7f593b5df740 1 --2- 172.21.15.63:0/1517642102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220bedd070 0x56220c2a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.959+0000 7f593b5df740 1 --2- 172.21.15.63:0/1517642102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220bebc390 0x56220c298b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.959+0000 7f593b5df740 1 --2- 172.21.15.63:0/1517642102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220beb41b0 0x56220c2985f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.959+0000 7f593b5df740 1 -- 172.21.15.63:0/1517642102 >> 172.21.15.63:0/1517642102 conn(0x56220bed1460 msgr2=0x56220c290040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:59.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.959+0000 7f5912ff5640 0 client.25346 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:28:59.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.960+0000 7f593b5df740 1 -- 172.21.15.63:0/1517642102 shutdown_connections 2024-09-21T06:28:59.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.960+0000 7f593b5df740 1 -- 172.21.15.63:0/1517642102 wait complete. 2024-09-21T06:28:59.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.960+0000 7f593b5df740 20 client.25346 trim_cache size 0 max 16384 2024-09-21T06:28:59.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.973+0000 7f593b5df740 1 Processor -- start 2024-09-21T06:28:59.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.973+0000 7f593b5df740 1 -- start start 2024-09-21T06:28:59.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.974+0000 7f593b5df740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220beb41b0 0x56220c298ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:59.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.974+0000 7f593b5df740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220bebc390 0x56220c2a48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:59.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.974+0000 7f593b5df740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220bedd070 0x56220c2957e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:59.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.974+0000 7f593b5df740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f59301ad4e0 con 0x56220beb41b0 2024-09-21T06:28:59.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.974+0000 7f593b5df740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f59301af020 con 0x56220bedd070 2024-09-21T06:28:59.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.974+0000 7f593b5df740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f59301adbb0 con 0x56220bebc390 2024-09-21T06:28:59.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.974+0000 7f592e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220beb41b0 0x56220c298ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:59.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.974+0000 7f592ed9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220bebc390 0x56220c2a48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:59.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.974+0000 7f592ed9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220bebc390 0x56220c2a48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:52642/0 (socket says 172.21.15.63:52642) 2024-09-21T06:28:59.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.974+0000 7f592ed9d640 1 -- 172.21.15.63:0/3444985135 learned_addr learned my addr 172.21.15.63:0/3444985135 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:59.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.975+0000 7f592ed9d640 1 -- 172.21.15.63:0/3444985135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220bedd070 msgr2=0x56220c2957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:59.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.975+0000 7f592ed9d640 1 --2- 172.21.15.63:0/3444985135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220bedd070 0x56220c2957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.975+0000 7f592ed9d640 1 -- 172.21.15.63:0/3444985135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220beb41b0 msgr2=0x56220c298ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:59.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.975+0000 7f592ed9d640 1 --2- 172.21.15.63:0/3444985135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220beb41b0 0x56220c298ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.975+0000 7f592ed9d640 1 -- 172.21.15.63:0/3444985135 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56220c2998b0 con 0x56220bebc390 2024-09-21T06:28:59.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.975+0000 7f592ed9d640 1 --2- 172.21.15.63:0/3444985135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220bebc390 0x56220c2a48b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x56220c28bb30 tx=0x7f5920011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f526c539b425c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:59.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.975+0000 7f5914ff9640 1 -- 172.21.15.63:0/3444985135 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59200052f0 con 0x56220bebc390 2024-09-21T06:28:59.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.975+0000 7f5914ff9640 1 -- 172.21.15.63:0/3444985135 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f592002f020 con 0x56220bebc390 2024-09-21T06:28:59.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.975+0000 7f5914ff9640 1 -- 172.21.15.63:0/3444985135 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5920019450 con 0x56220bebc390 2024-09-21T06:28:59.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.976+0000 7f593b5df740 1 -- 172.21.15.63:0/3444985135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220bebc390 msgr2=0x56220c2a48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:59.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.976+0000 7f593b5df740 1 --2- 172.21.15.63:0/3444985135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220bebc390 0x56220c2a48b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x56220c28bb30 tx=0x7f5920011810 comp rx=0 tx=0).stop 2024-09-21T06:28:59.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.977+0000 7f593b5df740 1 -- 172.21.15.63:0/3444985135 shutdown_connections 2024-09-21T06:28:59.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.977+0000 7f593b5df740 1 --2- 172.21.15.63:0/3444985135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220bedd070 0x56220c2957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.977+0000 7f593b5df740 1 --2- 172.21.15.63:0/3444985135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220bebc390 0x56220c2a48b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.977+0000 7f593b5df740 1 --2- 172.21.15.63:0/3444985135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220beb41b0 0x56220c298ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.977+0000 7f593b5df740 1 -- 172.21.15.63:0/3444985135 >> 172.21.15.63:0/3444985135 conn(0x56220bed1460 msgr2=0x56220c2983a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:59.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.977+0000 7f593b5df740 1 -- 172.21.15.63:0/3444985135 shutdown_connections 2024-09-21T06:28:59.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.977+0000 7f593b5df740 1 -- 172.21.15.63:0/3444985135 wait complete. 2024-09-21T06:28:59.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.977+0000 7f593b5df740 1 -- start start 2024-09-21T06:28:59.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.977+0000 7f593b5df740 1 Processor -- start 2024-09-21T06:28:59.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.978+0000 7f593b5df740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220beb41b0 0x56220c2a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:59.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.978+0000 7f593b5df740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220bebc390 0x56220c29c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:59.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.978+0000 7f593b5df740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220bedd070 0x56220c29ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:59.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.978+0000 7f593b5df740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f59301ae950 con 0x56220beb41b0 2024-09-21T06:28:59.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.978+0000 7f593b5df740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f59301ae280 con 0x56220bedd070 2024-09-21T06:28:59.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.978+0000 7f593b5df740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f59301ab4c0 con 0x56220bebc390 2024-09-21T06:28:59.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.978+0000 7f593b5df740 10 client.0 _ll_register_callbacks cb 0x7f5920005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:59.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.978+0000 7f592e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220beb41b0 0x56220c2a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:59.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.978+0000 7f592ed9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220bebc390 0x56220c29c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:59.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.978+0000 7f592e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220beb41b0 0x56220c2a12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35394/0 (socket says 172.21.15.63:35394) 2024-09-21T06:28:59.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.978+0000 7f592e59c640 1 -- 172.21.15.63:0/810813365 learned_addr learned my addr 172.21.15.63:0/810813365 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:28:59.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.978+0000 7f592e59c640 1 --2- 172.21.15.63:0/810813365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220bedd070 0x56220c29ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:59.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.978+0000 7f592e59c640 1 -- 172.21.15.63:0/810813365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220bebc390 msgr2=0x56220c29c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:59.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.978+0000 7f592e59c640 1 --2- 172.21.15.63:0/810813365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220bebc390 0x56220c29c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.979+0000 7f592e59c640 1 -- 172.21.15.63:0/810813365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220bedd070 msgr2=0x56220c29ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:59.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.979+0000 7f592e59c640 1 --2- 172.21.15.63:0/810813365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220bedd070 0x56220c29ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.979+0000 7f592e59c640 1 -- 172.21.15.63:0/810813365 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56220c3142e0 con 0x56220beb41b0 2024-09-21T06:28:59.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.979+0000 7f592e59c640 1 --2- 172.21.15.63:0/810813365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220beb41b0 0x56220c2a12b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5924004de0 tx=0x7f5924000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50570bdcc43cdde4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:59.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.979+0000 7f5912ff5640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:28:59.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.979+0000 7f5912ff5640 1 -- 172.21.15.63:0/810813365 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592405b060 con 0x56220beb41b0 2024-09-21T06:28:59.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.979+0000 7f593b5df740 1 -- 172.21.15.63:0/810813365 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f592002f020 con 0x56220beb41b0 2024-09-21T06:28:59.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.979+0000 7f5912ff5640 1 -- 172.21.15.63:0/810813365 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f5924004100 con 0x56220beb41b0 2024-09-21T06:28:59.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.979+0000 7f5912ff5640 1 -- 172.21.15.63:0/810813365 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5924041030 con 0x56220beb41b0 2024-09-21T06:28:59.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.979+0000 7f593b5df740 10 client.15657 fetch_fsmap learned FSMap version 29 2024-09-21T06:28:59.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.979+0000 7f593b5df740 1 -- 172.21.15.63:0/810813365 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56220c3153d0 con 0x56220beb41b0 2024-09-21T06:28:59.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.980+0000 7f5912ff5640 1 -- 172.21.15.63:0/810813365 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f592002f020 con 0x56220beb41b0 2024-09-21T06:28:59.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.980+0000 7f5912ff5640 1 -- 172.21.15.63:0/810813365 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f59240035f0 con 0x56220beb41b0 2024-09-21T06:28:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.980+0000 7f593b5df740 10 client.15657 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:28:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.980+0000 7f593b5df740 10 client.15657 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:28:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.980+0000 7f593b5df740 20 client.15657 populate_metadata read hostname 'smithi063' 2024-09-21T06:28:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.980+0000 7f593b5df740 1 --2- 172.21.15.63:0/810813365 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56220be70da0 0x56220c317b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.980+0000 7f593b5df740 4 client.15657 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:28:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.980+0000 7f593b5df740 1 -- 172.21.15.63:0/810813365 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56220c1fcdf0 con 0x56220be70da0 2024-09-21T06:28:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.980+0000 7f592ed9d640 1 --2- 172.21.15.63:0/810813365 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56220be70da0 0x56220c317b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.981+0000 7f5912ff5640 10 client.15657 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:28:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.981+0000 7f592ed9d640 1 --2- 172.21.15.63:0/810813365 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56220be70da0 0x56220c317b00 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=25f7035ee020ff0e server_cookie=4d147d40c4058bce in_seq=0 out_seq=0 2024-09-21T06:28:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.981+0000 7f5912ff5640 1 -- 172.21.15.63:0/810813365 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56220c1fcdf0 con 0x56220be70da0 2024-09-21T06:28:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.981+0000 7f5912ff5640 10 client.15657 handle_command_reply: tid=0 2024-09-21T06:28:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.981+0000 7f593b5df740 1 client.15657 shutdown 2024-09-21T06:28:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.982+0000 7f593b5df740 1 -- 172.21.15.63:0/810813365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220beb41b0 msgr2=0x56220c2a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.982+0000 7f593b5df740 1 --2- 172.21.15.63:0/810813365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220beb41b0 0x56220c2a12b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5924004de0 tx=0x7f5924000bc0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.982+0000 7f593b5df740 1 -- 172.21.15.63:0/810813365 shutdown_connections 2024-09-21T06:28:59.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.982+0000 7f593b5df740 1 --2- 172.21.15.63:0/810813365 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56220be70da0 0x56220c317b00 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.982+0000 7f593b5df740 1 --2- 172.21.15.63:0/810813365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56220bedd070 0x56220c29ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.982+0000 7f593b5df740 1 --2- 172.21.15.63:0/810813365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56220bebc390 0x56220c29c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.982+0000 7f5912ff5640 0 client.15657 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:28:59.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.982+0000 7f593b5df740 1 --2- 172.21.15.63:0/810813365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56220beb41b0 0x56220c2a12b0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.982+0000 7f593b5df740 1 -- 172.21.15.63:0/810813365 >> 172.21.15.63:0/810813365 conn(0x56220bed1460 msgr2=0x56220c299a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:59.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.982+0000 7f593b5df740 1 -- 172.21.15.63:0/810813365 shutdown_connections 2024-09-21T06:28:59.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.982+0000 7f593b5df740 1 -- 172.21.15.63:0/810813365 wait complete. 2024-09-21T06:28:59.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.982+0000 7f593b5df740 20 client.15657 trim_cache size 0 max 16384 2024-09-21T06:28:59.986 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:28:59.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.983+0000 7f593506b640 1 -- 172.21.15.63:0/2713125839 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f59180b6670 msgr2=0x7f59180b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:59.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.983+0000 7f593506b640 1 --2- 172.21.15.63:0/2713125839 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f59180b6670 0x7f59180b8b80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f59280e5900 tx=0x7f592800cee0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.983+0000 7f593506b640 1 -- 172.21.15.63:0/2713125839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f593010ddf0 msgr2=0x7f593019fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:59.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.983+0000 7f593506b640 1 --2- 172.21.15.63:0/2713125839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f593010ddf0 0x7f593019fd60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f592800eb10 tx=0x7f592800c2d0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.983+0000 7f593506b640 1 -- 172.21.15.63:0/2713125839 shutdown_connections 2024-09-21T06:28:59.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.983+0000 7f593506b640 1 --2- 172.21.15.63:0/2713125839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f593010ddf0 0x7f593019fd60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.983+0000 7f593506b640 1 --2- 172.21.15.63:0/2713125839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5930105270 0x7f593019aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.983+0000 7f593506b640 1 --2- 172.21.15.63:0/2713125839 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f59180b6670 0x7f59180b8b80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.983+0000 7f593506b640 1 --2- 172.21.15.63:0/2713125839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5930104840 0x7f593019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:59.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.983+0000 7f593506b640 1 -- 172.21.15.63:0/2713125839 >> 172.21.15.63:0/2713125839 conn(0x7f5930079730 msgr2=0x7f59301068f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:59.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.983+0000 7f593506b640 1 -- 172.21.15.63:0/2713125839 shutdown_connections 2024-09-21T06:28:59.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:28:59.983+0000 7f593506b640 1 -- 172.21.15.63:0/2713125839 wait complete. 2024-09-21T06:29:00.684 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:29:00.994 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:00 smithi063 ceph-mon[31150]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-21T06:29:00.994 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:29:00 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: 2024-09-21T06:29:00.886+0000 7f4c8b710640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:29:00.994 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:29:00 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: 2024-09-21T06:29:00.886+0000 7f4c8b710640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:29:00.994 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:29:00 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: 2024-09-21T06:29:00.886+0000 7f4c8b710640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:29:00.995 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:29:00 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: 2024-09-21T06:29:00.886+0000 7f4c8b710640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:29:00.995 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:29:00 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: 2024-09-21T06:29:00.886+0000 7f4c8b710640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:29:01.042 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:01.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:00 smithi071 ceph-mon[34844]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-21T06:29:01.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:00 smithi175 ceph-mon[34510]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-21T06:29:01.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.566+0000 7f907e9be640 1 -- 172.21.15.63:0/450889724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078108d10 msgr2=0x7f907810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:01.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.566+0000 7f907e9be640 1 --2- 172.21.15.63:0/450889724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078108d10 0x7f907810f540 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9070009ca0 tx=0x7f907002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.566+0000 7f907e9be640 1 -- 172.21.15.63:0/450889724 shutdown_connections 2024-09-21T06:29:01.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.566+0000 7f907e9be640 1 --2- 172.21.15.63:0/450889724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078108d10 0x7f907810f540 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.567+0000 7f907e9be640 1 --2- 172.21.15.63:0/450889724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90781083c0 0x7f90781087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.567+0000 7f907e9be640 1 --2- 172.21.15.63:0/450889724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9078102a80 0x7f9078102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.567+0000 7f907e9be640 1 -- 172.21.15.63:0/450889724 >> 172.21.15.63:0/450889724 conn(0x7f9078079740 msgr2=0x7f9078079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.567+0000 7f907e9be640 1 -- 172.21.15.63:0/450889724 shutdown_connections 2024-09-21T06:29:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.567+0000 7f907e9be640 1 -- 172.21.15.63:0/450889724 wait complete. 2024-09-21T06:29:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.567+0000 7f907e9be640 1 Processor -- start 2024-09-21T06:29:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.568+0000 7f907e9be640 1 -- start start 2024-09-21T06:29:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.568+0000 7f907e9be640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078102a80 0x7f907819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.568+0000 7f907e9be640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90781083c0 0x7f907819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.568+0000 7f907e9be640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9078108d10 0x7f907819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.568+0000 7f907e9be640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9078113aa0 con 0x7f9078102a80 2024-09-21T06:29:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.568+0000 7f907e9be640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9078113920 con 0x7f90781083c0 2024-09-21T06:29:01.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.568+0000 7f907e9be640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9078113c20 con 0x7f9078108d10 2024-09-21T06:29:01.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.568+0000 7f9077fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078102a80 0x7f907819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.568+0000 7f907cf5b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9078108d10 0x7f907819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.568+0000 7f907cf5b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9078108d10 0x7f907819fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:52688/0 (socket says 172.21.15.63:52688) 2024-09-21T06:29:01.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.568+0000 7f907cf5b640 1 -- 172.21.15.63:0/3433772876 learned_addr learned my addr 172.21.15.63:0/3433772876 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:01.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.569+0000 7f90777fe640 1 --2- 172.21.15.63:0/3433772876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90781083c0 0x7f907819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.569+0000 7f9077fff640 1 -- 172.21.15.63:0/3433772876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9078108d10 msgr2=0x7f907819fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:01.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.569+0000 7f9077fff640 1 --2- 172.21.15.63:0/3433772876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9078108d10 0x7f907819fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.569+0000 7f9077fff640 1 -- 172.21.15.63:0/3433772876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90781083c0 msgr2=0x7f907819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:01.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.569+0000 7f9077fff640 1 --2- 172.21.15.63:0/3433772876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90781083c0 0x7f907819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.569+0000 7f9077fff640 1 -- 172.21.15.63:0/3433772876 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90781a0400 con 0x7f9078102a80 2024-09-21T06:29:01.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.569+0000 7f907cf5b640 1 --2- 172.21.15.63:0/3433772876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9078108d10 0x7f907819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:01.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.569+0000 7f9077fff640 1 --2- 172.21.15.63:0/3433772876 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078102a80 0x7f907819a490 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f906800d720 tx=0x7f906800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:01.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.569+0000 7f90757fa640 1 -- 172.21.15.63:0/3433772876 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9068017070 con 0x7f9078102a80 2024-09-21T06:29:01.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.569+0000 7f90757fa640 1 -- 172.21.15.63:0/3433772876 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f906800de30 con 0x7f9078102a80 2024-09-21T06:29:01.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.569+0000 7f90757fa640 1 -- 172.21.15.63:0/3433772876 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90680047a0 con 0x7f9078102a80 2024-09-21T06:29:01.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.570+0000 7f907e9be640 1 -- 172.21.15.63:0/3433772876 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90781a06f0 con 0x7f9078102a80 2024-09-21T06:29:01.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.570+0000 7f907e9be640 1 -- 172.21.15.63:0/3433772876 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f907810feb0 con 0x7f9078102a80 2024-09-21T06:29:01.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.573+0000 7f9084f32740 1 Processor -- start 2024-09-21T06:29:01.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.574+0000 7f90757fa640 1 -- 172.21.15.63:0/3433772876 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 24) ==== 154586+0+0 (secure 0 0 0) 0x7f90680099d0 con 0x7f9078102a80 2024-09-21T06:29:01.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.574+0000 7f9084f32740 1 -- start start 2024-09-21T06:29:01.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.574+0000 7f9084f32740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90ac070 0x5582e945beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.574+0000 7f9084f32740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e90831b0 0x5582e945c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.574+0000 7f9084f32740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e908b390 0x5582e945c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.574+0000 7f9084f32740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5582e93c9ea0 con 0x5582e90831b0 2024-09-21T06:29:01.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.574+0000 7f9084f32740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5582e93b92d0 con 0x5582e908b390 2024-09-21T06:29:01.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.574+0000 7f9084f32740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5582e93bd0e0 con 0x5582e90ac070 2024-09-21T06:29:01.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.575+0000 7f907cf5b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90ac070 0x5582e945beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.575+0000 7f907cf5b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90ac070 0x5582e945beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:52696/0 (socket says 172.21.15.63:52696) 2024-09-21T06:29:01.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.575+0000 7f907cf5b640 1 -- 172.21.15.63:0/2948326893 learned_addr learned my addr 172.21.15.63:0/2948326893 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:01.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.575+0000 7f90757fa640 1 --2- 172.21.15.63:0/3433772876 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f90600b6740 0x7f90600b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.575+0000 7f907cf5b640 1 -- 172.21.15.63:0/2948326893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e908b390 msgr2=0x5582e945c930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:29:01.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.575+0000 7f907cf5b640 1 --2- 172.21.15.63:0/2948326893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e908b390 0x5582e945c930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.575+0000 7f907cf5b640 1 -- 172.21.15.63:0/2948326893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e90831b0 msgr2=0x5582e945c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:01.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.575+0000 7f90757fa640 1 -- 172.21.15.63:0/3433772876 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f90680e70d0 con 0x7f9078102a80 2024-09-21T06:29:01.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.575+0000 7f9077fff640 1 --2- 172.21.15.63:0/2948326893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e90831b0 0x5582e945c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.576+0000 7f907cf5b640 1 --2- 172.21.15.63:0/2948326893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e90831b0 0x5582e945c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.576+0000 7f907cf5b640 1 -- 172.21.15.63:0/2948326893 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582e9117650 con 0x5582e90ac070 2024-09-21T06:29:01.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.576+0000 7f907cf5b640 1 --2- 172.21.15.63:0/3433772876 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f90600b6740 0x7f90600b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.576+0000 7f9077fff640 1 --2- 172.21.15.63:0/2948326893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e90831b0 0x5582e945c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:01.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.576+0000 7f907cf5b640 1 --2- 172.21.15.63:0/2948326893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90ac070 0x5582e945beb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9070004af0 tx=0x7f9070009820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88d39065d00e05bb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:01.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.576+0000 7f907cf5b640 1 --2- 172.21.15.63:0/3433772876 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f90600b6740 0x7f90600b8c50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9070009a60 tx=0x7f9070049000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:01.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.576+0000 7f905e7fc640 1 -- 172.21.15.63:0/2948326893 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9070043040 con 0x5582e90ac070 2024-09-21T06:29:01.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.577+0000 7f905e7fc640 1 -- 172.21.15.63:0/2948326893 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9070036040 con 0x5582e90ac070 2024-09-21T06:29:01.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.577+0000 7f905e7fc640 1 -- 172.21.15.63:0/2948326893 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907002fd00 con 0x5582e90ac070 2024-09-21T06:29:01.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.578+0000 7f9084f32740 1 -- 172.21.15.63:0/2948326893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90ac070 msgr2=0x5582e945beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:01.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.578+0000 7f9084f32740 1 --2- 172.21.15.63:0/2948326893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90ac070 0x5582e945beb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9070004af0 tx=0x7f9070009820 comp rx=0 tx=0).stop 2024-09-21T06:29:01.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.578+0000 7f9084f32740 1 -- 172.21.15.63:0/2948326893 shutdown_connections 2024-09-21T06:29:01.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.578+0000 7f9084f32740 1 --2- 172.21.15.63:0/2948326893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e908b390 0x5582e945c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.578+0000 7f9084f32740 1 --2- 172.21.15.63:0/2948326893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e90831b0 0x5582e945c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.578+0000 7f9084f32740 1 --2- 172.21.15.63:0/2948326893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90ac070 0x5582e945beb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.578+0000 7f9084f32740 1 -- 172.21.15.63:0/2948326893 >> 172.21.15.63:0/2948326893 conn(0x5582e90a0460 msgr2=0x5582e9459da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.578+0000 7f9084f32740 1 -- 172.21.15.63:0/2948326893 shutdown_connections 2024-09-21T06:29:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.578+0000 7f9084f32740 1 -- 172.21.15.63:0/2948326893 wait complete. 2024-09-21T06:29:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.579+0000 7f9084f32740 1 -- start start 2024-09-21T06:29:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.579+0000 7f9084f32740 1 Processor -- start 2024-09-21T06:29:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.580+0000 7f9084f32740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90831b0 0x5582e94675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.580+0000 7f9084f32740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e908b390 0x5582e9467af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.580+0000 7f9084f32740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e90ac070 0x5582e9484930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.580+0000 7f9084f32740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5582e921a700 con 0x5582e90ac070 2024-09-21T06:29:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.580+0000 7f9084f32740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5582e9354160 con 0x5582e908b390 2024-09-21T06:29:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.580+0000 7f9084f32740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5582e947b640 con 0x5582e90831b0 2024-09-21T06:29:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.580+0000 7f9084f32740 10 client.0 _ll_register_callbacks cb 0x5582e936d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.580+0000 7f907cf5b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e90ac070 0x5582e9484930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.581+0000 7f907cf5b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e90ac070 0x5582e9484930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35444/0 (socket says 172.21.15.63:35444) 2024-09-21T06:29:01.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.581+0000 7f907cf5b640 1 -- 172.21.15.63:0/1309723896 learned_addr learned my addr 172.21.15.63:0/1309723896 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.581+0000 7f907cf5b640 1 -- 172.21.15.63:0/1309723896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90831b0 msgr2=0x5582e94675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.581+0000 7f9077fff640 1 --2- 172.21.15.63:0/1309723896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90831b0 0x5582e94675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.581+0000 7f907cf5b640 1 --2- 172.21.15.63:0/1309723896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90831b0 0x5582e94675b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.581+0000 7f907cf5b640 1 -- 172.21.15.63:0/1309723896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e908b390 msgr2=0x5582e9467af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:29:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.581+0000 7f907cf5b640 1 --2- 172.21.15.63:0/1309723896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e908b390 0x5582e9467af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.582+0000 7f907cf5b640 1 -- 172.21.15.63:0/1309723896 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582e9381c90 con 0x5582e90ac070 2024-09-21T06:29:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.582+0000 7f9077fff640 1 --2- 172.21.15.63:0/1309723896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90831b0 0x5582e94675b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.582+0000 7f907cf5b640 1 --2- 172.21.15.63:0/1309723896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e90ac070 0x5582e9484930 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9070006010 tx=0x7f9070003dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadd7678b7a8706 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.582+0000 7f90577fe640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.583+0000 7f90577fe640 1 -- 172.21.15.63:0/1309723896 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907005f060 con 0x5582e90ac070 2024-09-21T06:29:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.583+0000 7f9084f32740 1 -- 172.21.15.63:0/1309723896 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9070036040 con 0x5582e90ac070 2024-09-21T06:29:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.583+0000 7f90577fe640 1 -- 172.21.15.63:0/1309723896 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f907002fa80 con 0x5582e90ac070 2024-09-21T06:29:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.583+0000 7f90577fe640 1 -- 172.21.15.63:0/1309723896 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9070043030 con 0x5582e90ac070 2024-09-21T06:29:01.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.583+0000 7f9084f32740 10 client.15672 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:01.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.583+0000 7f9084f32740 1 -- 172.21.15.63:0/1309723896 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5582e9487320 con 0x5582e90ac070 2024-09-21T06:29:01.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.584+0000 7f90577fe640 1 -- 172.21.15.63:0/1309723896 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9070036040 con 0x5582e90ac070 2024-09-21T06:29:01.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.585+0000 7f90577fe640 1 -- 172.21.15.63:0/1309723896 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f90700305c0 con 0x5582e90ac070 2024-09-21T06:29:01.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.585+0000 7f9084f32740 10 client.15672 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:01.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.585+0000 7f9084f32740 10 client.15672 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:29:01.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.585+0000 7f9084f32740 20 client.15672 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:01.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.585+0000 7f9084f32740 1 --2- 172.21.15.63:0/1309723896 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5582e906a9f0 0x5582e948a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.585+0000 7f9084f32740 4 client.15672 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:01.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.585+0000 7f9084f32740 1 -- 172.21.15.63:0/1309723896 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582e93cbdf0 con 0x5582e906a9f0 2024-09-21T06:29:01.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.586+0000 7f9077fff640 1 --2- 172.21.15.63:0/1309723896 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5582e906a9f0 0x5582e948a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.586+0000 7f9077fff640 1 --2- 172.21.15.63:0/1309723896 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5582e906a9f0 0x5582e948a680 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c1f761e9a8a02172 server_cookie=6f918b2b3a4af61d in_seq=0 out_seq=0 2024-09-21T06:29:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.586+0000 7f90577fe640 10 client.15672 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:29:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.587+0000 7f90577fe640 1 -- 172.21.15.63:0/1309723896 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5582e93cbdf0 con 0x5582e906a9f0 2024-09-21T06:29:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.587+0000 7f90577fe640 10 client.15672 handle_command_reply: tid=0 2024-09-21T06:29:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.587+0000 7f9084f32740 1 client.15672 shutdown 2024-09-21T06:29:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.587+0000 7f9084f32740 1 -- 172.21.15.63:0/1309723896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e90ac070 msgr2=0x5582e9484930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.587+0000 7f9084f32740 1 --2- 172.21.15.63:0/1309723896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e90ac070 0x5582e9484930 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9070006010 tx=0x7f9070003dc0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.587+0000 7f9084f32740 1 -- 172.21.15.63:0/1309723896 shutdown_connections 2024-09-21T06:29:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.587+0000 7f9084f32740 1 --2- 172.21.15.63:0/1309723896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e90ac070 0x5582e9484930 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.587+0000 7f9084f32740 1 --2- 172.21.15.63:0/1309723896 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5582e906a9f0 0x5582e948a680 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.587+0000 7f9084f32740 1 --2- 172.21.15.63:0/1309723896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e908b390 0x5582e9467af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.587+0000 7f9084f32740 1 --2- 172.21.15.63:0/1309723896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90831b0 0x5582e94675b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.587+0000 7f9084f32740 1 -- 172.21.15.63:0/1309723896 >> 172.21.15.63:0/1309723896 conn(0x5582e90a0460 msgr2=0x5582e945f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.587+0000 7f90577fe640 0 client.15672 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:29:01.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.588+0000 7f9084f32740 1 -- 172.21.15.63:0/1309723896 shutdown_connections 2024-09-21T06:29:01.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.588+0000 7f9084f32740 1 -- 172.21.15.63:0/1309723896 wait complete. 2024-09-21T06:29:01.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.588+0000 7f9084f32740 20 client.15672 trim_cache size 0 max 16384 2024-09-21T06:29:01.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.601+0000 7f9084f32740 1 Processor -- start 2024-09-21T06:29:01.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.601+0000 7f9084f32740 1 -- start start 2024-09-21T06:29:01.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.601+0000 7f9084f32740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90831b0 0x5582e9467a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.601+0000 7f9084f32740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e908b390 0x5582e9484830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.601+0000 7f9084f32740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e90ac070 0x5582e9484d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.601+0000 7f9084f32740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f90780732f0 con 0x5582e908b390 2024-09-21T06:29:01.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.601+0000 7f9084f32740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9078074e30 con 0x5582e90ac070 2024-09-21T06:29:01.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.601+0000 7f9084f32740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f90780739c0 con 0x5582e90831b0 2024-09-21T06:29:01.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.601+0000 7f90777fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e908b390 0x5582e9484830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.602+0000 7f90777fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e908b390 0x5582e9484830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35456/0 (socket says 172.21.15.63:35456) 2024-09-21T06:29:01.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.602+0000 7f90777fe640 1 -- 172.21.15.63:0/2387906568 learned_addr learned my addr 172.21.15.63:0/2387906568 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:01.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.602+0000 7f9077fff640 1 --2- 172.21.15.63:0/2387906568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90831b0 0x5582e9467a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.602+0000 7f90777fe640 1 -- 172.21.15.63:0/2387906568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90831b0 msgr2=0x5582e9467a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:01.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.602+0000 7f90777fe640 1 --2- 172.21.15.63:0/2387906568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90831b0 0x5582e9467a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.602+0000 7f90777fe640 1 -- 172.21.15.63:0/2387906568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e90ac070 msgr2=0x5582e9484d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:01.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.602+0000 7f90777fe640 1 --2- 172.21.15.63:0/2387906568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e90ac070 0x5582e9484d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.602+0000 7f90777fe640 1 -- 172.21.15.63:0/2387906568 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582e9468870 con 0x5582e908b390 2024-09-21T06:29:01.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.602+0000 7f90777fe640 1 --2- 172.21.15.63:0/2387906568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e908b390 0x5582e9484830 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f906c00ff90 tx=0x7f906c00d770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84c1180b2f4dc86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:01.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.602+0000 7f905dffb640 1 -- 172.21.15.63:0/2387906568 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906c004030 con 0x5582e908b390 2024-09-21T06:29:01.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.603+0000 7f905dffb640 1 -- 172.21.15.63:0/2387906568 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f906c0041d0 con 0x5582e908b390 2024-09-21T06:29:01.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.603+0000 7f905dffb640 1 -- 172.21.15.63:0/2387906568 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906c018650 con 0x5582e908b390 2024-09-21T06:29:01.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.603+0000 7f9084f32740 1 -- 172.21.15.63:0/2387906568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e908b390 msgr2=0x5582e9484830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:01.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.603+0000 7f9084f32740 1 --2- 172.21.15.63:0/2387906568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e908b390 0x5582e9484830 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f906c00ff90 tx=0x7f906c00d770 comp rx=0 tx=0).stop 2024-09-21T06:29:01.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.604+0000 7f9084f32740 1 -- 172.21.15.63:0/2387906568 shutdown_connections 2024-09-21T06:29:01.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.604+0000 7f9084f32740 1 --2- 172.21.15.63:0/2387906568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e90ac070 0x5582e9484d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.604+0000 7f9084f32740 1 --2- 172.21.15.63:0/2387906568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e908b390 0x5582e9484830 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.604+0000 7f9084f32740 1 --2- 172.21.15.63:0/2387906568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90831b0 0x5582e9467a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.604+0000 7f9084f32740 1 -- 172.21.15.63:0/2387906568 >> 172.21.15.63:0/2387906568 conn(0x5582e90a0460 msgr2=0x5582e9467360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.604+0000 7f9084f32740 1 -- 172.21.15.63:0/2387906568 shutdown_connections 2024-09-21T06:29:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.604+0000 7f9084f32740 1 -- 172.21.15.63:0/2387906568 wait complete. 2024-09-21T06:29:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.604+0000 7f9084f32740 1 -- start start 2024-09-21T06:29:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.604+0000 7f9084f32740 1 Processor -- start 2024-09-21T06:29:01.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.605+0000 7f9084f32740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e90831b0 0x5582e947cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.605+0000 7f9084f32740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90ac070 0x5582e947d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.605+0000 7f9084f32740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e903fda0 0x5582e94f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.605+0000 7f9084f32740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9078074760 con 0x5582e903fda0 2024-09-21T06:29:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.605+0000 7f9084f32740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9078074090 con 0x5582e90831b0 2024-09-21T06:29:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.605+0000 7f9084f32740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f90780712d0 con 0x5582e90ac070 2024-09-21T06:29:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.605+0000 7f9084f32740 10 client.0 _ll_register_callbacks cb 0x7f907002f3e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.605+0000 7f907cf5b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e903fda0 0x5582e94f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.605+0000 7f90777fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90ac070 0x5582e947d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.605+0000 7f907cf5b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e903fda0 0x5582e94f3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35462/0 (socket says 172.21.15.63:35462) 2024-09-21T06:29:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.605+0000 7f907cf5b640 1 -- 172.21.15.63:0/2521286197 learned_addr learned my addr 172.21.15.63:0/2521286197 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.605+0000 7f907cf5b640 1 -- 172.21.15.63:0/2521286197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90ac070 msgr2=0x5582e947d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.605+0000 7f907cf5b640 1 --2- 172.21.15.63:0/2521286197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90ac070 0x5582e947d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.605+0000 7f907cf5b640 1 -- 172.21.15.63:0/2521286197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e90831b0 msgr2=0x5582e947cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.605+0000 7f9077fff640 1 --2- 172.21.15.63:0/2521286197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e90831b0 0x5582e947cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.606+0000 7f907cf5b640 1 --2- 172.21.15.63:0/2521286197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e90831b0 0x5582e947cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.606+0000 7f907cf5b640 1 -- 172.21.15.63:0/2521286197 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582e94f4360 con 0x5582e903fda0 2024-09-21T06:29:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.606+0000 7f9077fff640 1 --2- 172.21.15.63:0/2521286197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e90831b0 0x5582e947cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.606+0000 7f907cf5b640 1 --2- 172.21.15.63:0/2521286197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e903fda0 0x5582e94f3e20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9070005e30 tx=0x7f907002f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500572c2eb4e4e0c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.606+0000 7f90577fe640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.606+0000 7f90577fe640 1 -- 172.21.15.63:0/2521286197 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907005f070 con 0x5582e903fda0 2024-09-21T06:29:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.606+0000 7f90577fe640 1 -- 172.21.15.63:0/2521286197 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f9070041040 con 0x5582e903fda0 2024-09-21T06:29:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.606+0000 7f9084f32740 1 -- 172.21.15.63:0/2521286197 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f906c0041d0 con 0x5582e903fda0 2024-09-21T06:29:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.607+0000 7f90577fe640 1 -- 172.21.15.63:0/2521286197 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9070072050 con 0x5582e903fda0 2024-09-21T06:29:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.607+0000 7f9084f32740 10 client.15678 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:01.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.607+0000 7f9084f32740 1 -- 172.21.15.63:0/2521286197 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5582e94f5450 con 0x5582e903fda0 2024-09-21T06:29:01.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.607+0000 7f90577fe640 1 -- 172.21.15.63:0/2521286197 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9070056040 con 0x5582e903fda0 2024-09-21T06:29:01.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.607+0000 7f90577fe640 1 -- 172.21.15.63:0/2521286197 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9070004340 con 0x5582e903fda0 2024-09-21T06:29:01.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.607+0000 7f9084f32740 10 client.15678 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:01.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.607+0000 7f9084f32740 10 client.15678 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:29:01.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.607+0000 7f9084f32740 20 client.15678 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:01.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.607+0000 7f9084f32740 1 --2- 172.21.15.63:0/2521286197 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5582e94f5c00 0x5582e94f8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.607+0000 7f9084f32740 4 client.15678 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:29:01.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.607+0000 7f9084f32740 1 -- 172.21.15.63:0/2521286197 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f906c0041d0 con 0x5582e94f5c00 2024-09-21T06:29:01.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.607+0000 7f9077fff640 1 --2- 172.21.15.63:0/2521286197 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5582e94f5c00 0x5582e94f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.608+0000 7f90577fe640 10 client.15678 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:29:01.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.608+0000 7f9077fff640 1 --2- 172.21.15.63:0/2521286197 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5582e94f5c00 0x5582e94f8020 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=248ba0388359e29e server_cookie=3db54cb01ca73f1e in_seq=0 out_seq=0 2024-09-21T06:29:01.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.609+0000 7f90577fe640 1 -- 172.21.15.63:0/2521286197 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f906c0041d0 con 0x5582e94f5c00 2024-09-21T06:29:01.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.609+0000 7f90577fe640 10 client.15678 handle_command_reply: tid=0 2024-09-21T06:29:01.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.609+0000 7f9084f32740 1 client.15678 shutdown 2024-09-21T06:29:01.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.609+0000 7f9084f32740 1 -- 172.21.15.63:0/2521286197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e903fda0 msgr2=0x5582e94f3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:01.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.609+0000 7f9084f32740 1 --2- 172.21.15.63:0/2521286197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e903fda0 0x5582e94f3e20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9070005e30 tx=0x7f907002f520 comp rx=0 tx=0).stop 2024-09-21T06:29:01.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.609+0000 7f9084f32740 1 -- 172.21.15.63:0/2521286197 shutdown_connections 2024-09-21T06:29:01.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.609+0000 7f9084f32740 1 --2- 172.21.15.63:0/2521286197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5582e903fda0 0x5582e94f3e20 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.609+0000 7f9084f32740 1 --2- 172.21.15.63:0/2521286197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582e90ac070 0x5582e947d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.609+0000 7f9084f32740 1 --2- 172.21.15.63:0/2521286197 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5582e94f5c00 0x5582e94f8020 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.609+0000 7f90577fe640 0 client.15678 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:29:01.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.609+0000 7f9084f32740 1 --2- 172.21.15.63:0/2521286197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582e90831b0 0x5582e947cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.609+0000 7f9084f32740 1 -- 172.21.15.63:0/2521286197 >> 172.21.15.63:0/2521286197 conn(0x5582e90a0460 msgr2=0x5582e9468a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:01.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.609+0000 7f9084f32740 1 -- 172.21.15.63:0/2521286197 shutdown_connections 2024-09-21T06:29:01.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.609+0000 7f9084f32740 1 -- 172.21.15.63:0/2521286197 wait complete. 2024-09-21T06:29:01.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.609+0000 7f9084f32740 20 client.15678 trim_cache size 0 max 16384 2024-09-21T06:29:01.614 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:29:01.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.610+0000 7f907e9be640 1 -- 172.21.15.63:0/3433772876 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f90600b6740 msgr2=0x7f90600b8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:01.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.610+0000 7f907e9be640 1 --2- 172.21.15.63:0/3433772876 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f90600b6740 0x7f90600b8c50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9070009a60 tx=0x7f9070049000 comp rx=0 tx=0).stop 2024-09-21T06:29:01.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.610+0000 7f907e9be640 1 -- 172.21.15.63:0/3433772876 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078102a80 msgr2=0x7f907819a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:01.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.610+0000 7f907e9be640 1 --2- 172.21.15.63:0/3433772876 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078102a80 0x7f907819a490 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f906800d720 tx=0x7f906800dbe0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.610+0000 7f907e9be640 1 -- 172.21.15.63:0/3433772876 shutdown_connections 2024-09-21T06:29:01.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.610+0000 7f907e9be640 1 --2- 172.21.15.63:0/3433772876 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f90600b6740 0x7f90600b8c50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.610+0000 7f907e9be640 1 --2- 172.21.15.63:0/3433772876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9078108d10 0x7f907819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.610+0000 7f907e9be640 1 --2- 172.21.15.63:0/3433772876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90781083c0 0x7f907819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.610+0000 7f907e9be640 1 --2- 172.21.15.63:0/3433772876 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9078102a80 0x7f907819a490 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.610+0000 7f907e9be640 1 -- 172.21.15.63:0/3433772876 >> 172.21.15.63:0/3433772876 conn(0x7f9078079740 msgr2=0x7f9078104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.611+0000 7f907e9be640 1 -- 172.21.15.63:0/3433772876 shutdown_connections 2024-09-21T06:29:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:01.611+0000 7f907e9be640 1 -- 172.21.15.63:0/3433772876 wait complete. 2024-09-21T06:29:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.173+0000 7f6ae6a40640 1 -- 172.21.15.63:0/3703680411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae0102060 msgr2=0x7f6ae0102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.173+0000 7f6ae6a40640 1 --2- 172.21.15.63:0/3703680411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae0102060 0x7f6ae0102470 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009900 tx=0x7f6ad002a410 comp rx=0 tx=0).stop 2024-09-21T06:29:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.173+0000 7f6ae6a40640 1 -- 172.21.15.63:0/3703680411 shutdown_connections 2024-09-21T06:29:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.173+0000 7f6ae6a40640 1 --2- 172.21.15.63:0/3703680411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae0109d80 0x7f6ae01105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.173+0000 7f6ae6a40640 1 --2- 172.21.15.63:0/3703680411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ae0109430 0x7f6ae0109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.173+0000 7f6ae6a40640 1 --2- 172.21.15.63:0/3703680411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae0102060 0x7f6ae0102470 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.173+0000 7f6ae6a40640 1 -- 172.21.15.63:0/3703680411 >> 172.21.15.63:0/3703680411 conn(0x7f6ae0079e90 msgr2=0x7f6ae007a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.173+0000 7f6ae6a40640 1 -- 172.21.15.63:0/3703680411 shutdown_connections 2024-09-21T06:29:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.173+0000 7f6ae6a40640 1 -- 172.21.15.63:0/3703680411 wait complete. 2024-09-21T06:29:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.174+0000 7f6ae6a40640 1 Processor -- start 2024-09-21T06:29:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.174+0000 7f6ae6a40640 1 -- start start 2024-09-21T06:29:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.175+0000 7f6ae6a40640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae0102060 0x7f6ae0102ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.175+0000 7f6ae6a40640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae0109430 0x7f6ae0103530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.175+0000 7f6ae6a40640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ae0109d80 0x7f6ae0103a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.175+0000 7f6ae6a40640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae0113a40 con 0x7f6ae0102060 2024-09-21T06:29:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.175+0000 7f6ae6a40640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01138c0 con 0x7f6ae0109430 2024-09-21T06:29:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.175+0000 7f6ae6a40640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae0113bc0 con 0x7f6ae0109d80 2024-09-21T06:29:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.175+0000 7f6adffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae0102060 0x7f6ae0102ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.175+0000 7f6adffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae0102060 0x7f6ae0102ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35484/0 (socket says 172.21.15.63:35484) 2024-09-21T06:29:02.178 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.175+0000 7f6adffff640 1 -- 172.21.15.63:0/4293065620 learned_addr learned my addr 172.21.15.63:0/4293065620 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:02.178 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.175+0000 7f6adf7fe640 1 --2- 172.21.15.63:0/4293065620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae0109430 0x7f6ae0103530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:02.178 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.175+0000 7f6ae4fdd640 1 --2- 172.21.15.63:0/4293065620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ae0109d80 0x7f6ae0103a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:02.179 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.176+0000 7f6adffff640 1 -- 172.21.15.63:0/4293065620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ae0109d80 msgr2=0x7f6ae0103a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:02.179 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.176+0000 7f6adffff640 1 --2- 172.21.15.63:0/4293065620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ae0109d80 0x7f6ae0103a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.179 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.176+0000 7f6adffff640 1 -- 172.21.15.63:0/4293065620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae0109430 msgr2=0x7f6ae0103530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:02.179 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.176+0000 7f6adffff640 1 --2- 172.21.15.63:0/4293065620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae0109430 0x7f6ae0103530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.179 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.176+0000 7f6adffff640 1 -- 172.21.15.63:0/4293065620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae01a8750 con 0x7f6ae0102060 2024-09-21T06:29:02.179 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.176+0000 7f6adf7fe640 1 --2- 172.21.15.63:0/4293065620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae0109430 0x7f6ae0103530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:02.179 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.176+0000 7f6adffff640 1 --2- 172.21.15.63:0/4293065620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae0102060 0x7f6ae0102ff0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0005940 tx=0x7f6ad00040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:02.179 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.176+0000 7f6add7fa640 1 -- 172.21.15.63:0/4293065620 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad003f030 con 0x7f6ae0102060 2024-09-21T06:29:02.179 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.176+0000 7f6add7fa640 1 -- 172.21.15.63:0/4293065620 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ad00044c0 con 0x7f6ae0102060 2024-09-21T06:29:02.179 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.176+0000 7f6add7fa640 1 -- 172.21.15.63:0/4293065620 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0035070 con 0x7f6ae0102060 2024-09-21T06:29:02.179 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.176+0000 7f6ae6a40640 1 -- 172.21.15.63:0/4293065620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae01a89e0 con 0x7f6ae0102060 2024-09-21T06:29:02.179 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.176+0000 7f6ae6a40640 1 -- 172.21.15.63:0/4293065620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae01a8e80 con 0x7f6ae0102060 2024-09-21T06:29:02.181 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.180+0000 7f6aeda89740 1 Processor -- start 2024-09-21T06:29:02.181 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.180+0000 7f6aeda89740 1 -- start start 2024-09-21T06:29:02.182 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.180+0000 7f6aeda89740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f511b0 0x55c4a62f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:02.182 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.180+0000 7f6aeda89740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f282f0 0x55c4a62f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:02.182 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.180+0000 7f6aeda89740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f304d0 0x55c4a62f7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.180+0000 7f6aeda89740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c4a626b6f0 con 0x55c4a5f304d0 2024-09-21T06:29:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.180+0000 7f6aeda89740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c4a625ab20 con 0x55c4a5f511b0 2024-09-21T06:29:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.180+0000 7f6aeda89740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c4a625e930 con 0x55c4a5f282f0 2024-09-21T06:29:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.180+0000 7f6ae4fdd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f511b0 0x55c4a62f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.180+0000 7f6adf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f304d0 0x55c4a62f7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.180+0000 7f6ae4fdd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f511b0 0x55c4a62f69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:41048/0 (socket says 172.21.15.63:41048) 2024-09-21T06:29:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.180+0000 7f6ae4fdd640 1 -- 172.21.15.63:0/2053439946 learned_addr learned my addr 172.21.15.63:0/2053439946 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.180+0000 7f6add7fa640 1 -- 172.21.15.63:0/4293065620 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 24) ==== 154586+0+0 (secure 0 0 0) 0x7f6ad0042030 con 0x7f6ae0102060 2024-09-21T06:29:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.180+0000 7f6ae4fdd640 1 -- 172.21.15.63:0/2053439946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f282f0 msgr2=0x55c4a62f6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.180+0000 7f6adffff640 1 --2- 172.21.15.63:0/2053439946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f282f0 0x55c4a62f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.181+0000 7f6ae4fdd640 1 --2- 172.21.15.63:0/2053439946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f282f0 0x55c4a62f6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.181+0000 7f6ae4fdd640 1 -- 172.21.15.63:0/2053439946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f304d0 msgr2=0x55c4a62f7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.181+0000 7f6ae4fdd640 1 --2- 172.21.15.63:0/2053439946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f304d0 0x55c4a62f7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.181+0000 7f6ae4fdd640 1 -- 172.21.15.63:0/2053439946 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4a6220530 con 0x55c4a5f511b0 2024-09-21T06:29:02.184 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.181+0000 7f6adf7fe640 1 --2- 172.21.15.63:0/2053439946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f304d0 0x55c4a62f7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:02.184 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.181+0000 7f6adffff640 1 --2- 172.21.15.63:0/2053439946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f282f0 0x55c4a62f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:02.184 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.181+0000 7f6ae4fdd640 1 --2- 172.21.15.63:0/2053439946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f511b0 0x55c4a62f69b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8010400 tx=0x7f6ad80108c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c2fc19c95e1acf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:02.186 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.181+0000 7f6ac67fc640 1 -- 172.21.15.63:0/2053439946 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8003b70 con 0x55c4a5f511b0 2024-09-21T06:29:02.186 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.181+0000 7f6ac67fc640 1 -- 172.21.15.63:0/2053439946 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ad8003d10 con 0x55c4a5f511b0 2024-09-21T06:29:02.186 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.181+0000 7f6ac67fc640 1 -- 172.21.15.63:0/2053439946 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8011a00 con 0x55c4a5f511b0 2024-09-21T06:29:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.181+0000 7f6add7fa640 1 --2- 172.21.15.63:0/4293065620 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6ac80b6720 0x7f6ac80b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.182+0000 7f6adffff640 1 --2- 172.21.15.63:0/4293065620 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6ac80b6720 0x7f6ac80b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.182+0000 7f6add7fa640 1 -- 172.21.15.63:0/4293065620 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f6ad01079a0 con 0x7f6ae0102060 2024-09-21T06:29:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.182+0000 7f6aeda89740 1 -- 172.21.15.63:0/2053439946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f511b0 msgr2=0x55c4a62f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.182+0000 7f6aeda89740 1 --2- 172.21.15.63:0/2053439946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f511b0 0x55c4a62f69b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8010400 tx=0x7f6ad80108c0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.182+0000 7f6adffff640 1 --2- 172.21.15.63:0/4293065620 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6ac80b6720 0x7f6ac80b8c30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00cd590 tx=0x7f6ad00c9040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.182+0000 7f6aeda89740 1 -- 172.21.15.63:0/2053439946 shutdown_connections 2024-09-21T06:29:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.182+0000 7f6aeda89740 1 --2- 172.21.15.63:0/2053439946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f304d0 0x55c4a62f7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.182+0000 7f6aeda89740 1 --2- 172.21.15.63:0/2053439946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f282f0 0x55c4a62f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.182+0000 7f6aeda89740 1 --2- 172.21.15.63:0/2053439946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f511b0 0x55c4a62f69b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.182+0000 7f6aeda89740 1 -- 172.21.15.63:0/2053439946 >> 172.21.15.63:0/2053439946 conn(0x55c4a5f45300 msgr2=0x55c4a62f48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.182+0000 7f6aeda89740 1 -- 172.21.15.63:0/2053439946 shutdown_connections 2024-09-21T06:29:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.182+0000 7f6aeda89740 1 -- 172.21.15.63:0/2053439946 wait complete. 2024-09-21T06:29:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.183+0000 7f6aeda89740 1 -- start start 2024-09-21T06:29:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.183+0000 7f6aeda89740 1 Processor -- start 2024-09-21T06:29:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.183+0000 7f6aeda89740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f282f0 0x55c4a6302080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.183+0000 7f6aeda89740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f304d0 0x55c4a63025c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.183+0000 7f6aeda89740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f511b0 0x55c4a630e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.183+0000 7f6aeda89740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c4a6192ab0 con 0x55c4a5f304d0 2024-09-21T06:29:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.183+0000 7f6aeda89740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c4a6200730 con 0x55c4a5f282f0 2024-09-21T06:29:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.183+0000 7f6aeda89740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c4a6305130 con 0x55c4a5f511b0 2024-09-21T06:29:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.183+0000 7f6aeda89740 10 client.0 _ll_register_callbacks cb 0x55c4a62546b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.183+0000 7f6adf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f304d0 0x55c4a63025c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.183+0000 7f6adf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f304d0 0x55c4a63025c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35500/0 (socket says 172.21.15.63:35500) 2024-09-21T06:29:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.184+0000 7f6adf7fe640 1 -- 172.21.15.63:0/1339841326 learned_addr learned my addr 172.21.15.63:0/1339841326 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.184+0000 7f6ae4fdd640 1 --2- 172.21.15.63:0/1339841326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f282f0 0x55c4a6302080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.184+0000 7f6ae4fdd640 1 --2- 172.21.15.63:0/1339841326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f511b0 0x55c4a630e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.184+0000 7f6adf7fe640 1 -- 172.21.15.63:0/1339841326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f511b0 msgr2=0x55c4a630e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.184+0000 7f6adf7fe640 1 --2- 172.21.15.63:0/1339841326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f511b0 0x55c4a630e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.184+0000 7f6adf7fe640 1 -- 172.21.15.63:0/1339841326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f282f0 msgr2=0x55c4a6302080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.184+0000 7f6adf7fe640 1 --2- 172.21.15.63:0/1339841326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f282f0 0x55c4a6302080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.184+0000 7f6adf7fe640 1 -- 172.21.15.63:0/1339841326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4a5fbc790 con 0x55c4a5f304d0 2024-09-21T06:29:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.184+0000 7f6ae4fdd640 1 --2- 172.21.15.63:0/1339841326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f282f0 0x55c4a6302080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.184+0000 7f6adf7fe640 1 --2- 172.21.15.63:0/1339841326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f304d0 0x55c4a63025c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40129e0 tx=0x7f6ad4012ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a66788df18d5b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.184+0000 7f6abf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.184+0000 7f6abf7fe640 1 -- 172.21.15.63:0/1339841326 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad400fa30 con 0x55c4a5f304d0 2024-09-21T06:29:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.184+0000 7f6abf7fe640 1 -- 172.21.15.63:0/1339841326 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f6ad400fbd0 con 0x55c4a5f304d0 2024-09-21T06:29:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.185+0000 7f6aeda89740 1 -- 172.21.15.63:0/1339841326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ad8003d10 con 0x55c4a5f304d0 2024-09-21T06:29:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.185+0000 7f6abf7fe640 1 -- 172.21.15.63:0/1339841326 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6ad400fdd0 con 0x55c4a5f304d0 2024-09-21T06:29:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.185+0000 7f6aeda89740 10 client.15690 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.185+0000 7f6aeda89740 1 -- 172.21.15.63:0/1339841326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c4a6035620 con 0x55c4a5f304d0 2024-09-21T06:29:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.185+0000 7f6abf7fe640 1 -- 172.21.15.63:0/1339841326 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ad8003d10 con 0x55c4a5f304d0 2024-09-21T06:29:02.191 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.185+0000 7f6abf7fe640 1 -- 172.21.15.63:0/1339841326 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6ad40254d0 con 0x55c4a5f304d0 2024-09-21T06:29:02.191 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.185+0000 7f6aeda89740 10 client.15690 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:02.191 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.185+0000 7f6aeda89740 10 client.15690 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:02.191 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.185+0000 7f6aeda89740 20 client.15690 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.185+0000 7f6aeda89740 1 --2- 172.21.15.63:0/1339841326 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c4a5f0fd80 0x55c4a63141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.185+0000 7f6aeda89740 4 client.15690 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.185+0000 7f6aeda89740 1 -- 172.21.15.63:0/1339841326 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4a626d640 con 0x55c4a5f0fd80 2024-09-21T06:29:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.186+0000 7f6ae4fdd640 1 --2- 172.21.15.63:0/1339841326 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c4a5f0fd80 0x55c4a63141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.186+0000 7f6ae4fdd640 1 --2- 172.21.15.63:0/1339841326 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c4a5f0fd80 0x55c4a63141e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69b1b9dcff7d858b server_cookie=edf0e4950c9e1846 in_seq=0 out_seq=0 2024-09-21T06:29:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.186+0000 7f6abf7fe640 10 client.15690 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.187+0000 7f6abf7fe640 1 -- 172.21.15.63:0/1339841326 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c4a626d640 con 0x55c4a5f0fd80 2024-09-21T06:29:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.187+0000 7f6abf7fe640 10 client.15690 handle_command_reply: tid=0 2024-09-21T06:29:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.187+0000 7f6aeda89740 1 client.15690 shutdown 2024-09-21T06:29:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.187+0000 7f6aeda89740 1 -- 172.21.15.63:0/1339841326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f304d0 msgr2=0x55c4a63025c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.187+0000 7f6aeda89740 1 --2- 172.21.15.63:0/1339841326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f304d0 0x55c4a63025c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40129e0 tx=0x7f6ad4012ea0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.187+0000 7f6aeda89740 1 -- 172.21.15.63:0/1339841326 shutdown_connections 2024-09-21T06:29:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.187+0000 7f6aeda89740 1 --2- 172.21.15.63:0/1339841326 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c4a5f0fd80 0x55c4a63141e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.187+0000 7f6aeda89740 1 --2- 172.21.15.63:0/1339841326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f511b0 0x55c4a630e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.187+0000 7f6aeda89740 1 --2- 172.21.15.63:0/1339841326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f304d0 0x55c4a63025c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.187+0000 7f6aeda89740 1 --2- 172.21.15.63:0/1339841326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f282f0 0x55c4a6302080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.187+0000 7f6aeda89740 1 -- 172.21.15.63:0/1339841326 >> 172.21.15.63:0/1339841326 conn(0x55c4a5f45300 msgr2=0x55c4a62f79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.187+0000 7f6abf7fe640 0 client.15690 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.187+0000 7f6aeda89740 1 -- 172.21.15.63:0/1339841326 shutdown_connections 2024-09-21T06:29:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.187+0000 7f6aeda89740 1 -- 172.21.15.63:0/1339841326 wait complete. 2024-09-21T06:29:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.187+0000 7f6aeda89740 20 client.15690 trim_cache size 0 max 16384 2024-09-21T06:29:02.205 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.202+0000 7f6aeda89740 1 Processor -- start 2024-09-21T06:29:02.205 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.202+0000 7f6aeda89740 1 -- start start 2024-09-21T06:29:02.205 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.202+0000 7f6aeda89740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f282f0 0x55c4a62f83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:02.205 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.202+0000 7f6aeda89740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f304d0 0x55c4a6303cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:02.205 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.202+0000 7f6aeda89740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f511b0 0x55c4a630e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:02.205 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.202+0000 7f6aeda89740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01b18b0 con 0x55c4a5f304d0 2024-09-21T06:29:02.205 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.202+0000 7f6aeda89740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01b33f0 con 0x55c4a5f511b0 2024-09-21T06:29:02.205 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.202+0000 7f6aeda89740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01b1f80 con 0x55c4a5f282f0 2024-09-21T06:29:02.205 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.202+0000 7f6adf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f304d0 0x55c4a6303cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:02.205 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.202+0000 7f6adf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f304d0 0x55c4a6303cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35508/0 (socket says 172.21.15.63:35508) 2024-09-21T06:29:02.205 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.202+0000 7f6adf7fe640 1 -- 172.21.15.63:0/3244401141 learned_addr learned my addr 172.21.15.63:0/3244401141 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:02.205 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.203+0000 7f6ae4fdd640 1 --2- 172.21.15.63:0/3244401141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f282f0 0x55c4a62f83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:02.206 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.203+0000 7f6ae4fdd640 1 --2- 172.21.15.63:0/3244401141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f511b0 0x55c4a630e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:02.206 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.203+0000 7f6adf7fe640 1 -- 172.21.15.63:0/3244401141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f282f0 msgr2=0x55c4a62f83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:02.206 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.203+0000 7f6adf7fe640 1 --2- 172.21.15.63:0/3244401141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f282f0 0x55c4a62f83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.206 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.203+0000 7f6adf7fe640 1 -- 172.21.15.63:0/3244401141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f511b0 msgr2=0x55c4a630e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:02.206 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.203+0000 7f6adf7fe640 1 --2- 172.21.15.63:0/3244401141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f511b0 0x55c4a630e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.206 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.203+0000 7f6adf7fe640 1 -- 172.21.15.63:0/3244401141 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4a6303340 con 0x55c4a5f304d0 2024-09-21T06:29:02.206 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.203+0000 7f6ae4fdd640 1 --2- 172.21.15.63:0/3244401141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f511b0 0x55c4a630e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:02.206 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.203+0000 7f6adf7fe640 1 --2- 172.21.15.63:0/3244401141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f304d0 0x55c4a6303cb0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4025870 tx=0x7f6ad400fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f18c0ed87e3ab7a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:02.208 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.203+0000 7f6ac5ffb640 1 -- 172.21.15.63:0/3244401141 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4025ae0 con 0x55c4a5f304d0 2024-09-21T06:29:02.208 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.203+0000 7f6ac5ffb640 1 -- 172.21.15.63:0/3244401141 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ad4025c80 con 0x55c4a5f304d0 2024-09-21T06:29:02.208 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.203+0000 7f6ac5ffb640 1 -- 172.21.15.63:0/3244401141 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40055d0 con 0x55c4a5f304d0 2024-09-21T06:29:02.208 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.205+0000 7f6aeda89740 1 -- 172.21.15.63:0/3244401141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f304d0 msgr2=0x55c4a6303cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:02.208 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.205+0000 7f6aeda89740 1 --2- 172.21.15.63:0/3244401141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f304d0 0x55c4a6303cb0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4025870 tx=0x7f6ad400fcc0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.208 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.205+0000 7f6aeda89740 1 -- 172.21.15.63:0/3244401141 shutdown_connections 2024-09-21T06:29:02.208 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.205+0000 7f6aeda89740 1 --2- 172.21.15.63:0/3244401141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f511b0 0x55c4a630e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.208 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.205+0000 7f6aeda89740 1 --2- 172.21.15.63:0/3244401141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f304d0 0x55c4a6303cb0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.208 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.205+0000 7f6aeda89740 1 --2- 172.21.15.63:0/3244401141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f282f0 0x55c4a62f83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.208 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.205+0000 7f6aeda89740 1 -- 172.21.15.63:0/3244401141 >> 172.21.15.63:0/3244401141 conn(0x55c4a5f45300 msgr2=0x55c4a63035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.205+0000 7f6aeda89740 1 -- 172.21.15.63:0/3244401141 shutdown_connections 2024-09-21T06:29:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.205+0000 7f6aeda89740 1 -- 172.21.15.63:0/3244401141 wait complete. 2024-09-21T06:29:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.205+0000 7f6aeda89740 1 -- start start 2024-09-21T06:29:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.205+0000 7f6aeda89740 1 Processor -- start 2024-09-21T06:29:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.206+0000 7f6aeda89740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f282f0 0x55c4a6307560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.206+0000 7f6aeda89740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f304d0 0x55c4a6307aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.206+0000 7f6aeda89740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f511b0 0x55c4a6307fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.206+0000 7f6aeda89740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01b2d20 con 0x55c4a5f282f0 2024-09-21T06:29:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.206+0000 7f6aeda89740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01b2650 con 0x55c4a5f511b0 2024-09-21T06:29:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.206+0000 7f6aeda89740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01af890 con 0x55c4a5f304d0 2024-09-21T06:29:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.206+0000 7f6aeda89740 10 client.0 _ll_register_callbacks cb 0x7f6ad4009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.206+0000 7f6ae4fdd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f282f0 0x55c4a6307560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.206+0000 7f6ae4fdd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f282f0 0x55c4a6307560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35514/0 (socket says 172.21.15.63:35514) 2024-09-21T06:29:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.206+0000 7f6ae4fdd640 1 -- 172.21.15.63:0/303135782 learned_addr learned my addr 172.21.15.63:0/303135782 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:02.210 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.206+0000 7f6adf7fe640 1 --2- 172.21.15.63:0/303135782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f304d0 0x55c4a6307aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:02.211 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.206+0000 7f6adf7fe640 1 -- 172.21.15.63:0/303135782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f511b0 msgr2=0x55c4a6307fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:29:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.206+0000 7f6adf7fe640 1 --2- 172.21.15.63:0/303135782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f511b0 0x55c4a6307fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.206+0000 7f6adf7fe640 1 -- 172.21.15.63:0/303135782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f282f0 msgr2=0x55c4a6307560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.206+0000 7f6adf7fe640 1 --2- 172.21.15.63:0/303135782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f282f0 0x55c4a6307560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.206+0000 7f6adf7fe640 1 -- 172.21.15.63:0/303135782 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4a637cda0 con 0x55c4a5f304d0 2024-09-21T06:29:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.207+0000 7f6ae4fdd640 1 --2- 172.21.15.63:0/303135782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f282f0 0x55c4a6307560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.207+0000 7f6adf7fe640 1 --2- 172.21.15.63:0/303135782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f304d0 0x55c4a6307aa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4025990 tx=0x7f6ad401dca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c811972f55761e4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.207+0000 7f6abf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:29:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.207+0000 7f6abf7fe640 1 -- 172.21.15.63:0/303135782 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4034070 con 0x55c4a5f304d0 2024-09-21T06:29:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.207+0000 7f6aeda89740 1 -- 172.21.15.63:0/303135782 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ad4025c80 con 0x55c4a5f304d0 2024-09-21T06:29:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.207+0000 7f6abf7fe640 1 -- 172.21.15.63:0/303135782 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f6ad4025440 con 0x55c4a5f304d0 2024-09-21T06:29:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.207+0000 7f6abf7fe640 1 -- 172.21.15.63:0/303135782 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6ad4040050 con 0x55c4a5f304d0 2024-09-21T06:29:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.207+0000 7f6aeda89740 10 client.25420 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.207+0000 7f6aeda89740 1 -- 172.21.15.63:0/303135782 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c4a637e010 con 0x55c4a5f304d0 2024-09-21T06:29:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.208+0000 7f6abf7fe640 1 -- 172.21.15.63:0/303135782 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ad4025c80 con 0x55c4a5f304d0 2024-09-21T06:29:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.208+0000 7f6abf7fe640 1 -- 172.21.15.63:0/303135782 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6ad40035f0 con 0x55c4a5f304d0 2024-09-21T06:29:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.208+0000 7f6aeda89740 10 client.25420 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.208+0000 7f6aeda89740 10 client.25420 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.208+0000 7f6aeda89740 20 client.25420 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.208+0000 7f6aeda89740 1 --2- 172.21.15.63:0/303135782 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c4a5ee51c0 0x55c4a6380700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.208+0000 7f6aeda89740 4 client.25420 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:29:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.208+0000 7f6aeda89740 1 -- 172.21.15.63:0/303135782 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c4a62690f0 con 0x55c4a5ee51c0 2024-09-21T06:29:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.208+0000 7f6ae4fdd640 1 --2- 172.21.15.63:0/303135782 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c4a5ee51c0 0x55c4a6380700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.209+0000 7f6abf7fe640 10 client.25420 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:02.209+0000 7f6ae4fdd640 1 --2- 172.21.15.63:0/303135782 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c4a5ee51c0 0x55c4a6380700 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f120c260f6f39c83 server_cookie=92156cbb30d78071 in_seq=0 out_seq=0 2024-09-21T06:29:02.325 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:29:02.623 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:03.018 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:03.016+0000 7f6add7fa640 1 -- 172.21.15.63:0/4293065620 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f6ad0081d10 con 0x7f6ae0102060 2024-09-21T06:29:03.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.120+0000 7fe998a00640 1 -- 172.21.15.63:0/1933598638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9941081b0 msgr2=0x7fe9941085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:03.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.120+0000 7fe998a00640 1 --2- 172.21.15.63:0/1933598638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9941081b0 0x7fe9941085c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe988009900 tx=0x7fe98802a410 comp rx=0 tx=0).stop 2024-09-21T06:29:03.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.120+0000 7fe998a00640 1 -- 172.21.15.63:0/1933598638 shutdown_connections 2024-09-21T06:29:03.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.120+0000 7fe998a00640 1 --2- 172.21.15.63:0/1933598638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe994108b00 0x7fe99410f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.120+0000 7fe998a00640 1 --2- 172.21.15.63:0/1933598638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9941081b0 0x7fe9941085c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.120+0000 7fe998a00640 1 --2- 172.21.15.63:0/1933598638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe994102870 0x7fe994102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.120+0000 7fe998a00640 1 -- 172.21.15.63:0/1933598638 >> 172.21.15.63:0/1933598638 conn(0x7fe9940fe2c0 msgr2=0x7fe994100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:03.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.120+0000 7fe998a00640 1 -- 172.21.15.63:0/1933598638 shutdown_connections 2024-09-21T06:29:03.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.120+0000 7fe998a00640 1 -- 172.21.15.63:0/1933598638 wait complete. 2024-09-21T06:29:03.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.121+0000 7fe998a00640 1 Processor -- start 2024-09-21T06:29:03.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.121+0000 7fe998a00640 1 -- start start 2024-09-21T06:29:03.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.122+0000 7fe998a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe994102870 0x7fe9941980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.122+0000 7fe998a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9941081b0 0x7fe994198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.122+0000 7fe998a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe994108b00 0x7fe99419d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.122+0000 7fe998a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe994111700 con 0x7fe9941081b0 2024-09-21T06:29:03.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.122+0000 7fe998a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe994111580 con 0x7fe994108b00 2024-09-21T06:29:03.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.122+0000 7fe998a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe994111880 con 0x7fe994102870 2024-09-21T06:29:03.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.122+0000 7fe99259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9941081b0 0x7fe994198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.122+0000 7fe99259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9941081b0 0x7fe994198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35530/0 (socket says 172.21.15.63:35530) 2024-09-21T06:29:03.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.122+0000 7fe99259c640 1 -- 172.21.15.63:0/1181564570 learned_addr learned my addr 172.21.15.63:0/1181564570 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:03.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.122+0000 7fe992d9d640 1 --2- 172.21.15.63:0/1181564570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe994102870 0x7fe9941980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.122+0000 7fe99359e640 1 --2- 172.21.15.63:0/1181564570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe994108b00 0x7fe99419d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.123+0000 7fe992d9d640 1 -- 172.21.15.63:0/1181564570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe994108b00 msgr2=0x7fe99419d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:03.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.123+0000 7fe992d9d640 1 --2- 172.21.15.63:0/1181564570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe994108b00 0x7fe99419d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.123+0000 7fe992d9d640 1 -- 172.21.15.63:0/1181564570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9941081b0 msgr2=0x7fe994198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:03.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.123+0000 7fe992d9d640 1 --2- 172.21.15.63:0/1181564570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9941081b0 0x7fe994198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.123+0000 7fe992d9d640 1 -- 172.21.15.63:0/1181564570 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99419e040 con 0x7fe994102870 2024-09-21T06:29:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.123+0000 7fe99259c640 1 --2- 172.21.15.63:0/1181564570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9941081b0 0x7fe994198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.123+0000 7fe992d9d640 1 --2- 172.21.15.63:0/1181564570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe994102870 0x7fe9941980d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe984009760 tx=0x7fe984009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.123+0000 7fe97bfff640 1 -- 172.21.15.63:0/1181564570 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98401b070 con 0x7fe994102870 2024-09-21T06:29:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.123+0000 7fe97bfff640 1 -- 172.21.15.63:0/1181564570 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe984016410 con 0x7fe994102870 2024-09-21T06:29:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.123+0000 7fe97bfff640 1 -- 172.21.15.63:0/1181564570 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe984015610 con 0x7fe994102870 2024-09-21T06:29:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.123+0000 7fe998a00640 1 -- 172.21.15.63:0/1181564570 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99419e330 con 0x7fe994102870 2024-09-21T06:29:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.123+0000 7fe998a00640 1 -- 172.21.15.63:0/1181564570 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9941a4a90 con 0x7fe994102870 2024-09-21T06:29:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.127+0000 7fe99f775740 1 Processor -- start 2024-09-21T06:29:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.127+0000 7fe99f775740 1 -- start start 2024-09-21T06:29:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.127+0000 7fe99f775740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae9a24070 0x564ae9dcb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.128+0000 7fe99f775740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 0x564ae9dcb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.128+0000 7fe99f775740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ae9a03390 0x564ae9dcbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.128+0000 7fe99f775740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564ae9d41ea0 con 0x564ae9a24070 2024-09-21T06:29:03.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.128+0000 7fe99f775740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564ae9d312d0 con 0x564ae9a03390 2024-09-21T06:29:03.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.128+0000 7fe99f775740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564ae9d350e0 con 0x564ae99fb1b0 2024-09-21T06:29:03.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.128+0000 7fe99359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae9a24070 0x564ae9dcb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.128+0000 7fe99359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae9a24070 0x564ae9dcb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35542/0 (socket says 172.21.15.63:35542) 2024-09-21T06:29:03.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.128+0000 7fe99359e640 1 -- 172.21.15.63:0/3677516179 learned_addr learned my addr 172.21.15.63:0/3677516179 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:03.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.128+0000 7fe99259c640 1 --2- 172.21.15.63:0/3677516179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ae9a03390 0x564ae9dcbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.128+0000 7fe99359e640 1 -- 172.21.15.63:0/3677516179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 msgr2=0x564ae9dcb9a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:29:03.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.128+0000 7fe99359e640 1 --2- 172.21.15.63:0/3677516179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 0x564ae9dcb9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.128+0000 7fe99359e640 1 -- 172.21.15.63:0/3677516179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ae9a03390 msgr2=0x564ae9dcbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:03.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.128+0000 7fe99359e640 1 --2- 172.21.15.63:0/3677516179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ae9a03390 0x564ae9dcbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.128+0000 7fe99359e640 1 -- 172.21.15.63:0/3677516179 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ae9a8f650 con 0x564ae9a24070 2024-09-21T06:29:03.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.129+0000 7fe99359e640 1 --2- 172.21.15.63:0/3677516179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae9a24070 0x564ae9dcb460 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009ef0 tx=0x7fe98c009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0307039d77132bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:03.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.129+0000 7fe9797fa640 1 -- 172.21.15.63:0/3677516179 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c022030 con 0x564ae9a24070 2024-09-21T06:29:03.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.129+0000 7fe97bfff640 1 -- 172.21.15.63:0/1181564570 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fe9840165c0 con 0x7fe994102870 2024-09-21T06:29:03.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.129+0000 7fe9797fa640 1 -- 172.21.15.63:0/3677516179 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe98c015e00 con 0x564ae9a24070 2024-09-21T06:29:03.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.129+0000 7fe9797fa640 1 -- 172.21.15.63:0/3677516179 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c004050 con 0x564ae9a24070 2024-09-21T06:29:03.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.130+0000 7fe97bfff640 1 --2- 172.21.15.63:0/1181564570 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe97c0b6680 0x7fe97c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.130+0000 7fe97bfff640 1 -- 172.21.15.63:0/1181564570 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fe9840e6dc0 con 0x7fe994102870 2024-09-21T06:29:03.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.130+0000 7fe992d9d640 1 --2- 172.21.15.63:0/1181564570 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe97c0b6680 0x7fe97c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.131+0000 7fe99f775740 1 -- 172.21.15.63:0/3677516179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae9a24070 msgr2=0x564ae9dcb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:03.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.131+0000 7fe99f775740 1 --2- 172.21.15.63:0/3677516179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae9a24070 0x564ae9dcb460 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009ef0 tx=0x7fe98c009500 comp rx=0 tx=0).stop 2024-09-21T06:29:03.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.131+0000 7fe99f775740 1 -- 172.21.15.63:0/3677516179 shutdown_connections 2024-09-21T06:29:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.131+0000 7fe99f775740 1 --2- 172.21.15.63:0/3677516179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ae9a03390 0x564ae9dcbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.131+0000 7fe99f775740 1 --2- 172.21.15.63:0/3677516179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 0x564ae9dcb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.131+0000 7fe99f775740 1 --2- 172.21.15.63:0/3677516179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae9a24070 0x564ae9dcb460 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.131+0000 7fe99f775740 1 -- 172.21.15.63:0/3677516179 >> 172.21.15.63:0/3677516179 conn(0x564ae9a18460 msgr2=0x564ae9dc9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.132+0000 7fe992d9d640 1 --2- 172.21.15.63:0/1181564570 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe97c0b6680 0x7fe97c0b8b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x564ae9dca0e0 tx=0x7fe984011500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.132+0000 7fe99f775740 1 -- 172.21.15.63:0/3677516179 shutdown_connections 2024-09-21T06:29:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.132+0000 7fe99f775740 1 -- 172.21.15.63:0/3677516179 wait complete. 2024-09-21T06:29:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.133+0000 7fe99f775740 1 -- start start 2024-09-21T06:29:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.133+0000 7fe99f775740 1 Processor -- start 2024-09-21T06:29:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.134+0000 7fe99f775740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 0x564ae9dd6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.134+0000 7fe99f775740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae9a03390 0x564ae9dd7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.134+0000 7fe99f775740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ae9a24070 0x564ae9de2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.134+0000 7fe99f775740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564ae9b92700 con 0x564ae9a03390 2024-09-21T06:29:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.134+0000 7fe99f775740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564ae9ccc160 con 0x564ae9a24070 2024-09-21T06:29:03.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.134+0000 7fe99259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae9a03390 0x564ae9dd7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.134+0000 7fe99259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae9a03390 0x564ae9dd7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35556/0 (socket says 172.21.15.63:35556) 2024-09-21T06:29:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.134+0000 7fe99259c640 1 -- 172.21.15.63:0/1394005589 learned_addr learned my addr 172.21.15.63:0/1394005589 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.134+0000 7fe99f775740 1 -- 172.21.15.63:0/1394005589 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564ae9dd9c40 con 0x564ae99fb1b0 2024-09-21T06:29:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.134+0000 7fe99359e640 1 --2- 172.21.15.63:0/1394005589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 0x564ae9dd6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.134+0000 7fe99f775740 10 client.0 _ll_register_callbacks cb 0x564ae9ce59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.134+0000 7fe99259c640 1 -- 172.21.15.63:0/1394005589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 msgr2=0x564ae9dd6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.134+0000 7fe99259c640 1 --2- 172.21.15.63:0/1394005589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 0x564ae9dd6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.134+0000 7fe99259c640 1 -- 172.21.15.63:0/1394005589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ae9a24070 msgr2=0x564ae9de2f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:29:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.134+0000 7fe99259c640 1 --2- 172.21.15.63:0/1394005589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ae9a24070 0x564ae9de2f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.134+0000 7fe99259c640 1 -- 172.21.15.63:0/1394005589 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ae9cf9c90 con 0x564ae9a03390 2024-09-21T06:29:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.135+0000 7fe99259c640 1 --2- 172.21.15.63:0/1394005589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae9a03390 0x564ae9dd7020 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe98802aa00 tx=0x7fe988003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9bcbad7842db8a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:03.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.135+0000 7fe976ff5640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.135+0000 7fe976ff5640 1 -- 172.21.15.63:0/1394005589 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988035040 con 0x564ae9a03390 2024-09-21T06:29:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.135+0000 7fe976ff5640 1 -- 172.21.15.63:0/1394005589 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fe988003c10 con 0x564ae9a03390 2024-09-21T06:29:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.135+0000 7fe99f775740 1 -- 172.21.15.63:0/1394005589 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe98c015e00 con 0x564ae9a03390 2024-09-21T06:29:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.135+0000 7fe976ff5640 1 -- 172.21.15.63:0/1394005589 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe988003e10 con 0x564ae9a03390 2024-09-21T06:29:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.135+0000 7fe99f775740 10 client.15708 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.136+0000 7fe99f775740 1 -- 172.21.15.63:0/1394005589 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564ae9de58f0 con 0x564ae9a03390 2024-09-21T06:29:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.136+0000 7fe976ff5640 1 -- 172.21.15.63:0/1394005589 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe98c015e00 con 0x564ae9a03390 2024-09-21T06:29:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.136+0000 7fe976ff5640 1 -- 172.21.15.63:0/1394005589 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe9880465d0 con 0x564ae9a03390 2024-09-21T06:29:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.136+0000 7fe99f775740 10 client.15708 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.136+0000 7fe99f775740 10 client.15708 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:29:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.136+0000 7fe99f775740 20 client.15708 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.136+0000 7fe99f775740 1 --2- 172.21.15.63:0/1394005589 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564ae99e29f0 0x564ae9de8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.136+0000 7fe99f775740 4 client.15708 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:03.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.136+0000 7fe99f775740 1 -- 172.21.15.63:0/1394005589 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ae9d43df0 con 0x564ae99e29f0 2024-09-21T06:29:03.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.137+0000 7fe99359e640 1 --2- 172.21.15.63:0/1394005589 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564ae99e29f0 0x564ae9de8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.137+0000 7fe976ff5640 10 client.15708 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:29:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.138+0000 7fe99359e640 1 --2- 172.21.15.63:0/1394005589 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564ae99e29f0 0x564ae9de8dd0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f5308eeab92f5e92 server_cookie=ead172f90e6469fa in_seq=0 out_seq=0 2024-09-21T06:29:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.139+0000 7fe976ff5640 1 -- 172.21.15.63:0/1394005589 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564ae9d43df0 con 0x564ae99e29f0 2024-09-21T06:29:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.139+0000 7fe976ff5640 10 client.15708 handle_command_reply: tid=0 2024-09-21T06:29:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.139+0000 7fe99f775740 1 client.15708 shutdown 2024-09-21T06:29:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.139+0000 7fe99f775740 1 -- 172.21.15.63:0/1394005589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae9a03390 msgr2=0x564ae9dd7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.139+0000 7fe99f775740 1 --2- 172.21.15.63:0/1394005589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae9a03390 0x564ae9dd7020 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe98802aa00 tx=0x7fe988003820 comp rx=0 tx=0).stop 2024-09-21T06:29:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.139+0000 7fe99f775740 1 -- 172.21.15.63:0/1394005589 shutdown_connections 2024-09-21T06:29:03.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.139+0000 7fe99f775740 1 --2- 172.21.15.63:0/1394005589 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564ae99e29f0 0x564ae9de8dd0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.139+0000 7fe976ff5640 0 client.15708 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:29:03.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.139+0000 7fe99f775740 1 --2- 172.21.15.63:0/1394005589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ae9a24070 0x564ae9de2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.139+0000 7fe99f775740 1 --2- 172.21.15.63:0/1394005589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae9a03390 0x564ae9dd7020 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.139+0000 7fe99f775740 1 --2- 172.21.15.63:0/1394005589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 0x564ae9dd6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.139+0000 7fe99f775740 1 -- 172.21.15.63:0/1394005589 >> 172.21.15.63:0/1394005589 conn(0x564ae9a18460 msgr2=0x564ae9dce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:03.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.140+0000 7fe99f775740 1 -- 172.21.15.63:0/1394005589 shutdown_connections 2024-09-21T06:29:03.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.140+0000 7fe99f775740 1 -- 172.21.15.63:0/1394005589 wait complete. 2024-09-21T06:29:03.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.140+0000 7fe99f775740 20 client.15708 trim_cache size 0 max 16384 2024-09-21T06:29:03.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.166+0000 7fe99f775740 1 Processor -- start 2024-09-21T06:29:03.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.166+0000 7fe99f775740 1 -- start start 2024-09-21T06:29:03.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.167+0000 7fe99f775740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae99e29f0 0x564ae9dd89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.167+0000 7fe99f775740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 0x564ae9dccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.167+0000 7fe99359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae99e29f0 0x564ae9dd89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.167+0000 7fe99359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae99e29f0 0x564ae9dd89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35564/0 (socket says 172.21.15.63:35564) 2024-09-21T06:29:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.167+0000 7fe99359e640 1 -- 172.21.15.63:0/1469716622 learned_addr learned my addr 172.21.15.63:0/1469716622 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.167+0000 7fe99f775740 1 --2- 172.21.15.63:0/1469716622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ae9a24070 0x564ae9de2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.167+0000 7fe99f775740 1 -- 172.21.15.63:0/1469716622 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941ad370 con 0x564ae99e29f0 2024-09-21T06:29:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.167+0000 7fe99f775740 1 -- 172.21.15.63:0/1469716622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941aeeb0 con 0x564ae9a24070 2024-09-21T06:29:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.167+0000 7fe99f775740 1 -- 172.21.15.63:0/1469716622 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941ada40 con 0x564ae99fb1b0 2024-09-21T06:29:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.167+0000 7fe99259c640 1 --2- 172.21.15.63:0/1469716622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 0x564ae9dccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.168+0000 7fe99359e640 1 --2- 172.21.15.63:0/1469716622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ae9a24070 0x564ae9de2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.168+0000 7fe99359e640 1 -- 172.21.15.63:0/1469716622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 msgr2=0x564ae9dccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:03.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.168+0000 7fe99359e640 1 --2- 172.21.15.63:0/1469716622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 0x564ae9dccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.168+0000 7fe99359e640 1 -- 172.21.15.63:0/1469716622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ae9a24070 msgr2=0x564ae9de2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:03.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.168+0000 7fe99359e640 1 --2- 172.21.15.63:0/1469716622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ae9a24070 0x564ae9de2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.168+0000 7fe99359e640 1 -- 172.21.15.63:0/1469716622 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ae9dcd780 con 0x564ae99e29f0 2024-09-21T06:29:03.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.168+0000 7fe99359e640 1 --2- 172.21.15.63:0/1469716622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae99e29f0 0x564ae9dd89c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009270 tx=0x7fe98c003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4778d828ff8cc6c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.168+0000 7fe978ff9640 1 -- 172.21.15.63:0/1469716622 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c01ed30 con 0x564ae99e29f0 2024-09-21T06:29:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.168+0000 7fe978ff9640 1 -- 172.21.15.63:0/1469716622 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe98c005560 con 0x564ae99e29f0 2024-09-21T06:29:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.168+0000 7fe978ff9640 1 -- 172.21.15.63:0/1469716622 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0289b0 con 0x564ae99e29f0 2024-09-21T06:29:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.169+0000 7fe99f775740 1 -- 172.21.15.63:0/1469716622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae99e29f0 msgr2=0x564ae9dd89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.169+0000 7fe99f775740 1 --2- 172.21.15.63:0/1469716622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae99e29f0 0x564ae9dd89c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009270 tx=0x7fe98c003a80 comp rx=0 tx=0).stop 2024-09-21T06:29:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.169+0000 7fe99f775740 1 -- 172.21.15.63:0/1469716622 shutdown_connections 2024-09-21T06:29:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.169+0000 7fe99f775740 1 --2- 172.21.15.63:0/1469716622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ae9a24070 0x564ae9de2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.169+0000 7fe99f775740 1 --2- 172.21.15.63:0/1469716622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 0x564ae9dccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.169+0000 7fe99f775740 1 --2- 172.21.15.63:0/1469716622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae99e29f0 0x564ae9dd89c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.170+0000 7fe99f775740 1 -- 172.21.15.63:0/1469716622 >> 172.21.15.63:0/1469716622 conn(0x564ae9a18460 msgr2=0x564ae9dcc490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.170+0000 7fe99f775740 1 -- 172.21.15.63:0/1469716622 shutdown_connections 2024-09-21T06:29:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.170+0000 7fe99f775740 1 -- 172.21.15.63:0/1469716622 wait complete. 2024-09-21T06:29:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.170+0000 7fe99f775740 1 -- start start 2024-09-21T06:29:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.171+0000 7fe99f775740 1 Processor -- start 2024-09-21T06:29:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.171+0000 7fe99f775740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae99e29f0 0x564ae9ddb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.171+0000 7fe99f775740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 0x564ae9ddbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.172+0000 7fe99f775740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ae9a24070 0x564ae9e4c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.172+0000 7fe99f775740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941ae7e0 con 0x564ae99e29f0 2024-09-21T06:29:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.172+0000 7fe99f775740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941ae110 con 0x564ae9a24070 2024-09-21T06:29:03.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.172+0000 7fe99f775740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941ab350 con 0x564ae99fb1b0 2024-09-21T06:29:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.172+0000 7fe99f775740 10 client.0 _ll_register_callbacks cb 0x7fe984005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.172+0000 7fe99259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 0x564ae9ddbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.172+0000 7fe99259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 0x564ae9ddbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:52796/0 (socket says 172.21.15.63:52796) 2024-09-21T06:29:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.172+0000 7fe99259c640 1 -- 172.21.15.63:0/409085361 learned_addr learned my addr 172.21.15.63:0/409085361 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.172+0000 7fe99359e640 1 --2- 172.21.15.63:0/409085361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae99e29f0 0x564ae9ddb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.172+0000 7fe99259c640 1 -- 172.21.15.63:0/409085361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ae9a24070 msgr2=0x564ae9e4c760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:29:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.172+0000 7fe99259c640 1 --2- 172.21.15.63:0/409085361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ae9a24070 0x564ae9e4c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.172+0000 7fe99259c640 1 -- 172.21.15.63:0/409085361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae99e29f0 msgr2=0x564ae9ddb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.172+0000 7fe99259c640 1 --2- 172.21.15.63:0/409085361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae99e29f0 0x564ae9ddb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.172+0000 7fe99259c640 1 -- 172.21.15.63:0/409085361 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ae9e4cdd0 con 0x564ae99fb1b0 2024-09-21T06:29:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.173+0000 7fe99259c640 1 --2- 172.21.15.63:0/409085361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 0x564ae9ddbd80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe9880096c0 tx=0x7fe988000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edf58e7070e2843e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.173+0000 7fe976ff5640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:29:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.173+0000 7fe99359e640 1 --2- 172.21.15.63:0/409085361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae99e29f0 0x564ae9ddb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:03.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.173+0000 7fe976ff5640 1 -- 172.21.15.63:0/409085361 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988054030 con 0x564ae99fb1b0 2024-09-21T06:29:03.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.173+0000 7fe99f775740 1 -- 172.21.15.63:0/409085361 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe98c005560 con 0x564ae99fb1b0 2024-09-21T06:29:03.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.173+0000 7fe976ff5640 1 -- 172.21.15.63:0/409085361 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fe98804b030 con 0x564ae99fb1b0 2024-09-21T06:29:03.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.173+0000 7fe976ff5640 1 -- 172.21.15.63:0/409085361 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe98805e050 con 0x564ae99fb1b0 2024-09-21T06:29:03.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.173+0000 7fe99f775740 10 client.25435 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:03.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.173+0000 7fe99f775740 1 -- 172.21.15.63:0/409085361 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564ae9e540f0 con 0x564ae99fb1b0 2024-09-21T06:29:03.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.173+0000 7fe976ff5640 1 -- 172.21.15.63:0/409085361 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9880054e0 con 0x564ae99fb1b0 2024-09-21T06:29:03.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.174+0000 7fe976ff5640 1 -- 172.21.15.63:0/409085361 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe9880048e0 con 0x564ae99fb1b0 2024-09-21T06:29:03.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.174+0000 7fe99f775740 10 client.25435 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:03.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.174+0000 7fe99f775740 10 client.25435 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:29:03.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.174+0000 7fe99f775740 20 client.25435 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:03.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.174+0000 7fe99f775740 1 --2- 172.21.15.63:0/409085361 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564ae99b7da0 0x564ae9e568e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.174+0000 7fe99f775740 4 client.25435 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:29:03.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.174+0000 7fe99f775740 1 -- 172.21.15.63:0/409085361 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fe98c005560 con 0x564ae99b7da0 2024-09-21T06:29:03.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.174+0000 7fe99359e640 1 --2- 172.21.15.63:0/409085361 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564ae99b7da0 0x564ae9e568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.174+0000 7fe976ff5640 10 client.25435 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:29:03.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.175+0000 7fe99359e640 1 --2- 172.21.15.63:0/409085361 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564ae99b7da0 0x564ae9e568e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=636a51d9249f61f2 server_cookie=da29027e0c24a2b0 in_seq=0 out_seq=0 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.175+0000 7fe976ff5640 1 -- 172.21.15.63:0/409085361 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fe98c005560 con 0x564ae99b7da0 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.175+0000 7fe976ff5640 10 client.25435 handle_command_reply: tid=0 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.175+0000 7fe99f775740 1 client.25435 shutdown 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.176+0000 7fe99f775740 1 -- 172.21.15.63:0/409085361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 msgr2=0x564ae9ddbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.176+0000 7fe99f775740 1 --2- 172.21.15.63:0/409085361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 0x564ae9ddbd80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe9880096c0 tx=0x7fe988000bc0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.176+0000 7fe99f775740 1 -- 172.21.15.63:0/409085361 shutdown_connections 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.176+0000 7fe99f775740 1 --2- 172.21.15.63:0/409085361 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564ae99b7da0 0x564ae9e568e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.176+0000 7fe99f775740 1 --2- 172.21.15.63:0/409085361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564ae9a24070 0x564ae9e4c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.176+0000 7fe976ff5640 0 client.25435 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.176+0000 7fe99f775740 1 --2- 172.21.15.63:0/409085361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ae99fb1b0 0x564ae9ddbd80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.176+0000 7fe99f775740 1 --2- 172.21.15.63:0/409085361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564ae99e29f0 0x564ae9ddb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.176+0000 7fe99f775740 1 -- 172.21.15.63:0/409085361 >> 172.21.15.63:0/409085361 conn(0x564ae9a18460 msgr2=0x564ae9dd8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.176+0000 7fe99f775740 1 -- 172.21.15.63:0/409085361 shutdown_connections 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.176+0000 7fe99f775740 1 -- 172.21.15.63:0/409085361 wait complete. 2024-09-21T06:29:03.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.176+0000 7fe99f775740 20 client.25435 trim_cache size 0 max 16384 2024-09-21T06:29:03.181 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:29:03.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.177+0000 7fe998a00640 1 -- 172.21.15.63:0/1181564570 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe97c0b6680 msgr2=0x7fe97c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:03.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.177+0000 7fe998a00640 1 --2- 172.21.15.63:0/1181564570 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe97c0b6680 0x7fe97c0b8b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x564ae9dca0e0 tx=0x7fe984011500 comp rx=0 tx=0).stop 2024-09-21T06:29:03.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.177+0000 7fe998a00640 1 -- 172.21.15.63:0/1181564570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe994102870 msgr2=0x7fe9941980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:03.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.177+0000 7fe998a00640 1 --2- 172.21.15.63:0/1181564570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe994102870 0x7fe9941980d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe984009760 tx=0x7fe984009c20 comp rx=0 tx=0).stop 2024-09-21T06:29:03.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.177+0000 7fe998a00640 1 -- 172.21.15.63:0/1181564570 shutdown_connections 2024-09-21T06:29:03.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.177+0000 7fe998a00640 1 --2- 172.21.15.63:0/1181564570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe994108b00 0x7fe99419d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.177+0000 7fe998a00640 1 --2- 172.21.15.63:0/1181564570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9941081b0 0x7fe994198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.177+0000 7fe998a00640 1 --2- 172.21.15.63:0/1181564570 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe97c0b6680 0x7fe97c0b8b90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.177+0000 7fe998a00640 1 --2- 172.21.15.63:0/1181564570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe994102870 0x7fe9941980d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.177+0000 7fe998a00640 1 -- 172.21.15.63:0/1181564570 >> 172.21.15.63:0/1181564570 conn(0x7fe9940fe2c0 msgr2=0x7fe9941006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:03.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.177+0000 7fe998a00640 1 -- 172.21.15.63:0/1181564570 shutdown_connections 2024-09-21T06:29:03.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:03.178+0000 7fe998a00640 1 -- 172.21.15.63:0/1181564570 wait complete. 2024-09-21T06:29:03.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:03 smithi063 ceph-mon[31150]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-21T06:29:03.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:03 smithi175 ceph-mon[34510]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-21T06:29:03.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:03 smithi071 ceph-mon[34844]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-21T06:29:03.810 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:29:04.027 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:04 smithi063 ceph-mon[31150]: mgrmap e25: x(active, since 9m), standbys: z, y 2024-09-21T06:29:04.212 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:04.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:04 smithi175 ceph-mon[34510]: mgrmap e25: x(active, since 9m), standbys: z, y 2024-09-21T06:29:04.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:04 smithi071 ceph-mon[34844]: mgrmap e25: x(active, since 9m), standbys: z, y 2024-09-21T06:29:04.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.815+0000 7f75bcf8d640 1 -- 172.21.15.63:0/2709079643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75b8102ae0 msgr2=0x7f75b8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:04.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.815+0000 7f75bcf8d640 1 --2- 172.21.15.63:0/2709079643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75b8102ae0 0x7f75b8102ef0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009900 tx=0x7f75a802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.816+0000 7f75bcf8d640 1 -- 172.21.15.63:0/2709079643 shutdown_connections 2024-09-21T06:29:04.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.816+0000 7f75bcf8d640 1 --2- 172.21.15.63:0/2709079643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75b8108d20 0x7f75b810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.816+0000 7f75bcf8d640 1 --2- 172.21.15.63:0/2709079643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75b81083d0 0x7f75b81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.816+0000 7f75bcf8d640 1 --2- 172.21.15.63:0/2709079643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75b8102ae0 0x7f75b8102ef0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.816+0000 7f75bcf8d640 1 -- 172.21.15.63:0/2709079643 >> 172.21.15.63:0/2709079643 conn(0x7f75b80797b0 msgr2=0x7f75b8079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:04.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.816+0000 7f75bcf8d640 1 -- 172.21.15.63:0/2709079643 shutdown_connections 2024-09-21T06:29:04.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.816+0000 7f75bcf8d640 1 -- 172.21.15.63:0/2709079643 wait complete. 2024-09-21T06:29:04.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.817+0000 7f75bcf8d640 1 Processor -- start 2024-09-21T06:29:04.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.817+0000 7f75bcf8d640 1 -- start start 2024-09-21T06:29:04.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.817+0000 7f75bcf8d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75b8102ae0 0x7f75b8198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.818+0000 7f75bcf8d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75b81083d0 0x7f75b8198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.818+0000 7f75bcf8d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75b8108d20 0x7f75b819dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.818+0000 7f75bcf8d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81118e0 con 0x7f75b8108d20 2024-09-21T06:29:04.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.818+0000 7f75b659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75b8102ae0 0x7f75b8198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.818+0000 7f75b659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75b8102ae0 0x7f75b8198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:41160/0 (socket says 172.21.15.63:41160) 2024-09-21T06:29:04.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.818+0000 7f75b659c640 1 -- 172.21.15.63:0/454801265 learned_addr learned my addr 172.21.15.63:0/454801265 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:04.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.818+0000 7f75b6d9d640 1 --2- 172.21.15.63:0/454801265 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75b8108d20 0x7f75b819dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.818+0000 7f75b5d9b640 1 --2- 172.21.15.63:0/454801265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75b81083d0 0x7f75b8198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.818+0000 7f75bcf8d640 1 -- 172.21.15.63:0/454801265 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f75b8111760 con 0x7f75b8102ae0 2024-09-21T06:29:04.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.818+0000 7f75bcf8d640 1 -- 172.21.15.63:0/454801265 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75b8111a60 con 0x7f75b81083d0 2024-09-21T06:29:04.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.819+0000 7f75b659c640 1 -- 172.21.15.63:0/454801265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75b81083d0 msgr2=0x7f75b8198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:04.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.819+0000 7f75b659c640 1 --2- 172.21.15.63:0/454801265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75b81083d0 0x7f75b8198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.819+0000 7f75b659c640 1 -- 172.21.15.63:0/454801265 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75b8108d20 msgr2=0x7f75b819dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:04.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.819+0000 7f75b659c640 1 --2- 172.21.15.63:0/454801265 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75b8108d20 0x7f75b819dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.819+0000 7f75b659c640 1 -- 172.21.15.63:0/454801265 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b819e200 con 0x7f75b8102ae0 2024-09-21T06:29:04.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.819+0000 7f75b6d9d640 1 --2- 172.21.15.63:0/454801265 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75b8108d20 0x7f75b819dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:04.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.819+0000 7f75b659c640 1 --2- 172.21.15.63:0/454801265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75b8102ae0 0x7f75b8198290 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f75a8005940 tx=0x7f75a80040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:04.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.819+0000 7f75a77fe640 1 -- 172.21.15.63:0/454801265 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a803f030 con 0x7f75b8102ae0 2024-09-21T06:29:04.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.819+0000 7f75a77fe640 1 -- 172.21.15.63:0/454801265 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75a80044c0 con 0x7f75b8102ae0 2024-09-21T06:29:04.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.820+0000 7f75bcf8d640 1 -- 172.21.15.63:0/454801265 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75b819e490 con 0x7f75b8102ae0 2024-09-21T06:29:04.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.821+0000 7f75a77fe640 1 -- 172.21.15.63:0/454801265 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a8035070 con 0x7f75b8102ae0 2024-09-21T06:29:04.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.821+0000 7f75bcf8d640 1 -- 172.21.15.63:0/454801265 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75b81a4c50 con 0x7f75b8102ae0 2024-09-21T06:29:04.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.823+0000 7f75a77fe640 1 -- 172.21.15.63:0/454801265 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f75a8042030 con 0x7f75b8102ae0 2024-09-21T06:29:04.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.824+0000 7f75a77fe640 1 --2- 172.21.15.63:0/454801265 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f75a00b6700 0x7f75a00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.825+0000 7f75a77fe640 1 -- 172.21.15.63:0/454801265 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f75a81075b0 con 0x7f75b8102ae0 2024-09-21T06:29:04.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.825+0000 7f75b5d9b640 1 --2- 172.21.15.63:0/454801265 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f75a00b6700 0x7f75a00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.825+0000 7f75c3501740 1 Processor -- start 2024-09-21T06:29:04.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.825+0000 7f75c3501740 1 -- start start 2024-09-21T06:29:04.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.826+0000 7f75c3501740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5557b26f3070 0x5557b2a9a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.826+0000 7f75c3501740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26ca1b0 0x5557b2a9abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.826+0000 7f75c3501740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26d2390 0x5557b2a9b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.826+0000 7f75c3501740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5557b2a10ea0 con 0x5557b26ca1b0 2024-09-21T06:29:04.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.826+0000 7f75c3501740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5557b2a002d0 con 0x5557b26f3070 2024-09-21T06:29:04.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.826+0000 7f75c3501740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5557b2a040e0 con 0x5557b26d2390 2024-09-21T06:29:04.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.826+0000 7f75b6d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26d2390 0x5557b2a9b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.826+0000 7f75b6d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26d2390 0x5557b2a9b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:52830/0 (socket says 172.21.15.63:52830) 2024-09-21T06:29:04.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.826+0000 7f75b6d9d640 1 -- 172.21.15.63:0/1560823918 learned_addr learned my addr 172.21.15.63:0/1560823918 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:04.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.826+0000 7f75b6d9d640 1 -- 172.21.15.63:0/1560823918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5557b26f3070 msgr2=0x5557b2a9a6a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:29:04.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.826+0000 7f75b6d9d640 1 --2- 172.21.15.63:0/1560823918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5557b26f3070 0x5557b2a9a6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.826+0000 7f75b6d9d640 1 -- 172.21.15.63:0/1560823918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26ca1b0 msgr2=0x5557b2a9abe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:29:04.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.826+0000 7f75b6d9d640 1 --2- 172.21.15.63:0/1560823918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26ca1b0 0x5557b2a9abe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.826+0000 7f75b6d9d640 1 -- 172.21.15.63:0/1560823918 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557b275e650 con 0x5557b26d2390 2024-09-21T06:29:04.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.827+0000 7f75b6d9d640 1 --2- 172.21.15.63:0/1560823918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26d2390 0x5557b2a9b120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f75b000c7b0 tx=0x7f75b0009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d02f28194f2a09e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:04.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.827+0000 7f75b5d9b640 1 --2- 172.21.15.63:0/454801265 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f75a00b6700 0x7f75a00b8c10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0095f0 tx=0x7f75ac005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:04.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.827+0000 7f75a4ff9640 1 -- 172.21.15.63:0/1560823918 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b001c020 con 0x5557b26d2390 2024-09-21T06:29:04.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.827+0000 7f75a4ff9640 1 -- 172.21.15.63:0/1560823918 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75b0003e20 con 0x5557b26d2390 2024-09-21T06:29:04.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.828+0000 7f75c3501740 1 -- 172.21.15.63:0/1560823918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26d2390 msgr2=0x5557b2a9b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:04.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.828+0000 7f75c3501740 1 --2- 172.21.15.63:0/1560823918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26d2390 0x5557b2a9b120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f75b000c7b0 tx=0x7f75b0009500 comp rx=0 tx=0).stop 2024-09-21T06:29:04.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.828+0000 7f75c3501740 1 -- 172.21.15.63:0/1560823918 shutdown_connections 2024-09-21T06:29:04.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.828+0000 7f75c3501740 1 --2- 172.21.15.63:0/1560823918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26d2390 0x5557b2a9b120 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.828+0000 7f75c3501740 1 --2- 172.21.15.63:0/1560823918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26ca1b0 0x5557b2a9abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.828+0000 7f75c3501740 1 --2- 172.21.15.63:0/1560823918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5557b26f3070 0x5557b2a9a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.828+0000 7f75c3501740 1 -- 172.21.15.63:0/1560823918 >> 172.21.15.63:0/1560823918 conn(0x5557b26e7460 msgr2=0x5557b2a98590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:04.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.829+0000 7f75c3501740 1 -- 172.21.15.63:0/1560823918 shutdown_connections 2024-09-21T06:29:04.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.829+0000 7f75c3501740 1 -- 172.21.15.63:0/1560823918 wait complete. 2024-09-21T06:29:04.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.829+0000 7f75c3501740 1 -- start start 2024-09-21T06:29:04.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.830+0000 7f75c3501740 1 Processor -- start 2024-09-21T06:29:04.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.830+0000 7f75c3501740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5557b26ca1b0 0x5557b2aa5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.830+0000 7f75c3501740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26d2390 0x5557b2aa6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.830+0000 7f75c3501740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26f3070 0x5557b2ab2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.830+0000 7f75c3501740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5557b2861700 con 0x5557b26d2390 2024-09-21T06:29:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.830+0000 7f75c3501740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5557b299b160 con 0x5557b26ca1b0 2024-09-21T06:29:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.830+0000 7f75c3501740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5557b2aa8f20 con 0x5557b26f3070 2024-09-21T06:29:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.830+0000 7f75c3501740 10 client.0 _ll_register_callbacks cb 0x5557b29b49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.830+0000 7f75b6d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26f3070 0x5557b2ab2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.830+0000 7f75b6d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26f3070 0x5557b2ab2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:52844/0 (socket says 172.21.15.63:52844) 2024-09-21T06:29:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.830+0000 7f75b6d9d640 1 -- 172.21.15.63:0/4019293994 learned_addr learned my addr 172.21.15.63:0/4019293994 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.831+0000 7f75b6d9d640 1 -- 172.21.15.63:0/4019293994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5557b26ca1b0 msgr2=0x5557b2aa5cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:29:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.831+0000 7f75b6d9d640 1 --2- 172.21.15.63:0/4019293994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5557b26ca1b0 0x5557b2aa5cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.831+0000 7f75b6d9d640 1 -- 172.21.15.63:0/4019293994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26d2390 msgr2=0x5557b2aa6230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:29:04.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.831+0000 7f75b5d9b640 1 --2- 172.21.15.63:0/4019293994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26d2390 0x5557b2aa6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.831+0000 7f75b6d9d640 1 --2- 172.21.15.63:0/4019293994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26d2390 0x5557b2aa6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.831+0000 7f75b6d9d640 1 -- 172.21.15.63:0/4019293994 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557b29c8c90 con 0x5557b26f3070 2024-09-21T06:29:04.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.831+0000 7f75b5d9b640 1 --2- 172.21.15.63:0/4019293994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26d2390 0x5557b2aa6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:04.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.831+0000 7f75b6d9d640 1 --2- 172.21.15.63:0/4019293994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26f3070 0x5557b2ab2290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f75b0004130 tx=0x7f75b0005860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66cf945370e94c57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:04.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.831+0000 7f759dffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:29:04.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.832+0000 7f759dffb640 1 -- 172.21.15.63:0/4019293994 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b001c030 con 0x5557b26f3070 2024-09-21T06:29:04.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.832+0000 7f759dffb640 1 -- 172.21.15.63:0/4019293994 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f75b0013990 con 0x5557b26f3070 2024-09-21T06:29:04.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.832+0000 7f75c3501740 1 -- 172.21.15.63:0/4019293994 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75b0003e20 con 0x5557b26f3070 2024-09-21T06:29:04.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.832+0000 7f759dffb640 1 -- 172.21.15.63:0/4019293994 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f75b0013bd0 con 0x5557b26f3070 2024-09-21T06:29:04.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.832+0000 7f75c3501740 10 client.25447 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:04.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.832+0000 7f75c3501740 1 -- 172.21.15.63:0/4019293994 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5557b2ab4c30 con 0x5557b26f3070 2024-09-21T06:29:04.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.832+0000 7f759dffb640 1 -- 172.21.15.63:0/4019293994 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75b002f020 con 0x5557b26f3070 2024-09-21T06:29:04.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.832+0000 7f759dffb640 1 -- 172.21.15.63:0/4019293994 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f75b002d4f0 con 0x5557b26f3070 2024-09-21T06:29:04.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.832+0000 7f75c3501740 10 client.25447 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:04.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.832+0000 7f75c3501740 10 client.25447 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:04.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.832+0000 7f75c3501740 20 client.25447 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:04.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.833+0000 7f75c3501740 1 --2- 172.21.15.63:0/4019293994 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5557b26b19f0 0x5557b2ab8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.833+0000 7f75c3501740 4 client.25447 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:04.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.833+0000 7f75c3501740 1 -- 172.21.15.63:0/4019293994 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f75b0003e20 con 0x5557b26b19f0 2024-09-21T06:29:04.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.833+0000 7f75b659c640 1 --2- 172.21.15.63:0/4019293994 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5557b26b19f0 0x5557b2ab8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.833+0000 7f759dffb640 10 client.25447 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:04.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.833+0000 7f75b659c640 1 --2- 172.21.15.63:0/4019293994 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5557b26b19f0 0x5557b2ab8090 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a3687451afc178b server_cookie=e5be0869a74028ca in_seq=0 out_seq=0 2024-09-21T06:29:04.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.834+0000 7f759dffb640 1 -- 172.21.15.63:0/4019293994 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f75b0003e20 con 0x5557b26b19f0 2024-09-21T06:29:04.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.834+0000 7f759dffb640 10 client.25447 handle_command_reply: tid=0 2024-09-21T06:29:04.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.834+0000 7f75c3501740 1 client.25447 shutdown 2024-09-21T06:29:04.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.835+0000 7f75c3501740 1 -- 172.21.15.63:0/4019293994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26f3070 msgr2=0x5557b2ab2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:04.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.835+0000 7f75c3501740 1 --2- 172.21.15.63:0/4019293994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26f3070 0x5557b2ab2290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f75b0004130 tx=0x7f75b0005860 comp rx=0 tx=0).stop 2024-09-21T06:29:04.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.835+0000 7f75c3501740 1 -- 172.21.15.63:0/4019293994 shutdown_connections 2024-09-21T06:29:04.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.835+0000 7f75c3501740 1 --2- 172.21.15.63:0/4019293994 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5557b26b19f0 0x5557b2ab8090 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.835+0000 7f75c3501740 1 --2- 172.21.15.63:0/4019293994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26f3070 0x5557b2ab2290 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.835+0000 7f75c3501740 1 --2- 172.21.15.63:0/4019293994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26d2390 0x5557b2aa6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.835+0000 7f75c3501740 1 --2- 172.21.15.63:0/4019293994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5557b26ca1b0 0x5557b2aa5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.835+0000 7f75c3501740 1 -- 172.21.15.63:0/4019293994 >> 172.21.15.63:0/4019293994 conn(0x5557b26e7460 msgr2=0x5557b2a9d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:04.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.835+0000 7f759dffb640 0 client.25447 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:04.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.835+0000 7f75c3501740 1 -- 172.21.15.63:0/4019293994 shutdown_connections 2024-09-21T06:29:04.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.835+0000 7f75c3501740 1 -- 172.21.15.63:0/4019293994 wait complete. 2024-09-21T06:29:04.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.835+0000 7f75c3501740 20 client.25447 trim_cache size 0 max 16384 2024-09-21T06:29:04.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.849+0000 7f75c3501740 1 Processor -- start 2024-09-21T06:29:04.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.850+0000 7f75c3501740 1 -- start start 2024-09-21T06:29:04.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.850+0000 7f75c3501740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5557b26ca1b0 0x5557b2a9c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.850+0000 7f75c3501740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26d2390 0x5557b2ab2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.850+0000 7f75c3501740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26f3070 0x5557b2aa7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.850+0000 7f75c3501740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81ad400 con 0x5557b26f3070 2024-09-21T06:29:04.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.850+0000 7f75c3501740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81aef40 con 0x5557b26ca1b0 2024-09-21T06:29:04.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.850+0000 7f75c3501740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81adad0 con 0x5557b26d2390 2024-09-21T06:29:04.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.850+0000 7f75b659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5557b26ca1b0 0x5557b2a9c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.850+0000 7f75b659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5557b26ca1b0 0x5557b2a9c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:41188/0 (socket says 172.21.15.63:41188) 2024-09-21T06:29:04.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.850+0000 7f75b659c640 1 -- 172.21.15.63:0/45684298 learned_addr learned my addr 172.21.15.63:0/45684298 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:04.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.851+0000 7f75b6d9d640 1 --2- 172.21.15.63:0/45684298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26f3070 0x5557b2aa7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.851+0000 7f75b659c640 1 -- 172.21.15.63:0/45684298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26d2390 msgr2=0x5557b2ab2190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:29:04.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.851+0000 7f75b659c640 1 --2- 172.21.15.63:0/45684298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26d2390 0x5557b2ab2190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.851+0000 7f75b659c640 1 -- 172.21.15.63:0/45684298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26f3070 msgr2=0x5557b2aa7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:04.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.851+0000 7f75b659c640 1 --2- 172.21.15.63:0/45684298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26f3070 0x5557b2aa7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.851+0000 7f75b659c640 1 -- 172.21.15.63:0/45684298 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557b2aa6fb0 con 0x5557b26ca1b0 2024-09-21T06:29:04.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.851+0000 7f75b6d9d640 1 --2- 172.21.15.63:0/45684298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26f3070 0x5557b2aa7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:04.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.851+0000 7f75b659c640 1 --2- 172.21.15.63:0/45684298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5557b26ca1b0 0x5557b2a9c090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f75a8105340 tx=0x7f75a8004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef21d92971ecc9ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:04.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.851+0000 7f759ffff640 1 -- 172.21.15.63:0/45684298 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a807a070 con 0x5557b26ca1b0 2024-09-21T06:29:04.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.851+0000 7f759ffff640 1 -- 172.21.15.63:0/45684298 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75a80d6e60 con 0x5557b26ca1b0 2024-09-21T06:29:04.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.851+0000 7f759ffff640 1 -- 172.21.15.63:0/45684298 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a8049040 con 0x5557b26ca1b0 2024-09-21T06:29:04.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.852+0000 7f75c3501740 1 -- 172.21.15.63:0/45684298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5557b26ca1b0 msgr2=0x5557b2a9c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:04.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.852+0000 7f75c3501740 1 --2- 172.21.15.63:0/45684298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5557b26ca1b0 0x5557b2a9c090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f75a8105340 tx=0x7f75a8004040 comp rx=0 tx=0).stop 2024-09-21T06:29:04.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.852+0000 7f75c3501740 1 -- 172.21.15.63:0/45684298 shutdown_connections 2024-09-21T06:29:04.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.852+0000 7f75c3501740 1 --2- 172.21.15.63:0/45684298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26f3070 0x5557b2aa7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.852+0000 7f75c3501740 1 --2- 172.21.15.63:0/45684298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26d2390 0x5557b2ab2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.852+0000 7f75c3501740 1 --2- 172.21.15.63:0/45684298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5557b26ca1b0 0x5557b2a9c090 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.852+0000 7f75c3501740 1 -- 172.21.15.63:0/45684298 >> 172.21.15.63:0/45684298 conn(0x5557b26e7460 msgr2=0x5557b2aa7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:04.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.853+0000 7f75c3501740 1 -- 172.21.15.63:0/45684298 shutdown_connections 2024-09-21T06:29:04.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.853+0000 7f75c3501740 1 -- 172.21.15.63:0/45684298 wait complete. 2024-09-21T06:29:04.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.853+0000 7f75c3501740 1 -- start start 2024-09-21T06:29:04.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.853+0000 7f75c3501740 1 Processor -- start 2024-09-21T06:29:04.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.854+0000 7f75c3501740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26ca1b0 0x5557b2aaa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.854+0000 7f75c3501740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26d2390 0x5557b2aaa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.854+0000 7f75c3501740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5557b26f3070 0x5557b2aaad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.854+0000 7f75c3501740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81ae870 con 0x5557b26ca1b0 2024-09-21T06:29:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.854+0000 7f75c3501740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81ae1a0 con 0x5557b26f3070 2024-09-21T06:29:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.854+0000 7f75c3501740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81ab3e0 con 0x5557b26d2390 2024-09-21T06:29:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.854+0000 7f75c3501740 10 client.0 _ll_register_callbacks cb 0x7f75b000c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.854+0000 7f75b659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26ca1b0 0x5557b2aaa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.854+0000 7f75b659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26ca1b0 0x5557b2aaa290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35630/0 (socket says 172.21.15.63:35630) 2024-09-21T06:29:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.854+0000 7f75b659c640 1 -- 172.21.15.63:0/2428953046 learned_addr learned my addr 172.21.15.63:0/2428953046 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:04.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.854+0000 7f75b6d9d640 1 --2- 172.21.15.63:0/2428953046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5557b26f3070 0x5557b2aaad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.854+0000 7f75b659c640 1 -- 172.21.15.63:0/2428953046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26d2390 msgr2=0x5557b2aaa7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:04.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.854+0000 7f75b659c640 1 --2- 172.21.15.63:0/2428953046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26d2390 0x5557b2aaa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.854+0000 7f75b659c640 1 -- 172.21.15.63:0/2428953046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5557b26f3070 msgr2=0x5557b2aaad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:04.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.854+0000 7f75b659c640 1 --2- 172.21.15.63:0/2428953046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5557b26f3070 0x5557b2aaad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.854+0000 7f75b659c640 1 -- 172.21.15.63:0/2428953046 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557b2b25f30 con 0x5557b26ca1b0 2024-09-21T06:29:04.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.855+0000 7f75b659c640 1 --2- 172.21.15.63:0/2428953046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26ca1b0 0x5557b2aaa290 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f75a8104df0 tx=0x7f75a80d1fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d9e88588fcf1e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:04.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.855+0000 7f759dffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:04.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.855+0000 7f759dffb640 1 -- 172.21.15.63:0/2428953046 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a807a030 con 0x5557b26ca1b0 2024-09-21T06:29:04.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.855+0000 7f75c3501740 1 -- 172.21.15.63:0/2428953046 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75a80d6e60 con 0x5557b26ca1b0 2024-09-21T06:29:04.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.855+0000 7f759dffb640 1 -- 172.21.15.63:0/2428953046 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f75a8104fc0 con 0x5557b26ca1b0 2024-09-21T06:29:04.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.855+0000 7f759dffb640 1 -- 172.21.15.63:0/2428953046 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f75a8049070 con 0x5557b26ca1b0 2024-09-21T06:29:04.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.855+0000 7f75c3501740 10 client.15723 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:04.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.855+0000 7f75c3501740 1 -- 172.21.15.63:0/2428953046 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5557b2b27120 con 0x5557b26ca1b0 2024-09-21T06:29:04.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.856+0000 7f759dffb640 1 -- 172.21.15.63:0/2428953046 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75a80d6e60 con 0x5557b26ca1b0 2024-09-21T06:29:04.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.856+0000 7f759dffb640 1 -- 172.21.15.63:0/2428953046 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f75a80cc350 con 0x5557b26ca1b0 2024-09-21T06:29:04.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.856+0000 7f75c3501740 10 client.15723 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:04.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.856+0000 7f75c3501740 10 client.15723 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:04.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.856+0000 7f75c3501740 20 client.15723 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:04.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.856+0000 7f75c3501740 1 --2- 172.21.15.63:0/2428953046 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5557b2686da0 0x5557b2b29890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.856+0000 7f75c3501740 4 client.15723 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:29:04.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.856+0000 7f75c3501740 1 -- 172.21.15.63:0/2428953046 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5557b2a12df0 con 0x5557b2686da0 2024-09-21T06:29:04.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.856+0000 7f75b5d9b640 1 --2- 172.21.15.63:0/2428953046 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5557b2686da0 0x5557b2b29890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.857+0000 7f759dffb640 10 client.15723 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:04.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.857+0000 7f75b5d9b640 1 --2- 172.21.15.63:0/2428953046 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5557b2686da0 0x5557b2b29890 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f768cd66a56ae4b1 server_cookie=c0b0ec523c159bd8 in_seq=0 out_seq=0 2024-09-21T06:29:04.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.858+0000 7f759dffb640 1 -- 172.21.15.63:0/2428953046 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5557b2a12df0 con 0x5557b2686da0 2024-09-21T06:29:04.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.858+0000 7f759dffb640 10 client.15723 handle_command_reply: tid=0 2024-09-21T06:29:04.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.858+0000 7f75c3501740 1 client.15723 shutdown 2024-09-21T06:29:04.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.858+0000 7f75c3501740 1 -- 172.21.15.63:0/2428953046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26ca1b0 msgr2=0x5557b2aaa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:04.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.858+0000 7f75c3501740 1 --2- 172.21.15.63:0/2428953046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26ca1b0 0x5557b2aaa290 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f75a8104df0 tx=0x7f75a80d1fe0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.858+0000 7f75c3501740 1 -- 172.21.15.63:0/2428953046 shutdown_connections 2024-09-21T06:29:04.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.858+0000 7f75c3501740 1 --2- 172.21.15.63:0/2428953046 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5557b2686da0 0x5557b2b29890 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.858+0000 7f75c3501740 1 --2- 172.21.15.63:0/2428953046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5557b26f3070 0x5557b2aaad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.858+0000 7f75c3501740 1 --2- 172.21.15.63:0/2428953046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557b26d2390 0x5557b2aaa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.858+0000 7f75c3501740 1 --2- 172.21.15.63:0/2428953046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5557b26ca1b0 0x5557b2aaa290 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.858+0000 7f75c3501740 1 -- 172.21.15.63:0/2428953046 >> 172.21.15.63:0/2428953046 conn(0x5557b26e7460 msgr2=0x5557b2a9be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:04.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.858+0000 7f759dffb640 0 client.15723 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:04.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.858+0000 7f75c3501740 1 -- 172.21.15.63:0/2428953046 shutdown_connections 2024-09-21T06:29:04.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.858+0000 7f75c3501740 1 -- 172.21.15.63:0/2428953046 wait complete. 2024-09-21T06:29:04.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.858+0000 7f75c3501740 20 client.15723 trim_cache size 0 max 16384 2024-09-21T06:29:04.863 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:29:04.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.859+0000 7f75bcf8d640 1 -- 172.21.15.63:0/454801265 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f75a00b6700 msgr2=0x7f75a00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:04.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.859+0000 7f75bcf8d640 1 --2- 172.21.15.63:0/454801265 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f75a00b6700 0x7f75a00b8c10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0095f0 tx=0x7f75ac005f90 comp rx=0 tx=0).stop 2024-09-21T06:29:04.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.859+0000 7f75bcf8d640 1 -- 172.21.15.63:0/454801265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75b8102ae0 msgr2=0x7f75b8198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:04.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.859+0000 7f75bcf8d640 1 --2- 172.21.15.63:0/454801265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75b8102ae0 0x7f75b8198290 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f75a8005940 tx=0x7f75a80040c0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.859+0000 7f75bcf8d640 1 -- 172.21.15.63:0/454801265 shutdown_connections 2024-09-21T06:29:04.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.859+0000 7f75bcf8d640 1 --2- 172.21.15.63:0/454801265 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75b8108d20 0x7f75b819dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.859+0000 7f75bcf8d640 1 --2- 172.21.15.63:0/454801265 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f75a00b6700 0x7f75a00b8c10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.859+0000 7f75bcf8d640 1 --2- 172.21.15.63:0/454801265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75b81083d0 0x7f75b8198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.859+0000 7f75bcf8d640 1 --2- 172.21.15.63:0/454801265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75b8102ae0 0x7f75b8198290 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.859+0000 7f75bcf8d640 1 -- 172.21.15.63:0/454801265 >> 172.21.15.63:0/454801265 conn(0x7f75b80797b0 msgr2=0x7f75b8106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:04.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.860+0000 7f75bcf8d640 1 -- 172.21.15.63:0/454801265 shutdown_connections 2024-09-21T06:29:04.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:04.860+0000 7f75bcf8d640 1 -- 172.21.15.63:0/454801265 wait complete. 2024-09-21T06:29:05.029 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:05 smithi063 ceph-mon[31150]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 24 op/s 2024-09-21T06:29:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.229+0000 7f6abf7fe640 1 -- 172.21.15.63:0/303135782 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c4a62690f0 con 0x55c4a5ee51c0 2024-09-21T06:29:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.230+0000 7f6abf7fe640 10 client.25420 handle_command_reply: tid=0 2024-09-21T06:29:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.230+0000 7f6aeda89740 1 client.25420 shutdown 2024-09-21T06:29:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.230+0000 7f6aeda89740 1 -- 172.21.15.63:0/303135782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f304d0 msgr2=0x55c4a6307aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.230+0000 7f6aeda89740 1 --2- 172.21.15.63:0/303135782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f304d0 0x55c4a6307aa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4025990 tx=0x7f6ad401dca0 comp rx=0 tx=0).stop 2024-09-21T06:29:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.230+0000 7f6aeda89740 1 -- 172.21.15.63:0/303135782 shutdown_connections 2024-09-21T06:29:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.230+0000 7f6aeda89740 1 --2- 172.21.15.63:0/303135782 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c4a5ee51c0 0x55c4a6380700 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.230+0000 7f6aeda89740 1 --2- 172.21.15.63:0/303135782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4a5f511b0 0x55c4a6307fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.230+0000 7f6aeda89740 1 --2- 172.21.15.63:0/303135782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4a5f304d0 0x55c4a6307aa0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.230+0000 7f6aeda89740 1 --2- 172.21.15.63:0/303135782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4a5f282f0 0x55c4a6307560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.230+0000 7f6abf7fe640 0 client.25420 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.230+0000 7f6aeda89740 1 -- 172.21.15.63:0/303135782 >> 172.21.15.63:0/303135782 conn(0x55c4a5f45300 msgr2=0x55c4a62f8170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.230+0000 7f6aeda89740 1 -- 172.21.15.63:0/303135782 shutdown_connections 2024-09-21T06:29:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.230+0000 7f6aeda89740 1 -- 172.21.15.63:0/303135782 wait complete. 2024-09-21T06:29:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.230+0000 7f6aeda89740 20 client.25420 trim_cache size 0 max 16384 2024-09-21T06:29:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout:{ 2024-09-21T06:29:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout: "message": "", 2024-09-21T06:29:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout: "return_code": 0 2024-09-21T06:29:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout:} 2024-09-21T06:29:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.231+0000 7f6ae6a40640 1 -- 172.21.15.63:0/4293065620 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6ac80b6720 msgr2=0x7f6ac80b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.231+0000 7f6ae6a40640 1 --2- 172.21.15.63:0/4293065620 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6ac80b6720 0x7f6ac80b8c30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00cd590 tx=0x7f6ad00c9040 comp rx=0 tx=0).stop 2024-09-21T06:29:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.231+0000 7f6ae6a40640 1 -- 172.21.15.63:0/4293065620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae0102060 msgr2=0x7f6ae0102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.231+0000 7f6ae6a40640 1 --2- 172.21.15.63:0/4293065620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae0102060 0x7f6ae0102ff0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0005940 tx=0x7f6ad00040c0 comp rx=0 tx=0).stop 2024-09-21T06:29:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.231+0000 7f6ae6a40640 1 -- 172.21.15.63:0/4293065620 shutdown_connections 2024-09-21T06:29:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.231+0000 7f6ae6a40640 1 --2- 172.21.15.63:0/4293065620 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6ac80b6720 0x7f6ac80b8c30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.232+0000 7f6ae6a40640 1 --2- 172.21.15.63:0/4293065620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ae0109d80 0x7f6ae0103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.232+0000 7f6ae6a40640 1 --2- 172.21.15.63:0/4293065620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae0109430 0x7f6ae0103530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.232+0000 7f6ae6a40640 1 --2- 172.21.15.63:0/4293065620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae0102060 0x7f6ae0102ff0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.232+0000 7f6ae6a40640 1 -- 172.21.15.63:0/4293065620 >> 172.21.15.63:0/4293065620 conn(0x7f6ae0079e90 msgr2=0x7f6ae01074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.232+0000 7f6ae6a40640 1 -- 172.21.15.63:0/4293065620 shutdown_connections 2024-09-21T06:29:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:05.232+0000 7f6ae6a40640 1 -- 172.21.15.63:0/4293065620 wait complete. 2024-09-21T06:29:05.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:05 smithi175 ceph-mon[34510]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 24 op/s 2024-09-21T06:29:05.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:05 smithi071 ceph-mon[34844]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 24 op/s 2024-09-21T06:29:06.568 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:29:06.568 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:29:06.964 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:07.301 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:07 smithi063 ceph-mon[31150]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-09-21T06:29:07.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:07 smithi175 ceph-mon[34510]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-09-21T06:29:07.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:07 smithi071 ceph-mon[34844]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-09-21T06:29:07.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.540+0000 7fd7a4501640 1 -- 172.21.15.63:0/2189888728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd79c110180 msgr2=0x7fd79c1125a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:07.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.540+0000 7fd7a4501640 1 --2- 172.21.15.63:0/2189888728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd79c110180 0x7fd79c1125a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd794009ca0 tx=0x7fd79402a950 comp rx=0 tx=0).stop 2024-09-21T06:29:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.541+0000 7fd7a4501640 1 -- 172.21.15.63:0/2189888728 shutdown_connections 2024-09-21T06:29:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.541+0000 7fd7a4501640 1 --2- 172.21.15.63:0/2189888728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd79c110180 0x7fd79c1125a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.541+0000 7fd7a4501640 1 --2- 172.21.15.63:0/2189888728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd79c102f20 0x7fd79c10fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.541+0000 7fd7a4501640 1 --2- 172.21.15.63:0/2189888728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd79c1025d0 0x7fd79c1029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.541+0000 7fd7a4501640 1 -- 172.21.15.63:0/2189888728 >> 172.21.15.63:0/2189888728 conn(0x7fd79c079730 msgr2=0x7fd79c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.541+0000 7fd7a4501640 1 -- 172.21.15.63:0/2189888728 shutdown_connections 2024-09-21T06:29:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.541+0000 7fd7a4501640 1 -- 172.21.15.63:0/2189888728 wait complete. 2024-09-21T06:29:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.542+0000 7fd7a4501640 1 Processor -- start 2024-09-21T06:29:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.542+0000 7fd7a4501640 1 -- start start 2024-09-21T06:29:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.542+0000 7fd7a4501640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd79c1025d0 0x7fd79c19c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.542+0000 7fd7a4501640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd79c102f20 0x7fd79c19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.542+0000 7fd7a4501640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd79c110180 0x7fd79c1a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.542+0000 7fd7a229d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd79c1025d0 0x7fd79c19c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.542+0000 7fd7a229d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd79c1025d0 0x7fd79c19c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57460/0 (socket says 172.21.15.63:57460) 2024-09-21T06:29:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.542+0000 7fd7a1a9c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd79c102f20 0x7fd79c19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.542+0000 7fd7a1a9c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd79c102f20 0x7fd79c19cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:51738/0 (socket says 172.21.15.63:51738) 2024-09-21T06:29:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.542+0000 7fd7a229d640 1 -- 172.21.15.63:0/2868304286 learned_addr learned my addr 172.21.15.63:0/2868304286 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.543+0000 7fd7a4501640 1 -- 172.21.15.63:0/2868304286 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c115c70 con 0x7fd79c1025d0 2024-09-21T06:29:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.543+0000 7fd7a4501640 1 -- 172.21.15.63:0/2868304286 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c115af0 con 0x7fd79c102f20 2024-09-21T06:29:07.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.543+0000 7fd7a4501640 1 -- 172.21.15.63:0/2868304286 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c115df0 con 0x7fd79c110180 2024-09-21T06:29:07.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.543+0000 7fd7a2a9e640 1 --2- 172.21.15.63:0/2868304286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd79c110180 0x7fd79c1a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.543+0000 7fd7a1a9c640 1 -- 172.21.15.63:0/2868304286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd79c110180 msgr2=0x7fd79c1a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:07.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.543+0000 7fd7a1a9c640 1 --2- 172.21.15.63:0/2868304286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd79c110180 0x7fd79c1a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.543+0000 7fd7a1a9c640 1 -- 172.21.15.63:0/2868304286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd79c1025d0 msgr2=0x7fd79c19c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:07.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.543+0000 7fd7a1a9c640 1 --2- 172.21.15.63:0/2868304286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd79c1025d0 0x7fd79c19c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.543+0000 7fd7a1a9c640 1 -- 172.21.15.63:0/2868304286 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79c1a25f0 con 0x7fd79c102f20 2024-09-21T06:29:07.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.543+0000 7fd7a229d640 1 --2- 172.21.15.63:0/2868304286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd79c1025d0 0x7fd79c19c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:07.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.544+0000 7fd7a1a9c640 1 --2- 172.21.15.63:0/2868304286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd79c102f20 0x7fd79c19cc20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd79800e9f0 tx=0x7fd79800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:07.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.544+0000 7fd7937fe640 1 -- 172.21.15.63:0/2868304286 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79800ccc0 con 0x7fd79c102f20 2024-09-21T06:29:07.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.544+0000 7fd7937fe640 1 -- 172.21.15.63:0/2868304286 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7980108e0 con 0x7fd79c102f20 2024-09-21T06:29:07.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.544+0000 7fd7a4501640 1 -- 172.21.15.63:0/2868304286 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd79c1a28e0 con 0x7fd79c102f20 2024-09-21T06:29:07.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.544+0000 7fd7937fe640 1 -- 172.21.15.63:0/2868304286 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd798018880 con 0x7fd79c102f20 2024-09-21T06:29:07.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.545+0000 7fd7a4501640 1 -- 172.21.15.63:0/2868304286 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd79c1a9040 con 0x7fd79c102f20 2024-09-21T06:29:07.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.547+0000 7fd7937fe640 1 -- 172.21.15.63:0/2868304286 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fd798010430 con 0x7fd79c102f20 2024-09-21T06:29:07.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.548+0000 7fd7937fe640 1 --2- 172.21.15.63:0/2868304286 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd7880b6680 0x7fd7880b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.549+0000 7fd7a229d640 1 --2- 172.21.15.63:0/2868304286 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd7880b6680 0x7fd7880b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.549+0000 7fd7aaa75740 1 Processor -- start 2024-09-21T06:29:07.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.549+0000 7fd7aaa75740 1 -- start start 2024-09-21T06:29:07.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.549+0000 7fd7aaa75740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec7a350 0x55db1f021430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.550+0000 7fd7aaa75740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec51490 0x55db1f021970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.550+0000 7fd7aaa75740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec59670 0x55db1f021eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.550+0000 7fd7aaa75740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55db1ef97e60 con 0x55db1ec51490 2024-09-21T06:29:07.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.550+0000 7fd7aaa75740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55db1ef87290 con 0x55db1ec7a350 2024-09-21T06:29:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.550+0000 7fd7aaa75740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55db1ef8b0a0 con 0x55db1ec59670 2024-09-21T06:29:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.550+0000 7fd7a2a9e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec59670 0x55db1f021eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.550+0000 7fd7a2a9e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec59670 0x55db1f021eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:44450/0 (socket says 172.21.15.63:44450) 2024-09-21T06:29:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.550+0000 7fd7a2a9e640 1 -- 172.21.15.63:0/1788353349 learned_addr learned my addr 172.21.15.63:0/1788353349 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.550+0000 7fd7a2a9e640 1 -- 172.21.15.63:0/1788353349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec7a350 msgr2=0x55db1f021430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:29:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.550+0000 7fd7a2a9e640 1 --2- 172.21.15.63:0/1788353349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec7a350 0x55db1f021430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.550+0000 7fd7a2a9e640 1 -- 172.21.15.63:0/1788353349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec51490 msgr2=0x55db1f021970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.550+0000 7fd7a1a9c640 1 --2- 172.21.15.63:0/1788353349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec51490 0x55db1f021970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.550+0000 7fd7937fe640 1 -- 172.21.15.63:0/2868304286 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fd7980e79f0 con 0x7fd79c102f20 2024-09-21T06:29:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.551+0000 7fd7a2a9e640 1 --2- 172.21.15.63:0/1788353349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec51490 0x55db1f021970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.551+0000 7fd7a229d640 1 --2- 172.21.15.63:0/2868304286 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd7880b6680 0x7fd7880b8b90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0095f0 tx=0x7fd78c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.551+0000 7fd7a2a9e640 1 -- 172.21.15.63:0/1788353349 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db1ece5930 con 0x55db1ec59670 2024-09-21T06:29:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.551+0000 7fd7a1a9c640 1 --2- 172.21.15.63:0/1788353349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec51490 0x55db1f021970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.551+0000 7fd7a2a9e640 1 --2- 172.21.15.63:0/1788353349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec59670 0x55db1f021eb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd794009440 tx=0x7fd794009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e373750cd448f68e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:07.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.551+0000 7fd790ff9640 1 -- 172.21.15.63:0/1788353349 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd794034040 con 0x55db1ec59670 2024-09-21T06:29:07.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.551+0000 7fd790ff9640 1 -- 172.21.15.63:0/1788353349 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd79402fec0 con 0x55db1ec59670 2024-09-21T06:29:07.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.551+0000 7fd790ff9640 1 -- 172.21.15.63:0/1788353349 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd794004330 con 0x55db1ec59670 2024-09-21T06:29:07.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.552+0000 7fd7aaa75740 1 -- 172.21.15.63:0/1788353349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec59670 msgr2=0x55db1f021eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:07.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.552+0000 7fd7aaa75740 1 --2- 172.21.15.63:0/1788353349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec59670 0x55db1f021eb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd794009440 tx=0x7fd794009a20 comp rx=0 tx=0).stop 2024-09-21T06:29:07.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.553+0000 7fd7aaa75740 1 -- 172.21.15.63:0/1788353349 shutdown_connections 2024-09-21T06:29:07.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.553+0000 7fd7aaa75740 1 --2- 172.21.15.63:0/1788353349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec59670 0x55db1f021eb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.553+0000 7fd7aaa75740 1 --2- 172.21.15.63:0/1788353349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec51490 0x55db1f021970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.553+0000 7fd7aaa75740 1 --2- 172.21.15.63:0/1788353349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec7a350 0x55db1f021430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.553+0000 7fd7aaa75740 1 -- 172.21.15.63:0/1788353349 >> 172.21.15.63:0/1788353349 conn(0x55db1ec6e740 msgr2=0x55db1f01f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:07.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.553+0000 7fd7aaa75740 1 -- 172.21.15.63:0/1788353349 shutdown_connections 2024-09-21T06:29:07.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.553+0000 7fd7aaa75740 1 -- 172.21.15.63:0/1788353349 wait complete. 2024-09-21T06:29:07.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.554+0000 7fd7aaa75740 1 -- start start 2024-09-21T06:29:07.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.554+0000 7fd7aaa75740 1 Processor -- start 2024-09-21T06:29:07.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.555+0000 7fd7aaa75740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec51490 0x55db1f02d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.555+0000 7fd7aaa75740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec59670 0x55db1f02d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.555+0000 7fd7aaa75740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec7a350 0x55db1f038ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.555+0000 7fd7aaa75740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55db1ede8890 con 0x55db1ec7a350 2024-09-21T06:29:07.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.555+0000 7fd7a229d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec51490 0x55db1f02d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.555+0000 7fd7a229d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec51490 0x55db1f02d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:51768/0 (socket says 172.21.15.63:51768) 2024-09-21T06:29:07.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.555+0000 7fd7a229d640 1 -- 172.21.15.63:0/339416576 learned_addr learned my addr 172.21.15.63:0/339416576 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:07.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.555+0000 7fd7a2a9e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec7a350 0x55db1f038ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.555+0000 7fd7a1a9c640 1 --2- 172.21.15.63:0/339416576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec59670 0x55db1f02d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.555+0000 7fd7aaa75740 1 -- 172.21.15.63:0/339416576 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55db1ef21d40 con 0x55db1ec51490 2024-09-21T06:29:07.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.555+0000 7fd7aaa75740 1 -- 172.21.15.63:0/339416576 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55db1f02fbb0 con 0x55db1ec59670 2024-09-21T06:29:07.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.556+0000 7fd7aaa75740 10 client.0 _ll_register_callbacks cb 0x55db1ef85c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:07.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.556+0000 7fd7a2a9e640 1 -- 172.21.15.63:0/339416576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec59670 msgr2=0x55db1f02d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:07.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.556+0000 7fd7a2a9e640 1 --2- 172.21.15.63:0/339416576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec59670 0x55db1f02d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.556+0000 7fd7a2a9e640 1 -- 172.21.15.63:0/339416576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec51490 msgr2=0x55db1f02d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:07.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.556+0000 7fd7a2a9e640 1 --2- 172.21.15.63:0/339416576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec51490 0x55db1f02d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.556+0000 7fd7a2a9e640 1 -- 172.21.15.63:0/339416576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db1f039460 con 0x55db1ec7a350 2024-09-21T06:29:07.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.556+0000 7fd7a2a9e640 1 --2- 172.21.15.63:0/339416576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec7a350 0x55db1f038ed0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd794009bf0 tx=0x7fd79402a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1e39d2b85732ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:07.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.556+0000 7fd785ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:07.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.557+0000 7fd785ffb640 1 -- 172.21.15.63:0/339416576 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79404a070 con 0x55db1ec7a350 2024-09-21T06:29:07.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.557+0000 7fd785ffb640 1 -- 172.21.15.63:0/339416576 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fd794004240 con 0x55db1ec7a350 2024-09-21T06:29:07.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.557+0000 7fd7aaa75740 1 -- 172.21.15.63:0/339416576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd79402fec0 con 0x55db1ec7a350 2024-09-21T06:29:07.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.557+0000 7fd785ffb640 1 -- 172.21.15.63:0/339416576 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd794034040 con 0x55db1ec7a350 2024-09-21T06:29:07.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.557+0000 7fd7aaa75740 10 client.15732 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:07.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.557+0000 7fd7aaa75740 1 -- 172.21.15.63:0/339416576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55db1f03bce0 con 0x55db1ec7a350 2024-09-21T06:29:07.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.558+0000 7fd785ffb640 1 -- 172.21.15.63:0/339416576 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd79404f460 con 0x55db1ec7a350 2024-09-21T06:29:07.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.558+0000 7fd785ffb640 1 -- 172.21.15.63:0/339416576 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd794042070 con 0x55db1ec7a350 2024-09-21T06:29:07.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.558+0000 7fd7aaa75740 10 client.15732 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:07.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.559+0000 7fd7aaa75740 10 client.15732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:07.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.559+0000 7fd7aaa75740 20 client.15732 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:07.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.559+0000 7fd7aaa75740 1 --2- 172.21.15.63:0/339416576 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55db1ec38cd0 0x55db1f03f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.559+0000 7fd7aaa75740 4 client.15732 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:07.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.559+0000 7fd7aaa75740 1 -- 172.21.15.63:0/339416576 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd79402fec0 con 0x55db1ec38cd0 2024-09-21T06:29:07.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.559+0000 7fd7a229d640 1 --2- 172.21.15.63:0/339416576 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55db1ec38cd0 0x55db1f03f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.559+0000 7fd7a229d640 1 --2- 172.21.15.63:0/339416576 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55db1ec38cd0 0x55db1f03f040 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f326529ae55cfd5a server_cookie=13c85cef3f79c1ad in_seq=0 out_seq=0 2024-09-21T06:29:07.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.559+0000 7fd785ffb640 10 client.15732 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:07.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.560+0000 7fd785ffb640 1 -- 172.21.15.63:0/339416576 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fd79402fec0 con 0x55db1ec38cd0 2024-09-21T06:29:07.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.560+0000 7fd785ffb640 10 client.15732 handle_command_reply: tid=0 2024-09-21T06:29:07.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.560+0000 7fd7aaa75740 1 client.15732 shutdown 2024-09-21T06:29:07.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.560+0000 7fd7aaa75740 1 -- 172.21.15.63:0/339416576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec7a350 msgr2=0x55db1f038ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:07.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.560+0000 7fd7aaa75740 1 --2- 172.21.15.63:0/339416576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec7a350 0x55db1f038ed0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd794009bf0 tx=0x7fd79402a950 comp rx=0 tx=0).stop 2024-09-21T06:29:07.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.561+0000 7fd7aaa75740 1 -- 172.21.15.63:0/339416576 shutdown_connections 2024-09-21T06:29:07.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.561+0000 7fd7aaa75740 1 --2- 172.21.15.63:0/339416576 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55db1ec38cd0 0x55db1f03f040 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.561+0000 7fd7aaa75740 1 --2- 172.21.15.63:0/339416576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec7a350 0x55db1f038ed0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.561+0000 7fd7aaa75740 1 --2- 172.21.15.63:0/339416576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec59670 0x55db1f02d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.561+0000 7fd7aaa75740 1 --2- 172.21.15.63:0/339416576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec51490 0x55db1f02d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.561+0000 7fd7aaa75740 1 -- 172.21.15.63:0/339416576 >> 172.21.15.63:0/339416576 conn(0x55db1ec6e740 msgr2=0x55db1f0245c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:07.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.561+0000 7fd785ffb640 0 client.15732 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:07.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.561+0000 7fd7aaa75740 1 -- 172.21.15.63:0/339416576 shutdown_connections 2024-09-21T06:29:07.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.561+0000 7fd7aaa75740 1 -- 172.21.15.63:0/339416576 wait complete. 2024-09-21T06:29:07.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.561+0000 7fd7aaa75740 20 client.15732 trim_cache size 0 max 16384 2024-09-21T06:29:07.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.597+0000 7fd7aaa75740 1 Processor -- start 2024-09-21T06:29:07.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.597+0000 7fd7aaa75740 1 -- start start 2024-09-21T06:29:07.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.597+0000 7fd7aaa75740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec51490 0x55db1f024c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.597+0000 7fd7aaa75740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec59670 0x55db1f0264c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.597+0000 7fd7aaa75740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec7a350 0x55db1f026a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.597+0000 7fd7aaa75740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c1b1900 con 0x55db1ec51490 2024-09-21T06:29:07.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.597+0000 7fd7aaa75740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c1b3440 con 0x55db1ec59670 2024-09-21T06:29:07.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.597+0000 7fd7aaa75740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c1b1fd0 con 0x55db1ec7a350 2024-09-21T06:29:07.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.597+0000 7fd7a229d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec51490 0x55db1f024c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.597+0000 7fd7a229d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec51490 0x55db1f024c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57478/0 (socket says 172.21.15.63:57478) 2024-09-21T06:29:07.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.597+0000 7fd7a229d640 1 -- 172.21.15.63:0/1622647962 learned_addr learned my addr 172.21.15.63:0/1622647962 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:07.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.598+0000 7fd7a1a9c640 1 --2- 172.21.15.63:0/1622647962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec59670 0x55db1f0264c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.598+0000 7fd7a229d640 1 -- 172.21.15.63:0/1622647962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec7a350 msgr2=0x55db1f026a00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:29:07.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.598+0000 7fd7a229d640 1 --2- 172.21.15.63:0/1622647962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec7a350 0x55db1f026a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.598+0000 7fd7a229d640 1 -- 172.21.15.63:0/1622647962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec59670 msgr2=0x55db1f0264c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:07.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.598+0000 7fd7a229d640 1 --2- 172.21.15.63:0/1622647962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec59670 0x55db1f0264c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.598+0000 7fd7a229d640 1 -- 172.21.15.63:0/1622647962 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db1f01f860 con 0x55db1ec51490 2024-09-21T06:29:07.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.598+0000 7fd7a1a9c640 1 --2- 172.21.15.63:0/1622647962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec59670 0x55db1f0264c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:07.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.598+0000 7fd7a229d640 1 --2- 172.21.15.63:0/1622647962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec51490 0x55db1f024c40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0095c0 tx=0x7fd78c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4da1d9fe44aadb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:07.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.598+0000 7fd787fff640 1 -- 172.21.15.63:0/1622647962 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c02d070 con 0x55db1ec51490 2024-09-21T06:29:07.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.598+0000 7fd787fff640 1 -- 172.21.15.63:0/1622647962 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd78c003cb0 con 0x55db1ec51490 2024-09-21T06:29:07.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.598+0000 7fd787fff640 1 -- 172.21.15.63:0/1622647962 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c01e7b0 con 0x55db1ec51490 2024-09-21T06:29:07.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.599+0000 7fd7aaa75740 1 -- 172.21.15.63:0/1622647962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec51490 msgr2=0x55db1f024c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:07.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.599+0000 7fd7aaa75740 1 --2- 172.21.15.63:0/1622647962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec51490 0x55db1f024c40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0095c0 tx=0x7fd78c014000 comp rx=0 tx=0).stop 2024-09-21T06:29:07.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.600+0000 7fd7aaa75740 1 -- 172.21.15.63:0/1622647962 shutdown_connections 2024-09-21T06:29:07.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.600+0000 7fd7aaa75740 1 --2- 172.21.15.63:0/1622647962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec7a350 0x55db1f026a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.600+0000 7fd7aaa75740 1 --2- 172.21.15.63:0/1622647962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec59670 0x55db1f0264c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.600+0000 7fd7aaa75740 1 --2- 172.21.15.63:0/1622647962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec51490 0x55db1f024c40 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.600+0000 7fd7aaa75740 1 -- 172.21.15.63:0/1622647962 >> 172.21.15.63:0/1622647962 conn(0x55db1ec6e740 msgr2=0x55db1f024530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:07.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.600+0000 7fd7aaa75740 1 -- 172.21.15.63:0/1622647962 shutdown_connections 2024-09-21T06:29:07.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.600+0000 7fd7aaa75740 1 -- 172.21.15.63:0/1622647962 wait complete. 2024-09-21T06:29:07.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.600+0000 7fd7aaa75740 1 -- start start 2024-09-21T06:29:07.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.600+0000 7fd7aaa75740 1 Processor -- start 2024-09-21T06:29:07.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.601+0000 7fd7aaa75740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec51490 0x55db1f042610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.601+0000 7fd7aaa75740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec59670 0x55db1f040af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.601+0000 7fd7aaa75740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec7a350 0x55db1f041030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.601+0000 7fd7a2a9e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec7a350 0x55db1f041030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.601+0000 7fd7a2a9e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec7a350 0x55db1f041030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57490/0 (socket says 172.21.15.63:57490) 2024-09-21T06:29:07.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.601+0000 7fd7a2a9e640 1 -- 172.21.15.63:0/3025643038 learned_addr learned my addr 172.21.15.63:0/3025643038 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:07.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.601+0000 7fd7aaa75740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c1b2d70 con 0x55db1ec7a350 2024-09-21T06:29:07.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.601+0000 7fd7a229d640 1 --2- 172.21.15.63:0/3025643038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec51490 0x55db1f042610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.601+0000 7fd7a1a9c640 1 --2- 172.21.15.63:0/3025643038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec59670 0x55db1f040af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.601+0000 7fd7aaa75740 1 -- 172.21.15.63:0/3025643038 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c1b26a0 con 0x55db1ec51490 2024-09-21T06:29:07.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.601+0000 7fd7aaa75740 1 -- 172.21.15.63:0/3025643038 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c1af8e0 con 0x55db1ec59670 2024-09-21T06:29:07.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.602+0000 7fd7aaa75740 10 client.0 _ll_register_callbacks cb 0x7fd798005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:07.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.602+0000 7fd7a229d640 1 -- 172.21.15.63:0/3025643038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec59670 msgr2=0x55db1f040af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:07.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.602+0000 7fd7a229d640 1 --2- 172.21.15.63:0/3025643038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec59670 0x55db1f040af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.602+0000 7fd7a229d640 1 -- 172.21.15.63:0/3025643038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec7a350 msgr2=0x55db1f041030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:07.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.602+0000 7fd7a229d640 1 --2- 172.21.15.63:0/3025643038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec7a350 0x55db1f041030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.602+0000 7fd7a229d640 1 -- 172.21.15.63:0/3025643038 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db1f041570 con 0x55db1ec51490 2024-09-21T06:29:07.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.602+0000 7fd7a2a9e640 1 --2- 172.21.15.63:0/3025643038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec7a350 0x55db1f041030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:07.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.602+0000 7fd7a229d640 1 --2- 172.21.15.63:0/3025643038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec51490 0x55db1f042610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd78c02b040 tx=0x7fd78c003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c20cf9eebbbc60f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:07.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.602+0000 7fd785ffb640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:29:07.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.602+0000 7fd785ffb640 1 -- 172.21.15.63:0/3025643038 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c02d070 con 0x55db1ec51490 2024-09-21T06:29:07.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.602+0000 7fd785ffb640 1 -- 172.21.15.63:0/3025643038 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fd78c005280 con 0x55db1ec51490 2024-09-21T06:29:07.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.602+0000 7fd7aaa75740 1 -- 172.21.15.63:0/3025643038 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd78c003cb0 con 0x55db1ec51490 2024-09-21T06:29:07.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.603+0000 7fd785ffb640 1 -- 172.21.15.63:0/3025643038 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd78c005480 con 0x55db1ec51490 2024-09-21T06:29:07.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.603+0000 7fd7aaa75740 10 client.25412 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:07.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.603+0000 7fd7aaa75740 1 -- 172.21.15.63:0/3025643038 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55db1f0aa4c0 con 0x55db1ec51490 2024-09-21T06:29:07.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.603+0000 7fd785ffb640 1 -- 172.21.15.63:0/3025643038 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd78c022020 con 0x55db1ec51490 2024-09-21T06:29:07.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.603+0000 7fd785ffb640 1 -- 172.21.15.63:0/3025643038 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd78c004a60 con 0x55db1ec51490 2024-09-21T06:29:07.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.603+0000 7fd7aaa75740 10 client.25412 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:07.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.603+0000 7fd7aaa75740 10 client.25412 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:07.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.603+0000 7fd7aaa75740 20 client.25412 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:07.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.603+0000 7fd7aaa75740 1 --2- 172.21.15.63:0/3025643038 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55db1ec0e080 0x55db1f0acb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.603+0000 7fd7aaa75740 4 client.25412 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:29:07.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.603+0000 7fd7aaa75740 1 -- 172.21.15.63:0/3025643038 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fd78c003cb0 con 0x55db1ec0e080 2024-09-21T06:29:07.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.604+0000 7fd7a1a9c640 1 --2- 172.21.15.63:0/3025643038 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55db1ec0e080 0x55db1f0acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.604+0000 7fd785ffb640 10 client.25412 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:07.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.604+0000 7fd7a1a9c640 1 --2- 172.21.15.63:0/3025643038 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55db1ec0e080 0x55db1f0acb50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c5268497b307282 server_cookie=1aa8e24ea0a034d6 in_seq=0 out_seq=0 2024-09-21T06:29:07.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.606+0000 7fd785ffb640 1 -- 172.21.15.63:0/3025643038 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fd78c003cb0 con 0x55db1ec0e080 2024-09-21T06:29:07.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.606+0000 7fd785ffb640 10 client.25412 handle_command_reply: tid=0 2024-09-21T06:29:07.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.606+0000 7fd7aaa75740 1 client.25412 shutdown 2024-09-21T06:29:07.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.606+0000 7fd7aaa75740 1 -- 172.21.15.63:0/3025643038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec51490 msgr2=0x55db1f042610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:07.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.606+0000 7fd7aaa75740 1 --2- 172.21.15.63:0/3025643038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec51490 0x55db1f042610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd78c02b040 tx=0x7fd78c003f90 comp rx=0 tx=0).stop 2024-09-21T06:29:07.618 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:29:07.619 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0, 2024-09-21T06:29:07.619 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_tag": "99595c38-b81e-4cba-9256-e704dc084208", 2024-09-21T06:29:07.619 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": "asynchronous" 2024-09-21T06:29:07.619 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:29:07.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.606+0000 7fd7aaa75740 1 -- 172.21.15.63:0/3025643038 shutdown_connections 2024-09-21T06:29:07.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.606+0000 7fd7aaa75740 1 --2- 172.21.15.63:0/3025643038 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55db1ec0e080 0x55db1f0acb50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.606+0000 7fd7aaa75740 1 --2- 172.21.15.63:0/3025643038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55db1ec7a350 0x55db1f041030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.606+0000 7fd7aaa75740 1 --2- 172.21.15.63:0/3025643038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db1ec59670 0x55db1f040af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.606+0000 7fd785ffb640 0 client.25412 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:07.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.606+0000 7fd7aaa75740 1 --2- 172.21.15.63:0/3025643038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55db1ec51490 0x55db1f042610 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.607+0000 7fd7aaa75740 1 -- 172.21.15.63:0/3025643038 >> 172.21.15.63:0/3025643038 conn(0x55db1ec6e740 msgr2=0x55db1f022460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:07.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.607+0000 7fd7aaa75740 1 -- 172.21.15.63:0/3025643038 shutdown_connections 2024-09-21T06:29:07.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.607+0000 7fd7aaa75740 1 -- 172.21.15.63:0/3025643038 wait complete. 2024-09-21T06:29:07.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.607+0000 7fd7aaa75740 20 client.25412 trim_cache size 0 max 16384 2024-09-21T06:29:07.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.607+0000 7fd7a4501640 1 -- 172.21.15.63:0/2868304286 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd7880b6680 msgr2=0x7fd7880b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:07.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.607+0000 7fd7a4501640 1 --2- 172.21.15.63:0/2868304286 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd7880b6680 0x7fd7880b8b90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0095f0 tx=0x7fd78c005f90 comp rx=0 tx=0).stop 2024-09-21T06:29:07.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.608+0000 7fd7a4501640 1 -- 172.21.15.63:0/2868304286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd79c102f20 msgr2=0x7fd79c19cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:07.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.608+0000 7fd7a4501640 1 --2- 172.21.15.63:0/2868304286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd79c102f20 0x7fd79c19cc20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd79800e9f0 tx=0x7fd79800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.608+0000 7fd7a4501640 1 -- 172.21.15.63:0/2868304286 shutdown_connections 2024-09-21T06:29:07.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.608+0000 7fd7a4501640 1 --2- 172.21.15.63:0/2868304286 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd7880b6680 0x7fd7880b8b90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.608+0000 7fd7a4501640 1 --2- 172.21.15.63:0/2868304286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd79c110180 0x7fd79c1a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.608+0000 7fd7a4501640 1 --2- 172.21.15.63:0/2868304286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd79c102f20 0x7fd79c19cc20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.608+0000 7fd7a4501640 1 --2- 172.21.15.63:0/2868304286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd79c1025d0 0x7fd79c19c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.608+0000 7fd7a4501640 1 -- 172.21.15.63:0/2868304286 >> 172.21.15.63:0/2868304286 conn(0x7fd79c079730 msgr2=0x7fd79c109d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:07.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.608+0000 7fd7a4501640 1 -- 172.21.15.63:0/2868304286 shutdown_connections 2024-09-21T06:29:07.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:07.608+0000 7fd7a4501640 1 -- 172.21.15.63:0/2868304286 wait complete. 2024-09-21T06:29:08.448 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:29:08.844 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:09.252 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:09 smithi063 ceph-mon[31150]: scrub queued for path: / 2024-09-21T06:29:09.252 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:09 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:09.252 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:09 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:29:09.252 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:09 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:09.252 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:09 smithi063 ceph-mon[31150]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 26 op/s 2024-09-21T06:29:09.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:09 smithi175 ceph-mon[34510]: scrub queued for path: / 2024-09-21T06:29:09.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:09 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:09.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:09 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:29:09.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:09 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:09.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:09 smithi175 ceph-mon[34510]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 26 op/s 2024-09-21T06:29:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.393+0000 7ff682379640 1 -- 172.21.15.63:0/1712106249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff67c1083a0 msgr2=0x7ff67c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.393+0000 7ff682379640 1 --2- 172.21.15.63:0/1712106249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff67c1083a0 0x7ff67c1087b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff670009900 tx=0x7ff67002a410 comp rx=0 tx=0).stop 2024-09-21T06:29:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.394+0000 7ff682379640 1 -- 172.21.15.63:0/1712106249 shutdown_connections 2024-09-21T06:29:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.394+0000 7ff682379640 1 --2- 172.21.15.63:0/1712106249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff67c108cf0 0x7ff67c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.394+0000 7ff682379640 1 --2- 172.21.15.63:0/1712106249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff67c1083a0 0x7ff67c1087b0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.394+0000 7ff682379640 1 --2- 172.21.15.63:0/1712106249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff67c102a60 0x7ff67c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.394+0000 7ff682379640 1 -- 172.21.15.63:0/1712106249 >> 172.21.15.63:0/1712106249 conn(0x7ff67c079730 msgr2=0x7ff67c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.394+0000 7ff682379640 1 -- 172.21.15.63:0/1712106249 shutdown_connections 2024-09-21T06:29:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.394+0000 7ff682379640 1 -- 172.21.15.63:0/1712106249 wait complete. 2024-09-21T06:29:09.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.395+0000 7ff682379640 1 Processor -- start 2024-09-21T06:29:09.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.395+0000 7ff682379640 1 -- start start 2024-09-21T06:29:09.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.395+0000 7ff682379640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff67c102a60 0x7ff67c19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:09.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.395+0000 7ff682379640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff67c1083a0 0x7ff67c19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:09.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.396+0000 7ff682379640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff67c108cf0 0x7ff67c19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:09.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.396+0000 7ff682379640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c113ac0 con 0x7ff67c108cf0 2024-09-21T06:29:09.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.396+0000 7ff682379640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c113940 con 0x7ff67c102a60 2024-09-21T06:29:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.396+0000 7ff682379640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c113c40 con 0x7ff67c1083a0 2024-09-21T06:29:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.396+0000 7ff67b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff67c1083a0 0x7ff67c19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.396+0000 7ff67b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff67c1083a0 0x7ff67c19aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:44500/0 (socket says 172.21.15.63:44500) 2024-09-21T06:29:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.396+0000 7ff67b7fe640 1 -- 172.21.15.63:0/1280149892 learned_addr learned my addr 172.21.15.63:0/1280149892 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.396+0000 7ff67bfff640 1 --2- 172.21.15.63:0/1280149892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff67c102a60 0x7ff67c19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.396+0000 7ff680916640 1 --2- 172.21.15.63:0/1280149892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff67c108cf0 0x7ff67c19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.396+0000 7ff67bfff640 1 -- 172.21.15.63:0/1280149892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff67c1083a0 msgr2=0x7ff67c19aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.396+0000 7ff67bfff640 1 --2- 172.21.15.63:0/1280149892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff67c1083a0 0x7ff67c19aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.396+0000 7ff67bfff640 1 -- 172.21.15.63:0/1280149892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff67c108cf0 msgr2=0x7ff67c19fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.396+0000 7ff67bfff640 1 --2- 172.21.15.63:0/1280149892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff67c108cf0 0x7ff67c19fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.396+0000 7ff67bfff640 1 -- 172.21.15.63:0/1280149892 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c1a0480 con 0x7ff67c102a60 2024-09-21T06:29:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.396+0000 7ff680916640 1 --2- 172.21.15.63:0/1280149892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff67c108cf0 0x7ff67c19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.397+0000 7ff67bfff640 1 --2- 172.21.15.63:0/1280149892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff67c102a60 0x7ff67c19a510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff66c005fd0 tx=0x7ff66c00dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:09.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.397+0000 7ff6797fa640 1 -- 172.21.15.63:0/1280149892 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c009c30 con 0x7ff67c102a60 2024-09-21T06:29:09.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.397+0000 7ff682379640 1 -- 172.21.15.63:0/1280149892 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67c1a0770 con 0x7ff67c102a60 2024-09-21T06:29:09.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.397+0000 7ff6797fa640 1 -- 172.21.15.63:0/1280149892 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff66c009dd0 con 0x7ff67c102a60 2024-09-21T06:29:09.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.397+0000 7ff682379640 1 -- 172.21.15.63:0/1280149892 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67c1a6ed0 con 0x7ff67c102a60 2024-09-21T06:29:09.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.397+0000 7ff6797fa640 1 -- 172.21.15.63:0/1280149892 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c003e50 con 0x7ff67c102a60 2024-09-21T06:29:09.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.401+0000 7ff6888ed740 1 Processor -- start 2024-09-21T06:29:09.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.401+0000 7ff6888ed740 1 -- start start 2024-09-21T06:29:09.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.401+0000 7ff6888ed740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4cceef070 0x55c4cd296650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:09.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.401+0000 7ff6888ed740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccec61b0 0x55c4cd296b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:09.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.401+0000 7ff6888ed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccece390 0x55c4cd2970d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:09.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.401+0000 7ff6888ed740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c4cd20ce50 con 0x55c4cceef070 2024-09-21T06:29:09.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.401+0000 7ff6888ed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c4cd1fc280 con 0x55c4ccece390 2024-09-21T06:29:09.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.401+0000 7ff6888ed740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c4cd200090 con 0x55c4ccec61b0 2024-09-21T06:29:09.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.401+0000 7ff680916640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4cceef070 0x55c4cd296650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:09.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.401+0000 7ff680916640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4cceef070 0x55c4cd296650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57510/0 (socket says 172.21.15.63:57510) 2024-09-21T06:29:09.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.401+0000 7ff680916640 1 -- 172.21.15.63:0/1143852646 learned_addr learned my addr 172.21.15.63:0/1143852646 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:09.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.402+0000 7ff67b7fe640 1 --2- 172.21.15.63:0/1143852646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccece390 0x55c4cd2970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:09.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.402+0000 7ff6797fa640 1 -- 172.21.15.63:0/1280149892 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7ff66c010480 con 0x7ff67c102a60 2024-09-21T06:29:09.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.402+0000 7ff680916640 1 -- 172.21.15.63:0/1143852646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccec61b0 msgr2=0x55c4cd296b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:29:09.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.402+0000 7ff680916640 1 --2- 172.21.15.63:0/1143852646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccec61b0 0x55c4cd296b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.402+0000 7ff680916640 1 -- 172.21.15.63:0/1143852646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccece390 msgr2=0x55c4cd2970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:09.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.402+0000 7ff680916640 1 --2- 172.21.15.63:0/1143852646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccece390 0x55c4cd2970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.402+0000 7ff680916640 1 -- 172.21.15.63:0/1143852646 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4ccf5a650 con 0x55c4cceef070 2024-09-21T06:29:09.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.402+0000 7ff680916640 1 --2- 172.21.15.63:0/1143852646 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4cceef070 0x55c4cd296650 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff674010710 tx=0x7ff674010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06ee06bfce78982 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:09.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.402+0000 7ff67b7fe640 1 --2- 172.21.15.63:0/1143852646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccece390 0x55c4cd2970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:09.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.403+0000 7ff6627fc640 1 -- 172.21.15.63:0/1143852646 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67400e8d0 con 0x55c4cceef070 2024-09-21T06:29:09.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.403+0000 7ff6797fa640 1 --2- 172.21.15.63:0/1280149892 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff6640b6920 0x7ff6640b8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:09.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.403+0000 7ff6627fc640 1 -- 172.21.15.63:0/1143852646 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff674012450 con 0x55c4cceef070 2024-09-21T06:29:09.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.403+0000 7ff6627fc640 1 -- 172.21.15.63:0/1143852646 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67401c670 con 0x55c4cceef070 2024-09-21T06:29:09.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.403+0000 7ff6797fa640 1 -- 172.21.15.63:0/1280149892 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ff66c0e6cb0 con 0x7ff67c102a60 2024-09-21T06:29:09.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.404+0000 7ff67bfff640 1 --2- 172.21.15.63:0/1280149892 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff6640b6920 0x7ff6640b8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:09.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.404+0000 7ff6888ed740 1 -- 172.21.15.63:0/1143852646 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4cceef070 msgr2=0x55c4cd296650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:09.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.404+0000 7ff67bfff640 1 --2- 172.21.15.63:0/1280149892 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff6640b6920 0x7ff6640b8e30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55c4cd2952d0 tx=0x7ff66c0ac960 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:09.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.404+0000 7ff6888ed740 1 --2- 172.21.15.63:0/1143852646 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4cceef070 0x55c4cd296650 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff674010710 tx=0x7ff674010bd0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.404+0000 7ff6888ed740 1 -- 172.21.15.63:0/1143852646 shutdown_connections 2024-09-21T06:29:09.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.404+0000 7ff6888ed740 1 --2- 172.21.15.63:0/1143852646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccece390 0x55c4cd2970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.404+0000 7ff6888ed740 1 --2- 172.21.15.63:0/1143852646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccec61b0 0x55c4cd296b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.404+0000 7ff6888ed740 1 --2- 172.21.15.63:0/1143852646 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4cceef070 0x55c4cd296650 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.404+0000 7ff6888ed740 1 -- 172.21.15.63:0/1143852646 >> 172.21.15.63:0/1143852646 conn(0x55c4ccee3460 msgr2=0x55c4cd294540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:09.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.405+0000 7ff6888ed740 1 -- 172.21.15.63:0/1143852646 shutdown_connections 2024-09-21T06:29:09.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.405+0000 7ff6888ed740 1 -- 172.21.15.63:0/1143852646 wait complete. 2024-09-21T06:29:09.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.405+0000 7ff6888ed740 1 -- start start 2024-09-21T06:29:09.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.405+0000 7ff6888ed740 1 Processor -- start 2024-09-21T06:29:09.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.406+0000 7ff6888ed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccec61b0 0x55c4cd2aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:09.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.406+0000 7ff6888ed740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccece390 0x55c4cd2ab460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:09.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.406+0000 7ff6888ed740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4cceef070 0x55c4cd2b0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:09.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.406+0000 7ff680916640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccec61b0 0x55c4cd2aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:09.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.406+0000 7ff680916640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccec61b0 0x55c4cd2aae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:51826/0 (socket says 172.21.15.63:51826) 2024-09-21T06:29:09.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.406+0000 7ff680916640 1 -- 172.21.15.63:0/647685579 learned_addr learned my addr 172.21.15.63:0/647685579 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:09.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.406+0000 7ff6888ed740 1 -- 172.21.15.63:0/647685579 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c4cd05d700 con 0x55c4cceef070 2024-09-21T06:29:09.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.406+0000 7ff6888ed740 1 -- 172.21.15.63:0/647685579 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c4cd197110 con 0x55c4ccec61b0 2024-09-21T06:29:09.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.406+0000 7ff6888ed740 1 -- 172.21.15.63:0/647685579 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c4cd2a9240 con 0x55c4ccece390 2024-09-21T06:29:09.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.406+0000 7ff680916640 1 --2- 172.21.15.63:0/647685579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4cceef070 0x55c4cd2b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:09.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.406+0000 7ff67b7fe640 1 --2- 172.21.15.63:0/647685579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccece390 0x55c4cd2ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:09.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.407+0000 7ff680916640 1 -- 172.21.15.63:0/647685579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccece390 msgr2=0x55c4cd2ab460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:09.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.407+0000 7ff680916640 1 --2- 172.21.15.63:0/647685579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccece390 0x55c4cd2ab460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.407+0000 7ff680916640 1 -- 172.21.15.63:0/647685579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccec61b0 msgr2=0x55c4cd2aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:09.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.407+0000 7ff680916640 1 --2- 172.21.15.63:0/647685579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccec61b0 0x55c4cd2aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.407+0000 7ff680916640 1 -- 172.21.15.63:0/647685579 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4cd1c4c40 con 0x55c4cceef070 2024-09-21T06:29:09.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.407+0000 7ff6888ed740 10 client.0 _ll_register_callbacks cb 0x55c4cd1b0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:09.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.407+0000 7ff6888ed740 1 -- 172.21.15.63:0/647685579 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff674012450 con 0x55c4cceef070 2024-09-21T06:29:09.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.407+0000 7ff680916640 1 --2- 172.21.15.63:0/647685579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4cceef070 0x55c4cd2b0480 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff674012ae0 tx=0x7ff674012df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08fcd5a7faa643 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:09.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.407+0000 7ff65b7fe640 10 client.15750 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:09.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.408+0000 7ff65b7fe640 1 -- 172.21.15.63:0/647685579 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67402a420 con 0x55c4cceef070 2024-09-21T06:29:09.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.408+0000 7ff65b7fe640 1 -- 172.21.15.63:0/647685579 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ff67402a5c0 con 0x55c4cceef070 2024-09-21T06:29:09.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.408+0000 7ff65b7fe640 1 -- 172.21.15.63:0/647685579 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff67402a820 con 0x55c4cceef070 2024-09-21T06:29:09.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.408+0000 7ff6888ed740 10 client.15750 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:09.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.408+0000 7ff6888ed740 1 -- 172.21.15.63:0/647685579 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55c4cd2b9140 con 0x55c4cceef070 2024-09-21T06:29:09.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.408+0000 7ff65b7fe640 1 -- 172.21.15.63:0/647685579 <== mon.0 v2:172.21.15.63:3300/0 4 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff67400f040 con 0x55c4cceef070 2024-09-21T06:29:09.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.408+0000 7ff6888ed740 10 client.15750 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:09.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.408+0000 7ff6888ed740 10 client.15750 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:09.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.408+0000 7ff6888ed740 20 client.15750 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:09.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.408+0000 7ff6888ed740 1 --2- 172.21.15.63:0/647685579 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c4ccead9f0 0x55c4cd2bc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:09.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.408+0000 7ff6888ed740 4 client.15750 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:09.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.408+0000 7ff6888ed740 1 -- 172.21.15.63:0/647685579 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4cd20eda0 con 0x55c4ccead9f0 2024-09-21T06:29:09.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.409+0000 7ff67b7fe640 1 --2- 172.21.15.63:0/647685579 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c4ccead9f0 0x55c4cd2bc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:09.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.412+0000 7ff67b7fe640 1 --2- 172.21.15.63:0/647685579 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c4ccead9f0 0x55c4cd2bc4f0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fdd5c6c1c49b635 server_cookie=3c2eaa9146c68397 in_seq=0 out_seq=0 2024-09-21T06:29:09.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.412+0000 7ff65b7fe640 10 client.15750 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:09.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.413+0000 7ff65b7fe640 1 -- 172.21.15.63:0/647685579 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c4cd20eda0 con 0x55c4ccead9f0 2024-09-21T06:29:09.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.413+0000 7ff65b7fe640 10 client.15750 handle_command_reply: tid=0 2024-09-21T06:29:09.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.413+0000 7ff6888ed740 1 client.15750 shutdown 2024-09-21T06:29:09.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.413+0000 7ff6888ed740 1 -- 172.21.15.63:0/647685579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4cceef070 msgr2=0x55c4cd2b0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:09.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.413+0000 7ff6888ed740 1 --2- 172.21.15.63:0/647685579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4cceef070 0x55c4cd2b0480 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff674012ae0 tx=0x7ff674012df0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.413+0000 7ff6888ed740 1 -- 172.21.15.63:0/647685579 shutdown_connections 2024-09-21T06:29:09.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.413+0000 7ff6888ed740 1 --2- 172.21.15.63:0/647685579 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c4ccead9f0 0x55c4cd2bc4f0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.413+0000 7ff6888ed740 1 --2- 172.21.15.63:0/647685579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4cceef070 0x55c4cd2b0480 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.413+0000 7ff6888ed740 1 --2- 172.21.15.63:0/647685579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccece390 0x55c4cd2ab460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.413+0000 7ff6888ed740 1 --2- 172.21.15.63:0/647685579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccec61b0 0x55c4cd2aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.413+0000 7ff6888ed740 1 -- 172.21.15.63:0/647685579 >> 172.21.15.63:0/647685579 conn(0x55c4ccee3460 msgr2=0x55c4cd2997e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:09.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.413+0000 7ff65b7fe640 0 client.15750 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:09.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.413+0000 7ff6888ed740 1 -- 172.21.15.63:0/647685579 shutdown_connections 2024-09-21T06:29:09.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.413+0000 7ff6888ed740 1 -- 172.21.15.63:0/647685579 wait complete. 2024-09-21T06:29:09.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.414+0000 7ff6888ed740 20 client.15750 trim_cache size 0 max 16384 2024-09-21T06:29:09.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.449+0000 7ff6888ed740 1 Processor -- start 2024-09-21T06:29:09.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.449+0000 7ff6888ed740 1 -- start start 2024-09-21T06:29:09.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.449+0000 7ff6888ed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccee3460 0x55c4cd2b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:09.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.449+0000 7ff6888ed740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccec61b0 0x55c4cd2ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:09.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.449+0000 7ff6888ed740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4ccece390 0x55c4cd2a7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:09.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.449+0000 7ff6888ed740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff66800e700 con 0x55c4ccece390 2024-09-21T06:29:09.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.449+0000 7ff6888ed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff668010240 con 0x55c4ccee3460 2024-09-21T06:29:09.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.449+0000 7ff6888ed740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff66800edd0 con 0x55c4ccec61b0 2024-09-21T06:29:09.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.450+0000 7ff67b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccec61b0 0x55c4cd2ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:09.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.450+0000 7ff67b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccec61b0 0x55c4cd2ae9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:44528/0 (socket says 172.21.15.63:44528) 2024-09-21T06:29:09.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.450+0000 7ff67b7fe640 1 -- 172.21.15.63:0/2294179737 learned_addr learned my addr 172.21.15.63:0/2294179737 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:09.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.450+0000 7ff680916640 1 --2- 172.21.15.63:0/2294179737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccee3460 0x55c4cd2b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:09.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.450+0000 7ff67b7fe640 1 -- 172.21.15.63:0/2294179737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccee3460 msgr2=0x55c4cd2b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:09.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.450+0000 7ff67b7fe640 1 --2- 172.21.15.63:0/2294179737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccee3460 0x55c4cd2b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.450+0000 7ff67b7fe640 1 -- 172.21.15.63:0/2294179737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4ccece390 msgr2=0x55c4cd2a7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:09.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.450+0000 7ff67b7fe640 1 --2- 172.21.15.63:0/2294179737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4ccece390 0x55c4cd2a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.450+0000 7ff67b7fe640 1 -- 172.21.15.63:0/2294179737 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4cd2abf40 con 0x55c4ccec61b0 2024-09-21T06:29:09.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.450+0000 7ff67b7fe640 1 --2- 172.21.15.63:0/2294179737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccec61b0 0x55c4cd2ae9a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff67002a9d0 tx=0x7ff670005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ebbb91cb1ff23a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:09.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.451+0000 7ff661ffb640 1 -- 172.21.15.63:0/2294179737 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff670035040 con 0x55c4ccec61b0 2024-09-21T06:29:09.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.451+0000 7ff661ffb640 1 -- 172.21.15.63:0/2294179737 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6700054d0 con 0x55c4ccec61b0 2024-09-21T06:29:09.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.451+0000 7ff661ffb640 1 -- 172.21.15.63:0/2294179737 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff670004e50 con 0x55c4ccec61b0 2024-09-21T06:29:09.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.452+0000 7ff6888ed740 1 -- 172.21.15.63:0/2294179737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccec61b0 msgr2=0x55c4cd2ae9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:09.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.452+0000 7ff6888ed740 1 --2- 172.21.15.63:0/2294179737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccec61b0 0x55c4cd2ae9a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff67002a9d0 tx=0x7ff670005a20 comp rx=0 tx=0).stop 2024-09-21T06:29:09.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.452+0000 7ff6888ed740 1 -- 172.21.15.63:0/2294179737 shutdown_connections 2024-09-21T06:29:09.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.452+0000 7ff6888ed740 1 --2- 172.21.15.63:0/2294179737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4ccece390 0x55c4cd2a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.452+0000 7ff6888ed740 1 --2- 172.21.15.63:0/2294179737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccec61b0 0x55c4cd2ae9a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.452+0000 7ff6888ed740 1 --2- 172.21.15.63:0/2294179737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccee3460 0x55c4cd2b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.452+0000 7ff6888ed740 1 -- 172.21.15.63:0/2294179737 >> 172.21.15.63:0/2294179737 conn(0x55c4cd2ab650 msgr2=0x55c4cd2ae290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:09.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.452+0000 7ff6888ed740 1 -- 172.21.15.63:0/2294179737 shutdown_connections 2024-09-21T06:29:09.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.452+0000 7ff6888ed740 1 -- 172.21.15.63:0/2294179737 wait complete. 2024-09-21T06:29:09.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.453+0000 7ff6888ed740 1 -- start start 2024-09-21T06:29:09.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.453+0000 7ff6888ed740 1 Processor -- start 2024-09-21T06:29:09.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.454+0000 7ff6888ed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccec61b0 0x55c4cd2b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:09.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.454+0000 7ff6888ed740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccece390 0x55c4cd2b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:09.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.454+0000 7ff6888ed740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4ccee3460 0x55c4cd2b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:09.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.454+0000 7ff67b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccece390 0x55c4cd2b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:09.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.455+0000 7ff67b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccece390 0x55c4cd2b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:44532/0 (socket says 172.21.15.63:44532) 2024-09-21T06:29:09.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.455+0000 7ff680916640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4ccee3460 0x55c4cd2b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:09.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.455+0000 7ff680916640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4ccee3460 0x55c4cd2b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57538/0 (socket says 172.21.15.63:57538) 2024-09-21T06:29:09.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.455+0000 7ff67b7fe640 1 -- 172.21.15.63:0/176921793 learned_addr learned my addr 172.21.15.63:0/176921793 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:09.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.455+0000 7ff6888ed740 1 -- 172.21.15.63:0/176921793 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff66800fb70 con 0x55c4ccee3460 2024-09-21T06:29:09.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.455+0000 7ff6888ed740 1 -- 172.21.15.63:0/176921793 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff66800f4a0 con 0x55c4ccec61b0 2024-09-21T06:29:09.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.455+0000 7ff6888ed740 1 -- 172.21.15.63:0/176921793 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff66800c6e0 con 0x55c4ccece390 2024-09-21T06:29:09.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.455+0000 7ff680916640 1 -- 172.21.15.63:0/176921793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccece390 msgr2=0x55c4cd2b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:09.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.455+0000 7ff680916640 1 --2- 172.21.15.63:0/176921793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccece390 0x55c4cd2b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.455+0000 7ff680916640 1 -- 172.21.15.63:0/176921793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccec61b0 msgr2=0x55c4cd2b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:09.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.455+0000 7ff680916640 1 --2- 172.21.15.63:0/176921793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccec61b0 0x55c4cd2b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.455+0000 7ff680916640 1 -- 172.21.15.63:0/176921793 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4cd2b2e90 con 0x55c4ccee3460 2024-09-21T06:29:09.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.455+0000 7ff67b7fe640 1 --2- 172.21.15.63:0/176921793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccece390 0x55c4cd2b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:09.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.455+0000 7ff6888ed740 10 client.0 _ll_register_callbacks cb 0x7ff674016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:09.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.456+0000 7ff6888ed740 1 -- 172.21.15.63:0/176921793 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6700054d0 con 0x55c4ccee3460 2024-09-21T06:29:09.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.456+0000 7ff680916640 1 --2- 172.21.15.63:0/176921793 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4ccee3460 0x55c4cd2b2780 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff674012dc0 tx=0x7ff674009dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af305cb963707b03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:09.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.456+0000 7ff65b7fe640 10 client.15753 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:09.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.456+0000 7ff65b7fe640 1 -- 172.21.15.63:0/176921793 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67403b070 con 0x55c4ccee3460 2024-09-21T06:29:09.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.456+0000 7ff65b7fe640 1 -- 172.21.15.63:0/176921793 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ff6740049a0 con 0x55c4ccee3460 2024-09-21T06:29:09.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.457+0000 7ff65b7fe640 1 -- 172.21.15.63:0/176921793 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff674004ba0 con 0x55c4ccee3460 2024-09-21T06:29:09.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.457+0000 7ff6888ed740 10 client.15753 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:09.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.457+0000 7ff6888ed740 1 -- 172.21.15.63:0/176921793 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55c4cd3268f0 con 0x55c4ccee3460 2024-09-21T06:29:09.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.457+0000 7ff65b7fe640 1 -- 172.21.15.63:0/176921793 <== mon.0 v2:172.21.15.63:3300/0 4 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff674005040 con 0x55c4ccee3460 2024-09-21T06:29:09.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.457+0000 7ff6888ed740 10 client.15753 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:09.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.457+0000 7ff6888ed740 10 client.15753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:09.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.457+0000 7ff6888ed740 20 client.15753 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:09.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.457+0000 7ff6888ed740 1 --2- 172.21.15.63:0/176921793 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c4cceef070 0x55c4cd329030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:09.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.457+0000 7ff6888ed740 4 client.15753 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:29:09.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.458+0000 7ff6888ed740 1 -- 172.21.15.63:0/176921793 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c4cd20a850 con 0x55c4cceef070 2024-09-21T06:29:09.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.458+0000 7ff67b7fe640 1 --2- 172.21.15.63:0/176921793 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c4cceef070 0x55c4cd329030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:09.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.458+0000 7ff65b7fe640 10 client.15753 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:09.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.458+0000 7ff67b7fe640 1 --2- 172.21.15.63:0/176921793 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c4cceef070 0x55c4cd329030 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82ca4d815425bbfd server_cookie=2a5be018423bbdaf in_seq=0 out_seq=0 2024-09-21T06:29:09.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.459+0000 7ff65b7fe640 1 -- 172.21.15.63:0/176921793 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x55c4cd20a850 con 0x55c4cceef070 2024-09-21T06:29:09.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.459+0000 7ff65b7fe640 10 client.15753 handle_command_reply: tid=0 2024-09-21T06:29:09.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.459+0000 7ff6888ed740 1 client.15753 shutdown 2024-09-21T06:29:09.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.460+0000 7ff6888ed740 1 -- 172.21.15.63:0/176921793 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4ccee3460 msgr2=0x55c4cd2b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:09.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.460+0000 7ff6888ed740 1 --2- 172.21.15.63:0/176921793 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4ccee3460 0x55c4cd2b2780 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff674012dc0 tx=0x7ff674009dd0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.460+0000 7ff6888ed740 1 -- 172.21.15.63:0/176921793 shutdown_connections 2024-09-21T06:29:09.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.460+0000 7ff6888ed740 1 --2- 172.21.15.63:0/176921793 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c4cceef070 0x55c4cd329030 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.460+0000 7ff6888ed740 1 --2- 172.21.15.63:0/176921793 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c4ccee3460 0x55c4cd2b2780 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.460+0000 7ff65b7fe640 0 client.15753 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:09.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.460+0000 7ff6888ed740 1 --2- 172.21.15.63:0/176921793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ccece390 0x55c4cd2b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.460+0000 7ff6888ed740 1 --2- 172.21.15.63:0/176921793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c4ccec61b0 0x55c4cd2b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.460+0000 7ff6888ed740 1 -- 172.21.15.63:0/176921793 >> 172.21.15.63:0/176921793 conn(0x55c4cd2ab650 msgr2=0x55c4cd2996e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:09.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.460+0000 7ff6888ed740 1 -- 172.21.15.63:0/176921793 shutdown_connections 2024-09-21T06:29:09.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.460+0000 7ff6888ed740 1 -- 172.21.15.63:0/176921793 wait complete. 2024-09-21T06:29:09.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.461+0000 7ff6888ed740 20 client.15753 trim_cache size 0 max 16384 2024-09-21T06:29:09.465 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:29:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:29:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": { 2024-09-21T06:29:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "99595c38-b81e-4cba-9256-e704dc084208": { 2024-09-21T06:29:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:29:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "tag": "99595c38-b81e-4cba-9256-e704dc084208", 2024-09-21T06:29:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "options": "recursive,force" 2024-09-21T06:29:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:29:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:29:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:29:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "99595c38-b81e-4cba-9256-e704dc084208": { 2024-09-21T06:29:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:29:07.604466+0000", 2024-09-21T06:29:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:29:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:29:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:29:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:29:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:29:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:29:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "e7881878-4529-4e31-87c4-bfc71bc0cbfc": { 2024-09-21T06:29:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:28:21.722259+0000", 2024-09-21T06:29:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:29:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:29:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:29:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:29:09.467 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:29:09.467 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:29:09.467 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:29:09.467 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:29:09.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.462+0000 7ff682379640 1 -- 172.21.15.63:0/1280149892 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff6640b6920 msgr2=0x7ff6640b8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:09.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.462+0000 7ff682379640 1 --2- 172.21.15.63:0/1280149892 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff6640b6920 0x7ff6640b8e30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55c4cd2952d0 tx=0x7ff66c0ac960 comp rx=0 tx=0).stop 2024-09-21T06:29:09.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.462+0000 7ff682379640 1 -- 172.21.15.63:0/1280149892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff67c102a60 msgr2=0x7ff67c19a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:09.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.462+0000 7ff682379640 1 --2- 172.21.15.63:0/1280149892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff67c102a60 0x7ff67c19a510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff66c005fd0 tx=0x7ff66c00dde0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.462+0000 7ff682379640 1 -- 172.21.15.63:0/1280149892 shutdown_connections 2024-09-21T06:29:09.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.462+0000 7ff682379640 1 --2- 172.21.15.63:0/1280149892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff67c108cf0 0x7ff67c19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.462+0000 7ff682379640 1 --2- 172.21.15.63:0/1280149892 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff6640b6920 0x7ff6640b8e30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.462+0000 7ff682379640 1 --2- 172.21.15.63:0/1280149892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff67c1083a0 0x7ff67c19aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.462+0000 7ff682379640 1 --2- 172.21.15.63:0/1280149892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff67c102a60 0x7ff67c19a510 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:09.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.462+0000 7ff682379640 1 -- 172.21.15.63:0/1280149892 >> 172.21.15.63:0/1280149892 conn(0x7ff67c079730 msgr2=0x7ff67c104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:09.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.463+0000 7ff682379640 1 -- 172.21.15.63:0/1280149892 shutdown_connections 2024-09-21T06:29:09.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:09.463+0000 7ff682379640 1 -- 172.21.15.63:0/1280149892 wait complete. 2024-09-21T06:29:09.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:09 smithi071 ceph-mon[34844]: scrub queued for path: / 2024-09-21T06:29:09.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:09 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:09.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:09 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:29:09.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:09 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:09.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:09 smithi071 ceph-mon[34844]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 26 op/s 2024-09-21T06:29:10.135 INFO:tasks.cephfs.filesystem:scrub status for tag:99595c38-b81e-4cba-9256-e704dc084208 - {'path': '/', 'tag': '99595c38-b81e-4cba-9256-e704dc084208', 'options': 'recursive,force'} 2024-09-21T06:29:11.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:11 smithi063 ceph-mon[31150]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-09-21T06:29:11.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:11 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:29:11.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:11 smithi175 ceph-mon[34510]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-09-21T06:29:11.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:11 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:29:11.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:11 smithi071 ceph-mon[34844]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-09-21T06:29:11.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:11 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:29:13.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:13 smithi063 ceph-mon[31150]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-21T06:29:13.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:13 smithi175 ceph-mon[34510]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-21T06:29:13.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:13 smithi071 ceph-mon[34844]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-21T06:29:15.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:15 smithi063 ceph-mon[31150]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-21T06:29:15.348 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:15 smithi175 ceph-mon[34510]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-21T06:29:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:15 smithi071 ceph-mon[34844]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-21T06:29:17.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:17 smithi063 ceph-mon[31150]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-21T06:29:17.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:17 smithi175 ceph-mon[34510]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-21T06:29:17.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:17 smithi071 ceph-mon[34844]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-21T06:29:18.388 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.385+0000 7f723f739640 1 -- 172.21.15.63:0/4208470948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72381082e0 msgr2=0x7f72381086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:18.388 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.385+0000 7f723f739640 1 --2- 172.21.15.63:0/4208470948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72381082e0 0x7f72381086f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7228009900 tx=0x7f722802a410 comp rx=0 tx=0).stop 2024-09-21T06:29:18.388 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.386+0000 7f723f739640 1 -- 172.21.15.63:0/4208470948 shutdown_connections 2024-09-21T06:29:18.388 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.386+0000 7f723f739640 1 --2- 172.21.15.63:0/4208470948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7238108c30 0x7f723810f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.388 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.386+0000 7f723f739640 1 --2- 172.21.15.63:0/4208470948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72381082e0 0x7f72381086f0 secure :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7228009900 tx=0x7f722802a410 comp rx=0 tx=0).stop 2024-09-21T06:29:18.388 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.386+0000 7f723f739640 1 --2- 172.21.15.63:0/4208470948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72381029b0 0x7f7238102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.388 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.386+0000 7f723f739640 1 -- 172.21.15.63:0/4208470948 >> 172.21.15.63:0/4208470948 conn(0x7f723807a740 msgr2=0x7f723807ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:18.388 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.386+0000 7f723f739640 1 -- 172.21.15.63:0/4208470948 shutdown_connections 2024-09-21T06:29:18.388 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.386+0000 7f723f739640 1 -- 172.21.15.63:0/4208470948 wait complete. 2024-09-21T06:29:18.390 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.386+0000 7f723f739640 1 Processor -- start 2024-09-21T06:29:18.390 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.387+0000 7f723f739640 1 -- start start 2024-09-21T06:29:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.387+0000 7f723f739640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72381029b0 0x7f7238199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.387+0000 7f723f739640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7238108c30 0x7f7238199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.387+0000 7f723f739640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f723819ecb0 0x7f723819f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.387+0000 7f723f739640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7238112940 con 0x7f72381029b0 2024-09-21T06:29:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.387+0000 7f723f739640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f72381127c0 con 0x7f723819ecb0 2024-09-21T06:29:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.387+0000 7f723f739640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7238112ac0 con 0x7f7238108c30 2024-09-21T06:29:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.387+0000 7f723d4d5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72381029b0 0x7f7238199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.387+0000 7f723d4d5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72381029b0 0x7f7238199540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37220/0 (socket says 172.21.15.63:37220) 2024-09-21T06:29:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.387+0000 7f723d4d5640 1 -- 172.21.15.63:0/596779478 learned_addr learned my addr 172.21.15.63:0/596779478 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.387+0000 7f723ccd4640 1 --2- 172.21.15.63:0/596779478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7238108c30 0x7f7238199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.387+0000 7f723dcd6640 1 --2- 172.21.15.63:0/596779478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f723819ecb0 0x7f723819f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.387+0000 7f723d4d5640 1 -- 172.21.15.63:0/596779478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7238108c30 msgr2=0x7f7238199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.387+0000 7f723d4d5640 1 --2- 172.21.15.63:0/596779478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7238108c30 0x7f7238199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.387+0000 7f723d4d5640 1 -- 172.21.15.63:0/596779478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f723819ecb0 msgr2=0x7f723819f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.387+0000 7f723d4d5640 1 --2- 172.21.15.63:0/596779478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f723819ecb0 0x7f723819f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.388+0000 7f723d4d5640 1 -- 172.21.15.63:0/596779478 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723819f890 con 0x7f72381029b0 2024-09-21T06:29:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.388+0000 7f723dcd6640 1 --2- 172.21.15.63:0/596779478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f723819ecb0 0x7f723819f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.388+0000 7f723d4d5640 1 --2- 172.21.15.63:0/596779478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72381029b0 0x7f7238199540 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f723400ea60 tx=0x7f723400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.388+0000 7f722e7fc640 1 -- 172.21.15.63:0/596779478 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723400cde0 con 0x7f72381029b0 2024-09-21T06:29:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.388+0000 7f722e7fc640 1 -- 172.21.15.63:0/596779478 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72340035f0 con 0x7f72381029b0 2024-09-21T06:29:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.388+0000 7f723f739640 1 -- 172.21.15.63:0/596779478 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f723806abe0 con 0x7f72381029b0 2024-09-21T06:29:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.388+0000 7f722e7fc640 1 -- 172.21.15.63:0/596779478 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7234010690 con 0x7f72381029b0 2024-09-21T06:29:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.388+0000 7f723f739640 1 -- 172.21.15.63:0/596779478 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f723806b100 con 0x7f72381029b0 2024-09-21T06:29:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.392+0000 7f72466ad740 1 Processor -- start 2024-09-21T06:29:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.392+0000 7f72466ad740 1 -- start start 2024-09-21T06:29:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.392+0000 7f72466ad740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5f91b0 0x560b5b99e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.392+0000 7f72466ad740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b5b5d02f0 0x560b5b99eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.392+0000 7f72466ad740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5d84d0 0x560b5b99f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.392+0000 7f72466ad740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x560b5b9136f0 con 0x560b5b5d84d0 2024-09-21T06:29:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.392+0000 7f72466ad740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560b5b902b20 con 0x560b5b5f91b0 2024-09-21T06:29:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.392+0000 7f72466ad740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560b5b906930 con 0x560b5b5d02f0 2024-09-21T06:29:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.392+0000 7f723ccd4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5d84d0 0x560b5b99f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.392+0000 7f723ccd4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5d84d0 0x560b5b99f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37226/0 (socket says 172.21.15.63:37226) 2024-09-21T06:29:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.392+0000 7f723ccd4640 1 -- 172.21.15.63:0/415754919 learned_addr learned my addr 172.21.15.63:0/415754919 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.392+0000 7f723dcd6640 1 --2- 172.21.15.63:0/415754919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5f91b0 0x560b5b99e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.393+0000 7f722e7fc640 1 -- 172.21.15.63:0/596779478 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f7234010830 con 0x7f72381029b0 2024-09-21T06:29:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.393+0000 7f723dcd6640 1 -- 172.21.15.63:0/415754919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b5b5d02f0 msgr2=0x560b5b99eef0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:29:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.393+0000 7f723dcd6640 1 --2- 172.21.15.63:0/415754919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b5b5d02f0 0x560b5b99eef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.393+0000 7f723dcd6640 1 -- 172.21.15.63:0/415754919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5d84d0 msgr2=0x560b5b99f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.393+0000 7f723dcd6640 1 --2- 172.21.15.63:0/415754919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5d84d0 0x560b5b99f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.393+0000 7f723dcd6640 1 -- 172.21.15.63:0/415754919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b5b8c8530 con 0x560b5b5f91b0 2024-09-21T06:29:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.393+0000 7f723ccd4640 1 --2- 172.21.15.63:0/415754919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5d84d0 0x560b5b99f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.393+0000 7f723dcd6640 1 --2- 172.21.15.63:0/415754919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5f91b0 0x560b5b99e9b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7230009f00 tx=0x7f723000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ad8b9c369b57cac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.393+0000 7f72237fe640 1 -- 172.21.15.63:0/415754919 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7230015070 con 0x560b5b5f91b0 2024-09-21T06:29:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.394+0000 7f72237fe640 1 -- 172.21.15.63:0/415754919 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f723001ab10 con 0x560b5b5f91b0 2024-09-21T06:29:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.394+0000 7f72237fe640 1 -- 172.21.15.63:0/415754919 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7230011c00 con 0x560b5b5f91b0 2024-09-21T06:29:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.394+0000 7f722e7fc640 1 --2- 172.21.15.63:0/596779478 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f72240b6700 0x7f72240b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.394+0000 7f723d4d5640 1 --2- 172.21.15.63:0/596779478 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f72240b6700 0x7f72240b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.394+0000 7f722e7fc640 1 -- 172.21.15.63:0/596779478 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f72340e7900 con 0x7f72381029b0 2024-09-21T06:29:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.394+0000 7f72466ad740 1 -- 172.21.15.63:0/415754919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5f91b0 msgr2=0x560b5b99e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.394+0000 7f72466ad740 1 --2- 172.21.15.63:0/415754919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5f91b0 0x560b5b99e9b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7230009f00 tx=0x7f723000f730 comp rx=0 tx=0).stop 2024-09-21T06:29:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.395+0000 7f72466ad740 1 -- 172.21.15.63:0/415754919 shutdown_connections 2024-09-21T06:29:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.395+0000 7f72466ad740 1 --2- 172.21.15.63:0/415754919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5d84d0 0x560b5b99f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.395+0000 7f72466ad740 1 --2- 172.21.15.63:0/415754919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b5b5d02f0 0x560b5b99eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.395+0000 7f72466ad740 1 --2- 172.21.15.63:0/415754919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5f91b0 0x560b5b99e9b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.395+0000 7f72466ad740 1 -- 172.21.15.63:0/415754919 >> 172.21.15.63:0/415754919 conn(0x560b5b5ed300 msgr2=0x560b5b99c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.395+0000 7f723d4d5640 1 --2- 172.21.15.63:0/596779478 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f72240b6700 0x7f72240b8c10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x560b5b99d630 tx=0x7f7234013000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.395+0000 7f72466ad740 1 -- 172.21.15.63:0/415754919 shutdown_connections 2024-09-21T06:29:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.395+0000 7f72466ad740 1 -- 172.21.15.63:0/415754919 wait complete. 2024-09-21T06:29:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.395+0000 7f72466ad740 1 -- start start 2024-09-21T06:29:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.395+0000 7f72466ad740 1 Processor -- start 2024-09-21T06:29:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.396+0000 7f72466ad740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b5b5d02f0 0x560b5b9ae490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.396+0000 7f72466ad740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5d84d0 0x560b5b9ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.396+0000 7f72466ad740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5f91b0 0x560b5b9ba8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.396+0000 7f72466ad740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x560b5b83aab0 con 0x560b5b5d84d0 2024-09-21T06:29:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.396+0000 7f72466ad740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560b5b8a8730 con 0x560b5b5f91b0 2024-09-21T06:29:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.396+0000 7f72466ad740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560b5b9b1510 con 0x560b5b5d02f0 2024-09-21T06:29:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.396+0000 7f72466ad740 10 client.0 _ll_register_callbacks cb 0x560b5b8fc6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.396+0000 7f723ccd4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5d84d0 0x560b5b9ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.396+0000 7f723ccd4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5d84d0 0x560b5b9ae9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37242/0 (socket says 172.21.15.63:37242) 2024-09-21T06:29:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.396+0000 7f723ccd4640 1 -- 172.21.15.63:0/4276784575 learned_addr learned my addr 172.21.15.63:0/4276784575 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.396+0000 7f723dcd6640 1 --2- 172.21.15.63:0/4276784575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b5b5d02f0 0x560b5b9ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.396+0000 7f723dcd6640 1 --2- 172.21.15.63:0/4276784575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5f91b0 0x560b5b9ba8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.397+0000 7f723dcd6640 1 -- 172.21.15.63:0/4276784575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5f91b0 msgr2=0x560b5b9ba8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.397+0000 7f723dcd6640 1 --2- 172.21.15.63:0/4276784575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5f91b0 0x560b5b9ba8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.397+0000 7f723dcd6640 1 -- 172.21.15.63:0/4276784575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5d84d0 msgr2=0x560b5b9ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.397+0000 7f723dcd6640 1 --2- 172.21.15.63:0/4276784575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5d84d0 0x560b5b9ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.397+0000 7f723dcd6640 1 -- 172.21.15.63:0/4276784575 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b5b664790 con 0x560b5b5d02f0 2024-09-21T06:29:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.397+0000 7f723ccd4640 1 --2- 172.21.15.63:0/4276784575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5d84d0 0x560b5b9ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.397+0000 7f723dcd6640 1 --2- 172.21.15.63:0/4276784575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b5b5d02f0 0x560b5b9ae490 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f72300116e0 tx=0x7f72300117e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71529be587a93d53 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.397+0000 7f7220ff9640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:29:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.397+0000 7f7220ff9640 1 -- 172.21.15.63:0/4276784575 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7230015070 con 0x560b5b5d02f0 2024-09-21T06:29:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.397+0000 7f7220ff9640 1 -- 172.21.15.63:0/4276784575 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f723001a730 con 0x560b5b5d02f0 2024-09-21T06:29:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.397+0000 7f72466ad740 1 -- 172.21.15.63:0/4276784575 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f723001ab10 con 0x560b5b5d02f0 2024-09-21T06:29:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.398+0000 7f7220ff9640 1 -- 172.21.15.63:0/4276784575 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f723001a930 con 0x560b5b5d02f0 2024-09-21T06:29:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.398+0000 7f72466ad740 10 client.25486 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.398+0000 7f72466ad740 1 -- 172.21.15.63:0/4276784575 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560b5b6dd620 con 0x560b5b5d02f0 2024-09-21T06:29:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.398+0000 7f7220ff9640 1 -- 172.21.15.63:0/4276784575 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f723001ab10 con 0x560b5b5d02f0 2024-09-21T06:29:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.398+0000 7f7220ff9640 1 -- 172.21.15.63:0/4276784575 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f72300056f0 con 0x560b5b5d02f0 2024-09-21T06:29:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.398+0000 7f72466ad740 10 client.25486 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.398+0000 7f72466ad740 10 client.25486 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.398+0000 7f72466ad740 20 client.25486 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.398+0000 7f72466ad740 1 --2- 172.21.15.63:0/4276784575 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x560b5b5b7d80 0x560b5b9c0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.398+0000 7f72466ad740 4 client.25486 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.398+0000 7f72466ad740 1 -- 172.21.15.63:0/4276784575 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b5b915640 con 0x560b5b5b7d80 2024-09-21T06:29:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.399+0000 7f723ccd4640 1 --2- 172.21.15.63:0/4276784575 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x560b5b5b7d80 0x560b5b9c0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.399+0000 7f7220ff9640 10 client.25486 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.399+0000 7f723ccd4640 1 --2- 172.21.15.63:0/4276784575 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x560b5b5b7d80 0x560b5b9c0570 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea3948548495e851 server_cookie=945271cd10132ff1 in_seq=0 out_seq=0 2024-09-21T06:29:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.400+0000 7f7220ff9640 1 -- 172.21.15.63:0/4276784575 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b5b915640 con 0x560b5b5b7d80 2024-09-21T06:29:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.400+0000 7f7220ff9640 10 client.25486 handle_command_reply: tid=0 2024-09-21T06:29:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.400+0000 7f72466ad740 1 client.25486 shutdown 2024-09-21T06:29:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.400+0000 7f72466ad740 1 -- 172.21.15.63:0/4276784575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b5b5d02f0 msgr2=0x560b5b9ae490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.400+0000 7f72466ad740 1 --2- 172.21.15.63:0/4276784575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b5b5d02f0 0x560b5b9ae490 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f72300116e0 tx=0x7f72300117e0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.400+0000 7f72466ad740 1 -- 172.21.15.63:0/4276784575 shutdown_connections 2024-09-21T06:29:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.400+0000 7f72466ad740 1 --2- 172.21.15.63:0/4276784575 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x560b5b5b7d80 0x560b5b9c0570 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.400+0000 7f72466ad740 1 --2- 172.21.15.63:0/4276784575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5f91b0 0x560b5b9ba8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.406 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.400+0000 7f72466ad740 1 --2- 172.21.15.63:0/4276784575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5d84d0 0x560b5b9ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.406 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.400+0000 7f72466ad740 1 --2- 172.21.15.63:0/4276784575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b5b5d02f0 0x560b5b9ae490 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.406 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.400+0000 7f72466ad740 1 -- 172.21.15.63:0/4276784575 >> 172.21.15.63:0/4276784575 conn(0x560b5b5ed300 msgr2=0x560b5b9a03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:18.406 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.400+0000 7f7220ff9640 0 client.25486 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:18.406 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.400+0000 7f72466ad740 1 -- 172.21.15.63:0/4276784575 shutdown_connections 2024-09-21T06:29:18.406 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.400+0000 7f72466ad740 1 -- 172.21.15.63:0/4276784575 wait complete. 2024-09-21T06:29:18.406 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.400+0000 7f72466ad740 20 client.25486 trim_cache size 0 max 16384 2024-09-21T06:29:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.430+0000 7f72466ad740 1 Processor -- start 2024-09-21T06:29:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.430+0000 7f72466ad740 1 -- start start 2024-09-21T06:29:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.430+0000 7f72466ad740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5d02f0 0x560b5b9ae970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.430+0000 7f72466ad740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b5b5d84d0 0x560b5b9ba840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.430+0000 7f72466ad740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5f91b0 0x560b5b9a9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.430+0000 7f72466ad740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f721c00e730 con 0x560b5b5f91b0 2024-09-21T06:29:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.430+0000 7f72466ad740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f721c010270 con 0x560b5b5d02f0 2024-09-21T06:29:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.430+0000 7f72466ad740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f721c00ee00 con 0x560b5b5d84d0 2024-09-21T06:29:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.430+0000 7f723dcd6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5f91b0 0x560b5b9a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.430+0000 7f723dcd6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5f91b0 0x560b5b9a9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37254/0 (socket says 172.21.15.63:37254) 2024-09-21T06:29:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.430+0000 7f723dcd6640 1 -- 172.21.15.63:0/645012989 learned_addr learned my addr 172.21.15.63:0/645012989 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.430+0000 7f723dcd6640 1 --2- 172.21.15.63:0/645012989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5d02f0 0x560b5b9ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.430+0000 7f723ccd4640 1 --2- 172.21.15.63:0/645012989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b5b5d84d0 0x560b5b9ba840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.431+0000 7f723dcd6640 1 -- 172.21.15.63:0/645012989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b5b5d84d0 msgr2=0x560b5b9ba840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.431+0000 7f723dcd6640 1 --2- 172.21.15.63:0/645012989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b5b5d84d0 0x560b5b9ba840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.431+0000 7f723dcd6640 1 -- 172.21.15.63:0/645012989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5d02f0 msgr2=0x560b5b9ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.431+0000 7f723dcd6640 1 --2- 172.21.15.63:0/645012989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5d02f0 0x560b5b9ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.431+0000 7f723dcd6640 1 -- 172.21.15.63:0/645012989 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b5b9a0ee0 con 0x560b5b5f91b0 2024-09-21T06:29:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.431+0000 7f723dcd6640 1 --2- 172.21.15.63:0/645012989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5f91b0 0x560b5b9a9800 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7230031630 tx=0x7f723000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7133234fe44234 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.431+0000 7f7222ffd640 1 -- 172.21.15.63:0/645012989 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7230037030 con 0x560b5b5f91b0 2024-09-21T06:29:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.431+0000 7f7222ffd640 1 -- 172.21.15.63:0/645012989 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7230038040 con 0x560b5b5f91b0 2024-09-21T06:29:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.431+0000 7f7222ffd640 1 -- 172.21.15.63:0/645012989 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7230015040 con 0x560b5b5f91b0 2024-09-21T06:29:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.432+0000 7f72466ad740 1 -- 172.21.15.63:0/645012989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5f91b0 msgr2=0x560b5b9a9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.432+0000 7f72466ad740 1 --2- 172.21.15.63:0/645012989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5f91b0 0x560b5b9a9800 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7230031630 tx=0x7f723000f730 comp rx=0 tx=0).stop 2024-09-21T06:29:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.433+0000 7f72466ad740 1 -- 172.21.15.63:0/645012989 shutdown_connections 2024-09-21T06:29:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.433+0000 7f72466ad740 1 --2- 172.21.15.63:0/645012989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5f91b0 0x560b5b9a9800 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.433+0000 7f72466ad740 1 --2- 172.21.15.63:0/645012989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b5b5d84d0 0x560b5b9ba840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.433+0000 7f72466ad740 1 --2- 172.21.15.63:0/645012989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5d02f0 0x560b5b9ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.433+0000 7f72466ad740 1 -- 172.21.15.63:0/645012989 >> 172.21.15.63:0/645012989 conn(0x560b5b5ed300 msgr2=0x560b5b9a90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.433+0000 7f72466ad740 1 -- 172.21.15.63:0/645012989 shutdown_connections 2024-09-21T06:29:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.433+0000 7f72466ad740 1 -- 172.21.15.63:0/645012989 wait complete. 2024-09-21T06:29:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.433+0000 7f72466ad740 1 -- start start 2024-09-21T06:29:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.433+0000 7f72466ad740 1 Processor -- start 2024-09-21T06:29:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.434+0000 7f72466ad740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b5b5d02f0 0x560b5b9c0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.434+0000 7f72466ad740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5d84d0 0x560b5b9c0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.434+0000 7f72466ad740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5f91b0 0x560b5b9c1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.434+0000 7f72466ad740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f721c00fba0 con 0x560b5b5f91b0 2024-09-21T06:29:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.434+0000 7f72466ad740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f721c00f4d0 con 0x560b5b5d84d0 2024-09-21T06:29:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.434+0000 7f72466ad740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f721c00c710 con 0x560b5b5d02f0 2024-09-21T06:29:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.434+0000 7f723dcd6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5f91b0 0x560b5b9c1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.434+0000 7f723dcd6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5f91b0 0x560b5b9c1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37268/0 (socket says 172.21.15.63:37268) 2024-09-21T06:29:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.434+0000 7f723dcd6640 1 -- 172.21.15.63:0/1851379547 learned_addr learned my addr 172.21.15.63:0/1851379547 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.434+0000 7f723ccd4640 1 --2- 172.21.15.63:0/1851379547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5d84d0 0x560b5b9c0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.434+0000 7f723dcd6640 1 --2- 172.21.15.63:0/1851379547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b5b5d02f0 0x560b5b9c0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.434+0000 7f72466ad740 10 client.0 _ll_register_callbacks cb 0x7f7228009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.435+0000 7f723dcd6640 1 -- 172.21.15.63:0/1851379547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b5b5d02f0 msgr2=0x560b5b9c0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.435+0000 7f723dcd6640 1 --2- 172.21.15.63:0/1851379547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b5b5d02f0 0x560b5b9c0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.435+0000 7f723dcd6640 1 -- 172.21.15.63:0/1851379547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5d84d0 msgr2=0x560b5b9c0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.435+0000 7f723dcd6640 1 --2- 172.21.15.63:0/1851379547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5d84d0 0x560b5b9c0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.435+0000 7f723dcd6640 1 -- 172.21.15.63:0/1851379547 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b5ba28e90 con 0x560b5b5f91b0 2024-09-21T06:29:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.435+0000 7f723dcd6640 1 --2- 172.21.15.63:0/1851379547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5f91b0 0x560b5b9c1190 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x560b5b996b80 tx=0x7f723001a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f951969e51ac7731 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.435+0000 7f7220ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.435+0000 7f7220ff9640 1 -- 172.21.15.63:0/1851379547 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7230037070 con 0x560b5b5f91b0 2024-09-21T06:29:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.435+0000 7f7220ff9640 1 -- 172.21.15.63:0/1851379547 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f7230004bf0 con 0x560b5b5f91b0 2024-09-21T06:29:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.435+0000 7f72466ad740 1 -- 172.21.15.63:0/1851379547 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7230038040 con 0x560b5b5f91b0 2024-09-21T06:29:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.435+0000 7f7220ff9640 1 -- 172.21.15.63:0/1851379547 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7230015070 con 0x560b5b5f91b0 2024-09-21T06:29:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.435+0000 7f72466ad740 10 client.15771 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.436+0000 7f72466ad740 1 -- 172.21.15.63:0/1851379547 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560b5ba2a0a0 con 0x560b5b5f91b0 2024-09-21T06:29:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.436+0000 7f7220ff9640 1 -- 172.21.15.63:0/1851379547 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7230038040 con 0x560b5b5f91b0 2024-09-21T06:29:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.437+0000 7f7220ff9640 1 -- 172.21.15.63:0/1851379547 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f723003d070 con 0x560b5b5f91b0 2024-09-21T06:29:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.437+0000 7f72466ad740 10 client.15771 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.437+0000 7f72466ad740 10 client.15771 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.437+0000 7f72466ad740 20 client.15771 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.437+0000 7f72466ad740 1 --2- 172.21.15.63:0/1851379547 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x560b5b58d1c0 0x560b5ba2c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.437+0000 7f72466ad740 4 client.15771 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:29:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.437+0000 7f72466ad740 1 -- 172.21.15.63:0/1851379547 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560b5b9110f0 con 0x560b5b58d1c0 2024-09-21T06:29:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.437+0000 7f723ccd4640 1 --2- 172.21.15.63:0/1851379547 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x560b5b58d1c0 0x560b5ba2c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.438+0000 7f723ccd4640 1 --2- 172.21.15.63:0/1851379547 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x560b5b58d1c0 0x560b5ba2c720 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edbda4abc4192212 server_cookie=5a78bb3feeb943e6 in_seq=0 out_seq=0 2024-09-21T06:29:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.438+0000 7f7220ff9640 10 client.15771 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:18.446 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.443+0000 7f7220ff9640 1 -- 172.21.15.63:0/1851379547 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560b5b9110f0 con 0x560b5b58d1c0 2024-09-21T06:29:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.443+0000 7f7220ff9640 10 client.15771 handle_command_reply: tid=0 2024-09-21T06:29:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.443+0000 7f72466ad740 1 client.15771 shutdown 2024-09-21T06:29:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.444+0000 7f72466ad740 1 -- 172.21.15.63:0/1851379547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5f91b0 msgr2=0x560b5b9c1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.444+0000 7f72466ad740 1 --2- 172.21.15.63:0/1851379547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5f91b0 0x560b5b9c1190 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x560b5b996b80 tx=0x7f723001a730 comp rx=0 tx=0).stop 2024-09-21T06:29:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.444+0000 7f72466ad740 1 -- 172.21.15.63:0/1851379547 shutdown_connections 2024-09-21T06:29:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.444+0000 7f72466ad740 1 --2- 172.21.15.63:0/1851379547 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x560b5b58d1c0 0x560b5ba2c720 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.444+0000 7f72466ad740 1 --2- 172.21.15.63:0/1851379547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b5b5f91b0 0x560b5b9c1190 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.444+0000 7f72466ad740 1 --2- 172.21.15.63:0/1851379547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b5b5d84d0 0x560b5b9c0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.444+0000 7f72466ad740 1 --2- 172.21.15.63:0/1851379547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b5b5d02f0 0x560b5b9c0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.444+0000 7f72466ad740 1 -- 172.21.15.63:0/1851379547 >> 172.21.15.63:0/1851379547 conn(0x560b5b5ed300 msgr2=0x560b5b9ad050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.444+0000 7f7220ff9640 0 client.15771 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.444+0000 7f72466ad740 1 -- 172.21.15.63:0/1851379547 shutdown_connections 2024-09-21T06:29:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.444+0000 7f72466ad740 1 -- 172.21.15.63:0/1851379547 wait complete. 2024-09-21T06:29:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.444+0000 7f72466ad740 20 client.15771 trim_cache size 0 max 16384 2024-09-21T06:29:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout:{ 2024-09-21T06:29:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout: "message": "", 2024-09-21T06:29:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout: "return_code": 0 2024-09-21T06:29:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout:} 2024-09-21T06:29:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.445+0000 7f723f739640 1 -- 172.21.15.63:0/596779478 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f72240b6700 msgr2=0x7f72240b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.445+0000 7f723f739640 1 --2- 172.21.15.63:0/596779478 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f72240b6700 0x7f72240b8c10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x560b5b99d630 tx=0x7f7234013000 comp rx=0 tx=0).stop 2024-09-21T06:29:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.445+0000 7f723f739640 1 -- 172.21.15.63:0/596779478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72381029b0 msgr2=0x7f7238199540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.445+0000 7f723f739640 1 --2- 172.21.15.63:0/596779478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72381029b0 0x7f7238199540 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f723400ea60 tx=0x7f723400ef20 comp rx=0 tx=0).stop 2024-09-21T06:29:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.445+0000 7f723f739640 1 -- 172.21.15.63:0/596779478 shutdown_connections 2024-09-21T06:29:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.445+0000 7f723f739640 1 --2- 172.21.15.63:0/596779478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f723819ecb0 0x7f723819f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.445+0000 7f723f739640 1 --2- 172.21.15.63:0/596779478 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f72240b6700 0x7f72240b8c10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.445+0000 7f723f739640 1 --2- 172.21.15.63:0/596779478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7238108c30 0x7f7238199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.445+0000 7f723f739640 1 --2- 172.21.15.63:0/596779478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72381029b0 0x7f7238199540 secure :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f723400ea60 tx=0x7f723400ef20 comp rx=0 tx=0).stop 2024-09-21T06:29:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.445+0000 7f723f739640 1 -- 172.21.15.63:0/596779478 >> 172.21.15.63:0/596779478 conn(0x7f723807a740 msgr2=0x7f7238106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.445+0000 7f723f739640 1 -- 172.21.15.63:0/596779478 shutdown_connections 2024-09-21T06:29:18.450 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:18.445+0000 7f723f739640 1 -- 172.21.15.63:0/596779478 wait complete. 2024-09-21T06:29:19.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:19 smithi063 ceph-mon[31150]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T06:29:19.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:19 smithi175 ceph-mon[34510]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T06:29:19.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:19 smithi071 ceph-mon[34844]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T06:29:21.322 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:21 smithi071 ceph-mon[34844]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-21T06:29:21.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:21 smithi063 ceph-mon[31150]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-21T06:29:21.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:21 smithi175 ceph-mon[34510]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-21T06:29:23.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:23 smithi063 ceph-mon[31150]: pgmap v357: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T06:29:23.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:23 smithi175 ceph-mon[34510]: pgmap v357: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T06:29:23.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:23 smithi071 ceph-mon[34844]: pgmap v357: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T06:29:25.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:25 smithi063 ceph-mon[31150]: pgmap v358: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:29:25.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:25 smithi175 ceph-mon[34510]: pgmap v358: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:29:25.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:25 smithi071 ceph-mon[34844]: pgmap v358: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:29:25.913 INFO:tasks.workunit.client.0.smithi063.stderr:Updating files: 91% (11644/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T06:29:26.834 INFO:tasks.workunit.client.0.smithi063.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T06:29:26.834 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-21T06:29:26.834 INFO:tasks.workunit.client.0.smithi063.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T06:29:26.835 INFO:tasks.workunit.client.0.smithi063.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T06:29:26.835 INFO:tasks.workunit.client.0.smithi063.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T06:29:26.835 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-21T06:29:26.835 INFO:tasks.workunit.client.0.smithi063.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T06:29:26.835 INFO:tasks.workunit.client.0.smithi063.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T06:29:26.835 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-21T06:29:26.835 INFO:tasks.workunit.client.0.smithi063.stderr: git switch -c 2024-09-21T06:29:26.835 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-21T06:29:26.835 INFO:tasks.workunit.client.0.smithi063.stderr:Or undo this operation with: 2024-09-21T06:29:26.835 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-21T06:29:26.835 INFO:tasks.workunit.client.0.smithi063.stderr: git switch - 2024-09-21T06:29:26.835 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-21T06:29:26.835 INFO:tasks.workunit.client.0.smithi063.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T06:29:26.835 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-21T06:29:26.836 INFO:tasks.workunit.client.0.smithi063.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:29:26.842 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T06:29:26.866 INFO:tasks.workunit.client.0.smithi063.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T06:29:26.868 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T06:29:26.868 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T06:29:27.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:27 smithi063 ceph-mon[31150]: pgmap v359: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T06:29:27.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:27 smithi175 ceph-mon[34510]: pgmap v359: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T06:29:27.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:27 smithi071 ceph-mon[34844]: pgmap v359: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T06:29:27.566 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T06:29:27.644 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T06:29:27.687 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T06:29:27.688 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T06:29:27.688 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T06:29:27.729 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T06:29:27.733 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:29:27.733 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T06:29:27.790 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2024-09-21T06:29:27.792 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2024-09-21T06:29:27.792 DEBUG:teuthology.orchestra.run.smithi063:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2024-09-21T06:29:27.853 INFO:tasks.workunit.client.0.smithi063.stderr:+ set -e 2024-09-21T06:29:27.853 INFO:tasks.workunit.client.0.smithi063.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2024-09-21T06:29:27.855 INFO:tasks.workunit.client.0.smithi063.stderr:Cloning into 'xfstests-dev'... 2024-09-21T06:29:29.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:29 smithi063 ceph-mon[31150]: pgmap v360: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:29:29.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:29 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:29.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:29 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:29.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:29 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:29.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:29 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:29.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:29 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:29.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:29 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:29.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:29 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:29 smithi175 ceph-mon[34510]: pgmap v360: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:29:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:29 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:29 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:29 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:29 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:29 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:29 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:29.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:29 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:29.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:29 smithi071 ceph-mon[34844]: pgmap v360: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:29:29.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:29 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:29.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:29 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:29.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:29 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:29.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:29 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:29.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:29 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:29.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:29 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:29.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:29 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:30.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:30 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:30.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:30 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:30.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:30 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:30.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:30 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:30.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:30 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:30.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:30 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:30.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:30 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:30.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:30 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:30.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:30 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:29:31.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:31 smithi175 ceph-mon[34510]: pgmap v361: 97 pgs: 97 active+clean; 1.5 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-21T06:29:31.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:31 smithi071 ceph-mon[34844]: pgmap v361: 97 pgs: 97 active+clean; 1.5 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-21T06:29:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.557+0000 7fdd5d8de640 1 -- 172.21.15.63:0/76582736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd58104990 msgr2=0x7fdd58104da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.557+0000 7fdd5d8de640 1 --2- 172.21.15.63:0/76582736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd58104990 0x7fdd58104da0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009900 tx=0x7fdd4802a410 comp rx=0 tx=0).stop 2024-09-21T06:29:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.557+0000 7fdd5d8de640 1 -- 172.21.15.63:0/76582736 shutdown_connections 2024-09-21T06:29:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.557+0000 7fdd5d8de640 1 --2- 172.21.15.63:0/76582736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd5810ddb0 0x7fdd58110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.557+0000 7fdd5d8de640 1 --2- 172.21.15.63:0/76582736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd581052e0 0x7fdd5810d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.557+0000 7fdd5d8de640 1 --2- 172.21.15.63:0/76582736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd58104990 0x7fdd58104da0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.557+0000 7fdd5d8de640 1 -- 172.21.15.63:0/76582736 >> 172.21.15.63:0/76582736 conn(0x7fdd580fe3e0 msgr2=0x7fdd58100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.557+0000 7fdd5d8de640 1 -- 172.21.15.63:0/76582736 shutdown_connections 2024-09-21T06:29:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.557+0000 7fdd5d8de640 1 -- 172.21.15.63:0/76582736 wait complete. 2024-09-21T06:29:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.558+0000 7fdd5d8de640 1 Processor -- start 2024-09-21T06:29:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.558+0000 7fdd5d8de640 1 -- start start 2024-09-21T06:29:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.559+0000 7fdd5d8de640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd58104990 0x7fdd5819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.559+0000 7fdd5d8de640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd581052e0 0x7fdd5819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.559+0000 7fdd5d8de640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd5810ddb0 0x7fdd5819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.559+0000 7fdd5d8de640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdd58113a20 con 0x7fdd5810ddb0 2024-09-21T06:29:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.559+0000 7fdd5d8de640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581138a0 con 0x7fdd58104990 2024-09-21T06:29:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.559+0000 7fdd5d8de640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdd58113ba0 con 0x7fdd581052e0 2024-09-21T06:29:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.559+0000 7fdd577fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd5810ddb0 0x7fdd5819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.559+0000 7fdd577fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd5810ddb0 0x7fdd5819fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42968/0 (socket says 172.21.15.63:42968) 2024-09-21T06:29:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.559+0000 7fdd577fe640 1 -- 172.21.15.63:0/2478736979 learned_addr learned my addr 172.21.15.63:0/2478736979 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.559+0000 7fdd56ffd640 1 --2- 172.21.15.63:0/2478736979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd58104990 0x7fdd5819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.559+0000 7fdd567fc640 1 --2- 172.21.15.63:0/2478736979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd581052e0 0x7fdd5819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.559+0000 7fdd577fe640 1 -- 172.21.15.63:0/2478736979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd581052e0 msgr2=0x7fdd5819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.559+0000 7fdd577fe640 1 --2- 172.21.15.63:0/2478736979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd581052e0 0x7fdd5819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.559+0000 7fdd577fe640 1 -- 172.21.15.63:0/2478736979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd58104990 msgr2=0x7fdd5819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.559+0000 7fdd577fe640 1 --2- 172.21.15.63:0/2478736979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd58104990 0x7fdd5819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.559+0000 7fdd577fe640 1 -- 172.21.15.63:0/2478736979 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd581a03f0 con 0x7fdd5810ddb0 2024-09-21T06:29:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.559+0000 7fdd577fe640 1 --2- 172.21.15.63:0/2478736979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd5810ddb0 0x7fdd5819fcf0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000eb10 tx=0x7fdd5000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.560+0000 7fdd5c8dc640 1 -- 172.21.15.63:0/2478736979 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd50004b20 con 0x7fdd5810ddb0 2024-09-21T06:29:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.560+0000 7fdd5c8dc640 1 -- 172.21.15.63:0/2478736979 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd50004cc0 con 0x7fdd5810ddb0 2024-09-21T06:29:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.560+0000 7fdd5d8de640 1 -- 172.21.15.63:0/2478736979 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd581a06e0 con 0x7fdd5810ddb0 2024-09-21T06:29:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.560+0000 7fdd5c8dc640 1 -- 172.21.15.63:0/2478736979 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd50010670 con 0x7fdd5810ddb0 2024-09-21T06:29:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.560+0000 7fdd5d8de640 1 -- 172.21.15.63:0/2478736979 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd581a6e70 con 0x7fdd5810ddb0 2024-09-21T06:29:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.563+0000 7fdd64853740 1 Processor -- start 2024-09-21T06:29:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.563+0000 7fdd5c8dc640 1 -- 172.21.15.63:0/2478736979 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fdd50005020 con 0x7fdd5810ddb0 2024-09-21T06:29:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.563+0000 7fdd64853740 1 -- start start 2024-09-21T06:29:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.563+0000 7fdd64853740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b87151b0 0x5580b8aba9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.563+0000 7fdd64853740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580b86ec2f0 0x5580b8abaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.563+0000 7fdd64853740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b86f44d0 0x5580b8abb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.563+0000 7fdd64853740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5580b8a2f6f0 con 0x5580b87151b0 2024-09-21T06:29:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.563+0000 7fdd64853740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5580b8a1eb20 con 0x5580b86f44d0 2024-09-21T06:29:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.563+0000 7fdd64853740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5580b8a22930 con 0x5580b86ec2f0 2024-09-21T06:29:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.563+0000 7fdd567fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b87151b0 0x5580b8aba9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.563+0000 7fdd567fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b87151b0 0x5580b8aba9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42974/0 (socket says 172.21.15.63:42974) 2024-09-21T06:29:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.563+0000 7fdd567fc640 1 -- 172.21.15.63:0/1877795114 learned_addr learned my addr 172.21.15.63:0/1877795114 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.563+0000 7fdd56ffd640 1 --2- 172.21.15.63:0/1877795114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580b86ec2f0 0x5580b8abaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.564+0000 7fdd567fc640 1 --2- 172.21.15.63:0/1877795114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b86f44d0 0x5580b8abb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.564+0000 7fdd5c8dc640 1 --2- 172.21.15.63:0/2478736979 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdd400b6680 0x7fdd400b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.564+0000 7fdd567fc640 1 -- 172.21.15.63:0/1877795114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580b86ec2f0 msgr2=0x5580b8abaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.564+0000 7fdd567fc640 1 --2- 172.21.15.63:0/1877795114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580b86ec2f0 0x5580b8abaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.564+0000 7fdd567fc640 1 -- 172.21.15.63:0/1877795114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b86f44d0 msgr2=0x5580b8abb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.564+0000 7fdd567fc640 1 --2- 172.21.15.63:0/1877795114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b86f44d0 0x5580b8abb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.564+0000 7fdd567fc640 1 -- 172.21.15.63:0/1877795114 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580b89e4530 con 0x5580b87151b0 2024-09-21T06:29:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.564+0000 7fdd577fe640 1 --2- 172.21.15.63:0/2478736979 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdd400b6680 0x7fdd400b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.564+0000 7fdd567fc640 1 --2- 172.21.15.63:0/1877795114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b87151b0 0x5580b8aba9b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c013500 tx=0x7fdd4c009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7426aa155c6f4e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.564+0000 7fdd5c8dc640 1 -- 172.21.15.63:0/2478736979 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fdd500e7d10 con 0x7fdd5810ddb0 2024-09-21T06:29:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.564+0000 7fdd3dffb640 1 -- 172.21.15.63:0/1877795114 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c005020 con 0x5580b87151b0 2024-09-21T06:29:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.564+0000 7fdd3dffb640 1 -- 172.21.15.63:0/1877795114 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd4c0047a0 con 0x5580b87151b0 2024-09-21T06:29:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.564+0000 7fdd3dffb640 1 -- 172.21.15.63:0/1877795114 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c0106f0 con 0x5580b87151b0 2024-09-21T06:29:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.565+0000 7fdd64853740 1 -- 172.21.15.63:0/1877795114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b87151b0 msgr2=0x5580b8aba9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.565+0000 7fdd64853740 1 --2- 172.21.15.63:0/1877795114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b87151b0 0x5580b8aba9b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c013500 tx=0x7fdd4c009720 comp rx=0 tx=0).stop 2024-09-21T06:29:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.565+0000 7fdd577fe640 1 --2- 172.21.15.63:0/2478736979 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdd400b6680 0x7fdd400b8b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdd500e5550 tx=0x7fdd500de640 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.565+0000 7fdd64853740 1 -- 172.21.15.63:0/1877795114 shutdown_connections 2024-09-21T06:29:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.565+0000 7fdd64853740 1 --2- 172.21.15.63:0/1877795114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b86f44d0 0x5580b8abb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.565+0000 7fdd64853740 1 --2- 172.21.15.63:0/1877795114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580b86ec2f0 0x5580b8abaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.565+0000 7fdd64853740 1 --2- 172.21.15.63:0/1877795114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b87151b0 0x5580b8aba9b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.565+0000 7fdd64853740 1 -- 172.21.15.63:0/1877795114 >> 172.21.15.63:0/1877795114 conn(0x5580b8709300 msgr2=0x5580b8ab88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.565+0000 7fdd64853740 1 -- 172.21.15.63:0/1877795114 shutdown_connections 2024-09-21T06:29:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.565+0000 7fdd64853740 1 -- 172.21.15.63:0/1877795114 wait complete. 2024-09-21T06:29:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.566+0000 7fdd64853740 1 -- start start 2024-09-21T06:29:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.566+0000 7fdd64853740 1 Processor -- start 2024-09-21T06:29:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.566+0000 7fdd64853740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580b86ec2f0 0x5580b8aca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.566+0000 7fdd64853740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86f44d0 0x5580b8aca910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.566+0000 7fdd64853740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b87151b0 0x5580b8acae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.566+0000 7fdd64853740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5580b8956ab0 con 0x5580b86f44d0 2024-09-21T06:29:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.566+0000 7fdd64853740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5580b89c4730 con 0x5580b87151b0 2024-09-21T06:29:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.566+0000 7fdd64853740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5580b8acd510 con 0x5580b86ec2f0 2024-09-21T06:29:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.566+0000 7fdd64853740 10 client.0 _ll_register_callbacks cb 0x5580b8a186b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.566+0000 7fdd56ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86f44d0 0x5580b8aca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.566+0000 7fdd56ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86f44d0 0x5580b8aca910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42982/0 (socket says 172.21.15.63:42982) 2024-09-21T06:29:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.566+0000 7fdd56ffd640 1 -- 172.21.15.63:0/1233033416 learned_addr learned my addr 172.21.15.63:0/1233033416 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.567+0000 7fdd567fc640 1 --2- 172.21.15.63:0/1233033416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580b86ec2f0 0x5580b8aca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.567+0000 7fdd567fc640 1 --2- 172.21.15.63:0/1233033416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b87151b0 0x5580b8acae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.567+0000 7fdd56ffd640 1 -- 172.21.15.63:0/1233033416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580b86ec2f0 msgr2=0x5580b8aca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.567+0000 7fdd56ffd640 1 --2- 172.21.15.63:0/1233033416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580b86ec2f0 0x5580b8aca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.567+0000 7fdd56ffd640 1 -- 172.21.15.63:0/1233033416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b87151b0 msgr2=0x5580b8acae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.567+0000 7fdd56ffd640 1 --2- 172.21.15.63:0/1233033416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b87151b0 0x5580b8acae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.567+0000 7fdd56ffd640 1 -- 172.21.15.63:0/1233033416 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580b8780790 con 0x5580b86f44d0 2024-09-21T06:29:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.567+0000 7fdd567fc640 1 --2- 172.21.15.63:0/1233033416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b87151b0 0x5580b8acae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.567+0000 7fdd56ffd640 1 --2- 172.21.15.63:0/1233033416 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86f44d0 0x5580b8aca910 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fdd4802a930 tx=0x7fdd48032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738bed1280c4bd9d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.567+0000 7fdd36ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.567+0000 7fdd36ffd640 1 -- 172.21.15.63:0/1233033416 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48035040 con 0x5580b86f44d0 2024-09-21T06:29:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.567+0000 7fdd64853740 1 -- 172.21.15.63:0/1233033416 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd4c0047a0 con 0x5580b86f44d0 2024-09-21T06:29:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.567+0000 7fdd36ffd640 1 -- 172.21.15.63:0/1233033416 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fdd48031860 con 0x5580b86f44d0 2024-09-21T06:29:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.567+0000 7fdd36ffd640 1 -- 172.21.15.63:0/1233033416 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdd48004040 con 0x5580b86f44d0 2024-09-21T06:29:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.568+0000 7fdd64853740 10 client.15783 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.568+0000 7fdd64853740 1 -- 172.21.15.63:0/1233033416 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5580b87f9620 con 0x5580b86f44d0 2024-09-21T06:29:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.568+0000 7fdd36ffd640 1 -- 172.21.15.63:0/1233033416 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd4c0047a0 con 0x5580b86f44d0 2024-09-21T06:29:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.568+0000 7fdd36ffd640 1 -- 172.21.15.63:0/1233033416 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fdd480047e0 con 0x5580b86f44d0 2024-09-21T06:29:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.568+0000 7fdd64853740 10 client.15783 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.568+0000 7fdd64853740 10 client.15783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.568+0000 7fdd64853740 20 client.15783 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.568+0000 7fdd64853740 1 --2- 172.21.15.63:0/1233033416 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5580b86d3d80 0x5580b8adc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.568+0000 7fdd64853740 4 client.15783 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.568+0000 7fdd64853740 1 -- 172.21.15.63:0/1233033416 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580b8a31640 con 0x5580b86d3d80 2024-09-21T06:29:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.568+0000 7fdd567fc640 1 --2- 172.21.15.63:0/1233033416 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5580b86d3d80 0x5580b8adc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.569+0000 7fdd567fc640 1 --2- 172.21.15.63:0/1233033416 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5580b86d3d80 0x5580b8adc520 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=233f04cb6fabeb21 server_cookie=f008ceb1e454df8 in_seq=0 out_seq=0 2024-09-21T06:29:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.569+0000 7fdd36ffd640 10 client.15783 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.569+0000 7fdd36ffd640 1 -- 172.21.15.63:0/1233033416 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5580b8a31640 con 0x5580b86d3d80 2024-09-21T06:29:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.569+0000 7fdd36ffd640 10 client.15783 handle_command_reply: tid=0 2024-09-21T06:29:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.569+0000 7fdd64853740 1 client.15783 shutdown 2024-09-21T06:29:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.570+0000 7fdd64853740 1 -- 172.21.15.63:0/1233033416 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86f44d0 msgr2=0x5580b8aca910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.570+0000 7fdd64853740 1 --2- 172.21.15.63:0/1233033416 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86f44d0 0x5580b8aca910 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fdd4802a930 tx=0x7fdd48032f20 comp rx=0 tx=0).stop 2024-09-21T06:29:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.570+0000 7fdd64853740 1 -- 172.21.15.63:0/1233033416 shutdown_connections 2024-09-21T06:29:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.570+0000 7fdd64853740 1 --2- 172.21.15.63:0/1233033416 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5580b86d3d80 0x5580b8adc520 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.570+0000 7fdd64853740 1 --2- 172.21.15.63:0/1233033416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b87151b0 0x5580b8acae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.570+0000 7fdd64853740 1 --2- 172.21.15.63:0/1233033416 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86f44d0 0x5580b8aca910 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.570+0000 7fdd36ffd640 0 client.15783 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.570+0000 7fdd64853740 1 --2- 172.21.15.63:0/1233033416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580b86ec2f0 0x5580b8aca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.570+0000 7fdd64853740 1 -- 172.21.15.63:0/1233033416 >> 172.21.15.63:0/1233033416 conn(0x5580b8709300 msgr2=0x5580b8abc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.570+0000 7fdd64853740 1 -- 172.21.15.63:0/1233033416 shutdown_connections 2024-09-21T06:29:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.570+0000 7fdd64853740 1 -- 172.21.15.63:0/1233033416 wait complete. 2024-09-21T06:29:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.570+0000 7fdd64853740 20 client.15783 trim_cache size 0 max 16384 2024-09-21T06:29:31.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:31 smithi063 ceph-mon[31150]: pgmap v361: 97 pgs: 97 active+clean; 1.5 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-21T06:29:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.585+0000 7fdd64853740 1 Processor -- start 2024-09-21T06:29:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.585+0000 7fdd64853740 1 -- start start 2024-09-21T06:29:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.585+0000 7fdd64853740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86ec2f0 0x5580b8aca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.585+0000 7fdd64853740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580b86f44d0 0x5580b8ab81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.585+0000 7fdd64853740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b87151b0 0x5580b8ac75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.585+0000 7fdd64853740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581ad3e0 con 0x5580b86ec2f0 2024-09-21T06:29:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.585+0000 7fdd64853740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581aef20 con 0x5580b87151b0 2024-09-21T06:29:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.585+0000 7fdd64853740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581adab0 con 0x5580b86f44d0 2024-09-21T06:29:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.585+0000 7fdd567fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86ec2f0 0x5580b8aca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.585+0000 7fdd567fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86ec2f0 0x5580b8aca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42988/0 (socket says 172.21.15.63:42988) 2024-09-21T06:29:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.585+0000 7fdd567fc640 1 -- 172.21.15.63:0/134672565 learned_addr learned my addr 172.21.15.63:0/134672565 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.585+0000 7fdd56ffd640 1 --2- 172.21.15.63:0/134672565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580b86f44d0 0x5580b8ab81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.585+0000 7fdd567fc640 1 --2- 172.21.15.63:0/134672565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b87151b0 0x5580b8ac75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.586+0000 7fdd567fc640 1 -- 172.21.15.63:0/134672565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580b86f44d0 msgr2=0x5580b8ab81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.586+0000 7fdd567fc640 1 --2- 172.21.15.63:0/134672565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580b86f44d0 0x5580b8ab81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.586+0000 7fdd567fc640 1 -- 172.21.15.63:0/134672565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b87151b0 msgr2=0x5580b8ac75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.586+0000 7fdd567fc640 1 --2- 172.21.15.63:0/134672565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b87151b0 0x5580b8ac75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.586+0000 7fdd567fc640 1 -- 172.21.15.63:0/134672565 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580b8ad6740 con 0x5580b86ec2f0 2024-09-21T06:29:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.586+0000 7fdd567fc640 1 --2- 172.21.15.63:0/134672565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86ec2f0 0x5580b8aca8b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009380 tx=0x7fdd4c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1b571d897caa0d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.586+0000 7fdd3d7fa640 1 -- 172.21.15.63:0/134672565 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c0049d0 con 0x5580b86ec2f0 2024-09-21T06:29:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.586+0000 7fdd3d7fa640 1 -- 172.21.15.63:0/134672565 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd4c0044e0 con 0x5580b86ec2f0 2024-09-21T06:29:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.586+0000 7fdd3d7fa640 1 -- 172.21.15.63:0/134672565 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c005630 con 0x5580b86ec2f0 2024-09-21T06:29:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.587+0000 7fdd64853740 1 -- 172.21.15.63:0/134672565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86ec2f0 msgr2=0x5580b8aca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.587+0000 7fdd64853740 1 --2- 172.21.15.63:0/134672565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86ec2f0 0x5580b8aca8b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009380 tx=0x7fdd4c005f90 comp rx=0 tx=0).stop 2024-09-21T06:29:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.587+0000 7fdd64853740 1 -- 172.21.15.63:0/134672565 shutdown_connections 2024-09-21T06:29:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.587+0000 7fdd64853740 1 --2- 172.21.15.63:0/134672565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b87151b0 0x5580b8ac75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.587+0000 7fdd64853740 1 --2- 172.21.15.63:0/134672565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580b86f44d0 0x5580b8ab81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.587+0000 7fdd64853740 1 --2- 172.21.15.63:0/134672565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86ec2f0 0x5580b8aca8b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.587+0000 7fdd64853740 1 -- 172.21.15.63:0/134672565 >> 172.21.15.63:0/134672565 conn(0x5580b8709300 msgr2=0x5580b8abfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.587+0000 7fdd64853740 1 -- 172.21.15.63:0/134672565 shutdown_connections 2024-09-21T06:29:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.587+0000 7fdd64853740 1 -- 172.21.15.63:0/134672565 wait complete. 2024-09-21T06:29:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.587+0000 7fdd64853740 1 -- start start 2024-09-21T06:29:31.594 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.587+0000 7fdd64853740 1 Processor -- start 2024-09-21T06:29:31.594 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.588+0000 7fdd64853740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86ec2f0 0x5580b8ad2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.594 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.588+0000 7fdd64853740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b86f44d0 0x5580b8ad3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.594 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.588+0000 7fdd64853740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580b87151b0 0x5580b8ace1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.594 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.588+0000 7fdd64853740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581ae850 con 0x5580b86ec2f0 2024-09-21T06:29:31.594 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.588+0000 7fdd64853740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581ae180 con 0x5580b86f44d0 2024-09-21T06:29:31.594 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.588+0000 7fdd64853740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581ab3c0 con 0x5580b87151b0 2024-09-21T06:29:31.594 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.588+0000 7fdd64853740 10 client.0 _ll_register_callbacks cb 0x7fdd48009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:31.594 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.588+0000 7fdd567fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86ec2f0 0x5580b8ad2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.594 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.588+0000 7fdd567fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86ec2f0 0x5580b8ad2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42990/0 (socket says 172.21.15.63:42990) 2024-09-21T06:29:31.594 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.588+0000 7fdd567fc640 1 -- 172.21.15.63:0/2243663790 learned_addr learned my addr 172.21.15.63:0/2243663790 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:31.594 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.588+0000 7fdd56ffd640 1 --2- 172.21.15.63:0/2243663790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b86f44d0 0x5580b8ad3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.594 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.588+0000 7fdd567fc640 1 -- 172.21.15.63:0/2243663790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580b87151b0 msgr2=0x5580b8ace1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.588+0000 7fdd567fc640 1 --2- 172.21.15.63:0/2243663790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580b87151b0 0x5580b8ace1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.588+0000 7fdd567fc640 1 -- 172.21.15.63:0/2243663790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b86f44d0 msgr2=0x5580b8ad3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.588+0000 7fdd567fc640 1 --2- 172.21.15.63:0/2243663790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b86f44d0 0x5580b8ad3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.588+0000 7fdd567fc640 1 -- 172.21.15.63:0/2243663790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580b8ace930 con 0x5580b86ec2f0 2024-09-21T06:29:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.588+0000 7fdd56ffd640 1 --2- 172.21.15.63:0/2243663790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b86f44d0 0x5580b8ad3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.588+0000 7fdd567fc640 1 --2- 172.21.15.63:0/2243663790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86ec2f0 0x5580b8ad2ba0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0133a0 tx=0x7fdd4c005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e04b1f4d46c92bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.588+0000 7fdd36ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.589+0000 7fdd36ffd640 1 -- 172.21.15.63:0/2243663790 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c0055c0 con 0x5580b86ec2f0 2024-09-21T06:29:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.589+0000 7fdd36ffd640 1 -- 172.21.15.63:0/2243663790 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fdd4c0049d0 con 0x5580b86ec2f0 2024-09-21T06:29:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.589+0000 7fdd64853740 1 -- 172.21.15.63:0/2243663790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd4c0044e0 con 0x5580b86ec2f0 2024-09-21T06:29:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.589+0000 7fdd36ffd640 1 -- 172.21.15.63:0/2243663790 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdd4c004bd0 con 0x5580b86ec2f0 2024-09-21T06:29:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.589+0000 7fdd64853740 10 client.15789 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.589+0000 7fdd64853740 1 -- 172.21.15.63:0/2243663790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5580b8b46a40 con 0x5580b86ec2f0 2024-09-21T06:29:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.589+0000 7fdd36ffd640 1 -- 172.21.15.63:0/2243663790 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd4c0044e0 con 0x5580b86ec2f0 2024-09-21T06:29:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.589+0000 7fdd36ffd640 1 -- 172.21.15.63:0/2243663790 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fdd4c040440 con 0x5580b86ec2f0 2024-09-21T06:29:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.589+0000 7fdd64853740 10 client.15789 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.589+0000 7fdd64853740 10 client.15789 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.589+0000 7fdd64853740 20 client.15789 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.589+0000 7fdd64853740 1 --2- 172.21.15.63:0/2243663790 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5580b86a91c0 0x5580b8b48f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.589+0000 7fdd64853740 4 client.15789 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:29:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.589+0000 7fdd64853740 1 -- 172.21.15.63:0/2243663790 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5580b8a2d0f0 con 0x5580b86a91c0 2024-09-21T06:29:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.590+0000 7fdd56ffd640 1 --2- 172.21.15.63:0/2243663790 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5580b86a91c0 0x5580b8b48f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.590+0000 7fdd56ffd640 1 --2- 172.21.15.63:0/2243663790 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5580b86a91c0 0x5580b8b48f90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0ffe64d7cd4ed3d server_cookie=2dd41e5a4ad9c7f8 in_seq=0 out_seq=0 2024-09-21T06:29:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.590+0000 7fdd36ffd640 10 client.15789 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.802+0000 7fdd36ffd640 1 -- 172.21.15.63:0/2243663790 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5580b8a2d0f0 con 0x5580b86a91c0 2024-09-21T06:29:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.802+0000 7fdd36ffd640 10 client.15789 handle_command_reply: tid=0 2024-09-21T06:29:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.802+0000 7fdd64853740 1 client.15789 shutdown 2024-09-21T06:29:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.802+0000 7fdd64853740 1 -- 172.21.15.63:0/2243663790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86ec2f0 msgr2=0x5580b8ad2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.802+0000 7fdd64853740 1 --2- 172.21.15.63:0/2243663790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86ec2f0 0x5580b8ad2ba0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0133a0 tx=0x7fdd4c005020 comp rx=0 tx=0).stop 2024-09-21T06:29:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.802+0000 7fdd64853740 1 -- 172.21.15.63:0/2243663790 shutdown_connections 2024-09-21T06:29:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.802+0000 7fdd64853740 1 --2- 172.21.15.63:0/2243663790 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5580b86a91c0 0x5580b8b48f90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.802+0000 7fdd64853740 1 --2- 172.21.15.63:0/2243663790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580b87151b0 0x5580b8ace1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.802+0000 7fdd64853740 1 --2- 172.21.15.63:0/2243663790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580b86f44d0 0x5580b8ad3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.802+0000 7fdd64853740 1 --2- 172.21.15.63:0/2243663790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580b86ec2f0 0x5580b8ad2ba0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.802+0000 7fdd36ffd640 0 client.15789 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.802+0000 7fdd64853740 1 -- 172.21.15.63:0/2243663790 >> 172.21.15.63:0/2243663790 conn(0x5580b8709300 msgr2=0x5580b8ac50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.802+0000 7fdd64853740 1 -- 172.21.15.63:0/2243663790 shutdown_connections 2024-09-21T06:29:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.802+0000 7fdd64853740 1 -- 172.21.15.63:0/2243663790 wait complete. 2024-09-21T06:29:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.802+0000 7fdd64853740 20 client.15789 trim_cache size 0 max 16384 2024-09-21T06:29:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout:{ 2024-09-21T06:29:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout: "message": "", 2024-09-21T06:29:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout: "return_code": 0 2024-09-21T06:29:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout:} 2024-09-21T06:29:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.803+0000 7fdd5d8de640 1 -- 172.21.15.63:0/2478736979 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdd400b6680 msgr2=0x7fdd400b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.803+0000 7fdd5d8de640 1 --2- 172.21.15.63:0/2478736979 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdd400b6680 0x7fdd400b8b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdd500e5550 tx=0x7fdd500de640 comp rx=0 tx=0).stop 2024-09-21T06:29:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.803+0000 7fdd5d8de640 1 -- 172.21.15.63:0/2478736979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd5810ddb0 msgr2=0x7fdd5819fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.803+0000 7fdd5d8de640 1 --2- 172.21.15.63:0/2478736979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd5810ddb0 0x7fdd5819fcf0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000eb10 tx=0x7fdd5000c2d0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.803+0000 7fdd5d8de640 1 -- 172.21.15.63:0/2478736979 shutdown_connections 2024-09-21T06:29:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.803+0000 7fdd5d8de640 1 --2- 172.21.15.63:0/2478736979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd5810ddb0 0x7fdd5819fcf0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.803+0000 7fdd5d8de640 1 --2- 172.21.15.63:0/2478736979 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdd400b6680 0x7fdd400b8b90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.803+0000 7fdd5d8de640 1 --2- 172.21.15.63:0/2478736979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd581052e0 0x7fdd5819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.803+0000 7fdd5d8de640 1 --2- 172.21.15.63:0/2478736979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd58104990 0x7fdd5819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.803+0000 7fdd5d8de640 1 -- 172.21.15.63:0/2478736979 >> 172.21.15.63:0/2478736979 conn(0x7fdd580fe3e0 msgr2=0x7fdd580fffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.803+0000 7fdd5d8de640 1 -- 172.21.15.63:0/2478736979 shutdown_connections 2024-09-21T06:29:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:31.803+0000 7fdd5d8de640 1 -- 172.21.15.63:0/2478736979 wait complete. 2024-09-21T06:29:33.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:33 smithi071 ceph-mon[34844]: pgmap v362: 97 pgs: 97 active+clean; 15 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 1.1 MiB/s wr, 22 op/s 2024-09-21T06:29:33.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:33 smithi063 ceph-mon[31150]: pgmap v362: 97 pgs: 97 active+clean; 15 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 1.1 MiB/s wr, 22 op/s 2024-09-21T06:29:33.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:33 smithi175 ceph-mon[34510]: pgmap v362: 97 pgs: 97 active+clean; 15 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 1.1 MiB/s wr, 22 op/s 2024-09-21T06:29:35.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:35 smithi071 ceph-mon[34844]: pgmap v363: 97 pgs: 97 active+clean; 15 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 1.2 MiB/s wr, 39 op/s 2024-09-21T06:29:35.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:35 smithi063 ceph-mon[31150]: pgmap v363: 97 pgs: 97 active+clean; 15 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 1.2 MiB/s wr, 39 op/s 2024-09-21T06:29:35.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:35 smithi175 ceph-mon[34510]: pgmap v363: 97 pgs: 97 active+clean; 15 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 1.2 MiB/s wr, 39 op/s 2024-09-21T06:29:37.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:37 smithi071 ceph-mon[34844]: pgmap v364: 97 pgs: 97 active+clean; 16 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 1.3 MiB/s wr, 69 op/s 2024-09-21T06:29:37.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:37 smithi063 ceph-mon[31150]: pgmap v364: 97 pgs: 97 active+clean; 16 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 1.3 MiB/s wr, 69 op/s 2024-09-21T06:29:37.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:37 smithi175 ceph-mon[34510]: pgmap v364: 97 pgs: 97 active+clean; 16 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 1.3 MiB/s wr, 69 op/s 2024-09-21T06:29:39.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:39 smithi071 ceph-mon[34844]: pgmap v365: 97 pgs: 97 active+clean; 16 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 1.3 MiB/s wr, 92 op/s 2024-09-21T06:29:39.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:39 smithi063 ceph-mon[31150]: pgmap v365: 97 pgs: 97 active+clean; 16 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 1.3 MiB/s wr, 92 op/s 2024-09-21T06:29:39.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:39 smithi175 ceph-mon[34510]: pgmap v365: 97 pgs: 97 active+clean; 16 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 1.3 MiB/s wr, 92 op/s 2024-09-21T06:29:40.138 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:29:40.416 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:40.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.953+0000 7f8b02afe640 1 -- 172.21.15.63:0/722544454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8afc108cf0 msgr2=0x7f8afc10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:40.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.953+0000 7f8b02afe640 1 --2- 172.21.15.63:0/722544454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8afc108cf0 0x7f8afc10f520 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8af4009be0 tx=0x7f8af402a6c0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.953+0000 7f8b02afe640 1 -- 172.21.15.63:0/722544454 shutdown_connections 2024-09-21T06:29:40.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.953+0000 7f8b02afe640 1 --2- 172.21.15.63:0/722544454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8afc108cf0 0x7f8afc10f520 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.953+0000 7f8b02afe640 1 --2- 172.21.15.63:0/722544454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8afc1083a0 0x7f8afc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.953+0000 7f8b02afe640 1 --2- 172.21.15.63:0/722544454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8afc102a60 0x7f8afc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.953+0000 7f8b02afe640 1 -- 172.21.15.63:0/722544454 >> 172.21.15.63:0/722544454 conn(0x7f8afc079730 msgr2=0x7f8afc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.953+0000 7f8b02afe640 1 -- 172.21.15.63:0/722544454 shutdown_connections 2024-09-21T06:29:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.953+0000 7f8b02afe640 1 -- 172.21.15.63:0/722544454 wait complete. 2024-09-21T06:29:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.954+0000 7f8b02afe640 1 Processor -- start 2024-09-21T06:29:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.954+0000 7f8b02afe640 1 -- start start 2024-09-21T06:29:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.954+0000 7f8b02afe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8afc102a60 0x7f8afc19b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.954+0000 7f8b02afe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8afc1083a0 0x7f8afc19b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.954+0000 7f8b02afe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8afc108cf0 0x7f8afc19bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.954+0000 7f8b02afe640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc112960 con 0x7f8afc1083a0 2024-09-21T06:29:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.954+0000 7f8b02afe640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc1127e0 con 0x7f8afc108cf0 2024-09-21T06:29:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.954+0000 7f8b02afe640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc112ae0 con 0x7f8afc102a60 2024-09-21T06:29:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.954+0000 7f8afbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8afc1083a0 0x7f8afc19b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.954+0000 7f8afbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8afc1083a0 0x7f8afc19b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42724/0 (socket says 172.21.15.63:42724) 2024-09-21T06:29:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.954+0000 7f8afbfff640 1 -- 172.21.15.63:0/2977335442 learned_addr learned my addr 172.21.15.63:0/2977335442 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.955+0000 7f8b0089a640 1 --2- 172.21.15.63:0/2977335442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8afc102a60 0x7f8afc19b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.955+0000 7f8b0109b640 1 --2- 172.21.15.63:0/2977335442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8afc108cf0 0x7f8afc19bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.955+0000 7f8afbfff640 1 -- 172.21.15.63:0/2977335442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8afc102a60 msgr2=0x7f8afc19b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.955+0000 7f8afbfff640 1 --2- 172.21.15.63:0/2977335442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8afc102a60 0x7f8afc19b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.955+0000 7f8afbfff640 1 -- 172.21.15.63:0/2977335442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8afc108cf0 msgr2=0x7f8afc19bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.955+0000 7f8afbfff640 1 --2- 172.21.15.63:0/2977335442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8afc108cf0 0x7f8afc19bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.955+0000 7f8afbfff640 1 -- 172.21.15.63:0/2977335442 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8afc1a64d0 con 0x7f8afc1083a0 2024-09-21T06:29:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.955+0000 7f8b0109b640 1 --2- 172.21.15.63:0/2977335442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8afc108cf0 0x7f8afc19bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:40.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.955+0000 7f8afbfff640 1 --2- 172.21.15.63:0/2977335442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8afc1083a0 0x7f8afc19b750 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800e9a0 tx=0x7f8ae800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:40.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.955+0000 7f8af9ffb640 1 -- 172.21.15.63:0/2977335442 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae800cd80 con 0x7f8afc1083a0 2024-09-21T06:29:40.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.955+0000 7f8b02afe640 1 -- 172.21.15.63:0/2977335442 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8afc1a67c0 con 0x7f8afc1083a0 2024-09-21T06:29:40.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.955+0000 7f8af9ffb640 1 -- 172.21.15.63:0/2977335442 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ae80035f0 con 0x7f8afc1083a0 2024-09-21T06:29:40.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.955+0000 7f8af9ffb640 1 -- 172.21.15.63:0/2977335442 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8010690 con 0x7f8afc1083a0 2024-09-21T06:29:40.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.956+0000 7f8b02afe640 1 -- 172.21.15.63:0/2977335442 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8afc1a6d50 con 0x7f8afc1083a0 2024-09-21T06:29:40.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.958+0000 7f8af9ffb640 1 -- 172.21.15.63:0/2977335442 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f8ae8010830 con 0x7f8afc1083a0 2024-09-21T06:29:40.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.958+0000 7f8b09072740 1 Processor -- start 2024-09-21T06:29:40.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.958+0000 7f8b09072740 1 -- start start 2024-09-21T06:29:40.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.959+0000 7f8af9ffb640 1 --2- 172.21.15.63:0/2977335442 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8aec0b6680 0x7f8aec0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:40.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.959+0000 7f8b09072740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6f0070 0x562a9aa97650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:40.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.959+0000 7f8b09072740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6c71b0 0x562a9aa97b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:40.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.959+0000 7f8b09072740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6cf390 0x562a9aa980d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:40.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.959+0000 7f8b09072740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x562a9aa0de50 con 0x562a9a6cf390 2024-09-21T06:29:40.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.959+0000 7f8b09072740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562a9a9fd280 con 0x562a9a6c71b0 2024-09-21T06:29:40.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.959+0000 7f8b09072740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562a9aa01090 con 0x562a9a6f0070 2024-09-21T06:29:40.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.959+0000 7f8b0109b640 1 --2- 172.21.15.63:0/2977335442 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8aec0b6680 0x7f8aec0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:40.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.959+0000 7f8b0089a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6f0070 0x562a9aa97650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:40.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.959+0000 7f8b0089a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6f0070 0x562a9aa97650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:49472/0 (socket says 172.21.15.63:49472) 2024-09-21T06:29:40.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.959+0000 7f8b0089a640 1 -- 172.21.15.63:0/2434298566 learned_addr learned my addr 172.21.15.63:0/2434298566 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:40.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.959+0000 7f8b0109b640 1 --2- 172.21.15.63:0/2434298566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6cf390 0x562a9aa980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:40.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.959+0000 7f8afbfff640 1 --2- 172.21.15.63:0/2434298566 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6c71b0 0x562a9aa97b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:40.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.959+0000 7f8af9ffb640 1 -- 172.21.15.63:0/2977335442 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f8ae80e7a80 con 0x7f8afc1083a0 2024-09-21T06:29:40.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.960+0000 7f8b0089a640 1 -- 172.21.15.63:0/2434298566 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6c71b0 msgr2=0x562a9aa97b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:40.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.960+0000 7f8b0089a640 1 --2- 172.21.15.63:0/2434298566 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6c71b0 0x562a9aa97b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.960+0000 7f8b0089a640 1 -- 172.21.15.63:0/2434298566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6cf390 msgr2=0x562a9aa980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:40.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.960+0000 7f8b0089a640 1 --2- 172.21.15.63:0/2434298566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6cf390 0x562a9aa980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.960+0000 7f8b0089a640 1 -- 172.21.15.63:0/2434298566 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a9a75b650 con 0x562a9a6f0070 2024-09-21T06:29:40.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.960+0000 7f8afbfff640 1 --2- 172.21.15.63:0/2434298566 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6c71b0 0x562a9aa97b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:40.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.960+0000 7f8b0109b640 1 --2- 172.21.15.63:0/2977335442 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8aec0b6680 0x7f8aec0b8b90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8af4005cc0 tx=0x7f8af4030570 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:40.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.960+0000 7f8b0089a640 1 --2- 172.21.15.63:0/2434298566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6f0070 0x562a9aa97650 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8af0004650 tx=0x7f8af000bba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5154a4f3d31f703 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:40.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.960+0000 7f8ae6ffd640 1 -- 172.21.15.63:0/2434298566 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0003b50 con 0x562a9a6f0070 2024-09-21T06:29:40.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.960+0000 7f8ae6ffd640 1 -- 172.21.15.63:0/2434298566 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8af0015070 con 0x562a9a6f0070 2024-09-21T06:29:40.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.960+0000 7f8ae6ffd640 1 -- 172.21.15.63:0/2434298566 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0004c40 con 0x562a9a6f0070 2024-09-21T06:29:40.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.961+0000 7f8b09072740 1 -- 172.21.15.63:0/2434298566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6f0070 msgr2=0x562a9aa97650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:40.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.961+0000 7f8b09072740 1 --2- 172.21.15.63:0/2434298566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6f0070 0x562a9aa97650 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8af0004650 tx=0x7f8af000bba0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.961+0000 7f8b09072740 1 -- 172.21.15.63:0/2434298566 shutdown_connections 2024-09-21T06:29:40.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.961+0000 7f8b09072740 1 --2- 172.21.15.63:0/2434298566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6cf390 0x562a9aa980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.961+0000 7f8b09072740 1 --2- 172.21.15.63:0/2434298566 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6c71b0 0x562a9aa97b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.961+0000 7f8b09072740 1 --2- 172.21.15.63:0/2434298566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6f0070 0x562a9aa97650 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.961+0000 7f8b09072740 1 -- 172.21.15.63:0/2434298566 >> 172.21.15.63:0/2434298566 conn(0x562a9a6e4460 msgr2=0x562a9aa95540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:40.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.961+0000 7f8b09072740 1 -- 172.21.15.63:0/2434298566 shutdown_connections 2024-09-21T06:29:40.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.961+0000 7f8b09072740 1 -- 172.21.15.63:0/2434298566 wait complete. 2024-09-21T06:29:40.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.962+0000 7f8b09072740 1 -- start start 2024-09-21T06:29:40.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.962+0000 7f8b09072740 1 Processor -- start 2024-09-21T06:29:40.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.962+0000 7f8b09072740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6c71b0 0x562a9aaa2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:40.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.962+0000 7f8b09072740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6cf390 0x562a9aaa3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:40.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.962+0000 7f8b09072740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6f0070 0x562a9aaaf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:40.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.962+0000 7f8b09072740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x562a9a85e700 con 0x562a9a6f0070 2024-09-21T06:29:40.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.962+0000 7f8b09072740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562a9a998110 con 0x562a9a6c71b0 2024-09-21T06:29:40.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.962+0000 7f8b09072740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562a9aaa5e30 con 0x562a9a6cf390 2024-09-21T06:29:40.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.963+0000 7f8b09072740 10 client.0 _ll_register_callbacks cb 0x562a9a9b1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:40.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.963+0000 7f8b0089a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6c71b0 0x562a9aaa2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:40.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.963+0000 7f8b0109b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6f0070 0x562a9aaaf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:40.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.963+0000 7f8b0089a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6c71b0 0x562a9aaa2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:54030/0 (socket says 172.21.15.63:54030) 2024-09-21T06:29:40.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.963+0000 7f8b0089a640 1 -- 172.21.15.63:0/1557535823 learned_addr learned my addr 172.21.15.63:0/1557535823 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:40.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.963+0000 7f8afbfff640 1 --2- 172.21.15.63:0/1557535823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6cf390 0x562a9aaa3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:40.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.963+0000 7f8b0089a640 1 -- 172.21.15.63:0/1557535823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6cf390 msgr2=0x562a9aaa3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:40.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.963+0000 7f8b0089a640 1 --2- 172.21.15.63:0/1557535823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6cf390 0x562a9aaa3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.963+0000 7f8b0089a640 1 -- 172.21.15.63:0/1557535823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6f0070 msgr2=0x562a9aaaf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:40.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.963+0000 7f8b0089a640 1 --2- 172.21.15.63:0/1557535823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6f0070 0x562a9aaaf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.963+0000 7f8b0089a640 1 -- 172.21.15.63:0/1557535823 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a9a9c5c40 con 0x562a9a6c71b0 2024-09-21T06:29:40.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.963+0000 7f8b0109b640 1 --2- 172.21.15.63:0/1557535823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6f0070 0x562a9aaaf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:40.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.963+0000 7f8b0089a640 1 --2- 172.21.15.63:0/1557535823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6c71b0 0x562a9aaa2cf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8af00057c0 tx=0x7f8af0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d26967e2c2ba237 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:40.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.963+0000 7f8adbfff640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:29:40.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.963+0000 7f8adbfff640 1 -- 172.21.15.63:0/1557535823 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0028060 con 0x562a9a6c71b0 2024-09-21T06:29:40.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.963+0000 7f8adbfff640 1 -- 172.21.15.63:0/1557535823 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f8af0011440 con 0x562a9a6c71b0 2024-09-21T06:29:40.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.963+0000 7f8b09072740 1 -- 172.21.15.63:0/1557535823 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8af0015070 con 0x562a9a6c71b0 2024-09-21T06:29:40.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.964+0000 7f8adbfff640 1 -- 172.21.15.63:0/1557535823 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8af0011640 con 0x562a9a6c71b0 2024-09-21T06:29:40.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.964+0000 7f8b09072740 10 client.25469 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:40.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.964+0000 7f8b09072740 1 -- 172.21.15.63:0/1557535823 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562a9aab1b20 con 0x562a9a6c71b0 2024-09-21T06:29:40.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.964+0000 7f8adbfff640 1 -- 172.21.15.63:0/1557535823 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8af0015070 con 0x562a9a6c71b0 2024-09-21T06:29:40.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.964+0000 7f8adbfff640 1 -- 172.21.15.63:0/1557535823 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8af0022070 con 0x562a9a6c71b0 2024-09-21T06:29:40.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.964+0000 7f8b09072740 10 client.25469 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:40.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.964+0000 7f8b09072740 10 client.25469 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:40.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.964+0000 7f8b09072740 20 client.25469 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:40.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.964+0000 7f8b09072740 1 --2- 172.21.15.63:0/1557535823 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x562a9a6ae9f0 0x562a9aab4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:40.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.964+0000 7f8b09072740 4 client.25469 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:40.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.964+0000 7f8b09072740 1 -- 172.21.15.63:0/1557535823 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a9aa0fda0 con 0x562a9a6ae9f0 2024-09-21T06:29:40.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.964+0000 7f8afbfff640 1 --2- 172.21.15.63:0/1557535823 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x562a9a6ae9f0 0x562a9aab4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:40.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.965+0000 7f8afbfff640 1 --2- 172.21.15.63:0/1557535823 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x562a9a6ae9f0 0x562a9aab4f30 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c00df53d288a701f server_cookie=433c8f786ced2c40 in_seq=0 out_seq=0 2024-09-21T06:29:40.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.965+0000 7f8adbfff640 10 client.25469 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:40.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.967+0000 7f8adbfff640 1 -- 172.21.15.63:0/1557535823 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562a9aa0fda0 con 0x562a9a6ae9f0 2024-09-21T06:29:40.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.967+0000 7f8adbfff640 10 client.25469 handle_command_reply: tid=0 2024-09-21T06:29:40.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.967+0000 7f8b09072740 1 client.25469 shutdown 2024-09-21T06:29:40.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.967+0000 7f8b09072740 1 -- 172.21.15.63:0/1557535823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6c71b0 msgr2=0x562a9aaa2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:40.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.967+0000 7f8b09072740 1 --2- 172.21.15.63:0/1557535823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6c71b0 0x562a9aaa2cf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8af00057c0 tx=0x7f8af0004730 comp rx=0 tx=0).stop 2024-09-21T06:29:40.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.967+0000 7f8b09072740 1 -- 172.21.15.63:0/1557535823 shutdown_connections 2024-09-21T06:29:40.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.967+0000 7f8b09072740 1 --2- 172.21.15.63:0/1557535823 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x562a9a6ae9f0 0x562a9aab4f30 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.967+0000 7f8b09072740 1 --2- 172.21.15.63:0/1557535823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6f0070 0x562a9aaaf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.967+0000 7f8b09072740 1 --2- 172.21.15.63:0/1557535823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6cf390 0x562a9aaa3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.967+0000 7f8b09072740 1 --2- 172.21.15.63:0/1557535823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6c71b0 0x562a9aaa2cf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.967+0000 7f8b09072740 1 -- 172.21.15.63:0/1557535823 >> 172.21.15.63:0/1557535823 conn(0x562a9a6e4460 msgr2=0x562a9aa9a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:40.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.967+0000 7f8adbfff640 0 client.25469 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:40.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.967+0000 7f8b09072740 1 -- 172.21.15.63:0/1557535823 shutdown_connections 2024-09-21T06:29:40.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.967+0000 7f8b09072740 1 -- 172.21.15.63:0/1557535823 wait complete. 2024-09-21T06:29:40.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.967+0000 7f8b09072740 20 client.25469 trim_cache size 0 max 16384 2024-09-21T06:29:40.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.985+0000 7f8b09072740 1 Processor -- start 2024-09-21T06:29:40.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.985+0000 7f8b09072740 1 -- start start 2024-09-21T06:29:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.986+0000 7f8b09072740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6c71b0 0x562a9aaa31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.986+0000 7f8b09072740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6cf390 0x562a9aa94b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.986+0000 7f8b09072740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6f0070 0x562a9aa950b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.986+0000 7f8b09072740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc1ad460 con 0x562a9a6f0070 2024-09-21T06:29:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.986+0000 7f8b09072740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc1aefa0 con 0x562a9a6cf390 2024-09-21T06:29:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.986+0000 7f8b09072740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc1adb30 con 0x562a9a6c71b0 2024-09-21T06:29:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.986+0000 7f8b0109b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6f0070 0x562a9aa950b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.986+0000 7f8afbfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6cf390 0x562a9aa94b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.986+0000 7f8b0109b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6f0070 0x562a9aa950b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42748/0 (socket says 172.21.15.63:42748) 2024-09-21T06:29:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.986+0000 7f8b0109b640 1 -- 172.21.15.63:0/4277567678 learned_addr learned my addr 172.21.15.63:0/4277567678 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.986+0000 7f8b0089a640 1 --2- 172.21.15.63:0/4277567678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6c71b0 0x562a9aaa31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.986+0000 7f8afbfff640 1 -- 172.21.15.63:0/4277567678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6c71b0 msgr2=0x562a9aaa31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.986+0000 7f8afbfff640 1 --2- 172.21.15.63:0/4277567678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6c71b0 0x562a9aaa31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.986+0000 7f8afbfff640 1 -- 172.21.15.63:0/4277567678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6f0070 msgr2=0x562a9aa950b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.986+0000 7f8afbfff640 1 --2- 172.21.15.63:0/4277567678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6f0070 0x562a9aa950b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.986+0000 7f8afbfff640 1 -- 172.21.15.63:0/4277567678 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a9aa9a4b0 con 0x562a9a6cf390 2024-09-21T06:29:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.987+0000 7f8afbfff640 1 --2- 172.21.15.63:0/4277567678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6cf390 0x562a9aa94b70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80e5210 tx=0x7f8ae8013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dde3b2352806580f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.987+0000 7f8ae67fc640 1 -- 172.21.15.63:0/4277567678 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae80ad080 con 0x562a9a6cf390 2024-09-21T06:29:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.987+0000 7f8ae67fc640 1 -- 172.21.15.63:0/4277567678 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ae80a9070 con 0x562a9a6cf390 2024-09-21T06:29:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.987+0000 7f8ae67fc640 1 -- 172.21.15.63:0/4277567678 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae80037a0 con 0x562a9a6cf390 2024-09-21T06:29:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.988+0000 7f8b09072740 1 -- 172.21.15.63:0/4277567678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6cf390 msgr2=0x562a9aa94b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.988+0000 7f8b09072740 1 --2- 172.21.15.63:0/4277567678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6cf390 0x562a9aa94b70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80e5210 tx=0x7f8ae8013000 comp rx=0 tx=0).stop 2024-09-21T06:29:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.988+0000 7f8b09072740 1 -- 172.21.15.63:0/4277567678 shutdown_connections 2024-09-21T06:29:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.988+0000 7f8b09072740 1 --2- 172.21.15.63:0/4277567678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6f0070 0x562a9aa950b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.988+0000 7f8b09072740 1 --2- 172.21.15.63:0/4277567678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6cf390 0x562a9aa94b70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.988+0000 7f8b09072740 1 --2- 172.21.15.63:0/4277567678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6c71b0 0x562a9aaa31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.988+0000 7f8b09072740 1 -- 172.21.15.63:0/4277567678 >> 172.21.15.63:0/4277567678 conn(0x562a9a6e4460 msgr2=0x562a9aaa2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.988+0000 7f8b09072740 1 -- 172.21.15.63:0/4277567678 shutdown_connections 2024-09-21T06:29:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.988+0000 7f8b09072740 1 -- 172.21.15.63:0/4277567678 wait complete. 2024-09-21T06:29:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.988+0000 7f8b09072740 1 -- start start 2024-09-21T06:29:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.988+0000 7f8b09072740 1 Processor -- start 2024-09-21T06:29:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.989+0000 7f8b09072740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6c71b0 0x562a9aab85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.989+0000 7f8b09072740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6cf390 0x562a9aab5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.989+0000 7f8b09072740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6f0070 0x562a9aab5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.989+0000 7f8b09072740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc1ae8d0 con 0x562a9a6cf390 2024-09-21T06:29:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.989+0000 7f8b09072740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc1ae200 con 0x562a9a6c71b0 2024-09-21T06:29:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.989+0000 7f8b09072740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc1ab440 con 0x562a9a6f0070 2024-09-21T06:29:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.989+0000 7f8b09072740 10 client.0 _ll_register_callbacks cb 0x7f8af4034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.989+0000 7f8b0089a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6c71b0 0x562a9aab85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.989+0000 7f8b0089a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6c71b0 0x562a9aab85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:54036/0 (socket says 172.21.15.63:54036) 2024-09-21T06:29:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.989+0000 7f8b0089a640 1 -- 172.21.15.63:0/3127949503 learned_addr learned my addr 172.21.15.63:0/3127949503 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.989+0000 7f8afbfff640 1 --2- 172.21.15.63:0/3127949503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6cf390 0x562a9aab5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.989+0000 7f8b0109b640 1 --2- 172.21.15.63:0/3127949503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6f0070 0x562a9aab5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.989+0000 7f8b0089a640 1 -- 172.21.15.63:0/3127949503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6f0070 msgr2=0x562a9aab5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.989+0000 7f8b0089a640 1 --2- 172.21.15.63:0/3127949503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6f0070 0x562a9aab5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.989+0000 7f8b0089a640 1 -- 172.21.15.63:0/3127949503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6cf390 msgr2=0x562a9aab5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.989+0000 7f8b0089a640 1 --2- 172.21.15.63:0/3127949503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6cf390 0x562a9aab5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.989+0000 7f8b0089a640 1 -- 172.21.15.63:0/3127949503 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a9aab65a0 con 0x562a9a6c71b0 2024-09-21T06:29:41.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.990+0000 7f8b0109b640 1 --2- 172.21.15.63:0/3127949503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6f0070 0x562a9aab5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:41.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.990+0000 7f8afbfff640 1 --2- 172.21.15.63:0/3127949503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6cf390 0x562a9aab5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:41.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.990+0000 7f8b0089a640 1 --2- 172.21.15.63:0/3127949503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6c71b0 0x562a9aab85a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8af000b620 tx=0x7f8af000b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb76f5640ff7e87 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:41.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.990+0000 7f8adbfff640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:29:41.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.990+0000 7f8adbfff640 1 -- 172.21.15.63:0/3127949503 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0028040 con 0x562a9a6c71b0 2024-09-21T06:29:41.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.990+0000 7f8b09072740 1 -- 172.21.15.63:0/3127949503 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ae80a9070 con 0x562a9a6c71b0 2024-09-21T06:29:41.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.990+0000 7f8adbfff640 1 -- 172.21.15.63:0/3127949503 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f8af0019420 con 0x562a9a6c71b0 2024-09-21T06:29:41.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.990+0000 7f8adbfff640 1 -- 172.21.15.63:0/3127949503 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8af0019620 con 0x562a9a6c71b0 2024-09-21T06:29:41.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.990+0000 7f8b09072740 10 client.25475 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:41.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.990+0000 7f8b09072740 1 -- 172.21.15.63:0/3127949503 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562a9ab1f460 con 0x562a9a6c71b0 2024-09-21T06:29:41.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.990+0000 7f8adbfff640 1 -- 172.21.15.63:0/3127949503 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ae80a9070 con 0x562a9a6c71b0 2024-09-21T06:29:41.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.991+0000 7f8adbfff640 1 -- 172.21.15.63:0/3127949503 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8af0022070 con 0x562a9a6c71b0 2024-09-21T06:29:41.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.991+0000 7f8b09072740 10 client.25475 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:41.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.991+0000 7f8b09072740 10 client.25475 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:41.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.991+0000 7f8b09072740 20 client.25475 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:41.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.991+0000 7f8b09072740 1 --2- 172.21.15.63:0/3127949503 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x562a9a683da0 0x562a9ab21be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:41.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.991+0000 7f8b09072740 4 client.25475 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:29:41.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.991+0000 7f8b09072740 1 -- 172.21.15.63:0/3127949503 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562a9aa0b850 con 0x562a9a683da0 2024-09-21T06:29:41.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.991+0000 7f8afbfff640 1 --2- 172.21.15.63:0/3127949503 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x562a9a683da0 0x562a9ab21be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:41.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.991+0000 7f8adbfff640 10 client.25475 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:41.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.991+0000 7f8afbfff640 1 --2- 172.21.15.63:0/3127949503 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x562a9a683da0 0x562a9ab21be0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3aa5887ba8b1a74d server_cookie=b1bf7d60de85a48e in_seq=0 out_seq=0 2024-09-21T06:29:41.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.994+0000 7f8adbfff640 1 -- 172.21.15.63:0/3127949503 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x562a9aa0b850 con 0x562a9a683da0 2024-09-21T06:29:41.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.994+0000 7f8adbfff640 10 client.25475 handle_command_reply: tid=0 2024-09-21T06:29:41.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.994+0000 7f8b09072740 1 client.25475 shutdown 2024-09-21T06:29:41.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.994+0000 7f8b09072740 1 -- 172.21.15.63:0/3127949503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6c71b0 msgr2=0x562a9aab85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:41.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.994+0000 7f8b09072740 1 --2- 172.21.15.63:0/3127949503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6c71b0 0x562a9aab85a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8af000b620 tx=0x7f8af000b390 comp rx=0 tx=0).stop 2024-09-21T06:29:41.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.994+0000 7f8b09072740 1 -- 172.21.15.63:0/3127949503 shutdown_connections 2024-09-21T06:29:41.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.994+0000 7f8b09072740 1 --2- 172.21.15.63:0/3127949503 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x562a9a683da0 0x562a9ab21be0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.994+0000 7f8b09072740 1 --2- 172.21.15.63:0/3127949503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a9a6f0070 0x562a9aab5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.994+0000 7f8b09072740 1 --2- 172.21.15.63:0/3127949503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562a9a6cf390 0x562a9aab5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.994+0000 7f8adbfff640 0 client.25475 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:41.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.994+0000 7f8b09072740 1 --2- 172.21.15.63:0/3127949503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a9a6c71b0 0x562a9aab85a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.994+0000 7f8b09072740 1 -- 172.21.15.63:0/3127949503 >> 172.21.15.63:0/3127949503 conn(0x562a9a6e4460 msgr2=0x562a9aa9a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:41.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.994+0000 7f8b09072740 1 -- 172.21.15.63:0/3127949503 shutdown_connections 2024-09-21T06:29:41.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.994+0000 7f8b09072740 1 -- 172.21.15.63:0/3127949503 wait complete. 2024-09-21T06:29:41.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.994+0000 7f8b09072740 20 client.25475 trim_cache size 0 max 16384 2024-09-21T06:29:41.006 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:29:41.007 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "no active scrubs running", 2024-09-21T06:29:41.007 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": {}, 2024-09-21T06:29:41.007 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:29:41.007 INFO:teuthology.orchestra.run.smithi063.stdout: "99595c38-b81e-4cba-9256-e704dc084208": { 2024-09-21T06:29:41.007 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:29:07.604466+0000", 2024-09-21T06:29:41.007 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:29:41.007 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:29:41.007 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:29:41.007 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:29:41.007 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:29:41.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:29:41.007 INFO:teuthology.orchestra.run.smithi063.stdout: "e7881878-4529-4e31-87c4-bfc71bc0cbfc": { 2024-09-21T06:29:41.007 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:28:21.722259+0000", 2024-09-21T06:29:41.008 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:29:41.008 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:29:41.008 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:29:41.008 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:29:41.008 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:29:41.008 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:29:41.008 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:29:41.008 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:29:41.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.995+0000 7f8b02afe640 1 -- 172.21.15.63:0/2977335442 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8aec0b6680 msgr2=0x7f8aec0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:41.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.995+0000 7f8b02afe640 1 --2- 172.21.15.63:0/2977335442 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8aec0b6680 0x7f8aec0b8b90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8af4005cc0 tx=0x7f8af4030570 comp rx=0 tx=0).stop 2024-09-21T06:29:41.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.995+0000 7f8b02afe640 1 -- 172.21.15.63:0/2977335442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8afc1083a0 msgr2=0x7f8afc19b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:41.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.995+0000 7f8b02afe640 1 --2- 172.21.15.63:0/2977335442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8afc1083a0 0x7f8afc19b750 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800e9a0 tx=0x7f8ae800ee60 comp rx=0 tx=0).stop 2024-09-21T06:29:41.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.995+0000 7f8b02afe640 1 -- 172.21.15.63:0/2977335442 shutdown_connections 2024-09-21T06:29:41.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.995+0000 7f8b02afe640 1 --2- 172.21.15.63:0/2977335442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8afc108cf0 0x7f8afc19bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.995+0000 7f8b02afe640 1 --2- 172.21.15.63:0/2977335442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8afc1083a0 0x7f8afc19b750 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.995+0000 7f8b02afe640 1 --2- 172.21.15.63:0/2977335442 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8aec0b6680 0x7f8aec0b8b90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.995+0000 7f8b02afe640 1 --2- 172.21.15.63:0/2977335442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8afc102a60 0x7f8afc19b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.995+0000 7f8b02afe640 1 -- 172.21.15.63:0/2977335442 >> 172.21.15.63:0/2977335442 conn(0x7f8afc079730 msgr2=0x7f8afc1043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:41.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.995+0000 7f8b02afe640 1 -- 172.21.15.63:0/2977335442 shutdown_connections 2024-09-21T06:29:41.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:40.995+0000 7f8b02afe640 1 -- 172.21.15.63:0/2977335442 wait complete. 2024-09-21T06:29:41.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:41 smithi071 ceph-mon[34844]: pgmap v366: 97 pgs: 97 active+clean; 16 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 1.3 MiB/s wr, 95 op/s 2024-09-21T06:29:41.559 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:41 smithi063 ceph-mon[31150]: pgmap v366: 97 pgs: 97 active+clean; 16 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 1.3 MiB/s wr, 95 op/s 2024-09-21T06:29:41.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:41 smithi175 ceph-mon[34510]: pgmap v366: 97 pgs: 97 active+clean; 16 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 1.3 MiB/s wr, 95 op/s 2024-09-21T06:29:41.770 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:29:41.770 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:29:42.045 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:42.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.551+0000 7ff3d0c99640 1 -- 172.21.15.63:0/1244149627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3cc103b60 msgr2=0x7ff3cc103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:42.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.551+0000 7ff3d0c99640 1 --2- 172.21.15.63:0/1244149627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3cc103b60 0x7ff3cc103f70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc009900 tx=0x7ff3bc02a410 comp rx=0 tx=0).stop 2024-09-21T06:29:42.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.551+0000 7ff3d0c99640 1 -- 172.21.15.63:0/1244149627 shutdown_connections 2024-09-21T06:29:42.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.551+0000 7ff3d0c99640 1 --2- 172.21.15.63:0/1244149627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3cc109df0 0x7ff3cc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:42.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.551+0000 7ff3d0c99640 1 --2- 172.21.15.63:0/1244149627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3cc1094a0 0x7ff3cc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:42.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.551+0000 7ff3d0c99640 1 --2- 172.21.15.63:0/1244149627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3cc103b60 0x7ff3cc103f70 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:42.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.551+0000 7ff3d0c99640 1 -- 172.21.15.63:0/1244149627 >> 172.21.15.63:0/1244149627 conn(0x7ff3cc07b850 msgr2=0x7ff3cc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:42.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.551+0000 7ff3d0c99640 1 -- 172.21.15.63:0/1244149627 shutdown_connections 2024-09-21T06:29:42.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.551+0000 7ff3d0c99640 1 -- 172.21.15.63:0/1244149627 wait complete. 2024-09-21T06:29:42.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.552+0000 7ff3d0c99640 1 Processor -- start 2024-09-21T06:29:42.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.552+0000 7ff3d0c99640 1 -- start start 2024-09-21T06:29:42.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.552+0000 7ff3d0c99640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3cc103b60 0x7ff3cc19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:42.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.552+0000 7ff3d0c99640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3cc1094a0 0x7ff3cc19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:42.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.552+0000 7ff3d0c99640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3cc109df0 0x7ff3cc19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:42.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.552+0000 7ff3d0c99640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc113ab0 con 0x7ff3cc109df0 2024-09-21T06:29:42.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.552+0000 7ff3d0c99640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc113930 con 0x7ff3cc103b60 2024-09-21T06:29:42.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.552+0000 7ff3d0c99640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc113c30 con 0x7ff3cc1094a0 2024-09-21T06:29:42.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.552+0000 7ff3cad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3cc109df0 0x7ff3cc19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:42.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.552+0000 7ff3cad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3cc109df0 0x7ff3cc19fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42782/0 (socket says 172.21.15.63:42782) 2024-09-21T06:29:42.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.552+0000 7ff3cad9d640 1 -- 172.21.15.63:0/503656813 learned_addr learned my addr 172.21.15.63:0/503656813 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:42.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.552+0000 7ff3ca59c640 1 --2- 172.21.15.63:0/503656813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3cc103b60 0x7ff3cc19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:42.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.552+0000 7ff3c9d9b640 1 --2- 172.21.15.63:0/503656813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3cc1094a0 0x7ff3cc19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:42.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.553+0000 7ff3cad9d640 1 -- 172.21.15.63:0/503656813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3cc1094a0 msgr2=0x7ff3cc19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:42.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.553+0000 7ff3cad9d640 1 --2- 172.21.15.63:0/503656813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3cc1094a0 0x7ff3cc19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:42.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.553+0000 7ff3cad9d640 1 -- 172.21.15.63:0/503656813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3cc103b60 msgr2=0x7ff3cc19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:42.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.553+0000 7ff3cad9d640 1 --2- 172.21.15.63:0/503656813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3cc103b60 0x7ff3cc19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:42.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.553+0000 7ff3cad9d640 1 -- 172.21.15.63:0/503656813 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3cc1a0410 con 0x7ff3cc109df0 2024-09-21T06:29:42.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.553+0000 7ff3cad9d640 1 --2- 172.21.15.63:0/503656813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3cc109df0 0x7ff3cc19fce0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400eaa0 tx=0x7ff3c400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:42.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.553+0000 7ff3bb7fe640 1 -- 172.21.15.63:0/503656813 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c400cdb0 con 0x7ff3cc109df0 2024-09-21T06:29:42.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.553+0000 7ff3d0c99640 1 -- 172.21.15.63:0/503656813 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3cc1a0700 con 0x7ff3cc109df0 2024-09-21T06:29:42.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.553+0000 7ff3bb7fe640 1 -- 172.21.15.63:0/503656813 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3c4005020 con 0x7ff3cc109df0 2024-09-21T06:29:42.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.553+0000 7ff3bb7fe640 1 -- 172.21.15.63:0/503656813 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40116d0 con 0x7ff3cc109df0 2024-09-21T06:29:42.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.553+0000 7ff3d0c99640 1 -- 172.21.15.63:0/503656813 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3cc1a6e60 con 0x7ff3cc109df0 2024-09-21T06:29:42.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.554+0000 7ff3d0c99640 1 -- 172.21.15.63:0/503656813 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3cc103f70 con 0x7ff3cc109df0 2024-09-21T06:29:42.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.556+0000 7ff3bb7fe640 1 -- 172.21.15.63:0/503656813 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7ff3c40051d0 con 0x7ff3cc109df0 2024-09-21T06:29:42.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.556+0000 7ff3bb7fe640 1 --2- 172.21.15.63:0/503656813 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff3b40b6680 0x7ff3b40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:42.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.556+0000 7ff3ca59c640 1 --2- 172.21.15.63:0/503656813 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff3b40b6680 0x7ff3b40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:42.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.556+0000 7ff3bb7fe640 1 -- 172.21.15.63:0/503656813 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ff3c40e7bf0 con 0x7ff3cc109df0 2024-09-21T06:29:42.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.557+0000 7ff3ca59c640 1 --2- 172.21.15.63:0/503656813 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff3b40b6680 0x7ff3b40b8b90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc031440 tx=0x7ff3bc009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:42.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.559+0000 7ff3bb7fe640 1 -- 172.21.15.63:0/503656813 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff3c4016030 con 0x7ff3cc109df0 2024-09-21T06:29:42.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.784+0000 7ff3d0c99640 1 -- 172.21.15.63:0/503656813 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3cc19b5d0 con 0x7ff3cc109df0 2024-09-21T06:29:42.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.784+0000 7ff3bb7fe640 1 -- 172.21.15.63:0/503656813 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11969 (secure 0 0 0) 0x7ff3c40b2560 con 0x7ff3cc109df0 2024-09-21T06:29:42.786 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:29:42.787 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"btime":"2024-09-21T06:28:13:055252+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:28:12.568978+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24698,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24698":{"gid":24698,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6839/3472481253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3472481253},{"type":"v1","addr":"172.21.15.71:6839","nonce":3472481253}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24698,"qdb_cluster":[24698,24694,24670,24676,14835]},"id":1}]} 2024-09-21T06:29:42.787 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 29 2024-09-21T06:29:42.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.786+0000 7ff3d0c99640 1 -- 172.21.15.63:0/503656813 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff3b40b6680 msgr2=0x7ff3b40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:42.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.786+0000 7ff3d0c99640 1 --2- 172.21.15.63:0/503656813 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff3b40b6680 0x7ff3b40b8b90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc031440 tx=0x7ff3bc009560 comp rx=0 tx=0).stop 2024-09-21T06:29:42.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.787+0000 7ff3d0c99640 1 -- 172.21.15.63:0/503656813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3cc109df0 msgr2=0x7ff3cc19fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:42.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.787+0000 7ff3d0c99640 1 --2- 172.21.15.63:0/503656813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3cc109df0 0x7ff3cc19fce0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400eaa0 tx=0x7ff3c400ef60 comp rx=0 tx=0).stop 2024-09-21T06:29:42.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.787+0000 7ff3d0c99640 1 -- 172.21.15.63:0/503656813 shutdown_connections 2024-09-21T06:29:42.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.787+0000 7ff3d0c99640 1 --2- 172.21.15.63:0/503656813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3cc109df0 0x7ff3cc19fce0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:42.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.787+0000 7ff3d0c99640 1 --2- 172.21.15.63:0/503656813 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff3b40b6680 0x7ff3b40b8b90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:42.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.787+0000 7ff3d0c99640 1 --2- 172.21.15.63:0/503656813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3cc1094a0 0x7ff3cc19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:42.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.787+0000 7ff3d0c99640 1 --2- 172.21.15.63:0/503656813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3cc103b60 0x7ff3cc19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:42.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.787+0000 7ff3d0c99640 1 -- 172.21.15.63:0/503656813 >> 172.21.15.63:0/503656813 conn(0x7ff3cc07b850 msgr2=0x7ff3cc107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:42.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.787+0000 7ff3d0c99640 1 -- 172.21.15.63:0/503656813 shutdown_connections 2024-09-21T06:29:42.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:42.787+0000 7ff3d0c99640 1 -- 172.21.15.63:0/503656813 wait complete. 2024-09-21T06:29:43.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:43 smithi063 ceph-mon[31150]: pgmap v367: 97 pgs: 97 active+clean; 16 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 1.3 MiB/s wr, 94 op/s 2024-09-21T06:29:43.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:43 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/503656813' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:29:43.428 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T06:29:43.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:43 smithi071 ceph-mon[34844]: pgmap v367: 97 pgs: 97 active+clean; 16 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 1.3 MiB/s wr, 94 op/s 2024-09-21T06:29:43.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:43 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/503656813' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:29:43.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:43 smithi175 ceph-mon[34510]: pgmap v367: 97 pgs: 97 active+clean; 16 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 1.3 MiB/s wr, 94 op/s 2024-09-21T06:29:43.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:43 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/503656813' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:29:43.689 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:44.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.177+0000 7ff06eee8640 1 -- 172.21.15.63:0/852661011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06810de10 msgr2=0x7ff068110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:44.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.177+0000 7ff06eee8640 1 --2- 172.21.15.63:0/852661011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06810de10 0x7ff068110300 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff058009900 tx=0x7ff05802a410 comp rx=0 tx=0).stop 2024-09-21T06:29:44.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.177+0000 7ff06eee8640 1 -- 172.21.15.63:0/852661011 shutdown_connections 2024-09-21T06:29:44.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.177+0000 7ff06eee8640 1 --2- 172.21.15.63:0/852661011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06810de10 0x7ff068110300 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.177+0000 7ff06eee8640 1 --2- 172.21.15.63:0/852661011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff068105300 0x7ff06810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.177+0000 7ff06eee8640 1 --2- 172.21.15.63:0/852661011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0681049b0 0x7ff068104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.177+0000 7ff06eee8640 1 -- 172.21.15.63:0/852661011 >> 172.21.15.63:0/852661011 conn(0x7ff068079730 msgr2=0x7ff068079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:44.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.177+0000 7ff06eee8640 1 -- 172.21.15.63:0/852661011 shutdown_connections 2024-09-21T06:29:44.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.177+0000 7ff06eee8640 1 -- 172.21.15.63:0/852661011 wait complete. 2024-09-21T06:29:44.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.178+0000 7ff06eee8640 1 Processor -- start 2024-09-21T06:29:44.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.178+0000 7ff06eee8640 1 -- start start 2024-09-21T06:29:44.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.178+0000 7ff06eee8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0681049b0 0x7ff06819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.178+0000 7ff06eee8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff068105300 0x7ff06819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.178+0000 7ff06eee8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff06810de10 0x7ff06819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.178+0000 7ff06eee8640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff068113a90 con 0x7ff0681049b0 2024-09-21T06:29:44.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.178+0000 7ff06eee8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff068113910 con 0x7ff068105300 2024-09-21T06:29:44.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.178+0000 7ff06eee8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff068113c10 con 0x7ff06810de10 2024-09-21T06:29:44.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.178+0000 7ff06cc84640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0681049b0 0x7ff06819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.178+0000 7ff06cc84640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0681049b0 0x7ff06819a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42794/0 (socket says 172.21.15.63:42794) 2024-09-21T06:29:44.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.178+0000 7ff06cc84640 1 -- 172.21.15.63:0/2398585871 learned_addr learned my addr 172.21.15.63:0/2398585871 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:44.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.179+0000 7ff06d485640 1 --2- 172.21.15.63:0/2398585871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff06810de10 0x7ff06819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.179+0000 7ff067fff640 1 --2- 172.21.15.63:0/2398585871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff068105300 0x7ff06819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.179+0000 7ff06cc84640 1 -- 172.21.15.63:0/2398585871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff06810de10 msgr2=0x7ff06819fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:44.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.179+0000 7ff06cc84640 1 --2- 172.21.15.63:0/2398585871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff06810de10 0x7ff06819fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.179+0000 7ff06cc84640 1 -- 172.21.15.63:0/2398585871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff068105300 msgr2=0x7ff06819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:44.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.179+0000 7ff06cc84640 1 --2- 172.21.15.63:0/2398585871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff068105300 0x7ff06819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.179+0000 7ff06cc84640 1 -- 172.21.15.63:0/2398585871 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0681a0510 con 0x7ff0681049b0 2024-09-21T06:29:44.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.179+0000 7ff067fff640 1 --2- 172.21.15.63:0/2398585871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff068105300 0x7ff06819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:44.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.179+0000 7ff06cc84640 1 --2- 172.21.15.63:0/2398585871 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0681049b0 0x7ff06819a5a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff060009fd0 tx=0x7ff06000c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:44.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.179+0000 7ff065ffb640 1 -- 172.21.15.63:0/2398585871 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff060011470 con 0x7ff0681049b0 2024-09-21T06:29:44.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.179+0000 7ff06eee8640 1 -- 172.21.15.63:0/2398585871 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0681a0800 con 0x7ff0681049b0 2024-09-21T06:29:44.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.179+0000 7ff065ffb640 1 -- 172.21.15.63:0/2398585871 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff060011ac0 con 0x7ff0681049b0 2024-09-21T06:29:44.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.179+0000 7ff065ffb640 1 -- 172.21.15.63:0/2398585871 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06001aab0 con 0x7ff0681049b0 2024-09-21T06:29:44.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.179+0000 7ff06eee8640 1 -- 172.21.15.63:0/2398585871 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0681a6f60 con 0x7ff0681049b0 2024-09-21T06:29:44.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.182+0000 7ff065ffb640 1 -- 172.21.15.63:0/2398585871 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7ff06001ac50 con 0x7ff0681049b0 2024-09-21T06:29:44.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.182+0000 7ff07545c740 1 Processor -- start 2024-09-21T06:29:44.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.182+0000 7ff07545c740 1 -- start start 2024-09-21T06:29:44.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.182+0000 7ff07545c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dba11a0070 0x55dba15472c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.182+0000 7ff07545c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba11771b0 0x55dba1547800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.182+0000 7ff07545c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba117f390 0x55dba1547d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.183+0000 7ff07545c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55dba14bdea0 con 0x55dba117f390 2024-09-21T06:29:44.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.183+0000 7ff07545c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55dba14ad2d0 con 0x55dba11771b0 2024-09-21T06:29:44.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.183+0000 7ff07545c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dba14b10e0 con 0x55dba11a0070 2024-09-21T06:29:44.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.183+0000 7ff067fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba117f390 0x55dba1547d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.183+0000 7ff067fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba117f390 0x55dba1547d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42802/0 (socket says 172.21.15.63:42802) 2024-09-21T06:29:44.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.183+0000 7ff067fff640 1 -- 172.21.15.63:0/3731914744 learned_addr learned my addr 172.21.15.63:0/3731914744 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:44.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.183+0000 7ff06d485640 1 --2- 172.21.15.63:0/3731914744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dba11a0070 0x55dba15472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.183+0000 7ff06cc84640 1 --2- 172.21.15.63:0/3731914744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba11771b0 0x55dba1547800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.183+0000 7ff067fff640 1 -- 172.21.15.63:0/3731914744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dba11a0070 msgr2=0x55dba15472c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:44.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.183+0000 7ff067fff640 1 --2- 172.21.15.63:0/3731914744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dba11a0070 0x55dba15472c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.183+0000 7ff065ffb640 1 --2- 172.21.15.63:0/2398585871 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff0540b6680 0x7ff0540b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.183+0000 7ff067fff640 1 -- 172.21.15.63:0/3731914744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba11771b0 msgr2=0x55dba1547800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:44.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.183+0000 7ff067fff640 1 --2- 172.21.15.63:0/3731914744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba11771b0 0x55dba1547800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.183+0000 7ff067fff640 1 -- 172.21.15.63:0/3731914744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dba120b650 con 0x55dba117f390 2024-09-21T06:29:44.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.183+0000 7ff06d485640 1 --2- 172.21.15.63:0/2398585871 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff0540b6680 0x7ff0540b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.183+0000 7ff067fff640 1 --2- 172.21.15.63:0/3731914744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba117f390 0x55dba1547d40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff05000bc60 tx=0x7ff05000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ab8f5d3bf4acb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:44.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.183+0000 7ff065ffb640 1 -- 172.21.15.63:0/2398585871 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ff0600e7c70 con 0x7ff0681049b0 2024-09-21T06:29:44.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.184+0000 7ff05effd640 1 -- 172.21.15.63:0/3731914744 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050015070 con 0x55dba117f390 2024-09-21T06:29:44.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.184+0000 7ff05effd640 1 -- 172.21.15.63:0/3731914744 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0500054d0 con 0x55dba117f390 2024-09-21T06:29:44.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.184+0000 7ff05effd640 1 -- 172.21.15.63:0/3731914744 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050011440 con 0x55dba117f390 2024-09-21T06:29:44.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.184+0000 7ff07545c740 1 -- 172.21.15.63:0/3731914744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba117f390 msgr2=0x55dba1547d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:44.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.184+0000 7ff06d485640 1 --2- 172.21.15.63:0/2398585871 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff0540b6680 0x7ff0540b8b90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff058005ab0 tx=0x7ff058005a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:44.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.184+0000 7ff07545c740 1 --2- 172.21.15.63:0/3731914744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba117f390 0x55dba1547d40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff05000bc60 tx=0x7ff05000f730 comp rx=0 tx=0).stop 2024-09-21T06:29:44.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.185+0000 7ff07545c740 1 -- 172.21.15.63:0/3731914744 shutdown_connections 2024-09-21T06:29:44.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.185+0000 7ff07545c740 1 --2- 172.21.15.63:0/3731914744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba117f390 0x55dba1547d40 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.185+0000 7ff07545c740 1 --2- 172.21.15.63:0/3731914744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba11771b0 0x55dba1547800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.185+0000 7ff07545c740 1 --2- 172.21.15.63:0/3731914744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dba11a0070 0x55dba15472c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.185+0000 7ff07545c740 1 -- 172.21.15.63:0/3731914744 >> 172.21.15.63:0/3731914744 conn(0x55dba1194460 msgr2=0x55dba15451b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:44.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.185+0000 7ff07545c740 1 -- 172.21.15.63:0/3731914744 shutdown_connections 2024-09-21T06:29:44.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.185+0000 7ff07545c740 1 -- 172.21.15.63:0/3731914744 wait complete. 2024-09-21T06:29:44.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.185+0000 7ff07545c740 1 -- start start 2024-09-21T06:29:44.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.185+0000 7ff07545c740 1 Processor -- start 2024-09-21T06:29:44.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff07545c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba11771b0 0x55dba1556d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff07545c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba117f390 0x55dba1557290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff07545c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dba11a0070 0x55dba1563130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff07545c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55dba130e700 con 0x55dba117f390 2024-09-21T06:29:44.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff07545c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55dba1448160 con 0x55dba11771b0 2024-09-21T06:29:44.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff07545c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dba1559e00 con 0x55dba11a0070 2024-09-21T06:29:44.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff07545c740 10 client.0 _ll_register_callbacks cb 0x55dba14619e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:44.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff067fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba117f390 0x55dba1557290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff06cc84640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba11771b0 0x55dba1556d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff067fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba117f390 0x55dba1557290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42806/0 (socket says 172.21.15.63:42806) 2024-09-21T06:29:44.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff06cc84640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba11771b0 0x55dba1556d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:54106/0 (socket says 172.21.15.63:54106) 2024-09-21T06:29:44.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff067fff640 1 -- 172.21.15.63:0/451905966 learned_addr learned my addr 172.21.15.63:0/451905966 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:44.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff06d485640 1 --2- 172.21.15.63:0/451905966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dba11a0070 0x55dba1563130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff067fff640 1 -- 172.21.15.63:0/451905966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dba11a0070 msgr2=0x55dba1563130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:44.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff067fff640 1 --2- 172.21.15.63:0/451905966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dba11a0070 0x55dba1563130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff067fff640 1 -- 172.21.15.63:0/451905966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba11771b0 msgr2=0x55dba1556d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:44.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff067fff640 1 --2- 172.21.15.63:0/451905966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba11771b0 0x55dba1556d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff067fff640 1 -- 172.21.15.63:0/451905966 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dba1475c90 con 0x55dba117f390 2024-09-21T06:29:44.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff06cc84640 1 --2- 172.21.15.63:0/451905966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba11771b0 0x55dba1556d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:44.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff067fff640 1 --2- 172.21.15.63:0/451905966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba117f390 0x55dba1557290 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff050004c10 tx=0x7ff050004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a98f37714ccf464 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:44.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.186+0000 7ff047fff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:44.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.187+0000 7ff047fff640 1 -- 172.21.15.63:0/451905966 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050028060 con 0x55dba117f390 2024-09-21T06:29:44.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.187+0000 7ff047fff640 1 -- 172.21.15.63:0/451905966 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ff05000bd50 con 0x55dba117f390 2024-09-21T06:29:44.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.187+0000 7ff07545c740 1 -- 172.21.15.63:0/451905966 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0500054d0 con 0x55dba117f390 2024-09-21T06:29:44.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.187+0000 7ff047fff640 1 -- 172.21.15.63:0/451905966 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff050015070 con 0x55dba117f390 2024-09-21T06:29:44.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.187+0000 7ff07545c740 10 client.15825 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:44.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.187+0000 7ff07545c740 1 -- 172.21.15.63:0/451905966 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dba1565af0 con 0x55dba117f390 2024-09-21T06:29:44.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.187+0000 7ff047fff640 1 -- 172.21.15.63:0/451905966 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0500054d0 con 0x55dba117f390 2024-09-21T06:29:44.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.187+0000 7ff047fff640 1 -- 172.21.15.63:0/451905966 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff050011ac0 con 0x55dba117f390 2024-09-21T06:29:44.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.187+0000 7ff07545c740 10 client.15825 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:44.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.187+0000 7ff07545c740 10 client.15825 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:29:44.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.187+0000 7ff07545c740 20 client.15825 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:44.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.187+0000 7ff07545c740 1 --2- 172.21.15.63:0/451905966 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55dba115e9f0 0x55dba1568e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.187+0000 7ff07545c740 4 client.15825 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:44.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.187+0000 7ff07545c740 1 -- 172.21.15.63:0/451905966 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dba14bfdf0 con 0x55dba115e9f0 2024-09-21T06:29:44.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.188+0000 7ff06cc84640 1 --2- 172.21.15.63:0/451905966 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55dba115e9f0 0x55dba1568e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.188+0000 7ff047fff640 10 client.15825 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:29:44.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.188+0000 7ff06cc84640 1 --2- 172.21.15.63:0/451905966 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55dba115e9f0 0x55dba1568e50 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f8b012437c41a33d server_cookie=2fb88169b58f193e in_seq=0 out_seq=0 2024-09-21T06:29:44.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.189+0000 7ff047fff640 1 -- 172.21.15.63:0/451905966 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dba14bfdf0 con 0x55dba115e9f0 2024-09-21T06:29:44.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.189+0000 7ff047fff640 10 client.15825 handle_command_reply: tid=0 2024-09-21T06:29:44.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.189+0000 7ff07545c740 1 client.15825 shutdown 2024-09-21T06:29:44.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.189+0000 7ff07545c740 1 -- 172.21.15.63:0/451905966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba117f390 msgr2=0x55dba1557290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:44.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.189+0000 7ff07545c740 1 --2- 172.21.15.63:0/451905966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba117f390 0x55dba1557290 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff050004c10 tx=0x7ff050004990 comp rx=0 tx=0).stop 2024-09-21T06:29:44.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.189+0000 7ff07545c740 1 -- 172.21.15.63:0/451905966 shutdown_connections 2024-09-21T06:29:44.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.189+0000 7ff07545c740 1 --2- 172.21.15.63:0/451905966 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55dba115e9f0 0x55dba1568e50 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.189+0000 7ff07545c740 1 --2- 172.21.15.63:0/451905966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dba11a0070 0x55dba1563130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.189+0000 7ff07545c740 1 --2- 172.21.15.63:0/451905966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba117f390 0x55dba1557290 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.189+0000 7ff047fff640 0 client.15825 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:29:44.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.189+0000 7ff07545c740 1 --2- 172.21.15.63:0/451905966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba11771b0 0x55dba1556d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.189+0000 7ff07545c740 1 -- 172.21.15.63:0/451905966 >> 172.21.15.63:0/451905966 conn(0x55dba1194460 msgr2=0x55dba1543750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:44.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.189+0000 7ff07545c740 1 -- 172.21.15.63:0/451905966 shutdown_connections 2024-09-21T06:29:44.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.189+0000 7ff07545c740 1 -- 172.21.15.63:0/451905966 wait complete. 2024-09-21T06:29:44.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.189+0000 7ff07545c740 20 client.15825 trim_cache size 0 max 16384 2024-09-21T06:29:44.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.202+0000 7ff07545c740 1 Processor -- start 2024-09-21T06:29:44.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.202+0000 7ff07545c740 1 -- start start 2024-09-21T06:29:44.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.203+0000 7ff07545c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dba11771b0 0x55dba1548a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.203+0000 7ff07545c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba117f390 0x55dba1553f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.203+0000 7ff07545c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba11a0070 0x55dba1554480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.203+0000 7ff07545c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff0681ad4e0 con 0x55dba11a0070 2024-09-21T06:29:44.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.203+0000 7ff07545c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff0681af020 con 0x55dba117f390 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.203+0000 7ff07545c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff0681adbb0 con 0x55dba11771b0 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.203+0000 7ff06d485640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba11a0070 0x55dba1554480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.203+0000 7ff06d485640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba11a0070 0x55dba1554480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42816/0 (socket says 172.21.15.63:42816) 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.203+0000 7ff06d485640 1 -- 172.21.15.63:0/1888270032 learned_addr learned my addr 172.21.15.63:0/1888270032 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.203+0000 7ff06cc84640 1 --2- 172.21.15.63:0/1888270032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dba11771b0 0x55dba1548a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.203+0000 7ff067fff640 1 --2- 172.21.15.63:0/1888270032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba117f390 0x55dba1553f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.203+0000 7ff06d485640 1 -- 172.21.15.63:0/1888270032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dba11771b0 msgr2=0x55dba1548a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.203+0000 7ff06d485640 1 --2- 172.21.15.63:0/1888270032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dba11771b0 0x55dba1548a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.203+0000 7ff06d485640 1 -- 172.21.15.63:0/1888270032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba117f390 msgr2=0x55dba1553f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.203+0000 7ff06d485640 1 --2- 172.21.15.63:0/1888270032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba117f390 0x55dba1553f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.203+0000 7ff06d485640 1 -- 172.21.15.63:0/1888270032 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dba15480b0 con 0x55dba11a0070 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.203+0000 7ff06d485640 1 --2- 172.21.15.63:0/1888270032 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba11a0070 0x55dba1554480 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff05802a930 tx=0x7ff05803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8386dda00b0450 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.204+0000 7ff05e7fc640 1 -- 172.21.15.63:0/1888270032 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058035030 con 0x55dba11a0070 2024-09-21T06:29:44.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.204+0000 7ff05e7fc640 1 -- 172.21.15.63:0/1888270032 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff05804b070 con 0x55dba11a0070 2024-09-21T06:29:44.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.204+0000 7ff05e7fc640 1 -- 172.21.15.63:0/1888270032 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058004a00 con 0x55dba11a0070 2024-09-21T06:29:44.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.204+0000 7ff07545c740 1 -- 172.21.15.63:0/1888270032 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba11a0070 msgr2=0x55dba1554480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:44.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.204+0000 7ff07545c740 1 --2- 172.21.15.63:0/1888270032 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba11a0070 0x55dba1554480 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff05802a930 tx=0x7ff05803f000 comp rx=0 tx=0).stop 2024-09-21T06:29:44.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.204+0000 7ff07545c740 1 -- 172.21.15.63:0/1888270032 shutdown_connections 2024-09-21T06:29:44.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.204+0000 7ff07545c740 1 --2- 172.21.15.63:0/1888270032 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba11a0070 0x55dba1554480 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.204+0000 7ff07545c740 1 --2- 172.21.15.63:0/1888270032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba117f390 0x55dba1553f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.204+0000 7ff07545c740 1 --2- 172.21.15.63:0/1888270032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dba11771b0 0x55dba1548a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.204+0000 7ff07545c740 1 -- 172.21.15.63:0/1888270032 >> 172.21.15.63:0/1888270032 conn(0x55dba1194460 msgr2=0x55dba15482f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:44.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.204+0000 7ff07545c740 1 -- 172.21.15.63:0/1888270032 shutdown_connections 2024-09-21T06:29:44.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.205+0000 7ff07545c740 1 -- 172.21.15.63:0/1888270032 wait complete. 2024-09-21T06:29:44.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.205+0000 7ff07545c740 1 -- start start 2024-09-21T06:29:44.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.205+0000 7ff07545c740 1 Processor -- start 2024-09-21T06:29:44.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.205+0000 7ff07545c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba11771b0 0x55dba15c7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.205+0000 7ff07545c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dba117f390 0x55dba15c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.205+0000 7ff07545c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba11a0070 0x55dba15d25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.205+0000 7ff07545c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff0681ae950 con 0x55dba11771b0 2024-09-21T06:29:44.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.205+0000 7ff07545c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff0681ae280 con 0x55dba11a0070 2024-09-21T06:29:44.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.205+0000 7ff07545c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff0681ab4c0 con 0x55dba117f390 2024-09-21T06:29:44.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.206+0000 7ff07545c740 10 client.0 _ll_register_callbacks cb 0x7ff058009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:44.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.206+0000 7ff06cc84640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba11771b0 0x55dba15c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.206+0000 7ff06cc84640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba11771b0 0x55dba15c7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42820/0 (socket says 172.21.15.63:42820) 2024-09-21T06:29:44.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.206+0000 7ff06cc84640 1 -- 172.21.15.63:0/1259511768 learned_addr learned my addr 172.21.15.63:0/1259511768 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:44.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.206+0000 7ff067fff640 1 --2- 172.21.15.63:0/1259511768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dba117f390 0x55dba15c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.206+0000 7ff06d485640 1 --2- 172.21.15.63:0/1259511768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba11a0070 0x55dba15d25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.206+0000 7ff06cc84640 1 -- 172.21.15.63:0/1259511768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dba117f390 msgr2=0x55dba15c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:44.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.206+0000 7ff06cc84640 1 --2- 172.21.15.63:0/1259511768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dba117f390 0x55dba15c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.206+0000 7ff06cc84640 1 -- 172.21.15.63:0/1259511768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba11a0070 msgr2=0x55dba15d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:44.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.206+0000 7ff06cc84640 1 --2- 172.21.15.63:0/1259511768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba11a0070 0x55dba15d25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.206+0000 7ff06cc84640 1 -- 172.21.15.63:0/1259511768 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dba15c8290 con 0x55dba11771b0 2024-09-21T06:29:44.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.206+0000 7ff06d485640 1 --2- 172.21.15.63:0/1259511768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba11a0070 0x55dba15d25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:44.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.206+0000 7ff06cc84640 1 --2- 172.21.15.63:0/1259511768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba11771b0 0x55dba15c7560 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff0600e54b0 tx=0x7ff06000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50dbd2e1dc75f4de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:44.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.206+0000 7ff047fff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:44.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.206+0000 7ff047fff640 1 -- 172.21.15.63:0/1259511768 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0600b2070 con 0x55dba11771b0 2024-09-21T06:29:44.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.206+0000 7ff047fff640 1 -- 172.21.15.63:0/1259511768 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ff0600b2210 con 0x55dba11771b0 2024-09-21T06:29:44.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.206+0000 7ff07545c740 1 -- 172.21.15.63:0/1259511768 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff05804b070 con 0x55dba11771b0 2024-09-21T06:29:44.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.207+0000 7ff047fff640 1 -- 172.21.15.63:0/1259511768 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff0600a9270 con 0x55dba11771b0 2024-09-21T06:29:44.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.207+0000 7ff07545c740 10 client.15831 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:44.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.207+0000 7ff07545c740 1 -- 172.21.15.63:0/1259511768 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dba15d3b30 con 0x55dba11771b0 2024-09-21T06:29:44.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.207+0000 7ff047fff640 1 -- 172.21.15.63:0/1259511768 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff05804b070 con 0x55dba11771b0 2024-09-21T06:29:44.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.207+0000 7ff047fff640 1 -- 172.21.15.63:0/1259511768 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff060022030 con 0x55dba11771b0 2024-09-21T06:29:44.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.207+0000 7ff07545c740 10 client.15831 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:44.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.207+0000 7ff07545c740 10 client.15831 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:29:44.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.207+0000 7ff07545c740 20 client.15831 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:44.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.207+0000 7ff07545c740 1 --2- 172.21.15.63:0/1259511768 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55dba1133da0 0x55dba15d62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.207+0000 7ff07545c740 4 client.15831 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:29:44.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.207+0000 7ff07545c740 1 -- 172.21.15.63:0/1259511768 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dba14bb8a0 con 0x55dba1133da0 2024-09-21T06:29:44.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.207+0000 7ff067fff640 1 --2- 172.21.15.63:0/1259511768 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55dba1133da0 0x55dba15d62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.207+0000 7ff047fff640 10 client.15831 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:29:44.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.208+0000 7ff067fff640 1 --2- 172.21.15.63:0/1259511768 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55dba1133da0 0x55dba15d62a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=24f622fba30d7869 server_cookie=41899c8e5ce534de in_seq=0 out_seq=0 2024-09-21T06:29:44.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.208+0000 7ff047fff640 1 -- 172.21.15.63:0/1259511768 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dba14bb8a0 con 0x55dba1133da0 2024-09-21T06:29:44.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.208+0000 7ff047fff640 10 client.15831 handle_command_reply: tid=0 2024-09-21T06:29:44.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.208+0000 7ff07545c740 1 client.15831 shutdown 2024-09-21T06:29:44.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.208+0000 7ff07545c740 1 -- 172.21.15.63:0/1259511768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba11771b0 msgr2=0x55dba15c7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:44.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.208+0000 7ff07545c740 1 --2- 172.21.15.63:0/1259511768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba11771b0 0x55dba15c7560 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff0600e54b0 tx=0x7ff06000c920 comp rx=0 tx=0).stop 2024-09-21T06:29:44.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.208+0000 7ff07545c740 1 -- 172.21.15.63:0/1259511768 shutdown_connections 2024-09-21T06:29:44.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.208+0000 7ff07545c740 1 --2- 172.21.15.63:0/1259511768 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55dba1133da0 0x55dba15d62a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.208+0000 7ff07545c740 1 --2- 172.21.15.63:0/1259511768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dba11a0070 0x55dba15d25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.208+0000 7ff07545c740 1 --2- 172.21.15.63:0/1259511768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dba117f390 0x55dba15c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.208+0000 7ff07545c740 1 --2- 172.21.15.63:0/1259511768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55dba11771b0 0x55dba15c7560 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.208+0000 7ff07545c740 1 -- 172.21.15.63:0/1259511768 >> 172.21.15.63:0/1259511768 conn(0x55dba1194460 msgr2=0x55dba1558010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:44.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.208+0000 7ff047fff640 0 client.15831 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:29:44.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.208+0000 7ff07545c740 1 -- 172.21.15.63:0/1259511768 shutdown_connections 2024-09-21T06:29:44.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.208+0000 7ff07545c740 1 -- 172.21.15.63:0/1259511768 wait complete. 2024-09-21T06:29:44.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.208+0000 7ff07545c740 20 client.15831 trim_cache size 0 max 16384 2024-09-21T06:29:44.215 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:29:44.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.209+0000 7ff06eee8640 1 -- 172.21.15.63:0/2398585871 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff0540b6680 msgr2=0x7ff0540b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:44.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.209+0000 7ff06eee8640 1 --2- 172.21.15.63:0/2398585871 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff0540b6680 0x7ff0540b8b90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff058005ab0 tx=0x7ff058005a40 comp rx=0 tx=0).stop 2024-09-21T06:29:44.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.209+0000 7ff06eee8640 1 -- 172.21.15.63:0/2398585871 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0681049b0 msgr2=0x7ff06819a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:44.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.209+0000 7ff06eee8640 1 --2- 172.21.15.63:0/2398585871 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0681049b0 0x7ff06819a5a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff060009fd0 tx=0x7ff06000c270 comp rx=0 tx=0).stop 2024-09-21T06:29:44.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.209+0000 7ff06eee8640 1 -- 172.21.15.63:0/2398585871 shutdown_connections 2024-09-21T06:29:44.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.209+0000 7ff06eee8640 1 --2- 172.21.15.63:0/2398585871 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff0540b6680 0x7ff0540b8b90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.209+0000 7ff06eee8640 1 --2- 172.21.15.63:0/2398585871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff06810de10 0x7ff06819fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.209+0000 7ff06eee8640 1 --2- 172.21.15.63:0/2398585871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff068105300 0x7ff06819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.209+0000 7ff06eee8640 1 --2- 172.21.15.63:0/2398585871 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0681049b0 0x7ff06819a5a0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.209+0000 7ff06eee8640 1 -- 172.21.15.63:0/2398585871 >> 172.21.15.63:0/2398585871 conn(0x7ff068079730 msgr2=0x7ff0680ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:44.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.209+0000 7ff06eee8640 1 -- 172.21.15.63:0/2398585871 shutdown_connections 2024-09-21T06:29:44.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:44.209+0000 7ff06eee8640 1 -- 172.21.15.63:0/2398585871 wait complete. 2024-09-21T06:29:44.801 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T06:29:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.904+0000 7f801a9c3640 1 -- 172.21.15.63:0/3475868448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8014108310 msgr2=0x7f8014108720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.904+0000 7f801a9c3640 1 --2- 172.21.15.63:0/3475868448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8014108310 0x7f8014108720 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8008009900 tx=0x7f800802a410 comp rx=0 tx=0).stop 2024-09-21T06:29:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.904+0000 7f801a9c3640 1 -- 172.21.15.63:0/3475868448 shutdown_connections 2024-09-21T06:29:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.904+0000 7f801a9c3640 1 --2- 172.21.15.63:0/3475868448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8014108c60 0x7f801410f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.904+0000 7f801a9c3640 1 --2- 172.21.15.63:0/3475868448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8014108310 0x7f8014108720 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.904+0000 7f801a9c3640 1 --2- 172.21.15.63:0/3475868448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80141029e0 0x7f8014102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.904+0000 7f801a9c3640 1 -- 172.21.15.63:0/3475868448 >> 172.21.15.63:0/3475868448 conn(0x7f801407a6e0 msgr2=0x7f801407aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.904+0000 7f801a9c3640 1 -- 172.21.15.63:0/3475868448 shutdown_connections 2024-09-21T06:29:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.904+0000 7f801a9c3640 1 -- 172.21.15.63:0/3475868448 wait complete. 2024-09-21T06:29:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.905+0000 7f801a9c3640 1 Processor -- start 2024-09-21T06:29:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.905+0000 7f801a9c3640 1 -- start start 2024-09-21T06:29:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.905+0000 7f801a9c3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80141029e0 0x7f80140ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.905+0000 7f801a9c3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8014108310 0x7f80140ffa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.905+0000 7f801a9c3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8014108c60 0x7f80140fffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.905+0000 7f801a9c3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8014112920 con 0x7f8014108310 2024-09-21T06:29:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.905+0000 7f801a9c3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f80141127a0 con 0x7f8014108c60 2024-09-21T06:29:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.905+0000 7f801a9c3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8014112aa0 con 0x7f80141029e0 2024-09-21T06:29:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.905+0000 7f80137fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8014108310 0x7f80140ffa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.905+0000 7f80137fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8014108310 0x7f80140ffa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42846/0 (socket says 172.21.15.63:42846) 2024-09-21T06:29:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.905+0000 7f80137fe640 1 -- 172.21.15.63:0/1006965704 learned_addr learned my addr 172.21.15.63:0/1006965704 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.906+0000 7f8013fff640 1 --2- 172.21.15.63:0/1006965704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80141029e0 0x7f80140ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.906+0000 7f8018f60640 1 --2- 172.21.15.63:0/1006965704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8014108c60 0x7f80140fffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.906+0000 7f80137fe640 1 -- 172.21.15.63:0/1006965704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80141029e0 msgr2=0x7f80140ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.906+0000 7f80137fe640 1 --2- 172.21.15.63:0/1006965704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80141029e0 0x7f80140ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.906+0000 7f80137fe640 1 -- 172.21.15.63:0/1006965704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8014108c60 msgr2=0x7f80140fffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.906+0000 7f80137fe640 1 --2- 172.21.15.63:0/1006965704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8014108c60 0x7f80140fffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.906+0000 7f80137fe640 1 -- 172.21.15.63:0/1006965704 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80141a8740 con 0x7f8014108310 2024-09-21T06:29:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.906+0000 7f80137fe640 1 --2- 172.21.15.63:0/1006965704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8014108310 0x7f80140ffa90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f800802a930 tx=0x7f8008031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.906+0000 7f80117fa640 1 -- 172.21.15.63:0/1006965704 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800803f030 con 0x7f8014108310 2024-09-21T06:29:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.906+0000 7f80117fa640 1 -- 172.21.15.63:0/1006965704 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8008004490 con 0x7f8014108310 2024-09-21T06:29:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.906+0000 7f80117fa640 1 -- 172.21.15.63:0/1006965704 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008035070 con 0x7f8014108310 2024-09-21T06:29:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.906+0000 7f801a9c3640 1 -- 172.21.15.63:0/1006965704 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80141a89d0 con 0x7f8014108310 2024-09-21T06:29:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.906+0000 7f801a9c3640 1 -- 172.21.15.63:0/1006965704 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80141a8ec0 con 0x7f8014108310 2024-09-21T06:29:44.911 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.909+0000 7f8021a13740 1 Processor -- start 2024-09-21T06:29:44.911 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.909+0000 7f8021a13740 1 -- start start 2024-09-21T06:29:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.910+0000 7f8021a13740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baa619b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.910+0000 7f8021a13740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba6932f0 0x5602baa61ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.910+0000 7f8021a13740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba69b4d0 0x5602baa62430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.910+0000 7f8021a13740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5602ba9d66f0 con 0x5602ba69b4d0 2024-09-21T06:29:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.910+0000 7f8021a13740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5602ba9c5b20 con 0x5602ba6bc1b0 2024-09-21T06:29:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.910+0000 7f8021a13740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5602ba9c9930 con 0x5602ba6932f0 2024-09-21T06:29:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.910+0000 7f80117fa640 1 -- 172.21.15.63:0/1006965704 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f8008042030 con 0x7f8014108310 2024-09-21T06:29:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.910+0000 7f8018f60640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baa619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.910+0000 7f8018f60640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baa619b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:54156/0 (socket says 172.21.15.63:54156) 2024-09-21T06:29:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.910+0000 7f8018f60640 1 -- 172.21.15.63:0/2122790333 learned_addr learned my addr 172.21.15.63:0/2122790333 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.910+0000 7f8013fff640 1 --2- 172.21.15.63:0/2122790333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba6932f0 0x5602baa61ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.910+0000 7f80137fe640 1 --2- 172.21.15.63:0/2122790333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba69b4d0 0x5602baa62430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.910+0000 7f8013fff640 1 -- 172.21.15.63:0/2122790333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 msgr2=0x5602baa619b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.910+0000 7f8013fff640 1 --2- 172.21.15.63:0/2122790333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baa619b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.911+0000 7f8013fff640 1 -- 172.21.15.63:0/2122790333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba69b4d0 msgr2=0x5602baa62430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.911+0000 7f8013fff640 1 --2- 172.21.15.63:0/2122790333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba69b4d0 0x5602baa62430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.911+0000 7f8013fff640 1 -- 172.21.15.63:0/2122790333 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602ba98b530 con 0x5602ba6932f0 2024-09-21T06:29:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.911+0000 7f8018f60640 1 --2- 172.21.15.63:0/2122790333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baa619b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.911+0000 7f80137fe640 1 --2- 172.21.15.63:0/2122790333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba69b4d0 0x5602baa62430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.911+0000 7f8013fff640 1 --2- 172.21.15.63:0/2122790333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba6932f0 0x5602baa61ef0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8004009c20 tx=0x7f8004011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=500cfe9b4a0c8429 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.911+0000 7f80117fa640 1 --2- 172.21.15.63:0/1006965704 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7ffc0b66b0 0x7f7ffc0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.911+0000 7f8018f60640 1 --2- 172.21.15.63:0/1006965704 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7ffc0b66b0 0x7f7ffc0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.911+0000 7f7ffa7fc640 1 -- 172.21.15.63:0/2122790333 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8004004050 con 0x5602ba6932f0 2024-09-21T06:29:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.911+0000 7f80117fa640 1 -- 172.21.15.63:0/1006965704 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f8008107a10 con 0x7f8014108310 2024-09-21T06:29:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.911+0000 7f7ffa7fc640 1 -- 172.21.15.63:0/2122790333 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80040054d0 con 0x5602ba6932f0 2024-09-21T06:29:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.911+0000 7f7ffa7fc640 1 -- 172.21.15.63:0/2122790333 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8004004c60 con 0x5602ba6932f0 2024-09-21T06:29:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.912+0000 7f8021a13740 1 -- 172.21.15.63:0/2122790333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba6932f0 msgr2=0x5602baa61ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.912+0000 7f8018f60640 1 --2- 172.21.15.63:0/1006965704 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7ffc0b66b0 0x7f7ffc0b8bc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f800c011830 tx=0x7f800c009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.912+0000 7f8021a13740 1 --2- 172.21.15.63:0/2122790333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba6932f0 0x5602baa61ef0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8004009c20 tx=0x7f8004011810 comp rx=0 tx=0).stop 2024-09-21T06:29:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.912+0000 7f8021a13740 1 -- 172.21.15.63:0/2122790333 shutdown_connections 2024-09-21T06:29:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.912+0000 7f8021a13740 1 --2- 172.21.15.63:0/2122790333 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba69b4d0 0x5602baa62430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.912+0000 7f8021a13740 1 --2- 172.21.15.63:0/2122790333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba6932f0 0x5602baa61ef0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.912+0000 7f8021a13740 1 --2- 172.21.15.63:0/2122790333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baa619b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.912+0000 7f8021a13740 1 -- 172.21.15.63:0/2122790333 >> 172.21.15.63:0/2122790333 conn(0x5602ba6b0300 msgr2=0x5602baa5f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.912+0000 7f8021a13740 1 -- 172.21.15.63:0/2122790333 shutdown_connections 2024-09-21T06:29:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.912+0000 7f8021a13740 1 -- 172.21.15.63:0/2122790333 wait complete. 2024-09-21T06:29:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.913+0000 7f8021a13740 1 -- start start 2024-09-21T06:29:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.913+0000 7f8021a13740 1 Processor -- start 2024-09-21T06:29:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.913+0000 7f8021a13740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba6932f0 0x5602baa6cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.913+0000 7f8021a13740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba69b4d0 0x5602baa6d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.913+0000 7f8021a13740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baa6da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.913+0000 7f8021a13740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5602ba8fdab0 con 0x5602ba69b4d0 2024-09-21T06:29:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.913+0000 7f8021a13740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5602ba96b730 con 0x5602ba6bc1b0 2024-09-21T06:29:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.913+0000 7f8021a13740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5602baa70130 con 0x5602ba6932f0 2024-09-21T06:29:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.913+0000 7f8021a13740 10 client.0 _ll_register_callbacks cb 0x5602ba9bf6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.913+0000 7f80137fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba69b4d0 0x5602baa6d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.913+0000 7f80137fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba69b4d0 0x5602baa6d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42860/0 (socket says 172.21.15.63:42860) 2024-09-21T06:29:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.913+0000 7f80137fe640 1 -- 172.21.15.63:0/493340608 learned_addr learned my addr 172.21.15.63:0/493340608 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.913+0000 7f8013fff640 1 --2- 172.21.15.63:0/493340608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba6932f0 0x5602baa6cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.914+0000 7f8018f60640 1 --2- 172.21.15.63:0/493340608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baa6da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.914+0000 7f80137fe640 1 -- 172.21.15.63:0/493340608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba6932f0 msgr2=0x5602baa6cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.914+0000 7f80137fe640 1 --2- 172.21.15.63:0/493340608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba6932f0 0x5602baa6cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.914+0000 7f80137fe640 1 -- 172.21.15.63:0/493340608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 msgr2=0x5602baa6da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.914+0000 7f80137fe640 1 --2- 172.21.15.63:0/493340608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baa6da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.914+0000 7f80137fe640 1 -- 172.21.15.63:0/493340608 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602ba727790 con 0x5602ba69b4d0 2024-09-21T06:29:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.914+0000 7f80137fe640 1 --2- 172.21.15.63:0/493340608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba69b4d0 0x5602baa6d4e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8008031440 tx=0x7f800802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b00a606235c0c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.914+0000 7f7ff37fe640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.914+0000 7f7ff37fe640 1 -- 172.21.15.63:0/493340608 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008049030 con 0x5602ba69b4d0 2024-09-21T06:29:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.914+0000 7f7ff37fe640 1 -- 172.21.15.63:0/493340608 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f80080d7030 con 0x5602ba69b4d0 2024-09-21T06:29:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.914+0000 7f8021a13740 1 -- 172.21.15.63:0/493340608 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80040054d0 con 0x5602ba69b4d0 2024-09-21T06:29:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.914+0000 7f7ff37fe640 1 -- 172.21.15.63:0/493340608 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8008110070 con 0x5602ba69b4d0 2024-09-21T06:29:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.914+0000 7f8021a13740 10 client.15843 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.914+0000 7f8021a13740 1 -- 172.21.15.63:0/493340608 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5602ba7a0620 con 0x5602ba69b4d0 2024-09-21T06:29:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.914+0000 7f7ff37fe640 1 -- 172.21.15.63:0/493340608 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80040054d0 con 0x5602ba69b4d0 2024-09-21T06:29:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.915+0000 7f7ff37fe640 1 -- 172.21.15.63:0/493340608 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f80080cebd0 con 0x5602ba69b4d0 2024-09-21T06:29:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.915+0000 7f8021a13740 10 client.15843 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.915+0000 7f8021a13740 10 client.15843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.915+0000 7f8021a13740 20 client.15843 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.915+0000 7f8021a13740 1 --2- 172.21.15.63:0/493340608 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5602ba67ad80 0x5602baa7f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.915+0000 7f8021a13740 4 client.15843 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.915+0000 7f8021a13740 1 -- 172.21.15.63:0/493340608 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602ba9d8640 con 0x5602ba67ad80 2024-09-21T06:29:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.915+0000 7f8013fff640 1 --2- 172.21.15.63:0/493340608 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5602ba67ad80 0x5602baa7f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.915+0000 7f7ff37fe640 10 client.15843 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.916+0000 7f8013fff640 1 --2- 172.21.15.63:0/493340608 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5602ba67ad80 0x5602baa7f050 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de312b26e34ee2ad server_cookie=dd12d46f0a29a857 in_seq=0 out_seq=0 2024-09-21T06:29:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.917+0000 7f7ff37fe640 1 -- 172.21.15.63:0/493340608 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5602ba9d8640 con 0x5602ba67ad80 2024-09-21T06:29:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.917+0000 7f7ff37fe640 10 client.15843 handle_command_reply: tid=0 2024-09-21T06:29:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.917+0000 7f8021a13740 1 client.15843 shutdown 2024-09-21T06:29:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.917+0000 7f8021a13740 1 -- 172.21.15.63:0/493340608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba69b4d0 msgr2=0x5602baa6d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.917+0000 7f8021a13740 1 --2- 172.21.15.63:0/493340608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba69b4d0 0x5602baa6d4e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8008031440 tx=0x7f800802a410 comp rx=0 tx=0).stop 2024-09-21T06:29:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.917+0000 7f8021a13740 1 -- 172.21.15.63:0/493340608 shutdown_connections 2024-09-21T06:29:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.917+0000 7f8021a13740 1 --2- 172.21.15.63:0/493340608 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5602ba67ad80 0x5602baa7f050 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.917+0000 7f8021a13740 1 --2- 172.21.15.63:0/493340608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baa6da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.917+0000 7f8021a13740 1 --2- 172.21.15.63:0/493340608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba69b4d0 0x5602baa6d4e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.917+0000 7f8021a13740 1 --2- 172.21.15.63:0/493340608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba6932f0 0x5602baa6cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.917+0000 7f8021a13740 1 -- 172.21.15.63:0/493340608 >> 172.21.15.63:0/493340608 conn(0x5602ba6b0300 msgr2=0x5602baa629e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.917+0000 7f7ff37fe640 0 client.15843 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.917+0000 7f8021a13740 1 -- 172.21.15.63:0/493340608 shutdown_connections 2024-09-21T06:29:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.917+0000 7f8021a13740 1 -- 172.21.15.63:0/493340608 wait complete. 2024-09-21T06:29:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.917+0000 7f8021a13740 20 client.15843 trim_cache size 0 max 16384 2024-09-21T06:29:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.932+0000 7f8021a13740 1 Processor -- start 2024-09-21T06:29:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.932+0000 7f8021a13740 1 -- start start 2024-09-21T06:29:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.932+0000 7f8021a13740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba6932f0 0x5602baa6ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.932+0000 7f8021a13740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba69b4d0 0x5602baa6a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.932+0000 7f8021a13740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baa6a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.932+0000 7f8021a13740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f80141b18d0 con 0x5602ba6932f0 2024-09-21T06:29:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.932+0000 7f8021a13740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f80141b3410 con 0x5602ba6bc1b0 2024-09-21T06:29:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.932+0000 7f8021a13740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f80141b1fa0 con 0x5602ba69b4d0 2024-09-21T06:29:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.932+0000 7f8013fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba6932f0 0x5602baa6ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.932+0000 7f8013fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba6932f0 0x5602baa6ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42872/0 (socket says 172.21.15.63:42872) 2024-09-21T06:29:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.932+0000 7f8013fff640 1 -- 172.21.15.63:0/3277278348 learned_addr learned my addr 172.21.15.63:0/3277278348 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.932+0000 7f8018f60640 1 --2- 172.21.15.63:0/3277278348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baa6a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.932+0000 7f80137fe640 1 --2- 172.21.15.63:0/3277278348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba69b4d0 0x5602baa6a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.932+0000 7f8018f60640 1 -- 172.21.15.63:0/3277278348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba69b4d0 msgr2=0x5602baa6a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.932+0000 7f8018f60640 1 --2- 172.21.15.63:0/3277278348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba69b4d0 0x5602baa6a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.936 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.932+0000 7f8018f60640 1 -- 172.21.15.63:0/3277278348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba6932f0 msgr2=0x5602baa6ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:44.936 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.932+0000 7f8018f60640 1 --2- 172.21.15.63:0/3277278348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba6932f0 0x5602baa6ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.936 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.933+0000 7f8018f60640 1 -- 172.21.15.63:0/3277278348 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602baa59b40 con 0x5602ba6bc1b0 2024-09-21T06:29:44.936 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.933+0000 7f8013fff640 1 --2- 172.21.15.63:0/3277278348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba6932f0 0x5602baa6ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:44.936 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.933+0000 7f80137fe640 1 --2- 172.21.15.63:0/3277278348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba69b4d0 0x5602baa6a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:44.936 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.933+0000 7f8018f60640 1 --2- 172.21.15.63:0/3277278348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baa6a6b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f800c0107a0 tx=0x7f800c016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3da3d134a59b9e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:44.936 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.933+0000 7f7ff9ffb640 1 -- 172.21.15.63:0/3277278348 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c004b20 con 0x5602ba6bc1b0 2024-09-21T06:29:44.936 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.933+0000 7f7ff9ffb640 1 -- 172.21.15.63:0/3277278348 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f800c01fd30 con 0x5602ba6bc1b0 2024-09-21T06:29:44.936 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.933+0000 7f7ff9ffb640 1 -- 172.21.15.63:0/3277278348 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c005360 con 0x5602ba6bc1b0 2024-09-21T06:29:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.934+0000 7f8021a13740 1 -- 172.21.15.63:0/3277278348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 msgr2=0x5602baa6a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.934+0000 7f8021a13740 1 --2- 172.21.15.63:0/3277278348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baa6a6b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f800c0107a0 tx=0x7f800c016000 comp rx=0 tx=0).stop 2024-09-21T06:29:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.934+0000 7f8021a13740 1 -- 172.21.15.63:0/3277278348 shutdown_connections 2024-09-21T06:29:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.934+0000 7f8021a13740 1 --2- 172.21.15.63:0/3277278348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baa6a6b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.934+0000 7f8021a13740 1 --2- 172.21.15.63:0/3277278348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba69b4d0 0x5602baa6a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.934+0000 7f8021a13740 1 --2- 172.21.15.63:0/3277278348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba6932f0 0x5602baa6ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.934+0000 7f8021a13740 1 -- 172.21.15.63:0/3277278348 >> 172.21.15.63:0/3277278348 conn(0x5602ba6b0300 msgr2=0x5602baa6e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.934+0000 7f8021a13740 1 -- 172.21.15.63:0/3277278348 shutdown_connections 2024-09-21T06:29:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.934+0000 7f8021a13740 1 -- 172.21.15.63:0/3277278348 wait complete. 2024-09-21T06:29:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.934+0000 7f8021a13740 1 -- start start 2024-09-21T06:29:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.935+0000 7f8021a13740 1 Processor -- start 2024-09-21T06:29:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.935+0000 7f8021a13740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba6932f0 0x5602baa72e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.935+0000 7f8021a13740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba69b4d0 0x5602baa73440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.935+0000 7f8021a13740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baae0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.935+0000 7f8021a13740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f80141b2d40 con 0x5602ba69b4d0 2024-09-21T06:29:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.935+0000 7f8021a13740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f80141b2670 con 0x5602ba6bc1b0 2024-09-21T06:29:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.935+0000 7f8021a13740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f80141af8b0 con 0x5602ba6932f0 2024-09-21T06:29:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.935+0000 7f8021a13740 10 client.0 _ll_register_callbacks cb 0x7f8008005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.935+0000 7f80137fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba69b4d0 0x5602baa73440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.935+0000 7f8018f60640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baae0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.935+0000 7f8018f60640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baae0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:54186/0 (socket says 172.21.15.63:54186) 2024-09-21T06:29:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.935+0000 7f8018f60640 1 -- 172.21.15.63:0/3858019374 learned_addr learned my addr 172.21.15.63:0/3858019374 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.935+0000 7f8013fff640 1 --2- 172.21.15.63:0/3858019374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba6932f0 0x5602baa72e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.935+0000 7f80137fe640 1 -- 172.21.15.63:0/3858019374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba6932f0 msgr2=0x5602baa72e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.935+0000 7f80137fe640 1 --2- 172.21.15.63:0/3858019374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba6932f0 0x5602baa72e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.935+0000 7f80137fe640 1 -- 172.21.15.63:0/3858019374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 msgr2=0x5602baae0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.935+0000 7f80137fe640 1 --2- 172.21.15.63:0/3858019374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baae0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.935+0000 7f80137fe640 1 -- 172.21.15.63:0/3858019374 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602baae0fb0 con 0x5602ba69b4d0 2024-09-21T06:29:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.935+0000 7f8018f60640 1 --2- 172.21.15.63:0/3858019374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baae0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.936+0000 7f80137fe640 1 --2- 172.21.15.63:0/3858019374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba69b4d0 0x5602baa73440 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8008107e90 tx=0x7f8008009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6278c23d424f09e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.936+0000 7f7ff37fe640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.936+0000 7f7ff37fe640 1 -- 172.21.15.63:0/3858019374 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008049040 con 0x5602ba69b4d0 2024-09-21T06:29:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.936+0000 7f7ff37fe640 1 -- 172.21.15.63:0/3858019374 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f80080ccd10 con 0x5602ba69b4d0 2024-09-21T06:29:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.936+0000 7f8021a13740 1 -- 172.21.15.63:0/3858019374 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f800c01fd30 con 0x5602ba69b4d0 2024-09-21T06:29:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.936+0000 7f7ff37fe640 1 -- 172.21.15.63:0/3858019374 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f80080cd670 con 0x5602ba69b4d0 2024-09-21T06:29:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.936+0000 7f8021a13740 10 client.15849 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.936+0000 7f8021a13740 1 -- 172.21.15.63:0/3858019374 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5602baae94b0 con 0x5602ba69b4d0 2024-09-21T06:29:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.936+0000 7f7ff37fe640 1 -- 172.21.15.63:0/3858019374 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80080d2020 con 0x5602ba69b4d0 2024-09-21T06:29:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.936+0000 7f7ff37fe640 1 -- 172.21.15.63:0/3858019374 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8008031ac0 con 0x5602ba69b4d0 2024-09-21T06:29:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.936+0000 7f8021a13740 10 client.15849 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.937+0000 7f8021a13740 10 client.15849 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.937+0000 7f8021a13740 20 client.15849 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.937+0000 7f8021a13740 1 --2- 172.21.15.63:0/3858019374 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5602ba6501c0 0x5602baaebae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.937+0000 7f8021a13740 4 client.15849 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:29:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.937+0000 7f8021a13740 1 -- 172.21.15.63:0/3858019374 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5602ba9d40f0 con 0x5602ba6501c0 2024-09-21T06:29:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.937+0000 7f8013fff640 1 --2- 172.21.15.63:0/3858019374 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5602ba6501c0 0x5602baaebae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.937+0000 7f7ff37fe640 10 client.15849 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:44.937+0000 7f8013fff640 1 --2- 172.21.15.63:0/3858019374 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5602ba6501c0 0x5602baaebae0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c77e8ce26caffe18 server_cookie=51ab611d4e3d8566 in_seq=0 out_seq=0 2024-09-21T06:29:45.067 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.480+0000 7f7ff37fe640 1 -- 172.21.15.63:0/3858019374 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5602ba9d40f0 con 0x5602ba6501c0 2024-09-21T06:29:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.480+0000 7f7ff37fe640 10 client.15849 handle_command_reply: tid=0 2024-09-21T06:29:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.480+0000 7f8021a13740 1 client.15849 shutdown 2024-09-21T06:29:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.481+0000 7f8021a13740 1 -- 172.21.15.63:0/3858019374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba69b4d0 msgr2=0x5602baa73440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.481+0000 7f8021a13740 1 --2- 172.21.15.63:0/3858019374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba69b4d0 0x5602baa73440 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8008107e90 tx=0x7f8008009260 comp rx=0 tx=0).stop 2024-09-21T06:29:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.481+0000 7f8021a13740 1 -- 172.21.15.63:0/3858019374 shutdown_connections 2024-09-21T06:29:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.481+0000 7f8021a13740 1 --2- 172.21.15.63:0/3858019374 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x5602ba6501c0 0x5602baaebae0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.481+0000 7f8021a13740 1 --2- 172.21.15.63:0/3858019374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602ba6bc1b0 0x5602baae0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.481+0000 7f8021a13740 1 --2- 172.21.15.63:0/3858019374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602ba69b4d0 0x5602baa73440 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.481+0000 7f8021a13740 1 --2- 172.21.15.63:0/3858019374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602ba6932f0 0x5602baa72e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.481+0000 7f7ff37fe640 0 client.15849 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.481+0000 7f8021a13740 1 -- 172.21.15.63:0/3858019374 >> 172.21.15.63:0/3858019374 conn(0x5602ba6b0300 msgr2=0x5602baa629e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.481+0000 7f8021a13740 1 -- 172.21.15.63:0/3858019374 shutdown_connections 2024-09-21T06:29:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.481+0000 7f8021a13740 1 -- 172.21.15.63:0/3858019374 wait complete. 2024-09-21T06:29:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.481+0000 7f8021a13740 20 client.15849 trim_cache size 0 max 16384 2024-09-21T06:29:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout:{ 2024-09-21T06:29:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout: "message": "", 2024-09-21T06:29:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout: "return_code": 0 2024-09-21T06:29:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout:} 2024-09-21T06:29:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.481+0000 7f801a9c3640 1 -- 172.21.15.63:0/1006965704 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7ffc0b66b0 msgr2=0x7f7ffc0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.481+0000 7f801a9c3640 1 --2- 172.21.15.63:0/1006965704 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7ffc0b66b0 0x7f7ffc0b8bc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f800c011830 tx=0x7f800c009500 comp rx=0 tx=0).stop 2024-09-21T06:29:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.481+0000 7f801a9c3640 1 -- 172.21.15.63:0/1006965704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8014108310 msgr2=0x7f80140ffa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.481+0000 7f801a9c3640 1 --2- 172.21.15.63:0/1006965704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8014108310 0x7f80140ffa90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f800802a930 tx=0x7f8008031a20 comp rx=0 tx=0).stop 2024-09-21T06:29:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.482+0000 7f801a9c3640 1 -- 172.21.15.63:0/1006965704 shutdown_connections 2024-09-21T06:29:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.482+0000 7f801a9c3640 1 --2- 172.21.15.63:0/1006965704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8014108c60 0x7f80140fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.482+0000 7f801a9c3640 1 --2- 172.21.15.63:0/1006965704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8014108310 0x7f80140ffa90 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.482+0000 7f801a9c3640 1 --2- 172.21.15.63:0/1006965704 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7ffc0b66b0 0x7f7ffc0b8bc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.482+0000 7f801a9c3640 1 --2- 172.21.15.63:0/1006965704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80141029e0 0x7f80140ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.482+0000 7f801a9c3640 1 -- 172.21.15.63:0/1006965704 >> 172.21.15.63:0/1006965704 conn(0x7f801407a6e0 msgr2=0x7f80141019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.482+0000 7f801a9c3640 1 -- 172.21.15.63:0/1006965704 shutdown_connections 2024-09-21T06:29:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:45.482+0000 7f801a9c3640 1 -- 172.21.15.63:0/1006965704 wait complete. 2024-09-21T06:29:45.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:45 smithi071 ceph-mon[34844]: pgmap v368: 97 pgs: 97 active+clean; 16 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 211 KiB/s wr, 87 op/s 2024-09-21T06:29:45.578 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:45 smithi063 ceph-mon[31150]: pgmap v368: 97 pgs: 97 active+clean; 16 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 211 KiB/s wr, 87 op/s 2024-09-21T06:29:45.598 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:45 smithi175 ceph-mon[34510]: pgmap v368: 97 pgs: 97 active+clean; 16 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 211 KiB/s wr, 87 op/s 2024-09-21T06:29:45.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.677+0000 7f0ce5d2b640 1 -- 172.21.15.63:0/4074889702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ce01083a0 msgr2=0x7f0ce01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:45.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.677+0000 7f0ce5d2b640 1 --2- 172.21.15.63:0/4074889702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ce01083a0 0x7f0ce01087b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4009900 tx=0x7f0cd402a410 comp rx=0 tx=0).stop 2024-09-21T06:29:45.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.677+0000 7f0ce5d2b640 1 -- 172.21.15.63:0/4074889702 shutdown_connections 2024-09-21T06:29:45.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.677+0000 7f0ce5d2b640 1 --2- 172.21.15.63:0/4074889702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ce0108cf0 0x7f0ce010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.677+0000 7f0ce5d2b640 1 --2- 172.21.15.63:0/4074889702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ce01083a0 0x7f0ce01087b0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.677+0000 7f0ce5d2b640 1 --2- 172.21.15.63:0/4074889702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ce0102a60 0x7f0ce0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.677+0000 7f0ce5d2b640 1 -- 172.21.15.63:0/4074889702 >> 172.21.15.63:0/4074889702 conn(0x7f0ce0079730 msgr2=0x7f0ce0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:45.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.678+0000 7f0ce5d2b640 1 -- 172.21.15.63:0/4074889702 shutdown_connections 2024-09-21T06:29:45.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.678+0000 7f0ce5d2b640 1 -- 172.21.15.63:0/4074889702 wait complete. 2024-09-21T06:29:45.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.678+0000 7f0ce5d2b640 1 Processor -- start 2024-09-21T06:29:45.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.679+0000 7f0ce5d2b640 1 -- start start 2024-09-21T06:29:45.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.679+0000 7f0ce5d2b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ce0102a60 0x7f0ce00ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:45.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.679+0000 7f0ce5d2b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ce01083a0 0x7f0ce00ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:45.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.679+0000 7f0ce5d2b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ce0108cf0 0x7f0ce01000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:45.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.679+0000 7f0ce5d2b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce0112960 con 0x7f0ce01083a0 2024-09-21T06:29:45.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.679+0000 7f0ce5d2b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce01127e0 con 0x7f0ce0102a60 2024-09-21T06:29:45.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.679+0000 7f0ce5d2b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce0112ae0 con 0x7f0ce0108cf0 2024-09-21T06:29:45.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.679+0000 7f0cdeffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ce01083a0 0x7f0ce00ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:45.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.679+0000 7f0cdf7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ce0102a60 0x7f0ce00ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:45.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.679+0000 7f0cdffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ce0108cf0 0x7f0ce01000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:45.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.679+0000 7f0cdf7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ce0102a60 0x7f0ce00ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:54218/0 (socket says 172.21.15.63:54218) 2024-09-21T06:29:45.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.679+0000 7f0cdf7fe640 1 -- 172.21.15.63:0/213132986 learned_addr learned my addr 172.21.15.63:0/213132986 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:45.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.679+0000 7f0cdffff640 1 -- 172.21.15.63:0/213132986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ce0102a60 msgr2=0x7f0ce00ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:45.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.679+0000 7f0cdffff640 1 --2- 172.21.15.63:0/213132986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ce0102a60 0x7f0ce00ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.679+0000 7f0cdffff640 1 -- 172.21.15.63:0/213132986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ce01083a0 msgr2=0x7f0ce00ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:45.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.679+0000 7f0cdffff640 1 --2- 172.21.15.63:0/213132986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ce01083a0 0x7f0ce00ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.679+0000 7f0cdffff640 1 -- 172.21.15.63:0/213132986 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce01a8720 con 0x7f0ce0108cf0 2024-09-21T06:29:45.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.680+0000 7f0cdffff640 1 --2- 172.21.15.63:0/213132986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ce0108cf0 0x7f0ce01000f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8009fd0 tx=0x7f0cd800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:45.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.680+0000 7f0cdcff9640 1 -- 172.21.15.63:0/213132986 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd800ce20 con 0x7f0ce0108cf0 2024-09-21T06:29:45.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.680+0000 7f0cdcff9640 1 -- 172.21.15.63:0/213132986 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cd8005020 con 0x7f0ce0108cf0 2024-09-21T06:29:45.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.680+0000 7f0ce5d2b640 1 -- 172.21.15.63:0/213132986 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce01a8a10 con 0x7f0ce0108cf0 2024-09-21T06:29:45.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.680+0000 7f0cdcff9640 1 -- 172.21.15.63:0/213132986 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8010690 con 0x7f0ce0108cf0 2024-09-21T06:29:45.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.680+0000 7f0ce5d2b640 1 -- 172.21.15.63:0/213132986 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce01a8f20 con 0x7f0ce0108cf0 2024-09-21T06:29:45.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.682+0000 7f0cec29f740 1 Processor -- start 2024-09-21T06:29:45.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.683+0000 7f0cdcff9640 1 -- 172.21.15.63:0/213132986 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f0cd80054d0 con 0x7f0ce0108cf0 2024-09-21T06:29:45.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.683+0000 7f0cec29f740 1 -- start start 2024-09-21T06:29:45.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.683+0000 7f0cec29f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30ff070 0x55aca34a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:45.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.683+0000 7f0cec29f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30d61b0 0x55aca34a6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:45.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.683+0000 7f0cec29f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30de390 0x55aca34a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:45.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.683+0000 7f0cec29f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55aca341cea0 con 0x55aca30de390 2024-09-21T06:29:45.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.683+0000 7f0cec29f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55aca340c2d0 con 0x55aca30d61b0 2024-09-21T06:29:45.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.683+0000 7f0cec29f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55aca34100e0 con 0x55aca30ff070 2024-09-21T06:29:45.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.683+0000 7f0cdeffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30de390 0x55aca34a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:45.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.683+0000 7f0cdf7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30d61b0 0x55aca34a6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:45.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.683+0000 7f0cdeffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30de390 0x55aca34a6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42930/0 (socket says 172.21.15.63:42930) 2024-09-21T06:29:45.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.683+0000 7f0cdeffd640 1 -- 172.21.15.63:0/1833992142 learned_addr learned my addr 172.21.15.63:0/1833992142 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:45.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.683+0000 7f0cdf7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30d61b0 0x55aca34a6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:54224/0 (socket says 172.21.15.63:54224) 2024-09-21T06:29:45.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.683+0000 7f0cdeffd640 1 --2- 172.21.15.63:0/1833992142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30ff070 0x55aca34a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:45.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.683+0000 7f0cdf7fe640 1 -- 172.21.15.63:0/1833992142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30ff070 msgr2=0x55aca34a62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:45.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.683+0000 7f0cdf7fe640 1 --2- 172.21.15.63:0/1833992142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30ff070 0x55aca34a62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.683+0000 7f0cdf7fe640 1 -- 172.21.15.63:0/1833992142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30de390 msgr2=0x55aca34a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:45.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.683+0000 7f0cdf7fe640 1 --2- 172.21.15.63:0/1833992142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30de390 0x55aca34a6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.684+0000 7f0cdf7fe640 1 -- 172.21.15.63:0/1833992142 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aca316a650 con 0x55aca30d61b0 2024-09-21T06:29:45.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.684+0000 7f0cdcff9640 1 --2- 172.21.15.63:0/213132986 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0cc80b6700 0x7f0cc80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:45.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.684+0000 7f0cdeffd640 1 --2- 172.21.15.63:0/1833992142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30ff070 0x55aca34a62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:45.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.684+0000 7f0cdeffd640 1 --2- 172.21.15.63:0/213132986 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0cc80b6700 0x7f0cc80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:45.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.684+0000 7f0cdf7fe640 1 --2- 172.21.15.63:0/1833992142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30d61b0 0x55aca34a6800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009cf0 tx=0x7f0cd0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=127ffe7a5838938a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:45.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.684+0000 7f0cdcff9640 1 -- 172.21.15.63:0/213132986 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f0cd80e7d60 con 0x7f0ce0108cf0 2024-09-21T06:29:45.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.684+0000 7f0cc5ffb640 1 -- 172.21.15.63:0/1833992142 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd001e070 con 0x55aca30d61b0 2024-09-21T06:29:45.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.684+0000 7f0cc5ffb640 1 -- 172.21.15.63:0/1833992142 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cd00198c0 con 0x55aca30d61b0 2024-09-21T06:29:45.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.684+0000 7f0cc5ffb640 1 -- 172.21.15.63:0/1833992142 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00186f0 con 0x55aca30d61b0 2024-09-21T06:29:45.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.685+0000 7f0cec29f740 1 -- 172.21.15.63:0/1833992142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30d61b0 msgr2=0x55aca34a6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:45.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.685+0000 7f0cec29f740 1 --2- 172.21.15.63:0/1833992142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30d61b0 0x55aca34a6800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009cf0 tx=0x7f0cd0011810 comp rx=0 tx=0).stop 2024-09-21T06:29:45.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.685+0000 7f0cdeffd640 1 --2- 172.21.15.63:0/213132986 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0cc80b6700 0x7f0cc80b8c10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40096c0 tx=0x7f0cd4041040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:45.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.685+0000 7f0cec29f740 1 -- 172.21.15.63:0/1833992142 shutdown_connections 2024-09-21T06:29:45.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.685+0000 7f0cec29f740 1 --2- 172.21.15.63:0/1833992142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30de390 0x55aca34a6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.685+0000 7f0cec29f740 1 --2- 172.21.15.63:0/1833992142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30d61b0 0x55aca34a6800 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.685+0000 7f0cec29f740 1 --2- 172.21.15.63:0/1833992142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30ff070 0x55aca34a62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.685+0000 7f0cec29f740 1 -- 172.21.15.63:0/1833992142 >> 172.21.15.63:0/1833992142 conn(0x55aca30f3460 msgr2=0x55aca34a41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:45.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.685+0000 7f0cec29f740 1 -- 172.21.15.63:0/1833992142 shutdown_connections 2024-09-21T06:29:45.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.685+0000 7f0cec29f740 1 -- 172.21.15.63:0/1833992142 wait complete. 2024-09-21T06:29:45.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.685+0000 7f0cec29f740 1 -- start start 2024-09-21T06:29:45.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.686+0000 7f0cec29f740 1 Processor -- start 2024-09-21T06:29:45.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.686+0000 7f0cec29f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30d61b0 0x55aca34b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:45.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.686+0000 7f0cec29f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30de390 0x55aca34b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:45.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.686+0000 7f0cec29f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30ff070 0x55aca34b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:45.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.686+0000 7f0cec29f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55aca326d700 con 0x55aca30d61b0 2024-09-21T06:29:45.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.686+0000 7f0cec29f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55aca33a7160 con 0x55aca30ff070 2024-09-21T06:29:45.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.686+0000 7f0cec29f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55aca34b4aa0 con 0x55aca30de390 2024-09-21T06:29:45.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.686+0000 7f0cec29f740 10 client.0 _ll_register_callbacks cb 0x55aca33c09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:45.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.686+0000 7f0cdf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30d61b0 0x55aca34b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:45.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.686+0000 7f0cdf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30d61b0 0x55aca34b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42942/0 (socket says 172.21.15.63:42942) 2024-09-21T06:29:45.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.686+0000 7f0cdf7fe640 1 -- 172.21.15.63:0/101813468 learned_addr learned my addr 172.21.15.63:0/101813468 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:45.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.686+0000 7f0cdffff640 1 --2- 172.21.15.63:0/101813468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30ff070 0x55aca34b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:45.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.686+0000 7f0cdeffd640 1 --2- 172.21.15.63:0/101813468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30de390 0x55aca34b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:45.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.687+0000 7f0cdf7fe640 1 -- 172.21.15.63:0/101813468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30de390 msgr2=0x55aca34b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:45.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.687+0000 7f0cdf7fe640 1 --2- 172.21.15.63:0/101813468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30de390 0x55aca34b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.687+0000 7f0cdf7fe640 1 -- 172.21.15.63:0/101813468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30ff070 msgr2=0x55aca34b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:45.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.687+0000 7f0cdf7fe640 1 --2- 172.21.15.63:0/101813468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30ff070 0x55aca34b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.687+0000 7f0cdf7fe640 1 -- 172.21.15.63:0/101813468 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aca33d4c90 con 0x55aca30d61b0 2024-09-21T06:29:45.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.687+0000 7f0cdf7fe640 1 --2- 172.21.15.63:0/101813468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30d61b0 0x55aca34b1870 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00183f0 tx=0x7f0cd001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a28b5ee64f5135 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:45.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.687+0000 7f0cbeffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:45.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.687+0000 7f0cbeffd640 1 -- 172.21.15.63:0/101813468 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd001e040 con 0x55aca30d61b0 2024-09-21T06:29:45.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.687+0000 7f0cbeffd640 1 -- 172.21.15.63:0/101813468 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f0cd0004040 con 0x55aca30d61b0 2024-09-21T06:29:45.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.687+0000 7f0cec29f740 1 -- 172.21.15.63:0/101813468 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cd00198c0 con 0x55aca30d61b0 2024-09-21T06:29:45.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.687+0000 7f0cbeffd640 1 -- 172.21.15.63:0/101813468 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0cd0032050 con 0x55aca30d61b0 2024-09-21T06:29:45.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.687+0000 7f0cec29f740 10 client.15861 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:45.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.687+0000 7f0cec29f740 1 -- 172.21.15.63:0/101813468 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55aca34c0700 con 0x55aca30d61b0 2024-09-21T06:29:45.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.687+0000 7f0cbeffd640 1 -- 172.21.15.63:0/101813468 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cd00198c0 con 0x55aca30d61b0 2024-09-21T06:29:45.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.688+0000 7f0cbeffd640 1 -- 172.21.15.63:0/101813468 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0cd00046c0 con 0x55aca30d61b0 2024-09-21T06:29:45.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.688+0000 7f0cec29f740 10 client.15861 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:45.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.688+0000 7f0cec29f740 10 client.15861 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:29:45.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.688+0000 7f0cec29f740 20 client.15861 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:45.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.688+0000 7f0cec29f740 1 --2- 172.21.15.63:0/101813468 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55aca30bd9f0 0x55aca34c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:45.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.688+0000 7f0cec29f740 4 client.15861 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:45.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.688+0000 7f0cec29f740 1 -- 172.21.15.63:0/101813468 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aca341edf0 con 0x55aca30bd9f0 2024-09-21T06:29:45.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.688+0000 7f0cdeffd640 1 --2- 172.21.15.63:0/101813468 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55aca30bd9f0 0x55aca34c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:45.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.688+0000 7f0cdeffd640 1 --2- 172.21.15.63:0/101813468 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55aca30bd9f0 0x55aca34c3b70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f3d115e778a997a6 server_cookie=8f4e54ad81fba131 in_seq=0 out_seq=0 2024-09-21T06:29:45.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.688+0000 7f0cbeffd640 10 client.15861 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:29:45.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.689+0000 7f0cbeffd640 1 -- 172.21.15.63:0/101813468 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aca341edf0 con 0x55aca30bd9f0 2024-09-21T06:29:45.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.689+0000 7f0cbeffd640 10 client.15861 handle_command_reply: tid=0 2024-09-21T06:29:45.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.689+0000 7f0cec29f740 1 client.15861 shutdown 2024-09-21T06:29:45.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.689+0000 7f0cec29f740 1 -- 172.21.15.63:0/101813468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30d61b0 msgr2=0x55aca34b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:45.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.689+0000 7f0cec29f740 1 --2- 172.21.15.63:0/101813468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30d61b0 0x55aca34b1870 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00183f0 tx=0x7f0cd001ad30 comp rx=0 tx=0).stop 2024-09-21T06:29:45.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.689+0000 7f0cec29f740 1 -- 172.21.15.63:0/101813468 shutdown_connections 2024-09-21T06:29:45.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.689+0000 7f0cec29f740 1 --2- 172.21.15.63:0/101813468 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55aca30bd9f0 0x55aca34c3b70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.689+0000 7f0cec29f740 1 --2- 172.21.15.63:0/101813468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30ff070 0x55aca34b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.689+0000 7f0cec29f740 1 --2- 172.21.15.63:0/101813468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30de390 0x55aca34b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.690+0000 7f0cbeffd640 0 client.15861 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:29:45.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.689+0000 7f0cec29f740 1 --2- 172.21.15.63:0/101813468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30d61b0 0x55aca34b1870 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.690+0000 7f0cec29f740 1 -- 172.21.15.63:0/101813468 >> 172.21.15.63:0/101813468 conn(0x55aca30f3460 msgr2=0x55aca34a9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:45.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.690+0000 7f0cec29f740 1 -- 172.21.15.63:0/101813468 shutdown_connections 2024-09-21T06:29:45.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.690+0000 7f0cec29f740 1 -- 172.21.15.63:0/101813468 wait complete. 2024-09-21T06:29:45.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.690+0000 7f0cec29f740 20 client.15861 trim_cache size 0 max 16384 2024-09-21T06:29:45.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.703+0000 7f0cec29f740 1 Processor -- start 2024-09-21T06:29:45.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.703+0000 7f0cec29f740 1 -- start start 2024-09-21T06:29:45.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.703+0000 7f0cec29f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30bd9f0 0x55aca34b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:45.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.703+0000 7f0cec29f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30d61b0 0x55aca34a3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:45.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.703+0000 7f0cec29f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30de390 0x55aca34a3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:45.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.703+0000 7f0cec29f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce01b1740 con 0x55aca30de390 2024-09-21T06:29:45.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.703+0000 7f0cec29f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce01b3280 con 0x55aca30bd9f0 2024-09-21T06:29:45.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.703+0000 7f0cec29f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce01b1e10 con 0x55aca30d61b0 2024-09-21T06:29:45.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.703+0000 7f0cdffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30de390 0x55aca34a3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:45.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.703+0000 7f0cdffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30de390 0x55aca34a3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42954/0 (socket says 172.21.15.63:42954) 2024-09-21T06:29:45.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.703+0000 7f0cdffff640 1 -- 172.21.15.63:0/3727774954 learned_addr learned my addr 172.21.15.63:0/3727774954 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:45.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.703+0000 7f0cdeffd640 1 --2- 172.21.15.63:0/3727774954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30d61b0 0x55aca34a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:45.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.703+0000 7f0cdf7fe640 1 --2- 172.21.15.63:0/3727774954 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30bd9f0 0x55aca34b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:45.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.704+0000 7f0cdffff640 1 -- 172.21.15.63:0/3727774954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30d61b0 msgr2=0x55aca34a3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:45.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.704+0000 7f0cdffff640 1 --2- 172.21.15.63:0/3727774954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30d61b0 0x55aca34a3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.704+0000 7f0cdffff640 1 -- 172.21.15.63:0/3727774954 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30bd9f0 msgr2=0x55aca34b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:45.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.704+0000 7f0cdffff640 1 --2- 172.21.15.63:0/3727774954 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30bd9f0 0x55aca34b34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.704+0000 7f0cdffff640 1 -- 172.21.15.63:0/3727774954 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aca34b2b30 con 0x55aca30de390 2024-09-21T06:29:45.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.704+0000 7f0cdffff640 1 --2- 172.21.15.63:0/3727774954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30de390 0x55aca34a3ca0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80adb80 tx=0x7f0cd80ad360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34bed734e77d50e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:45.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.704+0000 7f0cc57fa640 1 -- 172.21.15.63:0/3727774954 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd80ae2f0 con 0x55aca30de390 2024-09-21T06:29:45.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.704+0000 7f0cc57fa640 1 -- 172.21.15.63:0/3727774954 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cd80b26d0 con 0x55aca30de390 2024-09-21T06:29:45.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.704+0000 7f0cc57fa640 1 -- 172.21.15.63:0/3727774954 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd80b73e0 con 0x55aca30de390 2024-09-21T06:29:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.705+0000 7f0cec29f740 1 -- 172.21.15.63:0/3727774954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30de390 msgr2=0x55aca34a3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.705+0000 7f0cec29f740 1 --2- 172.21.15.63:0/3727774954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30de390 0x55aca34a3ca0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80adb80 tx=0x7f0cd80ad360 comp rx=0 tx=0).stop 2024-09-21T06:29:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.705+0000 7f0cec29f740 1 -- 172.21.15.63:0/3727774954 shutdown_connections 2024-09-21T06:29:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.705+0000 7f0cec29f740 1 --2- 172.21.15.63:0/3727774954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30de390 0x55aca34a3ca0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.705+0000 7f0cec29f740 1 --2- 172.21.15.63:0/3727774954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30d61b0 0x55aca34a3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.705+0000 7f0cec29f740 1 --2- 172.21.15.63:0/3727774954 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30bd9f0 0x55aca34b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.705+0000 7f0cec29f740 1 -- 172.21.15.63:0/3727774954 >> 172.21.15.63:0/3727774954 conn(0x55aca30f3460 msgr2=0x55aca34b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.705+0000 7f0cec29f740 1 -- 172.21.15.63:0/3727774954 shutdown_connections 2024-09-21T06:29:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.705+0000 7f0cec29f740 1 -- 172.21.15.63:0/3727774954 wait complete. 2024-09-21T06:29:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.705+0000 7f0cec29f740 1 -- start start 2024-09-21T06:29:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.706+0000 7f0cec29f740 1 Processor -- start 2024-09-21T06:29:45.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.706+0000 7f0cec29f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30bd9f0 0x55aca34ba5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:45.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.706+0000 7f0cec29f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30d61b0 0x55aca34b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:45.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.706+0000 7f0cec29f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30de390 0x55aca34b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:45.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.706+0000 7f0cec29f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce01b2bb0 con 0x55aca30bd9f0 2024-09-21T06:29:45.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.706+0000 7f0cec29f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce01b24e0 con 0x55aca30de390 2024-09-21T06:29:45.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.706+0000 7f0cec29f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce01af720 con 0x55aca30d61b0 2024-09-21T06:29:45.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.706+0000 7f0cec29f740 10 client.0 _ll_register_callbacks cb 0x7f0cd001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:45.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.706+0000 7f0cdf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30bd9f0 0x55aca34ba5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:45.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.706+0000 7f0cdf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30bd9f0 0x55aca34ba5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42962/0 (socket says 172.21.15.63:42962) 2024-09-21T06:29:45.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.706+0000 7f0cdf7fe640 1 -- 172.21.15.63:0/4125164050 learned_addr learned my addr 172.21.15.63:0/4125164050 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:45.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.706+0000 7f0cdffff640 1 --2- 172.21.15.63:0/4125164050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30de390 0x55aca34b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:45.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.706+0000 7f0cdeffd640 1 --2- 172.21.15.63:0/4125164050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30d61b0 0x55aca34b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:45.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.707+0000 7f0cdf7fe640 1 -- 172.21.15.63:0/4125164050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30d61b0 msgr2=0x55aca34b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:45.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.707+0000 7f0cdf7fe640 1 --2- 172.21.15.63:0/4125164050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30d61b0 0x55aca34b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.707+0000 7f0cdf7fe640 1 -- 172.21.15.63:0/4125164050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30de390 msgr2=0x55aca34b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:45.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.707+0000 7f0cdf7fe640 1 --2- 172.21.15.63:0/4125164050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30de390 0x55aca34b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.707+0000 7f0cdf7fe640 1 -- 172.21.15.63:0/4125164050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aca34b6880 con 0x55aca30bd9f0 2024-09-21T06:29:45.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.707+0000 7f0cdeffd640 1 --2- 172.21.15.63:0/4125164050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30d61b0 0x55aca34b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:45.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.707+0000 7f0cdf7fe640 1 --2- 172.21.15.63:0/4125164050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30bd9f0 0x55aca34ba5f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0004b10 tx=0x7f0cd0004880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a86fda59ed35bfa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:45.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.707+0000 7f0cbeffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:45.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.707+0000 7f0cbeffd640 1 -- 172.21.15.63:0/4125164050 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd003a030 con 0x55aca30bd9f0 2024-09-21T06:29:45.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.707+0000 7f0cbeffd640 1 -- 172.21.15.63:0/4125164050 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f0cd0019930 con 0x55aca30bd9f0 2024-09-21T06:29:45.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.707+0000 7f0cec29f740 1 -- 172.21.15.63:0/4125164050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cd80b26d0 con 0x55aca30bd9f0 2024-09-21T06:29:45.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.707+0000 7f0cbeffd640 1 -- 172.21.15.63:0/4125164050 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0cd001e040 con 0x55aca30bd9f0 2024-09-21T06:29:45.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.707+0000 7f0cec29f740 10 client.15867 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:45.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.707+0000 7f0cec29f740 1 -- 172.21.15.63:0/4125164050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55aca352e450 con 0x55aca30bd9f0 2024-09-21T06:29:45.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.708+0000 7f0cbeffd640 1 -- 172.21.15.63:0/4125164050 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cd80b26d0 con 0x55aca30bd9f0 2024-09-21T06:29:45.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.708+0000 7f0cbeffd640 1 -- 172.21.15.63:0/4125164050 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0cd001a550 con 0x55aca30bd9f0 2024-09-21T06:29:45.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.708+0000 7f0cec29f740 10 client.15867 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:45.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.708+0000 7f0cec29f740 10 client.15867 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:29:45.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.708+0000 7f0cec29f740 20 client.15867 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:45.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.708+0000 7f0cec29f740 1 --2- 172.21.15.63:0/4125164050 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55aca30ff070 0x55aca3530ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:45.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.708+0000 7f0cec29f740 4 client.15867 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:29:45.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.708+0000 7f0cec29f740 1 -- 172.21.15.63:0/4125164050 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55aca341a8a0 con 0x55aca30ff070 2024-09-21T06:29:45.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.708+0000 7f0cdeffd640 1 --2- 172.21.15.63:0/4125164050 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55aca30ff070 0x55aca3530ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:45.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.709+0000 7f0cdeffd640 1 --2- 172.21.15.63:0/4125164050 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55aca30ff070 0x55aca3530ba0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ecf5be773f83b898 server_cookie=711c190c92f25f61 in_seq=0 out_seq=0 2024-09-21T06:29:45.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.709+0000 7f0cbeffd640 10 client.15867 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:29:45.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.709+0000 7f0cbeffd640 1 -- 172.21.15.63:0/4125164050 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55aca341a8a0 con 0x55aca30ff070 2024-09-21T06:29:45.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.709+0000 7f0cbeffd640 10 client.15867 handle_command_reply: tid=0 2024-09-21T06:29:45.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.709+0000 7f0cec29f740 1 client.15867 shutdown 2024-09-21T06:29:45.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.709+0000 7f0cec29f740 1 -- 172.21.15.63:0/4125164050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30bd9f0 msgr2=0x55aca34ba5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:45.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.709+0000 7f0cec29f740 1 --2- 172.21.15.63:0/4125164050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30bd9f0 0x55aca34ba5f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0004b10 tx=0x7f0cd0004880 comp rx=0 tx=0).stop 2024-09-21T06:29:45.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.709+0000 7f0cec29f740 1 -- 172.21.15.63:0/4125164050 shutdown_connections 2024-09-21T06:29:45.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.709+0000 7f0cec29f740 1 --2- 172.21.15.63:0/4125164050 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55aca30ff070 0x55aca3530ba0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.709+0000 7f0cec29f740 1 --2- 172.21.15.63:0/4125164050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55aca30de390 0x55aca34b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.709+0000 7f0cec29f740 1 --2- 172.21.15.63:0/4125164050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aca30d61b0 0x55aca34b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.709+0000 7f0cbeffd640 0 client.15867 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:29:45.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.709+0000 7f0cec29f740 1 --2- 172.21.15.63:0/4125164050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55aca30bd9f0 0x55aca34ba5f0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.709+0000 7f0cec29f740 1 -- 172.21.15.63:0/4125164050 >> 172.21.15.63:0/4125164050 conn(0x55aca30f3460 msgr2=0x55aca34bcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:45.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.709+0000 7f0cec29f740 1 -- 172.21.15.63:0/4125164050 shutdown_connections 2024-09-21T06:29:45.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.709+0000 7f0cec29f740 1 -- 172.21.15.63:0/4125164050 wait complete. 2024-09-21T06:29:45.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.709+0000 7f0cec29f740 20 client.15867 trim_cache size 0 max 16384 2024-09-21T06:29:45.716 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:29:45.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.710+0000 7f0ce5d2b640 1 -- 172.21.15.63:0/213132986 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0cc80b6700 msgr2=0x7f0cc80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:45.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.710+0000 7f0ce5d2b640 1 --2- 172.21.15.63:0/213132986 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0cc80b6700 0x7f0cc80b8c10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40096c0 tx=0x7f0cd4041040 comp rx=0 tx=0).stop 2024-09-21T06:29:45.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.710+0000 7f0ce5d2b640 1 -- 172.21.15.63:0/213132986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ce0108cf0 msgr2=0x7f0ce01000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:45.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.710+0000 7f0ce5d2b640 1 --2- 172.21.15.63:0/213132986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ce0108cf0 0x7f0ce01000f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8009fd0 tx=0x7f0cd800ef10 comp rx=0 tx=0).stop 2024-09-21T06:29:45.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.710+0000 7f0ce5d2b640 1 -- 172.21.15.63:0/213132986 shutdown_connections 2024-09-21T06:29:45.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.710+0000 7f0ce5d2b640 1 --2- 172.21.15.63:0/213132986 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0cc80b6700 0x7f0cc80b8c10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.710+0000 7f0ce5d2b640 1 --2- 172.21.15.63:0/213132986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ce0108cf0 0x7f0ce01000f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.710+0000 7f0ce5d2b640 1 --2- 172.21.15.63:0/213132986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ce01083a0 0x7f0ce00ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.710+0000 7f0ce5d2b640 1 --2- 172.21.15.63:0/213132986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ce0102a60 0x7f0ce00ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:45.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.710+0000 7f0ce5d2b640 1 -- 172.21.15.63:0/213132986 >> 172.21.15.63:0/213132986 conn(0x7f0ce0079730 msgr2=0x7f0ce006b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:45.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.710+0000 7f0ce5d2b640 1 -- 172.21.15.63:0/213132986 shutdown_connections 2024-09-21T06:29:45.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:45.710+0000 7f0ce5d2b640 1 -- 172.21.15.63:0/213132986 wait complete. 2024-09-21T06:29:46.395 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:29:46.653 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:47.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.156+0000 7fc20dd0e640 1 -- 172.21.15.63:0/3878867346 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc208108d10 msgr2=0x7fc20810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:47.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.156+0000 7fc20dd0e640 1 --2- 172.21.15.63:0/3878867346 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc208108d10 0x7fc20810f540 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc200009ca0 tx=0x7fc20002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.156+0000 7fc20dd0e640 1 -- 172.21.15.63:0/3878867346 shutdown_connections 2024-09-21T06:29:47.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.156+0000 7fc20dd0e640 1 --2- 172.21.15.63:0/3878867346 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc208108d10 0x7fc20810f540 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.156+0000 7fc20dd0e640 1 --2- 172.21.15.63:0/3878867346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2081083c0 0x7fc2081087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.156+0000 7fc20dd0e640 1 --2- 172.21.15.63:0/3878867346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc208102a80 0x7fc208102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.156+0000 7fc20dd0e640 1 -- 172.21.15.63:0/3878867346 >> 172.21.15.63:0/3878867346 conn(0x7fc208079740 msgr2=0x7fc208079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:47.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.156+0000 7fc20dd0e640 1 -- 172.21.15.63:0/3878867346 shutdown_connections 2024-09-21T06:29:47.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.156+0000 7fc20dd0e640 1 -- 172.21.15.63:0/3878867346 wait complete. 2024-09-21T06:29:47.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.157+0000 7fc20dd0e640 1 Processor -- start 2024-09-21T06:29:47.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.157+0000 7fc20dd0e640 1 -- start start 2024-09-21T06:29:47.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.157+0000 7fc20dd0e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc208102a80 0x7fc20819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:47.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.157+0000 7fc20dd0e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2081083c0 0x7fc20819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:47.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.157+0000 7fc20dd0e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc208108d10 0x7fc20819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:47.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.157+0000 7fc20dd0e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc208112980 con 0x7fc208102a80 2024-09-21T06:29:47.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.157+0000 7fc20dd0e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc208112800 con 0x7fc208108d10 2024-09-21T06:29:47.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.157+0000 7fc20dd0e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc208112b00 con 0x7fc2081083c0 2024-09-21T06:29:47.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.157+0000 7fc2077fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc208102a80 0x7fc20819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:47.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.157+0000 7fc2077fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc208102a80 0x7fc20819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60072/0 (socket says 172.21.15.63:60072) 2024-09-21T06:29:47.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.157+0000 7fc2077fe640 1 -- 172.21.15.63:0/986355269 learned_addr learned my addr 172.21.15.63:0/986355269 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:47.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.157+0000 7fc206ffd640 1 --2- 172.21.15.63:0/986355269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2081083c0 0x7fc20819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:47.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.158+0000 7fc207fff640 1 --2- 172.21.15.63:0/986355269 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc208108d10 0x7fc20819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:47.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.158+0000 7fc2077fe640 1 -- 172.21.15.63:0/986355269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2081083c0 msgr2=0x7fc20819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:47.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.158+0000 7fc2077fe640 1 --2- 172.21.15.63:0/986355269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2081083c0 0x7fc20819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.158+0000 7fc2077fe640 1 -- 172.21.15.63:0/986355269 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc208108d10 msgr2=0x7fc20819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:47.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.158+0000 7fc2077fe640 1 --2- 172.21.15.63:0/986355269 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc208108d10 0x7fc20819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.158+0000 7fc2077fe640 1 -- 172.21.15.63:0/986355269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2081a0430 con 0x7fc208102a80 2024-09-21T06:29:47.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.158+0000 7fc2077fe640 1 --2- 172.21.15.63:0/986355269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc208102a80 0x7fc20819a4c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc1f800d950 tx=0x7fc1f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:47.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.158+0000 7fc204ff9640 1 -- 172.21.15.63:0/986355269 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8017030 con 0x7fc208102a80 2024-09-21T06:29:47.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.158+0000 7fc20dd0e640 1 -- 172.21.15.63:0/986355269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2081a0720 con 0x7fc208102a80 2024-09-21T06:29:47.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.158+0000 7fc204ff9640 1 -- 172.21.15.63:0/986355269 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1f8004020 con 0x7fc208102a80 2024-09-21T06:29:47.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.158+0000 7fc204ff9640 1 -- 172.21.15.63:0/986355269 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f80047a0 con 0x7fc208102a80 2024-09-21T06:29:47.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.158+0000 7fc20dd0e640 1 -- 172.21.15.63:0/986355269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2081a6e80 con 0x7fc208102a80 2024-09-21T06:29:47.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.161+0000 7fc214282740 1 Processor -- start 2024-09-21T06:29:47.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.161+0000 7fc204ff9640 1 -- 172.21.15.63:0/986355269 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fc1f8009a30 con 0x7fc208102a80 2024-09-21T06:29:47.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.161+0000 7fc214282740 1 -- start start 2024-09-21T06:29:47.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.161+0000 7fc214282740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82ef070 0x55d0d86966a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:47.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.161+0000 7fc214282740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82c61b0 0x55d0d8696be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:47.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.161+0000 7fc214282740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0d82ce390 0x55d0d8697120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:47.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.161+0000 7fc214282740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d0d860cea0 con 0x55d0d82ef070 2024-09-21T06:29:47.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.161+0000 7fc214282740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d0d85fc2d0 con 0x55d0d82ce390 2024-09-21T06:29:47.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.161+0000 7fc214282740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d0d86000e0 con 0x55d0d82c61b0 2024-09-21T06:29:47.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.161+0000 7fc207fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82ef070 0x55d0d86966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:47.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.161+0000 7fc207fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82ef070 0x55d0d86966a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60074/0 (socket says 172.21.15.63:60074) 2024-09-21T06:29:47.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.161+0000 7fc207fff640 1 -- 172.21.15.63:0/2871962549 learned_addr learned my addr 172.21.15.63:0/2871962549 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:47.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.162+0000 7fc2077fe640 1 --2- 172.21.15.63:0/2871962549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82c61b0 0x55d0d8696be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:47.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.162+0000 7fc206ffd640 1 --2- 172.21.15.63:0/2871962549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0d82ce390 0x55d0d8697120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:47.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.162+0000 7fc207fff640 1 -- 172.21.15.63:0/2871962549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82c61b0 msgr2=0x55d0d8696be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:47.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.162+0000 7fc207fff640 1 --2- 172.21.15.63:0/2871962549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82c61b0 0x55d0d8696be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.162+0000 7fc207fff640 1 -- 172.21.15.63:0/2871962549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0d82ce390 msgr2=0x55d0d8697120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:47.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.162+0000 7fc207fff640 1 --2- 172.21.15.63:0/2871962549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0d82ce390 0x55d0d8697120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.162+0000 7fc207fff640 1 -- 172.21.15.63:0/2871962549 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0d835a650 con 0x55d0d82ef070 2024-09-21T06:29:47.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.162+0000 7fc2077fe640 1 --2- 172.21.15.63:0/2871962549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82c61b0 0x55d0d8696be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:47.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.162+0000 7fc204ff9640 1 --2- 172.21.15.63:0/986355269 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc1f40b6680 0x7fc1f40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:47.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.162+0000 7fc207fff640 1 --2- 172.21.15.63:0/2871962549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82ef070 0x55d0d86966a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc200005cc0 tx=0x7fc20002f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bec57c7a33e2d1d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:47.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.162+0000 7fc2077fe640 1 --2- 172.21.15.63:0/986355269 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc1f40b6680 0x7fc1f40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:47.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.162+0000 7fc204ff9640 1 -- 172.21.15.63:0/986355269 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fc1f80e70a0 con 0x7fc208102a80 2024-09-21T06:29:47.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.162+0000 7fc1fdffb640 1 -- 172.21.15.63:0/2871962549 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200031cf0 con 0x55d0d82ef070 2024-09-21T06:29:47.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.162+0000 7fc1fdffb640 1 -- 172.21.15.63:0/2871962549 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc200036040 con 0x55d0d82ef070 2024-09-21T06:29:47.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.162+0000 7fc1fdffb640 1 -- 172.21.15.63:0/2871962549 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200004040 con 0x55d0d82ef070 2024-09-21T06:29:47.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.163+0000 7fc214282740 1 -- 172.21.15.63:0/2871962549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82ef070 msgr2=0x55d0d86966a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:47.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.163+0000 7fc2077fe640 1 --2- 172.21.15.63:0/986355269 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc1f40b6680 0x7fc1f40b8b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80e4980 tx=0x7fc1f8094040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:47.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.163+0000 7fc214282740 1 --2- 172.21.15.63:0/2871962549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82ef070 0x55d0d86966a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc200005cc0 tx=0x7fc20002f420 comp rx=0 tx=0).stop 2024-09-21T06:29:47.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.163+0000 7fc214282740 1 -- 172.21.15.63:0/2871962549 shutdown_connections 2024-09-21T06:29:47.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.163+0000 7fc214282740 1 --2- 172.21.15.63:0/2871962549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0d82ce390 0x55d0d8697120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.163+0000 7fc214282740 1 --2- 172.21.15.63:0/2871962549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82c61b0 0x55d0d8696be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.163+0000 7fc214282740 1 --2- 172.21.15.63:0/2871962549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82ef070 0x55d0d86966a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.163+0000 7fc214282740 1 -- 172.21.15.63:0/2871962549 >> 172.21.15.63:0/2871962549 conn(0x55d0d82e3460 msgr2=0x55d0d8694590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:47.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.163+0000 7fc214282740 1 -- 172.21.15.63:0/2871962549 shutdown_connections 2024-09-21T06:29:47.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.163+0000 7fc214282740 1 -- 172.21.15.63:0/2871962549 wait complete. 2024-09-21T06:29:47.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.164+0000 7fc214282740 1 -- start start 2024-09-21T06:29:47.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.164+0000 7fc214282740 1 Processor -- start 2024-09-21T06:29:47.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.164+0000 7fc214282740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0d82c61b0 0x55d0d86a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:47.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc214282740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82ce390 0x55d0d86a22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:47.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc214282740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82ef070 0x55d0d86ae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:47.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc214282740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d0d845d700 con 0x55d0d82ef070 2024-09-21T06:29:47.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc214282740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d0d8597160 con 0x55d0d82c61b0 2024-09-21T06:29:47.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc214282740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d0d86a4e20 con 0x55d0d82ce390 2024-09-21T06:29:47.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc214282740 10 client.0 _ll_register_callbacks cb 0x55d0d85b09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:47.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc207fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82ef070 0x55d0d86ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:47.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc207fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82ef070 0x55d0d86ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60090/0 (socket says 172.21.15.63:60090) 2024-09-21T06:29:47.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc207fff640 1 -- 172.21.15.63:0/3989069770 learned_addr learned my addr 172.21.15.63:0/3989069770 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:47.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc207fff640 1 --2- 172.21.15.63:0/3989069770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0d82c61b0 0x55d0d86a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:47.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc206ffd640 1 --2- 172.21.15.63:0/3989069770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82ce390 0x55d0d86a22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:47.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc207fff640 1 -- 172.21.15.63:0/3989069770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82ce390 msgr2=0x55d0d86a22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:47.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc207fff640 1 --2- 172.21.15.63:0/3989069770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82ce390 0x55d0d86a22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc207fff640 1 -- 172.21.15.63:0/3989069770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0d82c61b0 msgr2=0x55d0d86a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:47.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc207fff640 1 --2- 172.21.15.63:0/3989069770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0d82c61b0 0x55d0d86a1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc207fff640 1 -- 172.21.15.63:0/3989069770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0d85c4c90 con 0x55d0d82ef070 2024-09-21T06:29:47.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc206ffd640 1 --2- 172.21.15.63:0/3989069770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82ce390 0x55d0d86a22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:47.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc207fff640 1 --2- 172.21.15.63:0/3989069770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82ef070 0x55d0d86ae110 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc200003cb0 tx=0x7fc20003e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908b1ca577e15826 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:47.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc1e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:47.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc1e6ffd640 1 -- 172.21.15.63:0/3989069770 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200058060 con 0x55d0d82ef070 2024-09-21T06:29:47.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.165+0000 7fc1e6ffd640 1 -- 172.21.15.63:0/3989069770 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fc200031cf0 con 0x55d0d82ef070 2024-09-21T06:29:47.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.166+0000 7fc214282740 1 -- 172.21.15.63:0/3989069770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc200036040 con 0x55d0d82ef070 2024-09-21T06:29:47.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.166+0000 7fc1e6ffd640 1 -- 172.21.15.63:0/3989069770 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc200031450 con 0x55d0d82ef070 2024-09-21T06:29:47.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.166+0000 7fc214282740 10 client.15879 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:47.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.166+0000 7fc214282740 1 -- 172.21.15.63:0/3989069770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d0d86b0b90 con 0x55d0d82ef070 2024-09-21T06:29:47.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.166+0000 7fc1e6ffd640 1 -- 172.21.15.63:0/3989069770 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc200036040 con 0x55d0d82ef070 2024-09-21T06:29:47.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.166+0000 7fc1e6ffd640 1 -- 172.21.15.63:0/3989069770 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc200050070 con 0x55d0d82ef070 2024-09-21T06:29:47.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.166+0000 7fc214282740 10 client.15879 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:47.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.166+0000 7fc214282740 10 client.15879 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:29:47.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.166+0000 7fc214282740 20 client.15879 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:47.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.166+0000 7fc214282740 1 --2- 172.21.15.63:0/3989069770 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d0d82ad9f0 0x55d0d86b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:47.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.166+0000 7fc214282740 4 client.15879 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:47.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.166+0000 7fc214282740 1 -- 172.21.15.63:0/3989069770 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0d860edf0 con 0x55d0d82ad9f0 2024-09-21T06:29:47.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.166+0000 7fc206ffd640 1 --2- 172.21.15.63:0/3989069770 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d0d82ad9f0 0x55d0d86b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:47.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.167+0000 7fc1e6ffd640 10 client.15879 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:29:47.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.167+0000 7fc206ffd640 1 --2- 172.21.15.63:0/3989069770 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d0d82ad9f0 0x55d0d86b3ef0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=453ec6f1a3f463ef server_cookie=efb84a7b9966823a in_seq=0 out_seq=0 2024-09-21T06:29:47.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.168+0000 7fc1e6ffd640 1 -- 172.21.15.63:0/3989069770 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d0d860edf0 con 0x55d0d82ad9f0 2024-09-21T06:29:47.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.168+0000 7fc1e6ffd640 10 client.15879 handle_command_reply: tid=0 2024-09-21T06:29:47.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.168+0000 7fc214282740 1 client.15879 shutdown 2024-09-21T06:29:47.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.168+0000 7fc214282740 1 -- 172.21.15.63:0/3989069770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82ef070 msgr2=0x55d0d86ae110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:47.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.168+0000 7fc214282740 1 --2- 172.21.15.63:0/3989069770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82ef070 0x55d0d86ae110 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc200003cb0 tx=0x7fc20003e040 comp rx=0 tx=0).stop 2024-09-21T06:29:47.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.168+0000 7fc214282740 1 -- 172.21.15.63:0/3989069770 shutdown_connections 2024-09-21T06:29:47.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.168+0000 7fc214282740 1 --2- 172.21.15.63:0/3989069770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82ef070 0x55d0d86ae110 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.168+0000 7fc214282740 1 --2- 172.21.15.63:0/3989069770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82ce390 0x55d0d86a22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.168+0000 7fc214282740 1 --2- 172.21.15.63:0/3989069770 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d0d82ad9f0 0x55d0d86b3ef0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.168+0000 7fc214282740 1 --2- 172.21.15.63:0/3989069770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0d82c61b0 0x55d0d86a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.168+0000 7fc214282740 1 -- 172.21.15.63:0/3989069770 >> 172.21.15.63:0/3989069770 conn(0x55d0d82e3460 msgr2=0x55d0d8699880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:47.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.168+0000 7fc1e6ffd640 0 client.15879 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:29:47.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.168+0000 7fc214282740 1 -- 172.21.15.63:0/3989069770 shutdown_connections 2024-09-21T06:29:47.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.168+0000 7fc214282740 1 -- 172.21.15.63:0/3989069770 wait complete. 2024-09-21T06:29:47.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.168+0000 7fc214282740 20 client.15879 trim_cache size 0 max 16384 2024-09-21T06:29:47.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.181+0000 7fc214282740 1 Processor -- start 2024-09-21T06:29:47.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.181+0000 7fc214282740 1 -- start start 2024-09-21T06:29:47.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.182+0000 7fc214282740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82e3460 0x55d0d86a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:47.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.182+0000 7fc214282740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82c61b0 0x55d0d869efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:47.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.182+0000 7fc214282740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0d82ce390 0x55d0d869f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:47.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.182+0000 7fc214282740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc2081af790 con 0x55d0d82c61b0 2024-09-21T06:29:47.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.182+0000 7fc214282740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc2081b12d0 con 0x55d0d82ce390 2024-09-21T06:29:47.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.182+0000 7fc214282740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc2081afe60 con 0x55d0d82e3460 2024-09-21T06:29:47.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.182+0000 7fc206ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82c61b0 0x55d0d869efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:47.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.182+0000 7fc206ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82c61b0 0x55d0d869efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60092/0 (socket says 172.21.15.63:60092) 2024-09-21T06:29:47.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.182+0000 7fc206ffd640 1 -- 172.21.15.63:0/2610886376 learned_addr learned my addr 172.21.15.63:0/2610886376 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:47.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.182+0000 7fc207fff640 1 --2- 172.21.15.63:0/2610886376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0d82ce390 0x55d0d869f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:47.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.182+0000 7fc207fff640 1 --2- 172.21.15.63:0/2610886376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82e3460 0x55d0d86a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:47.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.182+0000 7fc206ffd640 1 -- 172.21.15.63:0/2610886376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82e3460 msgr2=0x55d0d86a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:47.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.182+0000 7fc206ffd640 1 --2- 172.21.15.63:0/2610886376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82e3460 0x55d0d86a39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.182+0000 7fc206ffd640 1 -- 172.21.15.63:0/2610886376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0d82ce390 msgr2=0x55d0d869f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:47.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.182+0000 7fc206ffd640 1 --2- 172.21.15.63:0/2610886376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0d82ce390 0x55d0d869f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.182+0000 7fc206ffd640 1 -- 172.21.15.63:0/2610886376 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0d8698990 con 0x55d0d82c61b0 2024-09-21T06:29:47.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.182+0000 7fc207fff640 1 --2- 172.21.15.63:0/2610886376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82e3460 0x55d0d86a39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:47.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.182+0000 7fc206ffd640 1 --2- 172.21.15.63:0/2610886376 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82c61b0 0x55d0d869efa0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009ef0 tx=0x7fc1f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1b8a7801d3db62 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:47.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.183+0000 7fc1fd7fa640 1 -- 172.21.15.63:0/2610886376 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0003db0 con 0x55d0d82c61b0 2024-09-21T06:29:47.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.183+0000 7fc1fd7fa640 1 -- 172.21.15.63:0/2610886376 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1f00258f0 con 0x55d0d82c61b0 2024-09-21T06:29:47.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.183+0000 7fc1fd7fa640 1 -- 172.21.15.63:0/2610886376 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0010860 con 0x55d0d82c61b0 2024-09-21T06:29:47.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.183+0000 7fc214282740 1 -- 172.21.15.63:0/2610886376 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82c61b0 msgr2=0x55d0d869efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:47.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.183+0000 7fc214282740 1 --2- 172.21.15.63:0/2610886376 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82c61b0 0x55d0d869efa0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009ef0 tx=0x7fc1f00046c0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.184+0000 7fc214282740 1 -- 172.21.15.63:0/2610886376 shutdown_connections 2024-09-21T06:29:47.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.184+0000 7fc214282740 1 --2- 172.21.15.63:0/2610886376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0d82ce390 0x55d0d869f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.184+0000 7fc214282740 1 --2- 172.21.15.63:0/2610886376 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82c61b0 0x55d0d869efa0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.184+0000 7fc214282740 1 --2- 172.21.15.63:0/2610886376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82e3460 0x55d0d86a39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.184+0000 7fc214282740 1 -- 172.21.15.63:0/2610886376 >> 172.21.15.63:0/2610886376 conn(0x55d0d86a2470 msgr2=0x55d0d86a32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:47.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.184+0000 7fc214282740 1 -- 172.21.15.63:0/2610886376 shutdown_connections 2024-09-21T06:29:47.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.184+0000 7fc214282740 1 -- 172.21.15.63:0/2610886376 wait complete. 2024-09-21T06:29:47.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.184+0000 7fc214282740 1 -- start start 2024-09-21T06:29:47.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.184+0000 7fc214282740 1 Processor -- start 2024-09-21T06:29:47.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc214282740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82c61b0 0x55d0d8716a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:47.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc214282740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0d82ce390 0x55d0d8716f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:47.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc214282740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82e3460 0x55d0d8717490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:47.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc214282740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc2081b0c00 con 0x55d0d82c61b0 2024-09-21T06:29:47.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc214282740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc2081b0530 con 0x55d0d82ce390 2024-09-21T06:29:47.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc214282740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc2081ad770 con 0x55d0d82e3460 2024-09-21T06:29:47.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc214282740 10 client.0 _ll_register_callbacks cb 0x7fc200009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:47.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc207fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82c61b0 0x55d0d8716a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:47.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc207fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82c61b0 0x55d0d8716a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60100/0 (socket says 172.21.15.63:60100) 2024-09-21T06:29:47.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc207fff640 1 -- 172.21.15.63:0/1709503177 learned_addr learned my addr 172.21.15.63:0/1709503177 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:47.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc206ffd640 1 --2- 172.21.15.63:0/1709503177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0d82ce390 0x55d0d8716f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:47.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc207fff640 1 -- 172.21.15.63:0/1709503177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82e3460 msgr2=0x55d0d8717490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:47.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc207fff640 1 --2- 172.21.15.63:0/1709503177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82e3460 0x55d0d8717490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc207fff640 1 -- 172.21.15.63:0/1709503177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0d82ce390 msgr2=0x55d0d8716f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:47.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc207fff640 1 --2- 172.21.15.63:0/1709503177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0d82ce390 0x55d0d8716f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc207fff640 1 -- 172.21.15.63:0/1709503177 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0d8721b40 con 0x55d0d82c61b0 2024-09-21T06:29:47.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc207fff640 1 --2- 172.21.15.63:0/1709503177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82c61b0 0x55d0d8716a10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc20002ade0 tx=0x7fc200000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b469bf0c4372d5c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:47.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc1e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:47.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc1e6ffd640 1 -- 172.21.15.63:0/1709503177 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200058070 con 0x55d0d82c61b0 2024-09-21T06:29:47.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc1e6ffd640 1 -- 172.21.15.63:0/1709503177 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fc200004b40 con 0x55d0d82c61b0 2024-09-21T06:29:47.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.185+0000 7fc214282740 1 -- 172.21.15.63:0/1709503177 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1f00258f0 con 0x55d0d82c61b0 2024-09-21T06:29:47.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.186+0000 7fc1e6ffd640 1 -- 172.21.15.63:0/1709503177 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc200009540 con 0x55d0d82c61b0 2024-09-21T06:29:47.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.186+0000 7fc214282740 10 client.15885 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:47.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.186+0000 7fc214282740 1 -- 172.21.15.63:0/1709503177 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d0d8722dc0 con 0x55d0d82c61b0 2024-09-21T06:29:47.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.186+0000 7fc1e6ffd640 1 -- 172.21.15.63:0/1709503177 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1f00258f0 con 0x55d0d82c61b0 2024-09-21T06:29:47.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.186+0000 7fc1e6ffd640 1 -- 172.21.15.63:0/1709503177 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc200050040 con 0x55d0d82c61b0 2024-09-21T06:29:47.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.186+0000 7fc214282740 10 client.15885 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:47.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.186+0000 7fc214282740 10 client.15885 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:29:47.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.186+0000 7fc214282740 20 client.15885 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:47.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.186+0000 7fc214282740 1 --2- 172.21.15.63:0/1709503177 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d0d82ef070 0x55d0d87254b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:47.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.186+0000 7fc214282740 4 client.15885 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:29:47.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.186+0000 7fc214282740 1 -- 172.21.15.63:0/1709503177 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d0d860a8a0 con 0x55d0d82ef070 2024-09-21T06:29:47.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.186+0000 7fc206ffd640 1 --2- 172.21.15.63:0/1709503177 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d0d82ef070 0x55d0d87254b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:47.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.187+0000 7fc206ffd640 1 --2- 172.21.15.63:0/1709503177 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d0d82ef070 0x55d0d87254b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=76daf6156739e4e0 server_cookie=9c9f0866a7478ef9 in_seq=0 out_seq=0 2024-09-21T06:29:47.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.187+0000 7fc1e6ffd640 10 client.15885 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:29:47.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.187+0000 7fc1e6ffd640 1 -- 172.21.15.63:0/1709503177 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d0d860a8a0 con 0x55d0d82ef070 2024-09-21T06:29:47.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.187+0000 7fc1e6ffd640 10 client.15885 handle_command_reply: tid=0 2024-09-21T06:29:47.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.187+0000 7fc214282740 1 client.15885 shutdown 2024-09-21T06:29:47.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.187+0000 7fc214282740 1 -- 172.21.15.63:0/1709503177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82c61b0 msgr2=0x55d0d8716a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:47.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.187+0000 7fc214282740 1 --2- 172.21.15.63:0/1709503177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82c61b0 0x55d0d8716a10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc20002ade0 tx=0x7fc200000f40 comp rx=0 tx=0).stop 2024-09-21T06:29:47.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.187+0000 7fc214282740 1 -- 172.21.15.63:0/1709503177 shutdown_connections 2024-09-21T06:29:47.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.187+0000 7fc214282740 1 --2- 172.21.15.63:0/1709503177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0d82e3460 0x55d0d8717490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.187+0000 7fc214282740 1 --2- 172.21.15.63:0/1709503177 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d0d82ef070 0x55d0d87254b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.187+0000 7fc214282740 1 --2- 172.21.15.63:0/1709503177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0d82ce390 0x55d0d8716f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.187+0000 7fc214282740 1 --2- 172.21.15.63:0/1709503177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0d82c61b0 0x55d0d8716a10 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.187+0000 7fc214282740 1 -- 172.21.15.63:0/1709503177 >> 172.21.15.63:0/1709503177 conn(0x55d0d86a2470 msgr2=0x55d0d86976d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:47.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.187+0000 7fc1e6ffd640 0 client.15885 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:29:47.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.188+0000 7fc214282740 1 -- 172.21.15.63:0/1709503177 shutdown_connections 2024-09-21T06:29:47.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.188+0000 7fc214282740 1 -- 172.21.15.63:0/1709503177 wait complete. 2024-09-21T06:29:47.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.188+0000 7fc214282740 20 client.15885 trim_cache size 0 max 16384 2024-09-21T06:29:47.194 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:29:47.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.188+0000 7fc20dd0e640 1 -- 172.21.15.63:0/986355269 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc1f40b6680 msgr2=0x7fc1f40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:47.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.188+0000 7fc20dd0e640 1 --2- 172.21.15.63:0/986355269 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc1f40b6680 0x7fc1f40b8b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80e4980 tx=0x7fc1f8094040 comp rx=0 tx=0).stop 2024-09-21T06:29:47.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.188+0000 7fc20dd0e640 1 -- 172.21.15.63:0/986355269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc208102a80 msgr2=0x7fc20819a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:47.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.188+0000 7fc20dd0e640 1 --2- 172.21.15.63:0/986355269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc208102a80 0x7fc20819a4c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc1f800d950 tx=0x7fc1f800de10 comp rx=0 tx=0).stop 2024-09-21T06:29:47.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.188+0000 7fc20dd0e640 1 -- 172.21.15.63:0/986355269 shutdown_connections 2024-09-21T06:29:47.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.188+0000 7fc20dd0e640 1 --2- 172.21.15.63:0/986355269 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc208108d10 0x7fc20819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.188+0000 7fc20dd0e640 1 --2- 172.21.15.63:0/986355269 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc1f40b6680 0x7fc1f40b8b90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.188+0000 7fc20dd0e640 1 --2- 172.21.15.63:0/986355269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2081083c0 0x7fc20819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.188+0000 7fc20dd0e640 1 --2- 172.21.15.63:0/986355269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc208102a80 0x7fc20819a4c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:47.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.188+0000 7fc20dd0e640 1 -- 172.21.15.63:0/986355269 >> 172.21.15.63:0/986355269 conn(0x7fc208079740 msgr2=0x7fc20806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:47.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.188+0000 7fc20dd0e640 1 -- 172.21.15.63:0/986355269 shutdown_connections 2024-09-21T06:29:47.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:47.188+0000 7fc20dd0e640 1 -- 172.21.15.63:0/986355269 wait complete. 2024-09-21T06:29:47.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:47 smithi063 ceph-mon[31150]: pgmap v369: 97 pgs: 97 active+clean; 21 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 583 KiB/s wr, 118 op/s 2024-09-21T06:29:47.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:47 smithi071 ceph-mon[34844]: pgmap v369: 97 pgs: 97 active+clean; 21 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 583 KiB/s wr, 118 op/s 2024-09-21T06:29:47.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:47 smithi175 ceph-mon[34510]: pgmap v369: 97 pgs: 97 active+clean; 21 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 583 KiB/s wr, 118 op/s 2024-09-21T06:29:47.881 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:29:48.142 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:48.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.629+0000 7fc6cea79640 1 -- 172.21.15.63:0/1452456147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6c8109df0 msgr2=0x7fc6c8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:48.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.629+0000 7fc6cea79640 1 --2- 172.21.15.63:0/1452456147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6c8109df0 0x7fc6c8110620 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0009ca0 tx=0x7fc6c002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.630+0000 7fc6cea79640 1 -- 172.21.15.63:0/1452456147 shutdown_connections 2024-09-21T06:29:48.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.630+0000 7fc6cea79640 1 --2- 172.21.15.63:0/1452456147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6c8109df0 0x7fc6c8110620 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.630+0000 7fc6cea79640 1 --2- 172.21.15.63:0/1452456147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6c81094a0 0x7fc6c81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.630+0000 7fc6cea79640 1 --2- 172.21.15.63:0/1452456147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6c8103b60 0x7fc6c8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.630+0000 7fc6cea79640 1 -- 172.21.15.63:0/1452456147 >> 172.21.15.63:0/1452456147 conn(0x7fc6c807b850 msgr2=0x7fc6c807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:48.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.630+0000 7fc6cea79640 1 -- 172.21.15.63:0/1452456147 shutdown_connections 2024-09-21T06:29:48.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.630+0000 7fc6cea79640 1 -- 172.21.15.63:0/1452456147 wait complete. 2024-09-21T06:29:48.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.630+0000 7fc6cea79640 1 Processor -- start 2024-09-21T06:29:48.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.630+0000 7fc6cea79640 1 -- start start 2024-09-21T06:29:48.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.631+0000 7fc6cea79640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6c8103b60 0x7fc6c819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:48.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.631+0000 7fc6cea79640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6c81094a0 0x7fc6c819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:48.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.631+0000 7fc6cea79640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6c8109df0 0x7fc6c819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:48.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.631+0000 7fc6cea79640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c8113ab0 con 0x7fc6c81094a0 2024-09-21T06:29:48.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.631+0000 7fc6cea79640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c8113930 con 0x7fc6c8109df0 2024-09-21T06:29:48.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.631+0000 7fc6cea79640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c8113c30 con 0x7fc6c8103b60 2024-09-21T06:29:48.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.631+0000 7fc6c7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6c81094a0 0x7fc6c819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:48.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.631+0000 7fc6c7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6c81094a0 0x7fc6c819aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60112/0 (socket says 172.21.15.63:60112) 2024-09-21T06:29:48.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.631+0000 7fc6c7fff640 1 -- 172.21.15.63:0/1275630446 learned_addr learned my addr 172.21.15.63:0/1275630446 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:48.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.631+0000 7fc6cc815640 1 --2- 172.21.15.63:0/1275630446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6c8103b60 0x7fc6c819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:48.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.631+0000 7fc6cd016640 1 --2- 172.21.15.63:0/1275630446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6c8109df0 0x7fc6c819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:48.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.631+0000 7fc6c7fff640 1 -- 172.21.15.63:0/1275630446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6c8103b60 msgr2=0x7fc6c819a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:48.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.631+0000 7fc6c7fff640 1 --2- 172.21.15.63:0/1275630446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6c8103b60 0x7fc6c819a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.631+0000 7fc6c7fff640 1 -- 172.21.15.63:0/1275630446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6c8109df0 msgr2=0x7fc6c819fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:48.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.631+0000 7fc6c7fff640 1 --2- 172.21.15.63:0/1275630446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6c8109df0 0x7fc6c819fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.631+0000 7fc6c7fff640 1 -- 172.21.15.63:0/1275630446 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c81a03d0 con 0x7fc6c81094a0 2024-09-21T06:29:48.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.631+0000 7fc6cd016640 1 --2- 172.21.15.63:0/1275630446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6c8109df0 0x7fc6c819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:48.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.631+0000 7fc6c7fff640 1 --2- 172.21.15.63:0/1275630446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6c81094a0 0x7fc6c819aa00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000d750 tx=0x7fc6b000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:48.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.632+0000 7fc6c5ffb640 1 -- 172.21.15.63:0/1275630446 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0017070 con 0x7fc6c81094a0 2024-09-21T06:29:48.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.632+0000 7fc6c5ffb640 1 -- 172.21.15.63:0/1275630446 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6b00054d0 con 0x7fc6c81094a0 2024-09-21T06:29:48.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.632+0000 7fc6cea79640 1 -- 172.21.15.63:0/1275630446 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c81a06c0 con 0x7fc6c81094a0 2024-09-21T06:29:48.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.632+0000 7fc6c5ffb640 1 -- 172.21.15.63:0/1275630446 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0004c30 con 0x7fc6c81094a0 2024-09-21T06:29:48.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.632+0000 7fc6cea79640 1 -- 172.21.15.63:0/1275630446 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c81a6e20 con 0x7fc6c81094a0 2024-09-21T06:29:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.634+0000 7fc6c5ffb640 1 -- 172.21.15.63:0/1275630446 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fc6b0004dd0 con 0x7fc6c81094a0 2024-09-21T06:29:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.634+0000 7fc6d4fed740 1 Processor -- start 2024-09-21T06:29:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.635+0000 7fc6d4fed740 1 -- start start 2024-09-21T06:29:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.635+0000 7fc6d4fed740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2aa070 0x564bee6512c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.635+0000 7fc6d4fed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee2811b0 0x564bee651800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.635+0000 7fc6d4fed740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee289390 0x564bee651d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.635+0000 7fc6d4fed740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564bee5c7ea0 con 0x564bee289390 2024-09-21T06:29:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.635+0000 7fc6d4fed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564bee5b72d0 con 0x564bee2811b0 2024-09-21T06:29:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.635+0000 7fc6d4fed740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564bee5bb0e0 con 0x564bee2aa070 2024-09-21T06:29:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.635+0000 7fc6c7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee289390 0x564bee651d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.635+0000 7fc6c7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee289390 0x564bee651d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60128/0 (socket says 172.21.15.63:60128) 2024-09-21T06:29:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.635+0000 7fc6c7fff640 1 -- 172.21.15.63:0/3008502516 learned_addr learned my addr 172.21.15.63:0/3008502516 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.635+0000 7fc6cd016640 1 --2- 172.21.15.63:0/3008502516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2aa070 0x564bee6512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.635+0000 7fc6cc815640 1 --2- 172.21.15.63:0/3008502516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee2811b0 0x564bee651800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.636+0000 7fc6c5ffb640 1 --2- 172.21.15.63:0/1275630446 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc6b40b6680 0x7fc6b40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.636+0000 7fc6c7fff640 1 -- 172.21.15.63:0/3008502516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2aa070 msgr2=0x564bee6512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.636+0000 7fc6c7fff640 1 --2- 172.21.15.63:0/3008502516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2aa070 0x564bee6512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.636+0000 7fc6c7fff640 1 -- 172.21.15.63:0/3008502516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee2811b0 msgr2=0x564bee651800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.636+0000 7fc6c7fff640 1 --2- 172.21.15.63:0/3008502516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee2811b0 0x564bee651800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.636+0000 7fc6c7fff640 1 -- 172.21.15.63:0/3008502516 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bee315650 con 0x564bee289390 2024-09-21T06:29:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.636+0000 7fc6cd016640 1 --2- 172.21.15.63:0/3008502516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2aa070 0x564bee6512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.636+0000 7fc6cd016640 1 --2- 172.21.15.63:0/1275630446 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc6b40b6680 0x7fc6b40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.636+0000 7fc6c5ffb640 1 -- 172.21.15.63:0/1275630446 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fc6b00e71b0 con 0x7fc6c81094a0 2024-09-21T06:29:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.636+0000 7fc6c7fff640 1 --2- 172.21.15.63:0/3008502516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee289390 0x564bee651d40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00e48b0 tx=0x7fc6b00ad230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1b2c25d1739b16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:48.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.636+0000 7fc6beffd640 1 -- 172.21.15.63:0/3008502516 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0020030 con 0x564bee289390 2024-09-21T06:29:48.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.636+0000 7fc6beffd640 1 -- 172.21.15.63:0/3008502516 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6b00acb50 con 0x564bee289390 2024-09-21T06:29:48.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.636+0000 7fc6beffd640 1 -- 172.21.15.63:0/3008502516 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b00ac990 con 0x564bee289390 2024-09-21T06:29:48.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.637+0000 7fc6d4fed740 1 -- 172.21.15.63:0/3008502516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee289390 msgr2=0x564bee651d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:48.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.637+0000 7fc6cd016640 1 --2- 172.21.15.63:0/1275630446 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc6b40b6680 0x7fc6b40b8b90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc6c002f500 tx=0x7fc6c00095c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:48.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.637+0000 7fc6d4fed740 1 --2- 172.21.15.63:0/3008502516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee289390 0x564bee651d40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00e48b0 tx=0x7fc6b00ad230 comp rx=0 tx=0).stop 2024-09-21T06:29:48.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.637+0000 7fc6d4fed740 1 -- 172.21.15.63:0/3008502516 shutdown_connections 2024-09-21T06:29:48.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.637+0000 7fc6d4fed740 1 --2- 172.21.15.63:0/3008502516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee289390 0x564bee651d40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.637+0000 7fc6d4fed740 1 --2- 172.21.15.63:0/3008502516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee2811b0 0x564bee651800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.637+0000 7fc6d4fed740 1 --2- 172.21.15.63:0/3008502516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2aa070 0x564bee6512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.637+0000 7fc6d4fed740 1 -- 172.21.15.63:0/3008502516 >> 172.21.15.63:0/3008502516 conn(0x564bee29e460 msgr2=0x564bee64f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.637+0000 7fc6d4fed740 1 -- 172.21.15.63:0/3008502516 shutdown_connections 2024-09-21T06:29:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.637+0000 7fc6d4fed740 1 -- 172.21.15.63:0/3008502516 wait complete. 2024-09-21T06:29:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.638+0000 7fc6d4fed740 1 -- start start 2024-09-21T06:29:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.638+0000 7fc6d4fed740 1 Processor -- start 2024-09-21T06:29:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.638+0000 7fc6d4fed740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2811b0 0x564bee65c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.638+0000 7fc6d4fed740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee289390 0x564bee65ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.638+0000 7fc6d4fed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee2aa070 0x564bee668dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.638+0000 7fc6d4fed740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564bee418700 con 0x564bee289390 2024-09-21T06:29:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.638+0000 7fc6d4fed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564bee552160 con 0x564bee2aa070 2024-09-21T06:29:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.638+0000 7fc6d4fed740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564bee65faa0 con 0x564bee2811b0 2024-09-21T06:29:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.638+0000 7fc6d4fed740 10 client.0 _ll_register_callbacks cb 0x564bee56b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.638+0000 7fc6c7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee289390 0x564bee65ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.638+0000 7fc6c7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee289390 0x564bee65ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60136/0 (socket says 172.21.15.63:60136) 2024-09-21T06:29:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.639+0000 7fc6c7fff640 1 -- 172.21.15.63:0/2943544857 learned_addr learned my addr 172.21.15.63:0/2943544857 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.639+0000 7fc6cc815640 1 --2- 172.21.15.63:0/2943544857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2811b0 0x564bee65c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.639+0000 7fc6cd016640 1 --2- 172.21.15.63:0/2943544857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee2aa070 0x564bee668dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.639+0000 7fc6c7fff640 1 -- 172.21.15.63:0/2943544857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2811b0 msgr2=0x564bee65c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.639+0000 7fc6c7fff640 1 --2- 172.21.15.63:0/2943544857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2811b0 0x564bee65c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.639+0000 7fc6c7fff640 1 -- 172.21.15.63:0/2943544857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee2aa070 msgr2=0x564bee668dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.639+0000 7fc6c7fff640 1 --2- 172.21.15.63:0/2943544857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee2aa070 0x564bee668dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.639+0000 7fc6c7fff640 1 -- 172.21.15.63:0/2943544857 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bee57fc90 con 0x564bee289390 2024-09-21T06:29:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.639+0000 7fc6cd016640 1 --2- 172.21.15.63:0/2943544857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee2aa070 0x564bee668dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.639+0000 7fc6c7fff640 1 --2- 172.21.15.63:0/2943544857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee289390 0x564bee65ce50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009f40 tx=0x7fc6b0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4801336d6ddcb4d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.639+0000 7fc6a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.639+0000 7fc6a7fff640 1 -- 172.21.15.63:0/2943544857 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0020070 con 0x564bee289390 2024-09-21T06:29:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.639+0000 7fc6a7fff640 1 -- 172.21.15.63:0/2943544857 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fc6b00a92b0 con 0x564bee289390 2024-09-21T06:29:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.639+0000 7fc6d4fed740 1 -- 172.21.15.63:0/2943544857 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6b00acb50 con 0x564bee289390 2024-09-21T06:29:48.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.639+0000 7fc6a7fff640 1 -- 172.21.15.63:0/2943544857 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc6b00ac2a0 con 0x564bee289390 2024-09-21T06:29:48.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.639+0000 7fc6d4fed740 10 client.15897 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:48.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.639+0000 7fc6d4fed740 1 -- 172.21.15.63:0/2943544857 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564bee66b780 con 0x564bee289390 2024-09-21T06:29:48.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.640+0000 7fc6a7fff640 1 -- 172.21.15.63:0/2943544857 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6b00acb50 con 0x564bee289390 2024-09-21T06:29:48.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.640+0000 7fc6a7fff640 1 -- 172.21.15.63:0/2943544857 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc6b0098190 con 0x564bee289390 2024-09-21T06:29:48.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.640+0000 7fc6d4fed740 10 client.15897 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:48.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.640+0000 7fc6d4fed740 10 client.15897 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:29:48.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.640+0000 7fc6d4fed740 20 client.15897 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:48.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.640+0000 7fc6d4fed740 1 --2- 172.21.15.63:0/2943544857 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564bee2689f0 0x564bee66eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:48.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.640+0000 7fc6d4fed740 4 client.15897 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:48.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.640+0000 7fc6d4fed740 1 -- 172.21.15.63:0/2943544857 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564bee5c9df0 con 0x564bee2689f0 2024-09-21T06:29:48.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.640+0000 7fc6cc815640 1 --2- 172.21.15.63:0/2943544857 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564bee2689f0 0x564bee66eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:48.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.641+0000 7fc6cc815640 1 --2- 172.21.15.63:0/2943544857 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564bee2689f0 0x564bee66eae0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fe7df406844bb48f server_cookie=4aeff426734d9a18 in_seq=0 out_seq=0 2024-09-21T06:29:48.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.641+0000 7fc6a7fff640 10 client.15897 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:29:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.641+0000 7fc6a7fff640 1 -- 172.21.15.63:0/2943544857 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564bee5c9df0 con 0x564bee2689f0 2024-09-21T06:29:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.641+0000 7fc6a7fff640 10 client.15897 handle_command_reply: tid=0 2024-09-21T06:29:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.642+0000 7fc6d4fed740 1 client.15897 shutdown 2024-09-21T06:29:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.642+0000 7fc6d4fed740 1 -- 172.21.15.63:0/2943544857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee289390 msgr2=0x564bee65ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.642+0000 7fc6d4fed740 1 --2- 172.21.15.63:0/2943544857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee289390 0x564bee65ce50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009f40 tx=0x7fc6b0009f90 comp rx=0 tx=0).stop 2024-09-21T06:29:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.642+0000 7fc6d4fed740 1 -- 172.21.15.63:0/2943544857 shutdown_connections 2024-09-21T06:29:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.642+0000 7fc6d4fed740 1 --2- 172.21.15.63:0/2943544857 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564bee2689f0 0x564bee66eae0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.642+0000 7fc6a7fff640 0 client.15897 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:29:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.642+0000 7fc6d4fed740 1 --2- 172.21.15.63:0/2943544857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee2aa070 0x564bee668dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.642+0000 7fc6d4fed740 1 --2- 172.21.15.63:0/2943544857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee289390 0x564bee65ce50 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.642+0000 7fc6d4fed740 1 --2- 172.21.15.63:0/2943544857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2811b0 0x564bee65c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.642+0000 7fc6d4fed740 1 -- 172.21.15.63:0/2943544857 >> 172.21.15.63:0/2943544857 conn(0x564bee29e460 msgr2=0x564bee654450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.642+0000 7fc6d4fed740 1 -- 172.21.15.63:0/2943544857 shutdown_connections 2024-09-21T06:29:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.642+0000 7fc6d4fed740 1 -- 172.21.15.63:0/2943544857 wait complete. 2024-09-21T06:29:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.642+0000 7fc6d4fed740 20 client.15897 trim_cache size 0 max 16384 2024-09-21T06:29:48.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.655+0000 7fc6d4fed740 1 Processor -- start 2024-09-21T06:29:48.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.655+0000 7fc6d4fed740 1 -- start start 2024-09-21T06:29:48.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.655+0000 7fc6d4fed740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2689f0 0x564bee65b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:48.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.655+0000 7fc6d4fed740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee2811b0 0x564bee652a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:48.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.655+0000 7fc6d4fed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee289390 0x564bee64e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:48.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.655+0000 7fc6d4fed740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c81af650 con 0x564bee2811b0 2024-09-21T06:29:48.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.655+0000 7fc6d4fed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c81b1190 con 0x564bee289390 2024-09-21T06:29:48.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.655+0000 7fc6d4fed740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c81afd20 con 0x564bee2689f0 2024-09-21T06:29:48.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.656+0000 7fc6c7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee2811b0 0x564bee652a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:48.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.656+0000 7fc6c7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee2811b0 0x564bee652a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60146/0 (socket says 172.21.15.63:60146) 2024-09-21T06:29:48.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.656+0000 7fc6c7fff640 1 -- 172.21.15.63:0/2004285227 learned_addr learned my addr 172.21.15.63:0/2004285227 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:48.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.656+0000 7fc6cc815640 1 --2- 172.21.15.63:0/2004285227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2689f0 0x564bee65b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:48.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.656+0000 7fc6cd016640 1 --2- 172.21.15.63:0/2004285227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee289390 0x564bee64e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:48.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.656+0000 7fc6c7fff640 1 -- 172.21.15.63:0/2004285227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2689f0 msgr2=0x564bee65b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:48.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.656+0000 7fc6c7fff640 1 --2- 172.21.15.63:0/2004285227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2689f0 0x564bee65b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.656+0000 7fc6c7fff640 1 -- 172.21.15.63:0/2004285227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee289390 msgr2=0x564bee64e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:48.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.656+0000 7fc6c7fff640 1 --2- 172.21.15.63:0/2004285227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee289390 0x564bee64e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.656+0000 7fc6c7fff640 1 -- 172.21.15.63:0/2004285227 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bee64faa0 con 0x564bee2811b0 2024-09-21T06:29:48.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.656+0000 7fc6c7fff640 1 --2- 172.21.15.63:0/2004285227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee2811b0 0x564bee652a00 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009610 tx=0x7fc6b00eaeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5f55ea308853b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:48.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.656+0000 7fc6be7fc640 1 -- 172.21.15.63:0/2004285227 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0020070 con 0x564bee2811b0 2024-09-21T06:29:48.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.656+0000 7fc6be7fc640 1 -- 172.21.15.63:0/2004285227 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6b00acb50 con 0x564bee2811b0 2024-09-21T06:29:48.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.656+0000 7fc6be7fc640 1 -- 172.21.15.63:0/2004285227 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b00ac5d0 con 0x564bee2811b0 2024-09-21T06:29:48.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.657+0000 7fc6d4fed740 1 -- 172.21.15.63:0/2004285227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee2811b0 msgr2=0x564bee652a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:48.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.657+0000 7fc6d4fed740 1 --2- 172.21.15.63:0/2004285227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee2811b0 0x564bee652a00 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009610 tx=0x7fc6b00eaeb0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.657+0000 7fc6d4fed740 1 -- 172.21.15.63:0/2004285227 shutdown_connections 2024-09-21T06:29:48.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.657+0000 7fc6d4fed740 1 --2- 172.21.15.63:0/2004285227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee289390 0x564bee64e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.657+0000 7fc6d4fed740 1 --2- 172.21.15.63:0/2004285227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee2811b0 0x564bee652a00 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.657+0000 7fc6d4fed740 1 --2- 172.21.15.63:0/2004285227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2689f0 0x564bee65b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.657+0000 7fc6d4fed740 1 -- 172.21.15.63:0/2004285227 >> 172.21.15.63:0/2004285227 conn(0x564bee29e460 msgr2=0x564bee6522f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:48.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.657+0000 7fc6d4fed740 1 -- 172.21.15.63:0/2004285227 shutdown_connections 2024-09-21T06:29:48.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.657+0000 7fc6d4fed740 1 -- 172.21.15.63:0/2004285227 wait complete. 2024-09-21T06:29:48.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.657+0000 7fc6d4fed740 1 -- start start 2024-09-21T06:29:48.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.658+0000 7fc6d4fed740 1 Processor -- start 2024-09-21T06:29:48.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.658+0000 7fc6d4fed740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2689f0 0x564bee66f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:48.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.658+0000 7fc6d4fed740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee2811b0 0x564bee66fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:48.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.658+0000 7fc6d4fed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee289390 0x564bee6d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:48.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.658+0000 7fc6d4fed740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c81b0ac0 con 0x564bee2811b0 2024-09-21T06:29:48.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.658+0000 7fc6d4fed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c81b03f0 con 0x564bee289390 2024-09-21T06:29:48.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.658+0000 7fc6d4fed740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c81ad630 con 0x564bee2689f0 2024-09-21T06:29:48.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.658+0000 7fc6c7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee2811b0 0x564bee66fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:48.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.658+0000 7fc6d4fed740 10 client.0 _ll_register_callbacks cb 0x7fc6b800b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:48.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.658+0000 7fc6c7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee2811b0 0x564bee66fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60152/0 (socket says 172.21.15.63:60152) 2024-09-21T06:29:48.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.658+0000 7fc6c7fff640 1 -- 172.21.15.63:0/396099883 learned_addr learned my addr 172.21.15.63:0/396099883 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:48.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.658+0000 7fc6cc815640 1 --2- 172.21.15.63:0/396099883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2689f0 0x564bee66f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:48.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.658+0000 7fc6cd016640 1 --2- 172.21.15.63:0/396099883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee289390 0x564bee6d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:48.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.658+0000 7fc6c7fff640 1 -- 172.21.15.63:0/396099883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2689f0 msgr2=0x564bee66f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:48.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.658+0000 7fc6c7fff640 1 --2- 172.21.15.63:0/396099883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2689f0 0x564bee66f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.658+0000 7fc6c7fff640 1 -- 172.21.15.63:0/396099883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee289390 msgr2=0x564bee6d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:48.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.659+0000 7fc6c7fff640 1 --2- 172.21.15.63:0/396099883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee289390 0x564bee6d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.659+0000 7fc6c7fff640 1 -- 172.21.15.63:0/396099883 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bee6d08f0 con 0x564bee2811b0 2024-09-21T06:29:48.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.659+0000 7fc6c7fff640 1 --2- 172.21.15.63:0/396099883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee2811b0 0x564bee66fbb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00a9610 tx=0x7fc6b00ead00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e2b20c2aa4449a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:48.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.659+0000 7fc6a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:48.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.659+0000 7fc6a7fff640 1 -- 172.21.15.63:0/396099883 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b00d4020 con 0x564bee2811b0 2024-09-21T06:29:48.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.659+0000 7fc6a7fff640 1 -- 172.21.15.63:0/396099883 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fc6b005c1e0 con 0x564bee2811b0 2024-09-21T06:29:48.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.659+0000 7fc6d4fed740 1 -- 172.21.15.63:0/396099883 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6b00acb50 con 0x564bee2811b0 2024-09-21T06:29:48.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.659+0000 7fc6a7fff640 1 -- 172.21.15.63:0/396099883 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc6b0020070 con 0x564bee2811b0 2024-09-21T06:29:48.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.659+0000 7fc6d4fed740 10 client.15903 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:48.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.659+0000 7fc6d4fed740 1 -- 172.21.15.63:0/396099883 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564bee6d08f0 con 0x564bee2811b0 2024-09-21T06:29:48.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.659+0000 7fc6a7fff640 1 -- 172.21.15.63:0/396099883 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6b00acb50 con 0x564bee2811b0 2024-09-21T06:29:48.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.659+0000 7fc6a7fff640 1 -- 172.21.15.63:0/396099883 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc6b00c6070 con 0x564bee2811b0 2024-09-21T06:29:48.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.660+0000 7fc6d4fed740 10 client.15903 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:48.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.660+0000 7fc6d4fed740 10 client.15903 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:29:48.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.660+0000 7fc6d4fed740 20 client.15903 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:48.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.660+0000 7fc6d4fed740 1 --2- 172.21.15.63:0/396099883 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564bee2aa070 0x564bee6db120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:48.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.660+0000 7fc6d4fed740 4 client.15903 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:29:48.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.660+0000 7fc6d4fed740 1 -- 172.21.15.63:0/396099883 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564bee5c58a0 con 0x564bee2aa070 2024-09-21T06:29:48.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.660+0000 7fc6cc815640 1 --2- 172.21.15.63:0/396099883 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564bee2aa070 0x564bee6db120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:48.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.660+0000 7fc6cc815640 1 --2- 172.21.15.63:0/396099883 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564bee2aa070 0x564bee6db120 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f20c910e65e0241c server_cookie=6f042bb0b991aca3 in_seq=0 out_seq=0 2024-09-21T06:29:48.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.660+0000 7fc6a7fff640 10 client.15903 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:29:48.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.661+0000 7fc6a7fff640 1 -- 172.21.15.63:0/396099883 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564bee5c58a0 con 0x564bee2aa070 2024-09-21T06:29:48.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.661+0000 7fc6a7fff640 10 client.15903 handle_command_reply: tid=0 2024-09-21T06:29:48.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.661+0000 7fc6d4fed740 1 client.15903 shutdown 2024-09-21T06:29:48.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.661+0000 7fc6d4fed740 1 -- 172.21.15.63:0/396099883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee2811b0 msgr2=0x564bee66fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:48.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.661+0000 7fc6d4fed740 1 --2- 172.21.15.63:0/396099883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee2811b0 0x564bee66fbb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00a9610 tx=0x7fc6b00ead00 comp rx=0 tx=0).stop 2024-09-21T06:29:48.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.661+0000 7fc6d4fed740 1 -- 172.21.15.63:0/396099883 shutdown_connections 2024-09-21T06:29:48.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.661+0000 7fc6d4fed740 1 --2- 172.21.15.63:0/396099883 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x564bee2aa070 0x564bee6db120 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.661+0000 7fc6d4fed740 1 --2- 172.21.15.63:0/396099883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bee289390 0x564bee6d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.661+0000 7fc6a7fff640 0 client.15903 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:29:48.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.661+0000 7fc6d4fed740 1 --2- 172.21.15.63:0/396099883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564bee2811b0 0x564bee66fbb0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.661+0000 7fc6d4fed740 1 --2- 172.21.15.63:0/396099883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bee2689f0 0x564bee66f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.661+0000 7fc6d4fed740 1 -- 172.21.15.63:0/396099883 >> 172.21.15.63:0/396099883 conn(0x564bee29e460 msgr2=0x564bee65e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:48.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.661+0000 7fc6d4fed740 1 -- 172.21.15.63:0/396099883 shutdown_connections 2024-09-21T06:29:48.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.661+0000 7fc6d4fed740 1 -- 172.21.15.63:0/396099883 wait complete. 2024-09-21T06:29:48.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.661+0000 7fc6d4fed740 20 client.15903 trim_cache size 0 max 16384 2024-09-21T06:29:48.668 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:29:48.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.662+0000 7fc6cea79640 1 -- 172.21.15.63:0/1275630446 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc6b40b6680 msgr2=0x7fc6b40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:48.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.662+0000 7fc6cea79640 1 --2- 172.21.15.63:0/1275630446 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc6b40b6680 0x7fc6b40b8b90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc6c002f500 tx=0x7fc6c00095c0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.662+0000 7fc6cea79640 1 -- 172.21.15.63:0/1275630446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6c81094a0 msgr2=0x7fc6c819aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:48.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.662+0000 7fc6cea79640 1 --2- 172.21.15.63:0/1275630446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6c81094a0 0x7fc6c819aa00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000d750 tx=0x7fc6b000dc10 comp rx=0 tx=0).stop 2024-09-21T06:29:48.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.662+0000 7fc6cea79640 1 -- 172.21.15.63:0/1275630446 shutdown_connections 2024-09-21T06:29:48.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.662+0000 7fc6cea79640 1 --2- 172.21.15.63:0/1275630446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6c8109df0 0x7fc6c819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.662+0000 7fc6cea79640 1 --2- 172.21.15.63:0/1275630446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6c81094a0 0x7fc6c819aa00 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.662+0000 7fc6cea79640 1 --2- 172.21.15.63:0/1275630446 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc6b40b6680 0x7fc6b40b8b90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.662+0000 7fc6cea79640 1 --2- 172.21.15.63:0/1275630446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6c8103b60 0x7fc6c819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:48.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.662+0000 7fc6cea79640 1 -- 172.21.15.63:0/1275630446 >> 172.21.15.63:0/1275630446 conn(0x7fc6c807b850 msgr2=0x7fc6c81074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:48.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.662+0000 7fc6cea79640 1 -- 172.21.15.63:0/1275630446 shutdown_connections 2024-09-21T06:29:48.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:48.662+0000 7fc6cea79640 1 -- 172.21.15.63:0/1275630446 wait complete. 2024-09-21T06:29:49.379 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:49 smithi063 ceph-mon[31150]: pgmap v370: 97 pgs: 97 active+clean; 21 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 536 KiB/s wr, 339 op/s 2024-09-21T06:29:49.380 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:29:49.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:49 smithi071 ceph-mon[34844]: pgmap v370: 97 pgs: 97 active+clean; 21 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 536 KiB/s wr, 339 op/s 2024-09-21T06:29:49.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:49 smithi175 ceph-mon[34510]: pgmap v370: 97 pgs: 97 active+clean; 21 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 536 KiB/s wr, 339 op/s 2024-09-21T06:29:49.639 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:50.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.089+0000 7fc55420a640 1 -- 172.21.15.63:0/2610633268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c102a80 msgr2=0x7fc54c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:50.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.089+0000 7fc55420a640 1 --2- 172.21.15.63:0/2610633268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c102a80 0x7fc54c102e90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc548009900 tx=0x7fc54802a410 comp rx=0 tx=0).stop 2024-09-21T06:29:50.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.089+0000 7fc55420a640 1 -- 172.21.15.63:0/2610633268 shutdown_connections 2024-09-21T06:29:50.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.089+0000 7fc55420a640 1 --2- 172.21.15.63:0/2610633268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc54c108d10 0x7fc54c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.089+0000 7fc55420a640 1 --2- 172.21.15.63:0/2610633268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc54c1083c0 0x7fc54c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.089+0000 7fc55420a640 1 --2- 172.21.15.63:0/2610633268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c102a80 0x7fc54c102e90 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.089+0000 7fc55420a640 1 -- 172.21.15.63:0/2610633268 >> 172.21.15.63:0/2610633268 conn(0x7fc54c079740 msgr2=0x7fc54c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:50.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.089+0000 7fc55420a640 1 -- 172.21.15.63:0/2610633268 shutdown_connections 2024-09-21T06:29:50.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.089+0000 7fc55420a640 1 -- 172.21.15.63:0/2610633268 wait complete. 2024-09-21T06:29:50.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.090+0000 7fc55420a640 1 Processor -- start 2024-09-21T06:29:50.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.090+0000 7fc55420a640 1 -- start start 2024-09-21T06:29:50.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.090+0000 7fc55420a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc54c102a80 0x7fc54c1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:50.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.090+0000 7fc55420a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c1083c0 0x7fc54c199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:50.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.090+0000 7fc55420a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc54c108d10 0x7fc54c19ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:50.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.090+0000 7fc55420a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c112980 con 0x7fc54c1083c0 2024-09-21T06:29:50.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.090+0000 7fc55420a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c112800 con 0x7fc54c102a80 2024-09-21T06:29:50.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.090+0000 7fc55420a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c112b00 con 0x7fc54c108d10 2024-09-21T06:29:50.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.090+0000 7fc5517a5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c1083c0 0x7fc54c199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:50.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.090+0000 7fc5517a5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c1083c0 0x7fc54c199990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60174/0 (socket says 172.21.15.63:60174) 2024-09-21T06:29:50.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.090+0000 7fc5517a5640 1 -- 172.21.15.63:0/2863447317 learned_addr learned my addr 172.21.15.63:0/2863447317 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:50.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.090+0000 7fc5527a7640 1 --2- 172.21.15.63:0/2863447317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc54c108d10 0x7fc54c19ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:50.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.091+0000 7fc551fa6640 1 --2- 172.21.15.63:0/2863447317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc54c102a80 0x7fc54c1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:50.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.091+0000 7fc5517a5640 1 -- 172.21.15.63:0/2863447317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc54c108d10 msgr2=0x7fc54c19ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:50.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.091+0000 7fc5517a5640 1 --2- 172.21.15.63:0/2863447317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc54c108d10 0x7fc54c19ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.091+0000 7fc5517a5640 1 -- 172.21.15.63:0/2863447317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc54c102a80 msgr2=0x7fc54c1993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:50.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.091+0000 7fc5517a5640 1 --2- 172.21.15.63:0/2863447317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc54c102a80 0x7fc54c1993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.091+0000 7fc5517a5640 1 -- 172.21.15.63:0/2863447317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54c19f360 con 0x7fc54c1083c0 2024-09-21T06:29:50.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.091+0000 7fc551fa6640 1 --2- 172.21.15.63:0/2863447317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc54c102a80 0x7fc54c1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:50.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.091+0000 7fc5517a5640 1 --2- 172.21.15.63:0/2863447317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c1083c0 0x7fc54c199990 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00d740 tx=0x7fc53c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:50.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.091+0000 7fc542ffd640 1 -- 172.21.15.63:0/2863447317 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c017070 con 0x7fc54c1083c0 2024-09-21T06:29:50.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.091+0000 7fc55420a640 1 -- 172.21.15.63:0/2863447317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc54c19f650 con 0x7fc54c1083c0 2024-09-21T06:29:50.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.091+0000 7fc542ffd640 1 -- 172.21.15.63:0/2863447317 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc53c00de50 con 0x7fc54c1083c0 2024-09-21T06:29:50.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.091+0000 7fc542ffd640 1 -- 172.21.15.63:0/2863447317 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c004ce0 con 0x7fc54c1083c0 2024-09-21T06:29:50.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.091+0000 7fc55420a640 1 -- 172.21.15.63:0/2863447317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc54c1a5db0 con 0x7fc54c1083c0 2024-09-21T06:29:50.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.094+0000 7fc55a77e740 1 Processor -- start 2024-09-21T06:29:50.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.094+0000 7fc55a77e740 1 -- start start 2024-09-21T06:29:50.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.094+0000 7fc55a77e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8dc070 0x564a8cc832c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:50.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.094+0000 7fc55a77e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a8c8b31b0 0x564a8cc83800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:50.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.094+0000 7fc55a77e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8bb390 0x564a8cc83d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:50.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.094+0000 7fc55a77e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564a8cbf9ea0 con 0x564a8c8dc070 2024-09-21T06:29:50.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.094+0000 7fc55a77e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564a8cbe92d0 con 0x564a8c8bb390 2024-09-21T06:29:50.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.094+0000 7fc55a77e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564a8cbed0e0 con 0x564a8c8b31b0 2024-09-21T06:29:50.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.094+0000 7fc542ffd640 1 -- 172.21.15.63:0/2863447317 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fc53c004e80 con 0x7fc54c1083c0 2024-09-21T06:29:50.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.094+0000 7fc5527a7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8dc070 0x564a8cc832c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:50.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.094+0000 7fc5527a7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8dc070 0x564a8cc832c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60186/0 (socket says 172.21.15.63:60186) 2024-09-21T06:29:50.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.094+0000 7fc5527a7640 1 -- 172.21.15.63:0/63042298 learned_addr learned my addr 172.21.15.63:0/63042298 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:50.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.094+0000 7fc551fa6640 1 --2- 172.21.15.63:0/63042298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a8c8b31b0 0x564a8cc83800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:50.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.095+0000 7fc5517a5640 1 --2- 172.21.15.63:0/63042298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8bb390 0x564a8cc83d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:50.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.095+0000 7fc5527a7640 1 -- 172.21.15.63:0/63042298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a8c8b31b0 msgr2=0x564a8cc83800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:50.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.095+0000 7fc5527a7640 1 --2- 172.21.15.63:0/63042298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a8c8b31b0 0x564a8cc83800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.095+0000 7fc5527a7640 1 -- 172.21.15.63:0/63042298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8bb390 msgr2=0x564a8cc83d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:50.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.095+0000 7fc5527a7640 1 --2- 172.21.15.63:0/63042298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8bb390 0x564a8cc83d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.095+0000 7fc5527a7640 1 -- 172.21.15.63:0/63042298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a8c947650 con 0x564a8c8dc070 2024-09-21T06:29:50.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.095+0000 7fc5517a5640 1 --2- 172.21.15.63:0/63042298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8bb390 0x564a8cc83d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:50.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.095+0000 7fc5527a7640 1 --2- 172.21.15.63:0/63042298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8dc070 0x564a8cc832c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc54400ae10 tx=0x7fc54400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6115f1784e4d6a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:50.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.095+0000 7fc542ffd640 1 --2- 172.21.15.63:0/2863447317 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc5380b6700 0x7fc5380b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:50.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.095+0000 7fc537fff640 1 -- 172.21.15.63:0/63042298 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc544003b70 con 0x564a8c8dc070 2024-09-21T06:29:50.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.095+0000 7fc537fff640 1 -- 172.21.15.63:0/63042298 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc544003d10 con 0x564a8c8dc070 2024-09-21T06:29:50.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.095+0000 7fc537fff640 1 -- 172.21.15.63:0/63042298 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5440109c0 con 0x564a8c8dc070 2024-09-21T06:29:50.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.095+0000 7fc551fa6640 1 --2- 172.21.15.63:0/2863447317 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc5380b6700 0x7fc5380b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:50.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.095+0000 7fc542ffd640 1 -- 172.21.15.63:0/2863447317 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fc53c0e7140 con 0x7fc54c1083c0 2024-09-21T06:29:50.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.096+0000 7fc55a77e740 1 -- 172.21.15.63:0/63042298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8dc070 msgr2=0x564a8cc832c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:50.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.096+0000 7fc551fa6640 1 --2- 172.21.15.63:0/2863447317 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc5380b6700 0x7fc5380b8c10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc548031440 tx=0x7fc548005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:50.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.096+0000 7fc55a77e740 1 --2- 172.21.15.63:0/63042298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8dc070 0x564a8cc832c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc54400ae10 tx=0x7fc54400f790 comp rx=0 tx=0).stop 2024-09-21T06:29:50.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.096+0000 7fc55a77e740 1 -- 172.21.15.63:0/63042298 shutdown_connections 2024-09-21T06:29:50.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.096+0000 7fc55a77e740 1 --2- 172.21.15.63:0/63042298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8bb390 0x564a8cc83d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.096+0000 7fc55a77e740 1 --2- 172.21.15.63:0/63042298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a8c8b31b0 0x564a8cc83800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.096+0000 7fc55a77e740 1 --2- 172.21.15.63:0/63042298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8dc070 0x564a8cc832c0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.096+0000 7fc55a77e740 1 -- 172.21.15.63:0/63042298 >> 172.21.15.63:0/63042298 conn(0x564a8c8d0460 msgr2=0x564a8cc811b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:50.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.096+0000 7fc55a77e740 1 -- 172.21.15.63:0/63042298 shutdown_connections 2024-09-21T06:29:50.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.096+0000 7fc55a77e740 1 -- 172.21.15.63:0/63042298 wait complete. 2024-09-21T06:29:50.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.097+0000 7fc55a77e740 1 -- start start 2024-09-21T06:29:50.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.097+0000 7fc55a77e740 1 Processor -- start 2024-09-21T06:29:50.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.097+0000 7fc55a77e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8b31b0 0x564a8cc90b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:50.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.097+0000 7fc55a77e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a8c8bb390 0x564a8cc91060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:50.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.097+0000 7fc55a77e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8dc070 0x564a8cc9cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:50.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.097+0000 7fc55a77e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564a8ca4a700 con 0x564a8c8b31b0 2024-09-21T06:29:50.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.097+0000 7fc55a77e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564a8cb84160 con 0x564a8c8dc070 2024-09-21T06:29:50.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.097+0000 7fc55a77e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564a8cc93bd0 con 0x564a8c8bb390 2024-09-21T06:29:50.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.098+0000 7fc551fa6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8b31b0 0x564a8cc90b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:50.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.098+0000 7fc55a77e740 10 client.0 _ll_register_callbacks cb 0x564a8cb9d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:50.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.098+0000 7fc551fa6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8b31b0 0x564a8cc90b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60200/0 (socket says 172.21.15.63:60200) 2024-09-21T06:29:50.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.098+0000 7fc551fa6640 1 -- 172.21.15.63:0/2440829873 learned_addr learned my addr 172.21.15.63:0/2440829873 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:50.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.098+0000 7fc5517a5640 1 --2- 172.21.15.63:0/2440829873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a8c8bb390 0x564a8cc91060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:50.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.098+0000 7fc5527a7640 1 --2- 172.21.15.63:0/2440829873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8dc070 0x564a8cc9cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:50.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.098+0000 7fc551fa6640 1 -- 172.21.15.63:0/2440829873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a8c8bb390 msgr2=0x564a8cc91060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:50.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.098+0000 7fc551fa6640 1 --2- 172.21.15.63:0/2440829873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a8c8bb390 0x564a8cc91060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.098+0000 7fc551fa6640 1 -- 172.21.15.63:0/2440829873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8dc070 msgr2=0x564a8cc9cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:50.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.098+0000 7fc551fa6640 1 --2- 172.21.15.63:0/2440829873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8dc070 0x564a8cc9cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.098+0000 7fc551fa6640 1 -- 172.21.15.63:0/2440829873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a8cbb1c90 con 0x564a8c8b31b0 2024-09-21T06:29:50.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.098+0000 7fc551fa6640 1 --2- 172.21.15.63:0/2440829873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8b31b0 0x564a8cc90b20 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc548033000 tx=0x7fc54802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532329ae867fb3d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:50.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.098+0000 7fc5357fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:50.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.098+0000 7fc5357fa640 1 -- 172.21.15.63:0/2440829873 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54804c070 con 0x564a8c8b31b0 2024-09-21T06:29:50.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.098+0000 7fc5357fa640 1 -- 172.21.15.63:0/2440829873 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fc548004250 con 0x564a8c8b31b0 2024-09-21T06:29:50.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.098+0000 7fc55a77e740 1 -- 172.21.15.63:0/2440829873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc544003d10 con 0x564a8c8b31b0 2024-09-21T06:29:50.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.099+0000 7fc5357fa640 1 -- 172.21.15.63:0/2440829873 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc548058050 con 0x564a8c8b31b0 2024-09-21T06:29:50.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.099+0000 7fc55a77e740 10 client.15915 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:50.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.099+0000 7fc55a77e740 1 -- 172.21.15.63:0/2440829873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564a8cc9f830 con 0x564a8c8b31b0 2024-09-21T06:29:50.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.099+0000 7fc5357fa640 1 -- 172.21.15.63:0/2440829873 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc544003d10 con 0x564a8c8b31b0 2024-09-21T06:29:50.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.099+0000 7fc5357fa640 1 -- 172.21.15.63:0/2440829873 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc54803c4b0 con 0x564a8c8b31b0 2024-09-21T06:29:50.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.099+0000 7fc55a77e740 10 client.15915 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:50.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.099+0000 7fc55a77e740 10 client.15915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:50.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.099+0000 7fc55a77e740 20 client.15915 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:50.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.099+0000 7fc55a77e740 1 --2- 172.21.15.63:0/2440829873 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x564a8c89a9f0 0x564a8cca2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:50.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.099+0000 7fc55a77e740 4 client.15915 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:50.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.099+0000 7fc55a77e740 1 -- 172.21.15.63:0/2440829873 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a8cbfbdf0 con 0x564a8c89a9f0 2024-09-21T06:29:50.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.099+0000 7fc5517a5640 1 --2- 172.21.15.63:0/2440829873 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x564a8c89a9f0 0x564a8cca2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:50.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.100+0000 7fc5517a5640 1 --2- 172.21.15.63:0/2440829873 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x564a8c89a9f0 0x564a8cca2dd0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7070ded242a7dbee server_cookie=dac0b7d259c94b39 in_seq=0 out_seq=0 2024-09-21T06:29:50.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.100+0000 7fc5357fa640 10 client.15915 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:50.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.101+0000 7fc5357fa640 1 -- 172.21.15.63:0/2440829873 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564a8cbfbdf0 con 0x564a8c89a9f0 2024-09-21T06:29:50.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.101+0000 7fc5357fa640 10 client.15915 handle_command_reply: tid=0 2024-09-21T06:29:50.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.101+0000 7fc55a77e740 1 client.15915 shutdown 2024-09-21T06:29:50.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.101+0000 7fc55a77e740 1 -- 172.21.15.63:0/2440829873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8b31b0 msgr2=0x564a8cc90b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:50.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.101+0000 7fc55a77e740 1 --2- 172.21.15.63:0/2440829873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8b31b0 0x564a8cc90b20 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc548033000 tx=0x7fc54802a410 comp rx=0 tx=0).stop 2024-09-21T06:29:50.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.101+0000 7fc55a77e740 1 -- 172.21.15.63:0/2440829873 shutdown_connections 2024-09-21T06:29:50.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.101+0000 7fc55a77e740 1 --2- 172.21.15.63:0/2440829873 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x564a8c89a9f0 0x564a8cca2dd0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.101+0000 7fc55a77e740 1 --2- 172.21.15.63:0/2440829873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8dc070 0x564a8cc9cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.101+0000 7fc55a77e740 1 --2- 172.21.15.63:0/2440829873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a8c8bb390 0x564a8cc91060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.101+0000 7fc5357fa640 0 client.15915 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:50.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.101+0000 7fc55a77e740 1 --2- 172.21.15.63:0/2440829873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8b31b0 0x564a8cc90b20 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.101+0000 7fc55a77e740 1 -- 172.21.15.63:0/2440829873 >> 172.21.15.63:0/2440829873 conn(0x564a8c8d0460 msgr2=0x564a8cc7f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:50.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.101+0000 7fc55a77e740 1 -- 172.21.15.63:0/2440829873 shutdown_connections 2024-09-21T06:29:50.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.101+0000 7fc55a77e740 1 -- 172.21.15.63:0/2440829873 wait complete. 2024-09-21T06:29:50.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.101+0000 7fc55a77e740 20 client.15915 trim_cache size 0 max 16384 2024-09-21T06:29:50.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.115+0000 7fc55a77e740 1 Processor -- start 2024-09-21T06:29:50.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.115+0000 7fc55a77e740 1 -- start start 2024-09-21T06:29:50.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.115+0000 7fc55a77e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8b31b0 0x564a8cc90fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:50.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.115+0000 7fc55a77e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8bb390 0x564a8cc81150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:50.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.115+0000 7fc55a77e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a8c8dc070 0x564a8cc9ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:50.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.115+0000 7fc55a77e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c1ad4c0 con 0x564a8c8bb390 2024-09-21T06:29:50.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.115+0000 7fc55a77e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c1af000 con 0x564a8c8b31b0 2024-09-21T06:29:50.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.115+0000 7fc55a77e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c1adb90 con 0x564a8c8dc070 2024-09-21T06:29:50.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.115+0000 7fc5517a5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8bb390 0x564a8cc81150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:50.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.115+0000 7fc5517a5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8bb390 0x564a8cc81150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60204/0 (socket says 172.21.15.63:60204) 2024-09-21T06:29:50.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.115+0000 7fc5517a5640 1 -- 172.21.15.63:0/2266398012 learned_addr learned my addr 172.21.15.63:0/2266398012 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:50.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.115+0000 7fc5527a7640 1 --2- 172.21.15.63:0/2266398012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a8c8dc070 0x564a8cc9ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:50.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.115+0000 7fc551fa6640 1 --2- 172.21.15.63:0/2266398012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8b31b0 0x564a8cc90fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:50.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.115+0000 7fc5517a5640 1 -- 172.21.15.63:0/2266398012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a8c8dc070 msgr2=0x564a8cc9ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:50.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.115+0000 7fc5517a5640 1 --2- 172.21.15.63:0/2266398012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a8c8dc070 0x564a8cc9ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.115+0000 7fc5517a5640 1 -- 172.21.15.63:0/2266398012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8b31b0 msgr2=0x564a8cc90fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:50.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.115+0000 7fc5517a5640 1 --2- 172.21.15.63:0/2266398012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8b31b0 0x564a8cc90fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.115+0000 7fc5517a5640 1 -- 172.21.15.63:0/2266398012 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a8cc91a50 con 0x564a8c8bb390 2024-09-21T06:29:50.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.115+0000 7fc551fa6640 1 --2- 172.21.15.63:0/2266398012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8b31b0 0x564a8cc90fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:50.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.116+0000 7fc5517a5640 1 --2- 172.21.15.63:0/2266398012 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8bb390 0x564a8cc81150 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0a9540 tx=0x7fc53c094040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b09cbfaf45517e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:50.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.116+0000 7fc5377fe640 1 -- 172.21.15.63:0/2266398012 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c020040 con 0x564a8c8bb390 2024-09-21T06:29:50.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.116+0000 7fc5377fe640 1 -- 172.21.15.63:0/2266398012 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc53c0ad670 con 0x564a8c8bb390 2024-09-21T06:29:50.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.116+0000 7fc5377fe640 1 -- 172.21.15.63:0/2266398012 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c0a91e0 con 0x564a8c8bb390 2024-09-21T06:29:50.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.116+0000 7fc55a77e740 1 -- 172.21.15.63:0/2266398012 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8bb390 msgr2=0x564a8cc81150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:50.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.116+0000 7fc55a77e740 1 --2- 172.21.15.63:0/2266398012 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8bb390 0x564a8cc81150 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0a9540 tx=0x7fc53c094040 comp rx=0 tx=0).stop 2024-09-21T06:29:50.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.117+0000 7fc55a77e740 1 -- 172.21.15.63:0/2266398012 shutdown_connections 2024-09-21T06:29:50.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.117+0000 7fc55a77e740 1 --2- 172.21.15.63:0/2266398012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a8c8dc070 0x564a8cc9ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.117+0000 7fc55a77e740 1 --2- 172.21.15.63:0/2266398012 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8bb390 0x564a8cc81150 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.117+0000 7fc55a77e740 1 --2- 172.21.15.63:0/2266398012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8b31b0 0x564a8cc90fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.117+0000 7fc55a77e740 1 -- 172.21.15.63:0/2266398012 >> 172.21.15.63:0/2266398012 conn(0x564a8c8d0460 msgr2=0x564a8cc908d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.117+0000 7fc55a77e740 1 -- 172.21.15.63:0/2266398012 shutdown_connections 2024-09-21T06:29:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.117+0000 7fc55a77e740 1 -- 172.21.15.63:0/2266398012 wait complete. 2024-09-21T06:29:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.117+0000 7fc55a77e740 1 -- start start 2024-09-21T06:29:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.117+0000 7fc55a77e740 1 Processor -- start 2024-09-21T06:29:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.118+0000 7fc55a77e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a8c8b31b0 0x564a8cc98e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.118+0000 7fc55a77e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8bb390 0x564a8cc993b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.118+0000 7fc55a77e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8dc070 0x564a8cc93e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.118+0000 7fc55a77e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c1ae930 con 0x564a8c8bb390 2024-09-21T06:29:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.118+0000 7fc55a77e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c1ae260 con 0x564a8c8dc070 2024-09-21T06:29:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.118+0000 7fc55a77e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c1ab4a0 con 0x564a8c8b31b0 2024-09-21T06:29:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.118+0000 7fc55a77e740 10 client.0 _ll_register_callbacks cb 0x7fc548040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.118+0000 7fc5517a5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8bb390 0x564a8cc993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.118+0000 7fc5517a5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8bb390 0x564a8cc993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60206/0 (socket says 172.21.15.63:60206) 2024-09-21T06:29:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.118+0000 7fc5517a5640 1 -- 172.21.15.63:0/4014146745 learned_addr learned my addr 172.21.15.63:0/4014146745 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.118+0000 7fc5527a7640 1 --2- 172.21.15.63:0/4014146745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8dc070 0x564a8cc93e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.118+0000 7fc551fa6640 1 --2- 172.21.15.63:0/4014146745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a8c8b31b0 0x564a8cc98e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.118+0000 7fc5517a5640 1 -- 172.21.15.63:0/4014146745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a8c8b31b0 msgr2=0x564a8cc98e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.118+0000 7fc5517a5640 1 --2- 172.21.15.63:0/4014146745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a8c8b31b0 0x564a8cc98e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.118+0000 7fc5517a5640 1 -- 172.21.15.63:0/4014146745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8dc070 msgr2=0x564a8cc93e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.118+0000 7fc5517a5640 1 --2- 172.21.15.63:0/4014146745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8dc070 0x564a8cc93e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.118+0000 7fc5517a5640 1 -- 172.21.15.63:0/4014146745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a8cc99aa0 con 0x564a8c8bb390 2024-09-21T06:29:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.118+0000 7fc5517a5640 1 --2- 172.21.15.63:0/4014146745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8bb390 0x564a8cc993b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0ac8e0 tx=0x7fc53c0b1b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec04165cd0a3d21d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.118+0000 7fc5357fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.118+0000 7fc5357fa640 1 -- 172.21.15.63:0/4014146745 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c020040 con 0x564a8c8bb390 2024-09-21T06:29:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.119+0000 7fc5357fa640 1 -- 172.21.15.63:0/4014146745 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fc53c0940b0 con 0x564a8c8bb390 2024-09-21T06:29:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.119+0000 7fc55a77e740 1 -- 172.21.15.63:0/4014146745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc53c0ad670 con 0x564a8c8bb390 2024-09-21T06:29:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.119+0000 7fc5357fa640 1 -- 172.21.15.63:0/4014146745 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc53c0e4cf0 con 0x564a8c8bb390 2024-09-21T06:29:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.119+0000 7fc55a77e740 10 client.15921 fetch_fsmap learned FSMap version 29 2024-09-21T06:29:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.119+0000 7fc55a77e740 1 -- 172.21.15.63:0/4014146745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564a8cd0ff10 con 0x564a8c8bb390 2024-09-21T06:29:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.119+0000 7fc5357fa640 1 -- 172.21.15.63:0/4014146745 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc53c0ad670 con 0x564a8c8bb390 2024-09-21T06:29:50.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.119+0000 7fc5357fa640 1 -- 172.21.15.63:0/4014146745 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc53c0abc40 con 0x564a8c8bb390 2024-09-21T06:29:50.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.119+0000 7fc55a77e740 10 client.15921 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:29:50.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.119+0000 7fc55a77e740 10 client.15921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:50.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.119+0000 7fc55a77e740 20 client.15921 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:50.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.119+0000 7fc55a77e740 1 --2- 172.21.15.63:0/4014146745 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x564a8c86fda0 0x564a8cd12650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:50.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.119+0000 7fc55a77e740 4 client.15921 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:29:50.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.119+0000 7fc55a77e740 1 -- 172.21.15.63:0/4014146745 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564a8cbf78a0 con 0x564a8c86fda0 2024-09-21T06:29:50.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.119+0000 7fc551fa6640 1 --2- 172.21.15.63:0/4014146745 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x564a8c86fda0 0x564a8cd12650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:50.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.120+0000 7fc551fa6640 1 --2- 172.21.15.63:0/4014146745 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x564a8c86fda0 0x564a8cd12650 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4ce18647a11e553 server_cookie=8937907698febe0c in_seq=0 out_seq=0 2024-09-21T06:29:50.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.120+0000 7fc5357fa640 10 client.15921 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:50.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.120+0000 7fc5357fa640 1 -- 172.21.15.63:0/4014146745 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564a8cbf78a0 con 0x564a8c86fda0 2024-09-21T06:29:50.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.120+0000 7fc5357fa640 10 client.15921 handle_command_reply: tid=0 2024-09-21T06:29:50.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.120+0000 7fc55a77e740 1 client.15921 shutdown 2024-09-21T06:29:50.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.120+0000 7fc55a77e740 1 -- 172.21.15.63:0/4014146745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8bb390 msgr2=0x564a8cc993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.120+0000 7fc55a77e740 1 --2- 172.21.15.63:0/4014146745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8bb390 0x564a8cc993b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0ac8e0 tx=0x7fc53c0b1b90 comp rx=0 tx=0).stop 2024-09-21T06:29:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.120+0000 7fc55a77e740 1 -- 172.21.15.63:0/4014146745 shutdown_connections 2024-09-21T06:29:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.120+0000 7fc55a77e740 1 --2- 172.21.15.63:0/4014146745 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x564a8c86fda0 0x564a8cd12650 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.120+0000 7fc55a77e740 1 --2- 172.21.15.63:0/4014146745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a8c8dc070 0x564a8cc93e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.120+0000 7fc55a77e740 1 --2- 172.21.15.63:0/4014146745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564a8c8bb390 0x564a8cc993b0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.120+0000 7fc5357fa640 0 client.15921 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.120+0000 7fc55a77e740 1 --2- 172.21.15.63:0/4014146745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a8c8b31b0 0x564a8cc98e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.120+0000 7fc55a77e740 1 -- 172.21.15.63:0/4014146745 >> 172.21.15.63:0/4014146745 conn(0x564a8c8d0460 msgr2=0x564a8cc842f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.120+0000 7fc55a77e740 1 -- 172.21.15.63:0/4014146745 shutdown_connections 2024-09-21T06:29:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.120+0000 7fc55a77e740 1 -- 172.21.15.63:0/4014146745 wait complete. 2024-09-21T06:29:50.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.121+0000 7fc55a77e740 20 client.15921 trim_cache size 0 max 16384 2024-09-21T06:29:50.127 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:29:50.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.121+0000 7fc55420a640 1 -- 172.21.15.63:0/2863447317 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc5380b6700 msgr2=0x7fc5380b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:50.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.121+0000 7fc55420a640 1 --2- 172.21.15.63:0/2863447317 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc5380b6700 0x7fc5380b8c10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc548031440 tx=0x7fc548005a20 comp rx=0 tx=0).stop 2024-09-21T06:29:50.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.121+0000 7fc55420a640 1 -- 172.21.15.63:0/2863447317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c1083c0 msgr2=0x7fc54c199990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:50.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.121+0000 7fc55420a640 1 --2- 172.21.15.63:0/2863447317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c1083c0 0x7fc54c199990 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00d740 tx=0x7fc53c00dc00 comp rx=0 tx=0).stop 2024-09-21T06:29:50.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.121+0000 7fc55420a640 1 -- 172.21.15.63:0/2863447317 shutdown_connections 2024-09-21T06:29:50.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.121+0000 7fc55420a640 1 --2- 172.21.15.63:0/2863447317 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc5380b6700 0x7fc5380b8c10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.121+0000 7fc55420a640 1 --2- 172.21.15.63:0/2863447317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc54c108d10 0x7fc54c19ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.121+0000 7fc55420a640 1 --2- 172.21.15.63:0/2863447317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c1083c0 0x7fc54c199990 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.121+0000 7fc55420a640 1 --2- 172.21.15.63:0/2863447317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc54c102a80 0x7fc54c1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.121+0000 7fc55420a640 1 -- 172.21.15.63:0/2863447317 >> 172.21.15.63:0/2863447317 conn(0x7fc54c079740 msgr2=0x7fc54c1014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.121+0000 7fc55420a640 1 -- 172.21.15.63:0/2863447317 shutdown_connections 2024-09-21T06:29:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:50.121+0000 7fc55420a640 1 -- 172.21.15.63:0/2863447317 wait complete. 2024-09-21T06:29:51.401 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:51 smithi175 ceph-mon[34510]: pgmap v371: 97 pgs: 97 active+clean; 17 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 604 KiB/s wr, 431 op/s 2024-09-21T06:29:51.503 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:51 smithi063 ceph-mon[31150]: pgmap v371: 97 pgs: 97 active+clean; 17 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 604 KiB/s wr, 431 op/s 2024-09-21T06:29:51.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:51 smithi071 ceph-mon[34844]: pgmap v371: 97 pgs: 97 active+clean; 17 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 604 KiB/s wr, 431 op/s 2024-09-21T06:29:51.907 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:29:51.908 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:29:52.160 INFO:tasks.workunit.client.0.smithi063.stderr:Updating files: 7% (322/4351) Updating files: 8% (349/4351) Updating files: 9% (392/4351) Updating files: 10% (436/4351) Updating files: 11% (479/4351) Updating files: 11% (493/4351) Updating files: 12% (523/4351) Updating files: 13% (566/4351) Updating files: 14% (610/4351) Updating files: 15% (653/4351) Updating files: 16% (697/4351) Updating files: 17% (740/4351) Updating files: 18% (784/4351) Updating files: 19% (827/4351) Updating files: 20% (871/4351) Updating files: 21% (914/4351) Updating files: 22% (958/4351) Updating files: 23% (1001/4351) Updating files: 24% (1045/4351) Updating files: 25% (1088/4351) Updating files: 26% (1132/4351) Updating files: 27% (1175/4351) Updating files: 28% (1219/4351) Updating files: 29% (1262/4351) Updating files: 29% (1303/4351) Updating files: 30% (1306/4351) Updating files: 31% (1349/4351) Updating files: 32% (1393/4351) Updating files: 33% (1436/4351) Updating files: 34% (1480/4351) Updating files: 35% (1523/4351) Updating files: 36% (1567/4351) Updating files: 37% (1610/4351) Updating files: 38% (1654/4351) Updating files: 39% (1697/4351) Updating files: 40% (1741/4351) Updating files: 41% (1784/4351) Updating files: 42% (1828/4351) Updating files: 43% (1871/4351) Updating files: 43% (1899/4351) Updating files: 44% (1915/4351) Updating files: 45% (1958/4351) Updating files: 46% (2002/4351) Updating files: 47% (2045/4351) Updating files: 48% (2089/4351) Updating files: 49% (2132/4351) Updating files: 50% (2176/4351) Updating files: 51% (2220/4351) Updating files: 52% (2263/4351) Updating files: 53% (2307/4351) Updating files: 54% (2350/4351) Updating files: 55% (2394/4351) Updating files: 56% (2437/4351) Updating files: 57% (2481/4351) Updating files: 57% (2506/4351) Updating files: 58% (2524/4351) Updating files: 59% (2568/4351) Updating files: 60% (2611/4351) Updating files: 61% (2655/4351) Updating files: 62% (2698/4351) Updating files: 63% (2742/4351) Updating files: 64% (2785/4351) Updating files: 64% (2809/4351) Updating files: 65% (2829/4351) Updating files: 66% (2872/4351) Updating files: 67% (2916/4351) Updating files: 68% (2959/4351) Updating files: 69% (3003/4351) Updating files: 69% (3040/4351) Updating files: 70% (3046/4351) Updating files: 71% (3090/4351) Updating files: 72% (3133/4351) Updating files: 73% (3177/4351) Updating files: 74% (3220/4351) Updating files: 75% (3264/4351) Updating files: 76% (3307/4351) Updating files: 77% (3351/4351) Updating files: 78% (3394/4351) Updating files: 79% (3438/4351) Updating files: 80% (3481/4351) Updating files: 81% (3525/4351) Updating files: 82% (3568/4351) Updating files: 83% (3612/4351) Updating files: 84% (3655/4351) Updating files: 85% (3699/4351) Updating files: 86% (3742/4351) Updating files: 87% (3786/4351) Updating files: 88% (3829/4351) Updating files: 88% (3854/4351) Updating files: 89% (3873/4351) Updating files: 90% (3916/4351) Updating files: 91% (3960/4351) Updating files: 92% (4003/4351) Updating files: 93% (4047/4351) Updating files: 94% (4090/4351) Updating files: 95% (4134/4351) Updating files: 96% (4177/4351) Updating files: 97% (4221/4351) Updating files: 98% (4264/4351) Updating files: 99% (4308/4351) Updating files: 100% (4351/4351) Updating files: 100% (4351/4351), done. 2024-09-21T06:29:52.169 INFO:tasks.workunit.client.0.smithi063.stderr:+ cd xfstests-dev 2024-09-21T06:29:52.170 INFO:tasks.workunit.client.0.smithi063.stderr:+ git checkout 0e5c12dfd008efc2848c98108c9237487e91ef35 2024-09-21T06:29:52.181 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:52.263 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:52 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:29:52.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:52 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:29:52.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:52 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:29:53.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.001+0000 7febda479640 1 -- 172.21.15.63:0/3580897369 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febd4105300 msgr2=0x7febd410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:53.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.001+0000 7febda479640 1 --2- 172.21.15.63:0/3580897369 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febd4105300 0x7febd410d850 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7febc8009900 tx=0x7febc802a410 comp rx=0 tx=0).stop 2024-09-21T06:29:53.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.001+0000 7febda479640 1 -- 172.21.15.63:0/3580897369 shutdown_connections 2024-09-21T06:29:53.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.001+0000 7febda479640 1 --2- 172.21.15.63:0/3580897369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febd410de10 0x7febd4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.001+0000 7febda479640 1 --2- 172.21.15.63:0/3580897369 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febd4105300 0x7febd410d850 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.001+0000 7febda479640 1 --2- 172.21.15.63:0/3580897369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febd41049b0 0x7febd4104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.001+0000 7febda479640 1 -- 172.21.15.63:0/3580897369 >> 172.21.15.63:0/3580897369 conn(0x7febd4079730 msgr2=0x7febd4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.001+0000 7febda479640 1 -- 172.21.15.63:0/3580897369 shutdown_connections 2024-09-21T06:29:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.001+0000 7febda479640 1 -- 172.21.15.63:0/3580897369 wait complete. 2024-09-21T06:29:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.001+0000 7febda479640 1 Processor -- start 2024-09-21T06:29:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.002+0000 7febda479640 1 -- start start 2024-09-21T06:29:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.002+0000 7febda479640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febd41049b0 0x7febd419c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.002+0000 7febda479640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febd4105300 0x7febd419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.002+0000 7febda479640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febd410de10 0x7febd41a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.002+0000 7febda479640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7febd4113a70 con 0x7febd4105300 2024-09-21T06:29:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.002+0000 7febda479640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7febd41138f0 con 0x7febd41049b0 2024-09-21T06:29:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.002+0000 7febda479640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7febd4113bf0 con 0x7febd410de10 2024-09-21T06:29:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.002+0000 7febd37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febd4105300 0x7febd419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.002+0000 7febd37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febd4105300 0x7febd419cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60224/0 (socket says 172.21.15.63:60224) 2024-09-21T06:29:53.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.002+0000 7febd37fe640 1 -- 172.21.15.63:0/1539659567 learned_addr learned my addr 172.21.15.63:0/1539659567 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:53.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.002+0000 7febd3fff640 1 --2- 172.21.15.63:0/1539659567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febd41049b0 0x7febd419c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:53.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.002+0000 7febd8a16640 1 --2- 172.21.15.63:0/1539659567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febd410de10 0x7febd41a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:53.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.002+0000 7febd37fe640 1 -- 172.21.15.63:0/1539659567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febd410de10 msgr2=0x7febd41a1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:53.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.002+0000 7febd37fe640 1 --2- 172.21.15.63:0/1539659567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febd410de10 0x7febd41a1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.002+0000 7febd37fe640 1 -- 172.21.15.63:0/1539659567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febd41049b0 msgr2=0x7febd419c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:53.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.002+0000 7febd37fe640 1 --2- 172.21.15.63:0/1539659567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febd41049b0 0x7febd419c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.002+0000 7febd37fe640 1 -- 172.21.15.63:0/1539659567 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd41a2670 con 0x7febd4105300 2024-09-21T06:29:53.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.002+0000 7febd8a16640 1 --2- 172.21.15.63:0/1539659567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febd410de10 0x7febd41a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:53.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.002+0000 7febd3fff640 1 --2- 172.21.15.63:0/1539659567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febd41049b0 0x7febd419c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:53.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.003+0000 7febd37fe640 1 --2- 172.21.15.63:0/1539659567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febd4105300 0x7febd419cca0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7febc8006010 tx=0x7febc8004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:53.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.003+0000 7febd17fa640 1 -- 172.21.15.63:0/1539659567 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc803f030 con 0x7febd4105300 2024-09-21T06:29:53.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.003+0000 7febd17fa640 1 -- 172.21.15.63:0/1539659567 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febc8003aa0 con 0x7febd4105300 2024-09-21T06:29:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.003+0000 7febda479640 1 -- 172.21.15.63:0/1539659567 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febd41a2900 con 0x7febd4105300 2024-09-21T06:29:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.003+0000 7febd17fa640 1 -- 172.21.15.63:0/1539659567 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8035070 con 0x7febd4105300 2024-09-21T06:29:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.003+0000 7febda479640 1 -- 172.21.15.63:0/1539659567 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febd41a90c0 con 0x7febd4105300 2024-09-21T06:29:53.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.006+0000 7febe09ed740 1 Processor -- start 2024-09-21T06:29:53.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.006+0000 7febe09ed740 1 -- start start 2024-09-21T06:29:53.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.007+0000 7febe09ed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d3b350 0x5651670e2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:53.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.007+0000 7febe09ed740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d12490 0x5651670e2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:53.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.007+0000 7febe09ed740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565166d1a670 0x5651670e2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:53.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.007+0000 7febe09ed740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x565167058e60 con 0x565166d12490 2024-09-21T06:29:53.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.007+0000 7febe09ed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x565167048290 con 0x565166d3b350 2024-09-21T06:29:53.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.007+0000 7febe09ed740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56516704c0a0 con 0x565166d1a670 2024-09-21T06:29:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.007+0000 7febd3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d12490 0x5651670e2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.007+0000 7febd3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d12490 0x5651670e2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60228/0 (socket says 172.21.15.63:60228) 2024-09-21T06:29:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.007+0000 7febd3fff640 1 -- 172.21.15.63:0/1673357524 learned_addr learned my addr 172.21.15.63:0/1673357524 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.007+0000 7febd8a16640 1 --2- 172.21.15.63:0/1673357524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d3b350 0x5651670e2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.007+0000 7febd17fa640 1 -- 172.21.15.63:0/1539659567 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7febc8042030 con 0x7febd4105300 2024-09-21T06:29:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.007+0000 7febd8a16640 1 -- 172.21.15.63:0/1673357524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565166d1a670 msgr2=0x5651670e2eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:29:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.007+0000 7febd8a16640 1 --2- 172.21.15.63:0/1673357524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565166d1a670 0x5651670e2eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.007+0000 7febd8a16640 1 -- 172.21.15.63:0/1673357524 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d12490 msgr2=0x5651670e2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.007+0000 7febd8a16640 1 --2- 172.21.15.63:0/1673357524 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d12490 0x5651670e2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.007+0000 7febd8a16640 1 -- 172.21.15.63:0/1673357524 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565166da6930 con 0x565166d3b350 2024-09-21T06:29:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.007+0000 7febd3fff640 1 --2- 172.21.15.63:0/1673357524 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d12490 0x5651670e2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.008+0000 7febd8a16640 1 --2- 172.21.15.63:0/1673357524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d3b350 0x5651670e2430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7febcc005fd0 tx=0x7febcc011bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b8f1db7b39523b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.008+0000 7febba7fc640 1 -- 172.21.15.63:0/1673357524 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febcc004d20 con 0x565166d3b350 2024-09-21T06:29:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.008+0000 7febba7fc640 1 -- 172.21.15.63:0/1673357524 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febcc00f9a0 con 0x565166d3b350 2024-09-21T06:29:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.008+0000 7febba7fc640 1 -- 172.21.15.63:0/1673357524 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febcc004450 con 0x565166d3b350 2024-09-21T06:29:53.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.008+0000 7febd17fa640 1 --2- 172.21.15.63:0/1539659567 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7febbc0b6680 0x7febbc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:53.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.008+0000 7febd3fff640 1 --2- 172.21.15.63:0/1539659567 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7febbc0b6680 0x7febbc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:53.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.008+0000 7febd17fa640 1 -- 172.21.15.63:0/1539659567 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7febc8107b30 con 0x7febd4105300 2024-09-21T06:29:53.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.009+0000 7febe09ed740 1 -- 172.21.15.63:0/1673357524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d3b350 msgr2=0x5651670e2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:53.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.009+0000 7febe09ed740 1 --2- 172.21.15.63:0/1673357524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d3b350 0x5651670e2430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7febcc005fd0 tx=0x7febcc011bf0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.009+0000 7febd3fff640 1 --2- 172.21.15.63:0/1539659567 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7febbc0b6680 0x7febbc0b8b90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x5651670e10b0 tx=0x7febc400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:53.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.009+0000 7febe09ed740 1 -- 172.21.15.63:0/1673357524 shutdown_connections 2024-09-21T06:29:53.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.009+0000 7febe09ed740 1 --2- 172.21.15.63:0/1673357524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565166d1a670 0x5651670e2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.009+0000 7febe09ed740 1 --2- 172.21.15.63:0/1673357524 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d12490 0x5651670e2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.009+0000 7febe09ed740 1 --2- 172.21.15.63:0/1673357524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d3b350 0x5651670e2430 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.009+0000 7febe09ed740 1 -- 172.21.15.63:0/1673357524 >> 172.21.15.63:0/1673357524 conn(0x565166d2f740 msgr2=0x5651670e0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:53.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.009+0000 7febe09ed740 1 -- 172.21.15.63:0/1673357524 shutdown_connections 2024-09-21T06:29:53.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.009+0000 7febe09ed740 1 -- 172.21.15.63:0/1673357524 wait complete. 2024-09-21T06:29:53.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.009+0000 7febe09ed740 1 -- start start 2024-09-21T06:29:53.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.010+0000 7febe09ed740 1 Processor -- start 2024-09-21T06:29:53.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.010+0000 7febe09ed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d12490 0x5651670ee0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:53.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.010+0000 7febe09ed740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565166d1a670 0x5651670ee5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:53.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.010+0000 7febe09ed740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d3b350 0x5651670f9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:53.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.010+0000 7febe09ed740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x565166ea9890 con 0x565166d3b350 2024-09-21T06:29:53.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.010+0000 7febe09ed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x565166fe2d40 con 0x565166d12490 2024-09-21T06:29:53.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.010+0000 7febe09ed740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5651670f0c10 con 0x565166d1a670 2024-09-21T06:29:53.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.010+0000 7febe09ed740 10 client.0 _ll_register_callbacks cb 0x565167046c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:53.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.010+0000 7febd8a16640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d3b350 0x5651670f9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:53.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.010+0000 7febd37fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565166d1a670 0x5651670ee5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:53.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.010+0000 7febd8a16640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d3b350 0x5651670f9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60244/0 (socket says 172.21.15.63:60244) 2024-09-21T06:29:53.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.010+0000 7febd3fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d12490 0x5651670ee0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:53.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.010+0000 7febd8a16640 1 -- 172.21.15.63:0/1579309339 learned_addr learned my addr 172.21.15.63:0/1579309339 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:53.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.011+0000 7febd37fe640 1 -- 172.21.15.63:0/1579309339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d12490 msgr2=0x5651670ee0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:53.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.011+0000 7febd37fe640 1 --2- 172.21.15.63:0/1579309339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d12490 0x5651670ee0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.011+0000 7febd37fe640 1 -- 172.21.15.63:0/1579309339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d3b350 msgr2=0x5651670f9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:53.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.011+0000 7febd37fe640 1 --2- 172.21.15.63:0/1579309339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d3b350 0x5651670f9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.011+0000 7febd37fe640 1 -- 172.21.15.63:0/1579309339 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651670fa4f0 con 0x565166d1a670 2024-09-21T06:29:53.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.011+0000 7febd8a16640 1 --2- 172.21.15.63:0/1579309339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d3b350 0x5651670f9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:53.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.011+0000 7febd3fff640 1 --2- 172.21.15.63:0/1579309339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d12490 0x5651670ee0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:53.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.011+0000 7febd37fe640 1 --2- 172.21.15.63:0/1579309339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565166d1a670 0x5651670ee5f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7febc81052c0 tx=0x7febc803b540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3251c244620bec37 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:53.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.011+0000 7febb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:29:53.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.011+0000 7febb37fe640 1 -- 172.21.15.63:0/1579309339 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8049040 con 0x565166d1a670 2024-09-21T06:29:53.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.011+0000 7febe09ed740 1 -- 172.21.15.63:0/1579309339 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febcc00f9a0 con 0x565166d1a670 2024-09-21T06:29:53.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.011+0000 7febb37fe640 1 -- 172.21.15.63:0/1579309339 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7febc80d7150 con 0x565166d1a670 2024-09-21T06:29:53.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.011+0000 7febb37fe640 1 -- 172.21.15.63:0/1579309339 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7febc80c9040 con 0x565166d1a670 2024-09-21T06:29:53.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.011+0000 7febe09ed740 10 client.25645 fetch_fsmap learned FSMap version 30 2024-09-21T06:29:53.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.011+0000 7febe09ed740 1 -- 172.21.15.63:0/1579309339 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5651670fce20 con 0x565166d1a670 2024-09-21T06:29:53.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.011+0000 7febb37fe640 1 -- 172.21.15.63:0/1579309339 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febcc00f9a0 con 0x565166d1a670 2024-09-21T06:29:53.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.012+0000 7febb37fe640 1 -- 172.21.15.63:0/1579309339 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7febc80d2020 con 0x565166d1a670 2024-09-21T06:29:53.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.012+0000 7febe09ed740 10 client.25645 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:29:53.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.012+0000 7febe09ed740 10 client.25645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:53.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.012+0000 7febe09ed740 20 client.25645 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:53.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.012+0000 7febe09ed740 1 --2- 172.21.15.63:0/1579309339 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x565166cf9cd0 0x565167100310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:53.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.012+0000 7febe09ed740 4 client.25645 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:53.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.012+0000 7febe09ed740 1 -- 172.21.15.63:0/1579309339 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56516705adb0 con 0x565166cf9cd0 2024-09-21T06:29:53.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.012+0000 7febd3fff640 1 --2- 172.21.15.63:0/1579309339 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x565166cf9cd0 0x565167100310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:53.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.013+0000 7febd3fff640 1 --2- 172.21.15.63:0/1579309339 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x565166cf9cd0 0x565167100310 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=151a606418f36034 server_cookie=fef364abbee2f55f in_seq=0 out_seq=0 2024-09-21T06:29:53.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.013+0000 7febb37fe640 10 client.25645 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:53.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.013+0000 7febb37fe640 1 -- 172.21.15.63:0/1579309339 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56516705adb0 con 0x565166cf9cd0 2024-09-21T06:29:53.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.013+0000 7febb37fe640 10 client.25645 handle_command_reply: tid=0 2024-09-21T06:29:53.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.013+0000 7febe09ed740 1 client.25645 shutdown 2024-09-21T06:29:53.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.013+0000 7febe09ed740 1 -- 172.21.15.63:0/1579309339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565166d1a670 msgr2=0x5651670ee5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:53.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.013+0000 7febe09ed740 1 --2- 172.21.15.63:0/1579309339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565166d1a670 0x5651670ee5f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7febc81052c0 tx=0x7febc803b540 comp rx=0 tx=0).stop 2024-09-21T06:29:53.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.013+0000 7febe09ed740 1 -- 172.21.15.63:0/1579309339 shutdown_connections 2024-09-21T06:29:53.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.013+0000 7febe09ed740 1 --2- 172.21.15.63:0/1579309339 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x565166cf9cd0 0x565167100310 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.013+0000 7febe09ed740 1 --2- 172.21.15.63:0/1579309339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d3b350 0x5651670f9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.013+0000 7febe09ed740 1 --2- 172.21.15.63:0/1579309339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565166d1a670 0x5651670ee5f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.013+0000 7febe09ed740 1 --2- 172.21.15.63:0/1579309339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d12490 0x5651670ee0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.013+0000 7febb37fe640 0 client.25645 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:53.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.014+0000 7febe09ed740 1 -- 172.21.15.63:0/1579309339 >> 172.21.15.63:0/1579309339 conn(0x565166d2f740 msgr2=0x5651670e55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:53.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.014+0000 7febe09ed740 1 -- 172.21.15.63:0/1579309339 shutdown_connections 2024-09-21T06:29:53.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.014+0000 7febe09ed740 1 -- 172.21.15.63:0/1579309339 wait complete. 2024-09-21T06:29:53.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.014+0000 7febe09ed740 20 client.25645 trim_cache size 0 max 16384 2024-09-21T06:29:53.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.032+0000 7febe09ed740 1 Processor -- start 2024-09-21T06:29:53.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.032+0000 7febe09ed740 1 -- start start 2024-09-21T06:29:53.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.032+0000 7febe09ed740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d12490 0x5651670e5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:53.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.032+0000 7febe09ed740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565166d1a670 0x5651670ed740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:53.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.032+0000 7febe09ed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d3b350 0x5651670efae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:53.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.032+0000 7febe09ed740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7febd41b1870 con 0x565166d12490 2024-09-21T06:29:53.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.032+0000 7febe09ed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7febd41b33e0 con 0x565166d3b350 2024-09-21T06:29:53.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.032+0000 7febe09ed740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7febd41b1f40 con 0x565166d1a670 2024-09-21T06:29:53.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.032+0000 7febd3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d12490 0x5651670e5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:53.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.032+0000 7febd3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d12490 0x5651670e5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60260/0 (socket says 172.21.15.63:60260) 2024-09-21T06:29:53.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.032+0000 7febd3fff640 1 -- 172.21.15.63:0/3450233405 learned_addr learned my addr 172.21.15.63:0/3450233405 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:53.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.032+0000 7febd37fe640 1 --2- 172.21.15.63:0/3450233405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565166d1a670 0x5651670ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:53.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.032+0000 7febd8a16640 1 --2- 172.21.15.63:0/3450233405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d3b350 0x5651670efae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:53.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.032+0000 7febd3fff640 1 -- 172.21.15.63:0/3450233405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565166d1a670 msgr2=0x5651670ed740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:53.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.032+0000 7febd3fff640 1 --2- 172.21.15.63:0/3450233405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565166d1a670 0x5651670ed740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.032+0000 7febd3fff640 1 -- 172.21.15.63:0/3450233405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d3b350 msgr2=0x5651670efae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:53.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.032+0000 7febd3fff640 1 --2- 172.21.15.63:0/3450233405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d3b350 0x5651670efae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.032+0000 7febd3fff640 1 -- 172.21.15.63:0/3450233405 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651670eea90 con 0x565166d12490 2024-09-21T06:29:53.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.032+0000 7febd8a16640 1 --2- 172.21.15.63:0/3450233405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d3b350 0x5651670efae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:53.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.033+0000 7febd3fff640 1 --2- 172.21.15.63:0/3450233405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d12490 0x5651670e5ba0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7febc400b5d0 tx=0x7febc4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c927c9b9855da9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:53.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.033+0000 7febb9ffb640 1 -- 172.21.15.63:0/3450233405 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc4004020 con 0x565166d12490 2024-09-21T06:29:53.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.033+0000 7febb9ffb640 1 -- 172.21.15.63:0/3450233405 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febc40041c0 con 0x565166d12490 2024-09-21T06:29:53.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.033+0000 7febb9ffb640 1 -- 172.21.15.63:0/3450233405 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc401e920 con 0x565166d12490 2024-09-21T06:29:53.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.034+0000 7febe09ed740 1 -- 172.21.15.63:0/3450233405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d12490 msgr2=0x5651670e5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:53.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.034+0000 7febe09ed740 1 --2- 172.21.15.63:0/3450233405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d12490 0x5651670e5ba0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7febc400b5d0 tx=0x7febc4019000 comp rx=0 tx=0).stop 2024-09-21T06:29:53.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.034+0000 7febe09ed740 1 -- 172.21.15.63:0/3450233405 shutdown_connections 2024-09-21T06:29:53.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.034+0000 7febe09ed740 1 --2- 172.21.15.63:0/3450233405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d3b350 0x5651670efae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.034+0000 7febe09ed740 1 --2- 172.21.15.63:0/3450233405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565166d1a670 0x5651670ed740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.034+0000 7febe09ed740 1 --2- 172.21.15.63:0/3450233405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d12490 0x5651670e5ba0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.034+0000 7febe09ed740 1 -- 172.21.15.63:0/3450233405 >> 172.21.15.63:0/3450233405 conn(0x565166d2f740 msgr2=0x5651670ef3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:53.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.034+0000 7febe09ed740 1 -- 172.21.15.63:0/3450233405 shutdown_connections 2024-09-21T06:29:53.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.034+0000 7febe09ed740 1 -- 172.21.15.63:0/3450233405 wait complete. 2024-09-21T06:29:53.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.034+0000 7febe09ed740 1 -- start start 2024-09-21T06:29:53.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.034+0000 7febe09ed740 1 Processor -- start 2024-09-21T06:29:53.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.035+0000 7febe09ed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d12490 0x5651670f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.035+0000 7febe09ed740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d1a670 0x5651670f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.035+0000 7febe09ed740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565166d3b350 0x5651670f0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.035+0000 7febe09ed740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7febd41b2ce0 con 0x565166d1a670 2024-09-21T06:29:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.035+0000 7febe09ed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7febd41b2610 con 0x565166d12490 2024-09-21T06:29:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.035+0000 7febe09ed740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7febd41af850 con 0x565166d3b350 2024-09-21T06:29:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.035+0000 7febe09ed740 10 client.0 _ll_register_callbacks cb 0x7febc8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.035+0000 7febd37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d1a670 0x5651670f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.035+0000 7febd37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d1a670 0x5651670f63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60264/0 (socket says 172.21.15.63:60264) 2024-09-21T06:29:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.035+0000 7febd37fe640 1 -- 172.21.15.63:0/2329496207 learned_addr learned my addr 172.21.15.63:0/2329496207 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.035+0000 7febd8a16640 1 --2- 172.21.15.63:0/2329496207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565166d3b350 0x5651670f0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.035+0000 7febd3fff640 1 --2- 172.21.15.63:0/2329496207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d12490 0x5651670f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.035+0000 7febd37fe640 1 -- 172.21.15.63:0/2329496207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565166d3b350 msgr2=0x5651670f0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.035+0000 7febd37fe640 1 --2- 172.21.15.63:0/2329496207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565166d3b350 0x5651670f0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.035+0000 7febd37fe640 1 -- 172.21.15.63:0/2329496207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d12490 msgr2=0x5651670f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.035+0000 7febd37fe640 1 --2- 172.21.15.63:0/2329496207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d12490 0x5651670f5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.035+0000 7febd37fe640 1 -- 172.21.15.63:0/2329496207 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651670f69f0 con 0x565166d1a670 2024-09-21T06:29:53.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.035+0000 7febd3fff640 1 --2- 172.21.15.63:0/2329496207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d12490 0x5651670f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:53.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.036+0000 7febd37fe640 1 --2- 172.21.15.63:0/2329496207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d1a670 0x5651670f63e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7febc8105370 tx=0x7febc8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01b929e840345be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:53.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.036+0000 7febb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:53.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.036+0000 7febb37fe640 1 -- 172.21.15.63:0/2329496207 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8049070 con 0x565166d1a670 2024-09-21T06:29:53.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.036+0000 7febb37fe640 1 -- 172.21.15.63:0/2329496207 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7febc80cccd0 con 0x565166d1a670 2024-09-21T06:29:53.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.036+0000 7febe09ed740 1 -- 172.21.15.63:0/2329496207 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febc40041c0 con 0x565166d1a670 2024-09-21T06:29:53.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.036+0000 7febb37fe640 1 -- 172.21.15.63:0/2329496207 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7febc80cd840 con 0x565166d1a670 2024-09-21T06:29:53.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.036+0000 7febe09ed740 10 client.15939 fetch_fsmap learned FSMap version 30 2024-09-21T06:29:53.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.036+0000 7febe09ed740 1 -- 172.21.15.63:0/2329496207 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56516716b0c0 con 0x565166d1a670 2024-09-21T06:29:53.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.036+0000 7febb37fe640 1 -- 172.21.15.63:0/2329496207 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febc40041c0 con 0x565166d1a670 2024-09-21T06:29:53.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.036+0000 7febb37fe640 1 -- 172.21.15.63:0/2329496207 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7febc803bad0 con 0x565166d1a670 2024-09-21T06:29:53.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.036+0000 7febe09ed740 10 client.15939 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:29:53.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.036+0000 7febe09ed740 10 client.15939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:53.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.036+0000 7febe09ed740 20 client.15939 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:53.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.037+0000 7febe09ed740 1 --2- 172.21.15.63:0/2329496207 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x565166ccf080 0x56516716d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:53.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.037+0000 7febe09ed740 4 client.15939 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:29:53.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.037+0000 7febe09ed740 1 -- 172.21.15.63:0/2329496207 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x565167056860 con 0x565166ccf080 2024-09-21T06:29:53.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.037+0000 7febd3fff640 1 --2- 172.21.15.63:0/2329496207 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x565166ccf080 0x56516716d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:53.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.037+0000 7febb37fe640 10 client.15939 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:53.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.037+0000 7febd3fff640 1 --2- 172.21.15.63:0/2329496207 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x565166ccf080 0x56516716d770 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e1fba3fb17c601e server_cookie=6f7e8039f6307960 in_seq=0 out_seq=0 2024-09-21T06:29:53.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.039+0000 7febb37fe640 1 -- 172.21.15.63:0/2329496207 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x565167056860 con 0x565166ccf080 2024-09-21T06:29:53.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.039+0000 7febb37fe640 10 client.15939 handle_command_reply: tid=0 2024-09-21T06:29:53.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.039+0000 7febe09ed740 1 client.15939 shutdown 2024-09-21T06:29:53.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.039+0000 7febe09ed740 1 -- 172.21.15.63:0/2329496207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d1a670 msgr2=0x5651670f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:53.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.039+0000 7febe09ed740 1 --2- 172.21.15.63:0/2329496207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d1a670 0x5651670f63e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7febc8105370 tx=0x7febc8000bc0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.040+0000 7febe09ed740 1 -- 172.21.15.63:0/2329496207 shutdown_connections 2024-09-21T06:29:53.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.040+0000 7febe09ed740 1 --2- 172.21.15.63:0/2329496207 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x565166ccf080 0x56516716d770 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.040+0000 7febb37fe640 0 client.15939 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:53.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.040+0000 7febe09ed740 1 --2- 172.21.15.63:0/2329496207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565166d3b350 0x5651670f0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.040+0000 7febe09ed740 1 --2- 172.21.15.63:0/2329496207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565166d1a670 0x5651670f63e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.040+0000 7febe09ed740 1 --2- 172.21.15.63:0/2329496207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565166d12490 0x5651670f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.040+0000 7febe09ed740 1 -- 172.21.15.63:0/2329496207 >> 172.21.15.63:0/2329496207 conn(0x565166d2f740 msgr2=0x5651670efaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:53.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.040+0000 7febe09ed740 1 -- 172.21.15.63:0/2329496207 shutdown_connections 2024-09-21T06:29:53.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.040+0000 7febe09ed740 1 -- 172.21.15.63:0/2329496207 wait complete. 2024-09-21T06:29:53.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.040+0000 7febe09ed740 20 client.15939 trim_cache size 0 max 16384 2024-09-21T06:29:53.044 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:29:53.044 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0, 2024-09-21T06:29:53.044 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_tag": "30a46b54-06ce-440f-b28c-d17bb72f208a", 2024-09-21T06:29:53.044 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": "asynchronous" 2024-09-21T06:29:53.044 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:29:53.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.040+0000 7febda479640 1 -- 172.21.15.63:0/1539659567 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7febbc0b6680 msgr2=0x7febbc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:53.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.040+0000 7febda479640 1 --2- 172.21.15.63:0/1539659567 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7febbc0b6680 0x7febbc0b8b90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x5651670e10b0 tx=0x7febc400b390 comp rx=0 tx=0).stop 2024-09-21T06:29:53.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.040+0000 7febda479640 1 -- 172.21.15.63:0/1539659567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febd4105300 msgr2=0x7febd419cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:53.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.040+0000 7febda479640 1 --2- 172.21.15.63:0/1539659567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febd4105300 0x7febd419cca0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7febc8006010 tx=0x7febc8004060 comp rx=0 tx=0).stop 2024-09-21T06:29:53.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.041+0000 7febda479640 1 -- 172.21.15.63:0/1539659567 shutdown_connections 2024-09-21T06:29:53.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.041+0000 7febda479640 1 --2- 172.21.15.63:0/1539659567 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7febbc0b6680 0x7febbc0b8b90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.041+0000 7febda479640 1 --2- 172.21.15.63:0/1539659567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febd410de10 0x7febd41a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.041+0000 7febda479640 1 --2- 172.21.15.63:0/1539659567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febd4105300 0x7febd419cca0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.041+0000 7febda479640 1 --2- 172.21.15.63:0/1539659567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febd41049b0 0x7febd419c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:53.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.041+0000 7febda479640 1 -- 172.21.15.63:0/1539659567 >> 172.21.15.63:0/1539659567 conn(0x7febd4079730 msgr2=0x7febd4100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:53.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.041+0000 7febda479640 1 -- 172.21.15.63:0/1539659567 shutdown_connections 2024-09-21T06:29:53.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:53.041+0000 7febda479640 1 -- 172.21.15.63:0/1539659567 wait complete. 2024-09-21T06:29:53.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:53 smithi063 ceph-mon[31150]: pgmap v372: 97 pgs: 97 active+clean; 17 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 572 KiB/s wr, 474 op/s 2024-09-21T06:29:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:53 smithi071 ceph-mon[34844]: pgmap v372: 97 pgs: 97 active+clean; 17 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 572 KiB/s wr, 474 op/s 2024-09-21T06:29:53.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:53 smithi175 ceph-mon[34510]: pgmap v372: 97 pgs: 97 active+clean; 17 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 572 KiB/s wr, 474 op/s 2024-09-21T06:29:53.866 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:29:54.221 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:54.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:54 smithi063 ceph-mon[31150]: scrub queued for path: / 2024-09-21T06:29:54.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:54 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:54.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:54 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:29:54.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:54 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:29:54.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:54 smithi071 ceph-mon[34844]: scrub queued for path: / 2024-09-21T06:29:54.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:54 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:54.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:54 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:29:54.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:54 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:29:54.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:54 smithi175 ceph-mon[34510]: scrub queued for path: / 2024-09-21T06:29:54.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:54 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:54.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:54 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:29:54.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:54 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:29:54.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.785+0000 7f96cd5f2640 1 -- 172.21.15.63:0/473267808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96c8102a60 msgr2=0x7f96c8102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:54.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.785+0000 7f96cd5f2640 1 --2- 172.21.15.63:0/473267808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96c8102a60 0x7f96c8102e70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f96c0009be0 tx=0x7f96c002a6c0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.785+0000 7f96cd5f2640 1 -- 172.21.15.63:0/473267808 shutdown_connections 2024-09-21T06:29:54.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.785+0000 7f96cd5f2640 1 --2- 172.21.15.63:0/473267808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96c8108cf0 0x7f96c810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.785+0000 7f96cd5f2640 1 --2- 172.21.15.63:0/473267808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96c81083a0 0x7f96c81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.785+0000 7f96cd5f2640 1 --2- 172.21.15.63:0/473267808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96c8102a60 0x7f96c8102e70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.785+0000 7f96cd5f2640 1 -- 172.21.15.63:0/473267808 >> 172.21.15.63:0/473267808 conn(0x7f96c8079730 msgr2=0x7f96c8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:54.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.785+0000 7f96cd5f2640 1 -- 172.21.15.63:0/473267808 shutdown_connections 2024-09-21T06:29:54.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.785+0000 7f96cd5f2640 1 -- 172.21.15.63:0/473267808 wait complete. 2024-09-21T06:29:54.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.786+0000 7f96cd5f2640 1 Processor -- start 2024-09-21T06:29:54.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.786+0000 7f96cd5f2640 1 -- start start 2024-09-21T06:29:54.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.786+0000 7f96cd5f2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96c8102a60 0x7f96c819c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.787+0000 7f96cd5f2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96c81083a0 0x7f96c819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.787+0000 7f96cd5f2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96c8108cf0 0x7f96c81a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.787+0000 7f96cd5f2640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8112960 con 0x7f96c81083a0 2024-09-21T06:29:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.787+0000 7f96cd5f2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81127e0 con 0x7f96c8108cf0 2024-09-21T06:29:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.787+0000 7f96cd5f2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8112ae0 con 0x7f96c8102a60 2024-09-21T06:29:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.787+0000 7f96c6ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96c8102a60 0x7f96c819c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.787+0000 7f96c6ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96c8102a60 0x7f96c819c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:38782/0 (socket says 172.21.15.63:38782) 2024-09-21T06:29:54.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.787+0000 7f96c6ffd640 1 -- 172.21.15.63:0/2655832928 learned_addr learned my addr 172.21.15.63:0/2655832928 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:54.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.787+0000 7f96c77fe640 1 --2- 172.21.15.63:0/2655832928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96c8108cf0 0x7f96c81a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:54.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.787+0000 7f96c67fc640 1 --2- 172.21.15.63:0/2655832928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96c81083a0 0x7f96c819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:54.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.788+0000 7f96c77fe640 1 -- 172.21.15.63:0/2655832928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96c8102a60 msgr2=0x7f96c819c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:54.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.788+0000 7f96c77fe640 1 --2- 172.21.15.63:0/2655832928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96c8102a60 0x7f96c819c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.788+0000 7f96c77fe640 1 -- 172.21.15.63:0/2655832928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96c81083a0 msgr2=0x7f96c819cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:54.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.788+0000 7f96c77fe640 1 --2- 172.21.15.63:0/2655832928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96c81083a0 0x7f96c819cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.788+0000 7f96c77fe640 1 -- 172.21.15.63:0/2655832928 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c81a2650 con 0x7f96c8108cf0 2024-09-21T06:29:54.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.788+0000 7f96c77fe640 1 --2- 172.21.15.63:0/2655832928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96c8108cf0 0x7f96c81a1f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f96b8005fd0 tx=0x7f96b800ed20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:54.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.788+0000 7f96affff640 1 -- 172.21.15.63:0/2655832928 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b800ccc0 con 0x7f96c8108cf0 2024-09-21T06:29:54.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.788+0000 7f96affff640 1 -- 172.21.15.63:0/2655832928 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96b80035f0 con 0x7f96c8108cf0 2024-09-21T06:29:54.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.788+0000 7f96affff640 1 -- 172.21.15.63:0/2655832928 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b800ce60 con 0x7f96c8108cf0 2024-09-21T06:29:54.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.788+0000 7f96cd5f2640 1 -- 172.21.15.63:0/2655832928 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c81a2940 con 0x7f96c8108cf0 2024-09-21T06:29:54.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.789+0000 7f96cd5f2640 1 -- 172.21.15.63:0/2655832928 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c81a90a0 con 0x7f96c8108cf0 2024-09-21T06:29:54.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.792+0000 7f96d3b66740 1 Processor -- start 2024-09-21T06:29:54.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.792+0000 7f96affff640 1 -- 172.21.15.63:0/2655832928 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f96b8004000 con 0x7f96c8108cf0 2024-09-21T06:29:54.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.792+0000 7f96d3b66740 1 -- start start 2024-09-21T06:29:54.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.793+0000 7f96d3b66740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fcc070 0x558008373270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.793+0000 7f96d3b66740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fa31b0 0x5580083737b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.793+0000 7f96d3b66740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fab390 0x558008373cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.793+0000 7f96d3b66740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5580082e9e50 con 0x558007fab390 2024-09-21T06:29:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.793+0000 7f96d3b66740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5580082d9280 con 0x558007fcc070 2024-09-21T06:29:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.793+0000 7f96d3b66740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5580082dd090 con 0x558007fa31b0 2024-09-21T06:29:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.793+0000 7f96c67fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fcc070 0x558008373270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.793+0000 7f96c67fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fcc070 0x558008373270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:44224/0 (socket says 172.21.15.63:44224) 2024-09-21T06:29:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.793+0000 7f96c67fc640 1 -- 172.21.15.63:0/1640867197 learned_addr learned my addr 172.21.15.63:0/1640867197 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.793+0000 7f96c67fc640 1 --2- 172.21.15.63:0/1640867197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fab390 0x558008373cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:54.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.793+0000 7f96c6ffd640 1 --2- 172.21.15.63:0/1640867197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fa31b0 0x5580083737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:54.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.794+0000 7f96c67fc640 1 -- 172.21.15.63:0/1640867197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fa31b0 msgr2=0x5580083737b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:54.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.794+0000 7f96c67fc640 1 --2- 172.21.15.63:0/1640867197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fa31b0 0x5580083737b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.794+0000 7f96c67fc640 1 -- 172.21.15.63:0/1640867197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fab390 msgr2=0x558008373cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:54.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.794+0000 7f96c67fc640 1 --2- 172.21.15.63:0/1640867197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fab390 0x558008373cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.794+0000 7f96c67fc640 1 -- 172.21.15.63:0/1640867197 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558008037650 con 0x558007fcc070 2024-09-21T06:29:54.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.794+0000 7f96c67fc640 1 --2- 172.21.15.63:0/1640867197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fcc070 0x558008373270 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f96bc0058c0 tx=0x7f96bc005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c2dc4fd310918bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:54.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.794+0000 7f96affff640 1 --2- 172.21.15.63:0/2655832928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f96b00b6700 0x7f96b00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:54.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.794+0000 7f96ad7fa640 1 -- 172.21.15.63:0/1640867197 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96bc023a60 con 0x558007fcc070 2024-09-21T06:29:54.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.794+0000 7f96ad7fa640 1 -- 172.21.15.63:0/1640867197 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96bc023c00 con 0x558007fcc070 2024-09-21T06:29:54.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.795+0000 7f96ad7fa640 1 -- 172.21.15.63:0/1640867197 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96bc0047a0 con 0x558007fcc070 2024-09-21T06:29:54.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.795+0000 7f96c6ffd640 1 --2- 172.21.15.63:0/2655832928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f96b00b6700 0x7f96b00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:54.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.795+0000 7f96affff640 1 -- 172.21.15.63:0/2655832928 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f96b80e7880 con 0x7f96c8108cf0 2024-09-21T06:29:54.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.796+0000 7f96d3b66740 1 -- 172.21.15.63:0/1640867197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fcc070 msgr2=0x558008373270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:54.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.796+0000 7f96c6ffd640 1 --2- 172.21.15.63:0/2655832928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f96b00b6700 0x7f96b00b8c10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f96c0009420 tx=0x7f96c0009280 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:54.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.796+0000 7f96d3b66740 1 --2- 172.21.15.63:0/1640867197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fcc070 0x558008373270 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f96bc0058c0 tx=0x7f96bc005850 comp rx=0 tx=0).stop 2024-09-21T06:29:54.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.797+0000 7f96d3b66740 1 -- 172.21.15.63:0/1640867197 shutdown_connections 2024-09-21T06:29:54.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.797+0000 7f96d3b66740 1 --2- 172.21.15.63:0/1640867197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fab390 0x558008373cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.797+0000 7f96d3b66740 1 --2- 172.21.15.63:0/1640867197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fa31b0 0x5580083737b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.797+0000 7f96d3b66740 1 --2- 172.21.15.63:0/1640867197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fcc070 0x558008373270 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.797+0000 7f96d3b66740 1 -- 172.21.15.63:0/1640867197 >> 172.21.15.63:0/1640867197 conn(0x558007fc0460 msgr2=0x558008371160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:54.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.797+0000 7f96d3b66740 1 -- 172.21.15.63:0/1640867197 shutdown_connections 2024-09-21T06:29:54.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.797+0000 7f96d3b66740 1 -- 172.21.15.63:0/1640867197 wait complete. 2024-09-21T06:29:54.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.797+0000 7f96d3b66740 1 -- start start 2024-09-21T06:29:54.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.797+0000 7f96d3b66740 1 Processor -- start 2024-09-21T06:29:54.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.798+0000 7f96d3b66740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fa31b0 0x55800837e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:54.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.798+0000 7f96d3b66740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fab390 0x55800837ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:54.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.798+0000 7f96d3b66740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fcc070 0x55800837f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:54.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.798+0000 7f96c6ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fa31b0 0x55800837e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:54.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.798+0000 7f96c77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fcc070 0x55800837f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:54.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.799+0000 7f96c6ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fa31b0 0x55800837e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:44226/0 (socket says 172.21.15.63:44226) 2024-09-21T06:29:54.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.799+0000 7f96c77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fcc070 0x55800837f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60288/0 (socket says 172.21.15.63:60288) 2024-09-21T06:29:54.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.799+0000 7f96c6ffd640 1 -- 172.21.15.63:0/1577039467 learned_addr learned my addr 172.21.15.63:0/1577039467 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:54.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.799+0000 7f96d3b66740 1 -- 172.21.15.63:0/1577039467 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55800813a700 con 0x558007fcc070 2024-09-21T06:29:54.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.799+0000 7f96d3b66740 1 -- 172.21.15.63:0/1577039467 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558008274110 con 0x558007fa31b0 2024-09-21T06:29:54.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.799+0000 7f96d3b66740 1 -- 172.21.15.63:0/1577039467 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5580083819f0 con 0x558007fab390 2024-09-21T06:29:54.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.799+0000 7f96d3b66740 10 client.0 _ll_register_callbacks cb 0x55800828d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:54.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.799+0000 7f96c67fc640 1 --2- 172.21.15.63:0/1577039467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fab390 0x55800837ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:54.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.799+0000 7f96c6ffd640 1 -- 172.21.15.63:0/1577039467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fab390 msgr2=0x55800837ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:54.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.799+0000 7f96c6ffd640 1 --2- 172.21.15.63:0/1577039467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fab390 0x55800837ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.799+0000 7f96c6ffd640 1 -- 172.21.15.63:0/1577039467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fcc070 msgr2=0x55800837f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:54.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.799+0000 7f96c6ffd640 1 --2- 172.21.15.63:0/1577039467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fcc070 0x55800837f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.799+0000 7f96c6ffd640 1 -- 172.21.15.63:0/1577039467 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580082a1c40 con 0x558007fa31b0 2024-09-21T06:29:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.799+0000 7f96c77fe640 1 --2- 172.21.15.63:0/1577039467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fcc070 0x55800837f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.799+0000 7f96c6ffd640 1 --2- 172.21.15.63:0/1577039467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fa31b0 0x55800837e8a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f96c0034040 tx=0x7f96c0009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91f43a7a2a87b685 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.799+0000 7f96aaff5640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:29:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.800+0000 7f96aaff5640 1 -- 172.21.15.63:0/1577039467 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c004f070 con 0x558007fa31b0 2024-09-21T06:29:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.800+0000 7f96d3b66740 1 -- 172.21.15.63:0/1577039467 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96bc023c00 con 0x558007fa31b0 2024-09-21T06:29:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.800+0000 7f96aaff5640 1 -- 172.21.15.63:0/1577039467 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f96c0030d80 con 0x558007fa31b0 2024-09-21T06:29:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.800+0000 7f96aaff5640 1 -- 172.21.15.63:0/1577039467 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f96c005b050 con 0x558007fa31b0 2024-09-21T06:29:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.800+0000 7f96d3b66740 10 client.25598 fetch_fsmap learned FSMap version 30 2024-09-21T06:29:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.800+0000 7f96d3b66740 1 -- 172.21.15.63:0/1577039467 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55800838d6f0 con 0x558007fa31b0 2024-09-21T06:29:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.801+0000 7f96aaff5640 1 -- 172.21.15.63:0/1577039467 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96bc023c00 con 0x558007fa31b0 2024-09-21T06:29:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.801+0000 7f96aaff5640 1 -- 172.21.15.63:0/1577039467 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f96c004b6f0 con 0x558007fa31b0 2024-09-21T06:29:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.801+0000 7f96d3b66740 10 client.25598 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:29:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.801+0000 7f96d3b66740 10 client.25598 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.801+0000 7f96d3b66740 20 client.25598 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:54.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.801+0000 7f96d3b66740 1 --2- 172.21.15.63:0/1577039467 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x558007f8a9f0 0x558008390c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:54.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.801+0000 7f96d3b66740 4 client.25598 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:54.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.801+0000 7f96d3b66740 1 -- 172.21.15.63:0/1577039467 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580082ebda0 con 0x558007f8a9f0 2024-09-21T06:29:54.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.801+0000 7f96c67fc640 1 --2- 172.21.15.63:0/1577039467 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x558007f8a9f0 0x558008390c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:54.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.801+0000 7f96aaff5640 10 client.25598 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:54.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.802+0000 7f96c67fc640 1 --2- 172.21.15.63:0/1577039467 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x558007f8a9f0 0x558008390c40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=261a5c2380c57725 server_cookie=efe1b6d957d3ef91 in_seq=0 out_seq=0 2024-09-21T06:29:54.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.806+0000 7f96aaff5640 1 -- 172.21.15.63:0/1577039467 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5580082ebda0 con 0x558007f8a9f0 2024-09-21T06:29:54.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.806+0000 7f96aaff5640 10 client.25598 handle_command_reply: tid=0 2024-09-21T06:29:54.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.806+0000 7f96d3b66740 1 client.25598 shutdown 2024-09-21T06:29:54.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.806+0000 7f96d3b66740 1 -- 172.21.15.63:0/1577039467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fa31b0 msgr2=0x55800837e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:54.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.806+0000 7f96d3b66740 1 --2- 172.21.15.63:0/1577039467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fa31b0 0x55800837e8a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f96c0034040 tx=0x7f96c0009500 comp rx=0 tx=0).stop 2024-09-21T06:29:54.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.807+0000 7f96d3b66740 1 -- 172.21.15.63:0/1577039467 shutdown_connections 2024-09-21T06:29:54.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.807+0000 7f96d3b66740 1 --2- 172.21.15.63:0/1577039467 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x558007f8a9f0 0x558008390c40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.807+0000 7f96d3b66740 1 --2- 172.21.15.63:0/1577039467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fcc070 0x55800837f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.807+0000 7f96d3b66740 1 --2- 172.21.15.63:0/1577039467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fab390 0x55800837ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.807+0000 7f96d3b66740 1 --2- 172.21.15.63:0/1577039467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fa31b0 0x55800837e8a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.807+0000 7f96d3b66740 1 -- 172.21.15.63:0/1577039467 >> 172.21.15.63:0/1577039467 conn(0x558007fc0460 msgr2=0x558008376400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:54.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.807+0000 7f96aaff5640 0 client.25598 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:54.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.807+0000 7f96d3b66740 1 -- 172.21.15.63:0/1577039467 shutdown_connections 2024-09-21T06:29:54.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.807+0000 7f96d3b66740 1 -- 172.21.15.63:0/1577039467 wait complete. 2024-09-21T06:29:54.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.807+0000 7f96d3b66740 20 client.25598 trim_cache size 0 max 16384 2024-09-21T06:29:54.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.830+0000 7f96d3b66740 1 Processor -- start 2024-09-21T06:29:54.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.830+0000 7f96d3b66740 1 -- start start 2024-09-21T06:29:54.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.831+0000 7f96d3b66740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fa31b0 0x558008374c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:54.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.831+0000 7f96d3b66740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fab390 0x5580083804d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:54.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.831+0000 7f96d3b66740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fcc070 0x558008370710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:54.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.831+0000 7f96d3b66740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81ad4f0 con 0x558007fa31b0 2024-09-21T06:29:54.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.831+0000 7f96d3b66740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81af060 con 0x558007fcc070 2024-09-21T06:29:54.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.831+0000 7f96d3b66740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81adbc0 con 0x558007fab390 2024-09-21T06:29:54.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.831+0000 7f96c77fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fcc070 0x558008370710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:54.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.831+0000 7f96c67fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fab390 0x5580083804d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:54.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.831+0000 7f96c77fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fcc070 0x558008370710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:44236/0 (socket says 172.21.15.63:44236) 2024-09-21T06:29:54.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.831+0000 7f96c67fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fab390 0x5580083804d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:38800/0 (socket says 172.21.15.63:38800) 2024-09-21T06:29:54.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.831+0000 7f96c77fe640 1 -- 172.21.15.63:0/2240226036 learned_addr learned my addr 172.21.15.63:0/2240226036 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:54.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.831+0000 7f96c6ffd640 1 --2- 172.21.15.63:0/2240226036 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fa31b0 0x558008374c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:54.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.831+0000 7f96c77fe640 1 -- 172.21.15.63:0/2240226036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fab390 msgr2=0x5580083804d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:54.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.831+0000 7f96c77fe640 1 --2- 172.21.15.63:0/2240226036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fab390 0x5580083804d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.831+0000 7f96c77fe640 1 -- 172.21.15.63:0/2240226036 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fa31b0 msgr2=0x558008374c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:54.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.831+0000 7f96c77fe640 1 --2- 172.21.15.63:0/2240226036 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fa31b0 0x558008374c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.831+0000 7f96c77fe640 1 -- 172.21.15.63:0/2240226036 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55800837fb60 con 0x558007fcc070 2024-09-21T06:29:54.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.832+0000 7f96c77fe640 1 --2- 172.21.15.63:0/2240226036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fcc070 0x558008370710 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f96b80e5610 tx=0x7f96b80acf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=505ad75f3679377b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:54.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.832+0000 7f96acff9640 1 -- 172.21.15.63:0/2240226036 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8009510 con 0x558007fcc070 2024-09-21T06:29:54.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.832+0000 7f96acff9640 1 -- 172.21.15.63:0/2240226036 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96b8094e50 con 0x558007fcc070 2024-09-21T06:29:54.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.832+0000 7f96acff9640 1 -- 172.21.15.63:0/2240226036 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b80ac3e0 con 0x558007fcc070 2024-09-21T06:29:54.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.833+0000 7f96d3b66740 1 -- 172.21.15.63:0/2240226036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fcc070 msgr2=0x558008370710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:54.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.833+0000 7f96d3b66740 1 --2- 172.21.15.63:0/2240226036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fcc070 0x558008370710 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f96b80e5610 tx=0x7f96b80acf40 comp rx=0 tx=0).stop 2024-09-21T06:29:54.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.833+0000 7f96d3b66740 1 -- 172.21.15.63:0/2240226036 shutdown_connections 2024-09-21T06:29:54.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.833+0000 7f96d3b66740 1 --2- 172.21.15.63:0/2240226036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fcc070 0x558008370710 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.833+0000 7f96d3b66740 1 --2- 172.21.15.63:0/2240226036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fab390 0x5580083804d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.833+0000 7f96d3b66740 1 --2- 172.21.15.63:0/2240226036 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fa31b0 0x558008374c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.833+0000 7f96d3b66740 1 -- 172.21.15.63:0/2240226036 >> 172.21.15.63:0/2240226036 conn(0x558007fc0460 msgr2=0x55800837fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:54.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.833+0000 7f96d3b66740 1 -- 172.21.15.63:0/2240226036 shutdown_connections 2024-09-21T06:29:54.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.834+0000 7f96d3b66740 1 -- 172.21.15.63:0/2240226036 wait complete. 2024-09-21T06:29:54.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.834+0000 7f96d3b66740 1 -- start start 2024-09-21T06:29:54.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.834+0000 7f96d3b66740 1 Processor -- start 2024-09-21T06:29:54.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.835+0000 7f96d3b66740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fa31b0 0x558008382c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:54.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.835+0000 7f96d3b66740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fab390 0x5580083831d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:54.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.835+0000 7f96d3b66740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fcc070 0x558008383710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:54.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.835+0000 7f96d3b66740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81ae960 con 0x558007fa31b0 2024-09-21T06:29:54.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.835+0000 7f96d3b66740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81ae290 con 0x558007fab390 2024-09-21T06:29:54.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.835+0000 7f96d3b66740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81ab530 con 0x558007fcc070 2024-09-21T06:29:54.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.835+0000 7f96d3b66740 10 client.0 _ll_register_callbacks cb 0x7f96bc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:54.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.835+0000 7f96c6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fa31b0 0x558008382c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:54.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.835+0000 7f96c67fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fab390 0x5580083831d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:54.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.835+0000 7f96c67fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fab390 0x5580083831d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:44242/0 (socket says 172.21.15.63:44242) 2024-09-21T06:29:54.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.835+0000 7f96c67fc640 1 -- 172.21.15.63:0/2550888824 learned_addr learned my addr 172.21.15.63:0/2550888824 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:54.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.835+0000 7f96c6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fa31b0 0x558008382c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60316/0 (socket says 172.21.15.63:60316) 2024-09-21T06:29:54.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.835+0000 7f96c77fe640 1 --2- 172.21.15.63:0/2550888824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fcc070 0x558008383710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:54.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.835+0000 7f96c6ffd640 1 -- 172.21.15.63:0/2550888824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fcc070 msgr2=0x558008383710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:54.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.835+0000 7f96c6ffd640 1 --2- 172.21.15.63:0/2550888824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fcc070 0x558008383710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.835+0000 7f96c6ffd640 1 -- 172.21.15.63:0/2550888824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fab390 msgr2=0x5580083831d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:54.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.835+0000 7f96c6ffd640 1 --2- 172.21.15.63:0/2550888824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fab390 0x5580083831d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.835+0000 7f96c6ffd640 1 -- 172.21.15.63:0/2550888824 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580083fa690 con 0x558007fa31b0 2024-09-21T06:29:54.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.835+0000 7f96c67fc640 1 --2- 172.21.15.63:0/2550888824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fab390 0x5580083831d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:54.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.836+0000 7f96c6ffd640 1 --2- 172.21.15.63:0/2550888824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fa31b0 0x558008382c90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f96c004bc80 tx=0x7f96c0030eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aee3c2fb1aa5327 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:54.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.836+0000 7f96aaff5640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:54.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.836+0000 7f96aaff5640 1 -- 172.21.15.63:0/2550888824 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c004f040 con 0x558007fa31b0 2024-09-21T06:29:54.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.836+0000 7f96aaff5640 1 -- 172.21.15.63:0/2550888824 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f96c004b860 con 0x558007fa31b0 2024-09-21T06:29:54.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.836+0000 7f96d3b66740 1 -- 172.21.15.63:0/2550888824 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96b8094e50 con 0x558007fa31b0 2024-09-21T06:29:54.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.836+0000 7f96aaff5640 1 -- 172.21.15.63:0/2550888824 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f96c006f050 con 0x558007fa31b0 2024-09-21T06:29:54.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.836+0000 7f96d3b66740 10 client.15957 fetch_fsmap learned FSMap version 30 2024-09-21T06:29:54.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.836+0000 7f96d3b66740 1 -- 172.21.15.63:0/2550888824 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5580083fb950 con 0x558007fa31b0 2024-09-21T06:29:54.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.837+0000 7f96aaff5640 1 -- 172.21.15.63:0/2550888824 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96b8094e50 con 0x558007fa31b0 2024-09-21T06:29:54.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.838+0000 7f96aaff5640 1 -- 172.21.15.63:0/2550888824 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f96c0003f70 con 0x558007fa31b0 2024-09-21T06:29:54.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.838+0000 7f96d3b66740 10 client.15957 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:29:54.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.838+0000 7f96d3b66740 10 client.15957 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:54.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.838+0000 7f96d3b66740 20 client.15957 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:54.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.838+0000 7f96d3b66740 1 --2- 172.21.15.63:0/2550888824 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x558007f5fda0 0x5580083fe170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:54.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.838+0000 7f96d3b66740 4 client.15957 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:29:54.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.838+0000 7f96d3b66740 1 -- 172.21.15.63:0/2550888824 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55800837a450 con 0x558007f5fda0 2024-09-21T06:29:54.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.838+0000 7f96c67fc640 1 --2- 172.21.15.63:0/2550888824 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x558007f5fda0 0x5580083fe170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:54.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.839+0000 7f96c67fc640 1 --2- 172.21.15.63:0/2550888824 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x558007f5fda0 0x5580083fe170 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23586b1176598f1d server_cookie=8bdc58ccaf24ab9e in_seq=0 out_seq=0 2024-09-21T06:29:54.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.839+0000 7f96aaff5640 10 client.15957 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:54.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.841+0000 7f96aaff5640 1 -- 172.21.15.63:0/2550888824 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1147 (crc 0 0 0) 0x55800837a450 con 0x558007f5fda0 2024-09-21T06:29:54.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.841+0000 7f96aaff5640 10 client.15957 handle_command_reply: tid=0 2024-09-21T06:29:54.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.841+0000 7f96d3b66740 1 client.15957 shutdown 2024-09-21T06:29:54.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.841+0000 7f96d3b66740 1 -- 172.21.15.63:0/2550888824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fa31b0 msgr2=0x558008382c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:54.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.841+0000 7f96d3b66740 1 --2- 172.21.15.63:0/2550888824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fa31b0 0x558008382c90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f96c004bc80 tx=0x7f96c0030eb0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.841+0000 7f96d3b66740 1 -- 172.21.15.63:0/2550888824 shutdown_connections 2024-09-21T06:29:54.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.841+0000 7f96d3b66740 1 --2- 172.21.15.63:0/2550888824 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x558007f5fda0 0x5580083fe170 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.841+0000 7f96d3b66740 1 --2- 172.21.15.63:0/2550888824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558007fcc070 0x558008383710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.841+0000 7f96d3b66740 1 --2- 172.21.15.63:0/2550888824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558007fab390 0x5580083831d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.841+0000 7f96d3b66740 1 --2- 172.21.15.63:0/2550888824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558007fa31b0 0x558008382c90 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.841+0000 7f96d3b66740 1 -- 172.21.15.63:0/2550888824 >> 172.21.15.63:0/2550888824 conn(0x558007fc0460 msgr2=0x558008374a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:54.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.841+0000 7f96aaff5640 0 client.15957 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:54.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.842+0000 7f96d3b66740 1 -- 172.21.15.63:0/2550888824 shutdown_connections 2024-09-21T06:29:54.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.842+0000 7f96d3b66740 1 -- 172.21.15.63:0/2550888824 wait complete. 2024-09-21T06:29:54.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.842+0000 7f96d3b66740 20 client.15957 trim_cache size 0 max 16384 2024-09-21T06:29:54.845 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:29:54.845 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "scrub active (2995 inodes in the stack)", 2024-09-21T06:29:54.845 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": { 2024-09-21T06:29:54.845 INFO:teuthology.orchestra.run.smithi063.stdout: "30a46b54-06ce-440f-b28c-d17bb72f208a": { 2024-09-21T06:29:54.845 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:29:54.846 INFO:teuthology.orchestra.run.smithi063.stdout: "tag": "30a46b54-06ce-440f-b28c-d17bb72f208a", 2024-09-21T06:29:54.846 INFO:teuthology.orchestra.run.smithi063.stdout: "options": "recursive,force" 2024-09-21T06:29:54.846 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:29:54.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:29:54.846 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:29:54.846 INFO:teuthology.orchestra.run.smithi063.stdout: "30a46b54-06ce-440f-b28c-d17bb72f208a": { 2024-09-21T06:29:54.846 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:29:53.037680+0000", 2024-09-21T06:29:54.846 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:29:54.846 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:29:54.846 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:29:54.846 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:29:54.846 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:29:54.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:29:54.846 INFO:teuthology.orchestra.run.smithi063.stdout: "99595c38-b81e-4cba-9256-e704dc084208": { 2024-09-21T06:29:54.846 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:29:07.604466+0000", 2024-09-21T06:29:54.847 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:29:54.847 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:29:54.847 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:29:54.847 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:29:54.847 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:29:54.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:29:54.847 INFO:teuthology.orchestra.run.smithi063.stdout: "e7881878-4529-4e31-87c4-bfc71bc0cbfc": { 2024-09-21T06:29:54.847 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:28:21.722259+0000", 2024-09-21T06:29:54.847 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:29:54.847 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:29:54.847 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:29:54.847 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:29:54.847 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:29:54.847 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:29:54.847 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:29:54.848 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:29:54.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.842+0000 7f96cd5f2640 1 -- 172.21.15.63:0/2655832928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f96b00b6700 msgr2=0x7f96b00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:54.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.842+0000 7f96cd5f2640 1 --2- 172.21.15.63:0/2655832928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f96b00b6700 0x7f96b00b8c10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f96c0009420 tx=0x7f96c0009280 comp rx=0 tx=0).stop 2024-09-21T06:29:54.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.842+0000 7f96cd5f2640 1 -- 172.21.15.63:0/2655832928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96c8108cf0 msgr2=0x7f96c81a1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:54.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.842+0000 7f96cd5f2640 1 --2- 172.21.15.63:0/2655832928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96c8108cf0 0x7f96c81a1f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f96b8005fd0 tx=0x7f96b800ed20 comp rx=0 tx=0).stop 2024-09-21T06:29:54.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.842+0000 7f96cd5f2640 1 -- 172.21.15.63:0/2655832928 shutdown_connections 2024-09-21T06:29:54.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.842+0000 7f96cd5f2640 1 --2- 172.21.15.63:0/2655832928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96c8108cf0 0x7f96c81a1f20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.842+0000 7f96cd5f2640 1 --2- 172.21.15.63:0/2655832928 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96c81083a0 0x7f96c819cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.842+0000 7f96cd5f2640 1 --2- 172.21.15.63:0/2655832928 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f96b00b6700 0x7f96b00b8c10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.842+0000 7f96cd5f2640 1 --2- 172.21.15.63:0/2655832928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96c8102a60 0x7f96c819c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:54.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.842+0000 7f96cd5f2640 1 -- 172.21.15.63:0/2655832928 >> 172.21.15.63:0/2655832928 conn(0x7f96c8079730 msgr2=0x7f96c806aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:54.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.843+0000 7f96cd5f2640 1 -- 172.21.15.63:0/2655832928 shutdown_connections 2024-09-21T06:29:54.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:29:54.843+0000 7f96cd5f2640 1 -- 172.21.15.63:0/2655832928 wait complete. 2024-09-21T06:29:55.505 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:55 smithi063 ceph-mon[31150]: pgmap v373: 97 pgs: 97 active+clean; 20 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 862 KiB/s wr, 497 op/s 2024-09-21T06:29:55.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:55 smithi071 ceph-mon[34844]: pgmap v373: 97 pgs: 97 active+clean; 20 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 862 KiB/s wr, 497 op/s 2024-09-21T06:29:55.551 INFO:tasks.cephfs.filesystem:scrub status for tag:30a46b54-06ce-440f-b28c-d17bb72f208a - {'path': '/', 'tag': '30a46b54-06ce-440f-b28c-d17bb72f208a', 'options': 'recursive,force'} 2024-09-21T06:29:55.598 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:55 smithi175 ceph-mon[34510]: pgmap v373: 97 pgs: 97 active+clean; 20 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 862 KiB/s wr, 497 op/s 2024-09-21T06:29:56.435 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:56 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:56.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:56 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:56.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:56 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:57.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:57 smithi063 ceph-mon[31150]: pgmap v374: 97 pgs: 97 active+clean; 26 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 1.4 MiB/s wr, 577 op/s 2024-09-21T06:29:57.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:57 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:29:57.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:57 smithi071 ceph-mon[34844]: pgmap v374: 97 pgs: 97 active+clean; 26 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 1.4 MiB/s wr, 577 op/s 2024-09-21T06:29:57.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:57 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:29:57.598 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:57 smithi175 ceph-mon[34510]: pgmap v374: 97 pgs: 97 active+clean; 26 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 1.4 MiB/s wr, 577 op/s 2024-09-21T06:29:57.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:57 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:29:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.596+0000 7f22e0d13640 1 -- 172.21.15.63:0/883422022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22dc105270 msgr2=0x7f22dc10d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.596+0000 7f22e0d13640 1 --2- 172.21.15.63:0/883422022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22dc105270 0x7f22dc10d7b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009860 tx=0x7f22d002a340 comp rx=0 tx=0).stop 2024-09-21T06:29:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.596+0000 7f22e0d13640 1 -- 172.21.15.63:0/883422022 shutdown_connections 2024-09-21T06:29:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.596+0000 7f22e0d13640 1 --2- 172.21.15.63:0/883422022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22dc10dd70 0x7f22dc110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.596+0000 7f22e0d13640 1 --2- 172.21.15.63:0/883422022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22dc105270 0x7f22dc10d7b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.596+0000 7f22e0d13640 1 --2- 172.21.15.63:0/883422022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22dc104920 0x7f22dc104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.596+0000 7f22e0d13640 1 -- 172.21.15.63:0/883422022 >> 172.21.15.63:0/883422022 conn(0x7f22dc07a6f0 msgr2=0x7f22dc07ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.596+0000 7f22e0d13640 1 -- 172.21.15.63:0/883422022 shutdown_connections 2024-09-21T06:29:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.596+0000 7f22e0d13640 1 -- 172.21.15.63:0/883422022 wait complete. 2024-09-21T06:29:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.597+0000 7f22e0d13640 1 Processor -- start 2024-09-21T06:29:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.597+0000 7f22e0d13640 1 -- start start 2024-09-21T06:29:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.598+0000 7f22e0d13640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22dc104920 0x7f22dc19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.598+0000 7f22e0d13640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22dc105270 0x7f22dc19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.598+0000 7f22e0d13640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22dc10dd70 0x7f22dc19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.598+0000 7f22e0d13640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc113990 con 0x7f22dc104920 2024-09-21T06:29:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.598+0000 7f22e0d13640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc113810 con 0x7f22dc105270 2024-09-21T06:29:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.598+0000 7f22e0d13640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc113b10 con 0x7f22dc10dd70 2024-09-21T06:29:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.598+0000 7f22da59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22dc104920 0x7f22dc19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.598+0000 7f22d9d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22dc105270 0x7f22dc19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.598+0000 7f22da59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22dc104920 0x7f22dc19a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46522/0 (socket says 172.21.15.63:46522) 2024-09-21T06:29:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.598+0000 7f22dad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22dc10dd70 0x7f22dc19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.598+0000 7f22da59c640 1 -- 172.21.15.63:0/1600288154 learned_addr learned my addr 172.21.15.63:0/1600288154 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.598+0000 7f22da59c640 1 -- 172.21.15.63:0/1600288154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22dc10dd70 msgr2=0x7f22dc19fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.598+0000 7f22da59c640 1 --2- 172.21.15.63:0/1600288154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22dc10dd70 0x7f22dc19fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.598+0000 7f22da59c640 1 -- 172.21.15.63:0/1600288154 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22dc105270 msgr2=0x7f22dc19a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.598+0000 7f22da59c640 1 --2- 172.21.15.63:0/1600288154 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22dc105270 0x7f22dc19a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.598+0000 7f22da59c640 1 -- 172.21.15.63:0/1600288154 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22dc1a0320 con 0x7f22dc104920 2024-09-21T06:29:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.599+0000 7f22da59c640 1 --2- 172.21.15.63:0/1600288154 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22dc104920 0x7f22dc19a3f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00e9f0 tx=0x7f22cc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.599+0000 7f22cb7fe640 1 -- 172.21.15.63:0/1600288154 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc00cd80 con 0x7f22dc104920 2024-09-21T06:29:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.599+0000 7f22e0d13640 1 -- 172.21.15.63:0/1600288154 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22dc1a0610 con 0x7f22dc104920 2024-09-21T06:29:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.599+0000 7f22cb7fe640 1 -- 172.21.15.63:0/1600288154 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22cc0108e0 con 0x7f22dc104920 2024-09-21T06:29:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.599+0000 7f22cb7fe640 1 -- 172.21.15.63:0/1600288154 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc018980 con 0x7f22dc104920 2024-09-21T06:29:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.599+0000 7f22e0d13640 1 -- 172.21.15.63:0/1600288154 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22dc102530 con 0x7f22dc104920 2024-09-21T06:29:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.602+0000 7f22e7c7d740 1 Processor -- start 2024-09-21T06:29:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.602+0000 7f22e7c7d740 1 -- start start 2024-09-21T06:29:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.603+0000 7f22e7c7d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd3f1b0 0x55c33c0e49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.603+0000 7f22e7c7d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd162f0 0x55c33c0e4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.603+0000 7f22e7c7d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd1e4d0 0x55c33c0e5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.603+0000 7f22e7c7d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c33c0596f0 con 0x55c33bd162f0 2024-09-21T06:29:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.603+0000 7f22e7c7d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c33c048b20 con 0x55c33bd1e4d0 2024-09-21T06:29:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.603+0000 7f22e7c7d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c33c04c930 con 0x55c33bd3f1b0 2024-09-21T06:29:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.603+0000 7f22cb7fe640 1 -- 172.21.15.63:0/1600288154 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f22cc018b20 con 0x7f22dc104920 2024-09-21T06:29:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.603+0000 7f22dad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd3f1b0 0x55c33c0e49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.603+0000 7f22dad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd3f1b0 0x55c33c0e49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:45260/0 (socket says 172.21.15.63:45260) 2024-09-21T06:29:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.603+0000 7f22dad9d640 1 -- 172.21.15.63:0/1926727316 learned_addr learned my addr 172.21.15.63:0/1926727316 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.603+0000 7f22d9d9b640 1 --2- 172.21.15.63:0/1926727316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd1e4d0 0x55c33c0e5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.603+0000 7f22da59c640 1 --2- 172.21.15.63:0/1926727316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd162f0 0x55c33c0e4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.604+0000 7f22d9d9b640 1 -- 172.21.15.63:0/1926727316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd3f1b0 msgr2=0x55c33c0e49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.604+0000 7f22d9d9b640 1 --2- 172.21.15.63:0/1926727316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd3f1b0 0x55c33c0e49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.604+0000 7f22d9d9b640 1 -- 172.21.15.63:0/1926727316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd162f0 msgr2=0x55c33c0e4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.604+0000 7f22d9d9b640 1 --2- 172.21.15.63:0/1926727316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd162f0 0x55c33c0e4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.604+0000 7f22d9d9b640 1 -- 172.21.15.63:0/1926727316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c33c00e530 con 0x55c33bd1e4d0 2024-09-21T06:29:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.604+0000 7f22d9d9b640 1 --2- 172.21.15.63:0/1926727316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd1e4d0 0x55c33c0e5430 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f22d002a860 tx=0x7f22d00095a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8ed2ea8f3735671 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.604+0000 7f22cb7fe640 1 --2- 172.21.15.63:0/1600288154 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f22c40b6680 0x7f22c40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.604+0000 7f22dad9d640 1 --2- 172.21.15.63:0/1600288154 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f22c40b6680 0x7f22c40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.605+0000 7f22c8ff9640 1 -- 172.21.15.63:0/1926727316 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d0037040 con 0x55c33bd1e4d0 2024-09-21T06:29:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.605+0000 7f22c8ff9640 1 -- 172.21.15.63:0/1926727316 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22d0030e10 con 0x55c33bd1e4d0 2024-09-21T06:29:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.605+0000 7f22c8ff9640 1 -- 172.21.15.63:0/1926727316 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d00038e0 con 0x55c33bd1e4d0 2024-09-21T06:29:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.605+0000 7f22cb7fe640 1 -- 172.21.15.63:0/1600288154 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f22cc0e7a20 con 0x7f22dc104920 2024-09-21T06:29:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.606+0000 7f22e7c7d740 1 -- 172.21.15.63:0/1926727316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd1e4d0 msgr2=0x55c33c0e5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.606+0000 7f22dad9d640 1 --2- 172.21.15.63:0/1600288154 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f22c40b6680 0x7f22c40b8b90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f22d4005c40 tx=0x7f22d4010040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.606+0000 7f22e7c7d740 1 --2- 172.21.15.63:0/1926727316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd1e4d0 0x55c33c0e5430 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f22d002a860 tx=0x7f22d00095a0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.606+0000 7f22e7c7d740 1 -- 172.21.15.63:0/1926727316 shutdown_connections 2024-09-21T06:29:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.606+0000 7f22e7c7d740 1 --2- 172.21.15.63:0/1926727316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd1e4d0 0x55c33c0e5430 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.606+0000 7f22e7c7d740 1 --2- 172.21.15.63:0/1926727316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd162f0 0x55c33c0e4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.606+0000 7f22e7c7d740 1 --2- 172.21.15.63:0/1926727316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd3f1b0 0x55c33c0e49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.606+0000 7f22e7c7d740 1 -- 172.21.15.63:0/1926727316 >> 172.21.15.63:0/1926727316 conn(0x55c33bd33300 msgr2=0x55c33c0e28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.606+0000 7f22e7c7d740 1 -- 172.21.15.63:0/1926727316 shutdown_connections 2024-09-21T06:29:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.606+0000 7f22e7c7d740 1 -- 172.21.15.63:0/1926727316 wait complete. 2024-09-21T06:29:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.607+0000 7f22e7c7d740 1 -- start start 2024-09-21T06:29:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.607+0000 7f22e7c7d740 1 Processor -- start 2024-09-21T06:29:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.607+0000 7f22e7c7d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd162f0 0x55c33c0f00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.607+0000 7f22e7c7d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd1e4d0 0x55c33c0f0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.607+0000 7f22e7c7d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd3f1b0 0x55c33c0fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.607+0000 7f22e7c7d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c33bf80ab0 con 0x55c33bd1e4d0 2024-09-21T06:29:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.607+0000 7f22e7c7d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c33bfee730 con 0x55c33bd162f0 2024-09-21T06:29:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.607+0000 7f22e7c7d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c33c0f30d0 con 0x55c33bd3f1b0 2024-09-21T06:29:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.608+0000 7f22d9d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd1e4d0 0x55c33c0f0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.608+0000 7f22da59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd162f0 0x55c33c0f00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.608+0000 7f22dad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd3f1b0 0x55c33c0fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.608+0000 7f22d9d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd1e4d0 0x55c33c0f0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46548/0 (socket says 172.21.15.63:46548) 2024-09-21T06:29:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.608+0000 7f22d9d9b640 1 -- 172.21.15.63:0/2311751240 learned_addr learned my addr 172.21.15.63:0/2311751240 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.608+0000 7f22e7c7d740 10 client.0 _ll_register_callbacks cb 0x55c33c0426b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.608+0000 7f22da59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd162f0 0x55c33c0f00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:59356/0 (socket says 172.21.15.63:59356) 2024-09-21T06:29:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.608+0000 7f22d9d9b640 1 -- 172.21.15.63:0/2311751240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd3f1b0 msgr2=0x55c33c0fc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.608+0000 7f22d9d9b640 1 --2- 172.21.15.63:0/2311751240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd3f1b0 0x55c33c0fc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.608+0000 7f22d9d9b640 1 -- 172.21.15.63:0/2311751240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd162f0 msgr2=0x55c33c0f00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.608+0000 7f22d9d9b640 1 --2- 172.21.15.63:0/2311751240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd162f0 0x55c33c0f00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.608+0000 7f22d9d9b640 1 -- 172.21.15.63:0/2311751240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c33bdaa790 con 0x55c33bd1e4d0 2024-09-21T06:29:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.608+0000 7f22dad9d640 1 --2- 172.21.15.63:0/2311751240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd3f1b0 0x55c33c0fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.608+0000 7f22da59c640 1 --2- 172.21.15.63:0/2311751240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd162f0 0x55c33c0f00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.608+0000 7f22d9d9b640 1 --2- 172.21.15.63:0/2311751240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd1e4d0 0x55c33c0f0610 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f22d0035040 tx=0x7f22d0004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1f48aac13e5a42 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.608+0000 7f22c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:29:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.608+0000 7f22c1ffb640 1 -- 172.21.15.63:0/2311751240 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d0037030 con 0x55c33bd1e4d0 2024-09-21T06:29:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.608+0000 7f22c1ffb640 1 -- 172.21.15.63:0/2311751240 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f22d0030660 con 0x55c33bd1e4d0 2024-09-21T06:29:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.608+0000 7f22e7c7d740 1 -- 172.21.15.63:0/2311751240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22d0030e10 con 0x55c33bd1e4d0 2024-09-21T06:29:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.609+0000 7f22c1ffb640 1 -- 172.21.15.63:0/2311751240 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f22d0055050 con 0x55c33bd1e4d0 2024-09-21T06:29:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.609+0000 7f22e7c7d740 10 client.15969 fetch_fsmap learned FSMap version 31 2024-09-21T06:29:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.609+0000 7f22e7c7d740 1 -- 172.21.15.63:0/2311751240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c33be23620 con 0x55c33bd1e4d0 2024-09-21T06:29:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.609+0000 7f22c1ffb640 1 -- 172.21.15.63:0/2311751240 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22d0030e10 con 0x55c33bd1e4d0 2024-09-21T06:29:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.609+0000 7f22c1ffb640 1 -- 172.21.15.63:0/2311751240 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f22d003d640 con 0x55c33bd1e4d0 2024-09-21T06:29:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.609+0000 7f22e7c7d740 10 client.15969 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:29:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.609+0000 7f22e7c7d740 10 client.15969 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.609+0000 7f22e7c7d740 20 client.15969 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.609+0000 7f22e7c7d740 1 --2- 172.21.15.63:0/2311751240 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c33bcfdd80 0x55c33c101fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.609+0000 7f22e7c7d740 4 client.15969 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.609+0000 7f22e7c7d740 1 -- 172.21.15.63:0/2311751240 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c33c05b640 con 0x55c33bcfdd80 2024-09-21T06:29:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.609+0000 7f22da59c640 1 --2- 172.21.15.63:0/2311751240 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c33bcfdd80 0x55c33c101fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.610+0000 7f22da59c640 1 --2- 172.21.15.63:0/2311751240 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c33bcfdd80 0x55c33c101fd0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81bdc9099ef946 server_cookie=ffd0fcc963c80749 in_seq=0 out_seq=0 2024-09-21T06:29:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.610+0000 7f22c1ffb640 10 client.15969 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.614+0000 7f22c1ffb640 1 -- 172.21.15.63:0/2311751240 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c33c05b640 con 0x55c33bcfdd80 2024-09-21T06:29:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.614+0000 7f22c1ffb640 10 client.15969 handle_command_reply: tid=0 2024-09-21T06:29:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.614+0000 7f22e7c7d740 1 client.15969 shutdown 2024-09-21T06:29:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.614+0000 7f22e7c7d740 1 -- 172.21.15.63:0/2311751240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd1e4d0 msgr2=0x55c33c0f0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.614+0000 7f22e7c7d740 1 --2- 172.21.15.63:0/2311751240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd1e4d0 0x55c33c0f0610 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f22d0035040 tx=0x7f22d0004480 comp rx=0 tx=0).stop 2024-09-21T06:29:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.614+0000 7f22e7c7d740 1 -- 172.21.15.63:0/2311751240 shutdown_connections 2024-09-21T06:29:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.614+0000 7f22e7c7d740 1 --2- 172.21.15.63:0/2311751240 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c33bcfdd80 0x55c33c101fd0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.614+0000 7f22e7c7d740 1 --2- 172.21.15.63:0/2311751240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd3f1b0 0x55c33c0fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.614+0000 7f22e7c7d740 1 --2- 172.21.15.63:0/2311751240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd1e4d0 0x55c33c0f0610 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.614+0000 7f22e7c7d740 1 --2- 172.21.15.63:0/2311751240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd162f0 0x55c33c0f00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.614+0000 7f22e7c7d740 1 -- 172.21.15.63:0/2311751240 >> 172.21.15.63:0/2311751240 conn(0x55c33bd33300 msgr2=0x55c33c0e59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.614+0000 7f22c1ffb640 0 client.15969 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.614+0000 7f22e7c7d740 1 -- 172.21.15.63:0/2311751240 shutdown_connections 2024-09-21T06:29:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.614+0000 7f22e7c7d740 1 -- 172.21.15.63:0/2311751240 wait complete. 2024-09-21T06:29:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.614+0000 7f22e7c7d740 20 client.15969 trim_cache size 0 max 16384 2024-09-21T06:29:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.632+0000 7f22e7c7d740 1 Processor -- start 2024-09-21T06:29:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.632+0000 7f22e7c7d740 1 -- start start 2024-09-21T06:29:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.632+0000 7f22e7c7d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd162f0 0x55c33c0e60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.632+0000 7f22e7c7d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd1e4d0 0x55c33c0fc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.632+0000 7f22e7c7d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd3f1b0 0x55c33c0fc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.632+0000 7f22e7c7d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc1b1680 con 0x55c33bd162f0 2024-09-21T06:29:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.632+0000 7f22e7c7d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc1b3220 con 0x55c33bd3f1b0 2024-09-21T06:29:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.632+0000 7f22e7c7d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc1b1d50 con 0x55c33bd1e4d0 2024-09-21T06:29:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.632+0000 7f22da59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd162f0 0x55c33c0e60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.632+0000 7f22da59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd162f0 0x55c33c0e60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46562/0 (socket says 172.21.15.63:46562) 2024-09-21T06:29:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.632+0000 7f22da59c640 1 -- 172.21.15.63:0/4249686249 learned_addr learned my addr 172.21.15.63:0/4249686249 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.632+0000 7f22d9d9b640 1 --2- 172.21.15.63:0/4249686249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd1e4d0 0x55c33c0fc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.632+0000 7f22dad9d640 1 --2- 172.21.15.63:0/4249686249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd3f1b0 0x55c33c0fc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.633+0000 7f22da59c640 1 -- 172.21.15.63:0/4249686249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd1e4d0 msgr2=0x55c33c0fc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.633+0000 7f22da59c640 1 --2- 172.21.15.63:0/4249686249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd1e4d0 0x55c33c0fc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.633+0000 7f22da59c640 1 -- 172.21.15.63:0/4249686249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd3f1b0 msgr2=0x55c33c0fc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.633+0000 7f22da59c640 1 --2- 172.21.15.63:0/4249686249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd3f1b0 0x55c33c0fc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.633+0000 7f22da59c640 1 -- 172.21.15.63:0/4249686249 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c33c0ea4a0 con 0x55c33bd162f0 2024-09-21T06:29:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.633+0000 7f22d9d9b640 1 --2- 172.21.15.63:0/4249686249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd1e4d0 0x55c33c0fc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.633+0000 7f22da59c640 1 --2- 172.21.15.63:0/4249686249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd162f0 0x55c33c0e60f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00c6a0 tx=0x7f22cc018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dcf44ddae29ef97 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.633+0000 7f22c3fff640 1 -- 172.21.15.63:0/4249686249 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc0ad730 con 0x55c33bd162f0 2024-09-21T06:29:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.633+0000 7f22c3fff640 1 -- 172.21.15.63:0/4249686249 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22cc0f0040 con 0x55c33bd162f0 2024-09-21T06:29:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.633+0000 7f22c3fff640 1 -- 172.21.15.63:0/4249686249 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc0a90d0 con 0x55c33bd162f0 2024-09-21T06:29:58.638 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.634+0000 7f22e7c7d740 1 -- 172.21.15.63:0/4249686249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd162f0 msgr2=0x55c33c0e60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.634+0000 7f22e7c7d740 1 --2- 172.21.15.63:0/4249686249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd162f0 0x55c33c0e60f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00c6a0 tx=0x7f22cc018420 comp rx=0 tx=0).stop 2024-09-21T06:29:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.634+0000 7f22e7c7d740 1 -- 172.21.15.63:0/4249686249 shutdown_connections 2024-09-21T06:29:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.634+0000 7f22e7c7d740 1 --2- 172.21.15.63:0/4249686249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd3f1b0 0x55c33c0fc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.634+0000 7f22e7c7d740 1 --2- 172.21.15.63:0/4249686249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd1e4d0 0x55c33c0fc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.634+0000 7f22e7c7d740 1 --2- 172.21.15.63:0/4249686249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd162f0 0x55c33c0e60f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.634+0000 7f22e7c7d740 1 -- 172.21.15.63:0/4249686249 >> 172.21.15.63:0/4249686249 conn(0x55c33bd33300 msgr2=0x55c33c0e59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.634+0000 7f22e7c7d740 1 -- 172.21.15.63:0/4249686249 shutdown_connections 2024-09-21T06:29:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.634+0000 7f22e7c7d740 1 -- 172.21.15.63:0/4249686249 wait complete. 2024-09-21T06:29:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.634+0000 7f22e7c7d740 1 -- start start 2024-09-21T06:29:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.635+0000 7f22e7c7d740 1 Processor -- start 2024-09-21T06:29:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.635+0000 7f22e7c7d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd162f0 0x55c33c0f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.635+0000 7f22e7c7d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd1e4d0 0x55c33c0f6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.635+0000 7f22e7c7d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd3f1b0 0x55c33c1647e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.635+0000 7f22e7c7d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc1b2af0 con 0x55c33bd162f0 2024-09-21T06:29:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.635+0000 7f22e7c7d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc1b2420 con 0x55c33bd3f1b0 2024-09-21T06:29:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.635+0000 7f22e7c7d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc1af680 con 0x55c33bd1e4d0 2024-09-21T06:29:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.635+0000 7f22e7c7d740 10 client.0 _ll_register_callbacks cb 0x7f22cc0ec040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.635+0000 7f22d9d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd1e4d0 0x55c33c0f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.635+0000 7f22d9d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd1e4d0 0x55c33c0f6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:45304/0 (socket says 172.21.15.63:45304) 2024-09-21T06:29:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.635+0000 7f22d9d9b640 1 -- 172.21.15.63:0/673798869 learned_addr learned my addr 172.21.15.63:0/673798869 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:29:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.635+0000 7f22da59c640 1 --2- 172.21.15.63:0/673798869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd162f0 0x55c33c0f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.635+0000 7f22dad9d640 1 --2- 172.21.15.63:0/673798869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd3f1b0 0x55c33c1647e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.636+0000 7f22d9d9b640 1 -- 172.21.15.63:0/673798869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd3f1b0 msgr2=0x55c33c1647e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.636+0000 7f22d9d9b640 1 --2- 172.21.15.63:0/673798869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd3f1b0 0x55c33c1647e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.636+0000 7f22d9d9b640 1 -- 172.21.15.63:0/673798869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd162f0 msgr2=0x55c33c0f5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.636+0000 7f22d9d9b640 1 --2- 172.21.15.63:0/673798869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd162f0 0x55c33c0f5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.636+0000 7f22d9d9b640 1 -- 172.21.15.63:0/673798869 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c33c164e50 con 0x55c33bd1e4d0 2024-09-21T06:29:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.636+0000 7f22da59c640 1 --2- 172.21.15.63:0/673798869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd162f0 0x55c33c0f5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.636+0000 7f22d9d9b640 1 --2- 172.21.15.63:0/673798869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd1e4d0 0x55c33c0f6200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f22d002a860 tx=0x7f22d0030e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8ac751941c9028e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.636+0000 7f22c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:29:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.637+0000 7f22c1ffb640 1 -- 172.21.15.63:0/673798869 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d0037070 con 0x55c33bd1e4d0 2024-09-21T06:29:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.637+0000 7f22e7c7d740 1 -- 172.21.15.63:0/673798869 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22cc0f0040 con 0x55c33bd1e4d0 2024-09-21T06:29:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.637+0000 7f22c1ffb640 1 -- 172.21.15.63:0/673798869 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f22d003d480 con 0x55c33bd1e4d0 2024-09-21T06:29:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.637+0000 7f22c1ffb640 1 -- 172.21.15.63:0/673798869 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f22d0005d30 con 0x55c33bd1e4d0 2024-09-21T06:29:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.637+0000 7f22e7c7d740 10 client.25687 fetch_fsmap learned FSMap version 31 2024-09-21T06:29:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.637+0000 7f22e7c7d740 1 -- 172.21.15.63:0/673798869 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c33c16c180 con 0x55c33bd1e4d0 2024-09-21T06:29:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.638+0000 7f22c1ffb640 1 -- 172.21.15.63:0/673798869 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22d00054f0 con 0x55c33bd1e4d0 2024-09-21T06:29:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.638+0000 7f22c1ffb640 1 -- 172.21.15.63:0/673798869 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f22d0004820 con 0x55c33bd1e4d0 2024-09-21T06:29:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.638+0000 7f22e7c7d740 10 client.25687 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:29:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.638+0000 7f22e7c7d740 10 client.25687 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.638+0000 7f22e7c7d740 20 client.25687 populate_metadata read hostname 'smithi063' 2024-09-21T06:29:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.638+0000 7f22e7c7d740 1 --2- 172.21.15.63:0/673798869 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c33bcd31c0 0x55c33c16e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.638+0000 7f22e7c7d740 4 client.25687 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:29:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.638+0000 7f22e7c7d740 1 -- 172.21.15.63:0/673798869 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f22cc0f0040 con 0x55c33bcd31c0 2024-09-21T06:29:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.638+0000 7f22da59c640 1 --2- 172.21.15.63:0/673798869 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c33bcd31c0 0x55c33c16e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.639+0000 7f22c1ffb640 10 client.25687 ms_handle_connect on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:58.639+0000 7f22da59c640 1 --2- 172.21.15.63:0/673798869 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c33bcd31c0 0x55c33c16e9c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26eb68a7369a607e server_cookie=5b46334cce8c9f7b in_seq=0 out_seq=0 2024-09-21T06:29:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.270+0000 7f22c1ffb640 1 -- 172.21.15.63:0/673798869 <== mds.0 v2:172.21.15.71:6838/3472481253 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f22cc0f0040 con 0x55c33bcd31c0 2024-09-21T06:29:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.270+0000 7f22c1ffb640 10 client.25687 handle_command_reply: tid=0 2024-09-21T06:29:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.270+0000 7f22e7c7d740 1 client.25687 shutdown 2024-09-21T06:29:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.271+0000 7f22e7c7d740 1 -- 172.21.15.63:0/673798869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd1e4d0 msgr2=0x55c33c0f6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.271+0000 7f22e7c7d740 1 --2- 172.21.15.63:0/673798869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd1e4d0 0x55c33c0f6200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f22d002a860 tx=0x7f22d0030e40 comp rx=0 tx=0).stop 2024-09-21T06:29:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.271+0000 7f22e7c7d740 1 -- 172.21.15.63:0/673798869 shutdown_connections 2024-09-21T06:29:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.271+0000 7f22e7c7d740 1 --2- 172.21.15.63:0/673798869 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x55c33bcd31c0 0x55c33c16e9c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.271+0000 7f22e7c7d740 1 --2- 172.21.15.63:0/673798869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c33bd3f1b0 0x55c33c1647e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.271+0000 7f22e7c7d740 1 --2- 172.21.15.63:0/673798869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c33bd1e4d0 0x55c33c0f6200 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.271+0000 7f22c1ffb640 0 client.25687 ms_handle_reset on v2:172.21.15.71:6838/3472481253 2024-09-21T06:29:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.271+0000 7f22e7c7d740 1 --2- 172.21.15.63:0/673798869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c33bd162f0 0x55c33c0f5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.271+0000 7f22e7c7d740 1 -- 172.21.15.63:0/673798869 >> 172.21.15.63:0/673798869 conn(0x55c33bd33300 msgr2=0x55c33c0f1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.271+0000 7f22e7c7d740 1 -- 172.21.15.63:0/673798869 shutdown_connections 2024-09-21T06:29:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.271+0000 7f22e7c7d740 1 -- 172.21.15.63:0/673798869 wait complete. 2024-09-21T06:29:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.271+0000 7f22e7c7d740 20 client.25687 trim_cache size 0 max 16384 2024-09-21T06:29:59.275 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout:{ 2024-09-21T06:29:59.275 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout: "message": "", 2024-09-21T06:29:59.275 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout: "return_code": 0 2024-09-21T06:29:59.275 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stdout:} 2024-09-21T06:29:59.276 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.272+0000 7f22e0d13640 1 -- 172.21.15.63:0/1600288154 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f22c40b6680 msgr2=0x7f22c40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:59.276 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.272+0000 7f22e0d13640 1 --2- 172.21.15.63:0/1600288154 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f22c40b6680 0x7f22c40b8b90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f22d4005c40 tx=0x7f22d4010040 comp rx=0 tx=0).stop 2024-09-21T06:29:59.276 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.272+0000 7f22e0d13640 1 -- 172.21.15.63:0/1600288154 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22dc104920 msgr2=0x7f22dc19a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:59.276 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.272+0000 7f22e0d13640 1 --2- 172.21.15.63:0/1600288154 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22dc104920 0x7f22dc19a3f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00e9f0 tx=0x7f22cc00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:29:59.276 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.272+0000 7f22e0d13640 1 -- 172.21.15.63:0/1600288154 shutdown_connections 2024-09-21T06:29:59.276 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.272+0000 7f22e0d13640 1 --2- 172.21.15.63:0/1600288154 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f22c40b6680 0x7f22c40b8b90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:59.276 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.272+0000 7f22e0d13640 1 --2- 172.21.15.63:0/1600288154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22dc10dd70 0x7f22dc19fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:59.276 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.272+0000 7f22e0d13640 1 --2- 172.21.15.63:0/1600288154 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22dc105270 0x7f22dc19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:59.276 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.272+0000 7f22e0d13640 1 --2- 172.21.15.63:0/1600288154 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22dc104920 0x7f22dc19a3f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:59.276 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.272+0000 7f22e0d13640 1 -- 172.21.15.63:0/1600288154 >> 172.21.15.63:0/1600288154 conn(0x7f22dc07a6f0 msgr2=0x7f22dc100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:59.276 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.272+0000 7f22e0d13640 1 -- 172.21.15.63:0/1600288154 shutdown_connections 2024-09-21T06:29:59.276 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:29:59.272+0000 7f22e0d13640 1 -- 172.21.15.63:0/1600288154 wait complete. 2024-09-21T06:29:59.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:29:59 smithi071 ceph-mon[34844]: pgmap v375: 97 pgs: 97 active+clean; 28 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 1.3 MiB/s wr, 720 op/s 2024-09-21T06:29:59.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:29:59 smithi063 ceph-mon[31150]: pgmap v375: 97 pgs: 97 active+clean; 28 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 1.3 MiB/s wr, 720 op/s 2024-09-21T06:29:59.598 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:29:59 smithi175 ceph-mon[34510]: pgmap v375: 97 pgs: 97 active+clean; 28 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 1.3 MiB/s wr, 720 op/s 2024-09-21T06:30:00.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:00.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:00.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:00.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:00.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:00.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:00.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:00.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:00.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:00.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:00.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:00.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:00.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:00.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:00.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:00 smithi071 ceph-mon[34844]: overall HEALTH_OK 2024-09-21T06:30:00.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:00.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:00.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:00.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:00.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:00.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:00.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:00.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:00.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:00.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:00.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:00.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:00.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:00.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:00.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:00 smithi063 ceph-mon[31150]: overall HEALTH_OK 2024-09-21T06:30:00.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:00.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:00.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:00.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:00.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:00.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:00.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:00.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:00.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:00 smithi175 ceph-mon[34510]: overall HEALTH_OK 2024-09-21T06:30:01.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: pgmap v376: 97 pgs: 97 active+clean; 35 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 785 op/s 2024-09-21T06:30:01.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.526 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:01.527 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: pgmap v376: 97 pgs: 97 active+clean; 35 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 785 op/s 2024-09-21T06:30:01.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.585 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.586 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.586 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.586 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.586 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.586 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.586 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.586 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.586 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.586 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.586 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.586 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.586 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.586 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.587 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.587 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.587 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.587 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.587 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.587 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.587 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.588 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.588 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.588 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.588 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.588 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.588 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.588 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.588 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.588 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.588 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.588 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.588 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.588 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.588 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.588 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.589 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.589 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.589 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.589 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.589 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.589 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.589 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.589 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.589 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.589 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.589 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.589 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.589 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.589 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.589 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.590 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.590 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.590 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.590 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.590 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.590 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.590 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.590 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.590 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.590 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.590 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.590 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.590 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.590 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.590 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.591 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.591 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.591 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.591 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.591 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.591 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:01.591 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:01 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: pgmap v376: 97 pgs: 97 active+clean; 35 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 785 op/s 2024-09-21T06:30:01.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.605 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.605 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.605 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.605 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.605 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.605 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.605 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.605 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.605 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.605 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.605 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.605 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.606 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.606 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.606 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.606 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.606 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.606 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.606 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.606 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.606 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.606 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.606 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.606 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.606 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.606 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.607 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.607 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.607 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.607 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.607 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.607 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.607 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.607 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.607 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.607 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.607 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.607 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.607 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:01.607 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:01.607 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:01 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.269 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5120-g18432218/rpm/el9/BUILD/ceph-19.3.0-5120-g18432218/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:195: T& boost::intrusive_ptr::operator*() const [with T = const MClientRequest]: Assertion `px != 0' failed. 2024-09-21T06:30:02.269 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: *** Caught signal (Aborted) ** 2024-09-21T06:30:02.269 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: in thread 7f7db97d1640 thread_name:ms_dispatch 2024-09-21T06:30:02.269 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T06:30:02.269 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7dbeba66f0] 2024-09-21T06:30:02.269 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7dbebf399c] 2024-09-21T06:30:02.269 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 3: raise() 2024-09-21T06:30:02.269 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 4: abort() 2024-09-21T06:30:02.269 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 5: /lib64/libc.so.6(+0x2871b) [0x7f7dbeb9071b] 2024-09-21T06:30:02.269 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 6: /lib64/libc.so.6(+0x37386) [0x7f7dbeb9f386] 2024-09-21T06:30:02.270 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 7: (Server::dispatch_client_request(boost::intrusive_ptr const&)+0x23d) [0x563ad45fe0fb] 2024-09-21T06:30:02.270 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 8: /usr/bin/ceph-mds(+0x1e84fd) [0x563ad46034fd] 2024-09-21T06:30:02.270 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 9: (MDSContext::complete(int)+0x7c) [0x563ad48e26d8] 2024-09-21T06:30:02.270 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 10: (MDSRank::_advance_queues()+0x226) [0x563ad4535540] 2024-09-21T06:30:02.270 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 11: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x200) [0x563ad4536494] 2024-09-21T06:30:02.270 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 12: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x563ad4536e4a] 2024-09-21T06:30:02.270 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x563ad4519fa4] 2024-09-21T06:30:02.270 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 14: /usr/lib64/ceph/libceph-common.so.2(+0x3a57df) [0x7f7dbf47c7df] 2024-09-21T06:30:02.270 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 15: (DispatchQueue::entry()+0x60f) [0x7f7dbf47d0d1] 2024-09-21T06:30:02.270 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 16: /usr/lib64/ceph/libceph-common.so.2(+0x493f5b) [0x7f7dbf56af5b] 2024-09-21T06:30:02.270 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 17: (Thread::entry_wrapper()+0x43) [0x7f7dbf306d57] 2024-09-21T06:30:02.270 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 18: (Thread::_entry_func(void*)+0xd) [0x7f7dbf306d73] 2024-09-21T06:30:02.271 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 19: /lib64/libc.so.6(+0x89c52) [0x7f7dbebf1c52] 2024-09-21T06:30:02.271 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 20: /lib64/libc.so.6(+0x10ec80) [0x7f7dbec76c80] 2024-09-21T06:30:02.271 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 2024-09-21T06:30:01.970+0000 7f7db97d1640 -1 *** Caught signal (Aborted) ** 2024-09-21T06:30:02.271 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: in thread 7f7db97d1640 thread_name:ms_dispatch 2024-09-21T06:30:02.271 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 2024-09-21T06:30:02.271 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.271 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.271 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.271 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.271 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.272 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.272 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.272 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.272 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.272 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.272 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.272 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.272 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.272 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.272 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.272 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.272 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.272 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.272 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.272 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.273 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.274 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.274 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.274 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.274 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.274 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.274 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.274 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.274 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.274 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.274 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.274 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.274 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.274 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.274 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.274 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.274 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.275 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.275 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.275 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.275 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:02.275 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.275 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:02 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:30:02.275 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T06:30:02.275 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7dbeba66f0] 2024-09-21T06:30:02.276 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7dbebf399c] 2024-09-21T06:30:02.276 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 3: raise() 2024-09-21T06:30:02.276 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 4: abort() 2024-09-21T06:30:02.276 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 5: /lib64/libc.so.6(+0x2871b) [0x7f7dbeb9071b] 2024-09-21T06:30:02.276 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 6: /lib64/libc.so.6(+0x37386) [0x7f7dbeb9f386] 2024-09-21T06:30:02.276 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 7: (Server::dispatch_client_request(boost::intrusive_ptr const&)+0x23d) [0x563ad45fe0fb] 2024-09-21T06:30:02.276 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 8: /usr/bin/ceph-mds(+0x1e84fd) [0x563ad46034fd] 2024-09-21T06:30:02.276 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 9: (MDSContext::complete(int)+0x7c) [0x563ad48e26d8] 2024-09-21T06:30:02.276 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 10: (MDSRank::_advance_queues()+0x226) [0x563ad4535540] 2024-09-21T06:30:02.276 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 11: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x200) [0x563ad4536494] 2024-09-21T06:30:02.276 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 12: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x563ad4536e4a] 2024-09-21T06:30:02.276 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x563ad4519fa4] 2024-09-21T06:30:02.276 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 14: /usr/lib64/ceph/libceph-common.so.2(+0x3a57df) [0x7f7dbf47c7df] 2024-09-21T06:30:02.277 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 15: (DispatchQueue::entry()+0x60f) [0x7f7dbf47d0d1] 2024-09-21T06:30:02.277 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 16: /usr/lib64/ceph/libceph-common.so.2(+0x493f5b) [0x7f7dbf56af5b] 2024-09-21T06:30:02.277 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 17: (Thread::entry_wrapper()+0x43) [0x7f7dbf306d57] 2024-09-21T06:30:02.277 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 18: (Thread::_entry_func(void*)+0xd) [0x7f7dbf306d73] 2024-09-21T06:30:02.277 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 19: /lib64/libc.so.6(+0x89c52) [0x7f7dbebf1c52] 2024-09-21T06:30:02.277 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 20: /lib64/libc.so.6(+0x10ec80) [0x7f7dbec76c80] 2024-09-21T06:30:02.277 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-21T06:30:02.277 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 2024-09-21T06:30:02.277 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 0> 2024-09-21T06:30:01.970+0000 7f7db97d1640 -1 *** Caught signal (Aborted) ** 2024-09-21T06:30:02.277 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: in thread 7f7db97d1640 thread_name:ms_dispatch 2024-09-21T06:30:02.277 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 2024-09-21T06:30:02.277 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T06:30:02.277 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7dbeba66f0] 2024-09-21T06:30:02.277 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7dbebf399c] 2024-09-21T06:30:02.277 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 3: raise() 2024-09-21T06:30:02.278 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 4: abort() 2024-09-21T06:30:02.278 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 5: /lib64/libc.so.6(+0x2871b) [0x7f7dbeb9071b] 2024-09-21T06:30:02.278 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 6: /lib64/libc.so.6(+0x37386) [0x7f7dbeb9f386] 2024-09-21T06:30:02.278 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 7: (Server::dispatch_client_request(boost::intrusive_ptr const&)+0x23d) [0x563ad45fe0fb] 2024-09-21T06:30:02.278 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 8: /usr/bin/ceph-mds(+0x1e84fd) [0x563ad46034fd] 2024-09-21T06:30:02.278 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 9: (MDSContext::complete(int)+0x7c) [0x563ad48e26d8] 2024-09-21T06:30:02.278 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 10: (MDSRank::_advance_queues()+0x226) [0x563ad4535540] 2024-09-21T06:30:02.278 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 11: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x200) [0x563ad4536494] 2024-09-21T06:30:02.278 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 12: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x563ad4536e4a] 2024-09-21T06:30:02.278 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x563ad4519fa4] 2024-09-21T06:30:02.278 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 14: /usr/lib64/ceph/libceph-common.so.2(+0x3a57df) [0x7f7dbf47c7df] 2024-09-21T06:30:02.278 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 15: (DispatchQueue::entry()+0x60f) [0x7f7dbf47d0d1] 2024-09-21T06:30:02.278 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 16: /usr/lib64/ceph/libceph-common.so.2(+0x493f5b) [0x7f7dbf56af5b] 2024-09-21T06:30:02.278 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 17: (Thread::entry_wrapper()+0x43) [0x7f7dbf306d57] 2024-09-21T06:30:02.278 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 18: (Thread::_entry_func(void*)+0xd) [0x7f7dbf306d73] 2024-09-21T06:30:02.279 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 19: /lib64/libc.so.6(+0x89c52) [0x7f7dbebf1c52] 2024-09-21T06:30:02.279 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 20: /lib64/libc.so.6(+0x10ec80) [0x7f7dbec76c80] 2024-09-21T06:30:02.279 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-21T06:30:02.279 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 2024-09-21T06:30:02.279 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 0> 2024-09-21T06:30:01.970+0000 7f7db97d1640 -1 *** Caught signal (Aborted) ** 2024-09-21T06:30:02.279 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: in thread 7f7db97d1640 thread_name:ms_dispatch 2024-09-21T06:30:02.279 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 2024-09-21T06:30:02.279 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T06:30:02.279 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7dbeba66f0] 2024-09-21T06:30:02.279 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7dbebf399c] 2024-09-21T06:30:02.279 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 3: raise() 2024-09-21T06:30:02.279 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 4: abort() 2024-09-21T06:30:02.279 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 5: /lib64/libc.so.6(+0x2871b) [0x7f7dbeb9071b] 2024-09-21T06:30:02.279 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 6: /lib64/libc.so.6(+0x37386) [0x7f7dbeb9f386] 2024-09-21T06:30:02.279 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 7: (Server::dispatch_client_request(boost::intrusive_ptr const&)+0x23d) [0x563ad45fe0fb] 2024-09-21T06:30:02.280 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 8: /usr/bin/ceph-mds(+0x1e84fd) [0x563ad46034fd] 2024-09-21T06:30:02.280 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 9: (MDSContext::complete(int)+0x7c) [0x563ad48e26d8] 2024-09-21T06:30:02.280 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 10: (MDSRank::_advance_queues()+0x226) [0x563ad4535540] 2024-09-21T06:30:02.280 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 11: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x200) [0x563ad4536494] 2024-09-21T06:30:02.280 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 12: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x563ad4536e4a] 2024-09-21T06:30:02.280 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x563ad4519fa4] 2024-09-21T06:30:02.280 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 14: /usr/lib64/ceph/libceph-common.so.2(+0x3a57df) [0x7f7dbf47c7df] 2024-09-21T06:30:02.280 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 15: (DispatchQueue::entry()+0x60f) [0x7f7dbf47d0d1] 2024-09-21T06:30:02.280 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 16: /usr/lib64/ceph/libceph-common.so.2(+0x493f5b) [0x7f7dbf56af5b] 2024-09-21T06:30:02.280 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 17: (Thread::entry_wrapper()+0x43) [0x7f7dbf306d57] 2024-09-21T06:30:02.280 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 18: (Thread::_entry_func(void*)+0xd) [0x7f7dbf306d73] 2024-09-21T06:30:02.280 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 19: /lib64/libc.so.6(+0x89c52) [0x7f7dbebf1c52] 2024-09-21T06:30:02.280 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 20: /lib64/libc.so.6(+0x10ec80) [0x7f7dbec76c80] 2024-09-21T06:30:02.280 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-21T06:30:02.280 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[63970]: 2024-09-21T06:30:02.281 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:02 smithi071 podman[65659]: 2024-09-21 06:30:02.029768459 +0000 UTC m=+0.017733355 container died 0b826c7310b6d6c198fe5be608a821fcbf880dd372290899b66d374716c96025 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T06:30:02.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.334 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.335 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.336 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.336 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.336 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.336 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.336 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.336 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.336 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.336 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.336 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.336 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.336 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.336 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.337 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.337 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.337 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.337 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.337 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.337 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.337 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.337 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.337 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:02.337 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.337 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:02 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:30:02.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.602 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.603 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:02.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:02.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:02 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:30:03.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:03 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:03.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:03 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:03 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:03 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:03 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:03 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:03 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:03 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:03 smithi071 ceph-mon[34844]: pgmap v377: 97 pgs: 97 active+clean; 39 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 1.12k op/s 2024-09-21T06:30:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:03 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:03 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:03 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:03 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:03 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:03 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:03 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:03.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:03 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:03 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:03.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:03 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:03 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:03.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:03 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:03 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:03.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:03 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:03 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:03.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:03 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:03 smithi063 ceph-mon[31150]: pgmap v377: 97 pgs: 97 active+clean; 39 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 1.12k op/s 2024-09-21T06:30:03.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:03 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:03.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:03 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:03 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:03.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:03 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:03 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:03.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:03 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:03 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:03.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:03 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:03 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:03.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:03 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:03 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:03.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:03 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:03 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:03.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:03 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:03 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:03.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:03 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:03 smithi175 ceph-mon[34510]: pgmap v377: 97 pgs: 97 active+clean; 39 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 1.12k op/s 2024-09-21T06:30:03.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:03 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:03.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:03 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:03 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:03.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:03 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:03 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:03.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:03 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:03.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:03 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:03.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:03 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:05.364 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:05 smithi071 ceph-mon[34844]: pgmap v378: 97 pgs: 97 active+clean; 32 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 1.16k op/s 2024-09-21T06:30:05.364 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:05 smithi071 podman[65659]: 2024-09-21 06:30:05.111749686 +0000 UTC m=+3.099714572 container remove 0b826c7310b6d6c198fe5be608a821fcbf880dd372290899b66d374716c96025 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T06:30:05.364 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:05 smithi071 systemd[1]: ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.b.service: Main process exited, code=exited, status=134/n/a 2024-09-21T06:30:05.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:05 smithi063 ceph-mon[31150]: pgmap v378: 97 pgs: 97 active+clean; 32 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 1.16k op/s 2024-09-21T06:30:05.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:05 smithi175 ceph-mon[34510]: pgmap v378: 97 pgs: 97 active+clean; 32 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 1.16k op/s 2024-09-21T06:30:05.768 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:05 smithi071 systemd[1]: ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.b.service: Failed with result 'exit-code'. 2024-09-21T06:30:05.768 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:05 smithi071 systemd[1]: ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.b.service: Consumed 28.681s CPU time. 2024-09-21T06:30:07.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:07 smithi071 ceph-mon[34844]: pgmap v379: 97 pgs: 97 active+clean; 33 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 1.19k op/s 2024-09-21T06:30:07.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:07 smithi063 ceph-mon[31150]: pgmap v379: 97 pgs: 97 active+clean; 33 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 1.19k op/s 2024-09-21T06:30:07.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:07 smithi175 ceph-mon[34510]: pgmap v379: 97 pgs: 97 active+clean; 33 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 1.19k op/s 2024-09-21T06:30:09.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:09 smithi071 ceph-mon[34844]: pgmap v380: 97 pgs: 97 active+clean; 35 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 1.14k op/s 2024-09-21T06:30:09.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:09 smithi063 ceph-mon[31150]: pgmap v380: 97 pgs: 97 active+clean; 35 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 1.14k op/s 2024-09-21T06:30:09.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:09 smithi175 ceph-mon[34510]: pgmap v380: 97 pgs: 97 active+clean; 35 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 1.14k op/s 2024-09-21T06:30:11.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:11 smithi071 ceph-mon[34844]: pgmap v381: 97 pgs: 97 active+clean; 35 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 953 op/s 2024-09-21T06:30:11.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:11 smithi063 ceph-mon[31150]: pgmap v381: 97 pgs: 97 active+clean; 35 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 953 op/s 2024-09-21T06:30:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:11 smithi175 ceph-mon[34510]: pgmap v381: 97 pgs: 97 active+clean; 35 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 953 op/s 2024-09-21T06:30:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.386+0000 7fc5d7b72640 1 -- 172.21.15.63:0/2474948418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5d0108c80 msgr2=0x7fc5d010f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.386+0000 7fc5d7b72640 1 --2- 172.21.15.63:0/2474948418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5d0108c80 0x7fc5d010f4b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009ca0 tx=0x7fc5c802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.386+0000 7fc5d7b72640 1 -- 172.21.15.63:0/2474948418 shutdown_connections 2024-09-21T06:30:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.386+0000 7fc5d7b72640 1 --2- 172.21.15.63:0/2474948418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5d0108c80 0x7fc5d010f4b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.386+0000 7fc5d7b72640 1 --2- 172.21.15.63:0/2474948418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5d0108330 0x7fc5d0108740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.386+0000 7fc5d7b72640 1 --2- 172.21.15.63:0/2474948418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d0102a00 0x7fc5d0102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.386+0000 7fc5d7b72640 1 -- 172.21.15.63:0/2474948418 >> 172.21.15.63:0/2474948418 conn(0x7fc5d00fe420 msgr2=0x7fc5d0100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.386+0000 7fc5d7b72640 1 -- 172.21.15.63:0/2474948418 shutdown_connections 2024-09-21T06:30:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.386+0000 7fc5d7b72640 1 -- 172.21.15.63:0/2474948418 wait complete. 2024-09-21T06:30:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.387+0000 7fc5d7b72640 1 Processor -- start 2024-09-21T06:30:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.387+0000 7fc5d7b72640 1 -- start start 2024-09-21T06:30:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.387+0000 7fc5d7b72640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5d0102a00 0x7fc5d019c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.387+0000 7fc5d7b72640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5d0108330 0x7fc5d019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.387+0000 7fc5d7b72640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d0108c80 0x7fc5d01a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.387+0000 7fc5d7b72640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d0113a60 con 0x7fc5d0102a00 2024-09-21T06:30:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.387+0000 7fc5d7b72640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d01138e0 con 0x7fc5d0108c80 2024-09-21T06:30:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.387+0000 7fc5d7b72640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d0113be0 con 0x7fc5d0108330 2024-09-21T06:30:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.387+0000 7fc5d590e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5d0102a00 0x7fc5d019c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.388+0000 7fc5d590e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5d0102a00 0x7fc5d019c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37058/0 (socket says 172.21.15.63:37058) 2024-09-21T06:30:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.388+0000 7fc5d590e640 1 -- 172.21.15.63:0/3242143077 learned_addr learned my addr 172.21.15.63:0/3242143077 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.388+0000 7fc5d510d640 1 --2- 172.21.15.63:0/3242143077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5d0108330 0x7fc5d019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.388+0000 7fc5d610f640 1 --2- 172.21.15.63:0/3242143077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d0108c80 0x7fc5d01a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.388+0000 7fc5d590e640 1 -- 172.21.15.63:0/3242143077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5d0108330 msgr2=0x7fc5d019cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.388+0000 7fc5d590e640 1 --2- 172.21.15.63:0/3242143077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5d0108330 0x7fc5d019cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.388+0000 7fc5d590e640 1 -- 172.21.15.63:0/3242143077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d0108c80 msgr2=0x7fc5d01a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.388+0000 7fc5d590e640 1 --2- 172.21.15.63:0/3242143077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d0108c80 0x7fc5d01a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.388+0000 7fc5d590e640 1 -- 172.21.15.63:0/3242143077 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d01a2520 con 0x7fc5d0102a00 2024-09-21T06:30:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.388+0000 7fc5d590e640 1 --2- 172.21.15.63:0/3242143077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5d0102a00 0x7fc5d019c680 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00c890 tx=0x7fc5cc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.388+0000 7fc5c6ffd640 1 -- 172.21.15.63:0/3242143077 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc004220 con 0x7fc5d0102a00 2024-09-21T06:30:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.388+0000 7fc5c6ffd640 1 -- 172.21.15.63:0/3242143077 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5cc0043c0 con 0x7fc5d0102a00 2024-09-21T06:30:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.388+0000 7fc5c6ffd640 1 -- 172.21.15.63:0/3242143077 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc004a00 con 0x7fc5d0102a00 2024-09-21T06:30:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.388+0000 7fc5d7b72640 1 -- 172.21.15.63:0/3242143077 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5d01a2810 con 0x7fc5d0102a00 2024-09-21T06:30:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.388+0000 7fc5d7b72640 1 -- 172.21.15.63:0/3242143077 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5d01a9030 con 0x7fc5d0102a00 2024-09-21T06:30:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.391+0000 7fc5debc2740 1 Processor -- start 2024-09-21T06:30:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.392+0000 7fc5debc2740 1 -- start start 2024-09-21T06:30:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.392+0000 7fc5c6ffd640 1 -- 172.21.15.63:0/3242143077 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fc5cc0079b0 con 0x7fc5d0102a00 2024-09-21T06:30:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.392+0000 7fc5debc2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564238431b0 0x556423be89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.392+0000 7fc5debc2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55642381a2f0 0x556423be8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.392+0000 7fc5debc2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564238224d0 0x556423be9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.392+0000 7fc5debc2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x556423b5d6f0 con 0x5564238431b0 2024-09-21T06:30:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.392+0000 7fc5debc2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556423b4cb20 con 0x55642381a2f0 2024-09-21T06:30:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.392+0000 7fc5debc2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556423b50930 con 0x5564238224d0 2024-09-21T06:30:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.392+0000 7fc5d610f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564238431b0 0x556423be89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.392+0000 7fc5d610f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564238431b0 0x556423be89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37070/0 (socket says 172.21.15.63:37070) 2024-09-21T06:30:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.392+0000 7fc5d610f640 1 -- 172.21.15.63:0/460457332 learned_addr learned my addr 172.21.15.63:0/460457332 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.392+0000 7fc5d590e640 1 --2- 172.21.15.63:0/460457332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55642381a2f0 0x556423be8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.392+0000 7fc5d510d640 1 --2- 172.21.15.63:0/460457332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564238224d0 0x556423be9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.393+0000 7fc5d610f640 1 -- 172.21.15.63:0/460457332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564238224d0 msgr2=0x556423be9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.393+0000 7fc5d610f640 1 --2- 172.21.15.63:0/460457332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564238224d0 0x556423be9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.393+0000 7fc5d610f640 1 -- 172.21.15.63:0/460457332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55642381a2f0 msgr2=0x556423be8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.393+0000 7fc5d610f640 1 --2- 172.21.15.63:0/460457332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55642381a2f0 0x556423be8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.393+0000 7fc5d610f640 1 -- 172.21.15.63:0/460457332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556423b12530 con 0x5564238431b0 2024-09-21T06:30:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.393+0000 7fc5c6ffd640 1 --2- 172.21.15.63:0/3242143077 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc5bc0b6700 0x7fc5bc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.393+0000 7fc5d590e640 1 --2- 172.21.15.63:0/3242143077 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc5bc0b6700 0x7fc5bc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.393+0000 7fc5d610f640 1 --2- 172.21.15.63:0/460457332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564238431b0 0x556423be89b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009930 tx=0x7fc5c8009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab02524d1ecbeddc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.393+0000 7fc5c6ffd640 1 -- 172.21.15.63:0/3242143077 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fc5cc0e7490 con 0x7fc5d0102a00 2024-09-21T06:30:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.393+0000 7fc5bbfff640 1 -- 172.21.15.63:0/460457332 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8031df0 con 0x5564238431b0 2024-09-21T06:30:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.393+0000 7fc5bbfff640 1 -- 172.21.15.63:0/460457332 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5c8036040 con 0x5564238431b0 2024-09-21T06:30:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.393+0000 7fc5bbfff640 1 -- 172.21.15.63:0/460457332 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c80042a0 con 0x5564238431b0 2024-09-21T06:30:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.394+0000 7fc5debc2740 1 -- 172.21.15.63:0/460457332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564238431b0 msgr2=0x556423be89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.394+0000 7fc5d590e640 1 --2- 172.21.15.63:0/3242143077 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc5bc0b6700 0x7fc5bc0b8c10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0e4cd0 tx=0x7fc5cc0ec040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.394+0000 7fc5debc2740 1 --2- 172.21.15.63:0/460457332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564238431b0 0x556423be89b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009930 tx=0x7fc5c8009960 comp rx=0 tx=0).stop 2024-09-21T06:30:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.394+0000 7fc5debc2740 1 -- 172.21.15.63:0/460457332 shutdown_connections 2024-09-21T06:30:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.394+0000 7fc5debc2740 1 --2- 172.21.15.63:0/460457332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564238224d0 0x556423be9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.394+0000 7fc5debc2740 1 --2- 172.21.15.63:0/460457332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55642381a2f0 0x556423be8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.394+0000 7fc5debc2740 1 --2- 172.21.15.63:0/460457332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564238431b0 0x556423be89b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.394+0000 7fc5debc2740 1 -- 172.21.15.63:0/460457332 >> 172.21.15.63:0/460457332 conn(0x556423837300 msgr2=0x556423be68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.395+0000 7fc5debc2740 1 -- 172.21.15.63:0/460457332 shutdown_connections 2024-09-21T06:30:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.395+0000 7fc5debc2740 1 -- 172.21.15.63:0/460457332 wait complete. 2024-09-21T06:30:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.395+0000 7fc5debc2740 1 -- start start 2024-09-21T06:30:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.395+0000 7fc5debc2740 1 Processor -- start 2024-09-21T06:30:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.396+0000 7fc5debc2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55642381a2f0 0x556423bf4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.396+0000 7fc5debc2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564238224d0 0x556423bf4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.396+0000 7fc5debc2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564238431b0 0x556423c003c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.396+0000 7fc5debc2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x556423a84ab0 con 0x55642381a2f0 2024-09-21T06:30:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.396+0000 7fc5debc2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556423af2730 con 0x5564238431b0 2024-09-21T06:30:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.396+0000 7fc5debc2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556423bf70d0 con 0x5564238224d0 2024-09-21T06:30:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.396+0000 7fc5debc2740 10 client.0 _ll_register_callbacks cb 0x556423b466b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.396+0000 7fc5d610f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55642381a2f0 0x556423bf4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.396+0000 7fc5d610f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55642381a2f0 0x556423bf4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37078/0 (socket says 172.21.15.63:37078) 2024-09-21T06:30:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.396+0000 7fc5d610f640 1 -- 172.21.15.63:0/2511038578 learned_addr learned my addr 172.21.15.63:0/2511038578 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.396+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564238224d0 0x556423bf4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.396+0000 7fc5d610f640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564238431b0 0x556423c003c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.396+0000 7fc5d610f640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564238224d0 msgr2=0x556423bf4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.396+0000 7fc5d610f640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564238224d0 0x556423bf4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.396+0000 7fc5d610f640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564238431b0 msgr2=0x556423c003c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.396+0000 7fc5d610f640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564238431b0 0x556423c003c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.396+0000 7fc5d610f640 1 -- 172.21.15.63:0/2511038578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564238ae790 con 0x55642381a2f0 2024-09-21T06:30:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.396+0000 7fc5d610f640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55642381a2f0 0x556423bf4030 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8006010 tx=0x7fc5c8003da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbf1429c08f6d6f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.396+0000 7fc5b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:30:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.397+0000 7fc5b97fa640 1 -- 172.21.15.63:0/2511038578 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8058060 con 0x55642381a2f0 2024-09-21T06:30:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.397+0000 7fc5debc2740 1 -- 172.21.15.63:0/2511038578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5c8036040 con 0x55642381a2f0 2024-09-21T06:30:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.397+0000 7fc5b97fa640 1 -- 172.21.15.63:0/2511038578 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fc5c802f660 con 0x55642381a2f0 2024-09-21T06:30:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.397+0000 7fc5b97fa640 1 -- 172.21.15.63:0/2511038578 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc5c802f860 con 0x55642381a2f0 2024-09-21T06:30:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.397+0000 7fc5debc2740 10 client.15987 fetch_fsmap learned FSMap version 32 2024-09-21T06:30:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.397+0000 7fc5debc2740 1 -- 172.21.15.63:0/2511038578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556423927620 con 0x55642381a2f0 2024-09-21T06:30:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.397+0000 7fc5b97fa640 1 -- 172.21.15.63:0/2511038578 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5c8036040 con 0x55642381a2f0 2024-09-21T06:30:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.397+0000 7fc5b97fa640 1 -- 172.21.15.63:0/2511038578 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fc5c80043b0 con 0x55642381a2f0 2024-09-21T06:30:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.397+0000 7fc5debc2740 10 client.15987 fetch_fsmap finished waiting for FSMap version 32 2024-09-21T06:30:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.397+0000 7fc5debc2740 10 client.15987 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:30:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.397+0000 7fc5debc2740 20 client.15987 populate_metadata read hostname 'smithi063' 2024-09-21T06:30:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.397+0000 7fc5debc2740 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.397+0000 7fc5debc2740 4 client.15987 mds_command: new command op to 24698 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:30:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.397+0000 7fc5debc2740 1 -- 172.21.15.63:0/2511038578 --> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556423b5f640 con 0x556423801d80 2024-09-21T06:30:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.398+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:6838/3472481253 2024-09-21T06:30:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.398+0000 7fc5b97fa640 1 client.15987 ms_handle_refused on v2:172.21.15.71:6838/3472481253 2024-09-21T06:30:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.398+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T06:30:12.600 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.599+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:6838/3472481253 2024-09-21T06:30:12.600 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.599+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-21T06:30:12.600 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:12.599+0000 7fc5b97fa640 1 client.15987 ms_handle_refused on v2:172.21.15.71:6838/3472481253 2024-09-21T06:30:13.002 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:13.000+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:6838/3472481253 2024-09-21T06:30:13.002 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:13.000+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-21T06:30:13.002 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:13.000+0000 7fc5b97fa640 1 client.15987 ms_handle_refused on v2:172.21.15.71:6838/3472481253 2024-09-21T06:30:13.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:13 smithi071 ceph-mon[34844]: pgmap v382: 97 pgs: 97 active+clean; 35 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 1021 KiB/s wr, 648 op/s 2024-09-21T06:30:13.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:13 smithi063 ceph-mon[31150]: pgmap v382: 97 pgs: 97 active+clean; 35 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 1021 KiB/s wr, 648 op/s 2024-09-21T06:30:13.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:13 smithi175 ceph-mon[34510]: pgmap v382: 97 pgs: 97 active+clean; 35 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 1021 KiB/s wr, 648 op/s 2024-09-21T06:30:13.803 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:13.801+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:6838/3472481253 2024-09-21T06:30:13.803 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:13.801+0000 7fc5b97fa640 1 client.15987 ms_handle_refused on v2:172.21.15.71:6838/3472481253 2024-09-21T06:30:13.803 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:13.801+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-21T06:30:15.404 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:15.403+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:6838/3472481253 2024-09-21T06:30:15.405 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:15.403+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-21T06:30:15.405 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:15.403+0000 7fc5b97fa640 1 client.15987 ms_handle_refused on v2:172.21.15.71:6838/3472481253 2024-09-21T06:30:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:15 smithi071 ceph-mon[34844]: pgmap v383: 97 pgs: 97 active+clean; 35 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 480 KiB/s wr, 205 op/s 2024-09-21T06:30:15.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:15 smithi063 ceph-mon[31150]: pgmap v383: 97 pgs: 97 active+clean; 35 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 480 KiB/s wr, 205 op/s 2024-09-21T06:30:15.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:15 smithi175 ceph-mon[34510]: pgmap v383: 97 pgs: 97 active+clean; 35 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 480 KiB/s wr, 205 op/s 2024-09-21T06:30:15.795 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:15 smithi071 systemd[1]: ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.b.service: Scheduled restart job, restart counter is at 1. 2024-09-21T06:30:15.796 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:15 smithi071 systemd[1]: Stopped Ceph mds.b for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:30:15.796 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:15 smithi071 systemd[1]: ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.b.service: Consumed 28.681s CPU time. 2024-09-21T06:30:15.796 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:15 smithi071 systemd[1]: Starting Ceph mds.b for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:30:15.796 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:15 smithi071 podman[65759]: 2024-09-21 06:30:15.648509083 +0000 UTC m=+0.016413158 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:30:15.796 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:15 smithi071 podman[65759]: 2024-09-21 06:30:15.79501938 +0000 UTC m=+0.162923447 container create a851cf22920a40afcc65d46de0d0061adf5be20a053065543b61e0010fcf0db7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T06:30:16.336 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:16 smithi071 podman[65759]: 2024-09-21 06:30:16.064826253 +0000 UTC m=+0.432730321 container init a851cf22920a40afcc65d46de0d0061adf5be20a053065543b61e0010fcf0db7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T06:30:16.336 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:16 smithi071 podman[65759]: 2024-09-21 06:30:16.067739556 +0000 UTC m=+0.435643622 container start a851cf22920a40afcc65d46de0d0061adf5be20a053065543b61e0010fcf0db7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:30:16.336 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:16 smithi071 ceph-mds[65778]: -- 172.21.15.71:0/724355521 <== mon.2 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559843bd5860 con 0x559847d7da80 2024-09-21T06:30:16.336 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:16 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[65774]: starting mds.b at 2024-09-21T06:30:16.336 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:16 smithi071 bash[65759]: a851cf22920a40afcc65d46de0d0061adf5be20a053065543b61e0010fcf0db7 2024-09-21T06:30:16.336 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:30:16 smithi071 systemd[1]: Started Ceph mds.b for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:30:16.336 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:16 smithi071 ceph-mon[34844]: daemon mds.b restarted 2024-09-21T06:30:16.336 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:16 smithi071 ceph-mon[34844]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:30:16.337 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:16 smithi071 ceph-mon[34844]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T06:30:16.337 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:16 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.71:6838/3354670524,v1:172.21.15.71:6839/3354670524] up:boot 2024-09-21T06:30:16.337 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:16 smithi071 ceph-mon[34844]: Standby daemon mds.h assigned to filesystem cephfs as rank 0 2024-09-21T06:30:16.337 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:16 smithi071 ceph-mon[34844]: fsmap cephfs:4/5 {1=i=up:active,2=c=up:active,3=f=up:active,4=a=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-09-21T06:30:16.337 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:16 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:30:16.337 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:16 smithi071 ceph-mon[34844]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-09-21T06:30:16.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:16 smithi063 ceph-mon[31150]: daemon mds.b restarted 2024-09-21T06:30:16.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:16 smithi063 ceph-mon[31150]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:30:16.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:16 smithi063 ceph-mon[31150]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T06:30:16.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:16 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.71:6838/3354670524,v1:172.21.15.71:6839/3354670524] up:boot 2024-09-21T06:30:16.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:16 smithi063 ceph-mon[31150]: Standby daemon mds.h assigned to filesystem cephfs as rank 0 2024-09-21T06:30:16.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:16 smithi063 ceph-mon[31150]: fsmap cephfs:4/5 {1=i=up:active,2=c=up:active,3=f=up:active,4=a=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-09-21T06:30:16.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:16 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:30:16.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:16 smithi063 ceph-mon[31150]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-09-21T06:30:16.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:16 smithi175 ceph-mon[34510]: daemon mds.b restarted 2024-09-21T06:30:16.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:16 smithi175 ceph-mon[34510]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:30:16.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:16 smithi175 ceph-mon[34510]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T06:30:16.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:16 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.71:6838/3354670524,v1:172.21.15.71:6839/3354670524] up:boot 2024-09-21T06:30:16.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:16 smithi175 ceph-mon[34510]: Standby daemon mds.h assigned to filesystem cephfs as rank 0 2024-09-21T06:30:16.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:16 smithi175 ceph-mon[34510]: fsmap cephfs:4/5 {1=i=up:active,2=c=up:active,3=f=up:active,4=a=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-09-21T06:30:16.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:16 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:30:16.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:16 smithi175 ceph-mon[34510]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-09-21T06:30:17.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:17 smithi071 ceph-mon[34844]: pgmap v384: 97 pgs: 97 active+clean; 35 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 380 KiB/s wr, 119 op/s 2024-09-21T06:30:17.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:17 smithi063 ceph-mon[31150]: pgmap v384: 97 pgs: 97 active+clean; 35 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 380 KiB/s wr, 119 op/s 2024-09-21T06:30:17.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:17 smithi175 ceph-mon[34510]: pgmap v384: 97 pgs: 97 active+clean; 35 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 380 KiB/s wr, 119 op/s 2024-09-21T06:30:18.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:18 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] up:resolve 2024-09-21T06:30:18.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:18 smithi071 ceph-mon[34844]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:resolve 4 up:active 2024-09-21T06:30:18.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:18 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] up:resolve 2024-09-21T06:30:18.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:18 smithi063 ceph-mon[31150]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:resolve 4 up:active 2024-09-21T06:30:18.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:18 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] up:resolve 2024-09-21T06:30:18.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:18 smithi175 ceph-mon[34510]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:resolve 4 up:active 2024-09-21T06:30:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:18.606+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:18.606+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-21T06:30:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:18.606+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-21T06:30:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:18.606+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T06:30:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:18.606+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-09-21T06:30:19.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:19 smithi071 ceph-mon[34844]: pgmap v386: 97 pgs: 97 active+clean; 36 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 94 KiB/s wr, 47 op/s 2024-09-21T06:30:19.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:19 smithi071 ceph-mon[34844]: reconnect by client.25352 172.21.15.63:0/290672154 after 0.000999983 2024-09-21T06:30:19.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:19 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] up:reconnect 2024-09-21T06:30:19.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:19 smithi071 ceph-mon[34844]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:reconnect 4 up:active 2024-09-21T06:30:19.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:19 smithi071 ceph-mon[34844]: reconnect by client.15432 192.168.0.1:0/1517247081 after 0.0149997 2024-09-21T06:30:19.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:19 smithi063 ceph-mon[31150]: pgmap v386: 97 pgs: 97 active+clean; 36 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 94 KiB/s wr, 47 op/s 2024-09-21T06:30:19.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:19 smithi063 ceph-mon[31150]: reconnect by client.25352 172.21.15.63:0/290672154 after 0.000999983 2024-09-21T06:30:19.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:19 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] up:reconnect 2024-09-21T06:30:19.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:19 smithi063 ceph-mon[31150]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:reconnect 4 up:active 2024-09-21T06:30:19.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:19 smithi063 ceph-mon[31150]: reconnect by client.15432 192.168.0.1:0/1517247081 after 0.0149997 2024-09-21T06:30:19.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:19 smithi175 ceph-mon[34510]: pgmap v386: 97 pgs: 97 active+clean; 36 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 94 KiB/s wr, 47 op/s 2024-09-21T06:30:19.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:19 smithi175 ceph-mon[34510]: reconnect by client.25352 172.21.15.63:0/290672154 after 0.000999983 2024-09-21T06:30:19.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:19 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] up:reconnect 2024-09-21T06:30:19.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:19 smithi175 ceph-mon[34510]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:reconnect 4 up:active 2024-09-21T06:30:19.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:19 smithi175 ceph-mon[34510]: reconnect by client.15432 192.168.0.1:0/1517247081 after 0.0149997 2024-09-21T06:30:20.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:20 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] up:rejoin 2024-09-21T06:30:20.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:20 smithi071 ceph-mon[34844]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:rejoin 4 up:active 2024-09-21T06:30:20.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:20 smithi071 ceph-mon[34844]: daemon mds.h is now active in filesystem cephfs as rank 0 2024-09-21T06:30:20.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:20 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] up:rejoin 2024-09-21T06:30:20.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:20 smithi063 ceph-mon[31150]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:rejoin 4 up:active 2024-09-21T06:30:20.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:20 smithi063 ceph-mon[31150]: daemon mds.h is now active in filesystem cephfs as rank 0 2024-09-21T06:30:20.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:20 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] up:rejoin 2024-09-21T06:30:20.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:20 smithi175 ceph-mon[34510]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:rejoin 4 up:active 2024-09-21T06:30:20.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:20 smithi175 ceph-mon[34510]: daemon mds.h is now active in filesystem cephfs as rank 0 2024-09-21T06:30:21.516 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:21 smithi175 ceph-mon[34510]: pgmap v387: 97 pgs: 97 active+clean; 36 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 82 KiB/s wr, 61 op/s 2024-09-21T06:30:21.516 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:21 smithi175 ceph-mon[34510]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:30:21.516 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:21 smithi175 ceph-mon[34510]: Cluster is now healthy 2024-09-21T06:30:21.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:21 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] up:active 2024-09-21T06:30:21.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:21 smithi175 ceph-mon[34510]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-21T06:30:21.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:21 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:30:21.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:21 smithi071 ceph-mon[34844]: pgmap v387: 97 pgs: 97 active+clean; 36 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 82 KiB/s wr, 61 op/s 2024-09-21T06:30:21.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:21 smithi071 ceph-mon[34844]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:30:21.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:21 smithi071 ceph-mon[34844]: Cluster is now healthy 2024-09-21T06:30:21.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:21 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] up:active 2024-09-21T06:30:21.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:21 smithi071 ceph-mon[34844]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-21T06:30:21.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:21 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:30:21.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:21 smithi063 ceph-mon[31150]: pgmap v387: 97 pgs: 97 active+clean; 36 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 82 KiB/s wr, 61 op/s 2024-09-21T06:30:21.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:21 smithi063 ceph-mon[31150]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:30:21.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:21 smithi063 ceph-mon[31150]: Cluster is now healthy 2024-09-21T06:30:21.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:21 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] up:active 2024-09-21T06:30:21.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:21 smithi063 ceph-mon[31150]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-21T06:30:21.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:21 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:30:23.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:23 smithi071 ceph-mon[34844]: pgmap v388: 97 pgs: 97 active+clean; 36 MiB data, 505 MiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 84 KiB/s wr, 66 op/s 2024-09-21T06:30:23.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:23 smithi063 ceph-mon[31150]: pgmap v388: 97 pgs: 97 active+clean; 36 MiB data, 505 MiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 84 KiB/s wr, 66 op/s 2024-09-21T06:30:23.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:23 smithi175 ceph-mon[34510]: pgmap v388: 97 pgs: 97 active+clean; 36 MiB data, 505 MiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 84 KiB/s wr, 66 op/s 2024-09-21T06:30:24.019 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 21 06:30:23 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-h[63701]: 2024-09-21T06:30:23.591+0000 7f1048bdb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:30:24.019 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 21 06:30:23 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-h[63701]: 2024-09-21T06:30:23.591+0000 7f1048bdb640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-21T06:30:24.019 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 21 06:30:23 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-h[63701]: 2024-09-21T06:30:23.591+0000 7f1048bdb640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-21T06:30:24.019 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 21 06:30:23 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-h[63701]: 2024-09-21T06:30:23.591+0000 7f1048bdb640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-21T06:30:24.019 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 21 06:30:23 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-h[63701]: 2024-09-21T06:30:23.591+0000 7f1048bdb640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-21T06:30:25.015 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:25.012+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:25.015 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:25.012+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-21T06:30:25.015 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:25.012+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-21T06:30:25.015 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:25.012+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T06:30:25.015 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:25.012+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-09-21T06:30:25.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:25 smithi071 ceph-mon[34844]: pgmap v389: 97 pgs: 97 active+clean; 42 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 781 KiB/s wr, 101 op/s 2024-09-21T06:30:25.551 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:30:25.577 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:25 smithi063 ceph-mon[31150]: pgmap v389: 97 pgs: 97 active+clean; 42 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 781 KiB/s wr, 101 op/s 2024-09-21T06:30:25.598 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:25 smithi175 ceph-mon[34510]: pgmap v389: 97 pgs: 97 active+clean; 42 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 781 KiB/s wr, 101 op/s 2024-09-21T06:30:25.823 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:26.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.313+0000 7f09cfac4640 1 -- 172.21.15.63:0/3771646597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09c810de10 msgr2=0x7f09c8110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.313+0000 7f09cfac4640 1 --2- 172.21.15.63:0/3771646597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09c810de10 0x7f09c8110300 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f09c0009ca0 tx=0x7f09c002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.313+0000 7f09cfac4640 1 -- 172.21.15.63:0/3771646597 shutdown_connections 2024-09-21T06:30:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.313+0000 7f09cfac4640 1 --2- 172.21.15.63:0/3771646597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09c810de10 0x7f09c8110300 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.313+0000 7f09cfac4640 1 --2- 172.21.15.63:0/3771646597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c8105300 0x7f09c810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.313+0000 7f09cfac4640 1 --2- 172.21.15.63:0/3771646597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09c81049b0 0x7f09c8104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.313+0000 7f09cfac4640 1 -- 172.21.15.63:0/3771646597 >> 172.21.15.63:0/3771646597 conn(0x7f09c8079730 msgr2=0x7f09c8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.315+0000 7f09cfac4640 1 -- 172.21.15.63:0/3771646597 shutdown_connections 2024-09-21T06:30:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.315+0000 7f09cfac4640 1 -- 172.21.15.63:0/3771646597 wait complete. 2024-09-21T06:30:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09cfac4640 1 Processor -- start 2024-09-21T06:30:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09cfac4640 1 -- start start 2024-09-21T06:30:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09cfac4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09c81049b0 0x7f09c819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09cfac4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09c8105300 0x7f09c819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09cfac4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c810de10 0x7f09c819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09cfac4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f09c8113a90 con 0x7f09c8105300 2024-09-21T06:30:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09cfac4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f09c8113910 con 0x7f09c810de10 2024-09-21T06:30:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09cfac4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f09c8113c10 con 0x7f09c81049b0 2024-09-21T06:30:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09cd860640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09c81049b0 0x7f09c819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09cd05f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09c8105300 0x7f09c819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09cd860640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09c81049b0 0x7f09c819a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:36808/0 (socket says 172.21.15.63:36808) 2024-09-21T06:30:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09cd860640 1 -- 172.21.15.63:0/3346742428 learned_addr learned my addr 172.21.15.63:0/3346742428 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09ce061640 1 --2- 172.21.15.63:0/3346742428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c810de10 0x7f09c819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:26.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09cd860640 1 -- 172.21.15.63:0/3346742428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c810de10 msgr2=0x7f09c819fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:26.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09cd860640 1 --2- 172.21.15.63:0/3346742428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c810de10 0x7f09c819fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09cd860640 1 -- 172.21.15.63:0/3346742428 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09c8105300 msgr2=0x7f09c819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:26.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09cd860640 1 --2- 172.21.15.63:0/3346742428 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09c8105300 0x7f09c819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09cd860640 1 -- 172.21.15.63:0/3346742428 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c81a03d0 con 0x7f09c81049b0 2024-09-21T06:30:26.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09cd860640 1 --2- 172.21.15.63:0/3346742428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09c81049b0 0x7f09c819a460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f09c400e9c0 tx=0x7f09c400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:26.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09beffd640 1 -- 172.21.15.63:0/3346742428 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c400cd80 con 0x7f09c81049b0 2024-09-21T06:30:26.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09beffd640 1 -- 172.21.15.63:0/3346742428 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09c40035f0 con 0x7f09c81049b0 2024-09-21T06:30:26.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09cfac4640 1 -- 172.21.15.63:0/3346742428 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c81a06c0 con 0x7f09c81049b0 2024-09-21T06:30:26.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09beffd640 1 -- 172.21.15.63:0/3346742428 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c4010690 con 0x7f09c81049b0 2024-09-21T06:30:26.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.316+0000 7f09cfac4640 1 -- 172.21.15.63:0/3346742428 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c81025d0 con 0x7f09c81049b0 2024-09-21T06:30:26.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.319+0000 7f09d6038740 1 Processor -- start 2024-09-21T06:30:26.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.319+0000 7f09d6038740 1 -- start start 2024-09-21T06:30:26.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.319+0000 7f09beffd640 1 -- 172.21.15.63:0/3346742428 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f09c4010830 con 0x7f09c81049b0 2024-09-21T06:30:26.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.319+0000 7f09d6038740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602443a0070 0x560244747270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:26.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.319+0000 7f09d6038740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602443771b0 0x5602447477b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:26.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.319+0000 7f09d6038740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56024437f390 0x560244747cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:26.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.319+0000 7f09d6038740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5602446bde50 con 0x5602443771b0 2024-09-21T06:30:26.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.319+0000 7f09d6038740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5602446ad280 con 0x56024437f390 2024-09-21T06:30:26.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.319+0000 7f09d6038740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5602446b1090 con 0x5602443a0070 2024-09-21T06:30:26.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.320+0000 7f09cd860640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602443771b0 0x5602447477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:26.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.320+0000 7f09ce061640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602443a0070 0x560244747270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:26.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.320+0000 7f09ce061640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602443a0070 0x560244747270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:36816/0 (socket says 172.21.15.63:36816) 2024-09-21T06:30:26.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.320+0000 7f09ce061640 1 -- 172.21.15.63:0/1301155667 learned_addr learned my addr 172.21.15.63:0/1301155667 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:26.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.320+0000 7f09cd05f640 1 --2- 172.21.15.63:0/1301155667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56024437f390 0x560244747cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:26.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.320+0000 7f09ce061640 1 -- 172.21.15.63:0/1301155667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56024437f390 msgr2=0x560244747cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:26.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.320+0000 7f09ce061640 1 --2- 172.21.15.63:0/1301155667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56024437f390 0x560244747cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.320+0000 7f09ce061640 1 -- 172.21.15.63:0/1301155667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602443771b0 msgr2=0x5602447477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.320+0000 7f09ce061640 1 --2- 172.21.15.63:0/1301155667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602443771b0 0x5602447477b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.320+0000 7f09ce061640 1 -- 172.21.15.63:0/1301155667 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56024440b650 con 0x5602443a0070 2024-09-21T06:30:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.320+0000 7f09cd05f640 1 --2- 172.21.15.63:0/1301155667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56024437f390 0x560244747cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.320+0000 7f09cd860640 1 --2- 172.21.15.63:0/1301155667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602443771b0 0x5602447477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:30:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.320+0000 7f09ce061640 1 --2- 172.21.15.63:0/1301155667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602443a0070 0x560244747270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f09c002f410 tx=0x7f09c002f440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae1eac8c872c85e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.320+0000 7f09beffd640 1 --2- 172.21.15.63:0/3346742428 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f09b40b6680 0x7f09b40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.320+0000 7f09b3fff640 1 -- 172.21.15.63:0/1301155667 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c0031cf0 con 0x5602443a0070 2024-09-21T06:30:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.320+0000 7f09cd860640 1 --2- 172.21.15.63:0/3346742428 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f09b40b6680 0x7f09b40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.321+0000 7f09b3fff640 1 -- 172.21.15.63:0/1301155667 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09c0036030 con 0x5602443a0070 2024-09-21T06:30:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.321+0000 7f09b3fff640 1 -- 172.21.15.63:0/1301155667 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c00042a0 con 0x5602443a0070 2024-09-21T06:30:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.321+0000 7f09beffd640 1 -- 172.21.15.63:0/3346742428 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f09c40e7c80 con 0x7f09c81049b0 2024-09-21T06:30:26.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.321+0000 7f09d6038740 1 -- 172.21.15.63:0/1301155667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602443a0070 msgr2=0x560244747270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:26.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.321+0000 7f09cd860640 1 --2- 172.21.15.63:0/3346742428 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f09b40b6680 0x7f09b40b8b90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f09c40e5460 tx=0x7f09c4003e70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:26.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.321+0000 7f09d6038740 1 --2- 172.21.15.63:0/1301155667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602443a0070 0x560244747270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f09c002f410 tx=0x7f09c002f440 comp rx=0 tx=0).stop 2024-09-21T06:30:26.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.321+0000 7f09d6038740 1 -- 172.21.15.63:0/1301155667 shutdown_connections 2024-09-21T06:30:26.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.322+0000 7f09d6038740 1 --2- 172.21.15.63:0/1301155667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56024437f390 0x560244747cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.322+0000 7f09d6038740 1 --2- 172.21.15.63:0/1301155667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602443771b0 0x5602447477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.322+0000 7f09d6038740 1 --2- 172.21.15.63:0/1301155667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602443a0070 0x560244747270 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.322+0000 7f09d6038740 1 -- 172.21.15.63:0/1301155667 >> 172.21.15.63:0/1301155667 conn(0x560244394460 msgr2=0x560244745160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:26.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.322+0000 7f09d6038740 1 -- 172.21.15.63:0/1301155667 shutdown_connections 2024-09-21T06:30:26.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.322+0000 7f09d6038740 1 -- 172.21.15.63:0/1301155667 wait complete. 2024-09-21T06:30:26.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.322+0000 7f09d6038740 1 -- start start 2024-09-21T06:30:26.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.322+0000 7f09d6038740 1 Processor -- start 2024-09-21T06:30:26.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.323+0000 7f09d6038740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602443771b0 0x560244752900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:26.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.323+0000 7f09d6038740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024437f390 0x560244752e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:26.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.323+0000 7f09d6038740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602443a0070 0x56024475eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.323+0000 7f09d6038740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56024450e700 con 0x5602443771b0 2024-09-21T06:30:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.323+0000 7f09d6038740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560244648110 con 0x5602443a0070 2024-09-21T06:30:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.323+0000 7f09d6038740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560244755870 con 0x56024437f390 2024-09-21T06:30:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.323+0000 7f09ce061640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602443771b0 0x560244752900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.323+0000 7f09d6038740 10 client.0 _ll_register_callbacks cb 0x560244661990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.323+0000 7f09ce061640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602443771b0 0x560244752900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41608/0 (socket says 172.21.15.63:41608) 2024-09-21T06:30:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.323+0000 7f09ce061640 1 -- 172.21.15.63:0/978815384 learned_addr learned my addr 172.21.15.63:0/978815384 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.323+0000 7f09cd05f640 1 --2- 172.21.15.63:0/978815384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024437f390 0x560244752e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.323+0000 7f09ce061640 1 --2- 172.21.15.63:0/978815384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602443a0070 0x56024475eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.323+0000 7f09cd05f640 1 -- 172.21.15.63:0/978815384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602443a0070 msgr2=0x56024475eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.323+0000 7f09cd05f640 1 --2- 172.21.15.63:0/978815384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602443a0070 0x56024475eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.323+0000 7f09cd05f640 1 -- 172.21.15.63:0/978815384 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602443771b0 msgr2=0x560244752900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.323+0000 7f09cd05f640 1 --2- 172.21.15.63:0/978815384 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602443771b0 0x560244752900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.323+0000 7f09cd05f640 1 -- 172.21.15.63:0/978815384 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560244675c40 con 0x56024437f390 2024-09-21T06:30:26.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.323+0000 7f09cd05f640 1 --2- 172.21.15.63:0/978815384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024437f390 0x560244752e40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f09c806aaa0 tx=0x7f09b8009d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9302ccf4edb2be9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:26.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.323+0000 7f09b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:30:26.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.324+0000 7f09b17fa640 1 -- 172.21.15.63:0/978815384 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b801f020 con 0x56024437f390 2024-09-21T06:30:26.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.324+0000 7f09d6038740 1 -- 172.21.15.63:0/978815384 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09c0036030 con 0x56024437f390 2024-09-21T06:30:26.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.324+0000 7f09b17fa640 1 -- 172.21.15.63:0/978815384 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f09b800b790 con 0x56024437f390 2024-09-21T06:30:26.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.324+0000 7f09b17fa640 1 -- 172.21.15.63:0/978815384 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f09b802a050 con 0x56024437f390 2024-09-21T06:30:26.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.324+0000 7f09d6038740 10 client.25714 fetch_fsmap learned FSMap version 39 2024-09-21T06:30:26.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.324+0000 7f09d6038740 1 -- 172.21.15.63:0/978815384 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x560244761600 con 0x56024437f390 2024-09-21T06:30:26.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.324+0000 7f09b17fa640 1 -- 172.21.15.63:0/978815384 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09c0036030 con 0x56024437f390 2024-09-21T06:30:26.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.324+0000 7f09b17fa640 1 -- 172.21.15.63:0/978815384 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f09b8003b00 con 0x56024437f390 2024-09-21T06:30:26.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.324+0000 7f09d6038740 10 client.25714 fetch_fsmap finished waiting for FSMap version 39 2024-09-21T06:30:26.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.324+0000 7f09d6038740 10 client.25714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:30:26.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.324+0000 7f09d6038740 20 client.25714 populate_metadata read hostname 'smithi063' 2024-09-21T06:30:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.324+0000 7f09d6038740 1 --2- 172.21.15.63:0/978815384 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x56024435e9f0 0x560244764ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.324+0000 7f09d6038740 4 client.25714 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:30:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.324+0000 7f09d6038740 1 -- 172.21.15.63:0/978815384 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602446bfda0 con 0x56024435e9f0 2024-09-21T06:30:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.325+0000 7f09ce061640 1 --2- 172.21.15.63:0/978815384 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x56024435e9f0 0x560244764ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.325+0000 7f09b17fa640 10 client.25714 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:30:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.325+0000 7f09ce061640 1 --2- 172.21.15.63:0/978815384 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x56024435e9f0 0x560244764ab0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7170a6b3701d52a server_cookie=f9234f5095cef075 in_seq=0 out_seq=0 2024-09-21T06:30:26.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.326+0000 7f09b17fa640 1 -- 172.21.15.63:0/978815384 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5602446bfda0 con 0x56024435e9f0 2024-09-21T06:30:26.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.326+0000 7f09b17fa640 10 client.25714 handle_command_reply: tid=0 2024-09-21T06:30:26.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.326+0000 7f09d6038740 1 client.25714 shutdown 2024-09-21T06:30:26.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.327+0000 7f09d6038740 1 -- 172.21.15.63:0/978815384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024437f390 msgr2=0x560244752e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:26.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.327+0000 7f09d6038740 1 --2- 172.21.15.63:0/978815384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024437f390 0x560244752e40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f09c806aaa0 tx=0x7f09b8009d80 comp rx=0 tx=0).stop 2024-09-21T06:30:26.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.327+0000 7f09d6038740 1 -- 172.21.15.63:0/978815384 shutdown_connections 2024-09-21T06:30:26.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.327+0000 7f09d6038740 1 --2- 172.21.15.63:0/978815384 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x56024435e9f0 0x560244764ab0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.327+0000 7f09d6038740 1 --2- 172.21.15.63:0/978815384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602443a0070 0x56024475eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.327+0000 7f09d6038740 1 --2- 172.21.15.63:0/978815384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024437f390 0x560244752e40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.327+0000 7f09b17fa640 0 client.25714 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:30:26.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.327+0000 7f09d6038740 1 --2- 172.21.15.63:0/978815384 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602443771b0 0x560244752900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.327+0000 7f09d6038740 1 -- 172.21.15.63:0/978815384 >> 172.21.15.63:0/978815384 conn(0x560244394460 msgr2=0x56024474a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:26.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.327+0000 7f09d6038740 1 -- 172.21.15.63:0/978815384 shutdown_connections 2024-09-21T06:30:26.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.327+0000 7f09d6038740 1 -- 172.21.15.63:0/978815384 wait complete. 2024-09-21T06:30:26.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.327+0000 7f09d6038740 20 client.25714 trim_cache size 0 max 16384 2024-09-21T06:30:26.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.345+0000 7f09d6038740 1 Processor -- start 2024-09-21T06:30:26.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.345+0000 7f09d6038740 1 -- start start 2024-09-21T06:30:26.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.346+0000 7f09d6038740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024435e9f0 0x560244752dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:26.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.346+0000 7f09d6038740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602443771b0 0x56024475ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:26.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.346+0000 7f09d6038740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56024437f390 0x56024474faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:26.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.346+0000 7f09d6038740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f09c81ad470 con 0x5602443771b0 2024-09-21T06:30:26.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.346+0000 7f09d6038740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f09c81aefb0 con 0x56024437f390 2024-09-21T06:30:26.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.346+0000 7f09d6038740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f09c81adb40 con 0x56024435e9f0 2024-09-21T06:30:26.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.346+0000 7f09cd05f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602443771b0 0x56024475ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:26.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.346+0000 7f09cd05f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602443771b0 0x56024475ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41622/0 (socket says 172.21.15.63:41622) 2024-09-21T06:30:26.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.346+0000 7f09cd05f640 1 -- 172.21.15.63:0/872684520 learned_addr learned my addr 172.21.15.63:0/872684520 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:26.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.346+0000 7f09ce061640 1 --2- 172.21.15.63:0/872684520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024435e9f0 0x560244752dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:26.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.346+0000 7f09ce061640 1 --2- 172.21.15.63:0/872684520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56024437f390 0x56024474faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:26.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.346+0000 7f09ce061640 1 -- 172.21.15.63:0/872684520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56024437f390 msgr2=0x56024474faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:26.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.346+0000 7f09ce061640 1 --2- 172.21.15.63:0/872684520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56024437f390 0x56024474faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.346+0000 7f09ce061640 1 -- 172.21.15.63:0/872684520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602443771b0 msgr2=0x56024475ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:26.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.346+0000 7f09ce061640 1 --2- 172.21.15.63:0/872684520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602443771b0 0x56024475ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.346+0000 7f09ce061640 1 -- 172.21.15.63:0/872684520 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602447557b0 con 0x56024435e9f0 2024-09-21T06:30:26.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.346+0000 7f09cd05f640 1 --2- 172.21.15.63:0/872684520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602443771b0 0x56024475ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:26.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.346+0000 7f09ce061640 1 --2- 172.21.15.63:0/872684520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024435e9f0 0x560244752dc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f09c00094e0 tx=0x7f09c0003cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=959bb9e1ef260ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:26.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.347+0000 7f09b37fe640 1 -- 172.21.15.63:0/872684520 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c0031450 con 0x56024435e9f0 2024-09-21T06:30:26.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.347+0000 7f09b37fe640 1 -- 172.21.15.63:0/872684520 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09c0036040 con 0x56024435e9f0 2024-09-21T06:30:26.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.347+0000 7f09b37fe640 1 -- 172.21.15.63:0/872684520 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c00305c0 con 0x56024435e9f0 2024-09-21T06:30:26.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.347+0000 7f09d6038740 1 -- 172.21.15.63:0/872684520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024435e9f0 msgr2=0x560244752dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:26.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.347+0000 7f09d6038740 1 --2- 172.21.15.63:0/872684520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024435e9f0 0x560244752dc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f09c00094e0 tx=0x7f09c0003cd0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.347+0000 7f09d6038740 1 -- 172.21.15.63:0/872684520 shutdown_connections 2024-09-21T06:30:26.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.347+0000 7f09d6038740 1 --2- 172.21.15.63:0/872684520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56024437f390 0x56024474faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.347+0000 7f09d6038740 1 --2- 172.21.15.63:0/872684520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5602443771b0 0x56024475ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.347+0000 7f09d6038740 1 --2- 172.21.15.63:0/872684520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024435e9f0 0x560244752dc0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.348+0000 7f09d6038740 1 -- 172.21.15.63:0/872684520 >> 172.21.15.63:0/872684520 conn(0x560244394460 msgr2=0x5602447526b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:26.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.348+0000 7f09d6038740 1 -- 172.21.15.63:0/872684520 shutdown_connections 2024-09-21T06:30:26.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.348+0000 7f09d6038740 1 -- 172.21.15.63:0/872684520 wait complete. 2024-09-21T06:30:26.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.348+0000 7f09d6038740 1 -- start start 2024-09-21T06:30:26.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.348+0000 7f09d6038740 1 Processor -- start 2024-09-21T06:30:26.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.349+0000 7f09d6038740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024435e9f0 0x560244756ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:26.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.349+0000 7f09d6038740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602443771b0 0x560244757460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:26.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.349+0000 7f09d6038740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56024437f390 0x5602447ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:26.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.349+0000 7f09d6038740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f09c81ae8e0 con 0x56024437f390 2024-09-21T06:30:26.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.349+0000 7f09d6038740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f09c81ae210 con 0x5602443771b0 2024-09-21T06:30:26.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.349+0000 7f09d6038740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f09c81ab470 con 0x56024435e9f0 2024-09-21T06:30:26.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.349+0000 7f09d6038740 10 client.0 _ll_register_callbacks cb 0x7f09b8010ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:26.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.349+0000 7f09ce061640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56024437f390 0x5602447ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:26.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.349+0000 7f09cd05f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602443771b0 0x560244757460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:26.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.349+0000 7f09ce061640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56024437f390 0x5602447ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41632/0 (socket says 172.21.15.63:41632) 2024-09-21T06:30:26.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.349+0000 7f09ce061640 1 -- 172.21.15.63:0/281731200 learned_addr learned my addr 172.21.15.63:0/281731200 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:26.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.349+0000 7f09ce061640 1 --2- 172.21.15.63:0/281731200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024435e9f0 0x560244756ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:26.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.349+0000 7f09cd05f640 1 -- 172.21.15.63:0/281731200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024435e9f0 msgr2=0x560244756ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:26.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.349+0000 7f09cd05f640 1 --2- 172.21.15.63:0/281731200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024435e9f0 0x560244756ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.349+0000 7f09cd05f640 1 -- 172.21.15.63:0/281731200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56024437f390 msgr2=0x5602447ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:26.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.349+0000 7f09cd05f640 1 --2- 172.21.15.63:0/281731200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56024437f390 0x5602447ce470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.349+0000 7f09cd05f640 1 -- 172.21.15.63:0/281731200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56024473f410 con 0x5602443771b0 2024-09-21T06:30:26.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.349+0000 7f09cd05f640 1 --2- 172.21.15.63:0/281731200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602443771b0 0x560244757460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x5602447378b0 tx=0x7f09b801b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9504e34c13bbfc5e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:26.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.349+0000 7f09b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:30:26.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.350+0000 7f09b17fa640 1 -- 172.21.15.63:0/281731200 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b801f070 con 0x5602443771b0 2024-09-21T06:30:26.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.350+0000 7f09d6038740 1 -- 172.21.15.63:0/281731200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09c0036040 con 0x5602443771b0 2024-09-21T06:30:26.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.350+0000 7f09b17fa640 1 -- 172.21.15.63:0/281731200 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f09b801bb80 con 0x5602443771b0 2024-09-21T06:30:26.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.350+0000 7f09b17fa640 1 -- 172.21.15.63:0/281731200 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f09b803f050 con 0x5602443771b0 2024-09-21T06:30:26.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.350+0000 7f09d6038740 10 client.25655 fetch_fsmap learned FSMap version 39 2024-09-21T06:30:26.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.350+0000 7f09d6038740 1 -- 172.21.15.63:0/281731200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5602447cf9a0 con 0x5602443771b0 2024-09-21T06:30:26.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.350+0000 7f09b17fa640 1 -- 172.21.15.63:0/281731200 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09c0036040 con 0x5602443771b0 2024-09-21T06:30:26.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.350+0000 7f09b17fa640 1 -- 172.21.15.63:0/281731200 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f09b800b720 con 0x5602443771b0 2024-09-21T06:30:26.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.350+0000 7f09d6038740 10 client.25655 fetch_fsmap finished waiting for FSMap version 39 2024-09-21T06:30:26.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.350+0000 7f09d6038740 10 client.25655 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:30:26.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.350+0000 7f09d6038740 20 client.25655 populate_metadata read hostname 'smithi063' 2024-09-21T06:30:26.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.350+0000 7f09d6038740 1 --2- 172.21.15.63:0/281731200 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5602443a0070 0x5602447d2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:26.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.350+0000 7f09d6038740 4 client.25655 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:30:26.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.350+0000 7f09d6038740 1 -- 172.21.15.63:0/281731200 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5602446bb850 con 0x5602443a0070 2024-09-21T06:30:26.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.351+0000 7f09ce061640 1 --2- 172.21.15.63:0/281731200 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5602443a0070 0x5602447d2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:26.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.351+0000 7f09b17fa640 10 client.25655 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:30:26.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.351+0000 7f09ce061640 1 --2- 172.21.15.63:0/281731200 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5602443a0070 0x5602447d2160 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5a2ae074017f2c4 server_cookie=9af6044c2f52ce1c in_seq=0 out_seq=0 2024-09-21T06:30:26.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.351+0000 7f09b17fa640 1 -- 172.21.15.63:0/281731200 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+86 (crc 0 0 0) 0x5602446bb850 con 0x5602443a0070 2024-09-21T06:30:26.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.351+0000 7f09b17fa640 10 client.25655 handle_command_reply: tid=0 2024-09-21T06:30:26.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.351+0000 7f09d6038740 1 client.25655 shutdown 2024-09-21T06:30:26.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.351+0000 7f09d6038740 1 -- 172.21.15.63:0/281731200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602443771b0 msgr2=0x560244757460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:26.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.351+0000 7f09d6038740 1 --2- 172.21.15.63:0/281731200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602443771b0 0x560244757460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x5602447378b0 tx=0x7f09b801b870 comp rx=0 tx=0).stop 2024-09-21T06:30:26.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.351+0000 7f09d6038740 1 -- 172.21.15.63:0/281731200 shutdown_connections 2024-09-21T06:30:26.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.351+0000 7f09d6038740 1 --2- 172.21.15.63:0/281731200 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5602443a0070 0x5602447d2160 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.352+0000 7f09d6038740 1 --2- 172.21.15.63:0/281731200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56024437f390 0x5602447ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.352+0000 7f09d6038740 1 --2- 172.21.15.63:0/281731200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602443771b0 0x560244757460 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.352+0000 7f09b17fa640 0 client.25655 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:30:26.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.352+0000 7f09d6038740 1 --2- 172.21.15.63:0/281731200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024435e9f0 0x560244756ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.352+0000 7f09d6038740 1 -- 172.21.15.63:0/281731200 >> 172.21.15.63:0/281731200 conn(0x560244394460 msgr2=0x560244753d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:26.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.352+0000 7f09d6038740 1 -- 172.21.15.63:0/281731200 shutdown_connections 2024-09-21T06:30:26.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.352+0000 7f09d6038740 1 -- 172.21.15.63:0/281731200 wait complete. 2024-09-21T06:30:26.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.352+0000 7f09d6038740 20 client.25655 trim_cache size 0 max 16384 2024-09-21T06:30:26.360 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:30:26.360 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "no active scrubs running", 2024-09-21T06:30:26.360 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": {}, 2024-09-21T06:30:26.360 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": {} 2024-09-21T06:30:26.360 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:30:26.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.352+0000 7f09cfac4640 1 -- 172.21.15.63:0/3346742428 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f09b40b6680 msgr2=0x7f09b40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:26.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.352+0000 7f09cfac4640 1 --2- 172.21.15.63:0/3346742428 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f09b40b6680 0x7f09b40b8b90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f09c40e5460 tx=0x7f09c4003e70 comp rx=0 tx=0).stop 2024-09-21T06:30:26.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.352+0000 7f09cfac4640 1 -- 172.21.15.63:0/3346742428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09c81049b0 msgr2=0x7f09c819a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:26.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.352+0000 7f09cfac4640 1 --2- 172.21.15.63:0/3346742428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09c81049b0 0x7f09c819a460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f09c400e9c0 tx=0x7f09c400ee80 comp rx=0 tx=0).stop 2024-09-21T06:30:26.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.352+0000 7f09cfac4640 1 -- 172.21.15.63:0/3346742428 shutdown_connections 2024-09-21T06:30:26.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.352+0000 7f09cfac4640 1 --2- 172.21.15.63:0/3346742428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09c810de10 0x7f09c819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.352+0000 7f09cfac4640 1 --2- 172.21.15.63:0/3346742428 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09c8105300 0x7f09c819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.352+0000 7f09cfac4640 1 --2- 172.21.15.63:0/3346742428 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f09b40b6680 0x7f09b40b8b90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.352+0000 7f09cfac4640 1 --2- 172.21.15.63:0/3346742428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09c81049b0 0x7f09c819a460 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:26.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.352+0000 7f09cfac4640 1 -- 172.21.15.63:0/3346742428 >> 172.21.15.63:0/3346742428 conn(0x7f09c8079730 msgr2=0x7f09c80ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:26.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.352+0000 7f09cfac4640 1 -- 172.21.15.63:0/3346742428 shutdown_connections 2024-09-21T06:30:26.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:26.352+0000 7f09cfac4640 1 -- 172.21.15.63:0/3346742428 wait complete. 2024-09-21T06:30:27.140 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:30:27.140 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:30:27.443 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:27.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:27 smithi071 ceph-mon[34844]: pgmap v390: 97 pgs: 97 active+clean; 43 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 876 KiB/s wr, 145 op/s 2024-09-21T06:30:27.548 INFO:tasks.workunit.client.0.smithi063.stderr:Note: switching to '0e5c12dfd008efc2848c98108c9237487e91ef35'. 2024-09-21T06:30:27.548 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-21T06:30:27.548 INFO:tasks.workunit.client.0.smithi063.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T06:30:27.548 INFO:tasks.workunit.client.0.smithi063.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T06:30:27.548 INFO:tasks.workunit.client.0.smithi063.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T06:30:27.548 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-21T06:30:27.549 INFO:tasks.workunit.client.0.smithi063.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T06:30:27.549 INFO:tasks.workunit.client.0.smithi063.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T06:30:27.549 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-21T06:30:27.549 INFO:tasks.workunit.client.0.smithi063.stderr: git switch -c 2024-09-21T06:30:27.549 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-21T06:30:27.549 INFO:tasks.workunit.client.0.smithi063.stderr:Or undo this operation with: 2024-09-21T06:30:27.549 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-21T06:30:27.549 INFO:tasks.workunit.client.0.smithi063.stderr: git switch - 2024-09-21T06:30:27.549 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-21T06:30:27.549 INFO:tasks.workunit.client.0.smithi063.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T06:30:27.549 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-21T06:30:27.549 INFO:tasks.workunit.client.0.smithi063.stderr:HEAD is now at 0e5c12df xfs/522: use reflink instead of crc as test feature 2024-09-21T06:30:27.553 INFO:tasks.workunit.client.0.smithi063.stderr:+ make -j4 2024-09-21T06:30:27.562 INFO:tasks.workunit.client.0.smithi063.stdout:libtoolize -cfi 2024-09-21T06:30:27.564 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:27 smithi063 ceph-mon[31150]: pgmap v390: 97 pgs: 97 active+clean; 43 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 876 KiB/s wr, 145 op/s 2024-09-21T06:30:27.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:27 smithi175 ceph-mon[34510]: pgmap v390: 97 pgs: 97 active+clean; 43 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 876 KiB/s wr, 145 op/s 2024-09-21T06:30:28.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.064+0000 7f597fa12640 1 -- 172.21.15.63:0/496262692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59781083d0 msgr2=0x7f59781087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:28.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.064+0000 7f597fa12640 1 --2- 172.21.15.63:0/496262692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59781083d0 0x7f59781087e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f5968009900 tx=0x7f596802a410 comp rx=0 tx=0).stop 2024-09-21T06:30:28.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.064+0000 7f597fa12640 1 -- 172.21.15.63:0/496262692 shutdown_connections 2024-09-21T06:30:28.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.064+0000 7f597fa12640 1 --2- 172.21.15.63:0/496262692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5978108d20 0x7f597810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.064+0000 7f597fa12640 1 --2- 172.21.15.63:0/496262692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59781083d0 0x7f59781087e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.064+0000 7f597fa12640 1 --2- 172.21.15.63:0/496262692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5978102a90 0x7f5978102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.064+0000 7f597fa12640 1 -- 172.21.15.63:0/496262692 >> 172.21.15.63:0/496262692 conn(0x7f5978079730 msgr2=0x7f5978079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.064+0000 7f597fa12640 1 -- 172.21.15.63:0/496262692 shutdown_connections 2024-09-21T06:30:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.064+0000 7f597fa12640 1 -- 172.21.15.63:0/496262692 wait complete. 2024-09-21T06:30:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.065+0000 7f597fa12640 1 Processor -- start 2024-09-21T06:30:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.065+0000 7f597fa12640 1 -- start start 2024-09-21T06:30:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.065+0000 7f597fa12640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5978102a90 0x7f597819b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.065+0000 7f597fa12640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59781083d0 0x7f597819b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.065+0000 7f597fa12640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5978108d20 0x7f597819bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.065+0000 7f597fa12640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f59781129e0 con 0x7f5978102a90 2024-09-21T06:30:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.065+0000 7f597fa12640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5978112860 con 0x7f59781083d0 2024-09-21T06:30:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.065+0000 7f597fa12640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5978112b60 con 0x7f5978108d20 2024-09-21T06:30:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.065+0000 7f597d7ae640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5978102a90 0x7f597819b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.065+0000 7f597cfad640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59781083d0 0x7f597819b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.065+0000 7f597d7ae640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5978102a90 0x7f597819b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47438/0 (socket says 172.21.15.63:47438) 2024-09-21T06:30:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.065+0000 7f597d7ae640 1 -- 172.21.15.63:0/4231350233 learned_addr learned my addr 172.21.15.63:0/4231350233 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.065+0000 7f597dfaf640 1 --2- 172.21.15.63:0/4231350233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5978108d20 0x7f597819bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.066+0000 7f597dfaf640 1 -- 172.21.15.63:0/4231350233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59781083d0 msgr2=0x7f597819b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.066+0000 7f597dfaf640 1 --2- 172.21.15.63:0/4231350233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59781083d0 0x7f597819b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.066+0000 7f597dfaf640 1 -- 172.21.15.63:0/4231350233 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5978102a90 msgr2=0x7f597819b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.066+0000 7f597dfaf640 1 --2- 172.21.15.63:0/4231350233 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5978102a90 0x7f597819b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.066+0000 7f597dfaf640 1 -- 172.21.15.63:0/4231350233 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59781a65e0 con 0x7f5978108d20 2024-09-21T06:30:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.066+0000 7f597d7ae640 1 --2- 172.21.15.63:0/4231350233 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5978102a90 0x7f597819b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.066+0000 7f597cfad640 1 --2- 172.21.15.63:0/4231350233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59781083d0 0x7f597819b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.066+0000 7f597dfaf640 1 --2- 172.21.15.63:0/4231350233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5978108d20 0x7f597819bd50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5970009fd0 tx=0x7f597000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.066+0000 7f596e7fc640 1 -- 172.21.15.63:0/4231350233 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597000ce20 con 0x7f5978108d20 2024-09-21T06:30:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.066+0000 7f597fa12640 1 -- 172.21.15.63:0/4231350233 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59781a68d0 con 0x7f5978108d20 2024-09-21T06:30:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.066+0000 7f596e7fc640 1 -- 172.21.15.63:0/4231350233 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5970005020 con 0x7f5978108d20 2024-09-21T06:30:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.066+0000 7f596e7fc640 1 -- 172.21.15.63:0/4231350233 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970010690 con 0x7f5978108d20 2024-09-21T06:30:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.066+0000 7f597fa12640 1 -- 172.21.15.63:0/4231350233 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59781a6de0 con 0x7f5978108d20 2024-09-21T06:30:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.067+0000 7f597fa12640 1 -- 172.21.15.63:0/4231350233 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5978103d10 con 0x7f5978108d20 2024-09-21T06:30:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.069+0000 7f596e7fc640 1 -- 172.21.15.63:0/4231350233 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f59700054d0 con 0x7f5978108d20 2024-09-21T06:30:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.069+0000 7f596e7fc640 1 --2- 172.21.15.63:0/4231350233 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f59640b6680 0x7f59640b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.070+0000 7f597d7ae640 1 --2- 172.21.15.63:0/4231350233 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f59640b6680 0x7f59640b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.070+0000 7f596e7fc640 1 -- 172.21.15.63:0/4231350233 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f59700e7de0 con 0x7f5978108d20 2024-09-21T06:30:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.070+0000 7f597d7ae640 1 --2- 172.21.15.63:0/4231350233 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f59640b6680 0x7f59640b8b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f597806c740 tx=0x7f5974005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.073+0000 7f596e7fc640 1 -- 172.21.15.63:0/4231350233 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f59700ae2b0 con 0x7f5978108d20 2024-09-21T06:30:28.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.320+0000 7f597fa12640 1 -- 172.21.15.63:0/4231350233 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5978102ea0 con 0x7f5978108d20 2024-09-21T06:30:28.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.321+0000 7f596e7fc640 1 -- 172.21.15.63:0/4231350233 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11972 (secure 0 0 0) 0x7f5978102ea0 con 0x7f5978108d20 2024-09-21T06:30:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:30:28.324 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":40,"btime":"2024-09-21T06:30:28:261669+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:30:28.145266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24659,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":34,"state":"up:active","state_seq":69,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25637":{"gid":25637,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3354670524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3354670524},{"type":"v1","addr":"172.21.15.71:6839","nonce":3354670524}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24659,"qdb_cluster":[14835,24676,24659,24670,24694]},"id":1}]} 2024-09-21T06:30:28.324 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 40 2024-09-21T06:30:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.327+0000 7f597fa12640 1 -- 172.21.15.63:0/4231350233 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f59640b6680 msgr2=0x7f59640b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.327+0000 7f597fa12640 1 --2- 172.21.15.63:0/4231350233 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f59640b6680 0x7f59640b8b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f597806c740 tx=0x7f5974005f90 comp rx=0 tx=0).stop 2024-09-21T06:30:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.327+0000 7f597fa12640 1 -- 172.21.15.63:0/4231350233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5978108d20 msgr2=0x7f597819bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.327+0000 7f597fa12640 1 --2- 172.21.15.63:0/4231350233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5978108d20 0x7f597819bd50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5970009fd0 tx=0x7f597000ef10 comp rx=0 tx=0).stop 2024-09-21T06:30:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.327+0000 7f597fa12640 1 -- 172.21.15.63:0/4231350233 shutdown_connections 2024-09-21T06:30:28.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.327+0000 7f597fa12640 1 --2- 172.21.15.63:0/4231350233 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f59640b6680 0x7f59640b8b90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:28.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.327+0000 7f597fa12640 1 --2- 172.21.15.63:0/4231350233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5978108d20 0x7f597819bd50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:28.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.327+0000 7f597fa12640 1 --2- 172.21.15.63:0/4231350233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59781083d0 0x7f597819b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:28.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.327+0000 7f597fa12640 1 --2- 172.21.15.63:0/4231350233 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5978102a90 0x7f597819b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:28.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.327+0000 7f597fa12640 1 -- 172.21.15.63:0/4231350233 >> 172.21.15.63:0/4231350233 conn(0x7f5978079730 msgr2=0x7f5978106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:28.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.328+0000 7f597fa12640 1 -- 172.21.15.63:0/4231350233 shutdown_connections 2024-09-21T06:30:28.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:28.328+0000 7f597fa12640 1 -- 172.21.15.63:0/4231350233 wait complete. 2024-09-21T06:30:28.373 INFO:tasks.workunit.client.0.smithi063.stdout:libtoolize: putting auxiliary files in '.'. 2024-09-21T06:30:28.373 INFO:tasks.workunit.client.0.smithi063.stdout:libtoolize: copying file './config.guess' 2024-09-21T06:30:28.378 INFO:tasks.workunit.client.0.smithi063.stdout:libtoolize: copying file './config.sub' 2024-09-21T06:30:28.383 INFO:tasks.workunit.client.0.smithi063.stdout:libtoolize: copying file './install-sh' 2024-09-21T06:30:28.389 INFO:tasks.workunit.client.0.smithi063.stdout:libtoolize: copying file './ltmain.sh' 2024-09-21T06:30:28.422 INFO:tasks.workunit.client.0.smithi063.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-09-21T06:30:28.423 INFO:tasks.workunit.client.0.smithi063.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-09-21T06:30:28.429 INFO:tasks.workunit.client.0.smithi063.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-09-21T06:30:28.436 INFO:tasks.workunit.client.0.smithi063.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-09-21T06:30:28.443 INFO:tasks.workunit.client.0.smithi063.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-09-21T06:30:28.450 INFO:tasks.workunit.client.0.smithi063.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-09-21T06:30:28.456 INFO:tasks.workunit.client.0.smithi063.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-09-21T06:30:28.458 INFO:tasks.workunit.client.0.smithi063.stdout:cp include/install-sh . 2024-09-21T06:30:28.467 INFO:tasks.workunit.client.0.smithi063.stdout:aclocal -I m4 2024-09-21T06:30:28.986 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T06:30:29.265 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:29.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:29 smithi063 ceph-mon[31150]: pgmap v391: 97 pgs: 97 active+clean; 49 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 205 op/s 2024-09-21T06:30:29.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:29 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:30:29.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:29 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/4231350233' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:30:29.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:29 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:29.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:29 smithi175 ceph-mon[34510]: pgmap v391: 97 pgs: 97 active+clean; 49 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 205 op/s 2024-09-21T06:30:29.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:29 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:30:29.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:29 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/4231350233' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:30:29.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:29 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:29 smithi071 ceph-mon[34844]: pgmap v391: 97 pgs: 97 active+clean; 49 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 205 op/s 2024-09-21T06:30:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:29 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:30:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:29 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/4231350233' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:30:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:29 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:29.772 INFO:tasks.workunit.client.0.smithi063.stdout:autoheader 2024-09-21T06:30:30.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.064+0000 7f9e1a46f640 1 -- 172.21.15.63:0/2441417094 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e14102a60 msgr2=0x7f9e14102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:30.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.064+0000 7f9e1a46f640 1 --2- 172.21.15.63:0/2441417094 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e14102a60 0x7f9e14102e70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9e04009900 tx=0x7f9e0402a410 comp rx=0 tx=0).stop 2024-09-21T06:30:30.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.064+0000 7f9e1a46f640 1 -- 172.21.15.63:0/2441417094 shutdown_connections 2024-09-21T06:30:30.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.064+0000 7f9e1a46f640 1 --2- 172.21.15.63:0/2441417094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e14108cf0 0x7f9e1410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.064+0000 7f9e1a46f640 1 --2- 172.21.15.63:0/2441417094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e141083a0 0x7f9e141087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.064+0000 7f9e1a46f640 1 --2- 172.21.15.63:0/2441417094 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e14102a60 0x7f9e14102e70 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.064+0000 7f9e1a46f640 1 -- 172.21.15.63:0/2441417094 >> 172.21.15.63:0/2441417094 conn(0x7f9e14079730 msgr2=0x7f9e14079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:30.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.064+0000 7f9e1a46f640 1 -- 172.21.15.63:0/2441417094 shutdown_connections 2024-09-21T06:30:30.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.064+0000 7f9e1a46f640 1 -- 172.21.15.63:0/2441417094 wait complete. 2024-09-21T06:30:30.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.065+0000 7f9e1a46f640 1 Processor -- start 2024-09-21T06:30:30.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.065+0000 7f9e1a46f640 1 -- start start 2024-09-21T06:30:30.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.065+0000 7f9e1a46f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e14102a60 0x7f9e14199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:30.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.065+0000 7f9e1a46f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e141083a0 0x7f9e14199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:30.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.065+0000 7f9e1a46f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e14108cf0 0x7f9e1419ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:30.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.065+0000 7f9e1a46f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9e141129b0 con 0x7f9e141083a0 2024-09-21T06:30:30.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.065+0000 7f9e1a46f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9e14112830 con 0x7f9e14102a60 2024-09-21T06:30:30.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.065+0000 7f9e1a46f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9e14112b30 con 0x7f9e14108cf0 2024-09-21T06:30:30.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.065+0000 7f9e137fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e141083a0 0x7f9e14199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:30.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.066+0000 7f9e18a0c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e14108cf0 0x7f9e1419ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:30.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.066+0000 7f9e137fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e141083a0 0x7f9e14199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47454/0 (socket says 172.21.15.63:47454) 2024-09-21T06:30:30.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.066+0000 7f9e137fe640 1 -- 172.21.15.63:0/2938355715 learned_addr learned my addr 172.21.15.63:0/2938355715 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:30.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.066+0000 7f9e13fff640 1 --2- 172.21.15.63:0/2938355715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e14102a60 0x7f9e14199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:30.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.066+0000 7f9e18a0c640 1 -- 172.21.15.63:0/2938355715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e14102a60 msgr2=0x7f9e14199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:30.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.066+0000 7f9e18a0c640 1 --2- 172.21.15.63:0/2938355715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e14102a60 0x7f9e14199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.066+0000 7f9e18a0c640 1 -- 172.21.15.63:0/2938355715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e141083a0 msgr2=0x7f9e14199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:30.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.066+0000 7f9e18a0c640 1 --2- 172.21.15.63:0/2938355715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e141083a0 0x7f9e14199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.066+0000 7f9e18a0c640 1 -- 172.21.15.63:0/2938355715 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e1419f2f0 con 0x7f9e14108cf0 2024-09-21T06:30:30.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.066+0000 7f9e137fe640 1 --2- 172.21.15.63:0/2938355715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e141083a0 0x7f9e14199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:30.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.066+0000 7f9e18a0c640 1 --2- 172.21.15.63:0/2938355715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e14108cf0 0x7f9e1419ebc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c009fd0 tx=0x7f9e0c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:30.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.066+0000 7f9e117fa640 1 -- 172.21.15.63:0/2938355715 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c00ce20 con 0x7f9e14108cf0 2024-09-21T06:30:30.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.066+0000 7f9e1a46f640 1 -- 172.21.15.63:0/2938355715 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e1419f5e0 con 0x7f9e14108cf0 2024-09-21T06:30:30.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.066+0000 7f9e117fa640 1 -- 172.21.15.63:0/2938355715 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e0c005020 con 0x7f9e14108cf0 2024-09-21T06:30:30.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.067+0000 7f9e117fa640 1 -- 172.21.15.63:0/2938355715 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c010690 con 0x7f9e14108cf0 2024-09-21T06:30:30.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.067+0000 7f9e1a46f640 1 -- 172.21.15.63:0/2938355715 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e141a5d40 con 0x7f9e14108cf0 2024-09-21T06:30:30.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.069+0000 7f9e209e3740 1 Processor -- start 2024-09-21T06:30:30.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.069+0000 7f9e117fa640 1 -- 172.21.15.63:0/2938355715 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f9e0c010830 con 0x7f9e14108cf0 2024-09-21T06:30:30.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.069+0000 7f9e209e3740 1 -- start start 2024-09-21T06:30:30.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.070+0000 7f9e209e3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e25a8070 0x55d0e294f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:30.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.070+0000 7f9e209e3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e257f1b0 0x55d0e294f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:30.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.070+0000 7f9e137fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e25a8070 0x55d0e294f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:30.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.070+0000 7f9e209e3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e2587390 0x55d0e294fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:30.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.070+0000 7f9e209e3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d0e28c5ea0 con 0x55d0e25a8070 2024-09-21T06:30:30.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.070+0000 7f9e209e3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d0e28b52d0 con 0x55d0e2587390 2024-09-21T06:30:30.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.070+0000 7f9e209e3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d0e28b90e0 con 0x55d0e257f1b0 2024-09-21T06:30:30.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.070+0000 7f9e13fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e257f1b0 0x55d0e294f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:30.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.070+0000 7f9e137fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e25a8070 0x55d0e294f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47466/0 (socket says 172.21.15.63:47466) 2024-09-21T06:30:30.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.070+0000 7f9e13fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e257f1b0 0x55d0e294f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:60072/0 (socket says 172.21.15.63:60072) 2024-09-21T06:30:30.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.070+0000 7f9e137fe640 1 -- 172.21.15.63:0/380246734 learned_addr learned my addr 172.21.15.63:0/380246734 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:30.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.071+0000 7f9e137fe640 1 -- 172.21.15.63:0/380246734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e257f1b0 msgr2=0x55d0e294f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:30.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.071+0000 7f9e137fe640 1 --2- 172.21.15.63:0/380246734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e257f1b0 0x55d0e294f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.071+0000 7f9e137fe640 1 -- 172.21.15.63:0/380246734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e2587390 msgr2=0x55d0e294fd40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:30:30.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.071+0000 7f9e137fe640 1 --2- 172.21.15.63:0/380246734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e2587390 0x55d0e294fd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.071+0000 7f9e137fe640 1 -- 172.21.15.63:0/380246734 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0e2613650 con 0x55d0e25a8070 2024-09-21T06:30:30.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.071+0000 7f9e117fa640 1 --2- 172.21.15.63:0/2938355715 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9dfc0b6680 0x7f9dfc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:30.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.071+0000 7f9e137fe640 1 --2- 172.21.15.63:0/380246734 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e25a8070 0x55d0e294f2c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9e08011570 tx=0x7f9e08011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c60965040d713f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:30.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.071+0000 7f9e117fa640 1 -- 172.21.15.63:0/2938355715 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f9e0c0e7e20 con 0x7f9e14108cf0 2024-09-21T06:30:30.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.071+0000 7f9e13fff640 1 --2- 172.21.15.63:0/2938355715 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9dfc0b6680 0x7f9dfc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:30.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.071+0000 7f9dfa7fc640 1 -- 172.21.15.63:0/380246734 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e08005020 con 0x55d0e25a8070 2024-09-21T06:30:30.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.071+0000 7f9dfa7fc640 1 -- 172.21.15.63:0/380246734 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e080047a0 con 0x55d0e25a8070 2024-09-21T06:30:30.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.071+0000 7f9dfa7fc640 1 -- 172.21.15.63:0/380246734 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0800f910 con 0x55d0e25a8070 2024-09-21T06:30:30.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.072+0000 7f9e209e3740 1 -- 172.21.15.63:0/380246734 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e25a8070 msgr2=0x55d0e294f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:30.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.072+0000 7f9e13fff640 1 --2- 172.21.15.63:0/2938355715 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9dfc0b6680 0x7f9dfc0b8b90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9e04005ab0 tx=0x7f9e04005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:30.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.072+0000 7f9e209e3740 1 --2- 172.21.15.63:0/380246734 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e25a8070 0x55d0e294f2c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9e08011570 tx=0x7f9e08011a30 comp rx=0 tx=0).stop 2024-09-21T06:30:30.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.072+0000 7f9e209e3740 1 -- 172.21.15.63:0/380246734 shutdown_connections 2024-09-21T06:30:30.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.072+0000 7f9e209e3740 1 --2- 172.21.15.63:0/380246734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e2587390 0x55d0e294fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.072+0000 7f9e209e3740 1 --2- 172.21.15.63:0/380246734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e257f1b0 0x55d0e294f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.072+0000 7f9e209e3740 1 --2- 172.21.15.63:0/380246734 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e25a8070 0x55d0e294f2c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.072+0000 7f9e209e3740 1 -- 172.21.15.63:0/380246734 >> 172.21.15.63:0/380246734 conn(0x55d0e259c460 msgr2=0x55d0e294d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:30.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.072+0000 7f9e209e3740 1 -- 172.21.15.63:0/380246734 shutdown_connections 2024-09-21T06:30:30.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.072+0000 7f9e209e3740 1 -- 172.21.15.63:0/380246734 wait complete. 2024-09-21T06:30:30.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.073+0000 7f9e209e3740 1 -- start start 2024-09-21T06:30:30.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.073+0000 7f9e209e3740 1 Processor -- start 2024-09-21T06:30:30.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.074+0000 7f9e209e3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e257f1b0 0x55d0e295b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:30.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.074+0000 7f9e209e3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e2587390 0x55d0e295b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:30.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.074+0000 7f9e209e3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e25a8070 0x55d0e2964d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:30.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.074+0000 7f9e209e3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d0e2716700 con 0x55d0e257f1b0 2024-09-21T06:30:30.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.074+0000 7f9e209e3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d0e2850160 con 0x55d0e2587390 2024-09-21T06:30:30.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.074+0000 7f9e209e3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d0e29558f0 con 0x55d0e25a8070 2024-09-21T06:30:30.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.074+0000 7f9e209e3740 10 client.0 _ll_register_callbacks cb 0x55d0e28699e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:30.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.074+0000 7f9e13fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e257f1b0 0x55d0e295b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:30.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.074+0000 7f9e137fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e2587390 0x55d0e295b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:30.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.074+0000 7f9e13fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e257f1b0 0x55d0e295b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47470/0 (socket says 172.21.15.63:47470) 2024-09-21T06:30:30.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.074+0000 7f9e13fff640 1 -- 172.21.15.63:0/2672415083 learned_addr learned my addr 172.21.15.63:0/2672415083 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:30.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.074+0000 7f9e18a0c640 1 --2- 172.21.15.63:0/2672415083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e25a8070 0x55d0e2964d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:30.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.074+0000 7f9e18a0c640 1 -- 172.21.15.63:0/2672415083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e2587390 msgr2=0x55d0e295b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:30.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.074+0000 7f9e18a0c640 1 --2- 172.21.15.63:0/2672415083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e2587390 0x55d0e295b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.074+0000 7f9e18a0c640 1 -- 172.21.15.63:0/2672415083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e257f1b0 msgr2=0x55d0e295b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:30.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.074+0000 7f9e18a0c640 1 --2- 172.21.15.63:0/2672415083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e257f1b0 0x55d0e295b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.074+0000 7f9e18a0c640 1 -- 172.21.15.63:0/2672415083 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0e287dc90 con 0x55d0e25a8070 2024-09-21T06:30:30.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.074+0000 7f9e137fe640 1 --2- 172.21.15.63:0/2672415083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e2587390 0x55d0e295b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:30.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.075+0000 7f9e18a0c640 1 --2- 172.21.15.63:0/2672415083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e25a8070 0x55d0e2964d20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0e5550 tx=0x7f9e0c0ad480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25aa0c096750bf88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:30.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.075+0000 7f9df37fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:30:30.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.075+0000 7f9df37fe640 1 -- 172.21.15.63:0/2672415083 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c0ad0b0 con 0x55d0e25a8070 2024-09-21T06:30:30.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.075+0000 7f9df37fe640 1 -- 172.21.15.63:0/2672415083 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f9e0c010b20 con 0x55d0e25a8070 2024-09-21T06:30:30.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.075+0000 7f9e209e3740 1 -- 172.21.15.63:0/2672415083 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e080047a0 con 0x55d0e25a8070 2024-09-21T06:30:30.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.075+0000 7f9df37fe640 1 -- 172.21.15.63:0/2672415083 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f9e0c0950b0 con 0x55d0e25a8070 2024-09-21T06:30:30.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.075+0000 7f9e209e3740 10 client.25738 fetch_fsmap learned FSMap version 40 2024-09-21T06:30:30.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.075+0000 7f9e209e3740 1 -- 172.21.15.63:0/2672415083 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55d0e296dbe0 con 0x55d0e25a8070 2024-09-21T06:30:30.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.075+0000 7f9df37fe640 1 -- 172.21.15.63:0/2672415083 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e080047a0 con 0x55d0e25a8070 2024-09-21T06:30:30.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.075+0000 7f9df37fe640 1 -- 172.21.15.63:0/2672415083 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 40) ==== 8366+0+0 (secure 0 0 0) 0x7f9e0c0a95a0 con 0x55d0e25a8070 2024-09-21T06:30:30.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.076+0000 7f9e209e3740 10 client.25738 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T06:30:30.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.076+0000 7f9e209e3740 10 client.25738 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:30:30.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.076+0000 7f9e209e3740 20 client.25738 populate_metadata read hostname 'smithi063' 2024-09-21T06:30:30.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.076+0000 7f9e209e3740 1 --2- 172.21.15.63:0/2672415083 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55d0e25669f0 0x55d0e29710a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:30.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.076+0000 7f9e209e3740 4 client.25738 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:30:30.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.076+0000 7f9e209e3740 1 -- 172.21.15.63:0/2672415083 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0e28c7df0 con 0x55d0e25669f0 2024-09-21T06:30:30.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.076+0000 7f9e13fff640 1 --2- 172.21.15.63:0/2672415083 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55d0e25669f0 0x55d0e29710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:30.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.076+0000 7f9df37fe640 10 client.25738 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:30:30.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.076+0000 7f9e13fff640 1 --2- 172.21.15.63:0/2672415083 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55d0e25669f0 0x55d0e29710a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=91c094e3adddd54f server_cookie=1c8e8d36b37855d8 in_seq=0 out_seq=0 2024-09-21T06:30:30.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.077+0000 7f9df37fe640 1 -- 172.21.15.63:0/2672415083 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d0e28c7df0 con 0x55d0e25669f0 2024-09-21T06:30:30.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.077+0000 7f9df37fe640 10 client.25738 handle_command_reply: tid=0 2024-09-21T06:30:30.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.077+0000 7f9e209e3740 1 client.25738 shutdown 2024-09-21T06:30:30.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.077+0000 7f9e209e3740 1 -- 172.21.15.63:0/2672415083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e25a8070 msgr2=0x55d0e2964d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:30.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.077+0000 7f9e209e3740 1 --2- 172.21.15.63:0/2672415083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e25a8070 0x55d0e2964d20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0e5550 tx=0x7f9e0c0ad480 comp rx=0 tx=0).stop 2024-09-21T06:30:30.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.077+0000 7f9e209e3740 1 -- 172.21.15.63:0/2672415083 shutdown_connections 2024-09-21T06:30:30.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.077+0000 7f9e209e3740 1 --2- 172.21.15.63:0/2672415083 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55d0e25669f0 0x55d0e29710a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.077+0000 7f9e209e3740 1 --2- 172.21.15.63:0/2672415083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e25a8070 0x55d0e2964d20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.077+0000 7f9e209e3740 1 --2- 172.21.15.63:0/2672415083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e2587390 0x55d0e295b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.077+0000 7f9df37fe640 0 client.25738 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:30:30.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.077+0000 7f9e209e3740 1 --2- 172.21.15.63:0/2672415083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e257f1b0 0x55d0e295b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.077+0000 7f9e209e3740 1 -- 172.21.15.63:0/2672415083 >> 172.21.15.63:0/2672415083 conn(0x55d0e259c460 msgr2=0x55d0e294b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:30.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.077+0000 7f9e209e3740 1 -- 172.21.15.63:0/2672415083 shutdown_connections 2024-09-21T06:30:30.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.078+0000 7f9e209e3740 1 -- 172.21.15.63:0/2672415083 wait complete. 2024-09-21T06:30:30.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.078+0000 7f9e209e3740 20 client.25738 trim_cache size 0 max 16384 2024-09-21T06:30:30.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.091+0000 7f9e209e3740 1 Processor -- start 2024-09-21T06:30:30.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.091+0000 7f9e209e3740 1 -- start start 2024-09-21T06:30:30.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.091+0000 7f9e209e3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e257f1b0 0x55d0e2964d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:30.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.091+0000 7f9e209e3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e2587390 0x55d0e296baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:30.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.091+0000 7f9e209e3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e25a8070 0x55d0e294d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:30.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.092+0000 7f9e209e3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9e141ad550 con 0x55d0e2587390 2024-09-21T06:30:30.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.092+0000 7f9e209e3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9e141af0c0 con 0x55d0e257f1b0 2024-09-21T06:30:30.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.092+0000 7f9e209e3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9e141adc50 con 0x55d0e25a8070 2024-09-21T06:30:30.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.092+0000 7f9e13fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e257f1b0 0x55d0e2964d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:30.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.092+0000 7f9e137fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e2587390 0x55d0e296baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:30.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.092+0000 7f9e13fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e257f1b0 0x55d0e2964d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:48946/0 (socket says 172.21.15.63:48946) 2024-09-21T06:30:30.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.092+0000 7f9e137fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e2587390 0x55d0e296baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47482/0 (socket says 172.21.15.63:47482) 2024-09-21T06:30:30.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.092+0000 7f9e13fff640 1 -- 172.21.15.63:0/837993648 learned_addr learned my addr 172.21.15.63:0/837993648 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:30.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.092+0000 7f9e18a0c640 1 --2- 172.21.15.63:0/837993648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e25a8070 0x55d0e294d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:30.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.092+0000 7f9e13fff640 1 -- 172.21.15.63:0/837993648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e25a8070 msgr2=0x55d0e294d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:30.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.092+0000 7f9e13fff640 1 --2- 172.21.15.63:0/837993648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e25a8070 0x55d0e294d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.092+0000 7f9e13fff640 1 -- 172.21.15.63:0/837993648 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e2587390 msgr2=0x55d0e296baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:30.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.092+0000 7f9e13fff640 1 --2- 172.21.15.63:0/837993648 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e2587390 0x55d0e296baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.092+0000 7f9e13fff640 1 -- 172.21.15.63:0/837993648 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0e2952100 con 0x55d0e257f1b0 2024-09-21T06:30:30.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.092+0000 7f9e13fff640 1 --2- 172.21.15.63:0/837993648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e257f1b0 0x55d0e2964d20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e0402aa00 tx=0x7f9e0403f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e94f92dd2945b62 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.093+0000 7f9df9ffb640 1 -- 172.21.15.63:0/837993648 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e04035040 con 0x55d0e257f1b0 2024-09-21T06:30:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.093+0000 7f9df9ffb640 1 -- 172.21.15.63:0/837993648 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e04004e20 con 0x55d0e257f1b0 2024-09-21T06:30:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.093+0000 7f9df9ffb640 1 -- 172.21.15.63:0/837993648 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e04003e20 con 0x55d0e257f1b0 2024-09-21T06:30:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.094+0000 7f9e209e3740 1 -- 172.21.15.63:0/837993648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e257f1b0 msgr2=0x55d0e2964d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.094+0000 7f9e209e3740 1 --2- 172.21.15.63:0/837993648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e257f1b0 0x55d0e2964d20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e0402aa00 tx=0x7f9e0403f000 comp rx=0 tx=0).stop 2024-09-21T06:30:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.094+0000 7f9e209e3740 1 -- 172.21.15.63:0/837993648 shutdown_connections 2024-09-21T06:30:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.094+0000 7f9e209e3740 1 --2- 172.21.15.63:0/837993648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e25a8070 0x55d0e294d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.094+0000 7f9e209e3740 1 --2- 172.21.15.63:0/837993648 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e2587390 0x55d0e296baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.094+0000 7f9e209e3740 1 --2- 172.21.15.63:0/837993648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e257f1b0 0x55d0e2964d20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.094+0000 7f9e209e3740 1 -- 172.21.15.63:0/837993648 >> 172.21.15.63:0/837993648 conn(0x55d0e259c460 msgr2=0x55d0e294cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.094+0000 7f9e209e3740 1 -- 172.21.15.63:0/837993648 shutdown_connections 2024-09-21T06:30:30.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.094+0000 7f9e209e3740 1 -- 172.21.15.63:0/837993648 wait complete. 2024-09-21T06:30:30.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.094+0000 7f9e209e3740 1 -- start start 2024-09-21T06:30:30.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.094+0000 7f9e209e3740 1 Processor -- start 2024-09-21T06:30:30.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.095+0000 7f9e209e3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e257f1b0 0x55d0e296b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:30.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.095+0000 7f9e209e3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e2587390 0x55d0e2966d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:30.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.095+0000 7f9e209e3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e25a8070 0x55d0e29672d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:30.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.095+0000 7f9e209e3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9e141ae9f0 con 0x55d0e25a8070 2024-09-21T06:30:30.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.095+0000 7f9e209e3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9e141ae320 con 0x55d0e2587390 2024-09-21T06:30:30.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.095+0000 7f9e209e3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9e141ab530 con 0x55d0e257f1b0 2024-09-21T06:30:30.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.095+0000 7f9e209e3740 10 client.0 _ll_register_callbacks cb 0x7f9e0c0aa2a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:30.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.095+0000 7f9e18a0c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e25a8070 0x55d0e29672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:30.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.095+0000 7f9e18a0c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e25a8070 0x55d0e29672d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47496/0 (socket says 172.21.15.63:47496) 2024-09-21T06:30:30.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.095+0000 7f9e18a0c640 1 -- 172.21.15.63:0/1371868261 learned_addr learned my addr 172.21.15.63:0/1371868261 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:30.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.095+0000 7f9e137fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e2587390 0x55d0e2966d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.095+0000 7f9e13fff640 1 --2- 172.21.15.63:0/1371868261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e257f1b0 0x55d0e296b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.095+0000 7f9e18a0c640 1 -- 172.21.15.63:0/1371868261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e257f1b0 msgr2=0x55d0e296b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.095+0000 7f9e18a0c640 1 --2- 172.21.15.63:0/1371868261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e257f1b0 0x55d0e296b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.095+0000 7f9e18a0c640 1 -- 172.21.15.63:0/1371868261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e2587390 msgr2=0x55d0e2966d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.095+0000 7f9e18a0c640 1 --2- 172.21.15.63:0/1371868261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e2587390 0x55d0e2966d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.095+0000 7f9e18a0c640 1 -- 172.21.15.63:0/1371868261 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0e2967a40 con 0x55d0e25a8070 2024-09-21T06:30:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.095+0000 7f9e18a0c640 1 --2- 172.21.15.63:0/1371868261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e25a8070 0x55d0e29672d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0adbe0 tx=0x7f9e0c005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c57e6f28cb1501 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.095+0000 7f9df37fe640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:30:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.096+0000 7f9df37fe640 1 -- 172.21.15.63:0/1371868261 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c0ad5a0 con 0x55d0e25a8070 2024-09-21T06:30:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.096+0000 7f9df37fe640 1 -- 172.21.15.63:0/1371868261 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f9e0c0ad0b0 con 0x55d0e25a8070 2024-09-21T06:30:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.096+0000 7f9e209e3740 1 -- 172.21.15.63:0/1371868261 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e04004e20 con 0x55d0e25a8070 2024-09-21T06:30:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.096+0000 7f9df37fe640 1 -- 172.21.15.63:0/1371868261 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f9e0c0d12f0 con 0x55d0e25a8070 2024-09-21T06:30:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.096+0000 7f9e209e3740 10 client.16032 fetch_fsmap learned FSMap version 40 2024-09-21T06:30:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.096+0000 7f9e209e3740 1 -- 172.21.15.63:0/1371868261 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55d0e29db980 con 0x55d0e25a8070 2024-09-21T06:30:30.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.096+0000 7f9df37fe640 1 -- 172.21.15.63:0/1371868261 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e04004e20 con 0x55d0e25a8070 2024-09-21T06:30:30.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.096+0000 7f9df37fe640 1 -- 172.21.15.63:0/1371868261 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 40) ==== 8366+0+0 (secure 0 0 0) 0x7f9e0c0ac920 con 0x55d0e25a8070 2024-09-21T06:30:30.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.096+0000 7f9e209e3740 10 client.16032 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T06:30:30.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.096+0000 7f9e209e3740 10 client.16032 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:30:30.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.096+0000 7f9e209e3740 20 client.16032 populate_metadata read hostname 'smithi063' 2024-09-21T06:30:30.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.096+0000 7f9e209e3740 1 --2- 172.21.15.63:0/1371868261 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55d0e253bda0 0x55d0e29de140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.096+0000 7f9e209e3740 4 client.16032 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:30:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.096+0000 7f9e209e3740 1 -- 172.21.15.63:0/1371868261 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d0e28c38a0 con 0x55d0e253bda0 2024-09-21T06:30:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.097+0000 7f9e13fff640 1 --2- 172.21.15.63:0/1371868261 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55d0e253bda0 0x55d0e29de140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.097+0000 7f9df37fe640 10 client.16032 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:30:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.097+0000 7f9e13fff640 1 --2- 172.21.15.63:0/1371868261 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55d0e253bda0 0x55d0e29de140 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=817058b9e7e2e26f server_cookie=7c2cb533c5a7c4a6 in_seq=0 out_seq=0 2024-09-21T06:30:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.097+0000 7f9df37fe640 1 -- 172.21.15.63:0/1371868261 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d0e28c38a0 con 0x55d0e253bda0 2024-09-21T06:30:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.097+0000 7f9df37fe640 10 client.16032 handle_command_reply: tid=0 2024-09-21T06:30:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.097+0000 7f9e209e3740 1 client.16032 shutdown 2024-09-21T06:30:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.098+0000 7f9e209e3740 1 -- 172.21.15.63:0/1371868261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e25a8070 msgr2=0x55d0e29672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.098+0000 7f9e209e3740 1 --2- 172.21.15.63:0/1371868261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e25a8070 0x55d0e29672d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0adbe0 tx=0x7f9e0c005870 comp rx=0 tx=0).stop 2024-09-21T06:30:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.098+0000 7f9e209e3740 1 -- 172.21.15.63:0/1371868261 shutdown_connections 2024-09-21T06:30:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.098+0000 7f9e209e3740 1 --2- 172.21.15.63:0/1371868261 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55d0e253bda0 0x55d0e29de140 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.098+0000 7f9df37fe640 0 client.16032 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:30:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.098+0000 7f9e209e3740 1 --2- 172.21.15.63:0/1371868261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d0e25a8070 0x55d0e29672d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.098+0000 7f9e209e3740 1 --2- 172.21.15.63:0/1371868261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0e2587390 0x55d0e2966d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.098+0000 7f9e209e3740 1 --2- 172.21.15.63:0/1371868261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0e257f1b0 0x55d0e296b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.098+0000 7f9e209e3740 1 -- 172.21.15.63:0/1371868261 >> 172.21.15.63:0/1371868261 conn(0x55d0e259c460 msgr2=0x55d0e295e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:30.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.098+0000 7f9e209e3740 1 -- 172.21.15.63:0/1371868261 shutdown_connections 2024-09-21T06:30:30.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.098+0000 7f9e209e3740 1 -- 172.21.15.63:0/1371868261 wait complete. 2024-09-21T06:30:30.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.098+0000 7f9e209e3740 20 client.16032 trim_cache size 0 max 16384 2024-09-21T06:30:30.104 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:30:30.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.099+0000 7f9e1a46f640 1 -- 172.21.15.63:0/2938355715 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9dfc0b6680 msgr2=0x7f9dfc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:30.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.099+0000 7f9e1a46f640 1 --2- 172.21.15.63:0/2938355715 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9dfc0b6680 0x7f9dfc0b8b90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9e04005ab0 tx=0x7f9e04005a20 comp rx=0 tx=0).stop 2024-09-21T06:30:30.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.099+0000 7f9e1a46f640 1 -- 172.21.15.63:0/2938355715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e14108cf0 msgr2=0x7f9e1419ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:30.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.099+0000 7f9e1a46f640 1 --2- 172.21.15.63:0/2938355715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e14108cf0 0x7f9e1419ebc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c009fd0 tx=0x7f9e0c00ef10 comp rx=0 tx=0).stop 2024-09-21T06:30:30.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.099+0000 7f9e1a46f640 1 -- 172.21.15.63:0/2938355715 shutdown_connections 2024-09-21T06:30:30.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.099+0000 7f9e1a46f640 1 --2- 172.21.15.63:0/2938355715 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9dfc0b6680 0x7f9dfc0b8b90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.099+0000 7f9e1a46f640 1 --2- 172.21.15.63:0/2938355715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e14108cf0 0x7f9e1419ebc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.099+0000 7f9e1a46f640 1 --2- 172.21.15.63:0/2938355715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e141083a0 0x7f9e14199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.099+0000 7f9e1a46f640 1 --2- 172.21.15.63:0/2938355715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e14102a60 0x7f9e14199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:30.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.099+0000 7f9e1a46f640 1 -- 172.21.15.63:0/2938355715 >> 172.21.15.63:0/2938355715 conn(0x7f9e14079730 msgr2=0x7f9e14101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:30.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.099+0000 7f9e1a46f640 1 -- 172.21.15.63:0/2938355715 shutdown_connections 2024-09-21T06:30:30.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:30.099+0000 7f9e1a46f640 1 -- 172.21.15.63:0/2938355715 wait complete. 2024-09-21T06:30:30.123 INFO:tasks.workunit.client.0.smithi063.stdout:autoconf 2024-09-21T06:30:30.313 INFO:tasks.workunit.client.0.smithi063.stdout:./configure \ 2024-09-21T06:30:30.313 INFO:tasks.workunit.client.0.smithi063.stdout: --libexecdir=/usr/lib \ 2024-09-21T06:30:30.313 INFO:tasks.workunit.client.0.smithi063.stdout: --exec_prefix=/var/lib 2024-09-21T06:30:30.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:30 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:30.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:30 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:30.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:30 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:30:30.559 INFO:tasks.workunit.client.0.smithi063.stdout:checking build system type... x86_64-pc-linux-gnu 2024-09-21T06:30:30.559 INFO:tasks.workunit.client.0.smithi063.stdout:checking host system type... x86_64-pc-linux-gnu 2024-09-21T06:30:30.560 INFO:tasks.workunit.client.0.smithi063.stdout:checking how to print strings... printf 2024-09-21T06:30:30.560 INFO:tasks.workunit.client.0.smithi063.stdout:checking for gcc... gcc 2024-09-21T06:30:30.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:30 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:30.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:30 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:30.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:30 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:30:30.652 INFO:tasks.workunit.client.0.smithi063.stdout:checking whether the C compiler works... yes 2024-09-21T06:30:30.652 INFO:tasks.workunit.client.0.smithi063.stdout:checking for C compiler default output file name... a.out 2024-09-21T06:30:30.692 INFO:tasks.workunit.client.0.smithi063.stdout:checking for suffix of executables... 2024-09-21T06:30:30.733 INFO:tasks.workunit.client.0.smithi063.stdout:checking whether we are cross compiling... no 2024-09-21T06:30:30.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:30 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:30.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:30 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:30.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:30 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:30:30.771 INFO:tasks.workunit.client.0.smithi063.stdout:checking for suffix of object files... o 2024-09-21T06:30:30.797 INFO:tasks.workunit.client.0.smithi063.stdout:checking whether we are using the GNU C compiler... yes 2024-09-21T06:30:30.826 INFO:tasks.workunit.client.0.smithi063.stdout:checking whether gcc accepts -g... yes 2024-09-21T06:30:31.000 INFO:tasks.workunit.client.0.smithi063.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-21T06:30:31.003 INFO:tasks.workunit.client.0.smithi063.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-09-21T06:30:31.008 INFO:tasks.workunit.client.0.smithi063.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-21T06:30:31.009 INFO:tasks.workunit.client.0.smithi063.stdout:checking for egrep... /usr/bin/grep -E 2024-09-21T06:30:31.010 INFO:tasks.workunit.client.0.smithi063.stdout:checking for fgrep... /usr/bin/grep -F 2024-09-21T06:30:31.014 INFO:tasks.workunit.client.0.smithi063.stdout:checking for ld used by gcc... /usr/bin/ld 2024-09-21T06:30:31.016 INFO:tasks.workunit.client.0.smithi063.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-09-21T06:30:31.023 INFO:tasks.workunit.client.0.smithi063.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-09-21T06:30:31.042 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:30:31.301 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:31.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:31 smithi063 ceph-mon[31150]: pgmap v392: 97 pgs: 97 active+clean; 52 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 238 op/s 2024-09-21T06:30:31.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:31 smithi175 ceph-mon[34510]: pgmap v392: 97 pgs: 97 active+clean; 52 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 238 op/s 2024-09-21T06:30:31.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:31 smithi071 ceph-mon[34844]: pgmap v392: 97 pgs: 97 active+clean; 52 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 238 op/s 2024-09-21T06:30:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.878+0000 7f7044561640 1 -- 172.21.15.63:0/3237646262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f703c1083a0 msgr2=0x7f703c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.878+0000 7f7044561640 1 --2- 172.21.15.63:0/3237646262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f703c1083a0 0x7f703c1087b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7030009900 tx=0x7f703002a410 comp rx=0 tx=0).stop 2024-09-21T06:30:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.878+0000 7f7044561640 1 -- 172.21.15.63:0/3237646262 shutdown_connections 2024-09-21T06:30:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.878+0000 7f7044561640 1 --2- 172.21.15.63:0/3237646262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703c108cf0 0x7f703c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.878+0000 7f7044561640 1 --2- 172.21.15.63:0/3237646262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f703c1083a0 0x7f703c1087b0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.878+0000 7f7044561640 1 --2- 172.21.15.63:0/3237646262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f703c102a60 0x7f703c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.878+0000 7f7044561640 1 -- 172.21.15.63:0/3237646262 >> 172.21.15.63:0/3237646262 conn(0x7f703c079730 msgr2=0x7f703c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.878+0000 7f7044561640 1 -- 172.21.15.63:0/3237646262 shutdown_connections 2024-09-21T06:30:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.878+0000 7f7044561640 1 -- 172.21.15.63:0/3237646262 wait complete. 2024-09-21T06:30:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.879+0000 7f7044561640 1 Processor -- start 2024-09-21T06:30:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.879+0000 7f7044561640 1 -- start start 2024-09-21T06:30:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.879+0000 7f7044561640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f703c102a60 0x7f703c0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.879+0000 7f7044561640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f703c1083a0 0x7f703c0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.879+0000 7f7044561640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703c108cf0 0x7f703c1000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.879+0000 7f7044561640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f703c112960 con 0x7f703c102a60 2024-09-21T06:30:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.879+0000 7f7044561640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f703c1127e0 con 0x7f703c108cf0 2024-09-21T06:30:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.879+0000 7f7044561640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f703c112ae0 con 0x7f703c1083a0 2024-09-21T06:30:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.879+0000 7f70422fd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f703c102a60 0x7f703c0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.879+0000 7f70422fd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f703c102a60 0x7f703c0ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47526/0 (socket says 172.21.15.63:47526) 2024-09-21T06:30:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.879+0000 7f70422fd640 1 -- 172.21.15.63:0/3999408718 learned_addr learned my addr 172.21.15.63:0/3999408718 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.880+0000 7f7041afc640 1 --2- 172.21.15.63:0/3999408718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f703c1083a0 0x7f703c0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.880+0000 7f7042afe640 1 --2- 172.21.15.63:0/3999408718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703c108cf0 0x7f703c1000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.880+0000 7f70422fd640 1 -- 172.21.15.63:0/3999408718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f703c1083a0 msgr2=0x7f703c0ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.880+0000 7f70422fd640 1 --2- 172.21.15.63:0/3999408718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f703c1083a0 0x7f703c0ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.880+0000 7f70422fd640 1 -- 172.21.15.63:0/3999408718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703c108cf0 msgr2=0x7f703c1000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.880+0000 7f70422fd640 1 --2- 172.21.15.63:0/3999408718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703c108cf0 0x7f703c1000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.880+0000 7f70422fd640 1 -- 172.21.15.63:0/3999408718 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703c1a8760 con 0x7f703c102a60 2024-09-21T06:30:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.880+0000 7f7042afe640 1 --2- 172.21.15.63:0/3999408718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703c108cf0 0x7f703c1000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:30:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.880+0000 7f70422fd640 1 --2- 172.21.15.63:0/3999408718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f703c102a60 0x7f703c0ff670 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f703800d770 tx=0x7f703800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.880+0000 7f702f7fe640 1 -- 172.21.15.63:0/3999408718 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7038017070 con 0x7f703c102a60 2024-09-21T06:30:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.880+0000 7f7044561640 1 -- 172.21.15.63:0/3999408718 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f703c1a8a50 con 0x7f703c102a60 2024-09-21T06:30:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.880+0000 7f702f7fe640 1 -- 172.21.15.63:0/3999408718 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70380054d0 con 0x7f703c102a60 2024-09-21T06:30:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.880+0000 7f702f7fe640 1 -- 172.21.15.63:0/3999408718 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7038004c30 con 0x7f703c102a60 2024-09-21T06:30:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.880+0000 7f7044561640 1 -- 172.21.15.63:0/3999408718 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f703c1a8f60 con 0x7f703c102a60 2024-09-21T06:30:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.883+0000 7f702f7fe640 1 -- 172.21.15.63:0/3999408718 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f7038004e10 con 0x7f703c102a60 2024-09-21T06:30:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.883+0000 7f704aad5740 1 Processor -- start 2024-09-21T06:30:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.883+0000 7f704aad5740 1 -- start start 2024-09-21T06:30:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.884+0000 7f704aad5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 0x564d473062c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.884+0000 7f704aad5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d46f361b0 0x564d47306800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.884+0000 7f704aad5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f3e390 0x564d47306d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.884+0000 7f704aad5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564d4727cea0 con 0x564d46f5f070 2024-09-21T06:30:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.884+0000 7f704aad5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564d4726c2d0 con 0x564d46f3e390 2024-09-21T06:30:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.884+0000 7f704aad5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564d472700e0 con 0x564d46f361b0 2024-09-21T06:30:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.884+0000 7f7042afe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 0x564d473062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.884+0000 7f7042afe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 0x564d473062c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47538/0 (socket says 172.21.15.63:47538) 2024-09-21T06:30:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.884+0000 7f7042afe640 1 -- 172.21.15.63:0/573243600 learned_addr learned my addr 172.21.15.63:0/573243600 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.884+0000 7f70422fd640 1 --2- 172.21.15.63:0/573243600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d46f361b0 0x564d47306800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.884+0000 7f7041afc640 1 --2- 172.21.15.63:0/573243600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f3e390 0x564d47306d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.884+0000 7f702f7fe640 1 --2- 172.21.15.63:0/3999408718 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f70280b6680 0x7f70280b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.884+0000 7f7042afe640 1 -- 172.21.15.63:0/573243600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d46f361b0 msgr2=0x564d47306800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.884+0000 7f7042afe640 1 --2- 172.21.15.63:0/573243600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d46f361b0 0x564d47306800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.884+0000 7f7042afe640 1 -- 172.21.15.63:0/573243600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f3e390 msgr2=0x564d47306d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.884+0000 7f7042afe640 1 --2- 172.21.15.63:0/573243600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f3e390 0x564d47306d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.884+0000 7f7042afe640 1 -- 172.21.15.63:0/573243600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d46fca650 con 0x564d46f5f070 2024-09-21T06:30:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.884+0000 7f702f7fe640 1 -- 172.21.15.63:0/3999408718 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f70380e7250 con 0x7f703c102a60 2024-09-21T06:30:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.884+0000 7f7042afe640 1 --2- 172.21.15.63:0/3999408718 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f70280b6680 0x7f70280b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.885+0000 7f7042afe640 1 --2- 172.21.15.63:0/573243600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 0x564d473062c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f703400f410 tx=0x7f703400f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dfbd4520872fe5a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.885+0000 7f702cff9640 1 -- 172.21.15.63:0/573243600 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7034021070 con 0x564d46f5f070 2024-09-21T06:30:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.885+0000 7f702cff9640 1 -- 172.21.15.63:0/573243600 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7034011c40 con 0x564d46f5f070 2024-09-21T06:30:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.885+0000 7f702cff9640 1 -- 172.21.15.63:0/573243600 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7034015070 con 0x564d46f5f070 2024-09-21T06:30:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.886+0000 7f704aad5740 1 -- 172.21.15.63:0/573243600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 msgr2=0x564d473062c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.886+0000 7f704aad5740 1 --2- 172.21.15.63:0/573243600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 0x564d473062c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f703400f410 tx=0x7f703400f8d0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.886+0000 7f7042afe640 1 --2- 172.21.15.63:0/3999408718 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f70280b6680 0x7f70280b8b90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f703401e000 tx=0x7f7034010c90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.886+0000 7f704aad5740 1 -- 172.21.15.63:0/573243600 shutdown_connections 2024-09-21T06:30:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.886+0000 7f704aad5740 1 --2- 172.21.15.63:0/573243600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f3e390 0x564d47306d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.886+0000 7f704aad5740 1 --2- 172.21.15.63:0/573243600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d46f361b0 0x564d47306800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.886+0000 7f704aad5740 1 --2- 172.21.15.63:0/573243600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 0x564d473062c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.886+0000 7f704aad5740 1 -- 172.21.15.63:0/573243600 >> 172.21.15.63:0/573243600 conn(0x564d46f53460 msgr2=0x564d473041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.886+0000 7f704aad5740 1 -- 172.21.15.63:0/573243600 shutdown_connections 2024-09-21T06:30:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.886+0000 7f704aad5740 1 -- 172.21.15.63:0/573243600 wait complete. 2024-09-21T06:30:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.886+0000 7f704aad5740 1 -- start start 2024-09-21T06:30:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.886+0000 7f704aad5740 1 Processor -- start 2024-09-21T06:30:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.887+0000 7f704aad5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d46f361b0 0x564d47311950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.887+0000 7f704aad5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f3e390 0x564d47311e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.887+0000 7f704aad5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 0x564d4731dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.887+0000 7f704aad5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564d470cd700 con 0x564d46f5f070 2024-09-21T06:30:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.887+0000 7f704aad5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564d47207160 con 0x564d46f3e390 2024-09-21T06:30:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.887+0000 7f704aad5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564d47314aa0 con 0x564d46f361b0 2024-09-21T06:30:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.887+0000 7f704aad5740 10 client.0 _ll_register_callbacks cb 0x564d472209e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.887+0000 7f7042afe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 0x564d4731dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.887+0000 7f7042afe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 0x564d4731dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47550/0 (socket says 172.21.15.63:47550) 2024-09-21T06:30:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.887+0000 7f7042afe640 1 -- 172.21.15.63:0/2783598671 learned_addr learned my addr 172.21.15.63:0/2783598671 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.887+0000 7f70422fd640 1 --2- 172.21.15.63:0/2783598671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d46f361b0 0x564d47311950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.887+0000 7f7041afc640 1 --2- 172.21.15.63:0/2783598671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f3e390 0x564d47311e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.887+0000 7f7042afe640 1 -- 172.21.15.63:0/2783598671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d46f361b0 msgr2=0x564d47311950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.887+0000 7f7042afe640 1 --2- 172.21.15.63:0/2783598671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d46f361b0 0x564d47311950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.887+0000 7f7042afe640 1 -- 172.21.15.63:0/2783598671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f3e390 msgr2=0x564d47311e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.887+0000 7f7042afe640 1 --2- 172.21.15.63:0/2783598671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f3e390 0x564d47311e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.887+0000 7f7042afe640 1 -- 172.21.15.63:0/2783598671 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d47234c90 con 0x564d46f5f070 2024-09-21T06:30:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.887+0000 7f7042afe640 1 --2- 172.21.15.63:0/2783598671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 0x564d4731dd90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f703400f910 tx=0x7f703401d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1cf5e71234fa52 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.887+0000 7f7025ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:30:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.888+0000 7f7025ffb640 1 -- 172.21.15.63:0/2783598671 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7034034060 con 0x564d46f5f070 2024-09-21T06:30:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.888+0000 7f7025ffb640 1 -- 172.21.15.63:0/2783598671 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f7034010460 con 0x564d46f5f070 2024-09-21T06:30:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.888+0000 7f704aad5740 1 -- 172.21.15.63:0/2783598671 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7034011c40 con 0x564d46f5f070 2024-09-21T06:30:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.888+0000 7f7025ffb640 1 -- 172.21.15.63:0/2783598671 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f7034021040 con 0x564d46f5f070 2024-09-21T06:30:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.888+0000 7f704aad5740 10 client.16044 fetch_fsmap learned FSMap version 40 2024-09-21T06:30:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.888+0000 7f704aad5740 1 -- 172.21.15.63:0/2783598671 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x564d473207d0 con 0x564d46f5f070 2024-09-21T06:30:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.888+0000 7f7025ffb640 1 -- 172.21.15.63:0/2783598671 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7034011c40 con 0x564d46f5f070 2024-09-21T06:30:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.888+0000 7f7025ffb640 1 -- 172.21.15.63:0/2783598671 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 40) ==== 8366+0+0 (secure 0 0 0) 0x7f703402e030 con 0x564d46f5f070 2024-09-21T06:30:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.888+0000 7f704aad5740 10 client.16044 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T06:30:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.888+0000 7f704aad5740 10 client.16044 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:30:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.888+0000 7f704aad5740 20 client.16044 populate_metadata read hostname 'smithi063' 2024-09-21T06:30:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.888+0000 7f704aad5740 1 --2- 172.21.15.63:0/2783598671 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x564d46f1d9f0 0x564d47323c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.888+0000 7f704aad5740 4 client.16044 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:30:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.888+0000 7f704aad5740 1 -- 172.21.15.63:0/2783598671 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d4727edf0 con 0x564d46f1d9f0 2024-09-21T06:30:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.889+0000 7f70422fd640 1 --2- 172.21.15.63:0/2783598671 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x564d46f1d9f0 0x564d47323c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.889+0000 7f70422fd640 1 --2- 172.21.15.63:0/2783598671 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x564d46f1d9f0 0x564d47323c40 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82368bbb0d47662a server_cookie=6fb64805118d1b47 in_seq=0 out_seq=0 2024-09-21T06:30:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.889+0000 7f7025ffb640 10 client.16044 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:30:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.892+0000 7f7025ffb640 1 -- 172.21.15.63:0/2783598671 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564d4727edf0 con 0x564d46f1d9f0 2024-09-21T06:30:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.892+0000 7f7025ffb640 10 client.16044 handle_command_reply: tid=0 2024-09-21T06:30:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.892+0000 7f704aad5740 1 client.16044 shutdown 2024-09-21T06:30:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.892+0000 7f704aad5740 1 -- 172.21.15.63:0/2783598671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 msgr2=0x564d4731dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.892+0000 7f704aad5740 1 --2- 172.21.15.63:0/2783598671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 0x564d4731dd90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f703400f910 tx=0x7f703401d040 comp rx=0 tx=0).stop 2024-09-21T06:30:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.892+0000 7f704aad5740 1 -- 172.21.15.63:0/2783598671 shutdown_connections 2024-09-21T06:30:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.892+0000 7f704aad5740 1 --2- 172.21.15.63:0/2783598671 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x564d46f1d9f0 0x564d47323c40 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.892+0000 7f704aad5740 1 --2- 172.21.15.63:0/2783598671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 0x564d4731dd90 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.892+0000 7f704aad5740 1 --2- 172.21.15.63:0/2783598671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f3e390 0x564d47311e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.892+0000 7f704aad5740 1 --2- 172.21.15.63:0/2783598671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d46f361b0 0x564d47311950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.892+0000 7f704aad5740 1 -- 172.21.15.63:0/2783598671 >> 172.21.15.63:0/2783598671 conn(0x564d46f53460 msgr2=0x564d473094a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.892+0000 7f7025ffb640 0 client.16044 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:30:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.892+0000 7f704aad5740 1 -- 172.21.15.63:0/2783598671 shutdown_connections 2024-09-21T06:30:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.892+0000 7f704aad5740 1 -- 172.21.15.63:0/2783598671 wait complete. 2024-09-21T06:30:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.892+0000 7f704aad5740 20 client.16044 trim_cache size 0 max 16384 2024-09-21T06:30:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.905+0000 7f704aad5740 1 Processor -- start 2024-09-21T06:30:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.906+0000 7f704aad5740 1 -- start start 2024-09-21T06:30:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.906+0000 7f704aad5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d46f361b0 0x564d47311e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.906+0000 7f704aad5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f3e390 0x564d4731dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.906+0000 7f704aad5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 0x564d4730eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.906+0000 7f704aad5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f703c1b18d0 con 0x564d46f5f070 2024-09-21T06:30:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.906+0000 7f704aad5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f703c1b3440 con 0x564d46f3e390 2024-09-21T06:30:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.906+0000 7f704aad5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f703c1b1fd0 con 0x564d46f361b0 2024-09-21T06:30:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.906+0000 7f7042afe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 0x564d4730eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.906+0000 7f7042afe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 0x564d4730eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47560/0 (socket says 172.21.15.63:47560) 2024-09-21T06:30:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.906+0000 7f7042afe640 1 -- 172.21.15.63:0/1752888471 learned_addr learned my addr 172.21.15.63:0/1752888471 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:31.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.906+0000 7f70422fd640 1 --2- 172.21.15.63:0/1752888471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d46f361b0 0x564d47311e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.906+0000 7f7041afc640 1 --2- 172.21.15.63:0/1752888471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f3e390 0x564d4731dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.906+0000 7f7042afe640 1 -- 172.21.15.63:0/1752888471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d46f361b0 msgr2=0x564d47311e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:31.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.906+0000 7f7042afe640 1 --2- 172.21.15.63:0/1752888471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d46f361b0 0x564d47311e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.906+0000 7f7042afe640 1 -- 172.21.15.63:0/1752888471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f3e390 msgr2=0x564d4731dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:31.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.906+0000 7f7042afe640 1 --2- 172.21.15.63:0/1752888471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f3e390 0x564d4731dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.906+0000 7f7042afe640 1 -- 172.21.15.63:0/1752888471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d473240a0 con 0x564d46f5f070 2024-09-21T06:30:31.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.906+0000 7f7041afc640 1 --2- 172.21.15.63:0/1752888471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f3e390 0x564d4731dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:30:31.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.906+0000 7f7042afe640 1 --2- 172.21.15.63:0/1752888471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 0x564d4730eb40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7034006010 tx=0x7f7034011800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d205fc7dc61641e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:31.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.907+0000 7f7027fff640 1 -- 172.21.15.63:0/1752888471 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7034034070 con 0x564d46f5f070 2024-09-21T06:30:31.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.907+0000 7f7027fff640 1 -- 172.21.15.63:0/1752888471 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7034009c50 con 0x564d46f5f070 2024-09-21T06:30:31.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.907+0000 7f7027fff640 1 -- 172.21.15.63:0/1752888471 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7034015040 con 0x564d46f5f070 2024-09-21T06:30:31.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.907+0000 7f704aad5740 1 -- 172.21.15.63:0/1752888471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 msgr2=0x564d4730eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:31.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.907+0000 7f704aad5740 1 --2- 172.21.15.63:0/1752888471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 0x564d4730eb40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7034006010 tx=0x7f7034011800 comp rx=0 tx=0).stop 2024-09-21T06:30:31.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.907+0000 7f704aad5740 1 -- 172.21.15.63:0/1752888471 shutdown_connections 2024-09-21T06:30:31.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.907+0000 7f704aad5740 1 --2- 172.21.15.63:0/1752888471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f5f070 0x564d4730eb40 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.907+0000 7f704aad5740 1 --2- 172.21.15.63:0/1752888471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f3e390 0x564d4731dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.907+0000 7f704aad5740 1 --2- 172.21.15.63:0/1752888471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d46f361b0 0x564d47311e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.907+0000 7f704aad5740 1 -- 172.21.15.63:0/1752888471 >> 172.21.15.63:0/1752888471 conn(0x564d46f53460 msgr2=0x564d47311700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:31.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.907+0000 7f704aad5740 1 -- 172.21.15.63:0/1752888471 shutdown_connections 2024-09-21T06:30:31.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.908+0000 7f704aad5740 1 -- 172.21.15.63:0/1752888471 wait complete. 2024-09-21T06:30:31.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.908+0000 7f704aad5740 1 -- start start 2024-09-21T06:30:31.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.908+0000 7f704aad5740 1 Processor -- start 2024-09-21T06:30:31.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.908+0000 7f704aad5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f361b0 0x564d4731a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.908+0000 7f704aad5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d46f3e390 0x564d47315790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.908+0000 7f704aad5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f5f070 0x564d47315cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.908+0000 7f704aad5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f703c1b2d70 con 0x564d46f361b0 2024-09-21T06:30:31.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.908+0000 7f704aad5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f703c1b26a0 con 0x564d46f5f070 2024-09-21T06:30:31.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.908+0000 7f704aad5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f703c1af8b0 con 0x564d46f3e390 2024-09-21T06:30:31.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.908+0000 7f70422fd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f361b0 0x564d4731a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.908+0000 7f704aad5740 10 client.0 _ll_register_callbacks cb 0x7f703401f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:31.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.908+0000 7f70422fd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f361b0 0x564d4731a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47576/0 (socket says 172.21.15.63:47576) 2024-09-21T06:30:31.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.908+0000 7f70422fd640 1 -- 172.21.15.63:0/3415047931 learned_addr learned my addr 172.21.15.63:0/3415047931 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:31.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.909+0000 7f7041afc640 1 --2- 172.21.15.63:0/3415047931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d46f3e390 0x564d47315790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.909+0000 7f7042afe640 1 --2- 172.21.15.63:0/3415047931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f5f070 0x564d47315cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.909+0000 7f70422fd640 1 -- 172.21.15.63:0/3415047931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d46f3e390 msgr2=0x564d47315790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:31.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.909+0000 7f70422fd640 1 --2- 172.21.15.63:0/3415047931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d46f3e390 0x564d47315790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.909+0000 7f70422fd640 1 -- 172.21.15.63:0/3415047931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f5f070 msgr2=0x564d47315cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:31.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.909+0000 7f70422fd640 1 --2- 172.21.15.63:0/3415047931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f5f070 0x564d47315cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.909+0000 7f70422fd640 1 -- 172.21.15.63:0/3415047931 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d47316260 con 0x564d46f361b0 2024-09-21T06:30:31.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.909+0000 7f7042afe640 1 --2- 172.21.15.63:0/3415047931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f5f070 0x564d47315cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:30:31.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.909+0000 7f70422fd640 1 --2- 172.21.15.63:0/3415047931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f361b0 0x564d4731a2e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f70380e4a30 tx=0x7f70380e9760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d67f2453122f2b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:31.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.909+0000 7f7025ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:30:31.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.909+0000 7f7025ffb640 1 -- 172.21.15.63:0/3415047931 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7038020040 con 0x564d46f361b0 2024-09-21T06:30:31.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.909+0000 7f7025ffb640 1 -- 172.21.15.63:0/3415047931 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f70380ac2e0 con 0x564d46f361b0 2024-09-21T06:30:31.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.909+0000 7f704aad5740 1 -- 172.21.15.63:0/3415047931 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564d4727a8a0 con 0x564d46f361b0 2024-09-21T06:30:31.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.909+0000 7f7025ffb640 1 -- 172.21.15.63:0/3415047931 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f70380ace50 con 0x564d46f361b0 2024-09-21T06:30:31.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.909+0000 7f704aad5740 10 client.16050 fetch_fsmap learned FSMap version 40 2024-09-21T06:30:31.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.909+0000 7f704aad5740 1 -- 172.21.15.63:0/3415047931 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x564d4738e1a0 con 0x564d46f361b0 2024-09-21T06:30:31.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.910+0000 7f7025ffb640 1 -- 172.21.15.63:0/3415047931 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564d4727a8a0 con 0x564d46f361b0 2024-09-21T06:30:31.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.910+0000 7f7025ffb640 1 -- 172.21.15.63:0/3415047931 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 40) ==== 8366+0+0 (secure 0 0 0) 0x7f70380981c0 con 0x564d46f361b0 2024-09-21T06:30:31.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.910+0000 7f704aad5740 10 client.16050 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T06:30:31.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.910+0000 7f704aad5740 10 client.16050 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:30:31.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.910+0000 7f704aad5740 20 client.16050 populate_metadata read hostname 'smithi063' 2024-09-21T06:30:31.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.910+0000 7f704aad5740 1 --2- 172.21.15.63:0/3415047931 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x564d46ef2da0 0x564d473908f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.910+0000 7f704aad5740 4 client.16050 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:30:31.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.910+0000 7f704aad5740 1 -- 172.21.15.63:0/3415047931 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564d47277cd0 con 0x564d46ef2da0 2024-09-21T06:30:31.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.910+0000 7f7041afc640 1 --2- 172.21.15.63:0/3415047931 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x564d46ef2da0 0x564d473908f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.910+0000 7f7041afc640 1 --2- 172.21.15.63:0/3415047931 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x564d46ef2da0 0x564d473908f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d92870867748c99e server_cookie=cb01aa7c88bc5e36 in_seq=0 out_seq=0 2024-09-21T06:30:31.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.910+0000 7f7025ffb640 10 client.16050 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:30:31.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.911+0000 7f7025ffb640 1 -- 172.21.15.63:0/3415047931 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564d47277cd0 con 0x564d46ef2da0 2024-09-21T06:30:31.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.911+0000 7f7025ffb640 10 client.16050 handle_command_reply: tid=0 2024-09-21T06:30:31.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.911+0000 7f704aad5740 1 client.16050 shutdown 2024-09-21T06:30:31.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.911+0000 7f704aad5740 1 -- 172.21.15.63:0/3415047931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f361b0 msgr2=0x564d4731a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:31.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.911+0000 7f704aad5740 1 --2- 172.21.15.63:0/3415047931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f361b0 0x564d4731a2e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f70380e4a30 tx=0x7f70380e9760 comp rx=0 tx=0).stop 2024-09-21T06:30:31.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.911+0000 7f704aad5740 1 -- 172.21.15.63:0/3415047931 shutdown_connections 2024-09-21T06:30:31.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.911+0000 7f704aad5740 1 --2- 172.21.15.63:0/3415047931 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x564d46ef2da0 0x564d473908f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.911+0000 7f704aad5740 1 --2- 172.21.15.63:0/3415047931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d46f5f070 0x564d47315cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.911+0000 7f704aad5740 1 --2- 172.21.15.63:0/3415047931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d46f3e390 0x564d47315790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.911+0000 7f7025ffb640 0 client.16050 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:30:31.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.911+0000 7f704aad5740 1 --2- 172.21.15.63:0/3415047931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564d46f361b0 0x564d4731a2e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.911+0000 7f704aad5740 1 -- 172.21.15.63:0/3415047931 >> 172.21.15.63:0/3415047931 conn(0x564d46f53460 msgr2=0x564d473093c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:31.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.911+0000 7f704aad5740 1 -- 172.21.15.63:0/3415047931 shutdown_connections 2024-09-21T06:30:31.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.911+0000 7f704aad5740 1 -- 172.21.15.63:0/3415047931 wait complete. 2024-09-21T06:30:31.943 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:30:31.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.911+0000 7f704aad5740 20 client.16050 trim_cache size 0 max 16384 2024-09-21T06:30:31.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.911+0000 7f7044561640 1 -- 172.21.15.63:0/3999408718 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f70280b6680 msgr2=0x7f70280b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:31.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.911+0000 7f7044561640 1 --2- 172.21.15.63:0/3999408718 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f70280b6680 0x7f70280b8b90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f703401e000 tx=0x7f7034010c90 comp rx=0 tx=0).stop 2024-09-21T06:30:31.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.911+0000 7f7044561640 1 -- 172.21.15.63:0/3999408718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f703c102a60 msgr2=0x7f703c0ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:31.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.911+0000 7f7044561640 1 --2- 172.21.15.63:0/3999408718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f703c102a60 0x7f703c0ff670 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f703800d770 tx=0x7f703800dc30 comp rx=0 tx=0).stop 2024-09-21T06:30:31.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.912+0000 7f7044561640 1 -- 172.21.15.63:0/3999408718 shutdown_connections 2024-09-21T06:30:31.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.912+0000 7f7044561640 1 --2- 172.21.15.63:0/3999408718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703c108cf0 0x7f703c1000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.912+0000 7f7044561640 1 --2- 172.21.15.63:0/3999408718 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f70280b6680 0x7f70280b8b90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.912+0000 7f7044561640 1 --2- 172.21.15.63:0/3999408718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f703c1083a0 0x7f703c0ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.912+0000 7f7044561640 1 --2- 172.21.15.63:0/3999408718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f703c102a60 0x7f703c0ff670 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.912+0000 7f7044561640 1 -- 172.21.15.63:0/3999408718 >> 172.21.15.63:0/3999408718 conn(0x7f703c079730 msgr2=0x7f703c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:31.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.912+0000 7f7044561640 1 -- 172.21.15.63:0/3999408718 shutdown_connections 2024-09-21T06:30:31.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:31.912+0000 7f7044561640 1 -- 172.21.15.63:0/3999408718 wait complete. 2024-09-21T06:30:33.568 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:33 smithi063 ceph-mon[31150]: pgmap v393: 97 pgs: 97 active+clean; 56 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 294 op/s 2024-09-21T06:30:33.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:33 smithi175 ceph-mon[34510]: pgmap v393: 97 pgs: 97 active+clean; 56 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 294 op/s 2024-09-21T06:30:33.600 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T06:30:33.763 INFO:tasks.workunit.client.0.smithi063.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-09-21T06:30:33.763 INFO:tasks.workunit.client.0.smithi063.stdout:checking whether ln -s works... yes 2024-09-21T06:30:33.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:33 smithi071 ceph-mon[34844]: pgmap v393: 97 pgs: 97 active+clean; 56 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 294 op/s 2024-09-21T06:30:33.775 INFO:tasks.workunit.client.0.smithi063.stdout:checking the maximum length of command line arguments... 1572864 2024-09-21T06:30:33.777 INFO:tasks.workunit.client.0.smithi063.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-09-21T06:30:33.778 INFO:tasks.workunit.client.0.smithi063.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-09-21T06:30:33.778 INFO:tasks.workunit.client.0.smithi063.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-09-21T06:30:33.778 INFO:tasks.workunit.client.0.smithi063.stdout:checking for objdump... objdump 2024-09-21T06:30:33.779 INFO:tasks.workunit.client.0.smithi063.stdout:checking how to recognize dependent libraries... pass_all 2024-09-21T06:30:33.779 INFO:tasks.workunit.client.0.smithi063.stdout:checking for dlltool... no 2024-09-21T06:30:33.779 INFO:tasks.workunit.client.0.smithi063.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-09-21T06:30:33.780 INFO:tasks.workunit.client.0.smithi063.stdout:checking for ar... ar 2024-09-21T06:30:33.853 INFO:tasks.workunit.client.0.smithi063.stdout:checking for archiver @FILE support... @ 2024-09-21T06:30:33.853 INFO:tasks.workunit.client.0.smithi063.stdout:checking for strip... strip 2024-09-21T06:30:33.853 INFO:tasks.workunit.client.0.smithi063.stdout:checking for ranlib... ranlib 2024-09-21T06:30:33.853 INFO:tasks.workunit.client.0.smithi063.stdout:checking for gawk... gawk 2024-09-21T06:30:33.870 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:33.952 INFO:tasks.workunit.client.0.smithi063.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-09-21T06:30:33.953 INFO:tasks.workunit.client.0.smithi063.stdout:checking for sysroot... no 2024-09-21T06:30:33.964 INFO:tasks.workunit.client.0.smithi063.stdout:checking for a working dd... /usr/bin/dd 2024-09-21T06:30:33.974 INFO:tasks.workunit.client.0.smithi063.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-09-21T06:30:34.026 INFO:tasks.workunit.client.0.smithi063.stdout:checking for mt... no 2024-09-21T06:30:34.038 INFO:tasks.workunit.client.0.smithi063.stdout:checking if : is a manifest tool... no 2024-09-21T06:30:34.206 INFO:tasks.workunit.client.0.smithi063.stdout:checking how to run the C preprocessor... gcc -E 2024-09-21T06:30:34.438 INFO:tasks.workunit.client.0.smithi063.stdout:checking for ANSI C header files... yes 2024-09-21T06:30:34.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.436+0000 7f220f92a640 1 -- 172.21.15.63:0/3848700134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2208104850 msgr2=0x7f2208104c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:34.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.436+0000 7f220f92a640 1 --2- 172.21.15.63:0/3848700134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2208104850 0x7f2208104c60 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2200009900 tx=0x7f220002a410 comp rx=0 tx=0).stop 2024-09-21T06:30:34.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.436+0000 7f220f92a640 1 -- 172.21.15.63:0/3848700134 shutdown_connections 2024-09-21T06:30:34.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.436+0000 7f220f92a640 1 --2- 172.21.15.63:0/3848700134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f220810de00 0x7f2208110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.436+0000 7f220f92a640 1 --2- 172.21.15.63:0/3848700134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2208105280 0x7f220810d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.436+0000 7f220f92a640 1 --2- 172.21.15.63:0/3848700134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2208104850 0x7f2208104c60 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.436+0000 7f220f92a640 1 -- 172.21.15.63:0/3848700134 >> 172.21.15.63:0/3848700134 conn(0x7f2208079730 msgr2=0x7f2208079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:34.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.436+0000 7f220f92a640 1 -- 172.21.15.63:0/3848700134 shutdown_connections 2024-09-21T06:30:34.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.436+0000 7f220f92a640 1 -- 172.21.15.63:0/3848700134 wait complete. 2024-09-21T06:30:34.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.437+0000 7f220f92a640 1 Processor -- start 2024-09-21T06:30:34.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.437+0000 7f220f92a640 1 -- start start 2024-09-21T06:30:34.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.437+0000 7f220f92a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2208104850 0x7f220819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.437+0000 7f220f92a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2208105280 0x7f220819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.437+0000 7f220f92a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f220810de00 0x7f220819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.437+0000 7f220f92a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2208113aa0 con 0x7f2208105280 2024-09-21T06:30:34.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.437+0000 7f220f92a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2208113920 con 0x7f220810de00 2024-09-21T06:30:34.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.437+0000 7f220f92a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2208113c20 con 0x7f2208104850 2024-09-21T06:30:34.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.437+0000 7f220cec5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2208105280 0x7f220819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.437+0000 7f220dec7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f220810de00 0x7f220819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.437+0000 7f220cec5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2208105280 0x7f220819aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47596/0 (socket says 172.21.15.63:47596) 2024-09-21T06:30:34.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.437+0000 7f220cec5640 1 -- 172.21.15.63:0/2488044243 learned_addr learned my addr 172.21.15.63:0/2488044243 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:34.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.437+0000 7f220d6c6640 1 --2- 172.21.15.63:0/2488044243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2208104850 0x7f220819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.438+0000 7f220dec7640 1 -- 172.21.15.63:0/2488044243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2208104850 msgr2=0x7f220819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:34.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.438+0000 7f220dec7640 1 --2- 172.21.15.63:0/2488044243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2208104850 0x7f220819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.438+0000 7f220dec7640 1 -- 172.21.15.63:0/2488044243 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2208105280 msgr2=0x7f220819aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:34.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.438+0000 7f220dec7640 1 --2- 172.21.15.63:0/2488044243 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2208105280 0x7f220819aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.438+0000 7f220dec7640 1 -- 172.21.15.63:0/2488044243 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22081a03e0 con 0x7f220810de00 2024-09-21T06:30:34.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.438+0000 7f220cec5640 1 --2- 172.21.15.63:0/2488044243 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2208105280 0x7f220819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:34.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.438+0000 7f220dec7640 1 --2- 172.21.15.63:0/2488044243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f220810de00 0x7f220819fcb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f21f800e970 tx=0x7f21f800ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:34.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.438+0000 7f22067fc640 1 -- 172.21.15.63:0/2488044243 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f800ccc0 con 0x7f220810de00 2024-09-21T06:30:34.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.438+0000 7f22067fc640 1 -- 172.21.15.63:0/2488044243 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21f8005020 con 0x7f220810de00 2024-09-21T06:30:34.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.438+0000 7f220f92a640 1 -- 172.21.15.63:0/2488044243 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22081a06d0 con 0x7f220810de00 2024-09-21T06:30:34.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.438+0000 7f22067fc640 1 -- 172.21.15.63:0/2488044243 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8004a00 con 0x7f220810de00 2024-09-21T06:30:34.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.438+0000 7f220f92a640 1 -- 172.21.15.63:0/2488044243 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22081a6e30 con 0x7f220810de00 2024-09-21T06:30:34.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.441+0000 7f22067fc640 1 -- 172.21.15.63:0/2488044243 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f21f8004ba0 con 0x7f220810de00 2024-09-21T06:30:34.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.441+0000 7f2215e9e740 1 Processor -- start 2024-09-21T06:30:34.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.441+0000 7f2215e9e740 1 -- start start 2024-09-21T06:30:34.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.442+0000 7f2215e9e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641603a8070 0x56416074f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.442+0000 7f2215e9e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 0x56416074fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.442+0000 7f2215e9e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564160387390 0x564160750120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.442+0000 7f2215e9e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5641606c5ea0 con 0x564160387390 2024-09-21T06:30:34.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.442+0000 7f2215e9e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5641606b52d0 con 0x5641603a8070 2024-09-21T06:30:34.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.442+0000 7f2215e9e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5641606b90e0 con 0x56416037f1b0 2024-09-21T06:30:34.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.442+0000 7f220cec5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641603a8070 0x56416074f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.442+0000 7f220cec5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641603a8070 0x56416074f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:49058/0 (socket says 172.21.15.63:49058) 2024-09-21T06:30:34.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.442+0000 7f220cec5640 1 -- 172.21.15.63:0/837072715 learned_addr learned my addr 172.21.15.63:0/837072715 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:34.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.442+0000 7f220d6c6640 1 --2- 172.21.15.63:0/837072715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 0x56416074fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.442+0000 7f220cec5640 1 --2- 172.21.15.63:0/837072715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564160387390 0x564160750120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.442+0000 7f22067fc640 1 --2- 172.21.15.63:0/2488044243 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f21f00b6680 0x7f21f00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.442+0000 7f220d6c6640 1 -- 172.21.15.63:0/837072715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641603a8070 msgr2=0x56416074f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:34.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.442+0000 7f220d6c6640 1 --2- 172.21.15.63:0/837072715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641603a8070 0x56416074f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.442+0000 7f220d6c6640 1 -- 172.21.15.63:0/837072715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564160387390 msgr2=0x564160750120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:34.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.442+0000 7f220d6c6640 1 --2- 172.21.15.63:0/837072715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564160387390 0x564160750120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.442+0000 7f220d6c6640 1 -- 172.21.15.63:0/837072715 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564160413650 con 0x56416037f1b0 2024-09-21T06:30:34.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.442+0000 7f220cec5640 1 --2- 172.21.15.63:0/837072715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641603a8070 0x56416074f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:34.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.442+0000 7f220dec7640 1 --2- 172.21.15.63:0/2488044243 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f21f00b6680 0x7f21f00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.443+0000 7f22067fc640 1 -- 172.21.15.63:0/2488044243 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f21f80e76c0 con 0x7f220810de00 2024-09-21T06:30:34.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.443+0000 7f220d6c6640 1 --2- 172.21.15.63:0/837072715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 0x56416074fbe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2200006010 tx=0x7f2200032b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=350ecbb8e8874833 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:34.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.443+0000 7f21ef7fe640 1 -- 172.21.15.63:0/837072715 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2200040070 con 0x56416037f1b0 2024-09-21T06:30:34.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.443+0000 7f21ef7fe640 1 -- 172.21.15.63:0/837072715 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2200004030 con 0x56416037f1b0 2024-09-21T06:30:34.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.443+0000 7f21ef7fe640 1 -- 172.21.15.63:0/837072715 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2200035040 con 0x56416037f1b0 2024-09-21T06:30:34.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.443+0000 7f220dec7640 1 --2- 172.21.15.63:0/2488044243 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f21f00b6680 0x7f21f00b8b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f21f80ad420 tx=0x7f21f8075fb0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:34.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.444+0000 7f2215e9e740 1 -- 172.21.15.63:0/837072715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 msgr2=0x56416074fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:34.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.444+0000 7f2215e9e740 1 --2- 172.21.15.63:0/837072715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 0x56416074fbe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2200006010 tx=0x7f2200032b20 comp rx=0 tx=0).stop 2024-09-21T06:30:34.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.444+0000 7f2215e9e740 1 -- 172.21.15.63:0/837072715 shutdown_connections 2024-09-21T06:30:34.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.444+0000 7f2215e9e740 1 --2- 172.21.15.63:0/837072715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564160387390 0x564160750120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.444+0000 7f2215e9e740 1 --2- 172.21.15.63:0/837072715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 0x56416074fbe0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.444+0000 7f2215e9e740 1 --2- 172.21.15.63:0/837072715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641603a8070 0x56416074f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.444+0000 7f2215e9e740 1 -- 172.21.15.63:0/837072715 >> 172.21.15.63:0/837072715 conn(0x56416039c460 msgr2=0x56416074d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:34.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.444+0000 7f2215e9e740 1 -- 172.21.15.63:0/837072715 shutdown_connections 2024-09-21T06:30:34.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.444+0000 7f2215e9e740 1 -- 172.21.15.63:0/837072715 wait complete. 2024-09-21T06:30:34.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.444+0000 7f2215e9e740 1 -- start start 2024-09-21T06:30:34.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.445+0000 7f2215e9e740 1 Processor -- start 2024-09-21T06:30:34.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.445+0000 7f2215e9e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 0x56416075ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.445+0000 7f2215e9e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564160387390 0x56416075b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.445+0000 7f2215e9e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641603a8070 0x56416076b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.445+0000 7f2215e9e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564160516700 con 0x564160387390 2024-09-21T06:30:34.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.445+0000 7f2215e9e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564160650160 con 0x5641603a8070 2024-09-21T06:30:34.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.445+0000 7f2215e9e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564160762230 con 0x56416037f1b0 2024-09-21T06:30:34.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.445+0000 7f2215e9e740 10 client.0 _ll_register_callbacks cb 0x5641606699e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:34.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.445+0000 7f220d6c6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564160387390 0x56416075b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.445+0000 7f220cec5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641603a8070 0x56416076b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.445+0000 7f220cec5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641603a8070 0x56416076b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:49070/0 (socket says 172.21.15.63:49070) 2024-09-21T06:30:34.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.445+0000 7f220d6c6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564160387390 0x56416075b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47610/0 (socket says 172.21.15.63:47610) 2024-09-21T06:30:34.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.445+0000 7f220cec5640 1 -- 172.21.15.63:0/2687426018 learned_addr learned my addr 172.21.15.63:0/2687426018 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:34.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.445+0000 7f220cec5640 1 --2- 172.21.15.63:0/2687426018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 0x56416075ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.446+0000 7f220cec5640 1 -- 172.21.15.63:0/2687426018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 msgr2=0x56416075ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:34.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.446+0000 7f220cec5640 1 --2- 172.21.15.63:0/2687426018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 0x56416075ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.446+0000 7f220cec5640 1 -- 172.21.15.63:0/2687426018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564160387390 msgr2=0x56416075b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:34.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.446+0000 7f220cec5640 1 --2- 172.21.15.63:0/2687426018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564160387390 0x56416075b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.446+0000 7f220cec5640 1 -- 172.21.15.63:0/2687426018 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56416067dc90 con 0x5641603a8070 2024-09-21T06:30:34.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.446+0000 7f220d6c6640 1 --2- 172.21.15.63:0/2687426018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564160387390 0x56416075b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:34.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.446+0000 7f220cec5640 1 --2- 172.21.15.63:0/2687426018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641603a8070 0x56416076b520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f21fc013a70 tx=0x7f21fc015040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6764f58d8cd815b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:34.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.446+0000 7f21ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:30:34.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.446+0000 7f21ecff9640 1 -- 172.21.15.63:0/2687426018 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21fc025060 con 0x5641603a8070 2024-09-21T06:30:34.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.446+0000 7f21ecff9640 1 -- 172.21.15.63:0/2687426018 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f21fc00eca0 con 0x5641603a8070 2024-09-21T06:30:34.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.446+0000 7f2215e9e740 1 -- 172.21.15.63:0/2687426018 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2200004030 con 0x5641603a8070 2024-09-21T06:30:34.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.446+0000 7f21ecff9640 1 -- 172.21.15.63:0/2687426018 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f21fc00eea0 con 0x5641603a8070 2024-09-21T06:30:34.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.446+0000 7f2215e9e740 10 client.25703 fetch_fsmap learned FSMap version 41 2024-09-21T06:30:34.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.446+0000 7f2215e9e740 1 -- 172.21.15.63:0/2687426018 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x56416076df60 con 0x5641603a8070 2024-09-21T06:30:34.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.446+0000 7f21ecff9640 1 -- 172.21.15.63:0/2687426018 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2200004030 con 0x5641603a8070 2024-09-21T06:30:34.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.447+0000 7f21ecff9640 1 -- 172.21.15.63:0/2687426018 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f21fc01f030 con 0x5641603a8070 2024-09-21T06:30:34.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.447+0000 7f2215e9e740 10 client.25703 fetch_fsmap finished waiting for FSMap version 41 2024-09-21T06:30:34.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.447+0000 7f2215e9e740 10 client.25703 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:30:34.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.447+0000 7f2215e9e740 20 client.25703 populate_metadata read hostname 'smithi063' 2024-09-21T06:30:34.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.447+0000 7f2215e9e740 1 --2- 172.21.15.63:0/2687426018 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5641603669f0 0x564160771450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.447+0000 7f2215e9e740 4 client.25703 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:30:34.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.447+0000 7f2215e9e740 1 -- 172.21.15.63:0/2687426018 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641606c7df0 con 0x5641603669f0 2024-09-21T06:30:34.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.447+0000 7f220d6c6640 1 --2- 172.21.15.63:0/2687426018 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5641603669f0 0x564160771450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.447+0000 7f21ecff9640 10 client.25703 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:30:34.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.447+0000 7f220d6c6640 1 --2- 172.21.15.63:0/2687426018 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5641603669f0 0x564160771450 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3705a140c9259b87 server_cookie=91b73f65e46be67f in_seq=0 out_seq=0 2024-09-21T06:30:34.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.448+0000 7f21ecff9640 1 -- 172.21.15.63:0/2687426018 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5641606c7df0 con 0x5641603669f0 2024-09-21T06:30:34.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.448+0000 7f21ecff9640 10 client.25703 handle_command_reply: tid=0 2024-09-21T06:30:34.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.448+0000 7f2215e9e740 1 client.25703 shutdown 2024-09-21T06:30:34.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.448+0000 7f2215e9e740 1 -- 172.21.15.63:0/2687426018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641603a8070 msgr2=0x56416076b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:34.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.448+0000 7f2215e9e740 1 --2- 172.21.15.63:0/2687426018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641603a8070 0x56416076b520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f21fc013a70 tx=0x7f21fc015040 comp rx=0 tx=0).stop 2024-09-21T06:30:34.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.448+0000 7f2215e9e740 1 -- 172.21.15.63:0/2687426018 shutdown_connections 2024-09-21T06:30:34.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.448+0000 7f2215e9e740 1 --2- 172.21.15.63:0/2687426018 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5641603669f0 0x564160771450 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.448+0000 7f2215e9e740 1 --2- 172.21.15.63:0/2687426018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641603a8070 0x56416076b520 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.448+0000 7f2215e9e740 1 --2- 172.21.15.63:0/2687426018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564160387390 0x56416075b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.448+0000 7f21ecff9640 0 client.25703 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:30:34.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.448+0000 7f2215e9e740 1 --2- 172.21.15.63:0/2687426018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 0x56416075ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.448+0000 7f2215e9e740 1 -- 172.21.15.63:0/2687426018 >> 172.21.15.63:0/2687426018 conn(0x56416039c460 msgr2=0x564160752880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:34.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.449+0000 7f2215e9e740 1 -- 172.21.15.63:0/2687426018 shutdown_connections 2024-09-21T06:30:34.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.449+0000 7f2215e9e740 1 -- 172.21.15.63:0/2687426018 wait complete. 2024-09-21T06:30:34.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.449+0000 7f2215e9e740 20 client.25703 trim_cache size 0 max 16384 2024-09-21T06:30:34.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.462+0000 7f2215e9e740 1 Processor -- start 2024-09-21T06:30:34.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.462+0000 7f2215e9e740 1 -- start start 2024-09-21T06:30:34.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.463+0000 7f2215e9e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 0x56416075c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.463+0000 7f2215e9e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564160387390 0x564160757f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.463+0000 7f2215e9e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641603a8070 0x564160758450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.463+0000 7f2215e9e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f22081ad500 con 0x5641603a8070 2024-09-21T06:30:34.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.463+0000 7f2215e9e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f22081af0a0 con 0x564160387390 2024-09-21T06:30:34.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.463+0000 7f2215e9e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f22081adc30 con 0x56416037f1b0 2024-09-21T06:30:34.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.463+0000 7f220cec5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641603a8070 0x564160758450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.463+0000 7f220d6c6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564160387390 0x564160757f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.463+0000 7f220cec5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641603a8070 0x564160758450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47616/0 (socket says 172.21.15.63:47616) 2024-09-21T06:30:34.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.463+0000 7f220cec5640 1 -- 172.21.15.63:0/481302149 learned_addr learned my addr 172.21.15.63:0/481302149 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:34.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.463+0000 7f220d6c6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564160387390 0x564160757f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:49082/0 (socket says 172.21.15.63:49082) 2024-09-21T06:30:34.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.463+0000 7f220cec5640 1 --2- 172.21.15.63:0/481302149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 0x56416075c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.463+0000 7f220d6c6640 1 -- 172.21.15.63:0/481302149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 msgr2=0x56416075c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:34.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.463+0000 7f220d6c6640 1 --2- 172.21.15.63:0/481302149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 0x56416075c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.463+0000 7f220d6c6640 1 -- 172.21.15.63:0/481302149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641603a8070 msgr2=0x564160758450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:34.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.463+0000 7f220d6c6640 1 --2- 172.21.15.63:0/481302149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641603a8070 0x564160758450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.463+0000 7f220d6c6640 1 -- 172.21.15.63:0/481302149 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564160751990 con 0x564160387390 2024-09-21T06:30:34.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.463+0000 7f220cec5640 1 --2- 172.21.15.63:0/481302149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 0x56416075c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:30:34.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.464+0000 7f220d6c6640 1 --2- 172.21.15.63:0/481302149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564160387390 0x564160757f10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f220002a930 tx=0x7f2200047040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ba58e31b59f0e77 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:34.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.464+0000 7f21eeffd640 1 -- 172.21.15.63:0/481302149 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2200040040 con 0x564160387390 2024-09-21T06:30:34.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.464+0000 7f21eeffd640 1 -- 172.21.15.63:0/481302149 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2200005040 con 0x564160387390 2024-09-21T06:30:34.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.464+0000 7f21eeffd640 1 -- 172.21.15.63:0/481302149 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2200035040 con 0x564160387390 2024-09-21T06:30:34.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.465+0000 7f2215e9e740 1 -- 172.21.15.63:0/481302149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564160387390 msgr2=0x564160757f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:34.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.465+0000 7f2215e9e740 1 --2- 172.21.15.63:0/481302149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564160387390 0x564160757f10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f220002a930 tx=0x7f2200047040 comp rx=0 tx=0).stop 2024-09-21T06:30:34.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.465+0000 7f2215e9e740 1 -- 172.21.15.63:0/481302149 shutdown_connections 2024-09-21T06:30:34.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.465+0000 7f2215e9e740 1 --2- 172.21.15.63:0/481302149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641603a8070 0x564160758450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.465+0000 7f2215e9e740 1 --2- 172.21.15.63:0/481302149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564160387390 0x564160757f10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.465+0000 7f2215e9e740 1 --2- 172.21.15.63:0/481302149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 0x56416075c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.465+0000 7f2215e9e740 1 -- 172.21.15.63:0/481302149 >> 172.21.15.63:0/481302149 conn(0x56416039c460 msgr2=0x56416075c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:34.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.465+0000 7f2215e9e740 1 -- 172.21.15.63:0/481302149 shutdown_connections 2024-09-21T06:30:34.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.465+0000 7f2215e9e740 1 -- 172.21.15.63:0/481302149 wait complete. 2024-09-21T06:30:34.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.465+0000 7f2215e9e740 1 -- start start 2024-09-21T06:30:34.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.465+0000 7f2215e9e740 1 Processor -- start 2024-09-21T06:30:34.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.466+0000 7f2215e9e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 0x564160767df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.466+0000 7f2215e9e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564160387390 0x5641607632a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.466+0000 7f2215e9e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641603a8070 0x564160763990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.466+0000 7f2215e9e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f22081ae9d0 con 0x5641603a8070 2024-09-21T06:30:34.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.466+0000 7f2215e9e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f22081ae300 con 0x564160387390 2024-09-21T06:30:34.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.466+0000 7f2215e9e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f22081ab4e0 con 0x56416037f1b0 2024-09-21T06:30:34.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.466+0000 7f2215e9e740 10 client.0 _ll_register_callbacks cb 0x7f21fc013980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:34.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.466+0000 7f220d6c6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564160387390 0x5641607632a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.466+0000 7f220cec5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641603a8070 0x564160763990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.466+0000 7f220d6c6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564160387390 0x5641607632a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:49084/0 (socket says 172.21.15.63:49084) 2024-09-21T06:30:34.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.466+0000 7f220d6c6640 1 -- 172.21.15.63:0/3939934473 learned_addr learned my addr 172.21.15.63:0/3939934473 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:34.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.466+0000 7f220cec5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641603a8070 0x564160763990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47620/0 (socket says 172.21.15.63:47620) 2024-09-21T06:30:34.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.466+0000 7f220cec5640 1 --2- 172.21.15.63:0/3939934473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 0x564160767df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.466+0000 7f220d6c6640 1 -- 172.21.15.63:0/3939934473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 msgr2=0x564160767df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:34.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.466+0000 7f220d6c6640 1 --2- 172.21.15.63:0/3939934473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 0x564160767df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.466+0000 7f220d6c6640 1 -- 172.21.15.63:0/3939934473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641603a8070 msgr2=0x564160763990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:34.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.466+0000 7f220d6c6640 1 --2- 172.21.15.63:0/3939934473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641603a8070 0x564160763990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.466+0000 7f220d6c6640 1 -- 172.21.15.63:0/3939934473 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641607dae10 con 0x564160387390 2024-09-21T06:30:34.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.467+0000 7f220d6c6640 1 --2- 172.21.15.63:0/3939934473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564160387390 0x5641607632a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2200033000 tx=0x7f2200009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75aaca8f6907bcec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:34.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.467+0000 7f21ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:30:34.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.467+0000 7f21ecff9640 1 -- 172.21.15.63:0/3939934473 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2200035030 con 0x564160387390 2024-09-21T06:30:34.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.467+0000 7f21ecff9640 1 -- 172.21.15.63:0/3939934473 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f22000053f0 con 0x564160387390 2024-09-21T06:30:34.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.467+0000 7f2215e9e740 1 -- 172.21.15.63:0/3939934473 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2200005040 con 0x564160387390 2024-09-21T06:30:34.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.467+0000 7f21ecff9640 1 -- 172.21.15.63:0/3939934473 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f2200040040 con 0x564160387390 2024-09-21T06:30:34.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.467+0000 7f2215e9e740 10 client.25709 fetch_fsmap learned FSMap version 41 2024-09-21T06:30:34.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.467+0000 7f2215e9e740 1 -- 172.21.15.63:0/3939934473 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5641607dbee0 con 0x564160387390 2024-09-21T06:30:34.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.467+0000 7f21ecff9640 1 -- 172.21.15.63:0/3939934473 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2200005040 con 0x564160387390 2024-09-21T06:30:34.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.468+0000 7f21ecff9640 1 -- 172.21.15.63:0/3939934473 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f2200004af0 con 0x564160387390 2024-09-21T06:30:34.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.468+0000 7f2215e9e740 10 client.25709 fetch_fsmap finished waiting for FSMap version 41 2024-09-21T06:30:34.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.468+0000 7f2215e9e740 10 client.25709 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:30:34.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.468+0000 7f2215e9e740 20 client.25709 populate_metadata read hostname 'smithi063' 2024-09-21T06:30:34.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.468+0000 7f2215e9e740 1 --2- 172.21.15.63:0/3939934473 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56416033bda0 0x5641607de160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.468+0000 7f2215e9e740 4 client.25709 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:30:34.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.468+0000 7f2215e9e740 1 -- 172.21.15.63:0/3939934473 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5641607489e0 con 0x56416033bda0 2024-09-21T06:30:34.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.468+0000 7f220cec5640 1 --2- 172.21.15.63:0/3939934473 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56416033bda0 0x5641607de160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.468+0000 7f21ecff9640 10 client.25709 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:30:34.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.468+0000 7f220cec5640 1 --2- 172.21.15.63:0/3939934473 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56416033bda0 0x5641607de160 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c587b1f2094ba10f server_cookie=b574aaba27194f15 in_seq=0 out_seq=0 2024-09-21T06:30:34.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.469+0000 7f21ecff9640 1 -- 172.21.15.63:0/3939934473 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5641607489e0 con 0x56416033bda0 2024-09-21T06:30:34.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.469+0000 7f21ecff9640 10 client.25709 handle_command_reply: tid=0 2024-09-21T06:30:34.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.469+0000 7f2215e9e740 1 client.25709 shutdown 2024-09-21T06:30:34.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.469+0000 7f2215e9e740 1 -- 172.21.15.63:0/3939934473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564160387390 msgr2=0x5641607632a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:34.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.469+0000 7f2215e9e740 1 --2- 172.21.15.63:0/3939934473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564160387390 0x5641607632a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2200033000 tx=0x7f2200009260 comp rx=0 tx=0).stop 2024-09-21T06:30:34.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.469+0000 7f2215e9e740 1 -- 172.21.15.63:0/3939934473 shutdown_connections 2024-09-21T06:30:34.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.469+0000 7f2215e9e740 1 --2- 172.21.15.63:0/3939934473 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56416033bda0 0x5641607de160 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.469+0000 7f2215e9e740 1 --2- 172.21.15.63:0/3939934473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641603a8070 0x564160763990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.469+0000 7f2215e9e740 1 --2- 172.21.15.63:0/3939934473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564160387390 0x5641607632a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.469+0000 7f21ecff9640 0 client.25709 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:30:34.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.469+0000 7f2215e9e740 1 --2- 172.21.15.63:0/3939934473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56416037f1b0 0x564160767df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.469+0000 7f2215e9e740 1 -- 172.21.15.63:0/3939934473 >> 172.21.15.63:0/3939934473 conn(0x56416039c460 msgr2=0x56416075b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:34.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.469+0000 7f2215e9e740 1 -- 172.21.15.63:0/3939934473 shutdown_connections 2024-09-21T06:30:34.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.469+0000 7f2215e9e740 1 -- 172.21.15.63:0/3939934473 wait complete. 2024-09-21T06:30:34.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.469+0000 7f2215e9e740 20 client.25709 trim_cache size 0 max 16384 2024-09-21T06:30:34.479 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:30:34.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.470+0000 7f220f92a640 1 -- 172.21.15.63:0/2488044243 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f21f00b6680 msgr2=0x7f21f00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:34.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.470+0000 7f220f92a640 1 --2- 172.21.15.63:0/2488044243 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f21f00b6680 0x7f21f00b8b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f21f80ad420 tx=0x7f21f8075fb0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.470+0000 7f220f92a640 1 -- 172.21.15.63:0/2488044243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f220810de00 msgr2=0x7f220819fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:34.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.470+0000 7f220f92a640 1 --2- 172.21.15.63:0/2488044243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f220810de00 0x7f220819fcb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f21f800e970 tx=0x7f21f800ee30 comp rx=0 tx=0).stop 2024-09-21T06:30:34.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.470+0000 7f220f92a640 1 -- 172.21.15.63:0/2488044243 shutdown_connections 2024-09-21T06:30:34.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.470+0000 7f220f92a640 1 --2- 172.21.15.63:0/2488044243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f220810de00 0x7f220819fcb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.470+0000 7f220f92a640 1 --2- 172.21.15.63:0/2488044243 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2208105280 0x7f220819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.470+0000 7f220f92a640 1 --2- 172.21.15.63:0/2488044243 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f21f00b6680 0x7f21f00b8b90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.470+0000 7f220f92a640 1 --2- 172.21.15.63:0/2488044243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2208104850 0x7f220819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.470+0000 7f220f92a640 1 -- 172.21.15.63:0/2488044243 >> 172.21.15.63:0/2488044243 conn(0x7f2208079730 msgr2=0x7f2208100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:34.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.470+0000 7f220f92a640 1 -- 172.21.15.63:0/2488044243 shutdown_connections 2024-09-21T06:30:34.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:34.470+0000 7f220f92a640 1 -- 172.21.15.63:0/2488044243 wait complete. 2024-09-21T06:30:34.481 INFO:tasks.workunit.client.0.smithi063.stdout:checking for sys/types.h... yes 2024-09-21T06:30:34.513 INFO:tasks.workunit.client.0.smithi063.stdout:checking for sys/stat.h... yes 2024-09-21T06:30:34.554 INFO:tasks.workunit.client.0.smithi063.stdout:checking for stdlib.h... yes 2024-09-21T06:30:34.596 INFO:tasks.workunit.client.0.smithi063.stdout:checking for string.h... yes 2024-09-21T06:30:34.638 INFO:tasks.workunit.client.0.smithi063.stdout:checking for memory.h... yes 2024-09-21T06:30:34.677 INFO:tasks.workunit.client.0.smithi063.stdout:checking for strings.h... yes 2024-09-21T06:30:34.716 INFO:tasks.workunit.client.0.smithi063.stdout:checking for inttypes.h... yes 2024-09-21T06:30:34.758 INFO:tasks.workunit.client.0.smithi063.stdout:checking for stdint.h... yes 2024-09-21T06:30:34.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:34 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:30:34.807 INFO:tasks.workunit.client.0.smithi063.stdout:checking for unistd.h... yes 2024-09-21T06:30:34.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:34 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:30:34.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:34 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:30:34.901 INFO:tasks.workunit.client.0.smithi063.stdout:checking for dlfcn.h... yes 2024-09-21T06:30:34.907 INFO:tasks.workunit.client.0.smithi063.stdout:checking for objdir... .libs 2024-09-21T06:30:35.024 INFO:tasks.workunit.client.0.smithi063.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-09-21T06:30:35.024 INFO:tasks.workunit.client.0.smithi063.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-09-21T06:30:35.061 INFO:tasks.workunit.client.0.smithi063.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-09-21T06:30:35.395 INFO:tasks.workunit.client.0.smithi063.stdout:checking if gcc static flag -static works... no 2024-09-21T06:30:35.452 INFO:tasks.workunit.client.0.smithi063.stdout:checking if gcc supports -c -o file.o... yes 2024-09-21T06:30:35.452 INFO:tasks.workunit.client.0.smithi063.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-09-21T06:30:35.459 INFO:tasks.workunit.client.0.smithi063.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-09-21T06:30:35.541 INFO:tasks.workunit.client.0.smithi063.stdout:checking whether -lc should be explicitly linked in... no 2024-09-21T06:30:35.603 INFO:tasks.workunit.client.0.smithi063.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-09-21T06:30:35.603 INFO:tasks.workunit.client.0.smithi063.stdout:checking how to hardcode library paths into programs... immediate 2024-09-21T06:30:35.604 INFO:tasks.workunit.client.0.smithi063.stdout:checking whether stripping libraries is possible... yes 2024-09-21T06:30:35.604 INFO:tasks.workunit.client.0.smithi063.stdout:checking if libtool supports shared libraries... yes 2024-09-21T06:30:35.604 INFO:tasks.workunit.client.0.smithi063.stdout:checking whether to build shared libraries... yes 2024-09-21T06:30:35.604 INFO:tasks.workunit.client.0.smithi063.stdout:checking whether to build static libraries... yes 2024-09-21T06:30:35.612 INFO:tasks.workunit.client.0.smithi063.stdout:checking for gcc... (cached) gcc 2024-09-21T06:30:35.648 INFO:tasks.workunit.client.0.smithi063.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-21T06:30:35.648 INFO:tasks.workunit.client.0.smithi063.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-21T06:30:35.648 INFO:tasks.workunit.client.0.smithi063.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-21T06:30:35.648 INFO:tasks.workunit.client.0.smithi063.stdout:checking for gmake... /usr/bin/gmake 2024-09-21T06:30:35.649 INFO:tasks.workunit.client.0.smithi063.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-09-21T06:30:35.649 INFO:tasks.workunit.client.0.smithi063.stdout:checking for tar... /bin/tar 2024-09-21T06:30:35.649 INFO:tasks.workunit.client.0.smithi063.stdout:checking for gzip... /bin/gzip 2024-09-21T06:30:35.649 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:35 smithi063 ceph-mon[31150]: pgmap v394: 97 pgs: 97 active+clean; 56 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 285 op/s 2024-09-21T06:30:35.666 INFO:tasks.workunit.client.0.smithi063.stdout:checking whether gcc -MM is supported... yes 2024-09-21T06:30:35.667 INFO:tasks.workunit.client.0.smithi063.stdout:checking for sort... /bin/sort 2024-09-21T06:30:35.667 INFO:tasks.workunit.client.0.smithi063.stdout:checking whether ln -s works... yes 2024-09-21T06:30:35.667 INFO:tasks.workunit.client.0.smithi063.stdout:checking for rpm... /bin/rpm 2024-09-21T06:30:35.670 INFO:tasks.workunit.client.0.smithi063.stdout:checking for rpmbuild... no 2024-09-21T06:30:35.679 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:30:35.721 INFO:tasks.workunit.client.0.smithi063.stdout:checking assert.h usability... yes 2024-09-21T06:30:35.737 INFO:tasks.workunit.client.0.smithi063.stdout:checking assert.h presence... yes 2024-09-21T06:30:35.737 INFO:tasks.workunit.client.0.smithi063.stdout:checking for assert.h... yes 2024-09-21T06:30:35.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:35 smithi071 ceph-mon[34844]: pgmap v394: 97 pgs: 97 active+clean; 56 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 285 op/s 2024-09-21T06:30:35.788 INFO:tasks.workunit.client.0.smithi063.stdout:checking bstring.h usability... no 2024-09-21T06:30:35.819 INFO:tasks.workunit.client.0.smithi063.stdout:checking bstring.h presence... no 2024-09-21T06:30:35.819 INFO:tasks.workunit.client.0.smithi063.stdout:checking for bstring.h... no 2024-09-21T06:30:35.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:35 smithi175 ceph-mon[34510]: pgmap v394: 97 pgs: 97 active+clean; 56 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 285 op/s 2024-09-21T06:30:35.865 INFO:tasks.workunit.client.0.smithi063.stdout:checking libgen.h usability... yes 2024-09-21T06:30:35.882 INFO:tasks.workunit.client.0.smithi063.stdout:checking libgen.h presence... yes 2024-09-21T06:30:35.882 INFO:tasks.workunit.client.0.smithi063.stdout:checking for libgen.h... yes 2024-09-21T06:30:35.943 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:35.946 INFO:tasks.workunit.client.0.smithi063.stdout:checking dirent.h usability... yes 2024-09-21T06:30:35.962 INFO:tasks.workunit.client.0.smithi063.stdout:checking dirent.h presence... yes 2024-09-21T06:30:35.962 INFO:tasks.workunit.client.0.smithi063.stdout:checking for dirent.h... yes 2024-09-21T06:30:36.009 INFO:tasks.workunit.client.0.smithi063.stdout:checking errno.h usability... yes 2024-09-21T06:30:36.025 INFO:tasks.workunit.client.0.smithi063.stdout:checking errno.h presence... yes 2024-09-21T06:30:36.025 INFO:tasks.workunit.client.0.smithi063.stdout:checking for errno.h... yes 2024-09-21T06:30:36.087 INFO:tasks.workunit.client.0.smithi063.stdout:checking malloc.h usability... yes 2024-09-21T06:30:36.105 INFO:tasks.workunit.client.0.smithi063.stdout:checking malloc.h presence... yes 2024-09-21T06:30:36.105 INFO:tasks.workunit.client.0.smithi063.stdout:checking for malloc.h... yes 2024-09-21T06:30:36.168 INFO:tasks.workunit.client.0.smithi063.stdout:checking uuid.h usability... no 2024-09-21T06:30:36.198 INFO:tasks.workunit.client.0.smithi063.stdout:checking uuid.h presence... no 2024-09-21T06:30:36.198 INFO:tasks.workunit.client.0.smithi063.stdout:checking for uuid.h... no 2024-09-21T06:30:36.267 INFO:tasks.workunit.client.0.smithi063.stdout:checking uuid/uuid.h usability... yes 2024-09-21T06:30:36.286 INFO:tasks.workunit.client.0.smithi063.stdout:checking uuid/uuid.h presence... yes 2024-09-21T06:30:36.286 INFO:tasks.workunit.client.0.smithi063.stdout:checking for uuid/uuid.h... yes 2024-09-21T06:30:36.346 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/uuid.h usability... no 2024-09-21T06:30:36.378 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/uuid.h presence... no 2024-09-21T06:30:36.378 INFO:tasks.workunit.client.0.smithi063.stdout:checking for sys/uuid.h... no 2024-09-21T06:30:36.439 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/file.h usability... yes 2024-09-21T06:30:36.459 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/file.h presence... yes 2024-09-21T06:30:36.459 INFO:tasks.workunit.client.0.smithi063.stdout:checking for sys/file.h... yes 2024-09-21T06:30:36.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.473+0000 7f295fcbc640 1 -- 172.21.15.63:0/4002026455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2958108d10 msgr2=0x7f295810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:36.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.473+0000 7f295fcbc640 1 --2- 172.21.15.63:0/4002026455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2958108d10 0x7f295810f540 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2950009ca0 tx=0x7f295002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.473+0000 7f295fcbc640 1 -- 172.21.15.63:0/4002026455 shutdown_connections 2024-09-21T06:30:36.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.473+0000 7f295fcbc640 1 --2- 172.21.15.63:0/4002026455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2958108d10 0x7f295810f540 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.473+0000 7f295fcbc640 1 --2- 172.21.15.63:0/4002026455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29581083c0 0x7f29581087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.473+0000 7f295fcbc640 1 --2- 172.21.15.63:0/4002026455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2958102a80 0x7f2958102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.473+0000 7f295fcbc640 1 -- 172.21.15.63:0/4002026455 >> 172.21.15.63:0/4002026455 conn(0x7f2958079740 msgr2=0x7f2958079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:36.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.473+0000 7f295fcbc640 1 -- 172.21.15.63:0/4002026455 shutdown_connections 2024-09-21T06:30:36.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.473+0000 7f295fcbc640 1 -- 172.21.15.63:0/4002026455 wait complete. 2024-09-21T06:30:36.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.474+0000 7f295fcbc640 1 Processor -- start 2024-09-21T06:30:36.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.474+0000 7f295fcbc640 1 -- start start 2024-09-21T06:30:36.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.474+0000 7f295fcbc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2958102a80 0x7f295819b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:36.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.474+0000 7f295fcbc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29581083c0 0x7f295819b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:36.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.474+0000 7f295fcbc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2958108d10 0x7f295819bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:36.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.474+0000 7f295fcbc640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2958112980 con 0x7f2958108d10 2024-09-21T06:30:36.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.474+0000 7f295fcbc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2958112800 con 0x7f2958102a80 2024-09-21T06:30:36.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.474+0000 7f295fcbc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2958112b00 con 0x7f29581083c0 2024-09-21T06:30:36.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.475+0000 7f295e259640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2958108d10 0x7f295819bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:36.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.475+0000 7f295da58640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2958102a80 0x7f295819b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:36.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.475+0000 7f295da58640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2958102a80 0x7f295819b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:47398/0 (socket says 172.21.15.63:47398) 2024-09-21T06:30:36.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.475+0000 7f295da58640 1 -- 172.21.15.63:0/1924269433 learned_addr learned my addr 172.21.15.63:0/1924269433 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:36.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.475+0000 7f295e259640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2958108d10 0x7f295819bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44262/0 (socket says 172.21.15.63:44262) 2024-09-21T06:30:36.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.475+0000 7f295d257640 1 --2- 172.21.15.63:0/1924269433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29581083c0 0x7f295819b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:36.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.475+0000 7f295da58640 1 -- 172.21.15.63:0/1924269433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29581083c0 msgr2=0x7f295819b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:36.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.475+0000 7f295da58640 1 --2- 172.21.15.63:0/1924269433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29581083c0 0x7f295819b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.475+0000 7f295da58640 1 -- 172.21.15.63:0/1924269433 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2958108d10 msgr2=0x7f295819bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:36.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.475+0000 7f295da58640 1 --2- 172.21.15.63:0/1924269433 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2958108d10 0x7f295819bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.475+0000 7f295da58640 1 -- 172.21.15.63:0/1924269433 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29581a6500 con 0x7f2958102a80 2024-09-21T06:30:36.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.475+0000 7f295da58640 1 --2- 172.21.15.63:0/1924269433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2958102a80 0x7f295819b1f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f295400e9f0 tx=0x7f295400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:36.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.475+0000 7f294effd640 1 -- 172.21.15.63:0/1924269433 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295400cd80 con 0x7f2958102a80 2024-09-21T06:30:36.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.475+0000 7f295fcbc640 1 -- 172.21.15.63:0/1924269433 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29581a67f0 con 0x7f2958102a80 2024-09-21T06:30:36.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.475+0000 7f294effd640 1 -- 172.21.15.63:0/1924269433 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29540108e0 con 0x7f2958102a80 2024-09-21T06:30:36.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.475+0000 7f294effd640 1 -- 172.21.15.63:0/1924269433 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2954018980 con 0x7f2958102a80 2024-09-21T06:30:36.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.475+0000 7f295fcbc640 1 -- 172.21.15.63:0/1924269433 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29581a6d30 con 0x7f2958102a80 2024-09-21T06:30:36.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.478+0000 7f2966230740 1 Processor -- start 2024-09-21T06:30:36.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.478+0000 7f294effd640 1 -- 172.21.15.63:0/1924269433 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f2954010430 con 0x7f2958102a80 2024-09-21T06:30:36.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.478+0000 7f2966230740 1 -- start start 2024-09-21T06:30:36.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.479+0000 7f2966230740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d22ee2e070 0x55d22f1d52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:36.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.479+0000 7f2966230740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee051b0 0x55d22f1d5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:36.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.479+0000 7f2966230740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee0d390 0x55d22f1d5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:36.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.479+0000 7f2966230740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d22f14bea0 con 0x55d22ee0d390 2024-09-21T06:30:36.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.479+0000 7f2966230740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d22f13b2d0 con 0x55d22ee051b0 2024-09-21T06:30:36.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.479+0000 7f2966230740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d22f13f0e0 con 0x55d22ee2e070 2024-09-21T06:30:36.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.479+0000 7f295da58640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee051b0 0x55d22f1d5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:36.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.479+0000 7f295da58640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee051b0 0x55d22f1d5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:47400/0 (socket says 172.21.15.63:47400) 2024-09-21T06:30:36.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.479+0000 7f295da58640 1 -- 172.21.15.63:0/4000200305 learned_addr learned my addr 172.21.15.63:0/4000200305 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:36.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.479+0000 7f295da58640 1 -- 172.21.15.63:0/4000200305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d22ee2e070 msgr2=0x55d22f1d52c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:30:36.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.479+0000 7f295da58640 1 --2- 172.21.15.63:0/4000200305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d22ee2e070 0x55d22f1d52c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.479+0000 7f295da58640 1 -- 172.21.15.63:0/4000200305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee0d390 msgr2=0x55d22f1d5d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:30:36.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.479+0000 7f294effd640 1 --2- 172.21.15.63:0/1924269433 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f29440b6680 0x7f29440b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:36.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.480+0000 7f295da58640 1 --2- 172.21.15.63:0/4000200305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee0d390 0x55d22f1d5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.480+0000 7f295da58640 1 -- 172.21.15.63:0/4000200305 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d22ee99650 con 0x55d22ee051b0 2024-09-21T06:30:36.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.480+0000 7f295e259640 1 --2- 172.21.15.63:0/1924269433 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f29440b6680 0x7f29440b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:36.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.480+0000 7f294effd640 1 -- 172.21.15.63:0/1924269433 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f29540e7a70 con 0x7f2958102a80 2024-09-21T06:30:36.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.480+0000 7f295da58640 1 --2- 172.21.15.63:0/4000200305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee051b0 0x55d22f1d5800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f29540e5110 tx=0x7f2954071b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fe48e348cd857d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:36.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.480+0000 7f2943fff640 1 -- 172.21.15.63:0/4000200305 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29540ad720 con 0x55d22ee051b0 2024-09-21T06:30:36.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.480+0000 7f295e259640 1 --2- 172.21.15.63:0/1924269433 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f29440b6680 0x7f29440b8b90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2950006010 tx=0x7f29500093e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:36.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.480+0000 7f2943fff640 1 -- 172.21.15.63:0/4000200305 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2954010720 con 0x55d22ee051b0 2024-09-21T06:30:36.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.480+0000 7f2943fff640 1 -- 172.21.15.63:0/4000200305 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29540ad0c0 con 0x55d22ee051b0 2024-09-21T06:30:36.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.481+0000 7f2966230740 1 -- 172.21.15.63:0/4000200305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee051b0 msgr2=0x55d22f1d5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:36.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.481+0000 7f2966230740 1 --2- 172.21.15.63:0/4000200305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee051b0 0x55d22f1d5800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f29540e5110 tx=0x7f2954071b00 comp rx=0 tx=0).stop 2024-09-21T06:30:36.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.481+0000 7f2966230740 1 -- 172.21.15.63:0/4000200305 shutdown_connections 2024-09-21T06:30:36.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.481+0000 7f2966230740 1 --2- 172.21.15.63:0/4000200305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee0d390 0x55d22f1d5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.481+0000 7f2966230740 1 --2- 172.21.15.63:0/4000200305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee051b0 0x55d22f1d5800 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.481+0000 7f2966230740 1 --2- 172.21.15.63:0/4000200305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d22ee2e070 0x55d22f1d52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.481+0000 7f2966230740 1 -- 172.21.15.63:0/4000200305 >> 172.21.15.63:0/4000200305 conn(0x55d22ee22460 msgr2=0x55d22f1d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:36.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.481+0000 7f2966230740 1 -- 172.21.15.63:0/4000200305 shutdown_connections 2024-09-21T06:30:36.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.481+0000 7f2966230740 1 -- 172.21.15.63:0/4000200305 wait complete. 2024-09-21T06:30:36.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.482+0000 7f2966230740 1 -- start start 2024-09-21T06:30:36.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.482+0000 7f2966230740 1 Processor -- start 2024-09-21T06:30:36.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.482+0000 7f2966230740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee051b0 0x55d22f1dcb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:36.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.482+0000 7f2966230740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee0d390 0x55d22f1dd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.482+0000 7f2966230740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d22ee2e070 0x55d22f1e2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.482+0000 7f2966230740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d22ef9c700 con 0x55d22ee0d390 2024-09-21T06:30:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.482+0000 7f2966230740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d22f0d6160 con 0x55d22ee051b0 2024-09-21T06:30:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.482+0000 7f2966230740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d22f1e38e0 con 0x55d22ee2e070 2024-09-21T06:30:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.483+0000 7f2966230740 10 client.0 _ll_register_callbacks cb 0x55d22f0ef9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.483+0000 7f295d257640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee0d390 0x55d22f1dd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.483+0000 7f295da58640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee051b0 0x55d22f1dcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.483+0000 7f295d257640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee0d390 0x55d22f1dd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44280/0 (socket says 172.21.15.63:44280) 2024-09-21T06:30:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.483+0000 7f295d257640 1 -- 172.21.15.63:0/2227754919 learned_addr learned my addr 172.21.15.63:0/2227754919 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.483+0000 7f295e259640 1 --2- 172.21.15.63:0/2227754919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d22ee2e070 0x55d22f1e2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.483+0000 7f295da58640 1 -- 172.21.15.63:0/2227754919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d22ee2e070 msgr2=0x55d22f1e2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.483+0000 7f295da58640 1 --2- 172.21.15.63:0/2227754919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d22ee2e070 0x55d22f1e2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.483+0000 7f295da58640 1 -- 172.21.15.63:0/2227754919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee0d390 msgr2=0x55d22f1dd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:36.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.483+0000 7f295da58640 1 --2- 172.21.15.63:0/2227754919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee0d390 0x55d22f1dd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.483+0000 7f295da58640 1 -- 172.21.15.63:0/2227754919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d22f103c90 con 0x55d22ee051b0 2024-09-21T06:30:36.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.483+0000 7f295da58640 1 --2- 172.21.15.63:0/2227754919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee051b0 0x55d22f1dcb20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f29540ad650 tx=0x7f2954018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=778c1d3cc1786d81 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:36.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.483+0000 7f29417fa640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:30:36.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.483+0000 7f29417fa640 1 -- 172.21.15.63:0/2227754919 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29540ad2a0 con 0x55d22ee051b0 2024-09-21T06:30:36.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.483+0000 7f29417fa640 1 -- 172.21.15.63:0/2227754919 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f29540b6e30 con 0x55d22ee051b0 2024-09-21T06:30:36.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.483+0000 7f2966230740 1 -- 172.21.15.63:0/2227754919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d22f14ddf0 con 0x55d22ee051b0 2024-09-21T06:30:36.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.484+0000 7f29417fa640 1 -- 172.21.15.63:0/2227754919 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f29540ad0c0 con 0x55d22ee051b0 2024-09-21T06:30:36.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.484+0000 7f2966230740 10 client.25721 fetch_fsmap learned FSMap version 41 2024-09-21T06:30:36.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.484+0000 7f2966230740 1 -- 172.21.15.63:0/2227754919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55d22f1f7fe0 con 0x55d22ee051b0 2024-09-21T06:30:36.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.484+0000 7f29417fa640 1 -- 172.21.15.63:0/2227754919 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d22f14ddf0 con 0x55d22ee051b0 2024-09-21T06:30:36.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.484+0000 7f29417fa640 1 -- 172.21.15.63:0/2227754919 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f29540aebd0 con 0x55d22ee051b0 2024-09-21T06:30:36.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.484+0000 7f2966230740 10 client.25721 fetch_fsmap finished waiting for FSMap version 41 2024-09-21T06:30:36.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.484+0000 7f2966230740 10 client.25721 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:30:36.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.484+0000 7f2966230740 20 client.25721 populate_metadata read hostname 'smithi063' 2024-09-21T06:30:36.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.484+0000 7f2966230740 1 --2- 172.21.15.63:0/2227754919 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d22edec9f0 0x55d22f1fb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:36.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.484+0000 7f2966230740 4 client.25721 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:30:36.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.484+0000 7f2966230740 1 -- 172.21.15.63:0/2227754919 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d22f1498a0 con 0x55d22edec9f0 2024-09-21T06:30:36.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.484+0000 7f295d257640 1 --2- 172.21.15.63:0/2227754919 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d22edec9f0 0x55d22f1fb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:36.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.485+0000 7f295d257640 1 --2- 172.21.15.63:0/2227754919 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d22edec9f0 0x55d22f1fb340 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4e3f0f2ae2feba4a server_cookie=75adb28ee6968b4a in_seq=0 out_seq=0 2024-09-21T06:30:36.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.485+0000 7f29417fa640 10 client.25721 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:30:36.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.486+0000 7f29417fa640 1 -- 172.21.15.63:0/2227754919 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d22f1498a0 con 0x55d22edec9f0 2024-09-21T06:30:36.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.486+0000 7f29417fa640 10 client.25721 handle_command_reply: tid=0 2024-09-21T06:30:36.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.486+0000 7f2966230740 1 client.25721 shutdown 2024-09-21T06:30:36.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.486+0000 7f2966230740 1 -- 172.21.15.63:0/2227754919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee051b0 msgr2=0x55d22f1dcb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:36.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.486+0000 7f2966230740 1 --2- 172.21.15.63:0/2227754919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee051b0 0x55d22f1dcb20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f29540ad650 tx=0x7f2954018420 comp rx=0 tx=0).stop 2024-09-21T06:30:36.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.486+0000 7f2966230740 1 -- 172.21.15.63:0/2227754919 shutdown_connections 2024-09-21T06:30:36.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.486+0000 7f2966230740 1 --2- 172.21.15.63:0/2227754919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d22ee2e070 0x55d22f1e2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.486+0000 7f2966230740 1 --2- 172.21.15.63:0/2227754919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee0d390 0x55d22f1dd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.486+0000 7f2966230740 1 --2- 172.21.15.63:0/2227754919 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d22edec9f0 0x55d22f1fb340 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.486+0000 7f2966230740 1 --2- 172.21.15.63:0/2227754919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee051b0 0x55d22f1dcb20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.486+0000 7f2966230740 1 -- 172.21.15.63:0/2227754919 >> 172.21.15.63:0/2227754919 conn(0x55d22ee22460 msgr2=0x55d22f1d8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:36.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.486+0000 7f29417fa640 0 client.25721 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:30:36.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.486+0000 7f2966230740 1 -- 172.21.15.63:0/2227754919 shutdown_connections 2024-09-21T06:30:36.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.486+0000 7f2966230740 1 -- 172.21.15.63:0/2227754919 wait complete. 2024-09-21T06:30:36.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.486+0000 7f2966230740 20 client.25721 trim_cache size 0 max 16384 2024-09-21T06:30:36.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.500+0000 7f2966230740 1 Processor -- start 2024-09-21T06:30:36.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.500+0000 7f2966230740 1 -- start start 2024-09-21T06:30:36.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.500+0000 7f2966230740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee051b0 0x55d22f1d8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:36.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.501+0000 7f2966230740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee0d390 0x55d22f1da170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:36.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.501+0000 7f2966230740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d22ee2e070 0x55d22f1da6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:36.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.501+0000 7f2966230740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f29581ad600 con 0x55d22ee051b0 2024-09-21T06:30:36.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.501+0000 7f2966230740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f29581af1a0 con 0x55d22ee0d390 2024-09-21T06:30:36.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.501+0000 7f2966230740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f29581add30 con 0x55d22ee2e070 2024-09-21T06:30:36.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.501+0000 7f295d257640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee0d390 0x55d22f1da170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:36.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.501+0000 7f295da58640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee051b0 0x55d22f1d8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:36.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.501+0000 7f295d257640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee0d390 0x55d22f1da170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:47410/0 (socket says 172.21.15.63:47410) 2024-09-21T06:30:36.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.501+0000 7f295d257640 1 -- 172.21.15.63:0/591205009 learned_addr learned my addr 172.21.15.63:0/591205009 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:36.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.501+0000 7f295e259640 1 --2- 172.21.15.63:0/591205009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d22ee2e070 0x55d22f1da6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:36.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.501+0000 7f295d257640 1 -- 172.21.15.63:0/591205009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d22ee2e070 msgr2=0x55d22f1da6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:36.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.501+0000 7f295d257640 1 --2- 172.21.15.63:0/591205009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d22ee2e070 0x55d22f1da6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.501+0000 7f295d257640 1 -- 172.21.15.63:0/591205009 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee051b0 msgr2=0x55d22f1d8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:36.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.501+0000 7f295d257640 1 --2- 172.21.15.63:0/591205009 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee051b0 0x55d22f1d8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.501+0000 7f295d257640 1 -- 172.21.15.63:0/591205009 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d22f1d8120 con 0x55d22ee0d390 2024-09-21T06:30:36.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.501+0000 7f295e259640 1 --2- 172.21.15.63:0/591205009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d22ee2e070 0x55d22f1da6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:30:36.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.501+0000 7f295d257640 1 --2- 172.21.15.63:0/591205009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee0d390 0x55d22f1da170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f294800bc30 tx=0x7f294800bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=807904c1106c721d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:36.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.502+0000 7f29437fe640 1 -- 172.21.15.63:0/591205009 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2948003be0 con 0x55d22ee0d390 2024-09-21T06:30:36.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.502+0000 7f29437fe640 1 -- 172.21.15.63:0/591205009 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2948003d80 con 0x55d22ee0d390 2024-09-21T06:30:36.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.502+0000 7f29437fe640 1 -- 172.21.15.63:0/591205009 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2948004de0 con 0x55d22ee0d390 2024-09-21T06:30:36.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.502+0000 7f2966230740 1 -- 172.21.15.63:0/591205009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee0d390 msgr2=0x55d22f1da170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:36.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.502+0000 7f2966230740 1 --2- 172.21.15.63:0/591205009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee0d390 0x55d22f1da170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f294800bc30 tx=0x7f294800bf90 comp rx=0 tx=0).stop 2024-09-21T06:30:36.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.502+0000 7f2966230740 1 -- 172.21.15.63:0/591205009 shutdown_connections 2024-09-21T06:30:36.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.502+0000 7f2966230740 1 --2- 172.21.15.63:0/591205009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d22ee2e070 0x55d22f1da6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.503+0000 7f2966230740 1 --2- 172.21.15.63:0/591205009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee0d390 0x55d22f1da170 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.503+0000 7f2966230740 1 --2- 172.21.15.63:0/591205009 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee051b0 0x55d22f1d8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.503+0000 7f2966230740 1 -- 172.21.15.63:0/591205009 >> 172.21.15.63:0/591205009 conn(0x55d22ee22460 msgr2=0x55d22f1d83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:36.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.503+0000 7f2966230740 1 -- 172.21.15.63:0/591205009 shutdown_connections 2024-09-21T06:30:36.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.503+0000 7f2966230740 1 -- 172.21.15.63:0/591205009 wait complete. 2024-09-21T06:30:36.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.503+0000 7f2966230740 1 -- start start 2024-09-21T06:30:36.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.503+0000 7f2966230740 1 Processor -- start 2024-09-21T06:30:36.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.504+0000 7f2966230740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d22ee051b0 0x55d22f1f3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:36.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.504+0000 7f2966230740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee0d390 0x55d22f1f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:36.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.504+0000 7f2966230740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee2e070 0x55d22f1f4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:36.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.504+0000 7f2966230740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f29581aead0 con 0x55d22ee0d390 2024-09-21T06:30:36.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.504+0000 7f2966230740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f29581ae400 con 0x55d22ee2e070 2024-09-21T06:30:36.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.504+0000 7f2966230740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f29581ab5e0 con 0x55d22ee051b0 2024-09-21T06:30:36.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.504+0000 7f2966230740 10 client.0 _ll_register_callbacks cb 0x7f29540eb970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:36.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.504+0000 7f295d257640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee0d390 0x55d22f1f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:36.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.504+0000 7f295d257640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee0d390 0x55d22f1f3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44292/0 (socket says 172.21.15.63:44292) 2024-09-21T06:30:36.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.504+0000 7f295d257640 1 -- 172.21.15.63:0/413526363 learned_addr learned my addr 172.21.15.63:0/413526363 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:36.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.504+0000 7f295e259640 1 --2- 172.21.15.63:0/413526363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee2e070 0x55d22f1f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:36.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.504+0000 7f295da58640 1 --2- 172.21.15.63:0/413526363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d22ee051b0 0x55d22f1f3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:36.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.504+0000 7f295d257640 1 -- 172.21.15.63:0/413526363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d22ee051b0 msgr2=0x55d22f1f3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:36.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.504+0000 7f295d257640 1 --2- 172.21.15.63:0/413526363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d22ee051b0 0x55d22f1f3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.504+0000 7f295d257640 1 -- 172.21.15.63:0/413526363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee2e070 msgr2=0x55d22f1f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:36.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.504+0000 7f295d257640 1 --2- 172.21.15.63:0/413526363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee2e070 0x55d22f1f4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.504+0000 7f295d257640 1 -- 172.21.15.63:0/413526363 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d22f264b90 con 0x55d22ee0d390 2024-09-21T06:30:36.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.504+0000 7f295d257640 1 --2- 172.21.15.63:0/413526363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee0d390 0x55d22f1f3bd0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f294800b620 tx=0x7f294800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35768cd71e7e6fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:36.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.504+0000 7f29417fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:30:36.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.505+0000 7f29417fa640 1 -- 172.21.15.63:0/413526363 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2948004ae0 con 0x55d22ee0d390 2024-09-21T06:30:36.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.505+0000 7f29417fa640 1 -- 172.21.15.63:0/413526363 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f2948028070 con 0x55d22ee0d390 2024-09-21T06:30:36.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.505+0000 7f2966230740 1 -- 172.21.15.63:0/413526363 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2948003d80 con 0x55d22ee0d390 2024-09-21T06:30:36.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.505+0000 7f29417fa640 1 -- 172.21.15.63:0/413526363 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f294803a050 con 0x55d22ee0d390 2024-09-21T06:30:36.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.505+0000 7f2966230740 10 client.16083 fetch_fsmap learned FSMap version 41 2024-09-21T06:30:36.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.505+0000 7f2966230740 1 -- 172.21.15.63:0/413526363 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55d22f265e10 con 0x55d22ee0d390 2024-09-21T06:30:36.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.505+0000 7f29417fa640 1 -- 172.21.15.63:0/413526363 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2948003d80 con 0x55d22ee0d390 2024-09-21T06:30:36.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.505+0000 7f29417fa640 1 -- 172.21.15.63:0/413526363 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f29480235e0 con 0x55d22ee0d390 2024-09-21T06:30:36.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.505+0000 7f2966230740 10 client.16083 fetch_fsmap finished waiting for FSMap version 41 2024-09-21T06:30:36.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.505+0000 7f2966230740 10 client.16083 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:30:36.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.505+0000 7f2966230740 20 client.16083 populate_metadata read hostname 'smithi063' 2024-09-21T06:30:36.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.505+0000 7f2966230740 1 --2- 172.21.15.63:0/413526363 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d22edc1da0 0x55d22f2685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:36.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.505+0000 7f2966230740 4 client.16083 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:30:36.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.505+0000 7f2966230740 1 -- 172.21.15.63:0/413526363 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d22f146cd0 con 0x55d22edc1da0 2024-09-21T06:30:36.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.506+0000 7f295da58640 1 --2- 172.21.15.63:0/413526363 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d22edc1da0 0x55d22f2685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:36.511 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/fcntl.h usability... yes 2024-09-21T06:30:36.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.506+0000 7f295da58640 1 --2- 172.21.15.63:0/413526363 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d22edc1da0 0x55d22f2685a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ac8613e3faf22a10 server_cookie=4323c27f34de812d in_seq=0 out_seq=0 2024-09-21T06:30:36.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.506+0000 7f29417fa640 10 client.16083 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:30:36.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.506+0000 7f29417fa640 1 -- 172.21.15.63:0/413526363 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d22f146cd0 con 0x55d22edc1da0 2024-09-21T06:30:36.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.506+0000 7f29417fa640 10 client.16083 handle_command_reply: tid=0 2024-09-21T06:30:36.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.506+0000 7f2966230740 1 client.16083 shutdown 2024-09-21T06:30:36.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.507+0000 7f2966230740 1 -- 172.21.15.63:0/413526363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee0d390 msgr2=0x55d22f1f3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:36.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.507+0000 7f2966230740 1 --2- 172.21.15.63:0/413526363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee0d390 0x55d22f1f3bd0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f294800b620 tx=0x7f294800beb0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.507+0000 7f2966230740 1 -- 172.21.15.63:0/413526363 shutdown_connections 2024-09-21T06:30:36.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.507+0000 7f2966230740 1 --2- 172.21.15.63:0/413526363 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d22edc1da0 0x55d22f2685a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.507+0000 7f2966230740 1 --2- 172.21.15.63:0/413526363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d22ee2e070 0x55d22f1f4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.507+0000 7f2966230740 1 --2- 172.21.15.63:0/413526363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d22ee0d390 0x55d22f1f3bd0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.507+0000 7f2966230740 1 --2- 172.21.15.63:0/413526363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d22ee051b0 0x55d22f1f3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.507+0000 7f29417fa640 0 client.16083 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:30:36.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.507+0000 7f2966230740 1 -- 172.21.15.63:0/413526363 >> 172.21.15.63:0/413526363 conn(0x55d22ee22460 msgr2=0x55d22f1d2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:36.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.507+0000 7f2966230740 1 -- 172.21.15.63:0/413526363 shutdown_connections 2024-09-21T06:30:36.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.507+0000 7f2966230740 1 -- 172.21.15.63:0/413526363 wait complete. 2024-09-21T06:30:36.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.507+0000 7f2966230740 20 client.16083 trim_cache size 0 max 16384 2024-09-21T06:30:36.514 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:30:36.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.507+0000 7f295fcbc640 1 -- 172.21.15.63:0/1924269433 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f29440b6680 msgr2=0x7f29440b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:36.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.507+0000 7f295fcbc640 1 --2- 172.21.15.63:0/1924269433 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f29440b6680 0x7f29440b8b90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2950006010 tx=0x7f29500093e0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.507+0000 7f295fcbc640 1 -- 172.21.15.63:0/1924269433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2958102a80 msgr2=0x7f295819b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:36.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.507+0000 7f295fcbc640 1 --2- 172.21.15.63:0/1924269433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2958102a80 0x7f295819b1f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f295400e9f0 tx=0x7f295400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.508+0000 7f295fcbc640 1 -- 172.21.15.63:0/1924269433 shutdown_connections 2024-09-21T06:30:36.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.508+0000 7f295fcbc640 1 --2- 172.21.15.63:0/1924269433 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2958108d10 0x7f295819bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.508+0000 7f295fcbc640 1 --2- 172.21.15.63:0/1924269433 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f29440b6680 0x7f29440b8b90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.508+0000 7f295fcbc640 1 --2- 172.21.15.63:0/1924269433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29581083c0 0x7f295819b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.508+0000 7f295fcbc640 1 --2- 172.21.15.63:0/1924269433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2958102a80 0x7f295819b1f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:36.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.508+0000 7f295fcbc640 1 -- 172.21.15.63:0/1924269433 >> 172.21.15.63:0/1924269433 conn(0x7f2958079740 msgr2=0x7f2958104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:36.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.508+0000 7f295fcbc640 1 -- 172.21.15.63:0/1924269433 shutdown_connections 2024-09-21T06:30:36.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:36.508+0000 7f295fcbc640 1 -- 172.21.15.63:0/1924269433 wait complete. 2024-09-21T06:30:36.525 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/fcntl.h presence... yes 2024-09-21T06:30:36.525 INFO:tasks.workunit.client.0.smithi063.stdout:checking for sys/fcntl.h... yes 2024-09-21T06:30:36.580 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/syssgi.h usability... no 2024-09-21T06:30:36.608 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/syssgi.h presence... no 2024-09-21T06:30:36.608 INFO:tasks.workunit.client.0.smithi063.stdout:checking for sys/syssgi.h... no 2024-09-21T06:30:36.755 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/param.h usability... yes 2024-09-21T06:30:36.776 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/param.h presence... yes 2024-09-21T06:30:36.776 INFO:tasks.workunit.client.0.smithi063.stdout:checking for sys/param.h... yes 2024-09-21T06:30:36.792 INFO:tasks.workunit.client.0.smithi063.stdout:checking for sys/stat.h... (cached) yes 2024-09-21T06:30:36.872 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/statvfs.h usability... yes 2024-09-21T06:30:36.888 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/statvfs.h presence... yes 2024-09-21T06:30:36.888 INFO:tasks.workunit.client.0.smithi063.stdout:checking for sys/statvfs.h... yes 2024-09-21T06:30:36.942 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/time.h usability... yes 2024-09-21T06:30:36.959 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/time.h presence... yes 2024-09-21T06:30:36.959 INFO:tasks.workunit.client.0.smithi063.stdout:checking for sys/time.h... yes 2024-09-21T06:30:37.010 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/ioctl.h usability... yes 2024-09-21T06:30:37.031 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/ioctl.h presence... yes 2024-09-21T06:30:37.031 INFO:tasks.workunit.client.0.smithi063.stdout:checking for sys/ioctl.h... yes 2024-09-21T06:30:37.094 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/wait.h usability... yes 2024-09-21T06:30:37.115 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/wait.h presence... yes 2024-09-21T06:30:37.115 INFO:tasks.workunit.client.0.smithi063.stdout:checking for sys/wait.h... yes 2024-09-21T06:30:37.129 INFO:tasks.workunit.client.0.smithi063.stdout:checking for sys/types.h... (cached) yes 2024-09-21T06:30:37.134 INFO:tasks.workunit.client.0.smithi063.stdout:checking for strings.h... (cached) yes 2024-09-21T06:30:37.184 INFO:tasks.workunit.client.0.smithi063.stdout:checking err.h usability... yes 2024-09-21T06:30:37.200 INFO:tasks.workunit.client.0.smithi063.stdout:checking err.h presence... yes 2024-09-21T06:30:37.201 INFO:tasks.workunit.client.0.smithi063.stdout:checking for err.h... yes 2024-09-21T06:30:37.263 INFO:tasks.workunit.client.0.smithi063.stdout:checking linux/falloc.h usability... yes 2024-09-21T06:30:37.279 INFO:tasks.workunit.client.0.smithi063.stdout:checking linux/falloc.h presence... yes 2024-09-21T06:30:37.279 INFO:tasks.workunit.client.0.smithi063.stdout:checking for linux/falloc.h... yes 2024-09-21T06:30:37.348 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-09-21T06:30:37.380 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-09-21T06:30:37.380 INFO:tasks.workunit.client.0.smithi063.stdout:checking for sys/fs/xfs_fsops.h... no 2024-09-21T06:30:37.429 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/fs/xfs_itable.h usability... no 2024-09-21T06:30:37.457 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/fs/xfs_itable.h presence... no 2024-09-21T06:30:37.458 INFO:tasks.workunit.client.0.smithi063.stdout:checking for sys/fs/xfs_itable.h... no 2024-09-21T06:30:37.504 INFO:tasks.workunit.client.0.smithi063.stdout:checking xfs/platform_defs.h usability... no 2024-09-21T06:30:37.532 INFO:tasks.workunit.client.0.smithi063.stdout:checking xfs/platform_defs.h presence... no 2024-09-21T06:30:37.532 INFO:tasks.workunit.client.0.smithi063.stdout:checking for xfs/platform_defs.h... no 2024-09-21T06:30:37.562 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:30:37.576 INFO:tasks.workunit.client.0.smithi063.stdout:checking btrfs/ioctl.h usability... no 2024-09-21T06:30:37.604 INFO:tasks.workunit.client.0.smithi063.stdout:checking btrfs/ioctl.h presence... no 2024-09-21T06:30:37.604 INFO:tasks.workunit.client.0.smithi063.stdout:checking for btrfs/ioctl.h... no 2024-09-21T06:30:37.646 INFO:tasks.workunit.client.0.smithi063.stdout:checking cifs/ioctl.h usability... no 2024-09-21T06:30:37.674 INFO:tasks.workunit.client.0.smithi063.stdout:checking cifs/ioctl.h presence... no 2024-09-21T06:30:37.674 INFO:tasks.workunit.client.0.smithi063.stdout:checking for cifs/ioctl.h... no 2024-09-21T06:30:37.738 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/mman.h usability... yes 2024-09-21T06:30:37.754 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/mman.h presence... yes 2024-09-21T06:30:37.755 INFO:tasks.workunit.client.0.smithi063.stdout:checking for sys/mman.h... yes 2024-09-21T06:30:37.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:37 smithi071 ceph-mon[34844]: pgmap v395: 97 pgs: 97 active+clean; 57 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 270 op/s 2024-09-21T06:30:37.807 INFO:tasks.workunit.client.0.smithi063.stdout:checking linux/ext4.h usability... no 2024-09-21T06:30:37.828 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:37.826+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:37.828 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:37.827+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-21T06:30:37.828 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:37.827+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-21T06:30:37.829 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:37.827+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T06:30:37.829 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:37.827+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-09-21T06:30:37.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:37 smithi063 ceph-mon[31150]: pgmap v395: 97 pgs: 97 active+clean; 57 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 270 op/s 2024-09-21T06:30:37.838 INFO:tasks.workunit.client.0.smithi063.stdout:checking linux/ext4.h presence... no 2024-09-21T06:30:37.838 INFO:tasks.workunit.client.0.smithi063.stdout:checking for linux/ext4.h... no 2024-09-21T06:30:37.841 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:37.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:37 smithi175 ceph-mon[34510]: pgmap v395: 97 pgs: 97 active+clean; 57 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 270 op/s 2024-09-21T06:30:37.868 INFO:tasks.workunit.client.0.smithi063.stdout:checking for xfs/xfs_log_format.h... no 2024-09-21T06:30:37.924 INFO:tasks.workunit.client.0.smithi063.stdout:checking for uuid_compare... no 2024-09-21T06:30:37.979 INFO:tasks.workunit.client.0.smithi063.stdout:checking for uuid_compare in -luuid... yes 2024-09-21T06:30:38.131 INFO:tasks.workunit.client.0.smithi063.stdout:checking for xfs/xfs.h... yes 2024-09-21T06:30:38.166 INFO:tasks.workunit.client.0.smithi063.stdout:checking for xfs/libxfs.h... no 2024-09-21T06:30:38.206 INFO:tasks.workunit.client.0.smithi063.stdout:checking whether xlog_assign_lsn is declared... no 2024-09-21T06:30:38.246 INFO:tasks.workunit.client.0.smithi063.stdout:checking for xfs/xqm.h... yes 2024-09-21T06:30:38.303 INFO:tasks.workunit.client.0.smithi063.stdout:checking xfsctl from xfs/xfs.h... ok 2024-09-21T06:30:38.342 INFO:tasks.workunit.client.0.smithi063.stdout:checking xfs/handle.h usability... yes 2024-09-21T06:30:38.357 INFO:tasks.workunit.client.0.smithi063.stdout:checking xfs/handle.h presence... yes 2024-09-21T06:30:38.357 INFO:tasks.workunit.client.0.smithi063.stdout:checking for xfs/handle.h... yes 2024-09-21T06:30:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.373+0000 7fed6b316640 1 -- 172.21.15.63:0/887020798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed641084b0 msgr2=0x7fed6410ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.373+0000 7fed6b316640 1 --2- 172.21.15.63:0/887020798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed641084b0 0x7fed6410ece0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009ca0 tx=0x7fed5c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.373+0000 7fed6b316640 1 -- 172.21.15.63:0/887020798 shutdown_connections 2024-09-21T06:30:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.373+0000 7fed6b316640 1 --2- 172.21.15.63:0/887020798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed641084b0 0x7fed6410ece0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.373+0000 7fed6b316640 1 --2- 172.21.15.63:0/887020798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed64107b60 0x7fed64107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.373+0000 7fed6b316640 1 --2- 172.21.15.63:0/887020798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed64102270 0x7fed64102680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.373+0000 7fed6b316640 1 -- 172.21.15.63:0/887020798 >> 172.21.15.63:0/887020798 conn(0x7fed64077cc0 msgr2=0x7fed64078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.374+0000 7fed6b316640 1 -- 172.21.15.63:0/887020798 shutdown_connections 2024-09-21T06:30:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.374+0000 7fed6b316640 1 -- 172.21.15.63:0/887020798 wait complete. 2024-09-21T06:30:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.374+0000 7fed6b316640 1 Processor -- start 2024-09-21T06:30:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.374+0000 7fed6b316640 1 -- start start 2024-09-21T06:30:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.375+0000 7fed6b316640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed64102270 0x7fed6419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.375+0000 7fed6b316640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed64107b60 0x7fed6419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.375+0000 7fed6b316640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed641084b0 0x7fed6419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.375+0000 7fed6b316640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fed641118f0 con 0x7fed641084b0 2024-09-21T06:30:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.375+0000 7fed6b316640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fed64111770 con 0x7fed64102270 2024-09-21T06:30:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.375+0000 7fed6b316640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fed64111a70 con 0x7fed64107b60 2024-09-21T06:30:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.375+0000 7fed690b2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed64102270 0x7fed6419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.375+0000 7fed698b3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed641084b0 0x7fed6419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.375+0000 7fed690b2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed64102270 0x7fed6419a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:47440/0 (socket says 172.21.15.63:47440) 2024-09-21T06:30:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.375+0000 7fed690b2640 1 -- 172.21.15.63:0/3387114795 learned_addr learned my addr 172.21.15.63:0/3387114795 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.375+0000 7fed688b1640 1 --2- 172.21.15.63:0/3387114795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed64107b60 0x7fed6419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.375+0000 7fed690b2640 1 -- 172.21.15.63:0/3387114795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed64107b60 msgr2=0x7fed6419aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.375+0000 7fed690b2640 1 --2- 172.21.15.63:0/3387114795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed64107b60 0x7fed6419aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.375+0000 7fed690b2640 1 -- 172.21.15.63:0/3387114795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed641084b0 msgr2=0x7fed6419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.375+0000 7fed690b2640 1 --2- 172.21.15.63:0/3387114795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed641084b0 0x7fed6419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.375+0000 7fed690b2640 1 -- 172.21.15.63:0/3387114795 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed641a0410 con 0x7fed64102270 2024-09-21T06:30:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.376+0000 7fed690b2640 1 --2- 172.21.15.63:0/3387114795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed64102270 0x7fed6419a4a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fed6000ea20 tx=0x7fed6000eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.378+0000 7fed5a7fc640 1 -- 172.21.15.63:0/3387114795 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6000cd40 con 0x7fed64102270 2024-09-21T06:30:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.378+0000 7fed5a7fc640 1 -- 172.21.15.63:0/3387114795 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed600168c0 con 0x7fed64102270 2024-09-21T06:30:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.378+0000 7fed6b316640 1 -- 172.21.15.63:0/3387114795 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed641a0700 con 0x7fed64102270 2024-09-21T06:30:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.378+0000 7fed5a7fc640 1 -- 172.21.15.63:0/3387114795 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6000b840 con 0x7fed64102270 2024-09-21T06:30:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.378+0000 7fed6b316640 1 -- 172.21.15.63:0/3387114795 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed640fece0 con 0x7fed64102270 2024-09-21T06:30:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.381+0000 7fed5a7fc640 1 -- 172.21.15.63:0/3387114795 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fed6000b9e0 con 0x7fed64102270 2024-09-21T06:30:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.381+0000 7fed7188a740 1 Processor -- start 2024-09-21T06:30:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.381+0000 7fed7188a740 1 -- start start 2024-09-21T06:30:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.382+0000 7fed7188a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d10b647070 0x55d10b9ee6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.382+0000 7fed7188a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b61e1b0 0x55d10b9eebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:38.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.382+0000 7fed5a7fc640 1 --2- 172.21.15.63:0/3387114795 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fed500b6700 0x7fed500b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:38.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.382+0000 7fed7188a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b626390 0x55d10b9ef120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:38.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.382+0000 7fed7188a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d10b964ea0 con 0x55d10b61e1b0 2024-09-21T06:30:38.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.382+0000 7fed7188a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d10b9542d0 con 0x55d10b626390 2024-09-21T06:30:38.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.382+0000 7fed7188a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d10b9580e0 con 0x55d10b647070 2024-09-21T06:30:38.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.382+0000 7fed688b1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b61e1b0 0x55d10b9eebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:38.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.382+0000 7fed688b1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b61e1b0 0x55d10b9eebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44318/0 (socket says 172.21.15.63:44318) 2024-09-21T06:30:38.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.382+0000 7fed688b1640 1 -- 172.21.15.63:0/776238744 learned_addr learned my addr 172.21.15.63:0/776238744 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:38.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.382+0000 7fed690b2640 1 --2- 172.21.15.63:0/3387114795 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fed500b6700 0x7fed500b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:38.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.382+0000 7fed698b3640 1 --2- 172.21.15.63:0/776238744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b626390 0x55d10b9ef120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:38.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.382+0000 7fed698b3640 1 --2- 172.21.15.63:0/776238744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d10b647070 0x55d10b9ee6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:38.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.382+0000 7fed5a7fc640 1 -- 172.21.15.63:0/3387114795 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fed600e7590 con 0x7fed64102270 2024-09-21T06:30:38.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.382+0000 7fed688b1640 1 -- 172.21.15.63:0/776238744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d10b647070 msgr2=0x55d10b9ee6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.382+0000 7fed688b1640 1 --2- 172.21.15.63:0/776238744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d10b647070 0x55d10b9ee6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.382+0000 7fed688b1640 1 -- 172.21.15.63:0/776238744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b626390 msgr2=0x55d10b9ef120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.382+0000 7fed688b1640 1 --2- 172.21.15.63:0/776238744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b626390 0x55d10b9ef120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.382+0000 7fed688b1640 1 -- 172.21.15.63:0/776238744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d10b6b2650 con 0x55d10b61e1b0 2024-09-21T06:30:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.383+0000 7fed690b2640 1 --2- 172.21.15.63:0/3387114795 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fed500b6700 0x7fed500b8c10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fed600aa6e0 tx=0x7fed60009000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.383+0000 7fed688b1640 1 --2- 172.21.15.63:0/776238744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b61e1b0 0x55d10b9eebe0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fed5400bc30 tx=0x7fed540107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44147233a45aa9d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.384+0000 7fed4f7fe640 1 -- 172.21.15.63:0/776238744 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5401c480 con 0x55d10b61e1b0 2024-09-21T06:30:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.384+0000 7fed4f7fe640 1 -- 172.21.15.63:0/776238744 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed5401cad0 con 0x55d10b61e1b0 2024-09-21T06:30:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.384+0000 7fed4f7fe640 1 -- 172.21.15.63:0/776238744 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed54011a30 con 0x55d10b61e1b0 2024-09-21T06:30:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.385+0000 7fed7188a740 1 -- 172.21.15.63:0/776238744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b61e1b0 msgr2=0x55d10b9eebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.385+0000 7fed7188a740 1 --2- 172.21.15.63:0/776238744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b61e1b0 0x55d10b9eebe0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fed5400bc30 tx=0x7fed540107a0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.385+0000 7fed7188a740 1 -- 172.21.15.63:0/776238744 shutdown_connections 2024-09-21T06:30:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.385+0000 7fed7188a740 1 --2- 172.21.15.63:0/776238744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b626390 0x55d10b9ef120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.385+0000 7fed7188a740 1 --2- 172.21.15.63:0/776238744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b61e1b0 0x55d10b9eebe0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.385+0000 7fed7188a740 1 --2- 172.21.15.63:0/776238744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d10b647070 0x55d10b9ee6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.385+0000 7fed7188a740 1 -- 172.21.15.63:0/776238744 >> 172.21.15.63:0/776238744 conn(0x55d10b63b460 msgr2=0x55d10b9ec590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:38.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.385+0000 7fed7188a740 1 -- 172.21.15.63:0/776238744 shutdown_connections 2024-09-21T06:30:38.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.385+0000 7fed7188a740 1 -- 172.21.15.63:0/776238744 wait complete. 2024-09-21T06:30:38.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.386+0000 7fed7188a740 1 -- start start 2024-09-21T06:30:38.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.386+0000 7fed7188a740 1 Processor -- start 2024-09-21T06:30:38.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.386+0000 7fed7188a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b61e1b0 0x55d10b9f9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:38.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.386+0000 7fed7188a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b626390 0x55d10b9fa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:38.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.386+0000 7fed7188a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d10b647070 0x55d10ba061a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:38.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.386+0000 7fed7188a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d10b7b5700 con 0x55d10b626390 2024-09-21T06:30:38.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.386+0000 7fed7188a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d10b8ef160 con 0x55d10b61e1b0 2024-09-21T06:30:38.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.386+0000 7fed7188a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d10b9fce80 con 0x55d10b647070 2024-09-21T06:30:38.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.386+0000 7fed7188a740 10 client.0 _ll_register_callbacks cb 0x55d10b9089e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:38.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.386+0000 7fed688b1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b626390 0x55d10b9fa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:38.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.386+0000 7fed688b1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b626390 0x55d10b9fa2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44332/0 (socket says 172.21.15.63:44332) 2024-09-21T06:30:38.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.386+0000 7fed698b3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b61e1b0 0x55d10b9f9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:38.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.386+0000 7fed688b1640 1 -- 172.21.15.63:0/4233013824 learned_addr learned my addr 172.21.15.63:0/4233013824 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:38.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.386+0000 7fed698b3640 1 --2- 172.21.15.63:0/4233013824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d10b647070 0x55d10ba061a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:38.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.387+0000 7fed688b1640 1 -- 172.21.15.63:0/4233013824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d10b647070 msgr2=0x55d10ba061a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:38.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.387+0000 7fed688b1640 1 --2- 172.21.15.63:0/4233013824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d10b647070 0x55d10ba061a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.387+0000 7fed688b1640 1 -- 172.21.15.63:0/4233013824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b61e1b0 msgr2=0x55d10b9f9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:38.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.387+0000 7fed688b1640 1 --2- 172.21.15.63:0/4233013824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b61e1b0 0x55d10b9f9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.387+0000 7fed688b1640 1 -- 172.21.15.63:0/4233013824 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d10b91cc90 con 0x55d10b626390 2024-09-21T06:30:38.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.387+0000 7fed688b1640 1 --2- 172.21.15.63:0/4233013824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b626390 0x55d10b9fa2d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fed54006010 tx=0x7fed54011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef63e712d2234c2f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:38.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.387+0000 7fed4cff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:30:38.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.387+0000 7fed4cff9640 1 -- 172.21.15.63:0/4233013824 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5402b060 con 0x55d10b626390 2024-09-21T06:30:38.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.387+0000 7fed4cff9640 1 -- 172.21.15.63:0/4233013824 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fed5401c480 con 0x55d10b626390 2024-09-21T06:30:38.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.387+0000 7fed7188a740 1 -- 172.21.15.63:0/4233013824 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed5401cad0 con 0x55d10b626390 2024-09-21T06:30:38.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.387+0000 7fed4cff9640 1 -- 172.21.15.63:0/4233013824 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fed5401c680 con 0x55d10b626390 2024-09-21T06:30:38.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.387+0000 7fed7188a740 10 client.16095 fetch_fsmap learned FSMap version 42 2024-09-21T06:30:38.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.387+0000 7fed7188a740 1 -- 172.21.15.63:0/4233013824 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55d10ba08b90 con 0x55d10b626390 2024-09-21T06:30:38.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.388+0000 7fed4cff9640 1 -- 172.21.15.63:0/4233013824 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed5401cad0 con 0x55d10b626390 2024-09-21T06:30:38.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.388+0000 7fed4cff9640 1 -- 172.21.15.63:0/4233013824 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 42) ==== 8374+0+0 (secure 0 0 0) 0x7fed540117b0 con 0x55d10b626390 2024-09-21T06:30:38.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.388+0000 7fed7188a740 10 client.16095 fetch_fsmap finished waiting for FSMap version 42 2024-09-21T06:30:38.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.388+0000 7fed7188a740 10 client.16095 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:30:38.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.388+0000 7fed7188a740 20 client.16095 populate_metadata read hostname 'smithi063' 2024-09-21T06:30:38.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.388+0000 7fed7188a740 1 --2- 172.21.15.63:0/4233013824 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55d10b6059f0 0x55d10ba0bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:38.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.388+0000 7fed7188a740 4 client.16095 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:30:38.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.388+0000 7fed7188a740 1 -- 172.21.15.63:0/4233013824 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d10b966df0 con 0x55d10b6059f0 2024-09-21T06:30:38.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.388+0000 7fed698b3640 1 --2- 172.21.15.63:0/4233013824 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55d10b6059f0 0x55d10ba0bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:38.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.389+0000 7fed4cff9640 10 client.16095 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:30:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.389+0000 7fed698b3640 1 --2- 172.21.15.63:0/4233013824 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55d10b6059f0 0x55d10ba0bfa0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=57734ecd48a95034 server_cookie=2f74b2006ed2699f in_seq=0 out_seq=0 2024-09-21T06:30:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.390+0000 7fed4cff9640 1 -- 172.21.15.63:0/4233013824 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d10b966df0 con 0x55d10b6059f0 2024-09-21T06:30:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.390+0000 7fed4cff9640 10 client.16095 handle_command_reply: tid=0 2024-09-21T06:30:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.390+0000 7fed7188a740 1 client.16095 shutdown 2024-09-21T06:30:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.391+0000 7fed7188a740 1 -- 172.21.15.63:0/4233013824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b626390 msgr2=0x55d10b9fa2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.391+0000 7fed7188a740 1 --2- 172.21.15.63:0/4233013824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b626390 0x55d10b9fa2d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fed54006010 tx=0x7fed54011440 comp rx=0 tx=0).stop 2024-09-21T06:30:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.391+0000 7fed7188a740 1 -- 172.21.15.63:0/4233013824 shutdown_connections 2024-09-21T06:30:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.391+0000 7fed7188a740 1 --2- 172.21.15.63:0/4233013824 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55d10b6059f0 0x55d10ba0bfa0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.391+0000 7fed7188a740 1 --2- 172.21.15.63:0/4233013824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d10b647070 0x55d10ba061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.391+0000 7fed7188a740 1 --2- 172.21.15.63:0/4233013824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b626390 0x55d10b9fa2d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.391+0000 7fed7188a740 1 --2- 172.21.15.63:0/4233013824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b61e1b0 0x55d10b9f9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.391+0000 7fed7188a740 1 -- 172.21.15.63:0/4233013824 >> 172.21.15.63:0/4233013824 conn(0x55d10b63b460 msgr2=0x55d10b9f1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.391+0000 7fed4cff9640 0 client.16095 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:30:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.391+0000 7fed7188a740 1 -- 172.21.15.63:0/4233013824 shutdown_connections 2024-09-21T06:30:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.392+0000 7fed7188a740 1 -- 172.21.15.63:0/4233013824 wait complete. 2024-09-21T06:30:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.392+0000 7fed7188a740 20 client.16095 trim_cache size 0 max 16384 2024-09-21T06:30:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.406+0000 7fed7188a740 1 Processor -- start 2024-09-21T06:30:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.406+0000 7fed7188a740 1 -- start start 2024-09-21T06:30:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.406+0000 7fed7188a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d10b61e1b0 0x55d10b9fa250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.406+0000 7fed7188a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b626390 0x55d10ba06110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.406+0000 7fed7188a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b647070 0x55d10b9ebbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.406+0000 7fed7188a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fed641ad490 con 0x55d10b626390 2024-09-21T06:30:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.406+0000 7fed7188a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fed641af060 con 0x55d10b647070 2024-09-21T06:30:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.406+0000 7fed7188a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fed641adbf0 con 0x55d10b61e1b0 2024-09-21T06:30:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.407+0000 7fed688b1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b626390 0x55d10ba06110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.407+0000 7fed698b3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b647070 0x55d10b9ebbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.407+0000 7fed688b1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b626390 0x55d10ba06110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44348/0 (socket says 172.21.15.63:44348) 2024-09-21T06:30:38.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.407+0000 7fed688b1640 1 -- 172.21.15.63:0/2684063620 learned_addr learned my addr 172.21.15.63:0/2684063620 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:38.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.407+0000 7fed698b3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b647070 0x55d10b9ebbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:47482/0 (socket says 172.21.15.63:47482) 2024-09-21T06:30:38.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.407+0000 7fed698b3640 1 --2- 172.21.15.63:0/2684063620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d10b61e1b0 0x55d10b9fa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:38.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.407+0000 7fed688b1640 1 -- 172.21.15.63:0/2684063620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d10b61e1b0 msgr2=0x55d10b9fa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:38.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.407+0000 7fed688b1640 1 --2- 172.21.15.63:0/2684063620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d10b61e1b0 0x55d10b9fa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.407+0000 7fed688b1640 1 -- 172.21.15.63:0/2684063620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b647070 msgr2=0x55d10b9ebbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:38.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.407+0000 7fed688b1640 1 --2- 172.21.15.63:0/2684063620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b647070 0x55d10b9ebbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.407+0000 7fed688b1640 1 -- 172.21.15.63:0/2684063620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d10b9f0990 con 0x55d10b626390 2024-09-21T06:30:38.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.407+0000 7fed698b3640 1 --2- 172.21.15.63:0/2684063620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b647070 0x55d10b9ebbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:38.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.407+0000 7fed688b1640 1 --2- 172.21.15.63:0/2684063620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b626390 0x55d10ba06110 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fed54011d20 tx=0x7fed54005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ead217f76304e79 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:38.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.407+0000 7fed4effd640 1 -- 172.21.15.63:0/2684063620 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5402b040 con 0x55d10b626390 2024-09-21T06:30:38.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.408+0000 7fed4effd640 1 -- 172.21.15.63:0/2684063620 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed5401c480 con 0x55d10b626390 2024-09-21T06:30:38.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.408+0000 7fed4effd640 1 -- 172.21.15.63:0/2684063620 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed540042a0 con 0x55d10b626390 2024-09-21T06:30:38.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.408+0000 7fed7188a740 1 -- 172.21.15.63:0/2684063620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b626390 msgr2=0x55d10ba06110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:38.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.408+0000 7fed7188a740 1 --2- 172.21.15.63:0/2684063620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b626390 0x55d10ba06110 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fed54011d20 tx=0x7fed54005c50 comp rx=0 tx=0).stop 2024-09-21T06:30:38.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.409+0000 7fed7188a740 1 -- 172.21.15.63:0/2684063620 shutdown_connections 2024-09-21T06:30:38.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.409+0000 7fed7188a740 1 --2- 172.21.15.63:0/2684063620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b647070 0x55d10b9ebbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.409+0000 7fed7188a740 1 --2- 172.21.15.63:0/2684063620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b626390 0x55d10ba06110 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.409+0000 7fed7188a740 1 --2- 172.21.15.63:0/2684063620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d10b61e1b0 0x55d10b9fa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.409+0000 7fed7188a740 1 -- 172.21.15.63:0/2684063620 >> 172.21.15.63:0/2684063620 conn(0x55d10b63b460 msgr2=0x55d10b9f9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:38.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.409+0000 7fed7188a740 1 -- 172.21.15.63:0/2684063620 shutdown_connections 2024-09-21T06:30:38.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.409+0000 7fed7188a740 1 -- 172.21.15.63:0/2684063620 wait complete. 2024-09-21T06:30:38.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.409+0000 7fed7188a740 1 -- start start 2024-09-21T06:30:38.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.409+0000 7fed7188a740 1 Processor -- start 2024-09-21T06:30:38.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.410+0000 7fed7188a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d10b61e1b0 0x55d10ba0c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:38.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.410+0000 7fed7188a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b626390 0x55d10ba0cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:38.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.410+0000 7fed7188a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b647070 0x55d10ba6e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:38.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.410+0000 7fed7188a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fed641ae990 con 0x55d10b647070 2024-09-21T06:30:38.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.410+0000 7fed7188a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fed641ae2c0 con 0x55d10b626390 2024-09-21T06:30:38.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.410+0000 7fed7188a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fed641ab470 con 0x55d10b61e1b0 2024-09-21T06:30:38.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.410+0000 7fed7188a740 10 client.0 _ll_register_callbacks cb 0x7fed5c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:38.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.410+0000 7fed698b3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b647070 0x55d10ba6e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:38.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.410+0000 7fed688b1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b626390 0x55d10ba0cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:38.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.410+0000 7fed698b3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b647070 0x55d10ba6e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44364/0 (socket says 172.21.15.63:44364) 2024-09-21T06:30:38.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.410+0000 7fed688b1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b626390 0x55d10ba0cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:47484/0 (socket says 172.21.15.63:47484) 2024-09-21T06:30:38.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.410+0000 7fed698b3640 1 -- 172.21.15.63:0/2394983861 learned_addr learned my addr 172.21.15.63:0/2394983861 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:38.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.410+0000 7fed698b3640 1 --2- 172.21.15.63:0/2394983861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d10b61e1b0 0x55d10ba0c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:38.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.410+0000 7fed698b3640 1 -- 172.21.15.63:0/2394983861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d10b61e1b0 msgr2=0x55d10ba0c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:38.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.410+0000 7fed698b3640 1 --2- 172.21.15.63:0/2394983861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d10b61e1b0 0x55d10ba0c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.410+0000 7fed698b3640 1 -- 172.21.15.63:0/2394983861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b626390 msgr2=0x55d10ba0cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:38.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.410+0000 7fed698b3640 1 --2- 172.21.15.63:0/2394983861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b626390 0x55d10ba0cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.410+0000 7fed698b3640 1 -- 172.21.15.63:0/2394983861 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d10ba6edc0 con 0x55d10b647070 2024-09-21T06:30:38.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.410+0000 7fed698b3640 1 --2- 172.21.15.63:0/2394983861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b647070 0x55d10ba6e750 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0094b0 tx=0x7fed54005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94258276049c7b9d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:38.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.410+0000 7fed4cff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:30:38.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.411+0000 7fed4cff9640 1 -- 172.21.15.63:0/2394983861 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5c004c00 con 0x55d10b647070 2024-09-21T06:30:38.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.411+0000 7fed4cff9640 1 -- 172.21.15.63:0/2394983861 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fed5c046040 con 0x55d10b647070 2024-09-21T06:30:38.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.411+0000 7fed7188a740 1 -- 172.21.15.63:0/2394983861 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed5401c480 con 0x55d10b647070 2024-09-21T06:30:38.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.411+0000 7fed4cff9640 1 -- 172.21.15.63:0/2394983861 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fed5c004da0 con 0x55d10b647070 2024-09-21T06:30:38.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.411+0000 7fed7188a740 10 client.16101 fetch_fsmap learned FSMap version 42 2024-09-21T06:30:38.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.411+0000 7fed7188a740 1 -- 172.21.15.63:0/2394983861 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55d10ba761c0 con 0x55d10b647070 2024-09-21T06:30:38.427 INFO:tasks.workunit.client.0.smithi063.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-09-21T06:30:38.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.412+0000 7fed4cff9640 1 -- 172.21.15.63:0/2394983861 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed5c036040 con 0x55d10b647070 2024-09-21T06:30:38.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.412+0000 7fed4cff9640 1 -- 172.21.15.63:0/2394983861 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 42) ==== 8374+0+0 (secure 0 0 0) 0x7fed5c02f990 con 0x55d10b647070 2024-09-21T06:30:38.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.412+0000 7fed7188a740 10 client.16101 fetch_fsmap finished waiting for FSMap version 42 2024-09-21T06:30:38.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.412+0000 7fed7188a740 10 client.16101 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:30:38.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.412+0000 7fed7188a740 20 client.16101 populate_metadata read hostname 'smithi063' 2024-09-21T06:30:38.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.412+0000 7fed7188a740 1 --2- 172.21.15.63:0/2394983861 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55d10b5dada0 0x55d10ba78960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:38.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.412+0000 7fed7188a740 4 client.16101 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:30:38.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.412+0000 7fed7188a740 1 -- 172.21.15.63:0/2394983861 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fed5401c480 con 0x55d10b5dada0 2024-09-21T06:30:38.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.412+0000 7fed688b1640 1 --2- 172.21.15.63:0/2394983861 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55d10b5dada0 0x55d10ba78960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:38.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.413+0000 7fed4cff9640 10 client.16101 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:30:38.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.413+0000 7fed688b1640 1 --2- 172.21.15.63:0/2394983861 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55d10b5dada0 0x55d10ba78960 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7580afdcd132ada8 server_cookie=147203b1c0d97e14 in_seq=0 out_seq=0 2024-09-21T06:30:38.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.413+0000 7fed4cff9640 1 -- 172.21.15.63:0/2394983861 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fed5401c480 con 0x55d10b5dada0 2024-09-21T06:30:38.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.413+0000 7fed4cff9640 10 client.16101 handle_command_reply: tid=0 2024-09-21T06:30:38.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.413+0000 7fed7188a740 1 client.16101 shutdown 2024-09-21T06:30:38.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.413+0000 7fed7188a740 1 -- 172.21.15.63:0/2394983861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b647070 msgr2=0x55d10ba6e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:38.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.413+0000 7fed7188a740 1 --2- 172.21.15.63:0/2394983861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b647070 0x55d10ba6e750 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0094b0 tx=0x7fed54005cc0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.413+0000 7fed7188a740 1 -- 172.21.15.63:0/2394983861 shutdown_connections 2024-09-21T06:30:38.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.413+0000 7fed7188a740 1 --2- 172.21.15.63:0/2394983861 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55d10b5dada0 0x55d10ba78960 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.414+0000 7fed4cff9640 0 client.16101 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:30:38.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.414+0000 7fed7188a740 1 --2- 172.21.15.63:0/2394983861 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d10b647070 0x55d10ba6e750 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.414+0000 7fed7188a740 1 --2- 172.21.15.63:0/2394983861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d10b626390 0x55d10ba0cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.414+0000 7fed7188a740 1 --2- 172.21.15.63:0/2394983861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d10b61e1b0 0x55d10ba0c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.414+0000 7fed7188a740 1 -- 172.21.15.63:0/2394983861 >> 172.21.15.63:0/2394983861 conn(0x55d10b63b460 msgr2=0x55d10b9f81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:38.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.414+0000 7fed7188a740 1 -- 172.21.15.63:0/2394983861 shutdown_connections 2024-09-21T06:30:38.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.414+0000 7fed7188a740 1 -- 172.21.15.63:0/2394983861 wait complete. 2024-09-21T06:30:38.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.414+0000 7fed7188a740 20 client.16101 trim_cache size 0 max 16384 2024-09-21T06:30:38.431 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:30:38.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.414+0000 7fed6b316640 1 -- 172.21.15.63:0/3387114795 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fed500b6700 msgr2=0x7fed500b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:38.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.414+0000 7fed6b316640 1 --2- 172.21.15.63:0/3387114795 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fed500b6700 0x7fed500b8c10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fed600aa6e0 tx=0x7fed60009000 comp rx=0 tx=0).stop 2024-09-21T06:30:38.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.414+0000 7fed6b316640 1 -- 172.21.15.63:0/3387114795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed64102270 msgr2=0x7fed6419a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:38.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.414+0000 7fed6b316640 1 --2- 172.21.15.63:0/3387114795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed64102270 0x7fed6419a4a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fed6000ea20 tx=0x7fed6000eee0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.415+0000 7fed6b316640 1 -- 172.21.15.63:0/3387114795 shutdown_connections 2024-09-21T06:30:38.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.415+0000 7fed6b316640 1 --2- 172.21.15.63:0/3387114795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed641084b0 0x7fed6419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.415+0000 7fed6b316640 1 --2- 172.21.15.63:0/3387114795 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fed500b6700 0x7fed500b8c10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.415+0000 7fed6b316640 1 --2- 172.21.15.63:0/3387114795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed64107b60 0x7fed6419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.415+0000 7fed6b316640 1 --2- 172.21.15.63:0/3387114795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed64102270 0x7fed6419a4a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:38.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.415+0000 7fed6b316640 1 -- 172.21.15.63:0/3387114795 >> 172.21.15.63:0/3387114795 conn(0x7fed64077cc0 msgr2=0x7fed64103f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:38.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.415+0000 7fed6b316640 1 -- 172.21.15.63:0/3387114795 shutdown_connections 2024-09-21T06:30:38.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:38.415+0000 7fed6b316640 1 -- 172.21.15.63:0/3387114795 wait complete. 2024-09-21T06:30:38.500 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/acl.h usability... yes 2024-09-21T06:30:38.522 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/acl.h presence... yes 2024-09-21T06:30:38.522 INFO:tasks.workunit.client.0.smithi063.stdout:checking for sys/acl.h... yes 2024-09-21T06:30:38.597 INFO:tasks.workunit.client.0.smithi063.stdout:checking acl/libacl.h usability... yes 2024-09-21T06:30:38.619 INFO:tasks.workunit.client.0.smithi063.stdout:checking acl/libacl.h presence... yes 2024-09-21T06:30:38.619 INFO:tasks.workunit.client.0.smithi063.stdout:checking for acl/libacl.h... yes 2024-09-21T06:30:38.671 INFO:tasks.workunit.client.0.smithi063.stdout:checking for acl_init in -lacl... yes 2024-09-21T06:30:38.731 INFO:tasks.workunit.client.0.smithi063.stdout:checking gdbm-ndbm.h usability... no 2024-09-21T06:30:38.764 INFO:tasks.workunit.client.0.smithi063.stdout:checking gdbm-ndbm.h presence... no 2024-09-21T06:30:38.764 INFO:tasks.workunit.client.0.smithi063.stdout:checking for gdbm-ndbm.h... no 2024-09-21T06:30:38.806 INFO:tasks.workunit.client.0.smithi063.stdout:checking gdbm/ndbm.h usability... no 2024-09-21T06:30:38.837 INFO:tasks.workunit.client.0.smithi063.stdout:checking gdbm/ndbm.h presence... no 2024-09-21T06:30:38.837 INFO:tasks.workunit.client.0.smithi063.stdout:checking for gdbm/ndbm.h... no 2024-09-21T06:30:38.880 INFO:tasks.workunit.client.0.smithi063.stdout:checking ndbm.h usability... no 2024-09-21T06:30:38.914 INFO:tasks.workunit.client.0.smithi063.stdout:checking ndbm.h presence... no 2024-09-21T06:30:38.914 INFO:tasks.workunit.client.0.smithi063.stdout:checking for ndbm.h... no 2024-09-21T06:30:38.952 INFO:tasks.workunit.client.0.smithi063.stdout:checking libaio.h usability... yes 2024-09-21T06:30:38.975 INFO:tasks.workunit.client.0.smithi063.stdout:checking libaio.h presence... yes 2024-09-21T06:30:38.975 INFO:tasks.workunit.client.0.smithi063.stdout:checking for libaio.h... yes 2024-09-21T06:30:39.029 INFO:tasks.workunit.client.0.smithi063.stdout:checking liburing.h usability... no 2024-09-21T06:30:39.063 INFO:tasks.workunit.client.0.smithi063.stdout:checking liburing.h presence... no 2024-09-21T06:30:39.063 INFO:tasks.workunit.client.0.smithi063.stdout:checking for liburing.h... no 2024-09-21T06:30:39.108 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/capability.h usability... no 2024-09-21T06:30:39.137 INFO:tasks.workunit.client.0.smithi063.stdout:checking sys/capability.h presence... no 2024-09-21T06:30:39.138 INFO:tasks.workunit.client.0.smithi063.stdout:checking for sys/capability.h... no 2024-09-21T06:30:39.204 INFO:tasks.workunit.client.0.smithi063.stdout:checking linux/fiemap.h usability... yes 2024-09-21T06:30:39.225 INFO:tasks.workunit.client.0.smithi063.stdout:checking linux/fiemap.h presence... yes 2024-09-21T06:30:39.225 INFO:tasks.workunit.client.0.smithi063.stdout:checking for linux/fiemap.h... yes 2024-09-21T06:30:39.264 INFO:tasks.workunit.client.0.smithi063.stdout:checking for fallocate... yes 2024-09-21T06:30:39.314 INFO:tasks.workunit.client.0.smithi063.stdout:checking for open_by_handle_at... yes 2024-09-21T06:30:39.351 INFO:tasks.workunit.client.0.smithi063.stdout:checking linux/fs.h usability... yes 2024-09-21T06:30:39.367 INFO:tasks.workunit.client.0.smithi063.stdout:checking linux/fs.h presence... yes 2024-09-21T06:30:39.367 INFO:tasks.workunit.client.0.smithi063.stdout:checking for linux/fs.h... yes 2024-09-21T06:30:39.425 INFO:tasks.workunit.client.0.smithi063.stdout:checking btrfsutil.h usability... no 2024-09-21T06:30:39.456 INFO:tasks.workunit.client.0.smithi063.stdout:checking btrfsutil.h presence... no 2024-09-21T06:30:39.456 INFO:tasks.workunit.client.0.smithi063.stdout:checking for btrfsutil.h... no 2024-09-21T06:30:39.504 INFO:tasks.workunit.client.0.smithi063.stdout:checking for copy_file_range... yes 2024-09-21T06:30:39.548 INFO:tasks.workunit.client.0.smithi063.stdout:checking for SEEK_DATA... yes 2024-09-21T06:30:39.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:39 smithi063 ceph-mon[31150]: pgmap v396: 97 pgs: 97 active+clean; 58 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 234 op/s 2024-09-21T06:30:39.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:39 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:30:39.607 INFO:tasks.workunit.client.0.smithi063.stdout:checking for BMV_OF_SHARED... yes 2024-09-21T06:30:39.658 INFO:tasks.workunit.client.0.smithi063.stdout:checking for nftw... yes 2024-09-21T06:30:39.718 INFO:tasks.workunit.client.0.smithi063.stdout:checking for RLIMIT_NOFILE... yes 2024-09-21T06:30:39.765 INFO:tasks.workunit.client.0.smithi063.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-09-21T06:30:39.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:39 smithi071 ceph-mon[34844]: pgmap v396: 97 pgs: 97 active+clean; 58 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 234 op/s 2024-09-21T06:30:39.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:39 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:30:39.827 INFO:tasks.workunit.client.0.smithi063.stdout:checking for FICLONE... yes 2024-09-21T06:30:39.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:39 smithi175 ceph-mon[34510]: pgmap v396: 97 pgs: 97 active+clean; 58 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 234 op/s 2024-09-21T06:30:39.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:39 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:30:39.874 INFO:tasks.workunit.client.0.smithi063.stdout:checking for renameat2... yes 2024-09-21T06:30:39.918 INFO:tasks.workunit.client.0.smithi063.stdout:checking for reallocarray... yes 2024-09-21T06:30:39.994 INFO:tasks.workunit.client.0.smithi063.stdout:checking for struct mount_attr... yes 2024-09-21T06:30:40.063 INFO:tasks.workunit.client.0.smithi063.stdout:checking for struct btrfs_qgroup_limit... yes 2024-09-21T06:30:40.123 INFO:tasks.workunit.client.0.smithi063.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-09-21T06:30:40.182 INFO:tasks.workunit.client.0.smithi063.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-09-21T06:30:40.227 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:30:40.227 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:30:40.240 INFO:tasks.workunit.client.0.smithi063.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-09-21T06:30:40.304 INFO:tasks.workunit.client.0.smithi063.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-09-21T06:30:40.365 INFO:tasks.workunit.client.0.smithi063.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-09-21T06:30:40.420 INFO:tasks.workunit.client.0.smithi063.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-09-21T06:30:40.462 INFO:tasks.workunit.client.0.smithi063.stdout:checking linux/btrfs.h usability... yes 2024-09-21T06:30:40.479 INFO:tasks.workunit.client.0.smithi063.stdout:checking linux/btrfs.h presence... yes 2024-09-21T06:30:40.479 INFO:tasks.workunit.client.0.smithi063.stdout:checking for linux/btrfs.h... yes 2024-09-21T06:30:40.497 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:40.532 INFO:tasks.workunit.client.0.smithi063.stdout:checking linux/btrfs_tree.h usability... yes 2024-09-21T06:30:40.549 INFO:tasks.workunit.client.0.smithi063.stdout:checking linux/btrfs_tree.h presence... yes 2024-09-21T06:30:40.549 INFO:tasks.workunit.client.0.smithi063.stdout:checking for linux/btrfs_tree.h... yes 2024-09-21T06:30:40.588 INFO:tasks.workunit.client.0.smithi063.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-09-21T06:30:40.630 INFO:tasks.workunit.client.0.smithi063.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-09-21T06:30:40.651 INFO:tasks.workunit.client.0.smithi063.stdout:configure: creating ./config.status 2024-09-21T06:30:41.001 INFO:tasks.workunit.client.0.smithi063.stdout:config.status: creating include/builddefs 2024-09-21T06:30:41.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.000+0000 7f279eb3d640 1 -- 172.21.15.63:0/824586135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2798101f70 msgr2=0x7f2798102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:41.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.000+0000 7f279eb3d640 1 --2- 172.21.15.63:0/824586135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2798101f70 0x7f2798102380 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f278c009900 tx=0x7f278c02a410 comp rx=0 tx=0).stop 2024-09-21T06:30:41.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.000+0000 7f279eb3d640 1 -- 172.21.15.63:0/824586135 shutdown_connections 2024-09-21T06:30:41.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.000+0000 7f279eb3d640 1 --2- 172.21.15.63:0/824586135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2798109e00 0x7f2798110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.000+0000 7f279eb3d640 1 --2- 172.21.15.63:0/824586135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27981094b0 0x7f27981098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.000+0000 7f279eb3d640 1 --2- 172.21.15.63:0/824586135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2798101f70 0x7f2798102380 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.001+0000 7f279eb3d640 1 -- 172.21.15.63:0/824586135 >> 172.21.15.63:0/824586135 conn(0x7f2798077c60 msgr2=0x7f27980780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:41.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.001+0000 7f279eb3d640 1 -- 172.21.15.63:0/824586135 shutdown_connections 2024-09-21T06:30:41.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.001+0000 7f279eb3d640 1 -- 172.21.15.63:0/824586135 wait complete. 2024-09-21T06:30:41.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.001+0000 7f279eb3d640 1 Processor -- start 2024-09-21T06:30:41.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.002+0000 7f279eb3d640 1 -- start start 2024-09-21T06:30:41.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.002+0000 7f279eb3d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2798101f70 0x7f279819c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:41.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.002+0000 7f279eb3d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27981094b0 0x7f279819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:41.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.002+0000 7f279eb3d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2798109e00 0x7f27981a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:41.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.002+0000 7f279eb3d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2798113ac0 con 0x7f2798101f70 2024-09-21T06:30:41.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.002+0000 7f279eb3d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2798113940 con 0x7f2798109e00 2024-09-21T06:30:41.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.002+0000 7f279eb3d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2798113c40 con 0x7f27981094b0 2024-09-21T06:30:41.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.002+0000 7f279d0da640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2798109e00 0x7f27981a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:41.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.002+0000 7f279c8d9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2798101f70 0x7f279819c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:41.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.002+0000 7f279d0da640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2798109e00 0x7f27981a1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:47494/0 (socket says 172.21.15.63:47494) 2024-09-21T06:30:41.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.002+0000 7f279d0da640 1 -- 172.21.15.63:0/3132377307 learned_addr learned my addr 172.21.15.63:0/3132377307 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:41.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.002+0000 7f279c8d9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2798101f70 0x7f279819c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44370/0 (socket says 172.21.15.63:44370) 2024-09-21T06:30:41.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.002+0000 7f2797fff640 1 --2- 172.21.15.63:0/3132377307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27981094b0 0x7f279819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:41.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.002+0000 7f279d0da640 1 -- 172.21.15.63:0/3132377307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27981094b0 msgr2=0x7f279819cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:41.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.002+0000 7f279d0da640 1 --2- 172.21.15.63:0/3132377307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27981094b0 0x7f279819cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.002+0000 7f279d0da640 1 -- 172.21.15.63:0/3132377307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2798101f70 msgr2=0x7f279819c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:41.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.002+0000 7f279d0da640 1 --2- 172.21.15.63:0/3132377307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2798101f70 0x7f279819c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.002+0000 7f279d0da640 1 -- 172.21.15.63:0/3132377307 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27981a25e0 con 0x7f2798109e00 2024-09-21T06:30:41.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.003+0000 7f279d0da640 1 --2- 172.21.15.63:0/3132377307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2798109e00 0x7f27981a1eb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f279000eaa0 tx=0x7f279000ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:41.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.003+0000 7f2795ffb640 1 -- 172.21.15.63:0/3132377307 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279000cdb0 con 0x7f2798109e00 2024-09-21T06:30:41.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.003+0000 7f2795ffb640 1 -- 172.21.15.63:0/3132377307 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2790005020 con 0x7f2798109e00 2024-09-21T06:30:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.003+0000 7f279eb3d640 1 -- 172.21.15.63:0/3132377307 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27981a28d0 con 0x7f2798109e00 2024-09-21T06:30:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.004+0000 7f2795ffb640 1 -- 172.21.15.63:0/3132377307 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27900116d0 con 0x7f2798109e00 2024-09-21T06:30:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.004+0000 7f279eb3d640 1 -- 172.21.15.63:0/3132377307 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27981a9030 con 0x7f2798109e00 2024-09-21T06:30:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.006+0000 7f2795ffb640 1 -- 172.21.15.63:0/3132377307 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f2790004b20 con 0x7f2798109e00 2024-09-21T06:30:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.007+0000 7f2795ffb640 1 --2- 172.21.15.63:0/3132377307 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27880b6700 0x7f27880b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.007+0000 7f2795ffb640 1 -- 172.21.15.63:0/3132377307 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f27900e7860 con 0x7f2798109e00 2024-09-21T06:30:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.007+0000 7f279c8d9640 1 --2- 172.21.15.63:0/3132377307 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27880b6700 0x7f27880b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.007+0000 7f27a50b1740 1 Processor -- start 2024-09-21T06:30:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.008+0000 7f27a50b1740 1 -- start start 2024-09-21T06:30:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.008+0000 7f27a50b1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4acd350 0x558ba4e7cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.008+0000 7f27a50b1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aa4490 0x558ba4e7d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.008+0000 7f27a50b1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4aac670 0x558ba4e7d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:41.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.008+0000 7f27a50b1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558ba4deae60 con 0x558ba4acd350 2024-09-21T06:30:41.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.008+0000 7f27a50b1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558ba4dda290 con 0x558ba4aac670 2024-09-21T06:30:41.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.008+0000 7f27a50b1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558ba4dde0a0 con 0x558ba4aa4490 2024-09-21T06:30:41.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.008+0000 7f2797fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aa4490 0x558ba4e7d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:41.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.008+0000 7f2797fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aa4490 0x558ba4e7d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:35176/0 (socket says 172.21.15.63:35176) 2024-09-21T06:30:41.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.008+0000 7f2797fff640 1 -- 172.21.15.63:0/2797161745 learned_addr learned my addr 172.21.15.63:0/2797161745 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:41.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.008+0000 7f279c8d9640 1 --2- 172.21.15.63:0/2797161745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4acd350 0x558ba4e7cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:41.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.008+0000 7f279d0da640 1 --2- 172.21.15.63:0/2797161745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4aac670 0x558ba4e7d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:41.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.009+0000 7f2797fff640 1 -- 172.21.15.63:0/2797161745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4aac670 msgr2=0x558ba4e7d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:41.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.009+0000 7f2797fff640 1 --2- 172.21.15.63:0/2797161745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4aac670 0x558ba4e7d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.009+0000 7f2797fff640 1 -- 172.21.15.63:0/2797161745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4acd350 msgr2=0x558ba4e7cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:41.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.009+0000 7f2797fff640 1 --2- 172.21.15.63:0/2797161745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4acd350 0x558ba4e7cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.009+0000 7f2797fff640 1 -- 172.21.15.63:0/2797161745 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ba4b38930 con 0x558ba4aa4490 2024-09-21T06:30:41.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.009+0000 7f279c8d9640 1 --2- 172.21.15.63:0/2797161745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4acd350 0x558ba4e7cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:41.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.009+0000 7f279c8d9640 1 --2- 172.21.15.63:0/3132377307 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27880b6700 0x7f27880b8c10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f278c031440 tx=0x7f278c009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:41.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.009+0000 7f2797fff640 1 --2- 172.21.15.63:0/2797161745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aa4490 0x558ba4e7d180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2784009bb0 tx=0x7f27840117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28c3fa6411c83a05 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:41.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.009+0000 7f2782ffd640 1 -- 172.21.15.63:0/2797161745 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2784012450 con 0x558ba4aa4490 2024-09-21T06:30:41.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.009+0000 7f2782ffd640 1 -- 172.21.15.63:0/2797161745 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2784012aa0 con 0x558ba4aa4490 2024-09-21T06:30:41.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.010+0000 7f2782ffd640 1 -- 172.21.15.63:0/2797161745 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278400fa20 con 0x558ba4aa4490 2024-09-21T06:30:41.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.010+0000 7f27a50b1740 1 -- 172.21.15.63:0/2797161745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aa4490 msgr2=0x558ba4e7d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:41.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.010+0000 7f27a50b1740 1 --2- 172.21.15.63:0/2797161745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aa4490 0x558ba4e7d180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2784009bb0 tx=0x7f27840117b0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.011+0000 7f27a50b1740 1 -- 172.21.15.63:0/2797161745 shutdown_connections 2024-09-21T06:30:41.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.011+0000 7f27a50b1740 1 --2- 172.21.15.63:0/2797161745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4aac670 0x558ba4e7d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.011+0000 7f27a50b1740 1 --2- 172.21.15.63:0/2797161745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aa4490 0x558ba4e7d180 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.011+0000 7f27a50b1740 1 --2- 172.21.15.63:0/2797161745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4acd350 0x558ba4e7cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.011+0000 7f27a50b1740 1 -- 172.21.15.63:0/2797161745 >> 172.21.15.63:0/2797161745 conn(0x558ba4ac1740 msgr2=0x558ba4e7ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:41.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.011+0000 7f27a50b1740 1 -- 172.21.15.63:0/2797161745 shutdown_connections 2024-09-21T06:30:41.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.011+0000 7f27a50b1740 1 -- 172.21.15.63:0/2797161745 wait complete. 2024-09-21T06:30:41.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.011+0000 7f27a50b1740 1 -- start start 2024-09-21T06:30:41.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.011+0000 7f27a50b1740 1 Processor -- start 2024-09-21T06:30:41.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.012+0000 7f27a50b1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aa4490 0x558ba4e887b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.012+0000 7f27a50b1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4aac670 0x558ba4e88cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.012+0000 7f27a50b1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4acd350 0x558ba4e94740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.012+0000 7f27a50b1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558ba4c3b890 con 0x558ba4aac670 2024-09-21T06:30:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.012+0000 7f27a50b1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558ba4d74d40 con 0x558ba4acd350 2024-09-21T06:30:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.012+0000 7f27a50b1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558ba4e8b420 con 0x558ba4aa4490 2024-09-21T06:30:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.012+0000 7f2797fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4aac670 0x558ba4e88cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.012+0000 7f27a50b1740 10 client.0 _ll_register_callbacks cb 0x558ba4dd8c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.012+0000 7f2797fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4aac670 0x558ba4e88cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44384/0 (socket says 172.21.15.63:44384) 2024-09-21T06:30:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.012+0000 7f2797fff640 1 -- 172.21.15.63:0/324227445 learned_addr learned my addr 172.21.15.63:0/324227445 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.012+0000 7f279d0da640 1 --2- 172.21.15.63:0/324227445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4acd350 0x558ba4e94740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.012+0000 7f279c8d9640 1 --2- 172.21.15.63:0/324227445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aa4490 0x558ba4e887b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.012+0000 7f279d0da640 1 -- 172.21.15.63:0/324227445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aa4490 msgr2=0x558ba4e887b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.012+0000 7f279d0da640 1 --2- 172.21.15.63:0/324227445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aa4490 0x558ba4e887b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.012+0000 7f279d0da640 1 -- 172.21.15.63:0/324227445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4aac670 msgr2=0x558ba4e88cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.012+0000 7f279d0da640 1 --2- 172.21.15.63:0/324227445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4aac670 0x558ba4e88cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.012+0000 7f279d0da640 1 -- 172.21.15.63:0/324227445 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ba4e94c80 con 0x558ba4acd350 2024-09-21T06:30:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.013+0000 7f279d0da640 1 --2- 172.21.15.63:0/324227445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4acd350 0x558ba4e94740 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f27900e4f90 tx=0x7f27900ace00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e8ed9e62eccb399 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.013+0000 7f2777fff640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:30:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.013+0000 7f2777fff640 1 -- 172.21.15.63:0/324227445 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279001f040 con 0x558ba4acd350 2024-09-21T06:30:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.013+0000 7f2777fff640 1 -- 172.21.15.63:0/324227445 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f27900a91e0 con 0x558ba4acd350 2024-09-21T06:30:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.013+0000 7f27a50b1740 1 -- 172.21.15.63:0/324227445 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2784012aa0 con 0x558ba4acd350 2024-09-21T06:30:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.013+0000 7f2777fff640 1 -- 172.21.15.63:0/324227445 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f27900add90 con 0x558ba4acd350 2024-09-21T06:30:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.013+0000 7f27a50b1740 10 client.25757 fetch_fsmap learned FSMap version 42 2024-09-21T06:30:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.013+0000 7f27a50b1740 1 -- 172.21.15.63:0/324227445 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x558ba4e97580 con 0x558ba4acd350 2024-09-21T06:30:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.013+0000 7f2777fff640 1 -- 172.21.15.63:0/324227445 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27900b2170 con 0x558ba4acd350 2024-09-21T06:30:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.013+0000 7f2777fff640 1 -- 172.21.15.63:0/324227445 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 42) ==== 8374+0+0 (secure 0 0 0) 0x7f279000f040 con 0x558ba4acd350 2024-09-21T06:30:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.013+0000 7f27a50b1740 10 client.25757 fetch_fsmap finished waiting for FSMap version 42 2024-09-21T06:30:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.013+0000 7f27a50b1740 10 client.25757 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:30:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.013+0000 7f27a50b1740 20 client.25757 populate_metadata read hostname 'smithi063' 2024-09-21T06:30:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.013+0000 7f27a50b1740 1 --2- 172.21.15.63:0/324227445 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x558ba4a8bcd0 0x558ba4e9ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.013+0000 7f27a50b1740 4 client.25757 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:30:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.013+0000 7f27a50b1740 1 -- 172.21.15.63:0/324227445 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2784012aa0 con 0x558ba4a8bcd0 2024-09-21T06:30:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.014+0000 7f279c8d9640 1 --2- 172.21.15.63:0/324227445 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x558ba4a8bcd0 0x558ba4e9ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.014+0000 7f2777fff640 10 client.25757 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:30:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.014+0000 7f279c8d9640 1 --2- 172.21.15.63:0/324227445 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x558ba4a8bcd0 0x558ba4e9ab70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a809972c7b2431eb server_cookie=bcac6480c145df03 in_seq=0 out_seq=0 2024-09-21T06:30:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.016+0000 7f2777fff640 1 -- 172.21.15.63:0/324227445 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f2784012aa0 con 0x558ba4a8bcd0 2024-09-21T06:30:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.016+0000 7f2777fff640 10 client.25757 handle_command_reply: tid=0 2024-09-21T06:30:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.016+0000 7f27a50b1740 1 client.25757 shutdown 2024-09-21T06:30:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.016+0000 7f27a50b1740 1 -- 172.21.15.63:0/324227445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4acd350 msgr2=0x558ba4e94740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.016+0000 7f27a50b1740 1 --2- 172.21.15.63:0/324227445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4acd350 0x558ba4e94740 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f27900e4f90 tx=0x7f27900ace00 comp rx=0 tx=0).stop 2024-09-21T06:30:41.025 INFO:tasks.workunit.client.0.smithi063.stdout:config.status: creating include/config.h 2024-09-21T06:30:41.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.016+0000 7f27a50b1740 1 -- 172.21.15.63:0/324227445 shutdown_connections 2024-09-21T06:30:41.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.016+0000 7f27a50b1740 1 --2- 172.21.15.63:0/324227445 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x558ba4a8bcd0 0x558ba4e9ab70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.016+0000 7f27a50b1740 1 --2- 172.21.15.63:0/324227445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4acd350 0x558ba4e94740 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.016+0000 7f27a50b1740 1 --2- 172.21.15.63:0/324227445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4aac670 0x558ba4e88cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.016+0000 7f27a50b1740 1 --2- 172.21.15.63:0/324227445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aa4490 0x558ba4e887b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.016+0000 7f27a50b1740 1 -- 172.21.15.63:0/324227445 >> 172.21.15.63:0/324227445 conn(0x558ba4ac1740 msgr2=0x558ba4e7fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:41.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.016+0000 7f2777fff640 0 client.25757 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:30:41.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.016+0000 7f27a50b1740 1 -- 172.21.15.63:0/324227445 shutdown_connections 2024-09-21T06:30:41.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.016+0000 7f27a50b1740 1 -- 172.21.15.63:0/324227445 wait complete. 2024-09-21T06:30:41.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.016+0000 7f27a50b1740 20 client.25757 trim_cache size 0 max 16384 2024-09-21T06:30:41.030 INFO:tasks.workunit.client.0.smithi063.stdout:config.status: executing libtool commands 2024-09-21T06:30:41.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.035+0000 7f27a50b1740 1 Processor -- start 2024-09-21T06:30:41.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.035+0000 7f27a50b1740 1 -- start start 2024-09-21T06:30:41.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.035+0000 7f27a50b1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4aa4490 0x558ba4e857a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:41.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.035+0000 7f27a50b1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aac670 0x558ba4e85ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:41.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.035+0000 7f27a50b1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4acd350 0x558ba4ea0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:41.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.035+0000 7f27a50b1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f27981ad5a0 con 0x558ba4acd350 2024-09-21T06:30:41.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.035+0000 7f27a50b1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f27981af170 con 0x558ba4aa4490 2024-09-21T06:30:41.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.035+0000 7f27a50b1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27981add00 con 0x558ba4aac670 2024-09-21T06:30:41.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.035+0000 7f279c8d9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4aa4490 0x558ba4e857a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:41.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.035+0000 7f279d0da640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4acd350 0x558ba4ea0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:41.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.035+0000 7f279c8d9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4aa4490 0x558ba4e857a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:47510/0 (socket says 172.21.15.63:47510) 2024-09-21T06:30:41.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.035+0000 7f279c8d9640 1 -- 172.21.15.63:0/1078079430 learned_addr learned my addr 172.21.15.63:0/1078079430 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:41.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.036+0000 7f2797fff640 1 --2- 172.21.15.63:0/1078079430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aac670 0x558ba4e85ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:41.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.036+0000 7f279c8d9640 1 -- 172.21.15.63:0/1078079430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aac670 msgr2=0x558ba4e85ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:41.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.036+0000 7f279c8d9640 1 --2- 172.21.15.63:0/1078079430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aac670 0x558ba4e85ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.036+0000 7f279c8d9640 1 -- 172.21.15.63:0/1078079430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4acd350 msgr2=0x558ba4ea0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:41.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.036+0000 7f279c8d9640 1 --2- 172.21.15.63:0/1078079430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4acd350 0x558ba4ea0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.036+0000 7f279c8d9640 1 -- 172.21.15.63:0/1078079430 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ba4e87510 con 0x558ba4aa4490 2024-09-21T06:30:41.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.036+0000 7f279c8d9640 1 --2- 172.21.15.63:0/1078079430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4aa4490 0x558ba4e857a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f278c009900 tx=0x7f278c048000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b02b839bb0ef5f58 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:41.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.036+0000 7f27827fc640 1 -- 172.21.15.63:0/1078079430 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c057070 con 0x558ba4aa4490 2024-09-21T06:30:41.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.036+0000 7f27827fc640 1 -- 172.21.15.63:0/1078079430 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f278c0035f0 con 0x558ba4aa4490 2024-09-21T06:30:41.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.036+0000 7f27827fc640 1 -- 172.21.15.63:0/1078079430 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c035040 con 0x558ba4aa4490 2024-09-21T06:30:41.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.037+0000 7f27a50b1740 1 -- 172.21.15.63:0/1078079430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4aa4490 msgr2=0x558ba4e857a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:41.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.037+0000 7f27a50b1740 1 --2- 172.21.15.63:0/1078079430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4aa4490 0x558ba4e857a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f278c009900 tx=0x7f278c048000 comp rx=0 tx=0).stop 2024-09-21T06:30:41.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.037+0000 7f27a50b1740 1 -- 172.21.15.63:0/1078079430 shutdown_connections 2024-09-21T06:30:41.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.037+0000 7f27a50b1740 1 --2- 172.21.15.63:0/1078079430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4acd350 0x558ba4ea0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.037+0000 7f27a50b1740 1 --2- 172.21.15.63:0/1078079430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aac670 0x558ba4e85ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.037+0000 7f27a50b1740 1 --2- 172.21.15.63:0/1078079430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4aa4490 0x558ba4e857a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.037+0000 7f27a50b1740 1 -- 172.21.15.63:0/1078079430 >> 172.21.15.63:0/1078079430 conn(0x558ba4ac1740 msgr2=0x558ba4e83760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:41.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.037+0000 7f27a50b1740 1 -- 172.21.15.63:0/1078079430 shutdown_connections 2024-09-21T06:30:41.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.037+0000 7f27a50b1740 1 -- 172.21.15.63:0/1078079430 wait complete. 2024-09-21T06:30:41.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.038+0000 7f27a50b1740 1 -- start start 2024-09-21T06:30:41.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.038+0000 7f27a50b1740 1 Processor -- start 2024-09-21T06:30:41.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.039+0000 7f27a50b1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aa4490 0x558ba4e90da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:41.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.039+0000 7f27a50b1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4aac670 0x558ba4e8b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:41.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.039+0000 7f27a50b1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4acd350 0x558ba4e8bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:41.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.039+0000 7f27a50b1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f27981aeaa0 con 0x558ba4aac670 2024-09-21T06:30:41.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.039+0000 7f27a50b1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f27981ae3d0 con 0x558ba4acd350 2024-09-21T06:30:41.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.039+0000 7f2797fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4aac670 0x558ba4e8b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:41.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.039+0000 7f27a50b1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27981ab5c0 con 0x558ba4aa4490 2024-09-21T06:30:41.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.039+0000 7f2797fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4aac670 0x558ba4e8b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44402/0 (socket says 172.21.15.63:44402) 2024-09-21T06:30:41.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.039+0000 7f2797fff640 1 -- 172.21.15.63:0/550915191 learned_addr learned my addr 172.21.15.63:0/550915191 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:41.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.039+0000 7f279d0da640 1 --2- 172.21.15.63:0/550915191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4acd350 0x558ba4e8bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:41.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.039+0000 7f279c8d9640 1 --2- 172.21.15.63:0/550915191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aa4490 0x558ba4e90da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:41.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.039+0000 7f27a50b1740 10 client.0 _ll_register_callbacks cb 0x7f27900ad460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:41.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.039+0000 7f2797fff640 1 -- 172.21.15.63:0/550915191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aa4490 msgr2=0x558ba4e90da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:41.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.039+0000 7f2797fff640 1 --2- 172.21.15.63:0/550915191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aa4490 0x558ba4e90da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.039+0000 7f2797fff640 1 -- 172.21.15.63:0/550915191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4acd350 msgr2=0x558ba4e8bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:41.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.039+0000 7f2797fff640 1 --2- 172.21.15.63:0/550915191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4acd350 0x558ba4e8bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.039+0000 7f2797fff640 1 -- 172.21.15.63:0/550915191 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ba4e8c240 con 0x558ba4aac670 2024-09-21T06:30:41.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.039+0000 7f279d0da640 1 --2- 172.21.15.63:0/550915191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4acd350 0x558ba4e8bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:41.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.040+0000 7f2797fff640 1 --2- 172.21.15.63:0/550915191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4aac670 0x558ba4e8b660 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f2784009650 tx=0x7f2784009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3539c3d9f216769 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:41.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.040+0000 7f2777fff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:30:41.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.040+0000 7f2777fff640 1 -- 172.21.15.63:0/550915191 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278400f850 con 0x558ba4aac670 2024-09-21T06:30:41.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.040+0000 7f2777fff640 1 -- 172.21.15.63:0/550915191 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f278400f9f0 con 0x558ba4aac670 2024-09-21T06:30:41.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.040+0000 7f27a50b1740 1 -- 172.21.15.63:0/550915191 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f278c0035f0 con 0x558ba4aac670 2024-09-21T06:30:41.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.040+0000 7f2777fff640 1 -- 172.21.15.63:0/550915191 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f278400fc10 con 0x558ba4aac670 2024-09-21T06:30:41.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.040+0000 7f27a50b1740 10 client.16119 fetch_fsmap learned FSMap version 42 2024-09-21T06:30:41.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.040+0000 7f27a50b1740 1 -- 172.21.15.63:0/550915191 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x558ba4f06380 con 0x558ba4aac670 2024-09-21T06:30:41.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.040+0000 7f2777fff640 1 -- 172.21.15.63:0/550915191 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f278c0035f0 con 0x558ba4aac670 2024-09-21T06:30:41.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.041+0000 7f2777fff640 1 -- 172.21.15.63:0/550915191 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 42) ==== 8374+0+0 (secure 0 0 0) 0x7f278402b020 con 0x558ba4aac670 2024-09-21T06:30:41.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.041+0000 7f27a50b1740 10 client.16119 fetch_fsmap finished waiting for FSMap version 42 2024-09-21T06:30:41.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.041+0000 7f27a50b1740 10 client.16119 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:30:41.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.041+0000 7f27a50b1740 20 client.16119 populate_metadata read hostname 'smithi063' 2024-09-21T06:30:41.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.041+0000 7f27a50b1740 1 --2- 172.21.15.63:0/550915191 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x558ba4a61080 0x558ba4f088b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:41.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.041+0000 7f27a50b1740 4 client.16119 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:30:41.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.041+0000 7f27a50b1740 1 -- 172.21.15.63:0/550915191 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558ba4decdb0 con 0x558ba4a61080 2024-09-21T06:30:41.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.041+0000 7f279c8d9640 1 --2- 172.21.15.63:0/550915191 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x558ba4a61080 0x558ba4f088b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:41.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.041+0000 7f279c8d9640 1 --2- 172.21.15.63:0/550915191 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x558ba4a61080 0x558ba4f088b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d132bc636f3a78b server_cookie=8b4d995c79eb04ac in_seq=0 out_seq=0 2024-09-21T06:30:41.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.041+0000 7f2777fff640 10 client.16119 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:30:41.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.047+0000 7f2777fff640 1 -- 172.21.15.63:0/550915191 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558ba4decdb0 con 0x558ba4a61080 2024-09-21T06:30:41.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.047+0000 7f2777fff640 10 client.16119 handle_command_reply: tid=0 2024-09-21T06:30:41.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.047+0000 7f27a50b1740 1 client.16119 shutdown 2024-09-21T06:30:41.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.048+0000 7f27a50b1740 1 -- 172.21.15.63:0/550915191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4aac670 msgr2=0x558ba4e8b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:41.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.048+0000 7f27a50b1740 1 --2- 172.21.15.63:0/550915191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4aac670 0x558ba4e8b660 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f2784009650 tx=0x7f2784009810 comp rx=0 tx=0).stop 2024-09-21T06:30:41.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.048+0000 7f27a50b1740 1 -- 172.21.15.63:0/550915191 shutdown_connections 2024-09-21T06:30:41.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.048+0000 7f27a50b1740 1 --2- 172.21.15.63:0/550915191 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x558ba4a61080 0x558ba4f088b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.048+0000 7f2777fff640 0 client.16119 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:30:41.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.048+0000 7f27a50b1740 1 --2- 172.21.15.63:0/550915191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ba4acd350 0x558ba4e8bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.048+0000 7f27a50b1740 1 --2- 172.21.15.63:0/550915191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558ba4aac670 0x558ba4e8b660 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.048+0000 7f27a50b1740 1 --2- 172.21.15.63:0/550915191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ba4aa4490 0x558ba4e90da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.048+0000 7f27a50b1740 1 -- 172.21.15.63:0/550915191 >> 172.21.15.63:0/550915191 conn(0x558ba4ac1740 msgr2=0x558ba4e7ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:41.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.048+0000 7f27a50b1740 1 -- 172.21.15.63:0/550915191 shutdown_connections 2024-09-21T06:30:41.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.048+0000 7f27a50b1740 1 -- 172.21.15.63:0/550915191 wait complete. 2024-09-21T06:30:41.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.048+0000 7f27a50b1740 20 client.16119 trim_cache size 0 max 16384 2024-09-21T06:30:41.052 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:30:41.052 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0, 2024-09-21T06:30:41.052 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_tag": "5cef1d6e-b4d8-4a94-b290-40167760d82c", 2024-09-21T06:30:41.052 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": "asynchronous" 2024-09-21T06:30:41.052 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:30:41.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.049+0000 7f279eb3d640 1 -- 172.21.15.63:0/3132377307 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27880b6700 msgr2=0x7f27880b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:41.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.049+0000 7f279eb3d640 1 --2- 172.21.15.63:0/3132377307 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27880b6700 0x7f27880b8c10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f278c031440 tx=0x7f278c009560 comp rx=0 tx=0).stop 2024-09-21T06:30:41.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.049+0000 7f279eb3d640 1 -- 172.21.15.63:0/3132377307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2798109e00 msgr2=0x7f27981a1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:41.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.049+0000 7f279eb3d640 1 --2- 172.21.15.63:0/3132377307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2798109e00 0x7f27981a1eb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f279000eaa0 tx=0x7f279000ef60 comp rx=0 tx=0).stop 2024-09-21T06:30:41.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.049+0000 7f279eb3d640 1 -- 172.21.15.63:0/3132377307 shutdown_connections 2024-09-21T06:30:41.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.049+0000 7f279eb3d640 1 --2- 172.21.15.63:0/3132377307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2798109e00 0x7f27981a1eb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.049+0000 7f279eb3d640 1 --2- 172.21.15.63:0/3132377307 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27880b6700 0x7f27880b8c10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.049+0000 7f279eb3d640 1 --2- 172.21.15.63:0/3132377307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27981094b0 0x7f279819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.049+0000 7f279eb3d640 1 --2- 172.21.15.63:0/3132377307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2798101f70 0x7f279819c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:41.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.049+0000 7f279eb3d640 1 -- 172.21.15.63:0/3132377307 >> 172.21.15.63:0/3132377307 conn(0x7f2798077c60 msgr2=0x7f27981072c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:41.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.049+0000 7f279eb3d640 1 -- 172.21.15.63:0/3132377307 shutdown_connections 2024-09-21T06:30:41.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:41.049+0000 7f279eb3d640 1 -- 172.21.15.63:0/3132377307 wait complete. 2024-09-21T06:30:41.170 INFO:tasks.workunit.client.0.smithi063.stdout:Building include 2024-09-21T06:30:41.170 INFO:tasks.workunit.client.0.smithi063.stdout:Building lib 2024-09-21T06:30:41.170 INFO:tasks.workunit.client.0.smithi063.stdout:Building tests 2024-09-21T06:30:41.176 INFO:tasks.workunit.client.0.smithi063.stdout: [LTDEP] 2024-09-21T06:30:41.212 INFO:tasks.workunit.client.0.smithi063.stdout:Building ceph 2024-09-21T06:30:41.212 INFO:tasks.workunit.client.0.smithi063.stdout:Building btrfs 2024-09-21T06:30:41.213 INFO:tasks.workunit.client.0.smithi063.stdout:Building cifs 2024-09-21T06:30:41.223 INFO:tasks.workunit.client.0.smithi063.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/cifs/group.list 2024-09-21T06:30:41.225 INFO:tasks.workunit.client.0.smithi063.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ceph/group.list 2024-09-21T06:30:41.250 INFO:tasks.workunit.client.0.smithi063.stdout:Building ext4 2024-09-21T06:30:41.255 INFO:tasks.workunit.client.0.smithi063.stdout:Building f2fs 2024-09-21T06:30:41.271 INFO:tasks.workunit.client.0.smithi063.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/f2fs/group.list 2024-09-21T06:30:41.289 INFO:tasks.workunit.client.0.smithi063.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ext4/group.list 2024-09-21T06:30:41.304 INFO:tasks.workunit.client.0.smithi063.stdout:Building generic 2024-09-21T06:30:41.476 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:41 smithi063 ceph-mon[31150]: pgmap v397: 97 pgs: 97 active+clean; 58 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 864 KiB/s wr, 158 op/s 2024-09-21T06:30:41.476 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:41 smithi063 ceph-mon[31150]: scrub queued for path: / 2024-09-21T06:30:41.476 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:41 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:41.476 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:41 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:30:41.552 INFO:tasks.workunit.client.0.smithi063.stdout:Building nfs 2024-09-21T06:30:41.636 INFO:tasks.workunit.client.0.smithi063.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/nfs/group.list 2024-09-21T06:30:41.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:41 smithi071 ceph-mon[34844]: pgmap v397: 97 pgs: 97 active+clean; 58 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 864 KiB/s wr, 158 op/s 2024-09-21T06:30:41.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:41 smithi071 ceph-mon[34844]: scrub queued for path: / 2024-09-21T06:30:41.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:41 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:41.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:41 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:30:41.802 INFO:tasks.workunit.client.0.smithi063.stdout:Building ocfs2 2024-09-21T06:30:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:41 smithi175 ceph-mon[34510]: pgmap v397: 97 pgs: 97 active+clean; 58 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 864 KiB/s wr, 158 op/s 2024-09-21T06:30:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:41 smithi175 ceph-mon[34510]: scrub queued for path: / 2024-09-21T06:30:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:41 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:41 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:30:41.861 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:30:42.223 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:42.396 INFO:tasks.workunit.client.0.smithi063.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ocfs2/group.list 2024-09-21T06:30:42.647 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:42 smithi063 ceph-mon[31150]: scrub summary: active paths [/,/] 2024-09-21T06:30:42.647 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:42 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/,/] 2024-09-21T06:30:42.647 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:42 smithi063 ceph-mon[31150]: scrub summary: active paths [/,/] 2024-09-21T06:30:42.647 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:42 smithi063 ceph-mon[31150]: scrub summary: active paths [/,/] 2024-09-21T06:30:42.647 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:42 smithi063 ceph-mon[31150]: scrub summary: active paths [/,/] 2024-09-21T06:30:42.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:42 smithi071 ceph-mon[34844]: scrub summary: active paths [/,/] 2024-09-21T06:30:42.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:42 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/,/] 2024-09-21T06:30:42.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:42 smithi071 ceph-mon[34844]: scrub summary: active paths [/,/] 2024-09-21T06:30:42.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:42 smithi071 ceph-mon[34844]: scrub summary: active paths [/,/] 2024-09-21T06:30:42.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:42 smithi071 ceph-mon[34844]: scrub summary: active paths [/,/] 2024-09-21T06:30:42.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:42 smithi175 ceph-mon[34510]: scrub summary: active paths [/,/] 2024-09-21T06:30:42.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:42 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/,/] 2024-09-21T06:30:42.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:42 smithi175 ceph-mon[34510]: scrub summary: active paths [/,/] 2024-09-21T06:30:42.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:42 smithi175 ceph-mon[34510]: scrub summary: active paths [/,/] 2024-09-21T06:30:42.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:42 smithi175 ceph-mon[34510]: scrub summary: active paths [/,/] 2024-09-21T06:30:42.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.751+0000 7fc5d559e640 1 -- 172.21.15.63:0/3835041228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5d0103b70 msgr2=0x7fc5d0103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:42.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.751+0000 7fc5d559e640 1 --2- 172.21.15.63:0/3835041228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5d0103b70 0x7fc5d0103f80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009900 tx=0x7fc5c002a410 comp rx=0 tx=0).stop 2024-09-21T06:30:42.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.751+0000 7fc5d559e640 1 -- 172.21.15.63:0/3835041228 shutdown_connections 2024-09-21T06:30:42.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.751+0000 7fc5d559e640 1 --2- 172.21.15.63:0/3835041228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5d0109e00 0x7fc5d0110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.751+0000 7fc5d559e640 1 --2- 172.21.15.63:0/3835041228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d01094b0 0x7fc5d01098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.751+0000 7fc5d559e640 1 --2- 172.21.15.63:0/3835041228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5d0103b70 0x7fc5d0103f80 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.751+0000 7fc5d559e640 1 -- 172.21.15.63:0/3835041228 >> 172.21.15.63:0/3835041228 conn(0x7fc5d00ff5e0 msgr2=0x7fc5d0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:42.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.751+0000 7fc5d559e640 1 -- 172.21.15.63:0/3835041228 shutdown_connections 2024-09-21T06:30:42.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.751+0000 7fc5d559e640 1 -- 172.21.15.63:0/3835041228 wait complete. 2024-09-21T06:30:42.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.752+0000 7fc5d559e640 1 Processor -- start 2024-09-21T06:30:42.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.752+0000 7fc5d559e640 1 -- start start 2024-09-21T06:30:42.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.752+0000 7fc5d559e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5d0103b70 0x7fc5d019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.752+0000 7fc5d559e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d01094b0 0x7fc5d019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.752+0000 7fc5d559e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5d0109e00 0x7fc5d019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.752+0000 7fc5d559e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d0113ac0 con 0x7fc5d0103b70 2024-09-21T06:30:42.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.752+0000 7fc5d559e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d0113940 con 0x7fc5d01094b0 2024-09-21T06:30:42.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.752+0000 7fc5d559e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d0113c40 con 0x7fc5d0109e00 2024-09-21T06:30:42.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.752+0000 7fc5ceffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5d0103b70 0x7fc5d019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.752+0000 7fc5ceffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5d0103b70 0x7fc5d019a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44414/0 (socket says 172.21.15.63:44414) 2024-09-21T06:30:42.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.752+0000 7fc5ceffd640 1 -- 172.21.15.63:0/960698119 learned_addr learned my addr 172.21.15.63:0/960698119 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:42.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.752+0000 7fc5c7fff640 1 --2- 172.21.15.63:0/960698119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d01094b0 0x7fc5d019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.752+0000 7fc5cf7fe640 1 --2- 172.21.15.63:0/960698119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5d0109e00 0x7fc5d019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.753+0000 7fc5ceffd640 1 -- 172.21.15.63:0/960698119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5d0109e00 msgr2=0x7fc5d019fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:42.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.753+0000 7fc5ceffd640 1 --2- 172.21.15.63:0/960698119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5d0109e00 0x7fc5d019fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.753+0000 7fc5ceffd640 1 -- 172.21.15.63:0/960698119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d01094b0 msgr2=0x7fc5d019aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:42.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.753+0000 7fc5ceffd640 1 --2- 172.21.15.63:0/960698119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d01094b0 0x7fc5d019aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.753+0000 7fc5ceffd640 1 -- 172.21.15.63:0/960698119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d01a03e0 con 0x7fc5d0103b70 2024-09-21T06:30:42.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.753+0000 7fc5ceffd640 1 --2- 172.21.15.63:0/960698119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5d0103b70 0x7fc5d019a470 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0005940 tx=0x7fc5c00040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.753+0000 7fc5ccff9640 1 -- 172.21.15.63:0/960698119 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c003f030 con 0x7fc5d0103b70 2024-09-21T06:30:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.753+0000 7fc5d559e640 1 -- 172.21.15.63:0/960698119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5d01a0670 con 0x7fc5d0103b70 2024-09-21T06:30:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.753+0000 7fc5ccff9640 1 -- 172.21.15.63:0/960698119 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5c00044c0 con 0x7fc5d0103b70 2024-09-21T06:30:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.753+0000 7fc5ccff9640 1 -- 172.21.15.63:0/960698119 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0035070 con 0x7fc5d0103b70 2024-09-21T06:30:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.753+0000 7fc5d559e640 1 -- 172.21.15.63:0/960698119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5d01a6e30 con 0x7fc5d0103b70 2024-09-21T06:30:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.756+0000 7fc5dbb12740 1 Processor -- start 2024-09-21T06:30:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.756+0000 7fc5dbb12740 1 -- start start 2024-09-21T06:30:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.757+0000 7fc5dbb12740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70e7070 0x5654c748e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.757+0000 7fc5dbb12740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654c70be1b0 0x5654c748eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.757+0000 7fc5dbb12740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70c6390 0x5654c748f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.757+0000 7fc5ccff9640 1 -- 172.21.15.63:0/960698119 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fc5c0042030 con 0x7fc5d0103b70 2024-09-21T06:30:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.757+0000 7fc5dbb12740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5654c7404e50 con 0x5654c70e7070 2024-09-21T06:30:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.757+0000 7fc5dbb12740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5654c73f4280 con 0x5654c70c6390 2024-09-21T06:30:42.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.757+0000 7fc5dbb12740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5654c73f8090 con 0x5654c70be1b0 2024-09-21T06:30:42.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.757+0000 7fc5cf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70e7070 0x5654c748e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.757+0000 7fc5cf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70e7070 0x5654c748e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44426/0 (socket says 172.21.15.63:44426) 2024-09-21T06:30:42.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.757+0000 7fc5cf7fe640 1 -- 172.21.15.63:0/3780398378 learned_addr learned my addr 172.21.15.63:0/3780398378 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:42.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.757+0000 7fc5c7fff640 1 --2- 172.21.15.63:0/3780398378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70c6390 0x5654c748f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.757+0000 7fc5ceffd640 1 --2- 172.21.15.63:0/3780398378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654c70be1b0 0x5654c748eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.757+0000 7fc5cf7fe640 1 -- 172.21.15.63:0/3780398378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654c70be1b0 msgr2=0x5654c748eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:42.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.757+0000 7fc5cf7fe640 1 --2- 172.21.15.63:0/3780398378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654c70be1b0 0x5654c748eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.757+0000 7fc5cf7fe640 1 -- 172.21.15.63:0/3780398378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70c6390 msgr2=0x5654c748f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:42.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.757+0000 7fc5cf7fe640 1 --2- 172.21.15.63:0/3780398378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70c6390 0x5654c748f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.757+0000 7fc5cf7fe640 1 -- 172.21.15.63:0/3780398378 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c7152650 con 0x5654c70e7070 2024-09-21T06:30:42.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.757+0000 7fc5c7fff640 1 --2- 172.21.15.63:0/3780398378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70c6390 0x5654c748f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:42.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.757+0000 7fc5cf7fe640 1 --2- 172.21.15.63:0/3780398378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70e7070 0x5654c748e650 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009fd0 tx=0x7fc5c80118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8beb2fcdcbab35c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:42.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.758+0000 7fc5ccff9640 1 --2- 172.21.15.63:0/960698119 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc5bc0b6680 0x7fc5bc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.758+0000 7fc5c57fa640 1 -- 172.21.15.63:0/3780398378 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8004d20 con 0x5654c70e7070 2024-09-21T06:30:42.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.758+0000 7fc5c57fa640 1 -- 172.21.15.63:0/3780398378 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5c8004050 con 0x5654c70e7070 2024-09-21T06:30:42.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.758+0000 7fc5ccff9640 1 -- 172.21.15.63:0/960698119 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fc5c0107ad0 con 0x7fc5d0103b70 2024-09-21T06:30:42.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.758+0000 7fc5ceffd640 1 --2- 172.21.15.63:0/960698119 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc5bc0b6680 0x7fc5bc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.759+0000 7fc5c57fa640 1 -- 172.21.15.63:0/3780398378 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8005280 con 0x5654c70e7070 2024-09-21T06:30:42.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.759+0000 7fc5dbb12740 1 -- 172.21.15.63:0/3780398378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70e7070 msgr2=0x5654c748e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:42.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.759+0000 7fc5ceffd640 1 --2- 172.21.15.63:0/960698119 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc5bc0b6680 0x7fc5bc0b8b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x5654c748d2d0 tx=0x7fc5c010b580 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:42.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.759+0000 7fc5dbb12740 1 --2- 172.21.15.63:0/3780398378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70e7070 0x5654c748e650 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009fd0 tx=0x7fc5c80118d0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.760+0000 7fc5dbb12740 1 -- 172.21.15.63:0/3780398378 shutdown_connections 2024-09-21T06:30:42.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.760+0000 7fc5dbb12740 1 --2- 172.21.15.63:0/3780398378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70c6390 0x5654c748f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.760+0000 7fc5dbb12740 1 --2- 172.21.15.63:0/3780398378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654c70be1b0 0x5654c748eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.760+0000 7fc5dbb12740 1 --2- 172.21.15.63:0/3780398378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70e7070 0x5654c748e650 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.760+0000 7fc5dbb12740 1 -- 172.21.15.63:0/3780398378 >> 172.21.15.63:0/3780398378 conn(0x5654c70db460 msgr2=0x5654c748c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:42.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.760+0000 7fc5dbb12740 1 -- 172.21.15.63:0/3780398378 shutdown_connections 2024-09-21T06:30:42.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.760+0000 7fc5dbb12740 1 -- 172.21.15.63:0/3780398378 wait complete. 2024-09-21T06:30:42.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.760+0000 7fc5dbb12740 1 -- start start 2024-09-21T06:30:42.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.760+0000 7fc5dbb12740 1 Processor -- start 2024-09-21T06:30:42.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.761+0000 7fc5dbb12740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70be1b0 0x5654c74a0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.761+0000 7fc5dbb12740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70c6390 0x5654c7499c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.761+0000 7fc5dbb12740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654c70e7070 0x5654c749a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.761+0000 7fc5dbb12740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5654c7255700 con 0x5654c70c6390 2024-09-21T06:30:42.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.761+0000 7fc5dbb12740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5654c738f110 con 0x5654c70be1b0 2024-09-21T06:30:42.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.761+0000 7fc5dbb12740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5654c74a1230 con 0x5654c70e7070 2024-09-21T06:30:42.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.761+0000 7fc5dbb12740 10 client.0 _ll_register_callbacks cb 0x5654c73a8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:42.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.761+0000 7fc5cf7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70be1b0 0x5654c74a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.761+0000 7fc5cf7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70be1b0 0x5654c74a0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:47548/0 (socket says 172.21.15.63:47548) 2024-09-21T06:30:42.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.761+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70c6390 0x5654c7499c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.761+0000 7fc5cf7fe640 1 -- 172.21.15.63:0/311457631 learned_addr learned my addr 172.21.15.63:0/311457631 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:42.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.761+0000 7fc5cf7fe640 1 --2- 172.21.15.63:0/311457631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654c70e7070 0x5654c749a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.762+0000 7fc5c7fff640 1 -- 172.21.15.63:0/311457631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654c70e7070 msgr2=0x5654c749a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:42.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.762+0000 7fc5c7fff640 1 --2- 172.21.15.63:0/311457631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654c70e7070 0x5654c749a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.762+0000 7fc5c7fff640 1 -- 172.21.15.63:0/311457631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70be1b0 msgr2=0x5654c74a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:42.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.762+0000 7fc5c7fff640 1 --2- 172.21.15.63:0/311457631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70be1b0 0x5654c74a0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.762+0000 7fc5c7fff640 1 -- 172.21.15.63:0/311457631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654c73bcc40 con 0x5654c70c6390 2024-09-21T06:30:42.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.762+0000 7fc5cf7fe640 1 --2- 172.21.15.63:0/311457631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70be1b0 0x5654c74a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:42.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.762+0000 7fc5c7fff640 1 --2- 172.21.15.63:0/311457631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70c6390 0x5654c7499c20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc5d006bab0 tx=0x7fc5b8012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd984bf9dcea47a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:42.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.762+0000 7fc5b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:30:42.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.762+0000 7fc5b67fc640 1 -- 172.21.15.63:0/311457631 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8004030 con 0x5654c70c6390 2024-09-21T06:30:42.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.762+0000 7fc5b67fc640 1 -- 172.21.15.63:0/311457631 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fc5b80041d0 con 0x5654c70c6390 2024-09-21T06:30:42.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.762+0000 7fc5dbb12740 1 -- 172.21.15.63:0/311457631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5c8004050 con 0x5654c70c6390 2024-09-21T06:30:42.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.762+0000 7fc5b67fc640 1 -- 172.21.15.63:0/311457631 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fc5b80043d0 con 0x5654c70c6390 2024-09-21T06:30:42.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.762+0000 7fc5dbb12740 10 client.16131 fetch_fsmap learned FSMap version 42 2024-09-21T06:30:42.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.762+0000 7fc5dbb12740 1 -- 172.21.15.63:0/311457631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5654c74b13c0 con 0x5654c70c6390 2024-09-21T06:30:42.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.762+0000 7fc5b67fc640 1 -- 172.21.15.63:0/311457631 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5c8004050 con 0x5654c70c6390 2024-09-21T06:30:42.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.763+0000 7fc5b67fc640 1 -- 172.21.15.63:0/311457631 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 42) ==== 8374+0+0 (secure 0 0 0) 0x7fc5b8003ae0 con 0x5654c70c6390 2024-09-21T06:30:42.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.763+0000 7fc5dbb12740 10 client.16131 fetch_fsmap finished waiting for FSMap version 42 2024-09-21T06:30:42.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.763+0000 7fc5dbb12740 10 client.16131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:30:42.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.763+0000 7fc5dbb12740 20 client.16131 populate_metadata read hostname 'smithi063' 2024-09-21T06:30:42.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.763+0000 7fc5dbb12740 1 --2- 172.21.15.63:0/311457631 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5654c70a59f0 0x5654c74b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.763+0000 7fc5dbb12740 4 client.16131 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:30:42.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.763+0000 7fc5dbb12740 1 -- 172.21.15.63:0/311457631 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654c7406da0 con 0x5654c70a59f0 2024-09-21T06:30:42.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.763+0000 7fc5cf7fe640 1 --2- 172.21.15.63:0/311457631 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5654c70a59f0 0x5654c74b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.763+0000 7fc5b67fc640 10 client.16131 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:30:42.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.764+0000 7fc5cf7fe640 1 --2- 172.21.15.63:0/311457631 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5654c70a59f0 0x5654c74b4cd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21c687c35adcad4f server_cookie=4b59a764a894e97 in_seq=0 out_seq=0 2024-09-21T06:30:42.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.769+0000 7fc5b67fc640 1 -- 172.21.15.63:0/311457631 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5654c7406da0 con 0x5654c70a59f0 2024-09-21T06:30:42.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.769+0000 7fc5b67fc640 10 client.16131 handle_command_reply: tid=0 2024-09-21T06:30:42.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.769+0000 7fc5dbb12740 1 client.16131 shutdown 2024-09-21T06:30:42.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.769+0000 7fc5dbb12740 1 -- 172.21.15.63:0/311457631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70c6390 msgr2=0x5654c7499c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:42.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.769+0000 7fc5dbb12740 1 --2- 172.21.15.63:0/311457631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70c6390 0x5654c7499c20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc5d006bab0 tx=0x7fc5b8012b60 comp rx=0 tx=0).stop 2024-09-21T06:30:42.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.769+0000 7fc5dbb12740 1 -- 172.21.15.63:0/311457631 shutdown_connections 2024-09-21T06:30:42.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.769+0000 7fc5dbb12740 1 --2- 172.21.15.63:0/311457631 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5654c70a59f0 0x5654c74b4cd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.769+0000 7fc5dbb12740 1 --2- 172.21.15.63:0/311457631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654c70e7070 0x5654c749a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.769+0000 7fc5dbb12740 1 --2- 172.21.15.63:0/311457631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70c6390 0x5654c7499c20 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.769+0000 7fc5dbb12740 1 --2- 172.21.15.63:0/311457631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70be1b0 0x5654c74a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.769+0000 7fc5dbb12740 1 -- 172.21.15.63:0/311457631 >> 172.21.15.63:0/311457631 conn(0x5654c70db460 msgr2=0x5654c7490040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:42.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.769+0000 7fc5b67fc640 0 client.16131 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:30:42.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.769+0000 7fc5dbb12740 1 -- 172.21.15.63:0/311457631 shutdown_connections 2024-09-21T06:30:42.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.769+0000 7fc5dbb12740 1 -- 172.21.15.63:0/311457631 wait complete. 2024-09-21T06:30:42.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.769+0000 7fc5dbb12740 20 client.16131 trim_cache size 0 max 16384 2024-09-21T06:30:42.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.791+0000 7fc5dbb12740 1 Processor -- start 2024-09-21T06:30:42.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.791+0000 7fc5dbb12740 1 -- start start 2024-09-21T06:30:42.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.792+0000 7fc5dbb12740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654c70db460 0x5654c7494d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.792+0000 7fc5dbb12740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70be1b0 0x5654c74952a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.792+0000 7fc5dbb12740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70c6390 0x5654c74984a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.792+0000 7fc5dbb12740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d01ad4e0 con 0x5654c70c6390 2024-09-21T06:30:42.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.792+0000 7fc5dbb12740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d01af0b0 con 0x5654c70be1b0 2024-09-21T06:30:42.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.792+0000 7fc5dbb12740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d01adc40 con 0x5654c70db460 2024-09-21T06:30:42.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.792+0000 7fc5cf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70c6390 0x5654c74984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.792+0000 7fc5cf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70c6390 0x5654c74984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44458/0 (socket says 172.21.15.63:44458) 2024-09-21T06:30:42.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.792+0000 7fc5cf7fe640 1 -- 172.21.15.63:0/666145630 learned_addr learned my addr 172.21.15.63:0/666145630 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:42.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.792+0000 7fc5c7fff640 1 --2- 172.21.15.63:0/666145630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70be1b0 0x5654c74952a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.792+0000 7fc5cf7fe640 1 --2- 172.21.15.63:0/666145630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654c70db460 0x5654c7494d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.792+0000 7fc5c7fff640 1 -- 172.21.15.63:0/666145630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654c70db460 msgr2=0x5654c7494d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:42.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.792+0000 7fc5c7fff640 1 --2- 172.21.15.63:0/666145630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654c70db460 0x5654c7494d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.792+0000 7fc5c7fff640 1 -- 172.21.15.63:0/666145630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70c6390 msgr2=0x5654c74984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:42.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.792+0000 7fc5c7fff640 1 --2- 172.21.15.63:0/666145630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70c6390 0x5654c74984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.792+0000 7fc5c7fff640 1 -- 172.21.15.63:0/666145630 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c7498120 con 0x5654c70be1b0 2024-09-21T06:30:42.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.793+0000 7fc5c7fff640 1 --2- 172.21.15.63:0/666145630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70be1b0 0x5654c74952a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8012420 tx=0x7fc5b8009ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c87493909938f760 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:42.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.793+0000 7fc5c4ff9640 1 -- 172.21.15.63:0/666145630 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8029070 con 0x5654c70be1b0 2024-09-21T06:30:42.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.793+0000 7fc5c4ff9640 1 -- 172.21.15.63:0/666145630 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5b8010e20 con 0x5654c70be1b0 2024-09-21T06:30:42.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.793+0000 7fc5c4ff9640 1 -- 172.21.15.63:0/666145630 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b800fbe0 con 0x5654c70be1b0 2024-09-21T06:30:42.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.794+0000 7fc5dbb12740 1 -- 172.21.15.63:0/666145630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70be1b0 msgr2=0x5654c74952a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:42.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.794+0000 7fc5dbb12740 1 --2- 172.21.15.63:0/666145630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70be1b0 0x5654c74952a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8012420 tx=0x7fc5b8009ee0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.794+0000 7fc5dbb12740 1 -- 172.21.15.63:0/666145630 shutdown_connections 2024-09-21T06:30:42.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.794+0000 7fc5dbb12740 1 --2- 172.21.15.63:0/666145630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70c6390 0x5654c74984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.794+0000 7fc5dbb12740 1 --2- 172.21.15.63:0/666145630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70be1b0 0x5654c74952a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.794+0000 7fc5dbb12740 1 --2- 172.21.15.63:0/666145630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654c70db460 0x5654c7494d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.794+0000 7fc5dbb12740 1 -- 172.21.15.63:0/666145630 >> 172.21.15.63:0/666145630 conn(0x5654c7493b60 msgr2=0x5654c7487280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:42.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.794+0000 7fc5dbb12740 1 -- 172.21.15.63:0/666145630 shutdown_connections 2024-09-21T06:30:42.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.795+0000 7fc5dbb12740 1 -- 172.21.15.63:0/666145630 wait complete. 2024-09-21T06:30:42.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.795+0000 7fc5dbb12740 1 -- start start 2024-09-21T06:30:42.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.795+0000 7fc5dbb12740 1 Processor -- start 2024-09-21T06:30:42.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.795+0000 7fc5dbb12740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70be1b0 0x5654c74af240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.795+0000 7fc5dbb12740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70c6390 0x5654c74af820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.795+0000 7fc5dbb12740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654c70db460 0x5654c749b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.795+0000 7fc5dbb12740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d01ae9e0 con 0x5654c70c6390 2024-09-21T06:30:42.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.795+0000 7fc5dbb12740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d01ae310 con 0x5654c70be1b0 2024-09-21T06:30:42.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.795+0000 7fc5dbb12740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d01ab4c0 con 0x5654c70db460 2024-09-21T06:30:42.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.796+0000 7fc5dbb12740 10 client.0 _ll_register_callbacks cb 0x7fc5b8009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:42.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.796+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70c6390 0x5654c74af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.796+0000 7fc5cf7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70be1b0 0x5654c74af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.796+0000 7fc5cf7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70be1b0 0x5654c74af240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:47580/0 (socket says 172.21.15.63:47580) 2024-09-21T06:30:42.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.796+0000 7fc5cf7fe640 1 -- 172.21.15.63:0/2256755261 learned_addr learned my addr 172.21.15.63:0/2256755261 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:30:42.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.796+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70c6390 0x5654c74af820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44472/0 (socket says 172.21.15.63:44472) 2024-09-21T06:30:42.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.796+0000 7fc5cf7fe640 1 --2- 172.21.15.63:0/2256755261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654c70db460 0x5654c749b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.796+0000 7fc5c7fff640 1 -- 172.21.15.63:0/2256755261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654c70db460 msgr2=0x5654c749b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:42.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.796+0000 7fc5c7fff640 1 --2- 172.21.15.63:0/2256755261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654c70db460 0x5654c749b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.796+0000 7fc5c7fff640 1 -- 172.21.15.63:0/2256755261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70be1b0 msgr2=0x5654c74af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:42.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.796+0000 7fc5c7fff640 1 --2- 172.21.15.63:0/2256755261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70be1b0 0x5654c74af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.796+0000 7fc5c7fff640 1 -- 172.21.15.63:0/2256755261 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654c749b840 con 0x5654c70c6390 2024-09-21T06:30:42.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.796+0000 7fc5cf7fe640 1 --2- 172.21.15.63:0/2256755261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70be1b0 0x5654c74af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:42.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.796+0000 7fc5c7fff640 1 --2- 172.21.15.63:0/2256755261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70c6390 0x5654c74af820 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8010450 tx=0x7fc5b8003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c25d82b008edbf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:42.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.796+0000 7fc5b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:30:42.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.796+0000 7fc5b67fc640 1 -- 172.21.15.63:0/2256755261 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8029070 con 0x5654c70c6390 2024-09-21T06:30:42.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.796+0000 7fc5b67fc640 1 -- 172.21.15.63:0/2256755261 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fc5b8010950 con 0x5654c70c6390 2024-09-21T06:30:42.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.796+0000 7fc5dbb12740 1 -- 172.21.15.63:0/2256755261 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5b8010e20 con 0x5654c70c6390 2024-09-21T06:30:42.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.797+0000 7fc5b67fc640 1 -- 172.21.15.63:0/2256755261 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fc5b8010b50 con 0x5654c70c6390 2024-09-21T06:30:42.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.797+0000 7fc5dbb12740 10 client.16137 fetch_fsmap learned FSMap version 42 2024-09-21T06:30:42.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.797+0000 7fc5dbb12740 1 -- 172.21.15.63:0/2256755261 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5654c74ad9a0 con 0x5654c70c6390 2024-09-21T06:30:42.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.797+0000 7fc5b67fc640 1 -- 172.21.15.63:0/2256755261 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5b8010e20 con 0x5654c70c6390 2024-09-21T06:30:42.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.797+0000 7fc5b67fc640 1 -- 172.21.15.63:0/2256755261 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 42) ==== 8374+0+0 (secure 0 0 0) 0x7fc5b8005410 con 0x5654c70c6390 2024-09-21T06:30:42.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.797+0000 7fc5dbb12740 10 client.16137 fetch_fsmap finished waiting for FSMap version 42 2024-09-21T06:30:42.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.797+0000 7fc5dbb12740 10 client.16137 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:30:42.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.797+0000 7fc5dbb12740 20 client.16137 populate_metadata read hostname 'smithi063' 2024-09-21T06:30:42.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.797+0000 7fc5dbb12740 1 --2- 172.21.15.63:0/2256755261 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5654c70e7070 0x5654c7521a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.797+0000 7fc5dbb12740 4 client.16137 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:30:42.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.797+0000 7fc5dbb12740 1 -- 172.21.15.63:0/2256755261 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5654c7402850 con 0x5654c70e7070 2024-09-21T06:30:42.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.798+0000 7fc5cf7fe640 1 --2- 172.21.15.63:0/2256755261 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5654c70e7070 0x5654c7521a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.798+0000 7fc5b67fc640 10 client.16137 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:30:42.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.798+0000 7fc5cf7fe640 1 --2- 172.21.15.63:0/2256755261 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5654c70e7070 0x5654c7521a20 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b15bf3a55244e175 server_cookie=9ffc02453404a83d in_seq=0 out_seq=0 2024-09-21T06:30:42.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.801+0000 7fc5b67fc640 1 -- 172.21.15.63:0/2256755261 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+578 (crc 0 0 0) 0x5654c7402850 con 0x5654c70e7070 2024-09-21T06:30:42.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.801+0000 7fc5b67fc640 10 client.16137 handle_command_reply: tid=0 2024-09-21T06:30:42.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.801+0000 7fc5dbb12740 1 client.16137 shutdown 2024-09-21T06:30:42.879 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:30:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "scrub active (818 inodes in the stack)", 2024-09-21T06:30:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": { 2024-09-21T06:30:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:30:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:30:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: "tag": "5cef1d6e-b4d8-4a94-b290-40167760d82c", 2024-09-21T06:30:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: "options": "recursive,force" 2024-09-21T06:30:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:30:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:30:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:30:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:30:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:30:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:30:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:30:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:30:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:30:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:30:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:30:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:30:42.880 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:30:42.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.801+0000 7fc5dbb12740 1 -- 172.21.15.63:0/2256755261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70c6390 msgr2=0x5654c74af820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:42.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.801+0000 7fc5dbb12740 1 --2- 172.21.15.63:0/2256755261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70c6390 0x5654c74af820 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8010450 tx=0x7fc5b8003f80 comp rx=0 tx=0).stop 2024-09-21T06:30:42.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.801+0000 7fc5dbb12740 1 -- 172.21.15.63:0/2256755261 shutdown_connections 2024-09-21T06:30:42.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.801+0000 7fc5dbb12740 1 --2- 172.21.15.63:0/2256755261 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5654c70e7070 0x5654c7521a20 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.801+0000 7fc5dbb12740 1 --2- 172.21.15.63:0/2256755261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654c70db460 0x5654c749b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.801+0000 7fc5b67fc640 0 client.16137 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:30:42.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.801+0000 7fc5dbb12740 1 --2- 172.21.15.63:0/2256755261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5654c70c6390 0x5654c74af820 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.801+0000 7fc5dbb12740 1 --2- 172.21.15.63:0/2256755261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5654c70be1b0 0x5654c74af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.801+0000 7fc5dbb12740 1 -- 172.21.15.63:0/2256755261 >> 172.21.15.63:0/2256755261 conn(0x5654c7493b60 msgr2=0x5654c7494d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:42.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.802+0000 7fc5dbb12740 1 -- 172.21.15.63:0/2256755261 shutdown_connections 2024-09-21T06:30:42.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.802+0000 7fc5dbb12740 1 -- 172.21.15.63:0/2256755261 wait complete. 2024-09-21T06:30:42.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.802+0000 7fc5dbb12740 20 client.16137 trim_cache size 0 max 16384 2024-09-21T06:30:42.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.802+0000 7fc5d559e640 1 -- 172.21.15.63:0/960698119 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc5bc0b6680 msgr2=0x7fc5bc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:42.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.802+0000 7fc5d559e640 1 --2- 172.21.15.63:0/960698119 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc5bc0b6680 0x7fc5bc0b8b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x5654c748d2d0 tx=0x7fc5c010b580 comp rx=0 tx=0).stop 2024-09-21T06:30:42.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.802+0000 7fc5d559e640 1 -- 172.21.15.63:0/960698119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5d0103b70 msgr2=0x7fc5d019a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:42.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.802+0000 7fc5d559e640 1 --2- 172.21.15.63:0/960698119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5d0103b70 0x7fc5d019a470 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0005940 tx=0x7fc5c00040c0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.802+0000 7fc5d559e640 1 -- 172.21.15.63:0/960698119 shutdown_connections 2024-09-21T06:30:42.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.802+0000 7fc5d559e640 1 --2- 172.21.15.63:0/960698119 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc5bc0b6680 0x7fc5bc0b8b90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.802+0000 7fc5d559e640 1 --2- 172.21.15.63:0/960698119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5d0109e00 0x7fc5d019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.802+0000 7fc5d559e640 1 --2- 172.21.15.63:0/960698119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d01094b0 0x7fc5d019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.802+0000 7fc5d559e640 1 --2- 172.21.15.63:0/960698119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5d0103b70 0x7fc5d019a470 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.802+0000 7fc5d559e640 1 -- 172.21.15.63:0/960698119 >> 172.21.15.63:0/960698119 conn(0x7fc5d00ff5e0 msgr2=0x7fc5d0101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:42.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.802+0000 7fc5d559e640 1 -- 172.21.15.63:0/960698119 shutdown_connections 2024-09-21T06:30:42.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:30:42.802+0000 7fc5d559e640 1 -- 172.21.15.63:0/960698119 wait complete. 2024-09-21T06:30:43.365 INFO:tasks.workunit.client.0.smithi063.stdout:Building overlay 2024-09-21T06:30:43.528 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:43 smithi063 ceph-mon[31150]: pgmap v398: 97 pgs: 97 active+clean; 65 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 1.2 MiB/s wr, 192 op/s 2024-09-21T06:30:43.529 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:43 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/,/] 2024-09-21T06:30:43.529 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:43 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/,/] 2024-09-21T06:30:43.558 INFO:tasks.cephfs.filesystem:scrub status for tag:5cef1d6e-b4d8-4a94-b290-40167760d82c - {'path': '/', 'tag': '5cef1d6e-b4d8-4a94-b290-40167760d82c', 'options': 'recursive,force'} 2024-09-21T06:30:43.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:43 smithi071 ceph-mon[34844]: pgmap v398: 97 pgs: 97 active+clean; 65 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 1.2 MiB/s wr, 192 op/s 2024-09-21T06:30:43.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:43 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/,/] 2024-09-21T06:30:43.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:43 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/,/] 2024-09-21T06:30:43.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:43 smithi175 ceph-mon[34510]: pgmap v398: 97 pgs: 97 active+clean; 65 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 1.2 MiB/s wr, 192 op/s 2024-09-21T06:30:43.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:43 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/,/] 2024-09-21T06:30:43.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:43 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/,/] 2024-09-21T06:30:44.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:44 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/,/] 2024-09-21T06:30:44.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:44 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:44.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:44 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:44.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:44 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:44.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:44 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:30:44.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:44 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:44.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:44 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/,/] 2024-09-21T06:30:44.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:44 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:44.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:44 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:44.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:44 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:44.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:44 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:30:44.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:44 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:44.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:44 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/,/] 2024-09-21T06:30:44.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:44 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:44.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:44 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:44.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:44 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:44.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:44 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:30:44.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:44 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:30:44.955 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] dataascii.lo 2024-09-21T06:30:44.967 INFO:tasks.workunit.client.0.smithi063.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/btrfs/group.list 2024-09-21T06:30:44.987 INFO:tasks.workunit.client.0.smithi063.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/generic/group.list 2024-09-21T06:30:45.117 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] databin.lo 2024-09-21T06:30:45.139 INFO:tasks.workunit.client.0.smithi063.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/overlay/group.list 2024-09-21T06:30:45.302 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] datapid.lo 2024-09-21T06:30:45.422 INFO:tasks.workunit.client.0.smithi063.stdout:Building perf 2024-09-21T06:30:45.426 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] file_lock.lo 2024-09-21T06:30:45.430 INFO:tasks.workunit.client.0.smithi063.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/perf/group.list 2024-09-21T06:30:45.446 INFO:tasks.workunit.client.0.smithi063.stdout:Building selftest 2024-09-21T06:30:45.454 INFO:tasks.workunit.client.0.smithi063.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/selftest/group.list 2024-09-21T06:30:45.478 INFO:tasks.workunit.client.0.smithi063.stdout:Building shared 2024-09-21T06:30:45.485 INFO:tasks.workunit.client.0.smithi063.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/shared/group.list 2024-09-21T06:30:45.509 INFO:tasks.workunit.client.0.smithi063.stdout:Building tmpfs 2024-09-21T06:30:45.518 INFO:tasks.workunit.client.0.smithi063.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/tmpfs/group.list 2024-09-21T06:30:45.536 INFO:tasks.workunit.client.0.smithi063.stdout:Building udf 2024-09-21T06:30:45.544 INFO:tasks.workunit.client.0.smithi063.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/udf/group.list 2024-09-21T06:30:45.561 INFO:tasks.workunit.client.0.smithi063.stdout:Building xfs 2024-09-21T06:30:45.597 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] forker.lo 2024-09-21T06:30:45.653 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] pattern.lo 2024-09-21T06:30:45.678 INFO:tasks.workunit.client.0.smithi063.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/xfs/group.list 2024-09-21T06:30:45.745 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] open_flags.lo 2024-09-21T06:30:45.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:45 smithi071 ceph-mon[34844]: pgmap v399: 97 pgs: 97 active+clean; 66 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 969 KiB/s wr, 195 op/s 2024-09-21T06:30:45.794 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] random_range.lo 2024-09-21T06:30:45.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:45 smithi063 ceph-mon[31150]: pgmap v399: 97 pgs: 97 active+clean; 66 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 969 KiB/s wr, 195 op/s 2024-09-21T06:30:45.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:45 smithi175 ceph-mon[34510]: pgmap v399: 97 pgs: 97 active+clean; 66 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 969 KiB/s wr, 195 op/s 2024-09-21T06:30:45.922 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] string_to_tokens.lo 2024-09-21T06:30:46.044 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] str_to_bytes.lo 2024-09-21T06:30:46.070 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] tlibio.lo 2024-09-21T06:30:46.199 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] write_log.lo 2024-09-21T06:30:46.210 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] random.lo 2024-09-21T06:30:46.449 INFO:tasks.workunit.client.0.smithi063.stdout: [LD] 2024-09-21T06:30:46.566 INFO:tasks.workunit.client.0.smithi063.stdout:Building ltp 2024-09-21T06:30:46.566 INFO:tasks.workunit.client.0.smithi063.stdout:Building src 2024-09-21T06:30:46.566 INFO:tasks.workunit.client.0.smithi063.stdout:Building m4 2024-09-21T06:30:46.566 INFO:tasks.workunit.client.0.smithi063.stdout:Building common 2024-09-21T06:30:46.573 INFO:tasks.workunit.client.0.smithi063.stdout: [DEP] 2024-09-21T06:30:46.603 INFO:tasks.workunit.client.0.smithi063.stdout: [DEP] 2024-09-21T06:30:46.858 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] doio 2024-09-21T06:30:46.858 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] fsstress 2024-09-21T06:30:46.858 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] fsx 2024-09-21T06:30:47.555 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] growfiles 2024-09-21T06:30:47.624 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] iogen 2024-09-21T06:30:47.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:47 smithi071 ceph-mon[34844]: pgmap v400: 97 pgs: 97 active+clean; 67 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 1.1 MiB/s wr, 321 op/s 2024-09-21T06:30:47.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:47 smithi063 ceph-mon[31150]: pgmap v400: 97 pgs: 97 active+clean; 67 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 1.1 MiB/s wr, 321 op/s 2024-09-21T06:30:47.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:47 smithi175 ceph-mon[34510]: pgmap v400: 97 pgs: 97 active+clean; 67 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 1.1 MiB/s wr, 321 op/s 2024-09-21T06:30:48.026 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] aio-stress 2024-09-21T06:30:48.762 INFO:tasks.workunit.client.0.smithi063.stdout: [DEP] 2024-09-21T06:30:48.762 INFO:tasks.workunit.client.0.smithi063.stdout: [DEP] 2024-09-21T06:30:48.765 INFO:tasks.workunit.client.0.smithi063.stdout: [DEP] 2024-09-21T06:30:48.765 INFO:tasks.workunit.client.0.smithi063.stdout: [DEP] 2024-09-21T06:30:49.010 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] dirstress 2024-09-21T06:30:49.011 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] fill 2024-09-21T06:30:49.011 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] fill2 2024-09-21T06:30:49.012 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] getpagesize 2024-09-21T06:30:49.147 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] holes 2024-09-21T06:30:49.171 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] lstat64 2024-09-21T06:30:49.257 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] nametest 2024-09-21T06:30:49.264 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] permname 2024-09-21T06:30:49.358 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] randholes 2024-09-21T06:30:49.362 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] runas 2024-09-21T06:30:49.466 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] truncfile 2024-09-21T06:30:49.523 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] usemem 2024-09-21T06:30:49.550 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] mmapcat 2024-09-21T06:30:49.621 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] append_reader 2024-09-21T06:30:49.659 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] append_writer 2024-09-21T06:30:49.687 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] dirperf 2024-09-21T06:30:49.703 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] metaperf 2024-09-21T06:30:49.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:49 smithi071 ceph-mon[34844]: pgmap v401: 97 pgs: 97 active+clean; 76 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 650 op/s 2024-09-21T06:30:49.786 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] devzero 2024-09-21T06:30:49.811 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] feature 2024-09-21T06:30:49.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:49 smithi063 ceph-mon[31150]: pgmap v401: 97 pgs: 97 active+clean; 76 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 650 op/s 2024-09-21T06:30:49.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:49 smithi175 ceph-mon[34510]: pgmap v401: 97 pgs: 97 active+clean; 76 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 650 op/s 2024-09-21T06:30:49.940 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] alloc 2024-09-21T06:30:49.983 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] fault 2024-09-21T06:30:50.008 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] fstest 2024-09-21T06:30:50.037 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_access_root 2024-09-21T06:30:50.144 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] godown 2024-09-21T06:30:50.170 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] resvtest 2024-09-21T06:30:50.221 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] writemod 2024-09-21T06:30:50.248 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] writev_on_pagefault 2024-09-21T06:30:50.336 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] makeextents 2024-09-21T06:30:50.359 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] itrash 2024-09-21T06:30:50.440 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] rename 2024-09-21T06:30:50.440 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] multi_open_unlink 2024-09-21T06:30:50.518 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] unwritten_sync 2024-09-21T06:30:50.530 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] genhashnames 2024-09-21T06:30:50.531 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_holes 2024-09-21T06:30:50.580 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_mmap_writev 2024-09-21T06:30:50.677 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_truncate_cmtime 2024-09-21T06:30:50.703 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] dirhash_collide 2024-09-21T06:30:50.726 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_rename_overwrite 2024-09-21T06:30:50.727 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] holetest 2024-09-21T06:30:50.842 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_truncate_self 2024-09-21T06:30:50.874 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] af_unix 2024-09-21T06:30:50.903 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_mmap_stale_pmd 2024-09-21T06:30:50.974 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_mmap_cow_race 2024-09-21T06:30:50.980 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_mmap_fallocate 2024-09-21T06:30:51.038 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] fsync-err 2024-09-21T06:30:51.066 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_mmap_write_ro 2024-09-21T06:30:51.138 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_ext4_dax_journal_corruption 2024-09-21T06:30:51.153 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_ext4_dax_inline_corruption 2024-09-21T06:30:51.222 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_ofd_locks 2024-09-21T06:30:51.239 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_mmap_collision 2024-09-21T06:30:51.299 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] mmap-write-concurrent 2024-09-21T06:30:51.331 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_get_file_time 2024-09-21T06:30:51.441 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_create_short_dirs 2024-09-21T06:30:51.458 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_create_long_dirs 2024-09-21T06:30:51.497 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_enospc 2024-09-21T06:30:51.500 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_mmap_writev_overlap 2024-09-21T06:30:51.613 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] checkpoint_journal 2024-09-21T06:30:51.627 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] mmap-rw-fault 2024-09-21T06:30:51.665 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] allocstale 2024-09-21T06:30:51.684 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_mmap_cow_memory_failure 2024-09-21T06:30:51.766 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] fake-dump-rootino 2024-09-21T06:30:51.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:51 smithi071 ceph-mon[34844]: pgmap v402: 97 pgs: 97 active+clean; 77 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 706 op/s 2024-09-21T06:30:51.820 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:51 smithi063 ceph-mon[31150]: pgmap v402: 97 pgs: 97 active+clean; 77 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 706 op/s 2024-09-21T06:30:51.837 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] dio-buf-fault 2024-09-21T06:30:51.848 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] rewinddir-test 2024-09-21T06:30:51.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:51 smithi175 ceph-mon[34510]: pgmap v402: 97 pgs: 97 active+clean; 77 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 706 op/s 2024-09-21T06:30:51.883 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] readdir-while-renames 2024-09-21T06:30:51.930 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] xfsctl 2024-09-21T06:30:51.996 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] bstat 2024-09-21T06:30:52.031 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_mtab 2024-09-21T06:30:52.051 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] getdevicesize 2024-09-21T06:30:52.139 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] preallo_rw_pattern_reader 2024-09-21T06:30:52.202 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] preallo_rw_pattern_writer 2024-09-21T06:30:52.204 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] ftrunc 2024-09-21T06:30:52.242 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] trunc 2024-09-21T06:30:52.317 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] fs_perms 2024-09-21T06:30:52.356 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] testx 2024-09-21T06:30:52.360 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] looptest 2024-09-21T06:30:52.414 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] locktest 2024-09-21T06:30:52.492 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] unwritten_mmap 2024-09-21T06:30:52.498 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] bulkstat_unlink_test 2024-09-21T06:30:52.574 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] deduperace 2024-09-21T06:30:52.657 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] bulkstat_unlink_test_modified 2024-09-21T06:30:52.708 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_dir_offset 2024-09-21T06:30:52.764 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_futimens 2024-09-21T06:30:52.776 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_immutable 2024-09-21T06:30:52.844 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:52.842+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:52.844 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:52.842+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-21T06:30:52.844 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:52.842+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-21T06:30:52.844 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:52.842+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T06:30:52.844 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:30:52.842+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-09-21T06:30:52.867 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] stale_handle 2024-09-21T06:30:52.873 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] pwrite_mmap_blocked 2024-09-21T06:30:52.906 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_dir_offset2 2024-09-21T06:30:53.022 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] seek_sanity_test 2024-09-21T06:30:53.039 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] seek_copy_test 2024-09-21T06:30:53.116 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_readdir_1 2024-09-21T06:30:53.230 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_readdir_2 2024-09-21T06:30:53.261 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] fsync-tester 2024-09-21T06:30:53.401 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] nsexec 2024-09-21T06:30:53.510 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] cloner 2024-09-21T06:30:53.516 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] renameat2 2024-09-21T06:30:53.526 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_getcwd 2024-09-21T06:30:53.596 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] e4compact 2024-09-21T06:30:53.691 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] test-nextquota 2024-09-21T06:30:53.693 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] punch-alternating 2024-09-21T06:30:53.693 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] attr-list-by-handle-cursor-test 2024-09-21T06:30:53.733 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:53 smithi063 ceph-mon[31150]: pgmap v403: 97 pgs: 97 active+clean; 79 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 746 op/s 2024-09-21T06:30:53.733 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:53 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:30:53.733 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:53 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:30:53.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:53 smithi071 ceph-mon[34844]: pgmap v403: 97 pgs: 97 active+clean; 79 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 746 op/s 2024-09-21T06:30:53.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:53 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:30:53.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:53 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:30:53.840 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] listxattr 2024-09-21T06:30:53.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:53 smithi175 ceph-mon[34510]: pgmap v403: 97 pgs: 97 active+clean; 79 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 746 op/s 2024-09-21T06:30:53.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:53 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:30:53.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:53 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:30:53.861 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] dio-interleaved 2024-09-21T06:30:53.864 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_dir_type 2024-09-21T06:30:53.873 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] dio-invalidate-cache 2024-09-21T06:30:54.000 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] stat_test 2024-09-21T06:30:54.029 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_encrypted_d_revalidate 2024-09-21T06:30:54.031 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] attr_replace_test 2024-09-21T06:30:54.096 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] swapon 2024-09-21T06:30:54.199 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] mkswap 2024-09-21T06:30:54.202 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_attr_corruption 2024-09-21T06:30:54.280 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_open_tmpfiles 2024-09-21T06:30:54.339 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] fscrypt-crypt-util 2024-09-21T06:30:54.361 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] bulkstat_null_ocount 2024-09-21T06:30:54.368 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] splice-test 2024-09-21T06:30:54.475 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] chprojid_fail 2024-09-21T06:30:54.519 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] detached_mounts_propagation 2024-09-21T06:30:54.564 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] ext4_resize 2024-09-21T06:30:54.629 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_readdir_3 2024-09-21T06:30:54.707 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] splice2pipe 2024-09-21T06:30:54.710 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] uuid_ioctl 2024-09-21T06:30:54.746 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:54 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:30:54.746 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:54 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:30:54.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:54 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:30:54.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:54 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:30:54.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:54 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:30:54.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:54 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:30:54.852 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_snapshot_deleted_subvolume 2024-09-21T06:30:54.890 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] fiemap-fault 2024-09-21T06:30:54.904 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] fiemap-tester 2024-09-21T06:30:55.032 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_stripealign 2024-09-21T06:30:55.066 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] open_by_handle 2024-09-21T06:30:55.155 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_mmap_dio 2024-09-21T06:30:55.199 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] xfsfind 2024-09-21T06:30:55.246 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] t_reflink_read_race 2024-09-21T06:30:55.354 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] fssum 2024-09-21T06:30:55.358 INFO:tasks.workunit.client.0.smithi063.stdout:Building log-writes 2024-09-21T06:30:55.364 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] replay-log 2024-09-21T06:30:55.446 INFO:tasks.workunit.client.0.smithi063.stdout:Building perf 2024-09-21T06:30:55.452 INFO:tasks.workunit.client.0.smithi063.stdout:Building aio-dio-regress 2024-09-21T06:30:55.460 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] aiocp 2024-09-21T06:30:55.482 INFO:tasks.workunit.client.0.smithi063.stdout:Building vfs 2024-09-21T06:30:55.490 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] vfstest 2024-09-21T06:30:55.708 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] aio-dio-append-write-fallocate-race 2024-09-21T06:30:55.760 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] mount-idmapped 2024-09-21T06:30:55.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:55 smithi071 ceph-mon[34844]: pgmap v404: 97 pgs: 97 active+clean; 79 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 669 op/s 2024-09-21T06:30:55.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:55 smithi063 ceph-mon[31150]: pgmap v404: 97 pgs: 97 active+clean; 79 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 669 op/s 2024-09-21T06:30:55.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:55 smithi175 ceph-mon[34510]: pgmap v404: 97 pgs: 97 active+clean; 79 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 669 op/s 2024-09-21T06:30:55.884 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] aio-dio-append-write-read-race 2024-09-21T06:30:55.905 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] aio-dio-cow-race 2024-09-21T06:30:56.064 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] aio-dio-cycle-write 2024-09-21T06:30:56.111 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] aio-dio-eof-race 2024-09-21T06:30:56.252 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] aio-dio-extend-stat 2024-09-21T06:30:56.275 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] aio-dio-fcntl-race 2024-09-21T06:30:56.372 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] aio-dio-hole-filling-race 2024-09-21T06:30:56.420 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] aio-dio-invalidate-failure 2024-09-21T06:30:56.456 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] aio-dio-invalidate-readahead 2024-09-21T06:30:56.547 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] aiodio_sparse2 2024-09-21T06:30:56.594 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] aio-dio-subblock-eof-read 2024-09-21T06:30:56.649 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] aio-dio-write-verify 2024-09-21T06:30:56.741 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-09-21T06:30:56.779 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-09-21T06:30:56.859 INFO:tasks.workunit.client.0.smithi063.stdout: [CC] aio-last-ref-held-by-io 2024-09-21T06:30:57.718 INFO:tasks.workunit.client.0.smithi063.stderr:+ cd .. 2024-09-21T06:30:57.719 INFO:tasks.workunit.client.0.smithi063.stderr:+ cp xfstests-dev/ltp/fsx . 2024-09-21T06:30:57.721 INFO:tasks.workunit.client.0.smithi063.stderr:+ OPTIONS=-z 2024-09-21T06:30:57.721 INFO:tasks.workunit.client.0.smithi063.stderr:+ ./fsx -z 1MB -N 50000 -p 10000 -l 1048576 2024-09-21T06:30:57.721 INFO:tasks.workunit.client.0.smithi063.stdout:Seed set to 1 2024-09-21T06:30:57.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:57 smithi071 ceph-mon[34844]: pgmap v405: 97 pgs: 97 active+clean; 79 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 598 op/s 2024-09-21T06:30:57.774 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-09-21T06:30:57.774 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-09-21T06:30:57.777 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-21T06:30:57.778 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-21T06:30:57.778 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support clone range, disabling! 2024-09-21T06:30:57.782 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-21T06:30:57.784 INFO:tasks.workunit.client.0.smithi063.stdout:skipping zero size read 2024-09-21T06:30:57.784 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support exchange range, disabling! 2024-09-21T06:30:57.784 INFO:tasks.workunit.client.0.smithi063.stdout:skipping zero size read 2024-09-21T06:30:57.785 INFO:tasks.workunit.client.0.smithi063.stdout:truncating to largest ever: 0x81d54 2024-09-21T06:30:57.788 INFO:tasks.workunit.client.0.smithi063.stdout:copying to largest ever: 0xb86d7 2024-09-21T06:30:57.795 INFO:tasks.workunit.client.0.smithi063.stdout:copying to largest ever: 0xe627e 2024-09-21T06:30:57.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:57 smithi063 ceph-mon[31150]: pgmap v405: 97 pgs: 97 active+clean; 79 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 598 op/s 2024-09-21T06:30:57.836 INFO:tasks.workunit.client.0.smithi063.stdout:truncating to largest ever: 0xf3194 2024-09-21T06:30:57.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:57 smithi175 ceph-mon[34510]: pgmap v405: 97 pgs: 97 active+clean; 79 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 598 op/s 2024-09-21T06:30:57.859 INFO:tasks.workunit.client.0.smithi063.stdout:copying to largest ever: 0xf3ceb 2024-09-21T06:30:57.866 INFO:tasks.workunit.client.0.smithi063.stdout:truncating to largest ever: 0xf47e4 2024-09-21T06:30:57.955 INFO:tasks.workunit.client.0.smithi063.stdout:copying to largest ever: 0xfaccc 2024-09-21T06:30:58.333 INFO:tasks.workunit.client.0.smithi063.stdout:copying to largest ever: 0xfe423 2024-09-21T06:30:59.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:30:59 smithi071 ceph-mon[34844]: pgmap v406: 97 pgs: 97 active+clean; 80 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 465 op/s 2024-09-21T06:30:59.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:30:59 smithi063 ceph-mon[31150]: pgmap v406: 97 pgs: 97 active+clean; 80 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 465 op/s 2024-09-21T06:30:59.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:30:59 smithi175 ceph-mon[34510]: pgmap v406: 97 pgs: 97 active+clean; 80 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 465 op/s 2024-09-21T06:31:00.699 INFO:tasks.workunit.client.0.smithi063.stdout:copying to largest ever: 0xfe492 2024-09-21T06:31:01.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:01 smithi071 ceph-mon[34844]: pgmap v407: 97 pgs: 97 active+clean; 82 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 807 KiB/s wr, 216 op/s 2024-09-21T06:31:01.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:01 smithi063 ceph-mon[31150]: pgmap v407: 97 pgs: 97 active+clean; 82 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 807 KiB/s wr, 216 op/s 2024-09-21T06:31:01.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:01 smithi175 ceph-mon[34510]: pgmap v407: 97 pgs: 97 active+clean; 82 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 807 KiB/s wr, 216 op/s 2024-09-21T06:31:02.619 INFO:tasks.workunit.client.0.smithi063.stdout:copying to largest ever: 0xff038 2024-09-21T06:31:03.536 INFO:tasks.workunit.client.0.smithi063.stdout:truncating to largest ever: 0xffcac 2024-09-21T06:31:03.657 INFO:tasks.workunit.client.0.smithi063.stdout:10000 copy from 0x2d237 to 0x30552, (0x331b bytes) at 0x82aed 2024-09-21T06:31:03.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:03 smithi071 ceph-mon[34844]: pgmap v408: 97 pgs: 97 active+clean; 82 MiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 739 KiB/s wr, 152 op/s 2024-09-21T06:31:03.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:03 smithi063 ceph-mon[31150]: pgmap v408: 97 pgs: 97 active+clean; 82 MiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 739 KiB/s wr, 152 op/s 2024-09-21T06:31:03.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:03 smithi175 ceph-mon[34510]: pgmap v408: 97 pgs: 97 active+clean; 82 MiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 739 KiB/s wr, 152 op/s 2024-09-21T06:31:05.697 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:05 smithi063 ceph-mon[31150]: pgmap v409: 97 pgs: 97 active+clean; 83 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 334 op/s 2024-09-21T06:31:05.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:05 smithi071 ceph-mon[34844]: pgmap v409: 97 pgs: 97 active+clean; 83 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 334 op/s 2024-09-21T06:31:05.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:05 smithi175 ceph-mon[34510]: pgmap v409: 97 pgs: 97 active+clean; 83 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 334 op/s 2024-09-21T06:31:07.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:07 smithi071 ceph-mon[34844]: pgmap v410: 97 pgs: 97 active+clean; 85 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 386 op/s 2024-09-21T06:31:07.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:07 smithi063 ceph-mon[31150]: pgmap v410: 97 pgs: 97 active+clean; 85 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 386 op/s 2024-09-21T06:31:07.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:07 smithi175 ceph-mon[34510]: pgmap v410: 97 pgs: 97 active+clean; 85 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 386 op/s 2024-09-21T06:31:07.858 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:31:07.857+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:31:07.857+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-21T06:31:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:31:07.857+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-21T06:31:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:31:07.857+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T06:31:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:31:07.857+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-09-21T06:31:09.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:09 smithi071 ceph-mon[34844]: pgmap v411: 97 pgs: 97 active+clean; 90 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 485 op/s 2024-09-21T06:31:09.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:09 smithi063 ceph-mon[31150]: pgmap v411: 97 pgs: 97 active+clean; 90 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 485 op/s 2024-09-21T06:31:09.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:09 smithi175 ceph-mon[34510]: pgmap v411: 97 pgs: 97 active+clean; 90 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 485 op/s 2024-09-21T06:31:11.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:11 smithi071 ceph-mon[34844]: pgmap v412: 97 pgs: 97 active+clean; 93 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.0 MiB/s wr, 764 op/s 2024-09-21T06:31:11.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:11 smithi063 ceph-mon[31150]: pgmap v412: 97 pgs: 97 active+clean; 93 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.0 MiB/s wr, 764 op/s 2024-09-21T06:31:11.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:11 smithi175 ceph-mon[34510]: pgmap v412: 97 pgs: 97 active+clean; 93 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.0 MiB/s wr, 764 op/s 2024-09-21T06:31:13.559 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:31:13.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:13 smithi071 ceph-mon[34844]: pgmap v413: 97 pgs: 97 active+clean; 93 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.6 MiB/s wr, 701 op/s 2024-09-21T06:31:13.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:13 smithi063 ceph-mon[31150]: pgmap v413: 97 pgs: 97 active+clean; 93 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.6 MiB/s wr, 701 op/s 2024-09-21T06:31:13.845 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:31:13.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:13 smithi175 ceph-mon[34510]: pgmap v413: 97 pgs: 97 active+clean; 93 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.6 MiB/s wr, 701 op/s 2024-09-21T06:31:14.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.356+0000 7f2b77951640 1 -- 172.21.15.63:0/2497579610 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b701049f0 msgr2=0x7f2b70104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:14.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.356+0000 7f2b77951640 1 --2- 172.21.15.63:0/2497579610 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b701049f0 0x7f2b70104e00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009900 tx=0x7f2b6c02a410 comp rx=0 tx=0).stop 2024-09-21T06:31:14.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.356+0000 7f2b77951640 1 -- 172.21.15.63:0/2497579610 shutdown_connections 2024-09-21T06:31:14.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.356+0000 7f2b77951640 1 --2- 172.21.15.63:0/2497579610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b7010de50 0x7f2b70110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.356+0000 7f2b77951640 1 --2- 172.21.15.63:0/2497579610 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b70105340 0x7f2b7010d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.356+0000 7f2b77951640 1 --2- 172.21.15.63:0/2497579610 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b701049f0 0x7f2b70104e00 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.356+0000 7f2b77951640 1 -- 172.21.15.63:0/2497579610 >> 172.21.15.63:0/2497579610 conn(0x7f2b700797e0 msgr2=0x7f2b70079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:14.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.356+0000 7f2b77951640 1 -- 172.21.15.63:0/2497579610 shutdown_connections 2024-09-21T06:31:14.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.356+0000 7f2b77951640 1 -- 172.21.15.63:0/2497579610 wait complete. 2024-09-21T06:31:14.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.357+0000 7f2b77951640 1 Processor -- start 2024-09-21T06:31:14.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.357+0000 7f2b77951640 1 -- start start 2024-09-21T06:31:14.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.357+0000 7f2b77951640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b701049f0 0x7f2b7019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:14.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.357+0000 7f2b77951640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b70105340 0x7f2b7019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:14.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.357+0000 7f2b77951640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b7010de50 0x7f2b7019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:14.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.358+0000 7f2b77951640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70113ad0 con 0x7f2b701049f0 2024-09-21T06:31:14.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.358+0000 7f2b77951640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70113950 con 0x7f2b7010de50 2024-09-21T06:31:14.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.358+0000 7f2b77951640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70113c50 con 0x7f2b70105340 2024-09-21T06:31:14.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.358+0000 7f2b756ed640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b701049f0 0x7f2b7019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:14.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.358+0000 7f2b756ed640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b701049f0 0x7f2b7019a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46566/0 (socket says 172.21.15.63:46566) 2024-09-21T06:31:14.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.358+0000 7f2b756ed640 1 -- 172.21.15.63:0/2981058419 learned_addr learned my addr 172.21.15.63:0/2981058419 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:14.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.358+0000 7f2b74eec640 1 --2- 172.21.15.63:0/2981058419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b70105340 0x7f2b7019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:14.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.358+0000 7f2b75eee640 1 --2- 172.21.15.63:0/2981058419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b7010de50 0x7f2b7019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:14.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.358+0000 7f2b74eec640 1 -- 172.21.15.63:0/2981058419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b7010de50 msgr2=0x7f2b7019fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:14.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.358+0000 7f2b74eec640 1 --2- 172.21.15.63:0/2981058419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b7010de50 0x7f2b7019fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.358+0000 7f2b74eec640 1 -- 172.21.15.63:0/2981058419 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b701049f0 msgr2=0x7f2b7019a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:14.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.358+0000 7f2b74eec640 1 --2- 172.21.15.63:0/2981058419 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b701049f0 0x7f2b7019a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.358+0000 7f2b74eec640 1 -- 172.21.15.63:0/2981058419 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b701a0470 con 0x7f2b70105340 2024-09-21T06:31:14.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.358+0000 7f2b75eee640 1 --2- 172.21.15.63:0/2981058419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b7010de50 0x7f2b7019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:14.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.358+0000 7f2b756ed640 1 --2- 172.21.15.63:0/2981058419 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b701049f0 0x7f2b7019a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:14.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.359+0000 7f2b74eec640 1 --2- 172.21.15.63:0/2981058419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b70105340 0x7f2b7019aaa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2b7006ad30 tx=0x7f2b6000ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:14.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.359+0000 7f2b667fc640 1 -- 172.21.15.63:0/2981058419 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6000cc40 con 0x7f2b70105340 2024-09-21T06:31:14.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.359+0000 7f2b667fc640 1 -- 172.21.15.63:0/2981058419 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b6000cde0 con 0x7f2b70105340 2024-09-21T06:31:14.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.359+0000 7f2b667fc640 1 -- 172.21.15.63:0/2981058419 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b60018780 con 0x7f2b70105340 2024-09-21T06:31:14.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.359+0000 7f2b77951640 1 -- 172.21.15.63:0/2981058419 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b701a0760 con 0x7f2b70105340 2024-09-21T06:31:14.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.359+0000 7f2b77951640 1 -- 172.21.15.63:0/2981058419 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b70102610 con 0x7f2b70105340 2024-09-21T06:31:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.362+0000 7f2b7dec5740 1 Processor -- start 2024-09-21T06:31:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.362+0000 7f2b7dec5740 1 -- start start 2024-09-21T06:31:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.362+0000 7f2b667fc640 1 -- 172.21.15.63:0/2981058419 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f2b60010a90 con 0x7f2b70105340 2024-09-21T06:31:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.363+0000 7f2b7dec5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d9c070 0x55cb71143650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.363+0000 7f2b7dec5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d731b0 0x55cb71143b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.363+0000 7f2b7dec5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d7b390 0x55cb711440d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.363+0000 7f2b7dec5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55cb710b9e50 con 0x55cb70d731b0 2024-09-21T06:31:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.363+0000 7f2b7dec5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cb710a9280 con 0x55cb70d9c070 2024-09-21T06:31:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.363+0000 7f2b7dec5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cb710ad090 con 0x55cb70d7b390 2024-09-21T06:31:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.363+0000 7f2b756ed640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d731b0 0x55cb71143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.363+0000 7f2b75eee640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d9c070 0x55cb71143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.363+0000 7f2b75eee640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d9c070 0x55cb71143650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:60648/0 (socket says 172.21.15.63:60648) 2024-09-21T06:31:14.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.363+0000 7f2b75eee640 1 -- 172.21.15.63:0/1249309634 learned_addr learned my addr 172.21.15.63:0/1249309634 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:14.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.363+0000 7f2b74eec640 1 --2- 172.21.15.63:0/1249309634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d7b390 0x55cb711440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:14.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.363+0000 7f2b75eee640 1 -- 172.21.15.63:0/1249309634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d7b390 msgr2=0x55cb711440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:14.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.363+0000 7f2b75eee640 1 --2- 172.21.15.63:0/1249309634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d7b390 0x55cb711440d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.363+0000 7f2b75eee640 1 -- 172.21.15.63:0/1249309634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d731b0 msgr2=0x55cb71143b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:14.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.363+0000 7f2b75eee640 1 --2- 172.21.15.63:0/1249309634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d731b0 0x55cb71143b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.363+0000 7f2b75eee640 1 -- 172.21.15.63:0/1249309634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb70e07650 con 0x55cb70d9c070 2024-09-21T06:31:14.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.363+0000 7f2b75eee640 1 --2- 172.21.15.63:0/1249309634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d9c070 0x55cb71143650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2b68010a80 tx=0x7f2b68009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6b4cf12963dbf92 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:14.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.364+0000 7f2b5b7fe640 1 -- 172.21.15.63:0/1249309634 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b68003c30 con 0x55cb70d9c070 2024-09-21T06:31:14.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.364+0000 7f2b667fc640 1 --2- 172.21.15.63:0/2981058419 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2b5c0b6680 0x7f2b5c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:14.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.364+0000 7f2b5b7fe640 1 -- 172.21.15.63:0/1249309634 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b6801f070 con 0x55cb70d9c070 2024-09-21T06:31:14.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.364+0000 7f2b5b7fe640 1 -- 172.21.15.63:0/1249309634 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b680046d0 con 0x55cb70d9c070 2024-09-21T06:31:14.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.364+0000 7f2b756ed640 1 --2- 172.21.15.63:0/2981058419 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2b5c0b6680 0x7f2b5c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:14.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.364+0000 7f2b667fc640 1 -- 172.21.15.63:0/2981058419 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f2b600e7a30 con 0x7f2b70105340 2024-09-21T06:31:14.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.365+0000 7f2b7dec5740 1 -- 172.21.15.63:0/1249309634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d9c070 msgr2=0x55cb71143650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:14.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.365+0000 7f2b756ed640 1 --2- 172.21.15.63:0/2981058419 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2b5c0b6680 0x7f2b5c0b8b90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0096c0 tx=0x7f2b6c032ed0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:14.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.365+0000 7f2b7dec5740 1 --2- 172.21.15.63:0/1249309634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d9c070 0x55cb71143650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2b68010a80 tx=0x7f2b68009500 comp rx=0 tx=0).stop 2024-09-21T06:31:14.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.365+0000 7f2b7dec5740 1 -- 172.21.15.63:0/1249309634 shutdown_connections 2024-09-21T06:31:14.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.365+0000 7f2b7dec5740 1 --2- 172.21.15.63:0/1249309634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d7b390 0x55cb711440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.365+0000 7f2b7dec5740 1 --2- 172.21.15.63:0/1249309634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d731b0 0x55cb71143b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.365+0000 7f2b7dec5740 1 --2- 172.21.15.63:0/1249309634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d9c070 0x55cb71143650 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.365+0000 7f2b7dec5740 1 -- 172.21.15.63:0/1249309634 >> 172.21.15.63:0/1249309634 conn(0x55cb70d90460 msgr2=0x55cb71141540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:14.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.365+0000 7f2b7dec5740 1 -- 172.21.15.63:0/1249309634 shutdown_connections 2024-09-21T06:31:14.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.365+0000 7f2b7dec5740 1 -- 172.21.15.63:0/1249309634 wait complete. 2024-09-21T06:31:14.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.365+0000 7f2b7dec5740 1 -- start start 2024-09-21T06:31:14.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.365+0000 7f2b7dec5740 1 Processor -- start 2024-09-21T06:31:14.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.366+0000 7f2b7dec5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d731b0 0x55cb7114ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:14.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.366+0000 7f2b7dec5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d7b390 0x55cb7114f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:14.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.366+0000 7f2b7dec5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d9c070 0x55cb7115b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:14.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.366+0000 7f2b7dec5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55cb70f0a700 con 0x55cb70d7b390 2024-09-21T06:31:14.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.366+0000 7f2b7dec5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cb71044110 con 0x55cb70d9c070 2024-09-21T06:31:14.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.366+0000 7f2b7dec5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cb71151e30 con 0x55cb70d731b0 2024-09-21T06:31:14.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.366+0000 7f2b7dec5740 10 client.0 _ll_register_callbacks cb 0x55cb7105d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:31:14.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.366+0000 7f2b74eec640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d7b390 0x55cb7114f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:14.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.366+0000 7f2b756ed640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d731b0 0x55cb7114ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:14.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.366+0000 7f2b74eec640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d7b390 0x55cb7114f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46592/0 (socket says 172.21.15.63:46592) 2024-09-21T06:31:14.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.366+0000 7f2b74eec640 1 -- 172.21.15.63:0/2118056913 learned_addr learned my addr 172.21.15.63:0/2118056913 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:14.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.366+0000 7f2b75eee640 1 --2- 172.21.15.63:0/2118056913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d9c070 0x55cb7115b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:14.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.366+0000 7f2b74eec640 1 -- 172.21.15.63:0/2118056913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d731b0 msgr2=0x55cb7114ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:14.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.366+0000 7f2b74eec640 1 --2- 172.21.15.63:0/2118056913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d731b0 0x55cb7114ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.366+0000 7f2b74eec640 1 -- 172.21.15.63:0/2118056913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d9c070 msgr2=0x55cb7115b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:14.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.366+0000 7f2b74eec640 1 --2- 172.21.15.63:0/2118056913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d9c070 0x55cb7115b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.366+0000 7f2b74eec640 1 -- 172.21.15.63:0/2118056913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb71071c40 con 0x55cb70d7b390 2024-09-21T06:31:14.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.367+0000 7f2b756ed640 1 --2- 172.21.15.63:0/2118056913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d731b0 0x55cb7114ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:14.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.367+0000 7f2b74eec640 1 --2- 172.21.15.63:0/2118056913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d7b390 0x55cb7114f2d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2b600aab80 tx=0x7f2b600b71b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa07e24ccf18a3dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:14.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.367+0000 7f2b58ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:31:14.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.367+0000 7f2b58ff9640 1 -- 172.21.15.63:0/2118056913 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b600ad6e0 con 0x55cb70d7b390 2024-09-21T06:31:14.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.367+0000 7f2b58ff9640 1 -- 172.21.15.63:0/2118056913 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f2b600b34d0 con 0x55cb70d7b390 2024-09-21T06:31:14.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.367+0000 7f2b7dec5740 1 -- 172.21.15.63:0/2118056913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b6801f070 con 0x55cb70d7b390 2024-09-21T06:31:14.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.367+0000 7f2b58ff9640 1 -- 172.21.15.63:0/2118056913 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f2b600ad080 con 0x55cb70d7b390 2024-09-21T06:31:14.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.367+0000 7f2b7dec5740 10 client.16149 fetch_fsmap learned FSMap version 43 2024-09-21T06:31:14.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.367+0000 7f2b7dec5740 1 -- 172.21.15.63:0/2118056913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55cb7115dae0 con 0x55cb70d7b390 2024-09-21T06:31:14.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.367+0000 7f2b58ff9640 1 -- 172.21.15.63:0/2118056913 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b6801f070 con 0x55cb70d7b390 2024-09-21T06:31:14.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.368+0000 7f2b58ff9640 1 -- 172.21.15.63:0/2118056913 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f2b600b36f0 con 0x55cb70d7b390 2024-09-21T06:31:14.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.368+0000 7f2b7dec5740 10 client.16149 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:31:14.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.368+0000 7f2b7dec5740 10 client.16149 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:31:14.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.368+0000 7f2b7dec5740 20 client.16149 populate_metadata read hostname 'smithi063' 2024-09-21T06:31:14.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.368+0000 7f2b7dec5740 1 --2- 172.21.15.63:0/2118056913 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55cb70d5a9f0 0x55cb71161070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:14.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.368+0000 7f2b7dec5740 4 client.16149 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:31:14.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.368+0000 7f2b7dec5740 1 -- 172.21.15.63:0/2118056913 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb710bbda0 con 0x55cb70d5a9f0 2024-09-21T06:31:14.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.368+0000 7f2b756ed640 1 --2- 172.21.15.63:0/2118056913 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55cb70d5a9f0 0x55cb71161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:14.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.368+0000 7f2b58ff9640 10 client.16149 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:31:14.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.368+0000 7f2b756ed640 1 --2- 172.21.15.63:0/2118056913 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55cb70d5a9f0 0x55cb71161070 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37afc92d0cc2ea6d server_cookie=29388fec5c004d72 in_seq=0 out_seq=0 2024-09-21T06:31:14.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.369+0000 7f2b58ff9640 1 -- 172.21.15.63:0/2118056913 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cb710bbda0 con 0x55cb70d5a9f0 2024-09-21T06:31:14.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.369+0000 7f2b58ff9640 10 client.16149 handle_command_reply: tid=0 2024-09-21T06:31:14.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.369+0000 7f2b7dec5740 1 client.16149 shutdown 2024-09-21T06:31:14.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.369+0000 7f2b7dec5740 1 -- 172.21.15.63:0/2118056913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d7b390 msgr2=0x55cb7114f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:14.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.369+0000 7f2b7dec5740 1 --2- 172.21.15.63:0/2118056913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d7b390 0x55cb7114f2d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2b600aab80 tx=0x7f2b600b71b0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.369+0000 7f2b7dec5740 1 -- 172.21.15.63:0/2118056913 shutdown_connections 2024-09-21T06:31:14.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.369+0000 7f2b7dec5740 1 --2- 172.21.15.63:0/2118056913 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55cb70d5a9f0 0x55cb71161070 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.370+0000 7f2b7dec5740 1 --2- 172.21.15.63:0/2118056913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d9c070 0x55cb7115b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.370+0000 7f2b7dec5740 1 --2- 172.21.15.63:0/2118056913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d7b390 0x55cb7114f2d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.370+0000 7f2b7dec5740 1 --2- 172.21.15.63:0/2118056913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d731b0 0x55cb7114ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.370+0000 7f2b7dec5740 1 -- 172.21.15.63:0/2118056913 >> 172.21.15.63:0/2118056913 conn(0x55cb70d90460 msgr2=0x55cb71146830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:14.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.370+0000 7f2b58ff9640 0 client.16149 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:31:14.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.370+0000 7f2b7dec5740 1 -- 172.21.15.63:0/2118056913 shutdown_connections 2024-09-21T06:31:14.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.370+0000 7f2b7dec5740 1 -- 172.21.15.63:0/2118056913 wait complete. 2024-09-21T06:31:14.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.370+0000 7f2b7dec5740 20 client.16149 trim_cache size 0 max 16384 2024-09-21T06:31:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.391+0000 7f2b7dec5740 1 Processor -- start 2024-09-21T06:31:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.391+0000 7f2b7dec5740 1 -- start start 2024-09-21T06:31:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.391+0000 7f2b7dec5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d731b0 0x55cb7114f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.391+0000 7f2b7dec5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d7b390 0x55cb71140e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.391+0000 7f2b7dec5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d9c070 0x55cb7115b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.391+0000 7f2b7dec5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2b701ad510 con 0x55cb70d7b390 2024-09-21T06:31:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.391+0000 7f2b7dec5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2b701af110 con 0x55cb70d731b0 2024-09-21T06:31:14.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.391+0000 7f2b7dec5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2b701adca0 con 0x55cb70d9c070 2024-09-21T06:31:14.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.391+0000 7f2b74eec640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d7b390 0x55cb71140e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:14.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.391+0000 7f2b74eec640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d7b390 0x55cb71140e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46596/0 (socket says 172.21.15.63:46596) 2024-09-21T06:31:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.391+0000 7f2b74eec640 1 -- 172.21.15.63:0/1328710937 learned_addr learned my addr 172.21.15.63:0/1328710937 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.391+0000 7f2b756ed640 1 --2- 172.21.15.63:0/1328710937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d731b0 0x55cb7114f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.391+0000 7f2b75eee640 1 --2- 172.21.15.63:0/1328710937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d9c070 0x55cb7115b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.392+0000 7f2b74eec640 1 -- 172.21.15.63:0/1328710937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d9c070 msgr2=0x55cb7115b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.392+0000 7f2b74eec640 1 --2- 172.21.15.63:0/1328710937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d9c070 0x55cb7115b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.392+0000 7f2b74eec640 1 -- 172.21.15.63:0/1328710937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d731b0 msgr2=0x55cb7114f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.392+0000 7f2b74eec640 1 --2- 172.21.15.63:0/1328710937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d731b0 0x55cb7114f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.392+0000 7f2b74eec640 1 -- 172.21.15.63:0/1328710937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb7114dcf0 con 0x55cb70d7b390 2024-09-21T06:31:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.392+0000 7f2b74eec640 1 --2- 172.21.15.63:0/1328710937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d7b390 0x55cb71140e60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2b600ad610 tx=0x7f2b60010e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97912eac9adc2a60 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.392+0000 7f2b5affd640 1 -- 172.21.15.63:0/1328710937 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b600ad260 con 0x55cb70d7b390 2024-09-21T06:31:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.392+0000 7f2b5affd640 1 -- 172.21.15.63:0/1328710937 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b600ad420 con 0x55cb70d7b390 2024-09-21T06:31:14.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.392+0000 7f2b5affd640 1 -- 172.21.15.63:0/1328710937 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b600aeb90 con 0x55cb70d7b390 2024-09-21T06:31:14.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.393+0000 7f2b7dec5740 1 -- 172.21.15.63:0/1328710937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d7b390 msgr2=0x55cb71140e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:14.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.393+0000 7f2b7dec5740 1 --2- 172.21.15.63:0/1328710937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d7b390 0x55cb71140e60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2b600ad610 tx=0x7f2b60010e30 comp rx=0 tx=0).stop 2024-09-21T06:31:14.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.393+0000 7f2b7dec5740 1 -- 172.21.15.63:0/1328710937 shutdown_connections 2024-09-21T06:31:14.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.393+0000 7f2b7dec5740 1 --2- 172.21.15.63:0/1328710937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d9c070 0x55cb7115b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.393+0000 7f2b7dec5740 1 --2- 172.21.15.63:0/1328710937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d7b390 0x55cb71140e60 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.393+0000 7f2b7dec5740 1 --2- 172.21.15.63:0/1328710937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d731b0 0x55cb7114f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.393+0000 7f2b7dec5740 1 -- 172.21.15.63:0/1328710937 >> 172.21.15.63:0/1328710937 conn(0x55cb70d90460 msgr2=0x55cb7114eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:14.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.393+0000 7f2b7dec5740 1 -- 172.21.15.63:0/1328710937 shutdown_connections 2024-09-21T06:31:14.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.393+0000 7f2b7dec5740 1 -- 172.21.15.63:0/1328710937 wait complete. 2024-09-21T06:31:14.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.394+0000 7f2b7dec5740 1 -- start start 2024-09-21T06:31:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.394+0000 7f2b7dec5740 1 Processor -- start 2024-09-21T06:31:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.394+0000 7f2b7dec5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d731b0 0x55cb71157990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.395+0000 7f2b7dec5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d7b390 0x55cb71152e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.395+0000 7f2b7dec5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d9c070 0x55cb711534e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.395+0000 7f2b7dec5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2b701aea40 con 0x55cb70d9c070 2024-09-21T06:31:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.395+0000 7f2b7dec5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2b701ae370 con 0x55cb70d7b390 2024-09-21T06:31:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.395+0000 7f2b7dec5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2b701ab4f0 con 0x55cb70d731b0 2024-09-21T06:31:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.395+0000 7f2b75eee640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d9c070 0x55cb711534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.395+0000 7f2b7dec5740 10 client.0 _ll_register_callbacks cb 0x7f2b600ec040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:31:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.395+0000 7f2b75eee640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d9c070 0x55cb711534e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46600/0 (socket says 172.21.15.63:46600) 2024-09-21T06:31:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.395+0000 7f2b75eee640 1 -- 172.21.15.63:0/2313859925 learned_addr learned my addr 172.21.15.63:0/2313859925 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.395+0000 7f2b756ed640 1 --2- 172.21.15.63:0/2313859925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d731b0 0x55cb71157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:14.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.395+0000 7f2b74eec640 1 --2- 172.21.15.63:0/2313859925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d7b390 0x55cb71152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:14.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.395+0000 7f2b75eee640 1 -- 172.21.15.63:0/2313859925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d731b0 msgr2=0x55cb71157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:14.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.395+0000 7f2b75eee640 1 --2- 172.21.15.63:0/2313859925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d731b0 0x55cb71157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.395+0000 7f2b75eee640 1 -- 172.21.15.63:0/2313859925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d7b390 msgr2=0x55cb71152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:14.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.395+0000 7f2b75eee640 1 --2- 172.21.15.63:0/2313859925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d7b390 0x55cb71152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.395+0000 7f2b75eee640 1 -- 172.21.15.63:0/2313859925 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb71153c50 con 0x55cb70d9c070 2024-09-21T06:31:14.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.395+0000 7f2b74eec640 1 --2- 172.21.15.63:0/2313859925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d7b390 0x55cb71152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:14.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.395+0000 7f2b75eee640 1 --2- 172.21.15.63:0/2313859925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d9c070 0x55cb711534e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2b68012010 tx=0x7f2b680096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1e2d1951cdd6d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:14.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.395+0000 7f2b58ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:31:14.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.396+0000 7f2b58ff9640 1 -- 172.21.15.63:0/2313859925 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b68005660 con 0x55cb70d9c070 2024-09-21T06:31:14.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.396+0000 7f2b58ff9640 1 -- 172.21.15.63:0/2313859925 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f2b68005800 con 0x55cb70d9c070 2024-09-21T06:31:14.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.396+0000 7f2b7dec5740 1 -- 172.21.15.63:0/2313859925 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b600ad420 con 0x55cb70d9c070 2024-09-21T06:31:14.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.396+0000 7f2b58ff9640 1 -- 172.21.15.63:0/2313859925 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f2b6800b940 con 0x55cb70d9c070 2024-09-21T06:31:14.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.396+0000 7f2b7dec5740 10 client.16155 fetch_fsmap learned FSMap version 43 2024-09-21T06:31:14.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.396+0000 7f2b7dec5740 1 -- 172.21.15.63:0/2313859925 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55cb711cbaa0 con 0x55cb70d9c070 2024-09-21T06:31:14.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.396+0000 7f2b58ff9640 1 -- 172.21.15.63:0/2313859925 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b600ad420 con 0x55cb70d9c070 2024-09-21T06:31:14.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.396+0000 7f2b58ff9640 1 -- 172.21.15.63:0/2313859925 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f2b68038980 con 0x55cb70d9c070 2024-09-21T06:31:14.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.396+0000 7f2b7dec5740 10 client.16155 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:31:14.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.396+0000 7f2b7dec5740 10 client.16155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:31:14.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.396+0000 7f2b7dec5740 20 client.16155 populate_metadata read hostname 'smithi063' 2024-09-21T06:31:14.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.396+0000 7f2b7dec5740 1 --2- 172.21.15.63:0/2313859925 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55cb70d2fda0 0x55cb711ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:14.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.397+0000 7f2b7dec5740 4 client.16155 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:31:14.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.397+0000 7f2b7dec5740 1 -- 172.21.15.63:0/2313859925 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cb710b7850 con 0x55cb70d2fda0 2024-09-21T06:31:14.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.397+0000 7f2b756ed640 1 --2- 172.21.15.63:0/2313859925 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55cb70d2fda0 0x55cb711ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:14.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.397+0000 7f2b58ff9640 10 client.16155 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:31:14.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.397+0000 7f2b756ed640 1 --2- 172.21.15.63:0/2313859925 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55cb70d2fda0 0x55cb711ce130 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a04351874630579a server_cookie=4391a4c90f6dc902 in_seq=0 out_seq=0 2024-09-21T06:31:14.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.397+0000 7f2b58ff9640 1 -- 172.21.15.63:0/2313859925 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x55cb710b7850 con 0x55cb70d2fda0 2024-09-21T06:31:14.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.398+0000 7f2b58ff9640 10 client.16155 handle_command_reply: tid=0 2024-09-21T06:31:14.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.398+0000 7f2b7dec5740 1 client.16155 shutdown 2024-09-21T06:31:14.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.398+0000 7f2b7dec5740 1 -- 172.21.15.63:0/2313859925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d9c070 msgr2=0x55cb711534e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:14.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.398+0000 7f2b7dec5740 1 --2- 172.21.15.63:0/2313859925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d9c070 0x55cb711534e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2b68012010 tx=0x7f2b680096c0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.398+0000 7f2b7dec5740 1 -- 172.21.15.63:0/2313859925 shutdown_connections 2024-09-21T06:31:14.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.398+0000 7f2b7dec5740 1 --2- 172.21.15.63:0/2313859925 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55cb70d2fda0 0x55cb711ce130 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.398+0000 7f2b7dec5740 1 --2- 172.21.15.63:0/2313859925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cb70d9c070 0x55cb711534e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.398+0000 7f2b7dec5740 1 --2- 172.21.15.63:0/2313859925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cb70d7b390 0x55cb71152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.398+0000 7f2b7dec5740 1 --2- 172.21.15.63:0/2313859925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb70d731b0 0x55cb71157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.398+0000 7f2b7dec5740 1 -- 172.21.15.63:0/2313859925 >> 172.21.15.63:0/2313859925 conn(0x55cb70d90460 msgr2=0x55cb71144630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:14.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.398+0000 7f2b58ff9640 0 client.16155 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:31:14.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.398+0000 7f2b7dec5740 1 -- 172.21.15.63:0/2313859925 shutdown_connections 2024-09-21T06:31:14.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.398+0000 7f2b7dec5740 1 -- 172.21.15.63:0/2313859925 wait complete. 2024-09-21T06:31:14.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.398+0000 7f2b7dec5740 20 client.16155 trim_cache size 0 max 16384 2024-09-21T06:31:14.405 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:31:14.405 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "no active scrubs running", 2024-09-21T06:31:14.405 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": {}, 2024-09-21T06:31:14.405 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:31:14.405 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:31:14.405 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:31:14.405 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:31:14.406 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:31:14.406 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:31:14.406 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:31:14.406 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:31:14.406 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:31:14.406 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:31:14.406 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:31:14.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.399+0000 7f2b77951640 1 -- 172.21.15.63:0/2981058419 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2b5c0b6680 msgr2=0x7f2b5c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:14.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.399+0000 7f2b77951640 1 --2- 172.21.15.63:0/2981058419 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2b5c0b6680 0x7f2b5c0b8b90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0096c0 tx=0x7f2b6c032ed0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.399+0000 7f2b77951640 1 -- 172.21.15.63:0/2981058419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b70105340 msgr2=0x7f2b7019aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:14.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.399+0000 7f2b77951640 1 --2- 172.21.15.63:0/2981058419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b70105340 0x7f2b7019aaa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2b7006ad30 tx=0x7f2b6000ee50 comp rx=0 tx=0).stop 2024-09-21T06:31:14.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.399+0000 7f2b77951640 1 -- 172.21.15.63:0/2981058419 shutdown_connections 2024-09-21T06:31:14.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.399+0000 7f2b77951640 1 --2- 172.21.15.63:0/2981058419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b7010de50 0x7f2b7019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.399+0000 7f2b77951640 1 --2- 172.21.15.63:0/2981058419 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2b5c0b6680 0x7f2b5c0b8b90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.399+0000 7f2b77951640 1 --2- 172.21.15.63:0/2981058419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b70105340 0x7f2b7019aaa0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.399+0000 7f2b77951640 1 --2- 172.21.15.63:0/2981058419 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b701049f0 0x7f2b7019a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:14.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.399+0000 7f2b77951640 1 -- 172.21.15.63:0/2981058419 >> 172.21.15.63:0/2981058419 conn(0x7f2b700797e0 msgr2=0x7f2b700ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:14.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.399+0000 7f2b77951640 1 -- 172.21.15.63:0/2981058419 shutdown_connections 2024-09-21T06:31:14.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:14.399+0000 7f2b77951640 1 -- 172.21.15.63:0/2981058419 wait complete. 2024-09-21T06:31:15.568 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:31:15.568 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:31:15.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:15 smithi071 ceph-mon[34844]: pgmap v414: 97 pgs: 97 active+clean; 93 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.8 MiB/s wr, 868 op/s 2024-09-21T06:31:15.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:15 smithi063 ceph-mon[31150]: pgmap v414: 97 pgs: 97 active+clean; 93 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.8 MiB/s wr, 868 op/s 2024-09-21T06:31:15.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:15 smithi175 ceph-mon[34510]: pgmap v414: 97 pgs: 97 active+clean; 93 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.8 MiB/s wr, 868 op/s 2024-09-21T06:31:15.867 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:31:16.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.380+0000 7f43a5292640 1 -- 172.21.15.63:0/1875324498 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43a0105300 msgr2=0x7f43a010d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:16.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.380+0000 7f43a5292640 1 --2- 172.21.15.63:0/1875324498 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43a0105300 0x7f43a010d850 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4388009900 tx=0x7f438802a410 comp rx=0 tx=0).stop 2024-09-21T06:31:16.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.380+0000 7f43a5292640 1 -- 172.21.15.63:0/1875324498 shutdown_connections 2024-09-21T06:31:16.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.380+0000 7f43a5292640 1 --2- 172.21.15.63:0/1875324498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43a010de10 0x7f43a0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:16.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.380+0000 7f43a5292640 1 --2- 172.21.15.63:0/1875324498 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43a0105300 0x7f43a010d850 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:16.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.380+0000 7f43a5292640 1 --2- 172.21.15.63:0/1875324498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43a01049b0 0x7f43a0104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:16.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.380+0000 7f43a5292640 1 -- 172.21.15.63:0/1875324498 >> 172.21.15.63:0/1875324498 conn(0x7f43a0079730 msgr2=0x7f43a0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:16.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.380+0000 7f43a5292640 1 -- 172.21.15.63:0/1875324498 shutdown_connections 2024-09-21T06:31:16.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.381+0000 7f43a5292640 1 -- 172.21.15.63:0/1875324498 wait complete. 2024-09-21T06:31:16.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.381+0000 7f43a5292640 1 Processor -- start 2024-09-21T06:31:16.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.381+0000 7f43a5292640 1 -- start start 2024-09-21T06:31:16.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.382+0000 7f43a5292640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43a01049b0 0x7f43a019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:16.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.382+0000 7f43a5292640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43a0105300 0x7f43a019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:16.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.382+0000 7f43a5292640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43a010de10 0x7f43a019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:16.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.382+0000 7f43a5292640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f43a0113a70 con 0x7f43a0105300 2024-09-21T06:31:16.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.382+0000 7f43a5292640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f43a01138f0 con 0x7f43a010de10 2024-09-21T06:31:16.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.382+0000 7f43a5292640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f43a0113bf0 con 0x7f43a01049b0 2024-09-21T06:31:16.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.382+0000 7f4397fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43a0105300 0x7f43a019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:16.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.382+0000 7f439effd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43a01049b0 0x7f43a019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:16.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.382+0000 7f4397fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43a0105300 0x7f43a019aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46628/0 (socket says 172.21.15.63:46628) 2024-09-21T06:31:16.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.382+0000 7f439f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43a010de10 0x7f43a019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:16.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.382+0000 7f4397fff640 1 -- 172.21.15.63:0/311170400 learned_addr learned my addr 172.21.15.63:0/311170400 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:16.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.382+0000 7f439effd640 1 -- 172.21.15.63:0/311170400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43a010de10 msgr2=0x7f43a019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:16.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.382+0000 7f439effd640 1 --2- 172.21.15.63:0/311170400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43a010de10 0x7f43a019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:16.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.382+0000 7f439effd640 1 -- 172.21.15.63:0/311170400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43a0105300 msgr2=0x7f43a019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:16.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.382+0000 7f439effd640 1 --2- 172.21.15.63:0/311170400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43a0105300 0x7f43a019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:16.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.382+0000 7f439effd640 1 -- 172.21.15.63:0/311170400 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a01a0350 con 0x7f43a01049b0 2024-09-21T06:31:16.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.382+0000 7f4397fff640 1 --2- 172.21.15.63:0/311170400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43a0105300 0x7f43a019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:16.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.382+0000 7f439effd640 1 --2- 172.21.15.63:0/311170400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43a01049b0 0x7f43a019a4a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f439000e9c0 tx=0x7f439000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:16.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.383+0000 7f439cff9640 1 -- 172.21.15.63:0/311170400 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439000ccc0 con 0x7f43a01049b0 2024-09-21T06:31:16.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.383+0000 7f439cff9640 1 -- 172.21.15.63:0/311170400 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43900035f0 con 0x7f43a01049b0 2024-09-21T06:31:16.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.383+0000 7f439cff9640 1 -- 172.21.15.63:0/311170400 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439000ce60 con 0x7f43a01049b0 2024-09-21T06:31:16.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.383+0000 7f43a5292640 1 -- 172.21.15.63:0/311170400 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43a01a0640 con 0x7f43a01049b0 2024-09-21T06:31:16.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.383+0000 7f43a5292640 1 -- 172.21.15.63:0/311170400 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43a01a6e60 con 0x7f43a01049b0 2024-09-21T06:31:16.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.384+0000 7f43a5292640 1 -- 172.21.15.63:0/311170400 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43a0104dc0 con 0x7f43a01049b0 2024-09-21T06:31:16.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.386+0000 7f439cff9640 1 -- 172.21.15.63:0/311170400 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f4390004000 con 0x7f43a01049b0 2024-09-21T06:31:16.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.387+0000 7f439cff9640 1 --2- 172.21.15.63:0/311170400 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f438c0b6730 0x7f438c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:16.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.387+0000 7f4397fff640 1 --2- 172.21.15.63:0/311170400 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f438c0b6730 0x7f438c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:16.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.387+0000 7f439cff9640 1 -- 172.21.15.63:0/311170400 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f43900e7bf0 con 0x7f43a01049b0 2024-09-21T06:31:16.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.387+0000 7f4397fff640 1 --2- 172.21.15.63:0/311170400 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f438c0b6730 0x7f438c0b8c40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f43a007a080 tx=0x7f4388032ed0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:16.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.389+0000 7f439cff9640 1 -- 172.21.15.63:0/311170400 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f43900ae150 con 0x7f43a01049b0 2024-09-21T06:31:16.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.633+0000 7f43a5292640 1 -- 172.21.15.63:0/311170400 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43a019b5d0 con 0x7f43a01049b0 2024-09-21T06:31:16.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.634+0000 7f439cff9640 1 -- 172.21.15.63:0/311170400 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+11978 (secure 0 0 0) 0x7f43900b2530 con 0x7f43a01049b0 2024-09-21T06:31:16.636 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:31:16.636 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":43,"btime":"2024-09-21T06:30:43:391669+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":43,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:30:43.123943+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24659,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":34,"state":"up:active","state_seq":69,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25637":{"gid":25637,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3354670524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3354670524},{"type":"v1","addr":"172.21.15.71:6839","nonce":3354670524}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24659,"qdb_cluster":[24694,24670,24659,24676,14835]},"id":1}]} 2024-09-21T06:31:16.636 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 43 2024-09-21T06:31:16.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.636+0000 7f43a5292640 1 -- 172.21.15.63:0/311170400 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f438c0b6730 msgr2=0x7f438c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:16.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.636+0000 7f43a5292640 1 --2- 172.21.15.63:0/311170400 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f438c0b6730 0x7f438c0b8c40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f43a007a080 tx=0x7f4388032ed0 comp rx=0 tx=0).stop 2024-09-21T06:31:16.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.636+0000 7f43a5292640 1 -- 172.21.15.63:0/311170400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43a01049b0 msgr2=0x7f43a019a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:16.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.636+0000 7f43a5292640 1 --2- 172.21.15.63:0/311170400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43a01049b0 0x7f43a019a4a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f439000e9c0 tx=0x7f439000ee80 comp rx=0 tx=0).stop 2024-09-21T06:31:16.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.636+0000 7f43a5292640 1 -- 172.21.15.63:0/311170400 shutdown_connections 2024-09-21T06:31:16.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.636+0000 7f43a5292640 1 --2- 172.21.15.63:0/311170400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43a010de10 0x7f43a019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:16.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.636+0000 7f43a5292640 1 --2- 172.21.15.63:0/311170400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43a0105300 0x7f43a019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.636+0000 7f43a5292640 1 --2- 172.21.15.63:0/311170400 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f438c0b6730 0x7f438c0b8c40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.636+0000 7f43a5292640 1 --2- 172.21.15.63:0/311170400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43a01049b0 0x7f43a019a4a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.636+0000 7f43a5292640 1 -- 172.21.15.63:0/311170400 >> 172.21.15.63:0/311170400 conn(0x7f43a0079730 msgr2=0x7f43a0100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.636+0000 7f43a5292640 1 -- 172.21.15.63:0/311170400 shutdown_connections 2024-09-21T06:31:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:16.636+0000 7f43a5292640 1 -- 172.21.15.63:0/311170400 wait complete. 2024-09-21T06:31:17.358 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T06:31:17.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:17 smithi063 ceph-mon[31150]: pgmap v415: 97 pgs: 97 active+clean; 98 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.5 MiB/s wr, 751 op/s 2024-09-21T06:31:17.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:17 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/311170400' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:31:17.636 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:31:17.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:17 smithi071 ceph-mon[34844]: pgmap v415: 97 pgs: 97 active+clean; 98 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.5 MiB/s wr, 751 op/s 2024-09-21T06:31:17.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:17 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/311170400' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:31:17.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:17 smithi175 ceph-mon[34510]: pgmap v415: 97 pgs: 97 active+clean; 98 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.5 MiB/s wr, 751 op/s 2024-09-21T06:31:17.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:17 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/311170400' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:31:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.148+0000 7f801296c640 1 -- 172.21.15.63:0/1228094422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f800c105380 msgr2=0x7f800c10d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.148+0000 7f801296c640 1 --2- 172.21.15.63:0/1228094422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f800c105380 0x7f800c10d8d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8000009900 tx=0x7f800002a410 comp rx=0 tx=0).stop 2024-09-21T06:31:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.148+0000 7f801296c640 1 -- 172.21.15.63:0/1228094422 shutdown_connections 2024-09-21T06:31:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.148+0000 7f801296c640 1 --2- 172.21.15.63:0/1228094422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f800c10de60 0x7f800c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.148+0000 7f801296c640 1 --2- 172.21.15.63:0/1228094422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f800c105380 0x7f800c10d8d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.148+0000 7f801296c640 1 --2- 172.21.15.63:0/1228094422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f800c104a30 0x7f800c104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.148+0000 7f801296c640 1 -- 172.21.15.63:0/1228094422 >> 172.21.15.63:0/1228094422 conn(0x7f800c0797b0 msgr2=0x7f800c079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.148+0000 7f801296c640 1 -- 172.21.15.63:0/1228094422 shutdown_connections 2024-09-21T06:31:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.148+0000 7f801296c640 1 -- 172.21.15.63:0/1228094422 wait complete. 2024-09-21T06:31:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.149+0000 7f801296c640 1 Processor -- start 2024-09-21T06:31:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.149+0000 7f801296c640 1 -- start start 2024-09-21T06:31:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.149+0000 7f801296c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f800c104a30 0x7f800c102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.149+0000 7f801296c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f800c105380 0x7f800c102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.149+0000 7f801296c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f800c10de60 0x7f800c1031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.149+0000 7f801296c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f800c113aa0 con 0x7f800c10de60 2024-09-21T06:31:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.149+0000 7f801296c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f800c113920 con 0x7f800c104a30 2024-09-21T06:31:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.149+0000 7f801296c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f800c113c20 con 0x7f800c105380 2024-09-21T06:31:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.150+0000 7f8010f09640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f800c10de60 0x7f800c1031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.150+0000 7f800bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f800c104a30 0x7f800c102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.150+0000 7f800bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f800c104a30 0x7f800c102770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:53410/0 (socket says 172.21.15.63:53410) 2024-09-21T06:31:18.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.150+0000 7f800bfff640 1 -- 172.21.15.63:0/1857959659 learned_addr learned my addr 172.21.15.63:0/1857959659 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:18.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.150+0000 7f800b7fe640 1 --2- 172.21.15.63:0/1857959659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f800c105380 0x7f800c102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:18.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.150+0000 7f800bfff640 1 -- 172.21.15.63:0/1857959659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f800c105380 msgr2=0x7f800c102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:18.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.150+0000 7f800bfff640 1 --2- 172.21.15.63:0/1857959659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f800c105380 0x7f800c102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.150+0000 7f800bfff640 1 -- 172.21.15.63:0/1857959659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f800c10de60 msgr2=0x7f800c1031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:18.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.150+0000 7f800bfff640 1 --2- 172.21.15.63:0/1857959659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f800c10de60 0x7f800c1031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.150+0000 7f800bfff640 1 -- 172.21.15.63:0/1857959659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f800c1a87b0 con 0x7f800c104a30 2024-09-21T06:31:18.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.150+0000 7f8010f09640 1 --2- 172.21.15.63:0/1857959659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f800c10de60 0x7f800c1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:18.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.150+0000 7f800bfff640 1 --2- 172.21.15.63:0/1857959659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f800c104a30 0x7f800c102770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00e9f0 tx=0x7f7ffc00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:18.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.151+0000 7f80097fa640 1 -- 172.21.15.63:0/1857959659 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc00cd80 con 0x7f800c104a30 2024-09-21T06:31:18.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.151+0000 7f80097fa640 1 -- 172.21.15.63:0/1857959659 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ffc0054d0 con 0x7f800c104a30 2024-09-21T06:31:18.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.151+0000 7f801296c640 1 -- 172.21.15.63:0/1857959659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f800c1a8aa0 con 0x7f800c104a30 2024-09-21T06:31:18.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.151+0000 7f80097fa640 1 -- 172.21.15.63:0/1857959659 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc010690 con 0x7f800c104a30 2024-09-21T06:31:18.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.151+0000 7f801296c640 1 -- 172.21.15.63:0/1857959659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f800c1a8fb0 con 0x7f800c104a30 2024-09-21T06:31:18.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.153+0000 7f80097fa640 1 -- 172.21.15.63:0/1857959659 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f7ffc010830 con 0x7f800c104a30 2024-09-21T06:31:18.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.154+0000 7f8018ee0740 1 Processor -- start 2024-09-21T06:31:18.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.154+0000 7f8018ee0740 1 -- start start 2024-09-21T06:31:18.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.154+0000 7f8018ee0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae51402070 0x55ae517a96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:18.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.154+0000 7f8018ee0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae513d91b0 0x55ae517a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:18.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.154+0000 7f8018ee0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513e1390 0x55ae517aa120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:18.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.154+0000 7f8018ee0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ae5171fea0 con 0x55ae513e1390 2024-09-21T06:31:18.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.154+0000 7f8018ee0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ae5170f2d0 con 0x55ae51402070 2024-09-21T06:31:18.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.154+0000 7f8018ee0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ae517130e0 con 0x55ae513d91b0 2024-09-21T06:31:18.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.154+0000 7f8010f09640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae51402070 0x55ae517a96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:18.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.154+0000 7f800bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae513d91b0 0x55ae517a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:18.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.154+0000 7f8010f09640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae51402070 0x55ae517a96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:53412/0 (socket says 172.21.15.63:53412) 2024-09-21T06:31:18.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.154+0000 7f8010f09640 1 -- 172.21.15.63:0/2787123208 learned_addr learned my addr 172.21.15.63:0/2787123208 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:18.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.155+0000 7f800b7fe640 1 --2- 172.21.15.63:0/2787123208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513e1390 0x55ae517aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:18.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.155+0000 7f80097fa640 1 --2- 172.21.15.63:0/1857959659 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7ff40b6700 0x7f7ff40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:18.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.155+0000 7f8010f09640 1 -- 172.21.15.63:0/2787123208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae513d91b0 msgr2=0x55ae517a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:18.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.155+0000 7f8010f09640 1 --2- 172.21.15.63:0/2787123208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae513d91b0 0x55ae517a9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.155+0000 7f8010f09640 1 -- 172.21.15.63:0/2787123208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513e1390 msgr2=0x55ae517aa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:18.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.155+0000 7f8010f09640 1 --2- 172.21.15.63:0/2787123208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513e1390 0x55ae517aa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.155+0000 7f8010f09640 1 -- 172.21.15.63:0/2787123208 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae5146d650 con 0x55ae51402070 2024-09-21T06:31:18.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.155+0000 7f800b7fe640 1 --2- 172.21.15.63:0/2787123208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513e1390 0x55ae517aa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:31:18.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.155+0000 7f80097fa640 1 -- 172.21.15.63:0/1857959659 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f7ffc0e7af0 con 0x7f800c104a30 2024-09-21T06:31:18.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.155+0000 7f8010f09640 1 --2- 172.21.15.63:0/1857959659 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7ff40b6700 0x7f7ff40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:18.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.155+0000 7f8010f09640 1 --2- 172.21.15.63:0/2787123208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae51402070 0x55ae517a96a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8004011790 tx=0x7f8004011c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2015e6d87ba0785 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:18.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.155+0000 7f7ff27fc640 1 -- 172.21.15.63:0/2787123208 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800400f9a0 con 0x55ae51402070 2024-09-21T06:31:18.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.156+0000 7f7ff27fc640 1 -- 172.21.15.63:0/2787123208 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f800400fc80 con 0x55ae51402070 2024-09-21T06:31:18.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.156+0000 7f7ff27fc640 1 -- 172.21.15.63:0/2787123208 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800401cab0 con 0x55ae51402070 2024-09-21T06:31:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.157+0000 7f8018ee0740 1 -- 172.21.15.63:0/2787123208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae51402070 msgr2=0x55ae517a96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.157+0000 7f8010f09640 1 --2- 172.21.15.63:0/1857959659 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7ff40b6700 0x7f7ff40b8c10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8004020000 tx=0x7f8004021000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.157+0000 7f8018ee0740 1 --2- 172.21.15.63:0/2787123208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae51402070 0x55ae517a96a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8004011790 tx=0x7f8004011c50 comp rx=0 tx=0).stop 2024-09-21T06:31:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.157+0000 7f8018ee0740 1 -- 172.21.15.63:0/2787123208 shutdown_connections 2024-09-21T06:31:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.157+0000 7f8018ee0740 1 --2- 172.21.15.63:0/2787123208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513e1390 0x55ae517aa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.157+0000 7f8018ee0740 1 --2- 172.21.15.63:0/2787123208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae513d91b0 0x55ae517a9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.157+0000 7f8018ee0740 1 --2- 172.21.15.63:0/2787123208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae51402070 0x55ae517a96a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.157+0000 7f8018ee0740 1 -- 172.21.15.63:0/2787123208 >> 172.21.15.63:0/2787123208 conn(0x55ae513f6460 msgr2=0x55ae517a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.157+0000 7f8018ee0740 1 -- 172.21.15.63:0/2787123208 shutdown_connections 2024-09-21T06:31:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.157+0000 7f8018ee0740 1 -- 172.21.15.63:0/2787123208 wait complete. 2024-09-21T06:31:18.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.157+0000 7f8018ee0740 1 -- start start 2024-09-21T06:31:18.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.158+0000 7f8018ee0740 1 Processor -- start 2024-09-21T06:31:18.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.158+0000 7f8018ee0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae513d91b0 0x55ae517b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:18.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.158+0000 7f8018ee0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513e1390 0x55ae517b5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:18.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.158+0000 7f8018ee0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae51402070 0x55ae517c1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:18.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.158+0000 7f8018ee0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ae51570700 con 0x55ae513e1390 2024-09-21T06:31:18.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.158+0000 7f8018ee0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ae516aa160 con 0x55ae513d91b0 2024-09-21T06:31:18.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.158+0000 7f8018ee0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ae517b7e80 con 0x55ae51402070 2024-09-21T06:31:18.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.158+0000 7f800b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513e1390 0x55ae517b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:18.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.158+0000 7f800bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae513d91b0 0x55ae517b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:18.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.158+0000 7f800bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae513d91b0 0x55ae517b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:53426/0 (socket says 172.21.15.63:53426) 2024-09-21T06:31:18.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.158+0000 7f800b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513e1390 0x55ae517b5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47812/0 (socket says 172.21.15.63:47812) 2024-09-21T06:31:18.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.158+0000 7f800bfff640 1 -- 172.21.15.63:0/3196334976 learned_addr learned my addr 172.21.15.63:0/3196334976 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:18.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.158+0000 7f8010f09640 1 --2- 172.21.15.63:0/3196334976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae51402070 0x55ae517c1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:18.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.159+0000 7f8018ee0740 10 client.0 _ll_register_callbacks cb 0x55ae516c39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:31:18.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.159+0000 7f800b7fe640 1 -- 172.21.15.63:0/3196334976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae51402070 msgr2=0x55ae517c1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:18.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.159+0000 7f800b7fe640 1 --2- 172.21.15.63:0/3196334976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae51402070 0x55ae517c1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.159+0000 7f800b7fe640 1 -- 172.21.15.63:0/3196334976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae513d91b0 msgr2=0x55ae517b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:18.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.159+0000 7f800b7fe640 1 --2- 172.21.15.63:0/3196334976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae513d91b0 0x55ae517b4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.159+0000 7f800b7fe640 1 -- 172.21.15.63:0/3196334976 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae516d7c90 con 0x55ae513e1390 2024-09-21T06:31:18.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.159+0000 7f8018ee0740 1 -- 172.21.15.63:0/3196334976 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f800400fc80 con 0x55ae513e1390 2024-09-21T06:31:18.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.159+0000 7f800b7fe640 1 --2- 172.21.15.63:0/3196334976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513e1390 0x55ae517b5280 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f800002a930 tx=0x7f8000032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd2b7a2b2e240d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:18.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.159+0000 7f7feb7fe640 10 client.16173 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:31:18.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.159+0000 7f7feb7fe640 1 -- 172.21.15.63:0/3196334976 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000035040 con 0x55ae513e1390 2024-09-21T06:31:18.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.159+0000 7f7feb7fe640 1 -- 172.21.15.63:0/3196334976 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f80000316a0 con 0x55ae513e1390 2024-09-21T06:31:18.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.160+0000 7f7feb7fe640 1 -- 172.21.15.63:0/3196334976 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f80000318c0 con 0x55ae513e1390 2024-09-21T06:31:18.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.160+0000 7f8018ee0740 10 client.16173 fetch_fsmap learned FSMap version 43 2024-09-21T06:31:18.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.160+0000 7f8018ee0740 1 -- 172.21.15.63:0/3196334976 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({fsmap=43}) -- 0x55ae517c3a50 con 0x55ae513e1390 2024-09-21T06:31:18.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.160+0000 7f7feb7fe640 1 -- 172.21.15.63:0/3196334976 <== mon.0 v2:172.21.15.63:3300/0 4 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f8000004040 con 0x55ae513e1390 2024-09-21T06:31:18.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.160+0000 7f8018ee0740 10 client.16173 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:31:18.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.160+0000 7f8018ee0740 10 client.16173 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:31:18.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.160+0000 7f8018ee0740 20 client.16173 populate_metadata read hostname 'smithi063' 2024-09-21T06:31:18.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.160+0000 7f8018ee0740 1 --2- 172.21.15.63:0/3196334976 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55ae513c09f0 0x55ae517c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:18.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.160+0000 7f8018ee0740 4 client.16173 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:31:18.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.160+0000 7f8018ee0740 1 -- 172.21.15.63:0/3196334976 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae51721df0 con 0x55ae513c09f0 2024-09-21T06:31:18.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.160+0000 7f800bfff640 1 --2- 172.21.15.63:0/3196334976 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55ae513c09f0 0x55ae517c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:18.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.161+0000 7f800bfff640 1 --2- 172.21.15.63:0/3196334976 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55ae513c09f0 0x55ae517c6f60 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d3a48177dbd13e45 server_cookie=efd4768e8c18f8d5 in_seq=0 out_seq=0 2024-09-21T06:31:18.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.161+0000 7f7feb7fe640 10 client.16173 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:31:18.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.161+0000 7f7feb7fe640 1 -- 172.21.15.63:0/3196334976 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ae51721df0 con 0x55ae513c09f0 2024-09-21T06:31:18.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.161+0000 7f7feb7fe640 10 client.16173 handle_command_reply: tid=0 2024-09-21T06:31:18.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.161+0000 7f8018ee0740 1 client.16173 shutdown 2024-09-21T06:31:18.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.161+0000 7f8018ee0740 1 -- 172.21.15.63:0/3196334976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513e1390 msgr2=0x55ae517b5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:18.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.161+0000 7f8018ee0740 1 --2- 172.21.15.63:0/3196334976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513e1390 0x55ae517b5280 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f800002a930 tx=0x7f8000032d50 comp rx=0 tx=0).stop 2024-09-21T06:31:18.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.161+0000 7f8018ee0740 1 -- 172.21.15.63:0/3196334976 shutdown_connections 2024-09-21T06:31:18.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.161+0000 7f8018ee0740 1 --2- 172.21.15.63:0/3196334976 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55ae513c09f0 0x55ae517c6f60 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.161+0000 7f8018ee0740 1 --2- 172.21.15.63:0/3196334976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae51402070 0x55ae517c1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.161+0000 7f7feb7fe640 0 client.16173 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:31:18.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.162+0000 7f8018ee0740 1 --2- 172.21.15.63:0/3196334976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513e1390 0x55ae517b5280 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.162+0000 7f8018ee0740 1 --2- 172.21.15.63:0/3196334976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae513d91b0 0x55ae517b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.162+0000 7f8018ee0740 1 -- 172.21.15.63:0/3196334976 >> 172.21.15.63:0/3196334976 conn(0x55ae513f6460 msgr2=0x55ae517ac880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:18.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.162+0000 7f8018ee0740 1 -- 172.21.15.63:0/3196334976 shutdown_connections 2024-09-21T06:31:18.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.162+0000 7f8018ee0740 1 -- 172.21.15.63:0/3196334976 wait complete. 2024-09-21T06:31:18.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.162+0000 7f8018ee0740 20 client.16173 trim_cache size 0 max 16384 2024-09-21T06:31:18.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.176+0000 7f8018ee0740 1 Processor -- start 2024-09-21T06:31:18.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.176+0000 7f8018ee0740 1 -- start start 2024-09-21T06:31:18.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.176+0000 7f8018ee0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae513c09f0 0x55ae517ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:18.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.176+0000 7f8018ee0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513d91b0 0x55ae517b6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:18.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.176+0000 7f8018ee0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae513e1390 0x55ae517a6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:18.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.176+0000 7f8018ee0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f800c1ad4e0 con 0x55ae513d91b0 2024-09-21T06:31:18.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.176+0000 7f8018ee0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f800c1af0e0 con 0x55ae513c09f0 2024-09-21T06:31:18.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.176+0000 7f8018ee0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f800c1adc70 con 0x55ae513e1390 2024-09-21T06:31:18.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.176+0000 7f800b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513d91b0 0x55ae517b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:18.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.176+0000 7f800b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513d91b0 0x55ae517b6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47828/0 (socket says 172.21.15.63:47828) 2024-09-21T06:31:18.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.176+0000 7f800b7fe640 1 -- 172.21.15.63:0/2827097659 learned_addr learned my addr 172.21.15.63:0/2827097659 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:18.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.176+0000 7f800bfff640 1 --2- 172.21.15.63:0/2827097659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae513c09f0 0x55ae517ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:18.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.176+0000 7f8010f09640 1 --2- 172.21.15.63:0/2827097659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae513e1390 0x55ae517a6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:18.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.177+0000 7f800b7fe640 1 -- 172.21.15.63:0/2827097659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae513e1390 msgr2=0x55ae517a6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:18.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.177+0000 7f800b7fe640 1 --2- 172.21.15.63:0/2827097659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae513e1390 0x55ae517a6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.177+0000 7f800b7fe640 1 -- 172.21.15.63:0/2827097659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae513c09f0 msgr2=0x55ae517ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:18.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.177+0000 7f800b7fe640 1 --2- 172.21.15.63:0/2827097659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae513c09f0 0x55ae517ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.177+0000 7f800b7fe640 1 -- 172.21.15.63:0/2827097659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae517ab990 con 0x55ae513d91b0 2024-09-21T06:31:18.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.177+0000 7f800bfff640 1 --2- 172.21.15.63:0/2827097659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae513c09f0 0x55ae517ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:18.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.177+0000 7f800b7fe640 1 --2- 172.21.15.63:0/2827097659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513d91b0 0x55ae517b6970 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8000009230 tx=0x7f800003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe18eb1633844ec8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:18.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.177+0000 7f7ff1ffb640 1 -- 172.21.15.63:0/2827097659 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000035030 con 0x55ae513d91b0 2024-09-21T06:31:18.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.177+0000 7f7ff1ffb640 1 -- 172.21.15.63:0/2827097659 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f800400fc80 con 0x55ae513d91b0 2024-09-21T06:31:18.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.177+0000 7f7ff1ffb640 1 -- 172.21.15.63:0/2827097659 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000004920 con 0x55ae513d91b0 2024-09-21T06:31:18.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.178+0000 7f8018ee0740 1 -- 172.21.15.63:0/2827097659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513d91b0 msgr2=0x55ae517b6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:18.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.178+0000 7f8018ee0740 1 --2- 172.21.15.63:0/2827097659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513d91b0 0x55ae517b6970 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8000009230 tx=0x7f800003e000 comp rx=0 tx=0).stop 2024-09-21T06:31:18.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.178+0000 7f8018ee0740 1 -- 172.21.15.63:0/2827097659 shutdown_connections 2024-09-21T06:31:18.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.178+0000 7f8018ee0740 1 --2- 172.21.15.63:0/2827097659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae513e1390 0x55ae517a6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.178+0000 7f8018ee0740 1 --2- 172.21.15.63:0/2827097659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513d91b0 0x55ae517b6970 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.178+0000 7f8018ee0740 1 --2- 172.21.15.63:0/2827097659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae513c09f0 0x55ae517ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.178+0000 7f8018ee0740 1 -- 172.21.15.63:0/2827097659 >> 172.21.15.63:0/2827097659 conn(0x55ae513f6460 msgr2=0x55ae517b6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:18.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.179+0000 7f8018ee0740 1 -- 172.21.15.63:0/2827097659 shutdown_connections 2024-09-21T06:31:18.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.179+0000 7f8018ee0740 1 -- 172.21.15.63:0/2827097659 wait complete. 2024-09-21T06:31:18.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.179+0000 7f8018ee0740 1 -- start start 2024-09-21T06:31:18.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.179+0000 7f8018ee0740 1 Processor -- start 2024-09-21T06:31:18.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.179+0000 7f8018ee0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae513c09f0 0x55ae517bdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:18.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.179+0000 7f8018ee0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae513d91b0 0x55ae517b8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:18.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.179+0000 7f8018ee0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513e1390 0x55ae517b96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:18.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f8018ee0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f800c1aea10 con 0x55ae513e1390 2024-09-21T06:31:18.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f8018ee0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f800c1ae340 con 0x55ae513d91b0 2024-09-21T06:31:18.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f8018ee0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f800c1ab4c0 con 0x55ae513c09f0 2024-09-21T06:31:18.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f8018ee0740 10 client.0 _ll_register_callbacks cb 0x7f7ffc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:31:18.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f800b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae513d91b0 0x55ae517b8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:18.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f800bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae513c09f0 0x55ae517bdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:18.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f8010f09640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513e1390 0x55ae517b96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:18.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f800b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae513d91b0 0x55ae517b8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:53452/0 (socket says 172.21.15.63:53452) 2024-09-21T06:31:18.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f800b7fe640 1 -- 172.21.15.63:0/4186446268 learned_addr learned my addr 172.21.15.63:0/4186446268 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:18.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f800bfff640 1 -- 172.21.15.63:0/4186446268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae513d91b0 msgr2=0x55ae517b8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:18.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f800bfff640 1 --2- 172.21.15.63:0/4186446268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae513d91b0 0x55ae517b8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f800bfff640 1 -- 172.21.15.63:0/4186446268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513e1390 msgr2=0x55ae517b96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:18.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f800bfff640 1 --2- 172.21.15.63:0/4186446268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513e1390 0x55ae517b96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f800bfff640 1 -- 172.21.15.63:0/4186446268 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae51830920 con 0x55ae513c09f0 2024-09-21T06:31:18.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f800b7fe640 1 --2- 172.21.15.63:0/4186446268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae513d91b0 0x55ae517b8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:18.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f8010f09640 1 --2- 172.21.15.63:0/4186446268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513e1390 0x55ae517b96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:18.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f800bfff640 1 --2- 172.21.15.63:0/4186446268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae513c09f0 0x55ae517bdaa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00c6a0 tx=0x7f7ffc014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7577705c13074f54 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:18.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f7feb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:31:18.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f7feb7fe640 1 -- 172.21.15.63:0/4186446268 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc0b2020 con 0x55ae513c09f0 2024-09-21T06:31:18.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f7feb7fe640 1 -- 172.21.15.63:0/4186446268 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f7ffc0a9b90 con 0x55ae513c09f0 2024-09-21T06:31:18.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.180+0000 7f8018ee0740 1 -- 172.21.15.63:0/4186446268 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f800400fc80 con 0x55ae513c09f0 2024-09-21T06:31:18.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.181+0000 7f7feb7fe640 1 -- 172.21.15.63:0/4186446268 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f7ffc0ad090 con 0x55ae513c09f0 2024-09-21T06:31:18.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.181+0000 7f8018ee0740 10 client.25888 fetch_fsmap learned FSMap version 43 2024-09-21T06:31:18.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.181+0000 7f8018ee0740 1 -- 172.21.15.63:0/4186446268 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55ae51831ab0 con 0x55ae513c09f0 2024-09-21T06:31:18.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.181+0000 7f7feb7fe640 1 -- 172.21.15.63:0/4186446268 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f800400fc80 con 0x55ae513c09f0 2024-09-21T06:31:18.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.181+0000 7f7feb7fe640 1 -- 172.21.15.63:0/4186446268 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f7ffc010b20 con 0x55ae513c09f0 2024-09-21T06:31:18.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.181+0000 7f8018ee0740 10 client.25888 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:31:18.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.181+0000 7f8018ee0740 10 client.25888 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:31:18.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.181+0000 7f8018ee0740 20 client.25888 populate_metadata read hostname 'smithi063' 2024-09-21T06:31:18.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.181+0000 7f8018ee0740 1 --2- 172.21.15.63:0/4186446268 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55ae51402070 0x55ae51834240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:18.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.181+0000 7f8018ee0740 4 client.25888 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:31:18.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.181+0000 7f8018ee0740 1 -- 172.21.15.63:0/4186446268 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ae5171d8a0 con 0x55ae51402070 2024-09-21T06:31:18.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.181+0000 7f800b7fe640 1 --2- 172.21.15.63:0/4186446268 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55ae51402070 0x55ae51834240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:18.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.182+0000 7f7feb7fe640 10 client.25888 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:31:18.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.182+0000 7f800b7fe640 1 --2- 172.21.15.63:0/4186446268 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55ae51402070 0x55ae51834240 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=45f894c66dfde340 server_cookie=c3c771fba6fdfe82 in_seq=0 out_seq=0 2024-09-21T06:31:18.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.182+0000 7f7feb7fe640 1 -- 172.21.15.63:0/4186446268 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ae5171d8a0 con 0x55ae51402070 2024-09-21T06:31:18.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.182+0000 7f7feb7fe640 10 client.25888 handle_command_reply: tid=0 2024-09-21T06:31:18.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.182+0000 7f8018ee0740 1 client.25888 shutdown 2024-09-21T06:31:18.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.182+0000 7f8018ee0740 1 -- 172.21.15.63:0/4186446268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae513c09f0 msgr2=0x55ae517bdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:18.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.182+0000 7f8018ee0740 1 --2- 172.21.15.63:0/4186446268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae513c09f0 0x55ae517bdaa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00c6a0 tx=0x7f7ffc014000 comp rx=0 tx=0).stop 2024-09-21T06:31:18.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.182+0000 7f8018ee0740 1 -- 172.21.15.63:0/4186446268 shutdown_connections 2024-09-21T06:31:18.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.182+0000 7f8018ee0740 1 --2- 172.21.15.63:0/4186446268 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55ae51402070 0x55ae51834240 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.182+0000 7f8018ee0740 1 --2- 172.21.15.63:0/4186446268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ae513e1390 0x55ae517b96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.182+0000 7f8018ee0740 1 --2- 172.21.15.63:0/4186446268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae513d91b0 0x55ae517b8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.182+0000 7f8018ee0740 1 --2- 172.21.15.63:0/4186446268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae513c09f0 0x55ae517bdaa0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.182+0000 7f7feb7fe640 0 client.25888 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:31:18.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.182+0000 7f8018ee0740 1 -- 172.21.15.63:0/4186446268 >> 172.21.15.63:0/4186446268 conn(0x55ae513f6460 msgr2=0x55ae517aae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:18.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.182+0000 7f8018ee0740 1 -- 172.21.15.63:0/4186446268 shutdown_connections 2024-09-21T06:31:18.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.182+0000 7f8018ee0740 1 -- 172.21.15.63:0/4186446268 wait complete. 2024-09-21T06:31:18.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.183+0000 7f8018ee0740 20 client.25888 trim_cache size 0 max 16384 2024-09-21T06:31:18.189 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:31:18.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.183+0000 7f801296c640 1 -- 172.21.15.63:0/1857959659 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7ff40b6700 msgr2=0x7f7ff40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:18.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.183+0000 7f801296c640 1 --2- 172.21.15.63:0/1857959659 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7ff40b6700 0x7f7ff40b8c10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8004020000 tx=0x7f8004021000 comp rx=0 tx=0).stop 2024-09-21T06:31:18.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.183+0000 7f801296c640 1 -- 172.21.15.63:0/1857959659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f800c104a30 msgr2=0x7f800c102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:18.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.183+0000 7f801296c640 1 --2- 172.21.15.63:0/1857959659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f800c104a30 0x7f800c102770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00e9f0 tx=0x7f7ffc00edf0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.183+0000 7f801296c640 1 -- 172.21.15.63:0/1857959659 shutdown_connections 2024-09-21T06:31:18.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.183+0000 7f801296c640 1 --2- 172.21.15.63:0/1857959659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f800c10de60 0x7f800c1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.183+0000 7f801296c640 1 --2- 172.21.15.63:0/1857959659 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7ff40b6700 0x7f7ff40b8c10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.183+0000 7f801296c640 1 --2- 172.21.15.63:0/1857959659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f800c105380 0x7f800c102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.183+0000 7f801296c640 1 --2- 172.21.15.63:0/1857959659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f800c104a30 0x7f800c102770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:18.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.183+0000 7f801296c640 1 -- 172.21.15.63:0/1857959659 >> 172.21.15.63:0/1857959659 conn(0x7f800c0797b0 msgr2=0x7f800c0ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:18.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.183+0000 7f801296c640 1 -- 172.21.15.63:0/1857959659 shutdown_connections 2024-09-21T06:31:18.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:18.183+0000 7f801296c640 1 -- 172.21.15.63:0/1857959659 wait complete. 2024-09-21T06:31:18.886 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:31:19.117 INFO:tasks.workunit.client.0.smithi063.stdout:30000 trunc from 0x7bb2f to 0xcdf83 2024-09-21T06:31:19.166 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:31:19.564 INFO:tasks.workunit.client.0.smithi063.stdout:copying to largest ever: 0xffcdd 2024-09-21T06:31:19.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:19 smithi063 ceph-mon[31150]: pgmap v416: 97 pgs: 97 active+clean; 98 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.2 MiB/s wr, 700 op/s 2024-09-21T06:31:19.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.686+0000 7f816519a640 1 -- 172.21.15.63:0/1745924445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8160103bc0 msgr2=0x7f8160103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:19.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.686+0000 7f816519a640 1 --2- 172.21.15.63:0/1745924445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8160103bc0 0x7f8160103fd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8150009900 tx=0x7f815002a410 comp rx=0 tx=0).stop 2024-09-21T06:31:19.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.686+0000 7f816519a640 1 -- 172.21.15.63:0/1745924445 shutdown_connections 2024-09-21T06:31:19.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.686+0000 7f816519a640 1 --2- 172.21.15.63:0/1745924445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8160109e00 0x7f8160110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.686+0000 7f816519a640 1 --2- 172.21.15.63:0/1745924445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81601094b0 0x7f81601098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.686+0000 7f816519a640 1 --2- 172.21.15.63:0/1745924445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8160103bc0 0x7f8160103fd0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.686+0000 7f816519a640 1 -- 172.21.15.63:0/1745924445 >> 172.21.15.63:0/1745924445 conn(0x7f816007b910 msgr2=0x7f816007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:19.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.686+0000 7f816519a640 1 -- 172.21.15.63:0/1745924445 shutdown_connections 2024-09-21T06:31:19.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.686+0000 7f816519a640 1 -- 172.21.15.63:0/1745924445 wait complete. 2024-09-21T06:31:19.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.687+0000 7f816519a640 1 Processor -- start 2024-09-21T06:31:19.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.688+0000 7f816519a640 1 -- start start 2024-09-21T06:31:19.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.688+0000 7f816519a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8160103bc0 0x7f816019c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:19.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.688+0000 7f816519a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81601094b0 0x7f816019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:19.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.688+0000 7f816519a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8160109e00 0x7f81601a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:19.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.688+0000 7f816519a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8160113ac0 con 0x7f81601094b0 2024-09-21T06:31:19.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.688+0000 7f816519a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8160113940 con 0x7f8160109e00 2024-09-21T06:31:19.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.688+0000 7f816519a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8160113c40 con 0x7f8160103bc0 2024-09-21T06:31:19.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.688+0000 7f815e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81601094b0 0x7f816019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:19.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.688+0000 7f815e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81601094b0 0x7f816019ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47842/0 (socket says 172.21.15.63:47842) 2024-09-21T06:31:19.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.688+0000 7f815e59c640 1 -- 172.21.15.63:0/2606905700 learned_addr learned my addr 172.21.15.63:0/2606905700 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:19.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.688+0000 7f815f59e640 1 --2- 172.21.15.63:0/2606905700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8160109e00 0x7f81601a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:19.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.688+0000 7f815ed9d640 1 --2- 172.21.15.63:0/2606905700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8160103bc0 0x7f816019c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:19.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.688+0000 7f815e59c640 1 -- 172.21.15.63:0/2606905700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8160103bc0 msgr2=0x7f816019c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:19.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.688+0000 7f815e59c640 1 --2- 172.21.15.63:0/2606905700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8160103bc0 0x7f816019c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.688+0000 7f815e59c640 1 -- 172.21.15.63:0/2606905700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8160109e00 msgr2=0x7f81601a1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:19.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.688+0000 7f815e59c640 1 --2- 172.21.15.63:0/2606905700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8160109e00 0x7f81601a1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.688+0000 7f815e59c640 1 -- 172.21.15.63:0/2606905700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81601a2680 con 0x7f81601094b0 2024-09-21T06:31:19.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.688+0000 7f815ed9d640 1 --2- 172.21.15.63:0/2606905700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8160103bc0 0x7f816019c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:19.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.688+0000 7f815f59e640 1 --2- 172.21.15.63:0/2606905700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8160109e00 0x7f81601a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:19.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.689+0000 7f815e59c640 1 --2- 172.21.15.63:0/2606905700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81601094b0 0x7f816019ccb0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f815400d950 tx=0x7f815400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:19.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.689+0000 7f8147fff640 1 -- 172.21.15.63:0/2606905700 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8154017070 con 0x7f81601094b0 2024-09-21T06:31:19.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.689+0000 7f8147fff640 1 -- 172.21.15.63:0/2606905700 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8154009c30 con 0x7f81601094b0 2024-09-21T06:31:19.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.689+0000 7f8147fff640 1 -- 172.21.15.63:0/2606905700 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81540047a0 con 0x7f81601094b0 2024-09-21T06:31:19.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.689+0000 7f816519a640 1 -- 172.21.15.63:0/2606905700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81601a2970 con 0x7f81601094b0 2024-09-21T06:31:19.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.689+0000 7f816519a640 1 -- 172.21.15.63:0/2606905700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81601a90d0 con 0x7f81601094b0 2024-09-21T06:31:19.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.692+0000 7f816b70e740 1 Processor -- start 2024-09-21T06:31:19.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.692+0000 7f816b70e740 1 -- start start 2024-09-21T06:31:19.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.692+0000 7f8147fff640 1 -- 172.21.15.63:0/2606905700 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f8154004020 con 0x7f81601094b0 2024-09-21T06:31:19.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.692+0000 7f816b70e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4069b7070 0x55a406d5e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:19.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.692+0000 7f816b70e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a40698e1b0 0x55a406d5ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:19.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.692+0000 7f816b70e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a406996390 0x55a406d5f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:19.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.692+0000 7f816b70e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a406cd4ea0 con 0x55a40698e1b0 2024-09-21T06:31:19.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.692+0000 7f816b70e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a406cc42d0 con 0x55a406996390 2024-09-21T06:31:19.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.692+0000 7f816b70e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a406cc80e0 con 0x55a4069b7070 2024-09-21T06:31:19.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.692+0000 7f815f59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4069b7070 0x55a406d5e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:19.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.692+0000 7f815ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a40698e1b0 0x55a406d5ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:19.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.692+0000 7f815f59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4069b7070 0x55a406d5e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:44920/0 (socket says 172.21.15.63:44920) 2024-09-21T06:31:19.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.692+0000 7f815f59e640 1 -- 172.21.15.63:0/1374460182 learned_addr learned my addr 172.21.15.63:0/1374460182 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:19.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.692+0000 7f815e59c640 1 --2- 172.21.15.63:0/1374460182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a406996390 0x55a406d5f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:19.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.693+0000 7f815f59e640 1 -- 172.21.15.63:0/1374460182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a406996390 msgr2=0x55a406d5f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:19.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.693+0000 7f815f59e640 1 --2- 172.21.15.63:0/1374460182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a406996390 0x55a406d5f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.693+0000 7f815f59e640 1 -- 172.21.15.63:0/1374460182 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a40698e1b0 msgr2=0x55a406d5ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:19.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.693+0000 7f815f59e640 1 --2- 172.21.15.63:0/1374460182 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a40698e1b0 0x55a406d5ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.693+0000 7f815f59e640 1 -- 172.21.15.63:0/1374460182 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a406a22650 con 0x55a4069b7070 2024-09-21T06:31:19.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.693+0000 7f815f59e640 1 --2- 172.21.15.63:0/1374460182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4069b7070 0x55a406d5e6a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8158011790 tx=0x7f8158011c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e3d168a6032ba63 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:19.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.693+0000 7f81457fa640 1 -- 172.21.15.63:0/1374460182 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8158003c30 con 0x55a4069b7070 2024-09-21T06:31:19.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.693+0000 7f81457fa640 1 -- 172.21.15.63:0/1374460182 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f815800fe50 con 0x55a4069b7070 2024-09-21T06:31:19.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.693+0000 7f81457fa640 1 -- 172.21.15.63:0/1374460182 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81580193e0 con 0x55a4069b7070 2024-09-21T06:31:19.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.694+0000 7f8147fff640 1 --2- 172.21.15.63:0/2606905700 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f81480b6700 0x7f81480b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:19.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.694+0000 7f815ed9d640 1 --2- 172.21.15.63:0/2606905700 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f81480b6700 0x7f81480b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:19.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.694+0000 7f8147fff640 1 -- 172.21.15.63:0/2606905700 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f81540e72d0 con 0x7f81601094b0 2024-09-21T06:31:19.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.694+0000 7f816b70e740 1 -- 172.21.15.63:0/1374460182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4069b7070 msgr2=0x55a406d5e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:19.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.694+0000 7f816b70e740 1 --2- 172.21.15.63:0/1374460182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4069b7070 0x55a406d5e6a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8158011790 tx=0x7f8158011c50 comp rx=0 tx=0).stop 2024-09-21T06:31:19.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.694+0000 7f815ed9d640 1 --2- 172.21.15.63:0/2606905700 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f81480b6700 0x7f81480b8c10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8150031440 tx=0x7f8150032ed0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:19.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.694+0000 7f816b70e740 1 -- 172.21.15.63:0/1374460182 shutdown_connections 2024-09-21T06:31:19.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.694+0000 7f816b70e740 1 --2- 172.21.15.63:0/1374460182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a406996390 0x55a406d5f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.694+0000 7f816b70e740 1 --2- 172.21.15.63:0/1374460182 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a40698e1b0 0x55a406d5ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.694+0000 7f816b70e740 1 --2- 172.21.15.63:0/1374460182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4069b7070 0x55a406d5e6a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.694+0000 7f816b70e740 1 -- 172.21.15.63:0/1374460182 >> 172.21.15.63:0/1374460182 conn(0x55a4069ab460 msgr2=0x55a406d5c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:19.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.695+0000 7f816b70e740 1 -- 172.21.15.63:0/1374460182 shutdown_connections 2024-09-21T06:31:19.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.695+0000 7f816b70e740 1 -- 172.21.15.63:0/1374460182 wait complete. 2024-09-21T06:31:19.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.695+0000 7f816b70e740 1 -- start start 2024-09-21T06:31:19.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.695+0000 7f816b70e740 1 Processor -- start 2024-09-21T06:31:19.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.695+0000 7f816b70e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40698e1b0 0x55a406d69cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:19.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.695+0000 7f816b70e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a406996390 0x55a406d6a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:19.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.695+0000 7f816b70e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4069b7070 0x55a406d76170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:19.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.695+0000 7f816b70e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a406b25700 con 0x55a406996390 2024-09-21T06:31:19.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.695+0000 7f816b70e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a406c5f160 con 0x55a40698e1b0 2024-09-21T06:31:19.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.695+0000 7f816b70e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a406d6ce80 con 0x55a4069b7070 2024-09-21T06:31:19.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.696+0000 7f816b70e740 10 client.0 _ll_register_callbacks cb 0x55a406c789e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:31:19.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.696+0000 7f815ed9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40698e1b0 0x55a406d69cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:19.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.696+0000 7f815ed9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40698e1b0 0x55a406d69cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:53476/0 (socket says 172.21.15.63:53476) 2024-09-21T06:31:19.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.696+0000 7f815ed9d640 1 -- 172.21.15.63:0/1903373608 learned_addr learned my addr 172.21.15.63:0/1903373608 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:19.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.696+0000 7f815e59c640 1 --2- 172.21.15.63:0/1903373608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a406996390 0x55a406d6a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:19.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.696+0000 7f815f59e640 1 --2- 172.21.15.63:0/1903373608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4069b7070 0x55a406d76170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:19.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.696+0000 7f815ed9d640 1 -- 172.21.15.63:0/1903373608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4069b7070 msgr2=0x55a406d76170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:19.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.696+0000 7f815ed9d640 1 --2- 172.21.15.63:0/1903373608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4069b7070 0x55a406d76170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.696+0000 7f815ed9d640 1 -- 172.21.15.63:0/1903373608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a406996390 msgr2=0x55a406d6a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:19.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.696+0000 7f815ed9d640 1 --2- 172.21.15.63:0/1903373608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a406996390 0x55a406d6a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.696+0000 7f815ed9d640 1 -- 172.21.15.63:0/1903373608 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a406c8cc90 con 0x55a40698e1b0 2024-09-21T06:31:19.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.696+0000 7f815ed9d640 1 --2- 172.21.15.63:0/1903373608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40698e1b0 0x55a406d69cf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8150033000 tx=0x7f8150009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9c4b1a8b9c85621 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:19.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.696+0000 7f8142ff5640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:31:19.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.696+0000 7f8142ff5640 1 -- 172.21.15.63:0/1903373608 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815004d070 con 0x55a40698e1b0 2024-09-21T06:31:19.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.697+0000 7f8142ff5640 1 -- 172.21.15.63:0/1903373608 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f8150004250 con 0x55a40698e1b0 2024-09-21T06:31:19.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.697+0000 7f816b70e740 1 -- 172.21.15.63:0/1903373608 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f815800fe50 con 0x55a40698e1b0 2024-09-21T06:31:19.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.697+0000 7f8142ff5640 1 -- 172.21.15.63:0/1903373608 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f8150059050 con 0x55a40698e1b0 2024-09-21T06:31:19.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.697+0000 7f816b70e740 10 client.25835 fetch_fsmap learned FSMap version 43 2024-09-21T06:31:19.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.697+0000 7f816b70e740 1 -- 172.21.15.63:0/1903373608 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55a406d78b30 con 0x55a40698e1b0 2024-09-21T06:31:19.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.697+0000 7f8142ff5640 1 -- 172.21.15.63:0/1903373608 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f815800fe50 con 0x55a40698e1b0 2024-09-21T06:31:19.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.697+0000 7f8142ff5640 1 -- 172.21.15.63:0/1903373608 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f8150003780 con 0x55a40698e1b0 2024-09-21T06:31:19.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.697+0000 7f816b70e740 10 client.25835 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:31:19.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.697+0000 7f816b70e740 10 client.25835 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:31:19.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.697+0000 7f816b70e740 20 client.25835 populate_metadata read hostname 'smithi063' 2024-09-21T06:31:19.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.697+0000 7f816b70e740 1 --2- 172.21.15.63:0/1903373608 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55a4069759f0 0x55a406d7c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:19.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.697+0000 7f816b70e740 4 client.25835 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:31:19.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.697+0000 7f816b70e740 1 -- 172.21.15.63:0/1903373608 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a406cd6df0 con 0x55a4069759f0 2024-09-21T06:31:19.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.698+0000 7f815e59c640 1 --2- 172.21.15.63:0/1903373608 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55a4069759f0 0x55a406d7c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:19.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.698+0000 7f8142ff5640 10 client.25835 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:31:19.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.698+0000 7f815e59c640 1 --2- 172.21.15.63:0/1903373608 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55a4069759f0 0x55a406d7c520 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d012caa1c322dec0 server_cookie=415845210ee5282a in_seq=0 out_seq=0 2024-09-21T06:31:19.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.699+0000 7f8142ff5640 1 -- 172.21.15.63:0/1903373608 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a406cd6df0 con 0x55a4069759f0 2024-09-21T06:31:19.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.699+0000 7f8142ff5640 10 client.25835 handle_command_reply: tid=0 2024-09-21T06:31:19.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.699+0000 7f816b70e740 1 client.25835 shutdown 2024-09-21T06:31:19.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.699+0000 7f816b70e740 1 -- 172.21.15.63:0/1903373608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40698e1b0 msgr2=0x55a406d69cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:19.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.699+0000 7f816b70e740 1 --2- 172.21.15.63:0/1903373608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40698e1b0 0x55a406d69cf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8150033000 tx=0x7f8150009260 comp rx=0 tx=0).stop 2024-09-21T06:31:19.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.699+0000 7f816b70e740 1 -- 172.21.15.63:0/1903373608 shutdown_connections 2024-09-21T06:31:19.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.699+0000 7f816b70e740 1 --2- 172.21.15.63:0/1903373608 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55a4069759f0 0x55a406d7c520 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.699+0000 7f816b70e740 1 --2- 172.21.15.63:0/1903373608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4069b7070 0x55a406d76170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.699+0000 7f816b70e740 1 --2- 172.21.15.63:0/1903373608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a406996390 0x55a406d6a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.699+0000 7f816b70e740 1 --2- 172.21.15.63:0/1903373608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40698e1b0 0x55a406d69cf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.699+0000 7f816b70e740 1 -- 172.21.15.63:0/1903373608 >> 172.21.15.63:0/1903373608 conn(0x55a4069ab460 msgr2=0x55a406d61830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:19.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.699+0000 7f8142ff5640 0 client.25835 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:31:19.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.699+0000 7f816b70e740 1 -- 172.21.15.63:0/1903373608 shutdown_connections 2024-09-21T06:31:19.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.699+0000 7f816b70e740 1 -- 172.21.15.63:0/1903373608 wait complete. 2024-09-21T06:31:19.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.699+0000 7f816b70e740 20 client.25835 trim_cache size 0 max 16384 2024-09-21T06:31:19.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.713+0000 7f816b70e740 1 Processor -- start 2024-09-21T06:31:19.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.713+0000 7f816b70e740 1 -- start start 2024-09-21T06:31:19.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.713+0000 7f816b70e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a40698e1b0 0x55a406d76070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:19.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.713+0000 7f816b70e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a406996390 0x55a406d69aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:19.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.713+0000 7f816b70e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a4069b7070 0x55a406d69fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:19.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.713+0000 7f816b70e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f81601b1960 con 0x55a4069b7070 2024-09-21T06:31:19.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.713+0000 7f816b70e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81601b3560 con 0x55a406996390 2024-09-21T06:31:19.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.713+0000 7f816b70e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f81601b20f0 con 0x55a40698e1b0 2024-09-21T06:31:19.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.714+0000 7f815e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a406996390 0x55a406d69aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:19.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.714+0000 7f815f59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a4069b7070 0x55a406d69fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:19.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.714+0000 7f815ed9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a40698e1b0 0x55a406d76070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:19.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.714+0000 7f815e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a406996390 0x55a406d69aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:53490/0 (socket says 172.21.15.63:53490) 2024-09-21T06:31:19.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.714+0000 7f815e59c640 1 -- 172.21.15.63:0/2139501540 learned_addr learned my addr 172.21.15.63:0/2139501540 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:19.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.714+0000 7f815f59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a4069b7070 0x55a406d69fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47862/0 (socket says 172.21.15.63:47862) 2024-09-21T06:31:19.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.714+0000 7f815ed9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a40698e1b0 0x55a406d76070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:44942/0 (socket says 172.21.15.63:44942) 2024-09-21T06:31:19.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.714+0000 7f815ed9d640 1 -- 172.21.15.63:0/2139501540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a406996390 msgr2=0x55a406d69aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:19.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.714+0000 7f815ed9d640 1 --2- 172.21.15.63:0/2139501540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a406996390 0x55a406d69aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.714+0000 7f815ed9d640 1 -- 172.21.15.63:0/2139501540 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a4069b7070 msgr2=0x55a406d69fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:19.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.714+0000 7f815ed9d640 1 --2- 172.21.15.63:0/2139501540 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a4069b7070 0x55a406d69fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.714+0000 7f815ed9d640 1 -- 172.21.15.63:0/2139501540 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a406d60ee0 con 0x55a40698e1b0 2024-09-21T06:31:19.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.714+0000 7f815ed9d640 1 --2- 172.21.15.63:0/2139501540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a40698e1b0 0x55a406d76070 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8150006010 tx=0x7f815002a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63c8796c6e17d0d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:19.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.714+0000 7f8144ff9640 1 -- 172.21.15.63:0/2139501540 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8150061020 con 0x55a40698e1b0 2024-09-21T06:31:19.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.715+0000 7f8144ff9640 1 -- 172.21.15.63:0/2139501540 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8150004000 con 0x55a40698e1b0 2024-09-21T06:31:19.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.715+0000 7f8144ff9640 1 -- 172.21.15.63:0/2139501540 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815004d070 con 0x55a40698e1b0 2024-09-21T06:31:19.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.715+0000 7f816b70e740 1 -- 172.21.15.63:0/2139501540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a40698e1b0 msgr2=0x55a406d76070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:19.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.715+0000 7f816b70e740 1 --2- 172.21.15.63:0/2139501540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a40698e1b0 0x55a406d76070 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8150006010 tx=0x7f815002a410 comp rx=0 tx=0).stop 2024-09-21T06:31:19.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.716+0000 7f816b70e740 1 -- 172.21.15.63:0/2139501540 shutdown_connections 2024-09-21T06:31:19.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.716+0000 7f816b70e740 1 --2- 172.21.15.63:0/2139501540 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a4069b7070 0x55a406d69fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.716+0000 7f816b70e740 1 --2- 172.21.15.63:0/2139501540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a406996390 0x55a406d69aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.716+0000 7f816b70e740 1 --2- 172.21.15.63:0/2139501540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a40698e1b0 0x55a406d76070 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.716+0000 7f816b70e740 1 -- 172.21.15.63:0/2139501540 >> 172.21.15.63:0/2139501540 conn(0x55a4069ab460 msgr2=0x55a406d68570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:19.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.716+0000 7f816b70e740 1 -- 172.21.15.63:0/2139501540 shutdown_connections 2024-09-21T06:31:19.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.716+0000 7f816b70e740 1 -- 172.21.15.63:0/2139501540 wait complete. 2024-09-21T06:31:19.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.716+0000 7f816b70e740 1 -- start start 2024-09-21T06:31:19.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.716+0000 7f816b70e740 1 Processor -- start 2024-09-21T06:31:19.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.717+0000 7f816b70e740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a40698e1b0 0x55a406d6db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:19.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.717+0000 7f816b70e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a406996390 0x55a406d6e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:19.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.717+0000 7f816b70e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4069b7070 0x55a406ddefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:19.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.717+0000 7f816b70e740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f81601b2e90 con 0x55a40698e1b0 2024-09-21T06:31:19.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.717+0000 7f816b70e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81601b27c0 con 0x55a406996390 2024-09-21T06:31:19.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.717+0000 7f816b70e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f81601af940 con 0x55a4069b7070 2024-09-21T06:31:19.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.717+0000 7f816b70e740 10 client.0 _ll_register_callbacks cb 0x7f8150009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:31:19.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.717+0000 7f815ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a40698e1b0 0x55a406d6db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:19.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.717+0000 7f815e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a406996390 0x55a406d6e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:19.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.717+0000 7f815e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a406996390 0x55a406d6e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:53500/0 (socket says 172.21.15.63:53500) 2024-09-21T06:31:19.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.717+0000 7f815ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a40698e1b0 0x55a406d6db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47876/0 (socket says 172.21.15.63:47876) 2024-09-21T06:31:19.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.717+0000 7f815e59c640 1 -- 172.21.15.63:0/433048246 learned_addr learned my addr 172.21.15.63:0/433048246 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:19.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.717+0000 7f815f59e640 1 --2- 172.21.15.63:0/433048246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4069b7070 0x55a406ddefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:19.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.717+0000 7f815e59c640 1 -- 172.21.15.63:0/433048246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4069b7070 msgr2=0x55a406ddefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:19.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.717+0000 7f815e59c640 1 --2- 172.21.15.63:0/433048246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4069b7070 0x55a406ddefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.717+0000 7f815e59c640 1 -- 172.21.15.63:0/433048246 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a40698e1b0 msgr2=0x55a406d6db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:19.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.717+0000 7f815e59c640 1 --2- 172.21.15.63:0/433048246 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a40698e1b0 0x55a406d6db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.717+0000 7f815e59c640 1 -- 172.21.15.63:0/433048246 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a406ddf630 con 0x55a406996390 2024-09-21T06:31:19.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.717+0000 7f815e59c640 1 --2- 172.21.15.63:0/433048246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a406996390 0x55a406d6e110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f81540aa370 tx=0x7f81540a90b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bfca35d7ea0c1f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:19.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.717+0000 7f8142ff5640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:31:19.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.718+0000 7f8142ff5640 1 -- 172.21.15.63:0/433048246 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81540ac870 con 0x55a406996390 2024-09-21T06:31:19.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.718+0000 7f8142ff5640 1 -- 172.21.15.63:0/433048246 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f8154098200 con 0x55a406996390 2024-09-21T06:31:19.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.718+0000 7f816b70e740 1 -- 172.21.15.63:0/433048246 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8150004000 con 0x55a406996390 2024-09-21T06:31:19.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.718+0000 7f8142ff5640 1 -- 172.21.15.63:0/433048246 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f81540acc10 con 0x55a406996390 2024-09-21T06:31:19.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.718+0000 7f816b70e740 10 client.25841 fetch_fsmap learned FSMap version 43 2024-09-21T06:31:19.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.718+0000 7f816b70e740 1 -- 172.21.15.63:0/433048246 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55a406de6a20 con 0x55a406996390 2024-09-21T06:31:19.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.718+0000 7f8142ff5640 1 -- 172.21.15.63:0/433048246 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8150004000 con 0x55a406996390 2024-09-21T06:31:19.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.718+0000 7f8142ff5640 1 -- 172.21.15.63:0/433048246 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f81540abdd0 con 0x55a406996390 2024-09-21T06:31:19.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.718+0000 7f816b70e740 10 client.25841 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:31:19.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.718+0000 7f816b70e740 10 client.25841 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:31:19.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.718+0000 7f816b70e740 20 client.25841 populate_metadata read hostname 'smithi063' 2024-09-21T06:31:19.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.718+0000 7f816b70e740 1 --2- 172.21.15.63:0/433048246 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55a40694ada0 0x55a406de9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:19.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.718+0000 7f816b70e740 4 client.25841 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:31:19.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.718+0000 7f816b70e740 1 -- 172.21.15.63:0/433048246 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a406cd28a0 con 0x55a40694ada0 2024-09-21T06:31:19.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.719+0000 7f815ed9d640 1 --2- 172.21.15.63:0/433048246 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55a40694ada0 0x55a406de9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:19.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.719+0000 7f815ed9d640 1 --2- 172.21.15.63:0/433048246 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55a40694ada0 0x55a406de9280 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1da8171f166c2dae server_cookie=2fab16f45434745f in_seq=0 out_seq=0 2024-09-21T06:31:19.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.719+0000 7f8142ff5640 10 client.25841 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:31:19.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.719+0000 7f8142ff5640 1 -- 172.21.15.63:0/433048246 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a406cd28a0 con 0x55a40694ada0 2024-09-21T06:31:19.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.719+0000 7f8142ff5640 10 client.25841 handle_command_reply: tid=0 2024-09-21T06:31:19.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.719+0000 7f816b70e740 1 client.25841 shutdown 2024-09-21T06:31:19.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.720+0000 7f816b70e740 1 -- 172.21.15.63:0/433048246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a406996390 msgr2=0x55a406d6e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:19.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.720+0000 7f816b70e740 1 --2- 172.21.15.63:0/433048246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a406996390 0x55a406d6e110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f81540aa370 tx=0x7f81540a90b0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.720+0000 7f816b70e740 1 -- 172.21.15.63:0/433048246 shutdown_connections 2024-09-21T06:31:19.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.720+0000 7f816b70e740 1 --2- 172.21.15.63:0/433048246 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55a40694ada0 0x55a406de9280 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.720+0000 7f816b70e740 1 --2- 172.21.15.63:0/433048246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4069b7070 0x55a406ddefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.720+0000 7f816b70e740 1 --2- 172.21.15.63:0/433048246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a406996390 0x55a406d6e110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.720+0000 7f8142ff5640 0 client.25841 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:31:19.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.720+0000 7f816b70e740 1 --2- 172.21.15.63:0/433048246 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a40698e1b0 0x55a406d6db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.720+0000 7f816b70e740 1 -- 172.21.15.63:0/433048246 >> 172.21.15.63:0/433048246 conn(0x55a4069ab460 msgr2=0x55a406d69aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:19.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.720+0000 7f816b70e740 1 -- 172.21.15.63:0/433048246 shutdown_connections 2024-09-21T06:31:19.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.720+0000 7f816b70e740 1 -- 172.21.15.63:0/433048246 wait complete. 2024-09-21T06:31:19.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.720+0000 7f816b70e740 20 client.25841 trim_cache size 0 max 16384 2024-09-21T06:31:19.726 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:31:19.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.720+0000 7f816519a640 1 -- 172.21.15.63:0/2606905700 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f81480b6700 msgr2=0x7f81480b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:19.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.720+0000 7f816519a640 1 --2- 172.21.15.63:0/2606905700 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f81480b6700 0x7f81480b8c10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8150031440 tx=0x7f8150032ed0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.720+0000 7f816519a640 1 -- 172.21.15.63:0/2606905700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81601094b0 msgr2=0x7f816019ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:19.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.720+0000 7f816519a640 1 --2- 172.21.15.63:0/2606905700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81601094b0 0x7f816019ccb0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f815400d950 tx=0x7f815400de10 comp rx=0 tx=0).stop 2024-09-21T06:31:19.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.720+0000 7f816519a640 1 -- 172.21.15.63:0/2606905700 shutdown_connections 2024-09-21T06:31:19.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.720+0000 7f816519a640 1 --2- 172.21.15.63:0/2606905700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8160109e00 0x7f81601a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.721+0000 7f816519a640 1 --2- 172.21.15.63:0/2606905700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81601094b0 0x7f816019ccb0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.721+0000 7f816519a640 1 --2- 172.21.15.63:0/2606905700 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f81480b6700 0x7f81480b8c10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.721+0000 7f816519a640 1 --2- 172.21.15.63:0/2606905700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8160103bc0 0x7f816019c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.721+0000 7f816519a640 1 -- 172.21.15.63:0/2606905700 >> 172.21.15.63:0/2606905700 conn(0x7f816007b910 msgr2=0x7f8160107360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:19.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.721+0000 7f816519a640 1 -- 172.21.15.63:0/2606905700 shutdown_connections 2024-09-21T06:31:19.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:19.721+0000 7f816519a640 1 -- 172.21.15.63:0/2606905700 wait complete. 2024-09-21T06:31:19.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:19 smithi071 ceph-mon[34844]: pgmap v416: 97 pgs: 97 active+clean; 98 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.2 MiB/s wr, 700 op/s 2024-09-21T06:31:19.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:19 smithi175 ceph-mon[34510]: pgmap v416: 97 pgs: 97 active+clean; 98 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.2 MiB/s wr, 700 op/s 2024-09-21T06:31:20.783 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T06:31:21.059 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:31:21.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.557+0000 7f0f4b931640 1 -- 172.21.15.63:0/2723478051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f44108d10 msgr2=0x7f0f4410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:21.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.557+0000 7f0f4b931640 1 --2- 172.21.15.63:0/2723478051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f44108d10 0x7f0f4410f540 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009900 tx=0x7f0f3c02a410 comp rx=0 tx=0).stop 2024-09-21T06:31:21.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.557+0000 7f0f4b931640 1 -- 172.21.15.63:0/2723478051 shutdown_connections 2024-09-21T06:31:21.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.557+0000 7f0f4b931640 1 --2- 172.21.15.63:0/2723478051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f44108d10 0x7f0f4410f540 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.557+0000 7f0f4b931640 1 --2- 172.21.15.63:0/2723478051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f441083c0 0x7f0f441087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.557+0000 7f0f4b931640 1 --2- 172.21.15.63:0/2723478051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f44102a80 0x7f0f44102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.557+0000 7f0f4b931640 1 -- 172.21.15.63:0/2723478051 >> 172.21.15.63:0/2723478051 conn(0x7f0f44079740 msgr2=0x7f0f44079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:21.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.557+0000 7f0f4b931640 1 -- 172.21.15.63:0/2723478051 shutdown_connections 2024-09-21T06:31:21.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.557+0000 7f0f4b931640 1 -- 172.21.15.63:0/2723478051 wait complete. 2024-09-21T06:31:21.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.558+0000 7f0f4b931640 1 Processor -- start 2024-09-21T06:31:21.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.558+0000 7f0f4b931640 1 -- start start 2024-09-21T06:31:21.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.558+0000 7f0f4b931640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f44102a80 0x7f0f44199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:21.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.558+0000 7f0f4b931640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f441083c0 0x7f0f44199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:21.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.558+0000 7f0f4b931640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f44108d10 0x7f0f44199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:21.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.558+0000 7f0f4b931640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0f44112980 con 0x7f0f44108d10 2024-09-21T06:31:21.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.558+0000 7f0f4b931640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0f44112800 con 0x7f0f441083c0 2024-09-21T06:31:21.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.558+0000 7f0f4b931640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0f44112b00 con 0x7f0f44102a80 2024-09-21T06:31:21.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.558+0000 7f0f49ece640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f44108d10 0x7f0f44199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:21.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.558+0000 7f0f496cd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f44102a80 0x7f0f44199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:21.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.558+0000 7f0f48ecc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f441083c0 0x7f0f44199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:21.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.558+0000 7f0f49ece640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f44108d10 0x7f0f44199aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47882/0 (socket says 172.21.15.63:47882) 2024-09-21T06:31:21.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.558+0000 7f0f49ece640 1 -- 172.21.15.63:0/3518612510 learned_addr learned my addr 172.21.15.63:0/3518612510 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:21.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.559+0000 7f0f48ecc640 1 -- 172.21.15.63:0/3518612510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f44102a80 msgr2=0x7f0f44199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:21.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.559+0000 7f0f48ecc640 1 --2- 172.21.15.63:0/3518612510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f44102a80 0x7f0f44199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.559+0000 7f0f48ecc640 1 -- 172.21.15.63:0/3518612510 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f44108d10 msgr2=0x7f0f44199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:21.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.559+0000 7f0f48ecc640 1 --2- 172.21.15.63:0/3518612510 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f44108d10 0x7f0f44199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.559+0000 7f0f48ecc640 1 -- 172.21.15.63:0/3518612510 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f441a8720 con 0x7f0f441083c0 2024-09-21T06:31:21.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.559+0000 7f0f49ece640 1 --2- 172.21.15.63:0/3518612510 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f44108d10 0x7f0f44199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:21.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.559+0000 7f0f496cd640 1 --2- 172.21.15.63:0/3518612510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f44102a80 0x7f0f44199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:21.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.559+0000 7f0f48ecc640 1 --2- 172.21.15.63:0/3518612510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f441083c0 0x7f0f44199560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0f38005fd0 tx=0x7f0f3800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:21.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.559+0000 7f0f427fc640 1 -- 172.21.15.63:0/3518612510 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38003b70 con 0x7f0f441083c0 2024-09-21T06:31:21.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.559+0000 7f0f4b931640 1 -- 172.21.15.63:0/3518612510 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f441a8a10 con 0x7f0f441083c0 2024-09-21T06:31:21.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.559+0000 7f0f427fc640 1 -- 172.21.15.63:0/3518612510 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f38003d10 con 0x7f0f441083c0 2024-09-21T06:31:21.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.559+0000 7f0f427fc640 1 -- 172.21.15.63:0/3518612510 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f380108f0 con 0x7f0f441083c0 2024-09-21T06:31:21.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.559+0000 7f0f4b931640 1 -- 172.21.15.63:0/3518612510 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f441a8fa0 con 0x7f0f441083c0 2024-09-21T06:31:21.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.562+0000 7f0f51ea5740 1 Processor -- start 2024-09-21T06:31:21.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.562+0000 7f0f51ea5740 1 -- start start 2024-09-21T06:31:21.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.562+0000 7f0f427fc640 1 -- 172.21.15.63:0/3518612510 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f0f38003ec0 con 0x7f0f441083c0 2024-09-21T06:31:21.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.563+0000 7f0f51ea5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faca070 0x56177fe716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:21.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.563+0000 7f0f51ea5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faa11b0 0x56177fe71be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:21.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.563+0000 7f0f51ea5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faa9390 0x56177fe72120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:21.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.563+0000 7f0f51ea5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56177fde7ea0 con 0x56177faca070 2024-09-21T06:31:21.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.563+0000 7f0f51ea5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56177fdd72d0 con 0x56177faa9390 2024-09-21T06:31:21.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.563+0000 7f0f51ea5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56177fddb0e0 con 0x56177faa11b0 2024-09-21T06:31:21.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.563+0000 7f0f49ece640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faca070 0x56177fe716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:21.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.563+0000 7f0f49ece640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faca070 0x56177fe716a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47892/0 (socket says 172.21.15.63:47892) 2024-09-21T06:31:21.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.563+0000 7f0f49ece640 1 -- 172.21.15.63:0/763417012 learned_addr learned my addr 172.21.15.63:0/763417012 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:21.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.563+0000 7f0f496cd640 1 --2- 172.21.15.63:0/763417012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faa11b0 0x56177fe71be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:21.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.563+0000 7f0f48ecc640 1 --2- 172.21.15.63:0/763417012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faa9390 0x56177fe72120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.563+0000 7f0f49ece640 1 -- 172.21.15.63:0/763417012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faa11b0 msgr2=0x56177fe71be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.563+0000 7f0f49ece640 1 --2- 172.21.15.63:0/763417012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faa11b0 0x56177fe71be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.563+0000 7f0f49ece640 1 -- 172.21.15.63:0/763417012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faa9390 msgr2=0x56177fe72120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.563+0000 7f0f49ece640 1 --2- 172.21.15.63:0/763417012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faa9390 0x56177fe72120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.563+0000 7f0f49ece640 1 -- 172.21.15.63:0/763417012 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56177fb35650 con 0x56177faca070 2024-09-21T06:31:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.563+0000 7f0f49ece640 1 --2- 172.21.15.63:0/763417012 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faca070 0x56177fe716a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c005e60 tx=0x7f0f3c005e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0481b091ab0d1bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.564+0000 7f0f427fc640 1 --2- 172.21.15.63:0/3518612510 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0f2c0b6700 0x7f0f2c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.564+0000 7f0f2b7fe640 1 -- 172.21.15.63:0/763417012 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c035040 con 0x56177faca070 2024-09-21T06:31:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.564+0000 7f0f2b7fe640 1 -- 172.21.15.63:0/763417012 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f3c0317a0 con 0x56177faca070 2024-09-21T06:31:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.564+0000 7f0f2b7fe640 1 -- 172.21.15.63:0/763417012 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c004a00 con 0x56177faca070 2024-09-21T06:31:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.564+0000 7f0f496cd640 1 --2- 172.21.15.63:0/3518612510 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0f2c0b6700 0x7f0f2c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.564+0000 7f0f427fc640 1 -- 172.21.15.63:0/3518612510 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f0f380e7df0 con 0x7f0f441083c0 2024-09-21T06:31:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.565+0000 7f0f51ea5740 1 -- 172.21.15.63:0/763417012 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faca070 msgr2=0x56177fe716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.565+0000 7f0f496cd640 1 --2- 172.21.15.63:0/3518612510 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0f2c0b6700 0x7f0f2c0b8c10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x56177fe70320 tx=0x7f0f34005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.565+0000 7f0f51ea5740 1 --2- 172.21.15.63:0/763417012 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faca070 0x56177fe716a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c005e60 tx=0x7f0f3c005e90 comp rx=0 tx=0).stop 2024-09-21T06:31:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.565+0000 7f0f51ea5740 1 -- 172.21.15.63:0/763417012 shutdown_connections 2024-09-21T06:31:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.565+0000 7f0f51ea5740 1 --2- 172.21.15.63:0/763417012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faa9390 0x56177fe72120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.565+0000 7f0f51ea5740 1 --2- 172.21.15.63:0/763417012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faa11b0 0x56177fe71be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.565+0000 7f0f51ea5740 1 --2- 172.21.15.63:0/763417012 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faca070 0x56177fe716a0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.565+0000 7f0f51ea5740 1 -- 172.21.15.63:0/763417012 >> 172.21.15.63:0/763417012 conn(0x56177fabe460 msgr2=0x56177fe6f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.565+0000 7f0f51ea5740 1 -- 172.21.15.63:0/763417012 shutdown_connections 2024-09-21T06:31:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.565+0000 7f0f51ea5740 1 -- 172.21.15.63:0/763417012 wait complete. 2024-09-21T06:31:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.565+0000 7f0f51ea5740 1 -- start start 2024-09-21T06:31:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.565+0000 7f0f51ea5740 1 Processor -- start 2024-09-21T06:31:21.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.566+0000 7f0f51ea5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faa11b0 0x56177fe7cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:21.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.566+0000 7f0f51ea5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faa9390 0x56177fe7d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:21.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.566+0000 7f0f51ea5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faca070 0x56177fe89140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:21.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.566+0000 7f0f51ea5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56177fc38700 con 0x56177faa11b0 2024-09-21T06:31:21.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.566+0000 7f0f51ea5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56177fd72160 con 0x56177faa9390 2024-09-21T06:31:21.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.566+0000 7f0f51ea5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56177fe7fe20 con 0x56177faca070 2024-09-21T06:31:21.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.566+0000 7f0f51ea5740 10 client.0 _ll_register_callbacks cb 0x56177fd8b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:31:21.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.566+0000 7f0f496cd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faa11b0 0x56177fe7cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:21.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.566+0000 7f0f496cd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faa11b0 0x56177fe7cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47894/0 (socket says 172.21.15.63:47894) 2024-09-21T06:31:21.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.566+0000 7f0f496cd640 1 -- 172.21.15.63:0/69132422 learned_addr learned my addr 172.21.15.63:0/69132422 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:21.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.566+0000 7f0f48ecc640 1 --2- 172.21.15.63:0/69132422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faa9390 0x56177fe7d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:21.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.566+0000 7f0f49ece640 1 --2- 172.21.15.63:0/69132422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faca070 0x56177fe89140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:21.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.567+0000 7f0f48ecc640 1 -- 172.21.15.63:0/69132422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faca070 msgr2=0x56177fe89140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:21.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.567+0000 7f0f48ecc640 1 --2- 172.21.15.63:0/69132422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faca070 0x56177fe89140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.567+0000 7f0f48ecc640 1 -- 172.21.15.63:0/69132422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faa11b0 msgr2=0x56177fe7cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:21.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.567+0000 7f0f48ecc640 1 --2- 172.21.15.63:0/69132422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faa11b0 0x56177fe7cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.567+0000 7f0f48ecc640 1 -- 172.21.15.63:0/69132422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56177fd9fc90 con 0x56177faa9390 2024-09-21T06:31:21.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.567+0000 7f0f496cd640 1 --2- 172.21.15.63:0/69132422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faa11b0 0x56177fe7cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:21.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.567+0000 7f0f49ece640 1 --2- 172.21.15.63:0/69132422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faca070 0x56177fe89140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:21.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.567+0000 7f0f48ecc640 1 --2- 172.21.15.63:0/69132422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faa9390 0x56177fe7d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0f380e5520 tx=0x7f0f380b74f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd4da5b27440130f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:21.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.567+0000 7f0f28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:31:21.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.567+0000 7f0f28ff9640 1 -- 172.21.15.63:0/69132422 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f380aa270 con 0x56177faa9390 2024-09-21T06:31:21.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.567+0000 7f0f28ff9640 1 -- 172.21.15.63:0/69132422 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f0f380a9770 con 0x56177faa9390 2024-09-21T06:31:21.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.567+0000 7f0f51ea5740 1 -- 172.21.15.63:0/69132422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f3c0317a0 con 0x56177faa9390 2024-09-21T06:31:21.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.567+0000 7f0f28ff9640 1 -- 172.21.15.63:0/69132422 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f0f380d12e0 con 0x56177faa9390 2024-09-21T06:31:21.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.567+0000 7f0f51ea5740 10 client.25853 fetch_fsmap learned FSMap version 43 2024-09-21T06:31:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.567+0000 7f0f51ea5740 1 -- 172.21.15.63:0/69132422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56177fe8bc10 con 0x56177faa9390 2024-09-21T06:31:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.568+0000 7f0f28ff9640 1 -- 172.21.15.63:0/69132422 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f3c0317a0 con 0x56177faa9390 2024-09-21T06:31:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.568+0000 7f0f28ff9640 1 -- 172.21.15.63:0/69132422 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f0f380ac8f0 con 0x56177faa9390 2024-09-21T06:31:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.568+0000 7f0f51ea5740 10 client.25853 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:31:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.568+0000 7f0f51ea5740 10 client.25853 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:31:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.568+0000 7f0f51ea5740 20 client.25853 populate_metadata read hostname 'smithi063' 2024-09-21T06:31:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.568+0000 7f0f51ea5740 1 --2- 172.21.15.63:0/69132422 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56177fa889f0 0x56177fe8f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.568+0000 7f0f51ea5740 4 client.25853 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:31:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.568+0000 7f0f51ea5740 1 -- 172.21.15.63:0/69132422 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56177fde9df0 con 0x56177fa889f0 2024-09-21T06:31:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.568+0000 7f0f496cd640 1 --2- 172.21.15.63:0/69132422 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56177fa889f0 0x56177fe8f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.569+0000 7f0f496cd640 1 --2- 172.21.15.63:0/69132422 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56177fa889f0 0x56177fe8f110 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=730d8fb9327b43a server_cookie=5256fbfd5018ead6 in_seq=0 out_seq=0 2024-09-21T06:31:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.569+0000 7f0f28ff9640 10 client.25853 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:31:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.569+0000 7f0f28ff9640 1 -- 172.21.15.63:0/69132422 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56177fde9df0 con 0x56177fa889f0 2024-09-21T06:31:21.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.569+0000 7f0f28ff9640 10 client.25853 handle_command_reply: tid=0 2024-09-21T06:31:21.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.569+0000 7f0f51ea5740 1 client.25853 shutdown 2024-09-21T06:31:21.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.570+0000 7f0f51ea5740 1 -- 172.21.15.63:0/69132422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faa9390 msgr2=0x56177fe7d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:21.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.570+0000 7f0f51ea5740 1 --2- 172.21.15.63:0/69132422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faa9390 0x56177fe7d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0f380e5520 tx=0x7f0f380b74f0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.570+0000 7f0f51ea5740 1 -- 172.21.15.63:0/69132422 shutdown_connections 2024-09-21T06:31:21.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.570+0000 7f0f51ea5740 1 --2- 172.21.15.63:0/69132422 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56177fa889f0 0x56177fe8f110 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.570+0000 7f0f51ea5740 1 --2- 172.21.15.63:0/69132422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faca070 0x56177fe89140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.570+0000 7f0f51ea5740 1 --2- 172.21.15.63:0/69132422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faa9390 0x56177fe7d300 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.570+0000 7f0f28ff9640 0 client.25853 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:31:21.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.570+0000 7f0f51ea5740 1 --2- 172.21.15.63:0/69132422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faa11b0 0x56177fe7cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.570+0000 7f0f51ea5740 1 -- 172.21.15.63:0/69132422 >> 172.21.15.63:0/69132422 conn(0x56177fabe460 msgr2=0x56177fe74850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:21.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.570+0000 7f0f51ea5740 1 -- 172.21.15.63:0/69132422 shutdown_connections 2024-09-21T06:31:21.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.570+0000 7f0f51ea5740 1 -- 172.21.15.63:0/69132422 wait complete. 2024-09-21T06:31:21.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.570+0000 7f0f51ea5740 20 client.25853 trim_cache size 0 max 16384 2024-09-21T06:31:21.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.585+0000 7f0f51ea5740 1 Processor -- start 2024-09-21T06:31:21.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.585+0000 7f0f51ea5740 1 -- start start 2024-09-21T06:31:21.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.585+0000 7f0f51ea5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faa11b0 0x56177fe74eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:21.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.585+0000 7f0f51ea5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faa9390 0x56177fe6eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:21.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.585+0000 7f0f51ea5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faca070 0x56177fe6f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:21.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.585+0000 7f0f51ea5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0f441b1870 con 0x56177faa9390 2024-09-21T06:31:21.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.585+0000 7f0f51ea5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0f441b3470 con 0x56177faca070 2024-09-21T06:31:21.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.585+0000 7f0f51ea5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0f441b2000 con 0x56177faa11b0 2024-09-21T06:31:21.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.585+0000 7f0f48ecc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faa9390 0x56177fe6eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:21.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.585+0000 7f0f48ecc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faa9390 0x56177fe6eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47896/0 (socket says 172.21.15.63:47896) 2024-09-21T06:31:21.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.585+0000 7f0f48ecc640 1 -- 172.21.15.63:0/2671099616 learned_addr learned my addr 172.21.15.63:0/2671099616 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:21.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.585+0000 7f0f49ece640 1 --2- 172.21.15.63:0/2671099616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faca070 0x56177fe6f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:21.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.585+0000 7f0f496cd640 1 --2- 172.21.15.63:0/2671099616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faa11b0 0x56177fe74eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:21.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.585+0000 7f0f48ecc640 1 -- 172.21.15.63:0/2671099616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faa11b0 msgr2=0x56177fe74eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:21.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.585+0000 7f0f48ecc640 1 --2- 172.21.15.63:0/2671099616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faa11b0 0x56177fe74eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.585+0000 7f0f48ecc640 1 -- 172.21.15.63:0/2671099616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faca070 msgr2=0x56177fe6f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:21.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.586+0000 7f0f48ecc640 1 --2- 172.21.15.63:0/2671099616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faca070 0x56177fe6f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.586+0000 7f0f48ecc640 1 -- 172.21.15.63:0/2671099616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56177fe7b2c0 con 0x56177faa9390 2024-09-21T06:31:21.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.586+0000 7f0f48ecc640 1 --2- 172.21.15.63:0/2671099616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faa9390 0x56177fe6eed0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0f38000f80 tx=0x7f0f3800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876b50950f43e085 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:21.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.586+0000 7f0f2affd640 1 -- 172.21.15.63:0/2671099616 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f380c8070 con 0x56177faa9390 2024-09-21T06:31:21.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.586+0000 7f0f2affd640 1 -- 172.21.15.63:0/2671099616 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f380ae320 con 0x56177faa9390 2024-09-21T06:31:21.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.586+0000 7f0f2affd640 1 -- 172.21.15.63:0/2671099616 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f380ad390 con 0x56177faa9390 2024-09-21T06:31:21.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.587+0000 7f0f51ea5740 1 -- 172.21.15.63:0/2671099616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faa9390 msgr2=0x56177fe6eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:21.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.587+0000 7f0f51ea5740 1 --2- 172.21.15.63:0/2671099616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faa9390 0x56177fe6eed0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0f38000f80 tx=0x7f0f3800ced0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.587+0000 7f0f51ea5740 1 -- 172.21.15.63:0/2671099616 shutdown_connections 2024-09-21T06:31:21.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.587+0000 7f0f51ea5740 1 --2- 172.21.15.63:0/2671099616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faca070 0x56177fe6f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.587+0000 7f0f51ea5740 1 --2- 172.21.15.63:0/2671099616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faa9390 0x56177fe6eed0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.587+0000 7f0f51ea5740 1 --2- 172.21.15.63:0/2671099616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faa11b0 0x56177fe74eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.587+0000 7f0f51ea5740 1 -- 172.21.15.63:0/2671099616 >> 172.21.15.63:0/2671099616 conn(0x56177fabe460 msgr2=0x56177fe747a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.587+0000 7f0f51ea5740 1 -- 172.21.15.63:0/2671099616 shutdown_connections 2024-09-21T06:31:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.587+0000 7f0f51ea5740 1 -- 172.21.15.63:0/2671099616 wait complete. 2024-09-21T06:31:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.587+0000 7f0f51ea5740 1 -- start start 2024-09-21T06:31:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.588+0000 7f0f51ea5740 1 Processor -- start 2024-09-21T06:31:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.588+0000 7f0f51ea5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faa11b0 0x56177fe82920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.588+0000 7f0f51ea5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faa9390 0x56177fe82ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.588+0000 7f0f51ea5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faca070 0x56177fef7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.588+0000 7f0f51ea5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0f441b2da0 con 0x56177faa11b0 2024-09-21T06:31:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.588+0000 7f0f51ea5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0f441b26d0 con 0x56177faca070 2024-09-21T06:31:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.588+0000 7f0f51ea5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0f441af850 con 0x56177faa9390 2024-09-21T06:31:21.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.588+0000 7f0f51ea5740 10 client.0 _ll_register_callbacks cb 0x7f0f380aa0c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:31:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.588+0000 7f0f496cd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faa11b0 0x56177fe82920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.588+0000 7f0f496cd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faa11b0 0x56177fe82920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47904/0 (socket says 172.21.15.63:47904) 2024-09-21T06:31:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.588+0000 7f0f48ecc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faa9390 0x56177fe82ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.588+0000 7f0f496cd640 1 -- 172.21.15.63:0/1398121347 learned_addr learned my addr 172.21.15.63:0/1398121347 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.588+0000 7f0f49ece640 1 --2- 172.21.15.63:0/1398121347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faca070 0x56177fef7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.589+0000 7f0f48ecc640 1 -- 172.21.15.63:0/1398121347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faca070 msgr2=0x56177fef7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.589+0000 7f0f48ecc640 1 --2- 172.21.15.63:0/1398121347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faca070 0x56177fef7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.589+0000 7f0f48ecc640 1 -- 172.21.15.63:0/1398121347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faa11b0 msgr2=0x56177fe82920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.589+0000 7f0f48ecc640 1 --2- 172.21.15.63:0/1398121347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faa11b0 0x56177fe82920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.589+0000 7f0f48ecc640 1 -- 172.21.15.63:0/1398121347 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56177fef8180 con 0x56177faa9390 2024-09-21T06:31:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.589+0000 7f0f48ecc640 1 --2- 172.21.15.63:0/1398121347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faa9390 0x56177fe82ee0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0f38000f80 tx=0x7f0f38009960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddb28e3cf469c887 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.589+0000 7f0f28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:31:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.589+0000 7f0f28ff9640 1 -- 172.21.15.63:0/1398121347 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f380c8070 con 0x56177faa9390 2024-09-21T06:31:21.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.589+0000 7f0f28ff9640 1 -- 172.21.15.63:0/1398121347 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f0f38087b90 con 0x56177faa9390 2024-09-21T06:31:21.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.590+0000 7f0f51ea5740 1 -- 172.21.15.63:0/1398121347 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f380ae320 con 0x56177faa9390 2024-09-21T06:31:21.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.590+0000 7f0f28ff9640 1 -- 172.21.15.63:0/1398121347 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f0f380ad570 con 0x56177faa9390 2024-09-21T06:31:21.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.590+0000 7f0f51ea5740 10 client.25924 fetch_fsmap learned FSMap version 43 2024-09-21T06:31:21.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.590+0000 7f0f51ea5740 1 -- 172.21.15.63:0/1398121347 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56177fef93e0 con 0x56177faa9390 2024-09-21T06:31:21.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.590+0000 7f0f28ff9640 1 -- 172.21.15.63:0/1398121347 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f380ae320 con 0x56177faa9390 2024-09-21T06:31:21.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.590+0000 7f0f28ff9640 1 -- 172.21.15.63:0/1398121347 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f0f380b3890 con 0x56177faa9390 2024-09-21T06:31:21.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.590+0000 7f0f51ea5740 10 client.25924 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:31:21.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.590+0000 7f0f51ea5740 10 client.25924 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:31:21.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.590+0000 7f0f51ea5740 20 client.25924 populate_metadata read hostname 'smithi063' 2024-09-21T06:31:21.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.590+0000 7f0f51ea5740 1 --2- 172.21.15.63:0/1398121347 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56177fa5dda0 0x56177fefb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:21.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.590+0000 7f0f51ea5740 4 client.25924 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:31:21.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.590+0000 7f0f51ea5740 1 -- 172.21.15.63:0/1398121347 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56177fde58a0 con 0x56177fa5dda0 2024-09-21T06:31:21.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.591+0000 7f0f496cd640 1 --2- 172.21.15.63:0/1398121347 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56177fa5dda0 0x56177fefb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:21.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.591+0000 7f0f496cd640 1 --2- 172.21.15.63:0/1398121347 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56177fa5dda0 0x56177fefb8d0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9eded25a720f8c2a server_cookie=aee72a1ad960bd67 in_seq=0 out_seq=0 2024-09-21T06:31:21.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.591+0000 7f0f28ff9640 10 client.25924 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:31:21.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.591+0000 7f0f28ff9640 1 -- 172.21.15.63:0/1398121347 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56177fde58a0 con 0x56177fa5dda0 2024-09-21T06:31:21.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.591+0000 7f0f28ff9640 10 client.25924 handle_command_reply: tid=0 2024-09-21T06:31:21.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.591+0000 7f0f51ea5740 1 client.25924 shutdown 2024-09-21T06:31:21.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.591+0000 7f0f51ea5740 1 -- 172.21.15.63:0/1398121347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faa9390 msgr2=0x56177fe82ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:21.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.591+0000 7f0f51ea5740 1 --2- 172.21.15.63:0/1398121347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faa9390 0x56177fe82ee0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0f38000f80 tx=0x7f0f38009960 comp rx=0 tx=0).stop 2024-09-21T06:31:21.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.591+0000 7f0f51ea5740 1 -- 172.21.15.63:0/1398121347 shutdown_connections 2024-09-21T06:31:21.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.591+0000 7f0f51ea5740 1 --2- 172.21.15.63:0/1398121347 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56177fa5dda0 0x56177fefb8d0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.592+0000 7f0f51ea5740 1 --2- 172.21.15.63:0/1398121347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56177faca070 0x56177fef7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.592+0000 7f0f51ea5740 1 --2- 172.21.15.63:0/1398121347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56177faa9390 0x56177fe82ee0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.592+0000 7f0f51ea5740 1 --2- 172.21.15.63:0/1398121347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56177faa11b0 0x56177fe82920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.592+0000 7f0f28ff9640 0 client.25924 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:31:21.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.592+0000 7f0f51ea5740 1 -- 172.21.15.63:0/1398121347 >> 172.21.15.63:0/1398121347 conn(0x56177fabe460 msgr2=0x56177fe6eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:21.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.592+0000 7f0f51ea5740 1 -- 172.21.15.63:0/1398121347 shutdown_connections 2024-09-21T06:31:21.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.592+0000 7f0f51ea5740 1 -- 172.21.15.63:0/1398121347 wait complete. 2024-09-21T06:31:21.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.592+0000 7f0f51ea5740 20 client.25924 trim_cache size 0 max 16384 2024-09-21T06:31:21.598 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:31:21.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.592+0000 7f0f4b931640 1 -- 172.21.15.63:0/3518612510 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0f2c0b6700 msgr2=0x7f0f2c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:21.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.592+0000 7f0f4b931640 1 --2- 172.21.15.63:0/3518612510 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0f2c0b6700 0x7f0f2c0b8c10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x56177fe70320 tx=0x7f0f34005f90 comp rx=0 tx=0).stop 2024-09-21T06:31:21.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.592+0000 7f0f4b931640 1 -- 172.21.15.63:0/3518612510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f441083c0 msgr2=0x7f0f44199560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:21.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.592+0000 7f0f4b931640 1 --2- 172.21.15.63:0/3518612510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f441083c0 0x7f0f44199560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0f38005fd0 tx=0x7f0f3800c6a0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.593+0000 7f0f4b931640 1 -- 172.21.15.63:0/3518612510 shutdown_connections 2024-09-21T06:31:21.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.593+0000 7f0f4b931640 1 --2- 172.21.15.63:0/3518612510 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f44108d10 0x7f0f44199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.593+0000 7f0f4b931640 1 --2- 172.21.15.63:0/3518612510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f441083c0 0x7f0f44199560 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.593+0000 7f0f4b931640 1 --2- 172.21.15.63:0/3518612510 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0f2c0b6700 0x7f0f2c0b8c10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.593+0000 7f0f4b931640 1 --2- 172.21.15.63:0/3518612510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f44102a80 0x7f0f44199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.593+0000 7f0f4b931640 1 -- 172.21.15.63:0/3518612510 >> 172.21.15.63:0/3518612510 conn(0x7f0f44079740 msgr2=0x7f0f44104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:21.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.593+0000 7f0f4b931640 1 -- 172.21.15.63:0/3518612510 shutdown_connections 2024-09-21T06:31:21.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:21.593+0000 7f0f4b931640 1 -- 172.21.15.63:0/3518612510 wait complete. 2024-09-21T06:31:21.600 INFO:tasks.workunit.client.0.smithi063.stdout:copying to largest ever: 0xffd97 2024-09-21T06:31:21.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:21 smithi071 ceph-mon[34844]: pgmap v417: 97 pgs: 97 active+clean; 100 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.2 MiB/s wr, 792 op/s 2024-09-21T06:31:21.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:21 smithi063 ceph-mon[31150]: pgmap v417: 97 pgs: 97 active+clean; 100 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.2 MiB/s wr, 792 op/s 2024-09-21T06:31:21.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:21 smithi175 ceph-mon[34510]: pgmap v417: 97 pgs: 97 active+clean; 100 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.2 MiB/s wr, 792 op/s 2024-09-21T06:31:22.379 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:31:22.656 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:31:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:31:22.872+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:31:22.873+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-21T06:31:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:31:22.873+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-21T06:31:22.875 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:31:22.873+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T06:31:22.875 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:31:22.873+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-09-21T06:31:23.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.176+0000 7f45a3483640 1 -- 172.21.15.63:0/2230331611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f459c1083c0 msgr2=0x7f459c1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:23.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.177+0000 7f45a3483640 1 --2- 172.21.15.63:0/2230331611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f459c1083c0 0x7f459c1087d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f458c009900 tx=0x7f458c02a410 comp rx=0 tx=0).stop 2024-09-21T06:31:23.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.177+0000 7f45a3483640 1 -- 172.21.15.63:0/2230331611 shutdown_connections 2024-09-21T06:31:23.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.177+0000 7f45a3483640 1 --2- 172.21.15.63:0/2230331611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f459c108d10 0x7f459c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.177+0000 7f45a3483640 1 --2- 172.21.15.63:0/2230331611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f459c1083c0 0x7f459c1087d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.177+0000 7f45a3483640 1 --2- 172.21.15.63:0/2230331611 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f459c102a80 0x7f459c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.177+0000 7f45a3483640 1 -- 172.21.15.63:0/2230331611 >> 172.21.15.63:0/2230331611 conn(0x7f459c079740 msgr2=0x7f459c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:23.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.177+0000 7f45a3483640 1 -- 172.21.15.63:0/2230331611 shutdown_connections 2024-09-21T06:31:23.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.177+0000 7f45a3483640 1 -- 172.21.15.63:0/2230331611 wait complete. 2024-09-21T06:31:23.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.178+0000 7f45a3483640 1 Processor -- start 2024-09-21T06:31:23.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.178+0000 7f45a3483640 1 -- start start 2024-09-21T06:31:23.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.178+0000 7f45a3483640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f459c102a80 0x7f459c19b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.178+0000 7f45a3483640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f459c1083c0 0x7f459c19b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.178+0000 7f45a3483640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f459c108d10 0x7f459c19bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.178+0000 7f45a3483640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f459c112980 con 0x7f459c102a80 2024-09-21T06:31:23.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.178+0000 7f45a3483640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f459c112800 con 0x7f459c1083c0 2024-09-21T06:31:23.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.178+0000 7f45a3483640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f459c112b00 con 0x7f459c108d10 2024-09-21T06:31:23.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.178+0000 7f45a121f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f459c102a80 0x7f459c19b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.178+0000 7f45a121f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f459c102a80 0x7f459c19b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47914/0 (socket says 172.21.15.63:47914) 2024-09-21T06:31:23.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.178+0000 7f45a121f640 1 -- 172.21.15.63:0/2715721891 learned_addr learned my addr 172.21.15.63:0/2715721891 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:23.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.178+0000 7f45a0a1e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f459c1083c0 0x7f459c19b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.178+0000 7f45a1a20640 1 --2- 172.21.15.63:0/2715721891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f459c108d10 0x7f459c19bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.179+0000 7f45a121f640 1 -- 172.21.15.63:0/2715721891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f459c108d10 msgr2=0x7f459c19bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:23.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.179+0000 7f45a121f640 1 --2- 172.21.15.63:0/2715721891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f459c108d10 0x7f459c19bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.179+0000 7f45a121f640 1 -- 172.21.15.63:0/2715721891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f459c1083c0 msgr2=0x7f459c19b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:23.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.179+0000 7f45a121f640 1 --2- 172.21.15.63:0/2715721891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f459c1083c0 0x7f459c19b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.179+0000 7f45a121f640 1 -- 172.21.15.63:0/2715721891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459c1a65e0 con 0x7f459c102a80 2024-09-21T06:31:23.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.179+0000 7f45a121f640 1 --2- 172.21.15.63:0/2715721891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f459c102a80 0x7f459c19b350 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f459800e9f0 tx=0x7f459800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:23.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.179+0000 7f45927fc640 1 -- 172.21.15.63:0/2715721891 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459800cd80 con 0x7f459c102a80 2024-09-21T06:31:23.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.179+0000 7f45a3483640 1 -- 172.21.15.63:0/2715721891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f459c1a68d0 con 0x7f459c102a80 2024-09-21T06:31:23.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.179+0000 7f45927fc640 1 -- 172.21.15.63:0/2715721891 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45980108e0 con 0x7f459c102a80 2024-09-21T06:31:23.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.179+0000 7f45927fc640 1 -- 172.21.15.63:0/2715721891 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598018980 con 0x7f459c102a80 2024-09-21T06:31:23.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.179+0000 7f45a3483640 1 -- 172.21.15.63:0/2715721891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f459c1a6e30 con 0x7f459c102a80 2024-09-21T06:31:23.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.182+0000 7f45a99f7740 1 Processor -- start 2024-09-21T06:31:23.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.182+0000 7f45927fc640 1 -- 172.21.15.63:0/2715721891 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f4598010430 con 0x7f459c102a80 2024-09-21T06:31:23.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.182+0000 7f45a99f7740 1 -- start start 2024-09-21T06:31:23.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.182+0000 7f45a99f7740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06ed1070 0x55fe072782c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.182+0000 7f45a99f7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06ea81b0 0x55fe07278800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.182+0000 7f45a99f7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06eb0390 0x55fe07278d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.182+0000 7f45a99f7740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55fe071eeea0 con 0x55fe06ed1070 2024-09-21T06:31:23.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.183+0000 7f45a99f7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55fe071de2d0 con 0x55fe06eb0390 2024-09-21T06:31:23.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.183+0000 7f45a99f7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fe071e20e0 con 0x55fe06ea81b0 2024-09-21T06:31:23.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.183+0000 7f45a121f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06ea81b0 0x55fe07278800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.183+0000 7f45a121f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06ea81b0 0x55fe07278800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:45038/0 (socket says 172.21.15.63:45038) 2024-09-21T06:31:23.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.183+0000 7f45a0a1e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06eb0390 0x55fe07278d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.183+0000 7f45a121f640 1 -- 172.21.15.63:0/747352348 learned_addr learned my addr 172.21.15.63:0/747352348 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.183+0000 7f45a1a20640 1 --2- 172.21.15.63:0/747352348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06ed1070 0x55fe072782c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.183+0000 7f45a0a1e640 1 -- 172.21.15.63:0/747352348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06ea81b0 msgr2=0x55fe07278800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.183+0000 7f45a0a1e640 1 --2- 172.21.15.63:0/747352348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06ea81b0 0x55fe07278800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.183+0000 7f45a0a1e640 1 -- 172.21.15.63:0/747352348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06ed1070 msgr2=0x55fe072782c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.183+0000 7f45a0a1e640 1 --2- 172.21.15.63:0/747352348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06ed1070 0x55fe072782c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.183+0000 7f45a0a1e640 1 -- 172.21.15.63:0/747352348 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe06f3c650 con 0x55fe06eb0390 2024-09-21T06:31:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.183+0000 7f45927fc640 1 --2- 172.21.15.63:0/2715721891 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f45880b66b0 0x7f45880b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.183+0000 7f45a0a1e640 1 --2- 172.21.15.63:0/747352348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06eb0390 0x55fe07278d40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f458c006010 tx=0x7f458c032bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccee7026c0538153 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.184+0000 7f45a121f640 1 --2- 172.21.15.63:0/747352348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06ea81b0 0x55fe07278800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.184+0000 7f45a1a20640 1 --2- 172.21.15.63:0/747352348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06ed1070 0x55fe072782c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:31:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.184+0000 7f45927fc640 1 -- 172.21.15.63:0/2715721891 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f45980e7a50 con 0x7f459c102a80 2024-09-21T06:31:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.184+0000 7f45a1a20640 1 --2- 172.21.15.63:0/2715721891 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f45880b66b0 0x7f45880b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.184+0000 7f45877fe640 1 -- 172.21.15.63:0/747352348 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c040070 con 0x55fe06eb0390 2024-09-21T06:31:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.184+0000 7f45877fe640 1 -- 172.21.15.63:0/747352348 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f458c004030 con 0x55fe06eb0390 2024-09-21T06:31:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.184+0000 7f45877fe640 1 -- 172.21.15.63:0/747352348 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c035040 con 0x55fe06eb0390 2024-09-21T06:31:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.185+0000 7f45a99f7740 1 -- 172.21.15.63:0/747352348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06eb0390 msgr2=0x55fe07278d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.185+0000 7f45a99f7740 1 --2- 172.21.15.63:0/747352348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06eb0390 0x55fe07278d40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f458c006010 tx=0x7f458c032bd0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.185+0000 7f45a1a20640 1 --2- 172.21.15.63:0/2715721891 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f45880b66b0 0x7f45880b8bc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4594005fd0 tx=0x7f45940096a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.185+0000 7f45a99f7740 1 -- 172.21.15.63:0/747352348 shutdown_connections 2024-09-21T06:31:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.185+0000 7f45a99f7740 1 --2- 172.21.15.63:0/747352348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06eb0390 0x55fe07278d40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.185+0000 7f45a99f7740 1 --2- 172.21.15.63:0/747352348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06ea81b0 0x55fe07278800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.185+0000 7f45a99f7740 1 --2- 172.21.15.63:0/747352348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06ed1070 0x55fe072782c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.185+0000 7f45a99f7740 1 -- 172.21.15.63:0/747352348 >> 172.21.15.63:0/747352348 conn(0x55fe06ec5460 msgr2=0x55fe072761b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.185+0000 7f45a99f7740 1 -- 172.21.15.63:0/747352348 shutdown_connections 2024-09-21T06:31:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.185+0000 7f45a99f7740 1 -- 172.21.15.63:0/747352348 wait complete. 2024-09-21T06:31:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.186+0000 7f45a99f7740 1 -- start start 2024-09-21T06:31:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.186+0000 7f45a99f7740 1 Processor -- start 2024-09-21T06:31:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.186+0000 7f45a99f7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06ea81b0 0x55fe07287d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.186+0000 7f45a99f7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06eb0390 0x55fe07288280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.186+0000 7f45a99f7740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06ed1070 0x55fe07288800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.186+0000 7f45a99f7740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55fe0703f700 con 0x55fe06ed1070 2024-09-21T06:31:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.186+0000 7f45a99f7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55fe07179160 con 0x55fe06eb0390 2024-09-21T06:31:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.186+0000 7f45a99f7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fe0728ada0 con 0x55fe06ea81b0 2024-09-21T06:31:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.187+0000 7f45a0a1e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06eb0390 0x55fe07288280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.187+0000 7f45a99f7740 10 client.0 _ll_register_callbacks cb 0x55fe071929e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:31:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.187+0000 7f45a0a1e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06eb0390 0x55fe07288280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:53604/0 (socket says 172.21.15.63:53604) 2024-09-21T06:31:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.187+0000 7f45a0a1e640 1 -- 172.21.15.63:0/2780058989 learned_addr learned my addr 172.21.15.63:0/2780058989 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.187+0000 7f45a1a20640 1 --2- 172.21.15.63:0/2780058989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06ed1070 0x55fe07288800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.187+0000 7f45a121f640 1 --2- 172.21.15.63:0/2780058989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06ea81b0 0x55fe07287d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.187+0000 7f45a0a1e640 1 -- 172.21.15.63:0/2780058989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06ea81b0 msgr2=0x55fe07287d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.187+0000 7f45a0a1e640 1 --2- 172.21.15.63:0/2780058989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06ea81b0 0x55fe07287d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.187+0000 7f45a0a1e640 1 -- 172.21.15.63:0/2780058989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06ed1070 msgr2=0x55fe07288800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.187+0000 7f45a0a1e640 1 --2- 172.21.15.63:0/2780058989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06ed1070 0x55fe07288800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.187+0000 7f45a0a1e640 1 -- 172.21.15.63:0/2780058989 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe071a6c90 con 0x55fe06eb0390 2024-09-21T06:31:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.187+0000 7f45a0a1e640 1 --2- 172.21.15.63:0/2780058989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06eb0390 0x55fe07288280 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f458c02abd0 tx=0x7f458c005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f58d3893bec9e4cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.187+0000 7f4584ff9640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:31:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.188+0000 7f4584ff9640 1 -- 172.21.15.63:0/2780058989 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c052060 con 0x55fe06eb0390 2024-09-21T06:31:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.188+0000 7f45a99f7740 1 -- 172.21.15.63:0/2780058989 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f458c004030 con 0x55fe06eb0390 2024-09-21T06:31:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.188+0000 7f4584ff9640 1 -- 172.21.15.63:0/2780058989 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f458c0054a0 con 0x55fe06eb0390 2024-09-21T06:31:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.188+0000 7f4584ff9640 1 -- 172.21.15.63:0/2780058989 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f458c035070 con 0x55fe06eb0390 2024-09-21T06:31:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.188+0000 7f45a99f7740 10 client.25871 fetch_fsmap learned FSMap version 43 2024-09-21T06:31:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.188+0000 7f45a99f7740 1 -- 172.21.15.63:0/2780058989 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55fe072969f0 con 0x55fe06eb0390 2024-09-21T06:31:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.188+0000 7f4584ff9640 1 -- 172.21.15.63:0/2780058989 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f458c004030 con 0x55fe06eb0390 2024-09-21T06:31:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.188+0000 7f4584ff9640 1 -- 172.21.15.63:0/2780058989 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f458c004d90 con 0x55fe06eb0390 2024-09-21T06:31:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.188+0000 7f45a99f7740 10 client.25871 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:31:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.188+0000 7f45a99f7740 10 client.25871 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:31:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.188+0000 7f45a99f7740 20 client.25871 populate_metadata read hostname 'smithi063' 2024-09-21T06:31:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.188+0000 7f45a99f7740 1 --2- 172.21.15.63:0/2780058989 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55fe06e8f9f0 0x55fe07299d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.188+0000 7f45a99f7740 4 client.25871 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:31:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.188+0000 7f45a99f7740 1 -- 172.21.15.63:0/2780058989 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe071f0df0 con 0x55fe06e8f9f0 2024-09-21T06:31:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.189+0000 7f45a121f640 1 --2- 172.21.15.63:0/2780058989 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55fe06e8f9f0 0x55fe07299d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.189+0000 7f4584ff9640 10 client.25871 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:31:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.189+0000 7f45a121f640 1 --2- 172.21.15.63:0/2780058989 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55fe06e8f9f0 0x55fe07299d50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=84c98d4c8593515d server_cookie=4aa90fc617f2346a in_seq=0 out_seq=0 2024-09-21T06:31:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.190+0000 7f4584ff9640 1 -- 172.21.15.63:0/2780058989 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fe071f0df0 con 0x55fe06e8f9f0 2024-09-21T06:31:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.190+0000 7f4584ff9640 10 client.25871 handle_command_reply: tid=0 2024-09-21T06:31:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.190+0000 7f45a99f7740 1 client.25871 shutdown 2024-09-21T06:31:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.190+0000 7f45a99f7740 1 -- 172.21.15.63:0/2780058989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06eb0390 msgr2=0x55fe07288280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.190+0000 7f45a99f7740 1 --2- 172.21.15.63:0/2780058989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06eb0390 0x55fe07288280 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f458c02abd0 tx=0x7f458c005ef0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.190+0000 7f45a99f7740 1 -- 172.21.15.63:0/2780058989 shutdown_connections 2024-09-21T06:31:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.190+0000 7f45a99f7740 1 --2- 172.21.15.63:0/2780058989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06ed1070 0x55fe07288800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.190+0000 7f45a99f7740 1 --2- 172.21.15.63:0/2780058989 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55fe06e8f9f0 0x55fe07299d50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.190+0000 7f45a99f7740 1 --2- 172.21.15.63:0/2780058989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06eb0390 0x55fe07288280 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.190+0000 7f4584ff9640 0 client.25871 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:31:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.190+0000 7f45a99f7740 1 --2- 172.21.15.63:0/2780058989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06ea81b0 0x55fe07287d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.190+0000 7f45a99f7740 1 -- 172.21.15.63:0/2780058989 >> 172.21.15.63:0/2780058989 conn(0x55fe06ec5460 msgr2=0x55fe07274750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.190+0000 7f45a99f7740 1 -- 172.21.15.63:0/2780058989 shutdown_connections 2024-09-21T06:31:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.190+0000 7f45a99f7740 1 -- 172.21.15.63:0/2780058989 wait complete. 2024-09-21T06:31:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.191+0000 7f45a99f7740 20 client.25871 trim_cache size 0 max 16384 2024-09-21T06:31:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.205+0000 7f45a99f7740 1 Processor -- start 2024-09-21T06:31:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.205+0000 7f45a99f7740 1 -- start start 2024-09-21T06:31:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.205+0000 7f45a99f7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06e8f9f0 0x55fe07288200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.205+0000 7f45a99f7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06ea81b0 0x55fe07275af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.205+0000 7f45a99f7740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06eb0390 0x55fe07276030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.205+0000 7f45a99f7740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f459c1ad500 con 0x55fe06eb0390 2024-09-21T06:31:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.205+0000 7f45a99f7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f459c1af100 con 0x55fe06e8f9f0 2024-09-21T06:31:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.205+0000 7f45a99f7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f459c1adc90 con 0x55fe06ea81b0 2024-09-21T06:31:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.205+0000 7f45a121f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06e8f9f0 0x55fe07288200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.205+0000 7f45a121f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06e8f9f0 0x55fe07288200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:53612/0 (socket says 172.21.15.63:53612) 2024-09-21T06:31:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.205+0000 7f45a121f640 1 -- 172.21.15.63:0/3373506556 learned_addr learned my addr 172.21.15.63:0/3373506556 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.205+0000 7f45a1a20640 1 --2- 172.21.15.63:0/3373506556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06eb0390 0x55fe07276030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.205+0000 7f45a0a1e640 1 --2- 172.21.15.63:0/3373506556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06ea81b0 0x55fe07275af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.205+0000 7f45a121f640 1 -- 172.21.15.63:0/3373506556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06ea81b0 msgr2=0x55fe07275af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.206+0000 7f45a121f640 1 --2- 172.21.15.63:0/3373506556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06ea81b0 0x55fe07275af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.206+0000 7f45a121f640 1 -- 172.21.15.63:0/3373506556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06eb0390 msgr2=0x55fe07276030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.206+0000 7f45a121f640 1 --2- 172.21.15.63:0/3373506556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06eb0390 0x55fe07276030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.206+0000 7f45a121f640 1 -- 172.21.15.63:0/3373506556 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe0727b100 con 0x55fe06e8f9f0 2024-09-21T06:31:23.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.206+0000 7f45a0a1e640 1 --2- 172.21.15.63:0/3373506556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06ea81b0 0x55fe07275af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:23.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.206+0000 7f45a121f640 1 --2- 172.21.15.63:0/3373506556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06e8f9f0 0x55fe07288200 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f45980a9f00 tx=0x7f45980eb5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cbfb9d0cb82bd17 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:23.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.206+0000 7f4586ffd640 1 -- 172.21.15.63:0/3373506556 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45980ad280 con 0x55fe06e8f9f0 2024-09-21T06:31:23.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.206+0000 7f4586ffd640 1 -- 172.21.15.63:0/3373506556 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45980ee070 con 0x55fe06e8f9f0 2024-09-21T06:31:23.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.206+0000 7f4586ffd640 1 -- 172.21.15.63:0/3373506556 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45980a90a0 con 0x55fe06e8f9f0 2024-09-21T06:31:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.207+0000 7f45a99f7740 1 -- 172.21.15.63:0/3373506556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06e8f9f0 msgr2=0x55fe07288200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.207+0000 7f45a99f7740 1 --2- 172.21.15.63:0/3373506556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06e8f9f0 0x55fe07288200 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f45980a9f00 tx=0x7f45980eb5a0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.207+0000 7f45a99f7740 1 -- 172.21.15.63:0/3373506556 shutdown_connections 2024-09-21T06:31:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.207+0000 7f45a99f7740 1 --2- 172.21.15.63:0/3373506556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06eb0390 0x55fe07276030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.207+0000 7f45a99f7740 1 --2- 172.21.15.63:0/3373506556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06ea81b0 0x55fe07275af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.207+0000 7f45a99f7740 1 --2- 172.21.15.63:0/3373506556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06e8f9f0 0x55fe07288200 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.207+0000 7f45a99f7740 1 -- 172.21.15.63:0/3373506556 >> 172.21.15.63:0/3373506556 conn(0x55fe06ec5460 msgr2=0x55fe07287af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.207+0000 7f45a99f7740 1 -- 172.21.15.63:0/3373506556 shutdown_connections 2024-09-21T06:31:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.207+0000 7f45a99f7740 1 -- 172.21.15.63:0/3373506556 wait complete. 2024-09-21T06:31:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.207+0000 7f45a99f7740 1 -- start start 2024-09-21T06:31:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.208+0000 7f45a99f7740 1 Processor -- start 2024-09-21T06:31:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.208+0000 7f45a99f7740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06e8f9f0 0x55fe0729ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.208+0000 7f45a99f7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06ea81b0 0x55fe0729b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.208+0000 7f45a99f7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06eb0390 0x55fe0729b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.208+0000 7f45a99f7740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f459c1aea30 con 0x55fe06e8f9f0 2024-09-21T06:31:23.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.208+0000 7f45a99f7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f459c1ae360 con 0x55fe06ea81b0 2024-09-21T06:31:23.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.208+0000 7f45a99f7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f459c1ab4e0 con 0x55fe06eb0390 2024-09-21T06:31:23.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.208+0000 7f45a99f7740 10 client.0 _ll_register_callbacks cb 0x7f45980eb470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:31:23.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.208+0000 7f45a121f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06e8f9f0 0x55fe0729ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.208+0000 7f45a0a1e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06ea81b0 0x55fe0729b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.208+0000 7f45a1a20640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06eb0390 0x55fe0729b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.208+0000 7f45a121f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06e8f9f0 0x55fe0729ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47956/0 (socket says 172.21.15.63:47956) 2024-09-21T06:31:23.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.208+0000 7f45a121f640 1 -- 172.21.15.63:0/3998138590 learned_addr learned my addr 172.21.15.63:0/3998138590 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:23.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.208+0000 7f45a0a1e640 1 --2- 172.21.15.63:0/3998138590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06ea81b0 0x55fe0729b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:53626/0 (socket says 172.21.15.63:53626) 2024-09-21T06:31:23.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.209+0000 7f45a121f640 1 -- 172.21.15.63:0/3998138590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06eb0390 msgr2=0x55fe0729b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:23.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.209+0000 7f45a121f640 1 --2- 172.21.15.63:0/3998138590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06eb0390 0x55fe0729b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.209+0000 7f45a121f640 1 -- 172.21.15.63:0/3998138590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06ea81b0 msgr2=0x55fe0729b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:23.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.209+0000 7f45a121f640 1 --2- 172.21.15.63:0/3998138590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06ea81b0 0x55fe0729b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.209+0000 7f45a121f640 1 -- 172.21.15.63:0/3998138590 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe07303550 con 0x55fe06e8f9f0 2024-09-21T06:31:23.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.209+0000 7f45a0a1e640 1 --2- 172.21.15.63:0/3998138590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06ea81b0 0x55fe0729b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:23.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.209+0000 7f45a121f640 1 --2- 172.21.15.63:0/3998138590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06e8f9f0 0x55fe0729ae00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f45980097b0 tx=0x7f45980b2360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8296b2e8dd524bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:23.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.209+0000 7f4584ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:31:23.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.209+0000 7f4584ff9640 1 -- 172.21.15.63:0/3998138590 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45980ad0a0 con 0x55fe06e8f9f0 2024-09-21T06:31:23.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.209+0000 7f4584ff9640 1 -- 172.21.15.63:0/3998138590 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f45980aebb0 con 0x55fe06e8f9f0 2024-09-21T06:31:23.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.209+0000 7f45a99f7740 1 -- 172.21.15.63:0/3998138590 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45980ee070 con 0x55fe06e8f9f0 2024-09-21T06:31:23.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.209+0000 7f4584ff9640 1 -- 172.21.15.63:0/3998138590 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f4598010720 con 0x55fe06e8f9f0 2024-09-21T06:31:23.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.209+0000 7f45a99f7740 10 client.16230 fetch_fsmap learned FSMap version 43 2024-09-21T06:31:23.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.209+0000 7f45a99f7740 1 -- 172.21.15.63:0/3998138590 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55fe07304800 con 0x55fe06e8f9f0 2024-09-21T06:31:23.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.209+0000 7f4584ff9640 1 -- 172.21.15.63:0/3998138590 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45980ee070 con 0x55fe06e8f9f0 2024-09-21T06:31:23.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.209+0000 7f4584ff9640 1 -- 172.21.15.63:0/3998138590 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f45980d4070 con 0x55fe06e8f9f0 2024-09-21T06:31:23.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.210+0000 7f45a99f7740 10 client.16230 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:31:23.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.210+0000 7f45a99f7740 10 client.16230 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:31:23.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.210+0000 7f45a99f7740 20 client.16230 populate_metadata read hostname 'smithi063' 2024-09-21T06:31:23.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.210+0000 7f45a99f7740 1 --2- 172.21.15.63:0/3998138590 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55fe06ed1070 0x55fe07306f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.210+0000 7f45a99f7740 4 client.16230 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:31:23.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.210+0000 7f45a99f7740 1 -- 172.21.15.63:0/3998138590 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fe071ec8a0 con 0x55fe06ed1070 2024-09-21T06:31:23.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.210+0000 7f45a0a1e640 1 --2- 172.21.15.63:0/3998138590 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55fe06ed1070 0x55fe07306f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.210+0000 7f4584ff9640 10 client.16230 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:31:23.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.210+0000 7f45a0a1e640 1 --2- 172.21.15.63:0/3998138590 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55fe06ed1070 0x55fe07306f40 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e2dbe57199fd2225 server_cookie=604aaee18d159cb3 in_seq=0 out_seq=0 2024-09-21T06:31:23.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.210+0000 7f4584ff9640 1 -- 172.21.15.63:0/3998138590 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fe071ec8a0 con 0x55fe06ed1070 2024-09-21T06:31:23.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.210+0000 7f4584ff9640 10 client.16230 handle_command_reply: tid=0 2024-09-21T06:31:23.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.211+0000 7f45a99f7740 1 client.16230 shutdown 2024-09-21T06:31:23.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.211+0000 7f45a99f7740 1 -- 172.21.15.63:0/3998138590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06e8f9f0 msgr2=0x55fe0729ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:23.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.211+0000 7f45a99f7740 1 --2- 172.21.15.63:0/3998138590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06e8f9f0 0x55fe0729ae00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f45980097b0 tx=0x7f45980b2360 comp rx=0 tx=0).stop 2024-09-21T06:31:23.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.211+0000 7f45a99f7740 1 -- 172.21.15.63:0/3998138590 shutdown_connections 2024-09-21T06:31:23.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.211+0000 7f45a99f7740 1 --2- 172.21.15.63:0/3998138590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe06eb0390 0x55fe0729b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.211+0000 7f45a99f7740 1 --2- 172.21.15.63:0/3998138590 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55fe06ed1070 0x55fe07306f40 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.211+0000 7f45a99f7740 1 --2- 172.21.15.63:0/3998138590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe06ea81b0 0x55fe0729b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.211+0000 7f45a99f7740 1 --2- 172.21.15.63:0/3998138590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fe06e8f9f0 0x55fe0729ae00 secure :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f45980097b0 tx=0x7f45980b2360 comp rx=0 tx=0).stop 2024-09-21T06:31:23.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.211+0000 7f45a99f7740 1 -- 172.21.15.63:0/3998138590 >> 172.21.15.63:0/3998138590 conn(0x55fe06ec5460 msgr2=0x55fe0727d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:23.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.211+0000 7f4584ff9640 0 client.16230 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:31:23.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.211+0000 7f45a99f7740 1 -- 172.21.15.63:0/3998138590 shutdown_connections 2024-09-21T06:31:23.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.211+0000 7f45a99f7740 1 -- 172.21.15.63:0/3998138590 wait complete. 2024-09-21T06:31:23.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.211+0000 7f45a99f7740 20 client.16230 trim_cache size 0 max 16384 2024-09-21T06:31:23.219 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:31:23.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.212+0000 7f45a3483640 1 -- 172.21.15.63:0/2715721891 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f45880b66b0 msgr2=0x7f45880b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:23.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.212+0000 7f45a3483640 1 --2- 172.21.15.63:0/2715721891 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f45880b66b0 0x7f45880b8bc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4594005fd0 tx=0x7f45940096a0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.212+0000 7f45a3483640 1 -- 172.21.15.63:0/2715721891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f459c102a80 msgr2=0x7f459c19b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:23.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.212+0000 7f45a3483640 1 --2- 172.21.15.63:0/2715721891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f459c102a80 0x7f459c19b350 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f459800e9f0 tx=0x7f459800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.212+0000 7f45a3483640 1 -- 172.21.15.63:0/2715721891 shutdown_connections 2024-09-21T06:31:23.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.212+0000 7f45a3483640 1 --2- 172.21.15.63:0/2715721891 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f45880b66b0 0x7f45880b8bc0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.212+0000 7f45a3483640 1 --2- 172.21.15.63:0/2715721891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f459c108d10 0x7f459c19bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.212+0000 7f45a3483640 1 --2- 172.21.15.63:0/2715721891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f459c1083c0 0x7f459c19b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.212+0000 7f45a3483640 1 --2- 172.21.15.63:0/2715721891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f459c102a80 0x7f459c19b350 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.212+0000 7f45a3483640 1 -- 172.21.15.63:0/2715721891 >> 172.21.15.63:0/2715721891 conn(0x7f459c079740 msgr2=0x7f459c1044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:23.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.212+0000 7f45a3483640 1 -- 172.21.15.63:0/2715721891 shutdown_connections 2024-09-21T06:31:23.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:23.212+0000 7f45a3483640 1 -- 172.21.15.63:0/2715721891 wait complete. 2024-09-21T06:31:23.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:23 smithi071 ceph-mon[34844]: pgmap v418: 97 pgs: 97 active+clean; 102 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 538 op/s 2024-09-21T06:31:23.829 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:23 smithi063 ceph-mon[31150]: pgmap v418: 97 pgs: 97 active+clean; 102 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 538 op/s 2024-09-21T06:31:23.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:23 smithi175 ceph-mon[34510]: pgmap v418: 97 pgs: 97 active+clean; 102 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 538 op/s 2024-09-21T06:31:23.908 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:31:24.202 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:31:24.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.779+0000 7f9b65440640 1 -- 172.21.15.63:0/2254679938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b60102a60 msgr2=0x7f9b60102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:24.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.779+0000 7f9b65440640 1 --2- 172.21.15.63:0/2254679938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b60102a60 0x7f9b60102e70 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009900 tx=0x7f9b5002a410 comp rx=0 tx=0).stop 2024-09-21T06:31:24.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.779+0000 7f9b65440640 1 -- 172.21.15.63:0/2254679938 shutdown_connections 2024-09-21T06:31:24.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.779+0000 7f9b65440640 1 --2- 172.21.15.63:0/2254679938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b60108cf0 0x7f9b6010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.779+0000 7f9b65440640 1 --2- 172.21.15.63:0/2254679938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b601083a0 0x7f9b601087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.779+0000 7f9b65440640 1 --2- 172.21.15.63:0/2254679938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b60102a60 0x7f9b60102e70 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.779+0000 7f9b65440640 1 -- 172.21.15.63:0/2254679938 >> 172.21.15.63:0/2254679938 conn(0x7f9b60079730 msgr2=0x7f9b60079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:24.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.779+0000 7f9b65440640 1 -- 172.21.15.63:0/2254679938 shutdown_connections 2024-09-21T06:31:24.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.779+0000 7f9b65440640 1 -- 172.21.15.63:0/2254679938 wait complete. 2024-09-21T06:31:24.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.780+0000 7f9b65440640 1 Processor -- start 2024-09-21T06:31:24.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.780+0000 7f9b65440640 1 -- start start 2024-09-21T06:31:24.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.780+0000 7f9b65440640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b60102a60 0x7f9b6019c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:24.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.780+0000 7f9b65440640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b601083a0 0x7f9b6019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:24.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.780+0000 7f9b65440640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b60108cf0 0x7f9b601a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:24.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.780+0000 7f9b65440640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9b60111860 con 0x7f9b601083a0 2024-09-21T06:31:24.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.780+0000 7f9b65440640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9b601116e0 con 0x7f9b60108cf0 2024-09-21T06:31:24.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.780+0000 7f9b65440640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b601119e0 con 0x7f9b60102a60 2024-09-21T06:31:24.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.781+0000 7f9b57fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b601083a0 0x7f9b6019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:24.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.781+0000 7f9b5f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b60108cf0 0x7f9b601a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:24.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.781+0000 7f9b57fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b601083a0 0x7f9b6019cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47984/0 (socket says 172.21.15.63:47984) 2024-09-21T06:31:24.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.781+0000 7f9b5effd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b60102a60 0x7f9b6019c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:24.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.781+0000 7f9b57fff640 1 -- 172.21.15.63:0/3623897990 learned_addr learned my addr 172.21.15.63:0/3623897990 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:24.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.781+0000 7f9b5f7fe640 1 -- 172.21.15.63:0/3623897990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b60102a60 msgr2=0x7f9b6019c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:24.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.781+0000 7f9b5f7fe640 1 --2- 172.21.15.63:0/3623897990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b60102a60 0x7f9b6019c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.781+0000 7f9b5f7fe640 1 -- 172.21.15.63:0/3623897990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b601083a0 msgr2=0x7f9b6019cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:24.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.781+0000 7f9b5f7fe640 1 --2- 172.21.15.63:0/3623897990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b601083a0 0x7f9b6019cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.781+0000 7f9b5f7fe640 1 -- 172.21.15.63:0/3623897990 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b601a2590 con 0x7f9b60108cf0 2024-09-21T06:31:24.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.781+0000 7f9b5effd640 1 --2- 172.21.15.63:0/3623897990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b60102a60 0x7f9b6019c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:24.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.781+0000 7f9b57fff640 1 --2- 172.21.15.63:0/3623897990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b601083a0 0x7f9b6019cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:24.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.781+0000 7f9b5f7fe640 1 --2- 172.21.15.63:0/3623897990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b60108cf0 0x7f9b601a1e60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9b58009fd0 tx=0x7f9b5800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:24.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.781+0000 7f9b5cff9640 1 -- 172.21.15.63:0/3623897990 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5800ce20 con 0x7f9b60108cf0 2024-09-21T06:31:24.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.781+0000 7f9b65440640 1 -- 172.21.15.63:0/3623897990 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b601a2880 con 0x7f9b60108cf0 2024-09-21T06:31:24.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.782+0000 7f9b5cff9640 1 -- 172.21.15.63:0/3623897990 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b58005020 con 0x7f9b60108cf0 2024-09-21T06:31:24.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.782+0000 7f9b65440640 1 -- 172.21.15.63:0/3623897990 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b601a8fe0 con 0x7f9b60108cf0 2024-09-21T06:31:24.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.782+0000 7f9b5cff9640 1 -- 172.21.15.63:0/3623897990 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b58010690 con 0x7f9b60108cf0 2024-09-21T06:31:24.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.784+0000 7f9b5cff9640 1 -- 172.21.15.63:0/3623897990 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f9b58010830 con 0x7f9b60108cf0 2024-09-21T06:31:24.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.785+0000 7f9b6b9b4740 1 Processor -- start 2024-09-21T06:31:24.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.785+0000 7f9b6b9b4740 1 -- start start 2024-09-21T06:31:24.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.785+0000 7f9b6b9b4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c65070 0x557d3600c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:24.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.785+0000 7f9b6b9b4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 0x557d3600c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:24.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.785+0000 7f9b6b9b4740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c44390 0x557d3600cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:24.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.785+0000 7f9b6b9b4740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x557d35f82ea0 con 0x557d35c44390 2024-09-21T06:31:24.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.785+0000 7f9b6b9b4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557d35f722d0 con 0x557d35c65070 2024-09-21T06:31:24.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.785+0000 7f9b6b9b4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557d35f760e0 con 0x557d35c3c1b0 2024-09-21T06:31:24.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.786+0000 7f9b5effd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 0x557d3600c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:24.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.786+0000 7f9b5effd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 0x557d3600c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:45092/0 (socket says 172.21.15.63:45092) 2024-09-21T06:31:24.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.786+0000 7f9b5effd640 1 -- 172.21.15.63:0/1535081873 learned_addr learned my addr 172.21.15.63:0/1535081873 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:24.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.786+0000 7f9b57fff640 1 --2- 172.21.15.63:0/1535081873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c65070 0x557d3600c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:24.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.786+0000 7f9b57fff640 1 --2- 172.21.15.63:0/1535081873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c44390 0x557d3600cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:24.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.786+0000 7f9b5effd640 1 -- 172.21.15.63:0/1535081873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c65070 msgr2=0x557d3600c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:24.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.786+0000 7f9b5effd640 1 --2- 172.21.15.63:0/1535081873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c65070 0x557d3600c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.786+0000 7f9b5effd640 1 -- 172.21.15.63:0/1535081873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c44390 msgr2=0x557d3600cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:24.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.786+0000 7f9b5effd640 1 --2- 172.21.15.63:0/1535081873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c44390 0x557d3600cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.786+0000 7f9b5effd640 1 -- 172.21.15.63:0/1535081873 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d35cd0650 con 0x557d35c3c1b0 2024-09-21T06:31:24.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.786+0000 7f9b57fff640 1 --2- 172.21.15.63:0/1535081873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c65070 0x557d3600c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:31:24.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.786+0000 7f9b5cff9640 1 --2- 172.21.15.63:0/3623897990 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9b4c0b6670 0x7f9b4c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:24.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.786+0000 7f9b57fff640 1 --2- 172.21.15.63:0/3623897990 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9b4c0b6670 0x7f9b4c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:24.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.786+0000 7f9b5effd640 1 --2- 172.21.15.63:0/1535081873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 0x557d3600c800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009900 tx=0x7f9b50005e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c7bfff0afd2bab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:24.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.787+0000 7f9b5cff9640 1 -- 172.21.15.63:0/3623897990 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f9b580e7cf0 con 0x7f9b60108cf0 2024-09-21T06:31:24.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.787+0000 7f9b557fa640 1 -- 172.21.15.63:0/1535081873 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b50040070 con 0x557d35c3c1b0 2024-09-21T06:31:24.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.787+0000 7f9b557fa640 1 -- 172.21.15.63:0/1535081873 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b50031720 con 0x557d35c3c1b0 2024-09-21T06:31:24.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.787+0000 7f9b557fa640 1 -- 172.21.15.63:0/1535081873 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b50035040 con 0x557d35c3c1b0 2024-09-21T06:31:24.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.788+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/1535081873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 msgr2=0x557d3600c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:24.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.788+0000 7f9b57fff640 1 --2- 172.21.15.63:0/3623897990 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9b4c0b6670 0x7f9b4c0b8b80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9b480095f0 tx=0x7f9b48005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:24.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.788+0000 7f9b6b9b4740 1 --2- 172.21.15.63:0/1535081873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 0x557d3600c800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009900 tx=0x7f9b50005e20 comp rx=0 tx=0).stop 2024-09-21T06:31:24.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.788+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/1535081873 shutdown_connections 2024-09-21T06:31:24.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.788+0000 7f9b6b9b4740 1 --2- 172.21.15.63:0/1535081873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c44390 0x557d3600cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.788+0000 7f9b6b9b4740 1 --2- 172.21.15.63:0/1535081873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 0x557d3600c800 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.788+0000 7f9b6b9b4740 1 --2- 172.21.15.63:0/1535081873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c65070 0x557d3600c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.788+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/1535081873 >> 172.21.15.63:0/1535081873 conn(0x557d35c59460 msgr2=0x557d3600a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:24.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.788+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/1535081873 shutdown_connections 2024-09-21T06:31:24.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.788+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/1535081873 wait complete. 2024-09-21T06:31:24.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.788+0000 7f9b6b9b4740 1 -- start start 2024-09-21T06:31:24.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.789+0000 7f9b6b9b4740 1 Processor -- start 2024-09-21T06:31:24.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.789+0000 7f9b6b9b4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 0x557d360179c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:24.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.789+0000 7f9b6b9b4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c44390 0x557d36017f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:24.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.789+0000 7f9b6b9b4740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c65070 0x557d36023dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:24.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.789+0000 7f9b6b9b4740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x557d35dd3700 con 0x557d35c65070 2024-09-21T06:31:24.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.789+0000 7f9b6b9b4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557d35f0d160 con 0x557d35c44390 2024-09-21T06:31:24.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.789+0000 7f9b6b9b4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557d3601aa40 con 0x557d35c3c1b0 2024-09-21T06:31:24.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.789+0000 7f9b6b9b4740 10 client.0 _ll_register_callbacks cb 0x557d35f269e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:31:24.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.789+0000 7f9b57fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c44390 0x557d36017f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:24.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.789+0000 7f9b57fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c44390 0x557d36017f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:53662/0 (socket says 172.21.15.63:53662) 2024-09-21T06:31:24.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.789+0000 7f9b57fff640 1 -- 172.21.15.63:0/1477182827 learned_addr learned my addr 172.21.15.63:0/1477182827 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:24.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.789+0000 7f9b5effd640 1 --2- 172.21.15.63:0/1477182827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 0x557d360179c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:24.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.789+0000 7f9b5f7fe640 1 --2- 172.21.15.63:0/1477182827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c65070 0x557d36023dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:24.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.790+0000 7f9b5effd640 1 -- 172.21.15.63:0/1477182827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c44390 msgr2=0x557d36017f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:24.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.790+0000 7f9b5effd640 1 --2- 172.21.15.63:0/1477182827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c44390 0x557d36017f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.790+0000 7f9b5effd640 1 -- 172.21.15.63:0/1477182827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c65070 msgr2=0x557d36023dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:24.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.790+0000 7f9b5effd640 1 --2- 172.21.15.63:0/1477182827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c65070 0x557d36023dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.790+0000 7f9b5effd640 1 -- 172.21.15.63:0/1477182827 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d35f3ac90 con 0x557d35c3c1b0 2024-09-21T06:31:24.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.790+0000 7f9b57fff640 1 --2- 172.21.15.63:0/1477182827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c44390 0x557d36017f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:24.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.790+0000 7f9b5effd640 1 --2- 172.21.15.63:0/1477182827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 0x557d360179c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9b5002a930 tx=0x7f9b500053f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61f95f1c6dc27ed5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:24.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.790+0000 7f9b467fc640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:31:24.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.790+0000 7f9b467fc640 1 -- 172.21.15.63:0/1477182827 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5004a070 con 0x557d35c3c1b0 2024-09-21T06:31:24.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.790+0000 7f9b467fc640 1 -- 172.21.15.63:0/1477182827 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f9b500035f0 con 0x557d35c3c1b0 2024-09-21T06:31:24.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.790+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/1477182827 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b50031720 con 0x557d35c3c1b0 2024-09-21T06:31:24.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.790+0000 7f9b467fc640 1 -- 172.21.15.63:0/1477182827 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f9b50035040 con 0x557d35c3c1b0 2024-09-21T06:31:24.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.790+0000 7f9b6b9b4740 10 client.25954 fetch_fsmap learned FSMap version 43 2024-09-21T06:31:24.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.790+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/1477182827 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x557d360267c0 con 0x557d35c3c1b0 2024-09-21T06:31:24.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.791+0000 7f9b467fc640 1 -- 172.21.15.63:0/1477182827 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b50031720 con 0x557d35c3c1b0 2024-09-21T06:31:24.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.791+0000 7f9b467fc640 1 -- 172.21.15.63:0/1477182827 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f9b5004f4f0 con 0x557d35c3c1b0 2024-09-21T06:31:24.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.791+0000 7f9b6b9b4740 10 client.25954 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:31:24.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.791+0000 7f9b6b9b4740 10 client.25954 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:31:24.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.791+0000 7f9b6b9b4740 20 client.25954 populate_metadata read hostname 'smithi063' 2024-09-21T06:31:24.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.791+0000 7f9b6b9b4740 1 --2- 172.21.15.63:0/1477182827 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x557d35c239f0 0x557d36029b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:24.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.791+0000 7f9b6b9b4740 4 client.25954 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:31:24.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.791+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/1477182827 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d35f84df0 con 0x557d35c239f0 2024-09-21T06:31:24.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.791+0000 7f9b57fff640 1 --2- 172.21.15.63:0/1477182827 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x557d35c239f0 0x557d36029b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:24.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.792+0000 7f9b467fc640 10 client.25954 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:31:24.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.792+0000 7f9b57fff640 1 --2- 172.21.15.63:0/1477182827 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x557d35c239f0 0x557d36029b20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1b4796d904e3035c server_cookie=532d69aec8367581 in_seq=0 out_seq=0 2024-09-21T06:31:24.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.793+0000 7f9b467fc640 1 -- 172.21.15.63:0/1477182827 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557d35f84df0 con 0x557d35c239f0 2024-09-21T06:31:24.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.793+0000 7f9b467fc640 10 client.25954 handle_command_reply: tid=0 2024-09-21T06:31:24.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.793+0000 7f9b6b9b4740 1 client.25954 shutdown 2024-09-21T06:31:24.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.793+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/1477182827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 msgr2=0x557d360179c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:24.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.793+0000 7f9b6b9b4740 1 --2- 172.21.15.63:0/1477182827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 0x557d360179c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9b5002a930 tx=0x7f9b500053f0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.793+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/1477182827 shutdown_connections 2024-09-21T06:31:24.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.793+0000 7f9b6b9b4740 1 --2- 172.21.15.63:0/1477182827 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x557d35c239f0 0x557d36029b20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.793+0000 7f9b6b9b4740 1 --2- 172.21.15.63:0/1477182827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c65070 0x557d36023dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.793+0000 7f9b467fc640 0 client.25954 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:31:24.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.793+0000 7f9b6b9b4740 1 --2- 172.21.15.63:0/1477182827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c44390 0x557d36017f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.793+0000 7f9b6b9b4740 1 --2- 172.21.15.63:0/1477182827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 0x557d360179c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.793+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/1477182827 >> 172.21.15.63:0/1477182827 conn(0x557d35c59460 msgr2=0x557d3600f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:24.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.793+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/1477182827 shutdown_connections 2024-09-21T06:31:24.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.793+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/1477182827 wait complete. 2024-09-21T06:31:24.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.793+0000 7f9b6b9b4740 20 client.25954 trim_cache size 0 max 16384 2024-09-21T06:31:24.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.809+0000 7f9b6b9b4740 1 Processor -- start 2024-09-21T06:31:24.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.809+0000 7f9b6b9b4740 1 -- start start 2024-09-21T06:31:24.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.809+0000 7f9b6b9b4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c239f0 0x557d3600da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:24.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.809+0000 7f9b6b9b4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 0x557d36009760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:24.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.809+0000 7f9b6b9b4740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c44390 0x557d36009ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:24.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.809+0000 7f9b6b9b4740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4000e7c0 con 0x557d35c44390 2024-09-21T06:31:24.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.809+0000 7f9b6b9b4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9b400103c0 con 0x557d35c239f0 2024-09-21T06:31:24.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.809+0000 7f9b6b9b4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4000ef50 con 0x557d35c3c1b0 2024-09-21T06:31:24.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.809+0000 7f9b5f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c44390 0x557d36009ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:24.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.809+0000 7f9b5f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c44390 0x557d36009ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48022/0 (socket says 172.21.15.63:48022) 2024-09-21T06:31:24.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.809+0000 7f9b5f7fe640 1 -- 172.21.15.63:0/3585200461 learned_addr learned my addr 172.21.15.63:0/3585200461 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:24.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.809+0000 7f9b5effd640 1 --2- 172.21.15.63:0/3585200461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c239f0 0x557d3600da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:24.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.810+0000 7f9b57fff640 1 --2- 172.21.15.63:0/3585200461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 0x557d36009760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:24.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.810+0000 7f9b5effd640 1 -- 172.21.15.63:0/3585200461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 msgr2=0x557d36009760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:24.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.810+0000 7f9b5effd640 1 --2- 172.21.15.63:0/3585200461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 0x557d36009760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.810+0000 7f9b5effd640 1 -- 172.21.15.63:0/3585200461 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c44390 msgr2=0x557d36009ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:24.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.810+0000 7f9b5effd640 1 --2- 172.21.15.63:0/3585200461 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c44390 0x557d36009ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.810+0000 7f9b5effd640 1 -- 172.21.15.63:0/3585200461 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d3600e5b0 con 0x557d35c239f0 2024-09-21T06:31:24.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.810+0000 7f9b5f7fe640 1 --2- 172.21.15.63:0/3585200461 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c44390 0x557d36009ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:24.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.810+0000 7f9b5effd640 1 --2- 172.21.15.63:0/3585200461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c239f0 0x557d3600da00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9b50000c00 tx=0x7f9b5002a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=518fce73aa382225 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:24.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.810+0000 7f9b54ff9640 1 -- 172.21.15.63:0/3585200461 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5005c070 con 0x557d35c239f0 2024-09-21T06:31:24.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.810+0000 7f9b54ff9640 1 -- 172.21.15.63:0/3585200461 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b5004fb00 con 0x557d35c239f0 2024-09-21T06:31:24.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.810+0000 7f9b54ff9640 1 -- 172.21.15.63:0/3585200461 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b50040040 con 0x557d35c239f0 2024-09-21T06:31:24.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.811+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/3585200461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c239f0 msgr2=0x557d3600da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:24.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.812+0000 7f9b6b9b4740 1 --2- 172.21.15.63:0/3585200461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c239f0 0x557d3600da00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9b50000c00 tx=0x7f9b5002a410 comp rx=0 tx=0).stop 2024-09-21T06:31:24.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.812+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/3585200461 shutdown_connections 2024-09-21T06:31:24.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.812+0000 7f9b6b9b4740 1 --2- 172.21.15.63:0/3585200461 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c44390 0x557d36009ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.812+0000 7f9b6b9b4740 1 --2- 172.21.15.63:0/3585200461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 0x557d36009760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.812+0000 7f9b6b9b4740 1 --2- 172.21.15.63:0/3585200461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c239f0 0x557d3600da00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.812+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/3585200461 >> 172.21.15.63:0/3585200461 conn(0x557d35c59460 msgr2=0x557d3600d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:24.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.812+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/3585200461 shutdown_connections 2024-09-21T06:31:24.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.812+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/3585200461 wait complete. 2024-09-21T06:31:24.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.812+0000 7f9b6b9b4740 1 -- start start 2024-09-21T06:31:24.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.812+0000 7f9b6b9b4740 1 Processor -- start 2024-09-21T06:31:24.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.813+0000 7f9b6b9b4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c239f0 0x557d3602d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:24.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.813+0000 7f9b6b9b4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 0x557d3602a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:24.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.813+0000 7f9b6b9b4740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c44390 0x557d3602acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:24.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.813+0000 7f9b6b9b4740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4000fcf0 con 0x557d35c44390 2024-09-21T06:31:24.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.813+0000 7f9b6b9b4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4000f620 con 0x557d35c239f0 2024-09-21T06:31:24.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.813+0000 7f9b6b9b4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4000c7a0 con 0x557d35c3c1b0 2024-09-21T06:31:24.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.813+0000 7f9b6b9b4740 10 client.0 _ll_register_callbacks cb 0x7f9b50009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:31:24.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.813+0000 7f9b5f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c44390 0x557d3602acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:24.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.813+0000 7f9b5effd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c239f0 0x557d3602d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:24.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.813+0000 7f9b5f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c44390 0x557d3602acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48038/0 (socket says 172.21.15.63:48038) 2024-09-21T06:31:24.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.813+0000 7f9b5effd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c239f0 0x557d3602d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:53678/0 (socket says 172.21.15.63:53678) 2024-09-21T06:31:24.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.813+0000 7f9b5f7fe640 1 -- 172.21.15.63:0/431366531 learned_addr learned my addr 172.21.15.63:0/431366531 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:24.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.813+0000 7f9b57fff640 1 --2- 172.21.15.63:0/431366531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 0x557d3602a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:24.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.813+0000 7f9b5effd640 1 -- 172.21.15.63:0/431366531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 msgr2=0x557d3602a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:24.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.813+0000 7f9b5effd640 1 --2- 172.21.15.63:0/431366531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 0x557d3602a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.813+0000 7f9b5effd640 1 -- 172.21.15.63:0/431366531 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c44390 msgr2=0x557d3602acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:24.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.813+0000 7f9b5effd640 1 --2- 172.21.15.63:0/431366531 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c44390 0x557d3602acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.813+0000 7f9b5effd640 1 -- 172.21.15.63:0/431366531 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d3602b3e0 con 0x557d35c239f0 2024-09-21T06:31:24.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.813+0000 7f9b5effd640 1 --2- 172.21.15.63:0/431366531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c239f0 0x557d3602d2c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9b5004f890 tx=0x7f9b50032ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0c62e1682e19885 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:24.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.813+0000 7f9b467fc640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:31:24.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.814+0000 7f9b467fc640 1 -- 172.21.15.63:0/431366531 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5005c070 con 0x557d35c239f0 2024-09-21T06:31:24.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.814+0000 7f9b467fc640 1 -- 172.21.15.63:0/431366531 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f9b50003da0 con 0x557d35c239f0 2024-09-21T06:31:24.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.814+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/431366531 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b5004fb00 con 0x557d35c239f0 2024-09-21T06:31:24.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.814+0000 7f9b467fc640 1 -- 172.21.15.63:0/431366531 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f9b5006e050 con 0x557d35c239f0 2024-09-21T06:31:24.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.814+0000 7f9b6b9b4740 10 client.25895 fetch_fsmap learned FSMap version 43 2024-09-21T06:31:24.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.814+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/431366531 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x557d36094160 con 0x557d35c239f0 2024-09-21T06:31:24.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.814+0000 7f9b467fc640 1 -- 172.21.15.63:0/431366531 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b5004fb00 con 0x557d35c239f0 2024-09-21T06:31:24.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.814+0000 7f9b467fc640 1 -- 172.21.15.63:0/431366531 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f9b500324d0 con 0x557d35c239f0 2024-09-21T06:31:24.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.814+0000 7f9b6b9b4740 10 client.25895 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:31:24.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.814+0000 7f9b6b9b4740 10 client.25895 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:31:24.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.814+0000 7f9b6b9b4740 20 client.25895 populate_metadata read hostname 'smithi063' 2024-09-21T06:31:24.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.814+0000 7f9b6b9b4740 1 --2- 172.21.15.63:0/431366531 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x557d35c65070 0x557d36096950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:24.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.815+0000 7f9b6b9b4740 4 client.25895 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:31:24.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.815+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/431366531 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557d35f808a0 con 0x557d35c65070 2024-09-21T06:31:24.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.815+0000 7f9b57fff640 1 --2- 172.21.15.63:0/431366531 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x557d35c65070 0x557d36096950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:24.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.815+0000 7f9b467fc640 10 client.25895 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:31:24.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.815+0000 7f9b57fff640 1 --2- 172.21.15.63:0/431366531 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x557d35c65070 0x557d36096950 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d6b9edafb663319f server_cookie=30e1ed8bbdde03e9 in_seq=0 out_seq=0 2024-09-21T06:31:24.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.816+0000 7f9b467fc640 1 -- 172.21.15.63:0/431366531 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557d35f808a0 con 0x557d35c65070 2024-09-21T06:31:24.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.816+0000 7f9b467fc640 10 client.25895 handle_command_reply: tid=0 2024-09-21T06:31:24.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.816+0000 7f9b6b9b4740 1 client.25895 shutdown 2024-09-21T06:31:24.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.816+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/431366531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c239f0 msgr2=0x557d3602d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:24.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.816+0000 7f9b6b9b4740 1 --2- 172.21.15.63:0/431366531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c239f0 0x557d3602d2c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9b5004f890 tx=0x7f9b50032ed0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.816+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/431366531 shutdown_connections 2024-09-21T06:31:24.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.816+0000 7f9b6b9b4740 1 --2- 172.21.15.63:0/431366531 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x557d35c65070 0x557d36096950 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.816+0000 7f9b6b9b4740 1 --2- 172.21.15.63:0/431366531 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d35c44390 0x557d3602acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.816+0000 7f9b6b9b4740 1 --2- 172.21.15.63:0/431366531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d35c3c1b0 0x557d3602a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.816+0000 7f9b467fc640 0 client.25895 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:31:24.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.816+0000 7f9b6b9b4740 1 --2- 172.21.15.63:0/431366531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d35c239f0 0x557d3602d2c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.816+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/431366531 >> 172.21.15.63:0/431366531 conn(0x557d35c59460 msgr2=0x557d3600dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:24.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.816+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/431366531 shutdown_connections 2024-09-21T06:31:24.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.816+0000 7f9b6b9b4740 1 -- 172.21.15.63:0/431366531 wait complete. 2024-09-21T06:31:24.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.816+0000 7f9b6b9b4740 20 client.25895 trim_cache size 0 max 16384 2024-09-21T06:31:24.822 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:31:24.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.817+0000 7f9b65440640 1 -- 172.21.15.63:0/3623897990 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9b4c0b6670 msgr2=0x7f9b4c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:24.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.817+0000 7f9b65440640 1 --2- 172.21.15.63:0/3623897990 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9b4c0b6670 0x7f9b4c0b8b80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9b480095f0 tx=0x7f9b48005f90 comp rx=0 tx=0).stop 2024-09-21T06:31:24.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.817+0000 7f9b65440640 1 -- 172.21.15.63:0/3623897990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b60108cf0 msgr2=0x7f9b601a1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:24.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.817+0000 7f9b65440640 1 --2- 172.21.15.63:0/3623897990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b60108cf0 0x7f9b601a1e60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9b58009fd0 tx=0x7f9b5800ef10 comp rx=0 tx=0).stop 2024-09-21T06:31:24.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.817+0000 7f9b65440640 1 -- 172.21.15.63:0/3623897990 shutdown_connections 2024-09-21T06:31:24.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.817+0000 7f9b65440640 1 --2- 172.21.15.63:0/3623897990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b60108cf0 0x7f9b601a1e60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.817+0000 7f9b65440640 1 --2- 172.21.15.63:0/3623897990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b601083a0 0x7f9b6019cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.817+0000 7f9b65440640 1 --2- 172.21.15.63:0/3623897990 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9b4c0b6670 0x7f9b4c0b8b80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.817+0000 7f9b65440640 1 --2- 172.21.15.63:0/3623897990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b60102a60 0x7f9b6019c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:24.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.817+0000 7f9b65440640 1 -- 172.21.15.63:0/3623897990 >> 172.21.15.63:0/3623897990 conn(0x7f9b60079730 msgr2=0x7f9b60101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:24.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.817+0000 7f9b65440640 1 -- 172.21.15.63:0/3623897990 shutdown_connections 2024-09-21T06:31:24.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:24.817+0000 7f9b65440640 1 -- 172.21.15.63:0/3623897990 wait complete. 2024-09-21T06:31:25.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:25 smithi071 ceph-mon[34844]: pgmap v419: 97 pgs: 97 active+clean; 103 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.5 MiB/s wr, 631 op/s 2024-09-21T06:31:25.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:25 smithi063 ceph-mon[31150]: pgmap v419: 97 pgs: 97 active+clean; 103 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.5 MiB/s wr, 631 op/s 2024-09-21T06:31:25.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:25 smithi175 ceph-mon[34510]: pgmap v419: 97 pgs: 97 active+clean; 103 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.5 MiB/s wr, 631 op/s 2024-09-21T06:31:26.663 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:31:26.664 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:31:26.951 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:31:27.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.464+0000 7fa322896640 1 -- 172.21.15.63:0/707341258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa31c108480 msgr2=0x7fa31c10ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:27.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.464+0000 7fa322896640 1 --2- 172.21.15.63:0/707341258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa31c108480 0x7fa31c10ecb0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa31400adb0 tx=0x7fa31402b7a0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.464+0000 7fa322896640 1 -- 172.21.15.63:0/707341258 shutdown_connections 2024-09-21T06:31:27.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.464+0000 7fa322896640 1 --2- 172.21.15.63:0/707341258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa31c108480 0x7fa31c10ecb0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.464+0000 7fa322896640 1 --2- 172.21.15.63:0/707341258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa31c107b30 0x7fa31c107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.464+0000 7fa322896640 1 --2- 172.21.15.63:0/707341258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa31c1021f0 0x7fa31c102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.464+0000 7fa322896640 1 -- 172.21.15.63:0/707341258 >> 172.21.15.63:0/707341258 conn(0x7fa31c077c60 msgr2=0x7fa31c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:27.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.464+0000 7fa322896640 1 -- 172.21.15.63:0/707341258 shutdown_connections 2024-09-21T06:31:27.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.464+0000 7fa322896640 1 -- 172.21.15.63:0/707341258 wait complete. 2024-09-21T06:31:27.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.465+0000 7fa322896640 1 Processor -- start 2024-09-21T06:31:27.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.465+0000 7fa322896640 1 -- start start 2024-09-21T06:31:27.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.465+0000 7fa322896640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa31c1021f0 0x7fa31c1982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:27.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.465+0000 7fa322896640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa31c107b30 0x7fa31c198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:27.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.465+0000 7fa322896640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa31c108480 0x7fa31c19db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:27.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.465+0000 7fa322896640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c1118c0 con 0x7fa31c107b30 2024-09-21T06:31:27.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.465+0000 7fa322896640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c111740 con 0x7fa31c108480 2024-09-21T06:31:27.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.465+0000 7fa322896640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c111a40 con 0x7fa31c1021f0 2024-09-21T06:31:27.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.465+0000 7fa31b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa31c107b30 0x7fa31c198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:27.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.465+0000 7fa31b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa31c107b30 0x7fa31c198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40364/0 (socket says 172.21.15.63:40364) 2024-09-21T06:31:27.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.465+0000 7fa31b7fe640 1 -- 172.21.15.63:0/2161086576 learned_addr learned my addr 172.21.15.63:0/2161086576 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:27.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.465+0000 7fa320e33640 1 --2- 172.21.15.63:0/2161086576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa31c108480 0x7fa31c19db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:27.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.465+0000 7fa31bfff640 1 --2- 172.21.15.63:0/2161086576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa31c1021f0 0x7fa31c1982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:27.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.466+0000 7fa320e33640 1 -- 172.21.15.63:0/2161086576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa31c1021f0 msgr2=0x7fa31c1982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:27.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.466+0000 7fa320e33640 1 --2- 172.21.15.63:0/2161086576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa31c1021f0 0x7fa31c1982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.466+0000 7fa320e33640 1 -- 172.21.15.63:0/2161086576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa31c107b30 msgr2=0x7fa31c198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:27.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.466+0000 7fa320e33640 1 --2- 172.21.15.63:0/2161086576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa31c107b30 0x7fa31c198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.466+0000 7fa320e33640 1 -- 172.21.15.63:0/2161086576 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa31c19e240 con 0x7fa31c108480 2024-09-21T06:31:27.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.466+0000 7fa320e33640 1 --2- 172.21.15.63:0/2161086576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa31c108480 0x7fa31c19db10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa31402bcc0 tx=0x7fa314003b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:27.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.466+0000 7fa3197fa640 1 -- 172.21.15.63:0/2161086576 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa314040070 con 0x7fa31c108480 2024-09-21T06:31:27.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.466+0000 7fa3197fa640 1 -- 172.21.15.63:0/2161086576 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa314003e30 con 0x7fa31c108480 2024-09-21T06:31:27.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.466+0000 7fa322896640 1 -- 172.21.15.63:0/2161086576 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa31c19e4d0 con 0x7fa31c108480 2024-09-21T06:31:27.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.466+0000 7fa3197fa640 1 -- 172.21.15.63:0/2161086576 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa314004510 con 0x7fa31c108480 2024-09-21T06:31:27.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.467+0000 7fa322896640 1 -- 172.21.15.63:0/2161086576 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa31c1a4c90 con 0x7fa31c108480 2024-09-21T06:31:27.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.469+0000 7fa328e0a740 1 Processor -- start 2024-09-21T06:31:27.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.469+0000 7fa3197fa640 1 -- 172.21.15.63:0/2161086576 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fa3140046b0 con 0x7fa31c108480 2024-09-21T06:31:27.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.469+0000 7fa328e0a740 1 -- start start 2024-09-21T06:31:27.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.470+0000 7fa328e0a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c778517350 0x55c7788be430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:27.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.470+0000 7fa328e0a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7784ee490 0x55c7788be970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:27.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.470+0000 7fa328e0a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c7784f6670 0x55c7788beeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:27.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.470+0000 7fa328e0a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c778834e60 con 0x55c778517350 2024-09-21T06:31:27.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.470+0000 7fa328e0a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c778824290 con 0x55c7784f6670 2024-09-21T06:31:27.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.470+0000 7fa328e0a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c7788280a0 con 0x55c7784ee490 2024-09-21T06:31:27.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.470+0000 7fa31b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c778517350 0x55c7788be430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:27.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.470+0000 7fa31b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c778517350 0x55c7788be430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40370/0 (socket says 172.21.15.63:40370) 2024-09-21T06:31:27.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.470+0000 7fa31b7fe640 1 -- 172.21.15.63:0/2397283816 learned_addr learned my addr 172.21.15.63:0/2397283816 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:27.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.470+0000 7fa31bfff640 1 --2- 172.21.15.63:0/2397283816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7784ee490 0x55c7788be970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:27.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.470+0000 7fa31b7fe640 1 --2- 172.21.15.63:0/2397283816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c7784f6670 0x55c7788beeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:27.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.470+0000 7fa3197fa640 1 --2- 172.21.15.63:0/2161086576 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa3040b6700 0x7fa3040b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:27.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.470+0000 7fa31b7fe640 1 -- 172.21.15.63:0/2397283816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7784ee490 msgr2=0x55c7788be970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:27.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.470+0000 7fa31b7fe640 1 --2- 172.21.15.63:0/2397283816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7784ee490 0x55c7788be970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.470+0000 7fa31b7fe640 1 -- 172.21.15.63:0/2397283816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c7784f6670 msgr2=0x55c7788beeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:27.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.470+0000 7fa320e33640 1 --2- 172.21.15.63:0/2161086576 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa3040b6700 0x7fa3040b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:27.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.470+0000 7fa31b7fe640 1 --2- 172.21.15.63:0/2397283816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c7784f6670 0x55c7788beeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.470+0000 7fa31b7fe640 1 -- 172.21.15.63:0/2397283816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c778582930 con 0x55c778517350 2024-09-21T06:31:27.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.470+0000 7fa3197fa640 1 -- 172.21.15.63:0/2161086576 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fa314108930 con 0x7fa31c108480 2024-09-21T06:31:27.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.471+0000 7fa31b7fe640 1 --2- 172.21.15.63:0/2397283816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c778517350 0x55c7788be430 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa310009fd0 tx=0x7fa310009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd7ebc21e111b2d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:27.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.471+0000 7fa320e33640 1 --2- 172.21.15.63:0/2161086576 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa3040b6700 0x7fa3040b8c10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa3140cacd0 tx=0x7fa31400a6d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:27.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.471+0000 7fa3027fc640 1 -- 172.21.15.63:0/2397283816 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa310013d90 con 0x55c778517350 2024-09-21T06:31:27.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.471+0000 7fa3027fc640 1 -- 172.21.15.63:0/2397283816 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa310013170 con 0x55c778517350 2024-09-21T06:31:27.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.471+0000 7fa3027fc640 1 -- 172.21.15.63:0/2397283816 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa310004d30 con 0x55c778517350 2024-09-21T06:31:27.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.472+0000 7fa328e0a740 1 -- 172.21.15.63:0/2397283816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c778517350 msgr2=0x55c7788be430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:27.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.472+0000 7fa328e0a740 1 --2- 172.21.15.63:0/2397283816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c778517350 0x55c7788be430 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa310009fd0 tx=0x7fa310009530 comp rx=0 tx=0).stop 2024-09-21T06:31:27.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.472+0000 7fa328e0a740 1 -- 172.21.15.63:0/2397283816 shutdown_connections 2024-09-21T06:31:27.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.472+0000 7fa328e0a740 1 --2- 172.21.15.63:0/2397283816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c7784f6670 0x55c7788beeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.472+0000 7fa328e0a740 1 --2- 172.21.15.63:0/2397283816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7784ee490 0x55c7788be970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.472+0000 7fa328e0a740 1 --2- 172.21.15.63:0/2397283816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c778517350 0x55c7788be430 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.472+0000 7fa328e0a740 1 -- 172.21.15.63:0/2397283816 >> 172.21.15.63:0/2397283816 conn(0x55c77850b740 msgr2=0x55c7788bc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:27.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.472+0000 7fa328e0a740 1 -- 172.21.15.63:0/2397283816 shutdown_connections 2024-09-21T06:31:27.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.472+0000 7fa328e0a740 1 -- 172.21.15.63:0/2397283816 wait complete. 2024-09-21T06:31:27.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.473+0000 7fa328e0a740 1 -- start start 2024-09-21T06:31:27.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.473+0000 7fa328e0a740 1 Processor -- start 2024-09-21T06:31:27.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.474+0000 7fa328e0a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7784ee490 0x55c7788ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:27.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.474+0000 7fa328e0a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c7784f6670 0x55c7788ca650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:27.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.474+0000 7fa328e0a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c778517350 0x55c7788d5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:27.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.474+0000 7fa328e0a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c778685890 con 0x55c7784ee490 2024-09-21T06:31:27.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.474+0000 7fa328e0a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c7787bed40 con 0x55c7784f6670 2024-09-21T06:31:27.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.474+0000 7fa328e0a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c7788ccc10 con 0x55c778517350 2024-09-21T06:31:27.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.474+0000 7fa31b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7784ee490 0x55c7788ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:27.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.474+0000 7fa328e0a740 10 client.0 _ll_register_callbacks cb 0x55c778822c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:31:27.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.474+0000 7fa31b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7784ee490 0x55c7788ca0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40384/0 (socket says 172.21.15.63:40384) 2024-09-21T06:31:27.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.474+0000 7fa31b7fe640 1 -- 172.21.15.63:0/1343391758 learned_addr learned my addr 172.21.15.63:0/1343391758 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:27.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.474+0000 7fa31b7fe640 1 --2- 172.21.15.63:0/1343391758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c778517350 0x55c7788d5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:27.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.474+0000 7fa31bfff640 1 --2- 172.21.15.63:0/1343391758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c7784f6670 0x55c7788ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:27.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.474+0000 7fa31b7fe640 1 -- 172.21.15.63:0/1343391758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c778517350 msgr2=0x55c7788d5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:27.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.474+0000 7fa31b7fe640 1 --2- 172.21.15.63:0/1343391758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c778517350 0x55c7788d5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.474+0000 7fa31b7fe640 1 -- 172.21.15.63:0/1343391758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c7784f6670 msgr2=0x55c7788ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:27.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.474+0000 7fa31b7fe640 1 --2- 172.21.15.63:0/1343391758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c7784f6670 0x55c7788ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.474+0000 7fa31b7fe640 1 -- 172.21.15.63:0/1343391758 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7788d6570 con 0x55c7784ee490 2024-09-21T06:31:27.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.474+0000 7fa31b7fe640 1 --2- 172.21.15.63:0/1343391758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7784ee490 0x55c7788ca0b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa3100048f0 tx=0x7fa310004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff7036bc427f5b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:27.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.474+0000 7fa2fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:31:27.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.475+0000 7fa2fb7fe640 1 -- 172.21.15.63:0/1343391758 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa310004030 con 0x55c7784ee490 2024-09-21T06:31:27.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.475+0000 7fa328e0a740 1 -- 172.21.15.63:0/1343391758 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa310013170 con 0x55c7784ee490 2024-09-21T06:31:27.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.475+0000 7fa2fb7fe640 1 -- 172.21.15.63:0/1343391758 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fa3100041d0 con 0x55c7784ee490 2024-09-21T06:31:27.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.475+0000 7fa2fb7fe640 1 -- 172.21.15.63:0/1343391758 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fa3100043d0 con 0x55c7784ee490 2024-09-21T06:31:27.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.475+0000 7fa328e0a740 10 client.16260 fetch_fsmap learned FSMap version 43 2024-09-21T06:31:27.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.475+0000 7fa328e0a740 1 -- 172.21.15.63:0/1343391758 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55c7788d8ea0 con 0x55c7784ee490 2024-09-21T06:31:27.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.475+0000 7fa2fb7fe640 1 -- 172.21.15.63:0/1343391758 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa310013170 con 0x55c7784ee490 2024-09-21T06:31:27.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.475+0000 7fa2fb7fe640 1 -- 172.21.15.63:0/1343391758 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7fa31000f920 con 0x55c7784ee490 2024-09-21T06:31:27.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.476+0000 7fa328e0a740 10 client.16260 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:31:27.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.476+0000 7fa328e0a740 10 client.16260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:31:27.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.476+0000 7fa328e0a740 20 client.16260 populate_metadata read hostname 'smithi063' 2024-09-21T06:31:27.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.476+0000 7fa328e0a740 1 --2- 172.21.15.63:0/1343391758 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55c7784d5cd0 0x55c7788dc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:27.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.476+0000 7fa328e0a740 4 client.16260 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:31:27.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.476+0000 7fa328e0a740 1 -- 172.21.15.63:0/1343391758 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c778836db0 con 0x55c7784d5cd0 2024-09-21T06:31:27.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.476+0000 7fa31bfff640 1 --2- 172.21.15.63:0/1343391758 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55c7784d5cd0 0x55c7788dc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:27.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.476+0000 7fa31bfff640 1 --2- 172.21.15.63:0/1343391758 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55c7784d5cd0 0x55c7788dc200 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=206aad09f56285cb server_cookie=f8f6a043ab50f12b in_seq=0 out_seq=0 2024-09-21T06:31:27.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.476+0000 7fa2fb7fe640 10 client.16260 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:31:27.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.477+0000 7fa2fb7fe640 1 -- 172.21.15.63:0/1343391758 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c778836db0 con 0x55c7784d5cd0 2024-09-21T06:31:27.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.477+0000 7fa2fb7fe640 10 client.16260 handle_command_reply: tid=0 2024-09-21T06:31:27.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.477+0000 7fa328e0a740 1 client.16260 shutdown 2024-09-21T06:31:27.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.477+0000 7fa328e0a740 1 -- 172.21.15.63:0/1343391758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7784ee490 msgr2=0x55c7788ca0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:27.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.477+0000 7fa328e0a740 1 --2- 172.21.15.63:0/1343391758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7784ee490 0x55c7788ca0b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa3100048f0 tx=0x7fa310004950 comp rx=0 tx=0).stop 2024-09-21T06:31:27.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.477+0000 7fa328e0a740 1 -- 172.21.15.63:0/1343391758 shutdown_connections 2024-09-21T06:31:27.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.477+0000 7fa328e0a740 1 --2- 172.21.15.63:0/1343391758 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55c7784d5cd0 0x55c7788dc200 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.477+0000 7fa328e0a740 1 --2- 172.21.15.63:0/1343391758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c778517350 0x55c7788d5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.477+0000 7fa328e0a740 1 --2- 172.21.15.63:0/1343391758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c7784f6670 0x55c7788ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.477+0000 7fa328e0a740 1 --2- 172.21.15.63:0/1343391758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7784ee490 0x55c7788ca0b0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.477+0000 7fa328e0a740 1 -- 172.21.15.63:0/1343391758 >> 172.21.15.63:0/1343391758 conn(0x55c77850b740 msgr2=0x55c7788c1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:27.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.478+0000 7fa2fb7fe640 0 client.16260 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:31:27.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.478+0000 7fa328e0a740 1 -- 172.21.15.63:0/1343391758 shutdown_connections 2024-09-21T06:31:27.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.478+0000 7fa328e0a740 1 -- 172.21.15.63:0/1343391758 wait complete. 2024-09-21T06:31:27.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.478+0000 7fa328e0a740 20 client.16260 trim_cache size 0 max 16384 2024-09-21T06:31:27.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.499+0000 7fa328e0a740 1 Processor -- start 2024-09-21T06:31:27.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.499+0000 7fa328e0a740 1 -- start start 2024-09-21T06:31:27.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.499+0000 7fa328e0a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7784ee490 0x55c7788c1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:27.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.499+0000 7fa328e0a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7784f6670 0x55c7788c3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:27.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.499+0000 7fa328e0a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c778517350 0x55c7788c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:27.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.499+0000 7fa328e0a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c1ad520 con 0x55c7784f6670 2024-09-21T06:31:27.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.499+0000 7fa328e0a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c1af120 con 0x55c778517350 2024-09-21T06:31:27.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.499+0000 7fa328e0a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c1adcb0 con 0x55c7784ee490 2024-09-21T06:31:27.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.500+0000 7fa31bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7784f6670 0x55c7788c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:27.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.500+0000 7fa31bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7784f6670 0x55c7788c3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40394/0 (socket says 172.21.15.63:40394) 2024-09-21T06:31:27.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.500+0000 7fa31bfff640 1 -- 172.21.15.63:0/457835049 learned_addr learned my addr 172.21.15.63:0/457835049 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:27.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.500+0000 7fa31b7fe640 1 --2- 172.21.15.63:0/457835049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c778517350 0x55c7788c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:27.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.500+0000 7fa31b7fe640 1 --2- 172.21.15.63:0/457835049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7784ee490 0x55c7788c1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:27.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.500+0000 7fa31bfff640 1 -- 172.21.15.63:0/457835049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7784ee490 msgr2=0x55c7788c1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:27.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.500+0000 7fa31bfff640 1 --2- 172.21.15.63:0/457835049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7784ee490 0x55c7788c1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.500+0000 7fa31bfff640 1 -- 172.21.15.63:0/457835049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c778517350 msgr2=0x55c7788c3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:27.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.500+0000 7fa31bfff640 1 --2- 172.21.15.63:0/457835049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c778517350 0x55c7788c3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.500+0000 7fa31bfff640 1 -- 172.21.15.63:0/457835049 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7788bc860 con 0x55c7784f6670 2024-09-21T06:31:27.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.500+0000 7fa31bfff640 1 --2- 172.21.15.63:0/457835049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7784f6670 0x55c7788c3510 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa30c013dc0 tx=0x7fa30c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60a336fb748aad4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:27.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.501+0000 7fa301ffb640 1 -- 172.21.15.63:0/457835049 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c004020 con 0x55c7784f6670 2024-09-21T06:31:27.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.501+0000 7fa301ffb640 1 -- 172.21.15.63:0/457835049 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa30c0041c0 con 0x55c7784f6670 2024-09-21T06:31:27.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.501+0000 7fa301ffb640 1 -- 172.21.15.63:0/457835049 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c010430 con 0x55c7784f6670 2024-09-21T06:31:27.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.502+0000 7fa328e0a740 1 -- 172.21.15.63:0/457835049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7784f6670 msgr2=0x55c7788c3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:27.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.502+0000 7fa328e0a740 1 --2- 172.21.15.63:0/457835049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7784f6670 0x55c7788c3510 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa30c013dc0 tx=0x7fa30c005f90 comp rx=0 tx=0).stop 2024-09-21T06:31:27.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.502+0000 7fa328e0a740 1 -- 172.21.15.63:0/457835049 shutdown_connections 2024-09-21T06:31:27.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.502+0000 7fa328e0a740 1 --2- 172.21.15.63:0/457835049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c778517350 0x55c7788c3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.502+0000 7fa328e0a740 1 --2- 172.21.15.63:0/457835049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7784f6670 0x55c7788c3510 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.502+0000 7fa328e0a740 1 --2- 172.21.15.63:0/457835049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7784ee490 0x55c7788c1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.502+0000 7fa328e0a740 1 -- 172.21.15.63:0/457835049 >> 172.21.15.63:0/457835049 conn(0x55c77850b740 msgr2=0x55c7788c1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:27.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.502+0000 7fa328e0a740 1 -- 172.21.15.63:0/457835049 shutdown_connections 2024-09-21T06:31:27.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.502+0000 7fa328e0a740 1 -- 172.21.15.63:0/457835049 wait complete. 2024-09-21T06:31:27.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.503+0000 7fa328e0a740 1 -- start start 2024-09-21T06:31:27.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.503+0000 7fa328e0a740 1 Processor -- start 2024-09-21T06:31:27.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.503+0000 7fa328e0a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7784ee490 0x55c7788ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:27.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.503+0000 7fa328e0a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c7784f6670 0x55c7788ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:27.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.503+0000 7fa328e0a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c778517350 0x55c778945bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:27.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.503+0000 7fa328e0a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c1aea50 con 0x55c7784ee490 2024-09-21T06:31:27.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.503+0000 7fa328e0a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c1ae380 con 0x55c7784f6670 2024-09-21T06:31:27.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.503+0000 7fa328e0a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c1ab500 con 0x55c778517350 2024-09-21T06:31:27.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.503+0000 7fa31b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7784ee490 0x55c7788ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:27.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.503+0000 7fa328e0a740 10 client.0 _ll_register_callbacks cb 0x7fa310009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:31:27.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.503+0000 7fa31b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7784ee490 0x55c7788ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40402/0 (socket says 172.21.15.63:40402) 2024-09-21T06:31:27.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.504+0000 7fa31b7fe640 1 -- 172.21.15.63:0/1250606317 learned_addr learned my addr 172.21.15.63:0/1250606317 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:27.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.503+0000 7fa31bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c7784f6670 0x55c7788ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:27.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.504+0000 7fa31b7fe640 1 --2- 172.21.15.63:0/1250606317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c778517350 0x55c778945bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:27.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.504+0000 7fa31bfff640 1 -- 172.21.15.63:0/1250606317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c778517350 msgr2=0x55c778945bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:27.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.504+0000 7fa31bfff640 1 --2- 172.21.15.63:0/1250606317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c778517350 0x55c778945bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.504+0000 7fa31bfff640 1 -- 172.21.15.63:0/1250606317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7784ee490 msgr2=0x55c7788ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:27.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.504+0000 7fa31bfff640 1 --2- 172.21.15.63:0/1250606317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7784ee490 0x55c7788ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.504+0000 7fa31bfff640 1 -- 172.21.15.63:0/1250606317 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7788ceff0 con 0x55c7784f6670 2024-09-21T06:31:27.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.504+0000 7fa31b7fe640 1 --2- 172.21.15.63:0/1250606317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c778517350 0x55c778945bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:27.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.504+0000 7fa31bfff640 1 --2- 172.21.15.63:0/1250606317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c7784f6670 0x55c7788ce700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa30c013080 tx=0x7fa30c0045a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ae662542aea072c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:27.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.504+0000 7fa2fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:31:27.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.504+0000 7fa2fb7fe640 1 -- 172.21.15.63:0/1250606317 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0037f0 con 0x55c7784f6670 2024-09-21T06:31:27.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.505+0000 7fa2fb7fe640 1 -- 172.21.15.63:0/1250606317 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fa30c003990 con 0x55c7784f6670 2024-09-21T06:31:27.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.505+0000 7fa328e0a740 1 -- 172.21.15.63:0/1250606317 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa30c0041c0 con 0x55c7784f6670 2024-09-21T06:31:27.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.505+0000 7fa2fb7fe640 1 -- 172.21.15.63:0/1250606317 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fa30c003b90 con 0x55c7784f6670 2024-09-21T06:31:27.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.505+0000 7fa328e0a740 10 client.25913 fetch_fsmap learned FSMap version 43 2024-09-21T06:31:27.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.505+0000 7fa328e0a740 1 -- 172.21.15.63:0/1250606317 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55c7789471e0 con 0x55c7784f6670 2024-09-21T06:31:27.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.505+0000 7fa2fb7fe640 1 -- 172.21.15.63:0/1250606317 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa30c0041c0 con 0x55c7784f6670 2024-09-21T06:31:27.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.505+0000 7fa2fb7fe640 1 -- 172.21.15.63:0/1250606317 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7fa30c024070 con 0x55c7784f6670 2024-09-21T06:31:27.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.505+0000 7fa328e0a740 10 client.25913 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:31:27.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.505+0000 7fa328e0a740 10 client.25913 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:31:27.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.505+0000 7fa328e0a740 20 client.25913 populate_metadata read hostname 'smithi063' 2024-09-21T06:31:27.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.505+0000 7fa328e0a740 1 --2- 172.21.15.63:0/1250606317 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55c7784ab080 0x55c7789498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:27.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.505+0000 7fa328e0a740 4 client.25913 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:31:27.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.505+0000 7fa328e0a740 1 -- 172.21.15.63:0/1250606317 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c778832860 con 0x55c7784ab080 2024-09-21T06:31:27.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.506+0000 7fa31b7fe640 1 --2- 172.21.15.63:0/1250606317 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55c7784ab080 0x55c7789498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:27.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.506+0000 7fa2fb7fe640 10 client.25913 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:31:27.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.506+0000 7fa31b7fe640 1 --2- 172.21.15.63:0/1250606317 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55c7784ab080 0x55c7789498a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49a91df9d53aa8c6 server_cookie=7287284e44b38fea in_seq=0 out_seq=0 2024-09-21T06:31:27.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.507+0000 7fa2fb7fe640 1 -- 172.21.15.63:0/1250606317 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c778832860 con 0x55c7784ab080 2024-09-21T06:31:27.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.507+0000 7fa2fb7fe640 10 client.25913 handle_command_reply: tid=0 2024-09-21T06:31:27.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.507+0000 7fa328e0a740 1 client.25913 shutdown 2024-09-21T06:31:27.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.507+0000 7fa328e0a740 1 -- 172.21.15.63:0/1250606317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c7784f6670 msgr2=0x55c7788ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:27.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.507+0000 7fa328e0a740 1 --2- 172.21.15.63:0/1250606317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c7784f6670 0x55c7788ce700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa30c013080 tx=0x7fa30c0045a0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.508+0000 7fa328e0a740 1 -- 172.21.15.63:0/1250606317 shutdown_connections 2024-09-21T06:31:27.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.508+0000 7fa328e0a740 1 --2- 172.21.15.63:0/1250606317 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55c7784ab080 0x55c7789498a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.508+0000 7fa328e0a740 1 --2- 172.21.15.63:0/1250606317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c778517350 0x55c778945bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.508+0000 7fa328e0a740 1 --2- 172.21.15.63:0/1250606317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c7784f6670 0x55c7788ce700 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.508+0000 7fa2fb7fe640 0 client.25913 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:31:27.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.508+0000 7fa328e0a740 1 --2- 172.21.15.63:0/1250606317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7784ee490 0x55c7788ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.508+0000 7fa328e0a740 1 -- 172.21.15.63:0/1250606317 >> 172.21.15.63:0/1250606317 conn(0x55c77850b740 msgr2=0x55c7788cb170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:27.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.508+0000 7fa328e0a740 1 -- 172.21.15.63:0/1250606317 shutdown_connections 2024-09-21T06:31:27.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.508+0000 7fa328e0a740 1 -- 172.21.15.63:0/1250606317 wait complete. 2024-09-21T06:31:27.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.508+0000 7fa328e0a740 20 client.25913 trim_cache size 0 max 16384 2024-09-21T06:31:27.512 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:31:27.513 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0, 2024-09-21T06:31:27.513 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_tag": "9cd302bc-b682-49ab-bf6f-dee8f0549ead", 2024-09-21T06:31:27.513 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": "asynchronous" 2024-09-21T06:31:27.513 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:31:27.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.508+0000 7fa322896640 1 -- 172.21.15.63:0/2161086576 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa3040b6700 msgr2=0x7fa3040b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:27.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.508+0000 7fa322896640 1 --2- 172.21.15.63:0/2161086576 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa3040b6700 0x7fa3040b8c10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa3140cacd0 tx=0x7fa31400a6d0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.508+0000 7fa322896640 1 -- 172.21.15.63:0/2161086576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa31c108480 msgr2=0x7fa31c19db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:27.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.508+0000 7fa322896640 1 --2- 172.21.15.63:0/2161086576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa31c108480 0x7fa31c19db10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa31402bcc0 tx=0x7fa314003b80 comp rx=0 tx=0).stop 2024-09-21T06:31:27.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.509+0000 7fa322896640 1 -- 172.21.15.63:0/2161086576 shutdown_connections 2024-09-21T06:31:27.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.509+0000 7fa322896640 1 --2- 172.21.15.63:0/2161086576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa31c108480 0x7fa31c19db10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.509+0000 7fa322896640 1 --2- 172.21.15.63:0/2161086576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa31c107b30 0x7fa31c198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.509+0000 7fa322896640 1 --2- 172.21.15.63:0/2161086576 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa3040b6700 0x7fa3040b8c10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.509+0000 7fa322896640 1 --2- 172.21.15.63:0/2161086576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa31c1021f0 0x7fa31c1982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:27.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.509+0000 7fa322896640 1 -- 172.21.15.63:0/2161086576 >> 172.21.15.63:0/2161086576 conn(0x7fa31c077c60 msgr2=0x7fa31c105be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:27.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.509+0000 7fa322896640 1 -- 172.21.15.63:0/2161086576 shutdown_connections 2024-09-21T06:31:27.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:27.509+0000 7fa322896640 1 -- 172.21.15.63:0/2161086576 wait complete. 2024-09-21T06:31:27.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:27 smithi071 ceph-mon[34844]: pgmap v420: 97 pgs: 97 active+clean; 107 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.7 MiB/s wr, 550 op/s 2024-09-21T06:31:27.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:27 smithi063 ceph-mon[31150]: pgmap v420: 97 pgs: 97 active+clean; 107 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.7 MiB/s wr, 550 op/s 2024-09-21T06:31:27.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:27 smithi175 ceph-mon[34510]: pgmap v420: 97 pgs: 97 active+clean; 107 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.7 MiB/s wr, 550 op/s 2024-09-21T06:31:28.386 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:31:28.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:28 smithi071 ceph-mon[34844]: scrub queued for path: / 2024-09-21T06:31:28.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:28 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:28.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:28 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:31:28.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:28 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:31:28.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:28 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:31:28.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:28 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:28.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:28 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:28.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:28 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:31:28.775 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:31:28.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:28 smithi063 ceph-mon[31150]: scrub queued for path: / 2024-09-21T06:31:28.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:28 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:28.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:28 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:31:28.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:28 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:31:28.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:28 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:31:28.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:28 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:28.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:28 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:28.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:28 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:31:28.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:28 smithi175 ceph-mon[34510]: scrub queued for path: / 2024-09-21T06:31:28.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:28 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:28.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:28 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:31:28.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:28 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:31:28.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:28 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:31:28.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:28 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:28.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:28 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:28.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:28 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:31:29.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.308+0000 7f45d82bc640 1 -- 172.21.15.63:0/2961881253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45d01094d0 msgr2=0x7f45d01098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:29.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.308+0000 7f45d82bc640 1 --2- 172.21.15.63:0/2961881253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45d01094d0 0x7f45d01098e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009900 tx=0x7f45c402a410 comp rx=0 tx=0).stop 2024-09-21T06:31:29.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.308+0000 7f45d82bc640 1 -- 172.21.15.63:0/2961881253 shutdown_connections 2024-09-21T06:31:29.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.308+0000 7f45d82bc640 1 --2- 172.21.15.63:0/2961881253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45d0109e20 0x7f45d0110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.308+0000 7f45d82bc640 1 --2- 172.21.15.63:0/2961881253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45d01094d0 0x7f45d01098e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.308+0000 7f45d82bc640 1 --2- 172.21.15.63:0/2961881253 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d0103b90 0x7f45d0103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.308+0000 7f45d82bc640 1 -- 172.21.15.63:0/2961881253 >> 172.21.15.63:0/2961881253 conn(0x7f45d00ff5e0 msgr2=0x7f45d0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:29.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.308+0000 7f45d82bc640 1 -- 172.21.15.63:0/2961881253 shutdown_connections 2024-09-21T06:31:29.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.308+0000 7f45d82bc640 1 -- 172.21.15.63:0/2961881253 wait complete. 2024-09-21T06:31:29.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.309+0000 7f45d82bc640 1 Processor -- start 2024-09-21T06:31:29.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.309+0000 7f45d82bc640 1 -- start start 2024-09-21T06:31:29.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.310+0000 7f45d82bc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45d0103b90 0x7f45d0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:29.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.310+0000 7f45d82bc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45d01094d0 0x7f45d0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:29.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.310+0000 7f45d82bc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d0109e20 0x7f45d0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:29.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.310+0000 7f45d82bc640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f45d0113ae0 con 0x7f45d0103b90 2024-09-21T06:31:29.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.310+0000 7f45d82bc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f45d0113960 con 0x7f45d01094d0 2024-09-21T06:31:29.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.310+0000 7f45d82bc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f45d0113c60 con 0x7f45d0109e20 2024-09-21T06:31:29.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.310+0000 7f45d6058640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45d0103b90 0x7f45d0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:29.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.310+0000 7f45d6058640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45d0103b90 0x7f45d0075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40408/0 (socket says 172.21.15.63:40408) 2024-09-21T06:31:29.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.310+0000 7f45d6058640 1 -- 172.21.15.63:0/3026298085 learned_addr learned my addr 172.21.15.63:0/3026298085 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:29.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.310+0000 7f45d5857640 1 --2- 172.21.15.63:0/3026298085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45d01094d0 0x7f45d0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:29.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.310+0000 7f45d6859640 1 --2- 172.21.15.63:0/3026298085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d0109e20 0x7f45d0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:29.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.310+0000 7f45d6058640 1 -- 172.21.15.63:0/3026298085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d0109e20 msgr2=0x7f45d0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:29.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.310+0000 7f45d6058640 1 --2- 172.21.15.63:0/3026298085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d0109e20 0x7f45d0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.310+0000 7f45d6058640 1 -- 172.21.15.63:0/3026298085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45d01094d0 msgr2=0x7f45d0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:29.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.310+0000 7f45d6058640 1 --2- 172.21.15.63:0/3026298085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45d01094d0 0x7f45d0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.311+0000 7f45d6058640 1 -- 172.21.15.63:0/3026298085 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d01a8770 con 0x7f45d0103b90 2024-09-21T06:31:29.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.311+0000 7f45d6859640 1 --2- 172.21.15.63:0/3026298085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d0109e20 0x7f45d0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:29.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.311+0000 7f45d5857640 1 --2- 172.21.15.63:0/3026298085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45d01094d0 0x7f45d0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:29.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.311+0000 7f45d6058640 1 --2- 172.21.15.63:0/3026298085 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45d0103b90 0x7f45d0075710 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00e9f0 tx=0x7f45cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:29.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.311+0000 7f45c37fe640 1 -- 172.21.15.63:0/3026298085 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc00ccc0 con 0x7f45d0103b90 2024-09-21T06:31:29.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.311+0000 7f45d82bc640 1 -- 172.21.15.63:0/3026298085 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d01a8a60 con 0x7f45d0103b90 2024-09-21T06:31:29.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.311+0000 7f45c37fe640 1 -- 172.21.15.63:0/3026298085 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45cc00ce60 con 0x7f45d0103b90 2024-09-21T06:31:29.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.311+0000 7f45c37fe640 1 -- 172.21.15.63:0/3026298085 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc010430 con 0x7f45d0103b90 2024-09-21T06:31:29.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.311+0000 7f45d82bc640 1 -- 172.21.15.63:0/3026298085 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d01a8f20 con 0x7f45d0103b90 2024-09-21T06:31:29.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.314+0000 7f45de830740 1 Processor -- start 2024-09-21T06:31:29.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.314+0000 7f45c37fe640 1 -- 172.21.15.63:0/3026298085 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f45cc0046c0 con 0x7f45d0103b90 2024-09-21T06:31:29.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.314+0000 7f45de830740 1 -- start start 2024-09-21T06:31:29.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.315+0000 7f45de830740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b197070 0x55587b53e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:29.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.315+0000 7f45de830740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b16e1b0 0x55587b53e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:29.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.315+0000 7f45de830740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b176390 0x55587b53ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:29.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.315+0000 7f45de830740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55587b4b4e50 con 0x55587b197070 2024-09-21T06:31:29.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.315+0000 7f45de830740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55587b4a4280 con 0x55587b16e1b0 2024-09-21T06:31:29.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.315+0000 7f45de830740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55587b4a8090 con 0x55587b176390 2024-09-21T06:31:29.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.315+0000 7f45d6859640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b197070 0x55587b53e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:29.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.315+0000 7f45d6058640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b16e1b0 0x55587b53e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:29.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.315+0000 7f45d6859640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b197070 0x55587b53e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40416/0 (socket says 172.21.15.63:40416) 2024-09-21T06:31:29.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.315+0000 7f45d6859640 1 -- 172.21.15.63:0/620610122 learned_addr learned my addr 172.21.15.63:0/620610122 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:29.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.315+0000 7f45d5857640 1 --2- 172.21.15.63:0/620610122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b176390 0x55587b53ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:29.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.315+0000 7f45c37fe640 1 --2- 172.21.15.63:0/3026298085 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f45bc0b6680 0x7f45bc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:29.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.315+0000 7f45d6859640 1 -- 172.21.15.63:0/620610122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b176390 msgr2=0x55587b53ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:29.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.315+0000 7f45d6859640 1 --2- 172.21.15.63:0/620610122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b176390 0x55587b53ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.315+0000 7f45d6859640 1 -- 172.21.15.63:0/620610122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b16e1b0 msgr2=0x55587b53e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:29.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.315+0000 7f45d6859640 1 --2- 172.21.15.63:0/620610122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b16e1b0 0x55587b53e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.315+0000 7f45d6859640 1 -- 172.21.15.63:0/620610122 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55587b202650 con 0x55587b197070 2024-09-21T06:31:29.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.315+0000 7f45d5857640 1 --2- 172.21.15.63:0/620610122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b176390 0x55587b53ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:29.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.316+0000 7f45c37fe640 1 -- 172.21.15.63:0/3026298085 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f45cc0e7b90 con 0x7f45d0103b90 2024-09-21T06:31:29.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.316+0000 7f45d6859640 1 --2- 172.21.15.63:0/3026298085 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f45bc0b6680 0x7f45bc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:29.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.316+0000 7f45d6859640 1 --2- 172.21.15.63:0/620610122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b197070 0x55587b53e270 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f45c8011810 tx=0x7f45c8011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637e1f054c5634be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:29.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.316+0000 7f45c0d9a640 1 -- 172.21.15.63:0/620610122 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c8010570 con 0x55587b197070 2024-09-21T06:31:29.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.316+0000 7f45c0d9a640 1 -- 172.21.15.63:0/620610122 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45c8010bc0 con 0x55587b197070 2024-09-21T06:31:29.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.316+0000 7f45c0d9a640 1 -- 172.21.15.63:0/620610122 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c801cba0 con 0x55587b197070 2024-09-21T06:31:29.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.317+0000 7f45de830740 1 -- 172.21.15.63:0/620610122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b197070 msgr2=0x55587b53e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:29.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.317+0000 7f45de830740 1 --2- 172.21.15.63:0/620610122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b197070 0x55587b53e270 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f45c8011810 tx=0x7f45c8011cd0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.317+0000 7f45d6859640 1 --2- 172.21.15.63:0/3026298085 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f45bc0b6680 0x7f45bc0b8b90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f45c8011490 tx=0x7f45c8021000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:29.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.317+0000 7f45de830740 1 -- 172.21.15.63:0/620610122 shutdown_connections 2024-09-21T06:31:29.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.317+0000 7f45de830740 1 --2- 172.21.15.63:0/620610122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b176390 0x55587b53ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.317+0000 7f45de830740 1 --2- 172.21.15.63:0/620610122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b16e1b0 0x55587b53e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.317+0000 7f45de830740 1 --2- 172.21.15.63:0/620610122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b197070 0x55587b53e270 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.318+0000 7f45de830740 1 -- 172.21.15.63:0/620610122 >> 172.21.15.63:0/620610122 conn(0x55587b18b460 msgr2=0x55587b53c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:29.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.318+0000 7f45de830740 1 -- 172.21.15.63:0/620610122 shutdown_connections 2024-09-21T06:31:29.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.318+0000 7f45de830740 1 -- 172.21.15.63:0/620610122 wait complete. 2024-09-21T06:31:29.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.318+0000 7f45de830740 1 -- start start 2024-09-21T06:31:29.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.318+0000 7f45de830740 1 Processor -- start 2024-09-21T06:31:29.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.319+0000 7f45de830740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b16e1b0 0x55587b5499f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:29.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.319+0000 7f45de830740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b176390 0x55587b549f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:29.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.319+0000 7f45de830740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b197070 0x55587b555d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:29.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.319+0000 7f45de830740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55587b305700 con 0x55587b16e1b0 2024-09-21T06:31:29.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.319+0000 7f45de830740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55587b43f110 con 0x55587b197070 2024-09-21T06:31:29.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.319+0000 7f45de830740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55587b54ca50 con 0x55587b176390 2024-09-21T06:31:29.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.319+0000 7f45de830740 10 client.0 _ll_register_callbacks cb 0x55587b458990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:31:29.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.319+0000 7f45d6058640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b16e1b0 0x55587b5499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:29.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.319+0000 7f45d5857640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b176390 0x55587b549f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:29.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.319+0000 7f45d6058640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b16e1b0 0x55587b5499f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40422/0 (socket says 172.21.15.63:40422) 2024-09-21T06:31:29.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.319+0000 7f45d6058640 1 -- 172.21.15.63:0/935666273 learned_addr learned my addr 172.21.15.63:0/935666273 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:29.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.319+0000 7f45d6859640 1 --2- 172.21.15.63:0/935666273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b197070 0x55587b555d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:29.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.319+0000 7f45d6058640 1 -- 172.21.15.63:0/935666273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b176390 msgr2=0x55587b549f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:29.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.319+0000 7f45d6058640 1 --2- 172.21.15.63:0/935666273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b176390 0x55587b549f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.319+0000 7f45d6058640 1 -- 172.21.15.63:0/935666273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b197070 msgr2=0x55587b555d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:29.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.319+0000 7f45d6058640 1 --2- 172.21.15.63:0/935666273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b197070 0x55587b555d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.319+0000 7f45d6058640 1 -- 172.21.15.63:0/935666273 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55587b46cc40 con 0x55587b16e1b0 2024-09-21T06:31:29.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.319+0000 7f45d6058640 1 --2- 172.21.15.63:0/935666273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b16e1b0 0x55587b5499f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00c6a0 tx=0x7f45cc0b7290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d866f0d93e2c65 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:29.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.319+0000 7f45b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:31:29.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.320+0000 7f45b9ffb640 1 -- 172.21.15.63:0/935666273 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0aa010 con 0x55587b16e1b0 2024-09-21T06:31:29.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.320+0000 7f45de830740 1 -- 172.21.15.63:0/935666273 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45c8010bc0 con 0x55587b16e1b0 2024-09-21T06:31:29.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.320+0000 7f45b9ffb640 1 -- 172.21.15.63:0/935666273 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f45cc0ac690 con 0x55587b16e1b0 2024-09-21T06:31:29.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.320+0000 7f45b9ffb640 1 -- 172.21.15.63:0/935666273 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f45cc0ad130 con 0x55587b16e1b0 2024-09-21T06:31:29.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.320+0000 7f45de830740 10 client.16278 fetch_fsmap learned FSMap version 43 2024-09-21T06:31:29.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.320+0000 7f45de830740 1 -- 172.21.15.63:0/935666273 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55587b5587f0 con 0x55587b16e1b0 2024-09-21T06:31:29.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.321+0000 7f45b9ffb640 1 -- 172.21.15.63:0/935666273 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45c8010bc0 con 0x55587b16e1b0 2024-09-21T06:31:29.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.321+0000 7f45b9ffb640 1 -- 172.21.15.63:0/935666273 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f45cc0f0070 con 0x55587b16e1b0 2024-09-21T06:31:29.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.321+0000 7f45de830740 10 client.16278 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:31:29.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.321+0000 7f45de830740 10 client.16278 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:31:29.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.321+0000 7f45de830740 20 client.16278 populate_metadata read hostname 'smithi063' 2024-09-21T06:31:29.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.321+0000 7f45de830740 1 --2- 172.21.15.63:0/935666273 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55587b1559f0 0x55587b55bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:29.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.321+0000 7f45de830740 4 client.16278 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:31:29.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.321+0000 7f45de830740 1 -- 172.21.15.63:0/935666273 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55587b4b6da0 con 0x55587b1559f0 2024-09-21T06:31:29.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.321+0000 7f45d5857640 1 --2- 172.21.15.63:0/935666273 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55587b1559f0 0x55587b55bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:29.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.322+0000 7f45b9ffb640 10 client.16278 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:31:29.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.322+0000 7f45d5857640 1 --2- 172.21.15.63:0/935666273 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55587b1559f0 0x55587b55bc80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11986fef1757fbc9 server_cookie=2c184ec8af580ffc in_seq=0 out_seq=0 2024-09-21T06:31:29.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.323+0000 7f45b9ffb640 1 -- 172.21.15.63:0/935666273 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55587b4b6da0 con 0x55587b1559f0 2024-09-21T06:31:29.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.323+0000 7f45b9ffb640 10 client.16278 handle_command_reply: tid=0 2024-09-21T06:31:29.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.323+0000 7f45de830740 1 client.16278 shutdown 2024-09-21T06:31:29.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.323+0000 7f45de830740 1 -- 172.21.15.63:0/935666273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b16e1b0 msgr2=0x55587b5499f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:29.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.323+0000 7f45de830740 1 --2- 172.21.15.63:0/935666273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b16e1b0 0x55587b5499f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00c6a0 tx=0x7f45cc0b7290 comp rx=0 tx=0).stop 2024-09-21T06:31:29.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.323+0000 7f45de830740 1 -- 172.21.15.63:0/935666273 shutdown_connections 2024-09-21T06:31:29.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.323+0000 7f45de830740 1 --2- 172.21.15.63:0/935666273 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55587b1559f0 0x55587b55bc80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.324+0000 7f45de830740 1 --2- 172.21.15.63:0/935666273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b197070 0x55587b555d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.324+0000 7f45de830740 1 --2- 172.21.15.63:0/935666273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b176390 0x55587b549f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.324+0000 7f45b9ffb640 0 client.16278 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:31:29.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.324+0000 7f45de830740 1 --2- 172.21.15.63:0/935666273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b16e1b0 0x55587b5499f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.324+0000 7f45de830740 1 -- 172.21.15.63:0/935666273 >> 172.21.15.63:0/935666273 conn(0x55587b18b460 msgr2=0x55587b541450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:29.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.324+0000 7f45de830740 1 -- 172.21.15.63:0/935666273 shutdown_connections 2024-09-21T06:31:29.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.324+0000 7f45de830740 1 -- 172.21.15.63:0/935666273 wait complete. 2024-09-21T06:31:29.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.324+0000 7f45de830740 20 client.16278 trim_cache size 0 max 16384 2024-09-21T06:31:29.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.344+0000 7f45de830740 1 Processor -- start 2024-09-21T06:31:29.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.344+0000 7f45de830740 1 -- start start 2024-09-21T06:31:29.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.344+0000 7f45de830740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b18b460 0x55587b541a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:29.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.344+0000 7f45de830740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b1559f0 0x55587b546be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:29.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.344+0000 7f45de830740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b16e1b0 0x55587b547120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:29.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.344+0000 7f45de830740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f45d01b1980 con 0x55587b16e1b0 2024-09-21T06:31:29.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.344+0000 7f45de830740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f45d01b3580 con 0x55587b18b460 2024-09-21T06:31:29.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.344+0000 7f45de830740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f45d01b2110 con 0x55587b1559f0 2024-09-21T06:31:29.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.344+0000 7f45d6859640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b16e1b0 0x55587b547120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:29.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.345+0000 7f45d6859640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b16e1b0 0x55587b547120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40434/0 (socket says 172.21.15.63:40434) 2024-09-21T06:31:29.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.345+0000 7f45d5857640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b1559f0 0x55587b546be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:29.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.345+0000 7f45d6859640 1 -- 172.21.15.63:0/260141233 learned_addr learned my addr 172.21.15.63:0/260141233 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:29.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.345+0000 7f45d6058640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b18b460 0x55587b541a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:29.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.345+0000 7f45d6058640 1 -- 172.21.15.63:0/260141233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b1559f0 msgr2=0x55587b546be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:29.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.345+0000 7f45d6058640 1 --2- 172.21.15.63:0/260141233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b1559f0 0x55587b546be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.345+0000 7f45d6058640 1 -- 172.21.15.63:0/260141233 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b16e1b0 msgr2=0x55587b547120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:29.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.345+0000 7f45d6058640 1 --2- 172.21.15.63:0/260141233 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b16e1b0 0x55587b547120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.345+0000 7f45d6058640 1 -- 172.21.15.63:0/260141233 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55587b541fc0 con 0x55587b18b460 2024-09-21T06:31:29.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.345+0000 7f45d5857640 1 --2- 172.21.15.63:0/260141233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b1559f0 0x55587b546be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:29.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.345+0000 7f45d6859640 1 --2- 172.21.15.63:0/260141233 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b16e1b0 0x55587b547120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:29.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.345+0000 7f45d6058640 1 --2- 172.21.15.63:0/260141233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b18b460 0x55587b541a80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00c6a0 tx=0x7f45cc005760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43e41eb2dba78355 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:29.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.345+0000 7f45bbfff640 1 -- 172.21.15.63:0/260141233 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0ad310 con 0x55587b18b460 2024-09-21T06:31:29.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.345+0000 7f45bbfff640 1 -- 172.21.15.63:0/260141233 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45cc0eb020 con 0x55587b18b460 2024-09-21T06:31:29.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.345+0000 7f45bbfff640 1 -- 172.21.15.63:0/260141233 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0ad790 con 0x55587b18b460 2024-09-21T06:31:29.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.346+0000 7f45de830740 1 -- 172.21.15.63:0/260141233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b18b460 msgr2=0x55587b541a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:29.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.346+0000 7f45de830740 1 --2- 172.21.15.63:0/260141233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b18b460 0x55587b541a80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00c6a0 tx=0x7f45cc005760 comp rx=0 tx=0).stop 2024-09-21T06:31:29.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.346+0000 7f45de830740 1 -- 172.21.15.63:0/260141233 shutdown_connections 2024-09-21T06:31:29.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.346+0000 7f45de830740 1 --2- 172.21.15.63:0/260141233 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b16e1b0 0x55587b547120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.346+0000 7f45de830740 1 --2- 172.21.15.63:0/260141233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b1559f0 0x55587b546be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.346+0000 7f45de830740 1 --2- 172.21.15.63:0/260141233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b18b460 0x55587b541a80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.346+0000 7f45de830740 1 -- 172.21.15.63:0/260141233 >> 172.21.15.63:0/260141233 conn(0x55587b5561c0 msgr2=0x55587b541370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:29.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.347+0000 7f45de830740 1 -- 172.21.15.63:0/260141233 shutdown_connections 2024-09-21T06:31:29.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.347+0000 7f45de830740 1 -- 172.21.15.63:0/260141233 wait complete. 2024-09-21T06:31:29.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.347+0000 7f45de830740 1 -- start start 2024-09-21T06:31:29.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.347+0000 7f45de830740 1 Processor -- start 2024-09-21T06:31:29.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.348+0000 7f45de830740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b1559f0 0x55587b54e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:29.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.348+0000 7f45de830740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b16e1b0 0x55587b54e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:29.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.348+0000 7f45de830740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b18b460 0x55587b5c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:29.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.348+0000 7f45de830740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f45d01b2eb0 con 0x55587b18b460 2024-09-21T06:31:29.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.348+0000 7f45de830740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f45d01b27e0 con 0x55587b16e1b0 2024-09-21T06:31:29.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.348+0000 7f45de830740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f45d01af960 con 0x55587b1559f0 2024-09-21T06:31:29.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.348+0000 7f45de830740 10 client.0 _ll_register_callbacks cb 0x7f45cc0a9e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:31:29.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.348+0000 7f45d6058640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b1559f0 0x55587b54e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:29.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.348+0000 7f45d5857640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b16e1b0 0x55587b54e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:29.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.348+0000 7f45d5857640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b16e1b0 0x55587b54e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:60210/0 (socket says 172.21.15.63:60210) 2024-09-21T06:31:29.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.348+0000 7f45d5857640 1 -- 172.21.15.63:0/3481339404 learned_addr learned my addr 172.21.15.63:0/3481339404 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:31:29.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.348+0000 7f45d6859640 1 --2- 172.21.15.63:0/3481339404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b18b460 0x55587b5c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:29.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.348+0000 7f45d5857640 1 -- 172.21.15.63:0/3481339404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b1559f0 msgr2=0x55587b54e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:29.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.348+0000 7f45d5857640 1 --2- 172.21.15.63:0/3481339404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b1559f0 0x55587b54e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.348+0000 7f45d5857640 1 -- 172.21.15.63:0/3481339404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b18b460 msgr2=0x55587b5c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:31:29.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.348+0000 7f45d5857640 1 --2- 172.21.15.63:0/3481339404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b18b460 0x55587b5c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.348+0000 7f45d5857640 1 -- 172.21.15.63:0/3481339404 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55587b5c5bb0 con 0x55587b16e1b0 2024-09-21T06:31:29.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.348+0000 7f45d6859640 1 --2- 172.21.15.63:0/3481339404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b18b460 0x55587b5c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:31:29.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.349+0000 7f45d5857640 1 --2- 172.21.15.63:0/3481339404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b16e1b0 0x55587b54e920 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009230 tx=0x7f45c4009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7adc95f6e48284ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:29.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.349+0000 7f45b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:31:29.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.349+0000 7f45b9ffb640 1 -- 172.21.15.63:0/3481339404 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c4035040 con 0x55587b16e1b0 2024-09-21T06:31:29.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.349+0000 7f45de830740 1 -- 172.21.15.63:0/3481339404 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45cc0eb020 con 0x55587b16e1b0 2024-09-21T06:31:29.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.349+0000 7f45b9ffb640 1 -- 172.21.15.63:0/3481339404 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f45c4005240 con 0x55587b16e1b0 2024-09-21T06:31:29.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.349+0000 7f45b9ffb640 1 -- 172.21.15.63:0/3481339404 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f45c4005440 con 0x55587b16e1b0 2024-09-21T06:31:29.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.349+0000 7f45de830740 10 client.25931 fetch_fsmap learned FSMap version 43 2024-09-21T06:31:29.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.349+0000 7f45de830740 1 -- 172.21.15.63:0/3481339404 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55587b5c6e70 con 0x55587b16e1b0 2024-09-21T06:31:29.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.349+0000 7f45b9ffb640 1 -- 172.21.15.63:0/3481339404 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45cc0eb020 con 0x55587b16e1b0 2024-09-21T06:31:29.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.349+0000 7f45b9ffb640 1 -- 172.21.15.63:0/3481339404 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f45c40319d0 con 0x55587b16e1b0 2024-09-21T06:31:29.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.349+0000 7f45de830740 10 client.25931 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:31:29.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.349+0000 7f45de830740 10 client.25931 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:31:29.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.349+0000 7f45de830740 20 client.25931 populate_metadata read hostname 'smithi063' 2024-09-21T06:31:29.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.350+0000 7f45de830740 1 --2- 172.21.15.63:0/3481339404 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55587b176390 0x55587b5c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:29.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.350+0000 7f45de830740 4 client.25931 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:31:29.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.350+0000 7f45de830740 1 -- 172.21.15.63:0/3481339404 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55587b4b2850 con 0x55587b176390 2024-09-21T06:31:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.350+0000 7f45d6058640 1 --2- 172.21.15.63:0/3481339404 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55587b176390 0x55587b5c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.350+0000 7f45b9ffb640 10 client.25931 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:31:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.350+0000 7f45d6058640 1 --2- 172.21.15.63:0/3481339404 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55587b176390 0x55587b5c9770 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11763b770c9b68f6 server_cookie=76b997304a05478c in_seq=0 out_seq=0 2024-09-21T06:31:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.350+0000 7f45b9ffb640 1 -- 172.21.15.63:0/3481339404 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x55587b4b2850 con 0x55587b176390 2024-09-21T06:31:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.350+0000 7f45b9ffb640 10 client.25931 handle_command_reply: tid=0 2024-09-21T06:31:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.351+0000 7f45de830740 1 client.25931 shutdown 2024-09-21T06:31:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.351+0000 7f45de830740 1 -- 172.21.15.63:0/3481339404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b16e1b0 msgr2=0x55587b54e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.351+0000 7f45de830740 1 --2- 172.21.15.63:0/3481339404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b16e1b0 0x55587b54e920 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009230 tx=0x7f45c4009680 comp rx=0 tx=0).stop 2024-09-21T06:31:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.351+0000 7f45de830740 1 -- 172.21.15.63:0/3481339404 shutdown_connections 2024-09-21T06:31:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.351+0000 7f45de830740 1 --2- 172.21.15.63:0/3481339404 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55587b176390 0x55587b5c9770 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.351+0000 7f45de830740 1 --2- 172.21.15.63:0/3481339404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55587b18b460 0x55587b5c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.351+0000 7f45de830740 1 --2- 172.21.15.63:0/3481339404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55587b16e1b0 0x55587b54e920 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.351+0000 7f45de830740 1 --2- 172.21.15.63:0/3481339404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55587b1559f0 0x55587b54e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.351+0000 7f45b9ffb640 0 client.25931 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:31:29.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.351+0000 7f45de830740 1 -- 172.21.15.63:0/3481339404 >> 172.21.15.63:0/3481339404 conn(0x55587b5561c0 msgr2=0x55587b53f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:29.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.351+0000 7f45de830740 1 -- 172.21.15.63:0/3481339404 shutdown_connections 2024-09-21T06:31:29.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.351+0000 7f45de830740 1 -- 172.21.15.63:0/3481339404 wait complete. 2024-09-21T06:31:29.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.351+0000 7f45de830740 20 client.25931 trim_cache size 0 max 16384 2024-09-21T06:31:29.357 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:31:29.357 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:31:29.357 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": { 2024-09-21T06:31:29.357 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:31:29.357 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:31:29.357 INFO:teuthology.orchestra.run.smithi063.stdout: "tag": "9cd302bc-b682-49ab-bf6f-dee8f0549ead", 2024-09-21T06:31:29.358 INFO:teuthology.orchestra.run.smithi063.stdout: "options": "recursive,force" 2024-09-21T06:31:29.358 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:31:29.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:31:29.358 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:31:29.358 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:31:29.358 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:31:27.507051+0000", 2024-09-21T06:31:29.358 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:31:29.358 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:31:29.358 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:31:29.358 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:31:29.358 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:31:29.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:31:29.358 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:31:29.359 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:31:29.359 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:31:29.359 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:31:29.359 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:31:29.359 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:31:29.359 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:31:29.359 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:31:29.359 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:31:29.359 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:31:29.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.352+0000 7f45d82bc640 1 -- 172.21.15.63:0/3026298085 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f45bc0b6680 msgr2=0x7f45bc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:29.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.352+0000 7f45d82bc640 1 --2- 172.21.15.63:0/3026298085 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f45bc0b6680 0x7f45bc0b8b90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f45c8011490 tx=0x7f45c8021000 comp rx=0 tx=0).stop 2024-09-21T06:31:29.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.352+0000 7f45d82bc640 1 -- 172.21.15.63:0/3026298085 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45d0103b90 msgr2=0x7f45d0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:29.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.352+0000 7f45d82bc640 1 --2- 172.21.15.63:0/3026298085 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45d0103b90 0x7f45d0075710 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00e9f0 tx=0x7f45cc00edf0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.352+0000 7f45d82bc640 1 -- 172.21.15.63:0/3026298085 shutdown_connections 2024-09-21T06:31:29.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.352+0000 7f45d82bc640 1 --2- 172.21.15.63:0/3026298085 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f45bc0b6680 0x7f45bc0b8b90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.352+0000 7f45d82bc640 1 --2- 172.21.15.63:0/3026298085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d0109e20 0x7f45d0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.352+0000 7f45d82bc640 1 --2- 172.21.15.63:0/3026298085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45d01094d0 0x7f45d0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.352+0000 7f45d82bc640 1 --2- 172.21.15.63:0/3026298085 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45d0103b90 0x7f45d0075710 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:29.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.352+0000 7f45d82bc640 1 -- 172.21.15.63:0/3026298085 >> 172.21.15.63:0/3026298085 conn(0x7f45d00ff5e0 msgr2=0x7f45d0101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:29.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.352+0000 7f45d82bc640 1 -- 172.21.15.63:0/3026298085 shutdown_connections 2024-09-21T06:31:29.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:31:29.352+0000 7f45d82bc640 1 -- 172.21.15.63:0/3026298085 wait complete. 2024-09-21T06:31:29.736 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:29 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:31:29.736 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:29 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:31:29.736 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:29 smithi063 ceph-mon[31150]: pgmap v421: 97 pgs: 97 active+clean; 108 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 447 op/s 2024-09-21T06:31:29.736 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:29 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:29.736 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:29 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:29.736 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:29 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:29 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:31:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:29 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:31:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:29 smithi071 ceph-mon[34844]: pgmap v421: 97 pgs: 97 active+clean; 108 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 447 op/s 2024-09-21T06:31:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:29 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:29 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:29 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:29.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:29 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:31:29.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:29 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:31:29.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:29 smithi175 ceph-mon[34510]: pgmap v421: 97 pgs: 97 active+clean; 108 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 447 op/s 2024-09-21T06:31:29.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:29 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:29.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:29 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:29.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:29 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:30.071 INFO:tasks.cephfs.filesystem:scrub status for tag:9cd302bc-b682-49ab-bf6f-dee8f0549ead - {'path': '/', 'tag': '9cd302bc-b682-49ab-bf6f-dee8f0549ead', 'options': 'recursive,force'} 2024-09-21T06:31:30.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:30 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:30.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:30 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:30.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:30 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:30.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:30 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:30.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:30 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:31:30.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:30 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:31.414 INFO:tasks.workunit.client.0.smithi063.stdout:copying to largest ever: 0xffdb8 2024-09-21T06:31:31.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:31 smithi071 ceph-mon[34844]: pgmap v422: 97 pgs: 97 active+clean; 109 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.3 MiB/s wr, 614 op/s 2024-09-21T06:31:31.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:31 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:31.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:31 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:31.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:31 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:31:31.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:31 smithi063 ceph-mon[31150]: pgmap v422: 97 pgs: 97 active+clean; 109 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.3 MiB/s wr, 614 op/s 2024-09-21T06:31:31.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:31 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:31.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:31 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:31.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:31 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:31:31.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:31 smithi175 ceph-mon[34510]: pgmap v422: 97 pgs: 97 active+clean; 109 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.3 MiB/s wr, 614 op/s 2024-09-21T06:31:31.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:31 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:31.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:31 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:31.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:31 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:31:33.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:33 smithi063 ceph-mon[31150]: pgmap v423: 97 pgs: 97 active+clean; 113 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 625 op/s 2024-09-21T06:31:33.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:33 smithi071 ceph-mon[34844]: pgmap v423: 97 pgs: 97 active+clean; 113 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 625 op/s 2024-09-21T06:31:33.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:33 smithi175 ceph-mon[34510]: pgmap v423: 97 pgs: 97 active+clean; 113 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 625 op/s 2024-09-21T06:31:35.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:35 smithi071 ceph-mon[34844]: pgmap v424: 97 pgs: 97 active+clean; 113 MiB data, 934 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.0 MiB/s wr, 744 op/s 2024-09-21T06:31:35.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:35 smithi063 ceph-mon[31150]: pgmap v424: 97 pgs: 97 active+clean; 113 MiB data, 934 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.0 MiB/s wr, 744 op/s 2024-09-21T06:31:35.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:35 smithi175 ceph-mon[34510]: pgmap v424: 97 pgs: 97 active+clean; 113 MiB data, 934 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.0 MiB/s wr, 744 op/s 2024-09-21T06:31:37.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:37 smithi071 ceph-mon[34844]: pgmap v425: 97 pgs: 97 active+clean; 114 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 646 op/s 2024-09-21T06:31:37.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:37 smithi063 ceph-mon[31150]: pgmap v425: 97 pgs: 97 active+clean; 114 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 646 op/s 2024-09-21T06:31:37.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:37 smithi175 ceph-mon[34510]: pgmap v425: 97 pgs: 97 active+clean; 114 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 646 op/s 2024-09-21T06:31:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:31:37.888+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:31:37.888+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-21T06:31:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:31:37.888+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-21T06:31:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:31:37.888+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T06:31:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:31:37.888+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-09-21T06:31:38.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:38 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:31:38.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:38 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:31:38.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:38 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:31:38.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:38 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:31:38.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:38 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:31:38.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:38 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:31:39.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:39 smithi071 ceph-mon[34844]: pgmap v426: 97 pgs: 97 active+clean; 114 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.6 MiB/s wr, 559 op/s 2024-09-21T06:31:39.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:39 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:31:39.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:39 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:31:39.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:39 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:31:39.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:39 smithi063 ceph-mon[31150]: pgmap v426: 97 pgs: 97 active+clean; 114 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.6 MiB/s wr, 559 op/s 2024-09-21T06:31:39.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:39 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:31:39.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:39 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:31:39.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:39 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:31:39.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:39 smithi175 ceph-mon[34510]: pgmap v426: 97 pgs: 97 active+clean; 114 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.6 MiB/s wr, 559 op/s 2024-09-21T06:31:39.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:39 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:31:39.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:39 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:31:39.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:39 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:31:40.719 INFO:tasks.workunit.client.0.smithi063.stdout:50000 copy from 0x898b8 to 0x92015, (0x875d bytes) at 0xb142c 2024-09-21T06:31:40.719 INFO:tasks.workunit.client.0.smithi063.stdout:All 50000 operations completed A-OK! 2024-09-21T06:31:40.720 INFO:tasks.workunit.client.0.smithi063.stderr:+ ./fsx -z 10MB -N 50000 -p 10000 -l 10485760 2024-09-21T06:31:40.720 INFO:tasks.workunit.client.0.smithi063.stdout:Seed set to 1 2024-09-21T06:31:40.846 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-09-21T06:31:40.847 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-09-21T06:31:40.849 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-21T06:31:40.849 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-21T06:31:40.849 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support clone range, disabling! 2024-09-21T06:31:40.852 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-21T06:31:40.854 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support exchange range, disabling! 2024-09-21T06:31:40.854 INFO:tasks.workunit.client.0.smithi063.stdout:skipping zero length punch hole 2024-09-21T06:31:40.854 INFO:tasks.workunit.client.0.smithi063.stdout:skipping zero length punch hole 2024-09-21T06:31:40.854 INFO:tasks.workunit.client.0.smithi063.stdout:skipping zero length punch hole 2024-09-21T06:31:40.854 INFO:tasks.workunit.client.0.smithi063.stdout:skipping zero size read 2024-09-21T06:31:40.855 INFO:tasks.workunit.client.0.smithi063.stdout:skipping zero length punch hole 2024-09-21T06:31:40.855 INFO:tasks.workunit.client.0.smithi063.stdout:skipping zero size read 2024-09-21T06:31:40.855 INFO:tasks.workunit.client.0.smithi063.stdout:skipping zero length punch hole 2024-09-21T06:31:40.855 INFO:tasks.workunit.client.0.smithi063.stdout:truncating to largest ever: 0x4310e9 2024-09-21T06:31:40.860 INFO:tasks.workunit.client.0.smithi063.stdout:copying to largest ever: 0x954a45 2024-09-21T06:31:40.890 INFO:tasks.workunit.client.0.smithi063.stdout:truncating to largest ever: 0x9bc582 2024-09-21T06:31:40.911 INFO:tasks.workunit.client.0.smithi063.stdout:truncating to largest ever: 0x9eecbc 2024-09-21T06:31:41.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:41 smithi071 ceph-mon[34844]: pgmap v427: 97 pgs: 97 active+clean; 117 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 737 op/s 2024-09-21T06:31:41.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:41 smithi063 ceph-mon[31150]: pgmap v427: 97 pgs: 97 active+clean; 117 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 737 op/s 2024-09-21T06:31:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:41 smithi175 ceph-mon[34510]: pgmap v427: 97 pgs: 97 active+clean; 117 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 737 op/s 2024-09-21T06:31:42.651 INFO:tasks.workunit.client.0.smithi063.stdout:copying to largest ever: 0x9fdd84 2024-09-21T06:31:43.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:43 smithi071 ceph-mon[34844]: pgmap v428: 97 pgs: 97 active+clean; 119 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 600 op/s 2024-09-21T06:31:43.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:43 smithi063 ceph-mon[31150]: pgmap v428: 97 pgs: 97 active+clean; 119 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 600 op/s 2024-09-21T06:31:43.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:43 smithi175 ceph-mon[34510]: pgmap v428: 97 pgs: 97 active+clean; 119 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 600 op/s 2024-09-21T06:31:45.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:45 smithi071 ceph-mon[34844]: pgmap v429: 97 pgs: 97 active+clean; 123 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 557 op/s 2024-09-21T06:31:45.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:45 smithi063 ceph-mon[31150]: pgmap v429: 97 pgs: 97 active+clean; 123 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 557 op/s 2024-09-21T06:31:45.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:45 smithi175 ceph-mon[34510]: pgmap v429: 97 pgs: 97 active+clean; 123 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 557 op/s 2024-09-21T06:31:47.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:47 smithi071 ceph-mon[34844]: pgmap v430: 97 pgs: 97 active+clean; 123 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 416 op/s 2024-09-21T06:31:47.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:47 smithi063 ceph-mon[31150]: pgmap v430: 97 pgs: 97 active+clean; 123 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 416 op/s 2024-09-21T06:31:47.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:47 smithi175 ceph-mon[34510]: pgmap v430: 97 pgs: 97 active+clean; 123 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 416 op/s 2024-09-21T06:31:49.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:49 smithi071 ceph-mon[34844]: pgmap v431: 97 pgs: 97 active+clean; 122 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 3.5 MiB/s wr, 594 op/s 2024-09-21T06:31:49.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:49 smithi063 ceph-mon[31150]: pgmap v431: 97 pgs: 97 active+clean; 122 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 3.5 MiB/s wr, 594 op/s 2024-09-21T06:31:49.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:49 smithi175 ceph-mon[34510]: pgmap v431: 97 pgs: 97 active+clean; 122 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 3.5 MiB/s wr, 594 op/s 2024-09-21T06:31:51.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:51 smithi071 ceph-mon[34844]: pgmap v432: 97 pgs: 97 active+clean; 127 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 4.3 MiB/s wr, 763 op/s 2024-09-21T06:31:51.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:51 smithi063 ceph-mon[31150]: pgmap v432: 97 pgs: 97 active+clean; 127 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 4.3 MiB/s wr, 763 op/s 2024-09-21T06:31:51.923 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:51 smithi175 ceph-mon[34510]: pgmap v432: 97 pgs: 97 active+clean; 127 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 4.3 MiB/s wr, 763 op/s 2024-09-21T06:31:52.671 INFO:tasks.workunit.client.0.smithi063.stdout:copying to largest ever: 0x9ff773 2024-09-21T06:31:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:31:52.903+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:31:52.903+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-21T06:31:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:31:52.903+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-21T06:31:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:31:52.903+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T06:31:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:31:52.903+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-09-21T06:31:53.048 INFO:tasks.workunit.client.0.smithi063.stdout:20000 punch from 0x34ddcb to 0x35324f, (0x5484 bytes) 2024-09-21T06:31:53.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:53 smithi071 ceph-mon[34844]: pgmap v433: 97 pgs: 97 active+clean; 132 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.5 MiB/s wr, 792 op/s 2024-09-21T06:31:53.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:53 smithi063 ceph-mon[31150]: pgmap v433: 97 pgs: 97 active+clean; 132 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.5 MiB/s wr, 792 op/s 2024-09-21T06:31:53.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:53 smithi175 ceph-mon[34510]: pgmap v433: 97 pgs: 97 active+clean; 132 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.5 MiB/s wr, 792 op/s 2024-09-21T06:31:55.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:55 smithi071 ceph-mon[34844]: pgmap v434: 97 pgs: 97 active+clean; 132 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.9 MiB/s wr, 856 op/s 2024-09-21T06:31:55.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:55 smithi063 ceph-mon[31150]: pgmap v434: 97 pgs: 97 active+clean; 132 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.9 MiB/s wr, 856 op/s 2024-09-21T06:31:55.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:55 smithi175 ceph-mon[34510]: pgmap v434: 97 pgs: 97 active+clean; 132 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.9 MiB/s wr, 856 op/s 2024-09-21T06:31:57.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:57 smithi071 ceph-mon[34844]: pgmap v435: 97 pgs: 97 active+clean; 132 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.0 MiB/s wr, 693 op/s 2024-09-21T06:31:57.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:57 smithi063 ceph-mon[31150]: pgmap v435: 97 pgs: 97 active+clean; 132 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.0 MiB/s wr, 693 op/s 2024-09-21T06:31:57.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:57 smithi175 ceph-mon[34510]: pgmap v435: 97 pgs: 97 active+clean; 132 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.0 MiB/s wr, 693 op/s 2024-09-21T06:31:59.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:31:59 smithi071 ceph-mon[34844]: pgmap v436: 97 pgs: 97 active+clean; 137 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.5 MiB/s wr, 949 op/s 2024-09-21T06:31:59.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:31:59 smithi063 ceph-mon[31150]: pgmap v436: 97 pgs: 97 active+clean; 137 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.5 MiB/s wr, 949 op/s 2024-09-21T06:31:59.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:31:59 smithi175 ceph-mon[34510]: pgmap v436: 97 pgs: 97 active+clean; 137 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.5 MiB/s wr, 949 op/s 2024-09-21T06:32:00.072 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:32:00.315 INFO:tasks.workunit.client.0.smithi063.stdout:30000 trunc from 0x7a5444 to 0x143a5 2024-09-21T06:32:00.371 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:32:00.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.939+0000 7f3f8a7a4640 1 -- 172.21.15.63:0/1949623780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f84108cf0 msgr2=0x7f3f8410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:00.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.939+0000 7f3f8a7a4640 1 --2- 172.21.15.63:0/1949623780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f84108cf0 0x7f3f8410f520 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c009ca0 tx=0x7f3f7c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.939+0000 7f3f8a7a4640 1 -- 172.21.15.63:0/1949623780 shutdown_connections 2024-09-21T06:32:00.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.939+0000 7f3f8a7a4640 1 --2- 172.21.15.63:0/1949623780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f84108cf0 0x7f3f8410f520 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.939+0000 7f3f8a7a4640 1 --2- 172.21.15.63:0/1949623780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f841083a0 0x7f3f841087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.939+0000 7f3f8a7a4640 1 --2- 172.21.15.63:0/1949623780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f84102a60 0x7f3f84102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.939+0000 7f3f8a7a4640 1 -- 172.21.15.63:0/1949623780 >> 172.21.15.63:0/1949623780 conn(0x7f3f84079730 msgr2=0x7f3f84079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:00.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.939+0000 7f3f8a7a4640 1 -- 172.21.15.63:0/1949623780 shutdown_connections 2024-09-21T06:32:00.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.939+0000 7f3f8a7a4640 1 -- 172.21.15.63:0/1949623780 wait complete. 2024-09-21T06:32:00.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.940+0000 7f3f8a7a4640 1 Processor -- start 2024-09-21T06:32:00.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.940+0000 7f3f8a7a4640 1 -- start start 2024-09-21T06:32:00.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.941+0000 7f3f8a7a4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f84102a60 0x7f3f8419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:00.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.941+0000 7f3f8a7a4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f841083a0 0x7f3f8419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:00.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.941+0000 7f3f8a7a4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f84108cf0 0x7f3f8419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:00.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.941+0000 7f3f8a7a4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3f84112960 con 0x7f3f84108cf0 2024-09-21T06:32:00.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.941+0000 7f3f8a7a4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3f841127e0 con 0x7f3f84102a60 2024-09-21T06:32:00.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.941+0000 7f3f8a7a4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3f84112ae0 con 0x7f3f841083a0 2024-09-21T06:32:00.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.941+0000 7f3f83fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f84102a60 0x7f3f8419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:00.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.941+0000 7f3f88d41640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f84108cf0 0x7f3f8419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:00.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.941+0000 7f3f83fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f84102a60 0x7f3f8419a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:40368/0 (socket says 172.21.15.63:40368) 2024-09-21T06:32:00.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.941+0000 7f3f83fff640 1 -- 172.21.15.63:0/2094322591 learned_addr learned my addr 172.21.15.63:0/2094322591 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:00.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.941+0000 7f3f7bfff640 1 --2- 172.21.15.63:0/2094322591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f841083a0 0x7f3f8419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:00.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.941+0000 7f3f83fff640 1 -- 172.21.15.63:0/2094322591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f841083a0 msgr2=0x7f3f8419aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:00.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.941+0000 7f3f83fff640 1 --2- 172.21.15.63:0/2094322591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f841083a0 0x7f3f8419aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.941+0000 7f3f83fff640 1 -- 172.21.15.63:0/2094322591 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f84108cf0 msgr2=0x7f3f8419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:00.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.941+0000 7f3f83fff640 1 --2- 172.21.15.63:0/2094322591 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f84108cf0 0x7f3f8419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.941+0000 7f3f83fff640 1 -- 172.21.15.63:0/2094322591 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f841a0410 con 0x7f3f84102a60 2024-09-21T06:32:00.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.941+0000 7f3f83fff640 1 --2- 172.21.15.63:0/2094322591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f84102a60 0x7f3f8419a4a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3f7400e9f0 tx=0x7f3f7400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:00.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.942+0000 7f3f81ffb640 1 -- 172.21.15.63:0/2094322591 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7400cd80 con 0x7f3f84102a60 2024-09-21T06:32:00.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.942+0000 7f3f81ffb640 1 -- 172.21.15.63:0/2094322591 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f740108e0 con 0x7f3f84102a60 2024-09-21T06:32:00.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.942+0000 7f3f8a7a4640 1 -- 172.21.15.63:0/2094322591 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f841a0700 con 0x7f3f84102a60 2024-09-21T06:32:00.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.942+0000 7f3f81ffb640 1 -- 172.21.15.63:0/2094322591 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f74018980 con 0x7f3f84102a60 2024-09-21T06:32:00.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.942+0000 7f3f8a7a4640 1 -- 172.21.15.63:0/2094322591 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f841a6e60 con 0x7f3f84102a60 2024-09-21T06:32:00.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.945+0000 7f3f90d18740 1 Processor -- start 2024-09-21T06:32:00.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.945+0000 7f3f81ffb640 1 -- 172.21.15.63:0/2094322591 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f3f74010430 con 0x7f3f84102a60 2024-09-21T06:32:00.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.945+0000 7f3f90d18740 1 -- start start 2024-09-21T06:32:00.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.946+0000 7f3f90d18740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8d1070 0x55d6fec78650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:00.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.946+0000 7f3f90d18740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6fe8a81b0 0x55d6fec78b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:00.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.946+0000 7f3f90d18740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8b0390 0x55d6fec790d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:00.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.946+0000 7f3f90d18740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d6febeee50 con 0x55d6fe8b0390 2024-09-21T06:32:00.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.946+0000 7f3f90d18740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d6febde280 con 0x55d6fe8a81b0 2024-09-21T06:32:00.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.946+0000 7f3f90d18740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d6febe2090 con 0x55d6fe8d1070 2024-09-21T06:32:00.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.946+0000 7f3f88d41640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8d1070 0x55d6fec78650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:00.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.946+0000 7f3f88d41640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8d1070 0x55d6fec78650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:55544/0 (socket says 172.21.15.63:55544) 2024-09-21T06:32:00.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.946+0000 7f3f88d41640 1 -- 172.21.15.63:0/158804465 learned_addr learned my addr 172.21.15.63:0/158804465 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:00.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.946+0000 7f3f7bfff640 1 --2- 172.21.15.63:0/158804465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8b0390 0x55d6fec790d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:00.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.946+0000 7f3f83fff640 1 --2- 172.21.15.63:0/158804465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6fe8a81b0 0x55d6fec78b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:00.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.946+0000 7f3f88d41640 1 -- 172.21.15.63:0/158804465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6fe8a81b0 msgr2=0x55d6fec78b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:00.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.946+0000 7f3f88d41640 1 --2- 172.21.15.63:0/158804465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6fe8a81b0 0x55d6fec78b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.946+0000 7f3f88d41640 1 -- 172.21.15.63:0/158804465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8b0390 msgr2=0x55d6fec790d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:00.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.946+0000 7f3f88d41640 1 --2- 172.21.15.63:0/158804465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8b0390 0x55d6fec790d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.946+0000 7f3f88d41640 1 -- 172.21.15.63:0/158804465 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6fe93c650 con 0x55d6fe8d1070 2024-09-21T06:32:00.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.946+0000 7f3f88d41640 1 --2- 172.21.15.63:0/158804465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8d1070 0x55d6fec78650 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c02f410 tx=0x7f3f7c02f440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d116013032fb4ed5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:00.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.947+0000 7f3f81ffb640 1 --2- 172.21.15.63:0/2094322591 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3f700b6700 0x7f3f700b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:00.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.947+0000 7f3f83fff640 1 --2- 172.21.15.63:0/2094322591 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3f700b6700 0x7f3f700b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:00.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.947+0000 7f3f7a7fc640 1 -- 172.21.15.63:0/158804465 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c031cf0 con 0x55d6fe8d1070 2024-09-21T06:32:00.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.947+0000 7f3f81ffb640 1 -- 172.21.15.63:0/2094322591 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f3f740e79f0 con 0x7f3f84102a60 2024-09-21T06:32:00.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.947+0000 7f3f7a7fc640 1 -- 172.21.15.63:0/158804465 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f7c036030 con 0x55d6fe8d1070 2024-09-21T06:32:00.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.947+0000 7f3f7a7fc640 1 -- 172.21.15.63:0/158804465 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c0042a0 con 0x55d6fe8d1070 2024-09-21T06:32:00.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.948+0000 7f3f90d18740 1 -- 172.21.15.63:0/158804465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8d1070 msgr2=0x55d6fec78650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:00.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.948+0000 7f3f83fff640 1 --2- 172.21.15.63:0/2094322591 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3f700b6700 0x7f3f700b8c10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3f740e51d0 tx=0x7f3f74000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:00.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.948+0000 7f3f90d18740 1 --2- 172.21.15.63:0/158804465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8d1070 0x55d6fec78650 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c02f410 tx=0x7f3f7c02f440 comp rx=0 tx=0).stop 2024-09-21T06:32:00.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.948+0000 7f3f90d18740 1 -- 172.21.15.63:0/158804465 shutdown_connections 2024-09-21T06:32:00.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.948+0000 7f3f90d18740 1 --2- 172.21.15.63:0/158804465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8b0390 0x55d6fec790d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.948+0000 7f3f90d18740 1 --2- 172.21.15.63:0/158804465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6fe8a81b0 0x55d6fec78b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.948+0000 7f3f90d18740 1 --2- 172.21.15.63:0/158804465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8d1070 0x55d6fec78650 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.948+0000 7f3f90d18740 1 -- 172.21.15.63:0/158804465 >> 172.21.15.63:0/158804465 conn(0x55d6fe8c5460 msgr2=0x55d6fec76540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:00.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.948+0000 7f3f90d18740 1 -- 172.21.15.63:0/158804465 shutdown_connections 2024-09-21T06:32:00.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.948+0000 7f3f90d18740 1 -- 172.21.15.63:0/158804465 wait complete. 2024-09-21T06:32:00.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.948+0000 7f3f90d18740 1 -- start start 2024-09-21T06:32:00.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.949+0000 7f3f90d18740 1 Processor -- start 2024-09-21T06:32:00.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.949+0000 7f3f90d18740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8a81b0 0x55d6fec83d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:00.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.949+0000 7f3f90d18740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6fe8b0390 0x55d6fec84290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:00.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.949+0000 7f3f90d18740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8d1070 0x55d6fec8ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:00.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.949+0000 7f3f90d18740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d6fea3f700 con 0x55d6fe8d1070 2024-09-21T06:32:00.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.949+0000 7f3f90d18740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d6feb79110 con 0x55d6fe8b0390 2024-09-21T06:32:00.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.949+0000 7f3f90d18740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d6fec86c50 con 0x55d6fe8a81b0 2024-09-21T06:32:00.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.949+0000 7f3f7bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6fe8b0390 0x55d6fec84290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:00.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.949+0000 7f3f90d18740 10 client.0 _ll_register_callbacks cb 0x55d6feb92990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:00.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.949+0000 7f3f88d41640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8a81b0 0x55d6fec83d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:00.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.949+0000 7f3f88d41640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8a81b0 0x55d6fec83d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:55560/0 (socket says 172.21.15.63:55560) 2024-09-21T06:32:00.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.949+0000 7f3f88d41640 1 -- 172.21.15.63:0/400998679 learned_addr learned my addr 172.21.15.63:0/400998679 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:00.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.949+0000 7f3f88d41640 1 --2- 172.21.15.63:0/400998679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8d1070 0x55d6fec8ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:00.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.950+0000 7f3f88d41640 1 -- 172.21.15.63:0/400998679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6fe8b0390 msgr2=0x55d6fec84290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:00.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.950+0000 7f3f88d41640 1 --2- 172.21.15.63:0/400998679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6fe8b0390 0x55d6fec84290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.950+0000 7f3f88d41640 1 -- 172.21.15.63:0/400998679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8d1070 msgr2=0x55d6fec8ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:00.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.950+0000 7f3f88d41640 1 --2- 172.21.15.63:0/400998679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8d1070 0x55d6fec8ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.950+0000 7f3f88d41640 1 -- 172.21.15.63:0/400998679 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6feba6c40 con 0x55d6fe8a81b0 2024-09-21T06:32:00.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.950+0000 7f3f88d41640 1 --2- 172.21.15.63:0/400998679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8a81b0 0x55d6fec83d50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c0096c0 tx=0x7f3f7c003c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c58584f2eba42257 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:00.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.950+0000 7f3f637fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:32:00.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.950+0000 7f3f637fe640 1 -- 172.21.15.63:0/400998679 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c058020 con 0x55d6fe8a81b0 2024-09-21T06:32:00.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.950+0000 7f3f637fe640 1 -- 172.21.15.63:0/400998679 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f3f7c004b40 con 0x55d6fe8a81b0 2024-09-21T06:32:00.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.950+0000 7f3f90d18740 1 -- 172.21.15.63:0/400998679 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f7c036030 con 0x55d6fe8a81b0 2024-09-21T06:32:00.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.950+0000 7f3f637fe640 1 -- 172.21.15.63:0/400998679 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f3f7c02f660 con 0x55d6fe8a81b0 2024-09-21T06:32:00.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.950+0000 7f3f90d18740 10 client.26008 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:00.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.950+0000 7f3f90d18740 1 -- 172.21.15.63:0/400998679 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55d6fec929c0 con 0x55d6fe8a81b0 2024-09-21T06:32:00.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.951+0000 7f3f637fe640 1 -- 172.21.15.63:0/400998679 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f7c036030 con 0x55d6fe8a81b0 2024-09-21T06:32:00.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.951+0000 7f3f637fe640 1 -- 172.21.15.63:0/400998679 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f3f7c043070 con 0x55d6fe8a81b0 2024-09-21T06:32:00.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.951+0000 7f3f90d18740 10 client.26008 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:00.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.951+0000 7f3f90d18740 10 client.26008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:32:00.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.951+0000 7f3f90d18740 20 client.26008 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:00.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.951+0000 7f3f90d18740 1 --2- 172.21.15.63:0/400998679 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d6fe88f9f0 0x55d6fec95f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:00.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.951+0000 7f3f90d18740 4 client.26008 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:32:00.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.951+0000 7f3f90d18740 1 -- 172.21.15.63:0/400998679 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6febf0da0 con 0x55d6fe88f9f0 2024-09-21T06:32:00.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.951+0000 7f3f7bfff640 1 --2- 172.21.15.63:0/400998679 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d6fe88f9f0 0x55d6fec95f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:00.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.952+0000 7f3f7bfff640 1 --2- 172.21.15.63:0/400998679 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d6fe88f9f0 0x55d6fec95f30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e1c1b55d61dabde server_cookie=7157f277c4813b32 in_seq=0 out_seq=0 2024-09-21T06:32:00.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.952+0000 7f3f637fe640 10 client.26008 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:00.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.953+0000 7f3f637fe640 1 -- 172.21.15.63:0/400998679 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d6febf0da0 con 0x55d6fe88f9f0 2024-09-21T06:32:00.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.953+0000 7f3f637fe640 10 client.26008 handle_command_reply: tid=0 2024-09-21T06:32:00.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.953+0000 7f3f90d18740 1 client.26008 shutdown 2024-09-21T06:32:00.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.953+0000 7f3f90d18740 1 -- 172.21.15.63:0/400998679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8a81b0 msgr2=0x55d6fec83d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:00.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.953+0000 7f3f90d18740 1 --2- 172.21.15.63:0/400998679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8a81b0 0x55d6fec83d50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c0096c0 tx=0x7f3f7c003c70 comp rx=0 tx=0).stop 2024-09-21T06:32:00.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.953+0000 7f3f90d18740 1 -- 172.21.15.63:0/400998679 shutdown_connections 2024-09-21T06:32:00.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.953+0000 7f3f90d18740 1 --2- 172.21.15.63:0/400998679 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d6fe88f9f0 0x55d6fec95f30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.953+0000 7f3f90d18740 1 --2- 172.21.15.63:0/400998679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8d1070 0x55d6fec8ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.953+0000 7f3f90d18740 1 --2- 172.21.15.63:0/400998679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6fe8b0390 0x55d6fec84290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.953+0000 7f3f90d18740 1 --2- 172.21.15.63:0/400998679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8a81b0 0x55d6fec83d50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.953+0000 7f3f90d18740 1 -- 172.21.15.63:0/400998679 >> 172.21.15.63:0/400998679 conn(0x55d6fe8c5460 msgr2=0x55d6fec7b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:00.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.953+0000 7f3f637fe640 0 client.26008 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:00.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.953+0000 7f3f90d18740 1 -- 172.21.15.63:0/400998679 shutdown_connections 2024-09-21T06:32:00.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.953+0000 7f3f90d18740 1 -- 172.21.15.63:0/400998679 wait complete. 2024-09-21T06:32:00.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.953+0000 7f3f90d18740 20 client.26008 trim_cache size 0 max 16384 2024-09-21T06:32:00.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.973+0000 7f3f90d18740 1 Processor -- start 2024-09-21T06:32:00.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.973+0000 7f3f90d18740 1 -- start start 2024-09-21T06:32:00.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.973+0000 7f3f90d18740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6fe8a81b0 0x55d6fec79d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:00.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.973+0000 7f3f90d18740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8b0390 0x55d6fec80f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:00.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.974+0000 7f3f90d18740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8d1070 0x55d6fec81480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:00.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.974+0000 7f3f90d18740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3f841ad560 con 0x55d6fe8b0390 2024-09-21T06:32:00.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.974+0000 7f3f90d18740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3f841af160 con 0x55d6fe8a81b0 2024-09-21T06:32:00.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.974+0000 7f3f90d18740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3f841adcf0 con 0x55d6fe8d1070 2024-09-21T06:32:00.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.974+0000 7f3f7bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8b0390 0x55d6fec80f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:00.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.974+0000 7f3f7bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8b0390 0x55d6fec80f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42464/0 (socket says 172.21.15.63:42464) 2024-09-21T06:32:00.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.974+0000 7f3f7bfff640 1 -- 172.21.15.63:0/478262906 learned_addr learned my addr 172.21.15.63:0/478262906 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:00.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.974+0000 7f3f88d41640 1 --2- 172.21.15.63:0/478262906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6fe8a81b0 0x55d6fec79d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:00.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.974+0000 7f3f88d41640 1 --2- 172.21.15.63:0/478262906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8d1070 0x55d6fec81480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:00.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.974+0000 7f3f7bfff640 1 -- 172.21.15.63:0/478262906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8d1070 msgr2=0x55d6fec81480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:00.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.974+0000 7f3f7bfff640 1 --2- 172.21.15.63:0/478262906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8d1070 0x55d6fec81480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.974+0000 7f3f7bfff640 1 -- 172.21.15.63:0/478262906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6fe8a81b0 msgr2=0x55d6fec79d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:00.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.974+0000 7f3f7bfff640 1 --2- 172.21.15.63:0/478262906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6fe8a81b0 0x55d6fec79d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.974+0000 7f3f7bfff640 1 -- 172.21.15.63:0/478262906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6fec85010 con 0x55d6fe8b0390 2024-09-21T06:32:00.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.974+0000 7f3f7bfff640 1 --2- 172.21.15.63:0/478262906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8b0390 0x55d6fec80f40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009c00 tx=0x7f3f6c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae0eb67fd7d0088 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:00.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.975+0000 7f3f79ffb640 1 -- 172.21.15.63:0/478262906 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c004250 con 0x55d6fe8b0390 2024-09-21T06:32:00.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.975+0000 7f3f79ffb640 1 -- 172.21.15.63:0/478262906 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f6c0043f0 con 0x55d6fe8b0390 2024-09-21T06:32:00.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.975+0000 7f3f79ffb640 1 -- 172.21.15.63:0/478262906 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c01f8a0 con 0x55d6fe8b0390 2024-09-21T06:32:00.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.976+0000 7f3f90d18740 1 -- 172.21.15.63:0/478262906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8b0390 msgr2=0x55d6fec80f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:00.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.976+0000 7f3f90d18740 1 --2- 172.21.15.63:0/478262906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8b0390 0x55d6fec80f40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009c00 tx=0x7f3f6c005f90 comp rx=0 tx=0).stop 2024-09-21T06:32:00.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.976+0000 7f3f90d18740 1 -- 172.21.15.63:0/478262906 shutdown_connections 2024-09-21T06:32:00.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.976+0000 7f3f90d18740 1 --2- 172.21.15.63:0/478262906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8d1070 0x55d6fec81480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.976+0000 7f3f90d18740 1 --2- 172.21.15.63:0/478262906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8b0390 0x55d6fec80f40 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.976+0000 7f3f90d18740 1 --2- 172.21.15.63:0/478262906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6fe8a81b0 0x55d6fec79d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.976+0000 7f3f90d18740 1 -- 172.21.15.63:0/478262906 >> 172.21.15.63:0/478262906 conn(0x55d6fe8c5460 msgr2=0x55d6fec79680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.976+0000 7f3f90d18740 1 -- 172.21.15.63:0/478262906 shutdown_connections 2024-09-21T06:32:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.976+0000 7f3f90d18740 1 -- 172.21.15.63:0/478262906 wait complete. 2024-09-21T06:32:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.976+0000 7f3f90d18740 1 -- start start 2024-09-21T06:32:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.976+0000 7f3f90d18740 1 Processor -- start 2024-09-21T06:32:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.977+0000 7f3f90d18740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8a81b0 0x55d6fec896d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.977+0000 7f3f90d18740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8b0390 0x55d6fec89c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.977+0000 7f3f90d18740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6fe8d1070 0x55d6fecfe8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.977+0000 7f3f90d18740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3f841aea90 con 0x55d6fe8b0390 2024-09-21T06:32:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.977+0000 7f3f90d18740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3f841ae3c0 con 0x55d6fe8d1070 2024-09-21T06:32:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.977+0000 7f3f90d18740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3f841ab540 con 0x55d6fe8a81b0 2024-09-21T06:32:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.977+0000 7f3f90d18740 10 client.0 _ll_register_callbacks cb 0x7f3f6c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.977+0000 7f3f88d41640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8a81b0 0x55d6fec896d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.977+0000 7f3f7bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8b0390 0x55d6fec89c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.977+0000 7f3f88d41640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8a81b0 0x55d6fec896d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:55576/0 (socket says 172.21.15.63:55576) 2024-09-21T06:32:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.977+0000 7f3f88d41640 1 -- 172.21.15.63:0/3991449691 learned_addr learned my addr 172.21.15.63:0/3991449691 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.977+0000 7f3f7bfff640 1 --2- 172.21.15.63:0/3991449691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8b0390 0x55d6fec89c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42468/0 (socket says 172.21.15.63:42468) 2024-09-21T06:32:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.977+0000 7f3f88d41640 1 --2- 172.21.15.63:0/3991449691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6fe8d1070 0x55d6fecfe8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.977+0000 7f3f7bfff640 1 -- 172.21.15.63:0/3991449691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8a81b0 msgr2=0x55d6fec896d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.977+0000 7f3f7bfff640 1 --2- 172.21.15.63:0/3991449691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8a81b0 0x55d6fec896d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.977+0000 7f3f7bfff640 1 -- 172.21.15.63:0/3991449691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6fe8d1070 msgr2=0x55d6fecfe8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.977+0000 7f3f7bfff640 1 --2- 172.21.15.63:0/3991449691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6fe8d1070 0x55d6fecfe8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.977+0000 7f3f7bfff640 1 -- 172.21.15.63:0/3991449691 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6fecfef60 con 0x55d6fe8b0390 2024-09-21T06:32:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.978+0000 7f3f7bfff640 1 --2- 172.21.15.63:0/3991449691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8b0390 0x55d6fec89c90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009c00 tx=0x7f3f6c005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470d430f53275ed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.978+0000 7f3f637fe640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:32:00.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.978+0000 7f3f637fe640 1 -- 172.21.15.63:0/3991449691 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0035f0 con 0x55d6fe8b0390 2024-09-21T06:32:00.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.978+0000 7f3f637fe640 1 -- 172.21.15.63:0/3991449691 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f3f6c003790 con 0x55d6fe8b0390 2024-09-21T06:32:00.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.978+0000 7f3f90d18740 1 -- 172.21.15.63:0/3991449691 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f6c0043f0 con 0x55d6fe8b0390 2024-09-21T06:32:00.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.978+0000 7f3f637fe640 1 -- 172.21.15.63:0/3991449691 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f3f6c03a050 con 0x55d6fe8b0390 2024-09-21T06:32:00.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.978+0000 7f3f90d18740 10 client.16302 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:00.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.978+0000 7f3f90d18740 1 -- 172.21.15.63:0/3991449691 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55d6fed001d0 con 0x55d6fe8b0390 2024-09-21T06:32:00.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.978+0000 7f3f637fe640 1 -- 172.21.15.63:0/3991449691 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f6c0043f0 con 0x55d6fe8b0390 2024-09-21T06:32:00.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.979+0000 7f3f637fe640 1 -- 172.21.15.63:0/3991449691 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f3f6c023070 con 0x55d6fe8b0390 2024-09-21T06:32:00.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.979+0000 7f3f90d18740 10 client.16302 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:00.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.979+0000 7f3f90d18740 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:32:00.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.979+0000 7f3f90d18740 20 client.16302 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:00.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.979+0000 7f3f90d18740 1 --2- 172.21.15.63:0/3991449691 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d6fe864da0 0x55d6fed02a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:00.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.979+0000 7f3f90d18740 4 client.16302 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:32:00.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.979+0000 7f3f90d18740 1 -- 172.21.15.63:0/3991449691 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d6febec850 con 0x55d6fe864da0 2024-09-21T06:32:00.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.979+0000 7f3f88d41640 1 --2- 172.21.15.63:0/3991449691 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d6fe864da0 0x55d6fed02a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:00.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.980+0000 7f3f88d41640 1 --2- 172.21.15.63:0/3991449691 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d6fe864da0 0x55d6fed02a50 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d85e5ea955bb87ed server_cookie=5acf27da4149840 in_seq=0 out_seq=0 2024-09-21T06:32:00.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.980+0000 7f3f637fe640 10 client.16302 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:00.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.980+0000 7f3f637fe640 1 -- 172.21.15.63:0/3991449691 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x55d6febec850 con 0x55d6fe864da0 2024-09-21T06:32:00.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.980+0000 7f3f637fe640 10 client.16302 handle_command_reply: tid=0 2024-09-21T06:32:00.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.980+0000 7f3f90d18740 1 client.16302 shutdown 2024-09-21T06:32:00.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.980+0000 7f3f90d18740 1 -- 172.21.15.63:0/3991449691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8b0390 msgr2=0x55d6fec89c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:00.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.980+0000 7f3f90d18740 1 --2- 172.21.15.63:0/3991449691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8b0390 0x55d6fec89c90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009c00 tx=0x7f3f6c005d30 comp rx=0 tx=0).stop 2024-09-21T06:32:00.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.981+0000 7f3f90d18740 1 -- 172.21.15.63:0/3991449691 shutdown_connections 2024-09-21T06:32:00.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.981+0000 7f3f90d18740 1 --2- 172.21.15.63:0/3991449691 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d6fe864da0 0x55d6fed02a50 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.981+0000 7f3f637fe640 0 client.16302 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:00.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.981+0000 7f3f90d18740 1 --2- 172.21.15.63:0/3991449691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6fe8d1070 0x55d6fecfe8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.981+0000 7f3f90d18740 1 --2- 172.21.15.63:0/3991449691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6fe8b0390 0x55d6fec89c90 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.987 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:32:00.987 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "no active scrubs running", 2024-09-21T06:32:00.987 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": {}, 2024-09-21T06:32:00.987 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:32:00.987 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:32:00.987 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:31:27.507051+0000", 2024-09-21T06:32:00.987 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:32:00.987 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:32:00.987 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:32:00.988 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:32:00.988 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:32:00.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:32:00.988 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:32:00.988 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:32:00.988 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:32:00.988 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:32:00.988 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:32:00.988 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:32:00.988 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:32:00.988 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:32:00.988 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:32:00.988 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:32:00.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.981+0000 7f3f90d18740 1 --2- 172.21.15.63:0/3991449691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6fe8a81b0 0x55d6fec896d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.981+0000 7f3f90d18740 1 -- 172.21.15.63:0/3991449691 >> 172.21.15.63:0/3991449691 conn(0x55d6fe8c5460 msgr2=0x55d6fec85ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:00.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.981+0000 7f3f90d18740 1 -- 172.21.15.63:0/3991449691 shutdown_connections 2024-09-21T06:32:00.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.981+0000 7f3f90d18740 1 -- 172.21.15.63:0/3991449691 wait complete. 2024-09-21T06:32:00.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.981+0000 7f3f90d18740 20 client.16302 trim_cache size 0 max 16384 2024-09-21T06:32:00.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.982+0000 7f3f8a7a4640 1 -- 172.21.15.63:0/2094322591 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3f700b6700 msgr2=0x7f3f700b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:00.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.982+0000 7f3f8a7a4640 1 --2- 172.21.15.63:0/2094322591 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3f700b6700 0x7f3f700b8c10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3f740e51d0 tx=0x7f3f74000bc0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.982+0000 7f3f8a7a4640 1 -- 172.21.15.63:0/2094322591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f84102a60 msgr2=0x7f3f8419a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:00.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.982+0000 7f3f8a7a4640 1 --2- 172.21.15.63:0/2094322591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f84102a60 0x7f3f8419a4a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3f7400e9f0 tx=0x7f3f7400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.982+0000 7f3f8a7a4640 1 -- 172.21.15.63:0/2094322591 shutdown_connections 2024-09-21T06:32:00.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.982+0000 7f3f8a7a4640 1 --2- 172.21.15.63:0/2094322591 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f84108cf0 0x7f3f8419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.982+0000 7f3f8a7a4640 1 --2- 172.21.15.63:0/2094322591 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3f700b6700 0x7f3f700b8c10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.982+0000 7f3f8a7a4640 1 --2- 172.21.15.63:0/2094322591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f841083a0 0x7f3f8419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.982+0000 7f3f8a7a4640 1 --2- 172.21.15.63:0/2094322591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f84102a60 0x7f3f8419a4a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:00.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.982+0000 7f3f8a7a4640 1 -- 172.21.15.63:0/2094322591 >> 172.21.15.63:0/2094322591 conn(0x7f3f84079730 msgr2=0x7f3f8406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:00.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.982+0000 7f3f8a7a4640 1 -- 172.21.15.63:0/2094322591 shutdown_connections 2024-09-21T06:32:00.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:00.982+0000 7f3f8a7a4640 1 -- 172.21.15.63:0/2094322591 wait complete. 2024-09-21T06:32:01.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:01 smithi071 ceph-mon[34844]: pgmap v437: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.7 MiB/s wr, 848 op/s 2024-09-21T06:32:01.816 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:01 smithi063 ceph-mon[31150]: pgmap v437: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.7 MiB/s wr, 848 op/s 2024-09-21T06:32:01.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:01 smithi175 ceph-mon[34510]: pgmap v437: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.7 MiB/s wr, 848 op/s 2024-09-21T06:32:01.850 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:32:01.850 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:32:02.139 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:32:02.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.646+0000 7fcd85d9b640 1 -- 172.21.15.63:0/2425269123 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd80102a60 msgr2=0x7fcd80102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:02.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.646+0000 7fcd85d9b640 1 --2- 172.21.15.63:0/2425269123 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd80102a60 0x7fcd80102e70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fcd70009900 tx=0x7fcd7002a410 comp rx=0 tx=0).stop 2024-09-21T06:32:02.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.646+0000 7fcd85d9b640 1 -- 172.21.15.63:0/2425269123 shutdown_connections 2024-09-21T06:32:02.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.646+0000 7fcd85d9b640 1 --2- 172.21.15.63:0/2425269123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd80108cf0 0x7fcd8010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:02.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.646+0000 7fcd85d9b640 1 --2- 172.21.15.63:0/2425269123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd801083a0 0x7fcd801087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:02.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.646+0000 7fcd85d9b640 1 --2- 172.21.15.63:0/2425269123 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd80102a60 0x7fcd80102e70 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:02.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.646+0000 7fcd85d9b640 1 -- 172.21.15.63:0/2425269123 >> 172.21.15.63:0/2425269123 conn(0x7fcd80079730 msgr2=0x7fcd80079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:02.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.646+0000 7fcd85d9b640 1 -- 172.21.15.63:0/2425269123 shutdown_connections 2024-09-21T06:32:02.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.646+0000 7fcd85d9b640 1 -- 172.21.15.63:0/2425269123 wait complete. 2024-09-21T06:32:02.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.647+0000 7fcd85d9b640 1 Processor -- start 2024-09-21T06:32:02.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.647+0000 7fcd85d9b640 1 -- start start 2024-09-21T06:32:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.648+0000 7fcd85d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd80102a60 0x7fcd8019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.648+0000 7fcd85d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd801083a0 0x7fcd8019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.648+0000 7fcd85d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd80108cf0 0x7fcd8019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.648+0000 7fcd85d9b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcd80113a80 con 0x7fcd80102a60 2024-09-21T06:32:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.648+0000 7fcd85d9b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcd80113900 con 0x7fcd80108cf0 2024-09-21T06:32:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.648+0000 7fcd85d9b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcd80113c00 con 0x7fcd801083a0 2024-09-21T06:32:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.648+0000 7fcd7f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd80102a60 0x7fcd8019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.648+0000 7fcd7f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd80102a60 0x7fcd8019a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42496/0 (socket says 172.21.15.63:42496) 2024-09-21T06:32:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.648+0000 7fcd7f7fe640 1 -- 172.21.15.63:0/1251703859 learned_addr learned my addr 172.21.15.63:0/1251703859 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.648+0000 7fcd7effd640 1 --2- 172.21.15.63:0/1251703859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd801083a0 0x7fcd8019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.648+0000 7fcd7ffff640 1 --2- 172.21.15.63:0/1251703859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd80108cf0 0x7fcd8019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.648+0000 7fcd7effd640 1 -- 172.21.15.63:0/1251703859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd80108cf0 msgr2=0x7fcd8019fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.648+0000 7fcd7effd640 1 --2- 172.21.15.63:0/1251703859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd80108cf0 0x7fcd8019fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.648+0000 7fcd7effd640 1 -- 172.21.15.63:0/1251703859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd80102a60 msgr2=0x7fcd8019a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.648+0000 7fcd7effd640 1 --2- 172.21.15.63:0/1251703859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd80102a60 0x7fcd8019a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.648+0000 7fcd7effd640 1 -- 172.21.15.63:0/1251703859 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd801a0380 con 0x7fcd801083a0 2024-09-21T06:32:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.648+0000 7fcd7effd640 1 --2- 172.21.15.63:0/1251703859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd801083a0 0x7fcd8019a9b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400e9c0 tx=0x7fcd7400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.649+0000 7fcd7cff9640 1 -- 172.21.15.63:0/1251703859 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7400ccc0 con 0x7fcd801083a0 2024-09-21T06:32:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.649+0000 7fcd85d9b640 1 -- 172.21.15.63:0/1251703859 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd801a0670 con 0x7fcd801083a0 2024-09-21T06:32:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.649+0000 7fcd7cff9640 1 -- 172.21.15.63:0/1251703859 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd740108e0 con 0x7fcd801083a0 2024-09-21T06:32:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.649+0000 7fcd7cff9640 1 -- 172.21.15.63:0/1251703859 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd740187a0 con 0x7fcd801083a0 2024-09-21T06:32:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.649+0000 7fcd85d9b640 1 -- 172.21.15.63:0/1251703859 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd801a6dd0 con 0x7fcd801083a0 2024-09-21T06:32:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.650+0000 7fcd85d9b640 1 -- 172.21.15.63:0/1251703859 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd80102e70 con 0x7fcd801083a0 2024-09-21T06:32:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.652+0000 7fcd7cff9640 1 -- 172.21.15.63:0/1251703859 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fcd74010430 con 0x7fcd801083a0 2024-09-21T06:32:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.652+0000 7fcd7cff9640 1 --2- 172.21.15.63:0/1251703859 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcd680b6680 0x7fcd680b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:02.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.652+0000 7fcd7f7fe640 1 --2- 172.21.15.63:0/1251703859 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcd680b6680 0x7fcd680b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:02.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.653+0000 7fcd7cff9640 1 -- 172.21.15.63:0/1251703859 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fcd740e7ed0 con 0x7fcd801083a0 2024-09-21T06:32:02.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.653+0000 7fcd7f7fe640 1 --2- 172.21.15.63:0/1251703859 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcd680b6680 0x7fcd680b8b90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcd70031440 tx=0x7fcd700058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:02.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.657+0000 7fcd7cff9640 1 -- 172.21.15.63:0/1251703859 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcd740b27e0 con 0x7fcd801083a0 2024-09-21T06:32:02.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.911+0000 7fcd85d9b640 1 -- 172.21.15.63:0/1251703859 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd8019b540 con 0x7fcd801083a0 2024-09-21T06:32:02.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.912+0000 7fcd7cff9640 1 -- 172.21.15.63:0/1251703859 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+11978 (secure 0 0 0) 0x7fcd740b7720 con 0x7fcd801083a0 2024-09-21T06:32:02.915 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:32:02.916 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":43,"btime":"2024-09-21T06:30:43:391669+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":43,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:30:43.123943+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24659,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":34,"state":"up:active","state_seq":69,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25637":{"gid":25637,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3354670524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3354670524},{"type":"v1","addr":"172.21.15.71:6839","nonce":3354670524}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24659,"qdb_cluster":[24694,24670,24659,24676,14835]},"id":1}]} 2024-09-21T06:32:02.916 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 43 2024-09-21T06:32:02.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.915+0000 7fcd85d9b640 1 -- 172.21.15.63:0/1251703859 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcd680b6680 msgr2=0x7fcd680b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:02.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.915+0000 7fcd85d9b640 1 --2- 172.21.15.63:0/1251703859 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcd680b6680 0x7fcd680b8b90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcd70031440 tx=0x7fcd700058d0 comp rx=0 tx=0).stop 2024-09-21T06:32:02.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.915+0000 7fcd85d9b640 1 -- 172.21.15.63:0/1251703859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd801083a0 msgr2=0x7fcd8019a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:02.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.915+0000 7fcd85d9b640 1 --2- 172.21.15.63:0/1251703859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd801083a0 0x7fcd8019a9b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400e9c0 tx=0x7fcd7400ee80 comp rx=0 tx=0).stop 2024-09-21T06:32:02.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.915+0000 7fcd85d9b640 1 -- 172.21.15.63:0/1251703859 shutdown_connections 2024-09-21T06:32:02.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.915+0000 7fcd85d9b640 1 --2- 172.21.15.63:0/1251703859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd80108cf0 0x7fcd8019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:02.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.915+0000 7fcd85d9b640 1 --2- 172.21.15.63:0/1251703859 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcd680b6680 0x7fcd680b8b90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:02.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.915+0000 7fcd85d9b640 1 --2- 172.21.15.63:0/1251703859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd801083a0 0x7fcd8019a9b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:02.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.915+0000 7fcd85d9b640 1 --2- 172.21.15.63:0/1251703859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd80102a60 0x7fcd8019a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:02.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.915+0000 7fcd85d9b640 1 -- 172.21.15.63:0/1251703859 >> 172.21.15.63:0/1251703859 conn(0x7fcd80079730 msgr2=0x7fcd801013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:02.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.915+0000 7fcd85d9b640 1 -- 172.21.15.63:0/1251703859 shutdown_connections 2024-09-21T06:32:02.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:02.915+0000 7fcd85d9b640 1 -- 172.21.15.63:0/1251703859 wait complete. 2024-09-21T06:32:03.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:03 smithi063 ceph-mon[31150]: pgmap v438: 97 pgs: 97 active+clean; 146 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 5.1 MiB/s wr, 842 op/s 2024-09-21T06:32:03.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:03 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1251703859' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:32:03.716 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T06:32:03.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:03 smithi071 ceph-mon[34844]: pgmap v438: 97 pgs: 97 active+clean; 146 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 5.1 MiB/s wr, 842 op/s 2024-09-21T06:32:03.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:03 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1251703859' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:32:03.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:03 smithi175 ceph-mon[34510]: pgmap v438: 97 pgs: 97 active+clean; 146 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 5.1 MiB/s wr, 842 op/s 2024-09-21T06:32:03.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:03 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1251703859' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:32:04.000 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:32:04.386 INFO:tasks.workunit.client.0.smithi063.stdout:truncating to largest ever: 0x9ffb01 2024-09-21T06:32:04.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.626+0000 7f28078ec640 1 -- 172.21.15.63:0/3734721758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2800105300 msgr2=0x7f280010d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:04.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.626+0000 7f28078ec640 1 --2- 172.21.15.63:0/3734721758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2800105300 0x7f280010d850 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009900 tx=0x7f27f002a410 comp rx=0 tx=0).stop 2024-09-21T06:32:04.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.626+0000 7f28078ec640 1 -- 172.21.15.63:0/3734721758 shutdown_connections 2024-09-21T06:32:04.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.626+0000 7f28078ec640 1 --2- 172.21.15.63:0/3734721758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f280010de10 0x7f2800110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.626+0000 7f28078ec640 1 --2- 172.21.15.63:0/3734721758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2800105300 0x7f280010d850 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.626+0000 7f28078ec640 1 --2- 172.21.15.63:0/3734721758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28001049b0 0x7f2800104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.626+0000 7f28078ec640 1 -- 172.21.15.63:0/3734721758 >> 172.21.15.63:0/3734721758 conn(0x7f2800079730 msgr2=0x7f2800079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:04.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.626+0000 7f28078ec640 1 -- 172.21.15.63:0/3734721758 shutdown_connections 2024-09-21T06:32:04.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.626+0000 7f28078ec640 1 -- 172.21.15.63:0/3734721758 wait complete. 2024-09-21T06:32:04.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.627+0000 7f28078ec640 1 Processor -- start 2024-09-21T06:32:04.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.627+0000 7f28078ec640 1 -- start start 2024-09-21T06:32:04.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.627+0000 7f28078ec640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28001049b0 0x7f280019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:04.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.627+0000 7f28078ec640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2800105300 0x7f280019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:04.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.627+0000 7f28078ec640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f280010de10 0x7f280019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.627+0000 7f28078ec640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2800113a70 con 0x7f280010de10 2024-09-21T06:32:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.627+0000 7f28078ec640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f28001138f0 con 0x7f28001049b0 2024-09-21T06:32:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.627+0000 7f28078ec640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2800113bf0 con 0x7f2800105300 2024-09-21T06:32:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.627+0000 7f2804e87640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2800105300 0x7f280019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.627+0000 7f2805e89640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f280010de10 0x7f280019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.627+0000 7f2804e87640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2800105300 0x7f280019aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:55608/0 (socket says 172.21.15.63:55608) 2024-09-21T06:32:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.627+0000 7f2804e87640 1 -- 172.21.15.63:0/4141016518 learned_addr learned my addr 172.21.15.63:0/4141016518 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.627+0000 7f2805688640 1 --2- 172.21.15.63:0/4141016518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28001049b0 0x7f280019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.628+0000 7f2805e89640 1 -- 172.21.15.63:0/4141016518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2800105300 msgr2=0x7f280019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.628+0000 7f2805e89640 1 --2- 172.21.15.63:0/4141016518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2800105300 0x7f280019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.628+0000 7f2805e89640 1 -- 172.21.15.63:0/4141016518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28001049b0 msgr2=0x7f280019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.628+0000 7f2805e89640 1 --2- 172.21.15.63:0/4141016518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28001049b0 0x7f280019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.628+0000 7f2805e89640 1 -- 172.21.15.63:0/4141016518 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28001a0430 con 0x7f280010de10 2024-09-21T06:32:04.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.628+0000 7f2805688640 1 --2- 172.21.15.63:0/4141016518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28001049b0 0x7f280019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:04.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.628+0000 7f2804e87640 1 --2- 172.21.15.63:0/4141016518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2800105300 0x7f280019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:04.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.628+0000 7f2805e89640 1 --2- 172.21.15.63:0/4141016518 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f280010de10 0x7f280019fd00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009fd0 tx=0x7f27f800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:04.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.628+0000 7f27f67fc640 1 -- 172.21.15.63:0/4141016518 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f800ce20 con 0x7f280010de10 2024-09-21T06:32:04.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.628+0000 7f27f67fc640 1 -- 172.21.15.63:0/4141016518 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27f8005020 con 0x7f280010de10 2024-09-21T06:32:04.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.628+0000 7f27f67fc640 1 -- 172.21.15.63:0/4141016518 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f8010690 con 0x7f280010de10 2024-09-21T06:32:04.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.628+0000 7f28078ec640 1 -- 172.21.15.63:0/4141016518 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28001a0720 con 0x7f280010de10 2024-09-21T06:32:04.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.629+0000 7f28078ec640 1 -- 172.21.15.63:0/4141016518 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28001a6e80 con 0x7f280010de10 2024-09-21T06:32:04.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.632+0000 7f280de60740 1 Processor -- start 2024-09-21T06:32:04.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.632+0000 7f27f67fc640 1 -- 172.21.15.63:0/4141016518 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f27f80054d0 con 0x7f280010de10 2024-09-21T06:32:04.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.632+0000 7f280de60740 1 -- start start 2024-09-21T06:32:04.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.632+0000 7f280de60740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d75070 0x558be811c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:04.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.632+0000 7f280de60740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d4c1b0 0x558be811cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:04.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.632+0000 7f280de60740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d54390 0x558be811d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:04.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.632+0000 7f280de60740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558be8092ea0 con 0x558be7d54390 2024-09-21T06:32:04.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.632+0000 7f280de60740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558be80822d0 con 0x558be7d75070 2024-09-21T06:32:04.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.632+0000 7f280de60740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558be80860e0 con 0x558be7d4c1b0 2024-09-21T06:32:04.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.633+0000 7f2805688640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d4c1b0 0x558be811cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:04.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.633+0000 7f2805688640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d4c1b0 0x558be811cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:55622/0 (socket says 172.21.15.63:55622) 2024-09-21T06:32:04.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.633+0000 7f2805688640 1 -- 172.21.15.63:0/2393458612 learned_addr learned my addr 172.21.15.63:0/2393458612 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:04.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.633+0000 7f2804e87640 1 --2- 172.21.15.63:0/2393458612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d75070 0x558be811c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:04.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.633+0000 7f2804e87640 1 --2- 172.21.15.63:0/2393458612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d54390 0x558be811d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:04.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.633+0000 7f2805688640 1 -- 172.21.15.63:0/2393458612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d75070 msgr2=0x558be811c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:04.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.633+0000 7f2805688640 1 --2- 172.21.15.63:0/2393458612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d75070 0x558be811c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.633+0000 7f2805688640 1 -- 172.21.15.63:0/2393458612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d54390 msgr2=0x558be811d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:04.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.633+0000 7f2805688640 1 --2- 172.21.15.63:0/2393458612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d54390 0x558be811d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.633+0000 7f2805688640 1 -- 172.21.15.63:0/2393458612 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558be7de0650 con 0x558be7d4c1b0 2024-09-21T06:32:04.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.633+0000 7f2804e87640 1 --2- 172.21.15.63:0/2393458612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d54390 0x558be811d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:32:04.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.633+0000 7f27f67fc640 1 --2- 172.21.15.63:0/4141016518 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27ec0b6700 0x7f27ec0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:04.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.633+0000 7f2804e87640 1 --2- 172.21.15.63:0/4141016518 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27ec0b6700 0x7f27ec0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:04.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.633+0000 7f2805688640 1 --2- 172.21.15.63:0/2393458612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d4c1b0 0x558be811cbe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0114c0 tx=0x7f27fc011980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c07c6d735013634 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:04.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.633+0000 7f27f67fc640 1 -- 172.21.15.63:0/4141016518 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f27f80e7ce0 con 0x7f280010de10 2024-09-21T06:32:04.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.633+0000 7f27eb7fe640 1 -- 172.21.15.63:0/2393458612 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc004020 con 0x558be7d4c1b0 2024-09-21T06:32:04.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.634+0000 7f27eb7fe640 1 -- 172.21.15.63:0/2393458612 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27fc0041c0 con 0x558be7d4c1b0 2024-09-21T06:32:04.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.634+0000 7f27eb7fe640 1 -- 172.21.15.63:0/2393458612 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00f8d0 con 0x558be7d4c1b0 2024-09-21T06:32:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.635+0000 7f280de60740 1 -- 172.21.15.63:0/2393458612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d4c1b0 msgr2=0x558be811cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.635+0000 7f280de60740 1 --2- 172.21.15.63:0/2393458612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d4c1b0 0x558be811cbe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0114c0 tx=0x7f27fc011980 comp rx=0 tx=0).stop 2024-09-21T06:32:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.635+0000 7f2804e87640 1 --2- 172.21.15.63:0/4141016518 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27ec0b6700 0x7f27ec0b8c10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2800102450 tx=0x7f27f0032ed0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.635+0000 7f280de60740 1 -- 172.21.15.63:0/2393458612 shutdown_connections 2024-09-21T06:32:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.635+0000 7f280de60740 1 --2- 172.21.15.63:0/2393458612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d54390 0x558be811d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.635+0000 7f280de60740 1 --2- 172.21.15.63:0/2393458612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d4c1b0 0x558be811cbe0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.635+0000 7f280de60740 1 --2- 172.21.15.63:0/2393458612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d75070 0x558be811c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.635+0000 7f280de60740 1 -- 172.21.15.63:0/2393458612 >> 172.21.15.63:0/2393458612 conn(0x558be7d69460 msgr2=0x558be811a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:04.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.635+0000 7f280de60740 1 -- 172.21.15.63:0/2393458612 shutdown_connections 2024-09-21T06:32:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.635+0000 7f280de60740 1 -- 172.21.15.63:0/2393458612 wait complete. 2024-09-21T06:32:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.636+0000 7f280de60740 1 -- start start 2024-09-21T06:32:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.636+0000 7f280de60740 1 Processor -- start 2024-09-21T06:32:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.636+0000 7f280de60740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d4c1b0 0x558be812c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.637+0000 7f280de60740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d54390 0x558be812c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.637+0000 7f280de60740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d75070 0x558be8138510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.637+0000 7f280de60740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558be7ee3700 con 0x558be7d4c1b0 2024-09-21T06:32:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.637+0000 7f280de60740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558be801d160 con 0x558be7d54390 2024-09-21T06:32:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.637+0000 7f280de60740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558be812f1e0 con 0x558be7d75070 2024-09-21T06:32:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.637+0000 7f280de60740 10 client.0 _ll_register_callbacks cb 0x558be80369e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.637+0000 7f2805688640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d4c1b0 0x558be812c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.637+0000 7f2804e87640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d54390 0x558be812c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.637+0000 7f2805688640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d4c1b0 0x558be812c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42528/0 (socket says 172.21.15.63:42528) 2024-09-21T06:32:04.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.637+0000 7f2805688640 1 -- 172.21.15.63:0/2367090731 learned_addr learned my addr 172.21.15.63:0/2367090731 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:04.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.637+0000 7f2805e89640 1 --2- 172.21.15.63:0/2367090731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d75070 0x558be8138510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:04.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.637+0000 7f2804e87640 1 -- 172.21.15.63:0/2367090731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d75070 msgr2=0x558be8138510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:04.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.637+0000 7f2804e87640 1 --2- 172.21.15.63:0/2367090731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d75070 0x558be8138510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.637+0000 7f2804e87640 1 -- 172.21.15.63:0/2367090731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d4c1b0 msgr2=0x558be812c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:04.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.637+0000 7f2804e87640 1 --2- 172.21.15.63:0/2367090731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d4c1b0 0x558be812c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.637+0000 7f2804e87640 1 -- 172.21.15.63:0/2367090731 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558be804ac90 con 0x558be7d54390 2024-09-21T06:32:04.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.637+0000 7f2805688640 1 --2- 172.21.15.63:0/2367090731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d4c1b0 0x558be812c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:04.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.638+0000 7f2804e87640 1 --2- 172.21.15.63:0/2367090731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d54390 0x558be812c700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f27f0031440 tx=0x7f27f002a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6c863ebc1111cd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:04.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.638+0000 7f27e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:32:04.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.638+0000 7f27e8ff9640 1 -- 172.21.15.63:0/2367090731 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f004e070 con 0x558be7d54390 2024-09-21T06:32:04.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.638+0000 7f27e8ff9640 1 -- 172.21.15.63:0/2367090731 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f27f0005020 con 0x558be7d54390 2024-09-21T06:32:04.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.638+0000 7f280de60740 1 -- 172.21.15.63:0/2367090731 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27fc0041c0 con 0x558be7d54390 2024-09-21T06:32:04.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.638+0000 7f27e8ff9640 1 -- 172.21.15.63:0/2367090731 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f27f0035040 con 0x558be7d54390 2024-09-21T06:32:04.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.638+0000 7f280de60740 10 client.25967 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:04.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.638+0000 7f280de60740 1 -- 172.21.15.63:0/2367090731 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x558be813aed0 con 0x558be7d54390 2024-09-21T06:32:04.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.639+0000 7f27e8ff9640 1 -- 172.21.15.63:0/2367090731 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27fc0041c0 con 0x558be7d54390 2024-09-21T06:32:04.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.639+0000 7f27e8ff9640 1 -- 172.21.15.63:0/2367090731 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f27f00035f0 con 0x558be7d54390 2024-09-21T06:32:04.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.639+0000 7f280de60740 10 client.25967 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:04.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.639+0000 7f280de60740 10 client.25967 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:32:04.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.639+0000 7f280de60740 20 client.25967 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:04.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.639+0000 7f280de60740 1 --2- 172.21.15.63:0/2367090731 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x558be7d339f0 0x558be813e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:04.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.639+0000 7f280de60740 4 client.25967 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:32:04.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.639+0000 7f280de60740 1 -- 172.21.15.63:0/2367090731 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558be8094df0 con 0x558be7d339f0 2024-09-21T06:32:04.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.639+0000 7f2805688640 1 --2- 172.21.15.63:0/2367090731 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x558be7d339f0 0x558be813e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:04.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.640+0000 7f27e8ff9640 10 client.25967 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:32:04.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.640+0000 7f2805688640 1 --2- 172.21.15.63:0/2367090731 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x558be7d339f0 0x558be813e330 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4041dde047950b42 server_cookie=3f53b46f2387fafd in_seq=0 out_seq=0 2024-09-21T06:32:04.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.640+0000 7f27e8ff9640 1 -- 172.21.15.63:0/2367090731 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558be8094df0 con 0x558be7d339f0 2024-09-21T06:32:04.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.640+0000 7f27e8ff9640 10 client.25967 handle_command_reply: tid=0 2024-09-21T06:32:04.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.640+0000 7f280de60740 1 client.25967 shutdown 2024-09-21T06:32:04.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.641+0000 7f280de60740 1 -- 172.21.15.63:0/2367090731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d54390 msgr2=0x558be812c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:04.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.641+0000 7f280de60740 1 --2- 172.21.15.63:0/2367090731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d54390 0x558be812c700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f27f0031440 tx=0x7f27f002a410 comp rx=0 tx=0).stop 2024-09-21T06:32:04.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.641+0000 7f280de60740 1 -- 172.21.15.63:0/2367090731 shutdown_connections 2024-09-21T06:32:04.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.641+0000 7f280de60740 1 --2- 172.21.15.63:0/2367090731 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x558be7d339f0 0x558be813e330 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.641+0000 7f280de60740 1 --2- 172.21.15.63:0/2367090731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d75070 0x558be8138510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.641+0000 7f280de60740 1 --2- 172.21.15.63:0/2367090731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d54390 0x558be812c700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.641+0000 7f280de60740 1 --2- 172.21.15.63:0/2367090731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d4c1b0 0x558be812c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.641+0000 7f27e8ff9640 0 client.25967 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:32:04.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.641+0000 7f280de60740 1 -- 172.21.15.63:0/2367090731 >> 172.21.15.63:0/2367090731 conn(0x558be7d69460 msgr2=0x558be811e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:04.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.641+0000 7f280de60740 1 -- 172.21.15.63:0/2367090731 shutdown_connections 2024-09-21T06:32:04.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.641+0000 7f280de60740 1 -- 172.21.15.63:0/2367090731 wait complete. 2024-09-21T06:32:04.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.641+0000 7f280de60740 20 client.25967 trim_cache size 0 max 16384 2024-09-21T06:32:04.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.656+0000 7f280de60740 1 Processor -- start 2024-09-21T06:32:04.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.656+0000 7f280de60740 1 -- start start 2024-09-21T06:32:04.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.656+0000 7f280de60740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d4c1b0 0x558be812c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:04.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.656+0000 7f280de60740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d54390 0x558be8138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:04.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.656+0000 7f280de60740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d75070 0x558be8119ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:04.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.656+0000 7f280de60740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f28001ad630 con 0x558be7d54390 2024-09-21T06:32:04.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.656+0000 7f280de60740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f28001af230 con 0x558be7d75070 2024-09-21T06:32:04.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.656+0000 7f280de60740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f28001addc0 con 0x558be7d4c1b0 2024-09-21T06:32:04.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.656+0000 7f2804e87640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d54390 0x558be8138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:04.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.656+0000 7f2804e87640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d54390 0x558be8138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42542/0 (socket says 172.21.15.63:42542) 2024-09-21T06:32:04.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.656+0000 7f2805e89640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d75070 0x558be8119ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:04.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.656+0000 7f2804e87640 1 -- 172.21.15.63:0/2422473001 learned_addr learned my addr 172.21.15.63:0/2422473001 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:04.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.656+0000 7f2805688640 1 --2- 172.21.15.63:0/2422473001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d4c1b0 0x558be812c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:04.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.656+0000 7f2805e89640 1 -- 172.21.15.63:0/2422473001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d4c1b0 msgr2=0x558be812c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:04.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.656+0000 7f2805e89640 1 --2- 172.21.15.63:0/2422473001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d4c1b0 0x558be812c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.656+0000 7f2805e89640 1 -- 172.21.15.63:0/2422473001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d54390 msgr2=0x558be8138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:04.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.656+0000 7f2805e89640 1 --2- 172.21.15.63:0/2422473001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d54390 0x558be8138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.656+0000 7f2805e89640 1 -- 172.21.15.63:0/2422473001 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558be811f460 con 0x558be7d75070 2024-09-21T06:32:04.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.657+0000 7f2805e89640 1 --2- 172.21.15.63:0/2422473001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d75070 0x558be8119ed0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f27f80e5410 tx=0x7f27f80ad340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6583c00bc385176 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:04.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.657+0000 7f27eaffd640 1 -- 172.21.15.63:0/2422473001 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f80ae210 con 0x558be7d75070 2024-09-21T06:32:04.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.657+0000 7f27eaffd640 1 -- 172.21.15.63:0/2422473001 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27f80b25f0 con 0x558be7d75070 2024-09-21T06:32:04.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.657+0000 7f27eaffd640 1 -- 172.21.15.63:0/2422473001 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f80b2210 con 0x558be7d75070 2024-09-21T06:32:04.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.658+0000 7f280de60740 1 -- 172.21.15.63:0/2422473001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d75070 msgr2=0x558be8119ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:04.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.658+0000 7f280de60740 1 --2- 172.21.15.63:0/2422473001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d75070 0x558be8119ed0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f27f80e5410 tx=0x7f27f80ad340 comp rx=0 tx=0).stop 2024-09-21T06:32:04.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.659+0000 7f280de60740 1 -- 172.21.15.63:0/2422473001 shutdown_connections 2024-09-21T06:32:04.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.659+0000 7f280de60740 1 --2- 172.21.15.63:0/2422473001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d75070 0x558be8119ed0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.659+0000 7f280de60740 1 --2- 172.21.15.63:0/2422473001 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d54390 0x558be8138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.659+0000 7f280de60740 1 --2- 172.21.15.63:0/2422473001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d4c1b0 0x558be812c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.659+0000 7f280de60740 1 -- 172.21.15.63:0/2422473001 >> 172.21.15.63:0/2422473001 conn(0x558be7d69460 msgr2=0x558be812bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:04.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.659+0000 7f280de60740 1 -- 172.21.15.63:0/2422473001 shutdown_connections 2024-09-21T06:32:04.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.659+0000 7f280de60740 1 -- 172.21.15.63:0/2422473001 wait complete. 2024-09-21T06:32:04.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.659+0000 7f280de60740 1 -- start start 2024-09-21T06:32:04.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.659+0000 7f280de60740 1 Processor -- start 2024-09-21T06:32:04.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.660+0000 7f280de60740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d4c1b0 0x558be81305f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:04.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.660+0000 7f280de60740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d54390 0x558be8130b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:04.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.660+0000 7f280de60740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d75070 0x558be8131070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:04.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.660+0000 7f280de60740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f28001aeb60 con 0x558be7d54390 2024-09-21T06:32:04.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.660+0000 7f280de60740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f28001ae490 con 0x558be7d4c1b0 2024-09-21T06:32:04.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.660+0000 7f280de60740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f28001ab610 con 0x558be7d75070 2024-09-21T06:32:04.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.660+0000 7f280de60740 10 client.0 _ll_register_callbacks cb 0x7f27f0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:04.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.660+0000 7f2805e89640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d75070 0x558be8131070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:04.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.660+0000 7f2805e89640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d75070 0x558be8131070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:55658/0 (socket says 172.21.15.63:55658) 2024-09-21T06:32:04.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.660+0000 7f2804e87640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d54390 0x558be8130b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:04.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.660+0000 7f2805e89640 1 -- 172.21.15.63:0/2448425126 learned_addr learned my addr 172.21.15.63:0/2448425126 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:04.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.660+0000 7f2805688640 1 --2- 172.21.15.63:0/2448425126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d4c1b0 0x558be81305f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:04.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.661+0000 7f2805e89640 1 -- 172.21.15.63:0/2448425126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d4c1b0 msgr2=0x558be81305f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:04.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.661+0000 7f2805e89640 1 --2- 172.21.15.63:0/2448425126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d4c1b0 0x558be81305f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.661+0000 7f2805e89640 1 -- 172.21.15.63:0/2448425126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d54390 msgr2=0x558be8130b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:04.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.661+0000 7f2805e89640 1 --2- 172.21.15.63:0/2448425126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d54390 0x558be8130b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.661+0000 7f2805e89640 1 -- 172.21.15.63:0/2448425126 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558be81a7ea0 con 0x558be7d75070 2024-09-21T06:32:04.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.661+0000 7f2805e89640 1 --2- 172.21.15.63:0/2448425126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d75070 0x558be8131070 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f27f80aa0e0 tx=0x7f27f80ad3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6291ee172b064500 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:04.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.661+0000 7f27e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:32:04.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.661+0000 7f27e8ff9640 1 -- 172.21.15.63:0/2448425126 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f80c8060 con 0x558be7d75070 2024-09-21T06:32:04.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.661+0000 7f27e8ff9640 1 -- 172.21.15.63:0/2448425126 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f27f80e5b60 con 0x558be7d75070 2024-09-21T06:32:04.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.661+0000 7f280de60740 1 -- 172.21.15.63:0/2448425126 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27f80b25f0 con 0x558be7d75070 2024-09-21T06:32:04.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.662+0000 7f27e8ff9640 1 -- 172.21.15.63:0/2448425126 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f27f80b7530 con 0x558be7d75070 2024-09-21T06:32:04.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.662+0000 7f280de60740 10 client.26038 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:04.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.662+0000 7f280de60740 1 -- 172.21.15.63:0/2448425126 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x558be81a9120 con 0x558be7d75070 2024-09-21T06:32:04.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.662+0000 7f27e8ff9640 1 -- 172.21.15.63:0/2448425126 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27f80b25f0 con 0x558be7d75070 2024-09-21T06:32:04.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.662+0000 7f27e8ff9640 1 -- 172.21.15.63:0/2448425126 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f27f8097070 con 0x558be7d75070 2024-09-21T06:32:04.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.662+0000 7f280de60740 10 client.26038 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:04.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.662+0000 7f280de60740 10 client.26038 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:32:04.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.662+0000 7f280de60740 20 client.26038 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:04.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.662+0000 7f280de60740 1 --2- 172.21.15.63:0/2448425126 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x558be7d08da0 0x558be81ab850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:04.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.662+0000 7f280de60740 4 client.26038 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:32:04.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.662+0000 7f280de60740 1 -- 172.21.15.63:0/2448425126 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558be80908a0 con 0x558be7d08da0 2024-09-21T06:32:04.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.663+0000 7f2805688640 1 --2- 172.21.15.63:0/2448425126 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x558be7d08da0 0x558be81ab850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:04.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.663+0000 7f27e8ff9640 10 client.26038 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:32:04.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.663+0000 7f2805688640 1 --2- 172.21.15.63:0/2448425126 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x558be7d08da0 0x558be81ab850 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9e25e5fa1ba617ad server_cookie=48e3d24fa67acad8 in_seq=0 out_seq=0 2024-09-21T06:32:04.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.663+0000 7f27e8ff9640 1 -- 172.21.15.63:0/2448425126 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558be80908a0 con 0x558be7d08da0 2024-09-21T06:32:04.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.663+0000 7f27e8ff9640 10 client.26038 handle_command_reply: tid=0 2024-09-21T06:32:04.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.663+0000 7f280de60740 1 client.26038 shutdown 2024-09-21T06:32:04.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.664+0000 7f280de60740 1 -- 172.21.15.63:0/2448425126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d75070 msgr2=0x558be8131070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:04.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.664+0000 7f280de60740 1 --2- 172.21.15.63:0/2448425126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d75070 0x558be8131070 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f27f80aa0e0 tx=0x7f27f80ad3b0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.664+0000 7f280de60740 1 -- 172.21.15.63:0/2448425126 shutdown_connections 2024-09-21T06:32:04.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.664+0000 7f280de60740 1 --2- 172.21.15.63:0/2448425126 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x558be7d08da0 0x558be81ab850 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.664+0000 7f280de60740 1 --2- 172.21.15.63:0/2448425126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558be7d75070 0x558be8131070 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.664+0000 7f27e8ff9640 0 client.26038 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:32:04.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.664+0000 7f280de60740 1 --2- 172.21.15.63:0/2448425126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558be7d54390 0x558be8130b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.664+0000 7f280de60740 1 --2- 172.21.15.63:0/2448425126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558be7d4c1b0 0x558be81305f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.664+0000 7f280de60740 1 -- 172.21.15.63:0/2448425126 >> 172.21.15.63:0/2448425126 conn(0x558be7d69460 msgr2=0x558be8119e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:04.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.664+0000 7f280de60740 1 -- 172.21.15.63:0/2448425126 shutdown_connections 2024-09-21T06:32:04.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.664+0000 7f280de60740 1 -- 172.21.15.63:0/2448425126 wait complete. 2024-09-21T06:32:04.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.664+0000 7f280de60740 20 client.26038 trim_cache size 0 max 16384 2024-09-21T06:32:04.670 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:32:04.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.665+0000 7f28078ec640 1 -- 172.21.15.63:0/4141016518 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27ec0b6700 msgr2=0x7f27ec0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:04.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.665+0000 7f28078ec640 1 --2- 172.21.15.63:0/4141016518 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27ec0b6700 0x7f27ec0b8c10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2800102450 tx=0x7f27f0032ed0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.665+0000 7f28078ec640 1 -- 172.21.15.63:0/4141016518 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f280010de10 msgr2=0x7f280019fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:04.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.665+0000 7f28078ec640 1 --2- 172.21.15.63:0/4141016518 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f280010de10 0x7f280019fd00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009fd0 tx=0x7f27f800ef10 comp rx=0 tx=0).stop 2024-09-21T06:32:04.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.665+0000 7f28078ec640 1 -- 172.21.15.63:0/4141016518 shutdown_connections 2024-09-21T06:32:04.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.665+0000 7f28078ec640 1 --2- 172.21.15.63:0/4141016518 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f280010de10 0x7f280019fd00 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.665+0000 7f28078ec640 1 --2- 172.21.15.63:0/4141016518 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27ec0b6700 0x7f27ec0b8c10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.665+0000 7f28078ec640 1 --2- 172.21.15.63:0/4141016518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2800105300 0x7f280019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.665+0000 7f28078ec640 1 --2- 172.21.15.63:0/4141016518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28001049b0 0x7f280019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:04.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.665+0000 7f28078ec640 1 -- 172.21.15.63:0/4141016518 >> 172.21.15.63:0/4141016518 conn(0x7f2800079730 msgr2=0x7f2800100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:04.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.665+0000 7f28078ec640 1 -- 172.21.15.63:0/4141016518 shutdown_connections 2024-09-21T06:32:04.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:04.665+0000 7f28078ec640 1 -- 172.21.15.63:0/4141016518 wait complete. 2024-09-21T06:32:05.504 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:32:05.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:05 smithi071 ceph-mon[34844]: pgmap v439: 97 pgs: 97 active+clean; 149 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 4.1 MiB/s wr, 710 op/s 2024-09-21T06:32:05.792 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:32:05.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:05 smithi063 ceph-mon[31150]: pgmap v439: 97 pgs: 97 active+clean; 149 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 4.1 MiB/s wr, 710 op/s 2024-09-21T06:32:05.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:05 smithi175 ceph-mon[34510]: pgmap v439: 97 pgs: 97 active+clean; 149 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 4.1 MiB/s wr, 710 op/s 2024-09-21T06:32:06.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.334+0000 7eff25fe3640 1 -- 172.21.15.63:0/762501263 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff20105270 msgr2=0x7eff2010d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:06.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.334+0000 7eff25fe3640 1 --2- 172.21.15.63:0/762501263 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff20105270 0x7eff2010d8b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7eff14009900 tx=0x7eff1402a410 comp rx=0 tx=0).stop 2024-09-21T06:32:06.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.335+0000 7eff25fe3640 1 -- 172.21.15.63:0/762501263 shutdown_connections 2024-09-21T06:32:06.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.335+0000 7eff25fe3640 1 --2- 172.21.15.63:0/762501263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff2010ddf0 0x7eff20110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.335+0000 7eff25fe3640 1 --2- 172.21.15.63:0/762501263 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff20105270 0x7eff2010d8b0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.335+0000 7eff25fe3640 1 --2- 172.21.15.63:0/762501263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff20104840 0x7eff20104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.335+0000 7eff25fe3640 1 -- 172.21.15.63:0/762501263 >> 172.21.15.63:0/762501263 conn(0x7eff20079730 msgr2=0x7eff20079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:06.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.335+0000 7eff25fe3640 1 -- 172.21.15.63:0/762501263 shutdown_connections 2024-09-21T06:32:06.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.335+0000 7eff25fe3640 1 -- 172.21.15.63:0/762501263 wait complete. 2024-09-21T06:32:06.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.335+0000 7eff25fe3640 1 Processor -- start 2024-09-21T06:32:06.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.336+0000 7eff25fe3640 1 -- start start 2024-09-21T06:32:06.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.336+0000 7eff25fe3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff20104840 0x7eff2019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:06.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.336+0000 7eff25fe3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff20105270 0x7eff2019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:06.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.336+0000 7eff25fe3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff2010ddf0 0x7eff2019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:06.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.336+0000 7eff25fe3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7eff20113a70 con 0x7eff20105270 2024-09-21T06:32:06.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.336+0000 7eff25fe3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7eff201138f0 con 0x7eff2010ddf0 2024-09-21T06:32:06.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.336+0000 7eff25fe3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff20113bf0 con 0x7eff20104840 2024-09-21T06:32:06.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.336+0000 7eff1effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff20105270 0x7eff2019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:06.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.336+0000 7eff1effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff20105270 0x7eff2019aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42570/0 (socket says 172.21.15.63:42570) 2024-09-21T06:32:06.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.336+0000 7eff1f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff20104840 0x7eff2019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:06.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.336+0000 7eff1effd640 1 -- 172.21.15.63:0/1605522019 learned_addr learned my addr 172.21.15.63:0/1605522019 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:06.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.336+0000 7eff1ffff640 1 --2- 172.21.15.63:0/1605522019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff2010ddf0 0x7eff2019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:06.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.336+0000 7eff1effd640 1 -- 172.21.15.63:0/1605522019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff20104840 msgr2=0x7eff2019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:06.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.336+0000 7eff1effd640 1 --2- 172.21.15.63:0/1605522019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff20104840 0x7eff2019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.336+0000 7eff1effd640 1 -- 172.21.15.63:0/1605522019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff2010ddf0 msgr2=0x7eff2019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:06.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.336+0000 7eff1effd640 1 --2- 172.21.15.63:0/1605522019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff2010ddf0 0x7eff2019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.336+0000 7eff1effd640 1 -- 172.21.15.63:0/1605522019 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff201a0410 con 0x7eff20105270 2024-09-21T06:32:06.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.337+0000 7eff1f7fe640 1 --2- 172.21.15.63:0/1605522019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff20104840 0x7eff2019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:06.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.337+0000 7eff1ffff640 1 --2- 172.21.15.63:0/1605522019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff2010ddf0 0x7eff2019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:06.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.337+0000 7eff1effd640 1 --2- 172.21.15.63:0/1605522019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff20105270 0x7eff2019aa40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7eff1402a930 tx=0x7eff14031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:06.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.337+0000 7eff1cff9640 1 -- 172.21.15.63:0/1605522019 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1403f020 con 0x7eff20105270 2024-09-21T06:32:06.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.337+0000 7eff25fe3640 1 -- 172.21.15.63:0/1605522019 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff201a06a0 con 0x7eff20105270 2024-09-21T06:32:06.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.337+0000 7eff1cff9640 1 -- 172.21.15.63:0/1605522019 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff14003aa0 con 0x7eff20105270 2024-09-21T06:32:06.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.337+0000 7eff25fe3640 1 -- 172.21.15.63:0/1605522019 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff20102630 con 0x7eff20105270 2024-09-21T06:32:06.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.337+0000 7eff1cff9640 1 -- 172.21.15.63:0/1605522019 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff14035050 con 0x7eff20105270 2024-09-21T06:32:06.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.340+0000 7eff2c557740 1 Processor -- start 2024-09-21T06:32:06.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.341+0000 7eff2c557740 1 -- start start 2024-09-21T06:32:06.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.341+0000 7eff2c557740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d219552070 0x55d2198f92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:06.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.341+0000 7eff2c557740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2195291b0 0x55d2198f9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:06.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.341+0000 7eff2c557740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d219531390 0x55d2198f9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:06.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.341+0000 7eff2c557740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d21986fea0 con 0x55d219531390 2024-09-21T06:32:06.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.341+0000 7eff2c557740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d21985f2d0 con 0x55d2195291b0 2024-09-21T06:32:06.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.341+0000 7eff2c557740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d2198630e0 con 0x55d219552070 2024-09-21T06:32:06.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.341+0000 7eff1f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2195291b0 0x55d2198f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:06.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.341+0000 7eff1f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2195291b0 0x55d2198f9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:40506/0 (socket says 172.21.15.63:40506) 2024-09-21T06:32:06.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.341+0000 7eff1f7fe640 1 -- 172.21.15.63:0/1793920946 learned_addr learned my addr 172.21.15.63:0/1793920946 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:06.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.341+0000 7eff1ffff640 1 --2- 172.21.15.63:0/1793920946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d219552070 0x55d2198f92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:06.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.341+0000 7eff1f7fe640 1 -- 172.21.15.63:0/1793920946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d219552070 msgr2=0x55d2198f92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:06.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.341+0000 7eff1f7fe640 1 --2- 172.21.15.63:0/1793920946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d219552070 0x55d2198f92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.341+0000 7eff1f7fe640 1 -- 172.21.15.63:0/1793920946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d219531390 msgr2=0x55d2198f9d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:32:06.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.341+0000 7eff1f7fe640 1 --2- 172.21.15.63:0/1793920946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d219531390 0x55d2198f9d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.341+0000 7eff1f7fe640 1 -- 172.21.15.63:0/1793920946 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2195bd650 con 0x55d2195291b0 2024-09-21T06:32:06.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.342+0000 7eff1ffff640 1 --2- 172.21.15.63:0/1793920946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d219552070 0x55d2198f92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:32:06.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.341+0000 7eff1cff9640 1 -- 172.21.15.63:0/1605522019 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7eff1403ab50 con 0x7eff20105270 2024-09-21T06:32:06.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.342+0000 7eff1f7fe640 1 --2- 172.21.15.63:0/1793920946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2195291b0 0x55d2198f9800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7eff100041c0 tx=0x7eff10009f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8e86941210e606b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:06.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.342+0000 7eff05ffb640 1 -- 172.21.15.63:0/1793920946 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10005020 con 0x55d2195291b0 2024-09-21T06:32:06.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.342+0000 7eff05ffb640 1 -- 172.21.15.63:0/1793920946 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff100047a0 con 0x55d2195291b0 2024-09-21T06:32:06.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.343+0000 7eff05ffb640 1 -- 172.21.15.63:0/1793920946 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10021700 con 0x55d2195291b0 2024-09-21T06:32:06.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.343+0000 7eff1cff9640 1 --2- 172.21.15.63:0/1605522019 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7eff080b6700 0x7eff080b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:06.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.343+0000 7eff1cff9640 1 -- 172.21.15.63:0/1605522019 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7eff14107c40 con 0x7eff20105270 2024-09-21T06:32:06.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.343+0000 7eff1ffff640 1 --2- 172.21.15.63:0/1605522019 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7eff080b6700 0x7eff080b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:06.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.343+0000 7eff2c557740 1 -- 172.21.15.63:0/1793920946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2195291b0 msgr2=0x55d2198f9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:06.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.343+0000 7eff2c557740 1 --2- 172.21.15.63:0/1793920946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2195291b0 0x55d2198f9800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7eff100041c0 tx=0x7eff10009f60 comp rx=0 tx=0).stop 2024-09-21T06:32:06.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.343+0000 7eff2c557740 1 -- 172.21.15.63:0/1793920946 shutdown_connections 2024-09-21T06:32:06.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.343+0000 7eff2c557740 1 --2- 172.21.15.63:0/1793920946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d219531390 0x55d2198f9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.343+0000 7eff2c557740 1 --2- 172.21.15.63:0/1793920946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2195291b0 0x55d2198f9800 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.343+0000 7eff2c557740 1 --2- 172.21.15.63:0/1793920946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d219552070 0x55d2198f92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.343+0000 7eff2c557740 1 -- 172.21.15.63:0/1793920946 >> 172.21.15.63:0/1793920946 conn(0x55d219546460 msgr2=0x55d2198f71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:06.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.344+0000 7eff2c557740 1 -- 172.21.15.63:0/1793920946 shutdown_connections 2024-09-21T06:32:06.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.344+0000 7eff2c557740 1 -- 172.21.15.63:0/1793920946 wait complete. 2024-09-21T06:32:06.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.344+0000 7eff1ffff640 1 --2- 172.21.15.63:0/1605522019 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7eff080b6700 0x7eff080b8c10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7eff18005fd0 tx=0x7eff18009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:06.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.344+0000 7eff2c557740 1 -- start start 2024-09-21T06:32:06.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.344+0000 7eff2c557740 1 Processor -- start 2024-09-21T06:32:06.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.345+0000 7eff2c557740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2195291b0 0x55d2199048c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:06.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.345+0000 7eff2c557740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d219531390 0x55d219904e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:06.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.345+0000 7eff2c557740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d219552070 0x55d219905340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:06.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.345+0000 7eff2c557740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d2196c0700 con 0x55d219531390 2024-09-21T06:32:06.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.345+0000 7eff2c557740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d2197fa160 con 0x55d219552070 2024-09-21T06:32:06.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.345+0000 7eff2c557740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d219907b40 con 0x55d2195291b0 2024-09-21T06:32:06.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.345+0000 7eff2c557740 10 client.0 _ll_register_callbacks cb 0x55d2198139e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:06.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.345+0000 7eff1f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2195291b0 0x55d2199048c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:06.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.345+0000 7eff1effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d219531390 0x55d219904e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:06.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.345+0000 7eff1f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2195291b0 0x55d2199048c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:55682/0 (socket says 172.21.15.63:55682) 2024-09-21T06:32:06.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.345+0000 7eff1f7fe640 1 -- 172.21.15.63:0/1897383762 learned_addr learned my addr 172.21.15.63:0/1897383762 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:06.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.345+0000 7eff1ffff640 1 --2- 172.21.15.63:0/1897383762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d219552070 0x55d219905340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:06.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.345+0000 7eff1f7fe640 1 -- 172.21.15.63:0/1897383762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d219552070 msgr2=0x55d219905340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:06.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.345+0000 7eff1f7fe640 1 --2- 172.21.15.63:0/1897383762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d219552070 0x55d219905340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.345+0000 7eff1f7fe640 1 -- 172.21.15.63:0/1897383762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d219531390 msgr2=0x55d219904e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:06.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.345+0000 7eff1f7fe640 1 --2- 172.21.15.63:0/1897383762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d219531390 0x55d219904e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.345+0000 7eff1f7fe640 1 -- 172.21.15.63:0/1897383762 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d219827c90 con 0x55d2195291b0 2024-09-21T06:32:06.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.345+0000 7eff1ffff640 1 --2- 172.21.15.63:0/1897383762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d219552070 0x55d219905340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:32:06.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.346+0000 7eff1f7fe640 1 --2- 172.21.15.63:0/1897383762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2195291b0 0x55d2199048c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7eff10003fb0 tx=0x7eff10009d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc5dbcb9eaae8a2c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:06.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.346+0000 7efefeffd640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:32:06.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.346+0000 7efefeffd640 1 -- 172.21.15.63:0/1897383762 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10038020 con 0x55d2195291b0 2024-09-21T06:32:06.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.346+0000 7efefeffd640 1 -- 172.21.15.63:0/1897383762 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7eff10005220 con 0x55d2195291b0 2024-09-21T06:32:06.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.346+0000 7eff2c557740 1 -- 172.21.15.63:0/1897383762 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff100047a0 con 0x55d2195291b0 2024-09-21T06:32:06.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.346+0000 7efefeffd640 1 -- 172.21.15.63:0/1897383762 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7eff1002f040 con 0x55d2195291b0 2024-09-21T06:32:06.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.346+0000 7eff2c557740 10 client.26047 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:06.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.346+0000 7eff2c557740 1 -- 172.21.15.63:0/1897383762 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55d2199136c0 con 0x55d2195291b0 2024-09-21T06:32:06.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.346+0000 7efefeffd640 1 -- 172.21.15.63:0/1897383762 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff100047a0 con 0x55d2195291b0 2024-09-21T06:32:06.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.347+0000 7efefeffd640 1 -- 172.21.15.63:0/1897383762 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7eff10029070 con 0x55d2195291b0 2024-09-21T06:32:06.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.347+0000 7eff2c557740 10 client.26047 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:06.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.347+0000 7eff2c557740 10 client.26047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:32:06.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.347+0000 7eff2c557740 20 client.26047 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:06.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.347+0000 7eff2c557740 1 --2- 172.21.15.63:0/1897383762 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d2195109f0 0x55d219916ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:06.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.347+0000 7eff2c557740 4 client.26047 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:32:06.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.347+0000 7eff2c557740 1 -- 172.21.15.63:0/1897383762 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d219871df0 con 0x55d2195109f0 2024-09-21T06:32:06.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.347+0000 7eff1effd640 1 --2- 172.21.15.63:0/1897383762 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d2195109f0 0x55d219916ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:06.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.347+0000 7efefeffd640 10 client.26047 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:06.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.347+0000 7eff1effd640 1 --2- 172.21.15.63:0/1897383762 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d2195109f0 0x55d219916ad0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1f7744072070dd3 server_cookie=9ee20f941b53ecf2 in_seq=0 out_seq=0 2024-09-21T06:32:06.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.348+0000 7efefeffd640 1 -- 172.21.15.63:0/1897383762 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d219871df0 con 0x55d2195109f0 2024-09-21T06:32:06.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.348+0000 7efefeffd640 10 client.26047 handle_command_reply: tid=0 2024-09-21T06:32:06.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.348+0000 7eff2c557740 1 client.26047 shutdown 2024-09-21T06:32:06.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.349+0000 7eff2c557740 1 -- 172.21.15.63:0/1897383762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2195291b0 msgr2=0x55d2199048c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:06.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.349+0000 7eff2c557740 1 --2- 172.21.15.63:0/1897383762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2195291b0 0x55d2199048c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7eff10003fb0 tx=0x7eff10009d40 comp rx=0 tx=0).stop 2024-09-21T06:32:06.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.349+0000 7eff2c557740 1 -- 172.21.15.63:0/1897383762 shutdown_connections 2024-09-21T06:32:06.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.349+0000 7eff2c557740 1 --2- 172.21.15.63:0/1897383762 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d2195109f0 0x55d219916ad0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.349+0000 7eff2c557740 1 --2- 172.21.15.63:0/1897383762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d219552070 0x55d219905340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.349+0000 7efefeffd640 0 client.26047 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:06.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.349+0000 7eff2c557740 1 --2- 172.21.15.63:0/1897383762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d219531390 0x55d219904e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.349+0000 7eff2c557740 1 --2- 172.21.15.63:0/1897383762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2195291b0 0x55d2199048c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.349+0000 7eff2c557740 1 -- 172.21.15.63:0/1897383762 >> 172.21.15.63:0/1897383762 conn(0x55d219546460 msgr2=0x55d2198fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:06.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.349+0000 7eff2c557740 1 -- 172.21.15.63:0/1897383762 shutdown_connections 2024-09-21T06:32:06.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.349+0000 7eff2c557740 1 -- 172.21.15.63:0/1897383762 wait complete. 2024-09-21T06:32:06.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.349+0000 7eff2c557740 20 client.26047 trim_cache size 0 max 16384 2024-09-21T06:32:06.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.364+0000 7eff2c557740 1 Processor -- start 2024-09-21T06:32:06.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.364+0000 7eff2c557740 1 -- start start 2024-09-21T06:32:06.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.364+0000 7eff2c557740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d2195109f0 0x55d2199067a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:06.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.364+0000 7eff2c557740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2195291b0 0x55d2198faa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:06.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.364+0000 7eff2c557740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d219531390 0x55d2198f6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:06.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.364+0000 7eff2c557740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c00e790 con 0x55d2195109f0 2024-09-21T06:32:06.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.364+0000 7eff2c557740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c010390 con 0x55d219531390 2024-09-21T06:32:06.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.364+0000 7eff2c557740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c00ef20 con 0x55d2195291b0 2024-09-21T06:32:06.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.364+0000 7eff1f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d2195109f0 0x55d2199067a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:06.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.364+0000 7eff1effd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2195291b0 0x55d2198faa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:06.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.364+0000 7eff1ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d219531390 0x55d2198f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:06.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.364+0000 7eff1f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d2195109f0 0x55d2199067a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42580/0 (socket says 172.21.15.63:42580) 2024-09-21T06:32:06.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.364+0000 7eff1f7fe640 1 -- 172.21.15.63:0/505001692 learned_addr learned my addr 172.21.15.63:0/505001692 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:06.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.365+0000 7eff1effd640 1 -- 172.21.15.63:0/505001692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d219531390 msgr2=0x55d2198f6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:06.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.365+0000 7eff1effd640 1 --2- 172.21.15.63:0/505001692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d219531390 0x55d2198f6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.365+0000 7eff1effd640 1 -- 172.21.15.63:0/505001692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d2195109f0 msgr2=0x55d2199067a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:06.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.365+0000 7eff1effd640 1 --2- 172.21.15.63:0/505001692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d2195109f0 0x55d2199067a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.365+0000 7eff1effd640 1 -- 172.21.15.63:0/505001692 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d219905680 con 0x55d2195291b0 2024-09-21T06:32:06.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.365+0000 7eff1f7fe640 1 --2- 172.21.15.63:0/505001692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d2195109f0 0x55d2199067a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:06.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.365+0000 7eff1effd640 1 --2- 172.21.15.63:0/505001692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2195291b0 0x55d2198faa00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7eff14105310 tx=0x7eff14000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f638afe62e6ba81 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:06.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.365+0000 7eff057fa640 1 -- 172.21.15.63:0/505001692 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff140cd210 con 0x55d2195291b0 2024-09-21T06:32:06.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.365+0000 7eff057fa640 1 -- 172.21.15.63:0/505001692 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff140f10b0 con 0x55d2195291b0 2024-09-21T06:32:06.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.365+0000 7eff057fa640 1 -- 172.21.15.63:0/505001692 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff140c9210 con 0x55d2195291b0 2024-09-21T06:32:06.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.366+0000 7eff2c557740 1 -- 172.21.15.63:0/505001692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2195291b0 msgr2=0x55d2198faa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:06.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.366+0000 7eff2c557740 1 --2- 172.21.15.63:0/505001692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2195291b0 0x55d2198faa00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7eff14105310 tx=0x7eff14000bc0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.366+0000 7eff2c557740 1 -- 172.21.15.63:0/505001692 shutdown_connections 2024-09-21T06:32:06.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.366+0000 7eff2c557740 1 --2- 172.21.15.63:0/505001692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d219531390 0x55d2198f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.366+0000 7eff2c557740 1 --2- 172.21.15.63:0/505001692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2195291b0 0x55d2198faa00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.366+0000 7eff2c557740 1 --2- 172.21.15.63:0/505001692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d2195109f0 0x55d2199067a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.366+0000 7eff2c557740 1 -- 172.21.15.63:0/505001692 >> 172.21.15.63:0/505001692 conn(0x55d219546460 msgr2=0x55d2198fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:06.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.366+0000 7eff2c557740 1 -- 172.21.15.63:0/505001692 shutdown_connections 2024-09-21T06:32:06.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.366+0000 7eff2c557740 1 -- 172.21.15.63:0/505001692 wait complete. 2024-09-21T06:32:06.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.366+0000 7eff2c557740 1 -- start start 2024-09-21T06:32:06.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.367+0000 7eff2c557740 1 Processor -- start 2024-09-21T06:32:06.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.367+0000 7eff2c557740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d2195109f0 0x55d21990d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:06.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.367+0000 7eff2c557740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2195291b0 0x55d219908a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:06.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.367+0000 7eff2c557740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d219531390 0x55d219908fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:06.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.367+0000 7eff2c557740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c00fcc0 con 0x55d2195109f0 2024-09-21T06:32:06.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.367+0000 7eff2c557740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c00f5f0 con 0x55d219531390 2024-09-21T06:32:06.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.367+0000 7eff2c557740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c00c770 con 0x55d2195291b0 2024-09-21T06:32:06.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.367+0000 7eff2c557740 10 client.0 _ll_register_callbacks cb 0x7eff10004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:06.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.367+0000 7eff1f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d2195109f0 0x55d21990d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:06.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.367+0000 7eff1f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d2195109f0 0x55d21990d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42586/0 (socket says 172.21.15.63:42586) 2024-09-21T06:32:06.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.367+0000 7eff1f7fe640 1 -- 172.21.15.63:0/3466516268 learned_addr learned my addr 172.21.15.63:0/3466516268 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:06.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.367+0000 7eff1effd640 1 --2- 172.21.15.63:0/3466516268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2195291b0 0x55d219908a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:06.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.367+0000 7eff1ffff640 1 --2- 172.21.15.63:0/3466516268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d219531390 0x55d219908fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:06.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.367+0000 7eff1effd640 1 -- 172.21.15.63:0/3466516268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d219531390 msgr2=0x55d219908fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:06.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.367+0000 7eff1effd640 1 --2- 172.21.15.63:0/3466516268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d219531390 0x55d219908fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.367+0000 7eff1effd640 1 -- 172.21.15.63:0/3466516268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d2195109f0 msgr2=0x55d21990d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:06.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.368+0000 7eff1effd640 1 --2- 172.21.15.63:0/3466516268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d2195109f0 0x55d21990d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.368+0000 7eff1effd640 1 -- 172.21.15.63:0/3466516268 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d219909690 con 0x55d2195291b0 2024-09-21T06:32:06.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.368+0000 7eff1f7fe640 1 --2- 172.21.15.63:0/3466516268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d2195109f0 0x55d21990d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:06.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.368+0000 7eff1effd640 1 --2- 172.21.15.63:0/3466516268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2195291b0 0x55d219908a60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7eff140cd7a0 tx=0x7eff140cd210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=737a56947bacc31f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:06.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.368+0000 7efefeffd640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:32:06.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.368+0000 7efefeffd640 1 -- 172.21.15.63:0/3466516268 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff140ce1a0 con 0x55d2195291b0 2024-09-21T06:32:06.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.368+0000 7efefeffd640 1 -- 172.21.15.63:0/3466516268 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7eff140c9d10 con 0x55d2195291b0 2024-09-21T06:32:06.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.368+0000 7eff2c557740 1 -- 172.21.15.63:0/3466516268 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d21986d8a0 con 0x55d2195291b0 2024-09-21T06:32:06.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.368+0000 7efefeffd640 1 -- 172.21.15.63:0/3466516268 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7eff140d7430 con 0x55d2195291b0 2024-09-21T06:32:06.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.368+0000 7eff2c557740 10 client.26053 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:06.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.368+0000 7eff2c557740 1 -- 172.21.15.63:0/3466516268 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55d2199811d0 con 0x55d2195291b0 2024-09-21T06:32:06.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.368+0000 7efefeffd640 1 -- 172.21.15.63:0/3466516268 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d21986d8a0 con 0x55d2195291b0 2024-09-21T06:32:06.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.369+0000 7efefeffd640 1 -- 172.21.15.63:0/3466516268 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7eff140d6fa0 con 0x55d2195291b0 2024-09-21T06:32:06.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.369+0000 7eff2c557740 10 client.26053 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:06.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.369+0000 7eff2c557740 10 client.26053 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:32:06.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.369+0000 7eff2c557740 20 client.26053 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:06.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.369+0000 7eff2c557740 1 --2- 172.21.15.63:0/3466516268 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d219552070 0x55d219983770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:06.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.369+0000 7eff2c557740 4 client.26053 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:32:06.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.369+0000 7eff2c557740 1 -- 172.21.15.63:0/3466516268 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d21986acd0 con 0x55d219552070 2024-09-21T06:32:06.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.369+0000 7eff1f7fe640 1 --2- 172.21.15.63:0/3466516268 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d219552070 0x55d219983770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:06.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.369+0000 7eff1f7fe640 1 --2- 172.21.15.63:0/3466516268 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d219552070 0x55d219983770 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be7e22061be1f9f8 server_cookie=edcee1431b162c6f in_seq=0 out_seq=0 2024-09-21T06:32:06.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.369+0000 7efefeffd640 10 client.26053 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:06.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.370+0000 7efefeffd640 1 -- 172.21.15.63:0/3466516268 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d21986acd0 con 0x55d219552070 2024-09-21T06:32:06.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.370+0000 7efefeffd640 10 client.26053 handle_command_reply: tid=0 2024-09-21T06:32:06.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.370+0000 7eff2c557740 1 client.26053 shutdown 2024-09-21T06:32:06.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.370+0000 7eff2c557740 1 -- 172.21.15.63:0/3466516268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2195291b0 msgr2=0x55d219908a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:06.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.370+0000 7eff2c557740 1 --2- 172.21.15.63:0/3466516268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2195291b0 0x55d219908a60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7eff140cd7a0 tx=0x7eff140cd210 comp rx=0 tx=0).stop 2024-09-21T06:32:06.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.370+0000 7eff2c557740 1 -- 172.21.15.63:0/3466516268 shutdown_connections 2024-09-21T06:32:06.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.370+0000 7eff2c557740 1 --2- 172.21.15.63:0/3466516268 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d219552070 0x55d219983770 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.370+0000 7eff2c557740 1 --2- 172.21.15.63:0/3466516268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d219531390 0x55d219908fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.370+0000 7eff2c557740 1 --2- 172.21.15.63:0/3466516268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2195291b0 0x55d219908a60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.370+0000 7efefeffd640 0 client.26053 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:06.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.370+0000 7eff2c557740 1 --2- 172.21.15.63:0/3466516268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d2195109f0 0x55d21990d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.370+0000 7eff2c557740 1 -- 172.21.15.63:0/3466516268 >> 172.21.15.63:0/3466516268 conn(0x55d219546460 msgr2=0x55d2198fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:06.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.370+0000 7eff2c557740 1 -- 172.21.15.63:0/3466516268 shutdown_connections 2024-09-21T06:32:06.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.370+0000 7eff2c557740 1 -- 172.21.15.63:0/3466516268 wait complete. 2024-09-21T06:32:06.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.371+0000 7eff2c557740 20 client.26053 trim_cache size 0 max 16384 2024-09-21T06:32:06.377 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:32:06.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.371+0000 7eff25fe3640 1 -- 172.21.15.63:0/1605522019 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7eff080b6700 msgr2=0x7eff080b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:06.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.371+0000 7eff25fe3640 1 --2- 172.21.15.63:0/1605522019 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7eff080b6700 0x7eff080b8c10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7eff18005fd0 tx=0x7eff18009500 comp rx=0 tx=0).stop 2024-09-21T06:32:06.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.371+0000 7eff25fe3640 1 -- 172.21.15.63:0/1605522019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff20105270 msgr2=0x7eff2019aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:06.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.371+0000 7eff25fe3640 1 --2- 172.21.15.63:0/1605522019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff20105270 0x7eff2019aa40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7eff1402a930 tx=0x7eff14031a20 comp rx=0 tx=0).stop 2024-09-21T06:32:06.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.371+0000 7eff25fe3640 1 -- 172.21.15.63:0/1605522019 shutdown_connections 2024-09-21T06:32:06.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.371+0000 7eff25fe3640 1 --2- 172.21.15.63:0/1605522019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff2010ddf0 0x7eff2019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.371+0000 7eff25fe3640 1 --2- 172.21.15.63:0/1605522019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff20105270 0x7eff2019aa40 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.371+0000 7eff25fe3640 1 --2- 172.21.15.63:0/1605522019 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7eff080b6700 0x7eff080b8c10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.371+0000 7eff25fe3640 1 --2- 172.21.15.63:0/1605522019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff20104840 0x7eff2019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:06.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.371+0000 7eff25fe3640 1 -- 172.21.15.63:0/1605522019 >> 172.21.15.63:0/1605522019 conn(0x7eff20079730 msgr2=0x7eff20106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:06.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.371+0000 7eff25fe3640 1 -- 172.21.15.63:0/1605522019 shutdown_connections 2024-09-21T06:32:06.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:06.371+0000 7eff25fe3640 1 -- 172.21.15.63:0/1605522019 wait complete. 2024-09-21T06:32:07.173 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T06:32:07.461 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:32:07.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:07 smithi071 ceph-mon[34844]: pgmap v440: 97 pgs: 97 active+clean; 151 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 3.8 MiB/s wr, 666 op/s 2024-09-21T06:32:07.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:07 smithi063 ceph-mon[31150]: pgmap v440: 97 pgs: 97 active+clean; 151 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 3.8 MiB/s wr, 666 op/s 2024-09-21T06:32:07.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:07 smithi175 ceph-mon[34510]: pgmap v440: 97 pgs: 97 active+clean; 151 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 3.8 MiB/s wr, 666 op/s 2024-09-21T06:32:07.922 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:32:07.918+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:07.922 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:32:07.918+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-21T06:32:07.922 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:32:07.918+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-21T06:32:07.922 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:32:07.918+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T06:32:07.922 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:32:07.918+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-09-21T06:32:07.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.966+0000 7f86f6705640 1 -- 172.21.15.63:0/2192549750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86f0108d00 msgr2=0x7f86f010f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:07.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.966+0000 7f86f6705640 1 --2- 172.21.15.63:0/2192549750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86f0108d00 0x7f86f010f530 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f86e800bd70 tx=0x7f86e802c430 comp rx=0 tx=0).stop 2024-09-21T06:32:07.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.966+0000 7f86f6705640 1 -- 172.21.15.63:0/2192549750 shutdown_connections 2024-09-21T06:32:07.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.966+0000 7f86f6705640 1 --2- 172.21.15.63:0/2192549750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86f0108d00 0x7f86f010f530 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:07.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.966+0000 7f86f6705640 1 --2- 172.21.15.63:0/2192549750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86f01083b0 0x7f86f01087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:07.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.966+0000 7f86f6705640 1 --2- 172.21.15.63:0/2192549750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86f0102a70 0x7f86f0102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:07.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.966+0000 7f86f6705640 1 -- 172.21.15.63:0/2192549750 >> 172.21.15.63:0/2192549750 conn(0x7f86f0079730 msgr2=0x7f86f0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:07.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.966+0000 7f86f6705640 1 -- 172.21.15.63:0/2192549750 shutdown_connections 2024-09-21T06:32:07.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.966+0000 7f86f6705640 1 -- 172.21.15.63:0/2192549750 wait complete. 2024-09-21T06:32:07.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.967+0000 7f86f6705640 1 Processor -- start 2024-09-21T06:32:07.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.967+0000 7f86f6705640 1 -- start start 2024-09-21T06:32:07.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.967+0000 7f86f6705640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86f0102a70 0x7f86f019c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:07.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.967+0000 7f86f6705640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86f01083b0 0x7f86f019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:07.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.967+0000 7f86f6705640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86f0108d00 0x7f86f01a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:07.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.967+0000 7f86f6705640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f86f0111870 con 0x7f86f0102a70 2024-09-21T06:32:07.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.967+0000 7f86f6705640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f86f01116f0 con 0x7f86f01083b0 2024-09-21T06:32:07.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.967+0000 7f86f6705640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f86f01119f0 con 0x7f86f0108d00 2024-09-21T06:32:07.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.967+0000 7f86effff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86f0102a70 0x7f86f019c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:07.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.967+0000 7f86e7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86f01083b0 0x7f86f019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:07.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.967+0000 7f86effff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86f0102a70 0x7f86f019c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43514/0 (socket says 172.21.15.63:43514) 2024-09-21T06:32:07.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.967+0000 7f86effff640 1 -- 172.21.15.63:0/3792840340 learned_addr learned my addr 172.21.15.63:0/3792840340 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:07.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.967+0000 7f86e7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86f01083b0 0x7f86f019cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:43502/0 (socket says 172.21.15.63:43502) 2024-09-21T06:32:07.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.967+0000 7f86f4ca2640 1 --2- 172.21.15.63:0/3792840340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86f0108d00 0x7f86f01a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:07.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.968+0000 7f86effff640 1 -- 172.21.15.63:0/3792840340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86f0108d00 msgr2=0x7f86f01a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:07.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.968+0000 7f86effff640 1 --2- 172.21.15.63:0/3792840340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86f0108d00 0x7f86f01a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:07.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.968+0000 7f86effff640 1 -- 172.21.15.63:0/3792840340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86f01083b0 msgr2=0x7f86f019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:07.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.968+0000 7f86effff640 1 --2- 172.21.15.63:0/3792840340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86f01083b0 0x7f86f019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:07.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.968+0000 7f86effff640 1 -- 172.21.15.63:0/3792840340 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f01a2600 con 0x7f86f0102a70 2024-09-21T06:32:07.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.968+0000 7f86e7fff640 1 --2- 172.21.15.63:0/3792840340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86f01083b0 0x7f86f019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:07.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.968+0000 7f86effff640 1 --2- 172.21.15.63:0/3792840340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86f0102a70 0x7f86f019c690 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f86e000e9c0 tx=0x7f86e000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:07.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.968+0000 7f86edffb640 1 -- 172.21.15.63:0/3792840340 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e000cde0 con 0x7f86f0102a70 2024-09-21T06:32:07.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.968+0000 7f86edffb640 1 -- 172.21.15.63:0/3792840340 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e00035f0 con 0x7f86f0102a70 2024-09-21T06:32:07.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.968+0000 7f86edffb640 1 -- 172.21.15.63:0/3792840340 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0010690 con 0x7f86f0102a70 2024-09-21T06:32:07.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.968+0000 7f86f6705640 1 -- 172.21.15.63:0/3792840340 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f01a28f0 con 0x7f86f0102a70 2024-09-21T06:32:07.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.968+0000 7f86f6705640 1 -- 172.21.15.63:0/3792840340 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f01a9050 con 0x7f86f0102a70 2024-09-21T06:32:07.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.971+0000 7f86fcc79740 1 Processor -- start 2024-09-21T06:32:07.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.971+0000 7f86fcc79740 1 -- start start 2024-09-21T06:32:07.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.972+0000 7f86fcc79740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647af9070 0x55a647ea06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:07.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.972+0000 7f86fcc79740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 0x55a647ea0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:07.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.972+0000 7f86fcc79740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 0x55a647ea1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.972+0000 7f86fcc79740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a647e16ea0 con 0x55a647ad01b0 2024-09-21T06:32:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.972+0000 7f86fcc79740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a647e062d0 con 0x55a647af9070 2024-09-21T06:32:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.972+0000 7f86fcc79740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a647e0a0e0 con 0x55a647ad8390 2024-09-21T06:32:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.972+0000 7f86f4ca2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647af9070 0x55a647ea06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.972+0000 7f86e7fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 0x55a647ea1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.972+0000 7f86f4ca2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647af9070 0x55a647ea06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:43516/0 (socket says 172.21.15.63:43516) 2024-09-21T06:32:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.972+0000 7f86e7fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 0x55a647ea1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:41300/0 (socket says 172.21.15.63:41300) 2024-09-21T06:32:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.972+0000 7f86f4ca2640 1 -- 172.21.15.63:0/1373830587 learned_addr learned my addr 172.21.15.63:0/1373830587 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.972+0000 7f86e7fff640 1 -- 172.21.15.63:0/1373830587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647af9070 msgr2=0x55a647ea06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:07.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.972+0000 7f86e7fff640 1 --2- 172.21.15.63:0/1373830587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647af9070 0x55a647ea06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:07.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.972+0000 7f86e7fff640 1 -- 172.21.15.63:0/1373830587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 msgr2=0x55a647ea0be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:32:07.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.972+0000 7f86e7fff640 1 --2- 172.21.15.63:0/1373830587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 0x55a647ea0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:07.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.972+0000 7f86edffb640 1 -- 172.21.15.63:0/3792840340 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f86e0010830 con 0x7f86f0102a70 2024-09-21T06:32:07.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.972+0000 7f86e7fff640 1 -- 172.21.15.63:0/1373830587 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a647b64650 con 0x55a647ad8390 2024-09-21T06:32:07.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.973+0000 7f86e7fff640 1 --2- 172.21.15.63:0/1373830587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 0x55a647ea1120 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f86f006b6c0 tx=0x7f86d8011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4861da6aff0f34c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:07.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.973+0000 7f86e67fc640 1 -- 172.21.15.63:0/1373830587 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d8004230 con 0x55a647ad8390 2024-09-21T06:32:07.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.973+0000 7f86e67fc640 1 -- 172.21.15.63:0/1373830587 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86d80043d0 con 0x55a647ad8390 2024-09-21T06:32:07.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.974+0000 7f86e67fc640 1 -- 172.21.15.63:0/1373830587 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d800f940 con 0x55a647ad8390 2024-09-21T06:32:07.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.974+0000 7f86edffb640 1 --2- 172.21.15.63:0/3792840340 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f86dc0b6700 0x7f86dc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:07.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.974+0000 7f86f4ca2640 1 --2- 172.21.15.63:0/3792840340 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f86dc0b6700 0x7f86dc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:07.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.974+0000 7f86edffb640 1 -- 172.21.15.63:0/3792840340 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f86e00e7ab0 con 0x7f86f0102a70 2024-09-21T06:32:07.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.974+0000 7f86fcc79740 1 -- 172.21.15.63:0/1373830587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 msgr2=0x55a647ea1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:07.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.974+0000 7f86fcc79740 1 --2- 172.21.15.63:0/1373830587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 0x55a647ea1120 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f86f006b6c0 tx=0x7f86d8011810 comp rx=0 tx=0).stop 2024-09-21T06:32:07.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.974+0000 7f86fcc79740 1 -- 172.21.15.63:0/1373830587 shutdown_connections 2024-09-21T06:32:07.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.974+0000 7f86fcc79740 1 --2- 172.21.15.63:0/1373830587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 0x55a647ea1120 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:07.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.974+0000 7f86fcc79740 1 --2- 172.21.15.63:0/1373830587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 0x55a647ea0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:07.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.974+0000 7f86fcc79740 1 --2- 172.21.15.63:0/1373830587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647af9070 0x55a647ea06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:07.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.974+0000 7f86fcc79740 1 -- 172.21.15.63:0/1373830587 >> 172.21.15.63:0/1373830587 conn(0x55a647aed460 msgr2=0x55a647e9e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:07.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.975+0000 7f86f4ca2640 1 --2- 172.21.15.63:0/3792840340 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f86dc0b6700 0x7f86dc0b8c10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f86e800bbb0 tx=0x7f86e800e000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:07.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.975+0000 7f86fcc79740 1 -- 172.21.15.63:0/1373830587 shutdown_connections 2024-09-21T06:32:07.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.975+0000 7f86fcc79740 1 -- 172.21.15.63:0/1373830587 wait complete. 2024-09-21T06:32:07.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.976+0000 7f86fcc79740 1 -- start start 2024-09-21T06:32:07.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.976+0000 7f86fcc79740 1 Processor -- start 2024-09-21T06:32:07.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.977+0000 7f86fcc79740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 0x55a647eabca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:07.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.977+0000 7f86fcc79740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 0x55a647eac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:07.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.977+0000 7f86fcc79740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647af9070 0x55a647eac720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:07.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.977+0000 7f86fcc79740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a647c67700 con 0x55a647ad01b0 2024-09-21T06:32:07.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.977+0000 7f86fcc79740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a647da1160 con 0x55a647af9070 2024-09-21T06:32:07.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.977+0000 7f86fcc79740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a647eaef20 con 0x55a647ad8390 2024-09-21T06:32:07.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.977+0000 7f86fcc79740 10 client.0 _ll_register_callbacks cb 0x55a647dba9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:07.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.977+0000 7f86f4ca2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647af9070 0x55a647eac720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:07.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.977+0000 7f86f4ca2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647af9070 0x55a647eac720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:43518/0 (socket says 172.21.15.63:43518) 2024-09-21T06:32:07.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.977+0000 7f86f4ca2640 1 -- 172.21.15.63:0/3098377236 learned_addr learned my addr 172.21.15.63:0/3098377236 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:07.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.977+0000 7f86effff640 1 --2- 172.21.15.63:0/3098377236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 0x55a647eabca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:07.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.977+0000 7f86f4ca2640 1 -- 172.21.15.63:0/3098377236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 msgr2=0x55a647eac1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:32:07.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.977+0000 7f86f4ca2640 1 --2- 172.21.15.63:0/3098377236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 0x55a647eac1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:07.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.977+0000 7f86f4ca2640 1 -- 172.21.15.63:0/3098377236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 msgr2=0x55a647eabca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:07.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.977+0000 7f86f4ca2640 1 --2- 172.21.15.63:0/3098377236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 0x55a647eabca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:07.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.977+0000 7f86f4ca2640 1 -- 172.21.15.63:0/3098377236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a647dcec90 con 0x55a647af9070 2024-09-21T06:32:07.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.977+0000 7f86effff640 1 --2- 172.21.15.63:0/3098377236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 0x55a647eabca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:32:07.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.978+0000 7f86f4ca2640 1 --2- 172.21.15.63:0/3098377236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647af9070 0x55a647eac720 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f86e802ca20 tx=0x7f86e802c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31e8a9847c00844b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:07.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.978+0000 7f86cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:32:07.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.978+0000 7f86cf7fe640 1 -- 172.21.15.63:0/3098377236 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8033e60 con 0x55a647af9070 2024-09-21T06:32:07.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.978+0000 7f86cf7fe640 1 -- 172.21.15.63:0/3098377236 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f86e8003970 con 0x55a647af9070 2024-09-21T06:32:07.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.978+0000 7f86fcc79740 1 -- 172.21.15.63:0/3098377236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86d80043d0 con 0x55a647af9070 2024-09-21T06:32:07.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.978+0000 7f86cf7fe640 1 -- 172.21.15.63:0/3098377236 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f86e805a050 con 0x55a647af9070 2024-09-21T06:32:07.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.978+0000 7f86fcc79740 10 client.26003 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:07.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.978+0000 7f86fcc79740 1 -- 172.21.15.63:0/3098377236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55a647ebaba0 con 0x55a647af9070 2024-09-21T06:32:07.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.979+0000 7f86cf7fe640 1 -- 172.21.15.63:0/3098377236 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e8045030 con 0x55a647af9070 2024-09-21T06:32:07.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.979+0000 7f86cf7fe640 1 -- 172.21.15.63:0/3098377236 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f86e80095e0 con 0x55a647af9070 2024-09-21T06:32:07.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.979+0000 7f86fcc79740 10 client.26003 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:07.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.979+0000 7f86fcc79740 10 client.26003 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:32:07.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.979+0000 7f86fcc79740 20 client.26003 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:07.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.979+0000 7f86fcc79740 1 --2- 172.21.15.63:0/3098377236 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55a647ab79f0 0x55a647ebe580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:07.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.979+0000 7f86fcc79740 4 client.26003 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:32:07.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.979+0000 7f86fcc79740 1 -- 172.21.15.63:0/3098377236 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f86d80043d0 con 0x55a647ab79f0 2024-09-21T06:32:07.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.979+0000 7f86effff640 1 --2- 172.21.15.63:0/3098377236 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55a647ab79f0 0x55a647ebe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:07.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.980+0000 7f86cf7fe640 10 client.26003 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:32:07.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.980+0000 7f86effff640 1 --2- 172.21.15.63:0/3098377236 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55a647ab79f0 0x55a647ebe580 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f0350ce414f22e6f server_cookie=1290e28c01cf752a in_seq=0 out_seq=0 2024-09-21T06:32:07.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.981+0000 7f86cf7fe640 1 -- 172.21.15.63:0/3098377236 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f86d80043d0 con 0x55a647ab79f0 2024-09-21T06:32:07.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.981+0000 7f86cf7fe640 10 client.26003 handle_command_reply: tid=0 2024-09-21T06:32:07.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.981+0000 7f86fcc79740 1 client.26003 shutdown 2024-09-21T06:32:07.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.981+0000 7f86fcc79740 1 -- 172.21.15.63:0/3098377236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647af9070 msgr2=0x55a647eac720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:07.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.981+0000 7f86fcc79740 1 --2- 172.21.15.63:0/3098377236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647af9070 0x55a647eac720 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f86e802ca20 tx=0x7f86e802c430 comp rx=0 tx=0).stop 2024-09-21T06:32:07.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.981+0000 7f86fcc79740 1 -- 172.21.15.63:0/3098377236 shutdown_connections 2024-09-21T06:32:07.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.981+0000 7f86fcc79740 1 --2- 172.21.15.63:0/3098377236 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55a647ab79f0 0x55a647ebe580 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:07.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.981+0000 7f86fcc79740 1 --2- 172.21.15.63:0/3098377236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647af9070 0x55a647eac720 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:07.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.981+0000 7f86fcc79740 1 --2- 172.21.15.63:0/3098377236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 0x55a647eac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:07.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.981+0000 7f86cf7fe640 0 client.26003 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:32:07.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.981+0000 7f86fcc79740 1 --2- 172.21.15.63:0/3098377236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 0x55a647eabca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:07.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.981+0000 7f86fcc79740 1 -- 172.21.15.63:0/3098377236 >> 172.21.15.63:0/3098377236 conn(0x55a647aed460 msgr2=0x55a647ea3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:07.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.981+0000 7f86fcc79740 1 -- 172.21.15.63:0/3098377236 shutdown_connections 2024-09-21T06:32:07.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.981+0000 7f86fcc79740 1 -- 172.21.15.63:0/3098377236 wait complete. 2024-09-21T06:32:07.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.981+0000 7f86fcc79740 20 client.26003 trim_cache size 0 max 16384 2024-09-21T06:32:07.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.995+0000 7f86fcc79740 1 Processor -- start 2024-09-21T06:32:07.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.996+0000 7f86fcc79740 1 -- start start 2024-09-21T06:32:07.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.996+0000 7f86fcc79740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647ab79f0 0x55a647ea1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:07.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.996+0000 7f86fcc79740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 0x55a647e9dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:07.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.996+0000 7f86fcc79740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 0x55a647e9e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:07.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.996+0000 7f86fcc79740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f86f01b19a0 con 0x55a647ad01b0 2024-09-21T06:32:07.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.996+0000 7f86fcc79740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f86f01b35a0 con 0x55a647ab79f0 2024-09-21T06:32:07.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.996+0000 7f86fcc79740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f86f01b2130 con 0x55a647ad8390 2024-09-21T06:32:07.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.996+0000 7f86e7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 0x55a647e9dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:07.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.996+0000 7f86effff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647ab79f0 0x55a647ea1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:07.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.996+0000 7f86e7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 0x55a647e9dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43534/0 (socket says 172.21.15.63:43534) 2024-09-21T06:32:07.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.996+0000 7f86e7fff640 1 -- 172.21.15.63:0/238503815 learned_addr learned my addr 172.21.15.63:0/238503815 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:07.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.996+0000 7f86f4ca2640 1 --2- 172.21.15.63:0/238503815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 0x55a647e9e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:07.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.996+0000 7f86effff640 1 -- 172.21.15.63:0/238503815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 msgr2=0x55a647e9e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:08.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.997+0000 7f86effff640 1 --2- 172.21.15.63:0/238503815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 0x55a647e9e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:08.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.997+0000 7f86effff640 1 -- 172.21.15.63:0/238503815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 msgr2=0x55a647e9dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:08.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.997+0000 7f86effff640 1 --2- 172.21.15.63:0/238503815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 0x55a647e9dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:08.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.997+0000 7f86effff640 1 -- 172.21.15.63:0/238503815 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a647eacf60 con 0x55a647ab79f0 2024-09-21T06:32:08.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.997+0000 7f86f4ca2640 1 --2- 172.21.15.63:0/238503815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 0x55a647e9e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:08.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.997+0000 7f86effff640 1 --2- 172.21.15.63:0/238503815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647ab79f0 0x55a647ea1de0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f86e00e5180 tx=0x7f86e00e7d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2826548b3881457 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:08.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.997+0000 7f86e5ffb640 1 -- 172.21.15.63:0/238503815 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e00ad390 con 0x55a647ab79f0 2024-09-21T06:32:08.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.997+0000 7f86e5ffb640 1 -- 172.21.15.63:0/238503815 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e00adf80 con 0x55a647ab79f0 2024-09-21T06:32:08.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.997+0000 7f86e5ffb640 1 -- 172.21.15.63:0/238503815 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e00a9af0 con 0x55a647ab79f0 2024-09-21T06:32:08.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.998+0000 7f86fcc79740 1 -- 172.21.15.63:0/238503815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647ab79f0 msgr2=0x55a647ea1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:08.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.998+0000 7f86fcc79740 1 --2- 172.21.15.63:0/238503815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647ab79f0 0x55a647ea1de0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f86e00e5180 tx=0x7f86e00e7d20 comp rx=0 tx=0).stop 2024-09-21T06:32:08.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.998+0000 7f86fcc79740 1 -- 172.21.15.63:0/238503815 shutdown_connections 2024-09-21T06:32:08.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.998+0000 7f86fcc79740 1 --2- 172.21.15.63:0/238503815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 0x55a647e9e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:08.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.998+0000 7f86fcc79740 1 --2- 172.21.15.63:0/238503815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 0x55a647e9dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:08.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.998+0000 7f86fcc79740 1 --2- 172.21.15.63:0/238503815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647ab79f0 0x55a647ea1de0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:08.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.998+0000 7f86fcc79740 1 -- 172.21.15.63:0/238503815 >> 172.21.15.63:0/238503815 conn(0x55a647aed460 msgr2=0x55a647ea16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:08.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.998+0000 7f86fcc79740 1 -- 172.21.15.63:0/238503815 shutdown_connections 2024-09-21T06:32:08.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.998+0000 7f86fcc79740 1 -- 172.21.15.63:0/238503815 wait complete. 2024-09-21T06:32:08.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.998+0000 7f86fcc79740 1 -- start start 2024-09-21T06:32:08.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.999+0000 7f86fcc79740 1 Processor -- start 2024-09-21T06:32:08.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.999+0000 7f86fcc79740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647ab79f0 0x55a647eb4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:08.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.999+0000 7f86fcc79740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 0x55a647eafe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:08.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.999+0000 7f86fcc79740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 0x55a647eb0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:08.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.999+0000 7f86fcc79740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f86f01b2ed0 con 0x55a647ad01b0 2024-09-21T06:32:08.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.999+0000 7f86fcc79740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f86f01b2800 con 0x55a647ab79f0 2024-09-21T06:32:08.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.999+0000 7f86fcc79740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f86f01af980 con 0x55a647ad8390 2024-09-21T06:32:08.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.999+0000 7f86fcc79740 10 client.0 _ll_register_callbacks cb 0x7f86d8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:08.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.999+0000 7f86e7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 0x55a647eafe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:08.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.999+0000 7f86effff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647ab79f0 0x55a647eb4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:08.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.999+0000 7f86effff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647ab79f0 0x55a647eb4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:43534/0 (socket says 172.21.15.63:43534) 2024-09-21T06:32:08.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.999+0000 7f86effff640 1 -- 172.21.15.63:0/3149518756 learned_addr learned my addr 172.21.15.63:0/3149518756 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:08.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.999+0000 7f86e7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 0x55a647eafe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43538/0 (socket says 172.21.15.63:43538) 2024-09-21T06:32:08.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:07.999+0000 7f86f4ca2640 1 --2- 172.21.15.63:0/3149518756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 0x55a647eb0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:08.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.000+0000 7f86effff640 1 -- 172.21.15.63:0/3149518756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 msgr2=0x55a647eb0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:08.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.000+0000 7f86effff640 1 --2- 172.21.15.63:0/3149518756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 0x55a647eb0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:08.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.000+0000 7f86effff640 1 -- 172.21.15.63:0/3149518756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 msgr2=0x55a647eafe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:08.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.000+0000 7f86effff640 1 --2- 172.21.15.63:0/3149518756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 0x55a647eafe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:08.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.000+0000 7f86effff640 1 -- 172.21.15.63:0/3149518756 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a647eb0a70 con 0x55a647ab79f0 2024-09-21T06:32:08.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.000+0000 7f86effff640 1 --2- 172.21.15.63:0/3149518756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647ab79f0 0x55a647eb4940 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f86e00d10b0 tx=0x7f86e0003de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=218282ccf8a91a48 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:08.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.000+0000 7f86cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:32:08.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.000+0000 7f86cf7fe640 1 -- 172.21.15.63:0/3149518756 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e00ad390 con 0x55a647ab79f0 2024-09-21T06:32:08.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.000+0000 7f86cf7fe640 1 -- 172.21.15.63:0/3149518756 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f86e00e5400 con 0x55a647ab79f0 2024-09-21T06:32:08.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.000+0000 7f86fcc79740 1 -- 172.21.15.63:0/3149518756 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86e00adf80 con 0x55a647ab79f0 2024-09-21T06:32:08.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.000+0000 7f86cf7fe640 1 -- 172.21.15.63:0/3149518756 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f86e0003aa0 con 0x55a647ab79f0 2024-09-21T06:32:08.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.000+0000 7f86fcc79740 10 client.26009 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:08.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.000+0000 7f86fcc79740 1 -- 172.21.15.63:0/3149518756 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55a647f28e20 con 0x55a647ab79f0 2024-09-21T06:32:08.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.001+0000 7f86cf7fe640 1 -- 172.21.15.63:0/3149518756 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e00adf80 con 0x55a647ab79f0 2024-09-21T06:32:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.001+0000 7f86cf7fe640 1 -- 172.21.15.63:0/3149518756 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f86e00d4030 con 0x55a647ab79f0 2024-09-21T06:32:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.001+0000 7f86fcc79740 10 client.26009 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.001+0000 7f86fcc79740 10 client.26009 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:32:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.001+0000 7f86fcc79740 20 client.26009 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.001+0000 7f86fcc79740 1 --2- 172.21.15.63:0/3149518756 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55a647af9070 0x55a647f2b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.001+0000 7f86fcc79740 4 client.26009 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:32:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.001+0000 7f86fcc79740 1 -- 172.21.15.63:0/3149518756 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a647e18df0 con 0x55a647af9070 2024-09-21T06:32:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.001+0000 7f86e7fff640 1 --2- 172.21.15.63:0/3149518756 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55a647af9070 0x55a647f2b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.002+0000 7f86cf7fe640 10 client.26009 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:32:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.002+0000 7f86e7fff640 1 --2- 172.21.15.63:0/3149518756 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55a647af9070 0x55a647f2b590 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d1eaa56ac07cf9be server_cookie=b84e2942c5b8009c in_seq=0 out_seq=0 2024-09-21T06:32:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.002+0000 7f86cf7fe640 1 -- 172.21.15.63:0/3149518756 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a647e18df0 con 0x55a647af9070 2024-09-21T06:32:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.002+0000 7f86cf7fe640 10 client.26009 handle_command_reply: tid=0 2024-09-21T06:32:08.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.002+0000 7f86fcc79740 1 client.26009 shutdown 2024-09-21T06:32:08.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.002+0000 7f86fcc79740 1 -- 172.21.15.63:0/3149518756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647ab79f0 msgr2=0x55a647eb4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:08.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.002+0000 7f86fcc79740 1 --2- 172.21.15.63:0/3149518756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647ab79f0 0x55a647eb4940 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f86e00d10b0 tx=0x7f86e0003de0 comp rx=0 tx=0).stop 2024-09-21T06:32:08.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.002+0000 7f86fcc79740 1 -- 172.21.15.63:0/3149518756 shutdown_connections 2024-09-21T06:32:08.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.002+0000 7f86fcc79740 1 --2- 172.21.15.63:0/3149518756 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55a647af9070 0x55a647f2b590 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:08.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.002+0000 7f86fcc79740 1 --2- 172.21.15.63:0/3149518756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a647ad8390 0x55a647eb0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:08.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.002+0000 7f86cf7fe640 0 client.26009 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:32:08.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.002+0000 7f86fcc79740 1 --2- 172.21.15.63:0/3149518756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a647ad01b0 0x55a647eafe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:08.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.002+0000 7f86fcc79740 1 --2- 172.21.15.63:0/3149518756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a647ab79f0 0x55a647eb4940 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:08.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.002+0000 7f86fcc79740 1 -- 172.21.15.63:0/3149518756 >> 172.21.15.63:0/3149518756 conn(0x55a647aed460 msgr2=0x55a647ea16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:08.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.002+0000 7f86fcc79740 1 -- 172.21.15.63:0/3149518756 shutdown_connections 2024-09-21T06:32:08.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.002+0000 7f86fcc79740 1 -- 172.21.15.63:0/3149518756 wait complete. 2024-09-21T06:32:08.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.002+0000 7f86fcc79740 20 client.26009 trim_cache size 0 max 16384 2024-09-21T06:32:08.009 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:32:08.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.003+0000 7f86f6705640 1 -- 172.21.15.63:0/3792840340 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f86dc0b6700 msgr2=0x7f86dc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:08.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.003+0000 7f86f6705640 1 --2- 172.21.15.63:0/3792840340 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f86dc0b6700 0x7f86dc0b8c10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f86e800bbb0 tx=0x7f86e800e000 comp rx=0 tx=0).stop 2024-09-21T06:32:08.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.003+0000 7f86f6705640 1 -- 172.21.15.63:0/3792840340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86f0102a70 msgr2=0x7f86f019c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:08.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.003+0000 7f86f6705640 1 --2- 172.21.15.63:0/3792840340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86f0102a70 0x7f86f019c690 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f86e000e9c0 tx=0x7f86e000ee80 comp rx=0 tx=0).stop 2024-09-21T06:32:08.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.003+0000 7f86f6705640 1 -- 172.21.15.63:0/3792840340 shutdown_connections 2024-09-21T06:32:08.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.003+0000 7f86f6705640 1 --2- 172.21.15.63:0/3792840340 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f86dc0b6700 0x7f86dc0b8c10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:08.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.003+0000 7f86f6705640 1 --2- 172.21.15.63:0/3792840340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86f0108d00 0x7f86f01a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:08.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.003+0000 7f86f6705640 1 --2- 172.21.15.63:0/3792840340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86f01083b0 0x7f86f019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:08.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.003+0000 7f86f6705640 1 --2- 172.21.15.63:0/3792840340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86f0102a70 0x7f86f019c690 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:08.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.003+0000 7f86f6705640 1 -- 172.21.15.63:0/3792840340 >> 172.21.15.63:0/3792840340 conn(0x7f86f0079730 msgr2=0x7f86f0104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:08.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.003+0000 7f86f6705640 1 -- 172.21.15.63:0/3792840340 shutdown_connections 2024-09-21T06:32:08.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:08.003+0000 7f86f6705640 1 -- 172.21.15.63:0/3792840340 wait complete. 2024-09-21T06:32:08.184 INFO:tasks.workunit.client.0.smithi063.stdout:40000 mapwrite 0x1becad thru 0x1c6a92 (0x7de6 bytes) 2024-09-21T06:32:08.819 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:32:09.102 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:32:09.765 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:09 smithi063 ceph-mon[31150]: pgmap v441: 97 pgs: 97 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.8 MiB/s wr, 817 op/s 2024-09-21T06:32:09.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.768+0000 7f4f4f824640 1 -- 172.21.15.63:0/997590169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f481049b0 msgr2=0x7f4f48104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:09.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.768+0000 7f4f4f824640 1 --2- 172.21.15.63:0/997590169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f481049b0 0x7f4f48104dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009860 tx=0x7f4f4402a340 comp rx=0 tx=0).stop 2024-09-21T06:32:09.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.768+0000 7f4f4f824640 1 -- 172.21.15.63:0/997590169 shutdown_connections 2024-09-21T06:32:09.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.768+0000 7f4f4f824640 1 --2- 172.21.15.63:0/997590169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f4810de10 0x7f4f48110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.768+0000 7f4f4f824640 1 --2- 172.21.15.63:0/997590169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f48105300 0x7f4f4810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.768+0000 7f4f4f824640 1 --2- 172.21.15.63:0/997590169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f481049b0 0x7f4f48104dc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.768+0000 7f4f4f824640 1 -- 172.21.15.63:0/997590169 >> 172.21.15.63:0/997590169 conn(0x7f4f48079730 msgr2=0x7f4f48079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:09.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.768+0000 7f4f4f824640 1 -- 172.21.15.63:0/997590169 shutdown_connections 2024-09-21T06:32:09.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.768+0000 7f4f4f824640 1 -- 172.21.15.63:0/997590169 wait complete. 2024-09-21T06:32:09.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.769+0000 7f4f4f824640 1 Processor -- start 2024-09-21T06:32:09.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.769+0000 7f4f4f824640 1 -- start start 2024-09-21T06:32:09.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.769+0000 7f4f4f824640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f481049b0 0x7f4f4819c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:09.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.769+0000 7f4f4f824640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f48105300 0x7f4f4819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:09.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.769+0000 7f4f4f824640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f4810de10 0x7f4f481a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:09.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.769+0000 7f4f4f824640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4f48113a70 con 0x7f4f48105300 2024-09-21T06:32:09.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.769+0000 7f4f4f824640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4f481138f0 con 0x7f4f4810de10 2024-09-21T06:32:09.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.769+0000 7f4f4f824640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4f48113bf0 con 0x7f4f481049b0 2024-09-21T06:32:09.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.769+0000 7f4f4cdbf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f48105300 0x7f4f4819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.769+0000 7f4f4d5c0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f481049b0 0x7f4f4819c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.769+0000 7f4f4cdbf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f48105300 0x7f4f4819cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43552/0 (socket says 172.21.15.63:43552) 2024-09-21T06:32:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.769+0000 7f4f4ddc1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f4810de10 0x7f4f481a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.769+0000 7f4f4cdbf640 1 -- 172.21.15.63:0/1046615115 learned_addr learned my addr 172.21.15.63:0/1046615115 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.770+0000 7f4f4d5c0640 1 -- 172.21.15.63:0/1046615115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f4810de10 msgr2=0x7f4f481a1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.770+0000 7f4f4d5c0640 1 --2- 172.21.15.63:0/1046615115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f4810de10 0x7f4f481a1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.770+0000 7f4f4d5c0640 1 -- 172.21.15.63:0/1046615115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f48105300 msgr2=0x7f4f4819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.770+0000 7f4f4d5c0640 1 --2- 172.21.15.63:0/1046615115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f48105300 0x7f4f4819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.770+0000 7f4f4d5c0640 1 -- 172.21.15.63:0/1046615115 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f481a2670 con 0x7f4f481049b0 2024-09-21T06:32:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.770+0000 7f4f4cdbf640 1 --2- 172.21.15.63:0/1046615115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f48105300 0x7f4f4819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.770+0000 7f4f4ddc1640 1 --2- 172.21.15.63:0/1046615115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f4810de10 0x7f4f481a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.770+0000 7f4f4d5c0640 1 --2- 172.21.15.63:0/1046615115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f481049b0 0x7f4f4819c700 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4f44035040 tx=0x7f4f44032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.770+0000 7f4f3e7fc640 1 -- 172.21.15.63:0/1046615115 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f44040020 con 0x7f4f481049b0 2024-09-21T06:32:09.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.770+0000 7f4f4f824640 1 -- 172.21.15.63:0/1046615115 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f481a2900 con 0x7f4f481049b0 2024-09-21T06:32:09.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.770+0000 7f4f3e7fc640 1 -- 172.21.15.63:0/1046615115 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f44030e10 con 0x7f4f481049b0 2024-09-21T06:32:09.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.770+0000 7f4f3e7fc640 1 -- 172.21.15.63:0/1046615115 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f44037040 con 0x7f4f481049b0 2024-09-21T06:32:09.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.770+0000 7f4f4f824640 1 -- 172.21.15.63:0/1046615115 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f481a90c0 con 0x7f4f481049b0 2024-09-21T06:32:09.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.773+0000 7f4f55d98740 1 Processor -- start 2024-09-21T06:32:09.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.773+0000 7f4f55d98740 1 -- start start 2024-09-21T06:32:09.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.773+0000 7f4f3e7fc640 1 -- 172.21.15.63:0/1046615115 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f4f44043020 con 0x7f4f481049b0 2024-09-21T06:32:09.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.773+0000 7f4f55d98740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 0x55e0cabcc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:09.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.773+0000 7f4f55d98740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca7fc1b0 0x55e0cabcc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:09.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.773+0000 7f4f55d98740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca804390 0x55e0cabccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:09.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.773+0000 7f4f55d98740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55e0cab42ea0 con 0x55e0ca825070 2024-09-21T06:32:09.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.773+0000 7f4f55d98740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e0cab322d0 con 0x55e0ca7fc1b0 2024-09-21T06:32:09.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.773+0000 7f4f55d98740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e0cab360e0 con 0x55e0ca804390 2024-09-21T06:32:09.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.774+0000 7f4f4ddc1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 0x55e0cabcc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:09.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.774+0000 7f4f4ddc1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 0x55e0cabcc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43562/0 (socket says 172.21.15.63:43562) 2024-09-21T06:32:09.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.774+0000 7f4f4ddc1640 1 -- 172.21.15.63:0/3315223446 learned_addr learned my addr 172.21.15.63:0/3315223446 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:09.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.774+0000 7f4f4cdbf640 1 --2- 172.21.15.63:0/3315223446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca804390 0x55e0cabccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:09.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.774+0000 7f4f4d5c0640 1 --2- 172.21.15.63:0/3315223446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca7fc1b0 0x55e0cabcc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.774+0000 7f4f4ddc1640 1 -- 172.21.15.63:0/3315223446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca804390 msgr2=0x55e0cabccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.774+0000 7f4f4ddc1640 1 --2- 172.21.15.63:0/3315223446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca804390 0x55e0cabccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.774+0000 7f4f4ddc1640 1 -- 172.21.15.63:0/3315223446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca7fc1b0 msgr2=0x55e0cabcc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.774+0000 7f4f4ddc1640 1 --2- 172.21.15.63:0/3315223446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca7fc1b0 0x55e0cabcc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.774+0000 7f4f4ddc1640 1 -- 172.21.15.63:0/3315223446 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0ca890650 con 0x55e0ca825070 2024-09-21T06:32:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.774+0000 7f4f4ddc1640 1 --2- 172.21.15.63:0/3315223446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 0x55e0cabcc2c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009fd0 tx=0x7f4f4000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46c3fb9cbea0426 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.774+0000 7f4f337fe640 1 -- 172.21.15.63:0/3315223446 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4001d070 con 0x55e0ca825070 2024-09-21T06:32:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.775+0000 7f4f337fe640 1 -- 172.21.15.63:0/3315223446 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f40003e20 con 0x55e0ca825070 2024-09-21T06:32:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.775+0000 7f4f337fe640 1 -- 172.21.15.63:0/3315223446 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f40004670 con 0x55e0ca825070 2024-09-21T06:32:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.775+0000 7f4f3e7fc640 1 --2- 172.21.15.63:0/1046615115 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4f340b6680 0x7f4f340b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.775+0000 7f4f4d5c0640 1 --2- 172.21.15.63:0/1046615115 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4f340b6680 0x7f4f340b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.775+0000 7f4f3e7fc640 1 -- 172.21.15.63:0/1046615115 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f4f44107160 con 0x7f4f481049b0 2024-09-21T06:32:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.776+0000 7f4f55d98740 1 -- 172.21.15.63:0/3315223446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 msgr2=0x55e0cabcc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.776+0000 7f4f4d5c0640 1 --2- 172.21.15.63:0/1046615115 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4f340b6680 0x7f4f340b8b90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4f44104940 tx=0x7f4f4410acb0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.776+0000 7f4f55d98740 1 --2- 172.21.15.63:0/3315223446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 0x55e0cabcc2c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009fd0 tx=0x7f4f4000ebc0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.776+0000 7f4f55d98740 1 -- 172.21.15.63:0/3315223446 shutdown_connections 2024-09-21T06:32:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.776+0000 7f4f55d98740 1 --2- 172.21.15.63:0/3315223446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca804390 0x55e0cabccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.776+0000 7f4f55d98740 1 --2- 172.21.15.63:0/3315223446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca7fc1b0 0x55e0cabcc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.776+0000 7f4f55d98740 1 --2- 172.21.15.63:0/3315223446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 0x55e0cabcc2c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.776+0000 7f4f55d98740 1 -- 172.21.15.63:0/3315223446 >> 172.21.15.63:0/3315223446 conn(0x55e0ca819460 msgr2=0x55e0cabca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.776+0000 7f4f55d98740 1 -- 172.21.15.63:0/3315223446 shutdown_connections 2024-09-21T06:32:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.776+0000 7f4f55d98740 1 -- 172.21.15.63:0/3315223446 wait complete. 2024-09-21T06:32:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.776+0000 7f4f55d98740 1 -- start start 2024-09-21T06:32:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.776+0000 7f4f55d98740 1 Processor -- start 2024-09-21T06:32:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.777+0000 7f4f55d98740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca7fc1b0 0x55e0cabd79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.777+0000 7f4f55d98740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca804390 0x55e0cabd7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.777+0000 7f4f55d98740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca825070 0x55e0cabe3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.777+0000 7f4f55d98740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55e0ca993700 con 0x55e0ca7fc1b0 2024-09-21T06:32:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.777+0000 7f4f55d98740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e0caacd160 con 0x55e0ca804390 2024-09-21T06:32:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.777+0000 7f4f55d98740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e0cabdaaa0 con 0x55e0ca825070 2024-09-21T06:32:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.777+0000 7f4f4ddc1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca7fc1b0 0x55e0cabd79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.777+0000 7f4f4ddc1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca7fc1b0 0x55e0cabd79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43566/0 (socket says 172.21.15.63:43566) 2024-09-21T06:32:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.777+0000 7f4f4ddc1640 1 -- 172.21.15.63:0/3858045375 learned_addr learned my addr 172.21.15.63:0/3858045375 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.777+0000 7f4f55d98740 10 client.0 _ll_register_callbacks cb 0x55e0caae69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.777+0000 7f4f4cdbf640 1 --2- 172.21.15.63:0/3858045375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca804390 0x55e0cabd7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.777+0000 7f4f4ddc1640 1 --2- 172.21.15.63:0/3858045375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca825070 0x55e0cabe3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.777+0000 7f4f4ddc1640 1 -- 172.21.15.63:0/3858045375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca825070 msgr2=0x55e0cabe3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.777+0000 7f4f4ddc1640 1 --2- 172.21.15.63:0/3858045375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca825070 0x55e0cabe3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.777+0000 7f4f4ddc1640 1 -- 172.21.15.63:0/3858045375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca804390 msgr2=0x55e0cabd7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.777+0000 7f4f4ddc1640 1 --2- 172.21.15.63:0/3858045375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca804390 0x55e0cabd7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.777+0000 7f4f4ddc1640 1 -- 172.21.15.63:0/3858045375 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0caafac90 con 0x55e0ca7fc1b0 2024-09-21T06:32:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.777+0000 7f4f4cdbf640 1 --2- 172.21.15.63:0/3858045375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca804390 0x55e0cabd7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.778+0000 7f4f4ddc1640 1 --2- 172.21.15.63:0/3858045375 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca7fc1b0 0x55e0cabd79e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000efa0 tx=0x7f4f4000ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a20ebf2465c017 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.778+0000 7f4f30ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:32:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.778+0000 7f4f30ff9640 1 -- 172.21.15.63:0/3858045375 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4001d070 con 0x55e0ca7fc1b0 2024-09-21T06:32:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.778+0000 7f4f30ff9640 1 -- 172.21.15.63:0/3858045375 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f4f400043b0 con 0x55e0ca7fc1b0 2024-09-21T06:32:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.778+0000 7f4f55d98740 1 -- 172.21.15.63:0/3858045375 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f40003e20 con 0x55e0ca7fc1b0 2024-09-21T06:32:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.778+0000 7f4f30ff9640 1 -- 172.21.15.63:0/3858045375 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f4f40004e50 con 0x55e0ca7fc1b0 2024-09-21T06:32:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.778+0000 7f4f55d98740 10 client.16368 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.778+0000 7f4f55d98740 1 -- 172.21.15.63:0/3858045375 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55e0cabe6790 con 0x55e0ca7fc1b0 2024-09-21T06:32:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.778+0000 7f4f30ff9640 1 -- 172.21.15.63:0/3858045375 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f40003e20 con 0x55e0ca7fc1b0 2024-09-21T06:32:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.778+0000 7f4f30ff9640 1 -- 172.21.15.63:0/3858045375 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f4f4000b040 con 0x55e0ca7fc1b0 2024-09-21T06:32:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.779+0000 7f4f55d98740 10 client.16368 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.779+0000 7f4f55d98740 10 client.16368 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:32:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.779+0000 7f4f55d98740 20 client.16368 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.779+0000 7f4f55d98740 1 --2- 172.21.15.63:0/3858045375 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55e0ca7e39f0 0x55e0cabe9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.779+0000 7f4f55d98740 4 client.16368 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:32:09.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.779+0000 7f4f55d98740 1 -- 172.21.15.63:0/3858045375 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0cab44df0 con 0x55e0ca7e39f0 2024-09-21T06:32:09.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.779+0000 7f4f4cdbf640 1 --2- 172.21.15.63:0/3858045375 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55e0ca7e39f0 0x55e0cabe9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:09.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.779+0000 7f4f30ff9640 10 client.16368 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:32:09.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.779+0000 7f4f4cdbf640 1 --2- 172.21.15.63:0/3858045375 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55e0ca7e39f0 0x55e0cabe9c60 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e2238b008e6b29be server_cookie=5a8d9f3a256c59e5 in_seq=0 out_seq=0 2024-09-21T06:32:09.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.780+0000 7f4f30ff9640 1 -- 172.21.15.63:0/3858045375 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e0cab44df0 con 0x55e0ca7e39f0 2024-09-21T06:32:09.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.780+0000 7f4f30ff9640 10 client.16368 handle_command_reply: tid=0 2024-09-21T06:32:09.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.780+0000 7f4f55d98740 1 client.16368 shutdown 2024-09-21T06:32:09.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.780+0000 7f4f55d98740 1 -- 172.21.15.63:0/3858045375 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca7fc1b0 msgr2=0x55e0cabd79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:09.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.780+0000 7f4f55d98740 1 --2- 172.21.15.63:0/3858045375 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca7fc1b0 0x55e0cabd79e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000efa0 tx=0x7f4f4000ee10 comp rx=0 tx=0).stop 2024-09-21T06:32:09.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.780+0000 7f4f55d98740 1 -- 172.21.15.63:0/3858045375 shutdown_connections 2024-09-21T06:32:09.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.780+0000 7f4f55d98740 1 --2- 172.21.15.63:0/3858045375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca825070 0x55e0cabe3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.780+0000 7f4f55d98740 1 --2- 172.21.15.63:0/3858045375 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55e0ca7e39f0 0x55e0cabe9c60 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.780+0000 7f4f55d98740 1 --2- 172.21.15.63:0/3858045375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca804390 0x55e0cabd7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.780+0000 7f4f30ff9640 0 client.16368 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:32:09.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.780+0000 7f4f55d98740 1 --2- 172.21.15.63:0/3858045375 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca7fc1b0 0x55e0cabd79e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.781+0000 7f4f55d98740 1 -- 172.21.15.63:0/3858045375 >> 172.21.15.63:0/3858045375 conn(0x55e0ca819460 msgr2=0x55e0cabcf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:09.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.781+0000 7f4f55d98740 1 -- 172.21.15.63:0/3858045375 shutdown_connections 2024-09-21T06:32:09.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.781+0000 7f4f55d98740 1 -- 172.21.15.63:0/3858045375 wait complete. 2024-09-21T06:32:09.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.781+0000 7f4f55d98740 20 client.16368 trim_cache size 0 max 16384 2024-09-21T06:32:09.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.795+0000 7f4f55d98740 1 Processor -- start 2024-09-21T06:32:09.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.795+0000 7f4f55d98740 1 -- start start 2024-09-21T06:32:09.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.796+0000 7f4f55d98740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca7fc1b0 0x55e0cabcda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:09.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.796+0000 7f4f55d98740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca804390 0x55e0cabd4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:09.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.796+0000 7f4f55d98740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 0x55e0cabd5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:09.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.796+0000 7f4f55d98740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4f481b1990 con 0x55e0ca825070 2024-09-21T06:32:09.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.796+0000 7f4f55d98740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4f481b3590 con 0x55e0ca7fc1b0 2024-09-21T06:32:09.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.796+0000 7f4f55d98740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4f481b2120 con 0x55e0ca804390 2024-09-21T06:32:09.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.796+0000 7f4f4ddc1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 0x55e0cabd5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:09.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.796+0000 7f4f4ddc1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 0x55e0cabd5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43572/0 (socket says 172.21.15.63:43572) 2024-09-21T06:32:09.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.796+0000 7f4f4ddc1640 1 -- 172.21.15.63:0/1234996841 learned_addr learned my addr 172.21.15.63:0/1234996841 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:09.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.796+0000 7f4f4cdbf640 1 --2- 172.21.15.63:0/1234996841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca804390 0x55e0cabd4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:09.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.796+0000 7f4f4ddc1640 1 --2- 172.21.15.63:0/1234996841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca7fc1b0 0x55e0cabcda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:09.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.796+0000 7f4f4ddc1640 1 -- 172.21.15.63:0/1234996841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca804390 msgr2=0x55e0cabd4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:09.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.796+0000 7f4f4ddc1640 1 --2- 172.21.15.63:0/1234996841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca804390 0x55e0cabd4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.796+0000 7f4f4ddc1640 1 -- 172.21.15.63:0/1234996841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca7fc1b0 msgr2=0x55e0cabcda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:09.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.796+0000 7f4f4ddc1640 1 --2- 172.21.15.63:0/1234996841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca7fc1b0 0x55e0cabcda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.796+0000 7f4f4ddc1640 1 -- 172.21.15.63:0/1234996841 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0cabd8ca0 con 0x55e0ca825070 2024-09-21T06:32:09.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.796+0000 7f4f4cdbf640 1 --2- 172.21.15.63:0/1234996841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca804390 0x55e0cabd4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:09.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.797+0000 7f4f4ddc1640 1 --2- 172.21.15.63:0/1234996841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 0x55e0cabd5110 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4f40005d50 tx=0x7f4f4000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9065bc0fccdb7e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.797+0000 7f4f32ffd640 1 -- 172.21.15.63:0/1234996841 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f40034070 con 0x55e0ca825070 2024-09-21T06:32:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.797+0000 7f4f32ffd640 1 -- 172.21.15.63:0/1234996841 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f4000e070 con 0x55e0ca825070 2024-09-21T06:32:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.797+0000 7f4f32ffd640 1 -- 172.21.15.63:0/1234996841 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f40028950 con 0x55e0ca825070 2024-09-21T06:32:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.798+0000 7f4f55d98740 1 -- 172.21.15.63:0/1234996841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 msgr2=0x55e0cabd5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.798+0000 7f4f55d98740 1 --2- 172.21.15.63:0/1234996841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 0x55e0cabd5110 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4f40005d50 tx=0x7f4f4000ebc0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.798+0000 7f4f55d98740 1 -- 172.21.15.63:0/1234996841 shutdown_connections 2024-09-21T06:32:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.798+0000 7f4f55d98740 1 --2- 172.21.15.63:0/1234996841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 0x55e0cabd5110 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.798+0000 7f4f55d98740 1 --2- 172.21.15.63:0/1234996841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca804390 0x55e0cabd4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.798+0000 7f4f55d98740 1 --2- 172.21.15.63:0/1234996841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca7fc1b0 0x55e0cabcda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.798+0000 7f4f55d98740 1 -- 172.21.15.63:0/1234996841 >> 172.21.15.63:0/1234996841 conn(0x55e0ca819460 msgr2=0x55e0cabcd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.798+0000 7f4f55d98740 1 -- 172.21.15.63:0/1234996841 shutdown_connections 2024-09-21T06:32:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.798+0000 7f4f55d98740 1 -- 172.21.15.63:0/1234996841 wait complete. 2024-09-21T06:32:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.798+0000 7f4f55d98740 1 -- start start 2024-09-21T06:32:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.798+0000 7f4f55d98740 1 Processor -- start 2024-09-21T06:32:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.799+0000 7f4f55d98740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca7fc1b0 0x55e0cabec720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.799+0000 7f4f55d98740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca804390 0x55e0cabeccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.799+0000 7f4f55d98740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 0x55e0cac4c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.799+0000 7f4f55d98740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4f481b2ec0 con 0x55e0ca825070 2024-09-21T06:32:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.799+0000 7f4f55d98740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4f481b27f0 con 0x55e0ca804390 2024-09-21T06:32:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.799+0000 7f4f55d98740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4f481af970 con 0x55e0ca7fc1b0 2024-09-21T06:32:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.799+0000 7f4f55d98740 10 client.0 _ll_register_callbacks cb 0x7f4f4001b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.799+0000 7f4f4ddc1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 0x55e0cac4c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:09.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.799+0000 7f4f4ddc1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 0x55e0cac4c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43588/0 (socket says 172.21.15.63:43588) 2024-09-21T06:32:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.799+0000 7f4f4ddc1640 1 -- 172.21.15.63:0/2953173795 learned_addr learned my addr 172.21.15.63:0/2953173795 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.799+0000 7f4f4cdbf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca804390 0x55e0cabeccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.799+0000 7f4f4ddc1640 1 --2- 172.21.15.63:0/2953173795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca7fc1b0 0x55e0cabec720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.799+0000 7f4f4cdbf640 1 -- 172.21.15.63:0/2953173795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca7fc1b0 msgr2=0x55e0cabec720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.799+0000 7f4f4cdbf640 1 --2- 172.21.15.63:0/2953173795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca7fc1b0 0x55e0cabec720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.799+0000 7f4f4cdbf640 1 -- 172.21.15.63:0/2953173795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 msgr2=0x55e0cac4c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.799+0000 7f4f4cdbf640 1 --2- 172.21.15.63:0/2953173795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 0x55e0cac4c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.799+0000 7f4f4cdbf640 1 -- 172.21.15.63:0/2953173795 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0cac4ca90 con 0x55e0ca804390 2024-09-21T06:32:09.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.799+0000 7f4f4ddc1640 1 --2- 172.21.15.63:0/2953173795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 0x55e0cac4c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.800+0000 7f4f4cdbf640 1 --2- 172.21.15.63:0/2953173795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca804390 0x55e0cabeccc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55e0cabdabb0 tx=0x7f4f38009f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a2300f1d79b6e99 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.800+0000 7f4f30ff9640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:32:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.800+0000 7f4f30ff9640 1 -- 172.21.15.63:0/2953173795 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f38004230 con 0x55e0ca804390 2024-09-21T06:32:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.800+0000 7f4f55d98740 1 -- 172.21.15.63:0/2953173795 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f4000e070 con 0x55e0ca804390 2024-09-21T06:32:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.800+0000 7f4f30ff9640 1 -- 172.21.15.63:0/2953173795 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f4f380043d0 con 0x55e0ca804390 2024-09-21T06:32:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.800+0000 7f4f30ff9640 1 -- 172.21.15.63:0/2953173795 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f4f380035f0 con 0x55e0ca804390 2024-09-21T06:32:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.800+0000 7f4f55d98740 10 client.26027 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.800+0000 7f4f55d98740 1 -- 172.21.15.63:0/2953173795 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55e0cac53ee0 con 0x55e0ca804390 2024-09-21T06:32:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.800+0000 7f4f30ff9640 1 -- 172.21.15.63:0/2953173795 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f4000e070 con 0x55e0ca804390 2024-09-21T06:32:09.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.801+0000 7f4f30ff9640 1 -- 172.21.15.63:0/2953173795 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f4f3802e7c0 con 0x55e0ca804390 2024-09-21T06:32:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.801+0000 7f4f55d98740 10 client.26027 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.801+0000 7f4f55d98740 10 client.26027 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:32:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.801+0000 7f4f55d98740 20 client.26027 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.801+0000 7f4f55d98740 1 --2- 172.21.15.63:0/2953173795 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55e0ca7b8da0 0x55e0cac566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.801+0000 7f4f55d98740 4 client.26027 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:32:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.801+0000 7f4f55d98740 1 -- 172.21.15.63:0/2953173795 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e0cab408a0 con 0x55e0ca7b8da0 2024-09-21T06:32:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.801+0000 7f4f4ddc1640 1 --2- 172.21.15.63:0/2953173795 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55e0ca7b8da0 0x55e0cac566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.801+0000 7f4f30ff9640 10 client.26027 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:32:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.801+0000 7f4f4ddc1640 1 --2- 172.21.15.63:0/2953173795 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55e0ca7b8da0 0x55e0cac566f0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3e82cc82007666ff server_cookie=31b448769f324c09 in_seq=0 out_seq=0 2024-09-21T06:32:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.802+0000 7f4f30ff9640 1 -- 172.21.15.63:0/2953173795 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e0cab408a0 con 0x55e0ca7b8da0 2024-09-21T06:32:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.802+0000 7f4f30ff9640 10 client.26027 handle_command_reply: tid=0 2024-09-21T06:32:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.802+0000 7f4f55d98740 1 client.26027 shutdown 2024-09-21T06:32:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.802+0000 7f4f55d98740 1 -- 172.21.15.63:0/2953173795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca804390 msgr2=0x55e0cabeccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.802+0000 7f4f55d98740 1 --2- 172.21.15.63:0/2953173795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca804390 0x55e0cabeccc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55e0cabdabb0 tx=0x7f4f38009f80 comp rx=0 tx=0).stop 2024-09-21T06:32:09.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.803+0000 7f4f55d98740 1 -- 172.21.15.63:0/2953173795 shutdown_connections 2024-09-21T06:32:09.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.803+0000 7f4f55d98740 1 --2- 172.21.15.63:0/2953173795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e0ca825070 0x55e0cac4c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.803+0000 7f4f55d98740 1 --2- 172.21.15.63:0/2953173795 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55e0ca7b8da0 0x55e0cac566f0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.803+0000 7f4f55d98740 1 --2- 172.21.15.63:0/2953173795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0ca804390 0x55e0cabeccc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.803+0000 7f4f30ff9640 0 client.26027 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:32:09.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.803+0000 7f4f55d98740 1 --2- 172.21.15.63:0/2953173795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ca7fc1b0 0x55e0cabec720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.803+0000 7f4f55d98740 1 -- 172.21.15.63:0/2953173795 >> 172.21.15.63:0/2953173795 conn(0x55e0ca819460 msgr2=0x55e0cabd8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:09.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.803+0000 7f4f55d98740 1 -- 172.21.15.63:0/2953173795 shutdown_connections 2024-09-21T06:32:09.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.803+0000 7f4f55d98740 1 -- 172.21.15.63:0/2953173795 wait complete. 2024-09-21T06:32:09.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.804+0000 7f4f55d98740 20 client.26027 trim_cache size 0 max 16384 2024-09-21T06:32:09.808 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:32:09.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.804+0000 7f4f4f824640 1 -- 172.21.15.63:0/1046615115 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4f340b6680 msgr2=0x7f4f340b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:09.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.804+0000 7f4f4f824640 1 --2- 172.21.15.63:0/1046615115 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4f340b6680 0x7f4f340b8b90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4f44104940 tx=0x7f4f4410acb0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.804+0000 7f4f4f824640 1 -- 172.21.15.63:0/1046615115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f481049b0 msgr2=0x7f4f4819c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:09.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.804+0000 7f4f4f824640 1 --2- 172.21.15.63:0/1046615115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f481049b0 0x7f4f4819c700 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4f44035040 tx=0x7f4f44032d50 comp rx=0 tx=0).stop 2024-09-21T06:32:09.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.804+0000 7f4f4f824640 1 -- 172.21.15.63:0/1046615115 shutdown_connections 2024-09-21T06:32:09.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.804+0000 7f4f4f824640 1 --2- 172.21.15.63:0/1046615115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f4810de10 0x7f4f481a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.805+0000 7f4f4f824640 1 --2- 172.21.15.63:0/1046615115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f48105300 0x7f4f4819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.805+0000 7f4f4f824640 1 --2- 172.21.15.63:0/1046615115 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4f340b6680 0x7f4f340b8b90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.805+0000 7f4f4f824640 1 --2- 172.21.15.63:0/1046615115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f481049b0 0x7f4f4819c700 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:09.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.805+0000 7f4f4f824640 1 -- 172.21.15.63:0/1046615115 >> 172.21.15.63:0/1046615115 conn(0x7f4f48079730 msgr2=0x7f4f4810ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:09.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.805+0000 7f4f4f824640 1 -- 172.21.15.63:0/1046615115 shutdown_connections 2024-09-21T06:32:09.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:09.805+0000 7f4f4f824640 1 -- 172.21.15.63:0/1046615115 wait complete. 2024-09-21T06:32:09.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:09 smithi175 ceph-mon[34510]: pgmap v441: 97 pgs: 97 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.8 MiB/s wr, 817 op/s 2024-09-21T06:32:10.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:09 smithi071 ceph-mon[34844]: pgmap v441: 97 pgs: 97 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.8 MiB/s wr, 817 op/s 2024-09-21T06:32:10.703 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:32:10.988 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:32:11.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.511+0000 7f063def4640 1 -- 172.21.15.63:0/3613149122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0638108cf0 msgr2=0x7f063810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:11.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.511+0000 7f063def4640 1 --2- 172.21.15.63:0/3613149122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0638108cf0 0x7f063810f520 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0630009ca0 tx=0x7f063002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.511+0000 7f063def4640 1 -- 172.21.15.63:0/3613149122 shutdown_connections 2024-09-21T06:32:11.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.511+0000 7f063def4640 1 --2- 172.21.15.63:0/3613149122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0638108cf0 0x7f063810f520 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.511+0000 7f063def4640 1 --2- 172.21.15.63:0/3613149122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06381083a0 0x7f06381087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.511+0000 7f063def4640 1 --2- 172.21.15.63:0/3613149122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0638102a60 0x7f0638102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.511+0000 7f063def4640 1 -- 172.21.15.63:0/3613149122 >> 172.21.15.63:0/3613149122 conn(0x7f0638079730 msgr2=0x7f0638079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:11.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.511+0000 7f063def4640 1 -- 172.21.15.63:0/3613149122 shutdown_connections 2024-09-21T06:32:11.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.511+0000 7f063def4640 1 -- 172.21.15.63:0/3613149122 wait complete. 2024-09-21T06:32:11.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.512+0000 7f063def4640 1 Processor -- start 2024-09-21T06:32:11.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.512+0000 7f063def4640 1 -- start start 2024-09-21T06:32:11.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.513+0000 7f063def4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0638102a60 0x7f063819b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:11.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.513+0000 7f063def4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06381083a0 0x7f063819b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:11.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.513+0000 7f063def4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0638108cf0 0x7f063819bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:11.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.513+0000 7f063def4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0638112960 con 0x7f06381083a0 2024-09-21T06:32:11.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.513+0000 7f063def4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f06381127e0 con 0x7f0638108cf0 2024-09-21T06:32:11.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.513+0000 7f063def4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0638112ae0 con 0x7f0638102a60 2024-09-21T06:32:11.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.513+0000 7f0636ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06381083a0 0x7f063819b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:11.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.513+0000 7f0636ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06381083a0 0x7f063819b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43604/0 (socket says 172.21.15.63:43604) 2024-09-21T06:32:11.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.513+0000 7f06377fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0638102a60 0x7f063819b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:11.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.513+0000 7f0636ffd640 1 -- 172.21.15.63:0/811375726 learned_addr learned my addr 172.21.15.63:0/811375726 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:11.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.513+0000 7f0637fff640 1 --2- 172.21.15.63:0/811375726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0638108cf0 0x7f063819bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:11.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.513+0000 7f0637fff640 1 -- 172.21.15.63:0/811375726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0638102a60 msgr2=0x7f063819b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:11.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.513+0000 7f0637fff640 1 --2- 172.21.15.63:0/811375726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0638102a60 0x7f063819b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.513+0000 7f0637fff640 1 -- 172.21.15.63:0/811375726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06381083a0 msgr2=0x7f063819b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:11.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.513+0000 7f0637fff640 1 --2- 172.21.15.63:0/811375726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06381083a0 0x7f063819b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.513+0000 7f0637fff640 1 -- 172.21.15.63:0/811375726 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06381a6520 con 0x7f0638108cf0 2024-09-21T06:32:11.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.513+0000 7f0636ffd640 1 --2- 172.21.15.63:0/811375726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06381083a0 0x7f063819b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:11.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.513+0000 7f06377fe640 1 --2- 172.21.15.63:0/811375726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0638102a60 0x7f063819b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:11.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.514+0000 7f0637fff640 1 --2- 172.21.15.63:0/811375726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0638108cf0 0x7f063819bc90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f063002ade0 tx=0x7f06300316f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:11.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.514+0000 7f0634ff9640 1 -- 172.21.15.63:0/811375726 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0630003b70 con 0x7f0638108cf0 2024-09-21T06:32:11.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.514+0000 7f063def4640 1 -- 172.21.15.63:0/811375726 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06381a67b0 con 0x7f0638108cf0 2024-09-21T06:32:11.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.514+0000 7f0634ff9640 1 -- 172.21.15.63:0/811375726 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0630003d10 con 0x7f0638108cf0 2024-09-21T06:32:11.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.514+0000 7f0634ff9640 1 -- 172.21.15.63:0/811375726 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063002f9e0 con 0x7f0638108cf0 2024-09-21T06:32:11.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.514+0000 7f063def4640 1 -- 172.21.15.63:0/811375726 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06381a6d40 con 0x7f0638108cf0 2024-09-21T06:32:11.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.517+0000 7f0644468740 1 Processor -- start 2024-09-21T06:32:11.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.517+0000 7f0634ff9640 1 -- 172.21.15.63:0/811375726 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f063002fb80 con 0x7f0638108cf0 2024-09-21T06:32:11.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.517+0000 7f0644468740 1 -- start start 2024-09-21T06:32:11.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.518+0000 7f0644468740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a842c070 0x55f6a87d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:11.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.518+0000 7f0644468740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a84031b0 0x55f6a87d3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:11.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.518+0000 7f0644468740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a840b390 0x55f6a87d3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:11.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.518+0000 7f0644468740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f6a8749ea0 con 0x55f6a842c070 2024-09-21T06:32:11.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.518+0000 7f0644468740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f6a87392d0 con 0x55f6a84031b0 2024-09-21T06:32:11.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.518+0000 7f0644468740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f6a873d0e0 con 0x55f6a840b390 2024-09-21T06:32:11.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.518+0000 7f0636ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a842c070 0x55f6a87d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:11.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.518+0000 7f0636ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a842c070 0x55f6a87d32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43608/0 (socket says 172.21.15.63:43608) 2024-09-21T06:32:11.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.518+0000 7f0636ffd640 1 -- 172.21.15.63:0/2427061189 learned_addr learned my addr 172.21.15.63:0/2427061189 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:11.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.518+0000 7f0636ffd640 1 --2- 172.21.15.63:0/2427061189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a840b390 0x55f6a87d3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:11.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.518+0000 7f06377fe640 1 --2- 172.21.15.63:0/2427061189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a84031b0 0x55f6a87d3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:11.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.518+0000 7f0636ffd640 1 -- 172.21.15.63:0/2427061189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a840b390 msgr2=0x55f6a87d3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:11.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.518+0000 7f0636ffd640 1 --2- 172.21.15.63:0/2427061189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a840b390 0x55f6a87d3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.518+0000 7f0636ffd640 1 -- 172.21.15.63:0/2427061189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a84031b0 msgr2=0x55f6a87d3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:11.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.518+0000 7f0636ffd640 1 --2- 172.21.15.63:0/2427061189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a84031b0 0x55f6a87d3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.518+0000 7f0636ffd640 1 -- 172.21.15.63:0/2427061189 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6a8497650 con 0x55f6a842c070 2024-09-21T06:32:11.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.519+0000 7f06377fe640 1 --2- 172.21.15.63:0/2427061189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a84031b0 0x55f6a87d3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:11.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.519+0000 7f0636ffd640 1 --2- 172.21.15.63:0/2427061189 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a842c070 0x55f6a87d32c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f062c012c00 tx=0x7f062c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb7215fa1079e30 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:11.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.519+0000 7f0634ff9640 1 --2- 172.21.15.63:0/811375726 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f06200b6680 0x7f06200b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:11.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.519+0000 7f06377fe640 1 --2- 172.21.15.63:0/811375726 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f06200b6680 0x7f06200b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:11.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.519+0000 7f0634ff9640 1 -- 172.21.15.63:0/811375726 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f0630108840 con 0x7f0638108cf0 2024-09-21T06:32:11.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.520+0000 7f06377fe640 1 --2- 172.21.15.63:0/811375726 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f06200b6680 0x7f06200b8b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0628009fd0 tx=0x7f0628005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:11.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.523+0000 7f061dffb640 1 -- 172.21.15.63:0/2427061189 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c012cf0 con 0x55f6a842c070 2024-09-21T06:32:11.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.523+0000 7f061dffb640 1 -- 172.21.15.63:0/2427061189 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f062c0054d0 con 0x55f6a842c070 2024-09-21T06:32:11.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.523+0000 7f061dffb640 1 -- 172.21.15.63:0/2427061189 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c004a80 con 0x55f6a842c070 2024-09-21T06:32:11.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.524+0000 7f0644468740 1 -- 172.21.15.63:0/2427061189 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a842c070 msgr2=0x55f6a87d32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:11.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.524+0000 7f0644468740 1 --2- 172.21.15.63:0/2427061189 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a842c070 0x55f6a87d32c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f062c012c00 tx=0x7f062c00bbe0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.524+0000 7f0644468740 1 -- 172.21.15.63:0/2427061189 shutdown_connections 2024-09-21T06:32:11.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.524+0000 7f0644468740 1 --2- 172.21.15.63:0/2427061189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a840b390 0x55f6a87d3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.524+0000 7f0644468740 1 --2- 172.21.15.63:0/2427061189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a84031b0 0x55f6a87d3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.524+0000 7f0644468740 1 --2- 172.21.15.63:0/2427061189 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a842c070 0x55f6a87d32c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.524+0000 7f0644468740 1 -- 172.21.15.63:0/2427061189 >> 172.21.15.63:0/2427061189 conn(0x55f6a8420460 msgr2=0x55f6a87d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:11.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.524+0000 7f0644468740 1 -- 172.21.15.63:0/2427061189 shutdown_connections 2024-09-21T06:32:11.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.524+0000 7f0644468740 1 -- 172.21.15.63:0/2427061189 wait complete. 2024-09-21T06:32:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.524+0000 7f0644468740 1 -- start start 2024-09-21T06:32:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.525+0000 7f0644468740 1 Processor -- start 2024-09-21T06:32:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.525+0000 7f0644468740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a84031b0 0x55f6a87dea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.525+0000 7f0644468740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a840b390 0x55f6a87def80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.525+0000 7f0644468740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a842c070 0x55f6a87ef140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.525+0000 7f0644468740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f6a859a700 con 0x55f6a84031b0 2024-09-21T06:32:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.525+0000 7f0644468740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f6a86d4160 con 0x55f6a840b390 2024-09-21T06:32:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.525+0000 7f0644468740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f6a87e5e50 con 0x55f6a842c070 2024-09-21T06:32:11.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.525+0000 7f0644468740 10 client.0 _ll_register_callbacks cb 0x55f6a86ed9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:11.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.525+0000 7f06377fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a84031b0 0x55f6a87dea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:11.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.525+0000 7f0636ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a840b390 0x55f6a87def80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:11.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.525+0000 7f06377fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a84031b0 0x55f6a87dea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43610/0 (socket says 172.21.15.63:43610) 2024-09-21T06:32:11.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.525+0000 7f06377fe640 1 -- 172.21.15.63:0/2936309380 learned_addr learned my addr 172.21.15.63:0/2936309380 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:11.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.525+0000 7f0636ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a840b390 0x55f6a87def80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:43612/0 (socket says 172.21.15.63:43612) 2024-09-21T06:32:11.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.525+0000 7f0637fff640 1 --2- 172.21.15.63:0/2936309380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a842c070 0x55f6a87ef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:11.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.526+0000 7f06377fe640 1 -- 172.21.15.63:0/2936309380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a842c070 msgr2=0x55f6a87ef140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:11.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.526+0000 7f06377fe640 1 --2- 172.21.15.63:0/2936309380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a842c070 0x55f6a87ef140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.526+0000 7f06377fe640 1 -- 172.21.15.63:0/2936309380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a840b390 msgr2=0x55f6a87def80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:11.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.526+0000 7f06377fe640 1 --2- 172.21.15.63:0/2936309380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a840b390 0x55f6a87def80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.526+0000 7f06377fe640 1 -- 172.21.15.63:0/2936309380 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6a8701c90 con 0x55f6a84031b0 2024-09-21T06:32:11.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.526+0000 7f0636ffd640 1 --2- 172.21.15.63:0/2936309380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a840b390 0x55f6a87def80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:32:11.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.526+0000 7f06377fe640 1 --2- 172.21.15.63:0/2936309380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a84031b0 0x55f6a87dea40 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0628012e90 tx=0x7f0628004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec24b31d0a7c770 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:11.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.526+0000 7f0616ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:32:11.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.526+0000 7f0616ffd640 1 -- 172.21.15.63:0/2936309380 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062800fe20 con 0x55f6a84031b0 2024-09-21T06:32:11.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.526+0000 7f0616ffd640 1 -- 172.21.15.63:0/2936309380 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f0628011b50 con 0x55f6a84031b0 2024-09-21T06:32:11.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.526+0000 7f0644468740 1 -- 172.21.15.63:0/2936309380 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f062c0054d0 con 0x55f6a84031b0 2024-09-21T06:32:11.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.526+0000 7f0616ffd640 1 -- 172.21.15.63:0/2936309380 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f0628011d50 con 0x55f6a84031b0 2024-09-21T06:32:11.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.526+0000 7f0644468740 10 client.16386 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:11.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.526+0000 7f0644468740 1 -- 172.21.15.63:0/2936309380 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55f6a87f1c20 con 0x55f6a84031b0 2024-09-21T06:32:11.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.527+0000 7f0616ffd640 1 -- 172.21.15.63:0/2936309380 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f062c0054d0 con 0x55f6a84031b0 2024-09-21T06:32:11.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.527+0000 7f0616ffd640 1 -- 172.21.15.63:0/2936309380 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f0628027070 con 0x55f6a84031b0 2024-09-21T06:32:11.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.527+0000 7f0644468740 10 client.16386 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:11.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.527+0000 7f0644468740 10 client.16386 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:32:11.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.527+0000 7f0644468740 20 client.16386 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:11.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.527+0000 7f0644468740 1 --2- 172.21.15.63:0/2936309380 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55f6a83ea9f0 0x55f6a87f51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:11.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.527+0000 7f0644468740 4 client.16386 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:32:11.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.527+0000 7f0644468740 1 -- 172.21.15.63:0/2936309380 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6a874bdf0 con 0x55f6a83ea9f0 2024-09-21T06:32:11.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.527+0000 7f0636ffd640 1 --2- 172.21.15.63:0/2936309380 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55f6a83ea9f0 0x55f6a87f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:11.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.528+0000 7f0616ffd640 10 client.16386 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:32:11.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.528+0000 7f0636ffd640 1 --2- 172.21.15.63:0/2936309380 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55f6a83ea9f0 0x55f6a87f51d0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bd724b32bf87a542 server_cookie=8fd7afae73417308 in_seq=0 out_seq=0 2024-09-21T06:32:11.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.529+0000 7f0616ffd640 1 -- 172.21.15.63:0/2936309380 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f6a874bdf0 con 0x55f6a83ea9f0 2024-09-21T06:32:11.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.529+0000 7f0616ffd640 10 client.16386 handle_command_reply: tid=0 2024-09-21T06:32:11.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.529+0000 7f0644468740 1 client.16386 shutdown 2024-09-21T06:32:11.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.529+0000 7f0644468740 1 -- 172.21.15.63:0/2936309380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a84031b0 msgr2=0x55f6a87dea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:11.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.529+0000 7f0644468740 1 --2- 172.21.15.63:0/2936309380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a84031b0 0x55f6a87dea40 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0628012e90 tx=0x7f0628004730 comp rx=0 tx=0).stop 2024-09-21T06:32:11.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.529+0000 7f0644468740 1 -- 172.21.15.63:0/2936309380 shutdown_connections 2024-09-21T06:32:11.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.529+0000 7f0644468740 1 --2- 172.21.15.63:0/2936309380 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55f6a83ea9f0 0x55f6a87f51d0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.529+0000 7f0644468740 1 --2- 172.21.15.63:0/2936309380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a842c070 0x55f6a87ef140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.529+0000 7f0644468740 1 --2- 172.21.15.63:0/2936309380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a840b390 0x55f6a87def80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.529+0000 7f0616ffd640 0 client.16386 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:32:11.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.529+0000 7f0644468740 1 --2- 172.21.15.63:0/2936309380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a84031b0 0x55f6a87dea40 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.529+0000 7f0644468740 1 -- 172.21.15.63:0/2936309380 >> 172.21.15.63:0/2936309380 conn(0x55f6a8420460 msgr2=0x55f6a87d64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:11.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.530+0000 7f0644468740 1 -- 172.21.15.63:0/2936309380 shutdown_connections 2024-09-21T06:32:11.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.530+0000 7f0644468740 1 -- 172.21.15.63:0/2936309380 wait complete. 2024-09-21T06:32:11.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.530+0000 7f0644468740 20 client.16386 trim_cache size 0 max 16384 2024-09-21T06:32:11.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.546+0000 7f0644468740 1 Processor -- start 2024-09-21T06:32:11.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.546+0000 7f0644468740 1 -- start start 2024-09-21T06:32:11.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.547+0000 7f0644468740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a84031b0 0x55f6a87d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:11.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.547+0000 7f0644468740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a840b390 0x55f6a87ef040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:11.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.547+0000 7f0644468740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a842c070 0x55f6a87ef580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:11.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.547+0000 7f0644468740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f06381ad4d0 con 0x55f6a84031b0 2024-09-21T06:32:11.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.547+0000 7f0644468740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f06381af0d0 con 0x55f6a840b390 2024-09-21T06:32:11.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.547+0000 7f0644468740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f06381adc60 con 0x55f6a842c070 2024-09-21T06:32:11.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.547+0000 7f06377fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a84031b0 0x55f6a87d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:11.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.547+0000 7f0636ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a840b390 0x55f6a87ef040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:11.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.547+0000 7f06377fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a84031b0 0x55f6a87d1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43620/0 (socket says 172.21.15.63:43620) 2024-09-21T06:32:11.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.547+0000 7f0637fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a842c070 0x55f6a87ef580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:11.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.547+0000 7f0636ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a840b390 0x55f6a87ef040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:43628/0 (socket says 172.21.15.63:43628) 2024-09-21T06:32:11.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.547+0000 7f06377fe640 1 -- 172.21.15.63:0/1523853973 learned_addr learned my addr 172.21.15.63:0/1523853973 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:11.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.547+0000 7f0636ffd640 1 -- 172.21.15.63:0/1523853973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a842c070 msgr2=0x55f6a87ef580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:11.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.547+0000 7f0636ffd640 1 --2- 172.21.15.63:0/1523853973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a842c070 0x55f6a87ef580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.547+0000 7f0636ffd640 1 -- 172.21.15.63:0/1523853973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a84031b0 msgr2=0x55f6a87d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:11.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.547+0000 7f0636ffd640 1 --2- 172.21.15.63:0/1523853973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a84031b0 0x55f6a87d1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.547+0000 7f0636ffd640 1 -- 172.21.15.63:0/1523853973 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6a87d1aa0 con 0x55f6a840b390 2024-09-21T06:32:11.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.547+0000 7f0637fff640 1 --2- 172.21.15.63:0/1523853973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a842c070 0x55f6a87ef580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:11.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.547+0000 7f06377fe640 1 --2- 172.21.15.63:0/1523853973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a84031b0 0x55f6a87d1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:11.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.548+0000 7f0636ffd640 1 --2- 172.21.15.63:0/1523853973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a840b390 0x55f6a87ef040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x55f6a87f5940 tx=0x7f062c010fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=461cbe93f9d6214c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:11.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.548+0000 7f061d7fa640 1 -- 172.21.15.63:0/1523853973 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c01f670 con 0x55f6a840b390 2024-09-21T06:32:11.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.548+0000 7f061d7fa640 1 -- 172.21.15.63:0/1523853973 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f062c016040 con 0x55f6a840b390 2024-09-21T06:32:11.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.548+0000 7f061d7fa640 1 -- 172.21.15.63:0/1523853973 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c0288a0 con 0x55f6a840b390 2024-09-21T06:32:11.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.549+0000 7f0644468740 1 -- 172.21.15.63:0/1523853973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a840b390 msgr2=0x55f6a87ef040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:11.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.549+0000 7f0644468740 1 --2- 172.21.15.63:0/1523853973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a840b390 0x55f6a87ef040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x55f6a87f5940 tx=0x7f062c010fa0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.549+0000 7f0644468740 1 -- 172.21.15.63:0/1523853973 shutdown_connections 2024-09-21T06:32:11.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.549+0000 7f0644468740 1 --2- 172.21.15.63:0/1523853973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a842c070 0x55f6a87ef580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.549+0000 7f0644468740 1 --2- 172.21.15.63:0/1523853973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a840b390 0x55f6a87ef040 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.549+0000 7f0644468740 1 --2- 172.21.15.63:0/1523853973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a84031b0 0x55f6a87d1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.549+0000 7f0644468740 1 -- 172.21.15.63:0/1523853973 >> 172.21.15.63:0/1523853973 conn(0x55f6a8420460 msgr2=0x55f6a87d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:11.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.549+0000 7f0644468740 1 -- 172.21.15.63:0/1523853973 shutdown_connections 2024-09-21T06:32:11.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.549+0000 7f0644468740 1 -- 172.21.15.63:0/1523853973 wait complete. 2024-09-21T06:32:11.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.549+0000 7f0644468740 1 -- start start 2024-09-21T06:32:11.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.549+0000 7f0644468740 1 Processor -- start 2024-09-21T06:32:11.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.550+0000 7f0644468740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a84031b0 0x55f6a87eb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:11.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.550+0000 7f0644468740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a840b390 0x55f6a87e6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:11.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.550+0000 7f0644468740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a842c070 0x55f6a87e7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:11.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.550+0000 7f0644468740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f06381aea00 con 0x55f6a842c070 2024-09-21T06:32:11.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.550+0000 7f0644468740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f06381ae330 con 0x55f6a840b390 2024-09-21T06:32:11.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.550+0000 7f0644468740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f06381ab4b0 con 0x55f6a84031b0 2024-09-21T06:32:11.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.550+0000 7f0637fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a842c070 0x55f6a87e7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:11.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.550+0000 7f0636ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a840b390 0x55f6a87e6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:11.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.550+0000 7f0644468740 10 client.0 _ll_register_callbacks cb 0x7f0628009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:11.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.550+0000 7f0637fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a842c070 0x55f6a87e7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43626/0 (socket says 172.21.15.63:43626) 2024-09-21T06:32:11.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.550+0000 7f0636ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a840b390 0x55f6a87e6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:43632/0 (socket says 172.21.15.63:43632) 2024-09-21T06:32:11.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.550+0000 7f0637fff640 1 -- 172.21.15.63:0/910484280 learned_addr learned my addr 172.21.15.63:0/910484280 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:11.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.550+0000 7f06377fe640 1 --2- 172.21.15.63:0/910484280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a84031b0 0x55f6a87eb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:11.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.550+0000 7f0637fff640 1 -- 172.21.15.63:0/910484280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a84031b0 msgr2=0x55f6a87eb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:11.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.550+0000 7f0637fff640 1 --2- 172.21.15.63:0/910484280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a84031b0 0x55f6a87eb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.550+0000 7f0637fff640 1 -- 172.21.15.63:0/910484280 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a840b390 msgr2=0x55f6a87e6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:11.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.550+0000 7f0637fff640 1 --2- 172.21.15.63:0/910484280 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a840b390 0x55f6a87e6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.550+0000 7f0637fff640 1 -- 172.21.15.63:0/910484280 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6a87e7c70 con 0x55f6a842c070 2024-09-21T06:32:11.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.551+0000 7f0637fff640 1 --2- 172.21.15.63:0/910484280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a842c070 0x55f6a87e7500 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0630105fd0 tx=0x7f06301064b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4defe9784c078b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:11.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.551+0000 7f0616ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:32:11.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.551+0000 7f0616ffd640 1 -- 172.21.15.63:0/910484280 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06300e9060 con 0x55f6a842c070 2024-09-21T06:32:11.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.551+0000 7f0616ffd640 1 -- 172.21.15.63:0/910484280 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f06300d7e10 con 0x55f6a842c070 2024-09-21T06:32:11.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.551+0000 7f0644468740 1 -- 172.21.15.63:0/910484280 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f062c016040 con 0x55f6a842c070 2024-09-21T06:32:11.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.551+0000 7f0616ffd640 1 -- 172.21.15.63:0/910484280 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f06300f0050 con 0x55f6a842c070 2024-09-21T06:32:11.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.551+0000 7f0644468740 10 client.16392 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:11.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.551+0000 7f0644468740 1 -- 172.21.15.63:0/910484280 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55f6a885fc90 con 0x55f6a842c070 2024-09-21T06:32:11.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.551+0000 7f0616ffd640 1 -- 172.21.15.63:0/910484280 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f062c016040 con 0x55f6a842c070 2024-09-21T06:32:11.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.551+0000 7f0616ffd640 1 -- 172.21.15.63:0/910484280 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f06300f01f0 con 0x55f6a842c070 2024-09-21T06:32:11.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.552+0000 7f0644468740 10 client.16392 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:11.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.552+0000 7f0644468740 10 client.16392 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:32:11.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.552+0000 7f0644468740 20 client.16392 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:11.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.552+0000 7f0644468740 1 --2- 172.21.15.63:0/910484280 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55f6a83bfda0 0x55f6a8862450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:11.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.552+0000 7f0644468740 4 client.16392 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:32:11.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.552+0000 7f0644468740 1 -- 172.21.15.63:0/910484280 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f6a87478a0 con 0x55f6a83bfda0 2024-09-21T06:32:11.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.552+0000 7f06377fe640 1 --2- 172.21.15.63:0/910484280 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55f6a83bfda0 0x55f6a8862450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:11.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.552+0000 7f0616ffd640 10 client.16392 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:32:11.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.553+0000 7f06377fe640 1 --2- 172.21.15.63:0/910484280 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55f6a83bfda0 0x55f6a8862450 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b32d0462544470f4 server_cookie=5ccdb24015adedf0 in_seq=0 out_seq=0 2024-09-21T06:32:11.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.553+0000 7f0616ffd640 1 -- 172.21.15.63:0/910484280 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f6a87478a0 con 0x55f6a83bfda0 2024-09-21T06:32:11.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.553+0000 7f0616ffd640 10 client.16392 handle_command_reply: tid=0 2024-09-21T06:32:11.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.553+0000 7f0644468740 1 client.16392 shutdown 2024-09-21T06:32:11.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.553+0000 7f0644468740 1 -- 172.21.15.63:0/910484280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a842c070 msgr2=0x55f6a87e7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:11.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.553+0000 7f0644468740 1 --2- 172.21.15.63:0/910484280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a842c070 0x55f6a87e7500 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0630105fd0 tx=0x7f06301064b0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.553+0000 7f0644468740 1 -- 172.21.15.63:0/910484280 shutdown_connections 2024-09-21T06:32:11.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.553+0000 7f0644468740 1 --2- 172.21.15.63:0/910484280 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55f6a83bfda0 0x55f6a8862450 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.553+0000 7f0644468740 1 --2- 172.21.15.63:0/910484280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f6a842c070 0x55f6a87e7500 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.553+0000 7f0644468740 1 --2- 172.21.15.63:0/910484280 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f6a840b390 0x55f6a87e6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.553+0000 7f0644468740 1 --2- 172.21.15.63:0/910484280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6a84031b0 0x55f6a87eb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.553+0000 7f0644468740 1 -- 172.21.15.63:0/910484280 >> 172.21.15.63:0/910484280 conn(0x55f6a8420460 msgr2=0x55f6a87d63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:11.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.554+0000 7f0616ffd640 0 client.16392 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:32:11.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.554+0000 7f0644468740 1 -- 172.21.15.63:0/910484280 shutdown_connections 2024-09-21T06:32:11.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.554+0000 7f0644468740 1 -- 172.21.15.63:0/910484280 wait complete. 2024-09-21T06:32:11.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.554+0000 7f0644468740 20 client.16392 trim_cache size 0 max 16384 2024-09-21T06:32:11.561 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:32:11.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.555+0000 7f063def4640 1 -- 172.21.15.63:0/811375726 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f06200b6680 msgr2=0x7f06200b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:11.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.555+0000 7f063def4640 1 --2- 172.21.15.63:0/811375726 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f06200b6680 0x7f06200b8b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0628009fd0 tx=0x7f0628005f90 comp rx=0 tx=0).stop 2024-09-21T06:32:11.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.555+0000 7f063def4640 1 -- 172.21.15.63:0/811375726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0638108cf0 msgr2=0x7f063819bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:11.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.555+0000 7f063def4640 1 --2- 172.21.15.63:0/811375726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0638108cf0 0x7f063819bc90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f063002ade0 tx=0x7f06300316f0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.555+0000 7f063def4640 1 -- 172.21.15.63:0/811375726 shutdown_connections 2024-09-21T06:32:11.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.555+0000 7f063def4640 1 --2- 172.21.15.63:0/811375726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0638108cf0 0x7f063819bc90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.555+0000 7f063def4640 1 --2- 172.21.15.63:0/811375726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06381083a0 0x7f063819b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.555+0000 7f063def4640 1 --2- 172.21.15.63:0/811375726 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f06200b6680 0x7f06200b8b90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.555+0000 7f063def4640 1 --2- 172.21.15.63:0/811375726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0638102a60 0x7f063819b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.555+0000 7f063def4640 1 -- 172.21.15.63:0/811375726 >> 172.21.15.63:0/811375726 conn(0x7f0638079730 msgr2=0x7f06381043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:11.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.555+0000 7f063def4640 1 -- 172.21.15.63:0/811375726 shutdown_connections 2024-09-21T06:32:11.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:11.555+0000 7f063def4640 1 -- 172.21.15.63:0/811375726 wait complete. 2024-09-21T06:32:11.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:11 smithi063 ceph-mon[31150]: pgmap v442: 97 pgs: 97 active+clean; 153 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 4.0 MiB/s wr, 703 op/s 2024-09-21T06:32:11.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:11 smithi175 ceph-mon[34510]: pgmap v442: 97 pgs: 97 active+clean; 153 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 4.0 MiB/s wr, 703 op/s 2024-09-21T06:32:12.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:11 smithi071 ceph-mon[34844]: pgmap v442: 97 pgs: 97 active+clean; 153 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 4.0 MiB/s wr, 703 op/s 2024-09-21T06:32:13.426 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:32:13.426 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:32:13.722 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:32:13.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:13 smithi063 ceph-mon[31150]: pgmap v443: 97 pgs: 97 active+clean; 153 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.4 MiB/s wr, 749 op/s 2024-09-21T06:32:13.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:13 smithi175 ceph-mon[34510]: pgmap v443: 97 pgs: 97 active+clean; 153 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.4 MiB/s wr, 749 op/s 2024-09-21T06:32:14.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:13 smithi071 ceph-mon[34844]: pgmap v443: 97 pgs: 97 active+clean; 153 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.4 MiB/s wr, 749 op/s 2024-09-21T06:32:14.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.241+0000 7f56b0723640 1 -- 172.21.15.63:0/3167210576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56a8103b80 msgr2=0x7f56a8103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:14.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.241+0000 7f56b0723640 1 --2- 172.21.15.63:0/3167210576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56a8103b80 0x7f56a8103f90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f56a4009900 tx=0x7f56a402a410 comp rx=0 tx=0).stop 2024-09-21T06:32:14.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.241+0000 7f56b0723640 1 -- 172.21.15.63:0/3167210576 shutdown_connections 2024-09-21T06:32:14.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.241+0000 7f56b0723640 1 --2- 172.21.15.63:0/3167210576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56a8109e10 0x7f56a8110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.241+0000 7f56b0723640 1 --2- 172.21.15.63:0/3167210576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56a81094c0 0x7f56a81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.241+0000 7f56b0723640 1 --2- 172.21.15.63:0/3167210576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56a8103b80 0x7f56a8103f90 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.241+0000 7f56b0723640 1 -- 172.21.15.63:0/3167210576 >> 172.21.15.63:0/3167210576 conn(0x7f56a80ff610 msgr2=0x7f56a8101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:14.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.241+0000 7f56b0723640 1 -- 172.21.15.63:0/3167210576 shutdown_connections 2024-09-21T06:32:14.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.241+0000 7f56b0723640 1 -- 172.21.15.63:0/3167210576 wait complete. 2024-09-21T06:32:14.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.242+0000 7f56b0723640 1 Processor -- start 2024-09-21T06:32:14.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.242+0000 7f56b0723640 1 -- start start 2024-09-21T06:32:14.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.242+0000 7f56b0723640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56a8103b80 0x7f56a819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:14.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.242+0000 7f56b0723640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56a81094c0 0x7f56a819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:14.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.242+0000 7f56b0723640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56a8109e10 0x7f56a819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:14.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.242+0000 7f56b0723640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f56a8113ad0 con 0x7f56a8103b80 2024-09-21T06:32:14.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.242+0000 7f56b0723640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f56a8113950 con 0x7f56a8109e10 2024-09-21T06:32:14.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.242+0000 7f56b0723640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f56a8113c50 con 0x7f56a81094c0 2024-09-21T06:32:14.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.242+0000 7f56ae4bf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56a8103b80 0x7f56a819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:14.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.242+0000 7f56adcbe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56a81094c0 0x7f56a819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:14.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.242+0000 7f56ae4bf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56a8103b80 0x7f56a819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43634/0 (socket says 172.21.15.63:43634) 2024-09-21T06:32:14.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.242+0000 7f56ae4bf640 1 -- 172.21.15.63:0/3063038022 learned_addr learned my addr 172.21.15.63:0/3063038022 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:14.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.242+0000 7f56adcbe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56a81094c0 0x7f56a819aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:41446/0 (socket says 172.21.15.63:41446) 2024-09-21T06:32:14.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.242+0000 7f56aecc0640 1 --2- 172.21.15.63:0/3063038022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56a8109e10 0x7f56a819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:14.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.243+0000 7f56adcbe640 1 -- 172.21.15.63:0/3063038022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56a8109e10 msgr2=0x7f56a819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:14.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.243+0000 7f56adcbe640 1 --2- 172.21.15.63:0/3063038022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56a8109e10 0x7f56a819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.243+0000 7f56adcbe640 1 -- 172.21.15.63:0/3063038022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56a8103b80 msgr2=0x7f56a819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:14.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.243+0000 7f56adcbe640 1 --2- 172.21.15.63:0/3063038022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56a8103b80 0x7f56a819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.243+0000 7f56adcbe640 1 -- 172.21.15.63:0/3063038022 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a81a0430 con 0x7f56a81094c0 2024-09-21T06:32:14.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.243+0000 7f56ae4bf640 1 --2- 172.21.15.63:0/3063038022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56a8103b80 0x7f56a819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:14.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.243+0000 7f56adcbe640 1 --2- 172.21.15.63:0/3063038022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56a81094c0 0x7f56a819aa60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f56a806aa90 tx=0x7f569800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:14.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.243+0000 7f569f7fe640 1 -- 172.21.15.63:0/3063038022 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569800cc40 con 0x7f56a81094c0 2024-09-21T06:32:14.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.243+0000 7f569f7fe640 1 -- 172.21.15.63:0/3063038022 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f569800cde0 con 0x7f56a81094c0 2024-09-21T06:32:14.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.243+0000 7f56b0723640 1 -- 172.21.15.63:0/3063038022 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56a81a0720 con 0x7f56a81094c0 2024-09-21T06:32:14.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.243+0000 7f569f7fe640 1 -- 172.21.15.63:0/3063038022 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5698004a00 con 0x7f56a81094c0 2024-09-21T06:32:14.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.244+0000 7f56b0723640 1 -- 172.21.15.63:0/3063038022 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56a81a6e80 con 0x7f56a81094c0 2024-09-21T06:32:14.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.247+0000 7f56b6c97740 1 Processor -- start 2024-09-21T06:32:14.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.247+0000 7f56b6c97740 1 -- start start 2024-09-21T06:32:14.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.247+0000 7f56b6c97740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c6d350 0x557222014430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:14.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.248+0000 7f56b6c97740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c44490 0x557222014970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:14.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.248+0000 7f56b6c97740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c4c670 0x557222014eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:14.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.248+0000 7f569f7fe640 1 -- 172.21.15.63:0/3063038022 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f5698004ba0 con 0x7f56a81094c0 2024-09-21T06:32:14.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.248+0000 7f56b6c97740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x557221f8ae60 con 0x557221c44490 2024-09-21T06:32:14.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.248+0000 7f56b6c97740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557221f7a290 con 0x557221c6d350 2024-09-21T06:32:14.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.248+0000 7f56b6c97740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557221f7e0a0 con 0x557221c4c670 2024-09-21T06:32:14.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.248+0000 7f56ae4bf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c44490 0x557222014970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:14.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.248+0000 7f56aecc0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c6d350 0x557222014430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:14.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.248+0000 7f56ae4bf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c44490 0x557222014970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43636/0 (socket says 172.21.15.63:43636) 2024-09-21T06:32:14.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.248+0000 7f56aecc0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c6d350 0x557222014430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:43658/0 (socket says 172.21.15.63:43658) 2024-09-21T06:32:14.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.248+0000 7f56ae4bf640 1 -- 172.21.15.63:0/1322225201 learned_addr learned my addr 172.21.15.63:0/1322225201 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:14.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.248+0000 7f56ae4bf640 1 -- 172.21.15.63:0/1322225201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c4c670 msgr2=0x557222014eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:32:14.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.248+0000 7f56ae4bf640 1 --2- 172.21.15.63:0/1322225201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c4c670 0x557222014eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.248+0000 7f56ae4bf640 1 -- 172.21.15.63:0/1322225201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c6d350 msgr2=0x557222014430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:14.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.248+0000 7f56ae4bf640 1 --2- 172.21.15.63:0/1322225201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c6d350 0x557222014430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.248+0000 7f56ae4bf640 1 -- 172.21.15.63:0/1322225201 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557221cd8930 con 0x557221c44490 2024-09-21T06:32:14.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.249+0000 7f56ae4bf640 1 --2- 172.21.15.63:0/1322225201 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c44490 0x557222014970 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f56a4000c00 tx=0x7f56a4005ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887c08726c2f6024 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:14.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.249+0000 7f569cff9640 1 -- 172.21.15.63:0/1322225201 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a4035040 con 0x557221c44490 2024-09-21T06:32:14.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.249+0000 7f569f7fe640 1 --2- 172.21.15.63:0/3063038022 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f56940b6680 0x7f56940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:14.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.249+0000 7f569cff9640 1 -- 172.21.15.63:0/1322225201 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56a4031820 con 0x557221c44490 2024-09-21T06:32:14.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.249+0000 7f569cff9640 1 -- 172.21.15.63:0/1322225201 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a4004a00 con 0x557221c44490 2024-09-21T06:32:14.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.249+0000 7f56aecc0640 1 --2- 172.21.15.63:0/3063038022 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f56940b6680 0x7f56940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:14.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.250+0000 7f569f7fe640 1 -- 172.21.15.63:0/3063038022 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f56980e76c0 con 0x7f56a81094c0 2024-09-21T06:32:14.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.250+0000 7f56b6c97740 1 -- 172.21.15.63:0/1322225201 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c44490 msgr2=0x557222014970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:14.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.250+0000 7f56aecc0640 1 --2- 172.21.15.63:0/3063038022 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f56940b6680 0x7f56940b8b90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f56a0005fd0 tx=0x7f56a0009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:14.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.250+0000 7f56b6c97740 1 --2- 172.21.15.63:0/1322225201 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c44490 0x557222014970 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f56a4000c00 tx=0x7f56a4005ed0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.251+0000 7f56b6c97740 1 -- 172.21.15.63:0/1322225201 shutdown_connections 2024-09-21T06:32:14.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.251+0000 7f56b6c97740 1 --2- 172.21.15.63:0/1322225201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c4c670 0x557222014eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.251+0000 7f56b6c97740 1 --2- 172.21.15.63:0/1322225201 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c44490 0x557222014970 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.251+0000 7f56b6c97740 1 --2- 172.21.15.63:0/1322225201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c6d350 0x557222014430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.251+0000 7f56b6c97740 1 -- 172.21.15.63:0/1322225201 >> 172.21.15.63:0/1322225201 conn(0x557221c61740 msgr2=0x557222012320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:14.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.251+0000 7f56b6c97740 1 -- 172.21.15.63:0/1322225201 shutdown_connections 2024-09-21T06:32:14.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.251+0000 7f56b6c97740 1 -- 172.21.15.63:0/1322225201 wait complete. 2024-09-21T06:32:14.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.251+0000 7f56b6c97740 1 -- start start 2024-09-21T06:32:14.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.251+0000 7f56b6c97740 1 Processor -- start 2024-09-21T06:32:14.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.252+0000 7f56b6c97740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c44490 0x557222020120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:14.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.252+0000 7f56b6c97740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c4c670 0x5572220206c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:14.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.252+0000 7f56b6c97740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c6d350 0x557222025e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:14.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.252+0000 7f56b6c97740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x557221ddb890 con 0x557221c6d350 2024-09-21T06:32:14.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.252+0000 7f56b6c97740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557221f14d40 con 0x557221c4c670 2024-09-21T06:32:14.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.252+0000 7f56b6c97740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557222022bb0 con 0x557221c44490 2024-09-21T06:32:14.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.252+0000 7f56b6c97740 10 client.0 _ll_register_callbacks cb 0x557221f78c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:14.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.252+0000 7f56aecc0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c6d350 0x557222025e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:14.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.252+0000 7f56adcbe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c4c670 0x5572220206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:14.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.252+0000 7f56adcbe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c4c670 0x5572220206c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:43672/0 (socket says 172.21.15.63:43672) 2024-09-21T06:32:14.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.252+0000 7f56aecc0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c6d350 0x557222025e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43642/0 (socket says 172.21.15.63:43642) 2024-09-21T06:32:14.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.252+0000 7f56adcbe640 1 -- 172.21.15.63:0/1512556541 learned_addr learned my addr 172.21.15.63:0/1512556541 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:14.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.252+0000 7f56ae4bf640 1 --2- 172.21.15.63:0/1512556541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c44490 0x557222020120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:14.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.252+0000 7f56adcbe640 1 -- 172.21.15.63:0/1512556541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c44490 msgr2=0x557222020120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:14.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.252+0000 7f56adcbe640 1 --2- 172.21.15.63:0/1512556541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c44490 0x557222020120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.252+0000 7f56adcbe640 1 -- 172.21.15.63:0/1512556541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c6d350 msgr2=0x557222025e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:14.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.252+0000 7f56adcbe640 1 --2- 172.21.15.63:0/1512556541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c6d350 0x557222025e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.252+0000 7f56adcbe640 1 -- 172.21.15.63:0/1512556541 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572220264b0 con 0x557221c4c670 2024-09-21T06:32:14.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.252+0000 7f56adcbe640 1 --2- 172.21.15.63:0/1512556541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c4c670 0x5572220206c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f56980e4e50 tx=0x7f56980a9450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c49fe756a9c09e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:14.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.252+0000 7f5691ffb640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:32:14.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.253+0000 7f5691ffb640 1 -- 172.21.15.63:0/1512556541 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569801c040 con 0x557221c4c670 2024-09-21T06:32:14.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.253+0000 7f56b6c97740 1 -- 172.21.15.63:0/1512556541 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56a4031820 con 0x557221c4c670 2024-09-21T06:32:14.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.253+0000 7f5691ffb640 1 -- 172.21.15.63:0/1512556541 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f56980a8e40 con 0x557221c4c670 2024-09-21T06:32:14.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.253+0000 7f5691ffb640 1 -- 172.21.15.63:0/1512556541 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f56980ad000 con 0x557221c4c670 2024-09-21T06:32:14.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.253+0000 7f56b6c97740 10 client.26057 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:14.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.253+0000 7f56b6c97740 1 -- 172.21.15.63:0/1512556541 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55722202eee0 con 0x557221c4c670 2024-09-21T06:32:14.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.253+0000 7f5691ffb640 1 -- 172.21.15.63:0/1512556541 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56a4031820 con 0x557221c4c670 2024-09-21T06:32:14.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.254+0000 7f5691ffb640 1 -- 172.21.15.63:0/1512556541 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f56980ac1c0 con 0x557221c4c670 2024-09-21T06:32:14.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.254+0000 7f56b6c97740 10 client.26057 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:14.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.254+0000 7f56b6c97740 10 client.26057 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:32:14.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.254+0000 7f56b6c97740 20 client.26057 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:14.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.254+0000 7f56b6c97740 1 --2- 172.21.15.63:0/1512556541 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x557221c2bcd0 0x557222032350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:14.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.254+0000 7f56b6c97740 4 client.26057 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:32:14.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.254+0000 7f56b6c97740 1 -- 172.21.15.63:0/1512556541 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557221f8cdb0 con 0x557221c2bcd0 2024-09-21T06:32:14.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.254+0000 7f56ae4bf640 1 --2- 172.21.15.63:0/1512556541 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x557221c2bcd0 0x557222032350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:14.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.255+0000 7f5691ffb640 10 client.26057 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:14.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.255+0000 7f56ae4bf640 1 --2- 172.21.15.63:0/1512556541 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x557221c2bcd0 0x557222032350 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba4d53fbec570722 server_cookie=45ac001fa7c975ab in_seq=0 out_seq=0 2024-09-21T06:32:14.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.255+0000 7f5691ffb640 1 -- 172.21.15.63:0/1512556541 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557221f8cdb0 con 0x557221c2bcd0 2024-09-21T06:32:14.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.255+0000 7f5691ffb640 10 client.26057 handle_command_reply: tid=0 2024-09-21T06:32:14.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.255+0000 7f56b6c97740 1 client.26057 shutdown 2024-09-21T06:32:14.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.255+0000 7f56b6c97740 1 -- 172.21.15.63:0/1512556541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c4c670 msgr2=0x5572220206c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:14.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.255+0000 7f56b6c97740 1 --2- 172.21.15.63:0/1512556541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c4c670 0x5572220206c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f56980e4e50 tx=0x7f56980a9450 comp rx=0 tx=0).stop 2024-09-21T06:32:14.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.256+0000 7f56b6c97740 1 -- 172.21.15.63:0/1512556541 shutdown_connections 2024-09-21T06:32:14.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.256+0000 7f56b6c97740 1 --2- 172.21.15.63:0/1512556541 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x557221c2bcd0 0x557222032350 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.256+0000 7f56b6c97740 1 --2- 172.21.15.63:0/1512556541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c6d350 0x557222025e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.256+0000 7f56b6c97740 1 --2- 172.21.15.63:0/1512556541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c4c670 0x5572220206c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.256+0000 7f5691ffb640 0 client.26057 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:14.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.256+0000 7f56b6c97740 1 --2- 172.21.15.63:0/1512556541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c44490 0x557222020120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.256+0000 7f56b6c97740 1 -- 172.21.15.63:0/1512556541 >> 172.21.15.63:0/1512556541 conn(0x557221c61740 msgr2=0x557222017610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:14.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.256+0000 7f56b6c97740 1 -- 172.21.15.63:0/1512556541 shutdown_connections 2024-09-21T06:32:14.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.256+0000 7f56b6c97740 1 -- 172.21.15.63:0/1512556541 wait complete. 2024-09-21T06:32:14.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.256+0000 7f56b6c97740 20 client.26057 trim_cache size 0 max 16384 2024-09-21T06:32:14.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.275+0000 7f56b6c97740 1 Processor -- start 2024-09-21T06:32:14.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.275+0000 7f56b6c97740 1 -- start start 2024-09-21T06:32:14.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.276+0000 7f56b6c97740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c44490 0x557222025de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:14.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.276+0000 7f56b6c97740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c4c670 0x557222019510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:14.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.276+0000 7f56b6c97740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c6d350 0x557222019a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:14.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.276+0000 7f56b6c97740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f56a81b1890 con 0x557221c4c670 2024-09-21T06:32:14.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.276+0000 7f56b6c97740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f56a81b3490 con 0x557221c6d350 2024-09-21T06:32:14.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.276+0000 7f56b6c97740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f56a81b2020 con 0x557221c44490 2024-09-21T06:32:14.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.276+0000 7f56adcbe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c4c670 0x557222019510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:14.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.276+0000 7f56ae4bf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c44490 0x557222025de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:14.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.276+0000 7f56adcbe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c4c670 0x557222019510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43644/0 (socket says 172.21.15.63:43644) 2024-09-21T06:32:14.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.276+0000 7f56adcbe640 1 -- 172.21.15.63:0/1599670596 learned_addr learned my addr 172.21.15.63:0/1599670596 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:14.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.276+0000 7f56ae4bf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c44490 0x557222025de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:41482/0 (socket says 172.21.15.63:41482) 2024-09-21T06:32:14.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.276+0000 7f56aecc0640 1 --2- 172.21.15.63:0/1599670596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c6d350 0x557222019a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:14.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.276+0000 7f56adcbe640 1 -- 172.21.15.63:0/1599670596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c44490 msgr2=0x557222025de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:14.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.276+0000 7f56adcbe640 1 --2- 172.21.15.63:0/1599670596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c44490 0x557222025de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.276+0000 7f56adcbe640 1 -- 172.21.15.63:0/1599670596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c6d350 msgr2=0x557222019a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:14.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.276+0000 7f56adcbe640 1 --2- 172.21.15.63:0/1599670596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c6d350 0x557222019a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.276+0000 7f56adcbe640 1 -- 172.21.15.63:0/1599670596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557222011a70 con 0x557221c4c670 2024-09-21T06:32:14.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.276+0000 7f56aecc0640 1 --2- 172.21.15.63:0/1599670596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c6d350 0x557222019a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:14.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.276+0000 7f56adcbe640 1 --2- 172.21.15.63:0/1599670596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c4c670 0x557222019510 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f56980ad1f0 tx=0x7f56980a94c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0f8b72c4da9924 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:14.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.277+0000 7f5693fff640 1 -- 172.21.15.63:0/1599670596 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56980cc070 con 0x557221c4c670 2024-09-21T06:32:14.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.277+0000 7f5693fff640 1 -- 172.21.15.63:0/1599670596 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56980adbf0 con 0x557221c4c670 2024-09-21T06:32:14.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.277+0000 7f5693fff640 1 -- 172.21.15.63:0/1599670596 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569801c070 con 0x557221c4c670 2024-09-21T06:32:14.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.278+0000 7f56b6c97740 1 -- 172.21.15.63:0/1599670596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c4c670 msgr2=0x557222019510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:14.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.278+0000 7f56b6c97740 1 --2- 172.21.15.63:0/1599670596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c4c670 0x557222019510 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f56980ad1f0 tx=0x7f56980a94c0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.278+0000 7f56b6c97740 1 -- 172.21.15.63:0/1599670596 shutdown_connections 2024-09-21T06:32:14.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.278+0000 7f56b6c97740 1 --2- 172.21.15.63:0/1599670596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c6d350 0x557222019a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.278+0000 7f56b6c97740 1 --2- 172.21.15.63:0/1599670596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c4c670 0x557222019510 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.278+0000 7f56b6c97740 1 --2- 172.21.15.63:0/1599670596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c44490 0x557222025de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.278+0000 7f56b6c97740 1 -- 172.21.15.63:0/1599670596 >> 172.21.15.63:0/1599670596 conn(0x557221c61740 msgr2=0x557222017ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:14.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.278+0000 7f56b6c97740 1 -- 172.21.15.63:0/1599670596 shutdown_connections 2024-09-21T06:32:14.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.278+0000 7f56b6c97740 1 -- 172.21.15.63:0/1599670596 wait complete. 2024-09-21T06:32:14.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.278+0000 7f56b6c97740 1 -- start start 2024-09-21T06:32:14.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.278+0000 7f56b6c97740 1 Processor -- start 2024-09-21T06:32:14.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.279+0000 7f56b6c97740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c44490 0x557222026de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:14.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.279+0000 7f56b6c97740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c4c670 0x557222027360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:14.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.279+0000 7f56b6c97740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c6d350 0x55722202bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:14.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.279+0000 7f56b6c97740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f56a81b2dc0 con 0x557221c4c670 2024-09-21T06:32:14.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.279+0000 7f56b6c97740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f56a81b26f0 con 0x557221c6d350 2024-09-21T06:32:14.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.279+0000 7f56b6c97740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f56a81af870 con 0x557221c44490 2024-09-21T06:32:14.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.279+0000 7f56b6c97740 10 client.0 _ll_register_callbacks cb 0x7f56980046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:14.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.279+0000 7f56adcbe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c4c670 0x557222027360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:14.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.279+0000 7f56ae4bf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c44490 0x557222026de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:14.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.279+0000 7f56ae4bf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c44490 0x557222026de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:41498/0 (socket says 172.21.15.63:41498) 2024-09-21T06:32:14.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.279+0000 7f56ae4bf640 1 -- 172.21.15.63:0/2735103127 learned_addr learned my addr 172.21.15.63:0/2735103127 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:14.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.279+0000 7f56adcbe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c4c670 0x557222027360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43652/0 (socket says 172.21.15.63:43652) 2024-09-21T06:32:14.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.279+0000 7f56aecc0640 1 --2- 172.21.15.63:0/2735103127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c6d350 0x55722202bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:14.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.279+0000 7f56adcbe640 1 -- 172.21.15.63:0/2735103127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c44490 msgr2=0x557222026de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:14.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.279+0000 7f56adcbe640 1 --2- 172.21.15.63:0/2735103127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c44490 0x557222026de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.279+0000 7f56adcbe640 1 -- 172.21.15.63:0/2735103127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c6d350 msgr2=0x55722202bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:14.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.279+0000 7f56adcbe640 1 --2- 172.21.15.63:0/2735103127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c6d350 0x55722202bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.279+0000 7f56adcbe640 1 -- 172.21.15.63:0/2735103127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55722202c240 con 0x557221c4c670 2024-09-21T06:32:14.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.279+0000 7f56ae4bf640 1 --2- 172.21.15.63:0/2735103127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c44490 0x557222026de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.280+0000 7f56adcbe640 1 --2- 172.21.15.63:0/2735103127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c4c670 0x557222027360 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x557222022490 tx=0x7f5698004f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e9c92bbf892b25 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.280+0000 7f5691ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:32:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.280+0000 7f5691ffb640 1 -- 172.21.15.63:0/2735103127 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56980cc070 con 0x557221c4c670 2024-09-21T06:32:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.280+0000 7f5691ffb640 1 -- 172.21.15.63:0/2735103127 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f56980c8d40 con 0x557221c4c670 2024-09-21T06:32:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.280+0000 7f56b6c97740 1 -- 172.21.15.63:0/2735103127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56980adbf0 con 0x557221c4c670 2024-09-21T06:32:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.280+0000 7f5691ffb640 1 -- 172.21.15.63:0/2735103127 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f569801c030 con 0x557221c4c670 2024-09-21T06:32:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.280+0000 7f56b6c97740 10 client.16410 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:14.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.280+0000 7f56b6c97740 1 -- 172.21.15.63:0/2735103127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55722202c240 con 0x557221c4c670 2024-09-21T06:32:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.280+0000 7f5691ffb640 1 -- 172.21.15.63:0/2735103127 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56980adbf0 con 0x557221c4c670 2024-09-21T06:32:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.280+0000 7f5691ffb640 1 -- 172.21.15.63:0/2735103127 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f56980b6450 con 0x557221c4c670 2024-09-21T06:32:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.281+0000 7f56b6c97740 10 client.16410 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.281+0000 7f56b6c97740 10 client.16410 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:32:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.281+0000 7f56b6c97740 20 client.16410 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.281+0000 7f56b6c97740 1 --2- 172.21.15.63:0/2735103127 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x557221c01080 0x55722209f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.281+0000 7f56b6c97740 4 client.16410 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:32:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.281+0000 7f56b6c97740 1 -- 172.21.15.63:0/2735103127 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557221f88860 con 0x557221c01080 2024-09-21T06:32:14.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.281+0000 7f56ae4bf640 1 --2- 172.21.15.63:0/2735103127 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x557221c01080 0x55722209f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.281+0000 7f56ae4bf640 1 --2- 172.21.15.63:0/2735103127 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x557221c01080 0x55722209f8a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=310170bd671c44d8 server_cookie=3b7a187aabd2c4dd in_seq=0 out_seq=0 2024-09-21T06:32:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.281+0000 7f5691ffb640 10 client.16410 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.283+0000 7f5691ffb640 1 -- 172.21.15.63:0/2735103127 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557221f88860 con 0x557221c01080 2024-09-21T06:32:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.283+0000 7f5691ffb640 10 client.16410 handle_command_reply: tid=0 2024-09-21T06:32:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.283+0000 7f56b6c97740 1 client.16410 shutdown 2024-09-21T06:32:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.283+0000 7f56b6c97740 1 -- 172.21.15.63:0/2735103127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c4c670 msgr2=0x557222027360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.283+0000 7f56b6c97740 1 --2- 172.21.15.63:0/2735103127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c4c670 0x557222027360 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x557222022490 tx=0x7f5698004f50 comp rx=0 tx=0).stop 2024-09-21T06:32:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.283+0000 7f56b6c97740 1 -- 172.21.15.63:0/2735103127 shutdown_connections 2024-09-21T06:32:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.283+0000 7f56b6c97740 1 --2- 172.21.15.63:0/2735103127 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x557221c01080 0x55722209f8a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.283+0000 7f56b6c97740 1 --2- 172.21.15.63:0/2735103127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557221c6d350 0x55722202bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.283+0000 7f56b6c97740 1 --2- 172.21.15.63:0/2735103127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557221c4c670 0x557222027360 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.283+0000 7f56b6c97740 1 --2- 172.21.15.63:0/2735103127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557221c44490 0x557222026de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.283+0000 7f56b6c97740 1 -- 172.21.15.63:0/2735103127 >> 172.21.15.63:0/2735103127 conn(0x557221c61740 msgr2=0x557222017ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:14.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.283+0000 7f5691ffb640 0 client.16410 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:14.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.283+0000 7f56b6c97740 1 -- 172.21.15.63:0/2735103127 shutdown_connections 2024-09-21T06:32:14.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.283+0000 7f56b6c97740 1 -- 172.21.15.63:0/2735103127 wait complete. 2024-09-21T06:32:14.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.283+0000 7f56b6c97740 20 client.16410 trim_cache size 0 max 16384 2024-09-21T06:32:14.289 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:32:14.289 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0, 2024-09-21T06:32:14.289 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_tag": "024d3c59-0b67-49a9-bf4a-e02d36691942", 2024-09-21T06:32:14.289 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": "asynchronous" 2024-09-21T06:32:14.290 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:32:14.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.284+0000 7f56b0723640 1 -- 172.21.15.63:0/3063038022 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f56940b6680 msgr2=0x7f56940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.284+0000 7f56b0723640 1 --2- 172.21.15.63:0/3063038022 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f56940b6680 0x7f56940b8b90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f56a0005fd0 tx=0x7f56a0009500 comp rx=0 tx=0).stop 2024-09-21T06:32:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.284+0000 7f56b0723640 1 -- 172.21.15.63:0/3063038022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56a81094c0 msgr2=0x7f56a819aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.284+0000 7f56b0723640 1 --2- 172.21.15.63:0/3063038022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56a81094c0 0x7f56a819aa60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f56a806aa90 tx=0x7f569800ee50 comp rx=0 tx=0).stop 2024-09-21T06:32:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.284+0000 7f56b0723640 1 -- 172.21.15.63:0/3063038022 shutdown_connections 2024-09-21T06:32:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.284+0000 7f56b0723640 1 --2- 172.21.15.63:0/3063038022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56a8109e10 0x7f56a819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.284+0000 7f56b0723640 1 --2- 172.21.15.63:0/3063038022 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f56940b6680 0x7f56940b8b90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.284+0000 7f56b0723640 1 --2- 172.21.15.63:0/3063038022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56a81094c0 0x7f56a819aa60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.284+0000 7f56b0723640 1 --2- 172.21.15.63:0/3063038022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56a8103b80 0x7f56a819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.284+0000 7f56b0723640 1 -- 172.21.15.63:0/3063038022 >> 172.21.15.63:0/3063038022 conn(0x7f56a80ff610 msgr2=0x7f56a8101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.284+0000 7f56b0723640 1 -- 172.21.15.63:0/3063038022 shutdown_connections 2024-09-21T06:32:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:14.284+0000 7f56b0723640 1 -- 172.21.15.63:0/3063038022 wait complete. 2024-09-21T06:32:14.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:14 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:32:14.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:14 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:14.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:14 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:32:14.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:14 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:15.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:14 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:32:15.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:14 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:15.286 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:32:15.600 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:32:15.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:15 smithi063 ceph-mon[31150]: pgmap v444: 97 pgs: 97 active+clean; 153 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 3.6 MiB/s wr, 625 op/s 2024-09-21T06:32:15.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:15 smithi063 ceph-mon[31150]: scrub queued for path: / 2024-09-21T06:32:15.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:15 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:15.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:15 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:32:15.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:15 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:32:15.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:15 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:15.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:15 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:32:15.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:15 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:15.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:15 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:32:15.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:15 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:32:15.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:15 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:32:15.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:15 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:15.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:15 smithi175 ceph-mon[34510]: pgmap v444: 97 pgs: 97 active+clean; 153 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 3.6 MiB/s wr, 625 op/s 2024-09-21T06:32:15.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:15 smithi175 ceph-mon[34510]: scrub queued for path: / 2024-09-21T06:32:15.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:15 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:15.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:15 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:32:15.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:15 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:32:15.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:15 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:15.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:15 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:32:15.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:15 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:15.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:15 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:32:15.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:15 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:32:15.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:15 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:32:15.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:15 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:16.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:15 smithi071 ceph-mon[34844]: pgmap v444: 97 pgs: 97 active+clean; 153 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 3.6 MiB/s wr, 625 op/s 2024-09-21T06:32:16.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:15 smithi071 ceph-mon[34844]: scrub queued for path: / 2024-09-21T06:32:16.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:15 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:16.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:15 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:32:16.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:15 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:32:16.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:15 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:16.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:15 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:32:16.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:15 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:16.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:15 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:32:16.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:15 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:32:16.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:15 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:32:16.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:15 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:16.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.292+0000 7f4bf4872640 1 -- 172.21.15.63:0/4277449844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf01083a0 msgr2=0x7f4bf01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:16.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.292+0000 7f4bf4872640 1 --2- 172.21.15.63:0/4277449844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf01083a0 0x7f4bf01087b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009900 tx=0x7f4be402a410 comp rx=0 tx=0).stop 2024-09-21T06:32:16.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.292+0000 7f4bf4872640 1 -- 172.21.15.63:0/4277449844 shutdown_connections 2024-09-21T06:32:16.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.292+0000 7f4bf4872640 1 --2- 172.21.15.63:0/4277449844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bf0108cf0 0x7f4bf010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.292+0000 7f4bf4872640 1 --2- 172.21.15.63:0/4277449844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf01083a0 0x7f4bf01087b0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.292+0000 7f4bf4872640 1 --2- 172.21.15.63:0/4277449844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bf0102a60 0x7f4bf0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.292+0000 7f4bf4872640 1 -- 172.21.15.63:0/4277449844 >> 172.21.15.63:0/4277449844 conn(0x7f4bf0079730 msgr2=0x7f4bf0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:16.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.293+0000 7f4bf4872640 1 -- 172.21.15.63:0/4277449844 shutdown_connections 2024-09-21T06:32:16.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.293+0000 7f4bf4872640 1 -- 172.21.15.63:0/4277449844 wait complete. 2024-09-21T06:32:16.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.294+0000 7f4bf4872640 1 Processor -- start 2024-09-21T06:32:16.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.294+0000 7f4bf4872640 1 -- start start 2024-09-21T06:32:16.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.294+0000 7f4bf4872640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bf0102a60 0x7f4bf00ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:16.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.294+0000 7f4bf4872640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf01083a0 0x7f4bf00ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:16.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.294+0000 7f4bf4872640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bf0108cf0 0x7f4bf01000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:16.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.294+0000 7f4bf4872640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf0112960 con 0x7f4bf01083a0 2024-09-21T06:32:16.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.294+0000 7f4bf4872640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf01127e0 con 0x7f4bf0102a60 2024-09-21T06:32:16.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.294+0000 7f4bf4872640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf0112ae0 con 0x7f4bf0108cf0 2024-09-21T06:32:16.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.294+0000 7f4bee59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bf0102a60 0x7f4bf00ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:16.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.294+0000 7f4bee59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bf0102a60 0x7f4bf00ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:43708/0 (socket says 172.21.15.63:43708) 2024-09-21T06:32:16.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.294+0000 7f4beed9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bf0108cf0 0x7f4bf01000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:16.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.294+0000 7f4bee59c640 1 -- 172.21.15.63:0/1082056976 learned_addr learned my addr 172.21.15.63:0/1082056976 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:16.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.294+0000 7f4bedd9b640 1 --2- 172.21.15.63:0/1082056976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf01083a0 0x7f4bf00ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:16.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.295+0000 7f4bee59c640 1 -- 172.21.15.63:0/1082056976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bf0108cf0 msgr2=0x7f4bf01000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:16.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.295+0000 7f4bee59c640 1 --2- 172.21.15.63:0/1082056976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bf0108cf0 0x7f4bf01000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.295+0000 7f4bee59c640 1 -- 172.21.15.63:0/1082056976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf01083a0 msgr2=0x7f4bf00ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:16.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.295+0000 7f4bee59c640 1 --2- 172.21.15.63:0/1082056976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf01083a0 0x7f4bf00ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.295+0000 7f4bee59c640 1 -- 172.21.15.63:0/1082056976 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf01a8740 con 0x7f4bf0102a60 2024-09-21T06:32:16.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.295+0000 7f4bee59c640 1 --2- 172.21.15.63:0/1082056976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bf0102a60 0x7f4bf00ff670 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4be000e9f0 tx=0x7f4be000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:16.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.295+0000 7f4bdf7fe640 1 -- 172.21.15.63:0/1082056976 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be000cd80 con 0x7f4bf0102a60 2024-09-21T06:32:16.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.295+0000 7f4bf4872640 1 -- 172.21.15.63:0/1082056976 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bf01a8a30 con 0x7f4bf0102a60 2024-09-21T06:32:16.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.295+0000 7f4bdf7fe640 1 -- 172.21.15.63:0/1082056976 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4be00108e0 con 0x7f4bf0102a60 2024-09-21T06:32:16.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.295+0000 7f4bdf7fe640 1 -- 172.21.15.63:0/1082056976 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be0018980 con 0x7f4bf0102a60 2024-09-21T06:32:16.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.295+0000 7f4bf4872640 1 -- 172.21.15.63:0/1082056976 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bf01a8f40 con 0x7f4bf0102a60 2024-09-21T06:32:16.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.298+0000 7f4bfade6740 1 Processor -- start 2024-09-21T06:32:16.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.298+0000 7f4bdf7fe640 1 -- 172.21.15.63:0/1082056976 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f4be0018b20 con 0x7f4bf0102a60 2024-09-21T06:32:16.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.298+0000 7f4bfade6740 1 -- start start 2024-09-21T06:32:16.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.299+0000 7f4bfade6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2eb4070 0x563ae325b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:16.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.299+0000 7f4bfade6740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2e8b1b0 0x563ae325b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:16.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.299+0000 7f4bfade6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2e93390 0x563ae325bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:16.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.299+0000 7f4bfade6740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563ae31d1e50 con 0x563ae2e8b1b0 2024-09-21T06:32:16.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.299+0000 7f4bfade6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563ae31c1280 con 0x563ae2eb4070 2024-09-21T06:32:16.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.299+0000 7f4bfade6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563ae31c5090 con 0x563ae2e93390 2024-09-21T06:32:16.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.299+0000 7f4bee59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2e8b1b0 0x563ae325b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:16.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.299+0000 7f4bee59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2e8b1b0 0x563ae325b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43682/0 (socket says 172.21.15.63:43682) 2024-09-21T06:32:16.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.299+0000 7f4bee59c640 1 -- 172.21.15.63:0/1641870491 learned_addr learned my addr 172.21.15.63:0/1641870491 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:16.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.299+0000 7f4bedd9b640 1 --2- 172.21.15.63:0/1641870491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2e93390 0x563ae325bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:16.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.299+0000 7f4beed9d640 1 --2- 172.21.15.63:0/1641870491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2eb4070 0x563ae325b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:16.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.299+0000 7f4bedd9b640 1 -- 172.21.15.63:0/1641870491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2eb4070 msgr2=0x563ae325b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:16.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.299+0000 7f4bedd9b640 1 --2- 172.21.15.63:0/1641870491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2eb4070 0x563ae325b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.299+0000 7f4bedd9b640 1 -- 172.21.15.63:0/1641870491 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2e8b1b0 msgr2=0x563ae325b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:16.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.300+0000 7f4bedd9b640 1 --2- 172.21.15.63:0/1641870491 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2e8b1b0 0x563ae325b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.300+0000 7f4bedd9b640 1 -- 172.21.15.63:0/1641870491 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ae2f1f650 con 0x563ae2e93390 2024-09-21T06:32:16.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.300+0000 7f4bedd9b640 1 --2- 172.21.15.63:0/1641870491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2e93390 0x563ae325bcf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4be4006010 tx=0x7f4be4032b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=749c8b06d06684e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:16.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.300+0000 7f4bdf7fe640 1 --2- 172.21.15.63:0/1082056976 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4bd80b6680 0x7f4bd80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:16.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.300+0000 7f4bdcff9640 1 -- 172.21.15.63:0/1641870491 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be4040070 con 0x563ae2e93390 2024-09-21T06:32:16.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.300+0000 7f4bdcff9640 1 -- 172.21.15.63:0/1641870491 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4be4004030 con 0x563ae2e93390 2024-09-21T06:32:16.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.300+0000 7f4beed9d640 1 --2- 172.21.15.63:0/1082056976 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4bd80b6680 0x7f4bd80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:16.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.300+0000 7f4bdf7fe640 1 -- 172.21.15.63:0/1082056976 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f4be00e7a70 con 0x7f4bf0102a60 2024-09-21T06:32:16.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.301+0000 7f4bdcff9640 1 -- 172.21.15.63:0/1641870491 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be4035040 con 0x563ae2e93390 2024-09-21T06:32:16.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.301+0000 7f4bfade6740 1 -- 172.21.15.63:0/1641870491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2e93390 msgr2=0x563ae325bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:16.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.301+0000 7f4beed9d640 1 --2- 172.21.15.63:0/1082056976 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4bd80b6680 0x7f4bd80b8b90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4be8005fd0 tx=0x7f4be8009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:16.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.301+0000 7f4bfade6740 1 --2- 172.21.15.63:0/1641870491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2e93390 0x563ae325bcf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4be4006010 tx=0x7f4be4032b20 comp rx=0 tx=0).stop 2024-09-21T06:32:16.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.301+0000 7f4bfade6740 1 -- 172.21.15.63:0/1641870491 shutdown_connections 2024-09-21T06:32:16.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.301+0000 7f4bfade6740 1 --2- 172.21.15.63:0/1641870491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2e93390 0x563ae325bcf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.301+0000 7f4bfade6740 1 --2- 172.21.15.63:0/1641870491 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2e8b1b0 0x563ae325b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.301+0000 7f4bfade6740 1 --2- 172.21.15.63:0/1641870491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2eb4070 0x563ae325b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.301+0000 7f4bfade6740 1 -- 172.21.15.63:0/1641870491 >> 172.21.15.63:0/1641870491 conn(0x563ae2ea8460 msgr2=0x563ae3259160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:16.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.301+0000 7f4bfade6740 1 -- 172.21.15.63:0/1641870491 shutdown_connections 2024-09-21T06:32:16.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.301+0000 7f4bfade6740 1 -- 172.21.15.63:0/1641870491 wait complete. 2024-09-21T06:32:16.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.302+0000 7f4bfade6740 1 -- start start 2024-09-21T06:32:16.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.302+0000 7f4bfade6740 1 Processor -- start 2024-09-21T06:32:16.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.302+0000 7f4bfade6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2e8b1b0 0x563ae32667d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:16.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.302+0000 7f4bfade6740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2e93390 0x563ae3266d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:16.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.302+0000 7f4bfade6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2eb4070 0x563ae3267250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:16.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.302+0000 7f4bfade6740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563ae3022700 con 0x563ae2e93390 2024-09-21T06:32:16.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.302+0000 7f4bfade6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563ae315c110 con 0x563ae2e8b1b0 2024-09-21T06:32:16.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.302+0000 7f4bfade6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563ae3269a90 con 0x563ae2eb4070 2024-09-21T06:32:16.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.302+0000 7f4bfade6740 10 client.0 _ll_register_callbacks cb 0x563ae3175990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:16.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.302+0000 7f4bee59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2e8b1b0 0x563ae32667d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:16.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.302+0000 7f4bedd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2e93390 0x563ae3266d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:16.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.302+0000 7f4bedd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2e93390 0x563ae3266d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43698/0 (socket says 172.21.15.63:43698) 2024-09-21T06:32:16.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.302+0000 7f4bee59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2e8b1b0 0x563ae32667d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:43718/0 (socket says 172.21.15.63:43718) 2024-09-21T06:32:16.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.302+0000 7f4bedd9b640 1 -- 172.21.15.63:0/2191491112 learned_addr learned my addr 172.21.15.63:0/2191491112 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:16.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.302+0000 7f4beed9d640 1 --2- 172.21.15.63:0/2191491112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2eb4070 0x563ae3267250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:16.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.303+0000 7f4bee59c640 1 -- 172.21.15.63:0/2191491112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2eb4070 msgr2=0x563ae3267250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:16.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.303+0000 7f4bee59c640 1 --2- 172.21.15.63:0/2191491112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2eb4070 0x563ae3267250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.303+0000 7f4bee59c640 1 -- 172.21.15.63:0/2191491112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2e93390 msgr2=0x563ae3266d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:16.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.303+0000 7f4bee59c640 1 --2- 172.21.15.63:0/2191491112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2e93390 0x563ae3266d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.303+0000 7f4bee59c640 1 -- 172.21.15.63:0/2191491112 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ae3189c40 con 0x563ae2e8b1b0 2024-09-21T06:32:16.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.303+0000 7f4beed9d640 1 --2- 172.21.15.63:0/2191491112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2eb4070 0x563ae3267250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:16.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.303+0000 7f4bedd9b640 1 --2- 172.21.15.63:0/2191491112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2e93390 0x563ae3266d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:16.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.303+0000 7f4bee59c640 1 --2- 172.21.15.63:0/2191491112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2e8b1b0 0x563ae32667d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4be00aabc0 tx=0x7f4be0018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fb9ab66ee630c08 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:16.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.303+0000 7f4bd5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:32:16.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.303+0000 7f4bd5ffb640 1 -- 172.21.15.63:0/2191491112 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be00a97f0 con 0x563ae2e8b1b0 2024-09-21T06:32:16.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.303+0000 7f4bd5ffb640 1 -- 172.21.15.63:0/2191491112 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f4be00acbb0 con 0x563ae2e8b1b0 2024-09-21T06:32:16.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.303+0000 7f4bfade6740 1 -- 172.21.15.63:0/2191491112 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4be4004030 con 0x563ae2e8b1b0 2024-09-21T06:32:16.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.303+0000 7f4bd5ffb640 1 -- 172.21.15.63:0/2191491112 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f4be00e5630 con 0x563ae2e8b1b0 2024-09-21T06:32:16.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.303+0000 7f4bfade6740 10 client.26075 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:16.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.303+0000 7f4bfade6740 1 -- 172.21.15.63:0/2191491112 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x563ae32756f0 con 0x563ae2e8b1b0 2024-09-21T06:32:16.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.304+0000 7f4bd5ffb640 1 -- 172.21.15.63:0/2191491112 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4be4004030 con 0x563ae2e8b1b0 2024-09-21T06:32:16.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.304+0000 7f4bd5ffb640 1 -- 172.21.15.63:0/2191491112 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f4be00d4080 con 0x563ae2e8b1b0 2024-09-21T06:32:16.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.304+0000 7f4bfade6740 10 client.26075 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:16.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.304+0000 7f4bfade6740 10 client.26075 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:32:16.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.304+0000 7f4bfade6740 20 client.26075 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:16.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.304+0000 7f4bfade6740 1 --2- 172.21.15.63:0/2191491112 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563ae2e729f0 0x563ae3278cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:16.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.304+0000 7f4bfade6740 4 client.26075 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:32:16.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.304+0000 7f4bfade6740 1 -- 172.21.15.63:0/2191491112 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ae31d3da0 con 0x563ae2e729f0 2024-09-21T06:32:16.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.304+0000 7f4bedd9b640 1 --2- 172.21.15.63:0/2191491112 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563ae2e729f0 0x563ae3278cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:16.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.305+0000 7f4bedd9b640 1 --2- 172.21.15.63:0/2191491112 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563ae2e729f0 0x563ae3278cd0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3de9f7ca9fa394d server_cookie=e086fc527a269e25 in_seq=0 out_seq=0 2024-09-21T06:32:16.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.305+0000 7f4bd5ffb640 10 client.26075 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:16.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.305+0000 7f4bd5ffb640 1 -- 172.21.15.63:0/2191491112 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563ae31d3da0 con 0x563ae2e729f0 2024-09-21T06:32:16.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.305+0000 7f4bd5ffb640 10 client.26075 handle_command_reply: tid=0 2024-09-21T06:32:16.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.306+0000 7f4bfade6740 1 client.26075 shutdown 2024-09-21T06:32:16.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.306+0000 7f4bfade6740 1 -- 172.21.15.63:0/2191491112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2e8b1b0 msgr2=0x563ae32667d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:16.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.306+0000 7f4bfade6740 1 --2- 172.21.15.63:0/2191491112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2e8b1b0 0x563ae32667d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4be00aabc0 tx=0x7f4be0018420 comp rx=0 tx=0).stop 2024-09-21T06:32:16.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.306+0000 7f4bfade6740 1 -- 172.21.15.63:0/2191491112 shutdown_connections 2024-09-21T06:32:16.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.306+0000 7f4bfade6740 1 --2- 172.21.15.63:0/2191491112 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563ae2e729f0 0x563ae3278cd0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.306+0000 7f4bfade6740 1 --2- 172.21.15.63:0/2191491112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2eb4070 0x563ae3267250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.306+0000 7f4bfade6740 1 --2- 172.21.15.63:0/2191491112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2e93390 0x563ae3266d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.306+0000 7f4bfade6740 1 --2- 172.21.15.63:0/2191491112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2e8b1b0 0x563ae32667d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.306+0000 7f4bd5ffb640 0 client.26075 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:16.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.306+0000 7f4bfade6740 1 -- 172.21.15.63:0/2191491112 >> 172.21.15.63:0/2191491112 conn(0x563ae2ea8460 msgr2=0x563ae325e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:16.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.306+0000 7f4bfade6740 1 -- 172.21.15.63:0/2191491112 shutdown_connections 2024-09-21T06:32:16.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.306+0000 7f4bfade6740 1 -- 172.21.15.63:0/2191491112 wait complete. 2024-09-21T06:32:16.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.306+0000 7f4bfade6740 20 client.26075 trim_cache size 0 max 16384 2024-09-21T06:32:16.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.325+0000 7f4bfade6740 1 Processor -- start 2024-09-21T06:32:16.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.325+0000 7f4bfade6740 1 -- start start 2024-09-21T06:32:16.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.326+0000 7f4bfade6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2e8b1b0 0x563ae32686b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:16.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.326+0000 7f4bfade6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2e93390 0x563ae325c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:16.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.326+0000 7f4bfade6740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2eb4070 0x563ae3258710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:16.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.326+0000 7f4bfade6740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf01b1930 con 0x563ae2eb4070 2024-09-21T06:32:16.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.326+0000 7f4bfade6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf01b3530 con 0x563ae2e93390 2024-09-21T06:32:16.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.326+0000 7f4bfade6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf01b20c0 con 0x563ae2e8b1b0 2024-09-21T06:32:16.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.326+0000 7f4beed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2eb4070 0x563ae3258710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:16.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.326+0000 7f4bee59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2e8b1b0 0x563ae32686b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:16.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.326+0000 7f4beed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2eb4070 0x563ae3258710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43706/0 (socket says 172.21.15.63:43706) 2024-09-21T06:32:16.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.326+0000 7f4bedd9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2e93390 0x563ae325c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:16.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.326+0000 7f4bee59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2e8b1b0 0x563ae32686b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:41544/0 (socket says 172.21.15.63:41544) 2024-09-21T06:32:16.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.326+0000 7f4beed9d640 1 -- 172.21.15.63:0/3917422641 learned_addr learned my addr 172.21.15.63:0/3917422641 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:16.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.326+0000 7f4bedd9b640 1 -- 172.21.15.63:0/3917422641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2e8b1b0 msgr2=0x563ae32686b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:16.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.326+0000 7f4bedd9b640 1 --2- 172.21.15.63:0/3917422641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2e8b1b0 0x563ae32686b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.326+0000 7f4bedd9b640 1 -- 172.21.15.63:0/3917422641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2eb4070 msgr2=0x563ae3258710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:16.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.326+0000 7f4bedd9b640 1 --2- 172.21.15.63:0/3917422641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2eb4070 0x563ae3258710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.326+0000 7f4bedd9b640 1 -- 172.21.15.63:0/3917422641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ae325dab0 con 0x563ae2e93390 2024-09-21T06:32:16.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.326+0000 7f4bedd9b640 1 --2- 172.21.15.63:0/3917422641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2e93390 0x563ae325c9b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x563ae32793d0 tx=0x7f4be40050e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af2def9d24e75b43 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:16.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.327+0000 7f4bd7fff640 1 -- 172.21.15.63:0/3917422641 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be4035040 con 0x563ae2e93390 2024-09-21T06:32:16.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.327+0000 7f4bd7fff640 1 -- 172.21.15.63:0/3917422641 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4be4004410 con 0x563ae2e93390 2024-09-21T06:32:16.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.327+0000 7f4bd7fff640 1 -- 172.21.15.63:0/3917422641 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be4040040 con 0x563ae2e93390 2024-09-21T06:32:16.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.328+0000 7f4bfade6740 1 -- 172.21.15.63:0/3917422641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2e93390 msgr2=0x563ae325c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:16.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.328+0000 7f4bfade6740 1 --2- 172.21.15.63:0/3917422641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2e93390 0x563ae325c9b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x563ae32793d0 tx=0x7f4be40050e0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.328+0000 7f4bfade6740 1 -- 172.21.15.63:0/3917422641 shutdown_connections 2024-09-21T06:32:16.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.328+0000 7f4bfade6740 1 --2- 172.21.15.63:0/3917422641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2eb4070 0x563ae3258710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.328+0000 7f4bfade6740 1 --2- 172.21.15.63:0/3917422641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2e93390 0x563ae325c9b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.328+0000 7f4bfade6740 1 --2- 172.21.15.63:0/3917422641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2e8b1b0 0x563ae32686b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.328+0000 7f4bfade6740 1 -- 172.21.15.63:0/3917422641 >> 172.21.15.63:0/3917422641 conn(0x563ae2ea8460 msgr2=0x563ae325c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:16.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.328+0000 7f4bfade6740 1 -- 172.21.15.63:0/3917422641 shutdown_connections 2024-09-21T06:32:16.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.328+0000 7f4bfade6740 1 -- 172.21.15.63:0/3917422641 wait complete. 2024-09-21T06:32:16.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.328+0000 7f4bfade6740 1 -- start start 2024-09-21T06:32:16.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.328+0000 7f4bfade6740 1 Processor -- start 2024-09-21T06:32:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.329+0000 7f4bfade6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2e8b1b0 0x563ae326f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.329+0000 7f4bfade6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2e93390 0x563ae326a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.329+0000 7f4bfade6740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2eb4070 0x563ae326ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.329+0000 7f4bfade6740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf01b2e60 con 0x563ae2eb4070 2024-09-21T06:32:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.329+0000 7f4bfade6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf01b2790 con 0x563ae2e93390 2024-09-21T06:32:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.329+0000 7f4bfade6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf01af910 con 0x563ae2e8b1b0 2024-09-21T06:32:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.329+0000 7f4bfade6740 10 client.0 _ll_register_callbacks cb 0x7f4be0009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.329+0000 7f4bee59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2e8b1b0 0x563ae326f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.329+0000 7f4bee59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2e8b1b0 0x563ae326f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:41556/0 (socket says 172.21.15.63:41556) 2024-09-21T06:32:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.329+0000 7f4bee59c640 1 -- 172.21.15.63:0/3254005603 learned_addr learned my addr 172.21.15.63:0/3254005603 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.329+0000 7f4beed9d640 1 --2- 172.21.15.63:0/3254005603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2eb4070 0x563ae326ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.329+0000 7f4bedd9b640 1 --2- 172.21.15.63:0/3254005603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2e93390 0x563ae326a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.329+0000 7f4bee59c640 1 -- 172.21.15.63:0/3254005603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2e93390 msgr2=0x563ae326a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.329+0000 7f4bee59c640 1 --2- 172.21.15.63:0/3254005603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2e93390 0x563ae326a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.330+0000 7f4bee59c640 1 -- 172.21.15.63:0/3254005603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2eb4070 msgr2=0x563ae326ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.330+0000 7f4bee59c640 1 --2- 172.21.15.63:0/3254005603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2eb4070 0x563ae326ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.330+0000 7f4bee59c640 1 -- 172.21.15.63:0/3254005603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ae326b300 con 0x563ae2e8b1b0 2024-09-21T06:32:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.330+0000 7f4bedd9b640 1 --2- 172.21.15.63:0/3254005603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2e93390 0x563ae326a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:32:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.330+0000 7f4beed9d640 1 --2- 172.21.15.63:0/3254005603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2eb4070 0x563ae326ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.330+0000 7f4bee59c640 1 --2- 172.21.15.63:0/3254005603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2e8b1b0 0x563ae326f350 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4be00a9ed0 tx=0x7f4be00ac920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80f823e8421c68e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.330+0000 7f4bd5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:32:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.330+0000 7f4bd5ffb640 1 -- 172.21.15.63:0/3254005603 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be00a90c0 con 0x563ae2e8b1b0 2024-09-21T06:32:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.330+0000 7f4bfade6740 1 -- 172.21.15.63:0/3254005603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4be4004410 con 0x563ae2e8b1b0 2024-09-21T06:32:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.330+0000 7f4bd5ffb640 1 -- 172.21.15.63:0/3254005603 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f4be00ace00 con 0x563ae2e8b1b0 2024-09-21T06:32:16.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.330+0000 7f4bd5ffb640 1 -- 172.21.15.63:0/3254005603 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f4be00ad0c0 con 0x563ae2e8b1b0 2024-09-21T06:32:16.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.330+0000 7f4bfade6740 10 client.26137 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:16.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.330+0000 7f4bfade6740 1 -- 172.21.15.63:0/3254005603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x563ae32e3410 con 0x563ae2e8b1b0 2024-09-21T06:32:16.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.331+0000 7f4bd5ffb640 1 -- 172.21.15.63:0/3254005603 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4be4004410 con 0x563ae2e8b1b0 2024-09-21T06:32:16.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.331+0000 7f4bd5ffb640 1 -- 172.21.15.63:0/3254005603 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f4be00b6800 con 0x563ae2e8b1b0 2024-09-21T06:32:16.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.331+0000 7f4bfade6740 10 client.26137 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:16.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.331+0000 7f4bfade6740 10 client.26137 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:32:16.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.331+0000 7f4bfade6740 20 client.26137 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:16.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.331+0000 7f4bfade6740 1 --2- 172.21.15.63:0/3254005603 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563ae2e47da0 0x563ae32e5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:16.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.331+0000 7f4bfade6740 4 client.26137 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:32:16.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.331+0000 7f4bfade6740 1 -- 172.21.15.63:0/3254005603 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563ae31cf850 con 0x563ae2e47da0 2024-09-21T06:32:16.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.331+0000 7f4bedd9b640 1 --2- 172.21.15.63:0/3254005603 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563ae2e47da0 0x563ae32e5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:16.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.332+0000 7f4bd5ffb640 10 client.26137 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:16.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.332+0000 7f4bedd9b640 1 --2- 172.21.15.63:0/3254005603 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563ae2e47da0 0x563ae32e5b10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b651f6d8a506b7e server_cookie=454d1c8d7de7f716 in_seq=0 out_seq=0 2024-09-21T06:32:16.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.332+0000 7f4bd5ffb640 1 -- 172.21.15.63:0/3254005603 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x563ae31cf850 con 0x563ae2e47da0 2024-09-21T06:32:16.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.332+0000 7f4bd5ffb640 10 client.26137 handle_command_reply: tid=0 2024-09-21T06:32:16.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.332+0000 7f4bfade6740 1 client.26137 shutdown 2024-09-21T06:32:16.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.332+0000 7f4bfade6740 1 -- 172.21.15.63:0/3254005603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2e8b1b0 msgr2=0x563ae326f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:16.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.332+0000 7f4bfade6740 1 --2- 172.21.15.63:0/3254005603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2e8b1b0 0x563ae326f350 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4be00a9ed0 tx=0x7f4be00ac920 comp rx=0 tx=0).stop 2024-09-21T06:32:16.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.332+0000 7f4bfade6740 1 -- 172.21.15.63:0/3254005603 shutdown_connections 2024-09-21T06:32:16.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.332+0000 7f4bfade6740 1 --2- 172.21.15.63:0/3254005603 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563ae2e47da0 0x563ae32e5b10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.333+0000 7f4bfade6740 1 --2- 172.21.15.63:0/3254005603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ae2eb4070 0x563ae326ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.333+0000 7f4bfade6740 1 --2- 172.21.15.63:0/3254005603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ae2e93390 0x563ae326a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.333+0000 7f4bfade6740 1 --2- 172.21.15.63:0/3254005603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ae2e8b1b0 0x563ae326f350 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.333+0000 7f4bfade6740 1 -- 172.21.15.63:0/3254005603 >> 172.21.15.63:0/3254005603 conn(0x563ae2ea8460 msgr2=0x563ae3268450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:16.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.333+0000 7f4bd5ffb640 0 client.26137 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:16.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.333+0000 7f4bfade6740 1 -- 172.21.15.63:0/3254005603 shutdown_connections 2024-09-21T06:32:16.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.333+0000 7f4bfade6740 1 -- 172.21.15.63:0/3254005603 wait complete. 2024-09-21T06:32:16.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.333+0000 7f4bfade6740 20 client.26137 trim_cache size 0 max 16384 2024-09-21T06:32:16.339 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:32:16.339 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:32:16.339 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": { 2024-09-21T06:32:16.339 INFO:teuthology.orchestra.run.smithi063.stdout: "024d3c59-0b67-49a9-bf4a-e02d36691942": { 2024-09-21T06:32:16.339 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:32:16.339 INFO:teuthology.orchestra.run.smithi063.stdout: "tag": "024d3c59-0b67-49a9-bf4a-e02d36691942", 2024-09-21T06:32:16.339 INFO:teuthology.orchestra.run.smithi063.stdout: "options": "recursive,force" 2024-09-21T06:32:16.339 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:32:16.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:32:16.340 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:32:16.340 INFO:teuthology.orchestra.run.smithi063.stdout: "024d3c59-0b67-49a9-bf4a-e02d36691942": { 2024-09-21T06:32:16.340 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:32:14.282244+0000", 2024-09-21T06:32:16.340 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:32:16.340 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:32:16.340 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:32:16.340 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:32:16.340 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:32:16.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:32:16.340 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:32:16.340 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:31:27.507051+0000", 2024-09-21T06:32:16.340 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:32:16.340 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:32:16.340 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:32:16.341 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:32:16.341 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:32:16.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:32:16.341 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:32:16.341 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:32:16.341 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:32:16.341 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:32:16.341 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:32:16.341 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:32:16.341 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:32:16.341 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:32:16.341 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:32:16.341 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:32:16.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.334+0000 7f4bf4872640 1 -- 172.21.15.63:0/1082056976 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4bd80b6680 msgr2=0x7f4bd80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:16.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.334+0000 7f4bf4872640 1 --2- 172.21.15.63:0/1082056976 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4bd80b6680 0x7f4bd80b8b90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4be8005fd0 tx=0x7f4be8009500 comp rx=0 tx=0).stop 2024-09-21T06:32:16.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.334+0000 7f4bf4872640 1 -- 172.21.15.63:0/1082056976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bf0102a60 msgr2=0x7f4bf00ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:16.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.334+0000 7f4bf4872640 1 --2- 172.21.15.63:0/1082056976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bf0102a60 0x7f4bf00ff670 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4be000e9f0 tx=0x7f4be000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.334+0000 7f4bf4872640 1 -- 172.21.15.63:0/1082056976 shutdown_connections 2024-09-21T06:32:16.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.334+0000 7f4bf4872640 1 --2- 172.21.15.63:0/1082056976 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4bd80b6680 0x7f4bd80b8b90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.334+0000 7f4bf4872640 1 --2- 172.21.15.63:0/1082056976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bf0108cf0 0x7f4bf01000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.334+0000 7f4bf4872640 1 --2- 172.21.15.63:0/1082056976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bf01083a0 0x7f4bf00ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.334+0000 7f4bf4872640 1 --2- 172.21.15.63:0/1082056976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bf0102a60 0x7f4bf00ff670 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4be000e9f0 tx=0x7f4be000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:32:16.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.334+0000 7f4bf4872640 1 -- 172.21.15.63:0/1082056976 >> 172.21.15.63:0/1082056976 conn(0x7f4bf0079730 msgr2=0x7f4bf006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:16.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.334+0000 7f4bf4872640 1 -- 172.21.15.63:0/1082056976 shutdown_connections 2024-09-21T06:32:16.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:16.334+0000 7f4bf4872640 1 -- 172.21.15.63:0/1082056976 wait complete. 2024-09-21T06:32:16.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:16 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:16.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:16 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:16.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:16 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:16.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:16 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:17.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:16 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:17.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:16 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:17.130 INFO:tasks.cephfs.filesystem:scrub status for tag:024d3c59-0b67-49a9-bf4a-e02d36691942 - {'path': '/', 'tag': '024d3c59-0b67-49a9-bf4a-e02d36691942', 'options': 'recursive,force'} 2024-09-21T06:32:17.195 INFO:tasks.workunit.client.0.smithi063.stdout:50000 write 0x5304f4 thru 0x53fa11 (0xf51e bytes) 2024-09-21T06:32:17.195 INFO:tasks.workunit.client.0.smithi063.stdout:All 50000 operations completed A-OK! 2024-09-21T06:32:17.196 INFO:tasks.workunit.client.0.smithi063.stderr:+ ./fsx -z 100MB -N 50000 -p 10000 -l 104857600 2024-09-21T06:32:17.196 INFO:tasks.workunit.client.0.smithi063.stdout:Seed set to 1 2024-09-21T06:32:17.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:17 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:17.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:17 smithi063 ceph-mon[31150]: pgmap v445: 97 pgs: 97 active+clean; 157 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 3.6 MiB/s wr, 677 op/s 2024-09-21T06:32:17.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:17 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:17.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:17 smithi175 ceph-mon[34510]: pgmap v445: 97 pgs: 97 active+clean; 157 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 3.6 MiB/s wr, 677 op/s 2024-09-21T06:32:18.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:17 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:32:18.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:17 smithi071 ceph-mon[34844]: pgmap v445: 97 pgs: 97 active+clean; 157 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 3.6 MiB/s wr, 677 op/s 2024-09-21T06:32:18.388 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-09-21T06:32:18.389 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-09-21T06:32:18.390 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-21T06:32:18.390 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-21T06:32:18.390 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support clone range, disabling! 2024-09-21T06:32:18.392 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-21T06:32:18.394 INFO:tasks.workunit.client.0.smithi063.stderr:main: filesystem does not support exchange range, disabling! 2024-09-21T06:32:18.395 INFO:tasks.workunit.client.0.smithi063.stdout:skipping zero size read 2024-09-21T06:32:18.405 INFO:tasks.workunit.client.0.smithi063.stdout:truncating to largest ever: 0x1c37b90 2024-09-21T06:32:18.412 INFO:tasks.workunit.client.0.smithi063.stdout:truncating to largest ever: 0x5bd330d 2024-09-21T06:32:18.426 INFO:tasks.workunit.client.0.smithi063.stdout:copying to largest ever: 0x637bf99 2024-09-21T06:32:18.593 INFO:tasks.workunit.client.0.smithi063.stdout:copying to largest ever: 0x63d9b9c 2024-09-21T06:32:19.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:19 smithi063 ceph-mon[31150]: pgmap v446: 97 pgs: 97 active+clean; 158 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.4 MiB/s wr, 865 op/s 2024-09-21T06:32:19.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:19 smithi175 ceph-mon[34510]: pgmap v446: 97 pgs: 97 active+clean; 158 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.4 MiB/s wr, 865 op/s 2024-09-21T06:32:20.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:19 smithi071 ceph-mon[34844]: pgmap v446: 97 pgs: 97 active+clean; 158 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.4 MiB/s wr, 865 op/s 2024-09-21T06:32:21.819 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:21 smithi071 ceph-mon[34844]: pgmap v447: 97 pgs: 97 active+clean; 158 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 3.5 MiB/s wr, 782 op/s 2024-09-21T06:32:21.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:21 smithi063 ceph-mon[31150]: pgmap v447: 97 pgs: 97 active+clean; 158 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 3.5 MiB/s wr, 782 op/s 2024-09-21T06:32:21.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:21 smithi175 ceph-mon[34510]: pgmap v447: 97 pgs: 97 active+clean; 158 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 3.5 MiB/s wr, 782 op/s 2024-09-21T06:32:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:32:22.933+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:32:22.934+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-21T06:32:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:32:22.934+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-21T06:32:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:32:22.934+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T06:32:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:32:22.934+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-09-21T06:32:23.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:23 smithi063 ceph-mon[31150]: pgmap v448: 97 pgs: 97 active+clean; 167 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.6 MiB/s wr, 910 op/s 2024-09-21T06:32:23.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:23 smithi175 ceph-mon[34510]: pgmap v448: 97 pgs: 97 active+clean; 167 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.6 MiB/s wr, 910 op/s 2024-09-21T06:32:24.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:23 smithi071 ceph-mon[34844]: pgmap v448: 97 pgs: 97 active+clean; 167 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.6 MiB/s wr, 910 op/s 2024-09-21T06:32:25.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:25 smithi063 ceph-mon[31150]: pgmap v449: 97 pgs: 97 active+clean; 167 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 2.8 MiB/s wr, 798 op/s 2024-09-21T06:32:25.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:25 smithi175 ceph-mon[34510]: pgmap v449: 97 pgs: 97 active+clean; 167 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 2.8 MiB/s wr, 798 op/s 2024-09-21T06:32:26.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:25 smithi071 ceph-mon[34844]: pgmap v449: 97 pgs: 97 active+clean; 167 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 2.8 MiB/s wr, 798 op/s 2024-09-21T06:32:27.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:27 smithi063 ceph-mon[31150]: pgmap v450: 97 pgs: 97 active+clean; 175 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.7 MiB/s wr, 862 op/s 2024-09-21T06:32:27.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:27 smithi175 ceph-mon[34510]: pgmap v450: 97 pgs: 97 active+clean; 175 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.7 MiB/s wr, 862 op/s 2024-09-21T06:32:28.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:27 smithi071 ceph-mon[34844]: pgmap v450: 97 pgs: 97 active+clean; 175 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.7 MiB/s wr, 862 op/s 2024-09-21T06:32:28.528 INFO:tasks.workunit.client.0.smithi063.stdout:10000 mapread 0x33cc4e3 thru 0x33cec16 (0x2734 bytes) 2024-09-21T06:32:28.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:28 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:32:28.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:28 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:32:28.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:28 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:32:28.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:28 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:32:29.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:28 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:32:29.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:28 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:32:29.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:29 smithi063 ceph-mon[31150]: pgmap v451: 97 pgs: 97 active+clean; 175 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 3.2 MiB/s wr, 1.06k op/s 2024-09-21T06:32:29.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:29 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:32:29.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:29 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:32:29.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:29 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:32:29.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:29 smithi175 ceph-mon[34510]: pgmap v451: 97 pgs: 97 active+clean; 175 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 3.2 MiB/s wr, 1.06k op/s 2024-09-21T06:32:29.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:29 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:32:29.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:29 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:32:29.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:29 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:32:30.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:29 smithi071 ceph-mon[34844]: pgmap v451: 97 pgs: 97 active+clean; 175 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 3.2 MiB/s wr, 1.06k op/s 2024-09-21T06:32:30.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:29 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:32:30.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:29 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:32:30.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:29 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:32:31.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:31 smithi063 ceph-mon[31150]: pgmap v452: 97 pgs: 97 active+clean; 177 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 878 op/s 2024-09-21T06:32:31.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:31 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:31.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:31 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:31.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:31 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:31.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:31 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:32:31.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:31 smithi175 ceph-mon[34510]: pgmap v452: 97 pgs: 97 active+clean; 177 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 878 op/s 2024-09-21T06:32:31.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:31 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:31.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:31 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:31.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:31 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:31.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:31 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:32:32.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:31 smithi071 ceph-mon[34844]: pgmap v452: 97 pgs: 97 active+clean; 177 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 878 op/s 2024-09-21T06:32:32.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:31 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:32.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:31 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:32.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:31 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:32.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:31 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:32:33.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:33 smithi063 ceph-mon[31150]: pgmap v453: 97 pgs: 97 active+clean; 176 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 3.3 MiB/s wr, 1.20k op/s 2024-09-21T06:32:33.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:33 smithi175 ceph-mon[34510]: pgmap v453: 97 pgs: 97 active+clean; 176 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 3.3 MiB/s wr, 1.20k op/s 2024-09-21T06:32:34.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:33 smithi071 ceph-mon[34844]: pgmap v453: 97 pgs: 97 active+clean; 176 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 3.3 MiB/s wr, 1.20k op/s 2024-09-21T06:32:34.766 INFO:tasks.workunit.client.0.smithi063.stdout:truncating to largest ever: 0x63e5d2a 2024-09-21T06:32:35.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:35 smithi063 ceph-mon[31150]: pgmap v454: 97 pgs: 97 active+clean; 176 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.6 MiB/s wr, 965 op/s 2024-09-21T06:32:35.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:35 smithi175 ceph-mon[34510]: pgmap v454: 97 pgs: 97 active+clean; 176 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.6 MiB/s wr, 965 op/s 2024-09-21T06:32:36.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:35 smithi071 ceph-mon[34844]: pgmap v454: 97 pgs: 97 active+clean; 176 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.6 MiB/s wr, 965 op/s 2024-09-21T06:32:37.238 INFO:tasks.workunit.client.0.smithi063.stdout:truncating to largest ever: 0x63e9b52 2024-09-21T06:32:37.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:37 smithi063 ceph-mon[31150]: pgmap v455: 97 pgs: 97 active+clean; 178 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 2.9 MiB/s wr, 1.08k op/s 2024-09-21T06:32:37.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:37 smithi175 ceph-mon[34510]: pgmap v455: 97 pgs: 97 active+clean; 178 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 2.9 MiB/s wr, 1.08k op/s 2024-09-21T06:32:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:32:37.949+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:32:37.950+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-21T06:32:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:32:37.950+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-21T06:32:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:32:37.950+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T06:32:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:32:37.950+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-09-21T06:32:38.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:37 smithi071 ceph-mon[34844]: pgmap v455: 97 pgs: 97 active+clean; 178 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 2.9 MiB/s wr, 1.08k op/s 2024-09-21T06:32:39.139 INFO:tasks.workunit.client.0.smithi063.stdout:20000 read 0xa6cbf1 thru 0xa6e358 (0x1768 bytes) 2024-09-21T06:32:39.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:39 smithi063 ceph-mon[31150]: pgmap v456: 97 pgs: 97 active+clean; 181 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 3.3 MiB/s wr, 1.22k op/s 2024-09-21T06:32:39.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:39 smithi175 ceph-mon[34510]: pgmap v456: 97 pgs: 97 active+clean; 181 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 3.3 MiB/s wr, 1.22k op/s 2024-09-21T06:32:40.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:39 smithi071 ceph-mon[34844]: pgmap v456: 97 pgs: 97 active+clean; 181 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 3.3 MiB/s wr, 1.22k op/s 2024-09-21T06:32:40.956 INFO:tasks.workunit.client.0.smithi063.stdout:copying to largest ever: 0x63ed6b9 2024-09-21T06:32:41.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:41 smithi063 ceph-mon[31150]: pgmap v457: 97 pgs: 97 active+clean; 184 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.8 MiB/s wr, 995 op/s 2024-09-21T06:32:41.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:41 smithi175 ceph-mon[34510]: pgmap v457: 97 pgs: 97 active+clean; 184 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.8 MiB/s wr, 995 op/s 2024-09-21T06:32:42.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:41 smithi071 ceph-mon[34844]: pgmap v457: 97 pgs: 97 active+clean; 184 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.8 MiB/s wr, 995 op/s 2024-09-21T06:32:43.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:43 smithi063 ceph-mon[31150]: pgmap v458: 97 pgs: 97 active+clean; 179 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 3.4 MiB/s wr, 1.26k op/s 2024-09-21T06:32:43.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:43 smithi175 ceph-mon[34510]: pgmap v458: 97 pgs: 97 active+clean; 179 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 3.4 MiB/s wr, 1.26k op/s 2024-09-21T06:32:44.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:43 smithi071 ceph-mon[34844]: pgmap v458: 97 pgs: 97 active+clean; 179 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 3.4 MiB/s wr, 1.26k op/s 2024-09-21T06:32:45.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:45 smithi063 ceph-mon[31150]: pgmap v459: 97 pgs: 97 active+clean; 180 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.5 MiB/s wr, 896 op/s 2024-09-21T06:32:45.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:45 smithi175 ceph-mon[34510]: pgmap v459: 97 pgs: 97 active+clean; 180 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.5 MiB/s wr, 896 op/s 2024-09-21T06:32:46.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:45 smithi071 ceph-mon[34844]: pgmap v459: 97 pgs: 97 active+clean; 180 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.5 MiB/s wr, 896 op/s 2024-09-21T06:32:47.132 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:32:47.438 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:32:47.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:47 smithi063 ceph-mon[31150]: pgmap v460: 97 pgs: 97 active+clean; 181 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.9 MiB/s wr, 1.01k op/s 2024-09-21T06:32:47.848 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:47 smithi175 ceph-mon[34510]: pgmap v460: 97 pgs: 97 active+clean; 181 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.9 MiB/s wr, 1.01k op/s 2024-09-21T06:32:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.989+0000 7fe44cfc9640 1 -- 172.21.15.63:0/1049220790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4481094d0 msgr2=0x7fe4481098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.989+0000 7fe44cfc9640 1 --2- 172.21.15.63:0/1049220790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4481094d0 0x7fe4481098e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009900 tx=0x7fe43c02a410 comp rx=0 tx=0).stop 2024-09-21T06:32:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.989+0000 7fe44cfc9640 1 -- 172.21.15.63:0/1049220790 shutdown_connections 2024-09-21T06:32:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.989+0000 7fe44cfc9640 1 --2- 172.21.15.63:0/1049220790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe448109e20 0x7fe448110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.989+0000 7fe44cfc9640 1 --2- 172.21.15.63:0/1049220790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4481094d0 0x7fe4481098e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.989+0000 7fe44cfc9640 1 --2- 172.21.15.63:0/1049220790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe448103b90 0x7fe448103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.989+0000 7fe44cfc9640 1 -- 172.21.15.63:0/1049220790 >> 172.21.15.63:0/1049220790 conn(0x7fe4480ff5e0 msgr2=0x7fe448101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.989+0000 7fe44cfc9640 1 -- 172.21.15.63:0/1049220790 shutdown_connections 2024-09-21T06:32:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.989+0000 7fe44cfc9640 1 -- 172.21.15.63:0/1049220790 wait complete. 2024-09-21T06:32:47.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.990+0000 7fe44cfc9640 1 Processor -- start 2024-09-21T06:32:47.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.991+0000 7fe44cfc9640 1 -- start start 2024-09-21T06:32:47.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.991+0000 7fe44cfc9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe448103b90 0x7fe44819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:47.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.991+0000 7fe44cfc9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4481094d0 0x7fe44819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:47.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.991+0000 7fe44cfc9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe448109e20 0x7fe44819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:47.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.991+0000 7fe44cfc9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe448113ae0 con 0x7fe4481094d0 2024-09-21T06:32:47.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.991+0000 7fe44cfc9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe448113960 con 0x7fe448103b90 2024-09-21T06:32:47.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.991+0000 7fe44cfc9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe448113c60 con 0x7fe448109e20 2024-09-21T06:32:47.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.991+0000 7fe44659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe448103b90 0x7fe44819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.991+0000 7fe445d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4481094d0 0x7fe44819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.991+0000 7fe44659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe448103b90 0x7fe44819a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:35278/0 (socket says 172.21.15.63:35278) 2024-09-21T06:32:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.991+0000 7fe44659c640 1 -- 172.21.15.63:0/3276252756 learned_addr learned my addr 172.21.15.63:0/3276252756 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.991+0000 7fe446d9d640 1 --2- 172.21.15.63:0/3276252756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe448109e20 0x7fe44819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.991+0000 7fe44659c640 1 -- 172.21.15.63:0/3276252756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe448109e20 msgr2=0x7fe44819fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.991+0000 7fe44659c640 1 --2- 172.21.15.63:0/3276252756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe448109e20 0x7fe44819fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.991+0000 7fe44659c640 1 -- 172.21.15.63:0/3276252756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4481094d0 msgr2=0x7fe44819aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.991+0000 7fe44659c640 1 --2- 172.21.15.63:0/3276252756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4481094d0 0x7fe44819aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.991+0000 7fe44659c640 1 -- 172.21.15.63:0/3276252756 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4481a0440 con 0x7fe448103b90 2024-09-21T06:32:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.992+0000 7fe44659c640 1 --2- 172.21.15.63:0/3276252756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe448103b90 0x7fe44819a4d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe43800ea60 tx=0x7fe43800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.992+0000 7fe4377fe640 1 -- 172.21.15.63:0/3276252756 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43800cde0 con 0x7fe448103b90 2024-09-21T06:32:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.992+0000 7fe44cfc9640 1 -- 172.21.15.63:0/3276252756 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4481a0730 con 0x7fe448103b90 2024-09-21T06:32:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.992+0000 7fe4377fe640 1 -- 172.21.15.63:0/3276252756 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4380035f0 con 0x7fe448103b90 2024-09-21T06:32:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.992+0000 7fe4377fe640 1 -- 172.21.15.63:0/3276252756 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe438010690 con 0x7fe448103b90 2024-09-21T06:32:47.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.992+0000 7fe44cfc9640 1 -- 172.21.15.63:0/3276252756 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4480755f0 con 0x7fe448103b90 2024-09-21T06:32:47.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.995+0000 7fe4377fe640 1 -- 172.21.15.63:0/3276252756 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fe438010830 con 0x7fe448103b90 2024-09-21T06:32:47.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.995+0000 7fe45353d740 1 Processor -- start 2024-09-21T06:32:47.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.995+0000 7fe45353d740 1 -- start start 2024-09-21T06:32:47.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.995+0000 7fe45353d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4aa9070 0x55afc4e50650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:47.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.995+0000 7fe45353d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4a801b0 0x55afc4e50b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:47.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.995+0000 7fe45353d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4a88390 0x55afc4e510d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:47.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.995+0000 7fe45353d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55afc4dc6e50 con 0x55afc4a801b0 2024-09-21T06:32:47.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.995+0000 7fe45353d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55afc4db6280 con 0x55afc4aa9070 2024-09-21T06:32:47.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.995+0000 7fe45353d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55afc4dba090 con 0x55afc4a88390 2024-09-21T06:32:47.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.995+0000 7fe44659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4a801b0 0x55afc4e50b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:47.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.995+0000 7fe445d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4a88390 0x55afc4e510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:47.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.996+0000 7fe446d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4aa9070 0x55afc4e50650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:47.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.996+0000 7fe445d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4a88390 0x55afc4e510d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:41638/0 (socket says 172.21.15.63:41638) 2024-09-21T06:32:47.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.996+0000 7fe445d9b640 1 -- 172.21.15.63:0/1691632718 learned_addr learned my addr 172.21.15.63:0/1691632718 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:47.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.996+0000 7fe445d9b640 1 -- 172.21.15.63:0/1691632718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4aa9070 msgr2=0x55afc4e50650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:47.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.996+0000 7fe445d9b640 1 --2- 172.21.15.63:0/1691632718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4aa9070 0x55afc4e50650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:47.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.996+0000 7fe445d9b640 1 -- 172.21.15.63:0/1691632718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4a801b0 msgr2=0x55afc4e50b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:47.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.996+0000 7fe445d9b640 1 --2- 172.21.15.63:0/1691632718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4a801b0 0x55afc4e50b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:47.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.996+0000 7fe445d9b640 1 -- 172.21.15.63:0/1691632718 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afc4b14650 con 0x55afc4a88390 2024-09-21T06:32:47.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.996+0000 7fe4377fe640 1 --2- 172.21.15.63:0/3276252756 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe4300b6700 0x7fe4300b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:48.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.996+0000 7fe446d9d640 1 --2- 172.21.15.63:0/3276252756 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe4300b6700 0x7fe4300b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:48.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.996+0000 7fe445d9b640 1 --2- 172.21.15.63:0/1691632718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4a88390 0x55afc4e510d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009900 tx=0x7fe43c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=493d637315a3e9f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:48.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.996+0000 7fe4377fe640 1 -- 172.21.15.63:0/3276252756 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fe4380e79c0 con 0x7fe448103b90 2024-09-21T06:32:48.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.996+0000 7fe434ff9640 1 -- 172.21.15.63:0/1691632718 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c040070 con 0x55afc4a88390 2024-09-21T06:32:48.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.997+0000 7fe434ff9640 1 -- 172.21.15.63:0/1691632718 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe43c004030 con 0x55afc4a88390 2024-09-21T06:32:48.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.997+0000 7fe434ff9640 1 -- 172.21.15.63:0/1691632718 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c035040 con 0x55afc4a88390 2024-09-21T06:32:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.997+0000 7fe45353d740 1 -- 172.21.15.63:0/1691632718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4a88390 msgr2=0x55afc4e510d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.997+0000 7fe446d9d640 1 --2- 172.21.15.63:0/3276252756 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe4300b6700 0x7fe4300b8c10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe440005fd0 tx=0x7fe440009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.997+0000 7fe45353d740 1 --2- 172.21.15.63:0/1691632718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4a88390 0x55afc4e510d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009900 tx=0x7fe43c000bc0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.998+0000 7fe45353d740 1 -- 172.21.15.63:0/1691632718 shutdown_connections 2024-09-21T06:32:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.998+0000 7fe45353d740 1 --2- 172.21.15.63:0/1691632718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4a88390 0x55afc4e510d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.998+0000 7fe45353d740 1 --2- 172.21.15.63:0/1691632718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4a801b0 0x55afc4e50b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.998+0000 7fe45353d740 1 --2- 172.21.15.63:0/1691632718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4aa9070 0x55afc4e50650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.998+0000 7fe45353d740 1 -- 172.21.15.63:0/1691632718 >> 172.21.15.63:0/1691632718 conn(0x55afc4a9d460 msgr2=0x55afc4e4e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.998+0000 7fe45353d740 1 -- 172.21.15.63:0/1691632718 shutdown_connections 2024-09-21T06:32:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.998+0000 7fe45353d740 1 -- 172.21.15.63:0/1691632718 wait complete. 2024-09-21T06:32:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.998+0000 7fe45353d740 1 -- start start 2024-09-21T06:32:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:47.999+0000 7fe45353d740 1 Processor -- start 2024-09-21T06:32:48.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.000+0000 7fe45353d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4a801b0 0x55afc4e5bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:48.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.000+0000 7fe45353d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4a88390 0x55afc4e5c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:48.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.000+0000 7fe45353d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4aa9070 0x55afc4e680c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:48.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.000+0000 7fe45353d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55afc4c17700 con 0x55afc4a801b0 2024-09-21T06:32:48.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.000+0000 7fe45353d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55afc4d51110 con 0x55afc4aa9070 2024-09-21T06:32:48.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.000+0000 7fe45353d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55afc4e5edd0 con 0x55afc4a88390 2024-09-21T06:32:48.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.000+0000 7fe45353d740 10 client.0 _ll_register_callbacks cb 0x55afc4d6a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:48.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.003+0000 7fe445d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4a88390 0x55afc4e5c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:48.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.003+0000 7fe446d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4aa9070 0x55afc4e680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:48.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.004+0000 7fe445d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4a88390 0x55afc4e5c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:41654/0 (socket says 172.21.15.63:41654) 2024-09-21T06:32:48.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.004+0000 7fe445d9b640 1 -- 172.21.15.63:0/733527323 learned_addr learned my addr 172.21.15.63:0/733527323 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:48.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.004+0000 7fe44659c640 1 --2- 172.21.15.63:0/733527323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4a801b0 0x55afc4e5bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:48.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.004+0000 7fe445d9b640 1 -- 172.21.15.63:0/733527323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4aa9070 msgr2=0x55afc4e680c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:48.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.004+0000 7fe445d9b640 1 --2- 172.21.15.63:0/733527323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4aa9070 0x55afc4e680c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.004+0000 7fe445d9b640 1 -- 172.21.15.63:0/733527323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4a801b0 msgr2=0x55afc4e5bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:48.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.004+0000 7fe445d9b640 1 --2- 172.21.15.63:0/733527323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4a801b0 0x55afc4e5bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.004+0000 7fe445d9b640 1 -- 172.21.15.63:0/733527323 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afc4d7ec40 con 0x55afc4a88390 2024-09-21T06:32:48.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.005+0000 7fe445d9b640 1 --2- 172.21.15.63:0/733527323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4a88390 0x55afc4e5c260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe43c032f00 tx=0x7fe43c02ab30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f6eaf35d9a90228 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:48.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.005+0000 7fe42dffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:32:48.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.005+0000 7fe42dffb640 1 -- 172.21.15.63:0/733527323 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c035070 con 0x55afc4a88390 2024-09-21T06:32:48.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.005+0000 7fe42dffb640 1 -- 172.21.15.63:0/733527323 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fe43c0316a0 con 0x55afc4a88390 2024-09-21T06:32:48.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.005+0000 7fe45353d740 1 -- 172.21.15.63:0/733527323 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe43c004030 con 0x55afc4a88390 2024-09-21T06:32:48.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.006+0000 7fe42dffb640 1 -- 172.21.15.63:0/733527323 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fe43c040040 con 0x55afc4a88390 2024-09-21T06:32:48.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.006+0000 7fe45353d740 10 client.26149 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:48.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.006+0000 7fe45353d740 1 -- 172.21.15.63:0/733527323 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55afc4e7bb00 con 0x55afc4a88390 2024-09-21T06:32:48.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.006+0000 7fe42dffb640 1 -- 172.21.15.63:0/733527323 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe43c004030 con 0x55afc4a88390 2024-09-21T06:32:48.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.006+0000 7fe42dffb640 1 -- 172.21.15.63:0/733527323 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7fe43c004be0 con 0x55afc4a88390 2024-09-21T06:32:48.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.006+0000 7fe45353d740 10 client.26149 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:48.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.006+0000 7fe45353d740 10 client.26149 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:32:48.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.006+0000 7fe45353d740 20 client.26149 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:48.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.007+0000 7fe45353d740 1 --2- 172.21.15.63:0/733527323 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55afc4a679f0 0x55afc4e7ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:48.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.007+0000 7fe45353d740 4 client.26149 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:32:48.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.007+0000 7fe45353d740 1 -- 172.21.15.63:0/733527323 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55afc4dc8da0 con 0x55afc4a679f0 2024-09-21T06:32:48.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.007+0000 7fe44659c640 1 --2- 172.21.15.63:0/733527323 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55afc4a679f0 0x55afc4e7ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:48.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.007+0000 7fe44659c640 1 --2- 172.21.15.63:0/733527323 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55afc4a679f0 0x55afc4e7ee60 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bafc57e5adeee77a server_cookie=7c7f66dfae7a24b3 in_seq=0 out_seq=0 2024-09-21T06:32:48.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.007+0000 7fe42dffb640 10 client.26149 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:48.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.008+0000 7fe42dffb640 1 -- 172.21.15.63:0/733527323 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55afc4dc8da0 con 0x55afc4a679f0 2024-09-21T06:32:48.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.008+0000 7fe42dffb640 10 client.26149 handle_command_reply: tid=0 2024-09-21T06:32:48.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.008+0000 7fe45353d740 1 client.26149 shutdown 2024-09-21T06:32:48.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.008+0000 7fe45353d740 1 -- 172.21.15.63:0/733527323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4a88390 msgr2=0x55afc4e5c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:48.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.008+0000 7fe45353d740 1 --2- 172.21.15.63:0/733527323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4a88390 0x55afc4e5c260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe43c032f00 tx=0x7fe43c02ab30 comp rx=0 tx=0).stop 2024-09-21T06:32:48.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.008+0000 7fe45353d740 1 -- 172.21.15.63:0/733527323 shutdown_connections 2024-09-21T06:32:48.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.008+0000 7fe45353d740 1 --2- 172.21.15.63:0/733527323 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55afc4a679f0 0x55afc4e7ee60 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.008+0000 7fe45353d740 1 --2- 172.21.15.63:0/733527323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4aa9070 0x55afc4e680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.008+0000 7fe45353d740 1 --2- 172.21.15.63:0/733527323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4a88390 0x55afc4e5c260 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.008+0000 7fe45353d740 1 --2- 172.21.15.63:0/733527323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4a801b0 0x55afc4e5bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.008+0000 7fe45353d740 1 -- 172.21.15.63:0/733527323 >> 172.21.15.63:0/733527323 conn(0x55afc4a9d460 msgr2=0x55afc4e53830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:48.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.008+0000 7fe42dffb640 0 client.26149 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:48.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.009+0000 7fe45353d740 1 -- 172.21.15.63:0/733527323 shutdown_connections 2024-09-21T06:32:48.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.009+0000 7fe45353d740 1 -- 172.21.15.63:0/733527323 wait complete. 2024-09-21T06:32:48.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.009+0000 7fe45353d740 20 client.26149 trim_cache size 0 max 16384 2024-09-21T06:32:48.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:47 smithi071 ceph-mon[34844]: pgmap v460: 97 pgs: 97 active+clean; 181 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.9 MiB/s wr, 1.01k op/s 2024-09-21T06:32:48.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.028+0000 7fe45353d740 1 Processor -- start 2024-09-21T06:32:48.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.028+0000 7fe45353d740 1 -- start start 2024-09-21T06:32:48.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.028+0000 7fe45353d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4a801b0 0x55afc4e68030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:48.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.029+0000 7fe45353d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4a88390 0x55afc4e51d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:48.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.029+0000 7fe45353d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4aa9070 0x55afc4e58f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:48.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.029+0000 7fe45353d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe448073420 con 0x55afc4aa9070 2024-09-21T06:32:48.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.029+0000 7fe45353d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe448075020 con 0x55afc4a88390 2024-09-21T06:32:48.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.029+0000 7fe45353d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe448073bb0 con 0x55afc4a801b0 2024-09-21T06:32:48.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.029+0000 7fe446d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4aa9070 0x55afc4e58f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:48.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.029+0000 7fe44659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4a801b0 0x55afc4e68030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:48.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.029+0000 7fe446d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4aa9070 0x55afc4e58f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52128/0 (socket says 172.21.15.63:52128) 2024-09-21T06:32:48.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.029+0000 7fe446d9d640 1 -- 172.21.15.63:0/931637063 learned_addr learned my addr 172.21.15.63:0/931637063 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:48.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.029+0000 7fe445d9b640 1 --2- 172.21.15.63:0/931637063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4a88390 0x55afc4e51d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:48.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.029+0000 7fe44659c640 1 -- 172.21.15.63:0/931637063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4a88390 msgr2=0x55afc4e51d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:48.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.029+0000 7fe44659c640 1 --2- 172.21.15.63:0/931637063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4a88390 0x55afc4e51d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.029+0000 7fe44659c640 1 -- 172.21.15.63:0/931637063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4aa9070 msgr2=0x55afc4e58f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:48.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.029+0000 7fe44659c640 1 --2- 172.21.15.63:0/931637063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4aa9070 0x55afc4e58f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.029+0000 7fe44659c640 1 -- 172.21.15.63:0/931637063 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afc4e5cdc0 con 0x55afc4a801b0 2024-09-21T06:32:48.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.029+0000 7fe446d9d640 1 --2- 172.21.15.63:0/931637063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4aa9070 0x55afc4e58f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:32:48.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.030+0000 7fe44659c640 1 --2- 172.21.15.63:0/931637063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4a801b0 0x55afc4e68030 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe4380e50f0 tx=0x7fe438003e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75f44cb49be04ae9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:48.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.031+0000 7fe42ffff640 1 -- 172.21.15.63:0/931637063 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4380a9e40 con 0x55afc4a801b0 2024-09-21T06:32:48.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.031+0000 7fe42ffff640 1 -- 172.21.15.63:0/931637063 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4380ad300 con 0x55afc4a801b0 2024-09-21T06:32:48.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.031+0000 7fe42ffff640 1 -- 172.21.15.63:0/931637063 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4380acf60 con 0x55afc4a801b0 2024-09-21T06:32:48.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.034+0000 7fe45353d740 1 -- 172.21.15.63:0/931637063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4a801b0 msgr2=0x55afc4e68030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:48.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.034+0000 7fe45353d740 1 --2- 172.21.15.63:0/931637063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4a801b0 0x55afc4e68030 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe4380e50f0 tx=0x7fe438003e90 comp rx=0 tx=0).stop 2024-09-21T06:32:48.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.034+0000 7fe45353d740 1 -- 172.21.15.63:0/931637063 shutdown_connections 2024-09-21T06:32:48.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.034+0000 7fe45353d740 1 --2- 172.21.15.63:0/931637063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4aa9070 0x55afc4e58f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.034+0000 7fe45353d740 1 --2- 172.21.15.63:0/931637063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4a88390 0x55afc4e51d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.034+0000 7fe45353d740 1 --2- 172.21.15.63:0/931637063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4a801b0 0x55afc4e68030 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.034+0000 7fe45353d740 1 -- 172.21.15.63:0/931637063 >> 172.21.15.63:0/931637063 conn(0x55afc4a9d460 msgr2=0x55afc4e51680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:48.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.034+0000 7fe45353d740 1 -- 172.21.15.63:0/931637063 shutdown_connections 2024-09-21T06:32:48.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.034+0000 7fe45353d740 1 -- 172.21.15.63:0/931637063 wait complete. 2024-09-21T06:32:48.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.035+0000 7fe45353d740 1 -- start start 2024-09-21T06:32:48.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.035+0000 7fe45353d740 1 Processor -- start 2024-09-21T06:32:48.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.035+0000 7fe45353d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4a801b0 0x55afc4e80650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:48.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.035+0000 7fe45353d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4a88390 0x55afc4e80b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:48.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.035+0000 7fe45353d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4aa9070 0x55afc4ee85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:48.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.035+0000 7fe45353d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe448074950 con 0x55afc4a88390 2024-09-21T06:32:48.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.035+0000 7fe45353d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe448074280 con 0x55afc4a801b0 2024-09-21T06:32:48.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.035+0000 7fe45353d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe448071400 con 0x55afc4aa9070 2024-09-21T06:32:48.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.036+0000 7fe44659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4a801b0 0x55afc4e80650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:48.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.036+0000 7fe44659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4a801b0 0x55afc4e80650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:35318/0 (socket says 172.21.15.63:35318) 2024-09-21T06:32:48.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.036+0000 7fe445d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4a88390 0x55afc4e80b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:48.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.036+0000 7fe44659c640 1 -- 172.21.15.63:0/1767099101 learned_addr learned my addr 172.21.15.63:0/1767099101 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:48.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.036+0000 7fe446d9d640 1 --2- 172.21.15.63:0/1767099101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4aa9070 0x55afc4ee85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:48.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.036+0000 7fe45353d740 10 client.0 _ll_register_callbacks cb 0x7fe4380eb3e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:48.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.036+0000 7fe44659c640 1 -- 172.21.15.63:0/1767099101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4aa9070 msgr2=0x55afc4ee85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:48.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.036+0000 7fe44659c640 1 --2- 172.21.15.63:0/1767099101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4aa9070 0x55afc4ee85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.036+0000 7fe44659c640 1 -- 172.21.15.63:0/1767099101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4a88390 msgr2=0x55afc4e80b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:48.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.036+0000 7fe44659c640 1 --2- 172.21.15.63:0/1767099101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4a88390 0x55afc4e80b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.036+0000 7fe44659c640 1 -- 172.21.15.63:0/1767099101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afc4ee8b70 con 0x55afc4a801b0 2024-09-21T06:32:48.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.036+0000 7fe446d9d640 1 --2- 172.21.15.63:0/1767099101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4aa9070 0x55afc4ee85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:48.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.036+0000 7fe44659c640 1 --2- 172.21.15.63:0/1767099101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4a801b0 0x55afc4e80650 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe4380e5150 tx=0x7fe438003cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a4d86cd46658321 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:48.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.036+0000 7fe42dffb640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:32:48.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.036+0000 7fe42dffb640 1 -- 172.21.15.63:0/1767099101 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4380d2020 con 0x55afc4a801b0 2024-09-21T06:32:48.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.037+0000 7fe42dffb640 1 -- 172.21.15.63:0/1767099101 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fe4380a9a60 con 0x55afc4a801b0 2024-09-21T06:32:48.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.037+0000 7fe45353d740 1 -- 172.21.15.63:0/1767099101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4380ad300 con 0x55afc4a801b0 2024-09-21T06:32:48.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.037+0000 7fe42dffb640 1 -- 172.21.15.63:0/1767099101 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fe4380ad140 con 0x55afc4a801b0 2024-09-21T06:32:48.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.037+0000 7fe45353d740 10 client.26096 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:48.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.037+0000 7fe45353d740 1 -- 172.21.15.63:0/1767099101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55afc4ee9dc0 con 0x55afc4a801b0 2024-09-21T06:32:48.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.037+0000 7fe42dffb640 1 -- 172.21.15.63:0/1767099101 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4380ad300 con 0x55afc4a801b0 2024-09-21T06:32:48.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.038+0000 7fe42dffb640 1 -- 172.21.15.63:0/1767099101 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7fe4380aeb20 con 0x55afc4a801b0 2024-09-21T06:32:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.038+0000 7fe45353d740 10 client.26096 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.038+0000 7fe45353d740 10 client.26096 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:32:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.038+0000 7fe45353d740 20 client.26096 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.038+0000 7fe45353d740 1 --2- 172.21.15.63:0/1767099101 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55afc4a3cda0 0x55afc4eec460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.038+0000 7fe45353d740 4 client.26096 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:32:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.038+0000 7fe45353d740 1 -- 172.21.15.63:0/1767099101 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55afc4dc4850 con 0x55afc4a3cda0 2024-09-21T06:32:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.038+0000 7fe445d9b640 1 --2- 172.21.15.63:0/1767099101 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55afc4a3cda0 0x55afc4eec460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.038+0000 7fe42dffb640 10 client.26096 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.038+0000 7fe445d9b640 1 --2- 172.21.15.63:0/1767099101 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55afc4a3cda0 0x55afc4eec460 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebd8a07686bec9cf server_cookie=3b1a176aef8745da in_seq=0 out_seq=0 2024-09-21T06:32:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.039+0000 7fe42dffb640 1 -- 172.21.15.63:0/1767099101 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x55afc4dc4850 con 0x55afc4a3cda0 2024-09-21T06:32:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.039+0000 7fe42dffb640 10 client.26096 handle_command_reply: tid=0 2024-09-21T06:32:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.039+0000 7fe45353d740 1 client.26096 shutdown 2024-09-21T06:32:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.039+0000 7fe45353d740 1 -- 172.21.15.63:0/1767099101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4a801b0 msgr2=0x55afc4e80650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.039+0000 7fe45353d740 1 --2- 172.21.15.63:0/1767099101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4a801b0 0x55afc4e80650 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe4380e5150 tx=0x7fe438003cf0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.039+0000 7fe45353d740 1 -- 172.21.15.63:0/1767099101 shutdown_connections 2024-09-21T06:32:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.039+0000 7fe45353d740 1 --2- 172.21.15.63:0/1767099101 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55afc4a3cda0 0x55afc4eec460 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.039+0000 7fe45353d740 1 --2- 172.21.15.63:0/1767099101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55afc4aa9070 0x55afc4ee85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.039+0000 7fe45353d740 1 --2- 172.21.15.63:0/1767099101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55afc4a88390 0x55afc4e80b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.039+0000 7fe45353d740 1 --2- 172.21.15.63:0/1767099101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55afc4a801b0 0x55afc4e80650 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.039+0000 7fe45353d740 1 -- 172.21.15.63:0/1767099101 >> 172.21.15.63:0/1767099101 conn(0x55afc4a9d460 msgr2=0x55afc4e52040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.039+0000 7fe42dffb640 0 client.26096 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.039+0000 7fe45353d740 1 -- 172.21.15.63:0/1767099101 shutdown_connections 2024-09-21T06:32:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.039+0000 7fe45353d740 1 -- 172.21.15.63:0/1767099101 wait complete. 2024-09-21T06:32:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.039+0000 7fe45353d740 20 client.26096 trim_cache size 0 max 16384 2024-09-21T06:32:48.045 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:32:48.045 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "no active scrubs running", 2024-09-21T06:32:48.045 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": {}, 2024-09-21T06:32:48.045 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:32:48.045 INFO:teuthology.orchestra.run.smithi063.stdout: "024d3c59-0b67-49a9-bf4a-e02d36691942": { 2024-09-21T06:32:48.045 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:32:14.282244+0000", 2024-09-21T06:32:48.045 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:32:48.045 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:32:48.045 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:32:48.045 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:32:48.045 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:32:48.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:32:48.045 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:32:48.046 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:31:27.507051+0000", 2024-09-21T06:32:48.046 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:32:48.046 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:32:48.046 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:32:48.046 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:32:48.046 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:32:48.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:32:48.046 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:32:48.046 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:32:48.046 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:32:48.046 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:32:48.046 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:32:48.047 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:32:48.047 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:32:48.047 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:32:48.047 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:32:48.047 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:32:48.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.040+0000 7fe44cfc9640 1 -- 172.21.15.63:0/3276252756 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe4300b6700 msgr2=0x7fe4300b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:48.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.040+0000 7fe44cfc9640 1 --2- 172.21.15.63:0/3276252756 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe4300b6700 0x7fe4300b8c10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe440005fd0 tx=0x7fe440009500 comp rx=0 tx=0).stop 2024-09-21T06:32:48.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.040+0000 7fe44cfc9640 1 -- 172.21.15.63:0/3276252756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe448103b90 msgr2=0x7fe44819a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:48.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.040+0000 7fe44cfc9640 1 --2- 172.21.15.63:0/3276252756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe448103b90 0x7fe44819a4d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe43800ea60 tx=0x7fe43800ef20 comp rx=0 tx=0).stop 2024-09-21T06:32:48.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.040+0000 7fe44cfc9640 1 -- 172.21.15.63:0/3276252756 shutdown_connections 2024-09-21T06:32:48.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.040+0000 7fe44cfc9640 1 --2- 172.21.15.63:0/3276252756 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe4300b6700 0x7fe4300b8c10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.040+0000 7fe44cfc9640 1 --2- 172.21.15.63:0/3276252756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe448109e20 0x7fe44819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.040+0000 7fe44cfc9640 1 --2- 172.21.15.63:0/3276252756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4481094d0 0x7fe44819aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.040+0000 7fe44cfc9640 1 --2- 172.21.15.63:0/3276252756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe448103b90 0x7fe44819a4d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:48.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.040+0000 7fe44cfc9640 1 -- 172.21.15.63:0/3276252756 >> 172.21.15.63:0/3276252756 conn(0x7fe4480ff5e0 msgr2=0x7fe448101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:48.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.040+0000 7fe44cfc9640 1 -- 172.21.15.63:0/3276252756 shutdown_connections 2024-09-21T06:32:48.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:48.040+0000 7fe44cfc9640 1 -- 172.21.15.63:0/3276252756 wait complete. 2024-09-21T06:32:49.707 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:32:49.708 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:32:49.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:49 smithi175 ceph-mon[34510]: pgmap v461: 97 pgs: 97 active+clean; 189 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.1 MiB/s wr, 1.10k op/s 2024-09-21T06:32:50.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:49 smithi071 ceph-mon[34844]: pgmap v461: 97 pgs: 97 active+clean; 189 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.1 MiB/s wr, 1.10k op/s 2024-09-21T06:32:50.031 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:32:50.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:49 smithi063 ceph-mon[31150]: pgmap v461: 97 pgs: 97 active+clean; 189 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.1 MiB/s wr, 1.10k op/s 2024-09-21T06:32:51.123 INFO:tasks.workunit.client.0.smithi063.stdout:copying to largest ever: 0x63ef9ee 2024-09-21T06:32:51.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:51 smithi175 ceph-mon[34510]: pgmap v462: 97 pgs: 97 active+clean; 193 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.8 MiB/s wr, 968 op/s 2024-09-21T06:32:52.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:51 smithi071 ceph-mon[34844]: pgmap v462: 97 pgs: 97 active+clean; 193 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.8 MiB/s wr, 968 op/s 2024-09-21T06:32:52.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:51 smithi063 ceph-mon[31150]: pgmap v462: 97 pgs: 97 active+clean; 193 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.8 MiB/s wr, 968 op/s 2024-09-21T06:32:52.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.249+0000 7fbb711ec640 1 -- 172.21.15.63:0/1287271003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb6c108cf0 msgr2=0x7fbb6c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:52.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.249+0000 7fbb711ec640 1 --2- 172.21.15.63:0/1287271003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb6c108cf0 0x7fbb6c10f520 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009860 tx=0x7fbb5c02a340 comp rx=0 tx=0).stop 2024-09-21T06:32:52.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.249+0000 7fbb711ec640 1 -- 172.21.15.63:0/1287271003 shutdown_connections 2024-09-21T06:32:52.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.249+0000 7fbb711ec640 1 --2- 172.21.15.63:0/1287271003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb6c108cf0 0x7fbb6c10f520 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:52.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.249+0000 7fbb711ec640 1 --2- 172.21.15.63:0/1287271003 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb6c1083a0 0x7fbb6c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:52.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.249+0000 7fbb711ec640 1 --2- 172.21.15.63:0/1287271003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb6c102a60 0x7fbb6c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:52.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.249+0000 7fbb711ec640 1 -- 172.21.15.63:0/1287271003 >> 172.21.15.63:0/1287271003 conn(0x7fbb6c079730 msgr2=0x7fbb6c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:52.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.249+0000 7fbb711ec640 1 -- 172.21.15.63:0/1287271003 shutdown_connections 2024-09-21T06:32:52.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.249+0000 7fbb711ec640 1 -- 172.21.15.63:0/1287271003 wait complete. 2024-09-21T06:32:52.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.250+0000 7fbb711ec640 1 Processor -- start 2024-09-21T06:32:52.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.250+0000 7fbb711ec640 1 -- start start 2024-09-21T06:32:52.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.250+0000 7fbb711ec640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb6c102a60 0x7fbb6c0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:52.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.250+0000 7fbb711ec640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb6c1083a0 0x7fbb6c0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:52.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.250+0000 7fbb711ec640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb6c108cf0 0x7fbb6c1000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:52.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.250+0000 7fbb711ec640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c112960 con 0x7fbb6c102a60 2024-09-21T06:32:52.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.250+0000 7fbb711ec640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c1127e0 con 0x7fbb6c108cf0 2024-09-21T06:32:52.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.250+0000 7fbb711ec640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c112ae0 con 0x7fbb6c1083a0 2024-09-21T06:32:52.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.250+0000 7fbb6ad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb6c102a60 0x7fbb6c0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:52.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.250+0000 7fbb6b59e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb6c108cf0 0x7fbb6c1000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:52.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.250+0000 7fbb6ad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb6c102a60 0x7fbb6c0ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52150/0 (socket says 172.21.15.63:52150) 2024-09-21T06:32:52.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.250+0000 7fbb6ad9d640 1 -- 172.21.15.63:0/2155145287 learned_addr learned my addr 172.21.15.63:0/2155145287 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:52.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.250+0000 7fbb6a59c640 1 --2- 172.21.15.63:0/2155145287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb6c1083a0 0x7fbb6c0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:52.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.251+0000 7fbb6b59e640 1 -- 172.21.15.63:0/2155145287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb6c1083a0 msgr2=0x7fbb6c0ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:52.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.251+0000 7fbb6b59e640 1 --2- 172.21.15.63:0/2155145287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb6c1083a0 0x7fbb6c0ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:52.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.251+0000 7fbb6b59e640 1 -- 172.21.15.63:0/2155145287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb6c102a60 msgr2=0x7fbb6c0ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:52.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.251+0000 7fbb6b59e640 1 --2- 172.21.15.63:0/2155145287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb6c102a60 0x7fbb6c0ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:52.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.251+0000 7fbb6b59e640 1 -- 172.21.15.63:0/2155145287 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6c1a8680 con 0x7fbb6c108cf0 2024-09-21T06:32:52.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.251+0000 7fbb6b59e640 1 --2- 172.21.15.63:0/2155145287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb6c108cf0 0x7fbb6c1000f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c02a930 tx=0x7fbb5c032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:52.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.251+0000 7fbb63fff640 1 -- 172.21.15.63:0/2155145287 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c040020 con 0x7fbb6c108cf0 2024-09-21T06:32:52.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.251+0000 7fbb711ec640 1 -- 172.21.15.63:0/2155145287 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb6c1a8910 con 0x7fbb6c108cf0 2024-09-21T06:32:52.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.251+0000 7fbb63fff640 1 -- 172.21.15.63:0/2155145287 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb5c030d50 con 0x7fbb6c108cf0 2024-09-21T06:32:52.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.251+0000 7fbb63fff640 1 -- 172.21.15.63:0/2155145287 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c037040 con 0x7fbb6c108cf0 2024-09-21T06:32:52.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.251+0000 7fbb711ec640 1 -- 172.21.15.63:0/2155145287 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb6c1a8df0 con 0x7fbb6c108cf0 2024-09-21T06:32:52.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.252+0000 7fbb711ec640 1 -- 172.21.15.63:0/2155145287 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb6c102e70 con 0x7fbb6c108cf0 2024-09-21T06:32:52.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.254+0000 7fbb63fff640 1 -- 172.21.15.63:0/2155145287 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fbb5c043020 con 0x7fbb6c108cf0 2024-09-21T06:32:52.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.255+0000 7fbb63fff640 1 --2- 172.21.15.63:0/2155145287 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbb580b6680 0x7fbb580b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:52.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.255+0000 7fbb6ad9d640 1 --2- 172.21.15.63:0/2155145287 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbb580b6680 0x7fbb580b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:52.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.255+0000 7fbb63fff640 1 -- 172.21.15.63:0/2155145287 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fbb5c107550 con 0x7fbb6c108cf0 2024-09-21T06:32:52.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.255+0000 7fbb6ad9d640 1 --2- 172.21.15.63:0/2155145287 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbb580b6680 0x7fbb580b8b90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c1010c0 tx=0x7fbb64009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:52.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.259+0000 7fbb63fff640 1 -- 172.21.15.63:0/2155145287 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbb5c04a020 con 0x7fbb6c108cf0 2024-09-21T06:32:52.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.531+0000 7fbb711ec640 1 -- 172.21.15.63:0/2155145287 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb6c100970 con 0x7fbb6c108cf0 2024-09-21T06:32:52.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.532+0000 7fbb63fff640 1 -- 172.21.15.63:0/2155145287 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+11978 (secure 0 0 0) 0x7fbb5c0cda80 con 0x7fbb6c108cf0 2024-09-21T06:32:52.534 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:32:52.535 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":43,"btime":"2024-09-21T06:30:43:391669+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":43,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:30:43.123943+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24659,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":34,"state":"up:active","state_seq":69,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25637":{"gid":25637,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3354670524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3354670524},{"type":"v1","addr":"172.21.15.71:6839","nonce":3354670524}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24659,"qdb_cluster":[24694,24670,24659,24676,14835]},"id":1}]} 2024-09-21T06:32:52.535 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 43 2024-09-21T06:32:52.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.535+0000 7fbb711ec640 1 -- 172.21.15.63:0/2155145287 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbb580b6680 msgr2=0x7fbb580b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:52.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.535+0000 7fbb711ec640 1 --2- 172.21.15.63:0/2155145287 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbb580b6680 0x7fbb580b8b90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c1010c0 tx=0x7fbb64009500 comp rx=0 tx=0).stop 2024-09-21T06:32:52.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.535+0000 7fbb711ec640 1 -- 172.21.15.63:0/2155145287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb6c108cf0 msgr2=0x7fbb6c1000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:52.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.535+0000 7fbb711ec640 1 --2- 172.21.15.63:0/2155145287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb6c108cf0 0x7fbb6c1000f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c02a930 tx=0x7fbb5c032d50 comp rx=0 tx=0).stop 2024-09-21T06:32:52.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.535+0000 7fbb711ec640 1 -- 172.21.15.63:0/2155145287 shutdown_connections 2024-09-21T06:32:52.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.535+0000 7fbb711ec640 1 --2- 172.21.15.63:0/2155145287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb6c108cf0 0x7fbb6c1000f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:52.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.535+0000 7fbb711ec640 1 --2- 172.21.15.63:0/2155145287 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbb580b6680 0x7fbb580b8b90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:52.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.535+0000 7fbb711ec640 1 --2- 172.21.15.63:0/2155145287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb6c1083a0 0x7fbb6c0ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:52.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.535+0000 7fbb711ec640 1 --2- 172.21.15.63:0/2155145287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb6c102a60 0x7fbb6c0ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:52.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.535+0000 7fbb711ec640 1 -- 172.21.15.63:0/2155145287 >> 172.21.15.63:0/2155145287 conn(0x7fbb6c079730 msgr2=0x7fbb6c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:52.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.535+0000 7fbb711ec640 1 -- 172.21.15.63:0/2155145287 shutdown_connections 2024-09-21T06:32:52.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:52.535+0000 7fbb711ec640 1 -- 172.21.15.63:0/2155145287 wait complete. 2024-09-21T06:32:52.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:52 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2155145287' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:32:52.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:52 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2155145287' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:32:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:32:52.965+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:32:52.966+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-21T06:32:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:32:52.966+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-21T06:32:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:32:52.966+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T06:32:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:32:52.966+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-09-21T06:32:53.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:52 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2155145287' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:32:53.569 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T06:32:53.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:53 smithi175 ceph-mon[34510]: pgmap v463: 97 pgs: 97 active+clean; 191 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.2 MiB/s wr, 1.15k op/s 2024-09-21T06:32:53.887 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:32:54.012 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:53 smithi063 ceph-mon[31150]: pgmap v463: 97 pgs: 97 active+clean; 191 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.2 MiB/s wr, 1.15k op/s 2024-09-21T06:32:54.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:53 smithi071 ceph-mon[34844]: pgmap v463: 97 pgs: 97 active+clean; 191 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.2 MiB/s wr, 1.15k op/s 2024-09-21T06:32:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.432+0000 7fcaa1abf640 1 -- 172.21.15.63:0/902815531 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca9c103b80 msgr2=0x7fca9c103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.432+0000 7fcaa1abf640 1 --2- 172.21.15.63:0/902815531 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca9c103b80 0x7fca9c103f90 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009900 tx=0x7fca8c02a410 comp rx=0 tx=0).stop 2024-09-21T06:32:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.432+0000 7fcaa1abf640 1 -- 172.21.15.63:0/902815531 shutdown_connections 2024-09-21T06:32:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.432+0000 7fcaa1abf640 1 --2- 172.21.15.63:0/902815531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca9c109e10 0x7fca9c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.432+0000 7fcaa1abf640 1 --2- 172.21.15.63:0/902815531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9c1094c0 0x7fca9c1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.432+0000 7fcaa1abf640 1 --2- 172.21.15.63:0/902815531 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca9c103b80 0x7fca9c103f90 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.432+0000 7fcaa1abf640 1 -- 172.21.15.63:0/902815531 >> 172.21.15.63:0/902815531 conn(0x7fca9c0ff610 msgr2=0x7fca9c101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.432+0000 7fcaa1abf640 1 -- 172.21.15.63:0/902815531 shutdown_connections 2024-09-21T06:32:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.432+0000 7fcaa1abf640 1 -- 172.21.15.63:0/902815531 wait complete. 2024-09-21T06:32:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.433+0000 7fcaa1abf640 1 Processor -- start 2024-09-21T06:32:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.433+0000 7fcaa1abf640 1 -- start start 2024-09-21T06:32:54.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.433+0000 7fcaa1abf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9c103b80 0x7fca9c19c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:54.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.433+0000 7fcaa1abf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca9c1094c0 0x7fca9c19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:54.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.434+0000 7fcaa1abf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca9c109e10 0x7fca9c1a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:54.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.434+0000 7fcaa1abf640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c113ad0 con 0x7fca9c109e10 2024-09-21T06:32:54.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.434+0000 7fcaa1abf640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c113950 con 0x7fca9c103b80 2024-09-21T06:32:54.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.434+0000 7fcaa1abf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c113c50 con 0x7fca9c1094c0 2024-09-21T06:32:54.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.434+0000 7fca9affd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca9c1094c0 0x7fca9c19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:54.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.434+0000 7fca9affd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca9c1094c0 0x7fca9c19cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:41720/0 (socket says 172.21.15.63:41720) 2024-09-21T06:32:54.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.434+0000 7fca9affd640 1 -- 172.21.15.63:0/2922866599 learned_addr learned my addr 172.21.15.63:0/2922866599 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:54.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.434+0000 7fca9b7fe640 1 --2- 172.21.15.63:0/2922866599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9c103b80 0x7fca9c19c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:54.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.434+0000 7fca9b7fe640 1 -- 172.21.15.63:0/2922866599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca9c1094c0 msgr2=0x7fca9c19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:54.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.434+0000 7fca9b7fe640 1 --2- 172.21.15.63:0/2922866599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca9c1094c0 0x7fca9c19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.434+0000 7fca9b7fe640 1 -- 172.21.15.63:0/2922866599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca9c109e10 msgr2=0x7fca9c1a1f20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T06:32:54.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.434+0000 7fca9b7fe640 1 --2- 172.21.15.63:0/2922866599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca9c109e10 0x7fca9c1a1f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.434+0000 7fca9b7fe640 1 -- 172.21.15.63:0/2922866599 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9c1a2650 con 0x7fca9c103b80 2024-09-21T06:32:54.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.435+0000 7fca9b7fe640 1 --2- 172.21.15.63:0/2922866599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9c103b80 0x7fca9c19c6e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fca8c02a930 tx=0x7fca8c031a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:54.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.437+0000 7fca98ff9640 1 -- 172.21.15.63:0/2922866599 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c050030 con 0x7fca9c103b80 2024-09-21T06:32:54.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.437+0000 7fca98ff9640 1 -- 172.21.15.63:0/2922866599 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca8c004490 con 0x7fca9c103b80 2024-09-21T06:32:54.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.437+0000 7fca98ff9640 1 -- 172.21.15.63:0/2922866599 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c035070 con 0x7fca9c103b80 2024-09-21T06:32:54.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.437+0000 7fcaa1abf640 1 -- 172.21.15.63:0/2922866599 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca9c1a28e0 con 0x7fca9c103b80 2024-09-21T06:32:54.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.438+0000 7fcaa1abf640 1 -- 172.21.15.63:0/2922866599 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca9c1a2cb0 con 0x7fca9c103b80 2024-09-21T06:32:54.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.440+0000 7fca98ff9640 1 -- 172.21.15.63:0/2922866599 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fca8c053030 con 0x7fca9c103b80 2024-09-21T06:32:54.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.440+0000 7fcaa8033740 1 Processor -- start 2024-09-21T06:32:54.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.441+0000 7fcaa8033740 1 -- start start 2024-09-21T06:32:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.441+0000 7fcaa8033740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561593030070 0x5615933d72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.441+0000 7fcaa8033740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5615930071b0 0x5615933d7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.441+0000 7fcaa8033740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56159300f390 0x5615933d7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.441+0000 7fcaa8033740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56159334dea0 con 0x5615930071b0 2024-09-21T06:32:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.441+0000 7fcaa8033740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56159333d2d0 con 0x561593030070 2024-09-21T06:32:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.441+0000 7fcaa8033740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5615933410e0 con 0x56159300f390 2024-09-21T06:32:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.441+0000 7fca9b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5615930071b0 0x5615933d7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.441+0000 7fca9bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561593030070 0x5615933d72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.441+0000 7fca9affd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56159300f390 0x5615933d7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.441+0000 7fca9bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561593030070 0x5615933d72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:35362/0 (socket says 172.21.15.63:35362) 2024-09-21T06:32:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.441+0000 7fca9bfff640 1 -- 172.21.15.63:0/751173382 learned_addr learned my addr 172.21.15.63:0/751173382 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.442+0000 7fca98ff9640 1 --2- 172.21.15.63:0/2922866599 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fca840b67d0 0x7fca840b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.442+0000 7fca9bfff640 1 -- 172.21.15.63:0/751173382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56159300f390 msgr2=0x5615933d7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:54.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.442+0000 7fca9bfff640 1 --2- 172.21.15.63:0/751173382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56159300f390 0x5615933d7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.442+0000 7fca9bfff640 1 -- 172.21.15.63:0/751173382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5615930071b0 msgr2=0x5615933d7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:54.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.442+0000 7fca9bfff640 1 --2- 172.21.15.63:0/751173382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5615930071b0 0x5615933d7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.442+0000 7fca9bfff640 1 -- 172.21.15.63:0/751173382 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56159309b650 con 0x561593030070 2024-09-21T06:32:54.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.442+0000 7fca98ff9640 1 -- 172.21.15.63:0/2922866599 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fca8c118b10 con 0x7fca9c103b80 2024-09-21T06:32:54.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.442+0000 7fca9bfff640 1 --2- 172.21.15.63:0/2922866599 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fca840b67d0 0x7fca840b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:54.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.442+0000 7fca9bfff640 1 --2- 172.21.15.63:0/751173382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561593030070 0x5615933d72c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fca94009e30 tx=0x7fca9400e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5395ffe96b51d255 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:54.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.442+0000 7fca81ffb640 1 -- 172.21.15.63:0/751173382 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9401a610 con 0x561593030070 2024-09-21T06:32:54.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.442+0000 7fca81ffb640 1 -- 172.21.15.63:0/751173382 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca94010e00 con 0x561593030070 2024-09-21T06:32:54.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.442+0000 7fca81ffb640 1 -- 172.21.15.63:0/751173382 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94019a00 con 0x561593030070 2024-09-21T06:32:54.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.443+0000 7fca9bfff640 1 --2- 172.21.15.63:0/2922866599 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fca840b67d0 0x7fca840b8ce0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fca9400f010 tx=0x7fca94021000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:54.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.443+0000 7fcaa8033740 1 -- 172.21.15.63:0/751173382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561593030070 msgr2=0x5615933d72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:54.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.443+0000 7fcaa8033740 1 --2- 172.21.15.63:0/751173382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561593030070 0x5615933d72c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fca94009e30 tx=0x7fca9400e720 comp rx=0 tx=0).stop 2024-09-21T06:32:54.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.444+0000 7fcaa8033740 1 -- 172.21.15.63:0/751173382 shutdown_connections 2024-09-21T06:32:54.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.444+0000 7fcaa8033740 1 --2- 172.21.15.63:0/751173382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56159300f390 0x5615933d7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.444+0000 7fcaa8033740 1 --2- 172.21.15.63:0/751173382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5615930071b0 0x5615933d7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.444+0000 7fcaa8033740 1 --2- 172.21.15.63:0/751173382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561593030070 0x5615933d72c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.444+0000 7fcaa8033740 1 -- 172.21.15.63:0/751173382 >> 172.21.15.63:0/751173382 conn(0x561593024460 msgr2=0x5615933d51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:54.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.444+0000 7fcaa8033740 1 -- 172.21.15.63:0/751173382 shutdown_connections 2024-09-21T06:32:54.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.444+0000 7fcaa8033740 1 -- 172.21.15.63:0/751173382 wait complete. 2024-09-21T06:32:54.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.444+0000 7fcaa8033740 1 -- start start 2024-09-21T06:32:54.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.445+0000 7fcaa8033740 1 Processor -- start 2024-09-21T06:32:54.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.445+0000 7fcaa8033740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615930071b0 0x5615933e29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:54.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.445+0000 7fcaa8033740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56159300f390 0x5615933e2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:54.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.445+0000 7fcaa8033740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561593030070 0x5615933f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:54.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.445+0000 7fcaa8033740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56159319e700 con 0x56159300f390 2024-09-21T06:32:54.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.445+0000 7fcaa8033740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5615932d8160 con 0x5615930071b0 2024-09-21T06:32:54.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.445+0000 7fcaa8033740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5615933e5aa0 con 0x561593030070 2024-09-21T06:32:54.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.445+0000 7fcaa8033740 10 client.0 _ll_register_callbacks cb 0x5615932f19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:54.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.445+0000 7fca9bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561593030070 0x5615933f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:54.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.445+0000 7fca9bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561593030070 0x5615933f75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:41740/0 (socket says 172.21.15.63:41740) 2024-09-21T06:32:54.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.445+0000 7fca9bfff640 1 -- 172.21.15.63:0/3285638973 learned_addr learned my addr 172.21.15.63:0/3285638973 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:54.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.446+0000 7fca9b7fe640 1 --2- 172.21.15.63:0/3285638973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615930071b0 0x5615933e29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:54.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.446+0000 7fca9affd640 1 --2- 172.21.15.63:0/3285638973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56159300f390 0x5615933e2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:54.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.446+0000 7fca9bfff640 1 -- 172.21.15.63:0/3285638973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615930071b0 msgr2=0x5615933e29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:54.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.446+0000 7fca9bfff640 1 --2- 172.21.15.63:0/3285638973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615930071b0 0x5615933e29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.446+0000 7fca9bfff640 1 -- 172.21.15.63:0/3285638973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56159300f390 msgr2=0x5615933e2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:54.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.446+0000 7fca9bfff640 1 --2- 172.21.15.63:0/3285638973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56159300f390 0x5615933e2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.446+0000 7fca9bfff640 1 -- 172.21.15.63:0/3285638973 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561593305c90 con 0x561593030070 2024-09-21T06:32:54.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.447+0000 7fca9bfff640 1 --2- 172.21.15.63:0/3285638973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561593030070 0x5615933f75a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fca94006010 tx=0x7fca94005b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cf0c4d892565e41 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:54.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.447+0000 7fca7affd640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:32:54.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.447+0000 7fca7affd640 1 -- 172.21.15.63:0/3285638973 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca940193d0 con 0x561593030070 2024-09-21T06:32:54.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.447+0000 7fca7affd640 1 -- 172.21.15.63:0/3285638973 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fca9402c070 con 0x561593030070 2024-09-21T06:32:54.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.447+0000 7fcaa8033740 1 -- 172.21.15.63:0/3285638973 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca94010e00 con 0x561593030070 2024-09-21T06:32:54.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.448+0000 7fca7affd640 1 -- 172.21.15.63:0/3285638973 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fca9403d050 con 0x561593030070 2024-09-21T06:32:54.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.448+0000 7fcaa8033740 10 client.26173 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:54.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.448+0000 7fcaa8033740 1 -- 172.21.15.63:0/3285638973 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5615933f9f90 con 0x561593030070 2024-09-21T06:32:54.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.449+0000 7fca7affd640 1 -- 172.21.15.63:0/3285638973 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca94010e00 con 0x561593030070 2024-09-21T06:32:54.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.449+0000 7fca7affd640 1 -- 172.21.15.63:0/3285638973 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7fca94004040 con 0x561593030070 2024-09-21T06:32:54.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.449+0000 7fcaa8033740 10 client.26173 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:54.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.449+0000 7fcaa8033740 10 client.26173 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:32:54.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.449+0000 7fcaa8033740 20 client.26173 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:54.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.449+0000 7fcaa8033740 1 --2- 172.21.15.63:0/3285638973 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x561592fee9f0 0x5615933fd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:54.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.449+0000 7fcaa8033740 4 client.26173 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:32:54.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.449+0000 7fcaa8033740 1 -- 172.21.15.63:0/3285638973 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56159334fdf0 con 0x561592fee9f0 2024-09-21T06:32:54.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.450+0000 7fca9b7fe640 1 --2- 172.21.15.63:0/3285638973 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x561592fee9f0 0x5615933fd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:54.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.450+0000 7fca9b7fe640 1 --2- 172.21.15.63:0/3285638973 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x561592fee9f0 0x5615933fd7b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7a58e8cedcd6fe94 server_cookie=f9c1feeff78c53b3 in_seq=0 out_seq=0 2024-09-21T06:32:54.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.450+0000 7fca7affd640 10 client.26173 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:32:54.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.451+0000 7fca7affd640 1 -- 172.21.15.63:0/3285638973 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56159334fdf0 con 0x561592fee9f0 2024-09-21T06:32:54.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.451+0000 7fca7affd640 10 client.26173 handle_command_reply: tid=0 2024-09-21T06:32:54.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.451+0000 7fcaa8033740 1 client.26173 shutdown 2024-09-21T06:32:54.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.452+0000 7fcaa8033740 1 -- 172.21.15.63:0/3285638973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561593030070 msgr2=0x5615933f75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:54.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.452+0000 7fcaa8033740 1 --2- 172.21.15.63:0/3285638973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561593030070 0x5615933f75a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fca94006010 tx=0x7fca94005b70 comp rx=0 tx=0).stop 2024-09-21T06:32:54.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.452+0000 7fcaa8033740 1 -- 172.21.15.63:0/3285638973 shutdown_connections 2024-09-21T06:32:54.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.452+0000 7fcaa8033740 1 --2- 172.21.15.63:0/3285638973 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x561592fee9f0 0x5615933fd7b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.452+0000 7fcaa8033740 1 --2- 172.21.15.63:0/3285638973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561593030070 0x5615933f75a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.452+0000 7fcaa8033740 1 --2- 172.21.15.63:0/3285638973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56159300f390 0x5615933e2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.452+0000 7fcaa8033740 1 --2- 172.21.15.63:0/3285638973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615930071b0 0x5615933e29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.452+0000 7fcaa8033740 1 -- 172.21.15.63:0/3285638973 >> 172.21.15.63:0/3285638973 conn(0x561593024460 msgr2=0x5615933da4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:54.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.452+0000 7fca7affd640 0 client.26173 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:32:54.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.452+0000 7fcaa8033740 1 -- 172.21.15.63:0/3285638973 shutdown_connections 2024-09-21T06:32:54.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.452+0000 7fcaa8033740 1 -- 172.21.15.63:0/3285638973 wait complete. 2024-09-21T06:32:54.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.452+0000 7fcaa8033740 20 client.26173 trim_cache size 0 max 16384 2024-09-21T06:32:54.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.469+0000 7fcaa8033740 1 Processor -- start 2024-09-21T06:32:54.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.469+0000 7fcaa8033740 1 -- start start 2024-09-21T06:32:54.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.469+0000 7fcaa8033740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615930071b0 0x5615933d8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:54.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.469+0000 7fcaa8033740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56159300f390 0x5615933d4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:54.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.469+0000 7fcaa8033740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561593030070 0x5615933d4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:54.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.469+0000 7fcaa8033740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c071320 con 0x56159300f390 2024-09-21T06:32:54.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.469+0000 7fcaa8033740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c072f20 con 0x5615930071b0 2024-09-21T06:32:54.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.469+0000 7fcaa8033740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c071ab0 con 0x561593030070 2024-09-21T06:32:54.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.469+0000 7fca9affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56159300f390 0x5615933d4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:54.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.469+0000 7fca9affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56159300f390 0x5615933d4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52164/0 (socket says 172.21.15.63:52164) 2024-09-21T06:32:54.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.469+0000 7fca9affd640 1 -- 172.21.15.63:0/3314441547 learned_addr learned my addr 172.21.15.63:0/3314441547 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:54.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.469+0000 7fca9b7fe640 1 --2- 172.21.15.63:0/3314441547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615930071b0 0x5615933d8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:54.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.470+0000 7fca9b7fe640 1 -- 172.21.15.63:0/3314441547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561593030070 msgr2=0x5615933d4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.470+0000 7fca9b7fe640 1 --2- 172.21.15.63:0/3314441547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561593030070 0x5615933d4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.470+0000 7fca9b7fe640 1 -- 172.21.15.63:0/3314441547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56159300f390 msgr2=0x5615933d4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.470+0000 7fca9b7fe640 1 --2- 172.21.15.63:0/3314441547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56159300f390 0x5615933d4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.470+0000 7fca9b7fe640 1 -- 172.21.15.63:0/3314441547 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615933dd5f0 con 0x5615930071b0 2024-09-21T06:32:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.470+0000 7fca9affd640 1 --2- 172.21.15.63:0/3314441547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56159300f390 0x5615933d4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.470+0000 7fca9b7fe640 1 --2- 172.21.15.63:0/3314441547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615930071b0 0x5615933d8a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca8c1161e0 tx=0x7fca8c11af60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c56b4adcf85615e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.470+0000 7fca817fa640 1 -- 172.21.15.63:0/3314441547 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c05a040 con 0x5615930071b0 2024-09-21T06:32:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.470+0000 7fca817fa640 1 -- 172.21.15.63:0/3314441547 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca8c120040 con 0x5615930071b0 2024-09-21T06:32:54.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.470+0000 7fca817fa640 1 -- 172.21.15.63:0/3314441547 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c0de3f0 con 0x5615930071b0 2024-09-21T06:32:54.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.471+0000 7fcaa8033740 1 -- 172.21.15.63:0/3314441547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615930071b0 msgr2=0x5615933d8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:54.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.471+0000 7fcaa8033740 1 --2- 172.21.15.63:0/3314441547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615930071b0 0x5615933d8a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca8c1161e0 tx=0x7fca8c11af60 comp rx=0 tx=0).stop 2024-09-21T06:32:54.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.471+0000 7fcaa8033740 1 -- 172.21.15.63:0/3314441547 shutdown_connections 2024-09-21T06:32:54.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.471+0000 7fcaa8033740 1 --2- 172.21.15.63:0/3314441547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561593030070 0x5615933d4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.471+0000 7fcaa8033740 1 --2- 172.21.15.63:0/3314441547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56159300f390 0x5615933d4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.471+0000 7fcaa8033740 1 --2- 172.21.15.63:0/3314441547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615930071b0 0x5615933d8a00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.471+0000 7fcaa8033740 1 -- 172.21.15.63:0/3314441547 >> 172.21.15.63:0/3314441547 conn(0x561593024460 msgr2=0x5615933d82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:54.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.471+0000 7fcaa8033740 1 -- 172.21.15.63:0/3314441547 shutdown_connections 2024-09-21T06:32:54.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.471+0000 7fcaa8033740 1 -- 172.21.15.63:0/3314441547 wait complete. 2024-09-21T06:32:54.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.472+0000 7fcaa8033740 1 -- start start 2024-09-21T06:32:54.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.472+0000 7fcaa8033740 1 Processor -- start 2024-09-21T06:32:54.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.473+0000 7fcaa8033740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615930071b0 0x5615933eee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:54.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.473+0000 7fcaa8033740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56159300f390 0x5615933ef430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:54.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.473+0000 7fcaa8033740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561593030070 0x5615934601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:54.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.473+0000 7fcaa8033740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c072850 con 0x56159300f390 2024-09-21T06:32:54.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.473+0000 7fcaa8033740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c072180 con 0x5615930071b0 2024-09-21T06:32:54.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.473+0000 7fcaa8033740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c06f320 con 0x561593030070 2024-09-21T06:32:54.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.473+0000 7fcaa8033740 10 client.0 _ll_register_callbacks cb 0x7fca9401d020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:54.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.473+0000 7fca9b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615930071b0 0x5615933eee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:54.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.473+0000 7fca9b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615930071b0 0x5615933eee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:35388/0 (socket says 172.21.15.63:35388) 2024-09-21T06:32:54.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.473+0000 7fca9b7fe640 1 -- 172.21.15.63:0/215961919 learned_addr learned my addr 172.21.15.63:0/215961919 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:54.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.473+0000 7fca9affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56159300f390 0x5615933ef430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:54.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.473+0000 7fca9bfff640 1 --2- 172.21.15.63:0/215961919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561593030070 0x5615934601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:54.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.473+0000 7fca9b7fe640 1 -- 172.21.15.63:0/215961919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561593030070 msgr2=0x5615934601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:54.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.473+0000 7fca9b7fe640 1 --2- 172.21.15.63:0/215961919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561593030070 0x5615934601e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.473+0000 7fca9b7fe640 1 -- 172.21.15.63:0/215961919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56159300f390 msgr2=0x5615933ef430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:54.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.473+0000 7fca9b7fe640 1 --2- 172.21.15.63:0/215961919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56159300f390 0x5615933ef430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.473+0000 7fca9b7fe640 1 -- 172.21.15.63:0/215961919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561593460850 con 0x5615930071b0 2024-09-21T06:32:54.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.474+0000 7fca9b7fe640 1 --2- 172.21.15.63:0/215961919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615930071b0 0x5615933eee70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0de1c0 tx=0x7fca8c031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=944595e577d42879 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:54.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.474+0000 7fca7affd640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:32:54.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.474+0000 7fca7affd640 1 -- 172.21.15.63:0/215961919 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c08b070 con 0x5615930071b0 2024-09-21T06:32:54.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.474+0000 7fca7affd640 1 -- 172.21.15.63:0/215961919 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fca8c0e8070 con 0x5615930071b0 2024-09-21T06:32:54.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.474+0000 7fcaa8033740 1 -- 172.21.15.63:0/215961919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca8c120040 con 0x5615930071b0 2024-09-21T06:32:54.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.474+0000 7fca7affd640 1 -- 172.21.15.63:0/215961919 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fca8c05a070 con 0x5615930071b0 2024-09-21T06:32:54.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.474+0000 7fcaa8033740 10 client.26120 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:54.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.474+0000 7fcaa8033740 1 -- 172.21.15.63:0/215961919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x561593467b50 con 0x5615930071b0 2024-09-21T06:32:54.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.474+0000 7fca7affd640 1 -- 172.21.15.63:0/215961919 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca8c120040 con 0x5615930071b0 2024-09-21T06:32:54.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.474+0000 7fca7affd640 1 -- 172.21.15.63:0/215961919 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7fca8c0da230 con 0x5615930071b0 2024-09-21T06:32:54.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.475+0000 7fcaa8033740 10 client.26120 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:54.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.475+0000 7fcaa8033740 10 client.26120 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:32:54.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.475+0000 7fcaa8033740 20 client.26120 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:54.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.475+0000 7fcaa8033740 1 --2- 172.21.15.63:0/215961919 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x561592fc3da0 0x56159346a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:54.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.475+0000 7fcaa8033740 4 client.26120 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:32:54.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.475+0000 7fcaa8033740 1 -- 172.21.15.63:0/215961919 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56159334b8a0 con 0x561592fc3da0 2024-09-21T06:32:54.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.475+0000 7fca9affd640 1 --2- 172.21.15.63:0/215961919 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x561592fc3da0 0x56159346a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:54.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.476+0000 7fca7affd640 10 client.26120 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:32:54.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.476+0000 7fca9affd640 1 --2- 172.21.15.63:0/215961919 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x561592fc3da0 0x56159346a250 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5481e6a7e69601d8 server_cookie=daf473eae1fe3403 in_seq=0 out_seq=0 2024-09-21T06:32:54.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.476+0000 7fca7affd640 1 -- 172.21.15.63:0/215961919 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56159334b8a0 con 0x561592fc3da0 2024-09-21T06:32:54.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.476+0000 7fca7affd640 10 client.26120 handle_command_reply: tid=0 2024-09-21T06:32:54.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.476+0000 7fcaa8033740 1 client.26120 shutdown 2024-09-21T06:32:54.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.476+0000 7fcaa8033740 1 -- 172.21.15.63:0/215961919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615930071b0 msgr2=0x5615933eee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:54.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.476+0000 7fcaa8033740 1 --2- 172.21.15.63:0/215961919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615930071b0 0x5615933eee70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0de1c0 tx=0x7fca8c031400 comp rx=0 tx=0).stop 2024-09-21T06:32:54.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.476+0000 7fcaa8033740 1 -- 172.21.15.63:0/215961919 shutdown_connections 2024-09-21T06:32:54.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.476+0000 7fcaa8033740 1 --2- 172.21.15.63:0/215961919 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x561592fc3da0 0x56159346a250 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.476+0000 7fcaa8033740 1 --2- 172.21.15.63:0/215961919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561593030070 0x5615934601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.476+0000 7fca7affd640 0 client.26120 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:32:54.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.476+0000 7fcaa8033740 1 --2- 172.21.15.63:0/215961919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56159300f390 0x5615933ef430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.476+0000 7fcaa8033740 1 --2- 172.21.15.63:0/215961919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615930071b0 0x5615933eee70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.476+0000 7fcaa8033740 1 -- 172.21.15.63:0/215961919 >> 172.21.15.63:0/215961919 conn(0x561593024460 msgr2=0x5615933e3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:54.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.477+0000 7fcaa8033740 1 -- 172.21.15.63:0/215961919 shutdown_connections 2024-09-21T06:32:54.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.477+0000 7fcaa8033740 1 -- 172.21.15.63:0/215961919 wait complete. 2024-09-21T06:32:54.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.477+0000 7fcaa8033740 20 client.26120 trim_cache size 0 max 16384 2024-09-21T06:32:54.482 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:32:54.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.477+0000 7fcaa1abf640 1 -- 172.21.15.63:0/2922866599 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fca840b67d0 msgr2=0x7fca840b8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:54.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.477+0000 7fcaa1abf640 1 --2- 172.21.15.63:0/2922866599 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fca840b67d0 0x7fca840b8ce0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fca9400f010 tx=0x7fca94021000 comp rx=0 tx=0).stop 2024-09-21T06:32:54.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.477+0000 7fcaa1abf640 1 -- 172.21.15.63:0/2922866599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9c103b80 msgr2=0x7fca9c19c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:54.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.477+0000 7fcaa1abf640 1 --2- 172.21.15.63:0/2922866599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9c103b80 0x7fca9c19c6e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fca8c02a930 tx=0x7fca8c031a40 comp rx=0 tx=0).stop 2024-09-21T06:32:54.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.478+0000 7fcaa1abf640 1 -- 172.21.15.63:0/2922866599 shutdown_connections 2024-09-21T06:32:54.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.478+0000 7fcaa1abf640 1 --2- 172.21.15.63:0/2922866599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca9c109e10 0x7fca9c1a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.478+0000 7fcaa1abf640 1 --2- 172.21.15.63:0/2922866599 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fca840b67d0 0x7fca840b8ce0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.478+0000 7fcaa1abf640 1 --2- 172.21.15.63:0/2922866599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca9c1094c0 0x7fca9c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.478+0000 7fcaa1abf640 1 --2- 172.21.15.63:0/2922866599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9c103b80 0x7fca9c19c6e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:54.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.478+0000 7fcaa1abf640 1 -- 172.21.15.63:0/2922866599 >> 172.21.15.63:0/2922866599 conn(0x7fca9c0ff610 msgr2=0x7fca9c10e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:54.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.478+0000 7fcaa1abf640 1 -- 172.21.15.63:0/2922866599 shutdown_connections 2024-09-21T06:32:54.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:54.478+0000 7fcaa1abf640 1 -- 172.21.15.63:0/2922866599 wait complete. 2024-09-21T06:32:55.276 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:32:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:32:55.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:55 smithi175 ceph-mon[34510]: pgmap v464: 97 pgs: 97 active+clean; 189 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 901 op/s 2024-09-21T06:32:55.883 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:55 smithi063 ceph-mon[31150]: pgmap v464: 97 pgs: 97 active+clean; 189 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 901 op/s 2024-09-21T06:32:56.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:55 smithi071 ceph-mon[34844]: pgmap v464: 97 pgs: 97 active+clean; 189 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 901 op/s 2024-09-21T06:32:56.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.160+0000 7f448e8cd640 1 -- 172.21.15.63:0/1364385746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4488106280 msgr2=0x7f4488106690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:56.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.160+0000 7f448e8cd640 1 --2- 172.21.15.63:0/1364385746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4488106280 0x7f4488106690 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f447c009930 tx=0x7f447c02a420 comp rx=0 tx=0).stop 2024-09-21T06:32:56.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.160+0000 7f448e8cd640 1 -- 172.21.15.63:0/1364385746 shutdown_connections 2024-09-21T06:32:56.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.160+0000 7f448e8cd640 1 --2- 172.21.15.63:0/1364385746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4488106bd0 0x7f4488110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.160+0000 7f448e8cd640 1 --2- 172.21.15.63:0/1364385746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4488106280 0x7f4488106690 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.160+0000 7f448e8cd640 1 --2- 172.21.15.63:0/1364385746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4488102030 0x7f4488102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.161+0000 7f448e8cd640 1 -- 172.21.15.63:0/1364385746 >> 172.21.15.63:0/1364385746 conn(0x7f4488077c60 msgr2=0x7f44880780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:56.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.161+0000 7f448e8cd640 1 -- 172.21.15.63:0/1364385746 shutdown_connections 2024-09-21T06:32:56.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.161+0000 7f448e8cd640 1 -- 172.21.15.63:0/1364385746 wait complete. 2024-09-21T06:32:56.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.161+0000 7f448e8cd640 1 Processor -- start 2024-09-21T06:32:56.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.161+0000 7f448e8cd640 1 -- start start 2024-09-21T06:32:56.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.162+0000 7f448e8cd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4488102030 0x7f448819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:56.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.162+0000 7f448e8cd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4488106280 0x7f448819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:56.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.162+0000 7f448e8cd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4488106bd0 0x7f448819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:56.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.162+0000 7f448e8cd640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4488113af0 con 0x7f4488106bd0 2024-09-21T06:32:56.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.162+0000 7f448e8cd640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4488113970 con 0x7f4488102030 2024-09-21T06:32:56.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.162+0000 7f448e8cd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4488113c70 con 0x7f4488106280 2024-09-21T06:32:56.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.162+0000 7f4487fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4488102030 0x7f448819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:56.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.162+0000 7f4487fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4488102030 0x7f448819a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:35418/0 (socket says 172.21.15.63:35418) 2024-09-21T06:32:56.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.162+0000 7f44877fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4488106280 0x7f448819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:56.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.162+0000 7f448ce6a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4488106bd0 0x7f448819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:56.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.162+0000 7f4487fff640 1 -- 172.21.15.63:0/1917664735 learned_addr learned my addr 172.21.15.63:0/1917664735 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:56.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.162+0000 7f4487fff640 1 -- 172.21.15.63:0/1917664735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4488106280 msgr2=0x7f448819aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.162+0000 7f4487fff640 1 --2- 172.21.15.63:0/1917664735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4488106280 0x7f448819aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.162+0000 7f4487fff640 1 -- 172.21.15.63:0/1917664735 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4488106bd0 msgr2=0x7f448819fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.162+0000 7f4487fff640 1 --2- 172.21.15.63:0/1917664735 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4488106bd0 0x7f448819fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.162+0000 7f4487fff640 1 -- 172.21.15.63:0/1917664735 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44881a0450 con 0x7f4488102030 2024-09-21T06:32:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.163+0000 7f4487fff640 1 --2- 172.21.15.63:0/1917664735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4488102030 0x7f448819a4e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4478009c70 tx=0x7f447800d6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.163+0000 7f44857fa640 1 -- 172.21.15.63:0/1917664735 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4478004020 con 0x7f4488102030 2024-09-21T06:32:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.163+0000 7f44857fa640 1 -- 172.21.15.63:0/1917664735 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44780041c0 con 0x7f4488102030 2024-09-21T06:32:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.163+0000 7f44857fa640 1 -- 172.21.15.63:0/1917664735 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447800f620 con 0x7f4488102030 2024-09-21T06:32:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.163+0000 7f448e8cd640 1 -- 172.21.15.63:0/1917664735 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44881a0740 con 0x7f4488102030 2024-09-21T06:32:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.163+0000 7f448e8cd640 1 -- 172.21.15.63:0/1917664735 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4488102eb0 con 0x7f4488102030 2024-09-21T06:32:56.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.166+0000 7f44857fa640 1 -- 172.21.15.63:0/1917664735 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f447800f7c0 con 0x7f4488102030 2024-09-21T06:32:56.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.166+0000 7f4494e41740 1 Processor -- start 2024-09-21T06:32:56.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.166+0000 7f4494e41740 1 -- start start 2024-09-21T06:32:56.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.166+0000 7f4494e41740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 0x5640fdaaa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:56.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.166+0000 7f4494e41740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6da1b0 0x5640fdaaa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:56.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.166+0000 7f4494e41740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6e2390 0x5640fdaaad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:56.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.166+0000 7f4494e41740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5640fda20ea0 con 0x5640fd6e2390 2024-09-21T06:32:56.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.166+0000 7f4494e41740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5640fda102d0 con 0x5640fd6da1b0 2024-09-21T06:32:56.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.166+0000 7f4494e41740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5640fda140e0 con 0x5640fd703070 2024-09-21T06:32:56.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.167+0000 7f448ce6a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 0x5640fdaaa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:56.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.167+0000 7f44877fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6e2390 0x5640fdaaad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:56.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.167+0000 7f448ce6a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 0x5640fdaaa2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:41782/0 (socket says 172.21.15.63:41782) 2024-09-21T06:32:56.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.167+0000 7f44877fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6e2390 0x5640fdaaad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52192/0 (socket says 172.21.15.63:52192) 2024-09-21T06:32:56.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.167+0000 7f448ce6a640 1 -- 172.21.15.63:0/2478763063 learned_addr learned my addr 172.21.15.63:0/2478763063 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:56.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.167+0000 7f4487fff640 1 --2- 172.21.15.63:0/2478763063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6da1b0 0x5640fdaaa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:56.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.167+0000 7f448ce6a640 1 -- 172.21.15.63:0/2478763063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6da1b0 msgr2=0x5640fdaaa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:56.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.167+0000 7f448ce6a640 1 --2- 172.21.15.63:0/2478763063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6da1b0 0x5640fdaaa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.167+0000 7f448ce6a640 1 -- 172.21.15.63:0/2478763063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6e2390 msgr2=0x5640fdaaad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:56.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.167+0000 7f448ce6a640 1 --2- 172.21.15.63:0/2478763063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6e2390 0x5640fdaaad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.167+0000 7f448ce6a640 1 -- 172.21.15.63:0/2478763063 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640fd76e650 con 0x5640fd703070 2024-09-21T06:32:56.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.167+0000 7f44877fe640 1 --2- 172.21.15.63:0/2478763063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6e2390 0x5640fdaaad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:56.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.167+0000 7f448ce6a640 1 --2- 172.21.15.63:0/2478763063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 0x5640fdaaa2c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4480009c30 tx=0x7f4480009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a4fc8280e7e08db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:56.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.167+0000 7f44857fa640 1 --2- 172.21.15.63:0/1917664735 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f44700b6700 0x7f44700b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:56.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.168+0000 7f446e7fc640 1 -- 172.21.15.63:0/2478763063 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448000bcb0 con 0x5640fd703070 2024-09-21T06:32:56.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.168+0000 7f446e7fc640 1 -- 172.21.15.63:0/2478763063 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f448000be50 con 0x5640fd703070 2024-09-21T06:32:56.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.168+0000 7f446e7fc640 1 -- 172.21.15.63:0/2478763063 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448001e400 con 0x5640fd703070 2024-09-21T06:32:56.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.168+0000 7f4487fff640 1 --2- 172.21.15.63:0/1917664735 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f44700b6700 0x7f44700b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:56.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.168+0000 7f44857fa640 1 -- 172.21.15.63:0/1917664735 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f44780e7b70 con 0x7f4488102030 2024-09-21T06:32:56.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.169+0000 7f4494e41740 1 -- 172.21.15.63:0/2478763063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 msgr2=0x5640fdaaa2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:56.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.169+0000 7f4494e41740 1 --2- 172.21.15.63:0/2478763063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 0x5640fdaaa2c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4480009c30 tx=0x7f4480009500 comp rx=0 tx=0).stop 2024-09-21T06:32:56.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.169+0000 7f4487fff640 1 --2- 172.21.15.63:0/1917664735 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f44700b6700 0x7f44700b8c10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x5640fdaa8f40 tx=0x7f4478003b30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:56.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.169+0000 7f4494e41740 1 -- 172.21.15.63:0/2478763063 shutdown_connections 2024-09-21T06:32:56.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.169+0000 7f4494e41740 1 --2- 172.21.15.63:0/2478763063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6e2390 0x5640fdaaad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.169+0000 7f4494e41740 1 --2- 172.21.15.63:0/2478763063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6da1b0 0x5640fdaaa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.169+0000 7f4494e41740 1 --2- 172.21.15.63:0/2478763063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 0x5640fdaaa2c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.169+0000 7f4494e41740 1 -- 172.21.15.63:0/2478763063 >> 172.21.15.63:0/2478763063 conn(0x5640fd6f7460 msgr2=0x5640fdaa81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:56.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.169+0000 7f4494e41740 1 -- 172.21.15.63:0/2478763063 shutdown_connections 2024-09-21T06:32:56.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.169+0000 7f4494e41740 1 -- 172.21.15.63:0/2478763063 wait complete. 2024-09-21T06:32:56.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.170+0000 7f4494e41740 1 -- start start 2024-09-21T06:32:56.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.170+0000 7f4494e41740 1 Processor -- start 2024-09-21T06:32:56.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.170+0000 7f4494e41740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6da1b0 0x5640fdab5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:56.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.170+0000 7f4494e41740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6e2390 0x5640fdab5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:56.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.171+0000 7f448ce6a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6da1b0 0x5640fdab5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:56.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.171+0000 7f4494e41740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 0x5640fdac1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:56.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.171+0000 7f4494e41740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5640fd871700 con 0x5640fd6da1b0 2024-09-21T06:32:56.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.171+0000 7f4494e41740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5640fd9ab160 con 0x5640fd6e2390 2024-09-21T06:32:56.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.171+0000 7f4494e41740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5640fdab8aa0 con 0x5640fd703070 2024-09-21T06:32:56.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.171+0000 7f448ce6a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6da1b0 0x5640fdab5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52206/0 (socket says 172.21.15.63:52206) 2024-09-21T06:32:56.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.171+0000 7f448ce6a640 1 -- 172.21.15.63:0/3332044008 learned_addr learned my addr 172.21.15.63:0/3332044008 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:56.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.171+0000 7f44877fe640 1 --2- 172.21.15.63:0/3332044008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6e2390 0x5640fdab5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:56.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.171+0000 7f4494e41740 10 client.0 _ll_register_callbacks cb 0x5640fd9c49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:56.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.171+0000 7f448ce6a640 1 --2- 172.21.15.63:0/3332044008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 0x5640fdac1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:56.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.171+0000 7f448ce6a640 1 -- 172.21.15.63:0/3332044008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 msgr2=0x5640fdac1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:56.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.171+0000 7f448ce6a640 1 --2- 172.21.15.63:0/3332044008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 0x5640fdac1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.171+0000 7f448ce6a640 1 -- 172.21.15.63:0/3332044008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6e2390 msgr2=0x5640fdab5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:56.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.171+0000 7f448ce6a640 1 --2- 172.21.15.63:0/3332044008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6e2390 0x5640fdab5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.171+0000 7f448ce6a640 1 -- 172.21.15.63:0/3332044008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640fd9d8c90 con 0x5640fd6da1b0 2024-09-21T06:32:56.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.171+0000 7f44877fe640 1 --2- 172.21.15.63:0/3332044008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6e2390 0x5640fdab5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:32:56.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.171+0000 7f448ce6a640 1 --2- 172.21.15.63:0/3332044008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6da1b0 0x5640fdab5920 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f44800045a0 tx=0x7f44800044a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0eb76d8e1fc643 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:56.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.171+0000 7f44677fe640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:32:56.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.172+0000 7f44677fe640 1 -- 172.21.15.63:0/3332044008 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4480034060 con 0x5640fd6da1b0 2024-09-21T06:32:56.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.172+0000 7f44677fe640 1 -- 172.21.15.63:0/3332044008 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f4480003970 con 0x5640fd6da1b0 2024-09-21T06:32:56.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.172+0000 7f4494e41740 1 -- 172.21.15.63:0/3332044008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f448000be50 con 0x5640fd6da1b0 2024-09-21T06:32:56.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.172+0000 7f44677fe640 1 -- 172.21.15.63:0/3332044008 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f4480004e50 con 0x5640fd6da1b0 2024-09-21T06:32:56.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.172+0000 7f4494e41740 10 client.16479 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:56.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.172+0000 7f4494e41740 1 -- 172.21.15.63:0/3332044008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5640fdac4770 con 0x5640fd6da1b0 2024-09-21T06:32:56.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.173+0000 7f44677fe640 1 -- 172.21.15.63:0/3332044008 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f448000be50 con 0x5640fd6da1b0 2024-09-21T06:32:56.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.173+0000 7f44677fe640 1 -- 172.21.15.63:0/3332044008 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f44800057a0 con 0x5640fd6da1b0 2024-09-21T06:32:56.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.173+0000 7f4494e41740 10 client.16479 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:56.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.173+0000 7f4494e41740 10 client.16479 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:32:56.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.173+0000 7f4494e41740 20 client.16479 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:56.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.173+0000 7f4494e41740 1 --2- 172.21.15.63:0/3332044008 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5640fd6c19f0 0x5640fdac7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:56.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.173+0000 7f4494e41740 4 client.16479 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:32:56.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.173+0000 7f4494e41740 1 -- 172.21.15.63:0/3332044008 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640fda22df0 con 0x5640fd6c19f0 2024-09-21T06:32:56.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.173+0000 7f44877fe640 1 --2- 172.21.15.63:0/3332044008 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5640fd6c19f0 0x5640fdac7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:56.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.174+0000 7f44877fe640 1 --2- 172.21.15.63:0/3332044008 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5640fd6c19f0 0x5640fdac7b80 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=159fabb675065e16 server_cookie=cbb6cb336cd578d6 in_seq=0 out_seq=0 2024-09-21T06:32:56.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.174+0000 7f44677fe640 10 client.16479 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:56.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.175+0000 7f44677fe640 1 -- 172.21.15.63:0/3332044008 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5640fda22df0 con 0x5640fd6c19f0 2024-09-21T06:32:56.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.175+0000 7f44677fe640 10 client.16479 handle_command_reply: tid=0 2024-09-21T06:32:56.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.175+0000 7f4494e41740 1 client.16479 shutdown 2024-09-21T06:32:56.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.175+0000 7f4494e41740 1 -- 172.21.15.63:0/3332044008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6da1b0 msgr2=0x5640fdab5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:56.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.175+0000 7f4494e41740 1 --2- 172.21.15.63:0/3332044008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6da1b0 0x5640fdab5920 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f44800045a0 tx=0x7f44800044a0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.175+0000 7f4494e41740 1 -- 172.21.15.63:0/3332044008 shutdown_connections 2024-09-21T06:32:56.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.175+0000 7f4494e41740 1 --2- 172.21.15.63:0/3332044008 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5640fd6c19f0 0x5640fdac7b80 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.175+0000 7f4494e41740 1 --2- 172.21.15.63:0/3332044008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 0x5640fdac1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.175+0000 7f4494e41740 1 --2- 172.21.15.63:0/3332044008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6e2390 0x5640fdab5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.175+0000 7f44677fe640 0 client.16479 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:56.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.175+0000 7f4494e41740 1 --2- 172.21.15.63:0/3332044008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6da1b0 0x5640fdab5920 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.175+0000 7f4494e41740 1 -- 172.21.15.63:0/3332044008 >> 172.21.15.63:0/3332044008 conn(0x5640fd6f7460 msgr2=0x5640fdaad450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:56.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.176+0000 7f4494e41740 1 -- 172.21.15.63:0/3332044008 shutdown_connections 2024-09-21T06:32:56.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.176+0000 7f4494e41740 1 -- 172.21.15.63:0/3332044008 wait complete. 2024-09-21T06:32:56.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.176+0000 7f4494e41740 20 client.16479 trim_cache size 0 max 16384 2024-09-21T06:32:56.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.190+0000 7f4494e41740 1 Processor -- start 2024-09-21T06:32:56.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.190+0000 7f4494e41740 1 -- start start 2024-09-21T06:32:56.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.190+0000 7f4494e41740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6da1b0 0x5640fdab5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:56.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.190+0000 7f4494e41740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6e2390 0x5640fdac1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:56.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.190+0000 7f4494e41740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 0x5640fdab2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:56.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.190+0000 7f4494e41740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f44881ad560 con 0x5640fd6e2390 2024-09-21T06:32:56.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.190+0000 7f4494e41740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f44881af160 con 0x5640fd6da1b0 2024-09-21T06:32:56.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.190+0000 7f4494e41740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f44881adcf0 con 0x5640fd703070 2024-09-21T06:32:56.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.190+0000 7f44877fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6e2390 0x5640fdac1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:56.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.190+0000 7f44877fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6e2390 0x5640fdac1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52212/0 (socket says 172.21.15.63:52212) 2024-09-21T06:32:56.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.190+0000 7f448ce6a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6da1b0 0x5640fdab5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:56.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.190+0000 7f44877fe640 1 -- 172.21.15.63:0/3177481595 learned_addr learned my addr 172.21.15.63:0/3177481595 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:56.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.190+0000 7f448ce6a640 1 --2- 172.21.15.63:0/3177481595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 0x5640fdab2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:56.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.190+0000 7f44877fe640 1 -- 172.21.15.63:0/3177481595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 msgr2=0x5640fdab2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:56.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.190+0000 7f44877fe640 1 --2- 172.21.15.63:0/3177481595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 0x5640fdab2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.190+0000 7f44877fe640 1 -- 172.21.15.63:0/3177481595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6da1b0 msgr2=0x5640fdab5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:56.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.190+0000 7f44877fe640 1 --2- 172.21.15.63:0/3177481595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6da1b0 0x5640fdab5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.191+0000 7f44877fe640 1 -- 172.21.15.63:0/3177481595 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640fdaac7e0 con 0x5640fd6e2390 2024-09-21T06:32:56.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.191+0000 7f448ce6a640 1 --2- 172.21.15.63:0/3177481595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6da1b0 0x5640fdab5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:56.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.191+0000 7f44877fe640 1 --2- 172.21.15.63:0/3177481595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6e2390 0x5640fdac1d60 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f447c005ab0 tx=0x7f447c005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abfe12f4bb2755c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:56.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.191+0000 7f446dffb640 1 -- 172.21.15.63:0/3177481595 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c049020 con 0x5640fd6e2390 2024-09-21T06:32:56.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.191+0000 7f446dffb640 1 -- 172.21.15.63:0/3177481595 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f447c004750 con 0x5640fd6e2390 2024-09-21T06:32:56.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.191+0000 7f446dffb640 1 -- 172.21.15.63:0/3177481595 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c035040 con 0x5640fd6e2390 2024-09-21T06:32:56.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.192+0000 7f4494e41740 1 -- 172.21.15.63:0/3177481595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6e2390 msgr2=0x5640fdac1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:56.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.192+0000 7f4494e41740 1 --2- 172.21.15.63:0/3177481595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6e2390 0x5640fdac1d60 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f447c005ab0 tx=0x7f447c005a20 comp rx=0 tx=0).stop 2024-09-21T06:32:56.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.192+0000 7f4494e41740 1 -- 172.21.15.63:0/3177481595 shutdown_connections 2024-09-21T06:32:56.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.192+0000 7f4494e41740 1 --2- 172.21.15.63:0/3177481595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 0x5640fdab2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.192+0000 7f4494e41740 1 --2- 172.21.15.63:0/3177481595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6e2390 0x5640fdac1d60 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.192+0000 7f4494e41740 1 --2- 172.21.15.63:0/3177481595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6da1b0 0x5640fdab5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.192+0000 7f4494e41740 1 -- 172.21.15.63:0/3177481595 >> 172.21.15.63:0/3177481595 conn(0x5640fd6f7460 msgr2=0x5640fdab56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:56.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.192+0000 7f4494e41740 1 -- 172.21.15.63:0/3177481595 shutdown_connections 2024-09-21T06:32:56.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.192+0000 7f4494e41740 1 -- 172.21.15.63:0/3177481595 wait complete. 2024-09-21T06:32:56.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.192+0000 7f4494e41740 1 -- start start 2024-09-21T06:32:56.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.193+0000 7f4494e41740 1 Processor -- start 2024-09-21T06:32:56.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.193+0000 7f4494e41740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6da1b0 0x5640fdacb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:56.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.193+0000 7f4494e41740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6e2390 0x5640fdac88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:56.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.193+0000 7f4494e41740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 0x5640fdac8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:56.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.193+0000 7f4494e41740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f44881aea90 con 0x5640fd6e2390 2024-09-21T06:32:56.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.193+0000 7f4494e41740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f44881ae3c0 con 0x5640fd6da1b0 2024-09-21T06:32:56.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.193+0000 7f448ce6a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6da1b0 0x5640fdacb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.193+0000 7f4494e41740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f44881ab540 con 0x5640fd703070 2024-09-21T06:32:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.193+0000 7f4494e41740 10 client.0 _ll_register_callbacks cb 0x7f44800093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.193+0000 7f448ce6a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6da1b0 0x5640fdacb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:35452/0 (socket says 172.21.15.63:35452) 2024-09-21T06:32:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.193+0000 7f44877fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6e2390 0x5640fdac88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.193+0000 7f448ce6a640 1 -- 172.21.15.63:0/2248639870 learned_addr learned my addr 172.21.15.63:0/2248639870 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.194+0000 7f448ce6a640 1 --2- 172.21.15.63:0/2248639870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 0x5640fdac8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.194+0000 7f448ce6a640 1 -- 172.21.15.63:0/2248639870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 msgr2=0x5640fdac8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.194+0000 7f448ce6a640 1 --2- 172.21.15.63:0/2248639870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 0x5640fdac8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.194+0000 7f448ce6a640 1 -- 172.21.15.63:0/2248639870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6e2390 msgr2=0x5640fdac88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.194+0000 7f448ce6a640 1 --2- 172.21.15.63:0/2248639870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6e2390 0x5640fdac88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.194+0000 7f448ce6a640 1 -- 172.21.15.63:0/2248639870 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640fdac95f0 con 0x5640fd6da1b0 2024-09-21T06:32:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.194+0000 7f44877fe640 1 --2- 172.21.15.63:0/2248639870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6e2390 0x5640fdac88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.194+0000 7f448ce6a640 1 --2- 172.21.15.63:0/2248639870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6da1b0 0x5640fdacb3f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f448002b460 tx=0x7f4480004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eff65db86f563e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:56.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.194+0000 7f44677fe640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:32:56.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.194+0000 7f44677fe640 1 -- 172.21.15.63:0/2248639870 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4480005bd0 con 0x5640fd6da1b0 2024-09-21T06:32:56.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.194+0000 7f44677fe640 1 -- 172.21.15.63:0/2248639870 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f448000bd70 con 0x5640fd6da1b0 2024-09-21T06:32:56.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.194+0000 7f4494e41740 1 -- 172.21.15.63:0/2248639870 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f447c004750 con 0x5640fd6da1b0 2024-09-21T06:32:56.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.195+0000 7f44677fe640 1 -- 172.21.15.63:0/2248639870 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f448002b650 con 0x5640fd6da1b0 2024-09-21T06:32:56.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.195+0000 7f4494e41740 10 client.26138 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:56.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.195+0000 7f4494e41740 1 -- 172.21.15.63:0/2248639870 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5640fdb322b0 con 0x5640fd6da1b0 2024-09-21T06:32:56.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.195+0000 7f44677fe640 1 -- 172.21.15.63:0/2248639870 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f447c004750 con 0x5640fd6da1b0 2024-09-21T06:32:56.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.195+0000 7f44677fe640 1 -- 172.21.15.63:0/2248639870 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f4480044040 con 0x5640fd6da1b0 2024-09-21T06:32:56.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.195+0000 7f4494e41740 10 client.26138 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:56.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.195+0000 7f4494e41740 10 client.26138 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:32:56.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.195+0000 7f4494e41740 20 client.26138 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:56.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.195+0000 7f4494e41740 1 --2- 172.21.15.63:0/2248639870 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5640fd696da0 0x5640fdb349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:56.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.195+0000 7f4494e41740 4 client.26138 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:32:56.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.195+0000 7f4494e41740 1 -- 172.21.15.63:0/2248639870 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5640fda1e8a0 con 0x5640fd696da0 2024-09-21T06:32:56.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.196+0000 7f44877fe640 1 --2- 172.21.15.63:0/2248639870 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5640fd696da0 0x5640fdb349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:56.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.198+0000 7f44677fe640 10 client.26138 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:56.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.199+0000 7f44877fe640 1 --2- 172.21.15.63:0/2248639870 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5640fd696da0 0x5640fdb349c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cce85c842290721 server_cookie=7271522c91d043ff in_seq=0 out_seq=0 2024-09-21T06:32:56.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.200+0000 7f44677fe640 1 -- 172.21.15.63:0/2248639870 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5640fda1e8a0 con 0x5640fd696da0 2024-09-21T06:32:56.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.200+0000 7f44677fe640 10 client.26138 handle_command_reply: tid=0 2024-09-21T06:32:56.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.200+0000 7f4494e41740 1 client.26138 shutdown 2024-09-21T06:32:56.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.200+0000 7f4494e41740 1 -- 172.21.15.63:0/2248639870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6da1b0 msgr2=0x5640fdacb3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:56.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.200+0000 7f4494e41740 1 --2- 172.21.15.63:0/2248639870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6da1b0 0x5640fdacb3f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f448002b460 tx=0x7f4480004360 comp rx=0 tx=0).stop 2024-09-21T06:32:56.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.201+0000 7f4494e41740 1 -- 172.21.15.63:0/2248639870 shutdown_connections 2024-09-21T06:32:56.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.201+0000 7f4494e41740 1 --2- 172.21.15.63:0/2248639870 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5640fd696da0 0x5640fdb349c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.201+0000 7f4494e41740 1 --2- 172.21.15.63:0/2248639870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640fd703070 0x5640fdac8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.201+0000 7f4494e41740 1 --2- 172.21.15.63:0/2248639870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5640fd6e2390 0x5640fdac88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.201+0000 7f4494e41740 1 --2- 172.21.15.63:0/2248639870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640fd6da1b0 0x5640fdacb3f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.201+0000 7f44677fe640 0 client.26138 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:32:56.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.201+0000 7f4494e41740 1 -- 172.21.15.63:0/2248639870 >> 172.21.15.63:0/2248639870 conn(0x5640fd6f7460 msgr2=0x5640fdab6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:56.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.201+0000 7f4494e41740 1 -- 172.21.15.63:0/2248639870 shutdown_connections 2024-09-21T06:32:56.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.201+0000 7f4494e41740 1 -- 172.21.15.63:0/2248639870 wait complete. 2024-09-21T06:32:56.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.201+0000 7f4494e41740 20 client.26138 trim_cache size 0 max 16384 2024-09-21T06:32:56.204 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:32:56.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.202+0000 7f448e8cd640 1 -- 172.21.15.63:0/1917664735 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f44700b6700 msgr2=0x7f44700b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:56.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.202+0000 7f448e8cd640 1 --2- 172.21.15.63:0/1917664735 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f44700b6700 0x7f44700b8c10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x5640fdaa8f40 tx=0x7f4478003b30 comp rx=0 tx=0).stop 2024-09-21T06:32:56.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.202+0000 7f448e8cd640 1 -- 172.21.15.63:0/1917664735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4488102030 msgr2=0x7f448819a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:56.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.202+0000 7f448e8cd640 1 --2- 172.21.15.63:0/1917664735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4488102030 0x7f448819a4e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4478009c70 tx=0x7f447800d6b0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.202+0000 7f448e8cd640 1 -- 172.21.15.63:0/1917664735 shutdown_connections 2024-09-21T06:32:56.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.202+0000 7f448e8cd640 1 --2- 172.21.15.63:0/1917664735 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4488106bd0 0x7f448819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.202+0000 7f448e8cd640 1 --2- 172.21.15.63:0/1917664735 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f44700b6700 0x7f44700b8c10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.202+0000 7f448e8cd640 1 --2- 172.21.15.63:0/1917664735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4488106280 0x7f448819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.202+0000 7f448e8cd640 1 --2- 172.21.15.63:0/1917664735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4488102030 0x7f448819a4e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:56.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.202+0000 7f448e8cd640 1 -- 172.21.15.63:0/1917664735 >> 172.21.15.63:0/1917664735 conn(0x7f4488077c60 msgr2=0x7f4488107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:56.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.202+0000 7f448e8cd640 1 -- 172.21.15.63:0/1917664735 shutdown_connections 2024-09-21T06:32:56.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:56.202+0000 7f448e8cd640 1 -- 172.21.15.63:0/1917664735 wait complete. 2024-09-21T06:32:57.075 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T06:32:57.390 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:32:57.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:57 smithi063 ceph-mon[31150]: pgmap v465: 97 pgs: 97 active+clean; 193 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.7 MiB/s wr, 970 op/s 2024-09-21T06:32:57.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.949+0000 7fd308b8b640 1 -- 172.21.15.63:0/1585439379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd304105300 msgr2=0x7fd30410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:57.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.949+0000 7fd308b8b640 1 --2- 172.21.15.63:0/1585439379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd304105300 0x7fd30410d850 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009900 tx=0x7fd2f802a410 comp rx=0 tx=0).stop 2024-09-21T06:32:57.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.949+0000 7fd308b8b640 1 -- 172.21.15.63:0/1585439379 shutdown_connections 2024-09-21T06:32:57.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.949+0000 7fd308b8b640 1 --2- 172.21.15.63:0/1585439379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd30410de10 0x7fd304110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.949+0000 7fd308b8b640 1 --2- 172.21.15.63:0/1585439379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd304105300 0x7fd30410d850 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.949+0000 7fd308b8b640 1 --2- 172.21.15.63:0/1585439379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3041049b0 0x7fd304104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.949+0000 7fd308b8b640 1 -- 172.21.15.63:0/1585439379 >> 172.21.15.63:0/1585439379 conn(0x7fd304079730 msgr2=0x7fd304079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.949+0000 7fd308b8b640 1 -- 172.21.15.63:0/1585439379 shutdown_connections 2024-09-21T06:32:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.949+0000 7fd308b8b640 1 -- 172.21.15.63:0/1585439379 wait complete. 2024-09-21T06:32:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.950+0000 7fd308b8b640 1 Processor -- start 2024-09-21T06:32:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.950+0000 7fd308b8b640 1 -- start start 2024-09-21T06:32:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.951+0000 7fd308b8b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3041049b0 0x7fd3041026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.951+0000 7fd308b8b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd304105300 0x7fd304102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.951+0000 7fd308b8b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd30410de10 0x7fd304103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.951+0000 7fd308b8b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd304113a70 con 0x7fd304105300 2024-09-21T06:32:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.951+0000 7fd308b8b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd3041138f0 con 0x7fd30410de10 2024-09-21T06:32:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.951+0000 7fd308b8b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd304113bf0 con 0x7fd3041049b0 2024-09-21T06:32:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.951+0000 7fd30259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3041049b0 0x7fd3041026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:57.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.951+0000 7fd301d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd304105300 0x7fd304102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:57.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.951+0000 7fd30259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3041049b0 0x7fd3041026f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:43238/0 (socket says 172.21.15.63:43238) 2024-09-21T06:32:57.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.951+0000 7fd30259c640 1 -- 172.21.15.63:0/3946412911 learned_addr learned my addr 172.21.15.63:0/3946412911 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:57.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.951+0000 7fd302d9d640 1 --2- 172.21.15.63:0/3946412911 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd30410de10 0x7fd304103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:57.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.951+0000 7fd30259c640 1 -- 172.21.15.63:0/3946412911 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd30410de10 msgr2=0x7fd304103170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:57.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.951+0000 7fd30259c640 1 --2- 172.21.15.63:0/3946412911 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd30410de10 0x7fd304103170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.951+0000 7fd30259c640 1 -- 172.21.15.63:0/3946412911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd304105300 msgr2=0x7fd304102c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:57.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.951+0000 7fd30259c640 1 --2- 172.21.15.63:0/3946412911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd304105300 0x7fd304102c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.951+0000 7fd30259c640 1 -- 172.21.15.63:0/3946412911 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3041a8800 con 0x7fd3041049b0 2024-09-21T06:32:57.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.951+0000 7fd301d9b640 1 --2- 172.21.15.63:0/3946412911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd304105300 0x7fd304102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:57.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.952+0000 7fd30259c640 1 --2- 172.21.15.63:0/3946412911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3041049b0 0x7fd3041026f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400d950 tx=0x7fd2f400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:57.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.952+0000 7fd2f37fe640 1 -- 172.21.15.63:0/3946412911 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4017020 con 0x7fd3041049b0 2024-09-21T06:32:57.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.952+0000 7fd2f37fe640 1 -- 172.21.15.63:0/3946412911 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2f4009c30 con 0x7fd3041049b0 2024-09-21T06:32:57.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.952+0000 7fd2f37fe640 1 -- 172.21.15.63:0/3946412911 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f400f690 con 0x7fd3041049b0 2024-09-21T06:32:57.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.952+0000 7fd308b8b640 1 -- 172.21.15.63:0/3946412911 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3041a8af0 con 0x7fd3041049b0 2024-09-21T06:32:57.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.952+0000 7fd308b8b640 1 -- 172.21.15.63:0/3946412911 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3041a8f50 con 0x7fd3041049b0 2024-09-21T06:32:57.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.957+0000 7fd30f0ff740 1 Processor -- start 2024-09-21T06:32:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.958+0000 7fd30f0ff740 1 -- start start 2024-09-21T06:32:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.959+0000 7fd30f0ff740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55e0070 0x5593f598feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.959+0000 7fd30f0ff740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55b71b0 0x5593f59903f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.959+0000 7fd30f0ff740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55bf390 0x5593f5990930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.959+0000 7fd2f37fe640 1 -- 172.21.15.63:0/3946412911 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fd2f401a020 con 0x7fd3041049b0 2024-09-21T06:32:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.959+0000 7fd302d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55e0070 0x5593f598feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.959+0000 7fd302d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55e0070 0x5593f598feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:43240/0 (socket says 172.21.15.63:43240) 2024-09-21T06:32:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.959+0000 7fd302d9d640 1 -- 172.21.15.63:0/3325642957 learned_addr learned my addr 172.21.15.63:0/3325642957 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.960+0000 7fd30259c640 1 --2- 172.21.15.63:0/3325642957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55b71b0 0x5593f59903f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.960+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3325642957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5593f58fdea0 con 0x5593f55b71b0 2024-09-21T06:32:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.960+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3325642957 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5593f58ed2d0 con 0x5593f55bf390 2024-09-21T06:32:57.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.960+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3325642957 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5593f58f10e0 con 0x5593f55e0070 2024-09-21T06:32:57.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.960+0000 7fd301d9b640 1 --2- 172.21.15.63:0/3325642957 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55bf390 0x5593f5990930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:57.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.961+0000 7fd301d9b640 1 -- 172.21.15.63:0/3325642957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55e0070 msgr2=0x5593f598feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:57.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.961+0000 7fd301d9b640 1 --2- 172.21.15.63:0/3325642957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55e0070 0x5593f598feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.961+0000 7fd301d9b640 1 -- 172.21.15.63:0/3325642957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55b71b0 msgr2=0x5593f59903f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:57.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.961+0000 7fd301d9b640 1 --2- 172.21.15.63:0/3325642957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55b71b0 0x5593f59903f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.961+0000 7fd301d9b640 1 -- 172.21.15.63:0/3325642957 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593f564b650 con 0x5593f55bf390 2024-09-21T06:32:57.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.962+0000 7fd2f37fe640 1 --2- 172.21.15.63:0/3946412911 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd2ec0b6700 0x7fd2ec0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:57.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.962+0000 7fd301d9b640 1 --2- 172.21.15.63:0/3325642957 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55bf390 0x5593f5990930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd2f802a930 tx=0x7fd2f8000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96642a40ba95df99 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:57.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.962+0000 7fd2f37fe640 1 -- 172.21.15.63:0/3946412911 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fd2f40e75a0 con 0x7fd3041049b0 2024-09-21T06:32:57.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.962+0000 7fd2f0ff9640 1 -- 172.21.15.63:0/3325642957 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8040070 con 0x5593f55bf390 2024-09-21T06:32:57.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.962+0000 7fd2f0ff9640 1 -- 172.21.15.63:0/3325642957 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2f80317a0 con 0x5593f55bf390 2024-09-21T06:32:57.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.962+0000 7fd2f0ff9640 1 -- 172.21.15.63:0/3325642957 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8035040 con 0x5593f55bf390 2024-09-21T06:32:57.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.962+0000 7fd302d9d640 1 --2- 172.21.15.63:0/3946412911 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd2ec0b6700 0x7fd2ec0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:57.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.963+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3325642957 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55bf390 msgr2=0x5593f5990930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:57.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.963+0000 7fd302d9d640 1 --2- 172.21.15.63:0/3946412911 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd2ec0b6700 0x7fd2ec0b8c10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc012560 tx=0x7fd2fc009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:57.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.963+0000 7fd30f0ff740 1 --2- 172.21.15.63:0/3325642957 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55bf390 0x5593f5990930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd2f802a930 tx=0x7fd2f8000bc0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.964+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3325642957 shutdown_connections 2024-09-21T06:32:57.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.964+0000 7fd30f0ff740 1 --2- 172.21.15.63:0/3325642957 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55bf390 0x5593f5990930 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.964+0000 7fd30f0ff740 1 --2- 172.21.15.63:0/3325642957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55b71b0 0x5593f59903f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.964+0000 7fd30f0ff740 1 --2- 172.21.15.63:0/3325642957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55e0070 0x5593f598feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.964+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3325642957 >> 172.21.15.63:0/3325642957 conn(0x5593f55d4460 msgr2=0x5593f598dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:57.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.964+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3325642957 shutdown_connections 2024-09-21T06:32:57.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.964+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3325642957 wait complete. 2024-09-21T06:32:57.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.964+0000 7fd30f0ff740 1 -- start start 2024-09-21T06:32:57.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.964+0000 7fd30f0ff740 1 Processor -- start 2024-09-21T06:32:57.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.965+0000 7fd30f0ff740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55b71b0 0x5593f599b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:57.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.965+0000 7fd30f0ff740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55bf390 0x5593f599bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:57.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.965+0000 7fd30f0ff740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55e0070 0x5593f59a7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:57.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.965+0000 7fd30f0ff740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5593f574e700 con 0x5593f55e0070 2024-09-21T06:32:57.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.965+0000 7fd30f0ff740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5593f5888160 con 0x5593f55b71b0 2024-09-21T06:32:57.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.965+0000 7fd30f0ff740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5593f599e630 con 0x5593f55bf390 2024-09-21T06:32:57.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.965+0000 7fd302d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55e0070 0x5593f59a7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:57.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.965+0000 7fd302d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55e0070 0x5593f59a7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39090/0 (socket says 172.21.15.63:39090) 2024-09-21T06:32:57.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.965+0000 7fd30f0ff740 10 client.0 _ll_register_callbacks cb 0x5593f58a19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:57.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.965+0000 7fd302d9d640 1 -- 172.21.15.63:0/3164477819 learned_addr learned my addr 172.21.15.63:0/3164477819 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:57.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.965+0000 7fd30259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55b71b0 0x5593f599b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:57.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.965+0000 7fd301d9b640 1 --2- 172.21.15.63:0/3164477819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55bf390 0x5593f599bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:57.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.965+0000 7fd302d9d640 1 -- 172.21.15.63:0/3164477819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55bf390 msgr2=0x5593f599bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:57.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.966+0000 7fd302d9d640 1 --2- 172.21.15.63:0/3164477819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55bf390 0x5593f599bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.966+0000 7fd302d9d640 1 -- 172.21.15.63:0/3164477819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55b71b0 msgr2=0x5593f599b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:57.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.966+0000 7fd302d9d640 1 --2- 172.21.15.63:0/3164477819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55b71b0 0x5593f599b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.966+0000 7fd302d9d640 1 -- 172.21.15.63:0/3164477819 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593f58b5c90 con 0x5593f55e0070 2024-09-21T06:32:57.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.966+0000 7fd302d9d640 1 --2- 172.21.15.63:0/3164477819 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55e0070 0x5593f59a7920 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0094d0 tx=0x7fd2fc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3c62e3d01316c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:57.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.966+0000 7fd2e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:32:57.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.966+0000 7fd2e9ffb640 1 -- 172.21.15.63:0/3164477819 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc00f750 con 0x5593f55e0070 2024-09-21T06:32:57.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.966+0000 7fd2e9ffb640 1 -- 172.21.15.63:0/3164477819 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fd2fc00f8f0 con 0x5593f55e0070 2024-09-21T06:32:57.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.966+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3164477819 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2f80317a0 con 0x5593f55e0070 2024-09-21T06:32:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.967+0000 7fd2e9ffb640 1 -- 172.21.15.63:0/3164477819 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fd2fc00faf0 con 0x5593f55e0070 2024-09-21T06:32:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.967+0000 7fd30f0ff740 10 client.16497 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.967+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3164477819 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5593f59aa420 con 0x5593f55e0070 2024-09-21T06:32:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.967+0000 7fd2e9ffb640 1 -- 172.21.15.63:0/3164477819 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2f80317a0 con 0x5593f55e0070 2024-09-21T06:32:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.967+0000 7fd2e9ffb640 1 -- 172.21.15.63:0/3164477819 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7fd2fc027070 con 0x5593f55e0070 2024-09-21T06:32:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.967+0000 7fd30f0ff740 10 client.16497 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.967+0000 7fd30f0ff740 10 client.16497 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:32:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.967+0000 7fd30f0ff740 20 client.16497 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.967+0000 7fd30f0ff740 1 --2- 172.21.15.63:0/3164477819 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5593f559e9f0 0x5593f59adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.967+0000 7fd30f0ff740 4 client.16497 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:32:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.967+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3164477819 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593f58ffdf0 con 0x5593f559e9f0 2024-09-21T06:32:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.967+0000 7fd30259c640 1 --2- 172.21.15.63:0/3164477819 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5593f559e9f0 0x5593f59adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:57.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.968+0000 7fd2e9ffb640 10 client.16497 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:32:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.968+0000 7fd30259c640 1 --2- 172.21.15.63:0/3164477819 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5593f559e9f0 0x5593f59adb10 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=749b162191294a09 server_cookie=2b00c8c454f745b6 in_seq=0 out_seq=0 2024-09-21T06:32:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.969+0000 7fd2e9ffb640 1 -- 172.21.15.63:0/3164477819 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5593f58ffdf0 con 0x5593f559e9f0 2024-09-21T06:32:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.969+0000 7fd2e9ffb640 10 client.16497 handle_command_reply: tid=0 2024-09-21T06:32:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.969+0000 7fd30f0ff740 1 client.16497 shutdown 2024-09-21T06:32:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.969+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3164477819 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55e0070 msgr2=0x5593f59a7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.969+0000 7fd30f0ff740 1 --2- 172.21.15.63:0/3164477819 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55e0070 0x5593f59a7920 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0094d0 tx=0x7fd2fc004ab0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.969+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3164477819 shutdown_connections 2024-09-21T06:32:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.969+0000 7fd30f0ff740 1 --2- 172.21.15.63:0/3164477819 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5593f559e9f0 0x5593f59adb10 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.969+0000 7fd30f0ff740 1 --2- 172.21.15.63:0/3164477819 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55e0070 0x5593f59a7920 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.969+0000 7fd30f0ff740 1 --2- 172.21.15.63:0/3164477819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55bf390 0x5593f599bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.969+0000 7fd30f0ff740 1 --2- 172.21.15.63:0/3164477819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55b71b0 0x5593f599b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.969+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3164477819 >> 172.21.15.63:0/3164477819 conn(0x5593f55d4460 msgr2=0x5593f5993090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.969+0000 7fd2e9ffb640 0 client.16497 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:32:57.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.969+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3164477819 shutdown_connections 2024-09-21T06:32:57.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.969+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3164477819 wait complete. 2024-09-21T06:32:57.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.970+0000 7fd30f0ff740 20 client.16497 trim_cache size 0 max 16384 2024-09-21T06:32:57.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.991+0000 7fd30f0ff740 1 Processor -- start 2024-09-21T06:32:57.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.991+0000 7fd30f0ff740 1 -- start start 2024-09-21T06:32:57.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.991+0000 7fd30f0ff740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55b71b0 0x5593f599bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:57.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.991+0000 7fd30f0ff740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55bf390 0x5593f59a7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:57.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.991+0000 7fd30f0ff740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55e0070 0x5593f59987e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:57.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.991+0000 7fd30f0ff740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd3041ad5b0 con 0x5593f55e0070 2024-09-21T06:32:57.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.991+0000 7fd30f0ff740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd3041af1b0 con 0x5593f55b71b0 2024-09-21T06:32:57.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.991+0000 7fd30f0ff740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd3041add40 con 0x5593f55bf390 2024-09-21T06:32:57.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.991+0000 7fd302d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55e0070 0x5593f59987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:57.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.992+0000 7fd30259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55b71b0 0x5593f599bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:57.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.992+0000 7fd302d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55e0070 0x5593f59987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39104/0 (socket says 172.21.15.63:39104) 2024-09-21T06:32:57.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.992+0000 7fd302d9d640 1 -- 172.21.15.63:0/3635416016 learned_addr learned my addr 172.21.15.63:0/3635416016 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:57.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.992+0000 7fd301d9b640 1 --2- 172.21.15.63:0/3635416016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55bf390 0x5593f59a7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:57.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.992+0000 7fd302d9d640 1 -- 172.21.15.63:0/3635416016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55bf390 msgr2=0x5593f59a7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:57.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.992+0000 7fd302d9d640 1 --2- 172.21.15.63:0/3635416016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55bf390 0x5593f59a7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.992+0000 7fd302d9d640 1 -- 172.21.15.63:0/3635416016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55b71b0 msgr2=0x5593f599bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:57.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.992+0000 7fd302d9d640 1 --2- 172.21.15.63:0/3635416016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55b71b0 0x5593f599bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.992+0000 7fd302d9d640 1 -- 172.21.15.63:0/3635416016 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593f5999af0 con 0x5593f55e0070 2024-09-21T06:32:57.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.992+0000 7fd30259c640 1 --2- 172.21.15.63:0/3635416016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55b71b0 0x5593f599bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:57.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.992+0000 7fd302d9d640 1 --2- 172.21.15.63:0/3635416016 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55e0070 0x5593f59987e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0094a0 tx=0x7fd2fc003fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7fc35b49e70a41 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:57.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.992+0000 7fd2ebfff640 1 -- 172.21.15.63:0/3635416016 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc038030 con 0x5593f55e0070 2024-09-21T06:32:57.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.992+0000 7fd2ebfff640 1 -- 172.21.15.63:0/3635416016 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2fc00fe10 con 0x5593f55e0070 2024-09-21T06:32:57.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.992+0000 7fd2ebfff640 1 -- 172.21.15.63:0/3635416016 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc0336d0 con 0x5593f55e0070 2024-09-21T06:32:57.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.993+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3635416016 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55e0070 msgr2=0x5593f59987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:57.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.993+0000 7fd30f0ff740 1 --2- 172.21.15.63:0/3635416016 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55e0070 0x5593f59987e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0094a0 tx=0x7fd2fc003fc0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.993+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3635416016 shutdown_connections 2024-09-21T06:32:57.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.993+0000 7fd30f0ff740 1 --2- 172.21.15.63:0/3635416016 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55e0070 0x5593f59987e0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.993+0000 7fd30f0ff740 1 --2- 172.21.15.63:0/3635416016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55bf390 0x5593f59a7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.993+0000 7fd30f0ff740 1 --2- 172.21.15.63:0/3635416016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55b71b0 0x5593f599bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:57.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.993+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3635416016 >> 172.21.15.63:0/3635416016 conn(0x5593f55d4460 msgr2=0x5593f599b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:57.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.993+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3635416016 shutdown_connections 2024-09-21T06:32:57.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.993+0000 7fd30f0ff740 1 -- 172.21.15.63:0/3635416016 wait complete. 2024-09-21T06:32:57.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.994+0000 7fd30f0ff740 1 -- start start 2024-09-21T06:32:57.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.994+0000 7fd30f0ff740 1 Processor -- start 2024-09-21T06:32:58.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.994+0000 7fd30f0ff740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55b71b0 0x5593f59a4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:58.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.994+0000 7fd30f0ff740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55bf390 0x5593f599f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:58.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.994+0000 7fd30f0ff740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55e0070 0x5593f599fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:58.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.994+0000 7fd30f0ff740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd3041aeae0 con 0x5593f55bf390 2024-09-21T06:32:58.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.994+0000 7fd30f0ff740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd3041ae410 con 0x5593f55b71b0 2024-09-21T06:32:58.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.994+0000 7fd30f0ff740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd3041ab590 con 0x5593f55e0070 2024-09-21T06:32:58.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.994+0000 7fd30259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55b71b0 0x5593f59a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:58.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.995+0000 7fd301d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55bf390 0x5593f599f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:58.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.995+0000 7fd30f0ff740 10 client.0 _ll_register_callbacks cb 0x7fd2fc009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:58.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.995+0000 7fd30259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55b71b0 0x5593f59a4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:36478/0 (socket says 172.21.15.63:36478) 2024-09-21T06:32:58.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.995+0000 7fd30259c640 1 -- 172.21.15.63:0/2132405987 learned_addr learned my addr 172.21.15.63:0/2132405987 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:58.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.995+0000 7fd302d9d640 1 --2- 172.21.15.63:0/2132405987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55e0070 0x5593f599fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:58.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.995+0000 7fd30259c640 1 -- 172.21.15.63:0/2132405987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55e0070 msgr2=0x5593f599fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:58.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.995+0000 7fd30259c640 1 --2- 172.21.15.63:0/2132405987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55e0070 0x5593f599fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:58.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.995+0000 7fd30259c640 1 -- 172.21.15.63:0/2132405987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55bf390 msgr2=0x5593f599f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:58.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.995+0000 7fd30259c640 1 --2- 172.21.15.63:0/2132405987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55bf390 0x5593f599f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:58.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.995+0000 7fd30259c640 1 -- 172.21.15.63:0/2132405987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593f59a03b0 con 0x5593f55b71b0 2024-09-21T06:32:58.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.995+0000 7fd301d9b640 1 --2- 172.21.15.63:0/2132405987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55bf390 0x5593f599f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:58.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.995+0000 7fd30259c640 1 --2- 172.21.15.63:0/2132405987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55b71b0 0x5593f59a4140 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4009610 tx=0x7fd2f4010bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4057db978ec548e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:58.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.995+0000 7fd2e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:32:58.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.995+0000 7fd2e9ffb640 1 -- 172.21.15.63:0/2132405987 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40ada70 con 0x5593f55b71b0 2024-09-21T06:32:58.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.995+0000 7fd2e9ffb640 1 -- 172.21.15.63:0/2132405987 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fd2f40a95e0 con 0x5593f55b71b0 2024-09-21T06:32:58.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.995+0000 7fd30f0ff740 1 -- 172.21.15.63:0/2132405987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2fc00fe10 con 0x5593f55b71b0 2024-09-21T06:32:58.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.996+0000 7fd2e9ffb640 1 -- 172.21.15.63:0/2132405987 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fd2f40b1e50 con 0x5593f55b71b0 2024-09-21T06:32:58.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.996+0000 7fd30f0ff740 10 client.26156 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:58.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.996+0000 7fd30f0ff740 1 -- 172.21.15.63:0/2132405987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5593f5a18320 con 0x5593f55b71b0 2024-09-21T06:32:58.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.996+0000 7fd2e9ffb640 1 -- 172.21.15.63:0/2132405987 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2fc00fe10 con 0x5593f55b71b0 2024-09-21T06:32:58.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.996+0000 7fd2e9ffb640 1 -- 172.21.15.63:0/2132405987 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7fd2f40e9b10 con 0x5593f55b71b0 2024-09-21T06:32:58.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.996+0000 7fd30f0ff740 10 client.26156 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:58.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.996+0000 7fd30f0ff740 10 client.26156 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:32:58.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.996+0000 7fd30f0ff740 20 client.26156 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:58.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.996+0000 7fd30f0ff740 1 --2- 172.21.15.63:0/2132405987 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5593f5573da0 0x5593f5a1aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:58.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.996+0000 7fd30f0ff740 4 client.26156 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:32:58.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.996+0000 7fd30f0ff740 1 -- 172.21.15.63:0/2132405987 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5593f58fb8a0 con 0x5593f5573da0 2024-09-21T06:32:58.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.996+0000 7fd301d9b640 1 --2- 172.21.15.63:0/2132405987 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5593f5573da0 0x5593f5a1aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:58.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.997+0000 7fd2e9ffb640 10 client.26156 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:32:58.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.997+0000 7fd301d9b640 1 --2- 172.21.15.63:0/2132405987 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5593f5573da0 0x5593f5a1aa40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7f894b201f25b48 server_cookie=b03bad297adf0c75 in_seq=0 out_seq=0 2024-09-21T06:32:58.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.997+0000 7fd2e9ffb640 1 -- 172.21.15.63:0/2132405987 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5593f58fb8a0 con 0x5593f5573da0 2024-09-21T06:32:58.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.997+0000 7fd2e9ffb640 10 client.26156 handle_command_reply: tid=0 2024-09-21T06:32:58.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.997+0000 7fd30f0ff740 1 client.26156 shutdown 2024-09-21T06:32:58.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.998+0000 7fd30f0ff740 1 -- 172.21.15.63:0/2132405987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55b71b0 msgr2=0x5593f59a4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:58.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.998+0000 7fd30f0ff740 1 --2- 172.21.15.63:0/2132405987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55b71b0 0x5593f59a4140 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4009610 tx=0x7fd2f4010bd0 comp rx=0 tx=0).stop 2024-09-21T06:32:58.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.998+0000 7fd30f0ff740 1 -- 172.21.15.63:0/2132405987 shutdown_connections 2024-09-21T06:32:58.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.998+0000 7fd30f0ff740 1 --2- 172.21.15.63:0/2132405987 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5593f5573da0 0x5593f5a1aa40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:58.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.998+0000 7fd30f0ff740 1 --2- 172.21.15.63:0/2132405987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593f55e0070 0x5593f599fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:58.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.998+0000 7fd2e9ffb640 0 client.26156 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:32:58.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.998+0000 7fd30f0ff740 1 --2- 172.21.15.63:0/2132405987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5593f55bf390 0x5593f599f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:58.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.998+0000 7fd30f0ff740 1 --2- 172.21.15.63:0/2132405987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5593f55b71b0 0x5593f59a4140 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:58.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.998+0000 7fd30f0ff740 1 -- 172.21.15.63:0/2132405987 >> 172.21.15.63:0/2132405987 conn(0x5593f55d4460 msgr2=0x5593f5990ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:58.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.998+0000 7fd30f0ff740 1 -- 172.21.15.63:0/2132405987 shutdown_connections 2024-09-21T06:32:58.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.998+0000 7fd30f0ff740 1 -- 172.21.15.63:0/2132405987 wait complete. 2024-09-21T06:32:58.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.998+0000 7fd30f0ff740 20 client.26156 trim_cache size 0 max 16384 2024-09-21T06:32:58.004 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:32:58.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.999+0000 7fd308b8b640 1 -- 172.21.15.63:0/3946412911 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd2ec0b6700 msgr2=0x7fd2ec0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:58.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.999+0000 7fd308b8b640 1 --2- 172.21.15.63:0/3946412911 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd2ec0b6700 0x7fd2ec0b8c10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc012560 tx=0x7fd2fc009500 comp rx=0 tx=0).stop 2024-09-21T06:32:58.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.999+0000 7fd308b8b640 1 -- 172.21.15.63:0/3946412911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3041049b0 msgr2=0x7fd3041026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:58.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.999+0000 7fd308b8b640 1 --2- 172.21.15.63:0/3946412911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3041049b0 0x7fd3041026f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400d950 tx=0x7fd2f400de10 comp rx=0 tx=0).stop 2024-09-21T06:32:58.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.999+0000 7fd308b8b640 1 -- 172.21.15.63:0/3946412911 shutdown_connections 2024-09-21T06:32:58.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.999+0000 7fd308b8b640 1 --2- 172.21.15.63:0/3946412911 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd30410de10 0x7fd304103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:58.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.999+0000 7fd308b8b640 1 --2- 172.21.15.63:0/3946412911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd304105300 0x7fd304102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:58.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.999+0000 7fd308b8b640 1 --2- 172.21.15.63:0/3946412911 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd2ec0b6700 0x7fd2ec0b8c10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:58.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.999+0000 7fd308b8b640 1 --2- 172.21.15.63:0/3946412911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3041049b0 0x7fd3041026f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:58.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.999+0000 7fd308b8b640 1 -- 172.21.15.63:0/3946412911 >> 172.21.15.63:0/3946412911 conn(0x7fd304079730 msgr2=0x7fd304100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:58.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.999+0000 7fd308b8b640 1 -- 172.21.15.63:0/3946412911 shutdown_connections 2024-09-21T06:32:58.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:57.999+0000 7fd308b8b640 1 -- 172.21.15.63:0/3946412911 wait complete. 2024-09-21T06:32:58.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:57 smithi071 ceph-mon[34844]: pgmap v465: 97 pgs: 97 active+clean; 193 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.7 MiB/s wr, 970 op/s 2024-09-21T06:32:58.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:57 smithi175 ceph-mon[34510]: pgmap v465: 97 pgs: 97 active+clean; 193 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.7 MiB/s wr, 970 op/s 2024-09-21T06:32:59.003 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:32:59.322 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:32:59.739 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:32:59 smithi063 ceph-mon[31150]: pgmap v466: 97 pgs: 97 active+clean; 195 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.8 MiB/s wr, 1.04k op/s 2024-09-21T06:32:59.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.852+0000 7f9b0292c640 1 -- 172.21.15.63:0/1746287458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9afc114770 msgr2=0x7f9afc116b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:59.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.852+0000 7f9b0292c640 1 --2- 172.21.15.63:0/1746287458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9afc114770 0x7f9afc116b90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009900 tx=0x7f9af402a410 comp rx=0 tx=0).stop 2024-09-21T06:32:59.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.853+0000 7f9b0292c640 1 -- 172.21.15.63:0/1746287458 shutdown_connections 2024-09-21T06:32:59.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.853+0000 7f9b0292c640 1 --2- 172.21.15.63:0/1746287458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9afc114770 0x7f9afc116b90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.853+0000 7f9b0292c640 1 --2- 172.21.15.63:0/1746287458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9afc078290 0x7f9afc114230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.853+0000 7f9b0292c640 1 --2- 172.21.15.63:0/1746287458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9afc077940 0x7f9afc077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.853+0000 7f9b0292c640 1 -- 172.21.15.63:0/1746287458 >> 172.21.15.63:0/1746287458 conn(0x7f9afc1017c0 msgr2=0x7f9afc103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:59.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.853+0000 7f9b0292c640 1 -- 172.21.15.63:0/1746287458 shutdown_connections 2024-09-21T06:32:59.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.853+0000 7f9b0292c640 1 -- 172.21.15.63:0/1746287458 wait complete. 2024-09-21T06:32:59.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.853+0000 7f9b0292c640 1 Processor -- start 2024-09-21T06:32:59.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.854+0000 7f9b0292c640 1 -- start start 2024-09-21T06:32:59.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.854+0000 7f9b0292c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9afc077940 0x7f9afc1a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:59.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.854+0000 7f9b0292c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9afc078290 0x7f9afc1a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:59.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.854+0000 7f9b0292c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9afc114770 0x7f9afc1a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:59.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.854+0000 7f9b0292c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9afc11a0f0 con 0x7f9afc114770 2024-09-21T06:32:59.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.854+0000 7f9afbfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9afc077940 0x7f9afc1a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:59.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.854+0000 7f9b0292c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9afc119f70 con 0x7f9afc077940 2024-09-21T06:32:59.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.854+0000 7f9afb7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9afc078290 0x7f9afc1a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:59.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.854+0000 7f9afbfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9afc077940 0x7f9afc1a0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:36498/0 (socket says 172.21.15.63:36498) 2024-09-21T06:32:59.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.854+0000 7f9afbfff640 1 -- 172.21.15.63:0/3894684126 learned_addr learned my addr 172.21.15.63:0/3894684126 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:59.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.854+0000 7f9b0292c640 1 -- 172.21.15.63:0/3894684126 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9afc11a270 con 0x7f9afc078290 2024-09-21T06:32:59.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.854+0000 7f9b00ec9640 1 --2- 172.21.15.63:0/3894684126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9afc114770 0x7f9afc1a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:59.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.855+0000 7f9b00ec9640 1 -- 172.21.15.63:0/3894684126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9afc078290 msgr2=0x7f9afc1a1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:59.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.855+0000 7f9b00ec9640 1 --2- 172.21.15.63:0/3894684126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9afc078290 0x7f9afc1a1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.855+0000 7f9b00ec9640 1 -- 172.21.15.63:0/3894684126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9afc077940 msgr2=0x7f9afc1a0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:59.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.855+0000 7f9b00ec9640 1 --2- 172.21.15.63:0/3894684126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9afc077940 0x7f9afc1a0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.855+0000 7f9b00ec9640 1 -- 172.21.15.63:0/3894684126 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9afc1a69f0 con 0x7f9afc114770 2024-09-21T06:32:59.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.855+0000 7f9b00ec9640 1 --2- 172.21.15.63:0/3894684126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9afc114770 0x7f9afc1a62c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9af4005940 tx=0x7f9af4031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:59.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.855+0000 7f9af97fa640 1 -- 172.21.15.63:0/3894684126 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af403f030 con 0x7f9afc114770 2024-09-21T06:32:59.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.856+0000 7f9af97fa640 1 -- 172.21.15.63:0/3894684126 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9af40043d0 con 0x7f9afc114770 2024-09-21T06:32:59.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.856+0000 7f9af97fa640 1 -- 172.21.15.63:0/3894684126 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af4035070 con 0x7f9afc114770 2024-09-21T06:32:59.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.856+0000 7f9b0292c640 1 -- 172.21.15.63:0/3894684126 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9afc1a6c80 con 0x7f9afc114770 2024-09-21T06:32:59.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.856+0000 7f9b0292c640 1 -- 172.21.15.63:0/3894684126 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9afc1a7050 con 0x7f9afc114770 2024-09-21T06:32:59.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.859+0000 7f9af97fa640 1 -- 172.21.15.63:0/3894684126 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f9af4042030 con 0x7f9afc114770 2024-09-21T06:32:59.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.859+0000 7f9b08ea0740 1 Processor -- start 2024-09-21T06:32:59.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.859+0000 7f9b08ea0740 1 -- start start 2024-09-21T06:32:59.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.859+0000 7f9b08ea0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41de070 0x55c2a45852c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:59.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.859+0000 7f9b08ea0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a41b51b0 0x55c2a4585800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:59.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.859+0000 7f9b08ea0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2a41bd390 0x55c2a4585d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:59.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.859+0000 7f9b08ea0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c2a44fbea0 con 0x55c2a41de070 2024-09-21T06:32:59.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.859+0000 7f9b08ea0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c2a44eb2d0 con 0x55c2a41b51b0 2024-09-21T06:32:59.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.859+0000 7f9b08ea0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c2a44ef0e0 con 0x55c2a41bd390 2024-09-21T06:32:59.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.860+0000 7f9afb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41de070 0x55c2a45852c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:59.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.860+0000 7f9afbfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a41b51b0 0x55c2a4585800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:59.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.860+0000 7f9afbfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a41b51b0 0x55c2a4585800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:36512/0 (socket says 172.21.15.63:36512) 2024-09-21T06:32:59.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.860+0000 7f9afb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41de070 0x55c2a45852c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39150/0 (socket says 172.21.15.63:39150) 2024-09-21T06:32:59.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.860+0000 7f9afbfff640 1 -- 172.21.15.63:0/1277072509 learned_addr learned my addr 172.21.15.63:0/1277072509 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:59.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.860+0000 7f9afb7fe640 1 --2- 172.21.15.63:0/1277072509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2a41bd390 0x55c2a4585d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:59.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.860+0000 7f9af97fa640 1 --2- 172.21.15.63:0/3894684126 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9ae80b6680 0x7f9ae80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:59.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.860+0000 7f9afb7fe640 1 -- 172.21.15.63:0/1277072509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2a41bd390 msgr2=0x55c2a4585d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:59.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.860+0000 7f9afb7fe640 1 --2- 172.21.15.63:0/1277072509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2a41bd390 0x55c2a4585d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.860+0000 7f9afb7fe640 1 -- 172.21.15.63:0/1277072509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a41b51b0 msgr2=0x55c2a4585800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:59.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.860+0000 7f9afb7fe640 1 --2- 172.21.15.63:0/1277072509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a41b51b0 0x55c2a4585800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.860+0000 7f9afb7fe640 1 -- 172.21.15.63:0/1277072509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2a4249650 con 0x55c2a41de070 2024-09-21T06:32:59.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.860+0000 7f9af97fa640 1 -- 172.21.15.63:0/3894684126 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f9af41079d0 con 0x7f9afc114770 2024-09-21T06:32:59.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.860+0000 7f9b00ec9640 1 --2- 172.21.15.63:0/3894684126 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9ae80b6680 0x7f9ae80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:59.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.861+0000 7f9afb7fe640 1 --2- 172.21.15.63:0/1277072509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41de070 0x55c2a45852c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9afc07a170 tx=0x7f9ae40096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684509e1f8053487 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:59.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.861+0000 7f9af27fc640 1 -- 172.21.15.63:0/1277072509 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4013d50 con 0x55c2a41de070 2024-09-21T06:32:59.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.861+0000 7f9af27fc640 1 -- 172.21.15.63:0/1277072509 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ae4013120 con 0x55c2a41de070 2024-09-21T06:32:59.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.861+0000 7f9af27fc640 1 -- 172.21.15.63:0/1277072509 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae400fc00 con 0x55c2a41de070 2024-09-21T06:32:59.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.861+0000 7f9b00ec9640 1 --2- 172.21.15.63:0/3894684126 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9ae80b6680 0x7f9ae80b8b90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9af4105160 tx=0x7f9af403b460 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:59.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.863+0000 7f9b08ea0740 1 -- 172.21.15.63:0/1277072509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41de070 msgr2=0x55c2a45852c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:59.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.863+0000 7f9b08ea0740 1 --2- 172.21.15.63:0/1277072509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41de070 0x55c2a45852c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9afc07a170 tx=0x7f9ae40096c0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.863+0000 7f9b08ea0740 1 -- 172.21.15.63:0/1277072509 shutdown_connections 2024-09-21T06:32:59.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.863+0000 7f9b08ea0740 1 --2- 172.21.15.63:0/1277072509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2a41bd390 0x55c2a4585d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.863+0000 7f9b08ea0740 1 --2- 172.21.15.63:0/1277072509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a41b51b0 0x55c2a4585800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.863+0000 7f9b08ea0740 1 --2- 172.21.15.63:0/1277072509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41de070 0x55c2a45852c0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.863+0000 7f9b08ea0740 1 -- 172.21.15.63:0/1277072509 >> 172.21.15.63:0/1277072509 conn(0x55c2a41d2460 msgr2=0x55c2a45831b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:59.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.863+0000 7f9b08ea0740 1 -- 172.21.15.63:0/1277072509 shutdown_connections 2024-09-21T06:32:59.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.863+0000 7f9b08ea0740 1 -- 172.21.15.63:0/1277072509 wait complete. 2024-09-21T06:32:59.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.864+0000 7f9b08ea0740 1 -- start start 2024-09-21T06:32:59.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.864+0000 7f9b08ea0740 1 Processor -- start 2024-09-21T06:32:59.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.865+0000 7f9b08ea0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a41b51b0 0x55c2a45909c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:59.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.865+0000 7f9b08ea0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41bd390 0x55c2a4590f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:59.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.865+0000 7f9b08ea0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2a41de070 0x55c2a459cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:59.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.865+0000 7f9b08ea0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c2a434c700 con 0x55c2a41bd390 2024-09-21T06:32:59.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.865+0000 7f9b08ea0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c2a4486160 con 0x55c2a41b51b0 2024-09-21T06:32:59.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.865+0000 7f9b08ea0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c2a4593a40 con 0x55c2a41de070 2024-09-21T06:32:59.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.865+0000 7f9b08ea0740 10 client.0 _ll_register_callbacks cb 0x55c2a449f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:59.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.865+0000 7f9afb7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a41b51b0 0x55c2a45909c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:59.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.865+0000 7f9afb7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a41b51b0 0x55c2a45909c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:36526/0 (socket says 172.21.15.63:36526) 2024-09-21T06:32:59.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.865+0000 7f9afb7fe640 1 -- 172.21.15.63:0/2401217063 learned_addr learned my addr 172.21.15.63:0/2401217063 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:59.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.865+0000 7f9afb7fe640 1 --2- 172.21.15.63:0/2401217063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2a41de070 0x55c2a459cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:59.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.865+0000 7f9afbfff640 1 --2- 172.21.15.63:0/2401217063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41bd390 0x55c2a4590f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:59.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.865+0000 7f9afb7fe640 1 -- 172.21.15.63:0/2401217063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2a41de070 msgr2=0x55c2a459cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:59.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.865+0000 7f9afb7fe640 1 --2- 172.21.15.63:0/2401217063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2a41de070 0x55c2a459cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.865+0000 7f9afb7fe640 1 -- 172.21.15.63:0/2401217063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41bd390 msgr2=0x55c2a4590f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:59.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.865+0000 7f9afb7fe640 1 --2- 172.21.15.63:0/2401217063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41bd390 0x55c2a4590f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.865+0000 7f9afb7fe640 1 -- 172.21.15.63:0/2401217063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2a44b3c90 con 0x55c2a41b51b0 2024-09-21T06:32:59.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.866+0000 7f9afb7fe640 1 --2- 172.21.15.63:0/2401217063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a41b51b0 0x55c2a45909c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9ae401d040 tx=0x7f9ae4009cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=908bff1e6c06ba21 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:59.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.866+0000 7f9adb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:32:59.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.866+0000 7f9adb7fe640 1 -- 172.21.15.63:0/2401217063 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae400fe20 con 0x55c2a41b51b0 2024-09-21T06:32:59.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.866+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2401217063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ae4013120 con 0x55c2a41b51b0 2024-09-21T06:32:59.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.866+0000 7f9adb7fe640 1 -- 172.21.15.63:0/2401217063 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f9ae40046c0 con 0x55c2a41b51b0 2024-09-21T06:32:59.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.866+0000 7f9adb7fe640 1 -- 172.21.15.63:0/2401217063 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f9ae40048c0 con 0x55c2a41b51b0 2024-09-21T06:32:59.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.866+0000 7f9b08ea0740 10 client.26168 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:59.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.866+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2401217063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55c2a459f730 con 0x55c2a41b51b0 2024-09-21T06:32:59.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.867+0000 7f9adb7fe640 1 -- 172.21.15.63:0/2401217063 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ae4013120 con 0x55c2a41b51b0 2024-09-21T06:32:59.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.867+0000 7f9adb7fe640 1 -- 172.21.15.63:0/2401217063 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f9ae401fac0 con 0x55c2a41b51b0 2024-09-21T06:32:59.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.867+0000 7f9b08ea0740 10 client.26168 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:59.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.867+0000 7f9b08ea0740 10 client.26168 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:32:59.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.867+0000 7f9b08ea0740 20 client.26168 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:59.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.867+0000 7f9b08ea0740 1 --2- 172.21.15.63:0/2401217063 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55c2a419c9f0 0x55c2a45a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:59.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.867+0000 7f9b08ea0740 4 client.26168 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:32:59.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.867+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2401217063 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2a44fddf0 con 0x55c2a419c9f0 2024-09-21T06:32:59.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.867+0000 7f9afbfff640 1 --2- 172.21.15.63:0/2401217063 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55c2a419c9f0 0x55c2a45a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:59.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.868+0000 7f9afbfff640 1 --2- 172.21.15.63:0/2401217063 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55c2a419c9f0 0x55c2a45a2a90 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b51543b0b9cbeb1a server_cookie=14b4cdf401a7bb6c in_seq=0 out_seq=0 2024-09-21T06:32:59.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.868+0000 7f9adb7fe640 10 client.26168 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:32:59.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.868+0000 7f9adb7fe640 1 -- 172.21.15.63:0/2401217063 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c2a44fddf0 con 0x55c2a419c9f0 2024-09-21T06:32:59.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.868+0000 7f9adb7fe640 10 client.26168 handle_command_reply: tid=0 2024-09-21T06:32:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.869+0000 7f9b08ea0740 1 client.26168 shutdown 2024-09-21T06:32:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.869+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2401217063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a41b51b0 msgr2=0x55c2a45909c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.869+0000 7f9b08ea0740 1 --2- 172.21.15.63:0/2401217063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a41b51b0 0x55c2a45909c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9ae401d040 tx=0x7f9ae4009cb0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.869+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2401217063 shutdown_connections 2024-09-21T06:32:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.869+0000 7f9b08ea0740 1 --2- 172.21.15.63:0/2401217063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2a41de070 0x55c2a459cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.869+0000 7f9b08ea0740 1 --2- 172.21.15.63:0/2401217063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41bd390 0x55c2a4590f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.869+0000 7f9b08ea0740 1 --2- 172.21.15.63:0/2401217063 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55c2a419c9f0 0x55c2a45a2a90 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.869+0000 7f9b08ea0740 1 --2- 172.21.15.63:0/2401217063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a41b51b0 0x55c2a45909c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.869+0000 7f9adb7fe640 0 client.26168 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:32:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.869+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2401217063 >> 172.21.15.63:0/2401217063 conn(0x55c2a41d2460 msgr2=0x55c2a45884a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.869+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2401217063 shutdown_connections 2024-09-21T06:32:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.869+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2401217063 wait complete. 2024-09-21T06:32:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.869+0000 7f9b08ea0740 20 client.26168 trim_cache size 0 max 16384 2024-09-21T06:32:59.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.888+0000 7f9b08ea0740 1 Processor -- start 2024-09-21T06:32:59.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.889+0000 7f9b08ea0740 1 -- start start 2024-09-21T06:32:59.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.889+0000 7f9b08ea0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a419c9f0 0x55c2a45925f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:59.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.889+0000 7f9b08ea0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2a41b51b0 0x55c2a459cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:59.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.889+0000 7f9b08ea0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41bd390 0x55c2a458dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:59.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.889+0000 7f9b08ea0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9afc1b5d20 con 0x55c2a41bd390 2024-09-21T06:32:59.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.889+0000 7f9b08ea0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9afc1b7920 con 0x55c2a419c9f0 2024-09-21T06:32:59.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.889+0000 7f9b08ea0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9afc1b64b0 con 0x55c2a41b51b0 2024-09-21T06:32:59.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.889+0000 7f9afb7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a419c9f0 0x55c2a45925f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:59.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.889+0000 7f9afb7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a419c9f0 0x55c2a45925f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:36528/0 (socket says 172.21.15.63:36528) 2024-09-21T06:32:59.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.889+0000 7f9afb7fe640 1 -- 172.21.15.63:0/2179039778 learned_addr learned my addr 172.21.15.63:0/2179039778 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:59.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.889+0000 7f9afb7fe640 1 --2- 172.21.15.63:0/2179039778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41bd390 0x55c2a458dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:59.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.890+0000 7f9afb7fe640 1 -- 172.21.15.63:0/2179039778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2a41b51b0 msgr2=0x55c2a459cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:59.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.890+0000 7f9afb7fe640 1 --2- 172.21.15.63:0/2179039778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2a41b51b0 0x55c2a459cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.890+0000 7f9afb7fe640 1 -- 172.21.15.63:0/2179039778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41bd390 msgr2=0x55c2a458dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:59.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.890+0000 7f9afb7fe640 1 --2- 172.21.15.63:0/2179039778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41bd390 0x55c2a458dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.890+0000 7f9afb7fe640 1 -- 172.21.15.63:0/2179039778 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2a4588120 con 0x55c2a419c9f0 2024-09-21T06:32:59.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.890+0000 7f9afb7fe640 1 --2- 172.21.15.63:0/2179039778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a419c9f0 0x55c2a45925f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4013430 tx=0x7f9ae4024040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83f1b272d2307f7b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:59.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.890+0000 7f9af1ffb640 1 -- 172.21.15.63:0/2179039778 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4013120 con 0x55c2a419c9f0 2024-09-21T06:32:59.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.890+0000 7f9af1ffb640 1 -- 172.21.15.63:0/2179039778 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ae400fc20 con 0x55c2a419c9f0 2024-09-21T06:32:59.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.890+0000 7f9af1ffb640 1 -- 172.21.15.63:0/2179039778 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae402fc60 con 0x55c2a419c9f0 2024-09-21T06:32:59.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.891+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2179039778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a419c9f0 msgr2=0x55c2a45925f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:59.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.891+0000 7f9b08ea0740 1 --2- 172.21.15.63:0/2179039778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a419c9f0 0x55c2a45925f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4013430 tx=0x7f9ae4024040 comp rx=0 tx=0).stop 2024-09-21T06:32:59.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.891+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2179039778 shutdown_connections 2024-09-21T06:32:59.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.891+0000 7f9b08ea0740 1 --2- 172.21.15.63:0/2179039778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41bd390 0x55c2a458dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.891+0000 7f9b08ea0740 1 --2- 172.21.15.63:0/2179039778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2a41b51b0 0x55c2a459cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.891+0000 7f9b08ea0740 1 --2- 172.21.15.63:0/2179039778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a419c9f0 0x55c2a45925f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.891+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2179039778 >> 172.21.15.63:0/2179039778 conn(0x55c2a41d2460 msgr2=0x55c2a4591ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:59.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.892+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2179039778 shutdown_connections 2024-09-21T06:32:59.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.892+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2179039778 wait complete. 2024-09-21T06:32:59.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.892+0000 7f9b08ea0740 1 -- start start 2024-09-21T06:32:59.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.892+0000 7f9b08ea0740 1 Processor -- start 2024-09-21T06:32:59.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.893+0000 7f9b08ea0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a41b51b0 0x55c2a45a3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:59.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.893+0000 7f9b08ea0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41bd390 0x55c2a45a4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:59.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.893+0000 7f9b08ea0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2a41de070 0x55c2a460c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:59.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.893+0000 7f9b08ea0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9afc1b7250 con 0x55c2a41bd390 2024-09-21T06:32:59.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.893+0000 7f9b08ea0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9afc1b6b80 con 0x55c2a41b51b0 2024-09-21T06:32:59.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.893+0000 7f9b08ea0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9afc1b3d00 con 0x55c2a41de070 2024-09-21T06:32:59.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.893+0000 7f9b08ea0740 10 client.0 _ll_register_callbacks cb 0x7f9ae4009d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:32:59.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.893+0000 7f9afbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41bd390 0x55c2a45a4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:59.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.893+0000 7f9afb7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a41b51b0 0x55c2a45a3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:59.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.893+0000 7f9afbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41bd390 0x55c2a45a4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39184/0 (socket says 172.21.15.63:39184) 2024-09-21T06:32:59.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.893+0000 7f9afbfff640 1 -- 172.21.15.63:0/2142870306 learned_addr learned my addr 172.21.15.63:0/2142870306 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:32:59.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.893+0000 7f9afb7fe640 1 --2- 172.21.15.63:0/2142870306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2a41de070 0x55c2a460c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:59.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.894+0000 7f9afbfff640 1 -- 172.21.15.63:0/2142870306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2a41de070 msgr2=0x55c2a460c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:59.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.894+0000 7f9afbfff640 1 --2- 172.21.15.63:0/2142870306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2a41de070 0x55c2a460c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.894+0000 7f9afbfff640 1 -- 172.21.15.63:0/2142870306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a41b51b0 msgr2=0x55c2a45a3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:32:59.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.894+0000 7f9afbfff640 1 --2- 172.21.15.63:0/2142870306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a41b51b0 0x55c2a45a3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.894+0000 7f9afbfff640 1 -- 172.21.15.63:0/2142870306 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2a460c750 con 0x55c2a41bd390 2024-09-21T06:32:59.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.894+0000 7f9afb7fe640 1 --2- 172.21.15.63:0/2142870306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a41b51b0 0x55c2a45a3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:59.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.894+0000 7f9afbfff640 1 --2- 172.21.15.63:0/2142870306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41bd390 0x55c2a45a4400 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9aec0049d0 tx=0x7f9aec012eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2960b7647542ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:59.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.894+0000 7f9adb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:32:59.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.894+0000 7f9adb7fe640 1 -- 172.21.15.63:0/2142870306 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec004d20 con 0x55c2a41bd390 2024-09-21T06:32:59.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.894+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2142870306 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ae400fc20 con 0x55c2a41bd390 2024-09-21T06:32:59.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.894+0000 7f9adb7fe640 1 -- 172.21.15.63:0/2142870306 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f9aec00f9b0 con 0x55c2a41bd390 2024-09-21T06:32:59.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.895+0000 7f9adb7fe640 1 -- 172.21.15.63:0/2142870306 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f9aec00fbb0 con 0x55c2a41bd390 2024-09-21T06:32:59.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.895+0000 7f9b08ea0740 10 client.16521 fetch_fsmap learned FSMap version 43 2024-09-21T06:32:59.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.895+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2142870306 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55c2a460d880 con 0x55c2a41bd390 2024-09-21T06:32:59.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.895+0000 7f9adb7fe640 1 -- 172.21.15.63:0/2142870306 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ae400fc20 con 0x55c2a41bd390 2024-09-21T06:32:59.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.895+0000 7f9adb7fe640 1 -- 172.21.15.63:0/2142870306 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f9aec010430 con 0x55c2a41bd390 2024-09-21T06:32:59.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.895+0000 7f9b08ea0740 10 client.16521 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:32:59.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.895+0000 7f9b08ea0740 10 client.16521 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:32:59.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.895+0000 7f9b08ea0740 20 client.16521 populate_metadata read hostname 'smithi063' 2024-09-21T06:32:59.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.895+0000 7f9b08ea0740 1 --2- 172.21.15.63:0/2142870306 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55c2a4171da0 0x55c2a4610070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:59.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.895+0000 7f9b08ea0740 4 client.16521 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:32:59.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.895+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2142870306 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c2a44f98a0 con 0x55c2a4171da0 2024-09-21T06:32:59.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.896+0000 7f9afb7fe640 1 --2- 172.21.15.63:0/2142870306 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55c2a4171da0 0x55c2a4610070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:59.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.898+0000 7f9afb7fe640 1 --2- 172.21.15.63:0/2142870306 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55c2a4171da0 0x55c2a4610070 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ba8705a102ed5a0 server_cookie=c10fab26531f4181 in_seq=0 out_seq=0 2024-09-21T06:32:59.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.898+0000 7f9adb7fe640 10 client.16521 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:32:59.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.898+0000 7f9adb7fe640 1 -- 172.21.15.63:0/2142870306 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c2a44f98a0 con 0x55c2a4171da0 2024-09-21T06:32:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.898+0000 7f9adb7fe640 10 client.16521 handle_command_reply: tid=0 2024-09-21T06:32:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.898+0000 7f9b08ea0740 1 client.16521 shutdown 2024-09-21T06:32:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.899+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2142870306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41bd390 msgr2=0x55c2a45a4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.899+0000 7f9b08ea0740 1 --2- 172.21.15.63:0/2142870306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41bd390 0x55c2a45a4400 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9aec0049d0 tx=0x7f9aec012eb0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.899+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2142870306 shutdown_connections 2024-09-21T06:32:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.899+0000 7f9b08ea0740 1 --2- 172.21.15.63:0/2142870306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2a41de070 0x55c2a460c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.899+0000 7f9b08ea0740 1 --2- 172.21.15.63:0/2142870306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c2a41bd390 0x55c2a45a4400 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.899+0000 7f9b08ea0740 1 --2- 172.21.15.63:0/2142870306 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55c2a4171da0 0x55c2a4610070 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.899+0000 7f9b08ea0740 1 --2- 172.21.15.63:0/2142870306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c2a41b51b0 0x55c2a45a3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.899+0000 7f9adb7fe640 0 client.16521 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:32:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.899+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2142870306 >> 172.21.15.63:0/2142870306 conn(0x55c2a41d2460 msgr2=0x55c2a4592640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.899+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2142870306 shutdown_connections 2024-09-21T06:32:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.899+0000 7f9b08ea0740 1 -- 172.21.15.63:0/2142870306 wait complete. 2024-09-21T06:32:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.900+0000 7f9b08ea0740 20 client.16521 trim_cache size 0 max 16384 2024-09-21T06:32:59.903 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:32:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.900+0000 7f9b0292c640 1 -- 172.21.15.63:0/3894684126 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9ae80b6680 msgr2=0x7f9ae80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:59.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.900+0000 7f9b0292c640 1 --2- 172.21.15.63:0/3894684126 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9ae80b6680 0x7f9ae80b8b90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9af4105160 tx=0x7f9af403b460 comp rx=0 tx=0).stop 2024-09-21T06:32:59.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.900+0000 7f9b0292c640 1 -- 172.21.15.63:0/3894684126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9afc114770 msgr2=0x7f9afc1a62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:59.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.900+0000 7f9b0292c640 1 --2- 172.21.15.63:0/3894684126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9afc114770 0x7f9afc1a62c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9af4005940 tx=0x7f9af4031a10 comp rx=0 tx=0).stop 2024-09-21T06:32:59.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.901+0000 7f9b0292c640 1 -- 172.21.15.63:0/3894684126 shutdown_connections 2024-09-21T06:32:59.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.901+0000 7f9b0292c640 1 --2- 172.21.15.63:0/3894684126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9afc114770 0x7f9afc1a62c0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.901+0000 7f9b0292c640 1 --2- 172.21.15.63:0/3894684126 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f9ae80b6680 0x7f9ae80b8b90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.901+0000 7f9b0292c640 1 --2- 172.21.15.63:0/3894684126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9afc078290 0x7f9afc1a1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.901+0000 7f9b0292c640 1 --2- 172.21.15.63:0/3894684126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9afc077940 0x7f9afc1a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:59.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.901+0000 7f9b0292c640 1 -- 172.21.15.63:0/3894684126 >> 172.21.15.63:0/3894684126 conn(0x7f9afc1017c0 msgr2=0x7f9afc103be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:59.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.901+0000 7f9b0292c640 1 -- 172.21.15.63:0/3894684126 shutdown_connections 2024-09-21T06:32:59.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:32:59.901+0000 7f9b0292c640 1 -- 172.21.15.63:0/3894684126 wait complete. 2024-09-21T06:33:00.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:32:59 smithi071 ceph-mon[34844]: pgmap v466: 97 pgs: 97 active+clean; 195 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.8 MiB/s wr, 1.04k op/s 2024-09-21T06:33:00.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:32:59 smithi175 ceph-mon[34510]: pgmap v466: 97 pgs: 97 active+clean; 195 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.8 MiB/s wr, 1.04k op/s 2024-09-21T06:33:00.761 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:33:01.092 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:01.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.653+0000 7f7db72d9640 1 -- 172.21.15.63:0/835241660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7db0103bc0 msgr2=0x7f7db0103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:01.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.653+0000 7f7db72d9640 1 --2- 172.21.15.63:0/835241660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7db0103bc0 0x7f7db0103fd0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009900 tx=0x7f7dac02a410 comp rx=0 tx=0).stop 2024-09-21T06:33:01.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.653+0000 7f7db72d9640 1 -- 172.21.15.63:0/835241660 shutdown_connections 2024-09-21T06:33:01.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.653+0000 7f7db72d9640 1 --2- 172.21.15.63:0/835241660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7db0109e00 0x7f7db0110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.653+0000 7f7db72d9640 1 --2- 172.21.15.63:0/835241660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7db01094b0 0x7f7db01098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.653+0000 7f7db72d9640 1 --2- 172.21.15.63:0/835241660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7db0103bc0 0x7f7db0103fd0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.653+0000 7f7db72d9640 1 -- 172.21.15.63:0/835241660 >> 172.21.15.63:0/835241660 conn(0x7f7db007b910 msgr2=0x7f7db007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:01.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.653+0000 7f7db72d9640 1 -- 172.21.15.63:0/835241660 shutdown_connections 2024-09-21T06:33:01.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.653+0000 7f7db72d9640 1 -- 172.21.15.63:0/835241660 wait complete. 2024-09-21T06:33:01.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.655+0000 7f7db72d9640 1 Processor -- start 2024-09-21T06:33:01.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.655+0000 7f7db72d9640 1 -- start start 2024-09-21T06:33:01.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.655+0000 7f7db72d9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7db0103bc0 0x7f7db019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:01.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.655+0000 7f7db72d9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7db01094b0 0x7f7db019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:01.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.655+0000 7f7db72d9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7db0109e00 0x7f7db019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:01.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.655+0000 7f7db72d9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7db0113ac0 con 0x7f7db0103bc0 2024-09-21T06:33:01.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.655+0000 7f7db72d9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7db0113940 con 0x7f7db0109e00 2024-09-21T06:33:01.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.655+0000 7f7db72d9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7db0113c40 con 0x7f7db01094b0 2024-09-21T06:33:01.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.656+0000 7f7db5075640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7db0103bc0 0x7f7db019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:01.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.656+0000 7f7db4874640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7db01094b0 0x7f7db019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.656+0000 7f7db5876640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7db0109e00 0x7f7db019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.656+0000 7f7db5075640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7db0103bc0 0x7f7db019a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39200/0 (socket says 172.21.15.63:39200) 2024-09-21T06:33:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.656+0000 7f7db5876640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7db0109e00 0x7f7db019fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:36556/0 (socket says 172.21.15.63:36556) 2024-09-21T06:33:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.656+0000 7f7db4874640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7db01094b0 0x7f7db019aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:43346/0 (socket says 172.21.15.63:43346) 2024-09-21T06:33:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.656+0000 7f7db5075640 1 -- 172.21.15.63:0/222916869 learned_addr learned my addr 172.21.15.63:0/222916869 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.656+0000 7f7db5876640 1 -- 172.21.15.63:0/222916869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7db01094b0 msgr2=0x7f7db019aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.656+0000 7f7db5876640 1 --2- 172.21.15.63:0/222916869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7db01094b0 0x7f7db019aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.656+0000 7f7db5876640 1 -- 172.21.15.63:0/222916869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7db0103bc0 msgr2=0x7f7db019a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.656+0000 7f7db5876640 1 --2- 172.21.15.63:0/222916869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7db0103bc0 0x7f7db019a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.656+0000 7f7db5876640 1 -- 172.21.15.63:0/222916869 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db01a0460 con 0x7f7db0109e00 2024-09-21T06:33:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.656+0000 7f7db4874640 1 --2- 172.21.15.63:0/222916869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7db01094b0 0x7f7db019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:33:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.656+0000 7f7db5876640 1 --2- 172.21.15.63:0/222916869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7db0109e00 0x7f7db019fd30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009fd0 tx=0x7f7da800b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:01.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.657+0000 7f7da67fc640 1 -- 172.21.15.63:0/222916869 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8004b20 con 0x7f7db0109e00 2024-09-21T06:33:01.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.657+0000 7f7da67fc640 1 -- 172.21.15.63:0/222916869 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7da8004cc0 con 0x7f7db0109e00 2024-09-21T06:33:01.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.657+0000 7f7da67fc640 1 -- 172.21.15.63:0/222916869 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8005410 con 0x7f7db0109e00 2024-09-21T06:33:01.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.657+0000 7f7db72d9640 1 -- 172.21.15.63:0/222916869 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db01a0750 con 0x7f7db0109e00 2024-09-21T06:33:01.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.657+0000 7f7db72d9640 1 -- 172.21.15.63:0/222916869 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db00755f0 con 0x7f7db0109e00 2024-09-21T06:33:01.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.660+0000 7f7da67fc640 1 -- 172.21.15.63:0/222916869 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f7da8005840 con 0x7f7db0109e00 2024-09-21T06:33:01.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.660+0000 7f7dbd84d740 1 Processor -- start 2024-09-21T06:33:01.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.660+0000 7f7dbd84d740 1 -- start start 2024-09-21T06:33:01.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.660+0000 7f7dbd84d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a7c5070 0x562f1ab6c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:01.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.660+0000 7f7dbd84d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a79c1b0 0x562f1ab6cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.660+0000 7f7dbd84d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7a4390 0x562f1ab6d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.660+0000 7f7dbd84d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x562f1aae2ea0 con 0x562f1a79c1b0 2024-09-21T06:33:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.660+0000 7f7dbd84d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562f1aad22d0 con 0x562f1a7c5070 2024-09-21T06:33:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.660+0000 7f7dbd84d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562f1aad60e0 con 0x562f1a7a4390 2024-09-21T06:33:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.661+0000 7f7db5075640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a79c1b0 0x562f1ab6cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.661+0000 7f7db4874640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a7c5070 0x562f1ab6c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.661+0000 7f7db5075640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a79c1b0 0x562f1ab6cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39202/0 (socket says 172.21.15.63:39202) 2024-09-21T06:33:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.661+0000 7f7db4874640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a7c5070 0x562f1ab6c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:36566/0 (socket says 172.21.15.63:36566) 2024-09-21T06:33:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.661+0000 7f7db5075640 1 -- 172.21.15.63:0/2239683200 learned_addr learned my addr 172.21.15.63:0/2239683200 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.661+0000 7f7db4874640 1 --2- 172.21.15.63:0/2239683200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7a4390 0x562f1ab6d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.661+0000 7f7db4874640 1 -- 172.21.15.63:0/2239683200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7a4390 msgr2=0x562f1ab6d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.661+0000 7f7db4874640 1 --2- 172.21.15.63:0/2239683200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7a4390 0x562f1ab6d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.661+0000 7f7db4874640 1 -- 172.21.15.63:0/2239683200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a79c1b0 msgr2=0x562f1ab6cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.661+0000 7f7db4874640 1 --2- 172.21.15.63:0/2239683200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a79c1b0 0x562f1ab6cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.661+0000 7f7db4874640 1 -- 172.21.15.63:0/2239683200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f1a830650 con 0x562f1a7c5070 2024-09-21T06:33:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.661+0000 7f7db4874640 1 --2- 172.21.15.63:0/2239683200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a7c5070 0x562f1ab6c6a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7db007bff0 tx=0x7f7da0005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f36002667b1895c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.661+0000 7f7d9b7fe640 1 -- 172.21.15.63:0/2239683200 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da0013250 con 0x562f1a7c5070 2024-09-21T06:33:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.662+0000 7f7d9b7fe640 1 -- 172.21.15.63:0/2239683200 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7da0011930 con 0x562f1a7c5070 2024-09-21T06:33:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.662+0000 7f7d9b7fe640 1 -- 172.21.15.63:0/2239683200 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da00039b0 con 0x562f1a7c5070 2024-09-21T06:33:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.662+0000 7f7da67fc640 1 --2- 172.21.15.63:0/222916869 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7d9c0b6700 0x7f7d9c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.662+0000 7f7db5075640 1 --2- 172.21.15.63:0/222916869 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7d9c0b6700 0x7f7d9c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.662+0000 7f7da67fc640 1 -- 172.21.15.63:0/222916869 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f7da80eb7d0 con 0x7f7db0109e00 2024-09-21T06:33:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.663+0000 7f7dbd84d740 1 -- 172.21.15.63:0/2239683200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a7c5070 msgr2=0x562f1ab6c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.663+0000 7f7dbd84d740 1 --2- 172.21.15.63:0/2239683200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a7c5070 0x562f1ab6c6a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7db007bff0 tx=0x7f7da0005850 comp rx=0 tx=0).stop 2024-09-21T06:33:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.663+0000 7f7dbd84d740 1 -- 172.21.15.63:0/2239683200 shutdown_connections 2024-09-21T06:33:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.663+0000 7f7dbd84d740 1 --2- 172.21.15.63:0/2239683200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7a4390 0x562f1ab6d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.663+0000 7f7dbd84d740 1 --2- 172.21.15.63:0/2239683200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a79c1b0 0x562f1ab6cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.663+0000 7f7dbd84d740 1 --2- 172.21.15.63:0/2239683200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a7c5070 0x562f1ab6c6a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.663+0000 7f7dbd84d740 1 -- 172.21.15.63:0/2239683200 >> 172.21.15.63:0/2239683200 conn(0x562f1a7b9460 msgr2=0x562f1ab6a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.663+0000 7f7db5075640 1 --2- 172.21.15.63:0/222916869 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7d9c0b6700 0x7f7d9c0b8c10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0096c0 tx=0x7f7dac0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.663+0000 7f7dbd84d740 1 -- 172.21.15.63:0/2239683200 shutdown_connections 2024-09-21T06:33:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.663+0000 7f7dbd84d740 1 -- 172.21.15.63:0/2239683200 wait complete. 2024-09-21T06:33:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.663+0000 7f7dbd84d740 1 -- start start 2024-09-21T06:33:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.663+0000 7f7dbd84d740 1 Processor -- start 2024-09-21T06:33:01.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.664+0000 7f7dbd84d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a79c1b0 0x562f1ab77e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:01.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.664+0000 7f7dbd84d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a7a4390 0x562f1ab78360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:01.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.664+0000 7f7dbd84d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7c5070 0x562f1ab841f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:01.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.664+0000 7f7dbd84d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x562f1a933700 con 0x562f1a7a4390 2024-09-21T06:33:01.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.664+0000 7f7dbd84d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562f1aa6d160 con 0x562f1a79c1b0 2024-09-21T06:33:01.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.664+0000 7f7dbd84d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562f1ab7aed0 con 0x562f1a7c5070 2024-09-21T06:33:01.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.664+0000 7f7db5075640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a79c1b0 0x562f1ab77e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:01.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.664+0000 7f7dbd84d740 10 client.0 _ll_register_callbacks cb 0x562f1aa869e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:01.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.664+0000 7f7db5876640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7c5070 0x562f1ab841f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:01.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.664+0000 7f7db4874640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a7a4390 0x562f1ab78360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:01.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.664+0000 7f7db5876640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7c5070 0x562f1ab841f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:43352/0 (socket says 172.21.15.63:43352) 2024-09-21T06:33:01.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.664+0000 7f7db5075640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a79c1b0 0x562f1ab77e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:36570/0 (socket says 172.21.15.63:36570) 2024-09-21T06:33:01.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.664+0000 7f7db5876640 1 -- 172.21.15.63:0/3520036020 learned_addr learned my addr 172.21.15.63:0/3520036020 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:01.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.664+0000 7f7db5876640 1 -- 172.21.15.63:0/3520036020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a79c1b0 msgr2=0x562f1ab77e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:01.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.664+0000 7f7db5876640 1 --2- 172.21.15.63:0/3520036020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a79c1b0 0x562f1ab77e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.664+0000 7f7db5876640 1 -- 172.21.15.63:0/3520036020 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a7a4390 msgr2=0x562f1ab78360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:01.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.664+0000 7f7db5876640 1 --2- 172.21.15.63:0/3520036020 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a7a4390 0x562f1ab78360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.664+0000 7f7db5876640 1 -- 172.21.15.63:0/3520036020 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f1aa9ac90 con 0x562f1a7c5070 2024-09-21T06:33:01.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.665+0000 7f7db4874640 1 --2- 172.21.15.63:0/3520036020 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a7a4390 0x562f1ab78360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:33:01.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.665+0000 7f7db5876640 1 --2- 172.21.15.63:0/3520036020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7c5070 0x562f1ab841f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7da80adc20 tx=0x7f7da80b14e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93408989970b80d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:01.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.665+0000 7f7d98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:33:01.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.665+0000 7f7d98ff9640 1 -- 172.21.15.63:0/3520036020 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da80b1160 con 0x562f1a7c5070 2024-09-21T06:33:01.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.665+0000 7f7d98ff9640 1 -- 172.21.15.63:0/3520036020 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f7da80acfa0 con 0x562f1a7c5070 2024-09-21T06:33:01.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.665+0000 7f7dbd84d740 1 -- 172.21.15.63:0/3520036020 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7da0011930 con 0x562f1a7c5070 2024-09-21T06:33:01.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.665+0000 7f7d98ff9640 1 -- 172.21.15.63:0/3520036020 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f7da80b6080 con 0x562f1a7c5070 2024-09-21T06:33:01.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.665+0000 7f7dbd84d740 10 client.26239 fetch_fsmap learned FSMap version 43 2024-09-21T06:33:01.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.665+0000 7f7dbd84d740 1 -- 172.21.15.63:0/3520036020 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x562f1ab86c50 con 0x562f1a7c5070 2024-09-21T06:33:01.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.666+0000 7f7d98ff9640 1 -- 172.21.15.63:0/3520036020 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7da0011930 con 0x562f1a7c5070 2024-09-21T06:33:01.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.666+0000 7f7d98ff9640 1 -- 172.21.15.63:0/3520036020 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f7da80b7460 con 0x562f1a7c5070 2024-09-21T06:33:01.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.666+0000 7f7dbd84d740 10 client.26239 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:33:01.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.666+0000 7f7dbd84d740 10 client.26239 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:33:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.666+0000 7f7dbd84d740 20 client.26239 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.666+0000 7f7dbd84d740 1 --2- 172.21.15.63:0/3520036020 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x562f1a7839f0 0x562f1ab8a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.666+0000 7f7dbd84d740 4 client.26239 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:33:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.666+0000 7f7dbd84d740 1 -- 172.21.15.63:0/3520036020 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f1aae4df0 con 0x562f1a7839f0 2024-09-21T06:33:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.666+0000 7f7db5075640 1 --2- 172.21.15.63:0/3520036020 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x562f1a7839f0 0x562f1ab8a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.667+0000 7f7d98ff9640 10 client.26239 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:33:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.667+0000 7f7db5075640 1 --2- 172.21.15.63:0/3520036020 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x562f1a7839f0 0x562f1ab8a630 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=707a8ad4387858e6 server_cookie=c1c9b9713e37c4ee in_seq=0 out_seq=0 2024-09-21T06:33:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.667+0000 7f7d98ff9640 1 -- 172.21.15.63:0/3520036020 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562f1aae4df0 con 0x562f1a7839f0 2024-09-21T06:33:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.667+0000 7f7d98ff9640 10 client.26239 handle_command_reply: tid=0 2024-09-21T06:33:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.667+0000 7f7dbd84d740 1 client.26239 shutdown 2024-09-21T06:33:01.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.668+0000 7f7dbd84d740 1 -- 172.21.15.63:0/3520036020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7c5070 msgr2=0x562f1ab841f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:01.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.668+0000 7f7dbd84d740 1 --2- 172.21.15.63:0/3520036020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7c5070 0x562f1ab841f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7da80adc20 tx=0x7f7da80b14e0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.668+0000 7f7dbd84d740 1 -- 172.21.15.63:0/3520036020 shutdown_connections 2024-09-21T06:33:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.668+0000 7f7dbd84d740 1 --2- 172.21.15.63:0/3520036020 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x562f1a7839f0 0x562f1ab8a630 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.668+0000 7f7dbd84d740 1 --2- 172.21.15.63:0/3520036020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7c5070 0x562f1ab841f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.668+0000 7f7dbd84d740 1 --2- 172.21.15.63:0/3520036020 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a7a4390 0x562f1ab78360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.668+0000 7f7d98ff9640 0 client.26239 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:33:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.668+0000 7f7dbd84d740 1 --2- 172.21.15.63:0/3520036020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a79c1b0 0x562f1ab77e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.668+0000 7f7dbd84d740 1 -- 172.21.15.63:0/3520036020 >> 172.21.15.63:0/3520036020 conn(0x562f1a7b9460 msgr2=0x562f1ab6f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.668+0000 7f7dbd84d740 1 -- 172.21.15.63:0/3520036020 shutdown_connections 2024-09-21T06:33:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.668+0000 7f7dbd84d740 1 -- 172.21.15.63:0/3520036020 wait complete. 2024-09-21T06:33:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.668+0000 7f7dbd84d740 20 client.26239 trim_cache size 0 max 16384 2024-09-21T06:33:01.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.686+0000 7f7dbd84d740 1 Processor -- start 2024-09-21T06:33:01.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.686+0000 7f7dbd84d740 1 -- start start 2024-09-21T06:33:01.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.686+0000 7f7dbd84d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a79c1b0 0x562f1ab6feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:01.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.687+0000 7f7dbd84d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7a4390 0x562f1ab840f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:01.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.687+0000 7f7dbd84d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a7c5070 0x562f1ab69eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:01.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.687+0000 7f7dbd84d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7db01ad580 con 0x562f1a7c5070 2024-09-21T06:33:01.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.687+0000 7f7dbd84d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7db01af180 con 0x562f1a79c1b0 2024-09-21T06:33:01.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.687+0000 7f7dbd84d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7db01add10 con 0x562f1a7a4390 2024-09-21T06:33:01.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.687+0000 7f7db5876640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a7c5070 0x562f1ab69eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:01.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.687+0000 7f7db5075640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a79c1b0 0x562f1ab6feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:01.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.687+0000 7f7db5075640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a79c1b0 0x562f1ab6feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:36572/0 (socket says 172.21.15.63:36572) 2024-09-21T06:33:01.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.687+0000 7f7db5075640 1 -- 172.21.15.63:0/1494954846 learned_addr learned my addr 172.21.15.63:0/1494954846 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:01.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.687+0000 7f7db5876640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a7c5070 0x562f1ab69eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39214/0 (socket says 172.21.15.63:39214) 2024-09-21T06:33:01.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.687+0000 7f7db4874640 1 --2- 172.21.15.63:0/1494954846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7a4390 0x562f1ab840f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:01.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.687+0000 7f7db5876640 1 -- 172.21.15.63:0/1494954846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7a4390 msgr2=0x562f1ab840f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:01.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.687+0000 7f7db5876640 1 --2- 172.21.15.63:0/1494954846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7a4390 0x562f1ab840f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.687+0000 7f7db5876640 1 -- 172.21.15.63:0/1494954846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a79c1b0 msgr2=0x562f1ab6feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:01.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.687+0000 7f7db5876640 1 --2- 172.21.15.63:0/1494954846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a79c1b0 0x562f1ab6feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.687+0000 7f7db5876640 1 -- 172.21.15.63:0/1494954846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f1ab72a50 con 0x562f1a7c5070 2024-09-21T06:33:01.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.688+0000 7f7db5876640 1 --2- 172.21.15.63:0/1494954846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a7c5070 0x562f1ab69eb0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f7da80b6240 tx=0x7f7da80adaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf648433c2ce35a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:01.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.688+0000 7f7d9affd640 1 -- 172.21.15.63:0/1494954846 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da80ba920 con 0x562f1a7c5070 2024-09-21T06:33:01.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.688+0000 7f7d9affd640 1 -- 172.21.15.63:0/1494954846 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7da80bafc0 con 0x562f1a7c5070 2024-09-21T06:33:01.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.688+0000 7f7d9affd640 1 -- 172.21.15.63:0/1494954846 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da80b7210 con 0x562f1a7c5070 2024-09-21T06:33:01.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.689+0000 7f7dbd84d740 1 -- 172.21.15.63:0/1494954846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a7c5070 msgr2=0x562f1ab69eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:01.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.689+0000 7f7dbd84d740 1 --2- 172.21.15.63:0/1494954846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a7c5070 0x562f1ab69eb0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f7da80b6240 tx=0x7f7da80adaf0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.689+0000 7f7dbd84d740 1 -- 172.21.15.63:0/1494954846 shutdown_connections 2024-09-21T06:33:01.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.689+0000 7f7dbd84d740 1 --2- 172.21.15.63:0/1494954846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a7c5070 0x562f1ab69eb0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.689+0000 7f7dbd84d740 1 --2- 172.21.15.63:0/1494954846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7a4390 0x562f1ab840f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.689+0000 7f7dbd84d740 1 --2- 172.21.15.63:0/1494954846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a79c1b0 0x562f1ab6feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.689+0000 7f7dbd84d740 1 -- 172.21.15.63:0/1494954846 >> 172.21.15.63:0/1494954846 conn(0x562f1a7b9460 msgr2=0x562f1ab6f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:01.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.689+0000 7f7dbd84d740 1 -- 172.21.15.63:0/1494954846 shutdown_connections 2024-09-21T06:33:01.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.689+0000 7f7dbd84d740 1 -- 172.21.15.63:0/1494954846 wait complete. 2024-09-21T06:33:01.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.690+0000 7f7dbd84d740 1 -- start start 2024-09-21T06:33:01.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.690+0000 7f7dbd84d740 1 Processor -- start 2024-09-21T06:33:01.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.691+0000 7f7dbd84d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a79c1b0 0x562f1ab80950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:01.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.691+0000 7f7dbd84d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7a4390 0x562f1ab7be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:01.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.691+0000 7f7dbd84d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a7c5070 0x562f1ab7c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:01.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.691+0000 7f7db5075640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a79c1b0 0x562f1ab80950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:01.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.691+0000 7f7db5075640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a79c1b0 0x562f1ab80950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:36582/0 (socket says 172.21.15.63:36582) 2024-09-21T06:33:01.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.691+0000 7f7db4874640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7a4390 0x562f1ab7be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:01.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.691+0000 7f7db5075640 1 -- 172.21.15.63:0/2854932589 learned_addr learned my addr 172.21.15.63:0/2854932589 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:01.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.691+0000 7f7dbd84d740 1 -- 172.21.15.63:0/2854932589 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7db01aeab0 con 0x562f1a7c5070 2024-09-21T06:33:01.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.691+0000 7f7dbd84d740 1 -- 172.21.15.63:0/2854932589 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7db01ae3e0 con 0x562f1a79c1b0 2024-09-21T06:33:01.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.691+0000 7f7dbd84d740 1 -- 172.21.15.63:0/2854932589 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7db01ab560 con 0x562f1a7a4390 2024-09-21T06:33:01.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.691+0000 7f7db5876640 1 --2- 172.21.15.63:0/2854932589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a7c5070 0x562f1ab7c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:01.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.691+0000 7f7dbd84d740 10 client.0 _ll_register_callbacks cb 0x7f7da8005b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:01.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.691+0000 7f7db4874640 1 -- 172.21.15.63:0/2854932589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a79c1b0 msgr2=0x562f1ab80950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:01.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.691+0000 7f7db4874640 1 --2- 172.21.15.63:0/2854932589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a79c1b0 0x562f1ab80950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.691+0000 7f7db4874640 1 -- 172.21.15.63:0/2854932589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a7c5070 msgr2=0x562f1ab7c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:01.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.691+0000 7f7db4874640 1 --2- 172.21.15.63:0/2854932589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a7c5070 0x562f1ab7c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.691+0000 7f7db4874640 1 -- 172.21.15.63:0/2854932589 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f1ab7cb40 con 0x562f1a7a4390 2024-09-21T06:33:01.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.691+0000 7f7db5075640 1 --2- 172.21.15.63:0/2854932589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a79c1b0 0x562f1ab80950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:33:01.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.692+0000 7f7db4874640 1 --2- 172.21.15.63:0/2854932589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7a4390 0x562f1ab7be50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7da00138a0 tx=0x7f7da0009ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b87e894e94d9a6a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:01.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.692+0000 7f7d98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:33:01.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.692+0000 7f7d98ff9640 1 -- 172.21.15.63:0/2854932589 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da0005450 con 0x562f1a7a4390 2024-09-21T06:33:01.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.692+0000 7f7d98ff9640 1 -- 172.21.15.63:0/2854932589 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f7da00055f0 con 0x562f1a7a4390 2024-09-21T06:33:01.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.692+0000 7f7dbd84d740 1 -- 172.21.15.63:0/2854932589 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7da80bafc0 con 0x562f1a7a4390 2024-09-21T06:33:01.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.692+0000 7f7d98ff9640 1 -- 172.21.15.63:0/2854932589 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f7da00035f0 con 0x562f1a7a4390 2024-09-21T06:33:01.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.692+0000 7f7dbd84d740 10 client.26245 fetch_fsmap learned FSMap version 43 2024-09-21T06:33:01.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.692+0000 7f7dbd84d740 1 -- 172.21.15.63:0/2854932589 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x562f1abfd770 con 0x562f1a7a4390 2024-09-21T06:33:01.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.692+0000 7f7d98ff9640 1 -- 172.21.15.63:0/2854932589 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7da80bafc0 con 0x562f1a7a4390 2024-09-21T06:33:01.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.693+0000 7f7d98ff9640 1 -- 172.21.15.63:0/2854932589 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7f7da00337d0 con 0x562f1a7a4390 2024-09-21T06:33:01.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.693+0000 7f7dbd84d740 10 client.26245 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:33:01.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.693+0000 7f7dbd84d740 10 client.26245 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:33:01.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.693+0000 7f7dbd84d740 20 client.26245 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:01.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.693+0000 7f7dbd84d740 1 --2- 172.21.15.63:0/2854932589 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x562f1a758da0 0x562f1abffd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:01.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.693+0000 7f7dbd84d740 4 client.26245 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:33:01.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.693+0000 7f7dbd84d740 1 -- 172.21.15.63:0/2854932589 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562f1aae08a0 con 0x562f1a758da0 2024-09-21T06:33:01.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.693+0000 7f7db5075640 1 --2- 172.21.15.63:0/2854932589 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x562f1a758da0 0x562f1abffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:01.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.693+0000 7f7d98ff9640 10 client.26245 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:33:01.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.693+0000 7f7db5075640 1 --2- 172.21.15.63:0/2854932589 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x562f1a758da0 0x562f1abffd30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=99ef4f19f4aadd4 server_cookie=b260dc3120af7d53 in_seq=0 out_seq=0 2024-09-21T06:33:01.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.694+0000 7f7d98ff9640 1 -- 172.21.15.63:0/2854932589 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562f1aae08a0 con 0x562f1a758da0 2024-09-21T06:33:01.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.694+0000 7f7d98ff9640 10 client.26245 handle_command_reply: tid=0 2024-09-21T06:33:01.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.694+0000 7f7dbd84d740 1 client.26245 shutdown 2024-09-21T06:33:01.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.694+0000 7f7dbd84d740 1 -- 172.21.15.63:0/2854932589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7a4390 msgr2=0x562f1ab7be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:01.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.694+0000 7f7dbd84d740 1 --2- 172.21.15.63:0/2854932589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7a4390 0x562f1ab7be50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7da00138a0 tx=0x7f7da0009ba0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.694+0000 7f7dbd84d740 1 -- 172.21.15.63:0/2854932589 shutdown_connections 2024-09-21T06:33:01.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.694+0000 7f7dbd84d740 1 --2- 172.21.15.63:0/2854932589 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x562f1a758da0 0x562f1abffd30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.694+0000 7f7dbd84d740 1 --2- 172.21.15.63:0/2854932589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f1a7c5070 0x562f1ab7c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.694+0000 7f7dbd84d740 1 --2- 172.21.15.63:0/2854932589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f1a7a4390 0x562f1ab7be50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.694+0000 7f7dbd84d740 1 --2- 172.21.15.63:0/2854932589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1a79c1b0 0x562f1ab80950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.694+0000 7f7dbd84d740 1 -- 172.21.15.63:0/2854932589 >> 172.21.15.63:0/2854932589 conn(0x562f1a7b9460 msgr2=0x562f1ab69dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:01.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.694+0000 7f7d98ff9640 0 client.26245 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:33:01.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.694+0000 7f7dbd84d740 1 -- 172.21.15.63:0/2854932589 shutdown_connections 2024-09-21T06:33:01.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.694+0000 7f7dbd84d740 1 -- 172.21.15.63:0/2854932589 wait complete. 2024-09-21T06:33:01.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.694+0000 7f7dbd84d740 20 client.26245 trim_cache size 0 max 16384 2024-09-21T06:33:01.701 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:33:01.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.695+0000 7f7db72d9640 1 -- 172.21.15.63:0/222916869 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7d9c0b6700 msgr2=0x7f7d9c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:01.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.695+0000 7f7db72d9640 1 --2- 172.21.15.63:0/222916869 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7d9c0b6700 0x7f7d9c0b8c10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0096c0 tx=0x7f7dac0058d0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.695+0000 7f7db72d9640 1 -- 172.21.15.63:0/222916869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7db0109e00 msgr2=0x7f7db019fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:01.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.695+0000 7f7db72d9640 1 --2- 172.21.15.63:0/222916869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7db0109e00 0x7f7db019fd30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009fd0 tx=0x7f7da800b690 comp rx=0 tx=0).stop 2024-09-21T06:33:01.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.695+0000 7f7db72d9640 1 -- 172.21.15.63:0/222916869 shutdown_connections 2024-09-21T06:33:01.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.695+0000 7f7db72d9640 1 --2- 172.21.15.63:0/222916869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7db0109e00 0x7f7db019fd30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.695+0000 7f7db72d9640 1 --2- 172.21.15.63:0/222916869 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7d9c0b6700 0x7f7d9c0b8c10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.695+0000 7f7db72d9640 1 --2- 172.21.15.63:0/222916869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7db01094b0 0x7f7db019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.695+0000 7f7db72d9640 1 --2- 172.21.15.63:0/222916869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7db0103bc0 0x7f7db019a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:01.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.695+0000 7f7db72d9640 1 -- 172.21.15.63:0/222916869 >> 172.21.15.63:0/222916869 conn(0x7f7db007b910 msgr2=0x7f7db0107600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:01.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.695+0000 7f7db72d9640 1 -- 172.21.15.63:0/222916869 shutdown_connections 2024-09-21T06:33:01.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:01.695+0000 7f7db72d9640 1 -- 172.21.15.63:0/222916869 wait complete. 2024-09-21T06:33:01.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:01 smithi063 ceph-mon[31150]: pgmap v467: 97 pgs: 97 active+clean; 202 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 924 op/s 2024-09-21T06:33:02.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:01 smithi071 ceph-mon[34844]: pgmap v467: 97 pgs: 97 active+clean; 202 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 924 op/s 2024-09-21T06:33:02.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:01 smithi175 ceph-mon[34510]: pgmap v467: 97 pgs: 97 active+clean; 202 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 924 op/s 2024-09-21T06:33:03.513 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:33:03.513 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:33:03.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:03 smithi063 ceph-mon[31150]: pgmap v468: 97 pgs: 97 active+clean; 211 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 2.9 MiB/s wr, 1.11k op/s 2024-09-21T06:33:03.835 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:04.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:03 smithi071 ceph-mon[34844]: pgmap v468: 97 pgs: 97 active+clean; 211 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 2.9 MiB/s wr, 1.11k op/s 2024-09-21T06:33:04.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:03 smithi175 ceph-mon[34510]: pgmap v468: 97 pgs: 97 active+clean; 211 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 2.9 MiB/s wr, 1.11k op/s 2024-09-21T06:33:04.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.476+0000 7ff50636b640 1 -- 172.21.15.63:0/2349968491 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff500109e10 msgr2=0x7ff500110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:04.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.476+0000 7ff50636b640 1 --2- 172.21.15.63:0/2349968491 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff500109e10 0x7ff500110640 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8009ca0 tx=0x7ff4f802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.477+0000 7ff50636b640 1 -- 172.21.15.63:0/2349968491 shutdown_connections 2024-09-21T06:33:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.477+0000 7ff50636b640 1 --2- 172.21.15.63:0/2349968491 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff500109e10 0x7ff500110640 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.477+0000 7ff50636b640 1 --2- 172.21.15.63:0/2349968491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5001094c0 0x7ff5001098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.477+0000 7ff50636b640 1 --2- 172.21.15.63:0/2349968491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff500103b80 0x7ff500103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.477+0000 7ff50636b640 1 -- 172.21.15.63:0/2349968491 >> 172.21.15.63:0/2349968491 conn(0x7ff50007b8d0 msgr2=0x7ff50007bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.477+0000 7ff50636b640 1 -- 172.21.15.63:0/2349968491 shutdown_connections 2024-09-21T06:33:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.477+0000 7ff50636b640 1 -- 172.21.15.63:0/2349968491 wait complete. 2024-09-21T06:33:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.478+0000 7ff50636b640 1 Processor -- start 2024-09-21T06:33:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.478+0000 7ff50636b640 1 -- start start 2024-09-21T06:33:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.478+0000 7ff50636b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff500103b80 0x7ff50019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.478+0000 7ff50636b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5001094c0 0x7ff50019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.478+0000 7ff50636b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff500109e10 0x7ff50019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:04.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.478+0000 7ff50636b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff500113af0 con 0x7ff500103b80 2024-09-21T06:33:04.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.478+0000 7ff50636b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff500113970 con 0x7ff500109e10 2024-09-21T06:33:04.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.478+0000 7ff50636b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff500113c70 con 0x7ff5001094c0 2024-09-21T06:33:04.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.478+0000 7ff4fffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff500103b80 0x7ff50019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:04.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.478+0000 7ff4fffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff500103b80 0x7ff50019a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39230/0 (socket says 172.21.15.63:39230) 2024-09-21T06:33:04.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.478+0000 7ff4fffff640 1 -- 172.21.15.63:0/502893050 learned_addr learned my addr 172.21.15.63:0/502893050 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:04.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.478+0000 7ff4ff7fe640 1 --2- 172.21.15.63:0/502893050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5001094c0 0x7ff50019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:04.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.479+0000 7ff4fffff640 1 -- 172.21.15.63:0/502893050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5001094c0 msgr2=0x7ff50019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:04.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.479+0000 7ff4fffff640 1 --2- 172.21.15.63:0/502893050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5001094c0 0x7ff50019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.479+0000 7ff4fffff640 1 -- 172.21.15.63:0/502893050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff500109e10 msgr2=0x7ff50019fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:04.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.479+0000 7ff504908640 1 --2- 172.21.15.63:0/502893050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff500109e10 0x7ff50019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:04.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.479+0000 7ff4fffff640 1 --2- 172.21.15.63:0/502893050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff500109e10 0x7ff50019fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.479+0000 7ff4fffff640 1 -- 172.21.15.63:0/502893050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5001a04d0 con 0x7ff500103b80 2024-09-21T06:33:04.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.479+0000 7ff4ff7fe640 1 --2- 172.21.15.63:0/502893050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5001094c0 0x7ff50019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:33:04.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.479+0000 7ff504908640 1 --2- 172.21.15.63:0/502893050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff500109e10 0x7ff50019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:33:04.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.479+0000 7ff4fffff640 1 --2- 172.21.15.63:0/502893050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff500103b80 0x7ff50019a560 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000e9f0 tx=0x7ff4f000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:04.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.479+0000 7ff4fd7fa640 1 -- 172.21.15.63:0/502893050 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f000cd80 con 0x7ff500103b80 2024-09-21T06:33:04.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.479+0000 7ff4fd7fa640 1 -- 172.21.15.63:0/502893050 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4f00054d0 con 0x7ff500103b80 2024-09-21T06:33:04.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.479+0000 7ff4fd7fa640 1 -- 172.21.15.63:0/502893050 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0010690 con 0x7ff500103b80 2024-09-21T06:33:04.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.480+0000 7ff50636b640 1 -- 172.21.15.63:0/502893050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5001a07c0 con 0x7ff500103b80 2024-09-21T06:33:04.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.480+0000 7ff50636b640 1 -- 172.21.15.63:0/502893050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5000755f0 con 0x7ff500103b80 2024-09-21T06:33:04.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.483+0000 7ff50c8df740 1 Processor -- start 2024-09-21T06:33:04.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.483+0000 7ff50c8df740 1 -- start start 2024-09-21T06:33:04.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.483+0000 7ff50c8df740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748279350 0x55f748620430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:04.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.483+0000 7ff50c8df740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f748250490 0x55f748620970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:04.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.483+0000 7ff50c8df740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748258670 0x55f748620eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:04.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.483+0000 7ff50c8df740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f748596e60 con 0x55f748279350 2024-09-21T06:33:04.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.483+0000 7ff50c8df740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f748586290 con 0x55f748250490 2024-09-21T06:33:04.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.483+0000 7ff50c8df740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f74858a0a0 con 0x55f748258670 2024-09-21T06:33:04.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.483+0000 7ff504908640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748279350 0x55f748620430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.483+0000 7ff504908640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748279350 0x55f748620430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39236/0 (socket says 172.21.15.63:39236) 2024-09-21T06:33:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.483+0000 7ff504908640 1 -- 172.21.15.63:0/2730740270 learned_addr learned my addr 172.21.15.63:0/2730740270 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.483+0000 7ff4ff7fe640 1 --2- 172.21.15.63:0/2730740270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748258670 0x55f748620eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.483+0000 7ff4fd7fa640 1 -- 172.21.15.63:0/502893050 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7ff4f0004e90 con 0x7ff500103b80 2024-09-21T06:33:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.483+0000 7ff504908640 1 -- 172.21.15.63:0/2730740270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748258670 msgr2=0x55f748620eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.483+0000 7ff504908640 1 --2- 172.21.15.63:0/2730740270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748258670 0x55f748620eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.483+0000 7ff504908640 1 -- 172.21.15.63:0/2730740270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f748250490 msgr2=0x55f748620970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:33:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.483+0000 7ff504908640 1 --2- 172.21.15.63:0/2730740270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f748250490 0x55f748620970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.484+0000 7ff504908640 1 -- 172.21.15.63:0/2730740270 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7482e4930 con 0x55f748279350 2024-09-21T06:33:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.484+0000 7ff504908640 1 --2- 172.21.15.63:0/2730740270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748279350 0x55f748620430 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8006010 tx=0x7ff4f8009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959a33e227220a53 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.484+0000 7ff4e67fc640 1 -- 172.21.15.63:0/2730740270 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8031cf0 con 0x55f748279350 2024-09-21T06:33:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.484+0000 7ff4e67fc640 1 -- 172.21.15.63:0/2730740270 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4f8036070 con 0x55f748279350 2024-09-21T06:33:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.484+0000 7ff4e67fc640 1 -- 172.21.15.63:0/2730740270 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8004240 con 0x55f748279350 2024-09-21T06:33:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.484+0000 7ff4fd7fa640 1 --2- 172.21.15.63:0/502893050 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff4e80b6680 0x7ff4e80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.485+0000 7ff4fffff640 1 --2- 172.21.15.63:0/502893050 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff4e80b6680 0x7ff4e80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.485+0000 7ff4fd7fa640 1 -- 172.21.15.63:0/502893050 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7ff4f00e7bc0 con 0x7ff500103b80 2024-09-21T06:33:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.485+0000 7ff50c8df740 1 -- 172.21.15.63:0/2730740270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748279350 msgr2=0x55f748620430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.485+0000 7ff4fffff640 1 --2- 172.21.15.63:0/502893050 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff4e80b6680 0x7ff4e80b8b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x55f74861f0b0 tx=0x7ff4f00d1040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.485+0000 7ff50c8df740 1 --2- 172.21.15.63:0/2730740270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748279350 0x55f748620430 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8006010 tx=0x7ff4f8009800 comp rx=0 tx=0).stop 2024-09-21T06:33:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.485+0000 7ff50c8df740 1 -- 172.21.15.63:0/2730740270 shutdown_connections 2024-09-21T06:33:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.485+0000 7ff50c8df740 1 --2- 172.21.15.63:0/2730740270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748258670 0x55f748620eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.485+0000 7ff50c8df740 1 --2- 172.21.15.63:0/2730740270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f748250490 0x55f748620970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.485+0000 7ff50c8df740 1 --2- 172.21.15.63:0/2730740270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748279350 0x55f748620430 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.485+0000 7ff50c8df740 1 -- 172.21.15.63:0/2730740270 >> 172.21.15.63:0/2730740270 conn(0x55f74826d740 msgr2=0x55f74861e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.485+0000 7ff50c8df740 1 -- 172.21.15.63:0/2730740270 shutdown_connections 2024-09-21T06:33:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.486+0000 7ff50c8df740 1 -- 172.21.15.63:0/2730740270 wait complete. 2024-09-21T06:33:04.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.486+0000 7ff50c8df740 1 -- start start 2024-09-21T06:33:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.486+0000 7ff50c8df740 1 Processor -- start 2024-09-21T06:33:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.487+0000 7ff50c8df740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748250490 0x55f74862bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.487+0000 7ff50c8df740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f748258670 0x55f74862c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.487+0000 7ff50c8df740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748279350 0x55f748637f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.487+0000 7ff50c8df740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f7483e7890 con 0x55f748250490 2024-09-21T06:33:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.487+0000 7ff50c8df740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f748520d40 con 0x55f748258670 2024-09-21T06:33:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.487+0000 7ff50c8df740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f74862ebb0 con 0x55f748279350 2024-09-21T06:33:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.487+0000 7ff504908640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748250490 0x55f74862bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.487+0000 7ff504908640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748250490 0x55f74862bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39244/0 (socket says 172.21.15.63:39244) 2024-09-21T06:33:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.487+0000 7ff504908640 1 -- 172.21.15.63:0/2166146181 learned_addr learned my addr 172.21.15.63:0/2166146181 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.487+0000 7ff504908640 1 --2- 172.21.15.63:0/2166146181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748279350 0x55f748637f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.487+0000 7ff4ff7fe640 1 --2- 172.21.15.63:0/2166146181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f748258670 0x55f74862c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.487+0000 7ff504908640 1 -- 172.21.15.63:0/2166146181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748279350 msgr2=0x55f748637f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.487+0000 7ff504908640 1 --2- 172.21.15.63:0/2166146181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748279350 0x55f748637f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.487+0000 7ff504908640 1 -- 172.21.15.63:0/2166146181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f748258670 msgr2=0x55f74862c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.487+0000 7ff504908640 1 --2- 172.21.15.63:0/2166146181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f748258670 0x55f74862c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.487+0000 7ff504908640 1 -- 172.21.15.63:0/2166146181 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f748638440 con 0x55f748250490 2024-09-21T06:33:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.487+0000 7ff50c8df740 10 client.0 _ll_register_callbacks cb 0x55f748584c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.488+0000 7ff50c8df740 1 -- 172.21.15.63:0/2166146181 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4f8036070 con 0x55f748250490 2024-09-21T06:33:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.488+0000 7ff504908640 1 --2- 172.21.15.63:0/2166146181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748250490 0x55f74862bfd0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff4f802a900 tx=0x7ff4f8009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ccb88e51a1bdd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.488+0000 7ff4df7fe640 10 client.16551 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:33:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.488+0000 7ff4df7fe640 1 -- 172.21.15.63:0/2166146181 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f805d060 con 0x55f748250490 2024-09-21T06:33:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.488+0000 7ff4df7fe640 1 -- 172.21.15.63:0/2166146181 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7ff4f8055a90 con 0x55f748250490 2024-09-21T06:33:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.488+0000 7ff4df7fe640 1 -- 172.21.15.63:0/2166146181 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7ff4f8055c90 con 0x55f748250490 2024-09-21T06:33:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.488+0000 7ff50c8df740 10 client.16551 fetch_fsmap learned FSMap version 43 2024-09-21T06:33:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.488+0000 7ff50c8df740 1 -- 172.21.15.63:0/2166146181 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({fsmap=43}) -- 0x55f74863a940 con 0x55f748250490 2024-09-21T06:33:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.488+0000 7ff4df7fe640 1 -- 172.21.15.63:0/2166146181 <== mon.0 v2:172.21.15.63:3300/0 4 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7ff4f8031450 con 0x55f748250490 2024-09-21T06:33:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.489+0000 7ff50c8df740 10 client.16551 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:33:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.489+0000 7ff50c8df740 10 client.16551 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:33:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.489+0000 7ff50c8df740 20 client.16551 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.489+0000 7ff50c8df740 1 --2- 172.21.15.63:0/2166146181 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f748237cd0 0x55f74863dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.489+0000 7ff50c8df740 4 client.16551 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:33:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.489+0000 7ff50c8df740 1 -- 172.21.15.63:0/2166146181 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f748598db0 con 0x55f748237cd0 2024-09-21T06:33:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.490+0000 7ff4ff7fe640 1 --2- 172.21.15.63:0/2166146181 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f748237cd0 0x55f74863dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.491+0000 7ff4df7fe640 10 client.16551 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.491+0000 7ff4ff7fe640 1 --2- 172.21.15.63:0/2166146181 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f748237cd0 0x55f74863dca0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2443584b71a6d0d2 server_cookie=9b587403aaf2000c in_seq=0 out_seq=0 2024-09-21T06:33:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.492+0000 7ff4df7fe640 1 -- 172.21.15.63:0/2166146181 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f748598db0 con 0x55f748237cd0 2024-09-21T06:33:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.492+0000 7ff4df7fe640 10 client.16551 handle_command_reply: tid=0 2024-09-21T06:33:04.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.492+0000 7ff50c8df740 1 client.16551 shutdown 2024-09-21T06:33:04.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.492+0000 7ff50c8df740 1 -- 172.21.15.63:0/2166146181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748250490 msgr2=0x55f74862bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:04.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.492+0000 7ff50c8df740 1 --2- 172.21.15.63:0/2166146181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748250490 0x55f74862bfd0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff4f802a900 tx=0x7ff4f8009a20 comp rx=0 tx=0).stop 2024-09-21T06:33:04.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.492+0000 7ff50c8df740 1 -- 172.21.15.63:0/2166146181 shutdown_connections 2024-09-21T06:33:04.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.492+0000 7ff50c8df740 1 --2- 172.21.15.63:0/2166146181 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f748237cd0 0x55f74863dca0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.492+0000 7ff50c8df740 1 --2- 172.21.15.63:0/2166146181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748279350 0x55f748637f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.492+0000 7ff50c8df740 1 --2- 172.21.15.63:0/2166146181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f748258670 0x55f74862c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.492+0000 7ff50c8df740 1 --2- 172.21.15.63:0/2166146181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748250490 0x55f74862bfd0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.492+0000 7ff50c8df740 1 -- 172.21.15.63:0/2166146181 >> 172.21.15.63:0/2166146181 conn(0x55f74826d740 msgr2=0x55f748623610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:04.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.492+0000 7ff4df7fe640 0 client.16551 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:04.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.492+0000 7ff50c8df740 1 -- 172.21.15.63:0/2166146181 shutdown_connections 2024-09-21T06:33:04.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.492+0000 7ff50c8df740 1 -- 172.21.15.63:0/2166146181 wait complete. 2024-09-21T06:33:04.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.493+0000 7ff50c8df740 20 client.16551 trim_cache size 0 max 16384 2024-09-21T06:33:04.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.515+0000 7ff50c8df740 1 Processor -- start 2024-09-21T06:33:04.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.515+0000 7ff50c8df740 1 -- start start 2024-09-21T06:33:04.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.515+0000 7ff50c8df740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748250490 0x55f748637e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:04.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.515+0000 7ff50c8df740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748258670 0x55f748626550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.515+0000 7ff50c8df740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f748279350 0x55f748628fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.515+0000 7ff50c8df740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff5001ad660 con 0x55f748250490 2024-09-21T06:33:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.515+0000 7ff50c8df740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff5001af260 con 0x55f748279350 2024-09-21T06:33:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.515+0000 7ff50c8df740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5001addf0 con 0x55f748258670 2024-09-21T06:33:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.516+0000 7ff504908640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748250490 0x55f748637e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.516+0000 7ff504908640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748250490 0x55f748637e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39248/0 (socket says 172.21.15.63:39248) 2024-09-21T06:33:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.516+0000 7ff4ff7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748258670 0x55f748626550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.516+0000 7ff504908640 1 -- 172.21.15.63:0/1035975819 learned_addr learned my addr 172.21.15.63:0/1035975819 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.516+0000 7ff504908640 1 --2- 172.21.15.63:0/1035975819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f748279350 0x55f748628fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.516+0000 7ff4ff7fe640 1 -- 172.21.15.63:0/1035975819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f748279350 msgr2=0x55f748628fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.516+0000 7ff4ff7fe640 1 --2- 172.21.15.63:0/1035975819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f748279350 0x55f748628fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.516+0000 7ff4ff7fe640 1 -- 172.21.15.63:0/1035975819 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748250490 msgr2=0x55f748637e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.516+0000 7ff4ff7fe640 1 --2- 172.21.15.63:0/1035975819 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748250490 0x55f748637e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.516+0000 7ff4ff7fe640 1 -- 172.21.15.63:0/1035975819 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f748623290 con 0x55f748258670 2024-09-21T06:33:04.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.516+0000 7ff504908640 1 --2- 172.21.15.63:0/1035975819 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748250490 0x55f748637e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:33:04.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.516+0000 7ff4ff7fe640 1 --2- 172.21.15.63:0/1035975819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748258670 0x55f748626550 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55f74863e380 tx=0x7ff4f40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a589cd335dd920bb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:04.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.517+0000 7ff4e5ffb640 1 -- 172.21.15.63:0/1035975819 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f40122d0 con 0x55f748258670 2024-09-21T06:33:04.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.517+0000 7ff4e5ffb640 1 -- 172.21.15.63:0/1035975819 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f748598db0 con 0x55f748258670 2024-09-21T06:33:04.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.517+0000 7ff4e5ffb640 1 -- 172.21.15.63:0/1035975819 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4004c60 con 0x55f748258670 2024-09-21T06:33:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.518+0000 7ff50c8df740 1 -- 172.21.15.63:0/1035975819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748258670 msgr2=0x55f748626550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.518+0000 7ff50c8df740 1 --2- 172.21.15.63:0/1035975819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748258670 0x55f748626550 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55f74863e380 tx=0x7ff4f40046c0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.518+0000 7ff50c8df740 1 -- 172.21.15.63:0/1035975819 shutdown_connections 2024-09-21T06:33:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.518+0000 7ff50c8df740 1 --2- 172.21.15.63:0/1035975819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f748279350 0x55f748628fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.518+0000 7ff50c8df740 1 --2- 172.21.15.63:0/1035975819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748258670 0x55f748626550 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.518+0000 7ff50c8df740 1 --2- 172.21.15.63:0/1035975819 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748250490 0x55f748637e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.518+0000 7ff50c8df740 1 -- 172.21.15.63:0/1035975819 >> 172.21.15.63:0/1035975819 conn(0x55f74826d740 msgr2=0x55f74862a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.518+0000 7ff50c8df740 1 -- 172.21.15.63:0/1035975819 shutdown_connections 2024-09-21T06:33:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.518+0000 7ff50c8df740 1 -- 172.21.15.63:0/1035975819 wait complete. 2024-09-21T06:33:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.519+0000 7ff50c8df740 1 -- start start 2024-09-21T06:33:04.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.519+0000 7ff50c8df740 1 Processor -- start 2024-09-21T06:33:04.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.519+0000 7ff50c8df740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748250490 0x55f748630540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:04.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.519+0000 7ff50c8df740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f748258670 0x55f748630a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:04.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.519+0000 7ff50c8df740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748279350 0x55f7486a75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:04.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.519+0000 7ff50c8df740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff5001aeb90 con 0x55f748279350 2024-09-21T06:33:04.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.519+0000 7ff50c8df740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff5001ae4c0 con 0x55f748258670 2024-09-21T06:33:04.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.519+0000 7ff50c8df740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5001ab690 con 0x55f748250490 2024-09-21T06:33:04.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.519+0000 7ff50c8df740 10 client.0 _ll_register_callbacks cb 0x7ff4f4009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:04.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.520+0000 7ff504908640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748279350 0x55f7486a75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:04.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.520+0000 7ff504908640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748279350 0x55f7486a75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39260/0 (socket says 172.21.15.63:39260) 2024-09-21T06:33:04.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.520+0000 7ff504908640 1 -- 172.21.15.63:0/3837053080 learned_addr learned my addr 172.21.15.63:0/3837053080 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:04.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.520+0000 7ff4ff7fe640 1 --2- 172.21.15.63:0/3837053080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f748258670 0x55f748630a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:04.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.520+0000 7ff504908640 1 --2- 172.21.15.63:0/3837053080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748250490 0x55f748630540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:04.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.520+0000 7ff504908640 1 -- 172.21.15.63:0/3837053080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748250490 msgr2=0x55f748630540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:04.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.520+0000 7ff504908640 1 --2- 172.21.15.63:0/3837053080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748250490 0x55f748630540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.520+0000 7ff504908640 1 -- 172.21.15.63:0/3837053080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f748258670 msgr2=0x55f748630a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:04.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.520+0000 7ff504908640 1 --2- 172.21.15.63:0/3837053080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f748258670 0x55f748630a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.520+0000 7ff504908640 1 -- 172.21.15.63:0/3837053080 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7486a7b20 con 0x55f748279350 2024-09-21T06:33:04.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.520+0000 7ff4ff7fe640 1 --2- 172.21.15.63:0/3837053080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f748258670 0x55f748630a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:33:04.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.520+0000 7ff504908640 1 --2- 172.21.15.63:0/3837053080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748279350 0x55f7486a75e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x55f74861e2a0 tx=0x7ff4f8057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0d789c749f91b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:04.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.520+0000 7ff4df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:33:04.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.521+0000 7ff4df7fe640 1 -- 172.21.15.63:0/3837053080 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f802f660 con 0x55f748279350 2024-09-21T06:33:04.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.521+0000 7ff4df7fe640 1 -- 172.21.15.63:0/3837053080 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7ff4f802f800 con 0x55f748279350 2024-09-21T06:33:04.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.521+0000 7ff50c8df740 1 -- 172.21.15.63:0/3837053080 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f748598db0 con 0x55f748279350 2024-09-21T06:33:04.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.521+0000 7ff4df7fe640 1 -- 172.21.15.63:0/3837053080 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7ff4f802fa00 con 0x55f748279350 2024-09-21T06:33:04.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.521+0000 7ff50c8df740 10 client.16557 fetch_fsmap learned FSMap version 43 2024-09-21T06:33:04.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.521+0000 7ff50c8df740 1 -- 172.21.15.63:0/3837053080 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55f7486a8db0 con 0x55f748279350 2024-09-21T06:33:04.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.521+0000 7ff4df7fe640 1 -- 172.21.15.63:0/3837053080 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f748598db0 con 0x55f748279350 2024-09-21T06:33:04.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.522+0000 7ff4df7fe640 1 -- 172.21.15.63:0/3837053080 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7ff4f8030c10 con 0x55f748279350 2024-09-21T06:33:04.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.522+0000 7ff50c8df740 10 client.16557 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:33:04.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.522+0000 7ff50c8df740 10 client.16557 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:33:04.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.522+0000 7ff50c8df740 20 client.16557 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:04.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.522+0000 7ff50c8df740 1 --2- 172.21.15.63:0/3837053080 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f74820d080 0x55f7486ab540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:04.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.522+0000 7ff50c8df740 4 client.16557 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:33:04.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.522+0000 7ff50c8df740 1 -- 172.21.15.63:0/3837053080 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f748594860 con 0x55f74820d080 2024-09-21T06:33:04.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.522+0000 7ff4ff7fe640 1 --2- 172.21.15.63:0/3837053080 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f74820d080 0x55f7486ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:04.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.523+0000 7ff4df7fe640 10 client.16557 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:04.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.523+0000 7ff4ff7fe640 1 --2- 172.21.15.63:0/3837053080 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f74820d080 0x55f7486ab540 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63f22b405023ef43 server_cookie=52ad259b804cccda in_seq=0 out_seq=0 2024-09-21T06:33:04.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.524+0000 7ff4df7fe640 1 -- 172.21.15.63:0/3837053080 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f748594860 con 0x55f74820d080 2024-09-21T06:33:04.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.524+0000 7ff4df7fe640 10 client.16557 handle_command_reply: tid=0 2024-09-21T06:33:04.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.524+0000 7ff50c8df740 1 client.16557 shutdown 2024-09-21T06:33:04.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.524+0000 7ff50c8df740 1 -- 172.21.15.63:0/3837053080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748279350 msgr2=0x55f7486a75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:04.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.524+0000 7ff50c8df740 1 --2- 172.21.15.63:0/3837053080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748279350 0x55f7486a75e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x55f74861e2a0 tx=0x7ff4f8057000 comp rx=0 tx=0).stop 2024-09-21T06:33:04.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.525+0000 7ff50c8df740 1 -- 172.21.15.63:0/3837053080 shutdown_connections 2024-09-21T06:33:04.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.525+0000 7ff50c8df740 1 --2- 172.21.15.63:0/3837053080 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f74820d080 0x55f7486ab540 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.525+0000 7ff4df7fe640 0 client.16557 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:04.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.525+0000 7ff50c8df740 1 --2- 172.21.15.63:0/3837053080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f748279350 0x55f7486a75e0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.525+0000 7ff50c8df740 1 --2- 172.21.15.63:0/3837053080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f748258670 0x55f748630a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.525+0000 7ff50c8df740 1 --2- 172.21.15.63:0/3837053080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f748250490 0x55f748630540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.525+0000 7ff50c8df740 1 -- 172.21.15.63:0/3837053080 >> 172.21.15.63:0/3837053080 conn(0x55f74826d740 msgr2=0x55f748621460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:04.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.525+0000 7ff50c8df740 1 -- 172.21.15.63:0/3837053080 shutdown_connections 2024-09-21T06:33:04.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.525+0000 7ff50c8df740 1 -- 172.21.15.63:0/3837053080 wait complete. 2024-09-21T06:33:04.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.525+0000 7ff50c8df740 20 client.16557 trim_cache size 0 max 16384 2024-09-21T06:33:04.529 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:33:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0, 2024-09-21T06:33:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_tag": "5396028b-35f4-48fe-b54d-385784e97de3", 2024-09-21T06:33:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": "asynchronous" 2024-09-21T06:33:04.529 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:33:04.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.526+0000 7ff50636b640 1 -- 172.21.15.63:0/502893050 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff4e80b6680 msgr2=0x7ff4e80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:04.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.526+0000 7ff50636b640 1 --2- 172.21.15.63:0/502893050 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff4e80b6680 0x7ff4e80b8b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x55f74861f0b0 tx=0x7ff4f00d1040 comp rx=0 tx=0).stop 2024-09-21T06:33:04.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.526+0000 7ff50636b640 1 -- 172.21.15.63:0/502893050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff500103b80 msgr2=0x7ff50019a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:04.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.526+0000 7ff50636b640 1 --2- 172.21.15.63:0/502893050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff500103b80 0x7ff50019a560 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000e9f0 tx=0x7ff4f000edf0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.526+0000 7ff50636b640 1 -- 172.21.15.63:0/502893050 shutdown_connections 2024-09-21T06:33:04.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.526+0000 7ff50636b640 1 --2- 172.21.15.63:0/502893050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff500109e10 0x7ff50019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.526+0000 7ff50636b640 1 --2- 172.21.15.63:0/502893050 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff4e80b6680 0x7ff4e80b8b90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.526+0000 7ff50636b640 1 --2- 172.21.15.63:0/502893050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5001094c0 0x7ff50019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.526+0000 7ff50636b640 1 --2- 172.21.15.63:0/502893050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff500103b80 0x7ff50019a560 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:04.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.526+0000 7ff50636b640 1 -- 172.21.15.63:0/502893050 >> 172.21.15.63:0/502893050 conn(0x7ff50007b8d0 msgr2=0x7ff500105530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:04.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.526+0000 7ff50636b640 1 -- 172.21.15.63:0/502893050 shutdown_connections 2024-09-21T06:33:04.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:04.526+0000 7ff50636b640 1 -- 172.21.15.63:0/502893050 wait complete. 2024-09-21T06:33:05.534 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:33:05.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:05 smithi063 ceph-mon[31150]: pgmap v469: 97 pgs: 97 active+clean; 212 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.4 MiB/s wr, 869 op/s 2024-09-21T06:33:05.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:05 smithi063 ceph-mon[31150]: scrub queued for path: / 2024-09-21T06:33:05.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:05 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:05.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:05 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:33:05.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:05 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:33:05.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:05 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:05.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:05 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:33:05.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:05 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:33:05.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:05 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:05.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:05 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:05.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:05 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:33:05.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:05 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:33:05.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:05 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:05.872 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:06.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:05 smithi071 ceph-mon[34844]: pgmap v469: 97 pgs: 97 active+clean; 212 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.4 MiB/s wr, 869 op/s 2024-09-21T06:33:06.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:05 smithi071 ceph-mon[34844]: scrub queued for path: / 2024-09-21T06:33:06.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:05 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:06.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:05 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:33:06.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:05 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:33:06.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:05 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:06.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:05 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:33:06.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:05 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:33:06.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:05 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:06.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:05 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:06.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:05 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:33:06.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:05 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:33:06.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:05 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:06.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:05 smithi175 ceph-mon[34510]: pgmap v469: 97 pgs: 97 active+clean; 212 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.4 MiB/s wr, 869 op/s 2024-09-21T06:33:06.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:05 smithi175 ceph-mon[34510]: scrub queued for path: / 2024-09-21T06:33:06.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:05 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:06.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:05 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:33:06.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:05 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:33:06.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:05 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:06.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:05 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:33:06.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:05 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:33:06.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:05 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:06.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:05 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:06.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:05 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:33:06.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:05 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:33:06.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:05 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:06.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.561+0000 7fa7ad52d640 1 -- 172.21.15.63:0/3407245883 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4004db0 con 0x7fa7a8102a60 2024-09-21T06:33:06.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.562+0000 7fa7b0793640 1 -- 172.21.15.63:0/3407245883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a8102a60 msgr2=0x7fa7a8102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:06.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.562+0000 7fa7b0793640 1 --2- 172.21.15.63:0/3407245883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a8102a60 0x7fa7a8102e70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa7a401a910 tx=0x7fa7a403b470 comp rx=0 tx=0).stop 2024-09-21T06:33:06.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.563+0000 7fa7b0793640 1 -- 172.21.15.63:0/3407245883 shutdown_connections 2024-09-21T06:33:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.563+0000 7fa7b0793640 1 --2- 172.21.15.63:0/3407245883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7a8108cf0 0x7fa7a810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.563+0000 7fa7b0793640 1 --2- 172.21.15.63:0/3407245883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7a81083a0 0x7fa7a81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.563+0000 7fa7b0793640 1 --2- 172.21.15.63:0/3407245883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a8102a60 0x7fa7a8102e70 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.563+0000 7fa7b0793640 1 -- 172.21.15.63:0/3407245883 >> 172.21.15.63:0/3407245883 conn(0x7fa7a8079730 msgr2=0x7fa7a8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.563+0000 7fa7b0793640 1 -- 172.21.15.63:0/3407245883 shutdown_connections 2024-09-21T06:33:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.563+0000 7fa7b0793640 1 -- 172.21.15.63:0/3407245883 wait complete. 2024-09-21T06:33:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.564+0000 7fa7b0793640 1 Processor -- start 2024-09-21T06:33:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.564+0000 7fa7b0793640 1 -- start start 2024-09-21T06:33:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.564+0000 7fa7b0793640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7a8102a60 0x7fa7a8074de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.564+0000 7fa7b0793640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a81083a0 0x7fa7a80700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.564+0000 7fa7b0793640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7a8108cf0 0x7fa7a80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.564+0000 7fa7b0793640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a806e5e0 con 0x7fa7a81083a0 2024-09-21T06:33:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.564+0000 7fa7b0793640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a806e460 con 0x7fa7a8102a60 2024-09-21T06:33:06.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.564+0000 7fa7b0793640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a806e760 con 0x7fa7a8108cf0 2024-09-21T06:33:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.565+0000 7fa7ae52f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7a8102a60 0x7fa7a8074de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.565+0000 7fa7aed30640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7a8108cf0 0x7fa7a80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.565+0000 7fa7aed30640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7a8108cf0 0x7fa7a80705f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:53158/0 (socket says 172.21.15.63:53158) 2024-09-21T06:33:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.565+0000 7fa7ae52f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7a8102a60 0x7fa7a8074de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:57882/0 (socket says 172.21.15.63:57882) 2024-09-21T06:33:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.565+0000 7fa7aed30640 1 -- 172.21.15.63:0/4150394911 learned_addr learned my addr 172.21.15.63:0/4150394911 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.565+0000 7fa7add2e640 1 --2- 172.21.15.63:0/4150394911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a81083a0 0x7fa7a80700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.565+0000 7fa7aed30640 1 -- 172.21.15.63:0/4150394911 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7a8102a60 msgr2=0x7fa7a8074de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.565+0000 7fa7aed30640 1 --2- 172.21.15.63:0/4150394911 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7a8102a60 0x7fa7a8074de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.565+0000 7fa7aed30640 1 -- 172.21.15.63:0/4150394911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a81083a0 msgr2=0x7fa7a80700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.565+0000 7fa7aed30640 1 --2- 172.21.15.63:0/4150394911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a81083a0 0x7fa7a80700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.565+0000 7fa7aed30640 1 -- 172.21.15.63:0/4150394911 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a8070dc0 con 0x7fa7a8108cf0 2024-09-21T06:33:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.565+0000 7fa7add2e640 1 --2- 172.21.15.63:0/4150394911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a81083a0 0x7fa7a80700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:33:06.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.565+0000 7fa7aed30640 1 --2- 172.21.15.63:0/4150394911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7a8108cf0 0x7fa7a80705f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa79800b3f0 tx=0x7fa79800b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:06.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.566+0000 7fa79f7fe640 1 -- 172.21.15.63:0/4150394911 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798015020 con 0x7fa7a8108cf0 2024-09-21T06:33:06.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.566+0000 7fa79f7fe640 1 -- 172.21.15.63:0/4150394911 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa798011ce0 con 0x7fa7a8108cf0 2024-09-21T06:33:06.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.566+0000 7fa7b0793640 1 -- 172.21.15.63:0/4150394911 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a8117160 con 0x7fa7a8108cf0 2024-09-21T06:33:06.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.566+0000 7fa79f7fe640 1 -- 172.21.15.63:0/4150394911 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798010da0 con 0x7fa7a8108cf0 2024-09-21T06:33:06.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.566+0000 7fa7b0793640 1 -- 172.21.15.63:0/4150394911 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a81176d0 con 0x7fa7a8108cf0 2024-09-21T06:33:06.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.569+0000 7fa7b6d07740 1 Processor -- start 2024-09-21T06:33:06.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.569+0000 7fa79f7fe640 1 -- 172.21.15.63:0/4150394911 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fa798018020 con 0x7fa7a8108cf0 2024-09-21T06:33:06.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.569+0000 7fa7b6d07740 1 -- start start 2024-09-21T06:33:06.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.570+0000 7fa7b6d07740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a399070 0x55805a740270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:06.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.570+0000 7fa7b6d07740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a3701b0 0x55805a7407b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:06.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.570+0000 7fa7b6d07740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a378390 0x55805a740cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:06.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.570+0000 7fa7b6d07740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55805a6b6e50 con 0x55805a378390 2024-09-21T06:33:06.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.570+0000 7fa7b6d07740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55805a6a6280 con 0x55805a399070 2024-09-21T06:33:06.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.570+0000 7fa7b6d07740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55805a6aa090 con 0x55805a3701b0 2024-09-21T06:33:06.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.570+0000 7fa7add2e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a399070 0x55805a740270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:06.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.570+0000 7fa7add2e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a399070 0x55805a740270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:57890/0 (socket says 172.21.15.63:57890) 2024-09-21T06:33:06.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.570+0000 7fa7add2e640 1 -- 172.21.15.63:0/2007693007 learned_addr learned my addr 172.21.15.63:0/2007693007 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:06.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.570+0000 7fa7add2e640 1 --2- 172.21.15.63:0/2007693007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a378390 0x55805a740cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:06.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.571+0000 7fa79f7fe640 1 --2- 172.21.15.63:0/4150394911 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa7940b66b0 0x7fa7940b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:06.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.571+0000 7fa79f7fe640 1 -- 172.21.15.63:0/4150394911 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fa7980e6e00 con 0x7fa7a8108cf0 2024-09-21T06:33:06.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.572+0000 7fa7ae52f640 1 --2- 172.21.15.63:0/2007693007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a3701b0 0x55805a7407b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:06.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.572+0000 7fa7aed30640 1 --2- 172.21.15.63:0/4150394911 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa7940b66b0 0x7fa7940b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:06.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.573+0000 7fa7aed30640 1 --2- 172.21.15.63:0/4150394911 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa7940b66b0 0x7fa7940b8bc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa7980e45e0 tx=0x7fa798010fe0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:06.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.574+0000 7fa7ae52f640 1 -- 172.21.15.63:0/2007693007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a399070 msgr2=0x55805a740270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:06.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.574+0000 7fa7ae52f640 1 --2- 172.21.15.63:0/2007693007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a399070 0x55805a740270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.574+0000 7fa7ae52f640 1 -- 172.21.15.63:0/2007693007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a378390 msgr2=0x55805a740cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:06.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.574+0000 7fa7ae52f640 1 --2- 172.21.15.63:0/2007693007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a378390 0x55805a740cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.574+0000 7fa7ae52f640 1 -- 172.21.15.63:0/2007693007 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55805a404650 con 0x55805a3701b0 2024-09-21T06:33:06.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.575+0000 7fa7ae52f640 1 --2- 172.21.15.63:0/2007693007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a3701b0 0x55805a7407b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4006010 tx=0x7fa7a4004900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0d5abc0b4aa8dd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:06.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.575+0000 7fa79cff9640 1 -- 172.21.15.63:0/2007693007 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4052070 con 0x55805a3701b0 2024-09-21T06:33:06.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.575+0000 7fa79cff9640 1 -- 172.21.15.63:0/2007693007 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7a4040b80 con 0x55805a3701b0 2024-09-21T06:33:06.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.576+0000 7fa79cff9640 1 -- 172.21.15.63:0/2007693007 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4052070 con 0x55805a3701b0 2024-09-21T06:33:06.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.577+0000 7fa7b6d07740 1 -- 172.21.15.63:0/2007693007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a3701b0 msgr2=0x55805a7407b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:06.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.577+0000 7fa7b6d07740 1 --2- 172.21.15.63:0/2007693007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a3701b0 0x55805a7407b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4006010 tx=0x7fa7a4004900 comp rx=0 tx=0).stop 2024-09-21T06:33:06.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.577+0000 7fa7b6d07740 1 -- 172.21.15.63:0/2007693007 shutdown_connections 2024-09-21T06:33:06.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.577+0000 7fa7b6d07740 1 --2- 172.21.15.63:0/2007693007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a378390 0x55805a740cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.577+0000 7fa7b6d07740 1 --2- 172.21.15.63:0/2007693007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a3701b0 0x55805a7407b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.577+0000 7fa7b6d07740 1 --2- 172.21.15.63:0/2007693007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a399070 0x55805a740270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.577+0000 7fa7b6d07740 1 -- 172.21.15.63:0/2007693007 >> 172.21.15.63:0/2007693007 conn(0x55805a38d460 msgr2=0x55805a73e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:06.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.577+0000 7fa7b6d07740 1 -- 172.21.15.63:0/2007693007 shutdown_connections 2024-09-21T06:33:06.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.578+0000 7fa7b6d07740 1 -- 172.21.15.63:0/2007693007 wait complete. 2024-09-21T06:33:06.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.578+0000 7fa7b6d07740 1 -- start start 2024-09-21T06:33:06.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.578+0000 7fa7b6d07740 1 Processor -- start 2024-09-21T06:33:06.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.579+0000 7fa7b6d07740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a3701b0 0x55805a74b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:06.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.579+0000 7fa7b6d07740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a378390 0x55805a74bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:06.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.579+0000 7fa7b6d07740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a399070 0x55805a74c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:06.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.579+0000 7fa7b6d07740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55805a507700 con 0x55805a399070 2024-09-21T06:33:06.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.579+0000 7fa7b6d07740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55805a641110 con 0x55805a3701b0 2024-09-21T06:33:06.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.579+0000 7fa7b6d07740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55805a74ea40 con 0x55805a378390 2024-09-21T06:33:06.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.579+0000 7fa7b6d07740 10 client.0 _ll_register_callbacks cb 0x55805a65a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:06.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.579+0000 7fa7add2e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a3701b0 0x55805a74b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:06.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.579+0000 7fa7add2e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a3701b0 0x55805a74b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:57894/0 (socket says 172.21.15.63:57894) 2024-09-21T06:33:06.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.579+0000 7fa7add2e640 1 -- 172.21.15.63:0/287146157 learned_addr learned my addr 172.21.15.63:0/287146157 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:06.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.579+0000 7fa7add2e640 1 --2- 172.21.15.63:0/287146157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a399070 0x55805a74c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:06.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.579+0000 7fa7ae52f640 1 --2- 172.21.15.63:0/287146157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a378390 0x55805a74bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:06.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.580+0000 7fa7add2e640 1 -- 172.21.15.63:0/287146157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a378390 msgr2=0x55805a74bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:06.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.580+0000 7fa7add2e640 1 --2- 172.21.15.63:0/287146157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a378390 0x55805a74bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.580+0000 7fa7add2e640 1 -- 172.21.15.63:0/287146157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a399070 msgr2=0x55805a74c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:06.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.580+0000 7fa7add2e640 1 --2- 172.21.15.63:0/287146157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a399070 0x55805a74c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.580+0000 7fa7add2e640 1 -- 172.21.15.63:0/287146157 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55805a66ec40 con 0x55805a3701b0 2024-09-21T06:33:06.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.580+0000 7fa7add2e640 1 --2- 172.21.15.63:0/287146157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a3701b0 0x55805a74b860 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000fc90 tx=0x7fa7a0004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a53907c9f17b550f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:06.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.580+0000 7fa791ffb640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:33:06.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.580+0000 7fa791ffb640 1 -- 172.21.15.63:0/287146157 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a000fe40 con 0x55805a3701b0 2024-09-21T06:33:06.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.580+0000 7fa791ffb640 1 -- 172.21.15.63:0/287146157 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fa7a000edf0 con 0x55805a3701b0 2024-09-21T06:33:06.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.580+0000 7fa7b6d07740 1 -- 172.21.15.63:0/287146157 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7a4040b80 con 0x55805a3701b0 2024-09-21T06:33:06.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.580+0000 7fa791ffb640 1 -- 172.21.15.63:0/287146157 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fa7a0004b20 con 0x55805a3701b0 2024-09-21T06:33:06.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.580+0000 7fa7b6d07740 10 client.26213 fetch_fsmap learned FSMap version 43 2024-09-21T06:33:06.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.580+0000 7fa7b6d07740 1 -- 172.21.15.63:0/287146157 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55805a75a6b0 con 0x55805a3701b0 2024-09-21T06:33:06.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.581+0000 7fa791ffb640 1 -- 172.21.15.63:0/287146157 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7a0003e20 con 0x55805a3701b0 2024-09-21T06:33:06.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.581+0000 7fa791ffb640 1 -- 172.21.15.63:0/287146157 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7fa7a0020040 con 0x55805a3701b0 2024-09-21T06:33:06.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.581+0000 7fa7b6d07740 10 client.26213 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:33:06.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.581+0000 7fa7b6d07740 10 client.26213 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:33:06.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.581+0000 7fa7b6d07740 20 client.26213 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:06.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.581+0000 7fa7b6d07740 1 --2- 172.21.15.63:0/287146157 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55805a3579f0 0x55805a75dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:06.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.581+0000 7fa7b6d07740 4 client.26213 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:33:06.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.581+0000 7fa7b6d07740 1 -- 172.21.15.63:0/287146157 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa7a4040b80 con 0x55805a3579f0 2024-09-21T06:33:06.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.581+0000 7fa7ae52f640 1 --2- 172.21.15.63:0/287146157 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55805a3579f0 0x55805a75dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:06.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.581+0000 7fa791ffb640 10 client.26213 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:06.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.582+0000 7fa7ae52f640 1 --2- 172.21.15.63:0/287146157 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55805a3579f0 0x55805a75dd10 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=698f4dd2d840eade server_cookie=9c19b3e3c67e1792 in_seq=0 out_seq=0 2024-09-21T06:33:06.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.583+0000 7fa791ffb640 1 -- 172.21.15.63:0/287146157 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fa7a4040b80 con 0x55805a3579f0 2024-09-21T06:33:06.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.583+0000 7fa791ffb640 10 client.26213 handle_command_reply: tid=0 2024-09-21T06:33:06.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.583+0000 7fa7b6d07740 1 client.26213 shutdown 2024-09-21T06:33:06.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.583+0000 7fa7b6d07740 1 -- 172.21.15.63:0/287146157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a3701b0 msgr2=0x55805a74b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:06.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.583+0000 7fa7b6d07740 1 --2- 172.21.15.63:0/287146157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a3701b0 0x55805a74b860 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000fc90 tx=0x7fa7a0004ab0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.583+0000 7fa7b6d07740 1 -- 172.21.15.63:0/287146157 shutdown_connections 2024-09-21T06:33:06.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.583+0000 7fa7b6d07740 1 --2- 172.21.15.63:0/287146157 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55805a3579f0 0x55805a75dd10 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.583+0000 7fa7b6d07740 1 --2- 172.21.15.63:0/287146157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a399070 0x55805a74c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.583+0000 7fa7b6d07740 1 --2- 172.21.15.63:0/287146157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a378390 0x55805a74bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.583+0000 7fa7b6d07740 1 --2- 172.21.15.63:0/287146157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a3701b0 0x55805a74b860 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.583+0000 7fa7b6d07740 1 -- 172.21.15.63:0/287146157 >> 172.21.15.63:0/287146157 conn(0x55805a38d460 msgr2=0x55805a7412a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:06.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.583+0000 7fa791ffb640 0 client.26213 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:06.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.583+0000 7fa7b6d07740 1 -- 172.21.15.63:0/287146157 shutdown_connections 2024-09-21T06:33:06.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.583+0000 7fa7b6d07740 1 -- 172.21.15.63:0/287146157 wait complete. 2024-09-21T06:33:06.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.583+0000 7fa7b6d07740 20 client.26213 trim_cache size 0 max 16384 2024-09-21T06:33:06.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.605+0000 7fa7b6d07740 1 Processor -- start 2024-09-21T06:33:06.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.605+0000 7fa7b6d07740 1 -- start start 2024-09-21T06:33:06.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.606+0000 7fa7b6d07740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a3701b0 0x55805a73e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:06.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.606+0000 7fa7b6d07740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a378390 0x55805a7634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:06.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.606+0000 7fa7b6d07740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a399070 0x55805a763a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:06.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.606+0000 7fa7b6d07740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a81b5d60 con 0x55805a3701b0 2024-09-21T06:33:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.606+0000 7fa7b6d07740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a81b7960 con 0x55805a378390 2024-09-21T06:33:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.606+0000 7fa7b6d07740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a81b64f0 con 0x55805a399070 2024-09-21T06:33:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.606+0000 7fa7add2e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a3701b0 0x55805a73e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.606+0000 7fa7add2e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a3701b0 0x55805a73e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42704/0 (socket says 172.21.15.63:42704) 2024-09-21T06:33:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.606+0000 7fa7add2e640 1 -- 172.21.15.63:0/1452993232 learned_addr learned my addr 172.21.15.63:0/1452993232 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.606+0000 7fa7add2e640 1 --2- 172.21.15.63:0/1452993232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a399070 0x55805a763a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.606+0000 7fa7add2e640 1 -- 172.21.15.63:0/1452993232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a399070 msgr2=0x55805a763a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.606+0000 7fa7add2e640 1 --2- 172.21.15.63:0/1452993232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a399070 0x55805a763a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.606+0000 7fa7add2e640 1 -- 172.21.15.63:0/1452993232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a378390 msgr2=0x55805a7634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.606+0000 7fa7ae52f640 1 --2- 172.21.15.63:0/1452993232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a378390 0x55805a7634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:06.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.606+0000 7fa7add2e640 1 --2- 172.21.15.63:0/1452993232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a378390 0x55805a7634d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.606+0000 7fa7add2e640 1 -- 172.21.15.63:0/1452993232 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55805a357c20 con 0x55805a3701b0 2024-09-21T06:33:06.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.607+0000 7fa7ae52f640 1 --2- 172.21.15.63:0/1452993232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a378390 0x55805a7634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:33:06.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.607+0000 7fa7add2e640 1 --2- 172.21.15.63:0/1452993232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a3701b0 0x55805a73e1b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009730 tx=0x7fa7a0009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8ff20c287b80dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:06.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.607+0000 7fa793fff640 1 -- 172.21.15.63:0/1452993232 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a000edf0 con 0x55805a3701b0 2024-09-21T06:33:06.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.607+0000 7fa793fff640 1 -- 172.21.15.63:0/1452993232 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7a00047d0 con 0x55805a3701b0 2024-09-21T06:33:06.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.607+0000 7fa793fff640 1 -- 172.21.15.63:0/1452993232 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0004240 con 0x55805a3701b0 2024-09-21T06:33:06.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.608+0000 7fa7b6d07740 1 -- 172.21.15.63:0/1452993232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a3701b0 msgr2=0x55805a73e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:06.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.608+0000 7fa7b6d07740 1 --2- 172.21.15.63:0/1452993232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a3701b0 0x55805a73e1b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009730 tx=0x7fa7a0009fd0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.608+0000 7fa7b6d07740 1 -- 172.21.15.63:0/1452993232 shutdown_connections 2024-09-21T06:33:06.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.608+0000 7fa7b6d07740 1 --2- 172.21.15.63:0/1452993232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a399070 0x55805a763a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.608+0000 7fa7b6d07740 1 --2- 172.21.15.63:0/1452993232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a378390 0x55805a7634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.608+0000 7fa7b6d07740 1 --2- 172.21.15.63:0/1452993232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a3701b0 0x55805a73e1b0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.608+0000 7fa7b6d07740 1 -- 172.21.15.63:0/1452993232 >> 172.21.15.63:0/1452993232 conn(0x55805a38d460 msgr2=0x55805a73daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.608+0000 7fa7b6d07740 1 -- 172.21.15.63:0/1452993232 shutdown_connections 2024-09-21T06:33:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.608+0000 7fa7b6d07740 1 -- 172.21.15.63:0/1452993232 wait complete. 2024-09-21T06:33:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.609+0000 7fa7b6d07740 1 -- start start 2024-09-21T06:33:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.609+0000 7fa7b6d07740 1 Processor -- start 2024-09-21T06:33:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.609+0000 7fa7b6d07740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a3701b0 0x55805a754570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.609+0000 7fa7b6d07740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a378390 0x55805a74fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.609+0000 7fa7b6d07740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a399070 0x55805a750070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.609+0000 7fa7b6d07740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a81b7290 con 0x55805a378390 2024-09-21T06:33:06.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.609+0000 7fa7b6d07740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a81b6bc0 con 0x55805a399070 2024-09-21T06:33:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.609+0000 7fa7b6d07740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a81b3d40 con 0x55805a3701b0 2024-09-21T06:33:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.609+0000 7fa7ae52f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a378390 0x55805a74fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.609+0000 7fa7b6d07740 10 client.0 _ll_register_callbacks cb 0x7fa7a0011a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.609+0000 7fa7ae52f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a378390 0x55805a74fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42716/0 (socket says 172.21.15.63:42716) 2024-09-21T06:33:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.609+0000 7fa7ae52f640 1 -- 172.21.15.63:0/1358011733 learned_addr learned my addr 172.21.15.63:0/1358011733 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.610+0000 7fa7add2e640 1 --2- 172.21.15.63:0/1358011733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a3701b0 0x55805a754570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.610+0000 7fa7add2e640 1 --2- 172.21.15.63:0/1358011733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a399070 0x55805a750070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.610+0000 7fa7add2e640 1 -- 172.21.15.63:0/1358011733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a399070 msgr2=0x55805a750070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.610+0000 7fa7add2e640 1 --2- 172.21.15.63:0/1358011733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a399070 0x55805a750070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.610+0000 7fa7add2e640 1 -- 172.21.15.63:0/1358011733 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a378390 msgr2=0x55805a74fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.610+0000 7fa7add2e640 1 --2- 172.21.15.63:0/1358011733 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a378390 0x55805a74fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.610+0000 7fa7add2e640 1 -- 172.21.15.63:0/1358011733 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55805a7507e0 con 0x55805a3701b0 2024-09-21T06:33:06.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.610+0000 7fa7add2e640 1 --2- 172.21.15.63:0/1358011733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a3701b0 0x55805a754570 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0002230 tx=0x7fa7a000fbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93f88002ef59b23 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.610+0000 7fa791ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:33:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.610+0000 7fa791ffb640 1 -- 172.21.15.63:0/1358011733 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a000ee80 con 0x55805a3701b0 2024-09-21T06:33:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.611+0000 7fa791ffb640 1 -- 172.21.15.63:0/1358011733 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fa7a0003fc0 con 0x55805a3701b0 2024-09-21T06:33:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.611+0000 7fa7b6d07740 1 -- 172.21.15.63:0/1358011733 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7a00047d0 con 0x55805a3701b0 2024-09-21T06:33:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.611+0000 7fa791ffb640 1 -- 172.21.15.63:0/1358011733 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fa7a00041c0 con 0x55805a3701b0 2024-09-21T06:33:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.611+0000 7fa7b6d07740 10 client.26281 fetch_fsmap learned FSMap version 43 2024-09-21T06:33:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.611+0000 7fa7b6d07740 1 -- 172.21.15.63:0/1358011733 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55805a7c8660 con 0x55805a3701b0 2024-09-21T06:33:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.611+0000 7fa791ffb640 1 -- 172.21.15.63:0/1358011733 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7a00047d0 con 0x55805a3701b0 2024-09-21T06:33:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.611+0000 7fa791ffb640 1 -- 172.21.15.63:0/1358011733 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 43) ==== 8378+0+0 (secure 0 0 0) 0x7fa7a003e030 con 0x55805a3701b0 2024-09-21T06:33:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.611+0000 7fa7b6d07740 10 client.26281 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:33:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.612+0000 7fa7b6d07740 10 client.26281 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:33:06.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.612+0000 7fa7b6d07740 20 client.26281 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:06.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.612+0000 7fa7b6d07740 1 --2- 172.21.15.63:0/1358011733 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55805a32cda0 0x55805a7cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:06.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.612+0000 7fa7b6d07740 4 client.26281 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:33:06.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.612+0000 7fa7b6d07740 1 -- 172.21.15.63:0/1358011733 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55805a6b8da0 con 0x55805a32cda0 2024-09-21T06:33:06.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.612+0000 7fa7ae52f640 1 --2- 172.21.15.63:0/1358011733 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55805a32cda0 0x55805a7cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:06.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.612+0000 7fa7ae52f640 1 --2- 172.21.15.63:0/1358011733 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55805a32cda0 0x55805a7cae80 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15ca09592f2fd860 server_cookie=2f57aff68e64b49d in_seq=0 out_seq=0 2024-09-21T06:33:06.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.612+0000 7fa791ffb640 10 client.26281 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:06.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.612+0000 7fa791ffb640 1 -- 172.21.15.63:0/1358011733 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x55805a6b8da0 con 0x55805a32cda0 2024-09-21T06:33:06.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.612+0000 7fa791ffb640 10 client.26281 handle_command_reply: tid=0 2024-09-21T06:33:06.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.613+0000 7fa7b6d07740 1 client.26281 shutdown 2024-09-21T06:33:06.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.613+0000 7fa7b6d07740 1 -- 172.21.15.63:0/1358011733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a3701b0 msgr2=0x55805a754570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:06.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.613+0000 7fa7b6d07740 1 --2- 172.21.15.63:0/1358011733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a3701b0 0x55805a754570 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0002230 tx=0x7fa7a000fbf0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.613+0000 7fa7b6d07740 1 -- 172.21.15.63:0/1358011733 shutdown_connections 2024-09-21T06:33:06.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.613+0000 7fa7b6d07740 1 --2- 172.21.15.63:0/1358011733 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55805a32cda0 0x55805a7cae80 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.613+0000 7fa7b6d07740 1 --2- 172.21.15.63:0/1358011733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55805a399070 0x55805a750070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.613+0000 7fa791ffb640 0 client.26281 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:06.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.613+0000 7fa7b6d07740 1 --2- 172.21.15.63:0/1358011733 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55805a378390 0x55805a74fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.613+0000 7fa7b6d07740 1 --2- 172.21.15.63:0/1358011733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55805a3701b0 0x55805a754570 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.613+0000 7fa7b6d07740 1 -- 172.21.15.63:0/1358011733 >> 172.21.15.63:0/1358011733 conn(0x55805a38d460 msgr2=0x55805a73e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:06.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.613+0000 7fa7b6d07740 1 -- 172.21.15.63:0/1358011733 shutdown_connections 2024-09-21T06:33:06.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.613+0000 7fa7b6d07740 1 -- 172.21.15.63:0/1358011733 wait complete. 2024-09-21T06:33:06.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.613+0000 7fa7b6d07740 20 client.26281 trim_cache size 0 max 16384 2024-09-21T06:33:06.621 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:33:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:33:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": { 2024-09-21T06:33:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: "5396028b-35f4-48fe-b54d-385784e97de3": { 2024-09-21T06:33:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:33:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: "tag": "5396028b-35f4-48fe-b54d-385784e97de3", 2024-09-21T06:33:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: "options": "recursive,force" 2024-09-21T06:33:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:33:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:33:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:33:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "5396028b-35f4-48fe-b54d-385784e97de3": { 2024-09-21T06:33:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:04.523378+0000", 2024-09-21T06:33:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:33:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:33:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:33:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:33:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:33:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:33:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "024d3c59-0b67-49a9-bf4a-e02d36691942": { 2024-09-21T06:33:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:32:14.282244+0000", 2024-09-21T06:33:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:33:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:33:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:33:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:33:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:33:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:33:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:33:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:31:27.507051+0000", 2024-09-21T06:33:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:33:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:33:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:33:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:33:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:33:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:33:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:33:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:33:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:33:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:33:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:33:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:33:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:33:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:33:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:33:06.624 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:33:06.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.614+0000 7fa7b0793640 1 -- 172.21.15.63:0/4150394911 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa7940b66b0 msgr2=0x7fa7940b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:06.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.614+0000 7fa7b0793640 1 --2- 172.21.15.63:0/4150394911 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa7940b66b0 0x7fa7940b8bc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa7980e45e0 tx=0x7fa798010fe0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.614+0000 7fa7b0793640 1 -- 172.21.15.63:0/4150394911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7a8108cf0 msgr2=0x7fa7a80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:06.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.614+0000 7fa7b0793640 1 --2- 172.21.15.63:0/4150394911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7a8108cf0 0x7fa7a80705f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa79800b3f0 tx=0x7fa79800b8b0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.614+0000 7fa7b0793640 1 -- 172.21.15.63:0/4150394911 shutdown_connections 2024-09-21T06:33:06.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.614+0000 7fa7b0793640 1 --2- 172.21.15.63:0/4150394911 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa7940b66b0 0x7fa7940b8bc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.614+0000 7fa7b0793640 1 --2- 172.21.15.63:0/4150394911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7a8108cf0 0x7fa7a80705f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.614+0000 7fa7b0793640 1 --2- 172.21.15.63:0/4150394911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7a81083a0 0x7fa7a80700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.614+0000 7fa7b0793640 1 --2- 172.21.15.63:0/4150394911 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7a8102a60 0x7fa7a8074de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.614+0000 7fa7b0793640 1 -- 172.21.15.63:0/4150394911 >> 172.21.15.63:0/4150394911 conn(0x7fa7a8079730 msgr2=0x7fa7a8101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.614+0000 7fa7b0793640 1 -- 172.21.15.63:0/4150394911 shutdown_connections 2024-09-21T06:33:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:06.614+0000 7fa7b0793640 1 -- 172.21.15.63:0/4150394911 wait complete. 2024-09-21T06:33:06.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:06 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:33:06.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:06 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:06.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:06 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:07.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:06 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:33:07.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:06 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:07.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:06 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:07.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:06 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:33:07.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:06 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:07.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:06 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:07.474 INFO:tasks.cephfs.filesystem:scrub status for tag:5396028b-35f4-48fe-b54d-385784e97de3 - {'path': '/', 'tag': '5396028b-35f4-48fe-b54d-385784e97de3', 'options': 'recursive,force'} 2024-09-21T06:33:07.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:07 smithi063 ceph-mon[31150]: pgmap v470: 97 pgs: 97 active+clean; 227 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.6 MiB/s wr, 970 op/s 2024-09-21T06:33:07.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:07 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:33:07.981+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:33:07.981+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-21T06:33:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:33:07.981+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-21T06:33:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:33:07.981+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T06:33:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:33:07.981+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-09-21T06:33:08.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:07 smithi071 ceph-mon[34844]: pgmap v470: 97 pgs: 97 active+clean; 227 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.6 MiB/s wr, 970 op/s 2024-09-21T06:33:08.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:07 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:08.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:07 smithi175 ceph-mon[34510]: pgmap v470: 97 pgs: 97 active+clean; 227 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.6 MiB/s wr, 970 op/s 2024-09-21T06:33:08.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:07 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:10.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:09 smithi071 ceph-mon[34844]: pgmap v471: 97 pgs: 97 active+clean; 237 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.9 MiB/s wr, 1.19k op/s 2024-09-21T06:33:10.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:09 smithi063 ceph-mon[31150]: pgmap v471: 97 pgs: 97 active+clean; 237 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.9 MiB/s wr, 1.19k op/s 2024-09-21T06:33:10.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:09 smithi175 ceph-mon[34510]: pgmap v471: 97 pgs: 97 active+clean; 237 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.9 MiB/s wr, 1.19k op/s 2024-09-21T06:33:12.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:11 smithi071 ceph-mon[34844]: pgmap v472: 97 pgs: 97 active+clean; 239 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.6 MiB/s wr, 1.09k op/s 2024-09-21T06:33:12.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:11 smithi063 ceph-mon[31150]: pgmap v472: 97 pgs: 97 active+clean; 239 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.6 MiB/s wr, 1.09k op/s 2024-09-21T06:33:12.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:11 smithi175 ceph-mon[34510]: pgmap v472: 97 pgs: 97 active+clean; 239 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.6 MiB/s wr, 1.09k op/s 2024-09-21T06:33:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:33:12.404+0000 7fc5c5ffb640 1 -- 172.21.15.63:0/3242143077 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7fc5a80034c0 con 0x7fc5d0102a00 2024-09-21T06:33:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:33:12.404+0000 7fc5c6ffd640 1 -- 172.21.15.63:0/3242143077 <== mon.0 v2:172.21.15.63:3300/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7fc5a80034c0 con 0x7fc5d0102a00 2024-09-21T06:33:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:33:12.410+0000 7fc5affff640 1 -- 172.21.15.63:0/2511038578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7fc5a00034c0 con 0x55642381a2f0 2024-09-21T06:33:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:33:12.411+0000 7fc5b97fa640 1 -- 172.21.15.63:0/2511038578 <== mon.0 v2:172.21.15.63:3300/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7fc5a00034c0 con 0x55642381a2f0 2024-09-21T06:33:14.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:13 smithi071 ceph-mon[34844]: pgmap v473: 97 pgs: 97 active+clean; 227 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 3.0 MiB/s wr, 1.28k op/s 2024-09-21T06:33:14.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:13 smithi063 ceph-mon[31150]: pgmap v473: 97 pgs: 97 active+clean; 227 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 3.0 MiB/s wr, 1.28k op/s 2024-09-21T06:33:14.098 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:13 smithi175 ceph-mon[34510]: pgmap v473: 97 pgs: 97 active+clean; 227 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 3.0 MiB/s wr, 1.28k op/s 2024-09-21T06:33:14.147 INFO:tasks.workunit.client.0.smithi063.stdout:All 50000 operations completed A-OK! 2024-09-21T06:33:14.148 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T06:33:14.148 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T06:33:16.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:15 smithi071 ceph-mon[34844]: pgmap v474: 97 pgs: 97 active+clean; 234 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 1.07k op/s 2024-09-21T06:33:16.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:15 smithi063 ceph-mon[31150]: pgmap v474: 97 pgs: 97 active+clean; 234 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 1.07k op/s 2024-09-21T06:33:16.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:15 smithi175 ceph-mon[34510]: pgmap v474: 97 pgs: 97 active+clean; 234 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 1.07k op/s 2024-09-21T06:33:18.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:17 smithi071 ceph-mon[34844]: pgmap v475: 97 pgs: 97 active+clean; 235 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.7 MiB/s wr, 1.08k op/s 2024-09-21T06:33:18.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:17 smithi063 ceph-mon[31150]: pgmap v475: 97 pgs: 97 active+clean; 235 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.7 MiB/s wr, 1.08k op/s 2024-09-21T06:33:18.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:17 smithi175 ceph-mon[34510]: pgmap v475: 97 pgs: 97 active+clean; 235 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.7 MiB/s wr, 1.08k op/s 2024-09-21T06:33:19.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:18 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:33:19.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:18 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:33:19.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:18 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:33:19.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:18 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:33:19.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:18 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:33:19.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:18 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:33:19.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:18 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:33:19.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:18 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:33:19.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:18 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:33:20.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:19 smithi071 ceph-mon[34844]: pgmap v476: 97 pgs: 97 active+clean; 240 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 1.05k op/s 2024-09-21T06:33:20.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:19 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:33:20.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:19 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:33:20.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:19 smithi063 ceph-mon[31150]: pgmap v476: 97 pgs: 97 active+clean; 240 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 1.05k op/s 2024-09-21T06:33:20.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:19 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:33:20.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:19 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:33:20.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:19 smithi175 ceph-mon[34510]: pgmap v476: 97 pgs: 97 active+clean; 240 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 1.05k op/s 2024-09-21T06:33:20.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:19 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:33:20.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:19 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:33:22.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:21 smithi071 ceph-mon[34844]: pgmap v477: 97 pgs: 97 active+clean; 238 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.3 MiB/s wr, 747 op/s 2024-09-21T06:33:22.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:21 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:22.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:21 smithi063 ceph-mon[31150]: pgmap v477: 97 pgs: 97 active+clean; 238 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.3 MiB/s wr, 747 op/s 2024-09-21T06:33:22.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:21 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:22.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:21 smithi175 ceph-mon[34510]: pgmap v477: 97 pgs: 97 active+clean; 238 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.3 MiB/s wr, 747 op/s 2024-09-21T06:33:22.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:21 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:22.998 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:33:22.996+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:22.998 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:33:22.996+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-21T06:33:22.998 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:33:22.996+0000 7fc5d510d640 1 -- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 msgr2=0x556423c05f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-21T06:33:22.998 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:33:22.996+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T06:33:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi063.front.sepia.ceph.com.smithi063.stderr:2024-09-21T06:33:22.996+0000 7fc5d510d640 1 --2- 172.21.15.63:0/2511038578 >> [v2:172.21.15.71:6838/3472481253,v1:172.21.15.71:6839/3472481253] conn(0x556423801d80 0x556423c05f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-09-21T06:33:24.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:23 smithi071 ceph-mon[34844]: pgmap v478: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.5 MiB/s wr, 720 op/s 2024-09-21T06:33:24.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:23 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:24.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:23 smithi063 ceph-mon[31150]: pgmap v478: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.5 MiB/s wr, 720 op/s 2024-09-21T06:33:24.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:23 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:24.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:23 smithi175 ceph-mon[34510]: pgmap v478: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.5 MiB/s wr, 720 op/s 2024-09-21T06:33:24.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:23 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:24.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:24 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:25.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:24 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:25.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:24 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:26.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:25 smithi071 ceph-mon[34844]: pgmap v479: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.7 MiB/s wr, 439 op/s 2024-09-21T06:33:26.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:25 smithi063 ceph-mon[31150]: pgmap v479: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.7 MiB/s wr, 439 op/s 2024-09-21T06:33:26.098 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:25 smithi175 ceph-mon[34510]: pgmap v479: 97 pgs: 97 active+clean; 245 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.7 MiB/s wr, 439 op/s 2024-09-21T06:33:27.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:26 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:27.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:26 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:27.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:26 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:28.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:27 smithi071 ceph-mon[34844]: pgmap v480: 97 pgs: 97 active+clean; 256 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.9 MiB/s wr, 432 op/s 2024-09-21T06:33:28.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:27 smithi063 ceph-mon[31150]: pgmap v480: 97 pgs: 97 active+clean; 256 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.9 MiB/s wr, 432 op/s 2024-09-21T06:33:28.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:27 smithi175 ceph-mon[34510]: pgmap v480: 97 pgs: 97 active+clean; 256 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.9 MiB/s wr, 432 op/s 2024-09-21T06:33:28.471 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2024-09-21T06:33:28.472 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T06:33:28.818 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:28 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:28.819 DEBUG:teuthology.parallel:result is None 2024-09-21T06:33:28.820 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T06:33:28.854 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T06:33:28.854 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-21T06:33:28.864 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T06:33:28.903 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-21T06:33:28.912 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-21T06:33:28.912 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T06:33:28.913 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T06:33:28.913 DEBUG:teuthology.orchestra.run.smithi063:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-21T06:33:28.971 DEBUG:teuthology.orchestra.run.smithi063:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-21T06:33:29.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:28 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:29.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:28 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:30.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:29 smithi071 ceph-mon[34844]: pgmap v481: 97 pgs: 97 active+clean; 267 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.1 MiB/s wr, 462 op/s 2024-09-21T06:33:30.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:29 smithi063 ceph-mon[31150]: pgmap v481: 97 pgs: 97 active+clean; 267 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.1 MiB/s wr, 462 op/s 2024-09-21T06:33:30.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:29 smithi175 ceph-mon[34510]: pgmap v481: 97 pgs: 97 active+clean; 267 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.1 MiB/s wr, 462 op/s 2024-09-21T06:33:32.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:31 smithi071 ceph-mon[34844]: pgmap v482: 97 pgs: 97 active+clean; 270 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 379 op/s 2024-09-21T06:33:32.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:31 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:32.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:31 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:32.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:31 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:32.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:31 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:33:32.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:31 smithi063 ceph-mon[31150]: pgmap v482: 97 pgs: 97 active+clean; 270 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 379 op/s 2024-09-21T06:33:32.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:31 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:32.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:31 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:32.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:31 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:32.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:31 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:33:32.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:31 smithi175 ceph-mon[34510]: pgmap v482: 97 pgs: 97 active+clean; 270 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 379 op/s 2024-09-21T06:33:32.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:31 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:32.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:31 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:32.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:31 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:32.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:31 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:33:33.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:32 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:33.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:32 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:33.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:32 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:34.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:33 smithi071 ceph-mon[34844]: pgmap v483: 97 pgs: 97 active+clean; 260 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 427 op/s 2024-09-21T06:33:34.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:33 smithi063 ceph-mon[31150]: pgmap v483: 97 pgs: 97 active+clean; 260 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 427 op/s 2024-09-21T06:33:34.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:33 smithi175 ceph-mon[34510]: pgmap v483: 97 pgs: 97 active+clean; 260 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 427 op/s 2024-09-21T06:33:36.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:35 smithi071 ceph-mon[34844]: pgmap v484: 97 pgs: 97 active+clean; 261 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 329 op/s 2024-09-21T06:33:36.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:35 smithi063 ceph-mon[31150]: pgmap v484: 97 pgs: 97 active+clean; 261 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 329 op/s 2024-09-21T06:33:36.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:35 smithi175 ceph-mon[34510]: pgmap v484: 97 pgs: 97 active+clean; 261 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 329 op/s 2024-09-21T06:33:37.475 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:33:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:37.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:37 smithi063 ceph-mon[31150]: pgmap v485: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 309 op/s 2024-09-21T06:33:38.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:37 smithi071 ceph-mon[34844]: pgmap v485: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 309 op/s 2024-09-21T06:33:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:37 smithi175 ceph-mon[34510]: pgmap v485: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 309 op/s 2024-09-21T06:33:38.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.241+0000 7f253bda0640 1 -- 172.21.15.63:0/3626790178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2534105300 msgr2=0x7f253410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:38.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.241+0000 7f253bda0640 1 --2- 172.21.15.63:0/3626790178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2534105300 0x7f253410d850 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2524009900 tx=0x7f252402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.241+0000 7f253bda0640 1 -- 172.21.15.63:0/3626790178 shutdown_connections 2024-09-21T06:33:38.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.241+0000 7f253bda0640 1 --2- 172.21.15.63:0/3626790178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253410de10 0x7f2534110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.241+0000 7f253bda0640 1 --2- 172.21.15.63:0/3626790178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2534105300 0x7f253410d850 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.241+0000 7f253bda0640 1 --2- 172.21.15.63:0/3626790178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25341049b0 0x7f2534104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.241+0000 7f253bda0640 1 -- 172.21.15.63:0/3626790178 >> 172.21.15.63:0/3626790178 conn(0x7f2534079730 msgr2=0x7f2534079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:38.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.241+0000 7f253bda0640 1 -- 172.21.15.63:0/3626790178 shutdown_connections 2024-09-21T06:33:38.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.241+0000 7f253bda0640 1 -- 172.21.15.63:0/3626790178 wait complete. 2024-09-21T06:33:38.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.242+0000 7f253bda0640 1 Processor -- start 2024-09-21T06:33:38.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.242+0000 7f253bda0640 1 -- start start 2024-09-21T06:33:38.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.242+0000 7f253bda0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25341049b0 0x7f253419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.242+0000 7f253bda0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2534105300 0x7f253419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.242+0000 7f253bda0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f253410de10 0x7f253419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.242+0000 7f253bda0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2534113a70 con 0x7f25341049b0 2024-09-21T06:33:38.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.242+0000 7f253bda0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f25341138f0 con 0x7f253410de10 2024-09-21T06:33:38.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.242+0000 7f253bda0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2534113bf0 con 0x7f2534105300 2024-09-21T06:33:38.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.242+0000 7f2539b3c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25341049b0 0x7f253419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.242+0000 7f2539b3c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25341049b0 0x7f253419a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38592/0 (socket says 172.21.15.63:38592) 2024-09-21T06:33:38.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.242+0000 7f2539b3c640 1 -- 172.21.15.63:0/2059545529 learned_addr learned my addr 172.21.15.63:0/2059545529 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:38.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.242+0000 7f253933b640 1 --2- 172.21.15.63:0/2059545529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2534105300 0x7f253419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.243+0000 7f253a33d640 1 --2- 172.21.15.63:0/2059545529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f253410de10 0x7f253419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.243+0000 7f2539b3c640 1 -- 172.21.15.63:0/2059545529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2534105300 msgr2=0x7f253419aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:38.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.243+0000 7f2539b3c640 1 --2- 172.21.15.63:0/2059545529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2534105300 0x7f253419aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.243+0000 7f2539b3c640 1 -- 172.21.15.63:0/2059545529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f253410de10 msgr2=0x7f253419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:38.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.243+0000 7f2539b3c640 1 --2- 172.21.15.63:0/2059545529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f253410de10 0x7f253419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.243+0000 7f2539b3c640 1 -- 172.21.15.63:0/2059545529 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25341a0350 con 0x7f25341049b0 2024-09-21T06:33:38.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.243+0000 7f2539b3c640 1 --2- 172.21.15.63:0/2059545529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25341049b0 0x7f253419a4a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f253000d770 tx=0x7f253000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:38.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.243+0000 7f252affd640 1 -- 172.21.15.63:0/2059545529 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530017070 con 0x7f25341049b0 2024-09-21T06:33:38.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.243+0000 7f253bda0640 1 -- 172.21.15.63:0/2059545529 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25341a0640 con 0x7f25341049b0 2024-09-21T06:33:38.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.243+0000 7f252affd640 1 -- 172.21.15.63:0/2059545529 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2530009c30 con 0x7f25341049b0 2024-09-21T06:33:38.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.243+0000 7f252affd640 1 -- 172.21.15.63:0/2059545529 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530003cc0 con 0x7f25341049b0 2024-09-21T06:33:38.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.243+0000 7f253bda0640 1 -- 172.21.15.63:0/2059545529 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25341a6e60 con 0x7f25341049b0 2024-09-21T06:33:38.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.246+0000 7f2542314740 1 Processor -- start 2024-09-21T06:33:38.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.246+0000 7f2542314740 1 -- start start 2024-09-21T06:33:38.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.246+0000 7f2542314740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f3e070 0x55fcb62e5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.246+0000 7f2542314740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fcb5f151b0 0x55fcb62e57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.246+0000 7f2542314740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f1d390 0x55fcb62e5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.247+0000 7f2542314740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55fcb625be50 con 0x55fcb5f1d390 2024-09-21T06:33:38.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.247+0000 7f2542314740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55fcb624b280 con 0x55fcb5f151b0 2024-09-21T06:33:38.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.247+0000 7f2542314740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fcb624f090 con 0x55fcb5f3e070 2024-09-21T06:33:38.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.247+0000 7f253933b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f1d390 0x55fcb62e5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.247+0000 7f253933b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f1d390 0x55fcb62e5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38600/0 (socket says 172.21.15.63:38600) 2024-09-21T06:33:38.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.247+0000 7f253933b640 1 -- 172.21.15.63:0/1135303394 learned_addr learned my addr 172.21.15.63:0/1135303394 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:38.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.247+0000 7f253a33d640 1 --2- 172.21.15.63:0/1135303394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f3e070 0x55fcb62e5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.247+0000 7f253933b640 1 -- 172.21.15.63:0/1135303394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f3e070 msgr2=0x55fcb62e5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:38.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.247+0000 7f253933b640 1 --2- 172.21.15.63:0/1135303394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f3e070 0x55fcb62e5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.247+0000 7f253933b640 1 -- 172.21.15.63:0/1135303394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fcb5f151b0 msgr2=0x55fcb62e57b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:33:38.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.247+0000 7f253933b640 1 --2- 172.21.15.63:0/1135303394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fcb5f151b0 0x55fcb62e57b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.247+0000 7f253933b640 1 -- 172.21.15.63:0/1135303394 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcb5fa9650 con 0x55fcb5f1d390 2024-09-21T06:33:38.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.247+0000 7f253933b640 1 --2- 172.21.15.63:0/1135303394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f1d390 0x55fcb62e5cf0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2524009900 tx=0x7f2524000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933afc9dbe54423d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:38.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.248+0000 7f251ffff640 1 -- 172.21.15.63:0/1135303394 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2524040070 con 0x55fcb5f1d390 2024-09-21T06:33:38.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.248+0000 7f251ffff640 1 -- 172.21.15.63:0/1135303394 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2524005db0 con 0x55fcb5f1d390 2024-09-21T06:33:38.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.248+0000 7f251ffff640 1 -- 172.21.15.63:0/1135303394 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2524035040 con 0x55fcb5f1d390 2024-09-21T06:33:38.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.248+0000 7f252affd640 1 -- 172.21.15.63:0/2059545529 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f2530003e60 con 0x7f25341049b0 2024-09-21T06:33:38.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.248+0000 7f252affd640 1 --2- 172.21.15.63:0/2059545529 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f25200b66b0 0x7f25200b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.248+0000 7f2542314740 1 -- 172.21.15.63:0/1135303394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f1d390 msgr2=0x55fcb62e5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:38.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.248+0000 7f2542314740 1 --2- 172.21.15.63:0/1135303394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f1d390 0x55fcb62e5cf0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2524009900 tx=0x7f2524000bc0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.249+0000 7f252affd640 1 -- 172.21.15.63:0/2059545529 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f25300e70d0 con 0x7f25341049b0 2024-09-21T06:33:38.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.249+0000 7f253a33d640 1 --2- 172.21.15.63:0/2059545529 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f25200b66b0 0x7f25200b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.249+0000 7f2542314740 1 -- 172.21.15.63:0/1135303394 shutdown_connections 2024-09-21T06:33:38.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.249+0000 7f2542314740 1 --2- 172.21.15.63:0/1135303394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f1d390 0x55fcb62e5cf0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.249+0000 7f2542314740 1 --2- 172.21.15.63:0/1135303394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fcb5f151b0 0x55fcb62e57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.249+0000 7f2542314740 1 --2- 172.21.15.63:0/1135303394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f3e070 0x55fcb62e5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.249+0000 7f2542314740 1 -- 172.21.15.63:0/1135303394 >> 172.21.15.63:0/1135303394 conn(0x55fcb5f32460 msgr2=0x55fcb62e3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:38.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.249+0000 7f2542314740 1 -- 172.21.15.63:0/1135303394 shutdown_connections 2024-09-21T06:33:38.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.249+0000 7f2542314740 1 -- 172.21.15.63:0/1135303394 wait complete. 2024-09-21T06:33:38.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.249+0000 7f253a33d640 1 --2- 172.21.15.63:0/2059545529 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f25200b66b0 0x7f25200b8bc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f252c007e90 tx=0x7f252c007680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:38.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.249+0000 7f2542314740 1 -- start start 2024-09-21T06:33:38.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.250+0000 7f2542314740 1 Processor -- start 2024-09-21T06:33:38.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.250+0000 7f2542314740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f151b0 0x55fcb62f0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.250+0000 7f2542314740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f1d390 0x55fcb62f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.250+0000 7f2542314740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fcb5f3e070 0x55fcb62fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.250+0000 7f2542314740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55fcb60ac700 con 0x55fcb5f151b0 2024-09-21T06:33:38.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.250+0000 7f2542314740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55fcb61e6110 con 0x55fcb5f3e070 2024-09-21T06:33:38.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.250+0000 7f2542314740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fcb62f39f0 con 0x55fcb5f1d390 2024-09-21T06:33:38.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.250+0000 7f253933b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f1d390 0x55fcb62f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.250+0000 7f253933b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f1d390 0x55fcb62f0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:38688/0 (socket says 172.21.15.63:38688) 2024-09-21T06:33:38.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.250+0000 7f2539b3c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f151b0 0x55fcb62f0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.250+0000 7f253933b640 1 -- 172.21.15.63:0/3542136988 learned_addr learned my addr 172.21.15.63:0/3542136988 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:38.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.250+0000 7f2542314740 10 client.0 _ll_register_callbacks cb 0x55fcb61ff990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:38.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.251+0000 7f253a33d640 1 --2- 172.21.15.63:0/3542136988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fcb5f3e070 0x55fcb62fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.251+0000 7f253933b640 1 -- 172.21.15.63:0/3542136988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fcb5f3e070 msgr2=0x55fcb62fcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:38.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.251+0000 7f253933b640 1 --2- 172.21.15.63:0/3542136988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fcb5f3e070 0x55fcb62fcd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.251+0000 7f253933b640 1 -- 172.21.15.63:0/3542136988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f151b0 msgr2=0x55fcb62f0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:38.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.251+0000 7f253933b640 1 --2- 172.21.15.63:0/3542136988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f151b0 0x55fcb62f0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.251+0000 7f253933b640 1 -- 172.21.15.63:0/3542136988 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcb6213c40 con 0x55fcb5f1d390 2024-09-21T06:33:38.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.251+0000 7f2539b3c640 1 --2- 172.21.15.63:0/3542136988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f151b0 0x55fcb62f0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:33:38.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.251+0000 7f253933b640 1 --2- 172.21.15.63:0/3542136988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f1d390 0x55fcb62f0e60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f25240052f0 tx=0x7f2524031a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8d2ea79faf793c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:38.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.251+0000 7f251d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:33:38.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.252+0000 7f251d7fa640 1 -- 172.21.15.63:0/3542136988 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252404c060 con 0x55fcb5f1d390 2024-09-21T06:33:38.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.252+0000 7f2542314740 1 -- 172.21.15.63:0/3542136988 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2524005db0 con 0x55fcb5f1d390 2024-09-21T06:33:38.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.252+0000 7f251d7fa640 1 -- 172.21.15.63:0/3542136988 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f25240314a0 con 0x55fcb5f1d390 2024-09-21T06:33:38.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.252+0000 7f251d7fa640 1 -- 172.21.15.63:0/3542136988 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f2524035030 con 0x55fcb5f1d390 2024-09-21T06:33:38.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.252+0000 7f2542314740 10 client.26290 fetch_fsmap learned FSMap version 49 2024-09-21T06:33:38.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.252+0000 7f2542314740 1 -- 172.21.15.63:0/3542136988 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55fcb62feaa0 con 0x55fcb5f1d390 2024-09-21T06:33:38.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.252+0000 7f251d7fa640 1 -- 172.21.15.63:0/3542136988 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2524005db0 con 0x55fcb5f1d390 2024-09-21T06:33:38.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.252+0000 7f251d7fa640 1 -- 172.21.15.63:0/3542136988 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 49) ==== 8410+0+0 (secure 0 0 0) 0x7f2524004cc0 con 0x55fcb5f1d390 2024-09-21T06:33:38.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.253+0000 7f2542314740 10 client.26290 fetch_fsmap finished waiting for FSMap version 49 2024-09-21T06:33:38.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.253+0000 7f2542314740 10 client.26290 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:33:38.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.253+0000 7f2542314740 20 client.26290 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:38.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.253+0000 7f2542314740 1 --2- 172.21.15.63:0/3542136988 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55fcb5efc9f0 0x55fcb62ffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.253+0000 7f2542314740 4 client.26290 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:33:38.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.253+0000 7f2542314740 1 -- 172.21.15.63:0/3542136988 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcb625dda0 con 0x55fcb5efc9f0 2024-09-21T06:33:38.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.253+0000 7f2539b3c640 1 --2- 172.21.15.63:0/3542136988 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55fcb5efc9f0 0x55fcb62ffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.254+0000 7f2539b3c640 1 --2- 172.21.15.63:0/3542136988 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55fcb5efc9f0 0x55fcb62ffeb0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80b175180239707d server_cookie=940a610c1aabd69 in_seq=0 out_seq=0 2024-09-21T06:33:38.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.254+0000 7f251d7fa640 10 client.26290 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:38.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.254+0000 7f251d7fa640 1 -- 172.21.15.63:0/3542136988 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fcb625dda0 con 0x55fcb5efc9f0 2024-09-21T06:33:38.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.254+0000 7f251d7fa640 10 client.26290 handle_command_reply: tid=0 2024-09-21T06:33:38.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.254+0000 7f2542314740 1 client.26290 shutdown 2024-09-21T06:33:38.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.254+0000 7f2542314740 1 -- 172.21.15.63:0/3542136988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f1d390 msgr2=0x55fcb62f0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:38.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.254+0000 7f2542314740 1 --2- 172.21.15.63:0/3542136988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f1d390 0x55fcb62f0e60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f25240052f0 tx=0x7f2524031a50 comp rx=0 tx=0).stop 2024-09-21T06:33:38.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.255+0000 7f2542314740 1 -- 172.21.15.63:0/3542136988 shutdown_connections 2024-09-21T06:33:38.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.255+0000 7f2542314740 1 --2- 172.21.15.63:0/3542136988 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55fcb5efc9f0 0x55fcb62ffeb0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.255+0000 7f2542314740 1 --2- 172.21.15.63:0/3542136988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fcb5f3e070 0x55fcb62fcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.255+0000 7f2542314740 1 --2- 172.21.15.63:0/3542136988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f1d390 0x55fcb62f0e60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.255+0000 7f251d7fa640 0 client.26290 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:38.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.255+0000 7f2542314740 1 --2- 172.21.15.63:0/3542136988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f151b0 0x55fcb62f0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.255+0000 7f2542314740 1 -- 172.21.15.63:0/3542136988 >> 172.21.15.63:0/3542136988 conn(0x55fcb5f32460 msgr2=0x55fcb62e8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:38.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.255+0000 7f2542314740 1 -- 172.21.15.63:0/3542136988 shutdown_connections 2024-09-21T06:33:38.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.255+0000 7f2542314740 1 -- 172.21.15.63:0/3542136988 wait complete. 2024-09-21T06:33:38.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.255+0000 7f2542314740 20 client.26290 trim_cache size 0 max 16384 2024-09-21T06:33:38.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.272+0000 7f2542314740 1 Processor -- start 2024-09-21T06:33:38.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.272+0000 7f2542314740 1 -- start start 2024-09-21T06:33:38.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.273+0000 7f2542314740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f151b0 0x55fcb62f2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.273+0000 7f2542314740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fcb5f1d390 0x55fcb6300ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.273+0000 7f2542314740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f3e070 0x55fcb6301400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.273+0000 7f2542314740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f25341ad440 con 0x55fcb5f151b0 2024-09-21T06:33:38.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.273+0000 7f2542314740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f25341af100 con 0x55fcb5f1d390 2024-09-21T06:33:38.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.273+0000 7f2542314740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f25341adbd0 con 0x55fcb5f3e070 2024-09-21T06:33:38.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.273+0000 7f2539b3c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f151b0 0x55fcb62f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.273+0000 7f2539b3c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f151b0 0x55fcb62f2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38614/0 (socket says 172.21.15.63:38614) 2024-09-21T06:33:38.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.273+0000 7f2539b3c640 1 -- 172.21.15.63:0/2129052620 learned_addr learned my addr 172.21.15.63:0/2129052620 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:38.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.273+0000 7f253a33d640 1 --2- 172.21.15.63:0/2129052620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f3e070 0x55fcb6301400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.273+0000 7f253933b640 1 --2- 172.21.15.63:0/2129052620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fcb5f1d390 0x55fcb6300ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.273+0000 7f2539b3c640 1 -- 172.21.15.63:0/2129052620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f3e070 msgr2=0x55fcb6301400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:38.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.273+0000 7f2539b3c640 1 --2- 172.21.15.63:0/2129052620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f3e070 0x55fcb6301400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.273+0000 7f2539b3c640 1 -- 172.21.15.63:0/2129052620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fcb5f1d390 msgr2=0x55fcb6300ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:38.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.273+0000 7f2539b3c640 1 --2- 172.21.15.63:0/2129052620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fcb5f1d390 0x55fcb6300ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.273+0000 7f2539b3c640 1 -- 172.21.15.63:0/2129052620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcb62eee20 con 0x55fcb5f151b0 2024-09-21T06:33:38.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.273+0000 7f2539b3c640 1 --2- 172.21.15.63:0/2129052620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f151b0 0x55fcb62f2550 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f25300aa170 tx=0x7f25300045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c52f9e5cddd076fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:38.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.274+0000 7f251f7fe640 1 -- 172.21.15.63:0/2129052620 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530020040 con 0x55fcb5f151b0 2024-09-21T06:33:38.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.274+0000 7f251f7fe640 1 -- 172.21.15.63:0/2129052620 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25300ad600 con 0x55fcb5f151b0 2024-09-21T06:33:38.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.274+0000 7f251f7fe640 1 -- 172.21.15.63:0/2129052620 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530094340 con 0x55fcb5f151b0 2024-09-21T06:33:38.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.274+0000 7f2542314740 1 -- 172.21.15.63:0/2129052620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f151b0 msgr2=0x55fcb62f2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:38.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.274+0000 7f2542314740 1 --2- 172.21.15.63:0/2129052620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f151b0 0x55fcb62f2550 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f25300aa170 tx=0x7f25300045d0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.275+0000 7f2542314740 1 -- 172.21.15.63:0/2129052620 shutdown_connections 2024-09-21T06:33:38.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.275+0000 7f2542314740 1 --2- 172.21.15.63:0/2129052620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f3e070 0x55fcb6301400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.275+0000 7f2542314740 1 --2- 172.21.15.63:0/2129052620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fcb5f1d390 0x55fcb6300ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.275+0000 7f2542314740 1 --2- 172.21.15.63:0/2129052620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f151b0 0x55fcb62f2550 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.275+0000 7f2542314740 1 -- 172.21.15.63:0/2129052620 >> 172.21.15.63:0/2129052620 conn(0x55fcb5f32460 msgr2=0x55fcb62f1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:38.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.275+0000 7f2542314740 1 -- 172.21.15.63:0/2129052620 shutdown_connections 2024-09-21T06:33:38.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.275+0000 7f2542314740 1 -- 172.21.15.63:0/2129052620 wait complete. 2024-09-21T06:33:38.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.275+0000 7f2542314740 1 -- start start 2024-09-21T06:33:38.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.275+0000 7f2542314740 1 Processor -- start 2024-09-21T06:33:38.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.276+0000 7f2542314740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f151b0 0x55fcb6309c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.276+0000 7f2542314740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f1d390 0x55fcb63040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.276+0000 7f2542314740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fcb5f3e070 0x55fcb6304750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.276+0000 7f2542314740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f25341aea30 con 0x55fcb5f1d390 2024-09-21T06:33:38.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.276+0000 7f2542314740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f25341ae330 con 0x55fcb5f3e070 2024-09-21T06:33:38.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.276+0000 7f2542314740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f25341ab420 con 0x55fcb5f151b0 2024-09-21T06:33:38.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.276+0000 7f2542314740 10 client.0 _ll_register_callbacks cb 0x7f252c007520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:38.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.276+0000 7f253933b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f1d390 0x55fcb63040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.276+0000 7f253933b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f1d390 0x55fcb63040b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38626/0 (socket says 172.21.15.63:38626) 2024-09-21T06:33:38.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.276+0000 7f253933b640 1 -- 172.21.15.63:0/1282061535 learned_addr learned my addr 172.21.15.63:0/1282061535 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:38.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.276+0000 7f2539b3c640 1 --2- 172.21.15.63:0/1282061535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f151b0 0x55fcb6309c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.276+0000 7f253a33d640 1 --2- 172.21.15.63:0/1282061535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fcb5f3e070 0x55fcb6304750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.276+0000 7f253933b640 1 -- 172.21.15.63:0/1282061535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f151b0 msgr2=0x55fcb6309c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:38.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.276+0000 7f253933b640 1 --2- 172.21.15.63:0/1282061535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f151b0 0x55fcb6309c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.276+0000 7f253933b640 1 -- 172.21.15.63:0/1282061535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fcb5f3e070 msgr2=0x55fcb6304750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:38.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.276+0000 7f253933b640 1 --2- 172.21.15.63:0/1282061535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fcb5f3e070 0x55fcb6304750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.276+0000 7f253933b640 1 -- 172.21.15.63:0/1282061535 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcb6304ec0 con 0x55fcb5f1d390 2024-09-21T06:33:38.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.276+0000 7f253a33d640 1 --2- 172.21.15.63:0/1282061535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fcb5f3e070 0x55fcb6304750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:33:38.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.276+0000 7f2539b3c640 1 --2- 172.21.15.63:0/1282061535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f151b0 0x55fcb6309c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:33:38.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.277+0000 7f253933b640 1 --2- 172.21.15.63:0/1282061535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f1d390 0x55fcb63040b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f2524009900 tx=0x7f2524005320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a3da75242da62 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:38.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.277+0000 7f251d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:33:38.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.277+0000 7f251d7fa640 1 -- 172.21.15.63:0/1282061535 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252405f060 con 0x55fcb5f1d390 2024-09-21T06:33:38.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.277+0000 7f2542314740 1 -- 172.21.15.63:0/1282061535 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25300ad600 con 0x55fcb5f1d390 2024-09-21T06:33:38.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.277+0000 7f251d7fa640 1 -- 172.21.15.63:0/1282061535 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f25240048c0 con 0x55fcb5f1d390 2024-09-21T06:33:38.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.277+0000 7f251d7fa640 1 -- 172.21.15.63:0/1282061535 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f252404c040 con 0x55fcb5f1d390 2024-09-21T06:33:38.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.277+0000 7f2542314740 10 client.16593 fetch_fsmap learned FSMap version 49 2024-09-21T06:33:38.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.277+0000 7f2542314740 1 -- 172.21.15.63:0/1282061535 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55fcb636d590 con 0x55fcb5f1d390 2024-09-21T06:33:38.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.277+0000 7f251d7fa640 1 -- 172.21.15.63:0/1282061535 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25300ad600 con 0x55fcb5f1d390 2024-09-21T06:33:38.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.277+0000 7f251d7fa640 1 -- 172.21.15.63:0/1282061535 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 49) ==== 8410+0+0 (secure 0 0 0) 0x7f2524003f00 con 0x55fcb5f1d390 2024-09-21T06:33:38.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.277+0000 7f2542314740 10 client.16593 fetch_fsmap finished waiting for FSMap version 49 2024-09-21T06:33:38.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.277+0000 7f2542314740 10 client.16593 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:33:38.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.277+0000 7f2542314740 20 client.16593 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:38.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.277+0000 7f2542314740 1 --2- 172.21.15.63:0/1282061535 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55fcb5ed1da0 0x55fcb636fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.278+0000 7f2542314740 4 client.16593 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:33:38.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.278+0000 7f2542314740 1 -- 172.21.15.63:0/1282061535 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fcb6259850 con 0x55fcb5ed1da0 2024-09-21T06:33:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.278+0000 7f2539b3c640 1 --2- 172.21.15.63:0/1282061535 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55fcb5ed1da0 0x55fcb636fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.278+0000 7f251d7fa640 10 client.16593 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.278+0000 7f2539b3c640 1 --2- 172.21.15.63:0/1282061535 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55fcb5ed1da0 0x55fcb636fdb0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2588bd15524910de server_cookie=7bb96bdaa5cc0576 in_seq=0 out_seq=0 2024-09-21T06:33:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.279+0000 7f251d7fa640 1 -- 172.21.15.63:0/1282061535 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x55fcb6259850 con 0x55fcb5ed1da0 2024-09-21T06:33:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.279+0000 7f251d7fa640 10 client.16593 handle_command_reply: tid=0 2024-09-21T06:33:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.279+0000 7f2542314740 1 client.16593 shutdown 2024-09-21T06:33:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.279+0000 7f2542314740 1 -- 172.21.15.63:0/1282061535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f1d390 msgr2=0x55fcb63040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.279+0000 7f2542314740 1 --2- 172.21.15.63:0/1282061535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f1d390 0x55fcb63040b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f2524009900 tx=0x7f2524005320 comp rx=0 tx=0).stop 2024-09-21T06:33:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.279+0000 7f2542314740 1 -- 172.21.15.63:0/1282061535 shutdown_connections 2024-09-21T06:33:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.279+0000 7f2542314740 1 --2- 172.21.15.63:0/1282061535 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55fcb5ed1da0 0x55fcb636fdb0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.279+0000 7f2542314740 1 --2- 172.21.15.63:0/1282061535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fcb5f3e070 0x55fcb6304750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.279+0000 7f2542314740 1 --2- 172.21.15.63:0/1282061535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fcb5f1d390 0x55fcb63040b0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.279+0000 7f251d7fa640 0 client.16593 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.279+0000 7f2542314740 1 --2- 172.21.15.63:0/1282061535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcb5f151b0 0x55fcb6309c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.279+0000 7f2542314740 1 -- 172.21.15.63:0/1282061535 >> 172.21.15.63:0/1282061535 conn(0x55fcb5f32460 msgr2=0x55fcb62f0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:38.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.279+0000 7f2542314740 1 -- 172.21.15.63:0/1282061535 shutdown_connections 2024-09-21T06:33:38.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.279+0000 7f2542314740 1 -- 172.21.15.63:0/1282061535 wait complete. 2024-09-21T06:33:38.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.279+0000 7f2542314740 20 client.16593 trim_cache size 0 max 16384 2024-09-21T06:33:38.288 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:33:38.288 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "no active scrubs running", 2024-09-21T06:33:38.288 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": {}, 2024-09-21T06:33:38.288 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:33:38.288 INFO:teuthology.orchestra.run.smithi063.stdout: "5396028b-35f4-48fe-b54d-385784e97de3": { 2024-09-21T06:33:38.288 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:04.523378+0000", 2024-09-21T06:33:38.289 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:33:38.289 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:33:38.289 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:33:38.289 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:33:38.289 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:33:38.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:33:38.289 INFO:teuthology.orchestra.run.smithi063.stdout: "024d3c59-0b67-49a9-bf4a-e02d36691942": { 2024-09-21T06:33:38.289 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:32:14.282244+0000", 2024-09-21T06:33:38.289 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:33:38.289 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:33:38.289 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:33:38.289 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:33:38.289 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:33:38.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:33:38.290 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:33:38.290 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:31:27.507051+0000", 2024-09-21T06:33:38.290 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:33:38.290 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:33:38.290 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:33:38.290 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:33:38.290 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:33:38.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:33:38.290 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:33:38.290 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:33:38.290 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:33:38.290 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:33:38.290 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:33:38.291 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:33:38.291 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:33:38.291 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:33:38.291 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:33:38.291 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:33:38.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.280+0000 7f253bda0640 1 -- 172.21.15.63:0/2059545529 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f25200b66b0 msgr2=0x7f25200b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:38.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.280+0000 7f253bda0640 1 --2- 172.21.15.63:0/2059545529 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f25200b66b0 0x7f25200b8bc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f252c007e90 tx=0x7f252c007680 comp rx=0 tx=0).stop 2024-09-21T06:33:38.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.280+0000 7f253bda0640 1 -- 172.21.15.63:0/2059545529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25341049b0 msgr2=0x7f253419a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:38.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.280+0000 7f253bda0640 1 --2- 172.21.15.63:0/2059545529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25341049b0 0x7f253419a4a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f253000d770 tx=0x7f253000dc30 comp rx=0 tx=0).stop 2024-09-21T06:33:38.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.280+0000 7f253bda0640 1 -- 172.21.15.63:0/2059545529 shutdown_connections 2024-09-21T06:33:38.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.280+0000 7f253bda0640 1 --2- 172.21.15.63:0/2059545529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f253410de10 0x7f253419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.280+0000 7f253bda0640 1 --2- 172.21.15.63:0/2059545529 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f25200b66b0 0x7f25200b8bc0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.280+0000 7f253bda0640 1 --2- 172.21.15.63:0/2059545529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2534105300 0x7f253419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.280+0000 7f253bda0640 1 --2- 172.21.15.63:0/2059545529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25341049b0 0x7f253419a4a0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.280+0000 7f253bda0640 1 -- 172.21.15.63:0/2059545529 >> 172.21.15.63:0/2059545529 conn(0x7f2534079730 msgr2=0x7f2534100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:38.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.280+0000 7f253bda0640 1 -- 172.21.15.63:0/2059545529 shutdown_connections 2024-09-21T06:33:38.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:38.280+0000 7f253bda0640 1 -- 172.21.15.63:0/2059545529 wait complete. 2024-09-21T06:33:39.281 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:33:39.282 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:33:39.541 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:39.932 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:39 smithi063 ceph-mon[31150]: pgmap v486: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 978 KiB/s wr, 233 op/s 2024-09-21T06:33:39.932 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:39 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:40.022 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:39 smithi071 ceph-mon[34844]: pgmap v486: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 978 KiB/s wr, 233 op/s 2024-09-21T06:33:40.022 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:39 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:40.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.023+0000 7f1150ee9640 1 -- 172.21.15.63:0/3861041079 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f114c108d10 msgr2=0x7f114c10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:40.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.023+0000 7f1150ee9640 1 --2- 172.21.15.63:0/3861041079 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f114c108d10 0x7f114c10f540 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1144009ca0 tx=0x7f114402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:33:40.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.023+0000 7f1150ee9640 1 -- 172.21.15.63:0/3861041079 shutdown_connections 2024-09-21T06:33:40.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.023+0000 7f1150ee9640 1 --2- 172.21.15.63:0/3861041079 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f114c108d10 0x7f114c10f540 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:40.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.023+0000 7f1150ee9640 1 --2- 172.21.15.63:0/3861041079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f114c1083c0 0x7f114c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:40.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.023+0000 7f1150ee9640 1 --2- 172.21.15.63:0/3861041079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f114c102a80 0x7f114c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:40.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.023+0000 7f1150ee9640 1 -- 172.21.15.63:0/3861041079 >> 172.21.15.63:0/3861041079 conn(0x7f114c079740 msgr2=0x7f114c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:40.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.023+0000 7f1150ee9640 1 -- 172.21.15.63:0/3861041079 shutdown_connections 2024-09-21T06:33:40.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.023+0000 7f1150ee9640 1 -- 172.21.15.63:0/3861041079 wait complete. 2024-09-21T06:33:40.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.024+0000 7f1150ee9640 1 Processor -- start 2024-09-21T06:33:40.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.024+0000 7f1150ee9640 1 -- start start 2024-09-21T06:33:40.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.024+0000 7f1150ee9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f114c102a80 0x7f114c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:40.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.024+0000 7f1150ee9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f114c1083c0 0x7f114c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:40.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.024+0000 7f1150ee9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f114c108d10 0x7f114c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:40.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.024+0000 7f1150ee9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f114c112980 con 0x7f114c108d10 2024-09-21T06:33:40.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.024+0000 7f1150ee9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f114c112800 con 0x7f114c102a80 2024-09-21T06:33:40.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.024+0000 7f1150ee9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f114c112b00 con 0x7f114c1083c0 2024-09-21T06:33:40.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.024+0000 7f114ad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f114c108d10 0x7f114c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:40.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.025+0000 7f114ad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f114c108d10 0x7f114c19fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38638/0 (socket says 172.21.15.63:38638) 2024-09-21T06:33:40.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.025+0000 7f114ad9d640 1 -- 172.21.15.63:0/513759220 learned_addr learned my addr 172.21.15.63:0/513759220 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:40.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.025+0000 7f1149d9b640 1 --2- 172.21.15.63:0/513759220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f114c1083c0 0x7f114c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:40.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.025+0000 7f114a59c640 1 --2- 172.21.15.63:0/513759220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f114c102a80 0x7f114c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:40.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.025+0000 7f114ad9d640 1 -- 172.21.15.63:0/513759220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f114c1083c0 msgr2=0x7f114c19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:40.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.025+0000 7f114ad9d640 1 --2- 172.21.15.63:0/513759220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f114c1083c0 0x7f114c19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:40.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.025+0000 7f114ad9d640 1 -- 172.21.15.63:0/513759220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f114c102a80 msgr2=0x7f114c19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:40.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.025+0000 7f114ad9d640 1 --2- 172.21.15.63:0/513759220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f114c102a80 0x7f114c19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:40.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.025+0000 7f114ad9d640 1 -- 172.21.15.63:0/513759220 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f114c1a03f0 con 0x7f114c108d10 2024-09-21T06:33:40.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.025+0000 7f114ad9d640 1 --2- 172.21.15.63:0/513759220 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f114c108d10 0x7f114c19fcc0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f1144005cc0 tx=0x7f114402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:40.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.025+0000 7f113b7fe640 1 -- 172.21.15.63:0/513759220 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1144003cf0 con 0x7f114c108d10 2024-09-21T06:33:40.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.025+0000 7f1150ee9640 1 -- 172.21.15.63:0/513759220 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f114c1a0680 con 0x7f114c108d10 2024-09-21T06:33:40.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.025+0000 7f113b7fe640 1 -- 172.21.15.63:0/513759220 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11440044f0 con 0x7f114c108d10 2024-09-21T06:33:40.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.025+0000 7f113b7fe640 1 -- 172.21.15.63:0/513759220 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114402fd10 con 0x7f114c108d10 2024-09-21T06:33:40.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.026+0000 7f1150ee9640 1 -- 172.21.15.63:0/513759220 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f114c1a6e40 con 0x7f114c108d10 2024-09-21T06:33:40.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.026+0000 7f1150ee9640 1 -- 172.21.15.63:0/513759220 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f114c103d00 con 0x7f114c108d10 2024-09-21T06:33:40.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.028+0000 7f113b7fe640 1 -- 172.21.15.63:0/513759220 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f1144004040 con 0x7f114c108d10 2024-09-21T06:33:40.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.029+0000 7f113b7fe640 1 --2- 172.21.15.63:0/513759220 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f11340b6680 0x7f11340b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:40.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.029+0000 7f113b7fe640 1 -- 172.21.15.63:0/513759220 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f1144108ec0 con 0x7f114c108d10 2024-09-21T06:33:40.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.029+0000 7f114a59c640 1 --2- 172.21.15.63:0/513759220 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f11340b6680 0x7f11340b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:40.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.029+0000 7f114a59c640 1 --2- 172.21.15.63:0/513759220 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f11340b6680 0x7f11340b8b90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f113c0058c0 tx=0x7f113c00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:40.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.032+0000 7f113b7fe640 1 -- 172.21.15.63:0/513759220 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f11440cf3f0 con 0x7f114c108d10 2024-09-21T06:33:40.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:39 smithi175 ceph-mon[34510]: pgmap v486: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 978 KiB/s wr, 233 op/s 2024-09-21T06:33:40.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:39 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:40.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.256+0000 7f1150ee9640 1 -- 172.21.15.63:0/513759220 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f114c19b5b0 con 0x7f114c108d10 2024-09-21T06:33:40.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.257+0000 7f113b7fe640 1 -- 172.21.15.63:0/513759220 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11988 (secure 0 0 0) 0x7f11440d37d0 con 0x7f114c108d10 2024-09-21T06:33:40.261 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:33:40.262 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":50,"btime":"2024-09-21T06:33:38:740762+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:33:38.126802+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24659,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":34,"state":"up:active","state_seq":69,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[1,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25637":{"gid":25637,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3354670524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3354670524},{"type":"v1","addr":"172.21.15.71:6839","nonce":3354670524}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24659,"qdb_cluster":[14835,24676,24659,24670,24694]},"id":1}]} 2024-09-21T06:33:40.262 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 50 2024-09-21T06:33:40.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.259+0000 7f1150ee9640 1 -- 172.21.15.63:0/513759220 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f11340b6680 msgr2=0x7f11340b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:40.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.259+0000 7f1150ee9640 1 --2- 172.21.15.63:0/513759220 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f11340b6680 0x7f11340b8b90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f113c0058c0 tx=0x7f113c00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:33:40.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.260+0000 7f1150ee9640 1 -- 172.21.15.63:0/513759220 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f114c108d10 msgr2=0x7f114c19fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:40.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.260+0000 7f1150ee9640 1 --2- 172.21.15.63:0/513759220 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f114c108d10 0x7f114c19fcc0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f1144005cc0 tx=0x7f114402f470 comp rx=0 tx=0).stop 2024-09-21T06:33:40.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.260+0000 7f1150ee9640 1 -- 172.21.15.63:0/513759220 shutdown_connections 2024-09-21T06:33:40.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.260+0000 7f1150ee9640 1 --2- 172.21.15.63:0/513759220 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f114c108d10 0x7f114c19fcc0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:40.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.260+0000 7f1150ee9640 1 --2- 172.21.15.63:0/513759220 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f11340b6680 0x7f11340b8b90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:40.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.260+0000 7f1150ee9640 1 --2- 172.21.15.63:0/513759220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f114c1083c0 0x7f114c19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:40.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.260+0000 7f1150ee9640 1 --2- 172.21.15.63:0/513759220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f114c102a80 0x7f114c19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:40.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.260+0000 7f1150ee9640 1 -- 172.21.15.63:0/513759220 >> 172.21.15.63:0/513759220 conn(0x7f114c079740 msgr2=0x7f114c06be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:40.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.260+0000 7f1150ee9640 1 -- 172.21.15.63:0/513759220 shutdown_connections 2024-09-21T06:33:40.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:40.260+0000 7f1150ee9640 1 -- 172.21.15.63:0/513759220 wait complete. 2024-09-21T06:33:40.930 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:40 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/513759220' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:33:40.962 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T06:33:41.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:40 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/513759220' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:33:41.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:40 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/513759220' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:33:41.226 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:41.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.715+0000 7f7e1f7fe640 1 -- 172.21.15.63:0/773604065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e18103b90 msgr2=0x7f7e18103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:41.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.715+0000 7f7e1f7fe640 1 --2- 172.21.15.63:0/773604065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e18103b90 0x7f7e18103fa0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009ca0 tx=0x7f7e0802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.715+0000 7f7e1f7fe640 1 -- 172.21.15.63:0/773604065 shutdown_connections 2024-09-21T06:33:41.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.715+0000 7f7e1f7fe640 1 --2- 172.21.15.63:0/773604065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e18109e20 0x7f7e18110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.715+0000 7f7e1f7fe640 1 --2- 172.21.15.63:0/773604065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e181094d0 0x7f7e181098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.715+0000 7f7e1f7fe640 1 --2- 172.21.15.63:0/773604065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e18103b90 0x7f7e18103fa0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.715+0000 7f7e1f7fe640 1 -- 172.21.15.63:0/773604065 >> 172.21.15.63:0/773604065 conn(0x7f7e180ff600 msgr2=0x7f7e18101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:41.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.716+0000 7f7e1f7fe640 1 -- 172.21.15.63:0/773604065 shutdown_connections 2024-09-21T06:33:41.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.716+0000 7f7e1f7fe640 1 -- 172.21.15.63:0/773604065 wait complete. 2024-09-21T06:33:41.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.716+0000 7f7e1f7fe640 1 Processor -- start 2024-09-21T06:33:41.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.716+0000 7f7e1f7fe640 1 -- start start 2024-09-21T06:33:41.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.716+0000 7f7e1f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e18103b90 0x7f7e18075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.716+0000 7f7e1f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e181094d0 0x7f7e18075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.717+0000 7f7e1f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e18109e20 0x7f7e18076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.717+0000 7f7e1f7fe640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7e18113ae0 con 0x7f7e181094d0 2024-09-21T06:33:41.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.717+0000 7f7e1f7fe640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7e18113960 con 0x7f7e18109e20 2024-09-21T06:33:41.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.717+0000 7f7e1f7fe640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7e18113c60 con 0x7f7e18103b90 2024-09-21T06:33:41.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.717+0000 7f7e1cd99640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e181094d0 0x7f7e18075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.717+0000 7f7e1cd99640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e181094d0 0x7f7e18075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38646/0 (socket says 172.21.15.63:38646) 2024-09-21T06:33:41.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.717+0000 7f7e1cd99640 1 -- 172.21.15.63:0/3213655974 learned_addr learned my addr 172.21.15.63:0/3213655974 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:41.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.717+0000 7f7e1d59a640 1 --2- 172.21.15.63:0/3213655974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e18103b90 0x7f7e18075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.717+0000 7f7e1dd9b640 1 --2- 172.21.15.63:0/3213655974 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e18109e20 0x7f7e18076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.717+0000 7f7e1cd99640 1 -- 172.21.15.63:0/3213655974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e18103b90 msgr2=0x7f7e18075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:41.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.717+0000 7f7e1cd99640 1 --2- 172.21.15.63:0/3213655974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e18103b90 0x7f7e18075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.717+0000 7f7e1cd99640 1 -- 172.21.15.63:0/3213655974 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e18109e20 msgr2=0x7f7e18076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:41.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.717+0000 7f7e1cd99640 1 --2- 172.21.15.63:0/3213655974 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e18109e20 0x7f7e18076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.717+0000 7f7e1cd99640 1 -- 172.21.15.63:0/3213655974 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e181a8770 con 0x7f7e181094d0 2024-09-21T06:33:41.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.717+0000 7f7e1cd99640 1 --2- 172.21.15.63:0/3213655974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e181094d0 0x7f7e18075c50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00e9f0 tx=0x7f7e0c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:41.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.717+0000 7f7e167fc640 1 -- 172.21.15.63:0/3213655974 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c00ccc0 con 0x7f7e181094d0 2024-09-21T06:33:41.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.718+0000 7f7e167fc640 1 -- 172.21.15.63:0/3213655974 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e0c0108e0 con 0x7f7e181094d0 2024-09-21T06:33:41.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.718+0000 7f7e1f7fe640 1 -- 172.21.15.63:0/3213655974 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e181a8a60 con 0x7f7e181094d0 2024-09-21T06:33:41.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.718+0000 7f7e167fc640 1 -- 172.21.15.63:0/3213655974 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c018860 con 0x7f7e181094d0 2024-09-21T06:33:41.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.718+0000 7f7e1f7fe640 1 -- 172.21.15.63:0/3213655974 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e181a8fa0 con 0x7f7e181094d0 2024-09-21T06:33:41.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.721+0000 7f7e25d72740 1 Processor -- start 2024-09-21T06:33:41.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.721+0000 7f7e25d72740 1 -- start start 2024-09-21T06:33:41.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.721+0000 7f7e167fc640 1 -- 172.21.15.63:0/3213655974 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f7e0c010430 con 0x7f7e181094d0 2024-09-21T06:33:41.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.721+0000 7f7e25d72740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d48070 0x55e3430ef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.721+0000 7f7e25d72740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 0x55e3430ef800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.721+0000 7f7e25d72740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d27390 0x55e3430efd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.721+0000 7f7e25d72740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55e343065ea0 con 0x55e342d1f1b0 2024-09-21T06:33:41.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.721+0000 7f7e25d72740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e3430552d0 con 0x55e342d48070 2024-09-21T06:33:41.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.721+0000 7f7e25d72740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e3430590e0 con 0x55e342d27390 2024-09-21T06:33:41.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.721+0000 7f7e1d59a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 0x55e3430ef800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.721+0000 7f7e1d59a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 0x55e3430ef800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38650/0 (socket says 172.21.15.63:38650) 2024-09-21T06:33:41.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.721+0000 7f7e1d59a640 1 -- 172.21.15.63:0/4072036590 learned_addr learned my addr 172.21.15.63:0/4072036590 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:41.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.721+0000 7f7e1dd9b640 1 --2- 172.21.15.63:0/4072036590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d48070 0x55e3430ef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.721+0000 7f7e1cd99640 1 --2- 172.21.15.63:0/4072036590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d27390 0x55e3430efd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.721+0000 7f7e1d59a640 1 -- 172.21.15.63:0/4072036590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d27390 msgr2=0x55e3430efd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:41.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.721+0000 7f7e1d59a640 1 --2- 172.21.15.63:0/4072036590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d27390 0x55e3430efd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.721+0000 7f7e1d59a640 1 -- 172.21.15.63:0/4072036590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d48070 msgr2=0x55e3430ef2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:41.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.721+0000 7f7e1d59a640 1 --2- 172.21.15.63:0/4072036590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d48070 0x55e3430ef2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.721+0000 7f7e1d59a640 1 -- 172.21.15.63:0/4072036590 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e342db3650 con 0x55e342d1f1b0 2024-09-21T06:33:41.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.721+0000 7f7e1dd9b640 1 --2- 172.21.15.63:0/4072036590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d48070 0x55e3430ef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:33:41.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.722+0000 7f7e167fc640 1 --2- 172.21.15.63:0/3213655974 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7e000b6680 0x7f7e000b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.722+0000 7f7e1d59a640 1 --2- 172.21.15.63:0/4072036590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 0x55e3430ef800 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009ca0 tx=0x7f7e08009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49c9b2818adbc23 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:41.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.722+0000 7f7e1dd9b640 1 --2- 172.21.15.63:0/3213655974 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7e000b6680 0x7f7e000b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.722+0000 7f7e167fc640 1 -- 172.21.15.63:0/3213655974 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f7e0c0e7a90 con 0x7f7e181094d0 2024-09-21T06:33:41.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.722+0000 7f7dff7fe640 1 -- 172.21.15.63:0/4072036590 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08031db0 con 0x55e342d1f1b0 2024-09-21T06:33:41.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.722+0000 7f7dff7fe640 1 -- 172.21.15.63:0/4072036590 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e08036030 con 0x55e342d1f1b0 2024-09-21T06:33:41.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.722+0000 7f7dff7fe640 1 -- 172.21.15.63:0/4072036590 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08004330 con 0x55e342d1f1b0 2024-09-21T06:33:41.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.723+0000 7f7e25d72740 1 -- 172.21.15.63:0/4072036590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 msgr2=0x55e3430ef800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:41.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.723+0000 7f7e1dd9b640 1 --2- 172.21.15.63:0/3213655974 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7e000b6680 0x7f7e000b8b90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000be70 tx=0x7f7e1000b450 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:41.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.723+0000 7f7e25d72740 1 --2- 172.21.15.63:0/4072036590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 0x55e3430ef800 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009ca0 tx=0x7f7e08009800 comp rx=0 tx=0).stop 2024-09-21T06:33:41.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.723+0000 7f7e25d72740 1 -- 172.21.15.63:0/4072036590 shutdown_connections 2024-09-21T06:33:41.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.723+0000 7f7e25d72740 1 --2- 172.21.15.63:0/4072036590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d27390 0x55e3430efd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.723+0000 7f7e25d72740 1 --2- 172.21.15.63:0/4072036590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 0x55e3430ef800 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.723+0000 7f7e25d72740 1 --2- 172.21.15.63:0/4072036590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d48070 0x55e3430ef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.723+0000 7f7e25d72740 1 -- 172.21.15.63:0/4072036590 >> 172.21.15.63:0/4072036590 conn(0x55e342d3c460 msgr2=0x55e3430ed1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:41.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.723+0000 7f7e25d72740 1 -- 172.21.15.63:0/4072036590 shutdown_connections 2024-09-21T06:33:41.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.723+0000 7f7e25d72740 1 -- 172.21.15.63:0/4072036590 wait complete. 2024-09-21T06:33:41.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.724+0000 7f7e25d72740 1 -- start start 2024-09-21T06:33:41.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.724+0000 7f7e25d72740 1 Processor -- start 2024-09-21T06:33:41.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.724+0000 7f7e25d72740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 0x55e3430fa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.724+0000 7f7e25d72740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d27390 0x55e3430faea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.724+0000 7f7e25d72740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d48070 0x55e3430fb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.724+0000 7f7e25d72740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55e342eb6700 con 0x55e342d1f1b0 2024-09-21T06:33:41.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.724+0000 7f7e25d72740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e342ff0160 con 0x55e342d27390 2024-09-21T06:33:41.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.724+0000 7f7e25d72740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e3430fd8c0 con 0x55e342d48070 2024-09-21T06:33:41.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.724+0000 7f7e1d59a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 0x55e3430fa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.724+0000 7f7e25d72740 10 client.0 _ll_register_callbacks cb 0x55e3430099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:41.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.724+0000 7f7e1d59a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 0x55e3430fa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38664/0 (socket says 172.21.15.63:38664) 2024-09-21T06:33:41.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.724+0000 7f7e1d59a640 1 -- 172.21.15.63:0/1190764932 learned_addr learned my addr 172.21.15.63:0/1190764932 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:41.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.725+0000 7f7e1dd9b640 1 --2- 172.21.15.63:0/1190764932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d48070 0x55e3430fb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.725+0000 7f7e1cd99640 1 --2- 172.21.15.63:0/1190764932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d27390 0x55e3430faea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.725+0000 7f7e1d59a640 1 -- 172.21.15.63:0/1190764932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d48070 msgr2=0x55e3430fb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:41.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.725+0000 7f7e1d59a640 1 --2- 172.21.15.63:0/1190764932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d48070 0x55e3430fb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.725+0000 7f7e1d59a640 1 -- 172.21.15.63:0/1190764932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d27390 msgr2=0x55e3430faea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:41.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.725+0000 7f7e1d59a640 1 --2- 172.21.15.63:0/1190764932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d27390 0x55e3430faea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.725+0000 7f7e1d59a640 1 -- 172.21.15.63:0/1190764932 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e34301dc90 con 0x55e342d1f1b0 2024-09-21T06:33:41.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.725+0000 7f7e1dd9b640 1 --2- 172.21.15.63:0/1190764932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d48070 0x55e3430fb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:33:41.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.725+0000 7f7e1d59a640 1 --2- 172.21.15.63:0/1190764932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 0x55e3430fa960 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7e080094e0 tx=0x7f7e080099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341931d6f3ca25e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:41.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.725+0000 7f7dfcff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:33:41.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.725+0000 7f7dfcff9640 1 -- 172.21.15.63:0/1190764932 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0804a040 con 0x55e342d1f1b0 2024-09-21T06:33:41.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.725+0000 7f7dfcff9640 1 -- 172.21.15.63:0/1190764932 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f7e08031650 con 0x55e342d1f1b0 2024-09-21T06:33:41.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.725+0000 7f7e25d72740 1 -- 172.21.15.63:0/1190764932 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e08036030 con 0x55e342d1f1b0 2024-09-21T06:33:41.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.725+0000 7f7dfcff9640 1 -- 172.21.15.63:0/1190764932 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f7e0805e050 con 0x55e342d1f1b0 2024-09-21T06:33:41.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.725+0000 7f7e25d72740 10 client.16611 fetch_fsmap learned FSMap version 50 2024-09-21T06:33:41.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.726+0000 7f7e25d72740 1 -- 172.21.15.63:0/1190764932 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55e3431095c0 con 0x55e342d1f1b0 2024-09-21T06:33:41.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.726+0000 7f7dfcff9640 1 -- 172.21.15.63:0/1190764932 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e08036030 con 0x55e342d1f1b0 2024-09-21T06:33:41.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.726+0000 7f7dfcff9640 1 -- 172.21.15.63:0/1190764932 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 50) ==== 8406+0+0 (secure 0 0 0) 0x7f7e0804d030 con 0x55e342d1f1b0 2024-09-21T06:33:41.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.726+0000 7f7e25d72740 10 client.16611 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T06:33:41.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.726+0000 7f7e25d72740 10 client.16611 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:33:41.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.726+0000 7f7e25d72740 20 client.16611 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:41.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.726+0000 7f7e25d72740 1 --2- 172.21.15.63:0/1190764932 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55e342d069f0 0x55e34310c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.726+0000 7f7e25d72740 4 client.16611 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:33:41.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.726+0000 7f7e25d72740 1 -- 172.21.15.63:0/1190764932 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e343067df0 con 0x55e342d069f0 2024-09-21T06:33:41.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.726+0000 7f7e1cd99640 1 --2- 172.21.15.63:0/1190764932 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55e342d069f0 0x55e34310c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.726+0000 7f7dfcff9640 10 client.16611 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:33:41.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.727+0000 7f7e1cd99640 1 --2- 172.21.15.63:0/1190764932 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55e342d069f0 0x55e34310c920 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4c9a0917772efc77 server_cookie=1d1d0e8dc8d93e90 in_seq=0 out_seq=0 2024-09-21T06:33:41.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.727+0000 7f7dfcff9640 1 -- 172.21.15.63:0/1190764932 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e343067df0 con 0x55e342d069f0 2024-09-21T06:33:41.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.727+0000 7f7dfcff9640 10 client.16611 handle_command_reply: tid=0 2024-09-21T06:33:41.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.727+0000 7f7e25d72740 1 client.16611 shutdown 2024-09-21T06:33:41.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.727+0000 7f7e25d72740 1 -- 172.21.15.63:0/1190764932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 msgr2=0x55e3430fa960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:41.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.727+0000 7f7e25d72740 1 --2- 172.21.15.63:0/1190764932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 0x55e3430fa960 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7e080094e0 tx=0x7f7e080099f0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.728+0000 7f7e25d72740 1 -- 172.21.15.63:0/1190764932 shutdown_connections 2024-09-21T06:33:41.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.728+0000 7f7e25d72740 1 --2- 172.21.15.63:0/1190764932 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55e342d069f0 0x55e34310c920 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.728+0000 7f7e25d72740 1 --2- 172.21.15.63:0/1190764932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d48070 0x55e3430fb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.728+0000 7f7e25d72740 1 --2- 172.21.15.63:0/1190764932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d27390 0x55e3430faea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.728+0000 7f7e25d72740 1 --2- 172.21.15.63:0/1190764932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 0x55e3430fa960 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.728+0000 7f7e25d72740 1 -- 172.21.15.63:0/1190764932 >> 172.21.15.63:0/1190764932 conn(0x55e342d3c460 msgr2=0x55e3430f2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:41.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.728+0000 7f7dfcff9640 0 client.16611 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:33:41.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.728+0000 7f7e25d72740 1 -- 172.21.15.63:0/1190764932 shutdown_connections 2024-09-21T06:33:41.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.728+0000 7f7e25d72740 1 -- 172.21.15.63:0/1190764932 wait complete. 2024-09-21T06:33:41.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.728+0000 7f7e25d72740 20 client.16611 trim_cache size 0 max 16384 2024-09-21T06:33:41.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.741+0000 7f7e25d72740 1 Processor -- start 2024-09-21T06:33:41.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.741+0000 7f7e25d72740 1 -- start start 2024-09-21T06:33:41.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.741+0000 7f7e25d72740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 0x55e3430fa710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.741+0000 7f7e25d72740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d27390 0x55e3430fac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.741+0000 7f7e25d72740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d48070 0x55e3430f7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.741+0000 7f7e25d72740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181b1890 con 0x55e342d1f1b0 2024-09-21T06:33:41.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.741+0000 7f7e25d72740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181b3520 con 0x55e342d48070 2024-09-21T06:33:41.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.741+0000 7f7e25d72740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181b1ff0 con 0x55e342d27390 2024-09-21T06:33:41.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.741+0000 7f7e1d59a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 0x55e3430fa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.741+0000 7f7e1d59a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 0x55e3430fa710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38676/0 (socket says 172.21.15.63:38676) 2024-09-21T06:33:41.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.741+0000 7f7e1d59a640 1 -- 172.21.15.63:0/1221434808 learned_addr learned my addr 172.21.15.63:0/1221434808 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:41.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.742+0000 7f7e1dd9b640 1 --2- 172.21.15.63:0/1221434808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d48070 0x55e3430f7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.742+0000 7f7e1cd99640 1 --2- 172.21.15.63:0/1221434808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d27390 0x55e3430fac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.742+0000 7f7e1d59a640 1 -- 172.21.15.63:0/1221434808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d27390 msgr2=0x55e3430fac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:41.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.742+0000 7f7e1d59a640 1 --2- 172.21.15.63:0/1221434808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d27390 0x55e3430fac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.742+0000 7f7e1d59a640 1 -- 172.21.15.63:0/1221434808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d48070 msgr2=0x55e3430f7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:41.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.742+0000 7f7e1d59a640 1 --2- 172.21.15.63:0/1221434808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d48070 0x55e3430f7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.742+0000 7f7e1d59a640 1 -- 172.21.15.63:0/1221434808 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3430fbc20 con 0x55e342d1f1b0 2024-09-21T06:33:41.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.742+0000 7f7e1cd99640 1 --2- 172.21.15.63:0/1221434808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d27390 0x55e3430fac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:33:41.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.742+0000 7f7e1d59a640 1 --2- 172.21.15.63:0/1221434808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 0x55e3430fa710 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009a60 tx=0x7f7e08009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176d8c56547b2e30 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:41.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.742+0000 7f7dfeffd640 1 -- 172.21.15.63:0/1221434808 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08003b80 con 0x55e342d1f1b0 2024-09-21T06:33:41.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.742+0000 7f7dfeffd640 1 -- 172.21.15.63:0/1221434808 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e08036070 con 0x55e342d1f1b0 2024-09-21T06:33:41.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.742+0000 7f7dfeffd640 1 -- 172.21.15.63:0/1221434808 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0802f910 con 0x55e342d1f1b0 2024-09-21T06:33:41.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.743+0000 7f7e25d72740 1 -- 172.21.15.63:0/1221434808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 msgr2=0x55e3430fa710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:41.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.743+0000 7f7e25d72740 1 --2- 172.21.15.63:0/1221434808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 0x55e3430fa710 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009a60 tx=0x7f7e08009540 comp rx=0 tx=0).stop 2024-09-21T06:33:41.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.743+0000 7f7e25d72740 1 -- 172.21.15.63:0/1221434808 shutdown_connections 2024-09-21T06:33:41.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.743+0000 7f7e25d72740 1 --2- 172.21.15.63:0/1221434808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d48070 0x55e3430f7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.743+0000 7f7e25d72740 1 --2- 172.21.15.63:0/1221434808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d27390 0x55e3430fac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.743+0000 7f7e25d72740 1 --2- 172.21.15.63:0/1221434808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d1f1b0 0x55e3430fa710 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.743+0000 7f7e25d72740 1 -- 172.21.15.63:0/1221434808 >> 172.21.15.63:0/1221434808 conn(0x55e342d3c460 msgr2=0x55e3430f91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:41.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.743+0000 7f7e25d72740 1 -- 172.21.15.63:0/1221434808 shutdown_connections 2024-09-21T06:33:41.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.743+0000 7f7e25d72740 1 -- 172.21.15.63:0/1221434808 wait complete. 2024-09-21T06:33:41.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.743+0000 7f7e25d72740 1 -- start start 2024-09-21T06:33:41.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.743+0000 7f7e25d72740 1 Processor -- start 2024-09-21T06:33:41.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.744+0000 7f7e25d72740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d1f1b0 0x55e3431033b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.744+0000 7f7e25d72740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d27390 0x55e3430fe900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.744+0000 7f7e25d72740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d48070 0x55e3430feea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.744+0000 7f7e25d72740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181b2e50 con 0x55e342d48070 2024-09-21T06:33:41.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.744+0000 7f7e25d72740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181b2750 con 0x55e342d1f1b0 2024-09-21T06:33:41.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.744+0000 7f7e25d72740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181af870 con 0x55e342d27390 2024-09-21T06:33:41.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.744+0000 7f7e25d72740 10 client.0 _ll_register_callbacks cb 0x7f7e10005f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:41.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.744+0000 7f7e1dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d48070 0x55e3430feea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.744+0000 7f7e1dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d48070 0x55e3430feea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38692/0 (socket says 172.21.15.63:38692) 2024-09-21T06:33:41.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.744+0000 7f7e1dd9b640 1 -- 172.21.15.63:0/654958292 learned_addr learned my addr 172.21.15.63:0/654958292 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:41.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.744+0000 7f7e1d59a640 1 --2- 172.21.15.63:0/654958292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d1f1b0 0x55e3431033b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.744+0000 7f7e1cd99640 1 --2- 172.21.15.63:0/654958292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d27390 0x55e3430fe900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.744+0000 7f7e1dd9b640 1 -- 172.21.15.63:0/654958292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d27390 msgr2=0x55e3430fe900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:41.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.744+0000 7f7e1dd9b640 1 --2- 172.21.15.63:0/654958292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d27390 0x55e3430fe900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.745+0000 7f7e1dd9b640 1 -- 172.21.15.63:0/654958292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d1f1b0 msgr2=0x55e3431033b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:41.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.745+0000 7f7e1dd9b640 1 --2- 172.21.15.63:0/654958292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d1f1b0 0x55e3431033b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.745+0000 7f7e1dd9b640 1 -- 172.21.15.63:0/654958292 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3430ff630 con 0x55e342d48070 2024-09-21T06:33:41.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.745+0000 7f7e1dd9b640 1 --2- 172.21.15.63:0/654958292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d48070 0x55e3430feea0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7e1001f940 tx=0x7f7e100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc3fd426543b0b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:41.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.745+0000 7f7dfcff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:33:41.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.745+0000 7f7dfcff9640 1 -- 172.21.15.63:0/654958292 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1001f020 con 0x55e342d48070 2024-09-21T06:33:41.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.745+0000 7f7dfcff9640 1 -- 172.21.15.63:0/654958292 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f7e1001f1c0 con 0x55e342d48070 2024-09-21T06:33:41.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.745+0000 7f7e25d72740 1 -- 172.21.15.63:0/654958292 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e08036070 con 0x55e342d48070 2024-09-21T06:33:41.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.745+0000 7f7dfcff9640 1 -- 172.21.15.63:0/654958292 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f7e10005020 con 0x55e342d48070 2024-09-21T06:33:41.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.745+0000 7f7e25d72740 10 client.16617 fetch_fsmap learned FSMap version 50 2024-09-21T06:33:41.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.745+0000 7f7e25d72740 1 -- 172.21.15.63:0/654958292 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55e3431770d0 con 0x55e342d48070 2024-09-21T06:33:41.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.745+0000 7f7dfcff9640 1 -- 172.21.15.63:0/654958292 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e08036070 con 0x55e342d48070 2024-09-21T06:33:41.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.746+0000 7f7dfcff9640 1 -- 172.21.15.63:0/654958292 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 50) ==== 8406+0+0 (secure 0 0 0) 0x7f7e10027070 con 0x55e342d48070 2024-09-21T06:33:41.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.746+0000 7f7e25d72740 10 client.16617 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T06:33:41.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.746+0000 7f7e25d72740 10 client.16617 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:33:41.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.746+0000 7f7e25d72740 20 client.16617 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:41.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.746+0000 7f7e25d72740 1 --2- 172.21.15.63:0/654958292 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55e342cdbda0 0x55e343179980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.746+0000 7f7e25d72740 4 client.16617 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:33:41.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.746+0000 7f7e25d72740 1 -- 172.21.15.63:0/654958292 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e3430638a0 con 0x55e342cdbda0 2024-09-21T06:33:41.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.746+0000 7f7e1d59a640 1 --2- 172.21.15.63:0/654958292 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55e342cdbda0 0x55e343179980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.746+0000 7f7dfcff9640 10 client.16617 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:33:41.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.746+0000 7f7e1d59a640 1 --2- 172.21.15.63:0/654958292 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55e342cdbda0 0x55e343179980 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6c5ad36acc7253ac server_cookie=6146268d8403396d in_seq=0 out_seq=0 2024-09-21T06:33:41.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.746+0000 7f7dfcff9640 1 -- 172.21.15.63:0/654958292 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e3430638a0 con 0x55e342cdbda0 2024-09-21T06:33:41.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.746+0000 7f7dfcff9640 10 client.16617 handle_command_reply: tid=0 2024-09-21T06:33:41.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.747+0000 7f7e25d72740 1 client.16617 shutdown 2024-09-21T06:33:41.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.747+0000 7f7e25d72740 1 -- 172.21.15.63:0/654958292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d48070 msgr2=0x55e3430feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:41.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.747+0000 7f7e25d72740 1 --2- 172.21.15.63:0/654958292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d48070 0x55e3430feea0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7e1001f940 tx=0x7f7e100046c0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.747+0000 7f7e25d72740 1 -- 172.21.15.63:0/654958292 shutdown_connections 2024-09-21T06:33:41.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.747+0000 7f7e25d72740 1 --2- 172.21.15.63:0/654958292 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55e342cdbda0 0x55e343179980 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.747+0000 7f7e25d72740 1 --2- 172.21.15.63:0/654958292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e342d48070 0x55e3430feea0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.747+0000 7f7e25d72740 1 --2- 172.21.15.63:0/654958292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e342d27390 0x55e3430fe900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.747+0000 7f7e25d72740 1 --2- 172.21.15.63:0/654958292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e342d1f1b0 0x55e3431033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.747+0000 7f7e25d72740 1 -- 172.21.15.63:0/654958292 >> 172.21.15.63:0/654958292 conn(0x55e342d3c460 msgr2=0x55e3430fa710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:41.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.747+0000 7f7dfcff9640 0 client.16617 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:33:41.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.747+0000 7f7e25d72740 1 -- 172.21.15.63:0/654958292 shutdown_connections 2024-09-21T06:33:41.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.747+0000 7f7e25d72740 1 -- 172.21.15.63:0/654958292 wait complete. 2024-09-21T06:33:41.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.747+0000 7f7e25d72740 20 client.16617 trim_cache size 0 max 16384 2024-09-21T06:33:41.757 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:33:41.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.747+0000 7f7e1f7fe640 1 -- 172.21.15.63:0/3213655974 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7e000b6680 msgr2=0x7f7e000b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:41.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.747+0000 7f7e1f7fe640 1 --2- 172.21.15.63:0/3213655974 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7e000b6680 0x7f7e000b8b90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000be70 tx=0x7f7e1000b450 comp rx=0 tx=0).stop 2024-09-21T06:33:41.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.747+0000 7f7e1f7fe640 1 -- 172.21.15.63:0/3213655974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e181094d0 msgr2=0x7f7e18075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:41.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.748+0000 7f7e1f7fe640 1 --2- 172.21.15.63:0/3213655974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e181094d0 0x7f7e18075c50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00e9f0 tx=0x7f7e0c00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.748+0000 7f7e1f7fe640 1 -- 172.21.15.63:0/3213655974 shutdown_connections 2024-09-21T06:33:41.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.748+0000 7f7e1f7fe640 1 --2- 172.21.15.63:0/3213655974 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e18109e20 0x7f7e18076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.748+0000 7f7e1f7fe640 1 --2- 172.21.15.63:0/3213655974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e181094d0 0x7f7e18075c50 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.748+0000 7f7e1f7fe640 1 --2- 172.21.15.63:0/3213655974 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7e000b6680 0x7f7e000b8b90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.748+0000 7f7e1f7fe640 1 --2- 172.21.15.63:0/3213655974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e18103b90 0x7f7e18075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.748+0000 7f7e1f7fe640 1 -- 172.21.15.63:0/3213655974 >> 172.21.15.63:0/3213655974 conn(0x7f7e180ff600 msgr2=0x7f7e18101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:41.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.748+0000 7f7e1f7fe640 1 -- 172.21.15.63:0/3213655974 shutdown_connections 2024-09-21T06:33:41.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:41.748+0000 7f7e1f7fe640 1 -- 172.21.15.63:0/3213655974 wait complete. 2024-09-21T06:33:42.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:41 smithi071 ceph-mon[34844]: pgmap v487: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 525 KiB/s wr, 137 op/s 2024-09-21T06:33:42.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:41 smithi063 ceph-mon[31150]: pgmap v487: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 525 KiB/s wr, 137 op/s 2024-09-21T06:33:42.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:41 smithi175 ceph-mon[34510]: pgmap v487: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 525 KiB/s wr, 137 op/s 2024-09-21T06:33:42.509 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:33:42.765 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:43.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.261+0000 7f69590e2640 1 -- 172.21.15.63:0/3139122516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69541083d0 msgr2=0x7f69541087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:43.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.261+0000 7f69590e2640 1 --2- 172.21.15.63:0/3139122516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69541083d0 0x7f69541087e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f693c009900 tx=0x7f693c02a410 comp rx=0 tx=0).stop 2024-09-21T06:33:43.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.261+0000 7f69590e2640 1 -- 172.21.15.63:0/3139122516 shutdown_connections 2024-09-21T06:33:43.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.261+0000 7f69590e2640 1 --2- 172.21.15.63:0/3139122516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6954108d20 0x7f695410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.261+0000 7f69590e2640 1 --2- 172.21.15.63:0/3139122516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69541083d0 0x7f69541087e0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.261+0000 7f69590e2640 1 --2- 172.21.15.63:0/3139122516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6954102ae0 0x7f6954102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.261+0000 7f69590e2640 1 -- 172.21.15.63:0/3139122516 >> 172.21.15.63:0/3139122516 conn(0x7f6954079760 msgr2=0x7f6954079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:43.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.261+0000 7f69590e2640 1 -- 172.21.15.63:0/3139122516 shutdown_connections 2024-09-21T06:33:43.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.261+0000 7f69590e2640 1 -- 172.21.15.63:0/3139122516 wait complete. 2024-09-21T06:33:43.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.262+0000 7f69590e2640 1 Processor -- start 2024-09-21T06:33:43.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.262+0000 7f69590e2640 1 -- start start 2024-09-21T06:33:43.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.262+0000 7f69590e2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6954102ae0 0x7f69540ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:43.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.262+0000 7f69590e2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69541083d0 0x7f69540ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:43.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.262+0000 7f69590e2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6954108d20 0x7f69541000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:43.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.262+0000 7f69590e2640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6954112990 con 0x7f69541083d0 2024-09-21T06:33:43.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.262+0000 7f69590e2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6954112810 con 0x7f6954108d20 2024-09-21T06:33:43.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.262+0000 7f69590e2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6954112b10 con 0x7f6954102ae0 2024-09-21T06:33:43.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.262+0000 7f694bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69541083d0 0x7f69540ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:43.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.262+0000 7f694bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69541083d0 0x7f69540ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38710/0 (socket says 172.21.15.63:38710) 2024-09-21T06:33:43.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.262+0000 7f694bfff640 1 -- 172.21.15.63:0/3437375518 learned_addr learned my addr 172.21.15.63:0/3437375518 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:43.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.263+0000 7f695359e640 1 --2- 172.21.15.63:0/3437375518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6954108d20 0x7f69541000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:43.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.263+0000 7f6952d9d640 1 --2- 172.21.15.63:0/3437375518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6954102ae0 0x7f69540ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:43.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.263+0000 7f694bfff640 1 -- 172.21.15.63:0/3437375518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6954102ae0 msgr2=0x7f69540ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:43.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.263+0000 7f694bfff640 1 --2- 172.21.15.63:0/3437375518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6954102ae0 0x7f69540ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.263+0000 7f694bfff640 1 -- 172.21.15.63:0/3437375518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6954108d20 msgr2=0x7f69541000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:43.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.263+0000 7f694bfff640 1 --2- 172.21.15.63:0/3437375518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6954108d20 0x7f69541000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.263+0000 7f694bfff640 1 -- 172.21.15.63:0/3437375518 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69541a8790 con 0x7f69541083d0 2024-09-21T06:33:43.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.263+0000 7f694bfff640 1 --2- 172.21.15.63:0/3437375518 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69541083d0 0x7f69540ffbb0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f693c032fd0 tx=0x7f693c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:43.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.263+0000 7f6950d99640 1 -- 172.21.15.63:0/3437375518 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c03f030 con 0x7f69541083d0 2024-09-21T06:33:43.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.263+0000 7f69590e2640 1 -- 172.21.15.63:0/3437375518 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69541a8a20 con 0x7f69541083d0 2024-09-21T06:33:43.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.263+0000 7f6950d99640 1 -- 172.21.15.63:0/3437375518 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f693c004490 con 0x7f69541083d0 2024-09-21T06:33:43.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.263+0000 7f6950d99640 1 -- 172.21.15.63:0/3437375518 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c035070 con 0x7f69541083d0 2024-09-21T06:33:43.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.263+0000 7f69590e2640 1 -- 172.21.15.63:0/3437375518 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69541a8f50 con 0x7f69541083d0 2024-09-21T06:33:43.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.266+0000 7f695f656740 1 Processor -- start 2024-09-21T06:33:43.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.266+0000 7f695f656740 1 -- start start 2024-09-21T06:33:43.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.266+0000 7f6950d99640 1 -- 172.21.15.63:0/3437375518 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f693c042030 con 0x7f69541083d0 2024-09-21T06:33:43.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.267+0000 7f695f656740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55806d23f070 0x55806d5e66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:43.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.267+0000 7f695f656740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d2161b0 0x55806d5e6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:43.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.267+0000 7f695f656740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5e7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:43.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.267+0000 7f695f656740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55806d55cea0 con 0x55806d21e390 2024-09-21T06:33:43.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.267+0000 7f695f656740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55806d54c2d0 con 0x55806d2161b0 2024-09-21T06:33:43.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.267+0000 7f695f656740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55806d5500e0 con 0x55806d23f070 2024-09-21T06:33:43.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.267+0000 7f694bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5e7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:43.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.267+0000 7f694bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5e7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38720/0 (socket says 172.21.15.63:38720) 2024-09-21T06:33:43.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.267+0000 7f694bfff640 1 -- 172.21.15.63:0/1703422723 learned_addr learned my addr 172.21.15.63:0/1703422723 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:43.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.267+0000 7f6952d9d640 1 --2- 172.21.15.63:0/1703422723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d2161b0 0x55806d5e6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:43.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.267+0000 7f6952d9d640 1 -- 172.21.15.63:0/1703422723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55806d23f070 msgr2=0x55806d5e66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:43.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.267+0000 7f6952d9d640 1 --2- 172.21.15.63:0/1703422723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55806d23f070 0x55806d5e66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.267+0000 7f6952d9d640 1 -- 172.21.15.63:0/1703422723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 msgr2=0x55806d5e7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:43.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.267+0000 7f6952d9d640 1 --2- 172.21.15.63:0/1703422723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5e7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.267+0000 7f6952d9d640 1 -- 172.21.15.63:0/1703422723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55806d2aa650 con 0x55806d2161b0 2024-09-21T06:33:43.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.268+0000 7f6952d9d640 1 --2- 172.21.15.63:0/1703422723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d2161b0 0x55806d5e6be0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6944005fd0 tx=0x7f694400bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ba5c26d306a554b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:43.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.268+0000 7f6950d99640 1 --2- 172.21.15.63:0/3437375518 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f69400b6680 0x7f69400b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:43.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.268+0000 7f69497fa640 1 -- 172.21.15.63:0/1703422723 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944003bd0 con 0x55806d2161b0 2024-09-21T06:33:43.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.268+0000 7f695359e640 1 --2- 172.21.15.63:0/3437375518 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f69400b6680 0x7f69400b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:43.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.268+0000 7f6950d99640 1 -- 172.21.15.63:0/3437375518 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f693c107ba0 con 0x7f69541083d0 2024-09-21T06:33:43.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.268+0000 7f69497fa640 1 -- 172.21.15.63:0/1703422723 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6944015070 con 0x55806d2161b0 2024-09-21T06:33:43.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.268+0000 7f69497fa640 1 -- 172.21.15.63:0/1703422723 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944004d60 con 0x55806d2161b0 2024-09-21T06:33:43.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.269+0000 7f695f656740 1 -- 172.21.15.63:0/1703422723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d2161b0 msgr2=0x55806d5e6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:43.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.269+0000 7f695f656740 1 --2- 172.21.15.63:0/1703422723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d2161b0 0x55806d5e6be0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6944005fd0 tx=0x7f694400bb20 comp rx=0 tx=0).stop 2024-09-21T06:33:43.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.269+0000 7f695359e640 1 --2- 172.21.15.63:0/3437375518 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f69400b6680 0x7f69400b8b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f694c005fd0 tx=0x7f694c009ae0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:43.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.269+0000 7f695f656740 1 -- 172.21.15.63:0/1703422723 shutdown_connections 2024-09-21T06:33:43.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.269+0000 7f695f656740 1 --2- 172.21.15.63:0/1703422723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5e7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.269+0000 7f695f656740 1 --2- 172.21.15.63:0/1703422723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d2161b0 0x55806d5e6be0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.269+0000 7f695f656740 1 --2- 172.21.15.63:0/1703422723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55806d23f070 0x55806d5e66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.269+0000 7f695f656740 1 -- 172.21.15.63:0/1703422723 >> 172.21.15.63:0/1703422723 conn(0x55806d233460 msgr2=0x55806d5e4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:43.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.269+0000 7f695f656740 1 -- 172.21.15.63:0/1703422723 shutdown_connections 2024-09-21T06:33:43.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.269+0000 7f695f656740 1 -- 172.21.15.63:0/1703422723 wait complete. 2024-09-21T06:33:43.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.269+0000 7f695f656740 1 -- start start 2024-09-21T06:33:43.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.270+0000 7f695f656740 1 Processor -- start 2024-09-21T06:33:43.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.270+0000 7f695f656740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55806d2161b0 0x55806d5f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:43.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.270+0000 7f695f656740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5f2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:43.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.270+0000 7f695f656740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d23f070 0x55806d5fe200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:43.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.270+0000 7f695f656740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55806d3ad700 con 0x55806d21e390 2024-09-21T06:33:43.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.270+0000 7f695f656740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55806d4e7160 con 0x55806d23f070 2024-09-21T06:33:43.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.270+0000 7f695f656740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55806d5f4e80 con 0x55806d2161b0 2024-09-21T06:33:43.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.270+0000 7f695f656740 10 client.0 _ll_register_callbacks cb 0x55806d5009e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:43.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.270+0000 7f694bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:43.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.270+0000 7f694bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5f2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38724/0 (socket says 172.21.15.63:38724) 2024-09-21T06:33:43.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.270+0000 7f694bfff640 1 -- 172.21.15.63:0/2762343029 learned_addr learned my addr 172.21.15.63:0/2762343029 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:43.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.270+0000 7f695359e640 1 --2- 172.21.15.63:0/2762343029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d23f070 0x55806d5fe200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:43.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.270+0000 7f6952d9d640 1 --2- 172.21.15.63:0/2762343029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55806d2161b0 0x55806d5f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:43.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.270+0000 7f694bfff640 1 -- 172.21.15.63:0/2762343029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55806d2161b0 msgr2=0x55806d5f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:43.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.270+0000 7f694bfff640 1 --2- 172.21.15.63:0/2762343029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55806d2161b0 0x55806d5f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.270+0000 7f694bfff640 1 -- 172.21.15.63:0/2762343029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d23f070 msgr2=0x55806d5fe200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:43.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.270+0000 7f694bfff640 1 --2- 172.21.15.63:0/2762343029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d23f070 0x55806d5fe200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.270+0000 7f694bfff640 1 -- 172.21.15.63:0/2762343029 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55806d514c90 con 0x55806d21e390 2024-09-21T06:33:43.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.270+0000 7f695359e640 1 --2- 172.21.15.63:0/2762343029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d23f070 0x55806d5fe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:33:43.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.271+0000 7f694bfff640 1 --2- 172.21.15.63:0/2762343029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5f2290 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f693c0ca050 tx=0x7f693c03b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d7a283688005a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:43.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.271+0000 7f693a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:33:43.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.271+0000 7f693a7fc640 1 -- 172.21.15.63:0/2762343029 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c049070 con 0x55806d21e390 2024-09-21T06:33:43.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.271+0000 7f693a7fc640 1 -- 172.21.15.63:0/2762343029 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f693c0d6f60 con 0x55806d21e390 2024-09-21T06:33:43.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.271+0000 7f695f656740 1 -- 172.21.15.63:0/2762343029 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6944015070 con 0x55806d21e390 2024-09-21T06:33:43.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.271+0000 7f693a7fc640 1 -- 172.21.15.63:0/2762343029 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f693c0ca0d0 con 0x55806d21e390 2024-09-21T06:33:43.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.271+0000 7f695f656740 10 client.16629 fetch_fsmap learned FSMap version 50 2024-09-21T06:33:43.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.271+0000 7f695f656740 1 -- 172.21.15.63:0/2762343029 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55806d600bc0 con 0x55806d21e390 2024-09-21T06:33:43.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.271+0000 7f693a7fc640 1 -- 172.21.15.63:0/2762343029 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6944015070 con 0x55806d21e390 2024-09-21T06:33:43.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.271+0000 7f693a7fc640 1 -- 172.21.15.63:0/2762343029 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 50) ==== 8406+0+0 (secure 0 0 0) 0x7f693c0d2080 con 0x55806d21e390 2024-09-21T06:33:43.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.272+0000 7f695f656740 10 client.16629 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T06:33:43.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.272+0000 7f695f656740 10 client.16629 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:33:43.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.272+0000 7f695f656740 20 client.16629 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:43.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.272+0000 7f695f656740 1 --2- 172.21.15.63:0/2762343029 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55806d1fd9f0 0x55806d604170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:43.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.272+0000 7f695f656740 4 client.16629 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:33:43.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.272+0000 7f695f656740 1 -- 172.21.15.63:0/2762343029 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55806d55edf0 con 0x55806d1fd9f0 2024-09-21T06:33:43.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.272+0000 7f6952d9d640 1 --2- 172.21.15.63:0/2762343029 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55806d1fd9f0 0x55806d604170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:43.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.272+0000 7f6952d9d640 1 --2- 172.21.15.63:0/2762343029 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55806d1fd9f0 0x55806d604170 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c4a71e105cbcf2e server_cookie=7d785bcfdbc7c312 in_seq=0 out_seq=0 2024-09-21T06:33:43.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.272+0000 7f693a7fc640 10 client.16629 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:43.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.273+0000 7f693a7fc640 1 -- 172.21.15.63:0/2762343029 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55806d55edf0 con 0x55806d1fd9f0 2024-09-21T06:33:43.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.273+0000 7f693a7fc640 10 client.16629 handle_command_reply: tid=0 2024-09-21T06:33:43.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.273+0000 7f695f656740 1 client.16629 shutdown 2024-09-21T06:33:43.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.274+0000 7f695f656740 1 -- 172.21.15.63:0/2762343029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 msgr2=0x55806d5f2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:43.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.274+0000 7f695f656740 1 --2- 172.21.15.63:0/2762343029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5f2290 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f693c0ca050 tx=0x7f693c03b690 comp rx=0 tx=0).stop 2024-09-21T06:33:43.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.274+0000 7f695f656740 1 -- 172.21.15.63:0/2762343029 shutdown_connections 2024-09-21T06:33:43.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.274+0000 7f695f656740 1 --2- 172.21.15.63:0/2762343029 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55806d1fd9f0 0x55806d604170 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.274+0000 7f695f656740 1 --2- 172.21.15.63:0/2762343029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d23f070 0x55806d5fe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.274+0000 7f695f656740 1 --2- 172.21.15.63:0/2762343029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5f2290 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.274+0000 7f695f656740 1 --2- 172.21.15.63:0/2762343029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55806d2161b0 0x55806d5f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.274+0000 7f695f656740 1 -- 172.21.15.63:0/2762343029 >> 172.21.15.63:0/2762343029 conn(0x55806d233460 msgr2=0x55806d5e9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:43.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.274+0000 7f693a7fc640 0 client.16629 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:43.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.274+0000 7f695f656740 1 -- 172.21.15.63:0/2762343029 shutdown_connections 2024-09-21T06:33:43.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.274+0000 7f695f656740 1 -- 172.21.15.63:0/2762343029 wait complete. 2024-09-21T06:33:43.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.274+0000 7f695f656740 20 client.16629 trim_cache size 0 max 16384 2024-09-21T06:33:43.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.287+0000 7f695f656740 1 Processor -- start 2024-09-21T06:33:43.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.287+0000 7f695f656740 1 -- start start 2024-09-21T06:33:43.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.288+0000 7f695f656740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55806d2161b0 0x55806d5fe100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:43.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.288+0000 7f695f656740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:43.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.288+0000 7f695f656740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d23f070 0x55806d5f2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:43.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.288+0000 7f695f656740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f69541b18e0 con 0x55806d21e390 2024-09-21T06:33:43.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.288+0000 7f695f656740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f69541b3570 con 0x55806d23f070 2024-09-21T06:33:43.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.288+0000 7f695f656740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f69541b2040 con 0x55806d2161b0 2024-09-21T06:33:43.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.288+0000 7f694bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:43.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.288+0000 7f694bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5f1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38732/0 (socket says 172.21.15.63:38732) 2024-09-21T06:33:43.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.288+0000 7f694bfff640 1 -- 172.21.15.63:0/2949536899 learned_addr learned my addr 172.21.15.63:0/2949536899 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:43.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.288+0000 7f695359e640 1 --2- 172.21.15.63:0/2949536899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d23f070 0x55806d5f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:43.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.288+0000 7f6952d9d640 1 --2- 172.21.15.63:0/2949536899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55806d2161b0 0x55806d5fe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:43.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.288+0000 7f694bfff640 1 -- 172.21.15.63:0/2949536899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55806d2161b0 msgr2=0x55806d5fe100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:43.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.288+0000 7f694bfff640 1 --2- 172.21.15.63:0/2949536899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55806d2161b0 0x55806d5fe100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.288+0000 7f694bfff640 1 -- 172.21.15.63:0/2949536899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d23f070 msgr2=0x55806d5f2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:43.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.288+0000 7f694bfff640 1 --2- 172.21.15.63:0/2949536899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d23f070 0x55806d5f2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.288+0000 7f694bfff640 1 -- 172.21.15.63:0/2949536899 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55806d5e8990 con 0x55806d21e390 2024-09-21T06:33:43.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.288+0000 7f695359e640 1 --2- 172.21.15.63:0/2949536899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d23f070 0x55806d5f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:33:43.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.288+0000 7f694bfff640 1 --2- 172.21.15.63:0/2949536899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5f1b00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f693c03d040 tx=0x7f693c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ce8fbe39471e35 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:43.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.288+0000 7f6948ff9640 1 -- 172.21.15.63:0/2949536899 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c049070 con 0x55806d21e390 2024-09-21T06:33:43.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.289+0000 7f6948ff9640 1 -- 172.21.15.63:0/2949536899 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f693c0c9050 con 0x55806d21e390 2024-09-21T06:33:43.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.289+0000 7f6948ff9640 1 -- 172.21.15.63:0/2949536899 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c0cd1f0 con 0x55806d21e390 2024-09-21T06:33:43.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.289+0000 7f695f656740 1 -- 172.21.15.63:0/2949536899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 msgr2=0x55806d5f1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:43.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.289+0000 7f695f656740 1 --2- 172.21.15.63:0/2949536899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5f1b00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f693c03d040 tx=0x7f693c009260 comp rx=0 tx=0).stop 2024-09-21T06:33:43.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.289+0000 7f695f656740 1 -- 172.21.15.63:0/2949536899 shutdown_connections 2024-09-21T06:33:43.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.289+0000 7f695f656740 1 --2- 172.21.15.63:0/2949536899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d23f070 0x55806d5f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.289+0000 7f695f656740 1 --2- 172.21.15.63:0/2949536899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5f1b00 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.289+0000 7f695f656740 1 --2- 172.21.15.63:0/2949536899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55806d2161b0 0x55806d5fe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.289+0000 7f695f656740 1 -- 172.21.15.63:0/2949536899 >> 172.21.15.63:0/2949536899 conn(0x55806d233460 msgr2=0x55806d5f05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:43.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.289+0000 7f695f656740 1 -- 172.21.15.63:0/2949536899 shutdown_connections 2024-09-21T06:33:43.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.289+0000 7f695f656740 1 -- 172.21.15.63:0/2949536899 wait complete. 2024-09-21T06:33:43.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.290+0000 7f695f656740 1 -- start start 2024-09-21T06:33:43.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.290+0000 7f695f656740 1 Processor -- start 2024-09-21T06:33:43.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.290+0000 7f695f656740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55806d2161b0 0x55806d5fa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:43.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.290+0000 7f695f656740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:43.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.290+0000 7f695f656740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d23f070 0x55806d5f6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:43.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.290+0000 7f695f656740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f69541b2ea0 con 0x55806d21e390 2024-09-21T06:33:43.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.290+0000 7f695f656740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f69541b27a0 con 0x55806d23f070 2024-09-21T06:33:43.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.290+0000 7f695f656740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f69541af8c0 con 0x55806d2161b0 2024-09-21T06:33:43.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.290+0000 7f695f656740 10 client.0 _ll_register_callbacks cb 0x7f693c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:43.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.290+0000 7f694bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:43.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.290+0000 7f694bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5f5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38738/0 (socket says 172.21.15.63:38738) 2024-09-21T06:33:43.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.290+0000 7f694bfff640 1 -- 172.21.15.63:0/2923589070 learned_addr learned my addr 172.21.15.63:0/2923589070 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:43.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.290+0000 7f6952d9d640 1 --2- 172.21.15.63:0/2923589070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55806d2161b0 0x55806d5fa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:43.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.291+0000 7f695359e640 1 --2- 172.21.15.63:0/2923589070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d23f070 0x55806d5f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:43.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.291+0000 7f694bfff640 1 -- 172.21.15.63:0/2923589070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55806d2161b0 msgr2=0x55806d5fa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:43.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.291+0000 7f694bfff640 1 --2- 172.21.15.63:0/2923589070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55806d2161b0 0x55806d5fa6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.291+0000 7f694bfff640 1 -- 172.21.15.63:0/2923589070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d23f070 msgr2=0x55806d5f6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:43.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.291+0000 7f694bfff640 1 --2- 172.21.15.63:0/2923589070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d23f070 0x55806d5f6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.291+0000 7f694bfff640 1 -- 172.21.15.63:0/2923589070 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55806d5f65d0 con 0x55806d21e390 2024-09-21T06:33:43.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.291+0000 7f695359e640 1 --2- 172.21.15.63:0/2923589070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d23f070 0x55806d5f6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:33:43.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.291+0000 7f694bfff640 1 --2- 172.21.15.63:0/2923589070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5f5b50 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f693c000c00 tx=0x7f693c03b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0111bf0e648fac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:43.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.291+0000 7f693a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:33:43.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.291+0000 7f693a7fc640 1 -- 172.21.15.63:0/2923589070 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c0d2070 con 0x55806d21e390 2024-09-21T06:33:43.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.291+0000 7f693a7fc640 1 -- 172.21.15.63:0/2923589070 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f693c0c93d0 con 0x55806d21e390 2024-09-21T06:33:43.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.291+0000 7f695f656740 1 -- 172.21.15.63:0/2923589070 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f693c0c9050 con 0x55806d21e390 2024-09-21T06:33:43.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.291+0000 7f693a7fc640 1 -- 172.21.15.63:0/2923589070 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f693c049050 con 0x55806d21e390 2024-09-21T06:33:43.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.291+0000 7f695f656740 10 client.16635 fetch_fsmap learned FSMap version 50 2024-09-21T06:33:43.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.291+0000 7f695f656740 1 -- 172.21.15.63:0/2923589070 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55806d5f65d0 con 0x55806d21e390 2024-09-21T06:33:43.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.292+0000 7f693a7fc640 1 -- 172.21.15.63:0/2923589070 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f693c0c9050 con 0x55806d21e390 2024-09-21T06:33:43.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.292+0000 7f693a7fc640 1 -- 172.21.15.63:0/2923589070 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 50) ==== 8406+0+0 (secure 0 0 0) 0x7f693c0c95d0 con 0x55806d21e390 2024-09-21T06:33:43.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.292+0000 7f695f656740 10 client.16635 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T06:33:43.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.292+0000 7f695f656740 10 client.16635 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:33:43.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.292+0000 7f695f656740 20 client.16635 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:43.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.292+0000 7f695f656740 1 --2- 172.21.15.63:0/2923589070 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55806d1d2da0 0x55806d670bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:43.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.292+0000 7f695f656740 4 client.16635 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:33:43.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.292+0000 7f695f656740 1 -- 172.21.15.63:0/2923589070 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55806d55a8a0 con 0x55806d1d2da0 2024-09-21T06:33:43.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.292+0000 7f6952d9d640 1 --2- 172.21.15.63:0/2923589070 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55806d1d2da0 0x55806d670bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:43.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.292+0000 7f6952d9d640 1 --2- 172.21.15.63:0/2923589070 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55806d1d2da0 0x55806d670bd0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=874e403ea780e3e6 server_cookie=aaff13c974de9156 in_seq=0 out_seq=0 2024-09-21T06:33:43.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.292+0000 7f693a7fc640 10 client.16635 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:43.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.293+0000 7f693a7fc640 1 -- 172.21.15.63:0/2923589070 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55806d55a8a0 con 0x55806d1d2da0 2024-09-21T06:33:43.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.293+0000 7f693a7fc640 10 client.16635 handle_command_reply: tid=0 2024-09-21T06:33:43.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.293+0000 7f695f656740 1 client.16635 shutdown 2024-09-21T06:33:43.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.293+0000 7f695f656740 1 -- 172.21.15.63:0/2923589070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 msgr2=0x55806d5f5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:43.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.293+0000 7f695f656740 1 --2- 172.21.15.63:0/2923589070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5f5b50 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f693c000c00 tx=0x7f693c03b720 comp rx=0 tx=0).stop 2024-09-21T06:33:43.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.293+0000 7f695f656740 1 -- 172.21.15.63:0/2923589070 shutdown_connections 2024-09-21T06:33:43.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.293+0000 7f695f656740 1 --2- 172.21.15.63:0/2923589070 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55806d1d2da0 0x55806d670bd0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.293+0000 7f695f656740 1 --2- 172.21.15.63:0/2923589070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55806d23f070 0x55806d5f6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.293+0000 7f695f656740 1 --2- 172.21.15.63:0/2923589070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55806d21e390 0x55806d5f5b50 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.293+0000 7f695f656740 1 --2- 172.21.15.63:0/2923589070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55806d2161b0 0x55806d5fa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.293+0000 7f693a7fc640 0 client.16635 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:43.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.293+0000 7f695f656740 1 -- 172.21.15.63:0/2923589070 >> 172.21.15.63:0/2923589070 conn(0x55806d233460 msgr2=0x55806d5f1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:43.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.293+0000 7f695f656740 1 -- 172.21.15.63:0/2923589070 shutdown_connections 2024-09-21T06:33:43.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.293+0000 7f695f656740 1 -- 172.21.15.63:0/2923589070 wait complete. 2024-09-21T06:33:43.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.293+0000 7f695f656740 20 client.16635 trim_cache size 0 max 16384 2024-09-21T06:33:43.301 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:33:43.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.294+0000 7f69590e2640 1 -- 172.21.15.63:0/3437375518 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f69400b6680 msgr2=0x7f69400b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:43.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.294+0000 7f69590e2640 1 --2- 172.21.15.63:0/3437375518 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f69400b6680 0x7f69400b8b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f694c005fd0 tx=0x7f694c009ae0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.294+0000 7f69590e2640 1 -- 172.21.15.63:0/3437375518 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69541083d0 msgr2=0x7f69540ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:43.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.294+0000 7f69590e2640 1 --2- 172.21.15.63:0/3437375518 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69541083d0 0x7f69540ffbb0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f693c032fd0 tx=0x7f693c004270 comp rx=0 tx=0).stop 2024-09-21T06:33:43.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.294+0000 7f69590e2640 1 -- 172.21.15.63:0/3437375518 shutdown_connections 2024-09-21T06:33:43.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.294+0000 7f69590e2640 1 --2- 172.21.15.63:0/3437375518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6954108d20 0x7f69541000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.294+0000 7f69590e2640 1 --2- 172.21.15.63:0/3437375518 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69541083d0 0x7f69540ffbb0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.294+0000 7f69590e2640 1 --2- 172.21.15.63:0/3437375518 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f69400b6680 0x7f69400b8b90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.294+0000 7f69590e2640 1 --2- 172.21.15.63:0/3437375518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6954102ae0 0x7f69540ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:43.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.294+0000 7f69590e2640 1 -- 172.21.15.63:0/3437375518 >> 172.21.15.63:0/3437375518 conn(0x7f6954079760 msgr2=0x7f695406bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:43.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.294+0000 7f69590e2640 1 -- 172.21.15.63:0/3437375518 shutdown_connections 2024-09-21T06:33:43.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:43.294+0000 7f69590e2640 1 -- 172.21.15.63:0/3437375518 wait complete. 2024-09-21T06:33:43.976 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:43 smithi063 ceph-mon[31150]: pgmap v488: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 321 KiB/s wr, 90 op/s 2024-09-21T06:33:44.005 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T06:33:44.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:43 smithi071 ceph-mon[34844]: pgmap v488: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 321 KiB/s wr, 90 op/s 2024-09-21T06:33:44.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:43 smithi175 ceph-mon[34510]: pgmap v488: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 321 KiB/s wr, 90 op/s 2024-09-21T06:33:44.263 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:44.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.871+0000 7f36e481b640 1 -- 172.21.15.63:0/206658121 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36e0108cf0 msgr2=0x7f36e010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:44.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.871+0000 7f36e481b640 1 --2- 172.21.15.63:0/206658121 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36e0108cf0 0x7f36e010f520 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009ca0 tx=0x7f36d002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.871+0000 7f36e481b640 1 -- 172.21.15.63:0/206658121 shutdown_connections 2024-09-21T06:33:44.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.871+0000 7f36e481b640 1 --2- 172.21.15.63:0/206658121 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36e0108cf0 0x7f36e010f520 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.871+0000 7f36e481b640 1 --2- 172.21.15.63:0/206658121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e01083a0 0x7f36e01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.871+0000 7f36e481b640 1 --2- 172.21.15.63:0/206658121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36e0102a60 0x7f36e0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.871+0000 7f36e481b640 1 -- 172.21.15.63:0/206658121 >> 172.21.15.63:0/206658121 conn(0x7f36e0079730 msgr2=0x7f36e0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:44.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.871+0000 7f36e481b640 1 -- 172.21.15.63:0/206658121 shutdown_connections 2024-09-21T06:33:44.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.871+0000 7f36e481b640 1 -- 172.21.15.63:0/206658121 wait complete. 2024-09-21T06:33:44.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.872+0000 7f36e481b640 1 Processor -- start 2024-09-21T06:33:44.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.872+0000 7f36e481b640 1 -- start start 2024-09-21T06:33:44.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.872+0000 7f36e481b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36e0102a60 0x7f36e019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:44.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.872+0000 7f36e481b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36e01083a0 0x7f36e019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:44.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.872+0000 7f36e481b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e0108cf0 0x7f36e019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:44.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.872+0000 7f36e481b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f36e0112960 con 0x7f36e0102a60 2024-09-21T06:33:44.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.872+0000 7f36e481b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f36e01127e0 con 0x7f36e0108cf0 2024-09-21T06:33:44.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.872+0000 7f36e481b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36e0112ae0 con 0x7f36e01083a0 2024-09-21T06:33:44.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.873+0000 7f36de59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36e0102a60 0x7f36e019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:44.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.873+0000 7f36de59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36e0102a60 0x7f36e019a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38752/0 (socket says 172.21.15.63:38752) 2024-09-21T06:33:44.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.873+0000 7f36de59c640 1 -- 172.21.15.63:0/2892273584 learned_addr learned my addr 172.21.15.63:0/2892273584 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:44.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.873+0000 7f36ddd9b640 1 --2- 172.21.15.63:0/2892273584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36e01083a0 0x7f36e019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:44.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.873+0000 7f36ded9d640 1 --2- 172.21.15.63:0/2892273584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e0108cf0 0x7f36e019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:44.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.873+0000 7f36de59c640 1 -- 172.21.15.63:0/2892273584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36e01083a0 msgr2=0x7f36e019a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:44.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.873+0000 7f36de59c640 1 --2- 172.21.15.63:0/2892273584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36e01083a0 0x7f36e019a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.873+0000 7f36de59c640 1 -- 172.21.15.63:0/2892273584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e0108cf0 msgr2=0x7f36e019fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:44.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.873+0000 7f36de59c640 1 --2- 172.21.15.63:0/2892273584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e0108cf0 0x7f36e019fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.873+0000 7f36de59c640 1 -- 172.21.15.63:0/2892273584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e01a0350 con 0x7f36e0102a60 2024-09-21T06:33:44.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.873+0000 7f36de59c640 1 --2- 172.21.15.63:0/2892273584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36e0102a60 0x7f36e019a3e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f36d800d770 tx=0x7f36d800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:44.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.873+0000 7f36d77fe640 1 -- 172.21.15.63:0/2892273584 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d8017070 con 0x7f36e0102a60 2024-09-21T06:33:44.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.874+0000 7f36d77fe640 1 -- 172.21.15.63:0/2892273584 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36d80054d0 con 0x7f36e0102a60 2024-09-21T06:33:44.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.874+0000 7f36d77fe640 1 -- 172.21.15.63:0/2892273584 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d8004c30 con 0x7f36e0102a60 2024-09-21T06:33:44.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.874+0000 7f36e481b640 1 -- 172.21.15.63:0/2892273584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36e01a0640 con 0x7f36e0102a60 2024-09-21T06:33:44.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.874+0000 7f36e481b640 1 -- 172.21.15.63:0/2892273584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36e01a6da0 con 0x7f36e0102a60 2024-09-21T06:33:44.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.876+0000 7f36ead8f740 1 Processor -- start 2024-09-21T06:33:44.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.876+0000 7f36ead8f740 1 -- start start 2024-09-21T06:33:44.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.877+0000 7f36ead8f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561064808070 0x561064baf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:44.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.877+0000 7f36ead8f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610647df1b0 0x561064bafbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:44.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.877+0000 7f36ead8f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5610647e7390 0x561064bb0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:44.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.877+0000 7f36ead8f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x561064b25ea0 con 0x561064808070 2024-09-21T06:33:44.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.877+0000 7f36ead8f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561064b152d0 con 0x5610647e7390 2024-09-21T06:33:44.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.877+0000 7f36ead8f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561064b190e0 con 0x5610647df1b0 2024-09-21T06:33:44.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.877+0000 7f36d77fe640 1 -- 172.21.15.63:0/2892273584 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f36d8004e10 con 0x7f36e0102a60 2024-09-21T06:33:44.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.877+0000 7f36ded9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561064808070 0x561064baf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:44.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.877+0000 7f36ded9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561064808070 0x561064baf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38768/0 (socket says 172.21.15.63:38768) 2024-09-21T06:33:44.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.877+0000 7f36ded9d640 1 -- 172.21.15.63:0/78440745 learned_addr learned my addr 172.21.15.63:0/78440745 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:44.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.877+0000 7f36ddd9b640 1 --2- 172.21.15.63:0/78440745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5610647e7390 0x561064bb0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:44.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.877+0000 7f36de59c640 1 --2- 172.21.15.63:0/78440745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610647df1b0 0x561064bafbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:44.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.877+0000 7f36ded9d640 1 -- 172.21.15.63:0/78440745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610647df1b0 msgr2=0x561064bafbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:44.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.877+0000 7f36ded9d640 1 --2- 172.21.15.63:0/78440745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610647df1b0 0x561064bafbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.877+0000 7f36ded9d640 1 -- 172.21.15.63:0/78440745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5610647e7390 msgr2=0x561064bb0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:44.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.877+0000 7f36ded9d640 1 --2- 172.21.15.63:0/78440745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5610647e7390 0x561064bb0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.877+0000 7f36ded9d640 1 -- 172.21.15.63:0/78440745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561064873650 con 0x561064808070 2024-09-21T06:33:44.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.878+0000 7f36ded9d640 1 --2- 172.21.15.63:0/78440745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561064808070 0x561064baf6a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009930 tx=0x7f36d0009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb5adf0f8895b10 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:44.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.878+0000 7f36d4ff9640 1 -- 172.21.15.63:0/78440745 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d0031df0 con 0x561064808070 2024-09-21T06:33:44.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.878+0000 7f36d77fe640 1 --2- 172.21.15.63:0/2892273584 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f36cc0b6680 0x7f36cc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:44.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.878+0000 7f36d4ff9640 1 -- 172.21.15.63:0/78440745 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36d0036040 con 0x561064808070 2024-09-21T06:33:44.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.878+0000 7f36d4ff9640 1 -- 172.21.15.63:0/78440745 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d00042a0 con 0x561064808070 2024-09-21T06:33:44.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.878+0000 7f36de59c640 1 --2- 172.21.15.63:0/2892273584 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f36cc0b6680 0x7f36cc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:44.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.878+0000 7f36d77fe640 1 -- 172.21.15.63:0/2892273584 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f36d80e7230 con 0x7f36e0102a60 2024-09-21T06:33:44.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.879+0000 7f36ead8f740 1 -- 172.21.15.63:0/78440745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561064808070 msgr2=0x561064baf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:44.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.879+0000 7f36de59c640 1 --2- 172.21.15.63:0/2892273584 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f36cc0b6680 0x7f36cc0b8b90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f36d80e4a10 tx=0x7f36d80046c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:44.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.879+0000 7f36ead8f740 1 --2- 172.21.15.63:0/78440745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561064808070 0x561064baf6a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009930 tx=0x7f36d0009960 comp rx=0 tx=0).stop 2024-09-21T06:33:44.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.879+0000 7f36ead8f740 1 -- 172.21.15.63:0/78440745 shutdown_connections 2024-09-21T06:33:44.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.879+0000 7f36ead8f740 1 --2- 172.21.15.63:0/78440745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5610647e7390 0x561064bb0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.879+0000 7f36ead8f740 1 --2- 172.21.15.63:0/78440745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610647df1b0 0x561064bafbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.879+0000 7f36ead8f740 1 --2- 172.21.15.63:0/78440745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561064808070 0x561064baf6a0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.879+0000 7f36ead8f740 1 -- 172.21.15.63:0/78440745 >> 172.21.15.63:0/78440745 conn(0x5610647fc460 msgr2=0x561064bad590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:44.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.879+0000 7f36ead8f740 1 -- 172.21.15.63:0/78440745 shutdown_connections 2024-09-21T06:33:44.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.879+0000 7f36ead8f740 1 -- 172.21.15.63:0/78440745 wait complete. 2024-09-21T06:33:44.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.879+0000 7f36ead8f740 1 -- start start 2024-09-21T06:33:44.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.880+0000 7f36ead8f740 1 Processor -- start 2024-09-21T06:33:44.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.880+0000 7f36ead8f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5610647df1b0 0x561064bbac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:44.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.880+0000 7f36ead8f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610647e7390 0x561064bbb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:44.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.880+0000 7f36ead8f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561064808070 0x561064bbb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:44.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.880+0000 7f36ead8f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x561064976700 con 0x5610647df1b0 2024-09-21T06:33:44.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.880+0000 7f36ead8f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561064ab0160 con 0x561064808070 2024-09-21T06:33:44.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.880+0000 7f36ead8f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561064bbde20 con 0x5610647e7390 2024-09-21T06:33:44.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.880+0000 7f36ead8f740 10 client.0 _ll_register_callbacks cb 0x561064ac99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:44.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.880+0000 7f36ded9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5610647df1b0 0x561064bbac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:44.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.880+0000 7f36ded9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5610647df1b0 0x561064bbac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38780/0 (socket says 172.21.15.63:38780) 2024-09-21T06:33:44.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.880+0000 7f36ded9d640 1 -- 172.21.15.63:0/3529041753 learned_addr learned my addr 172.21.15.63:0/3529041753 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:44.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.880+0000 7f36ddd9b640 1 --2- 172.21.15.63:0/3529041753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610647e7390 0x561064bbb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:44.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.880+0000 7f36ded9d640 1 --2- 172.21.15.63:0/3529041753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561064808070 0x561064bbb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:44.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.880+0000 7f36ded9d640 1 -- 172.21.15.63:0/3529041753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610647e7390 msgr2=0x561064bbb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:44.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.880+0000 7f36ded9d640 1 --2- 172.21.15.63:0/3529041753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610647e7390 0x561064bbb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.880+0000 7f36ded9d640 1 -- 172.21.15.63:0/3529041753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561064808070 msgr2=0x561064bbb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:44.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.880+0000 7f36ded9d640 1 --2- 172.21.15.63:0/3529041753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561064808070 0x561064bbb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.880+0000 7f36ded9d640 1 -- 172.21.15.63:0/3529041753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561064addc90 con 0x5610647df1b0 2024-09-21T06:33:44.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.881+0000 7f36ded9d640 1 --2- 172.21.15.63:0/3529041753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5610647df1b0 0x561064bbac50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009620 tx=0x7f36d002afc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=259a6c22e3f99357 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:44.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.881+0000 7f36c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:33:44.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.881+0000 7f36c5ffb640 1 -- 172.21.15.63:0/3529041753 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d0058060 con 0x5610647df1b0 2024-09-21T06:33:44.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.881+0000 7f36c5ffb640 1 -- 172.21.15.63:0/3529041753 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f36d002f660 con 0x5610647df1b0 2024-09-21T06:33:44.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.881+0000 7f36ead8f740 1 -- 172.21.15.63:0/3529041753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36d0036040 con 0x5610647df1b0 2024-09-21T06:33:44.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.881+0000 7f36c5ffb640 1 -- 172.21.15.63:0/3529041753 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f36d002f860 con 0x5610647df1b0 2024-09-21T06:33:44.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.881+0000 7f36ead8f740 10 client.16647 fetch_fsmap learned FSMap version 50 2024-09-21T06:33:44.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.881+0000 7f36ead8f740 1 -- 172.21.15.63:0/3529041753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x561064bc9a20 con 0x5610647df1b0 2024-09-21T06:33:44.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.881+0000 7f36c5ffb640 1 -- 172.21.15.63:0/3529041753 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36d0036040 con 0x5610647df1b0 2024-09-21T06:33:44.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.881+0000 7f36c5ffb640 1 -- 172.21.15.63:0/3529041753 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 50) ==== 8406+0+0 (secure 0 0 0) 0x7f36d00043f0 con 0x5610647df1b0 2024-09-21T06:33:44.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.881+0000 7f36ead8f740 10 client.16647 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T06:33:44.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.881+0000 7f36ead8f740 10 client.16647 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:33:44.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.881+0000 7f36ead8f740 20 client.16647 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:44.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.881+0000 7f36ead8f740 1 --2- 172.21.15.63:0/3529041753 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5610647c69f0 0x561064bccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:44.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.881+0000 7f36ead8f740 4 client.16647 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:33:44.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.881+0000 7f36ead8f740 1 -- 172.21.15.63:0/3529041753 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561064b27df0 con 0x5610647c69f0 2024-09-21T06:33:44.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.882+0000 7f36ddd9b640 1 --2- 172.21.15.63:0/3529041753 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5610647c69f0 0x561064bccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:44.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.882+0000 7f36c5ffb640 10 client.16647 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:33:44.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.882+0000 7f36ddd9b640 1 --2- 172.21.15.63:0/3529041753 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5610647c69f0 0x561064bccd80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7047bc0129f296b4 server_cookie=9ba082bc1f4eab2b in_seq=0 out_seq=0 2024-09-21T06:33:44.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.883+0000 7f36c5ffb640 1 -- 172.21.15.63:0/3529041753 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561064b27df0 con 0x5610647c69f0 2024-09-21T06:33:44.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.883+0000 7f36c5ffb640 10 client.16647 handle_command_reply: tid=0 2024-09-21T06:33:44.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.883+0000 7f36ead8f740 1 client.16647 shutdown 2024-09-21T06:33:44.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.883+0000 7f36ead8f740 1 -- 172.21.15.63:0/3529041753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5610647df1b0 msgr2=0x561064bbac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:44.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.883+0000 7f36ead8f740 1 --2- 172.21.15.63:0/3529041753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5610647df1b0 0x561064bbac50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009620 tx=0x7f36d002afc0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.883+0000 7f36ead8f740 1 -- 172.21.15.63:0/3529041753 shutdown_connections 2024-09-21T06:33:44.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.883+0000 7f36ead8f740 1 --2- 172.21.15.63:0/3529041753 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5610647c69f0 0x561064bccd80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.883+0000 7f36ead8f740 1 --2- 172.21.15.63:0/3529041753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561064808070 0x561064bbb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.883+0000 7f36ead8f740 1 --2- 172.21.15.63:0/3529041753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610647e7390 0x561064bbb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.883+0000 7f36ead8f740 1 --2- 172.21.15.63:0/3529041753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5610647df1b0 0x561064bbac50 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.883+0000 7f36ead8f740 1 -- 172.21.15.63:0/3529041753 >> 172.21.15.63:0/3529041753 conn(0x5610647fc460 msgr2=0x561064bb2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:44.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.883+0000 7f36c5ffb640 0 client.16647 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:33:44.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.883+0000 7f36ead8f740 1 -- 172.21.15.63:0/3529041753 shutdown_connections 2024-09-21T06:33:44.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.883+0000 7f36ead8f740 1 -- 172.21.15.63:0/3529041753 wait complete. 2024-09-21T06:33:44.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.883+0000 7f36ead8f740 20 client.16647 trim_cache size 0 max 16384 2024-09-21T06:33:44.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.897+0000 7f36ead8f740 1 Processor -- start 2024-09-21T06:33:44.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.897+0000 7f36ead8f740 1 -- start start 2024-09-21T06:33:44.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.897+0000 7f36ead8f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610647df1b0 0x561064bb1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:44.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.897+0000 7f36ead8f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5610647e7390 0x561064bc6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:44.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.897+0000 7f36ead8f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561064808070 0x561064bacbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:44.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.897+0000 7f36ead8f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f36e01af710 con 0x5610647e7390 2024-09-21T06:33:44.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.897+0000 7f36ead8f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f36e01b13a0 con 0x561064808070 2024-09-21T06:33:44.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.897+0000 7f36ead8f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36e01afe70 con 0x5610647df1b0 2024-09-21T06:33:44.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.897+0000 7f36ddd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5610647e7390 0x561064bc6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:44.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.897+0000 7f36ddd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5610647e7390 0x561064bc6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38794/0 (socket says 172.21.15.63:38794) 2024-09-21T06:33:44.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.897+0000 7f36ddd9b640 1 -- 172.21.15.63:0/1033390683 learned_addr learned my addr 172.21.15.63:0/1033390683 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:44.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.897+0000 7f36ded9d640 1 --2- 172.21.15.63:0/1033390683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610647df1b0 0x561064bb1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:44.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.897+0000 7f36ded9d640 1 --2- 172.21.15.63:0/1033390683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561064808070 0x561064bacbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:44.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.898+0000 7f36ddd9b640 1 -- 172.21.15.63:0/1033390683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610647df1b0 msgr2=0x561064bb1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:44.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.898+0000 7f36ddd9b640 1 --2- 172.21.15.63:0/1033390683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610647df1b0 0x561064bb1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.898+0000 7f36ddd9b640 1 -- 172.21.15.63:0/1033390683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561064808070 msgr2=0x561064bacbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:44.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.898+0000 7f36ddd9b640 1 --2- 172.21.15.63:0/1033390683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561064808070 0x561064bacbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.898+0000 7f36ddd9b640 1 -- 172.21.15.63:0/1033390683 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561064bb04c0 con 0x5610647e7390 2024-09-21T06:33:44.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.898+0000 7f36ded9d640 1 --2- 172.21.15.63:0/1033390683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561064808070 0x561064bacbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:33:44.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.898+0000 7f36ddd9b640 1 --2- 172.21.15.63:0/1033390683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5610647e7390 0x561064bc6780 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x561064b25f90 tx=0x7f36c800a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d0921bd712593f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:44.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.898+0000 7f36c7fff640 1 -- 172.21.15.63:0/1033390683 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c8005220 con 0x5610647e7390 2024-09-21T06:33:44.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.898+0000 7f36c7fff640 1 -- 172.21.15.63:0/1033390683 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36c8004c50 con 0x5610647e7390 2024-09-21T06:33:44.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.898+0000 7f36c7fff640 1 -- 172.21.15.63:0/1033390683 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c801d8b0 con 0x5610647e7390 2024-09-21T06:33:44.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.899+0000 7f36ead8f740 1 -- 172.21.15.63:0/1033390683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5610647e7390 msgr2=0x561064bc6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:44.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.899+0000 7f36ead8f740 1 --2- 172.21.15.63:0/1033390683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5610647e7390 0x561064bc6780 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x561064b25f90 tx=0x7f36c800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.899+0000 7f36ead8f740 1 -- 172.21.15.63:0/1033390683 shutdown_connections 2024-09-21T06:33:44.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.899+0000 7f36ead8f740 1 --2- 172.21.15.63:0/1033390683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561064808070 0x561064bacbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.899+0000 7f36ead8f740 1 --2- 172.21.15.63:0/1033390683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5610647e7390 0x561064bc6780 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.899+0000 7f36ead8f740 1 --2- 172.21.15.63:0/1033390683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610647df1b0 0x561064bb1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.899+0000 7f36ead8f740 1 -- 172.21.15.63:0/1033390683 >> 172.21.15.63:0/1033390683 conn(0x5610647fc460 msgr2=0x561064bc6070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:44.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.899+0000 7f36ead8f740 1 -- 172.21.15.63:0/1033390683 shutdown_connections 2024-09-21T06:33:44.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.899+0000 7f36ead8f740 1 -- 172.21.15.63:0/1033390683 wait complete. 2024-09-21T06:33:44.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.899+0000 7f36ead8f740 1 -- start start 2024-09-21T06:33:44.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.900+0000 7f36ead8f740 1 Processor -- start 2024-09-21T06:33:44.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.900+0000 7f36ead8f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610647df1b0 0x561064c2f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:44.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.900+0000 7f36ead8f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5610647e7390 0x561064c2fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:44.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.900+0000 7f36ead8f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561064808070 0x561064bce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:44.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.900+0000 7f36ead8f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f36e01b0cd0 con 0x561064808070 2024-09-21T06:33:44.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.900+0000 7f36ead8f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f36e01b05d0 con 0x5610647e7390 2024-09-21T06:33:44.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.900+0000 7f36ead8f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36e01ad6f0 con 0x5610647df1b0 2024-09-21T06:33:44.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.900+0000 7f36ead8f740 10 client.0 _ll_register_callbacks cb 0x7f36c800a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:44.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.900+0000 7f36ded9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561064808070 0x561064bce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:44.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.900+0000 7f36ded9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561064808070 0x561064bce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38798/0 (socket says 172.21.15.63:38798) 2024-09-21T06:33:44.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.900+0000 7f36ded9d640 1 -- 172.21.15.63:0/1010068521 learned_addr learned my addr 172.21.15.63:0/1010068521 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:44.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.900+0000 7f36ded9d640 1 --2- 172.21.15.63:0/1010068521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610647df1b0 0x561064c2f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:44.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.900+0000 7f36ddd9b640 1 --2- 172.21.15.63:0/1010068521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5610647e7390 0x561064c2fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:44.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.901+0000 7f36ded9d640 1 -- 172.21.15.63:0/1010068521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610647df1b0 msgr2=0x561064c2f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:44.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.901+0000 7f36ded9d640 1 --2- 172.21.15.63:0/1010068521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610647df1b0 0x561064c2f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.901+0000 7f36ded9d640 1 -- 172.21.15.63:0/1010068521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5610647e7390 msgr2=0x561064c2fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:44.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.901+0000 7f36ded9d640 1 --2- 172.21.15.63:0/1010068521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5610647e7390 0x561064c2fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.901+0000 7f36ded9d640 1 -- 172.21.15.63:0/1010068521 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561064bced50 con 0x561064808070 2024-09-21T06:33:44.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.901+0000 7f36ded9d640 1 --2- 172.21.15.63:0/1010068521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561064808070 0x561064bce5e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x561064c315f0 tx=0x7f36d002afc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1ca41a3e41bf18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:44.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.901+0000 7f36c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:33:44.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.901+0000 7f36c5ffb640 1 -- 172.21.15.63:0/1010068521 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d0058040 con 0x561064808070 2024-09-21T06:33:44.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.901+0000 7f36c5ffb640 1 -- 172.21.15.63:0/1010068521 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f36d0004b40 con 0x561064808070 2024-09-21T06:33:44.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.901+0000 7f36ead8f740 1 -- 172.21.15.63:0/1010068521 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36c8004c50 con 0x561064808070 2024-09-21T06:33:44.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.901+0000 7f36c5ffb640 1 -- 172.21.15.63:0/1010068521 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f36d006b050 con 0x561064808070 2024-09-21T06:33:44.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.901+0000 7f36ead8f740 10 client.16653 fetch_fsmap learned FSMap version 50 2024-09-21T06:33:44.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.901+0000 7f36ead8f740 1 -- 172.21.15.63:0/1010068521 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x561064c37fa0 con 0x561064808070 2024-09-21T06:33:44.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.902+0000 7f36c5ffb640 1 -- 172.21.15.63:0/1010068521 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36c8004c50 con 0x561064808070 2024-09-21T06:33:44.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.902+0000 7f36c5ffb640 1 -- 172.21.15.63:0/1010068521 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 50) ==== 8406+0+0 (secure 0 0 0) 0x7f36d0066030 con 0x561064808070 2024-09-21T06:33:44.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.902+0000 7f36ead8f740 10 client.16653 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T06:33:44.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.902+0000 7f36ead8f740 10 client.16653 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:33:44.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.902+0000 7f36ead8f740 20 client.16653 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:44.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.902+0000 7f36ead8f740 1 --2- 172.21.15.63:0/1010068521 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56106479bda0 0x561064c3a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:44.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.902+0000 7f36ead8f740 4 client.16653 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:33:44.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.902+0000 7f36ead8f740 1 -- 172.21.15.63:0/1010068521 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561064b238a0 con 0x56106479bda0 2024-09-21T06:33:44.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.902+0000 7f36ddd9b640 1 --2- 172.21.15.63:0/1010068521 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56106479bda0 0x561064c3a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:44.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.903+0000 7f36c5ffb640 10 client.16653 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:33:44.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.903+0000 7f36ddd9b640 1 --2- 172.21.15.63:0/1010068521 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56106479bda0 0x561064c3a730 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ae6368574725fec server_cookie=2fbf8871d0307b3b in_seq=0 out_seq=0 2024-09-21T06:33:44.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.903+0000 7f36c5ffb640 1 -- 172.21.15.63:0/1010068521 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561064b238a0 con 0x56106479bda0 2024-09-21T06:33:44.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.903+0000 7f36c5ffb640 10 client.16653 handle_command_reply: tid=0 2024-09-21T06:33:44.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.903+0000 7f36ead8f740 1 client.16653 shutdown 2024-09-21T06:33:44.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.903+0000 7f36ead8f740 1 -- 172.21.15.63:0/1010068521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561064808070 msgr2=0x561064bce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:44.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.903+0000 7f36ead8f740 1 --2- 172.21.15.63:0/1010068521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561064808070 0x561064bce5e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x561064c315f0 tx=0x7f36d002afc0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.903+0000 7f36ead8f740 1 -- 172.21.15.63:0/1010068521 shutdown_connections 2024-09-21T06:33:44.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.903+0000 7f36ead8f740 1 --2- 172.21.15.63:0/1010068521 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x56106479bda0 0x561064c3a730 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.903+0000 7f36ead8f740 1 --2- 172.21.15.63:0/1010068521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561064808070 0x561064bce5e0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.903+0000 7f36ead8f740 1 --2- 172.21.15.63:0/1010068521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5610647e7390 0x561064c2fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.903+0000 7f36ead8f740 1 --2- 172.21.15.63:0/1010068521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610647df1b0 0x561064c2f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.903+0000 7f36ead8f740 1 -- 172.21.15.63:0/1010068521 >> 172.21.15.63:0/1010068521 conn(0x5610647fc460 msgr2=0x561064bb0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:44.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.903+0000 7f36c5ffb640 0 client.16653 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:33:44.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.903+0000 7f36ead8f740 1 -- 172.21.15.63:0/1010068521 shutdown_connections 2024-09-21T06:33:44.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.903+0000 7f36ead8f740 1 -- 172.21.15.63:0/1010068521 wait complete. 2024-09-21T06:33:44.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.903+0000 7f36ead8f740 20 client.16653 trim_cache size 0 max 16384 2024-09-21T06:33:44.912 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:33:44.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.904+0000 7f36e481b640 1 -- 172.21.15.63:0/2892273584 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f36cc0b6680 msgr2=0x7f36cc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:44.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.904+0000 7f36e481b640 1 --2- 172.21.15.63:0/2892273584 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f36cc0b6680 0x7f36cc0b8b90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f36d80e4a10 tx=0x7f36d80046c0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.904+0000 7f36e481b640 1 -- 172.21.15.63:0/2892273584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36e0102a60 msgr2=0x7f36e019a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:44.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.904+0000 7f36e481b640 1 --2- 172.21.15.63:0/2892273584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36e0102a60 0x7f36e019a3e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f36d800d770 tx=0x7f36d800dc30 comp rx=0 tx=0).stop 2024-09-21T06:33:44.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.904+0000 7f36e481b640 1 -- 172.21.15.63:0/2892273584 shutdown_connections 2024-09-21T06:33:44.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.904+0000 7f36e481b640 1 --2- 172.21.15.63:0/2892273584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e0108cf0 0x7f36e019fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.904+0000 7f36e481b640 1 --2- 172.21.15.63:0/2892273584 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f36cc0b6680 0x7f36cc0b8b90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.904+0000 7f36e481b640 1 --2- 172.21.15.63:0/2892273584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36e01083a0 0x7f36e019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.904+0000 7f36e481b640 1 --2- 172.21.15.63:0/2892273584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36e0102a60 0x7f36e019a3e0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:44.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.904+0000 7f36e481b640 1 -- 172.21.15.63:0/2892273584 >> 172.21.15.63:0/2892273584 conn(0x7f36e0079730 msgr2=0x7f36e006b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:44.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.904+0000 7f36e481b640 1 -- 172.21.15.63:0/2892273584 shutdown_connections 2024-09-21T06:33:44.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:44.904+0000 7f36e481b640 1 -- 172.21.15.63:0/2892273584 wait complete. 2024-09-21T06:33:45.616 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:33:45.875 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:45.997 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:45 smithi063 ceph-mon[31150]: pgmap v489: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 124 KiB/s wr, 21 op/s 2024-09-21T06:33:46.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:45 smithi071 ceph-mon[34844]: pgmap v489: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 124 KiB/s wr, 21 op/s 2024-09-21T06:33:46.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:45 smithi175 ceph-mon[34510]: pgmap v489: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 124 KiB/s wr, 21 op/s 2024-09-21T06:33:46.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.343+0000 7f5847023640 1 -- 172.21.15.63:0/3056846355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5840104a30 msgr2=0x7f5840104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:46.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.343+0000 7f5847023640 1 --2- 172.21.15.63:0/3056846355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5840104a30 0x7f5840104e40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5834009900 tx=0x7f583402a410 comp rx=0 tx=0).stop 2024-09-21T06:33:46.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.343+0000 7f5847023640 1 -- 172.21.15.63:0/3056846355 shutdown_connections 2024-09-21T06:33:46.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.343+0000 7f5847023640 1 --2- 172.21.15.63:0/3056846355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f584010de60 0x7f5840110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.343+0000 7f5847023640 1 --2- 172.21.15.63:0/3056846355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5840105380 0x7f584010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.343+0000 7f5847023640 1 --2- 172.21.15.63:0/3056846355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5840104a30 0x7f5840104e40 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.343+0000 7f5847023640 1 -- 172.21.15.63:0/3056846355 >> 172.21.15.63:0/3056846355 conn(0x7f5840079760 msgr2=0x7f5840079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:46.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.343+0000 7f5847023640 1 -- 172.21.15.63:0/3056846355 shutdown_connections 2024-09-21T06:33:46.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.343+0000 7f5847023640 1 -- 172.21.15.63:0/3056846355 wait complete. 2024-09-21T06:33:46.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.343+0000 7f5847023640 1 Processor -- start 2024-09-21T06:33:46.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.343+0000 7f5847023640 1 -- start start 2024-09-21T06:33:46.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.344+0000 7f5847023640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5840104a30 0x7f584019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:46.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.344+0000 7f5847023640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5840105380 0x7f584019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:46.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.344+0000 7f5847023640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f584010de60 0x7f584019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:46.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.344+0000 7f5847023640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5840113aa0 con 0x7f5840105380 2024-09-21T06:33:46.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.344+0000 7f5847023640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5840113920 con 0x7f5840104a30 2024-09-21T06:33:46.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.344+0000 7f5847023640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5840113c20 con 0x7f584010de60 2024-09-21T06:33:46.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.344+0000 7f583ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5840105380 0x7f584019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:46.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.344+0000 7f583ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5840105380 0x7f584019aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38810/0 (socket says 172.21.15.63:38810) 2024-09-21T06:33:46.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.344+0000 7f583ffff640 1 -- 172.21.15.63:0/1511124018 learned_addr learned my addr 172.21.15.63:0/1511124018 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:46.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.344+0000 7f58455c0640 1 --2- 172.21.15.63:0/1511124018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f584010de60 0x7f584019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:46.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.344+0000 7f5844dbf640 1 --2- 172.21.15.63:0/1511124018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5840104a30 0x7f584019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:46.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.344+0000 7f583ffff640 1 -- 172.21.15.63:0/1511124018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f584010de60 msgr2=0x7f584019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:46.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.344+0000 7f583ffff640 1 --2- 172.21.15.63:0/1511124018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f584010de60 0x7f584019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.344+0000 7f583ffff640 1 -- 172.21.15.63:0/1511124018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5840104a30 msgr2=0x7f584019a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:46.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.344+0000 7f583ffff640 1 --2- 172.21.15.63:0/1511124018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5840104a30 0x7f584019a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.344+0000 7f583ffff640 1 -- 172.21.15.63:0/1511124018 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58401a0460 con 0x7f5840105380 2024-09-21T06:33:46.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.344+0000 7f5844dbf640 1 --2- 172.21.15.63:0/1511124018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5840104a30 0x7f584019a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:33:46.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.344+0000 7f583ffff640 1 --2- 172.21.15.63:0/1511124018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5840105380 0x7f584019aa90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f582c00c970 tx=0x7f582c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:46.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.345+0000 7f583dffb640 1 -- 172.21.15.63:0/1511124018 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c007bb0 con 0x7f5840105380 2024-09-21T06:33:46.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.345+0000 7f5847023640 1 -- 172.21.15.63:0/1511124018 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58401a0750 con 0x7f5840105380 2024-09-21T06:33:46.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.345+0000 7f583dffb640 1 -- 172.21.15.63:0/1511124018 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f582c007d50 con 0x7f5840105380 2024-09-21T06:33:46.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.345+0000 7f583dffb640 1 -- 172.21.15.63:0/1511124018 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c004e10 con 0x7f5840105380 2024-09-21T06:33:46.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.345+0000 7f5847023640 1 -- 172.21.15.63:0/1511124018 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58401a6eb0 con 0x7f5840105380 2024-09-21T06:33:46.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.348+0000 7f584d597740 1 Processor -- start 2024-09-21T06:33:46.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.348+0000 7f583dffb640 1 -- 172.21.15.63:0/1511124018 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f582c005000 con 0x7f5840105380 2024-09-21T06:33:46.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.348+0000 7f584d597740 1 -- start start 2024-09-21T06:33:46.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.348+0000 7f584d597740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5e5070 0x558a6e98c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:46.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.348+0000 7f584d597740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5bc1b0 0x558a6e98cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:46.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.348+0000 7f584d597740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5c4390 0x558a6e98d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:46.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.348+0000 7f584d597740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558a6e902ea0 con 0x558a6e5c4390 2024-09-21T06:33:46.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.348+0000 7f584d597740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558a6e8f22d0 con 0x558a6e5e5070 2024-09-21T06:33:46.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.348+0000 7f584d597740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558a6e8f60e0 con 0x558a6e5bc1b0 2024-09-21T06:33:46.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.348+0000 7f583ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5c4390 0x558a6e98d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:46.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.348+0000 7f583ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5c4390 0x558a6e98d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38822/0 (socket says 172.21.15.63:38822) 2024-09-21T06:33:46.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.348+0000 7f583ffff640 1 -- 172.21.15.63:0/2195177452 learned_addr learned my addr 172.21.15.63:0/2195177452 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:46.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.348+0000 7f58455c0640 1 --2- 172.21.15.63:0/2195177452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5e5070 0x558a6e98c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:46.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.348+0000 7f5844dbf640 1 --2- 172.21.15.63:0/2195177452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5bc1b0 0x558a6e98cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:46.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.349+0000 7f583ffff640 1 -- 172.21.15.63:0/2195177452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5bc1b0 msgr2=0x558a6e98cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:46.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.349+0000 7f583ffff640 1 --2- 172.21.15.63:0/2195177452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5bc1b0 0x558a6e98cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.349+0000 7f583ffff640 1 -- 172.21.15.63:0/2195177452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5e5070 msgr2=0x558a6e98c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:46.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.349+0000 7f583ffff640 1 --2- 172.21.15.63:0/2195177452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5e5070 0x558a6e98c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.349+0000 7f583ffff640 1 -- 172.21.15.63:0/2195177452 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a6e650650 con 0x558a6e5c4390 2024-09-21T06:33:46.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.349+0000 7f58455c0640 1 --2- 172.21.15.63:0/2195177452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5e5070 0x558a6e98c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:33:46.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.349+0000 7f583dffb640 1 --2- 172.21.15.63:0/1511124018 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f58300b6680 0x7f58300b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:46.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.349+0000 7f583ffff640 1 --2- 172.21.15.63:0/2195177452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5c4390 0x558a6e98d120 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f582c0e4b50 tx=0x7f582c0edb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ee26fc9ece3980 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:46.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.349+0000 7f58455c0640 1 --2- 172.21.15.63:0/1511124018 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f58300b6680 0x7f58300b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:46.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.349+0000 7f583dffb640 1 -- 172.21.15.63:0/1511124018 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f582c0e74b0 con 0x7f5840105380 2024-09-21T06:33:46.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.349+0000 7f582affd640 1 -- 172.21.15.63:0/2195177452 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c0a9930 con 0x558a6e5c4390 2024-09-21T06:33:46.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.349+0000 7f582affd640 1 -- 172.21.15.63:0/2195177452 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f582c0acdf0 con 0x558a6e5c4390 2024-09-21T06:33:46.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.349+0000 7f582affd640 1 -- 172.21.15.63:0/2195177452 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c0aca50 con 0x558a6e5c4390 2024-09-21T06:33:46.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.350+0000 7f584d597740 1 -- 172.21.15.63:0/2195177452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5c4390 msgr2=0x558a6e98d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:46.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.350+0000 7f584d597740 1 --2- 172.21.15.63:0/2195177452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5c4390 0x558a6e98d120 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f582c0e4b50 tx=0x7f582c0edb20 comp rx=0 tx=0).stop 2024-09-21T06:33:46.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.350+0000 7f58455c0640 1 --2- 172.21.15.63:0/1511124018 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f58300b6680 0x7f58300b8b90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5838005fd0 tx=0x7f5838009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:46.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.350+0000 7f584d597740 1 -- 172.21.15.63:0/2195177452 shutdown_connections 2024-09-21T06:33:46.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.350+0000 7f584d597740 1 --2- 172.21.15.63:0/2195177452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5c4390 0x558a6e98d120 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.350+0000 7f584d597740 1 --2- 172.21.15.63:0/2195177452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5bc1b0 0x558a6e98cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.350+0000 7f584d597740 1 --2- 172.21.15.63:0/2195177452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5e5070 0x558a6e98c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.350+0000 7f584d597740 1 -- 172.21.15.63:0/2195177452 >> 172.21.15.63:0/2195177452 conn(0x558a6e5d9460 msgr2=0x558a6e98a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:46.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.350+0000 7f584d597740 1 -- 172.21.15.63:0/2195177452 shutdown_connections 2024-09-21T06:33:46.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.350+0000 7f584d597740 1 -- 172.21.15.63:0/2195177452 wait complete. 2024-09-21T06:33:46.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.351+0000 7f584d597740 1 -- start start 2024-09-21T06:33:46.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.351+0000 7f584d597740 1 Processor -- start 2024-09-21T06:33:46.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.351+0000 7f584d597740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5bc1b0 0x558a6e997d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:46.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.351+0000 7f584d597740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5c4390 0x558a6e9982d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:46.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.351+0000 7f584d597740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5e5070 0x558a6e9a4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:46.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.351+0000 7f584d597740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558a6e753700 con 0x558a6e5e5070 2024-09-21T06:33:46.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.351+0000 7f584d597740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558a6e88d160 con 0x558a6e5bc1b0 2024-09-21T06:33:46.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.351+0000 7f584d597740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558a6e99ae80 con 0x558a6e5c4390 2024-09-21T06:33:46.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.352+0000 7f584d597740 10 client.0 _ll_register_callbacks cb 0x558a6e8a69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:46.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.352+0000 7f58455c0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5e5070 0x558a6e9a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:46.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.352+0000 7f58455c0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5e5070 0x558a6e9a4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38830/0 (socket says 172.21.15.63:38830) 2024-09-21T06:33:46.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.352+0000 7f58455c0640 1 -- 172.21.15.63:0/2152109427 learned_addr learned my addr 172.21.15.63:0/2152109427 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:46.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.352+0000 7f583ffff640 1 --2- 172.21.15.63:0/2152109427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5c4390 0x558a6e9982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:46.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.352+0000 7f5844dbf640 1 --2- 172.21.15.63:0/2152109427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5bc1b0 0x558a6e997d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:46.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.352+0000 7f58455c0640 1 -- 172.21.15.63:0/2152109427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5c4390 msgr2=0x558a6e9982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:46.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.352+0000 7f58455c0640 1 --2- 172.21.15.63:0/2152109427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5c4390 0x558a6e9982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.352+0000 7f58455c0640 1 -- 172.21.15.63:0/2152109427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5bc1b0 msgr2=0x558a6e997d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:46.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.352+0000 7f58455c0640 1 --2- 172.21.15.63:0/2152109427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5bc1b0 0x558a6e997d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.352+0000 7f58455c0640 1 -- 172.21.15.63:0/2152109427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a6e8bac90 con 0x558a6e5e5070 2024-09-21T06:33:46.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.352+0000 7f583ffff640 1 --2- 172.21.15.63:0/2152109427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5c4390 0x558a6e9982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:33:46.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.352+0000 7f58455c0640 1 --2- 172.21.15.63:0/2152109427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5e5070 0x558a6e9a4170 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5838009b40 tx=0x7f5838004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1a4263f9921510 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:46.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.352+0000 7f581ffff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:33:46.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.352+0000 7f581ffff640 1 -- 172.21.15.63:0/2152109427 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5838020620 con 0x558a6e5e5070 2024-09-21T06:33:46.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.353+0000 7f581ffff640 1 -- 172.21.15.63:0/2152109427 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f58380207c0 con 0x558a6e5e5070 2024-09-21T06:33:46.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.353+0000 7f584d597740 1 -- 172.21.15.63:0/2152109427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f582c0acdf0 con 0x558a6e5e5070 2024-09-21T06:33:46.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.353+0000 7f581ffff640 1 -- 172.21.15.63:0/2152109427 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f5838011e90 con 0x558a6e5e5070 2024-09-21T06:33:46.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.353+0000 7f584d597740 10 client.16665 fetch_fsmap learned FSMap version 50 2024-09-21T06:33:46.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.353+0000 7f584d597740 1 -- 172.21.15.63:0/2152109427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x558a6e9a6c20 con 0x558a6e5e5070 2024-09-21T06:33:46.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.353+0000 7f581ffff640 1 -- 172.21.15.63:0/2152109427 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f582c0acdf0 con 0x558a6e5e5070 2024-09-21T06:33:46.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.353+0000 7f581ffff640 1 -- 172.21.15.63:0/2152109427 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 50) ==== 8406+0+0 (secure 0 0 0) 0x7f583800f040 con 0x558a6e5e5070 2024-09-21T06:33:46.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.353+0000 7f584d597740 10 client.16665 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T06:33:46.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.353+0000 7f584d597740 10 client.16665 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:33:46.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.353+0000 7f584d597740 20 client.16665 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:46.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.353+0000 7f584d597740 1 --2- 172.21.15.63:0/2152109427 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x558a6e5a39f0 0x558a6e9aa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:46.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.353+0000 7f584d597740 4 client.16665 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:33:46.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.353+0000 7f584d597740 1 -- 172.21.15.63:0/2152109427 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a6e904df0 con 0x558a6e5a39f0 2024-09-21T06:33:46.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.354+0000 7f5844dbf640 1 --2- 172.21.15.63:0/2152109427 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x558a6e5a39f0 0x558a6e9aa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:46.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.354+0000 7f581ffff640 10 client.16665 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:33:46.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.354+0000 7f5844dbf640 1 --2- 172.21.15.63:0/2152109427 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x558a6e5a39f0 0x558a6e9aa1b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f8b41c950eb45350 server_cookie=fae6c4e79d7b7690 in_seq=0 out_seq=0 2024-09-21T06:33:46.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.355+0000 7f581ffff640 1 -- 172.21.15.63:0/2152109427 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558a6e904df0 con 0x558a6e5a39f0 2024-09-21T06:33:46.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.355+0000 7f581ffff640 10 client.16665 handle_command_reply: tid=0 2024-09-21T06:33:46.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.355+0000 7f584d597740 1 client.16665 shutdown 2024-09-21T06:33:46.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.355+0000 7f584d597740 1 -- 172.21.15.63:0/2152109427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5e5070 msgr2=0x558a6e9a4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:46.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.355+0000 7f584d597740 1 --2- 172.21.15.63:0/2152109427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5e5070 0x558a6e9a4170 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5838009b40 tx=0x7f5838004a40 comp rx=0 tx=0).stop 2024-09-21T06:33:46.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.355+0000 7f584d597740 1 -- 172.21.15.63:0/2152109427 shutdown_connections 2024-09-21T06:33:46.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.355+0000 7f584d597740 1 --2- 172.21.15.63:0/2152109427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5e5070 0x558a6e9a4170 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.355+0000 7f584d597740 1 --2- 172.21.15.63:0/2152109427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5c4390 0x558a6e9982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.355+0000 7f584d597740 1 --2- 172.21.15.63:0/2152109427 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x558a6e5a39f0 0x558a6e9aa1b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.355+0000 7f584d597740 1 --2- 172.21.15.63:0/2152109427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5bc1b0 0x558a6e997d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.355+0000 7f581ffff640 0 client.16665 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:33:46.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.355+0000 7f584d597740 1 -- 172.21.15.63:0/2152109427 >> 172.21.15.63:0/2152109427 conn(0x558a6e5d9460 msgr2=0x558a6e98f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:46.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.355+0000 7f584d597740 1 -- 172.21.15.63:0/2152109427 shutdown_connections 2024-09-21T06:33:46.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.355+0000 7f584d597740 1 -- 172.21.15.63:0/2152109427 wait complete. 2024-09-21T06:33:46.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.355+0000 7f584d597740 20 client.16665 trim_cache size 0 max 16384 2024-09-21T06:33:46.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.369+0000 7f584d597740 1 Processor -- start 2024-09-21T06:33:46.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.369+0000 7f584d597740 1 -- start start 2024-09-21T06:33:46.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.369+0000 7f584d597740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5bc1b0 0x558a6e98feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:46.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.369+0000 7f584d597740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5c4390 0x558a6e9a4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:46.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.369+0000 7f584d597740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5e5070 0x558a6e989eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:46.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.369+0000 7f584d597740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f58401af870 con 0x558a6e5c4390 2024-09-21T06:33:46.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.369+0000 7f584d597740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58401b1500 con 0x558a6e5e5070 2024-09-21T06:33:46.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.369+0000 7f584d597740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f58401affd0 con 0x558a6e5bc1b0 2024-09-21T06:33:46.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.369+0000 7f583ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5c4390 0x558a6e9a4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:46.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.369+0000 7f583ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5c4390 0x558a6e9a4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38842/0 (socket says 172.21.15.63:38842) 2024-09-21T06:33:46.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.369+0000 7f583ffff640 1 -- 172.21.15.63:0/1450936167 learned_addr learned my addr 172.21.15.63:0/1450936167 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:46.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.370+0000 7f5844dbf640 1 --2- 172.21.15.63:0/1450936167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5bc1b0 0x558a6e98feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:46.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.370+0000 7f583ffff640 1 -- 172.21.15.63:0/1450936167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5bc1b0 msgr2=0x558a6e98feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:46.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.370+0000 7f583ffff640 1 --2- 172.21.15.63:0/1450936167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5bc1b0 0x558a6e98feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.370+0000 7f58455c0640 1 --2- 172.21.15.63:0/1450936167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5e5070 0x558a6e989eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:46.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.370+0000 7f583ffff640 1 -- 172.21.15.63:0/1450936167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5e5070 msgr2=0x558a6e989eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:46.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.370+0000 7f583ffff640 1 --2- 172.21.15.63:0/1450936167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5e5070 0x558a6e989eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.370+0000 7f583ffff640 1 -- 172.21.15.63:0/1450936167 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a6e98e990 con 0x558a6e5c4390 2024-09-21T06:33:46.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.370+0000 7f5844dbf640 1 --2- 172.21.15.63:0/1450936167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5bc1b0 0x558a6e98feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:33:46.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.370+0000 7f58455c0640 1 --2- 172.21.15.63:0/1450936167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5e5070 0x558a6e989eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:33:46.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.370+0000 7f583ffff640 1 --2- 172.21.15.63:0/1450936167 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5c4390 0x558a6e9a4070 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f582c00c940 tx=0x7f582c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd97bf8b7505a53 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:46.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.370+0000 7f582a7fc640 1 -- 172.21.15.63:0/1450936167 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c01d040 con 0x558a6e5c4390 2024-09-21T06:33:46.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.370+0000 7f582a7fc640 1 -- 172.21.15.63:0/1450936167 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f582c0eadd0 con 0x558a6e5c4390 2024-09-21T06:33:46.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.370+0000 7f582a7fc640 1 -- 172.21.15.63:0/1450936167 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c0acc30 con 0x558a6e5c4390 2024-09-21T06:33:46.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.371+0000 7f584d597740 1 -- 172.21.15.63:0/1450936167 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5c4390 msgr2=0x558a6e9a4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:46.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.371+0000 7f584d597740 1 --2- 172.21.15.63:0/1450936167 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5c4390 0x558a6e9a4070 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f582c00c940 tx=0x7f582c000bc0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.371+0000 7f584d597740 1 -- 172.21.15.63:0/1450936167 shutdown_connections 2024-09-21T06:33:46.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.371+0000 7f584d597740 1 --2- 172.21.15.63:0/1450936167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5e5070 0x558a6e989eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.371+0000 7f584d597740 1 --2- 172.21.15.63:0/1450936167 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5c4390 0x558a6e9a4070 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.371+0000 7f584d597740 1 --2- 172.21.15.63:0/1450936167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5bc1b0 0x558a6e98feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.371+0000 7f584d597740 1 -- 172.21.15.63:0/1450936167 >> 172.21.15.63:0/1450936167 conn(0x558a6e5d9460 msgr2=0x558a6e98f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:46.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.371+0000 7f584d597740 1 -- 172.21.15.63:0/1450936167 shutdown_connections 2024-09-21T06:33:46.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.371+0000 7f584d597740 1 -- 172.21.15.63:0/1450936167 wait complete. 2024-09-21T06:33:46.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.371+0000 7f584d597740 1 -- start start 2024-09-21T06:33:46.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.372+0000 7f584d597740 1 Processor -- start 2024-09-21T06:33:46.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.372+0000 7f584d597740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5bc1b0 0x558a6e9a0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:46.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.372+0000 7f584d597740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5c4390 0x558a6e99bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:46.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.372+0000 7f584d597740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5e5070 0x558a6e99c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:46.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.372+0000 7f584d597740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f58401b0e30 con 0x558a6e5e5070 2024-09-21T06:33:46.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.372+0000 7f584d597740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58401b0730 con 0x558a6e5bc1b0 2024-09-21T06:33:46.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.372+0000 7f584d597740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f58401ad850 con 0x558a6e5c4390 2024-09-21T06:33:46.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.372+0000 7f584d597740 10 client.0 _ll_register_callbacks cb 0x7f5838009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:46.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.372+0000 7f58455c0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5e5070 0x558a6e99c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:46.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.372+0000 7f5844dbf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5bc1b0 0x558a6e9a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:46.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.372+0000 7f5844dbf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5bc1b0 0x558a6e9a0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:39454/0 (socket says 172.21.15.63:39454) 2024-09-21T06:33:46.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.372+0000 7f5844dbf640 1 -- 172.21.15.63:0/3471153285 learned_addr learned my addr 172.21.15.63:0/3471153285 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:46.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.372+0000 7f583ffff640 1 --2- 172.21.15.63:0/3471153285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5c4390 0x558a6e99bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:46.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.373+0000 7f5844dbf640 1 -- 172.21.15.63:0/3471153285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5c4390 msgr2=0x558a6e99bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:46.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.373+0000 7f5844dbf640 1 --2- 172.21.15.63:0/3471153285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5c4390 0x558a6e99bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.373+0000 7f5844dbf640 1 -- 172.21.15.63:0/3471153285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5e5070 msgr2=0x558a6e99c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:46.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.373+0000 7f5844dbf640 1 --2- 172.21.15.63:0/3471153285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5e5070 0x558a6e99c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.373+0000 7f5844dbf640 1 -- 172.21.15.63:0/3471153285 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a6e99c9f0 con 0x558a6e5bc1b0 2024-09-21T06:33:46.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.373+0000 7f5844dbf640 1 --2- 172.21.15.63:0/3471153285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5bc1b0 0x558a6e9a0890 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5834005ab0 tx=0x7f5834004180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7525a17b9e84a09b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:46.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.373+0000 7f581ffff640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:33:46.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.373+0000 7f581ffff640 1 -- 172.21.15.63:0/3471153285 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5834035040 con 0x558a6e5bc1b0 2024-09-21T06:33:46.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.373+0000 7f584d597740 1 -- 172.21.15.63:0/3471153285 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f582c0eadd0 con 0x558a6e5bc1b0 2024-09-21T06:33:46.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.373+0000 7f581ffff640 1 -- 172.21.15.63:0/3471153285 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f5834005240 con 0x558a6e5bc1b0 2024-09-21T06:33:46.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.373+0000 7f581ffff640 1 -- 172.21.15.63:0/3471153285 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f5834053050 con 0x558a6e5bc1b0 2024-09-21T06:33:46.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.374+0000 7f584d597740 10 client.26294 fetch_fsmap learned FSMap version 50 2024-09-21T06:33:46.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.374+0000 7f584d597740 1 -- 172.21.15.63:0/3471153285 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x558a6ea149f0 con 0x558a6e5bc1b0 2024-09-21T06:33:46.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.374+0000 7f581ffff640 1 -- 172.21.15.63:0/3471153285 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f582c0eadd0 con 0x558a6e5bc1b0 2024-09-21T06:33:46.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.374+0000 7f581ffff640 1 -- 172.21.15.63:0/3471153285 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 50) ==== 8406+0+0 (secure 0 0 0) 0x7f5834031620 con 0x558a6e5bc1b0 2024-09-21T06:33:46.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.374+0000 7f584d597740 10 client.26294 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T06:33:46.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.374+0000 7f584d597740 10 client.26294 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:33:46.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.374+0000 7f584d597740 20 client.26294 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:46.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.374+0000 7f584d597740 1 --2- 172.21.15.63:0/3471153285 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x558a6e578da0 0x558a6ea17270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:46.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.374+0000 7f584d597740 4 client.26294 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:33:46.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.374+0000 7f584d597740 1 -- 172.21.15.63:0/3471153285 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558a6e9008a0 con 0x558a6e578da0 2024-09-21T06:33:46.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.374+0000 7f583ffff640 1 --2- 172.21.15.63:0/3471153285 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x558a6e578da0 0x558a6ea17270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:46.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.375+0000 7f581ffff640 10 client.26294 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:33:46.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.375+0000 7f583ffff640 1 --2- 172.21.15.63:0/3471153285 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x558a6e578da0 0x558a6ea17270 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cc048533c97b3d25 server_cookie=4d481bbfbd0c59b9 in_seq=0 out_seq=0 2024-09-21T06:33:46.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.375+0000 7f581ffff640 1 -- 172.21.15.63:0/3471153285 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558a6e9008a0 con 0x558a6e578da0 2024-09-21T06:33:46.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.375+0000 7f581ffff640 10 client.26294 handle_command_reply: tid=0 2024-09-21T06:33:46.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.375+0000 7f584d597740 1 client.26294 shutdown 2024-09-21T06:33:46.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.375+0000 7f584d597740 1 -- 172.21.15.63:0/3471153285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5bc1b0 msgr2=0x558a6e9a0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:46.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.375+0000 7f584d597740 1 --2- 172.21.15.63:0/3471153285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5bc1b0 0x558a6e9a0890 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5834005ab0 tx=0x7f5834004180 comp rx=0 tx=0).stop 2024-09-21T06:33:46.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.376+0000 7f584d597740 1 -- 172.21.15.63:0/3471153285 shutdown_connections 2024-09-21T06:33:46.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.376+0000 7f584d597740 1 --2- 172.21.15.63:0/3471153285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558a6e5e5070 0x558a6e99c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.376+0000 7f584d597740 1 --2- 172.21.15.63:0/3471153285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558a6e5c4390 0x558a6e99bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.376+0000 7f584d597740 1 --2- 172.21.15.63:0/3471153285 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x558a6e578da0 0x558a6ea17270 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.376+0000 7f584d597740 1 --2- 172.21.15.63:0/3471153285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558a6e5bc1b0 0x558a6e9a0890 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.376+0000 7f581ffff640 0 client.26294 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:33:46.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.376+0000 7f584d597740 1 -- 172.21.15.63:0/3471153285 >> 172.21.15.63:0/3471153285 conn(0x558a6e5d9460 msgr2=0x558a6e997b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:46.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.376+0000 7f584d597740 1 -- 172.21.15.63:0/3471153285 shutdown_connections 2024-09-21T06:33:46.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.376+0000 7f584d597740 1 -- 172.21.15.63:0/3471153285 wait complete. 2024-09-21T06:33:46.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.376+0000 7f584d597740 20 client.26294 trim_cache size 0 max 16384 2024-09-21T06:33:46.382 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:33:46.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.376+0000 7f5847023640 1 -- 172.21.15.63:0/1511124018 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f58300b6680 msgr2=0x7f58300b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:46.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.376+0000 7f5847023640 1 --2- 172.21.15.63:0/1511124018 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f58300b6680 0x7f58300b8b90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5838005fd0 tx=0x7f5838009600 comp rx=0 tx=0).stop 2024-09-21T06:33:46.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.376+0000 7f5847023640 1 -- 172.21.15.63:0/1511124018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5840105380 msgr2=0x7f584019aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:46.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.376+0000 7f5847023640 1 --2- 172.21.15.63:0/1511124018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5840105380 0x7f584019aa90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f582c00c970 tx=0x7f582c00ce30 comp rx=0 tx=0).stop 2024-09-21T06:33:46.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.376+0000 7f5847023640 1 -- 172.21.15.63:0/1511124018 shutdown_connections 2024-09-21T06:33:46.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.376+0000 7f5847023640 1 --2- 172.21.15.63:0/1511124018 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f58300b6680 0x7f58300b8b90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.376+0000 7f5847023640 1 --2- 172.21.15.63:0/1511124018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f584010de60 0x7f584019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.376+0000 7f5847023640 1 --2- 172.21.15.63:0/1511124018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5840105380 0x7f584019aa90 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.376+0000 7f5847023640 1 --2- 172.21.15.63:0/1511124018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5840104a30 0x7f584019a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:46.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.376+0000 7f5847023640 1 -- 172.21.15.63:0/1511124018 >> 172.21.15.63:0/1511124018 conn(0x7f5840079760 msgr2=0x7f58401008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:46.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.377+0000 7f5847023640 1 -- 172.21.15.63:0/1511124018 shutdown_connections 2024-09-21T06:33:46.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:46.377+0000 7f5847023640 1 -- 172.21.15.63:0/1511124018 wait complete. 2024-09-21T06:33:47.084 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:33:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:47.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.825+0000 7f7bf7c6f640 1 -- 172.21.15.63:0/2576081137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bf01083b0 msgr2=0x7f7bf01087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:47.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.825+0000 7f7bf7c6f640 1 --2- 172.21.15.63:0/2576081137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bf01083b0 0x7f7bf01087c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7be0009900 tx=0x7f7be002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.825+0000 7f7bf7c6f640 1 -- 172.21.15.63:0/2576081137 shutdown_connections 2024-09-21T06:33:47.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.825+0000 7f7bf7c6f640 1 --2- 172.21.15.63:0/2576081137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bf0108d00 0x7f7bf010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.825+0000 7f7bf7c6f640 1 --2- 172.21.15.63:0/2576081137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bf01083b0 0x7f7bf01087c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.825+0000 7f7bf7c6f640 1 --2- 172.21.15.63:0/2576081137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bf0102a70 0x7f7bf0102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.825+0000 7f7bf7c6f640 1 -- 172.21.15.63:0/2576081137 >> 172.21.15.63:0/2576081137 conn(0x7f7bf0079710 msgr2=0x7f7bf0079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:47.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.825+0000 7f7bf7c6f640 1 -- 172.21.15.63:0/2576081137 shutdown_connections 2024-09-21T06:33:47.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.825+0000 7f7bf7c6f640 1 -- 172.21.15.63:0/2576081137 wait complete. 2024-09-21T06:33:47.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.826+0000 7f7bf7c6f640 1 Processor -- start 2024-09-21T06:33:47.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.826+0000 7f7bf7c6f640 1 -- start start 2024-09-21T06:33:47.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.826+0000 7f7bf7c6f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bf0102a70 0x7f7bf00ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:47.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.826+0000 7f7bf7c6f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bf01083b0 0x7f7bf00ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:47.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.826+0000 7f7bf7c6f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bf0108d00 0x7f7bf0100070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:47.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.826+0000 7f7bf7c6f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf01129c0 con 0x7f7bf0108d00 2024-09-21T06:33:47.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.826+0000 7f7bf7c6f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf0112840 con 0x7f7bf01083b0 2024-09-21T06:33:47.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.826+0000 7f7bf7c6f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf0112b40 con 0x7f7bf0102a70 2024-09-21T06:33:47.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.826+0000 7f7bf620c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bf0108d00 0x7f7bf0100070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:47.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.826+0000 7f7bf620c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bf0108d00 0x7f7bf0100070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34562/0 (socket says 172.21.15.63:34562) 2024-09-21T06:33:47.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.826+0000 7f7bf620c640 1 -- 172.21.15.63:0/2685102963 learned_addr learned my addr 172.21.15.63:0/2685102963 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:47.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.826+0000 7f7bf5a0b640 1 --2- 172.21.15.63:0/2685102963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bf0102a70 0x7f7bf00ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:47.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.827+0000 7f7bf520a640 1 --2- 172.21.15.63:0/2685102963 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bf01083b0 0x7f7bf00ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:47.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.827+0000 7f7bf620c640 1 -- 172.21.15.63:0/2685102963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bf0102a70 msgr2=0x7f7bf00ff5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:47.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.827+0000 7f7bf620c640 1 --2- 172.21.15.63:0/2685102963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bf0102a70 0x7f7bf00ff5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.827+0000 7f7bf620c640 1 -- 172.21.15.63:0/2685102963 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bf01083b0 msgr2=0x7f7bf00ffb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:47.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.827+0000 7f7bf620c640 1 --2- 172.21.15.63:0/2685102963 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bf01083b0 0x7f7bf00ffb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.827+0000 7f7bf620c640 1 -- 172.21.15.63:0/2685102963 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf01a8670 con 0x7f7bf0108d00 2024-09-21T06:33:47.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.827+0000 7f7bf620c640 1 --2- 172.21.15.63:0/2685102963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bf0108d00 0x7f7bf0100070 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f7be800cce0 tx=0x7f7be800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:47.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.827+0000 7f7be6ffd640 1 -- 172.21.15.63:0/2685102963 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be800f450 con 0x7f7bf0108d00 2024-09-21T06:33:47.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.827+0000 7f7be6ffd640 1 -- 172.21.15.63:0/2685102963 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7be800faa0 con 0x7f7bf0108d00 2024-09-21T06:33:47.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.827+0000 7f7bf7c6f640 1 -- 172.21.15.63:0/2685102963 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf01a8960 con 0x7f7bf0108d00 2024-09-21T06:33:47.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.827+0000 7f7be6ffd640 1 -- 172.21.15.63:0/2685102963 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8018a80 con 0x7f7bf0108d00 2024-09-21T06:33:47.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.827+0000 7f7bf7c6f640 1 -- 172.21.15.63:0/2685102963 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf01a8e70 con 0x7f7bf0108d00 2024-09-21T06:33:47.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.831+0000 7f7bfe1e3740 1 Processor -- start 2024-09-21T06:33:47.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.831+0000 7f7be6ffd640 1 -- 172.21.15.63:0/2685102963 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f7be800fc50 con 0x7f7bf0108d00 2024-09-21T06:33:47.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.831+0000 7f7bfe1e3740 1 -- start start 2024-09-21T06:33:47.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.831+0000 7f7bfe1e3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563754459070 0x5637548002c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:47.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.831+0000 7f7bfe1e3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 0x563754800800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:47.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.831+0000 7f7bfe1e3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563754438390 0x563754800d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:47.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.831+0000 7f7bfe1e3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563754776ea0 con 0x5637544301b0 2024-09-21T06:33:47.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.831+0000 7f7bfe1e3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5637547662d0 con 0x563754438390 2024-09-21T06:33:47.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.831+0000 7f7bfe1e3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56375476a0e0 con 0x563754459070 2024-09-21T06:33:47.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.831+0000 7f7bf5a0b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 0x563754800800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:47.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.831+0000 7f7bf5a0b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 0x563754800800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34564/0 (socket says 172.21.15.63:34564) 2024-09-21T06:33:47.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.831+0000 7f7bf5a0b640 1 -- 172.21.15.63:0/1133190225 learned_addr learned my addr 172.21.15.63:0/1133190225 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:47.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.831+0000 7f7bf520a640 1 --2- 172.21.15.63:0/1133190225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563754459070 0x5637548002c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:47.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.832+0000 7f7bf520a640 1 --2- 172.21.15.63:0/1133190225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563754438390 0x563754800d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:47.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.832+0000 7f7bf5a0b640 1 -- 172.21.15.63:0/1133190225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563754459070 msgr2=0x5637548002c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:47.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.832+0000 7f7bf5a0b640 1 --2- 172.21.15.63:0/1133190225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563754459070 0x5637548002c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.832+0000 7f7be6ffd640 1 --2- 172.21.15.63:0/2685102963 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7bdc0b6700 0x7f7bdc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:47.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.832+0000 7f7bf5a0b640 1 -- 172.21.15.63:0/1133190225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563754438390 msgr2=0x563754800d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:47.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.832+0000 7f7bf5a0b640 1 --2- 172.21.15.63:0/1133190225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563754438390 0x563754800d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.832+0000 7f7bf5a0b640 1 -- 172.21.15.63:0/1133190225 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637544c4650 con 0x5637544301b0 2024-09-21T06:33:47.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.832+0000 7f7bf520a640 1 --2- 172.21.15.63:0/1133190225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563754438390 0x563754800d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:33:47.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.832+0000 7f7bf620c640 1 --2- 172.21.15.63:0/2685102963 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7bdc0b6700 0x7f7bdc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:47.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.832+0000 7f7bf5a0b640 1 --2- 172.21.15.63:0/1133190225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 0x563754800800 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00ac80 tx=0x7f7bec00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c964be58c4abc97 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:47.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.832+0000 7f7be6ffd640 1 -- 172.21.15.63:0/2685102963 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f7be80e7af0 con 0x7f7bf0108d00 2024-09-21T06:33:47.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.832+0000 7f7bdbfff640 1 -- 172.21.15.63:0/1133190225 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec01d070 con 0x5637544301b0 2024-09-21T06:33:47.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.832+0000 7f7bdbfff640 1 -- 172.21.15.63:0/1133190225 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bec018af0 con 0x5637544301b0 2024-09-21T06:33:47.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.832+0000 7f7bdbfff640 1 -- 172.21.15.63:0/1133190225 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec010b10 con 0x5637544301b0 2024-09-21T06:33:47.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.833+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/1133190225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 msgr2=0x563754800800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:47.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.833+0000 7f7bf620c640 1 --2- 172.21.15.63:0/2685102963 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7bdc0b6700 0x7f7bdc0b8c10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7be80e52d0 tx=0x7f7be807a5d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:47.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.833+0000 7f7bfe1e3740 1 --2- 172.21.15.63:0/1133190225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 0x563754800800 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00ac80 tx=0x7f7bec00f790 comp rx=0 tx=0).stop 2024-09-21T06:33:47.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.833+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/1133190225 shutdown_connections 2024-09-21T06:33:47.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.833+0000 7f7bfe1e3740 1 --2- 172.21.15.63:0/1133190225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563754438390 0x563754800d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.833+0000 7f7bfe1e3740 1 --2- 172.21.15.63:0/1133190225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 0x563754800800 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.833+0000 7f7bfe1e3740 1 --2- 172.21.15.63:0/1133190225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563754459070 0x5637548002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.833+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/1133190225 >> 172.21.15.63:0/1133190225 conn(0x56375444d460 msgr2=0x5637547fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:47.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.833+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/1133190225 shutdown_connections 2024-09-21T06:33:47.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.833+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/1133190225 wait complete. 2024-09-21T06:33:47.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.834+0000 7f7bfe1e3740 1 -- start start 2024-09-21T06:33:47.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.834+0000 7f7bfe1e3740 1 Processor -- start 2024-09-21T06:33:47.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bfe1e3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 0x56375480b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:47.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bfe1e3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563754438390 0x56375480bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:47.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bfe1e3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563754459070 0x563754817d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:47.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bfe1e3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5637545c7700 con 0x5637544301b0 2024-09-21T06:33:47.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bfe1e3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563754701160 con 0x563754459070 2024-09-21T06:33:47.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bfe1e3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56375480eaa0 con 0x563754438390 2024-09-21T06:33:47.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bfe1e3740 10 client.0 _ll_register_callbacks cb 0x56375471a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:47.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bf520a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 0x56375480b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:47.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bf520a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 0x56375480b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34566/0 (socket says 172.21.15.63:34566) 2024-09-21T06:33:47.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bf520a640 1 -- 172.21.15.63:0/625692107 learned_addr learned my addr 172.21.15.63:0/625692107 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:47.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bf5a0b640 1 --2- 172.21.15.63:0/625692107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563754438390 0x56375480bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:47.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bf520a640 1 -- 172.21.15.63:0/625692107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563754438390 msgr2=0x56375480bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:47.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bf520a640 1 --2- 172.21.15.63:0/625692107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563754438390 0x56375480bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bf520a640 1 -- 172.21.15.63:0/625692107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563754459070 msgr2=0x563754817d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:47.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bf520a640 1 --2- 172.21.15.63:0/625692107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563754459070 0x563754817d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bf520a640 1 -- 172.21.15.63:0/625692107 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56375472ec90 con 0x5637544301b0 2024-09-21T06:33:47.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bf5a0b640 1 --2- 172.21.15.63:0/625692107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563754438390 0x56375480bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:33:47.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bf520a640 1 --2- 172.21.15.63:0/625692107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 0x56375480b9d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f7be0009900 tx=0x7f7be0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757a093467fe476c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:47.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:33:47.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bd97fa640 1 -- 172.21.15.63:0/625692107 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be0035070 con 0x5637544301b0 2024-09-21T06:33:47.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bd97fa640 1 -- 172.21.15.63:0/625692107 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f7be0004300 con 0x5637544301b0 2024-09-21T06:33:47.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.835+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/625692107 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bec018af0 con 0x5637544301b0 2024-09-21T06:33:47.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.836+0000 7f7bd97fa640 1 -- 172.21.15.63:0/625692107 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f7be0005020 con 0x5637544301b0 2024-09-21T06:33:47.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.836+0000 7f7bfe1e3740 10 client.16683 fetch_fsmap learned FSMap version 50 2024-09-21T06:33:47.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.836+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/625692107 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x56375481a810 con 0x5637544301b0 2024-09-21T06:33:47.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.836+0000 7f7bd97fa640 1 -- 172.21.15.63:0/625692107 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bec018af0 con 0x5637544301b0 2024-09-21T06:33:47.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.836+0000 7f7bd97fa640 1 -- 172.21.15.63:0/625692107 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 50) ==== 8406+0+0 (secure 0 0 0) 0x7f7be0004c60 con 0x5637544301b0 2024-09-21T06:33:47.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.836+0000 7f7bfe1e3740 10 client.16683 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T06:33:47.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.836+0000 7f7bfe1e3740 10 client.16683 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:33:47.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.836+0000 7f7bfe1e3740 20 client.16683 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:47.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.836+0000 7f7bfe1e3740 1 --2- 172.21.15.63:0/625692107 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x5637544179f0 0x56375481dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:47.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.836+0000 7f7bfe1e3740 4 client.16683 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:33:47.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.836+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/625692107 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563754778df0 con 0x5637544179f0 2024-09-21T06:33:47.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.836+0000 7f7bf5a0b640 1 --2- 172.21.15.63:0/625692107 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x5637544179f0 0x56375481dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:47.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.837+0000 7f7bf5a0b640 1 --2- 172.21.15.63:0/625692107 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x5637544179f0 0x56375481dcc0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4b158ebabc460506 server_cookie=98b9e16c44181711 in_seq=0 out_seq=0 2024-09-21T06:33:47.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.837+0000 7f7bd97fa640 10 client.16683 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:33:47.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.838+0000 7f7bd97fa640 1 -- 172.21.15.63:0/625692107 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563754778df0 con 0x5637544179f0 2024-09-21T06:33:47.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.838+0000 7f7bd97fa640 10 client.16683 handle_command_reply: tid=0 2024-09-21T06:33:47.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.838+0000 7f7bfe1e3740 1 client.16683 shutdown 2024-09-21T06:33:47.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.838+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/625692107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 msgr2=0x56375480b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:47.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.838+0000 7f7bfe1e3740 1 --2- 172.21.15.63:0/625692107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 0x56375480b9d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f7be0009900 tx=0x7f7be0005850 comp rx=0 tx=0).stop 2024-09-21T06:33:47.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.838+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/625692107 shutdown_connections 2024-09-21T06:33:47.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.838+0000 7f7bfe1e3740 1 --2- 172.21.15.63:0/625692107 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x5637544179f0 0x56375481dcc0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.838+0000 7f7bfe1e3740 1 --2- 172.21.15.63:0/625692107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563754459070 0x563754817d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.838+0000 7f7bfe1e3740 1 --2- 172.21.15.63:0/625692107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563754438390 0x56375480bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.838+0000 7f7bd97fa640 0 client.16683 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:33:47.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.838+0000 7f7bfe1e3740 1 --2- 172.21.15.63:0/625692107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 0x56375480b9d0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.838+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/625692107 >> 172.21.15.63:0/625692107 conn(0x56375444d460 msgr2=0x563754803450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:47.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.838+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/625692107 shutdown_connections 2024-09-21T06:33:47.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.838+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/625692107 wait complete. 2024-09-21T06:33:47.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.838+0000 7f7bfe1e3740 20 client.16683 trim_cache size 0 max 16384 2024-09-21T06:33:47.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.851+0000 7f7bfe1e3740 1 Processor -- start 2024-09-21T06:33:47.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.851+0000 7f7bfe1e3740 1 -- start start 2024-09-21T06:33:47.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.852+0000 7f7bfe1e3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637544301b0 0x56375480a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:47.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.852+0000 7f7bfe1e3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563754438390 0x563754803ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:47.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.852+0000 7f7bfe1e3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563754459070 0x563754808bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:47.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.852+0000 7f7bfe1e3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf01b17f0 con 0x563754459070 2024-09-21T06:33:47.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.852+0000 7f7bfe1e3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf01b3480 con 0x563754438390 2024-09-21T06:33:47.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.852+0000 7f7bfe1e3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf01b1f50 con 0x5637544301b0 2024-09-21T06:33:47.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.852+0000 7f7bf520a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563754459070 0x563754808bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:47.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.852+0000 7f7bf520a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563754459070 0x563754808bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34574/0 (socket says 172.21.15.63:34574) 2024-09-21T06:33:47.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.852+0000 7f7bf520a640 1 -- 172.21.15.63:0/3277381521 learned_addr learned my addr 172.21.15.63:0/3277381521 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:47.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.852+0000 7f7bf520a640 1 --2- 172.21.15.63:0/3277381521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637544301b0 0x56375480a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:47.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.852+0000 7f7bf520a640 1 -- 172.21.15.63:0/3277381521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637544301b0 msgr2=0x56375480a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:47.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.852+0000 7f7bf5a0b640 1 --2- 172.21.15.63:0/3277381521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563754438390 0x563754803ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:47.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.852+0000 7f7bf520a640 1 --2- 172.21.15.63:0/3277381521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637544301b0 0x56375480a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.852+0000 7f7bf520a640 1 -- 172.21.15.63:0/3277381521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563754438390 msgr2=0x563754803ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:47.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.852+0000 7f7bf520a640 1 --2- 172.21.15.63:0/3277381521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563754438390 0x563754803ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.852+0000 7f7bf520a640 1 -- 172.21.15.63:0/3277381521 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56375480dfb0 con 0x563754459070 2024-09-21T06:33:47.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.852+0000 7f7bf520a640 1 --2- 172.21.15.63:0/3277381521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563754459070 0x563754808bc0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7be0006010 tx=0x7f7be00058c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833057f7a901f6b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:47.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.853+0000 7f7bdb7fe640 1 -- 172.21.15.63:0/3277381521 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be0035030 con 0x563754459070 2024-09-21T06:33:47.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.853+0000 7f7bdb7fe640 1 -- 172.21.15.63:0/3277381521 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7be0045070 con 0x563754459070 2024-09-21T06:33:47.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.853+0000 7f7bdb7fe640 1 -- 172.21.15.63:0/3277381521 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be0005540 con 0x563754459070 2024-09-21T06:33:47.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.853+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/3277381521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563754459070 msgr2=0x563754808bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:47.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.853+0000 7f7bfe1e3740 1 --2- 172.21.15.63:0/3277381521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563754459070 0x563754808bc0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7be0006010 tx=0x7f7be00058c0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.853+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/3277381521 shutdown_connections 2024-09-21T06:33:47.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.853+0000 7f7bfe1e3740 1 --2- 172.21.15.63:0/3277381521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563754459070 0x563754808bc0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.853+0000 7f7bfe1e3740 1 --2- 172.21.15.63:0/3277381521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563754438390 0x563754803ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.853+0000 7f7bfe1e3740 1 --2- 172.21.15.63:0/3277381521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637544301b0 0x56375480a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.853+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/3277381521 >> 172.21.15.63:0/3277381521 conn(0x56375444d460 msgr2=0x5637548033c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:47.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.853+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/3277381521 shutdown_connections 2024-09-21T06:33:47.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.854+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/3277381521 wait complete. 2024-09-21T06:33:47.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.854+0000 7f7bfe1e3740 1 -- start start 2024-09-21T06:33:47.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.854+0000 7f7bfe1e3740 1 Processor -- start 2024-09-21T06:33:47.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.854+0000 7f7bfe1e3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 0x563754810460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:47.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.854+0000 7f7bfe1e3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563754438390 0x5637548109a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:47.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.854+0000 7f7bfe1e3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563754459070 0x563754887680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:47.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.854+0000 7f7bfe1e3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf01b2db0 con 0x5637544301b0 2024-09-21T06:33:47.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.854+0000 7f7bfe1e3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf01b26b0 con 0x563754459070 2024-09-21T06:33:47.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.854+0000 7f7bfe1e3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf01af7d0 con 0x563754438390 2024-09-21T06:33:47.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.855+0000 7f7bfe1e3740 10 client.0 _ll_register_callbacks cb 0x7f7be0009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:47.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.855+0000 7f7bf520a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 0x563754810460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:47.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.855+0000 7f7bf520a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 0x563754810460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34584/0 (socket says 172.21.15.63:34584) 2024-09-21T06:33:47.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.855+0000 7f7bf520a640 1 -- 172.21.15.63:0/1235232241 learned_addr learned my addr 172.21.15.63:0/1235232241 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:47.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.855+0000 7f7bf5a0b640 1 --2- 172.21.15.63:0/1235232241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563754438390 0x5637548109a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:47.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.855+0000 7f7bf520a640 1 -- 172.21.15.63:0/1235232241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563754438390 msgr2=0x5637548109a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:47.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.855+0000 7f7bf520a640 1 --2- 172.21.15.63:0/1235232241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563754438390 0x5637548109a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.855+0000 7f7bf520a640 1 -- 172.21.15.63:0/1235232241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563754459070 msgr2=0x563754887680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:47.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.855+0000 7f7bf520a640 1 --2- 172.21.15.63:0/1235232241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563754459070 0x563754887680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.855+0000 7f7bf520a640 1 -- 172.21.15.63:0/1235232241 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563754887c10 con 0x5637544301b0 2024-09-21T06:33:47.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.855+0000 7f7bf520a640 1 --2- 172.21.15.63:0/1235232241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 0x563754810460 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7be0003a80 tx=0x7f7be002a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee1e89a8755f5bb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:47.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.855+0000 7f7bd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:33:47.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.855+0000 7f7bd97fa640 1 -- 172.21.15.63:0/1235232241 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be0035050 con 0x5637544301b0 2024-09-21T06:33:47.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.855+0000 7f7bd97fa640 1 -- 172.21.15.63:0/1235232241 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f7be00043c0 con 0x5637544301b0 2024-09-21T06:33:47.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.855+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/1235232241 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7be0045070 con 0x5637544301b0 2024-09-21T06:33:47.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.856+0000 7f7bd97fa640 1 -- 172.21.15.63:0/1235232241 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f7be00051c0 con 0x5637544301b0 2024-09-21T06:33:47.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.856+0000 7f7bfe1e3740 10 client.16689 fetch_fsmap learned FSMap version 50 2024-09-21T06:33:47.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.856+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/1235232241 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x563754888e90 con 0x5637544301b0 2024-09-21T06:33:47.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.856+0000 7f7bd97fa640 1 -- 172.21.15.63:0/1235232241 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7be0045070 con 0x5637544301b0 2024-09-21T06:33:47.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.856+0000 7f7bd97fa640 1 -- 172.21.15.63:0/1235232241 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 50) ==== 8406+0+0 (secure 0 0 0) 0x7f7be0032120 con 0x5637544301b0 2024-09-21T06:33:47.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.856+0000 7f7bfe1e3740 10 client.16689 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T06:33:47.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.856+0000 7f7bfe1e3740 10 client.16689 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:33:47.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.856+0000 7f7bfe1e3740 20 client.16689 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:47.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.856+0000 7f7bfe1e3740 1 --2- 172.21.15.63:0/1235232241 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x5637543ecda0 0x56375488b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:47.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.856+0000 7f7bfe1e3740 4 client.16689 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:33:47.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.856+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/1235232241 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563754807580 con 0x5637543ecda0 2024-09-21T06:33:47.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.856+0000 7f7bf5a0b640 1 --2- 172.21.15.63:0/1235232241 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x5637543ecda0 0x56375488b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:47.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.857+0000 7f7bd97fa640 10 client.16689 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:33:47.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.857+0000 7f7bf5a0b640 1 --2- 172.21.15.63:0/1235232241 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x5637543ecda0 0x56375488b4a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=561058f03e3e25e6 server_cookie=f37de8fa50a153cf in_seq=0 out_seq=0 2024-09-21T06:33:47.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.857+0000 7f7bd97fa640 1 -- 172.21.15.63:0/1235232241 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563754807580 con 0x5637543ecda0 2024-09-21T06:33:47.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.857+0000 7f7bd97fa640 10 client.16689 handle_command_reply: tid=0 2024-09-21T06:33:47.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.857+0000 7f7bfe1e3740 1 client.16689 shutdown 2024-09-21T06:33:47.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.857+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/1235232241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 msgr2=0x563754810460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:47.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.857+0000 7f7bfe1e3740 1 --2- 172.21.15.63:0/1235232241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 0x563754810460 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7be0003a80 tx=0x7f7be002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.857+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/1235232241 shutdown_connections 2024-09-21T06:33:47.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.857+0000 7f7bfe1e3740 1 --2- 172.21.15.63:0/1235232241 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x5637543ecda0 0x56375488b4a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.857+0000 7f7bfe1e3740 1 --2- 172.21.15.63:0/1235232241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563754459070 0x563754887680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.857+0000 7f7bfe1e3740 1 --2- 172.21.15.63:0/1235232241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563754438390 0x5637548109a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.857+0000 7f7bd97fa640 0 client.16689 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:33:47.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.857+0000 7f7bfe1e3740 1 --2- 172.21.15.63:0/1235232241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5637544301b0 0x563754810460 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.857+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/1235232241 >> 172.21.15.63:0/1235232241 conn(0x56375444d460 msgr2=0x563754801280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:47.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.858+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/1235232241 shutdown_connections 2024-09-21T06:33:47.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.858+0000 7f7bfe1e3740 1 -- 172.21.15.63:0/1235232241 wait complete. 2024-09-21T06:33:47.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.858+0000 7f7bfe1e3740 20 client.16689 trim_cache size 0 max 16384 2024-09-21T06:33:47.864 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:33:47.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.858+0000 7f7bf7c6f640 1 -- 172.21.15.63:0/2685102963 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7bdc0b6700 msgr2=0x7f7bdc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:47.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.858+0000 7f7bf7c6f640 1 --2- 172.21.15.63:0/2685102963 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7bdc0b6700 0x7f7bdc0b8c10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7be80e52d0 tx=0x7f7be807a5d0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.858+0000 7f7bf7c6f640 1 -- 172.21.15.63:0/2685102963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bf0108d00 msgr2=0x7f7bf0100070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:47.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.858+0000 7f7bf7c6f640 1 --2- 172.21.15.63:0/2685102963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bf0108d00 0x7f7bf0100070 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f7be800cce0 tx=0x7f7be800a620 comp rx=0 tx=0).stop 2024-09-21T06:33:47.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.858+0000 7f7bf7c6f640 1 -- 172.21.15.63:0/2685102963 shutdown_connections 2024-09-21T06:33:47.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.858+0000 7f7bf7c6f640 1 --2- 172.21.15.63:0/2685102963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bf0108d00 0x7f7bf0100070 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.858+0000 7f7bf7c6f640 1 --2- 172.21.15.63:0/2685102963 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bf01083b0 0x7f7bf00ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.858+0000 7f7bf7c6f640 1 --2- 172.21.15.63:0/2685102963 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f7bdc0b6700 0x7f7bdc0b8c10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.858+0000 7f7bf7c6f640 1 --2- 172.21.15.63:0/2685102963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bf0102a70 0x7f7bf00ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:47.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.858+0000 7f7bf7c6f640 1 -- 172.21.15.63:0/2685102963 >> 172.21.15.63:0/2685102963 conn(0x7f7bf0079710 msgr2=0x7f7bf0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:47.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.858+0000 7f7bf7c6f640 1 -- 172.21.15.63:0/2685102963 shutdown_connections 2024-09-21T06:33:47.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:47.859+0000 7f7bf7c6f640 1 -- 172.21.15.63:0/2685102963 wait complete. 2024-09-21T06:33:48.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:47 smithi071 ceph-mon[34844]: pgmap v490: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-21T06:33:48.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:47 smithi063 ceph-mon[31150]: pgmap v490: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-21T06:33:48.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:47 smithi175 ceph-mon[34510]: pgmap v490: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-21T06:33:49.553 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:33:49.554 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:33:49.814 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:50.068 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:49 smithi063 ceph-mon[31150]: pgmap v491: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-21T06:33:50.068 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:49 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:50.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:49 smithi175 ceph-mon[34510]: pgmap v491: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-21T06:33:50.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:49 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:50.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:49 smithi071 ceph-mon[34844]: pgmap v491: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-21T06:33:50.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:49 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:50.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.281+0000 7fbc76de5640 1 -- 172.21.15.63:0/1465110898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc70108d20 msgr2=0x7fbc7010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:50.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.281+0000 7fbc76de5640 1 --2- 172.21.15.63:0/1465110898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc70108d20 0x7fbc7010f550 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fbc68009ca0 tx=0x7fbc6802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.281+0000 7fbc76de5640 1 -- 172.21.15.63:0/1465110898 shutdown_connections 2024-09-21T06:33:50.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.281+0000 7fbc76de5640 1 --2- 172.21.15.63:0/1465110898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc70108d20 0x7fbc7010f550 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.281+0000 7fbc76de5640 1 --2- 172.21.15.63:0/1465110898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc701083d0 0x7fbc701087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.281+0000 7fbc76de5640 1 --2- 172.21.15.63:0/1465110898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc70102ae0 0x7fbc70102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.281+0000 7fbc76de5640 1 -- 172.21.15.63:0/1465110898 >> 172.21.15.63:0/1465110898 conn(0x7fbc70079760 msgr2=0x7fbc70079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:50.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.281+0000 7fbc76de5640 1 -- 172.21.15.63:0/1465110898 shutdown_connections 2024-09-21T06:33:50.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.281+0000 7fbc76de5640 1 -- 172.21.15.63:0/1465110898 wait complete. 2024-09-21T06:33:50.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.282+0000 7fbc76de5640 1 Processor -- start 2024-09-21T06:33:50.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.282+0000 7fbc76de5640 1 -- start start 2024-09-21T06:33:50.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.282+0000 7fbc76de5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc70102ae0 0x7fbc7019c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:50.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.282+0000 7fbc76de5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc701083d0 0x7fbc7019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:50.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.282+0000 7fbc76de5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc70108d20 0x7fbc701a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:50.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.282+0000 7fbc76de5640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbc70112990 con 0x7fbc701083d0 2024-09-21T06:33:50.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.282+0000 7fbc76de5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbc70112810 con 0x7fbc70102ae0 2024-09-21T06:33:50.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.282+0000 7fbc76de5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbc70112b10 con 0x7fbc70108d20 2024-09-21T06:33:50.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.283+0000 7fbc67fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc701083d0 0x7fbc7019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:50.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.283+0000 7fbc67fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc701083d0 0x7fbc7019cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34600/0 (socket says 172.21.15.63:34600) 2024-09-21T06:33:50.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.283+0000 7fbc67fff640 1 -- 172.21.15.63:0/3390213635 learned_addr learned my addr 172.21.15.63:0/3390213635 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:50.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.283+0000 7fbc74b81640 1 --2- 172.21.15.63:0/3390213635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc70102ae0 0x7fbc7019c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:50.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.283+0000 7fbc75382640 1 --2- 172.21.15.63:0/3390213635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc70108d20 0x7fbc701a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:50.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.283+0000 7fbc67fff640 1 -- 172.21.15.63:0/3390213635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc70108d20 msgr2=0x7fbc701a1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:50.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.283+0000 7fbc67fff640 1 --2- 172.21.15.63:0/3390213635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc70108d20 0x7fbc701a1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.283+0000 7fbc67fff640 1 -- 172.21.15.63:0/3390213635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc70102ae0 msgr2=0x7fbc7019c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:50.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.283+0000 7fbc67fff640 1 --2- 172.21.15.63:0/3390213635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc70102ae0 0x7fbc7019c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.283+0000 7fbc67fff640 1 -- 172.21.15.63:0/3390213635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc701a2670 con 0x7fbc701083d0 2024-09-21T06:33:50.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.283+0000 7fbc75382640 1 --2- 172.21.15.63:0/3390213635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc70108d20 0x7fbc701a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:33:50.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.283+0000 7fbc67fff640 1 --2- 172.21.15.63:0/3390213635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc701083d0 0x7fbc7019cca0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fbc6000d770 tx=0x7fbc6000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:50.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.283+0000 7fbc65ffb640 1 -- 172.21.15.63:0/3390213635 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60017070 con 0x7fbc701083d0 2024-09-21T06:33:50.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.283+0000 7fbc76de5640 1 -- 172.21.15.63:0/3390213635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc701a2960 con 0x7fbc701083d0 2024-09-21T06:33:50.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.283+0000 7fbc65ffb640 1 -- 172.21.15.63:0/3390213635 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc60009c30 con 0x7fbc701083d0 2024-09-21T06:33:50.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.283+0000 7fbc65ffb640 1 -- 172.21.15.63:0/3390213635 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6000f620 con 0x7fbc701083d0 2024-09-21T06:33:50.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.284+0000 7fbc76de5640 1 -- 172.21.15.63:0/3390213635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc701a90c0 con 0x7fbc701083d0 2024-09-21T06:33:50.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.286+0000 7fbc7d359740 1 Processor -- start 2024-09-21T06:33:50.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.286+0000 7fbc7d359740 1 -- start start 2024-09-21T06:33:50.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.286+0000 7fbc65ffb640 1 -- 172.21.15.63:0/3390213635 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fbc6001a070 con 0x7fbc701083d0 2024-09-21T06:33:50.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.287+0000 7fbc7d359740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e5c350 0x564226203430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:50.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.287+0000 7fbc7d359740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564225e33490 0x564226203970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:50.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.287+0000 7fbc7d359740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e3b670 0x564226203eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:50.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.287+0000 7fbc7d359740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564226179e60 con 0x564225e3b670 2024-09-21T06:33:50.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.287+0000 7fbc7d359740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564226169290 con 0x564225e5c350 2024-09-21T06:33:50.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.287+0000 7fbc7d359740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56422616d0a0 con 0x564225e33490 2024-09-21T06:33:50.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.287+0000 7fbc67fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e3b670 0x564226203eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:50.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.287+0000 7fbc67fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e3b670 0x564226203eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34616/0 (socket says 172.21.15.63:34616) 2024-09-21T06:33:50.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.287+0000 7fbc67fff640 1 -- 172.21.15.63:0/594771181 learned_addr learned my addr 172.21.15.63:0/594771181 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:50.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.287+0000 7fbc75382640 1 --2- 172.21.15.63:0/594771181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e5c350 0x564226203430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:50.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.287+0000 7fbc74b81640 1 --2- 172.21.15.63:0/594771181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564225e33490 0x564226203970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:50.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.287+0000 7fbc67fff640 1 -- 172.21.15.63:0/594771181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564225e33490 msgr2=0x564226203970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:50.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.287+0000 7fbc67fff640 1 --2- 172.21.15.63:0/594771181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564225e33490 0x564226203970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.287+0000 7fbc67fff640 1 -- 172.21.15.63:0/594771181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e5c350 msgr2=0x564226203430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:50.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.287+0000 7fbc67fff640 1 --2- 172.21.15.63:0/594771181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e5c350 0x564226203430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.287+0000 7fbc67fff640 1 -- 172.21.15.63:0/594771181 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564225ec7930 con 0x564225e3b670 2024-09-21T06:33:50.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.287+0000 7fbc67fff640 1 --2- 172.21.15.63:0/594771181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e3b670 0x564226203eb0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fbc600e48c0 tx=0x7fbc600ef910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d70682007c7dfb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:50.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.288+0000 7fbc56ffd640 1 -- 172.21.15.63:0/594771181 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc600fa070 con 0x564225e3b670 2024-09-21T06:33:50.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.288+0000 7fbc65ffb640 1 --2- 172.21.15.63:0/3390213635 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbc580b6680 0x7fbc580b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:50.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.288+0000 7fbc56ffd640 1 -- 172.21.15.63:0/594771181 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc600e94e0 con 0x564225e3b670 2024-09-21T06:33:50.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.288+0000 7fbc56ffd640 1 -- 172.21.15.63:0/594771181 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc600f5aa0 con 0x564225e3b670 2024-09-21T06:33:50.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.288+0000 7fbc75382640 1 --2- 172.21.15.63:0/3390213635 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbc580b6680 0x7fbc580b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:50.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.288+0000 7fbc65ffb640 1 -- 172.21.15.63:0/3390213635 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fbc600e7220 con 0x7fbc701083d0 2024-09-21T06:33:50.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.288+0000 7fbc7d359740 1 -- 172.21.15.63:0/594771181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e3b670 msgr2=0x564226203eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:50.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.288+0000 7fbc75382640 1 --2- 172.21.15.63:0/3390213635 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbc580b6680 0x7fbc580b8b90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbc68004af0 tx=0x7fbc68005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:50.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.289+0000 7fbc7d359740 1 --2- 172.21.15.63:0/594771181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e3b670 0x564226203eb0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fbc600e48c0 tx=0x7fbc600ef910 comp rx=0 tx=0).stop 2024-09-21T06:33:50.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.289+0000 7fbc7d359740 1 -- 172.21.15.63:0/594771181 shutdown_connections 2024-09-21T06:33:50.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.289+0000 7fbc7d359740 1 --2- 172.21.15.63:0/594771181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e3b670 0x564226203eb0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.289+0000 7fbc7d359740 1 --2- 172.21.15.63:0/594771181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564225e33490 0x564226203970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.289+0000 7fbc7d359740 1 --2- 172.21.15.63:0/594771181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e5c350 0x564226203430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.289+0000 7fbc7d359740 1 -- 172.21.15.63:0/594771181 >> 172.21.15.63:0/594771181 conn(0x564225e50740 msgr2=0x564226201320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:50.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.289+0000 7fbc7d359740 1 -- 172.21.15.63:0/594771181 shutdown_connections 2024-09-21T06:33:50.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.289+0000 7fbc7d359740 1 -- 172.21.15.63:0/594771181 wait complete. 2024-09-21T06:33:50.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.289+0000 7fbc7d359740 1 -- start start 2024-09-21T06:33:50.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.289+0000 7fbc7d359740 1 Processor -- start 2024-09-21T06:33:50.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.290+0000 7fbc7d359740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e33490 0x56422620f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:50.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.290+0000 7fbc7d359740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e3b670 0x56422620f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:50.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.290+0000 7fbc7d359740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564225e5c350 0x56422621af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:50.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.290+0000 7fbc7d359740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564225fca890 con 0x564225e33490 2024-09-21T06:33:50.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.290+0000 7fbc7d359740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564226103d40 con 0x564225e3b670 2024-09-21T06:33:50.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.290+0000 7fbc7d359740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564226211c10 con 0x564225e5c350 2024-09-21T06:33:50.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.290+0000 7fbc7d359740 10 client.0 _ll_register_callbacks cb 0x564226167c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:50.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.290+0000 7fbc74b81640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e33490 0x56422620f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:50.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.290+0000 7fbc74b81640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e33490 0x56422620f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34618/0 (socket says 172.21.15.63:34618) 2024-09-21T06:33:50.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.290+0000 7fbc74b81640 1 -- 172.21.15.63:0/2257816053 learned_addr learned my addr 172.21.15.63:0/2257816053 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:50.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.290+0000 7fbc67fff640 1 --2- 172.21.15.63:0/2257816053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e3b670 0x56422620f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:50.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.290+0000 7fbc75382640 1 --2- 172.21.15.63:0/2257816053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564225e5c350 0x56422621af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:50.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.290+0000 7fbc74b81640 1 -- 172.21.15.63:0/2257816053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564225e5c350 msgr2=0x56422621af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:50.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.290+0000 7fbc74b81640 1 --2- 172.21.15.63:0/2257816053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564225e5c350 0x56422621af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.290+0000 7fbc74b81640 1 -- 172.21.15.63:0/2257816053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e3b670 msgr2=0x56422620f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:50.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.290+0000 7fbc74b81640 1 --2- 172.21.15.63:0/2257816053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e3b670 0x56422620f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.290+0000 7fbc74b81640 1 -- 172.21.15.63:0/2257816053 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56422621b540 con 0x564225e33490 2024-09-21T06:33:50.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.290+0000 7fbc74b81640 1 --2- 172.21.15.63:0/2257816053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e33490 0x56422620f020 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00ba20 tx=0x7fbc6c00bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f81b30bda2f6c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:50.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.290+0000 7fbc4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:33:50.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.291+0000 7fbc4ffff640 1 -- 172.21.15.63:0/2257816053 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c01b640 con 0x564225e33490 2024-09-21T06:33:50.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.291+0000 7fbc4ffff640 1 -- 172.21.15.63:0/2257816053 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fbc6c01b7e0 con 0x564225e33490 2024-09-21T06:33:50.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.291+0000 7fbc7d359740 1 -- 172.21.15.63:0/2257816053 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc600e94e0 con 0x564225e33490 2024-09-21T06:33:50.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.291+0000 7fbc4ffff640 1 -- 172.21.15.63:0/2257816053 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fbc6c01b9e0 con 0x564225e33490 2024-09-21T06:33:50.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.291+0000 7fbc7d359740 10 client.16701 fetch_fsmap learned FSMap version 51 2024-09-21T06:33:50.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.291+0000 7fbc7d359740 1 -- 172.21.15.63:0/2257816053 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x56422621ded0 con 0x564225e33490 2024-09-21T06:33:50.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.291+0000 7fbc4ffff640 1 -- 172.21.15.63:0/2257816053 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc600e94e0 con 0x564225e33490 2024-09-21T06:33:50.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.291+0000 7fbc4ffff640 1 -- 172.21.15.63:0/2257816053 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 51) ==== 8402+0+0 (secure 0 0 0) 0x7fbc6c019020 con 0x564225e33490 2024-09-21T06:33:50.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.291+0000 7fbc7d359740 10 client.16701 fetch_fsmap finished waiting for FSMap version 51 2024-09-21T06:33:50.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.291+0000 7fbc7d359740 10 client.16701 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:33:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.291+0000 7fbc7d359740 20 client.16701 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.291+0000 7fbc7d359740 1 --2- 172.21.15.63:0/2257816053 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x564225e1acd0 0x564226221500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.291+0000 7fbc7d359740 4 client.16701 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:33:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.291+0000 7fbc7d359740 1 -- 172.21.15.63:0/2257816053 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56422617bdb0 con 0x564225e1acd0 2024-09-21T06:33:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.292+0000 7fbc67fff640 1 --2- 172.21.15.63:0/2257816053 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x564225e1acd0 0x564226221500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.292+0000 7fbc4ffff640 10 client.16701 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.292+0000 7fbc67fff640 1 --2- 172.21.15.63:0/2257816053 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x564225e1acd0 0x564226221500 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b093c174a6c2526 server_cookie=ca109a30e7b80b9 in_seq=0 out_seq=0 2024-09-21T06:33:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.293+0000 7fbc4ffff640 1 -- 172.21.15.63:0/2257816053 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56422617bdb0 con 0x564225e1acd0 2024-09-21T06:33:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.293+0000 7fbc4ffff640 10 client.16701 handle_command_reply: tid=0 2024-09-21T06:33:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.293+0000 7fbc7d359740 1 client.16701 shutdown 2024-09-21T06:33:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.293+0000 7fbc7d359740 1 -- 172.21.15.63:0/2257816053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e33490 msgr2=0x56422620f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.293+0000 7fbc7d359740 1 --2- 172.21.15.63:0/2257816053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e33490 0x56422620f020 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00ba20 tx=0x7fbc6c00bee0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.293+0000 7fbc7d359740 1 -- 172.21.15.63:0/2257816053 shutdown_connections 2024-09-21T06:33:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.293+0000 7fbc7d359740 1 --2- 172.21.15.63:0/2257816053 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x564225e1acd0 0x564226221500 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.293+0000 7fbc7d359740 1 --2- 172.21.15.63:0/2257816053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564225e5c350 0x56422621af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.293+0000 7fbc7d359740 1 --2- 172.21.15.63:0/2257816053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e3b670 0x56422620f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.293+0000 7fbc4ffff640 0 client.16701 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:50.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.293+0000 7fbc7d359740 1 --2- 172.21.15.63:0/2257816053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e33490 0x56422620f020 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.293+0000 7fbc7d359740 1 -- 172.21.15.63:0/2257816053 >> 172.21.15.63:0/2257816053 conn(0x564225e50740 msgr2=0x5642262065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:50.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.293+0000 7fbc7d359740 1 -- 172.21.15.63:0/2257816053 shutdown_connections 2024-09-21T06:33:50.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.293+0000 7fbc7d359740 1 -- 172.21.15.63:0/2257816053 wait complete. 2024-09-21T06:33:50.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.293+0000 7fbc7d359740 20 client.16701 trim_cache size 0 max 16384 2024-09-21T06:33:50.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.311+0000 7fbc7d359740 1 Processor -- start 2024-09-21T06:33:50.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.311+0000 7fbc7d359740 1 -- start start 2024-09-21T06:33:50.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.311+0000 7fbc7d359740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e33490 0x564226209550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:50.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.311+0000 7fbc7d359740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e3b670 0x56422621ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:50.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.311+0000 7fbc7d359740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564225e5c350 0x56422620c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:50.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.311+0000 7fbc7d359740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbc701b1a50 con 0x564225e33490 2024-09-21T06:33:50.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.311+0000 7fbc7d359740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbc701b36b0 con 0x564225e3b670 2024-09-21T06:33:50.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.311+0000 7fbc7d359740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbc701b2180 con 0x564225e5c350 2024-09-21T06:33:50.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.312+0000 7fbc74b81640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e33490 0x564226209550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:50.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.312+0000 7fbc74b81640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e33490 0x564226209550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34630/0 (socket says 172.21.15.63:34630) 2024-09-21T06:33:50.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.312+0000 7fbc74b81640 1 -- 172.21.15.63:0/4021216125 learned_addr learned my addr 172.21.15.63:0/4021216125 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:50.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.312+0000 7fbc75382640 1 --2- 172.21.15.63:0/4021216125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564225e5c350 0x56422620c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:50.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.312+0000 7fbc67fff640 1 --2- 172.21.15.63:0/4021216125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e3b670 0x56422621ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:50.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.312+0000 7fbc74b81640 1 -- 172.21.15.63:0/4021216125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564225e5c350 msgr2=0x56422620c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:50.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.312+0000 7fbc74b81640 1 --2- 172.21.15.63:0/4021216125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564225e5c350 0x56422620c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.312+0000 7fbc74b81640 1 -- 172.21.15.63:0/4021216125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e3b670 msgr2=0x56422621ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:50.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.312+0000 7fbc74b81640 1 --2- 172.21.15.63:0/4021216125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e3b670 0x56422621ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.312+0000 7fbc74b81640 1 -- 172.21.15.63:0/4021216125 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564226204240 con 0x564225e33490 2024-09-21T06:33:50.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.312+0000 7fbc67fff640 1 --2- 172.21.15.63:0/4021216125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e3b670 0x56422621ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:33:50.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.312+0000 7fbc74b81640 1 --2- 172.21.15.63:0/4021216125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e33490 0x564226209550 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0042c0 tx=0x7fbc6c004070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806701105353cde0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:50.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.312+0000 7fbc567fc640 1 -- 172.21.15.63:0/4021216125 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c031070 con 0x564225e33490 2024-09-21T06:33:50.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.312+0000 7fbc567fc640 1 -- 172.21.15.63:0/4021216125 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc6c01bd80 con 0x564225e33490 2024-09-21T06:33:50.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.312+0000 7fbc567fc640 1 -- 172.21.15.63:0/4021216125 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c028070 con 0x564225e33490 2024-09-21T06:33:50.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.313+0000 7fbc7d359740 1 -- 172.21.15.63:0/4021216125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e33490 msgr2=0x564226209550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:50.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.313+0000 7fbc7d359740 1 --2- 172.21.15.63:0/4021216125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e33490 0x564226209550 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0042c0 tx=0x7fbc6c004070 comp rx=0 tx=0).stop 2024-09-21T06:33:50.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.313+0000 7fbc7d359740 1 -- 172.21.15.63:0/4021216125 shutdown_connections 2024-09-21T06:33:50.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.313+0000 7fbc7d359740 1 --2- 172.21.15.63:0/4021216125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564225e5c350 0x56422620c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.313+0000 7fbc7d359740 1 --2- 172.21.15.63:0/4021216125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e3b670 0x56422621ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.313+0000 7fbc7d359740 1 --2- 172.21.15.63:0/4021216125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e33490 0x564226209550 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.313+0000 7fbc7d359740 1 -- 172.21.15.63:0/4021216125 >> 172.21.15.63:0/4021216125 conn(0x564225e50740 msgr2=0x56422620d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:50.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.313+0000 7fbc7d359740 1 -- 172.21.15.63:0/4021216125 shutdown_connections 2024-09-21T06:33:50.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.313+0000 7fbc7d359740 1 -- 172.21.15.63:0/4021216125 wait complete. 2024-09-21T06:33:50.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.314+0000 7fbc7d359740 1 -- start start 2024-09-21T06:33:50.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.314+0000 7fbc7d359740 1 Processor -- start 2024-09-21T06:33:50.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.314+0000 7fbc7d359740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564225e33490 0x564226213580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:50.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.314+0000 7fbc7d359740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e3b670 0x564226213ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:50.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.314+0000 7fbc7d359740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e5c350 0x56422628af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:50.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.314+0000 7fbc7d359740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbc701b2fe0 con 0x564225e3b670 2024-09-21T06:33:50.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.314+0000 7fbc7d359740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbc701b28e0 con 0x564225e5c350 2024-09-21T06:33:50.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.314+0000 7fbc7d359740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbc701afa30 con 0x564225e33490 2024-09-21T06:33:50.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.314+0000 7fbc7d359740 10 client.0 _ll_register_callbacks cb 0x7fbc6c0040e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:50.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.314+0000 7fbc67fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e3b670 0x564226213ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:50.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.314+0000 7fbc67fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e3b670 0x564226213ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34634/0 (socket says 172.21.15.63:34634) 2024-09-21T06:33:50.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.314+0000 7fbc67fff640 1 -- 172.21.15.63:0/2347368274 learned_addr learned my addr 172.21.15.63:0/2347368274 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:50.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.314+0000 7fbc74b81640 1 --2- 172.21.15.63:0/2347368274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564225e33490 0x564226213580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:50.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.315+0000 7fbc75382640 1 --2- 172.21.15.63:0/2347368274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e5c350 0x56422628af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:50.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.315+0000 7fbc67fff640 1 -- 172.21.15.63:0/2347368274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564225e33490 msgr2=0x564226213580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:50.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.315+0000 7fbc67fff640 1 --2- 172.21.15.63:0/2347368274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564225e33490 0x564226213580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.315+0000 7fbc67fff640 1 -- 172.21.15.63:0/2347368274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e5c350 msgr2=0x56422628af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:50.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.315+0000 7fbc67fff640 1 --2- 172.21.15.63:0/2347368274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e5c350 0x56422628af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.315+0000 7fbc67fff640 1 -- 172.21.15.63:0/2347368274 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56422628b440 con 0x564225e3b670 2024-09-21T06:33:50.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.315+0000 7fbc67fff640 1 --2- 172.21.15.63:0/2347368274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e3b670 0x564226213ac0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbc600acfe0 tx=0x7fbc600f55a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb44d44a7a8ade07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:50.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.315+0000 7fbc4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:33:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.315+0000 7fbc4ffff640 1 -- 172.21.15.63:0/2347368274 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60021070 con 0x564225e3b670 2024-09-21T06:33:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.315+0000 7fbc7d359740 1 -- 172.21.15.63:0/2347368274 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc6c01bd80 con 0x564225e3b670 2024-09-21T06:33:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.315+0000 7fbc4ffff640 1 -- 172.21.15.63:0/2347368274 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fbc600eab40 con 0x564225e3b670 2024-09-21T06:33:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.315+0000 7fbc4ffff640 1 -- 172.21.15.63:0/2347368274 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fbc600a96a0 con 0x564225e3b670 2024-09-21T06:33:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.315+0000 7fbc7d359740 10 client.16707 fetch_fsmap learned FSMap version 51 2024-09-21T06:33:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.315+0000 7fbc7d359740 1 -- 172.21.15.63:0/2347368274 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x56422628c640 con 0x564225e3b670 2024-09-21T06:33:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.316+0000 7fbc4ffff640 1 -- 172.21.15.63:0/2347368274 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc6c01bd80 con 0x564225e3b670 2024-09-21T06:33:50.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.316+0000 7fbc4ffff640 1 -- 172.21.15.63:0/2347368274 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 51) ==== 8402+0+0 (secure 0 0 0) 0x7fbc600b65e0 con 0x564225e3b670 2024-09-21T06:33:50.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.316+0000 7fbc7d359740 10 client.16707 fetch_fsmap finished waiting for FSMap version 51 2024-09-21T06:33:50.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.316+0000 7fbc7d359740 10 client.16707 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:33:50.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.316+0000 7fbc7d359740 20 client.16707 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:50.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.316+0000 7fbc7d359740 1 --2- 172.21.15.63:0/2347368274 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x564225df0080 0x56422628e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:50.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.316+0000 7fbc7d359740 4 client.16707 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:33:50.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.316+0000 7fbc7d359740 1 -- 172.21.15.63:0/2347368274 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564226177860 con 0x564225df0080 2024-09-21T06:33:50.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.316+0000 7fbc74b81640 1 --2- 172.21.15.63:0/2347368274 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x564225df0080 0x56422628e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:50.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.317+0000 7fbc74b81640 1 --2- 172.21.15.63:0/2347368274 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x564225df0080 0x56422628e9a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f401ec210466f0f7 server_cookie=e4666c146eed77d8 in_seq=0 out_seq=0 2024-09-21T06:33:50.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.317+0000 7fbc4ffff640 10 client.16707 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:50.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.318+0000 7fbc4ffff640 1 -- 172.21.15.63:0/2347368274 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564226177860 con 0x564225df0080 2024-09-21T06:33:50.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.318+0000 7fbc4ffff640 10 client.16707 handle_command_reply: tid=0 2024-09-21T06:33:50.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.318+0000 7fbc7d359740 1 client.16707 shutdown 2024-09-21T06:33:50.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.318+0000 7fbc7d359740 1 -- 172.21.15.63:0/2347368274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e3b670 msgr2=0x564226213ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:50.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.318+0000 7fbc7d359740 1 --2- 172.21.15.63:0/2347368274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e3b670 0x564226213ac0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbc600acfe0 tx=0x7fbc600f55a0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.319+0000 7fbc7d359740 1 -- 172.21.15.63:0/2347368274 shutdown_connections 2024-09-21T06:33:50.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.319+0000 7fbc7d359740 1 --2- 172.21.15.63:0/2347368274 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x564225df0080 0x56422628e9a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.319+0000 7fbc7d359740 1 --2- 172.21.15.63:0/2347368274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564225e5c350 0x56422628af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.319+0000 7fbc7d359740 1 --2- 172.21.15.63:0/2347368274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564225e3b670 0x564226213ac0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.319+0000 7fbc7d359740 1 --2- 172.21.15.63:0/2347368274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564225e33490 0x564226213580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.319+0000 7fbc7d359740 1 -- 172.21.15.63:0/2347368274 >> 172.21.15.63:0/2347368274 conn(0x564225e50740 msgr2=0x564226204460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:50.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.319+0000 7fbc4ffff640 0 client.16707 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:50.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.319+0000 7fbc7d359740 1 -- 172.21.15.63:0/2347368274 shutdown_connections 2024-09-21T06:33:50.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.319+0000 7fbc7d359740 1 -- 172.21.15.63:0/2347368274 wait complete. 2024-09-21T06:33:50.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.319+0000 7fbc7d359740 20 client.16707 trim_cache size 0 max 16384 2024-09-21T06:33:50.328 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:33:50.329 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0, 2024-09-21T06:33:50.329 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_tag": "91ae0a75-6a3f-452f-8bda-0f19862a5724", 2024-09-21T06:33:50.329 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": "asynchronous" 2024-09-21T06:33:50.329 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:33:50.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.320+0000 7fbc76de5640 1 -- 172.21.15.63:0/3390213635 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbc580b6680 msgr2=0x7fbc580b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:50.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.320+0000 7fbc76de5640 1 --2- 172.21.15.63:0/3390213635 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbc580b6680 0x7fbc580b8b90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbc68004af0 tx=0x7fbc68005c30 comp rx=0 tx=0).stop 2024-09-21T06:33:50.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.320+0000 7fbc76de5640 1 -- 172.21.15.63:0/3390213635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc701083d0 msgr2=0x7fbc7019cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:50.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.320+0000 7fbc76de5640 1 --2- 172.21.15.63:0/3390213635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc701083d0 0x7fbc7019cca0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fbc6000d770 tx=0x7fbc6000dc30 comp rx=0 tx=0).stop 2024-09-21T06:33:50.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.320+0000 7fbc76de5640 1 -- 172.21.15.63:0/3390213635 shutdown_connections 2024-09-21T06:33:50.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.320+0000 7fbc76de5640 1 --2- 172.21.15.63:0/3390213635 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbc580b6680 0x7fbc580b8b90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.320+0000 7fbc76de5640 1 --2- 172.21.15.63:0/3390213635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc70108d20 0x7fbc701a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.320+0000 7fbc76de5640 1 --2- 172.21.15.63:0/3390213635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc701083d0 0x7fbc7019cca0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.320+0000 7fbc76de5640 1 --2- 172.21.15.63:0/3390213635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc70102ae0 0x7fbc7019c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:50.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.320+0000 7fbc76de5640 1 -- 172.21.15.63:0/3390213635 >> 172.21.15.63:0/3390213635 conn(0x7fbc70079760 msgr2=0x7fbc70104500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:50.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.320+0000 7fbc76de5640 1 -- 172.21.15.63:0/3390213635 shutdown_connections 2024-09-21T06:33:50.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:50.320+0000 7fbc76de5640 1 -- 172.21.15.63:0/3390213635 wait complete. 2024-09-21T06:33:51.041 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:33:51.300 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:51.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.806+0000 7f4658bde640 1 -- 172.21.15.63:0/3493974943 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4654103bb0 msgr2=0x7f4654103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:51.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.806+0000 7f4658bde640 1 --2- 172.21.15.63:0/3493974943 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4654103bb0 0x7f4654103fc0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4644009900 tx=0x7f464402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.806+0000 7f4658bde640 1 -- 172.21.15.63:0/3493974943 shutdown_connections 2024-09-21T06:33:51.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.806+0000 7f4658bde640 1 --2- 172.21.15.63:0/3493974943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4654109e40 0x7f4654110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.806+0000 7f4658bde640 1 --2- 172.21.15.63:0/3493974943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46541094f0 0x7f4654109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.806+0000 7f4658bde640 1 --2- 172.21.15.63:0/3493974943 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4654103bb0 0x7f4654103fc0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.806+0000 7f4658bde640 1 -- 172.21.15.63:0/3493974943 >> 172.21.15.63:0/3493974943 conn(0x7f46540ff600 msgr2=0x7f4654101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:51.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.806+0000 7f4658bde640 1 -- 172.21.15.63:0/3493974943 shutdown_connections 2024-09-21T06:33:51.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.806+0000 7f4658bde640 1 -- 172.21.15.63:0/3493974943 wait complete. 2024-09-21T06:33:51.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.807+0000 7f4658bde640 1 Processor -- start 2024-09-21T06:33:51.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.807+0000 7f4658bde640 1 -- start start 2024-09-21T06:33:51.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.807+0000 7f4658bde640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4654103bb0 0x7f465419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.807+0000 7f4658bde640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46541094f0 0x7f465419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.807+0000 7f4658bde640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4654109e40 0x7f465419fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.807+0000 7f4658bde640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4654113b00 con 0x7f46541094f0 2024-09-21T06:33:51.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.807+0000 7f4658bde640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4654113980 con 0x7f4654109e40 2024-09-21T06:33:51.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.807+0000 7f4658bde640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4654113c80 con 0x7f4654103bb0 2024-09-21T06:33:51.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.807+0000 7f4651d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46541094f0 0x7f465419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.807+0000 7f4651d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46541094f0 0x7f465419a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34648/0 (socket says 172.21.15.63:34648) 2024-09-21T06:33:51.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.807+0000 7f4651d9b640 1 -- 172.21.15.63:0/2127801174 learned_addr learned my addr 172.21.15.63:0/2127801174 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:51.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.807+0000 7f4652d9d640 1 --2- 172.21.15.63:0/2127801174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4654109e40 0x7f465419fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.807+0000 7f465259c640 1 --2- 172.21.15.63:0/2127801174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4654103bb0 0x7f465419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.808+0000 7f4651d9b640 1 -- 172.21.15.63:0/2127801174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4654103bb0 msgr2=0x7f465419a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:51.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.808+0000 7f4651d9b640 1 --2- 172.21.15.63:0/2127801174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4654103bb0 0x7f465419a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.808+0000 7f4651d9b640 1 -- 172.21.15.63:0/2127801174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4654109e40 msgr2=0x7f465419fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:51.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.808+0000 7f4651d9b640 1 --2- 172.21.15.63:0/2127801174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4654109e40 0x7f465419fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.808+0000 7f4651d9b640 1 -- 172.21.15.63:0/2127801174 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46541a0300 con 0x7f46541094f0 2024-09-21T06:33:51.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.808+0000 7f4651d9b640 1 --2- 172.21.15.63:0/2127801174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46541094f0 0x7f465419a9f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f463c00cce0 tx=0x7f463c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:51.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.808+0000 7f464b7fe640 1 -- 172.21.15.63:0/2127801174 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c00f450 con 0x7f46541094f0 2024-09-21T06:33:51.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.808+0000 7f4658bde640 1 -- 172.21.15.63:0/2127801174 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46541a05f0 con 0x7f46541094f0 2024-09-21T06:33:51.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.808+0000 7f464b7fe640 1 -- 172.21.15.63:0/2127801174 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f463c00faa0 con 0x7f46541094f0 2024-09-21T06:33:51.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.808+0000 7f464b7fe640 1 -- 172.21.15.63:0/2127801174 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c018c50 con 0x7f46541094f0 2024-09-21T06:33:51.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.808+0000 7f4658bde640 1 -- 172.21.15.63:0/2127801174 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46541a6e10 con 0x7f46541094f0 2024-09-21T06:33:51.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.811+0000 7f464b7fe640 1 -- 172.21.15.63:0/2127801174 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f463c00fc50 con 0x7f46541094f0 2024-09-21T06:33:51.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.811+0000 7f465f152740 1 Processor -- start 2024-09-21T06:33:51.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.811+0000 7f465f152740 1 -- start start 2024-09-21T06:33:51.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.811+0000 7f465f152740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc5d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.811+0000 7f465f152740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 0x55d6ddc5db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.811+0000 7f465f152740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 0x55d6ddc5e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.811+0000 7f465f152740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d6ddbd3e50 con 0x55d6dd8b6070 2024-09-21T06:33:51.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.811+0000 7f465f152740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d6ddbc3280 con 0x55d6dd895390 2024-09-21T06:33:51.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.811+0000 7f465f152740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d6ddbc7090 con 0x55d6dd88d1b0 2024-09-21T06:33:51.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.811+0000 7f4652d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc5d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.811+0000 7f4652d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc5d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34658/0 (socket says 172.21.15.63:34658) 2024-09-21T06:33:51.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.811+0000 7f4652d9d640 1 -- 172.21.15.63:0/3300543431 learned_addr learned my addr 172.21.15.63:0/3300543431 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:51.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.812+0000 7f465259c640 1 --2- 172.21.15.63:0/3300543431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 0x55d6ddc5db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.812+0000 7f4652d9d640 1 -- 172.21.15.63:0/3300543431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 msgr2=0x55d6ddc5db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:51.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.812+0000 7f4652d9d640 1 --2- 172.21.15.63:0/3300543431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 0x55d6ddc5db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.812+0000 7f4651d9b640 1 --2- 172.21.15.63:0/3300543431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 0x55d6ddc5e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.812+0000 7f4652d9d640 1 -- 172.21.15.63:0/3300543431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 msgr2=0x55d6ddc5e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:51.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.812+0000 7f4652d9d640 1 --2- 172.21.15.63:0/3300543431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 0x55d6ddc5e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.812+0000 7f464b7fe640 1 --2- 172.21.15.63:0/2127801174 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f46400b66b0 0x7f46400b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.812+0000 7f4652d9d640 1 -- 172.21.15.63:0/3300543431 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6dd921650 con 0x55d6dd8b6070 2024-09-21T06:33:51.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.812+0000 7f465259c640 1 --2- 172.21.15.63:0/3300543431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 0x55d6ddc5db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:33:51.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.812+0000 7f4651d9b640 1 --2- 172.21.15.63:0/3300543431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 0x55d6ddc5e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:33:51.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.812+0000 7f464b7fe640 1 -- 172.21.15.63:0/2127801174 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f463c0e7b10 con 0x7f46541094f0 2024-09-21T06:33:51.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.812+0000 7f465259c640 1 --2- 172.21.15.63:0/2127801174 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f46400b66b0 0x7f46400b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.812+0000 7f4652d9d640 1 --2- 172.21.15.63:0/3300543431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc5d650 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f464c00ac10 tx=0x7f464c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0268bee04c1ee43 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:51.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.812+0000 7f4648ff9640 1 -- 172.21.15.63:0/3300543431 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c005220 con 0x55d6dd8b6070 2024-09-21T06:33:51.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.813+0000 7f4648ff9640 1 -- 172.21.15.63:0/3300543431 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f464c0047a0 con 0x55d6dd8b6070 2024-09-21T06:33:51.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.813+0000 7f4648ff9640 1 -- 172.21.15.63:0/3300543431 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c018770 con 0x55d6dd8b6070 2024-09-21T06:33:51.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.813+0000 7f465259c640 1 --2- 172.21.15.63:0/2127801174 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f46400b66b0 0x7f46400b8bc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4644031440 tx=0x7f4644005890 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:51.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.813+0000 7f465f152740 1 -- 172.21.15.63:0/3300543431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 msgr2=0x55d6ddc5d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:51.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.813+0000 7f465f152740 1 --2- 172.21.15.63:0/3300543431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc5d650 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f464c00ac10 tx=0x7f464c00f790 comp rx=0 tx=0).stop 2024-09-21T06:33:51.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.813+0000 7f465f152740 1 -- 172.21.15.63:0/3300543431 shutdown_connections 2024-09-21T06:33:51.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.813+0000 7f465f152740 1 --2- 172.21.15.63:0/3300543431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 0x55d6ddc5e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.813+0000 7f465f152740 1 --2- 172.21.15.63:0/3300543431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 0x55d6ddc5db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.813+0000 7f465f152740 1 --2- 172.21.15.63:0/3300543431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc5d650 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.813+0000 7f465f152740 1 -- 172.21.15.63:0/3300543431 >> 172.21.15.63:0/3300543431 conn(0x55d6dd8aa460 msgr2=0x55d6ddc5b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:51.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.814+0000 7f465f152740 1 -- 172.21.15.63:0/3300543431 shutdown_connections 2024-09-21T06:33:51.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.814+0000 7f465f152740 1 -- 172.21.15.63:0/3300543431 wait complete. 2024-09-21T06:33:51.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.814+0000 7f465f152740 1 -- start start 2024-09-21T06:33:51.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.814+0000 7f465f152740 1 Processor -- start 2024-09-21T06:33:51.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.814+0000 7f465f152740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 0x55d6ddc6d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.814+0000 7f465f152740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 0x55d6ddc6d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.814+0000 7f465f152740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc6db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.815+0000 7f465f152740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d6dda24700 con 0x55d6dd8b6070 2024-09-21T06:33:51.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.815+0000 7f465f152740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d6ddb5e110 con 0x55d6dd895390 2024-09-21T06:33:51.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.815+0000 7f465f152740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d6ddc70190 con 0x55d6dd88d1b0 2024-09-21T06:33:51.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.815+0000 7f465f152740 10 client.0 _ll_register_callbacks cb 0x55d6ddb77990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:51.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.815+0000 7f4652d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc6db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.815+0000 7f4652d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc6db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34662/0 (socket says 172.21.15.63:34662) 2024-09-21T06:33:51.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.815+0000 7f4652d9d640 1 -- 172.21.15.63:0/1463136361 learned_addr learned my addr 172.21.15.63:0/1463136361 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:51.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.815+0000 7f465259c640 1 --2- 172.21.15.63:0/1463136361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 0x55d6ddc6d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.815+0000 7f4651d9b640 1 --2- 172.21.15.63:0/1463136361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 0x55d6ddc6d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.815+0000 7f4652d9d640 1 -- 172.21.15.63:0/1463136361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 msgr2=0x55d6ddc6d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:51.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.815+0000 7f4652d9d640 1 --2- 172.21.15.63:0/1463136361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 0x55d6ddc6d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.815+0000 7f4652d9d640 1 -- 172.21.15.63:0/1463136361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 msgr2=0x55d6ddc6d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:51.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.815+0000 7f4652d9d640 1 --2- 172.21.15.63:0/1463136361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 0x55d6ddc6d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.815+0000 7f4652d9d640 1 -- 172.21.15.63:0/1463136361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6ddb8bc40 con 0x55d6dd8b6070 2024-09-21T06:33:51.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.815+0000 7f4652d9d640 1 --2- 172.21.15.63:0/1463136361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc6db50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f464c004270 tx=0x7f464c0042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14066b3712b87917 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:51.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.815+0000 7f4639ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:33:51.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.815+0000 7f4639ffb640 1 -- 172.21.15.63:0/1463136361 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c027020 con 0x55d6dd8b6070 2024-09-21T06:33:51.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.816+0000 7f465f152740 1 -- 172.21.15.63:0/1463136361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f464c0047a0 con 0x55d6dd8b6070 2024-09-21T06:33:51.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.816+0000 7f4639ffb640 1 -- 172.21.15.63:0/1463136361 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f464c005210 con 0x55d6dd8b6070 2024-09-21T06:33:51.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.816+0000 7f4639ffb640 1 -- 172.21.15.63:0/1463136361 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f464c032050 con 0x55d6dd8b6070 2024-09-21T06:33:51.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.816+0000 7f465f152740 10 client.16719 fetch_fsmap learned FSMap version 51 2024-09-21T06:33:51.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.816+0000 7f465f152740 1 -- 172.21.15.63:0/1463136361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55d6ddc7bdc0 con 0x55d6dd8b6070 2024-09-21T06:33:51.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.816+0000 7f4639ffb640 1 -- 172.21.15.63:0/1463136361 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f464c0047a0 con 0x55d6dd8b6070 2024-09-21T06:33:51.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.816+0000 7f4639ffb640 1 -- 172.21.15.63:0/1463136361 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 51) ==== 8402+0+0 (secure 0 0 0) 0x7f464c003bc0 con 0x55d6dd8b6070 2024-09-21T06:33:51.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.816+0000 7f465f152740 10 client.16719 fetch_fsmap finished waiting for FSMap version 51 2024-09-21T06:33:51.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.816+0000 7f465f152740 10 client.16719 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:33:51.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.816+0000 7f465f152740 20 client.16719 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:51.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.816+0000 7f465f152740 1 --2- 172.21.15.63:0/1463136361 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d6dd8749f0 0x55d6ddc7f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.816+0000 7f465f152740 4 client.16719 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:33:51.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.816+0000 7f465f152740 1 -- 172.21.15.63:0/1463136361 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6ddbd5da0 con 0x55d6dd8749f0 2024-09-21T06:33:51.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.817+0000 7f465259c640 1 --2- 172.21.15.63:0/1463136361 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d6dd8749f0 0x55d6ddc7f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.817+0000 7f4639ffb640 10 client.16719 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:51.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.817+0000 7f465259c640 1 --2- 172.21.15.63:0/1463136361 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d6dd8749f0 0x55d6ddc7f1e0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c01e7ba02215f1ce server_cookie=5e9da9f7078e2fb2 in_seq=0 out_seq=0 2024-09-21T06:33:51.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.818+0000 7f4639ffb640 1 -- 172.21.15.63:0/1463136361 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d6ddbd5da0 con 0x55d6dd8749f0 2024-09-21T06:33:51.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.818+0000 7f4639ffb640 10 client.16719 handle_command_reply: tid=0 2024-09-21T06:33:51.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.818+0000 7f465f152740 1 client.16719 shutdown 2024-09-21T06:33:51.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.818+0000 7f465f152740 1 -- 172.21.15.63:0/1463136361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 msgr2=0x55d6ddc6db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:51.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.818+0000 7f465f152740 1 --2- 172.21.15.63:0/1463136361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc6db50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f464c004270 tx=0x7f464c0042a0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.818+0000 7f465f152740 1 -- 172.21.15.63:0/1463136361 shutdown_connections 2024-09-21T06:33:51.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.818+0000 7f465f152740 1 --2- 172.21.15.63:0/1463136361 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d6dd8749f0 0x55d6ddc7f1e0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.818+0000 7f465f152740 1 --2- 172.21.15.63:0/1463136361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc6db50 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.818+0000 7f465f152740 1 --2- 172.21.15.63:0/1463136361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 0x55d6ddc6d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.818+0000 7f465f152740 1 --2- 172.21.15.63:0/1463136361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 0x55d6ddc6d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.818+0000 7f465f152740 1 -- 172.21.15.63:0/1463136361 >> 172.21.15.63:0/1463136361 conn(0x55d6dd8aa460 msgr2=0x55d6ddc59b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:51.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.818+0000 7f4639ffb640 0 client.16719 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:51.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.818+0000 7f465f152740 1 -- 172.21.15.63:0/1463136361 shutdown_connections 2024-09-21T06:33:51.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.818+0000 7f465f152740 1 -- 172.21.15.63:0/1463136361 wait complete. 2024-09-21T06:33:51.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.818+0000 7f465f152740 20 client.16719 trim_cache size 0 max 16384 2024-09-21T06:33:51.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.836+0000 7f465f152740 1 Processor -- start 2024-09-21T06:33:51.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.836+0000 7f465f152740 1 -- start start 2024-09-21T06:33:51.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.836+0000 7f465f152740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 0x55d6ddc5b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.836+0000 7f465f152740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 0x55d6ddc5a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.836+0000 7f465f152740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc6a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.836+0000 7f465f152740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f46541ad4b0 con 0x55d6dd8b6070 2024-09-21T06:33:51.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.836+0000 7f465f152740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f46541af110 con 0x55d6dd895390 2024-09-21T06:33:51.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.836+0000 7f465f152740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f46541adbe0 con 0x55d6dd88d1b0 2024-09-21T06:33:51.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.836+0000 7f4652d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc6a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.836+0000 7f4652d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc6a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34668/0 (socket says 172.21.15.63:34668) 2024-09-21T06:33:51.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.836+0000 7f4652d9d640 1 -- 172.21.15.63:0/2484670593 learned_addr learned my addr 172.21.15.63:0/2484670593 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:51.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.837+0000 7f4651d9b640 1 --2- 172.21.15.63:0/2484670593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 0x55d6ddc5a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.837+0000 7f465259c640 1 --2- 172.21.15.63:0/2484670593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 0x55d6ddc5b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.837+0000 7f4652d9d640 1 -- 172.21.15.63:0/2484670593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 msgr2=0x55d6ddc5b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:51.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.837+0000 7f4652d9d640 1 --2- 172.21.15.63:0/2484670593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 0x55d6ddc5b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.837+0000 7f4652d9d640 1 -- 172.21.15.63:0/2484670593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 msgr2=0x55d6ddc5a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:51.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.837+0000 7f4652d9d640 1 --2- 172.21.15.63:0/2484670593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 0x55d6ddc5a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.837+0000 7f4652d9d640 1 -- 172.21.15.63:0/2484670593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6ddc6c010 con 0x55d6dd8b6070 2024-09-21T06:33:51.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.837+0000 7f4651d9b640 1 --2- 172.21.15.63:0/2484670593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 0x55d6ddc5a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:33:51.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.837+0000 7f4652d9d640 1 --2- 172.21.15.63:0/2484670593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc6a2a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f464c00ac10 tx=0x7f464c00fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76008053ddd1d591 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:51.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.837+0000 7f463bfff640 1 -- 172.21.15.63:0/2484670593 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c03b070 con 0x55d6dd8b6070 2024-09-21T06:33:51.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.837+0000 7f463bfff640 1 -- 172.21.15.63:0/2484670593 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f464c004780 con 0x55d6dd8b6070 2024-09-21T06:33:51.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.837+0000 7f463bfff640 1 -- 172.21.15.63:0/2484670593 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c027040 con 0x55d6dd8b6070 2024-09-21T06:33:51.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.838+0000 7f465f152740 1 -- 172.21.15.63:0/2484670593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 msgr2=0x55d6ddc6a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:51.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.838+0000 7f465f152740 1 --2- 172.21.15.63:0/2484670593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc6a2a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f464c00ac10 tx=0x7f464c00fdc0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.838+0000 7f465f152740 1 -- 172.21.15.63:0/2484670593 shutdown_connections 2024-09-21T06:33:51.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.838+0000 7f465f152740 1 --2- 172.21.15.63:0/2484670593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc6a2a0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.838+0000 7f465f152740 1 --2- 172.21.15.63:0/2484670593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 0x55d6ddc5a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.838+0000 7f465f152740 1 --2- 172.21.15.63:0/2484670593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 0x55d6ddc5b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.838+0000 7f465f152740 1 -- 172.21.15.63:0/2484670593 >> 172.21.15.63:0/2484670593 conn(0x55d6dd8aa460 msgr2=0x55d6ddc5ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:51.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.838+0000 7f465f152740 1 -- 172.21.15.63:0/2484670593 shutdown_connections 2024-09-21T06:33:51.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.838+0000 7f465f152740 1 -- 172.21.15.63:0/2484670593 wait complete. 2024-09-21T06:33:51.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.838+0000 7f465f152740 1 -- start start 2024-09-21T06:33:51.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.838+0000 7f465f152740 1 Processor -- start 2024-09-21T06:33:51.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.839+0000 7f465f152740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 0x55d6ddc75d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.839+0000 7f465f152740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 0x55d6ddc71210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.839+0000 7f465f152740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.839+0000 7f465f152740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f46541aea40 con 0x55d6dd8b6070 2024-09-21T06:33:51.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.839+0000 7f465f152740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f46541ae340 con 0x55d6dd895390 2024-09-21T06:33:51.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.839+0000 7f465f152740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f46541ab490 con 0x55d6dd88d1b0 2024-09-21T06:33:51.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.839+0000 7f465f152740 10 client.0 _ll_register_callbacks cb 0x7f464c00aa60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:33:51.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.839+0000 7f4652d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.839+0000 7f465259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 0x55d6ddc75d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.839+0000 7f4652d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34684/0 (socket says 172.21.15.63:34684) 2024-09-21T06:33:51.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.839+0000 7f4651d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 0x55d6ddc71210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.839+0000 7f4652d9d640 1 -- 172.21.15.63:0/4257376934 learned_addr learned my addr 172.21.15.63:0/4257376934 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:33:51.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.839+0000 7f4652d9d640 1 -- 172.21.15.63:0/4257376934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 msgr2=0x55d6ddc75d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:51.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.839+0000 7f4652d9d640 1 --2- 172.21.15.63:0/4257376934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 0x55d6ddc75d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.839+0000 7f4652d9d640 1 -- 172.21.15.63:0/4257376934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 msgr2=0x55d6ddc71210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:33:51.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.839+0000 7f4652d9d640 1 --2- 172.21.15.63:0/4257376934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 0x55d6ddc71210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.839+0000 7f4652d9d640 1 -- 172.21.15.63:0/4257376934 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6ddc72040 con 0x55d6dd8b6070 2024-09-21T06:33:51.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.840+0000 7f4652d9d640 1 --2- 172.21.15.63:0/4257376934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc718b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f464c004ca0 tx=0x7f464c00ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857e5ca53ff18b2b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:51.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.840+0000 7f4639ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:33:51.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.840+0000 7f4639ffb640 1 -- 172.21.15.63:0/4257376934 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c027070 con 0x55d6dd8b6070 2024-09-21T06:33:51.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.840+0000 7f4639ffb640 1 -- 172.21.15.63:0/4257376934 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f464c018ac0 con 0x55d6dd8b6070 2024-09-21T06:33:51.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.840+0000 7f465f152740 1 -- 172.21.15.63:0/4257376934 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f464c004780 con 0x55d6dd8b6070 2024-09-21T06:33:51.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.840+0000 7f4639ffb640 1 -- 172.21.15.63:0/4257376934 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f464c03b070 con 0x55d6dd8b6070 2024-09-21T06:33:51.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.840+0000 7f465f152740 10 client.16725 fetch_fsmap learned FSMap version 51 2024-09-21T06:33:51.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.840+0000 7f465f152740 1 -- 172.21.15.63:0/4257376934 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55d6ddce9a40 con 0x55d6dd8b6070 2024-09-21T06:33:51.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.840+0000 7f4639ffb640 1 -- 172.21.15.63:0/4257376934 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f464c004780 con 0x55d6dd8b6070 2024-09-21T06:33:51.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.840+0000 7f4639ffb640 1 -- 172.21.15.63:0/4257376934 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 51) ==== 8402+0+0 (secure 0 0 0) 0x7f464c0037f0 con 0x55d6dd8b6070 2024-09-21T06:33:51.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.840+0000 7f465f152740 10 client.16725 fetch_fsmap finished waiting for FSMap version 51 2024-09-21T06:33:51.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.840+0000 7f465f152740 10 client.16725 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:33:51.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.840+0000 7f465f152740 20 client.16725 populate_metadata read hostname 'smithi063' 2024-09-21T06:33:51.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.840+0000 7f465f152740 1 --2- 172.21.15.63:0/4257376934 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d6dd849da0 0x55d6ddcec0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.840+0000 7f465f152740 4 client.16725 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:33:51.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.840+0000 7f465f152740 1 -- 172.21.15.63:0/4257376934 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d6ddbd1850 con 0x55d6dd849da0 2024-09-21T06:33:51.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.841+0000 7f465259c640 1 --2- 172.21.15.63:0/4257376934 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d6dd849da0 0x55d6ddcec0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.841+0000 7f4639ffb640 10 client.16725 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:51.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.841+0000 7f465259c640 1 --2- 172.21.15.63:0/4257376934 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d6dd849da0 0x55d6ddcec0e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b9cbb4eef2958e0 server_cookie=3ab13b24a87fc733 in_seq=0 out_seq=0 2024-09-21T06:33:51.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.841+0000 7f4639ffb640 1 -- 172.21.15.63:0/4257376934 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x55d6ddbd1850 con 0x55d6dd849da0 2024-09-21T06:33:51.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.841+0000 7f4639ffb640 10 client.16725 handle_command_reply: tid=0 2024-09-21T06:33:51.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.841+0000 7f465f152740 1 client.16725 shutdown 2024-09-21T06:33:51.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f465f152740 1 -- 172.21.15.63:0/4257376934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 msgr2=0x55d6ddc718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:51.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f465f152740 1 --2- 172.21.15.63:0/4257376934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc718b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f464c004ca0 tx=0x7f464c00ab90 comp rx=0 tx=0).stop 2024-09-21T06:33:51.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f465f152740 1 -- 172.21.15.63:0/4257376934 shutdown_connections 2024-09-21T06:33:51.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f465f152740 1 --2- 172.21.15.63:0/4257376934 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d6dd849da0 0x55d6ddcec0e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f465f152740 1 --2- 172.21.15.63:0/4257376934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d6dd8b6070 0x55d6ddc718b0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f465f152740 1 --2- 172.21.15.63:0/4257376934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6dd895390 0x55d6ddc71210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f4639ffb640 0 client.16725 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:33:51.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f465f152740 1 --2- 172.21.15.63:0/4257376934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6dd88d1b0 0x55d6ddc75d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f465f152740 1 -- 172.21.15.63:0/4257376934 >> 172.21.15.63:0/4257376934 conn(0x55d6dd8aa460 msgr2=0x55d6ddc5a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:51.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f465f152740 1 -- 172.21.15.63:0/4257376934 shutdown_connections 2024-09-21T06:33:51.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f465f152740 1 -- 172.21.15.63:0/4257376934 wait complete. 2024-09-21T06:33:51.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f465f152740 20 client.16725 trim_cache size 0 max 16384 2024-09-21T06:33:51.849 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:33:51.849 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:33:51.849 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": { 2024-09-21T06:33:51.849 INFO:teuthology.orchestra.run.smithi063.stdout: "91ae0a75-6a3f-452f-8bda-0f19862a5724": { 2024-09-21T06:33:51.849 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:33:51.849 INFO:teuthology.orchestra.run.smithi063.stdout: "tag": "91ae0a75-6a3f-452f-8bda-0f19862a5724", 2024-09-21T06:33:51.849 INFO:teuthology.orchestra.run.smithi063.stdout: "options": "recursive,force" 2024-09-21T06:33:51.850 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:33:51.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:33:51.850 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:33:51.850 INFO:teuthology.orchestra.run.smithi063.stdout: "91ae0a75-6a3f-452f-8bda-0f19862a5724": { 2024-09-21T06:33:51.850 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:50.316590+0000", 2024-09-21T06:33:51.850 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:33:51.850 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:33:51.850 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:33:51.850 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:33:51.850 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:33:51.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:33:51.850 INFO:teuthology.orchestra.run.smithi063.stdout: "5396028b-35f4-48fe-b54d-385784e97de3": { 2024-09-21T06:33:51.850 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:04.523378+0000", 2024-09-21T06:33:51.850 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:33:51.851 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:33:51.851 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:33:51.851 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:33:51.851 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:33:51.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:33:51.851 INFO:teuthology.orchestra.run.smithi063.stdout: "024d3c59-0b67-49a9-bf4a-e02d36691942": { 2024-09-21T06:33:51.851 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:32:14.282244+0000", 2024-09-21T06:33:51.851 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:33:51.851 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:33:51.851 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:33:51.851 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:33:51.851 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:33:51.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:33:51.852 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:33:51.852 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:31:27.507051+0000", 2024-09-21T06:33:51.852 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:33:51.852 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:33:51.852 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:33:51.852 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:33:51.852 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:33:51.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:33:51.852 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:33:51.852 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:33:51.852 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:33:51.852 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:33:51.852 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:33:51.853 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:33:51.853 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:33:51.853 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:33:51.853 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:33:51.853 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:33:51.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f4658bde640 1 -- 172.21.15.63:0/2127801174 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f46400b66b0 msgr2=0x7f46400b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:51.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f4658bde640 1 --2- 172.21.15.63:0/2127801174 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f46400b66b0 0x7f46400b8bc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4644031440 tx=0x7f4644005890 comp rx=0 tx=0).stop 2024-09-21T06:33:51.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f4658bde640 1 -- 172.21.15.63:0/2127801174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46541094f0 msgr2=0x7f465419a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:51.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f4658bde640 1 --2- 172.21.15.63:0/2127801174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46541094f0 0x7f465419a9f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f463c00cce0 tx=0x7f463c00a620 comp rx=0 tx=0).stop 2024-09-21T06:33:51.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f4658bde640 1 -- 172.21.15.63:0/2127801174 shutdown_connections 2024-09-21T06:33:51.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f4658bde640 1 --2- 172.21.15.63:0/2127801174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4654109e40 0x7f465419fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f4658bde640 1 --2- 172.21.15.63:0/2127801174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46541094f0 0x7f465419a9f0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f4658bde640 1 --2- 172.21.15.63:0/2127801174 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f46400b66b0 0x7f46400b8bc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f4658bde640 1 --2- 172.21.15.63:0/2127801174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4654103bb0 0x7f465419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.842+0000 7f4658bde640 1 -- 172.21.15.63:0/2127801174 >> 172.21.15.63:0/2127801174 conn(0x7f46540ff600 msgr2=0x7f4654101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:51.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.843+0000 7f4658bde640 1 -- 172.21.15.63:0/2127801174 shutdown_connections 2024-09-21T06:33:51.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:33:51.843+0000 7f4658bde640 1 -- 172.21.15.63:0/2127801174 wait complete. 2024-09-21T06:33:52.070 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:51 smithi071 ceph-mon[34844]: pgmap v492: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.7 KiB/s wr, 13 op/s 2024-09-21T06:33:52.070 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:51 smithi071 ceph-mon[34844]: scrub queued for path: / 2024-09-21T06:33:52.071 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:51 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:52.071 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:51 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:33:52.071 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:51 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:33:52.071 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:51 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:52.071 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:51 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:52.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:51 smithi063 ceph-mon[31150]: pgmap v492: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.7 KiB/s wr, 13 op/s 2024-09-21T06:33:52.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:51 smithi063 ceph-mon[31150]: scrub queued for path: / 2024-09-21T06:33:52.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:51 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:52.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:51 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:33:52.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:51 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:33:52.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:51 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:52.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:51 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:52.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:51 smithi175 ceph-mon[34510]: pgmap v492: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.7 KiB/s wr, 13 op/s 2024-09-21T06:33:52.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:51 smithi175 ceph-mon[34510]: scrub queued for path: / 2024-09-21T06:33:52.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:51 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:52.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:51 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:33:52.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:51 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:33:52.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:51 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:52.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:51 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:33:52.615 INFO:tasks.cephfs.filesystem:scrub status for tag:91ae0a75-6a3f-452f-8bda-0f19862a5724 - {'path': '/', 'tag': '91ae0a75-6a3f-452f-8bda-0f19862a5724', 'options': 'recursive,force'} 2024-09-21T06:33:53.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:52 smithi063 ceph-mon[31150]: pgmap v493: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.9 KiB/s wr, 12 op/s 2024-09-21T06:33:53.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:52 smithi175 ceph-mon[34510]: pgmap v493: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.9 KiB/s wr, 12 op/s 2024-09-21T06:33:53.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:52 smithi071 ceph-mon[34844]: pgmap v493: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.9 KiB/s wr, 12 op/s 2024-09-21T06:33:55.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:54 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:55.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:54 smithi063 ceph-mon[31150]: pgmap v494: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.0 KiB/s wr, 12 op/s 2024-09-21T06:33:55.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:54 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:55.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:54 smithi175 ceph-mon[34510]: pgmap v494: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.0 KiB/s wr, 12 op/s 2024-09-21T06:33:55.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:54 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:33:55.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:54 smithi071 ceph-mon[34844]: pgmap v494: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.0 KiB/s wr, 12 op/s 2024-09-21T06:33:57.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:57 smithi063 ceph-mon[31150]: pgmap v495: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-21T06:33:57.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:57 smithi175 ceph-mon[34510]: pgmap v495: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-21T06:33:57.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:57 smithi071 ceph-mon[34844]: pgmap v495: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-21T06:33:59.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:59 smithi063 ceph-mon[31150]: pgmap v496: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.4 KiB/s wr, 11 op/s 2024-09-21T06:33:59.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:59 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:33:59.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:33:59 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:33:59.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:59 smithi175 ceph-mon[34510]: pgmap v496: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.4 KiB/s wr, 11 op/s 2024-09-21T06:33:59.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:59 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:33:59.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:33:59 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:33:59.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:59 smithi071 ceph-mon[34844]: pgmap v496: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.4 KiB/s wr, 11 op/s 2024-09-21T06:33:59.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:59 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:33:59.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:33:59 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:34:01.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:01 smithi063 ceph-mon[31150]: pgmap v497: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-21T06:34:01.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:01 smithi175 ceph-mon[34510]: pgmap v497: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-21T06:34:01.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:01 smithi071 ceph-mon[34844]: pgmap v497: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-21T06:34:03.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:03 smithi063 ceph-mon[31150]: pgmap v498: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T06:34:03.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:03 smithi175 ceph-mon[34510]: pgmap v498: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T06:34:03.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:03 smithi071 ceph-mon[34844]: pgmap v498: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T06:34:05.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:05 smithi063 ceph-mon[31150]: pgmap v499: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 23 op/s 2024-09-21T06:34:05.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:05 smithi175 ceph-mon[34510]: pgmap v499: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 23 op/s 2024-09-21T06:34:05.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:05 smithi071 ceph-mon[34844]: pgmap v499: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 23 op/s 2024-09-21T06:34:07.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:07 smithi063 ceph-mon[31150]: pgmap v500: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-21T06:34:07.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:07 smithi175 ceph-mon[34510]: pgmap v500: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-21T06:34:07.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:07 smithi071 ceph-mon[34844]: pgmap v500: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-21T06:34:09.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:09 smithi063 ceph-mon[31150]: pgmap v501: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:34:09.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:09 smithi175 ceph-mon[34510]: pgmap v501: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:34:09.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:09 smithi071 ceph-mon[34844]: pgmap v501: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:34:10.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:10 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:34:10.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:10 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:34:10.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:10 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:34:11.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:11 smithi063 ceph-mon[31150]: pgmap v502: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T06:34:11.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:11 smithi175 ceph-mon[34510]: pgmap v502: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T06:34:11.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:11 smithi071 ceph-mon[34844]: pgmap v502: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T06:34:13.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:13 smithi175 ceph-mon[34510]: pgmap v503: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:34:13.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:13 smithi071 ceph-mon[34844]: pgmap v503: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:34:13.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:13 smithi063 ceph-mon[31150]: pgmap v503: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:34:15.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:15 smithi175 ceph-mon[34510]: pgmap v504: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:34:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:15 smithi071 ceph-mon[34844]: pgmap v504: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:34:15.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:15 smithi063 ceph-mon[31150]: pgmap v504: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:34:17.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:17 smithi175 ceph-mon[34510]: pgmap v505: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-21T06:34:17.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:17 smithi071 ceph-mon[34844]: pgmap v505: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-21T06:34:17.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:17 smithi063 ceph-mon[31150]: pgmap v505: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-21T06:34:19.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:19 smithi175 ceph-mon[34510]: pgmap v506: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:34:19.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:19 smithi071 ceph-mon[34844]: pgmap v506: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:34:19.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:19 smithi063 ceph-mon[31150]: pgmap v506: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T06:34:21.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:21 smithi071 ceph-mon[34844]: pgmap v507: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T06:34:21.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:21 smithi063 ceph-mon[31150]: pgmap v507: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T06:34:21.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:21 smithi175 ceph-mon[34510]: pgmap v507: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T06:34:22.617 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:34:22.895 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:23.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:23 smithi063 ceph-mon[31150]: pgmap v508: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T06:34:23.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.351+0000 7f281cf28640 1 -- 172.21.15.63:0/2814681547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28181094d0 msgr2=0x7f28181098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:23.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.351+0000 7f281cf28640 1 --2- 172.21.15.63:0/2814681547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28181094d0 0x7f28181098e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f280c009900 tx=0x7f280c02a410 comp rx=0 tx=0).stop 2024-09-21T06:34:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.351+0000 7f281cf28640 1 -- 172.21.15.63:0/2814681547 shutdown_connections 2024-09-21T06:34:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.351+0000 7f281cf28640 1 --2- 172.21.15.63:0/2814681547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2818109e20 0x7f2818110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.351+0000 7f281cf28640 1 --2- 172.21.15.63:0/2814681547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28181094d0 0x7f28181098e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.351+0000 7f281cf28640 1 --2- 172.21.15.63:0/2814681547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2818103b90 0x7f2818103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.351+0000 7f281cf28640 1 -- 172.21.15.63:0/2814681547 >> 172.21.15.63:0/2814681547 conn(0x7f28180ff5e0 msgr2=0x7f2818101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.351+0000 7f281cf28640 1 -- 172.21.15.63:0/2814681547 shutdown_connections 2024-09-21T06:34:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.351+0000 7f281cf28640 1 -- 172.21.15.63:0/2814681547 wait complete. 2024-09-21T06:34:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.352+0000 7f281cf28640 1 Processor -- start 2024-09-21T06:34:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.352+0000 7f281cf28640 1 -- start start 2024-09-21T06:34:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.352+0000 7f281cf28640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2818103b90 0x7f281819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.352+0000 7f281cf28640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28181094d0 0x7f281819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.352+0000 7f281cf28640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2818109e20 0x7f281819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.352+0000 7f281cf28640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2818113ae0 con 0x7f2818109e20 2024-09-21T06:34:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.353+0000 7f281cf28640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2818113960 con 0x7f2818103b90 2024-09-21T06:34:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.353+0000 7f281cf28640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2818113c60 con 0x7f28181094d0 2024-09-21T06:34:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.353+0000 7f2816d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2818109e20 0x7f281819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.353+0000 7f2816d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2818109e20 0x7f281819fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35174/0 (socket says 172.21.15.63:35174) 2024-09-21T06:34:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.353+0000 7f2816d9d640 1 -- 172.21.15.63:0/4049490635 learned_addr learned my addr 172.21.15.63:0/4049490635 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.353+0000 7f281659c640 1 --2- 172.21.15.63:0/4049490635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2818103b90 0x7f281819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.353+0000 7f2815d9b640 1 --2- 172.21.15.63:0/4049490635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28181094d0 0x7f281819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.353+0000 7f2816d9d640 1 -- 172.21.15.63:0/4049490635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28181094d0 msgr2=0x7f281819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.353+0000 7f2816d9d640 1 --2- 172.21.15.63:0/4049490635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28181094d0 0x7f281819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.353+0000 7f2816d9d640 1 -- 172.21.15.63:0/4049490635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2818103b90 msgr2=0x7f281819a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.353+0000 7f2816d9d640 1 --2- 172.21.15.63:0/4049490635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2818103b90 0x7f281819a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.353+0000 7f2816d9d640 1 -- 172.21.15.63:0/4049490635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28181a0340 con 0x7f2818109e20 2024-09-21T06:34:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.353+0000 7f2816d9d640 1 --2- 172.21.15.63:0/4049490635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2818109e20 0x7f281819fcd0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f281000eaa0 tx=0x7f281000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.353+0000 7f28077fe640 1 -- 172.21.15.63:0/4049490635 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2810004d20 con 0x7f2818109e20 2024-09-21T06:34:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.354+0000 7f281cf28640 1 -- 172.21.15.63:0/4049490635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28181a0630 con 0x7f2818109e20 2024-09-21T06:34:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.354+0000 7f28077fe640 1 -- 172.21.15.63:0/4049490635 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2810005020 con 0x7f2818109e20 2024-09-21T06:34:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.354+0000 7f28077fe640 1 -- 172.21.15.63:0/4049490635 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28100116b0 con 0x7f2818109e20 2024-09-21T06:34:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.354+0000 7f281cf28640 1 -- 172.21.15.63:0/4049490635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28181a6e50 con 0x7f2818109e20 2024-09-21T06:34:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.356+0000 7f282349c740 1 Processor -- start 2024-09-21T06:34:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.356+0000 7f28077fe640 1 -- 172.21.15.63:0/4049490635 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f2810011850 con 0x7f2818109e20 2024-09-21T06:34:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.357+0000 7f282349c740 1 -- start start 2024-09-21T06:34:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.357+0000 7f282349c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a64070 0x55b6b3e0b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.357+0000 7f282349c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a3b1b0 0x55b6b3e0bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.357+0000 7f282349c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a43390 0x55b6b3e0c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.357+0000 7f282349c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55b6b3d81e50 con 0x55b6b3a43390 2024-09-21T06:34:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.357+0000 7f282349c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b6b3d71280 con 0x55b6b3a3b1b0 2024-09-21T06:34:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.357+0000 7f282349c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b6b3d75090 con 0x55b6b3a64070 2024-09-21T06:34:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.357+0000 7f2815d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a43390 0x55b6b3e0c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.357+0000 7f2815d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a43390 0x55b6b3e0c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35176/0 (socket says 172.21.15.63:35176) 2024-09-21T06:34:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.357+0000 7f2815d9b640 1 -- 172.21.15.63:0/4262695378 learned_addr learned my addr 172.21.15.63:0/4262695378 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.357+0000 7f281659c640 1 --2- 172.21.15.63:0/4262695378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a3b1b0 0x55b6b3e0bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.357+0000 7f2815d9b640 1 --2- 172.21.15.63:0/4262695378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a64070 0x55b6b3e0b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.357+0000 7f2815d9b640 1 -- 172.21.15.63:0/4262695378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a64070 msgr2=0x55b6b3e0b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.357+0000 7f2815d9b640 1 --2- 172.21.15.63:0/4262695378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a64070 0x55b6b3e0b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.357+0000 7f2815d9b640 1 -- 172.21.15.63:0/4262695378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a3b1b0 msgr2=0x55b6b3e0bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.357+0000 7f2815d9b640 1 --2- 172.21.15.63:0/4262695378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a3b1b0 0x55b6b3e0bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.357+0000 7f2815d9b640 1 -- 172.21.15.63:0/4262695378 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b3acf650 con 0x55b6b3a43390 2024-09-21T06:34:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.357+0000 7f281659c640 1 --2- 172.21.15.63:0/4262695378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a3b1b0 0x55b6b3e0bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.357+0000 7f28077fe640 1 --2- 172.21.15.63:0/4049490635 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f28000b66b0 0x7f28000b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.358+0000 7f281659c640 1 --2- 172.21.15.63:0/4049490635 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f28000b66b0 0x7f28000b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.358+0000 7f2815d9b640 1 --2- 172.21.15.63:0/4262695378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a43390 0x55b6b3e0c0d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f281806bb30 tx=0x7f280c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92a7a0722bb95bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.358+0000 7f28077fe640 1 -- 172.21.15.63:0/4049490635 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f28100e7880 con 0x7f2818109e20 2024-09-21T06:34:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.358+0000 7f2804ff9640 1 -- 172.21.15.63:0/4262695378 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c044020 con 0x55b6b3a43390 2024-09-21T06:34:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.358+0000 7f2804ff9640 1 -- 172.21.15.63:0/4262695378 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f280c031820 con 0x55b6b3a43390 2024-09-21T06:34:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.358+0000 7f2804ff9640 1 -- 172.21.15.63:0/4262695378 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c035070 con 0x55b6b3a43390 2024-09-21T06:34:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.359+0000 7f282349c740 1 -- 172.21.15.63:0/4262695378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a43390 msgr2=0x55b6b3e0c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.359+0000 7f281659c640 1 --2- 172.21.15.63:0/4049490635 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f28000b66b0 0x7f28000b8bc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55b6b3e0a2d0 tx=0x7f280800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.359+0000 7f282349c740 1 --2- 172.21.15.63:0/4262695378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a43390 0x55b6b3e0c0d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f281806bb30 tx=0x7f280c000bc0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.359+0000 7f282349c740 1 -- 172.21.15.63:0/4262695378 shutdown_connections 2024-09-21T06:34:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.359+0000 7f282349c740 1 --2- 172.21.15.63:0/4262695378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a43390 0x55b6b3e0c0d0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.359+0000 7f282349c740 1 --2- 172.21.15.63:0/4262695378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a3b1b0 0x55b6b3e0bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.359+0000 7f282349c740 1 --2- 172.21.15.63:0/4262695378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a64070 0x55b6b3e0b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.359+0000 7f282349c740 1 -- 172.21.15.63:0/4262695378 >> 172.21.15.63:0/4262695378 conn(0x55b6b3a58460 msgr2=0x55b6b3e09540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.359+0000 7f282349c740 1 -- 172.21.15.63:0/4262695378 shutdown_connections 2024-09-21T06:34:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.359+0000 7f282349c740 1 -- 172.21.15.63:0/4262695378 wait complete. 2024-09-21T06:34:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f282349c740 1 -- start start 2024-09-21T06:34:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f282349c740 1 Processor -- start 2024-09-21T06:34:23.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f282349c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a3b1b0 0x55b6b3e16cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f282349c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a43390 0x55b6b3e17200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f282349c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a64070 0x55b6b3e230c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f282349c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55b6b3bd2700 con 0x55b6b3a64070 2024-09-21T06:34:23.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f282349c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b6b3d0c110 con 0x55b6b3a3b1b0 2024-09-21T06:34:23.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f282349c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b6b3e19dd0 con 0x55b6b3a43390 2024-09-21T06:34:23.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f282349c740 10 client.0 _ll_register_callbacks cb 0x55b6b3d25990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:34:23.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f2816d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a64070 0x55b6b3e230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f2816d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a64070 0x55b6b3e230c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35188/0 (socket says 172.21.15.63:35188) 2024-09-21T06:34:23.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f2816d9d640 1 -- 172.21.15.63:0/528609520 learned_addr learned my addr 172.21.15.63:0/528609520 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:23.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f281659c640 1 --2- 172.21.15.63:0/528609520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a3b1b0 0x55b6b3e16cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f2815d9b640 1 --2- 172.21.15.63:0/528609520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a43390 0x55b6b3e17200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f2816d9d640 1 -- 172.21.15.63:0/528609520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a43390 msgr2=0x55b6b3e17200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:23.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f2816d9d640 1 --2- 172.21.15.63:0/528609520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a43390 0x55b6b3e17200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f2816d9d640 1 -- 172.21.15.63:0/528609520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a3b1b0 msgr2=0x55b6b3e16cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:23.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f2816d9d640 1 --2- 172.21.15.63:0/528609520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a3b1b0 0x55b6b3e16cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f2816d9d640 1 -- 172.21.15.63:0/528609520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6b3d39c40 con 0x55b6b3a64070 2024-09-21T06:34:23.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f281659c640 1 --2- 172.21.15.63:0/528609520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a3b1b0 0x55b6b3e16cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:23.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.360+0000 7f2815d9b640 1 --2- 172.21.15.63:0/528609520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a43390 0x55b6b3e17200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:23.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.361+0000 7f2816d9d640 1 --2- 172.21.15.63:0/528609520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a64070 0x55b6b3e230c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f28100ad640 tx=0x7f2810005450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1659350a1c17983 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:23.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.361+0000 7f27fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:34:23.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.361+0000 7f27fdffb640 1 -- 172.21.15.63:0/528609520 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281001f030 con 0x55b6b3a64070 2024-09-21T06:34:23.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.361+0000 7f27fdffb640 1 -- 172.21.15.63:0/528609520 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f28100acb10 con 0x55b6b3a64070 2024-09-21T06:34:23.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.361+0000 7f282349c740 1 -- 172.21.15.63:0/528609520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f280c031820 con 0x55b6b3a64070 2024-09-21T06:34:23.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.361+0000 7f27fdffb640 1 -- 172.21.15.63:0/528609520 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f28100addb0 con 0x55b6b3a64070 2024-09-21T06:34:23.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.361+0000 7f282349c740 10 client.16737 fetch_fsmap learned FSMap version 53 2024-09-21T06:34:23.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.361+0000 7f282349c740 1 -- 172.21.15.63:0/528609520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55b6b3e25b00 con 0x55b6b3a64070 2024-09-21T06:34:23.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.361+0000 7f27fdffb640 1 -- 172.21.15.63:0/528609520 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f280c031820 con 0x55b6b3a64070 2024-09-21T06:34:23.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.361+0000 7f27fdffb640 1 -- 172.21.15.63:0/528609520 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7f281000f040 con 0x55b6b3a64070 2024-09-21T06:34:23.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.361+0000 7f282349c740 10 client.16737 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:34:23.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.361+0000 7f282349c740 10 client.16737 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:34:23.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.361+0000 7f282349c740 20 client.16737 populate_metadata read hostname 'smithi063' 2024-09-21T06:34:23.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.361+0000 7f282349c740 1 --2- 172.21.15.63:0/528609520 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b6b3a229f0 0x55b6b3e29000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.362+0000 7f282349c740 4 client.16737 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:34:23.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.362+0000 7f282349c740 1 -- 172.21.15.63:0/528609520 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6b3d83da0 con 0x55b6b3a229f0 2024-09-21T06:34:23.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.362+0000 7f281659c640 1 --2- 172.21.15.63:0/528609520 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b6b3a229f0 0x55b6b3e29000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.362+0000 7f281659c640 1 --2- 172.21.15.63:0/528609520 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b6b3a229f0 0x55b6b3e29000 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc97f1a2c49510c2 server_cookie=87bd036cf565d9b in_seq=0 out_seq=0 2024-09-21T06:34:23.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.362+0000 7f27fdffb640 10 client.16737 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:34:23.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.363+0000 7f27fdffb640 1 -- 172.21.15.63:0/528609520 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b6b3d83da0 con 0x55b6b3a229f0 2024-09-21T06:34:23.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.363+0000 7f27fdffb640 10 client.16737 handle_command_reply: tid=0 2024-09-21T06:34:23.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.363+0000 7f282349c740 1 client.16737 shutdown 2024-09-21T06:34:23.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.363+0000 7f282349c740 1 -- 172.21.15.63:0/528609520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a64070 msgr2=0x55b6b3e230c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:23.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.363+0000 7f282349c740 1 --2- 172.21.15.63:0/528609520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a64070 0x55b6b3e230c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f28100ad640 tx=0x7f2810005450 comp rx=0 tx=0).stop 2024-09-21T06:34:23.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.363+0000 7f282349c740 1 -- 172.21.15.63:0/528609520 shutdown_connections 2024-09-21T06:34:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.363+0000 7f282349c740 1 --2- 172.21.15.63:0/528609520 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b6b3a229f0 0x55b6b3e29000 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.363+0000 7f282349c740 1 --2- 172.21.15.63:0/528609520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a64070 0x55b6b3e230c0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.363+0000 7f27fdffb640 0 client.16737 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:34:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.363+0000 7f282349c740 1 --2- 172.21.15.63:0/528609520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a43390 0x55b6b3e17200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.363+0000 7f282349c740 1 --2- 172.21.15.63:0/528609520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a3b1b0 0x55b6b3e16cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.363+0000 7f282349c740 1 -- 172.21.15.63:0/528609520 >> 172.21.15.63:0/528609520 conn(0x55b6b3a58460 msgr2=0x55b6b3e0e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.363+0000 7f282349c740 1 -- 172.21.15.63:0/528609520 shutdown_connections 2024-09-21T06:34:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.363+0000 7f282349c740 1 -- 172.21.15.63:0/528609520 wait complete. 2024-09-21T06:34:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.363+0000 7f282349c740 20 client.16737 trim_cache size 0 max 16384 2024-09-21T06:34:23.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.382+0000 7f282349c740 1 Processor -- start 2024-09-21T06:34:23.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.382+0000 7f282349c740 1 -- start start 2024-09-21T06:34:23.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.382+0000 7f282349c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a229f0 0x55b6b3e0d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.382+0000 7f282349c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a3b1b0 0x55b6b3e18ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.382+0000 7f282349c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a43390 0x55b6b3e22fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.382+0000 7f282349c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f28181af6a0 con 0x55b6b3a3b1b0 2024-09-21T06:34:23.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.382+0000 7f282349c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f28181b12a0 con 0x55b6b3a229f0 2024-09-21T06:34:23.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.382+0000 7f282349c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f28181afd70 con 0x55b6b3a43390 2024-09-21T06:34:23.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.382+0000 7f2815d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a3b1b0 0x55b6b3e18ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.382+0000 7f2815d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a3b1b0 0x55b6b3e18ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35196/0 (socket says 172.21.15.63:35196) 2024-09-21T06:34:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.382+0000 7f2815d9b640 1 -- 172.21.15.63:0/1815198523 learned_addr learned my addr 172.21.15.63:0/1815198523 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.382+0000 7f281659c640 1 --2- 172.21.15.63:0/1815198523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a229f0 0x55b6b3e0d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.382+0000 7f2816d9d640 1 --2- 172.21.15.63:0/1815198523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a43390 0x55b6b3e22fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.382+0000 7f2815d9b640 1 -- 172.21.15.63:0/1815198523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a43390 msgr2=0x55b6b3e22fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.382+0000 7f2815d9b640 1 --2- 172.21.15.63:0/1815198523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a43390 0x55b6b3e22fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.382+0000 7f2815d9b640 1 -- 172.21.15.63:0/1815198523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a229f0 msgr2=0x55b6b3e0d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.382+0000 7f2815d9b640 1 --2- 172.21.15.63:0/1815198523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a229f0 0x55b6b3e0d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.382+0000 7f2815d9b640 1 -- 172.21.15.63:0/1815198523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b3e17f80 con 0x55b6b3a3b1b0 2024-09-21T06:34:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.383+0000 7f2815d9b640 1 --2- 172.21.15.63:0/1815198523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a3b1b0 0x55b6b3e18ba0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f280c005760 tx=0x7f280c032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca691066c5c6913d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.383+0000 7f27fffff640 1 -- 172.21.15.63:0/1815198523 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c044070 con 0x55b6b3a3b1b0 2024-09-21T06:34:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.383+0000 7f27fffff640 1 -- 172.21.15.63:0/1815198523 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f280c04e020 con 0x55b6b3a3b1b0 2024-09-21T06:34:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.383+0000 7f27fffff640 1 -- 172.21.15.63:0/1815198523 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c035070 con 0x55b6b3a3b1b0 2024-09-21T06:34:23.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.384+0000 7f282349c740 1 -- 172.21.15.63:0/1815198523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a3b1b0 msgr2=0x55b6b3e18ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:23.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.384+0000 7f282349c740 1 --2- 172.21.15.63:0/1815198523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a3b1b0 0x55b6b3e18ba0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f280c005760 tx=0x7f280c032f90 comp rx=0 tx=0).stop 2024-09-21T06:34:23.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.384+0000 7f282349c740 1 -- 172.21.15.63:0/1815198523 shutdown_connections 2024-09-21T06:34:23.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.384+0000 7f282349c740 1 --2- 172.21.15.63:0/1815198523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a43390 0x55b6b3e22fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.384+0000 7f282349c740 1 --2- 172.21.15.63:0/1815198523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a3b1b0 0x55b6b3e18ba0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.384+0000 7f282349c740 1 --2- 172.21.15.63:0/1815198523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a229f0 0x55b6b3e0d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.384+0000 7f282349c740 1 -- 172.21.15.63:0/1815198523 >> 172.21.15.63:0/1815198523 conn(0x55b6b3a58460 msgr2=0x55b6b3e10760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.384+0000 7f282349c740 1 -- 172.21.15.63:0/1815198523 shutdown_connections 2024-09-21T06:34:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.384+0000 7f282349c740 1 -- 172.21.15.63:0/1815198523 wait complete. 2024-09-21T06:34:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.384+0000 7f282349c740 1 -- start start 2024-09-21T06:34:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.384+0000 7f282349c740 1 Processor -- start 2024-09-21T06:34:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.385+0000 7f282349c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a229f0 0x55b6b3e1b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.385+0000 7f282349c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a3b1b0 0x55b6b3e1bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.385+0000 7f282349c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a43390 0x55b6b3e929c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.385+0000 7f282349c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f28181b0bd0 con 0x55b6b3a229f0 2024-09-21T06:34:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.385+0000 7f282349c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f28181b04d0 con 0x55b6b3a43390 2024-09-21T06:34:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.385+0000 7f282349c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f28181ad680 con 0x55b6b3a3b1b0 2024-09-21T06:34:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.385+0000 7f282349c740 10 client.0 _ll_register_callbacks cb 0x7f2810004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:34:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.385+0000 7f281659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a229f0 0x55b6b3e1b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.385+0000 7f281659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a229f0 0x55b6b3e1b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35198/0 (socket says 172.21.15.63:35198) 2024-09-21T06:34:23.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.385+0000 7f281659c640 1 -- 172.21.15.63:0/2188104449 learned_addr learned my addr 172.21.15.63:0/2188104449 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:23.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.385+0000 7f2816d9d640 1 --2- 172.21.15.63:0/2188104449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a43390 0x55b6b3e929c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.385+0000 7f2815d9b640 1 --2- 172.21.15.63:0/2188104449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a3b1b0 0x55b6b3e1bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.385+0000 7f281659c640 1 -- 172.21.15.63:0/2188104449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a3b1b0 msgr2=0x55b6b3e1bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:23.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.385+0000 7f281659c640 1 --2- 172.21.15.63:0/2188104449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a3b1b0 0x55b6b3e1bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.385+0000 7f281659c640 1 -- 172.21.15.63:0/2188104449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a43390 msgr2=0x55b6b3e929c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:23.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.385+0000 7f281659c640 1 --2- 172.21.15.63:0/2188104449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a43390 0x55b6b3e929c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.385+0000 7f281659c640 1 -- 172.21.15.63:0/2188104449 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6b3e92f00 con 0x55b6b3a229f0 2024-09-21T06:34:23.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.385+0000 7f281659c640 1 --2- 172.21.15.63:0/2188104449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a229f0 0x55b6b3e1b780 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f280801f390 tx=0x7f28080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b256c8dff85218 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:23.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.385+0000 7f27fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:34:23.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.385+0000 7f27fdffb640 1 -- 172.21.15.63:0/2188104449 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2808030620 con 0x55b6b3a229f0 2024-09-21T06:34:23.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.386+0000 7f27fdffb640 1 -- 172.21.15.63:0/2188104449 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f28080307c0 con 0x55b6b3a229f0 2024-09-21T06:34:23.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.386+0000 7f282349c740 1 -- 172.21.15.63:0/2188104449 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f280c04e020 con 0x55b6b3a229f0 2024-09-21T06:34:23.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.386+0000 7f27fdffb640 1 -- 172.21.15.63:0/2188104449 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f280801fe50 con 0x55b6b3a229f0 2024-09-21T06:34:23.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.386+0000 7f282349c740 10 client.16743 fetch_fsmap learned FSMap version 53 2024-09-21T06:34:23.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.386+0000 7f282349c740 1 -- 172.21.15.63:0/2188104449 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55b6b3e941f0 con 0x55b6b3a229f0 2024-09-21T06:34:23.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.386+0000 7f27fdffb640 1 -- 172.21.15.63:0/2188104449 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f280c04e020 con 0x55b6b3a229f0 2024-09-21T06:34:23.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.386+0000 7f27fdffb640 1 -- 172.21.15.63:0/2188104449 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7f280801ea90 con 0x55b6b3a229f0 2024-09-21T06:34:23.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.386+0000 7f282349c740 10 client.16743 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:34:23.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.386+0000 7f282349c740 10 client.16743 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:34:23.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.386+0000 7f282349c740 20 client.16743 populate_metadata read hostname 'smithi063' 2024-09-21T06:34:23.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.386+0000 7f282349c740 1 --2- 172.21.15.63:0/2188104449 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b6b3a64070 0x55b6b3e969e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.386+0000 7f282349c740 4 client.16743 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:34:23.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.386+0000 7f282349c740 1 -- 172.21.15.63:0/2188104449 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b6b3d7f850 con 0x55b6b3a64070 2024-09-21T06:34:23.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.387+0000 7f2815d9b640 1 --2- 172.21.15.63:0/2188104449 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b6b3a64070 0x55b6b3e969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.387+0000 7f2815d9b640 1 --2- 172.21.15.63:0/2188104449 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b6b3a64070 0x55b6b3e969e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfe0e4f4ac2eb1e5 server_cookie=1e927b3fcb69c183 in_seq=0 out_seq=0 2024-09-21T06:34:23.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.387+0000 7f27fdffb640 10 client.16743 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:34:23.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.387+0000 7f27fdffb640 1 -- 172.21.15.63:0/2188104449 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x55b6b3d7f850 con 0x55b6b3a64070 2024-09-21T06:34:23.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.387+0000 7f27fdffb640 10 client.16743 handle_command_reply: tid=0 2024-09-21T06:34:23.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.387+0000 7f282349c740 1 client.16743 shutdown 2024-09-21T06:34:23.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.387+0000 7f282349c740 1 -- 172.21.15.63:0/2188104449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a229f0 msgr2=0x55b6b3e1b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:23.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.387+0000 7f282349c740 1 --2- 172.21.15.63:0/2188104449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a229f0 0x55b6b3e1b780 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f280801f390 tx=0x7f28080046c0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.388+0000 7f282349c740 1 -- 172.21.15.63:0/2188104449 shutdown_connections 2024-09-21T06:34:23.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.388+0000 7f282349c740 1 --2- 172.21.15.63:0/2188104449 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b6b3a64070 0x55b6b3e969e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.388+0000 7f27fdffb640 0 client.16743 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:34:23.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.388+0000 7f282349c740 1 --2- 172.21.15.63:0/2188104449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6b3a43390 0x55b6b3e929c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.388+0000 7f282349c740 1 --2- 172.21.15.63:0/2188104449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6b3a3b1b0 0x55b6b3e1bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.388+0000 7f282349c740 1 --2- 172.21.15.63:0/2188104449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b6b3a229f0 0x55b6b3e1b780 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.388+0000 7f282349c740 1 -- 172.21.15.63:0/2188104449 >> 172.21.15.63:0/2188104449 conn(0x55b6b3a58460 msgr2=0x55b6b3e188e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:23.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.388+0000 7f282349c740 1 -- 172.21.15.63:0/2188104449 shutdown_connections 2024-09-21T06:34:23.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.388+0000 7f282349c740 1 -- 172.21.15.63:0/2188104449 wait complete. 2024-09-21T06:34:23.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.388+0000 7f282349c740 20 client.16743 trim_cache size 0 max 16384 2024-09-21T06:34:23.395 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:34:23.395 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "no active scrubs running", 2024-09-21T06:34:23.395 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": {}, 2024-09-21T06:34:23.395 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:34:23.395 INFO:teuthology.orchestra.run.smithi063.stdout: "91ae0a75-6a3f-452f-8bda-0f19862a5724": { 2024-09-21T06:34:23.395 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:50.316590+0000", 2024-09-21T06:34:23.395 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:34:23.395 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:34:23.395 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:34:23.396 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:34:23.396 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:34:23.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:34:23.396 INFO:teuthology.orchestra.run.smithi063.stdout: "5396028b-35f4-48fe-b54d-385784e97de3": { 2024-09-21T06:34:23.396 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:04.523378+0000", 2024-09-21T06:34:23.396 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:34:23.396 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:34:23.396 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:34:23.396 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:34:23.396 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:34:23.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:34:23.396 INFO:teuthology.orchestra.run.smithi063.stdout: "024d3c59-0b67-49a9-bf4a-e02d36691942": { 2024-09-21T06:34:23.396 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:32:14.282244+0000", 2024-09-21T06:34:23.396 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:34:23.397 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:34:23.397 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:34:23.397 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:34:23.397 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:34:23.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:34:23.397 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:34:23.397 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:31:27.507051+0000", 2024-09-21T06:34:23.397 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:34:23.397 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:34:23.397 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:34:23.397 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:34:23.397 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:34:23.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:34:23.397 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:34:23.397 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:34:23.398 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:34:23.398 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:34:23.398 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:34:23.398 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:34:23.398 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:34:23.398 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:34:23.398 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:34:23.398 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:34:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.388+0000 7f281cf28640 1 -- 172.21.15.63:0/4049490635 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f28000b66b0 msgr2=0x7f28000b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.388+0000 7f281cf28640 1 --2- 172.21.15.63:0/4049490635 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f28000b66b0 0x7f28000b8bc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55b6b3e0a2d0 tx=0x7f280800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.388+0000 7f281cf28640 1 -- 172.21.15.63:0/4049490635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2818109e20 msgr2=0x7f281819fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.388+0000 7f281cf28640 1 --2- 172.21.15.63:0/4049490635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2818109e20 0x7f281819fcd0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f281000eaa0 tx=0x7f281000eea0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.389+0000 7f281cf28640 1 -- 172.21.15.63:0/4049490635 shutdown_connections 2024-09-21T06:34:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.389+0000 7f281cf28640 1 --2- 172.21.15.63:0/4049490635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2818109e20 0x7f281819fcd0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.389+0000 7f281cf28640 1 --2- 172.21.15.63:0/4049490635 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f28000b66b0 0x7f28000b8bc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.389+0000 7f281cf28640 1 --2- 172.21.15.63:0/4049490635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28181094d0 0x7f281819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.389+0000 7f281cf28640 1 --2- 172.21.15.63:0/4049490635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2818103b90 0x7f281819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.389+0000 7f281cf28640 1 -- 172.21.15.63:0/4049490635 >> 172.21.15.63:0/4049490635 conn(0x7f28180ff5e0 msgr2=0x7f2818101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:23.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.389+0000 7f281cf28640 1 -- 172.21.15.63:0/4049490635 shutdown_connections 2024-09-21T06:34:23.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:23.389+0000 7f281cf28640 1 -- 172.21.15.63:0/4049490635 wait complete. 2024-09-21T06:34:23.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:23 smithi071 ceph-mon[34844]: pgmap v508: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T06:34:23.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:23 smithi175 ceph-mon[34510]: pgmap v508: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T06:34:24.279 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:34:24.279 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:34:24.551 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:25.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.110+0000 7f47e25f5640 1 -- 172.21.15.63:0/2336197604 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47dc109560 msgr2=0x7f47dc109970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:25.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.110+0000 7f47e25f5640 1 --2- 172.21.15.63:0/2336197604 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47dc109560 0x7f47dc109970 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f47d0009900 tx=0x7f47d002a410 comp rx=0 tx=0).stop 2024-09-21T06:34:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.110+0000 7f47e25f5640 1 -- 172.21.15.63:0/2336197604 shutdown_connections 2024-09-21T06:34:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.110+0000 7f47e25f5640 1 --2- 172.21.15.63:0/2336197604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47dc109eb0 0x7f47dc1106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.110+0000 7f47e25f5640 1 --2- 172.21.15.63:0/2336197604 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47dc109560 0x7f47dc109970 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.110+0000 7f47e25f5640 1 --2- 172.21.15.63:0/2336197604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47dc102080 0x7f47dc102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.110+0000 7f47e25f5640 1 -- 172.21.15.63:0/2336197604 >> 172.21.15.63:0/2336197604 conn(0x7f47dc079ec0 msgr2=0x7f47dc07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.110+0000 7f47e25f5640 1 -- 172.21.15.63:0/2336197604 shutdown_connections 2024-09-21T06:34:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.110+0000 7f47e25f5640 1 -- 172.21.15.63:0/2336197604 wait complete. 2024-09-21T06:34:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.111+0000 7f47e25f5640 1 Processor -- start 2024-09-21T06:34:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.111+0000 7f47e25f5640 1 -- start start 2024-09-21T06:34:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.112+0000 7f47e25f5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47dc102080 0x7f47dc19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.112+0000 7f47e25f5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47dc109560 0x7f47dc19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:25.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.112+0000 7f47e25f5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47dc109eb0 0x7f47dc19fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.112+0000 7f47e25f5640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f47dc113bc0 con 0x7f47dc109560 2024-09-21T06:34:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.112+0000 7f47e25f5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f47dc113a40 con 0x7f47dc102080 2024-09-21T06:34:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.112+0000 7f47e25f5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f47dc113d40 con 0x7f47dc109eb0 2024-09-21T06:34:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.112+0000 7f47db7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47dc109560 0x7f47dc19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.112+0000 7f47db7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47dc109560 0x7f47dc19ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35216/0 (socket says 172.21.15.63:35216) 2024-09-21T06:34:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.112+0000 7f47db7fe640 1 -- 172.21.15.63:0/3705765275 learned_addr learned my addr 172.21.15.63:0/3705765275 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.112+0000 7f47e0b92640 1 --2- 172.21.15.63:0/3705765275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47dc109eb0 0x7f47dc19fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.112+0000 7f47dbfff640 1 --2- 172.21.15.63:0/3705765275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47dc102080 0x7f47dc19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.113+0000 7f47db7fe640 1 -- 172.21.15.63:0/3705765275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47dc109eb0 msgr2=0x7f47dc19fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.113+0000 7f47db7fe640 1 --2- 172.21.15.63:0/3705765275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47dc109eb0 0x7f47dc19fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.113+0000 7f47db7fe640 1 -- 172.21.15.63:0/3705765275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47dc102080 msgr2=0x7f47dc19a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.113+0000 7f47db7fe640 1 --2- 172.21.15.63:0/3705765275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47dc102080 0x7f47dc19a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.113+0000 7f47db7fe640 1 -- 172.21.15.63:0/3705765275 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47dc1a0520 con 0x7f47dc109560 2024-09-21T06:34:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.113+0000 7f47db7fe640 1 --2- 172.21.15.63:0/3705765275 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47dc109560 0x7f47dc19ab50 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f47d0005ab0 tx=0x7f47d0003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:25.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.113+0000 7f47d97fa640 1 -- 172.21.15.63:0/3705765275 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d003f070 con 0x7f47dc109560 2024-09-21T06:34:25.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.113+0000 7f47d97fa640 1 -- 172.21.15.63:0/3705765275 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47d0031b50 con 0x7f47dc109560 2024-09-21T06:34:25.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.113+0000 7f47d97fa640 1 -- 172.21.15.63:0/3705765275 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d0035030 con 0x7f47dc109560 2024-09-21T06:34:25.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.113+0000 7f47e25f5640 1 -- 172.21.15.63:0/3705765275 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47dc1a07b0 con 0x7f47dc109560 2024-09-21T06:34:25.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.113+0000 7f47e25f5640 1 -- 172.21.15.63:0/3705765275 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47dc1a6f70 con 0x7f47dc109560 2024-09-21T06:34:25.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.114+0000 7f47e25f5640 1 -- 172.21.15.63:0/3705765275 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47dc06b8f0 con 0x7f47dc109560 2024-09-21T06:34:25.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.116+0000 7f47d97fa640 1 -- 172.21.15.63:0/3705765275 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f47d0042070 con 0x7f47dc109560 2024-09-21T06:34:25.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.116+0000 7f47d97fa640 1 --2- 172.21.15.63:0/3705765275 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f47c40b6680 0x7f47c40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:25.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.117+0000 7f47dbfff640 1 --2- 172.21.15.63:0/3705765275 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f47c40b6680 0x7f47c40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:25.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.117+0000 7f47d97fa640 1 -- 172.21.15.63:0/3705765275 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f47d0108170 con 0x7f47dc109560 2024-09-21T06:34:25.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.117+0000 7f47dbfff640 1 --2- 172.21.15.63:0/3705765275 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f47c40b6680 0x7f47c40b8b90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f47cc009b60 tx=0x7f47cc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:25.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.120+0000 7f47d97fa640 1 -- 172.21.15.63:0/3705765275 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f47d00ce6a0 con 0x7f47dc109560 2024-09-21T06:34:25.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:25 smithi063 ceph-mon[31150]: pgmap v509: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:34:25.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.347+0000 7f47e25f5640 1 -- 172.21.15.63:0/3705765275 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47dc10bc80 con 0x7f47dc109560 2024-09-21T06:34:25.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.348+0000 7f47d97fa640 1 -- 172.21.15.63:0/3705765275 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+11983 (secure 0 0 0) 0x7f47d00d2a80 con 0x7f47dc109560 2024-09-21T06:34:25.350 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:34:25.350 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":53,"btime":"2024-09-21T06:34:09:066423+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":53,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:34:08.127095+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24659,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":34,"state":"up:active","state_seq":69,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25637":{"gid":25637,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3354670524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3354670524},{"type":"v1","addr":"172.21.15.71:6839","nonce":3354670524}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24659,"qdb_cluster":[24694,24670,24659,24676,14835]},"id":1}]} 2024-09-21T06:34:25.350 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 53 2024-09-21T06:34:25.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.350+0000 7f47e25f5640 1 -- 172.21.15.63:0/3705765275 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f47c40b6680 msgr2=0x7f47c40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:25.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.350+0000 7f47e25f5640 1 --2- 172.21.15.63:0/3705765275 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f47c40b6680 0x7f47c40b8b90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f47cc009b60 tx=0x7f47cc005f90 comp rx=0 tx=0).stop 2024-09-21T06:34:25.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.350+0000 7f47e25f5640 1 -- 172.21.15.63:0/3705765275 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47dc109560 msgr2=0x7f47dc19ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:25.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.350+0000 7f47e25f5640 1 --2- 172.21.15.63:0/3705765275 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47dc109560 0x7f47dc19ab50 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f47d0005ab0 tx=0x7f47d0003b90 comp rx=0 tx=0).stop 2024-09-21T06:34:25.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.351+0000 7f47e25f5640 1 -- 172.21.15.63:0/3705765275 shutdown_connections 2024-09-21T06:34:25.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.351+0000 7f47e25f5640 1 --2- 172.21.15.63:0/3705765275 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f47c40b6680 0x7f47c40b8b90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:25.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.351+0000 7f47e25f5640 1 --2- 172.21.15.63:0/3705765275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47dc109eb0 0x7f47dc19fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:25.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.351+0000 7f47e25f5640 1 --2- 172.21.15.63:0/3705765275 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47dc109560 0x7f47dc19ab50 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:25.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.351+0000 7f47e25f5640 1 --2- 172.21.15.63:0/3705765275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47dc102080 0x7f47dc19a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:25.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.351+0000 7f47e25f5640 1 -- 172.21.15.63:0/3705765275 >> 172.21.15.63:0/3705765275 conn(0x7f47dc079ec0 msgr2=0x7f47dc1055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:25.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.351+0000 7f47e25f5640 1 -- 172.21.15.63:0/3705765275 shutdown_connections 2024-09-21T06:34:25.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:25.351+0000 7f47e25f5640 1 -- 172.21.15.63:0/3705765275 wait complete. 2024-09-21T06:34:25.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:25 smithi071 ceph-mon[34844]: pgmap v509: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:34:25.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:25 smithi175 ceph-mon[34510]: pgmap v509: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:34:26.057 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T06:34:26.323 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:26.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:26 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3705765275' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:26.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:26 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3705765275' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:26.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:26 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3705765275' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:26.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.811+0000 7fdd6cd23640 1 -- 172.21.15.63:0/2754305155 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd68102a80 msgr2=0x7fdd68102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.811+0000 7fdd6cd23640 1 --2- 172.21.15.63:0/2754305155 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd68102a80 0x7fdd68102e90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009900 tx=0x7fdd5002a410 comp rx=0 tx=0).stop 2024-09-21T06:34:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.811+0000 7fdd6cd23640 1 -- 172.21.15.63:0/2754305155 shutdown_connections 2024-09-21T06:34:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.811+0000 7fdd6cd23640 1 --2- 172.21.15.63:0/2754305155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd68108d10 0x7fdd6810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.811+0000 7fdd6cd23640 1 --2- 172.21.15.63:0/2754305155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd681083c0 0x7fdd681087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.811+0000 7fdd6cd23640 1 --2- 172.21.15.63:0/2754305155 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd68102a80 0x7fdd68102e90 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.811+0000 7fdd6cd23640 1 -- 172.21.15.63:0/2754305155 >> 172.21.15.63:0/2754305155 conn(0x7fdd68079740 msgr2=0x7fdd68079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.811+0000 7fdd6cd23640 1 -- 172.21.15.63:0/2754305155 shutdown_connections 2024-09-21T06:34:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.811+0000 7fdd6cd23640 1 -- 172.21.15.63:0/2754305155 wait complete. 2024-09-21T06:34:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.812+0000 7fdd6cd23640 1 Processor -- start 2024-09-21T06:34:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.812+0000 7fdd6cd23640 1 -- start start 2024-09-21T06:34:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.813+0000 7fdd6cd23640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd68102a80 0x7fdd6819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.813+0000 7fdd6cd23640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd681083c0 0x7fdd6819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.813+0000 7fdd6cd23640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd68108d10 0x7fdd6819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.813+0000 7fdd6cd23640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdd68112980 con 0x7fdd681083c0 2024-09-21T06:34:26.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.813+0000 7fdd6cd23640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdd68112800 con 0x7fdd68102a80 2024-09-21T06:34:26.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.813+0000 7fdd6cd23640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdd68112b00 con 0x7fdd68108d10 2024-09-21T06:34:26.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.813+0000 7fdd65d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd681083c0 0x7fdd6819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.813+0000 7fdd65d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd681083c0 0x7fdd6819aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42636/0 (socket says 172.21.15.63:42636) 2024-09-21T06:34:26.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.813+0000 7fdd65d9b640 1 -- 172.21.15.63:0/1145862916 learned_addr learned my addr 172.21.15.63:0/1145862916 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:26.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.813+0000 7fdd6659c640 1 --2- 172.21.15.63:0/1145862916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd68102a80 0x7fdd6819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.813+0000 7fdd66d9d640 1 --2- 172.21.15.63:0/1145862916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd68108d10 0x7fdd6819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.813+0000 7fdd65d9b640 1 -- 172.21.15.63:0/1145862916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd68108d10 msgr2=0x7fdd6819fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:26.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.813+0000 7fdd65d9b640 1 --2- 172.21.15.63:0/1145862916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd68108d10 0x7fdd6819fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.813+0000 7fdd65d9b640 1 -- 172.21.15.63:0/1145862916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd68102a80 msgr2=0x7fdd6819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:26.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.813+0000 7fdd65d9b640 1 --2- 172.21.15.63:0/1145862916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd68102a80 0x7fdd6819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.813+0000 7fdd65d9b640 1 -- 172.21.15.63:0/1145862916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd681a0450 con 0x7fdd681083c0 2024-09-21T06:34:26.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.813+0000 7fdd66d9d640 1 --2- 172.21.15.63:0/1145862916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd68108d10 0x7fdd6819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:34:26.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.813+0000 7fdd65d9b640 1 --2- 172.21.15.63:0/1145862916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd681083c0 0x7fdd6819aa80 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800d770 tx=0x7fdd5800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:26.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.813+0000 7fdd5f7fe640 1 -- 172.21.15.63:0/1145862916 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58017070 con 0x7fdd681083c0 2024-09-21T06:34:26.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.813+0000 7fdd5f7fe640 1 -- 172.21.15.63:0/1145862916 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd58009c30 con 0x7fdd681083c0 2024-09-21T06:34:26.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.814+0000 7fdd6cd23640 1 -- 172.21.15.63:0/1145862916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd681a0740 con 0x7fdd681083c0 2024-09-21T06:34:26.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.814+0000 7fdd5f7fe640 1 -- 172.21.15.63:0/1145862916 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5800f620 con 0x7fdd681083c0 2024-09-21T06:34:26.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.814+0000 7fdd6cd23640 1 -- 172.21.15.63:0/1145862916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd681a6ea0 con 0x7fdd681083c0 2024-09-21T06:34:26.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.816+0000 7fdd73297740 1 Processor -- start 2024-09-21T06:34:26.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.816+0000 7fdd73297740 1 -- start start 2024-09-21T06:34:26.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.816+0000 7fdd5f7fe640 1 -- 172.21.15.63:0/1145862916 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fdd5801a070 con 0x7fdd681083c0 2024-09-21T06:34:26.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.817+0000 7fdd73297740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0f15070 0x563cc12bc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.817+0000 7fdd73297740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0eec1b0 0x563cc12bc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.817+0000 7fdd73297740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0ef4390 0x563cc12bcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.817+0000 7fdd73297740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563cc1232ea0 con 0x563cc0eec1b0 2024-09-21T06:34:26.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.817+0000 7fdd73297740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563cc12222d0 con 0x563cc0f15070 2024-09-21T06:34:26.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.817+0000 7fdd73297740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563cc12260e0 con 0x563cc0ef4390 2024-09-21T06:34:26.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.817+0000 7fdd6659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0eec1b0 0x563cc12bc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.817+0000 7fdd6659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0eec1b0 0x563cc12bc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42640/0 (socket says 172.21.15.63:42640) 2024-09-21T06:34:26.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.817+0000 7fdd6659c640 1 -- 172.21.15.63:0/3813337612 learned_addr learned my addr 172.21.15.63:0/3813337612 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:26.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.817+0000 7fdd66d9d640 1 --2- 172.21.15.63:0/3813337612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0f15070 0x563cc12bc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.817+0000 7fdd65d9b640 1 --2- 172.21.15.63:0/3813337612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0ef4390 0x563cc12bcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.817+0000 7fdd6659c640 1 -- 172.21.15.63:0/3813337612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0ef4390 msgr2=0x563cc12bcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:26.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.817+0000 7fdd6659c640 1 --2- 172.21.15.63:0/3813337612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0ef4390 0x563cc12bcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.817+0000 7fdd6659c640 1 -- 172.21.15.63:0/3813337612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0f15070 msgr2=0x563cc12bc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:26.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.817+0000 7fdd6659c640 1 --2- 172.21.15.63:0/3813337612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0f15070 0x563cc12bc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.817+0000 7fdd6659c640 1 -- 172.21.15.63:0/3813337612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cc0f80650 con 0x563cc0eec1b0 2024-09-21T06:34:26.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.817+0000 7fdd5f7fe640 1 --2- 172.21.15.63:0/1145862916 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdd540b6680 0x7fdd540b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.817+0000 7fdd6659c640 1 --2- 172.21.15.63:0/3813337612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0eec1b0 0x563cc12bc800 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fdd5002a930 tx=0x7fdd50032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812ba3342b231912 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:26.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.818+0000 7fdd66d9d640 1 --2- 172.21.15.63:0/1145862916 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdd540b6680 0x7fdd540b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.818+0000 7fdd5cff9640 1 -- 172.21.15.63:0/3813337612 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5003f070 con 0x563cc0eec1b0 2024-09-21T06:34:26.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.818+0000 7fdd5f7fe640 1 -- 172.21.15.63:0/1145862916 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fdd580e7340 con 0x7fdd681083c0 2024-09-21T06:34:26.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.818+0000 7fdd5cff9640 1 -- 172.21.15.63:0/3813337612 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd50032e40 con 0x563cc0eec1b0 2024-09-21T06:34:26.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.818+0000 7fdd5cff9640 1 -- 172.21.15.63:0/3813337612 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd50035070 con 0x563cc0eec1b0 2024-09-21T06:34:26.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.819+0000 7fdd73297740 1 -- 172.21.15.63:0/3813337612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0eec1b0 msgr2=0x563cc12bc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:26.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.819+0000 7fdd73297740 1 --2- 172.21.15.63:0/3813337612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0eec1b0 0x563cc12bc800 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fdd5002a930 tx=0x7fdd50032c50 comp rx=0 tx=0).stop 2024-09-21T06:34:26.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.819+0000 7fdd66d9d640 1 --2- 172.21.15.63:0/1145862916 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdd540b6680 0x7fdd540b8b90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdd60009370 tx=0x7fdd60009720 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:26.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.819+0000 7fdd73297740 1 -- 172.21.15.63:0/3813337612 shutdown_connections 2024-09-21T06:34:26.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.819+0000 7fdd73297740 1 --2- 172.21.15.63:0/3813337612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0ef4390 0x563cc12bcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.819+0000 7fdd73297740 1 --2- 172.21.15.63:0/3813337612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0eec1b0 0x563cc12bc800 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.819+0000 7fdd73297740 1 --2- 172.21.15.63:0/3813337612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0f15070 0x563cc12bc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.819+0000 7fdd73297740 1 -- 172.21.15.63:0/3813337612 >> 172.21.15.63:0/3813337612 conn(0x563cc0f09460 msgr2=0x563cc12ba1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:26.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.819+0000 7fdd73297740 1 -- 172.21.15.63:0/3813337612 shutdown_connections 2024-09-21T06:34:26.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.819+0000 7fdd73297740 1 -- 172.21.15.63:0/3813337612 wait complete. 2024-09-21T06:34:26.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.819+0000 7fdd73297740 1 -- start start 2024-09-21T06:34:26.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.819+0000 7fdd73297740 1 Processor -- start 2024-09-21T06:34:26.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.820+0000 7fdd73297740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0eec1b0 0x563cc12c7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.820+0000 7fdd73297740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0ef4390 0x563cc12c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.820+0000 7fdd73297740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0f15070 0x563cc12c8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.820+0000 7fdd73297740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563cc1083700 con 0x563cc0f15070 2024-09-21T06:34:26.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.820+0000 7fdd73297740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563cc11bd160 con 0x563cc0eec1b0 2024-09-21T06:34:26.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.820+0000 7fdd73297740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563cc12caa40 con 0x563cc0ef4390 2024-09-21T06:34:26.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.820+0000 7fdd73297740 10 client.0 _ll_register_callbacks cb 0x563cc11d69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:34:26.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.820+0000 7fdd66d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0f15070 0x563cc12c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.820+0000 7fdd66d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0f15070 0x563cc12c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42656/0 (socket says 172.21.15.63:42656) 2024-09-21T06:34:26.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.820+0000 7fdd6659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0eec1b0 0x563cc12c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.820+0000 7fdd66d9d640 1 -- 172.21.15.63:0/1855454768 learned_addr learned my addr 172.21.15.63:0/1855454768 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:26.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.820+0000 7fdd65d9b640 1 --2- 172.21.15.63:0/1855454768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0ef4390 0x563cc12c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.820+0000 7fdd6659c640 1 -- 172.21.15.63:0/1855454768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0ef4390 msgr2=0x563cc12c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:26.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.820+0000 7fdd6659c640 1 --2- 172.21.15.63:0/1855454768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0ef4390 0x563cc12c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.820+0000 7fdd6659c640 1 -- 172.21.15.63:0/1855454768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0f15070 msgr2=0x563cc12c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:26.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.820+0000 7fdd6659c640 1 --2- 172.21.15.63:0/1855454768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0f15070 0x563cc12c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.820+0000 7fdd6659c640 1 -- 172.21.15.63:0/1855454768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cc11eac90 con 0x563cc0eec1b0 2024-09-21T06:34:26.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.820+0000 7fdd66d9d640 1 --2- 172.21.15.63:0/1855454768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0f15070 0x563cc12c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:34:26.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.820+0000 7fdd6659c640 1 --2- 172.21.15.63:0/1855454768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0eec1b0 0x563cc12c7900 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdd50031440 tx=0x7fdd50031750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=feb812b752cd26f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:26.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.820+0000 7fdd4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:34:26.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.821+0000 7fdd4dffb640 1 -- 172.21.15.63:0/1855454768 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5004b060 con 0x563cc0eec1b0 2024-09-21T06:34:26.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.821+0000 7fdd73297740 1 -- 172.21.15.63:0/1855454768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563cc1234df0 con 0x563cc0eec1b0 2024-09-21T06:34:26.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.821+0000 7fdd4dffb640 1 -- 172.21.15.63:0/1855454768 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fdd50004440 con 0x563cc0eec1b0 2024-09-21T06:34:26.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.821+0000 7fdd4dffb640 1 -- 172.21.15.63:0/1855454768 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fdd5003f030 con 0x563cc0eec1b0 2024-09-21T06:34:26.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.821+0000 7fdd73297740 10 client.26360 fetch_fsmap learned FSMap version 53 2024-09-21T06:34:26.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.821+0000 7fdd73297740 1 -- 172.21.15.63:0/1855454768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x563cc12d66a0 con 0x563cc0eec1b0 2024-09-21T06:34:26.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.821+0000 7fdd4dffb640 1 -- 172.21.15.63:0/1855454768 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x563cc1234df0 con 0x563cc0eec1b0 2024-09-21T06:34:26.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.821+0000 7fdd4dffb640 1 -- 172.21.15.63:0/1855454768 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7fdd50004880 con 0x563cc0eec1b0 2024-09-21T06:34:26.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.821+0000 7fdd73297740 10 client.26360 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:34:26.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.821+0000 7fdd73297740 10 client.26360 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:34:26.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.821+0000 7fdd73297740 20 client.26360 populate_metadata read hostname 'smithi063' 2024-09-21T06:34:26.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.821+0000 7fdd73297740 1 --2- 172.21.15.63:0/1855454768 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x563cc0ed39f0 0x563cc12d9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.821+0000 7fdd73297740 4 client.26360 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:34:26.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.822+0000 7fdd73297740 1 -- 172.21.15.63:0/1855454768 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563cc12308a0 con 0x563cc0ed39f0 2024-09-21T06:34:26.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.822+0000 7fdd65d9b640 1 --2- 172.21.15.63:0/1855454768 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x563cc0ed39f0 0x563cc12d9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.822+0000 7fdd4dffb640 10 client.26360 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:34:26.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.822+0000 7fdd65d9b640 1 --2- 172.21.15.63:0/1855454768 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x563cc0ed39f0 0x563cc12d9a00 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3d8bc895520d3e25 server_cookie=30cfa2a15c3e5c8d in_seq=0 out_seq=0 2024-09-21T06:34:26.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.823+0000 7fdd4dffb640 1 -- 172.21.15.63:0/1855454768 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563cc12308a0 con 0x563cc0ed39f0 2024-09-21T06:34:26.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.823+0000 7fdd4dffb640 10 client.26360 handle_command_reply: tid=0 2024-09-21T06:34:26.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.823+0000 7fdd73297740 1 client.26360 shutdown 2024-09-21T06:34:26.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.823+0000 7fdd73297740 1 -- 172.21.15.63:0/1855454768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0eec1b0 msgr2=0x563cc12c7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:26.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.823+0000 7fdd73297740 1 --2- 172.21.15.63:0/1855454768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0eec1b0 0x563cc12c7900 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdd50031440 tx=0x7fdd50031750 comp rx=0 tx=0).stop 2024-09-21T06:34:26.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.823+0000 7fdd73297740 1 -- 172.21.15.63:0/1855454768 shutdown_connections 2024-09-21T06:34:26.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.823+0000 7fdd73297740 1 --2- 172.21.15.63:0/1855454768 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x563cc0ed39f0 0x563cc12d9a00 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.823+0000 7fdd73297740 1 --2- 172.21.15.63:0/1855454768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0f15070 0x563cc12c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.823+0000 7fdd73297740 1 --2- 172.21.15.63:0/1855454768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0ef4390 0x563cc12c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.823+0000 7fdd4dffb640 0 client.26360 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:34:26.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.823+0000 7fdd73297740 1 --2- 172.21.15.63:0/1855454768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0eec1b0 0x563cc12c7900 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.823+0000 7fdd73297740 1 -- 172.21.15.63:0/1855454768 >> 172.21.15.63:0/1855454768 conn(0x563cc0f09460 msgr2=0x563cc12bf450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:26.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.823+0000 7fdd73297740 1 -- 172.21.15.63:0/1855454768 shutdown_connections 2024-09-21T06:34:26.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.823+0000 7fdd73297740 1 -- 172.21.15.63:0/1855454768 wait complete. 2024-09-21T06:34:26.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.823+0000 7fdd73297740 20 client.26360 trim_cache size 0 max 16384 2024-09-21T06:34:26.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.836+0000 7fdd73297740 1 Processor -- start 2024-09-21T06:34:26.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.836+0000 7fdd73297740 1 -- start start 2024-09-21T06:34:26.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.837+0000 7fdd73297740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0eec1b0 0x563cc12bda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.837+0000 7fdd73297740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0ef4390 0x563cc12c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.837+0000 7fdd73297740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0f15070 0x563cc12c5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.837+0000 7fdd73297740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdd681af7b0 con 0x563cc0ef4390 2024-09-21T06:34:26.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.837+0000 7fdd73297740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdd681b13b0 con 0x563cc0f15070 2024-09-21T06:34:26.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.837+0000 7fdd73297740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdd681afe80 con 0x563cc0eec1b0 2024-09-21T06:34:26.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.837+0000 7fdd65d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0ef4390 0x563cc12c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.837+0000 7fdd65d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0ef4390 0x563cc12c4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42658/0 (socket says 172.21.15.63:42658) 2024-09-21T06:34:26.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.837+0000 7fdd65d9b640 1 -- 172.21.15.63:0/927403785 learned_addr learned my addr 172.21.15.63:0/927403785 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:26.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.837+0000 7fdd6659c640 1 --2- 172.21.15.63:0/927403785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0eec1b0 0x563cc12bda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.837+0000 7fdd66d9d640 1 --2- 172.21.15.63:0/927403785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0f15070 0x563cc12c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.837+0000 7fdd65d9b640 1 -- 172.21.15.63:0/927403785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0eec1b0 msgr2=0x563cc12bda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:26.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.837+0000 7fdd65d9b640 1 --2- 172.21.15.63:0/927403785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0eec1b0 0x563cc12bda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.837+0000 7fdd65d9b640 1 -- 172.21.15.63:0/927403785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0f15070 msgr2=0x563cc12c5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:26.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.837+0000 7fdd65d9b640 1 --2- 172.21.15.63:0/927403785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0f15070 0x563cc12c5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.837+0000 7fdd65d9b640 1 -- 172.21.15.63:0/927403785 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cc12be5b0 con 0x563cc0ef4390 2024-09-21T06:34:26.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.837+0000 7fdd6659c640 1 --2- 172.21.15.63:0/927403785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0eec1b0 0x563cc12bda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:26.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.837+0000 7fdd66d9d640 1 --2- 172.21.15.63:0/927403785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0f15070 0x563cc12c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:34:26.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.837+0000 7fdd65d9b640 1 --2- 172.21.15.63:0/927403785 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0ef4390 0x563cc12c4af0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fdd580e4b20 tx=0x7fdd58094040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e226db74418b85a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:26.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.837+0000 7fdd4ffff640 1 -- 172.21.15.63:0/927403785 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58021040 con 0x563cc0ef4390 2024-09-21T06:34:26.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.838+0000 7fdd4ffff640 1 -- 172.21.15.63:0/927403785 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd580d0040 con 0x563cc0ef4390 2024-09-21T06:34:26.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.838+0000 7fdd4ffff640 1 -- 172.21.15.63:0/927403785 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd580b1c50 con 0x563cc0ef4390 2024-09-21T06:34:26.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.838+0000 7fdd73297740 1 -- 172.21.15.63:0/927403785 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0ef4390 msgr2=0x563cc12c4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:26.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.838+0000 7fdd73297740 1 --2- 172.21.15.63:0/927403785 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0ef4390 0x563cc12c4af0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fdd580e4b20 tx=0x7fdd58094040 comp rx=0 tx=0).stop 2024-09-21T06:34:26.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.838+0000 7fdd73297740 1 -- 172.21.15.63:0/927403785 shutdown_connections 2024-09-21T06:34:26.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.838+0000 7fdd73297740 1 --2- 172.21.15.63:0/927403785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0f15070 0x563cc12c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.838+0000 7fdd73297740 1 --2- 172.21.15.63:0/927403785 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0ef4390 0x563cc12c4af0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.838+0000 7fdd73297740 1 --2- 172.21.15.63:0/927403785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0eec1b0 0x563cc12bda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.838+0000 7fdd73297740 1 -- 172.21.15.63:0/927403785 >> 172.21.15.63:0/927403785 conn(0x563cc0f09460 msgr2=0x563cc12bd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:26.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.838+0000 7fdd73297740 1 -- 172.21.15.63:0/927403785 shutdown_connections 2024-09-21T06:34:26.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.838+0000 7fdd73297740 1 -- 172.21.15.63:0/927403785 wait complete. 2024-09-21T06:34:26.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.839+0000 7fdd73297740 1 -- start start 2024-09-21T06:34:26.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.839+0000 7fdd73297740 1 Processor -- start 2024-09-21T06:34:26.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.839+0000 7fdd73297740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0eec1b0 0x563cc12dd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.839+0000 7fdd73297740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0ef4390 0x563cc12da760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.839+0000 7fdd73297740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0f15070 0x563cc12dad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.839+0000 7fdd73297740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdd681b0ce0 con 0x563cc0f15070 2024-09-21T06:34:26.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.839+0000 7fdd73297740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdd681b05e0 con 0x563cc0ef4390 2024-09-21T06:34:26.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.839+0000 7fdd73297740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdd681ad790 con 0x563cc0eec1b0 2024-09-21T06:34:26.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.839+0000 7fdd73297740 10 client.0 _ll_register_callbacks cb 0x7fdd600095c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:34:26.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.839+0000 7fdd6659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0eec1b0 0x563cc12dd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.839+0000 7fdd66d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0f15070 0x563cc12dad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.839+0000 7fdd6659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0eec1b0 0x563cc12dd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:54936/0 (socket says 172.21.15.63:54936) 2024-09-21T06:34:26.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.839+0000 7fdd6659c640 1 -- 172.21.15.63:0/507206421 learned_addr learned my addr 172.21.15.63:0/507206421 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:26.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.839+0000 7fdd65d9b640 1 --2- 172.21.15.63:0/507206421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0ef4390 0x563cc12da760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.840+0000 7fdd66d9d640 1 -- 172.21.15.63:0/507206421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0eec1b0 msgr2=0x563cc12dd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:26.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.840+0000 7fdd66d9d640 1 --2- 172.21.15.63:0/507206421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0eec1b0 0x563cc12dd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.840+0000 7fdd66d9d640 1 -- 172.21.15.63:0/507206421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0ef4390 msgr2=0x563cc12da760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:26.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.840+0000 7fdd66d9d640 1 --2- 172.21.15.63:0/507206421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0ef4390 0x563cc12da760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.840+0000 7fdd66d9d640 1 -- 172.21.15.63:0/507206421 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cc12db4b0 con 0x563cc0f15070 2024-09-21T06:34:26.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.840+0000 7fdd66d9d640 1 --2- 172.21.15.63:0/507206421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0f15070 0x563cc12dad20 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x563cc12bd2a0 tx=0x7fdd60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89785cd0d44bde52 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:26.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.840+0000 7fdd4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:34:26.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.840+0000 7fdd4dffb640 1 -- 172.21.15.63:0/507206421 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd60003d80 con 0x563cc0f15070 2024-09-21T06:34:26.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.840+0000 7fdd4dffb640 1 -- 172.21.15.63:0/507206421 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fdd60004050 con 0x563cc0f15070 2024-09-21T06:34:26.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.840+0000 7fdd73297740 1 -- 172.21.15.63:0/507206421 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd580d0040 con 0x563cc0f15070 2024-09-21T06:34:26.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.840+0000 7fdd4dffb640 1 -- 172.21.15.63:0/507206421 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fdd60004250 con 0x563cc0f15070 2024-09-21T06:34:26.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.840+0000 7fdd73297740 10 client.16767 fetch_fsmap learned FSMap version 53 2024-09-21T06:34:26.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.840+0000 7fdd73297740 1 -- 172.21.15.63:0/507206421 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x563cc1344110 con 0x563cc0f15070 2024-09-21T06:34:26.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.841+0000 7fdd4dffb640 1 -- 172.21.15.63:0/507206421 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd580d0040 con 0x563cc0f15070 2024-09-21T06:34:26.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.841+0000 7fdd4dffb640 1 -- 172.21.15.63:0/507206421 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7fdd60028020 con 0x563cc0f15070 2024-09-21T06:34:26.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.841+0000 7fdd73297740 10 client.16767 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:34:26.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.841+0000 7fdd73297740 10 client.16767 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:34:26.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.841+0000 7fdd73297740 20 client.16767 populate_metadata read hostname 'smithi063' 2024-09-21T06:34:26.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.841+0000 7fdd73297740 1 --2- 172.21.15.63:0/507206421 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x563cc0ea8da0 0x563cc1346990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.841+0000 7fdd73297740 4 client.16767 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:34:26.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.841+0000 7fdd73297740 1 -- 172.21.15.63:0/507206421 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563cc122dcd0 con 0x563cc0ea8da0 2024-09-21T06:34:26.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.841+0000 7fdd6659c640 1 --2- 172.21.15.63:0/507206421 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x563cc0ea8da0 0x563cc1346990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.841+0000 7fdd6659c640 1 --2- 172.21.15.63:0/507206421 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x563cc0ea8da0 0x563cc1346990 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=13f77dc16ae4b491 server_cookie=b8514e7762aa9f4c in_seq=0 out_seq=0 2024-09-21T06:34:26.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.841+0000 7fdd4dffb640 10 client.16767 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:34:26.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.841+0000 7fdd4dffb640 1 -- 172.21.15.63:0/507206421 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563cc122dcd0 con 0x563cc0ea8da0 2024-09-21T06:34:26.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.841+0000 7fdd4dffb640 10 client.16767 handle_command_reply: tid=0 2024-09-21T06:34:26.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.842+0000 7fdd73297740 1 client.16767 shutdown 2024-09-21T06:34:26.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.842+0000 7fdd73297740 1 -- 172.21.15.63:0/507206421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0f15070 msgr2=0x563cc12dad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:26.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.842+0000 7fdd73297740 1 --2- 172.21.15.63:0/507206421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0f15070 0x563cc12dad20 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x563cc12bd2a0 tx=0x7fdd60004a40 comp rx=0 tx=0).stop 2024-09-21T06:34:26.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.842+0000 7fdd73297740 1 -- 172.21.15.63:0/507206421 shutdown_connections 2024-09-21T06:34:26.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.842+0000 7fdd73297740 1 --2- 172.21.15.63:0/507206421 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x563cc0ea8da0 0x563cc1346990 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.842+0000 7fdd73297740 1 --2- 172.21.15.63:0/507206421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cc0f15070 0x563cc12dad20 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.842+0000 7fdd73297740 1 --2- 172.21.15.63:0/507206421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563cc0ef4390 0x563cc12da760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.842+0000 7fdd73297740 1 --2- 172.21.15.63:0/507206421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cc0eec1b0 0x563cc12dd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.842+0000 7fdd73297740 1 -- 172.21.15.63:0/507206421 >> 172.21.15.63:0/507206421 conn(0x563cc0f09460 msgr2=0x563cc12c8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:26.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.842+0000 7fdd4dffb640 0 client.16767 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:34:26.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.842+0000 7fdd73297740 1 -- 172.21.15.63:0/507206421 shutdown_connections 2024-09-21T06:34:26.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.842+0000 7fdd73297740 1 -- 172.21.15.63:0/507206421 wait complete. 2024-09-21T06:34:26.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.842+0000 7fdd73297740 20 client.16767 trim_cache size 0 max 16384 2024-09-21T06:34:26.849 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:34:26.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.842+0000 7fdd6cd23640 1 -- 172.21.15.63:0/1145862916 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdd540b6680 msgr2=0x7fdd540b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:26.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.842+0000 7fdd6cd23640 1 --2- 172.21.15.63:0/1145862916 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdd540b6680 0x7fdd540b8b90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdd60009370 tx=0x7fdd60009720 comp rx=0 tx=0).stop 2024-09-21T06:34:26.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.842+0000 7fdd6cd23640 1 -- 172.21.15.63:0/1145862916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd681083c0 msgr2=0x7fdd6819aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:26.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.842+0000 7fdd6cd23640 1 --2- 172.21.15.63:0/1145862916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd681083c0 0x7fdd6819aa80 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800d770 tx=0x7fdd5800dc30 comp rx=0 tx=0).stop 2024-09-21T06:34:26.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.843+0000 7fdd6cd23640 1 -- 172.21.15.63:0/1145862916 shutdown_connections 2024-09-21T06:34:26.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.843+0000 7fdd6cd23640 1 --2- 172.21.15.63:0/1145862916 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fdd540b6680 0x7fdd540b8b90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.843+0000 7fdd6cd23640 1 --2- 172.21.15.63:0/1145862916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd68108d10 0x7fdd6819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.843+0000 7fdd6cd23640 1 --2- 172.21.15.63:0/1145862916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd681083c0 0x7fdd6819aa80 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.843+0000 7fdd6cd23640 1 --2- 172.21.15.63:0/1145862916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd68102a80 0x7fdd6819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.843+0000 7fdd6cd23640 1 -- 172.21.15.63:0/1145862916 >> 172.21.15.63:0/1145862916 conn(0x7fdd68079740 msgr2=0x7fdd68101b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:26.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.843+0000 7fdd6cd23640 1 -- 172.21.15.63:0/1145862916 shutdown_connections 2024-09-21T06:34:26.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:26.843+0000 7fdd6cd23640 1 -- 172.21.15.63:0/1145862916 wait complete. 2024-09-21T06:34:27.486 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:27 smithi063 ceph-mon[31150]: pgmap v510: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:34:27.514 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:34:27.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:27 smithi071 ceph-mon[34844]: pgmap v510: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:34:27.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:27 smithi175 ceph-mon[34510]: pgmap v510: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:34:27.771 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:28.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.298+0000 7f1ed3e25640 1 -- 172.21.15.63:0/3329855647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ecc114430 msgr2=0x7f1ecc116920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:28.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.298+0000 7f1ed3e25640 1 --2- 172.21.15.63:0/3329855647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ecc114430 0x7f1ecc116920 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009ca0 tx=0x7f1ec402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.299+0000 7f1ed3e25640 1 -- 172.21.15.63:0/3329855647 shutdown_connections 2024-09-21T06:34:28.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.299+0000 7f1ed3e25640 1 --2- 172.21.15.63:0/3329855647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ecc114430 0x7f1ecc116920 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.299+0000 7f1ed3e25640 1 --2- 172.21.15.63:0/3329855647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ecc075cf0 0x7f1ecc076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.299+0000 7f1ed3e25640 1 --2- 172.21.15.63:0/3329855647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ecc077330 0x7f1ecc0757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.299+0000 7f1ed3e25640 1 -- 172.21.15.63:0/3329855647 >> 172.21.15.63:0/3329855647 conn(0x7f1ecc07b910 msgr2=0x7f1ecc07bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:28.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.299+0000 7f1ed3e25640 1 -- 172.21.15.63:0/3329855647 shutdown_connections 2024-09-21T06:34:28.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.299+0000 7f1ed3e25640 1 -- 172.21.15.63:0/3329855647 wait complete. 2024-09-21T06:34:28.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.299+0000 7f1ed3e25640 1 Processor -- start 2024-09-21T06:34:28.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.299+0000 7f1ed3e25640 1 -- start start 2024-09-21T06:34:28.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.300+0000 7f1ed3e25640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ecc075cf0 0x7f1ecc1a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.300+0000 7f1ed3e25640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ecc077330 0x7f1ecc1a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.300+0000 7f1ed3e25640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ecc114430 0x7f1ecc1a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.300+0000 7f1ed3e25640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc11a0c0 con 0x7f1ecc114430 2024-09-21T06:34:28.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.300+0000 7f1ed3e25640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc119f40 con 0x7f1ecc075cf0 2024-09-21T06:34:28.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.300+0000 7f1ed3e25640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc11a240 con 0x7f1ecc077330 2024-09-21T06:34:28.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.300+0000 7f1ed23c2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ecc114430 0x7f1ecc1a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.300+0000 7f1ed23c2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ecc114430 0x7f1ecc1a6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42678/0 (socket says 172.21.15.63:42678) 2024-09-21T06:34:28.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.300+0000 7f1ed23c2640 1 -- 172.21.15.63:0/3228044126 learned_addr learned my addr 172.21.15.63:0/3228044126 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:28.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.300+0000 7f1ed13c0640 1 --2- 172.21.15.63:0/3228044126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ecc077330 0x7f1ecc1a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.300+0000 7f1ed1bc1640 1 --2- 172.21.15.63:0/3228044126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ecc075cf0 0x7f1ecc1a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.300+0000 7f1ed23c2640 1 -- 172.21.15.63:0/3228044126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ecc077330 msgr2=0x7f1ecc1a0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:28.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.300+0000 7f1ed23c2640 1 --2- 172.21.15.63:0/3228044126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ecc077330 0x7f1ecc1a0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.300+0000 7f1ed23c2640 1 -- 172.21.15.63:0/3228044126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ecc075cf0 msgr2=0x7f1ecc1a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:28.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.300+0000 7f1ed23c2640 1 --2- 172.21.15.63:0/3228044126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ecc075cf0 0x7f1ecc1a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.300+0000 7f1ed23c2640 1 -- 172.21.15.63:0/3228044126 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ecc1a69a0 con 0x7f1ecc114430 2024-09-21T06:34:28.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.301+0000 7f1ed23c2640 1 --2- 172.21.15.63:0/3228044126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ecc114430 0x7f1ecc1a6270 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4005cc0 tx=0x7f1ec4031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:28.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.301+0000 7f1ec2ffd640 1 -- 172.21.15.63:0/3228044126 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4003b70 con 0x7f1ecc114430 2024-09-21T06:34:28.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.301+0000 7f1ed3e25640 1 -- 172.21.15.63:0/3228044126 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ecc1a6c30 con 0x7f1ecc114430 2024-09-21T06:34:28.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.301+0000 7f1ec2ffd640 1 -- 172.21.15.63:0/3228044126 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ec40318f0 con 0x7f1ecc114430 2024-09-21T06:34:28.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.301+0000 7f1ec2ffd640 1 -- 172.21.15.63:0/3228044126 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec402f950 con 0x7f1ecc114430 2024-09-21T06:34:28.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.301+0000 7f1ed3e25640 1 -- 172.21.15.63:0/3228044126 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ecc1ad3f0 con 0x7f1ecc114430 2024-09-21T06:34:28.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.303+0000 7f1eda399740 1 Processor -- start 2024-09-21T06:34:28.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.304+0000 7f1ec2ffd640 1 -- 172.21.15.63:0/3228044126 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f1ec402fb30 con 0x7f1ecc114430 2024-09-21T06:34:28.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.304+0000 7f1eda399740 1 -- start start 2024-09-21T06:34:28.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.304+0000 7f1eda399740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfc9070 0x5561ae3702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.304+0000 7f1eda399740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfa01b0 0x5561ae370800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.304+0000 7f1eda399740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfa8390 0x5561ae370d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.304+0000 7f1eda399740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5561ae2e6ea0 con 0x5561adfc9070 2024-09-21T06:34:28.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.304+0000 7f1eda399740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5561ae2d62d0 con 0x5561adfa8390 2024-09-21T06:34:28.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.304+0000 7f1eda399740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5561ae2da0e0 con 0x5561adfa01b0 2024-09-21T06:34:28.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.305+0000 7f1ed13c0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfc9070 0x5561ae3702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.305+0000 7f1ed13c0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfc9070 0x5561ae3702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42686/0 (socket says 172.21.15.63:42686) 2024-09-21T06:34:28.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.305+0000 7f1ed13c0640 1 -- 172.21.15.63:0/3482434829 learned_addr learned my addr 172.21.15.63:0/3482434829 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:28.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.305+0000 7f1ed1bc1640 1 --2- 172.21.15.63:0/3482434829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfa01b0 0x5561ae370800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.305+0000 7f1ed13c0640 1 --2- 172.21.15.63:0/3482434829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfa8390 0x5561ae370d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.305+0000 7f1ed13c0640 1 -- 172.21.15.63:0/3482434829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfa01b0 msgr2=0x5561ae370800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:28.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.305+0000 7f1ed13c0640 1 --2- 172.21.15.63:0/3482434829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfa01b0 0x5561ae370800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.305+0000 7f1ed13c0640 1 -- 172.21.15.63:0/3482434829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfa8390 msgr2=0x5561ae370d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:28.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.305+0000 7f1ed13c0640 1 --2- 172.21.15.63:0/3482434829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfa8390 0x5561ae370d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.305+0000 7f1ed13c0640 1 -- 172.21.15.63:0/3482434829 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561ae034650 con 0x5561adfc9070 2024-09-21T06:34:28.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.305+0000 7f1ec2ffd640 1 --2- 172.21.15.63:0/3228044126 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1eb80b6680 0x7f1eb80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.305+0000 7f1ed1bc1640 1 --2- 172.21.15.63:0/3228044126 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1eb80b6680 0x7f1eb80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.305+0000 7f1ed13c0640 1 --2- 172.21.15.63:0/3482434829 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfc9070 0x5561ae3702c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009f70 tx=0x7f1ebc005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9022a88167f8e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:28.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.305+0000 7f1ec2ffd640 1 -- 172.21.15.63:0/3228044126 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f1ec4108a00 con 0x7f1ecc114430 2024-09-21T06:34:28.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.305+0000 7f1eb7fff640 1 -- 172.21.15.63:0/3482434829 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc004030 con 0x5561adfc9070 2024-09-21T06:34:28.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.306+0000 7f1eb7fff640 1 -- 172.21.15.63:0/3482434829 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ebc0035f0 con 0x5561adfc9070 2024-09-21T06:34:28.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.306+0000 7f1eb7fff640 1 -- 172.21.15.63:0/3482434829 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc00f760 con 0x5561adfc9070 2024-09-21T06:34:28.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.306+0000 7f1eda399740 1 -- 172.21.15.63:0/3482434829 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfc9070 msgr2=0x5561ae3702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:28.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.306+0000 7f1ed1bc1640 1 --2- 172.21.15.63:0/3228044126 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1eb80b6680 0x7f1eb80b8b90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x5561ae36ef40 tx=0x7f1ec8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:28.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.306+0000 7f1eda399740 1 --2- 172.21.15.63:0/3482434829 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfc9070 0x5561ae3702c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009f70 tx=0x7f1ebc005850 comp rx=0 tx=0).stop 2024-09-21T06:34:28.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.307+0000 7f1eda399740 1 -- 172.21.15.63:0/3482434829 shutdown_connections 2024-09-21T06:34:28.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.307+0000 7f1eda399740 1 --2- 172.21.15.63:0/3482434829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfa8390 0x5561ae370d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.307+0000 7f1eda399740 1 --2- 172.21.15.63:0/3482434829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfa01b0 0x5561ae370800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.307+0000 7f1eda399740 1 --2- 172.21.15.63:0/3482434829 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfc9070 0x5561ae3702c0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.307+0000 7f1eda399740 1 -- 172.21.15.63:0/3482434829 >> 172.21.15.63:0/3482434829 conn(0x5561adfbd460 msgr2=0x5561ae36e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:28.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.307+0000 7f1eda399740 1 -- 172.21.15.63:0/3482434829 shutdown_connections 2024-09-21T06:34:28.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.307+0000 7f1eda399740 1 -- 172.21.15.63:0/3482434829 wait complete. 2024-09-21T06:34:28.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.307+0000 7f1eda399740 1 -- start start 2024-09-21T06:34:28.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.307+0000 7f1eda399740 1 Processor -- start 2024-09-21T06:34:28.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.308+0000 7f1eda399740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfa01b0 0x5561ae37b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.308+0000 7f1eda399740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfa8390 0x5561ae37bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.308+0000 7f1eda399740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfc9070 0x5561ae387d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.308+0000 7f1eda399740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5561ae137700 con 0x5561adfa8390 2024-09-21T06:34:28.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.308+0000 7f1eda399740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5561ae271160 con 0x5561adfa01b0 2024-09-21T06:34:28.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.308+0000 7f1eda399740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5561ae37eaa0 con 0x5561adfc9070 2024-09-21T06:34:28.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.308+0000 7f1eda399740 10 client.0 _ll_register_callbacks cb 0x5561ae28a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:34:28.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.308+0000 7f1ed13c0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfa8390 0x5561ae37bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.308+0000 7f1ed13c0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfa8390 0x5561ae37bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42700/0 (socket says 172.21.15.63:42700) 2024-09-21T06:34:28.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.308+0000 7f1ed13c0640 1 -- 172.21.15.63:0/3699973620 learned_addr learned my addr 172.21.15.63:0/3699973620 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:28.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.308+0000 7f1ed1bc1640 1 --2- 172.21.15.63:0/3699973620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfa01b0 0x5561ae37b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.308+0000 7f1ed23c2640 1 --2- 172.21.15.63:0/3699973620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfc9070 0x5561ae387d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.308+0000 7f1ed13c0640 1 -- 172.21.15.63:0/3699973620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfc9070 msgr2=0x5561ae387d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:28.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.308+0000 7f1ed13c0640 1 --2- 172.21.15.63:0/3699973620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfc9070 0x5561ae387d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.308+0000 7f1ed13c0640 1 -- 172.21.15.63:0/3699973620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfa01b0 msgr2=0x5561ae37b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:28.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.308+0000 7f1ed13c0640 1 --2- 172.21.15.63:0/3699973620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfa01b0 0x5561ae37b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.308+0000 7f1ed13c0640 1 -- 172.21.15.63:0/3699973620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561ae29ec90 con 0x5561adfa8390 2024-09-21T06:34:28.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.308+0000 7f1ed23c2640 1 --2- 172.21.15.63:0/3699973620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfc9070 0x5561ae387d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:28.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.309+0000 7f1ed13c0640 1 --2- 172.21.15.63:0/3699973620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfa8390 0x5561ae37bf20 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc003f30 tx=0x7f1ebc0133c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ede08892a9059d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:28.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.309+0000 7f1eb57fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:34:28.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.309+0000 7f1eb57fa640 1 -- 172.21.15.63:0/3699973620 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc02f060 con 0x5561adfa8390 2024-09-21T06:34:28.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.309+0000 7f1eda399740 1 -- 172.21.15.63:0/3699973620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ebc0035f0 con 0x5561adfa8390 2024-09-21T06:34:28.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.309+0000 7f1eb57fa640 1 -- 172.21.15.63:0/3699973620 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f1ebc0041a0 con 0x5561adfa8390 2024-09-21T06:34:28.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.309+0000 7f1eb57fa640 1 -- 172.21.15.63:0/3699973620 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f1ebc009ca0 con 0x5561adfa8390 2024-09-21T06:34:28.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.309+0000 7f1eda399740 10 client.16779 fetch_fsmap learned FSMap version 53 2024-09-21T06:34:28.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.309+0000 7f1eda399740 1 -- 172.21.15.63:0/3699973620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5561ae38a810 con 0x5561adfa8390 2024-09-21T06:34:28.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.309+0000 7f1eb57fa640 1 -- 172.21.15.63:0/3699973620 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ebc0035f0 con 0x5561adfa8390 2024-09-21T06:34:28.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.309+0000 7f1eb57fa640 1 -- 172.21.15.63:0/3699973620 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7f1ebc01f430 con 0x5561adfa8390 2024-09-21T06:34:28.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.310+0000 7f1eda399740 10 client.16779 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:34:28.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.310+0000 7f1eda399740 10 client.16779 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:34:28.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.310+0000 7f1eda399740 20 client.16779 populate_metadata read hostname 'smithi063' 2024-09-21T06:34:28.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.310+0000 7f1eda399740 1 --2- 172.21.15.63:0/3699973620 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5561adf879f0 0x5561ae38dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.310+0000 7f1eda399740 4 client.16779 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:34:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.310+0000 7f1eda399740 1 -- 172.21.15.63:0/3699973620 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561ae2e8df0 con 0x5561adf879f0 2024-09-21T06:34:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.310+0000 7f1ed1bc1640 1 --2- 172.21.15.63:0/3699973620 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5561adf879f0 0x5561ae38dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.310+0000 7f1eb57fa640 10 client.16779 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:34:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.310+0000 7f1ed1bc1640 1 --2- 172.21.15.63:0/3699973620 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5561adf879f0 0x5561ae38dc80 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=539563809b1ae0fa server_cookie=372f0ad086228dac in_seq=0 out_seq=0 2024-09-21T06:34:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.311+0000 7f1eb57fa640 1 -- 172.21.15.63:0/3699973620 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5561ae2e8df0 con 0x5561adf879f0 2024-09-21T06:34:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.311+0000 7f1eb57fa640 10 client.16779 handle_command_reply: tid=0 2024-09-21T06:34:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.311+0000 7f1eda399740 1 client.16779 shutdown 2024-09-21T06:34:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.311+0000 7f1eda399740 1 -- 172.21.15.63:0/3699973620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfa8390 msgr2=0x5561ae37bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.312+0000 7f1eda399740 1 --2- 172.21.15.63:0/3699973620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfa8390 0x5561ae37bf20 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc003f30 tx=0x7f1ebc0133c0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.312+0000 7f1eda399740 1 -- 172.21.15.63:0/3699973620 shutdown_connections 2024-09-21T06:34:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.312+0000 7f1eda399740 1 --2- 172.21.15.63:0/3699973620 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5561adf879f0 0x5561ae38dc80 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.312+0000 7f1eda399740 1 --2- 172.21.15.63:0/3699973620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfc9070 0x5561ae387d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.312+0000 7f1eda399740 1 --2- 172.21.15.63:0/3699973620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfa8390 0x5561ae37bf20 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.312+0000 7f1eda399740 1 --2- 172.21.15.63:0/3699973620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfa01b0 0x5561ae37b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.312+0000 7f1eb57fa640 0 client.16779 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:34:28.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.312+0000 7f1eda399740 1 -- 172.21.15.63:0/3699973620 >> 172.21.15.63:0/3699973620 conn(0x5561adfbd460 msgr2=0x5561ae3734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:28.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.312+0000 7f1eda399740 1 -- 172.21.15.63:0/3699973620 shutdown_connections 2024-09-21T06:34:28.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.312+0000 7f1eda399740 1 -- 172.21.15.63:0/3699973620 wait complete. 2024-09-21T06:34:28.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.312+0000 7f1eda399740 20 client.16779 trim_cache size 0 max 16384 2024-09-21T06:34:28.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.325+0000 7f1eda399740 1 Processor -- start 2024-09-21T06:34:28.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.325+0000 7f1eda399740 1 -- start start 2024-09-21T06:34:28.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.325+0000 7f1eda399740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfa01b0 0x5561ae36e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.325+0000 7f1eda399740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfa8390 0x5561ae387c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.325+0000 7f1eda399740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfc9070 0x5561ae3733c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.325+0000 7f1eda399740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc1b5c70 con 0x5561adfa8390 2024-09-21T06:34:28.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.325+0000 7f1eda399740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc1b7870 con 0x5561adfc9070 2024-09-21T06:34:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.325+0000 7f1eda399740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc1b6340 con 0x5561adfa01b0 2024-09-21T06:34:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.326+0000 7f1ed13c0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfa8390 0x5561ae387c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.326+0000 7f1ed13c0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfa8390 0x5561ae387c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42702/0 (socket says 172.21.15.63:42702) 2024-09-21T06:34:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.326+0000 7f1ed13c0640 1 -- 172.21.15.63:0/4169478866 learned_addr learned my addr 172.21.15.63:0/4169478866 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.326+0000 7f1ed23c2640 1 --2- 172.21.15.63:0/4169478866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfc9070 0x5561ae3733c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.326+0000 7f1ed1bc1640 1 --2- 172.21.15.63:0/4169478866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfa01b0 0x5561ae36e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.326+0000 7f1ed13c0640 1 -- 172.21.15.63:0/4169478866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfa01b0 msgr2=0x5561ae36e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.326+0000 7f1ed13c0640 1 --2- 172.21.15.63:0/4169478866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfa01b0 0x5561ae36e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.326+0000 7f1ed13c0640 1 -- 172.21.15.63:0/4169478866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfc9070 msgr2=0x5561ae3733c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.326+0000 7f1ed13c0640 1 --2- 172.21.15.63:0/4169478866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfc9070 0x5561ae3733c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.326+0000 7f1ed13c0640 1 -- 172.21.15.63:0/4169478866 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561ae37cca0 con 0x5561adfa8390 2024-09-21T06:34:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.326+0000 7f1ed13c0640 1 --2- 172.21.15.63:0/4169478866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfa8390 0x5561ae387c90 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc005780 tx=0x7f1ebc001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae646471c8a5832 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.326+0000 7f1eb77fe640 1 -- 172.21.15.63:0/4169478866 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc009ca0 con 0x5561adfa8390 2024-09-21T06:34:28.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.326+0000 7f1eb77fe640 1 -- 172.21.15.63:0/4169478866 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ebc0035f0 con 0x5561adfa8390 2024-09-21T06:34:28.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.326+0000 7f1eb77fe640 1 -- 172.21.15.63:0/4169478866 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc003ab0 con 0x5561adfa8390 2024-09-21T06:34:28.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.327+0000 7f1eda399740 1 -- 172.21.15.63:0/4169478866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfa8390 msgr2=0x5561ae387c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:28.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.327+0000 7f1eda399740 1 --2- 172.21.15.63:0/4169478866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfa8390 0x5561ae387c90 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc005780 tx=0x7f1ebc001e50 comp rx=0 tx=0).stop 2024-09-21T06:34:28.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.327+0000 7f1eda399740 1 -- 172.21.15.63:0/4169478866 shutdown_connections 2024-09-21T06:34:28.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.327+0000 7f1eda399740 1 --2- 172.21.15.63:0/4169478866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfc9070 0x5561ae3733c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.327+0000 7f1eda399740 1 --2- 172.21.15.63:0/4169478866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfa8390 0x5561ae387c90 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.327+0000 7f1eda399740 1 --2- 172.21.15.63:0/4169478866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfa01b0 0x5561ae36e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.327+0000 7f1eda399740 1 -- 172.21.15.63:0/4169478866 >> 172.21.15.63:0/4169478866 conn(0x5561adfbd460 msgr2=0x5561ae36db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:28.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.327+0000 7f1eda399740 1 -- 172.21.15.63:0/4169478866 shutdown_connections 2024-09-21T06:34:28.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.327+0000 7f1eda399740 1 -- 172.21.15.63:0/4169478866 wait complete. 2024-09-21T06:34:28.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.328+0000 7f1eda399740 1 -- start start 2024-09-21T06:34:28.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.328+0000 7f1eda399740 1 Processor -- start 2024-09-21T06:34:28.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.328+0000 7f1eda399740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfa01b0 0x5561ae384200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.328+0000 7f1eda399740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfa8390 0x5561ae37f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.328+0000 7f1eda399740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfc9070 0x5561ae37fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.328+0000 7f1eda399740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc1b71a0 con 0x5561adfc9070 2024-09-21T06:34:28.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.328+0000 7f1eda399740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc1b6aa0 con 0x5561adfa01b0 2024-09-21T06:34:28.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.328+0000 7f1eda399740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc1b3c50 con 0x5561adfa8390 2024-09-21T06:34:28.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.328+0000 7f1eda399740 10 client.0 _ll_register_callbacks cb 0x7f1ec80097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:34:28.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.328+0000 7f1ed23c2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfc9070 0x5561ae37fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.328+0000 7f1ed23c2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfc9070 0x5561ae37fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42716/0 (socket says 172.21.15.63:42716) 2024-09-21T06:34:28.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.328+0000 7f1ed23c2640 1 -- 172.21.15.63:0/3998717433 learned_addr learned my addr 172.21.15.63:0/3998717433 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:28.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.328+0000 7f1ed1bc1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfa01b0 0x5561ae384200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.328+0000 7f1ed13c0640 1 --2- 172.21.15.63:0/3998717433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfa8390 0x5561ae37f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.329+0000 7f1ed23c2640 1 -- 172.21.15.63:0/3998717433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfa8390 msgr2=0x5561ae37f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:28.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.329+0000 7f1ed23c2640 1 --2- 172.21.15.63:0/3998717433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfa8390 0x5561ae37f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.329+0000 7f1ed23c2640 1 -- 172.21.15.63:0/3998717433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfa01b0 msgr2=0x5561ae384200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:28.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.329+0000 7f1ed23c2640 1 --2- 172.21.15.63:0/3998717433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfa01b0 0x5561ae384200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.329+0000 7f1ed23c2640 1 -- 172.21.15.63:0/3998717433 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561ae380180 con 0x5561adfc9070 2024-09-21T06:34:28.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.329+0000 7f1ed13c0640 1 --2- 172.21.15.63:0/3998717433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfa8390 0x5561ae37f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:34:28.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.329+0000 7f1ed1bc1640 1 --2- 172.21.15.63:0/3998717433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfa01b0 0x5561ae384200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:34:28.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.329+0000 7f1ed23c2640 1 --2- 172.21.15.63:0/3998717433 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfc9070 0x5561ae37fc40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4006010 tx=0x7f1ec40ce240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e609b12274759992 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:28.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.329+0000 7f1eb57fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:34:28.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.329+0000 7f1eb57fa640 1 -- 172.21.15.63:0/3998717433 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec40d3310 con 0x5561adfc9070 2024-09-21T06:34:28.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.329+0000 7f1eb57fa640 1 -- 172.21.15.63:0/3998717433 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f1ec40d7dc0 con 0x5561adfc9070 2024-09-21T06:34:28.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.329+0000 7f1eda399740 1 -- 172.21.15.63:0/3998717433 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ebc0035f0 con 0x5561adfc9070 2024-09-21T06:34:28.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.329+0000 7f1eb57fa640 1 -- 172.21.15.63:0/3998717433 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f1ec40d8250 con 0x5561adfc9070 2024-09-21T06:34:28.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.329+0000 7f1eda399740 10 client.16785 fetch_fsmap learned FSMap version 53 2024-09-21T06:34:28.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.329+0000 7f1eda399740 1 -- 172.21.15.63:0/3998717433 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5561ae3f8140 con 0x5561adfc9070 2024-09-21T06:34:28.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.330+0000 7f1eb57fa640 1 -- 172.21.15.63:0/3998717433 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ebc0035f0 con 0x5561adfc9070 2024-09-21T06:34:28.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.330+0000 7f1eb57fa640 1 -- 172.21.15.63:0/3998717433 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7f1ec40cfc80 con 0x5561adfc9070 2024-09-21T06:34:28.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.330+0000 7f1eda399740 10 client.16785 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:34:28.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.330+0000 7f1eda399740 10 client.16785 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:34:28.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.330+0000 7f1eda399740 20 client.16785 populate_metadata read hostname 'smithi063' 2024-09-21T06:34:28.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.330+0000 7f1eda399740 1 --2- 172.21.15.63:0/3998717433 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5561adf5cda0 0x5561ae3fa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.330+0000 7f1eda399740 4 client.16785 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:34:28.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.330+0000 7f1eda399740 1 -- 172.21.15.63:0/3998717433 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5561ae2e48a0 con 0x5561adf5cda0 2024-09-21T06:34:28.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.330+0000 7f1ed1bc1640 1 --2- 172.21.15.63:0/3998717433 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5561adf5cda0 0x5561ae3fa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.330+0000 7f1ed1bc1640 1 --2- 172.21.15.63:0/3998717433 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5561adf5cda0 0x5561ae3fa8d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1204abfa995b3a0b server_cookie=1799e57892e95831 in_seq=0 out_seq=0 2024-09-21T06:34:28.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.330+0000 7f1eb57fa640 10 client.16785 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:34:28.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.331+0000 7f1eb57fa640 1 -- 172.21.15.63:0/3998717433 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5561ae2e48a0 con 0x5561adf5cda0 2024-09-21T06:34:28.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.331+0000 7f1eb57fa640 10 client.16785 handle_command_reply: tid=0 2024-09-21T06:34:28.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.331+0000 7f1eda399740 1 client.16785 shutdown 2024-09-21T06:34:28.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.331+0000 7f1eda399740 1 -- 172.21.15.63:0/3998717433 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfc9070 msgr2=0x5561ae37fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:28.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.331+0000 7f1eda399740 1 --2- 172.21.15.63:0/3998717433 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfc9070 0x5561ae37fc40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4006010 tx=0x7f1ec40ce240 comp rx=0 tx=0).stop 2024-09-21T06:34:28.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.331+0000 7f1eda399740 1 -- 172.21.15.63:0/3998717433 shutdown_connections 2024-09-21T06:34:28.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.331+0000 7f1eda399740 1 --2- 172.21.15.63:0/3998717433 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5561adf5cda0 0x5561ae3fa8d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.331+0000 7f1eda399740 1 --2- 172.21.15.63:0/3998717433 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5561adfc9070 0x5561ae37fc40 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.331+0000 7f1eda399740 1 --2- 172.21.15.63:0/3998717433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561adfa8390 0x5561ae37f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.331+0000 7f1eda399740 1 --2- 172.21.15.63:0/3998717433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561adfa01b0 0x5561ae384200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.331+0000 7f1eb57fa640 0 client.16785 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:34:28.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.331+0000 7f1eda399740 1 -- 172.21.15.63:0/3998717433 >> 172.21.15.63:0/3998717433 conn(0x5561adfbd460 msgr2=0x5561ae3733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:28.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.331+0000 7f1eda399740 1 -- 172.21.15.63:0/3998717433 shutdown_connections 2024-09-21T06:34:28.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.331+0000 7f1eda399740 1 -- 172.21.15.63:0/3998717433 wait complete. 2024-09-21T06:34:28.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.331+0000 7f1eda399740 20 client.16785 trim_cache size 0 max 16384 2024-09-21T06:34:28.338 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:34:28.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.332+0000 7f1ed3e25640 1 -- 172.21.15.63:0/3228044126 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1eb80b6680 msgr2=0x7f1eb80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:28.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.332+0000 7f1ed3e25640 1 --2- 172.21.15.63:0/3228044126 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1eb80b6680 0x7f1eb80b8b90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x5561ae36ef40 tx=0x7f1ec8005f90 comp rx=0 tx=0).stop 2024-09-21T06:34:28.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.332+0000 7f1ed3e25640 1 -- 172.21.15.63:0/3228044126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ecc114430 msgr2=0x7f1ecc1a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:28.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.332+0000 7f1ed3e25640 1 --2- 172.21.15.63:0/3228044126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ecc114430 0x7f1ecc1a6270 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4005cc0 tx=0x7f1ec4031700 comp rx=0 tx=0).stop 2024-09-21T06:34:28.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.332+0000 7f1ed3e25640 1 -- 172.21.15.63:0/3228044126 shutdown_connections 2024-09-21T06:34:28.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.332+0000 7f1ed3e25640 1 --2- 172.21.15.63:0/3228044126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ecc114430 0x7f1ecc1a6270 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.332+0000 7f1ed3e25640 1 --2- 172.21.15.63:0/3228044126 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f1eb80b6680 0x7f1eb80b8b90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.332+0000 7f1ed3e25640 1 --2- 172.21.15.63:0/3228044126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ecc077330 0x7f1ecc1a0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.332+0000 7f1ed3e25640 1 --2- 172.21.15.63:0/3228044126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ecc075cf0 0x7f1ecc1a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.332+0000 7f1ed3e25640 1 -- 172.21.15.63:0/3228044126 >> 172.21.15.63:0/3228044126 conn(0x7f1ecc07b910 msgr2=0x7f1ecc113100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:28.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.332+0000 7f1ed3e25640 1 -- 172.21.15.63:0/3228044126 shutdown_connections 2024-09-21T06:34:28.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:28.332+0000 7f1ed3e25640 1 -- 172.21.15.63:0/3228044126 wait complete. 2024-09-21T06:34:29.044 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T06:34:29.306 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:29.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:29 smithi063 ceph-mon[31150]: pgmap v511: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:34:29.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:29 smithi071 ceph-mon[34844]: pgmap v511: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:34:29.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:29 smithi175 ceph-mon[34510]: pgmap v511: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:34:29.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.775+0000 7f37486d2640 1 -- 172.21.15.63:0/3416276046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37401083d0 msgr2=0x7f37401087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:29.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.775+0000 7f37486d2640 1 --2- 172.21.15.63:0/3416276046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37401083d0 0x7f37401087e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f3730009900 tx=0x7f373002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.775+0000 7f37486d2640 1 -- 172.21.15.63:0/3416276046 shutdown_connections 2024-09-21T06:34:29.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.775+0000 7f37486d2640 1 --2- 172.21.15.63:0/3416276046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3740108d20 0x7f374010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.775+0000 7f37486d2640 1 --2- 172.21.15.63:0/3416276046 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37401083d0 0x7f37401087e0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.775+0000 7f37486d2640 1 --2- 172.21.15.63:0/3416276046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3740102ae0 0x7f3740102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.775+0000 7f37486d2640 1 -- 172.21.15.63:0/3416276046 >> 172.21.15.63:0/3416276046 conn(0x7f3740079760 msgr2=0x7f3740079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.775+0000 7f37486d2640 1 -- 172.21.15.63:0/3416276046 shutdown_connections 2024-09-21T06:34:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.775+0000 7f37486d2640 1 -- 172.21.15.63:0/3416276046 wait complete. 2024-09-21T06:34:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.776+0000 7f37486d2640 1 Processor -- start 2024-09-21T06:34:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.776+0000 7f37486d2640 1 -- start start 2024-09-21T06:34:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.776+0000 7f37486d2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3740102ae0 0x7f374019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.776+0000 7f37486d2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37401083d0 0x7f374019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.776+0000 7f37486d2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3740108d20 0x7f374019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.776+0000 7f37486d2640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3740112990 con 0x7f3740102ae0 2024-09-21T06:34:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.776+0000 7f37486d2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3740112810 con 0x7f37401083d0 2024-09-21T06:34:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.776+0000 7f37486d2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3740112b10 con 0x7f3740108d20 2024-09-21T06:34:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.776+0000 7f374646e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3740102ae0 0x7f374019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.777+0000 7f374646e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3740102ae0 0x7f374019a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42732/0 (socket says 172.21.15.63:42732) 2024-09-21T06:34:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.777+0000 7f374646e640 1 -- 172.21.15.63:0/2433841179 learned_addr learned my addr 172.21.15.63:0/2433841179 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.777+0000 7f3746c6f640 1 --2- 172.21.15.63:0/2433841179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3740108d20 0x7f374019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.777+0000 7f3745c6d640 1 --2- 172.21.15.63:0/2433841179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37401083d0 0x7f374019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.777+0000 7f374646e640 1 -- 172.21.15.63:0/2433841179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3740108d20 msgr2=0x7f374019fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.777+0000 7f374646e640 1 --2- 172.21.15.63:0/2433841179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3740108d20 0x7f374019fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.777+0000 7f374646e640 1 -- 172.21.15.63:0/2433841179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37401083d0 msgr2=0x7f374019aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.777+0000 7f374646e640 1 --2- 172.21.15.63:0/2433841179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37401083d0 0x7f374019aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.777+0000 7f374646e640 1 -- 172.21.15.63:0/2433841179 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37401a0480 con 0x7f3740102ae0 2024-09-21T06:34:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.777+0000 7f3745c6d640 1 --2- 172.21.15.63:0/2433841179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37401083d0 0x7f374019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.777+0000 7f374646e640 1 --2- 172.21.15.63:0/2433841179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3740102ae0 0x7f374019a510 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f373c00d770 tx=0x7f373c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.777+0000 7f37377fe640 1 -- 172.21.15.63:0/2433841179 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c017070 con 0x7f3740102ae0 2024-09-21T06:34:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.777+0000 7f37377fe640 1 -- 172.21.15.63:0/2433841179 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f373c0054d0 con 0x7f3740102ae0 2024-09-21T06:34:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.777+0000 7f37486d2640 1 -- 172.21.15.63:0/2433841179 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37401a0770 con 0x7f3740102ae0 2024-09-21T06:34:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.777+0000 7f37377fe640 1 -- 172.21.15.63:0/2433841179 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c004c30 con 0x7f3740102ae0 2024-09-21T06:34:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.777+0000 7f37486d2640 1 -- 172.21.15.63:0/2433841179 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37401a6ed0 con 0x7f3740102ae0 2024-09-21T06:34:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.780+0000 7f374ec46740 1 Processor -- start 2024-09-21T06:34:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.780+0000 7f374ec46740 1 -- start start 2024-09-21T06:34:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.780+0000 7f37377fe640 1 -- 172.21.15.63:0/2433841179 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f373c004e10 con 0x7f3740102ae0 2024-09-21T06:34:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.780+0000 7f374ec46740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f0fc786070 0x55f0fcb2d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.780+0000 7f374ec46740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb2d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.780+0000 7f374ec46740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0fc765390 0x55f0fcb2dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.780+0000 7f374ec46740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f0fcaa3ea0 con 0x55f0fc75d1b0 2024-09-21T06:34:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.780+0000 7f374ec46740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f0fca932d0 con 0x55f0fc786070 2024-09-21T06:34:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.780+0000 7f374ec46740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f0fca970e0 con 0x55f0fc765390 2024-09-21T06:34:29.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.781+0000 7f374646e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb2d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:29.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.781+0000 7f374646e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb2d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42736/0 (socket says 172.21.15.63:42736) 2024-09-21T06:34:29.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.781+0000 7f374646e640 1 -- 172.21.15.63:0/69634573 learned_addr learned my addr 172.21.15.63:0/69634573 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:29.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.781+0000 7f3746c6f640 1 --2- 172.21.15.63:0/69634573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f0fc786070 0x55f0fcb2d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:29.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.781+0000 7f3745c6d640 1 --2- 172.21.15.63:0/69634573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0fc765390 0x55f0fcb2dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:29.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.781+0000 7f374646e640 1 -- 172.21.15.63:0/69634573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0fc765390 msgr2=0x55f0fcb2dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:29.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.781+0000 7f374646e640 1 --2- 172.21.15.63:0/69634573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0fc765390 0x55f0fcb2dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.781+0000 7f374646e640 1 -- 172.21.15.63:0/69634573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f0fc786070 msgr2=0x55f0fcb2d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:29.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.781+0000 7f374646e640 1 --2- 172.21.15.63:0/69634573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f0fc786070 0x55f0fcb2d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.781+0000 7f374646e640 1 -- 172.21.15.63:0/69634573 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0fc7f1650 con 0x55f0fc75d1b0 2024-09-21T06:34:29.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.781+0000 7f3745c6d640 1 --2- 172.21.15.63:0/69634573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0fc765390 0x55f0fcb2dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:29.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.781+0000 7f37377fe640 1 --2- 172.21.15.63:0/2433841179 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f372c0b6700 0x7f372c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.781+0000 7f374646e640 1 --2- 172.21.15.63:0/69634573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb2d800 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f373c0e4860 tx=0x7f373c0eaf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f745cc443390c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:29.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.781+0000 7f3746c6f640 1 --2- 172.21.15.63:0/2433841179 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f372c0b6700 0x7f372c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:29.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.781+0000 7f37377fe640 1 -- 172.21.15.63:0/2433841179 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f373c0e7120 con 0x7f3740102ae0 2024-09-21T06:34:29.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.782+0000 7f3734ff9640 1 -- 172.21.15.63:0/69634573 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c0a9640 con 0x55f0fc75d1b0 2024-09-21T06:34:29.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.782+0000 7f3734ff9640 1 -- 172.21.15.63:0/69634573 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f373c0b4e50 con 0x55f0fc75d1b0 2024-09-21T06:34:29.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.782+0000 7f3734ff9640 1 -- 172.21.15.63:0/69634573 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c0ac760 con 0x55f0fc75d1b0 2024-09-21T06:34:29.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.782+0000 7f374ec46740 1 -- 172.21.15.63:0/69634573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 msgr2=0x55f0fcb2d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:29.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.783+0000 7f3746c6f640 1 --2- 172.21.15.63:0/2433841179 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f372c0b6700 0x7f372c0b8c10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3738005fd0 tx=0x7f37380096a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:29.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.783+0000 7f374ec46740 1 --2- 172.21.15.63:0/69634573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb2d800 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f373c0e4860 tx=0x7f373c0eaf90 comp rx=0 tx=0).stop 2024-09-21T06:34:29.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.783+0000 7f374ec46740 1 -- 172.21.15.63:0/69634573 shutdown_connections 2024-09-21T06:34:29.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.783+0000 7f374ec46740 1 --2- 172.21.15.63:0/69634573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0fc765390 0x55f0fcb2dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.783+0000 7f374ec46740 1 --2- 172.21.15.63:0/69634573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb2d800 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.783+0000 7f374ec46740 1 --2- 172.21.15.63:0/69634573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f0fc786070 0x55f0fcb2d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.783+0000 7f374ec46740 1 -- 172.21.15.63:0/69634573 >> 172.21.15.63:0/69634573 conn(0x55f0fc77a460 msgr2=0x55f0fcb2b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:29.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.783+0000 7f374ec46740 1 -- 172.21.15.63:0/69634573 shutdown_connections 2024-09-21T06:34:29.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.783+0000 7f374ec46740 1 -- 172.21.15.63:0/69634573 wait complete. 2024-09-21T06:34:29.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.783+0000 7f374ec46740 1 -- start start 2024-09-21T06:34:29.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.783+0000 7f374ec46740 1 Processor -- start 2024-09-21T06:34:29.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.783+0000 7f374ec46740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb38a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.783+0000 7f374ec46740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f0fc765390 0x55f0fcb38f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.783+0000 7f374ec46740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0fc786070 0x55f0fcb44dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.784+0000 7f374ec46740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f0fc8f4700 con 0x55f0fc75d1b0 2024-09-21T06:34:29.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.784+0000 7f374ec46740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f0fca2e160 con 0x55f0fc765390 2024-09-21T06:34:29.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.784+0000 7f374ec46740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f0fcb3baa0 con 0x55f0fc786070 2024-09-21T06:34:29.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.784+0000 7f374ec46740 10 client.0 _ll_register_callbacks cb 0x55f0fca479e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:34:29.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.784+0000 7f374646e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb38a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:29.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.784+0000 7f374646e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb38a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42752/0 (socket says 172.21.15.63:42752) 2024-09-21T06:34:29.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.784+0000 7f374646e640 1 -- 172.21.15.63:0/2771716111 learned_addr learned my addr 172.21.15.63:0/2771716111 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:29.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.784+0000 7f374646e640 1 -- 172.21.15.63:0/2771716111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0fc786070 msgr2=0x55f0fcb44dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:29.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.784+0000 7f374646e640 1 --2- 172.21.15.63:0/2771716111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0fc786070 0x55f0fcb44dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.784+0000 7f374646e640 1 -- 172.21.15.63:0/2771716111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f0fc765390 msgr2=0x55f0fcb38f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:34:29.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.784+0000 7f374646e640 1 --2- 172.21.15.63:0/2771716111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f0fc765390 0x55f0fcb38f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.784+0000 7f374646e640 1 -- 172.21.15.63:0/2771716111 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0fca5bc90 con 0x55f0fc75d1b0 2024-09-21T06:34:29.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.785+0000 7f374646e640 1 --2- 172.21.15.63:0/2771716111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb38a00 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f373c0acf80 tx=0x7f373c009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0264a17c32175e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:29.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.785+0000 7f3729ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:34:29.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.785+0000 7f3729ffb640 1 -- 172.21.15.63:0/2771716111 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c020030 con 0x55f0fc75d1b0 2024-09-21T06:34:29.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.785+0000 7f3729ffb640 1 -- 172.21.15.63:0/2771716111 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f373c0b6580 con 0x55f0fc75d1b0 2024-09-21T06:34:29.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.785+0000 7f374ec46740 1 -- 172.21.15.63:0/2771716111 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f373c0b4e50 con 0x55f0fc75d1b0 2024-09-21T06:34:29.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.785+0000 7f3729ffb640 1 -- 172.21.15.63:0/2771716111 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f373c0ac940 con 0x55f0fc75d1b0 2024-09-21T06:34:29.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.785+0000 7f374ec46740 10 client.16797 fetch_fsmap learned FSMap version 53 2024-09-21T06:34:29.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.785+0000 7f374ec46740 1 -- 172.21.15.63:0/2771716111 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55f0fcb47810 con 0x55f0fc75d1b0 2024-09-21T06:34:29.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.785+0000 7f3729ffb640 1 -- 172.21.15.63:0/2771716111 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f373c0b4e50 con 0x55f0fc75d1b0 2024-09-21T06:34:29.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.785+0000 7f3729ffb640 1 -- 172.21.15.63:0/2771716111 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7f373c0a8940 con 0x55f0fc75d1b0 2024-09-21T06:34:29.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.786+0000 7f374ec46740 10 client.16797 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:34:29.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.786+0000 7f374ec46740 10 client.16797 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:34:29.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.786+0000 7f374ec46740 20 client.16797 populate_metadata read hostname 'smithi063' 2024-09-21T06:34:29.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.786+0000 7f374ec46740 1 --2- 172.21.15.63:0/2771716111 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55f0fc7449f0 0x55f0fcb4ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.786+0000 7f374ec46740 4 client.16797 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:34:29.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.786+0000 7f374ec46740 1 -- 172.21.15.63:0/2771716111 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0fcaa5df0 con 0x55f0fc7449f0 2024-09-21T06:34:29.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.786+0000 7f3745c6d640 1 --2- 172.21.15.63:0/2771716111 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55f0fc7449f0 0x55f0fcb4ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:29.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.786+0000 7f3745c6d640 1 --2- 172.21.15.63:0/2771716111 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55f0fc7449f0 0x55f0fcb4ab70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3a4fe4aebd1e66b3 server_cookie=b751181b7cc9d3ad in_seq=0 out_seq=0 2024-09-21T06:34:29.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.786+0000 7f3729ffb640 10 client.16797 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:34:29.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.787+0000 7f3729ffb640 1 -- 172.21.15.63:0/2771716111 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f0fcaa5df0 con 0x55f0fc7449f0 2024-09-21T06:34:29.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.787+0000 7f3729ffb640 10 client.16797 handle_command_reply: tid=0 2024-09-21T06:34:29.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.787+0000 7f374ec46740 1 client.16797 shutdown 2024-09-21T06:34:29.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.787+0000 7f374ec46740 1 -- 172.21.15.63:0/2771716111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 msgr2=0x55f0fcb38a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:29.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.787+0000 7f374ec46740 1 --2- 172.21.15.63:0/2771716111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb38a00 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f373c0acf80 tx=0x7f373c009f00 comp rx=0 tx=0).stop 2024-09-21T06:34:29.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.787+0000 7f374ec46740 1 -- 172.21.15.63:0/2771716111 shutdown_connections 2024-09-21T06:34:29.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.787+0000 7f374ec46740 1 --2- 172.21.15.63:0/2771716111 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55f0fc7449f0 0x55f0fcb4ab70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.787+0000 7f374ec46740 1 --2- 172.21.15.63:0/2771716111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0fc786070 0x55f0fcb44dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.787+0000 7f3729ffb640 0 client.16797 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:34:29.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.787+0000 7f374ec46740 1 --2- 172.21.15.63:0/2771716111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f0fc765390 0x55f0fcb38f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.787+0000 7f374ec46740 1 --2- 172.21.15.63:0/2771716111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb38a00 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.787+0000 7f374ec46740 1 -- 172.21.15.63:0/2771716111 >> 172.21.15.63:0/2771716111 conn(0x55f0fc77a460 msgr2=0x55f0fcb30450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:29.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.788+0000 7f374ec46740 1 -- 172.21.15.63:0/2771716111 shutdown_connections 2024-09-21T06:34:29.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.788+0000 7f374ec46740 1 -- 172.21.15.63:0/2771716111 wait complete. 2024-09-21T06:34:29.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.788+0000 7f374ec46740 20 client.16797 trim_cache size 0 max 16384 2024-09-21T06:34:29.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.801+0000 7f374ec46740 1 Processor -- start 2024-09-21T06:34:29.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.801+0000 7f374ec46740 1 -- start start 2024-09-21T06:34:29.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.801+0000 7f374ec46740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f0fc7449f0 0x55f0fcb303c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.801+0000 7f374ec46740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb30900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.801+0000 7f374ec46740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0fc765390 0x55f0fcb35bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.801+0000 7f374ec46740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f37401af6e0 con 0x55f0fc75d1b0 2024-09-21T06:34:29.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.801+0000 7f374ec46740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f37401b12e0 con 0x55f0fc7449f0 2024-09-21T06:34:29.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.801+0000 7f374ec46740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f37401afdb0 con 0x55f0fc765390 2024-09-21T06:34:29.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.801+0000 7f3745c6d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb30900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:29.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.801+0000 7f3745c6d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb30900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42766/0 (socket says 172.21.15.63:42766) 2024-09-21T06:34:29.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.801+0000 7f3745c6d640 1 -- 172.21.15.63:0/3380372989 learned_addr learned my addr 172.21.15.63:0/3380372989 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:29.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.802+0000 7f374646e640 1 --2- 172.21.15.63:0/3380372989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f0fc7449f0 0x55f0fcb303c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:29.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.802+0000 7f3746c6f640 1 --2- 172.21.15.63:0/3380372989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0fc765390 0x55f0fcb35bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:29.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.802+0000 7f3745c6d640 1 -- 172.21.15.63:0/3380372989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0fc765390 msgr2=0x55f0fcb35bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:29.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.802+0000 7f3745c6d640 1 --2- 172.21.15.63:0/3380372989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0fc765390 0x55f0fcb35bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.802+0000 7f3745c6d640 1 -- 172.21.15.63:0/3380372989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f0fc7449f0 msgr2=0x55f0fcb303c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:29.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.802+0000 7f3745c6d640 1 --2- 172.21.15.63:0/3380372989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f0fc7449f0 0x55f0fcb303c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.802+0000 7f3745c6d640 1 -- 172.21.15.63:0/3380372989 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0fcb33610 con 0x55f0fc75d1b0 2024-09-21T06:34:29.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.802+0000 7f374646e640 1 --2- 172.21.15.63:0/3380372989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f0fc7449f0 0x55f0fcb303c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:34:29.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.802+0000 7f3745c6d640 1 --2- 172.21.15.63:0/3380372989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb30900 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f3730000c00 tx=0x7f3730009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800d22ec3cad2b1c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:29.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.802+0000 7f372bfff640 1 -- 172.21.15.63:0/3380372989 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3730046070 con 0x55f0fc75d1b0 2024-09-21T06:34:29.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.802+0000 7f372bfff640 1 -- 172.21.15.63:0/3380372989 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3730005020 con 0x55f0fc75d1b0 2024-09-21T06:34:29.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.802+0000 7f372bfff640 1 -- 172.21.15.63:0/3380372989 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3730035040 con 0x55f0fc75d1b0 2024-09-21T06:34:29.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.803+0000 7f374ec46740 1 -- 172.21.15.63:0/3380372989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 msgr2=0x55f0fcb30900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:29.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.803+0000 7f374ec46740 1 --2- 172.21.15.63:0/3380372989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb30900 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f3730000c00 tx=0x7f3730009650 comp rx=0 tx=0).stop 2024-09-21T06:34:29.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.803+0000 7f374ec46740 1 -- 172.21.15.63:0/3380372989 shutdown_connections 2024-09-21T06:34:29.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.803+0000 7f374ec46740 1 --2- 172.21.15.63:0/3380372989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0fc765390 0x55f0fcb35bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.803+0000 7f374ec46740 1 --2- 172.21.15.63:0/3380372989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb30900 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.803+0000 7f374ec46740 1 --2- 172.21.15.63:0/3380372989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f0fc7449f0 0x55f0fcb303c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.803+0000 7f374ec46740 1 -- 172.21.15.63:0/3380372989 >> 172.21.15.63:0/3380372989 conn(0x55f0fc77a460 msgr2=0x55f0fcb37280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:29.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.803+0000 7f374ec46740 1 -- 172.21.15.63:0/3380372989 shutdown_connections 2024-09-21T06:34:29.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.803+0000 7f374ec46740 1 -- 172.21.15.63:0/3380372989 wait complete. 2024-09-21T06:34:29.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.804+0000 7f374ec46740 1 -- start start 2024-09-21T06:34:29.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.804+0000 7f374ec46740 1 Processor -- start 2024-09-21T06:34:29.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.804+0000 7f374ec46740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0fc7449f0 0x55f0fcb4bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.804+0000 7f374ec46740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb4c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.804+0000 7f374ec46740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc765390 0x55f0fcbb42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.804+0000 7f374ec46740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f37401b0c10 con 0x55f0fc765390 2024-09-21T06:34:29.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.804+0000 7f374ec46740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f37401b0510 con 0x55f0fc75d1b0 2024-09-21T06:34:29.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.804+0000 7f374ec46740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f37401ad6c0 con 0x55f0fc7449f0 2024-09-21T06:34:29.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.804+0000 7f374ec46740 10 client.0 _ll_register_callbacks cb 0x7f3738009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:34:29.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.804+0000 7f3746c6f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc765390 0x55f0fcbb42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:29.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.804+0000 7f3746c6f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc765390 0x55f0fcbb42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42776/0 (socket says 172.21.15.63:42776) 2024-09-21T06:34:29.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.804+0000 7f3746c6f640 1 -- 172.21.15.63:0/4207136462 learned_addr learned my addr 172.21.15.63:0/4207136462 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:29.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.804+0000 7f3745c6d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb4c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:29.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.804+0000 7f374646e640 1 --2- 172.21.15.63:0/4207136462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0fc7449f0 0x55f0fcb4bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:29.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.804+0000 7f3746c6f640 1 -- 172.21.15.63:0/4207136462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0fc7449f0 msgr2=0x55f0fcb4bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:29.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.804+0000 7f3746c6f640 1 --2- 172.21.15.63:0/4207136462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0fc7449f0 0x55f0fcb4bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.804+0000 7f3746c6f640 1 -- 172.21.15.63:0/4207136462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f0fc75d1b0 msgr2=0x55f0fcb4c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:29.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.804+0000 7f3746c6f640 1 --2- 172.21.15.63:0/4207136462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb4c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.805+0000 7f3746c6f640 1 -- 172.21.15.63:0/4207136462 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0fcbb4830 con 0x55f0fc765390 2024-09-21T06:34:29.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.805+0000 7f3746c6f640 1 --2- 172.21.15.63:0/4207136462 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc765390 0x55f0fcbb42f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f3738010970 tx=0x7f37380109a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a9532694807b83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:29.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.805+0000 7f3729ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:34:29.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.805+0000 7f3729ffb640 1 -- 172.21.15.63:0/4207136462 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3738010e90 con 0x55f0fc765390 2024-09-21T06:34:29.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.805+0000 7f3729ffb640 1 -- 172.21.15.63:0/4207136462 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f3738017030 con 0x55f0fc765390 2024-09-21T06:34:29.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.805+0000 7f374ec46740 1 -- 172.21.15.63:0/4207136462 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3730005020 con 0x55f0fc765390 2024-09-21T06:34:29.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.805+0000 7f3729ffb640 1 -- 172.21.15.63:0/4207136462 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f3738003b80 con 0x55f0fc765390 2024-09-21T06:34:29.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.805+0000 7f374ec46740 10 client.16803 fetch_fsmap learned FSMap version 53 2024-09-21T06:34:29.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.805+0000 7f374ec46740 1 -- 172.21.15.63:0/4207136462 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55f0fcbb59c0 con 0x55f0fc765390 2024-09-21T06:34:29.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.805+0000 7f3729ffb640 1 -- 172.21.15.63:0/4207136462 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3730005020 con 0x55f0fc765390 2024-09-21T06:34:29.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.805+0000 7f3729ffb640 1 -- 172.21.15.63:0/4207136462 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7f37380295f0 con 0x55f0fc765390 2024-09-21T06:34:29.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.805+0000 7f374ec46740 10 client.16803 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:34:29.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.805+0000 7f374ec46740 10 client.16803 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:34:29.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.805+0000 7f374ec46740 20 client.16803 populate_metadata read hostname 'smithi063' 2024-09-21T06:34:29.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.806+0000 7f374ec46740 1 --2- 172.21.15.63:0/4207136462 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55f0fc786070 0x55f0fcbb8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.806+0000 7f374ec46740 4 client.16803 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:34:29.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.806+0000 7f374ec46740 1 -- 172.21.15.63:0/4207136462 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f0fcaa18a0 con 0x55f0fc786070 2024-09-21T06:34:29.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.806+0000 7f374646e640 1 --2- 172.21.15.63:0/4207136462 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55f0fc786070 0x55f0fcbb8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:29.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.806+0000 7f3729ffb640 10 client.16803 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:34:29.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.806+0000 7f374646e640 1 --2- 172.21.15.63:0/4207136462 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55f0fc786070 0x55f0fcbb8150 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=966f88fe8f5a3aeb server_cookie=f8fafc40e7a5ff51 in_seq=0 out_seq=0 2024-09-21T06:34:29.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.806+0000 7f3729ffb640 1 -- 172.21.15.63:0/4207136462 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f0fcaa18a0 con 0x55f0fc786070 2024-09-21T06:34:29.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.806+0000 7f3729ffb640 10 client.16803 handle_command_reply: tid=0 2024-09-21T06:34:29.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.806+0000 7f374ec46740 1 client.16803 shutdown 2024-09-21T06:34:29.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.807+0000 7f374ec46740 1 -- 172.21.15.63:0/4207136462 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc765390 msgr2=0x55f0fcbb42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:29.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.807+0000 7f374ec46740 1 --2- 172.21.15.63:0/4207136462 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc765390 0x55f0fcbb42f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f3738010970 tx=0x7f37380109a0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.807+0000 7f374ec46740 1 -- 172.21.15.63:0/4207136462 shutdown_connections 2024-09-21T06:34:29.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.807+0000 7f374ec46740 1 --2- 172.21.15.63:0/4207136462 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55f0fc786070 0x55f0fcbb8150 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.807+0000 7f374ec46740 1 --2- 172.21.15.63:0/4207136462 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f0fc765390 0x55f0fcbb42f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.807+0000 7f374ec46740 1 --2- 172.21.15.63:0/4207136462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f0fc75d1b0 0x55f0fcb4c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.807+0000 7f374ec46740 1 --2- 172.21.15.63:0/4207136462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0fc7449f0 0x55f0fcb4bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.807+0000 7f374ec46740 1 -- 172.21.15.63:0/4207136462 >> 172.21.15.63:0/4207136462 conn(0x55f0fc77a460 msgr2=0x55f0fcb303c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:29.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.807+0000 7f3729ffb640 0 client.16803 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:34:29.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.807+0000 7f374ec46740 1 -- 172.21.15.63:0/4207136462 shutdown_connections 2024-09-21T06:34:29.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.807+0000 7f374ec46740 1 -- 172.21.15.63:0/4207136462 wait complete. 2024-09-21T06:34:29.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.807+0000 7f374ec46740 20 client.16803 trim_cache size 0 max 16384 2024-09-21T06:34:29.814 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:34:29.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.807+0000 7f37486d2640 1 -- 172.21.15.63:0/2433841179 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f372c0b6700 msgr2=0x7f372c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:29.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.807+0000 7f37486d2640 1 --2- 172.21.15.63:0/2433841179 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f372c0b6700 0x7f372c0b8c10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3738005fd0 tx=0x7f37380096a0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.807+0000 7f37486d2640 1 -- 172.21.15.63:0/2433841179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3740102ae0 msgr2=0x7f374019a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:29.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.807+0000 7f37486d2640 1 --2- 172.21.15.63:0/2433841179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3740102ae0 0x7f374019a510 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f373c00d770 tx=0x7f373c00dc30 comp rx=0 tx=0).stop 2024-09-21T06:34:29.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.808+0000 7f37486d2640 1 -- 172.21.15.63:0/2433841179 shutdown_connections 2024-09-21T06:34:29.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.808+0000 7f37486d2640 1 --2- 172.21.15.63:0/2433841179 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f372c0b6700 0x7f372c0b8c10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.808+0000 7f37486d2640 1 --2- 172.21.15.63:0/2433841179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3740108d20 0x7f374019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.808+0000 7f37486d2640 1 --2- 172.21.15.63:0/2433841179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37401083d0 0x7f374019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.808+0000 7f37486d2640 1 --2- 172.21.15.63:0/2433841179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3740102ae0 0x7f374019a510 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.808+0000 7f37486d2640 1 -- 172.21.15.63:0/2433841179 >> 172.21.15.63:0/2433841179 conn(0x7f3740079760 msgr2=0x7f3740101ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:29.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.808+0000 7f37486d2640 1 -- 172.21.15.63:0/2433841179 shutdown_connections 2024-09-21T06:34:29.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:29.808+0000 7f37486d2640 1 -- 172.21.15.63:0/2433841179 wait complete. 2024-09-21T06:34:30.573 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:34:30.838 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:31.250 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:31 smithi063 ceph-mon[31150]: pgmap v512: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:34:31.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.343+0000 7fa6a87f8640 1 -- 172.21.15.63:0/391971411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6a01083d0 msgr2=0x7fa6a01087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:31.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.343+0000 7fa6a87f8640 1 --2- 172.21.15.63:0/391971411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6a01083d0 0x7fa6a01087e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa694009900 tx=0x7fa69402a410 comp rx=0 tx=0).stop 2024-09-21T06:34:31.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.343+0000 7fa6a87f8640 1 -- 172.21.15.63:0/391971411 shutdown_connections 2024-09-21T06:34:31.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.343+0000 7fa6a87f8640 1 --2- 172.21.15.63:0/391971411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a0108d20 0x7fa6a010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.343+0000 7fa6a87f8640 1 --2- 172.21.15.63:0/391971411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6a01083d0 0x7fa6a01087e0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.343+0000 7fa6a87f8640 1 --2- 172.21.15.63:0/391971411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6a0102ae0 0x7fa6a0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.343+0000 7fa6a87f8640 1 -- 172.21.15.63:0/391971411 >> 172.21.15.63:0/391971411 conn(0x7fa6a0079760 msgr2=0x7fa6a0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:31.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.343+0000 7fa6a87f8640 1 -- 172.21.15.63:0/391971411 shutdown_connections 2024-09-21T06:34:31.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.343+0000 7fa6a87f8640 1 -- 172.21.15.63:0/391971411 wait complete. 2024-09-21T06:34:31.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.344+0000 7fa6a87f8640 1 Processor -- start 2024-09-21T06:34:31.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.344+0000 7fa6a87f8640 1 -- start start 2024-09-21T06:34:31.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.344+0000 7fa6a87f8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a0102ae0 0x7fa6a019c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.344+0000 7fa6a87f8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6a01083d0 0x7fa6a019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.344+0000 7fa6a87f8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6a0108d20 0x7fa6a01a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.344+0000 7fa6a87f8640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a0113ab0 con 0x7fa6a01083d0 2024-09-21T06:34:31.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.344+0000 7fa6a87f8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a0113930 con 0x7fa6a0102ae0 2024-09-21T06:34:31.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.344+0000 7fa6a87f8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a0113c30 con 0x7fa6a0108d20 2024-09-21T06:34:31.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.344+0000 7fa6a5d93640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6a01083d0 0x7fa6a019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.344+0000 7fa6a5d93640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6a01083d0 0x7fa6a019cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42790/0 (socket says 172.21.15.63:42790) 2024-09-21T06:34:31.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.344+0000 7fa6a5d93640 1 -- 172.21.15.63:0/1597391903 learned_addr learned my addr 172.21.15.63:0/1597391903 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:31.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.344+0000 7fa6a6594640 1 --2- 172.21.15.63:0/1597391903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a0102ae0 0x7fa6a019c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.344+0000 7fa6a6d95640 1 --2- 172.21.15.63:0/1597391903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6a0108d20 0x7fa6a01a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.345+0000 7fa6a5d93640 1 -- 172.21.15.63:0/1597391903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6a0108d20 msgr2=0x7fa6a01a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:31.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.345+0000 7fa6a5d93640 1 --2- 172.21.15.63:0/1597391903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6a0108d20 0x7fa6a01a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.345+0000 7fa6a5d93640 1 -- 172.21.15.63:0/1597391903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a0102ae0 msgr2=0x7fa6a019c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:31.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.345+0000 7fa6a5d93640 1 --2- 172.21.15.63:0/1597391903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a0102ae0 0x7fa6a019c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.345+0000 7fa6a5d93640 1 -- 172.21.15.63:0/1597391903 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a01a25d0 con 0x7fa6a01083d0 2024-09-21T06:34:31.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.345+0000 7fa6a5d93640 1 --2- 172.21.15.63:0/1597391903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6a01083d0 0x7fa6a019cc00 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa694006010 tx=0x7fa694004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:31.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.345+0000 7fa6937fe640 1 -- 172.21.15.63:0/1597391903 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69403f030 con 0x7fa6a01083d0 2024-09-21T06:34:31.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.345+0000 7fa6937fe640 1 -- 172.21.15.63:0/1597391903 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa694003aa0 con 0x7fa6a01083d0 2024-09-21T06:34:31.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.345+0000 7fa6a87f8640 1 -- 172.21.15.63:0/1597391903 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a01a2860 con 0x7fa6a01083d0 2024-09-21T06:34:31.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.345+0000 7fa6937fe640 1 -- 172.21.15.63:0/1597391903 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694035070 con 0x7fa6a01083d0 2024-09-21T06:34:31.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.346+0000 7fa6a87f8640 1 -- 172.21.15.63:0/1597391903 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a01a9020 con 0x7fa6a01083d0 2024-09-21T06:34:31.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.348+0000 7fa6aed6c740 1 Processor -- start 2024-09-21T06:34:31.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.349+0000 7fa6aed6c740 1 -- start start 2024-09-21T06:34:31.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.349+0000 7fa6aed6c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb42070 0x55c8ffee96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.349+0000 7fa6aed6c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb191b0 0x55c8ffee9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.349+0000 7fa6aed6c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c8ffb21390 0x55c8ffeea120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.349+0000 7fa6aed6c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c8ffe5fea0 con 0x55c8ffb191b0 2024-09-21T06:34:31.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.349+0000 7fa6aed6c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c8ffe4f2d0 con 0x55c8ffb21390 2024-09-21T06:34:31.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.349+0000 7fa6aed6c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c8ffe530e0 con 0x55c8ffb42070 2024-09-21T06:34:31.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.349+0000 7fa6937fe640 1 -- 172.21.15.63:0/1597391903 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fa694042030 con 0x7fa6a01083d0 2024-09-21T06:34:31.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.349+0000 7fa6a6594640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb191b0 0x55c8ffee9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.349+0000 7fa6a6594640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb191b0 0x55c8ffee9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42798/0 (socket says 172.21.15.63:42798) 2024-09-21T06:34:31.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.349+0000 7fa6a6594640 1 -- 172.21.15.63:0/2382936646 learned_addr learned my addr 172.21.15.63:0/2382936646 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:31.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.349+0000 7fa6a6d95640 1 --2- 172.21.15.63:0/2382936646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb42070 0x55c8ffee96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.349+0000 7fa6a5d93640 1 --2- 172.21.15.63:0/2382936646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c8ffb21390 0x55c8ffeea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.349+0000 7fa6a6d95640 1 -- 172.21.15.63:0/2382936646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c8ffb21390 msgr2=0x55c8ffeea120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:31.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.349+0000 7fa6a6d95640 1 --2- 172.21.15.63:0/2382936646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c8ffb21390 0x55c8ffeea120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.349+0000 7fa6a6d95640 1 -- 172.21.15.63:0/2382936646 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb191b0 msgr2=0x55c8ffee9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:31.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.349+0000 7fa6a6d95640 1 --2- 172.21.15.63:0/2382936646 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb191b0 0x55c8ffee9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.349+0000 7fa6a6d95640 1 -- 172.21.15.63:0/2382936646 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8ffbad650 con 0x55c8ffb42070 2024-09-21T06:34:31.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.349+0000 7fa6a6594640 1 --2- 172.21.15.63:0/2382936646 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb191b0 0x55c8ffee9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:34:31.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.350+0000 7fa6a6d95640 1 --2- 172.21.15.63:0/2382936646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb42070 0x55c8ffee96a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa698009f30 tx=0x7fa698010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93cf76de63ce9afa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:31.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.350+0000 7fa6937fe640 1 --2- 172.21.15.63:0/1597391903 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa68c0b6680 0x7fa68c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.350+0000 7fa690ff9640 1 -- 172.21.15.63:0/2382936646 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698016070 con 0x55c8ffb42070 2024-09-21T06:34:31.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.350+0000 7fa690ff9640 1 -- 172.21.15.63:0/2382936646 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa698004d20 con 0x55c8ffb42070 2024-09-21T06:34:31.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.350+0000 7fa6a6594640 1 --2- 172.21.15.63:0/1597391903 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa68c0b6680 0x7fa68c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.350+0000 7fa6937fe640 1 -- 172.21.15.63:0/1597391903 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fa6941077f0 con 0x7fa6a01083d0 2024-09-21T06:34:31.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.350+0000 7fa690ff9640 1 -- 172.21.15.63:0/2382936646 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6980127d0 con 0x55c8ffb42070 2024-09-21T06:34:31.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.351+0000 7fa6aed6c740 1 -- 172.21.15.63:0/2382936646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb42070 msgr2=0x55c8ffee96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:31.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.351+0000 7fa6aed6c740 1 --2- 172.21.15.63:0/2382936646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb42070 0x55c8ffee96a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa698009f30 tx=0x7fa698010800 comp rx=0 tx=0).stop 2024-09-21T06:34:31.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.351+0000 7fa6a6594640 1 --2- 172.21.15.63:0/1597391903 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa68c0b6680 0x7fa68c0b8b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55c8ffee8320 tx=0x7fa69c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:31.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.351+0000 7fa6aed6c740 1 -- 172.21.15.63:0/2382936646 shutdown_connections 2024-09-21T06:34:31.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.351+0000 7fa6aed6c740 1 --2- 172.21.15.63:0/2382936646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c8ffb21390 0x55c8ffeea120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.351+0000 7fa6aed6c740 1 --2- 172.21.15.63:0/2382936646 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb191b0 0x55c8ffee9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.351+0000 7fa6aed6c740 1 --2- 172.21.15.63:0/2382936646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb42070 0x55c8ffee96a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.351+0000 7fa6aed6c740 1 -- 172.21.15.63:0/2382936646 >> 172.21.15.63:0/2382936646 conn(0x55c8ffb36460 msgr2=0x55c8ffee7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:31.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.351+0000 7fa6aed6c740 1 -- 172.21.15.63:0/2382936646 shutdown_connections 2024-09-21T06:34:31.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.351+0000 7fa6aed6c740 1 -- 172.21.15.63:0/2382936646 wait complete. 2024-09-21T06:34:31.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.352+0000 7fa6aed6c740 1 -- start start 2024-09-21T06:34:31.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.352+0000 7fa6aed6c740 1 Processor -- start 2024-09-21T06:34:31.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.352+0000 7fa6aed6c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb191b0 0x55c8ffef4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.352+0000 7fa6aed6c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb21390 0x55c8ffef5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.352+0000 7fa6aed6c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c8ffb42070 0x55c8fff011d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.352+0000 7fa6aed6c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c8ffcb0700 con 0x55c8ffb21390 2024-09-21T06:34:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.352+0000 7fa6aed6c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c8ffdea160 con 0x55c8ffb42070 2024-09-21T06:34:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.352+0000 7fa6aed6c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c8ffef7e80 con 0x55c8ffb191b0 2024-09-21T06:34:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.352+0000 7fa6aed6c740 10 client.0 _ll_register_callbacks cb 0x55c8ffe039e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:34:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.352+0000 7fa6a5d93640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb21390 0x55c8ffef5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.352+0000 7fa6a5d93640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb21390 0x55c8ffef5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42804/0 (socket says 172.21.15.63:42804) 2024-09-21T06:34:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.352+0000 7fa6a6594640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb191b0 0x55c8ffef4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.352+0000 7fa6a5d93640 1 -- 172.21.15.63:0/1052197986 learned_addr learned my addr 172.21.15.63:0/1052197986 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.352+0000 7fa6a6d95640 1 --2- 172.21.15.63:0/1052197986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c8ffb42070 0x55c8fff011d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.353+0000 7fa6a5d93640 1 -- 172.21.15.63:0/1052197986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb191b0 msgr2=0x55c8ffef4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.353+0000 7fa6a5d93640 1 --2- 172.21.15.63:0/1052197986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb191b0 0x55c8ffef4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.353+0000 7fa6a5d93640 1 -- 172.21.15.63:0/1052197986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c8ffb42070 msgr2=0x55c8fff011d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:31.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.353+0000 7fa6a5d93640 1 --2- 172.21.15.63:0/1052197986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c8ffb42070 0x55c8fff011d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.353+0000 7fa6a5d93640 1 -- 172.21.15.63:0/1052197986 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8ffe17c90 con 0x55c8ffb21390 2024-09-21T06:34:31.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.353+0000 7fa6a5d93640 1 --2- 172.21.15.63:0/1052197986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb21390 0x55c8ffef5300 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa6940cd600 tx=0x7fa69403b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b14f00f4afa96d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:31.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.353+0000 7fa689ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:34:31.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.353+0000 7fa689ffb640 1 -- 172.21.15.63:0/1052197986 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694049070 con 0x55c8ffb21390 2024-09-21T06:34:31.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.353+0000 7fa689ffb640 1 -- 172.21.15.63:0/1052197986 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fa694107de0 con 0x55c8ffb21390 2024-09-21T06:34:31.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.353+0000 7fa6aed6c740 1 -- 172.21.15.63:0/1052197986 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa698004d20 con 0x55c8ffb21390 2024-09-21T06:34:31.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.353+0000 7fa689ffb640 1 -- 172.21.15.63:0/1052197986 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fa6940c9510 con 0x55c8ffb21390 2024-09-21T06:34:31.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.353+0000 7fa6aed6c740 10 client.16815 fetch_fsmap learned FSMap version 53 2024-09-21T06:34:31.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.353+0000 7fa6aed6c740 1 -- 172.21.15.63:0/1052197986 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55c8fff03bf0 con 0x55c8ffb21390 2024-09-21T06:34:31.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.354+0000 7fa689ffb640 1 -- 172.21.15.63:0/1052197986 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa698004d20 con 0x55c8ffb21390 2024-09-21T06:34:31.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.354+0000 7fa689ffb640 1 -- 172.21.15.63:0/1052197986 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7fa6940d6b50 con 0x55c8ffb21390 2024-09-21T06:34:31.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.354+0000 7fa6aed6c740 10 client.16815 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:34:31.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.354+0000 7fa6aed6c740 10 client.16815 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:34:31.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.354+0000 7fa6aed6c740 20 client.16815 populate_metadata read hostname 'smithi063' 2024-09-21T06:34:31.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.354+0000 7fa6aed6c740 1 --2- 172.21.15.63:0/1052197986 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55c8ffb009f0 0x55c8fff070c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.354+0000 7fa6aed6c740 4 client.16815 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:34:31.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.354+0000 7fa6aed6c740 1 -- 172.21.15.63:0/1052197986 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8ffe61df0 con 0x55c8ffb009f0 2024-09-21T06:34:31.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.354+0000 7fa6a6594640 1 --2- 172.21.15.63:0/1052197986 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55c8ffb009f0 0x55c8fff070c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.355+0000 7fa6a6594640 1 --2- 172.21.15.63:0/1052197986 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55c8ffb009f0 0x55c8fff070c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=70627575de9311a2 server_cookie=d67d0343f8d22a28 in_seq=0 out_seq=0 2024-09-21T06:34:31.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.355+0000 7fa689ffb640 10 client.16815 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:34:31.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.355+0000 7fa689ffb640 1 -- 172.21.15.63:0/1052197986 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c8ffe61df0 con 0x55c8ffb009f0 2024-09-21T06:34:31.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.356+0000 7fa689ffb640 10 client.16815 handle_command_reply: tid=0 2024-09-21T06:34:31.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.356+0000 7fa6aed6c740 1 client.16815 shutdown 2024-09-21T06:34:31.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.356+0000 7fa6aed6c740 1 -- 172.21.15.63:0/1052197986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb21390 msgr2=0x55c8ffef5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.356+0000 7fa6aed6c740 1 --2- 172.21.15.63:0/1052197986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb21390 0x55c8ffef5300 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa6940cd600 tx=0x7fa69403b640 comp rx=0 tx=0).stop 2024-09-21T06:34:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.356+0000 7fa6aed6c740 1 -- 172.21.15.63:0/1052197986 shutdown_connections 2024-09-21T06:34:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.356+0000 7fa6aed6c740 1 --2- 172.21.15.63:0/1052197986 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55c8ffb009f0 0x55c8fff070c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.356+0000 7fa6aed6c740 1 --2- 172.21.15.63:0/1052197986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c8ffb42070 0x55c8fff011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.356+0000 7fa6aed6c740 1 --2- 172.21.15.63:0/1052197986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb21390 0x55c8ffef5300 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.356+0000 7fa689ffb640 0 client.16815 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:34:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.356+0000 7fa6aed6c740 1 --2- 172.21.15.63:0/1052197986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb191b0 0x55c8ffef4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.356+0000 7fa6aed6c740 1 -- 172.21.15.63:0/1052197986 >> 172.21.15.63:0/1052197986 conn(0x55c8ffb36460 msgr2=0x55c8ffeec830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.356+0000 7fa6aed6c740 1 -- 172.21.15.63:0/1052197986 shutdown_connections 2024-09-21T06:34:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.356+0000 7fa6aed6c740 1 -- 172.21.15.63:0/1052197986 wait complete. 2024-09-21T06:34:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.356+0000 7fa6aed6c740 20 client.16815 trim_cache size 0 max 16384 2024-09-21T06:34:31.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.369+0000 7fa6aed6c740 1 Processor -- start 2024-09-21T06:34:31.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.369+0000 7fa6aed6c740 1 -- start start 2024-09-21T06:34:31.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.369+0000 7fa6aed6c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c8ffb009f0 0x55c8ffef3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.370+0000 7fa6aed6c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb191b0 0x55c8ffeeade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.370+0000 7fa6aed6c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb21390 0x55c8fff010d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.370+0000 7fa6aed6c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a01b1890 con 0x55c8ffb191b0 2024-09-21T06:34:31.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.370+0000 7fa6aed6c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a01b3490 con 0x55c8ffb009f0 2024-09-21T06:34:31.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.370+0000 7fa6aed6c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a01b1f60 con 0x55c8ffb21390 2024-09-21T06:34:31.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.370+0000 7fa6a5d93640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb191b0 0x55c8ffeeade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.370+0000 7fa6a5d93640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb191b0 0x55c8ffeeade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42820/0 (socket says 172.21.15.63:42820) 2024-09-21T06:34:31.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.370+0000 7fa6a5d93640 1 -- 172.21.15.63:0/1531766630 learned_addr learned my addr 172.21.15.63:0/1531766630 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:31.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.370+0000 7fa6a6594640 1 --2- 172.21.15.63:0/1531766630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c8ffb009f0 0x55c8ffef3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.370+0000 7fa6a6d95640 1 --2- 172.21.15.63:0/1531766630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb21390 0x55c8fff010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.370+0000 7fa6a5d93640 1 -- 172.21.15.63:0/1531766630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb21390 msgr2=0x55c8fff010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.370+0000 7fa6a5d93640 1 --2- 172.21.15.63:0/1531766630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb21390 0x55c8fff010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.370+0000 7fa6a5d93640 1 -- 172.21.15.63:0/1531766630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c8ffb009f0 msgr2=0x55c8ffef3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.370+0000 7fa6a5d93640 1 --2- 172.21.15.63:0/1531766630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c8ffb009f0 0x55c8ffef3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.370+0000 7fa6a5d93640 1 -- 172.21.15.63:0/1531766630 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8fff075f0 con 0x55c8ffb191b0 2024-09-21T06:34:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.370+0000 7fa6a6d95640 1 --2- 172.21.15.63:0/1531766630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb21390 0x55c8fff010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:34:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.370+0000 7fa6a5d93640 1 --2- 172.21.15.63:0/1531766630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb191b0 0x55c8ffeeade0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa694000c00 tx=0x7fa694009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7f84f133e4602b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.370+0000 7fa68bfff640 1 -- 172.21.15.63:0/1531766630 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694049070 con 0x55c8ffb191b0 2024-09-21T06:34:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.370+0000 7fa68bfff640 1 -- 172.21.15.63:0/1531766630 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa69410d220 con 0x55c8ffb191b0 2024-09-21T06:34:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.370+0000 7fa68bfff640 1 -- 172.21.15.63:0/1531766630 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694105350 con 0x55c8ffb191b0 2024-09-21T06:34:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.371+0000 7fa6aed6c740 1 -- 172.21.15.63:0/1531766630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb191b0 msgr2=0x55c8ffeeade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.371+0000 7fa6aed6c740 1 --2- 172.21.15.63:0/1531766630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb191b0 0x55c8ffeeade0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa694000c00 tx=0x7fa694009680 comp rx=0 tx=0).stop 2024-09-21T06:34:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.371+0000 7fa6aed6c740 1 -- 172.21.15.63:0/1531766630 shutdown_connections 2024-09-21T06:34:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.371+0000 7fa6aed6c740 1 --2- 172.21.15.63:0/1531766630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb21390 0x55c8fff010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.371+0000 7fa6aed6c740 1 --2- 172.21.15.63:0/1531766630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb191b0 0x55c8ffeeade0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.371+0000 7fa6aed6c740 1 --2- 172.21.15.63:0/1531766630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c8ffb009f0 0x55c8ffef3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.371+0000 7fa6aed6c740 1 -- 172.21.15.63:0/1531766630 >> 172.21.15.63:0/1531766630 conn(0x55c8ffb36460 msgr2=0x55c8ffeea6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.371+0000 7fa6aed6c740 1 -- 172.21.15.63:0/1531766630 shutdown_connections 2024-09-21T06:34:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.371+0000 7fa6aed6c740 1 -- 172.21.15.63:0/1531766630 wait complete. 2024-09-21T06:34:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.372+0000 7fa6aed6c740 1 -- start start 2024-09-21T06:34:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.372+0000 7fa6aed6c740 1 Processor -- start 2024-09-21T06:34:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.372+0000 7fa6aed6c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb009f0 0x55c8ffef9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.372+0000 7fa6aed6c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c8ffb191b0 0x55c8ffef9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.372+0000 7fa6aed6c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb21390 0x55c8fff70aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.372+0000 7fa6aed6c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a01b2dc0 con 0x55c8ffb009f0 2024-09-21T06:34:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.372+0000 7fa6aed6c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a01b26c0 con 0x55c8ffb191b0 2024-09-21T06:34:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.372+0000 7fa6aed6c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a01af870 con 0x55c8ffb21390 2024-09-21T06:34:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.372+0000 7fa6aed6c740 10 client.0 _ll_register_callbacks cb 0x7fa694005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:34:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.372+0000 7fa6a6594640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb009f0 0x55c8ffef9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.372+0000 7fa6a6594640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb009f0 0x55c8ffef9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42836/0 (socket says 172.21.15.63:42836) 2024-09-21T06:34:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.372+0000 7fa6a6594640 1 -- 172.21.15.63:0/3076693440 learned_addr learned my addr 172.21.15.63:0/3076693440 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.372+0000 7fa6a5d93640 1 --2- 172.21.15.63:0/3076693440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c8ffb191b0 0x55c8ffef9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.372+0000 7fa6a6d95640 1 --2- 172.21.15.63:0/3076693440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb21390 0x55c8fff70aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.372+0000 7fa6a6594640 1 -- 172.21.15.63:0/3076693440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb21390 msgr2=0x55c8fff70aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.372+0000 7fa6a6594640 1 --2- 172.21.15.63:0/3076693440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb21390 0x55c8fff70aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.372+0000 7fa6a6594640 1 -- 172.21.15.63:0/3076693440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c8ffb191b0 msgr2=0x55c8ffef9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.372+0000 7fa6a6594640 1 --2- 172.21.15.63:0/3076693440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c8ffb191b0 0x55c8ffef9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.373+0000 7fa6a6594640 1 -- 172.21.15.63:0/3076693440 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8fff70fe0 con 0x55c8ffb009f0 2024-09-21T06:34:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.373+0000 7fa6a6594640 1 --2- 172.21.15.63:0/3076693440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb009f0 0x55c8ffef9800 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa69c00f870 tx=0x7fa69c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec62f183f63420c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:31.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.373+0000 7fa689ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:34:31.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.373+0000 7fa689ffb640 1 -- 172.21.15.63:0/3076693440 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69c004020 con 0x55c8ffb009f0 2024-09-21T06:34:31.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.373+0000 7fa689ffb640 1 -- 172.21.15.63:0/3076693440 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fa69c018030 con 0x55c8ffb009f0 2024-09-21T06:34:31.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.373+0000 7fa6aed6c740 1 -- 172.21.15.63:0/3076693440 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa69410d220 con 0x55c8ffb009f0 2024-09-21T06:34:31.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.373+0000 7fa689ffb640 1 -- 172.21.15.63:0/3076693440 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fa69c0041c0 con 0x55c8ffb009f0 2024-09-21T06:34:31.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.373+0000 7fa6aed6c740 10 client.16821 fetch_fsmap learned FSMap version 53 2024-09-21T06:34:31.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.373+0000 7fa6aed6c740 1 -- 172.21.15.63:0/3076693440 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55c8fff72210 con 0x55c8ffb009f0 2024-09-21T06:34:31.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.373+0000 7fa689ffb640 1 -- 172.21.15.63:0/3076693440 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa69410d220 con 0x55c8ffb009f0 2024-09-21T06:34:31.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.374+0000 7fa689ffb640 1 -- 172.21.15.63:0/3076693440 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7fa69c004a00 con 0x55c8ffb009f0 2024-09-21T06:34:31.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.374+0000 7fa6aed6c740 10 client.16821 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:34:31.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.374+0000 7fa6aed6c740 10 client.16821 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:34:31.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.374+0000 7fa6aed6c740 20 client.16821 populate_metadata read hostname 'smithi063' 2024-09-21T06:34:31.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.374+0000 7fa6aed6c740 1 --2- 172.21.15.63:0/3076693440 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55c8ffb42070 0x55c8fff74a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.374+0000 7fa6aed6c740 4 client.16821 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:34:31.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.374+0000 7fa6aed6c740 1 -- 172.21.15.63:0/3076693440 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c8ffe5d8a0 con 0x55c8ffb42070 2024-09-21T06:34:31.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.374+0000 7fa6a5d93640 1 --2- 172.21.15.63:0/3076693440 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55c8ffb42070 0x55c8fff74a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.375+0000 7fa6a5d93640 1 --2- 172.21.15.63:0/3076693440 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55c8ffb42070 0x55c8fff74a40 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ee874f183099ebbe server_cookie=e96d5faff1987a73 in_seq=0 out_seq=0 2024-09-21T06:34:31.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.375+0000 7fa689ffb640 10 client.16821 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:34:31.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.375+0000 7fa689ffb640 1 -- 172.21.15.63:0/3076693440 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c8ffe5d8a0 con 0x55c8ffb42070 2024-09-21T06:34:31.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.375+0000 7fa689ffb640 10 client.16821 handle_command_reply: tid=0 2024-09-21T06:34:31.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.375+0000 7fa6aed6c740 1 client.16821 shutdown 2024-09-21T06:34:31.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.375+0000 7fa6aed6c740 1 -- 172.21.15.63:0/3076693440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb009f0 msgr2=0x55c8ffef9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:31.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.375+0000 7fa6aed6c740 1 --2- 172.21.15.63:0/3076693440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb009f0 0x55c8ffef9800 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa69c00f870 tx=0x7fa69c0046c0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.375+0000 7fa6aed6c740 1 -- 172.21.15.63:0/3076693440 shutdown_connections 2024-09-21T06:34:31.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.375+0000 7fa6aed6c740 1 --2- 172.21.15.63:0/3076693440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ffb21390 0x55c8fff70aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.375+0000 7fa6aed6c740 1 --2- 172.21.15.63:0/3076693440 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55c8ffb42070 0x55c8fff74a40 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.375+0000 7fa6aed6c740 1 --2- 172.21.15.63:0/3076693440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c8ffb191b0 0x55c8ffef9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.375+0000 7fa6aed6c740 1 --2- 172.21.15.63:0/3076693440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c8ffb009f0 0x55c8ffef9800 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.375+0000 7fa6aed6c740 1 -- 172.21.15.63:0/3076693440 >> 172.21.15.63:0/3076693440 conn(0x55c8ffb36460 msgr2=0x55c8ffeea6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:31.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.375+0000 7fa689ffb640 0 client.16821 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:34:31.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.375+0000 7fa6aed6c740 1 -- 172.21.15.63:0/3076693440 shutdown_connections 2024-09-21T06:34:31.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.375+0000 7fa6aed6c740 1 -- 172.21.15.63:0/3076693440 wait complete. 2024-09-21T06:34:31.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.375+0000 7fa6aed6c740 20 client.16821 trim_cache size 0 max 16384 2024-09-21T06:34:31.382 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:34:31.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.376+0000 7fa6a87f8640 1 -- 172.21.15.63:0/1597391903 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa68c0b6680 msgr2=0x7fa68c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:31.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.376+0000 7fa6a87f8640 1 --2- 172.21.15.63:0/1597391903 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa68c0b6680 0x7fa68c0b8b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55c8ffee8320 tx=0x7fa69c005f90 comp rx=0 tx=0).stop 2024-09-21T06:34:31.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.376+0000 7fa6a87f8640 1 -- 172.21.15.63:0/1597391903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6a01083d0 msgr2=0x7fa6a019cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:31.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.376+0000 7fa6a87f8640 1 --2- 172.21.15.63:0/1597391903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6a01083d0 0x7fa6a019cc00 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa694006010 tx=0x7fa694004060 comp rx=0 tx=0).stop 2024-09-21T06:34:31.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.376+0000 7fa6a87f8640 1 -- 172.21.15.63:0/1597391903 shutdown_connections 2024-09-21T06:34:31.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.376+0000 7fa6a87f8640 1 --2- 172.21.15.63:0/1597391903 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa68c0b6680 0x7fa68c0b8b90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.376+0000 7fa6a87f8640 1 --2- 172.21.15.63:0/1597391903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6a0108d20 0x7fa6a01a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.376+0000 7fa6a87f8640 1 --2- 172.21.15.63:0/1597391903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6a01083d0 0x7fa6a019cc00 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.376+0000 7fa6a87f8640 1 --2- 172.21.15.63:0/1597391903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a0102ae0 0x7fa6a019c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.376+0000 7fa6a87f8640 1 -- 172.21.15.63:0/1597391903 >> 172.21.15.63:0/1597391903 conn(0x7fa6a0079760 msgr2=0x7fa6a01041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:31.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.376+0000 7fa6a87f8640 1 -- 172.21.15.63:0/1597391903 shutdown_connections 2024-09-21T06:34:31.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:31.376+0000 7fa6a87f8640 1 -- 172.21.15.63:0/1597391903 wait complete. 2024-09-21T06:34:31.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:31 smithi071 ceph-mon[34844]: pgmap v512: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:34:31.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:31 smithi175 ceph-mon[34510]: pgmap v512: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:34:32.041 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:34:32.306 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:32.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:32 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:34:32.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:32 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:34:32.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:32 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:34:32.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.786+0000 7fd2aa24d640 1 -- 172.21.15.63:0/420768952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a4108d70 msgr2=0x7fd2a410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:32.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.786+0000 7fd2aa24d640 1 --2- 172.21.15.63:0/420768952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a4108d70 0x7fd2a410f5a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009ca0 tx=0x7fd29c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.786+0000 7fd2aa24d640 1 -- 172.21.15.63:0/420768952 shutdown_connections 2024-09-21T06:34:32.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.786+0000 7fd2aa24d640 1 --2- 172.21.15.63:0/420768952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a4108d70 0x7fd2a410f5a0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.786+0000 7fd2aa24d640 1 --2- 172.21.15.63:0/420768952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2a4108420 0x7fd2a4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.786+0000 7fd2aa24d640 1 --2- 172.21.15.63:0/420768952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2a4102ae0 0x7fd2a4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.786+0000 7fd2aa24d640 1 -- 172.21.15.63:0/420768952 >> 172.21.15.63:0/420768952 conn(0x7fd2a4079770 msgr2=0x7fd2a4079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:32.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.786+0000 7fd2aa24d640 1 -- 172.21.15.63:0/420768952 shutdown_connections 2024-09-21T06:34:32.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.786+0000 7fd2aa24d640 1 -- 172.21.15.63:0/420768952 wait complete. 2024-09-21T06:34:32.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.787+0000 7fd2aa24d640 1 Processor -- start 2024-09-21T06:34:32.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.787+0000 7fd2aa24d640 1 -- start start 2024-09-21T06:34:32.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.788+0000 7fd2aa24d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2a4102ae0 0x7fd2a419b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:32.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.788+0000 7fd2aa24d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2a4108420 0x7fd2a419b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:32.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.788+0000 7fd2aa24d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a4108d70 0x7fd2a419bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:32.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.788+0000 7fd2aa24d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a4112a30 con 0x7fd2a4108d70 2024-09-21T06:34:32.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.788+0000 7fd2aa24d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a41128b0 con 0x7fd2a4102ae0 2024-09-21T06:34:32.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.788+0000 7fd2aa24d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a4112bb0 con 0x7fd2a4108420 2024-09-21T06:34:32.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.788+0000 7fd2a3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a4108d70 0x7fd2a419bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:32.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.788+0000 7fd2a3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a4108d70 0x7fd2a419bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42864/0 (socket says 172.21.15.63:42864) 2024-09-21T06:34:32.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.788+0000 7fd2a3fff640 1 -- 172.21.15.63:0/2221391081 learned_addr learned my addr 172.21.15.63:0/2221391081 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:32.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.788+0000 7fd2a37fe640 1 --2- 172.21.15.63:0/2221391081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2a4102ae0 0x7fd2a419b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:32.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.788+0000 7fd2a2ffd640 1 --2- 172.21.15.63:0/2221391081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2a4108420 0x7fd2a419b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:32.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.788+0000 7fd2a3fff640 1 -- 172.21.15.63:0/2221391081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2a4108420 msgr2=0x7fd2a419b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:32.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.788+0000 7fd2a3fff640 1 --2- 172.21.15.63:0/2221391081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2a4108420 0x7fd2a419b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.788+0000 7fd2a3fff640 1 -- 172.21.15.63:0/2221391081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2a4102ae0 msgr2=0x7fd2a419b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:32.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.788+0000 7fd2a3fff640 1 --2- 172.21.15.63:0/2221391081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2a4102ae0 0x7fd2a419b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.788+0000 7fd2a3fff640 1 -- 172.21.15.63:0/2221391081 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a41a6560 con 0x7fd2a4108d70 2024-09-21T06:34:32.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.788+0000 7fd2a3fff640 1 --2- 172.21.15.63:0/2221391081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a4108d70 0x7fd2a419bd20 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd29c005cc0 tx=0x7fd29c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:32.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.789+0000 7fd2a0ff9640 1 -- 172.21.15.63:0/2221391081 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c003bf0 con 0x7fd2a4108d70 2024-09-21T06:34:32.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.789+0000 7fd2aa24d640 1 -- 172.21.15.63:0/2221391081 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2a41a67f0 con 0x7fd2a4108d70 2024-09-21T06:34:32.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.789+0000 7fd2a0ff9640 1 -- 172.21.15.63:0/2221391081 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd29c003d90 con 0x7fd2a4108d70 2024-09-21T06:34:32.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.789+0000 7fd2a0ff9640 1 -- 172.21.15.63:0/2221391081 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c02fbc0 con 0x7fd2a4108d70 2024-09-21T06:34:32.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.789+0000 7fd2aa24d640 1 -- 172.21.15.63:0/2221391081 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2a41a6d30 con 0x7fd2a4108d70 2024-09-21T06:34:32.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.791+0000 7fd2b07c1740 1 Processor -- start 2024-09-21T06:34:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.791+0000 7fd2a0ff9640 1 -- 172.21.15.63:0/2221391081 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fd29c02fd60 con 0x7fd2a4108d70 2024-09-21T06:34:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.791+0000 7fd2b07c1740 1 -- start start 2024-09-21T06:34:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2b07c1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b52c73070 0x560b5301a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2b07c1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c4a1b0 0x560b5301a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2b07c1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c52390 0x560b5301ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2b07c1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x560b52f90ea0 con 0x560b52c4a1b0 2024-09-21T06:34:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2b07c1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560b52f802d0 con 0x560b52c52390 2024-09-21T06:34:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2b07c1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560b52f840e0 con 0x560b52c73070 2024-09-21T06:34:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2a37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c4a1b0 0x560b5301a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2a37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c4a1b0 0x560b5301a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42874/0 (socket says 172.21.15.63:42874) 2024-09-21T06:34:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2a37fe640 1 -- 172.21.15.63:0/743731467 learned_addr learned my addr 172.21.15.63:0/743731467 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2a2ffd640 1 --2- 172.21.15.63:0/743731467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c52390 0x560b5301ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2a2ffd640 1 --2- 172.21.15.63:0/743731467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b52c73070 0x560b5301a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2a37fe640 1 -- 172.21.15.63:0/743731467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b52c73070 msgr2=0x560b5301a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2a37fe640 1 --2- 172.21.15.63:0/743731467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b52c73070 0x560b5301a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2a37fe640 1 -- 172.21.15.63:0/743731467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c52390 msgr2=0x560b5301ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2a37fe640 1 --2- 172.21.15.63:0/743731467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c52390 0x560b5301ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2a37fe640 1 -- 172.21.15.63:0/743731467 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b52cde650 con 0x560b52c4a1b0 2024-09-21T06:34:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2a2ffd640 1 --2- 172.21.15.63:0/743731467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b52c73070 0x560b5301a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:34:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2a0ff9640 1 --2- 172.21.15.63:0/2221391081 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd28c0b6680 0x7fd28c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2a2ffd640 1 --2- 172.21.15.63:0/2221391081 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd28c0b6680 0x7fd28c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2a37fe640 1 --2- 172.21.15.63:0/743731467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c4a1b0 0x560b5301a800 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd29400bce0 tx=0x7fd2940107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11b44da8620691b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.792+0000 7fd2a0ff9640 1 -- 172.21.15.63:0/2221391081 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fd29c108c90 con 0x7fd2a4108d70 2024-09-21T06:34:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.793+0000 7fd289ffb640 1 -- 172.21.15.63:0/743731467 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29401c480 con 0x560b52c4a1b0 2024-09-21T06:34:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.793+0000 7fd289ffb640 1 -- 172.21.15.63:0/743731467 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd29401cad0 con 0x560b52c4a1b0 2024-09-21T06:34:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.793+0000 7fd289ffb640 1 -- 172.21.15.63:0/743731467 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd294011c40 con 0x560b52c4a1b0 2024-09-21T06:34:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.794+0000 7fd2b07c1740 1 -- 172.21.15.63:0/743731467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c4a1b0 msgr2=0x560b5301a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.794+0000 7fd2a2ffd640 1 --2- 172.21.15.63:0/2221391081 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd28c0b6680 0x7fd28c0b8b90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4106070 tx=0x7fd2980046c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.794+0000 7fd2b07c1740 1 --2- 172.21.15.63:0/743731467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c4a1b0 0x560b5301a800 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd29400bce0 tx=0x7fd2940107a0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.794+0000 7fd2b07c1740 1 -- 172.21.15.63:0/743731467 shutdown_connections 2024-09-21T06:34:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.794+0000 7fd2b07c1740 1 --2- 172.21.15.63:0/743731467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c52390 0x560b5301ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.794+0000 7fd2b07c1740 1 --2- 172.21.15.63:0/743731467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c4a1b0 0x560b5301a800 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.794+0000 7fd2b07c1740 1 --2- 172.21.15.63:0/743731467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b52c73070 0x560b5301a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.794+0000 7fd2b07c1740 1 -- 172.21.15.63:0/743731467 >> 172.21.15.63:0/743731467 conn(0x560b52c67460 msgr2=0x560b530181b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.794+0000 7fd2b07c1740 1 -- 172.21.15.63:0/743731467 shutdown_connections 2024-09-21T06:34:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.794+0000 7fd2b07c1740 1 -- 172.21.15.63:0/743731467 wait complete. 2024-09-21T06:34:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.794+0000 7fd2b07c1740 1 -- start start 2024-09-21T06:34:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.794+0000 7fd2b07c1740 1 Processor -- start 2024-09-21T06:34:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.795+0000 7fd2b07c1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b52c4a1b0 0x560b53029dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.795+0000 7fd2b07c1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c52390 0x560b5302a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:32.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.795+0000 7fd2b07c1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c73070 0x560b53036100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:32.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.795+0000 7fd2b07c1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x560b52de1700 con 0x560b52c52390 2024-09-21T06:34:32.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.795+0000 7fd2b07c1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560b52f1b160 con 0x560b52c73070 2024-09-21T06:34:32.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.795+0000 7fd2b07c1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560b5302cdd0 con 0x560b52c4a1b0 2024-09-21T06:34:32.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.795+0000 7fd2b07c1740 10 client.0 _ll_register_callbacks cb 0x560b52f349e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:34:32.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.795+0000 7fd2a2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c52390 0x560b5302a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:32.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.795+0000 7fd2a2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c52390 0x560b5302a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42884/0 (socket says 172.21.15.63:42884) 2024-09-21T06:34:32.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.795+0000 7fd2a2ffd640 1 -- 172.21.15.63:0/2133555933 learned_addr learned my addr 172.21.15.63:0/2133555933 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:32.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.795+0000 7fd2a37fe640 1 --2- 172.21.15.63:0/2133555933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b52c4a1b0 0x560b53029dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:32.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.795+0000 7fd2a3fff640 1 --2- 172.21.15.63:0/2133555933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c73070 0x560b53036100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:32.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.795+0000 7fd2a2ffd640 1 -- 172.21.15.63:0/2133555933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b52c4a1b0 msgr2=0x560b53029dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:32.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.795+0000 7fd2a2ffd640 1 --2- 172.21.15.63:0/2133555933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b52c4a1b0 0x560b53029dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.795+0000 7fd2a2ffd640 1 -- 172.21.15.63:0/2133555933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c73070 msgr2=0x560b53036100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:32.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.795+0000 7fd2a2ffd640 1 --2- 172.21.15.63:0/2133555933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c73070 0x560b53036100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.795+0000 7fd2a2ffd640 1 -- 172.21.15.63:0/2133555933 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b52f48c90 con 0x560b52c52390 2024-09-21T06:34:32.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.795+0000 7fd2a2ffd640 1 --2- 172.21.15.63:0/2133555933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c52390 0x560b5302a300 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd2980042f0 tx=0x7fd298004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31cf2817676653af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:32.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.795+0000 7fd282ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:34:32.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.796+0000 7fd282ffd640 1 -- 172.21.15.63:0/2133555933 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29801f620 con 0x560b52c52390 2024-09-21T06:34:32.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.796+0000 7fd2b07c1740 1 -- 172.21.15.63:0/2133555933 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd29401cad0 con 0x560b52c52390 2024-09-21T06:34:32.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.796+0000 7fd282ffd640 1 -- 172.21.15.63:0/2133555933 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fd29801f7c0 con 0x560b52c52390 2024-09-21T06:34:32.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.796+0000 7fd282ffd640 1 -- 172.21.15.63:0/2133555933 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fd29801f9c0 con 0x560b52c52390 2024-09-21T06:34:32.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.796+0000 7fd2b07c1740 10 client.16833 fetch_fsmap learned FSMap version 53 2024-09-21T06:34:32.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.796+0000 7fd2b07c1740 1 -- 172.21.15.63:0/2133555933 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x560b53038b20 con 0x560b52c52390 2024-09-21T06:34:32.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.796+0000 7fd282ffd640 1 -- 172.21.15.63:0/2133555933 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd29401cad0 con 0x560b52c52390 2024-09-21T06:34:32.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.796+0000 7fd282ffd640 1 -- 172.21.15.63:0/2133555933 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7fd298027c90 con 0x560b52c52390 2024-09-21T06:34:32.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.796+0000 7fd2b07c1740 10 client.16833 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:34:32.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.796+0000 7fd2b07c1740 10 client.16833 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:34:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.796+0000 7fd2b07c1740 20 client.16833 populate_metadata read hostname 'smithi063' 2024-09-21T06:34:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.796+0000 7fd2b07c1740 1 --2- 172.21.15.63:0/2133555933 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x560b52c319f0 0x560b5303c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.796+0000 7fd2b07c1740 4 client.16833 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:34:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.796+0000 7fd2b07c1740 1 -- 172.21.15.63:0/2133555933 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b52f92df0 con 0x560b52c319f0 2024-09-21T06:34:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.797+0000 7fd2a37fe640 1 --2- 172.21.15.63:0/2133555933 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x560b52c319f0 0x560b5303c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.797+0000 7fd282ffd640 10 client.16833 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:34:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.797+0000 7fd2a37fe640 1 --2- 172.21.15.63:0/2133555933 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x560b52c319f0 0x560b5303c070 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ec70de831a811f88 server_cookie=8542568df77a0348 in_seq=0 out_seq=0 2024-09-21T06:34:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.798+0000 7fd282ffd640 1 -- 172.21.15.63:0/2133555933 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b52f92df0 con 0x560b52c319f0 2024-09-21T06:34:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.798+0000 7fd282ffd640 10 client.16833 handle_command_reply: tid=0 2024-09-21T06:34:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.798+0000 7fd2b07c1740 1 client.16833 shutdown 2024-09-21T06:34:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.798+0000 7fd2b07c1740 1 -- 172.21.15.63:0/2133555933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c52390 msgr2=0x560b5302a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.798+0000 7fd2b07c1740 1 --2- 172.21.15.63:0/2133555933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c52390 0x560b5302a300 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd2980042f0 tx=0x7fd298004730 comp rx=0 tx=0).stop 2024-09-21T06:34:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.798+0000 7fd2b07c1740 1 -- 172.21.15.63:0/2133555933 shutdown_connections 2024-09-21T06:34:32.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.798+0000 7fd2b07c1740 1 --2- 172.21.15.63:0/2133555933 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x560b52c319f0 0x560b5303c070 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.798+0000 7fd2b07c1740 1 --2- 172.21.15.63:0/2133555933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c73070 0x560b53036100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.798+0000 7fd2b07c1740 1 --2- 172.21.15.63:0/2133555933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c52390 0x560b5302a300 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.798+0000 7fd2b07c1740 1 --2- 172.21.15.63:0/2133555933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b52c4a1b0 0x560b53029dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.798+0000 7fd282ffd640 0 client.16833 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:34:32.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.798+0000 7fd2b07c1740 1 -- 172.21.15.63:0/2133555933 >> 172.21.15.63:0/2133555933 conn(0x560b52c67460 msgr2=0x560b5301d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:32.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.798+0000 7fd2b07c1740 1 -- 172.21.15.63:0/2133555933 shutdown_connections 2024-09-21T06:34:32.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.798+0000 7fd2b07c1740 1 -- 172.21.15.63:0/2133555933 wait complete. 2024-09-21T06:34:32.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.798+0000 7fd2b07c1740 20 client.16833 trim_cache size 0 max 16384 2024-09-21T06:34:32.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.812+0000 7fd2b07c1740 1 Processor -- start 2024-09-21T06:34:32.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.812+0000 7fd2b07c1740 1 -- start start 2024-09-21T06:34:32.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.812+0000 7fd2b07c1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c4a1b0 0x560b5302bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:32.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.812+0000 7fd2b07c1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b52c52390 0x560b5301db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:32.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.812+0000 7fd2b07c1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c73070 0x560b53036000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.812+0000 7fd2b07c1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a41ad4e0 con 0x560b52c4a1b0 2024-09-21T06:34:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.812+0000 7fd2b07c1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a41af0e0 con 0x560b52c73070 2024-09-21T06:34:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.812+0000 7fd2b07c1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a41adbb0 con 0x560b52c52390 2024-09-21T06:34:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.812+0000 7fd2a37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c4a1b0 0x560b5302bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.812+0000 7fd2a37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c4a1b0 0x560b5302bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42898/0 (socket says 172.21.15.63:42898) 2024-09-21T06:34:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.812+0000 7fd2a37fe640 1 -- 172.21.15.63:0/2345373808 learned_addr learned my addr 172.21.15.63:0/2345373808 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.812+0000 7fd2a3fff640 1 --2- 172.21.15.63:0/2345373808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c73070 0x560b53036000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.812+0000 7fd2a37fe640 1 -- 172.21.15.63:0/2345373808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b52c52390 msgr2=0x560b5301db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.812+0000 7fd2a37fe640 1 --2- 172.21.15.63:0/2345373808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b52c52390 0x560b5301db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.812+0000 7fd2a37fe640 1 -- 172.21.15.63:0/2345373808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c73070 msgr2=0x560b53036000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.812+0000 7fd2a37fe640 1 --2- 172.21.15.63:0/2345373808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c73070 0x560b53036000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.812+0000 7fd2a37fe640 1 -- 172.21.15.63:0/2345373808 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b530282c0 con 0x560b52c4a1b0 2024-09-21T06:34:32.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.812+0000 7fd2a37fe640 1 --2- 172.21.15.63:0/2345373808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c4a1b0 0x560b5302bca0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd294010ca0 tx=0x7fd29400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea671bb28514acc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.813+0000 7fd2897fa640 1 -- 172.21.15.63:0/2345373808 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd294023040 con 0x560b52c4a1b0 2024-09-21T06:34:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.813+0000 7fd2897fa640 1 -- 172.21.15.63:0/2345373808 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd294011640 con 0x560b52c4a1b0 2024-09-21T06:34:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.813+0000 7fd2897fa640 1 -- 172.21.15.63:0/2345373808 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29401c480 con 0x560b52c4a1b0 2024-09-21T06:34:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.813+0000 7fd2b07c1740 1 -- 172.21.15.63:0/2345373808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c4a1b0 msgr2=0x560b5302bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.813+0000 7fd2b07c1740 1 --2- 172.21.15.63:0/2345373808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c4a1b0 0x560b5302bca0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd294010ca0 tx=0x7fd29400bf60 comp rx=0 tx=0).stop 2024-09-21T06:34:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.813+0000 7fd2b07c1740 1 -- 172.21.15.63:0/2345373808 shutdown_connections 2024-09-21T06:34:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.813+0000 7fd2b07c1740 1 --2- 172.21.15.63:0/2345373808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c73070 0x560b53036000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.813+0000 7fd2b07c1740 1 --2- 172.21.15.63:0/2345373808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b52c52390 0x560b5301db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.813+0000 7fd2b07c1740 1 --2- 172.21.15.63:0/2345373808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c4a1b0 0x560b5302bca0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.813+0000 7fd2b07c1740 1 -- 172.21.15.63:0/2345373808 >> 172.21.15.63:0/2345373808 conn(0x560b52c67460 msgr2=0x560b5301d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.813+0000 7fd2b07c1740 1 -- 172.21.15.63:0/2345373808 shutdown_connections 2024-09-21T06:34:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.814+0000 7fd2b07c1740 1 -- 172.21.15.63:0/2345373808 wait complete. 2024-09-21T06:34:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.814+0000 7fd2b07c1740 1 -- start start 2024-09-21T06:34:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.814+0000 7fd2b07c1740 1 Processor -- start 2024-09-21T06:34:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.814+0000 7fd2b07c1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b52c4a1b0 0x560b5302e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.814+0000 7fd2b07c1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c52390 0x560b5302ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.814+0000 7fd2b07c1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c73070 0x560b530a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.814+0000 7fd2b07c1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a41aea10 con 0x560b52c73070 2024-09-21T06:34:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.814+0000 7fd2b07c1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a41ae310 con 0x560b52c52390 2024-09-21T06:34:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.814+0000 7fd2b07c1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a41ab4c0 con 0x560b52c4a1b0 2024-09-21T06:34:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.815+0000 7fd2b07c1740 10 client.0 _ll_register_callbacks cb 0x7fd29800ba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:34:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.815+0000 7fd2a3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c73070 0x560b530a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.815+0000 7fd2a2ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c52390 0x560b5302ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.815+0000 7fd2a3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c73070 0x560b530a5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42912/0 (socket says 172.21.15.63:42912) 2024-09-21T06:34:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.815+0000 7fd2a3fff640 1 -- 172.21.15.63:0/656225439 learned_addr learned my addr 172.21.15.63:0/656225439 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.815+0000 7fd2a37fe640 1 --2- 172.21.15.63:0/656225439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b52c4a1b0 0x560b5302e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:32.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.815+0000 7fd2a3fff640 1 -- 172.21.15.63:0/656225439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b52c4a1b0 msgr2=0x560b5302e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.815+0000 7fd2a3fff640 1 --2- 172.21.15.63:0/656225439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b52c4a1b0 0x560b5302e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.815+0000 7fd2a3fff640 1 -- 172.21.15.63:0/656225439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c52390 msgr2=0x560b5302ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.815+0000 7fd2a3fff640 1 --2- 172.21.15.63:0/656225439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c52390 0x560b5302ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.815+0000 7fd2a3fff640 1 -- 172.21.15.63:0/656225439 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b530a5f70 con 0x560b52c73070 2024-09-21T06:34:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.815+0000 7fd2a2ffd640 1 --2- 172.21.15.63:0/656225439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c52390 0x560b5302ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:34:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.815+0000 7fd2a3fff640 1 --2- 172.21.15.63:0/656225439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c73070 0x560b530a5a30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd29c006010 tx=0x7fd29c0ce950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1739e69b57be94ed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.815+0000 7fd282ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:34:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.815+0000 7fd282ffd640 1 -- 172.21.15.63:0/656225439 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0ca230 con 0x560b52c73070 2024-09-21T06:34:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.815+0000 7fd282ffd640 1 -- 172.21.15.63:0/656225439 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7fd29c0cad30 con 0x560b52c73070 2024-09-21T06:34:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.815+0000 7fd2b07c1740 1 -- 172.21.15.63:0/656225439 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd294011640 con 0x560b52c73070 2024-09-21T06:34:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.815+0000 7fd282ffd640 1 -- 172.21.15.63:0/656225439 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fd29c0ce5d0 con 0x560b52c73070 2024-09-21T06:34:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.815+0000 7fd2b07c1740 10 client.16839 fetch_fsmap learned FSMap version 53 2024-09-21T06:34:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.815+0000 7fd2b07c1740 1 -- 172.21.15.63:0/656225439 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x560b530a71b0 con 0x560b52c73070 2024-09-21T06:34:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.816+0000 7fd282ffd640 1 -- 172.21.15.63:0/656225439 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd294011640 con 0x560b52c73070 2024-09-21T06:34:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.816+0000 7fd282ffd640 1 -- 172.21.15.63:0/656225439 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7fd29c004610 con 0x560b52c73070 2024-09-21T06:34:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.816+0000 7fd2b07c1740 10 client.16839 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:34:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.816+0000 7fd2b07c1740 10 client.16839 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:34:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.816+0000 7fd2b07c1740 20 client.16839 populate_metadata read hostname 'smithi063' 2024-09-21T06:34:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.816+0000 7fd2b07c1740 1 --2- 172.21.15.63:0/656225439 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x560b52c06da0 0x560b530a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.816+0000 7fd2b07c1740 4 client.16839 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:34:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.816+0000 7fd2b07c1740 1 -- 172.21.15.63:0/656225439 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560b52f8e8a0 con 0x560b52c06da0 2024-09-21T06:34:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.816+0000 7fd2a37fe640 1 --2- 172.21.15.63:0/656225439 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x560b52c06da0 0x560b530a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.817+0000 7fd282ffd640 10 client.16839 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:34:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.817+0000 7fd2a37fe640 1 --2- 172.21.15.63:0/656225439 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x560b52c06da0 0x560b530a99a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2b8f90da0ea01cff server_cookie=1e189d0d4b7baeed in_seq=0 out_seq=0 2024-09-21T06:34:32.851 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:34:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.817+0000 7fd282ffd640 1 -- 172.21.15.63:0/656225439 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560b52f8e8a0 con 0x560b52c06da0 2024-09-21T06:34:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.817+0000 7fd282ffd640 10 client.16839 handle_command_reply: tid=0 2024-09-21T06:34:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.817+0000 7fd2b07c1740 1 client.16839 shutdown 2024-09-21T06:34:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.817+0000 7fd2b07c1740 1 -- 172.21.15.63:0/656225439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c73070 msgr2=0x560b530a5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.817+0000 7fd2b07c1740 1 --2- 172.21.15.63:0/656225439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c73070 0x560b530a5a30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd29c006010 tx=0x7fd29c0ce950 comp rx=0 tx=0).stop 2024-09-21T06:34:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.817+0000 7fd2b07c1740 1 -- 172.21.15.63:0/656225439 shutdown_connections 2024-09-21T06:34:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.817+0000 7fd2b07c1740 1 --2- 172.21.15.63:0/656225439 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x560b52c06da0 0x560b530a99a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.817+0000 7fd2b07c1740 1 --2- 172.21.15.63:0/656225439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560b52c73070 0x560b530a5a30 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.817+0000 7fd2b07c1740 1 --2- 172.21.15.63:0/656225439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560b52c52390 0x560b5302ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.817+0000 7fd2b07c1740 1 --2- 172.21.15.63:0/656225439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b52c4a1b0 0x560b5302e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.817+0000 7fd282ffd640 0 client.16839 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:34:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.817+0000 7fd2b07c1740 1 -- 172.21.15.63:0/656225439 >> 172.21.15.63:0/656225439 conn(0x560b52c67460 msgr2=0x560b5301dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.817+0000 7fd2b07c1740 1 -- 172.21.15.63:0/656225439 shutdown_connections 2024-09-21T06:34:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.817+0000 7fd2b07c1740 1 -- 172.21.15.63:0/656225439 wait complete. 2024-09-21T06:34:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.817+0000 7fd2b07c1740 20 client.16839 trim_cache size 0 max 16384 2024-09-21T06:34:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.818+0000 7fd2aa24d640 1 -- 172.21.15.63:0/2221391081 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd28c0b6680 msgr2=0x7fd28c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.818+0000 7fd2aa24d640 1 --2- 172.21.15.63:0/2221391081 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd28c0b6680 0x7fd28c0b8b90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4106070 tx=0x7fd2980046c0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.818+0000 7fd2aa24d640 1 -- 172.21.15.63:0/2221391081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a4108d70 msgr2=0x7fd2a419bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.818+0000 7fd2aa24d640 1 --2- 172.21.15.63:0/2221391081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a4108d70 0x7fd2a419bd20 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd29c005cc0 tx=0x7fd29c02f380 comp rx=0 tx=0).stop 2024-09-21T06:34:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.818+0000 7fd2aa24d640 1 -- 172.21.15.63:0/2221391081 shutdown_connections 2024-09-21T06:34:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.818+0000 7fd2aa24d640 1 --2- 172.21.15.63:0/2221391081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2a4108d70 0x7fd2a419bd20 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.818+0000 7fd2aa24d640 1 --2- 172.21.15.63:0/2221391081 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd28c0b6680 0x7fd28c0b8b90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.818+0000 7fd2aa24d640 1 --2- 172.21.15.63:0/2221391081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2a4108420 0x7fd2a419b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.818+0000 7fd2aa24d640 1 --2- 172.21.15.63:0/2221391081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2a4102ae0 0x7fd2a419b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:32.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.818+0000 7fd2aa24d640 1 -- 172.21.15.63:0/2221391081 >> 172.21.15.63:0/2221391081 conn(0x7fd2a4079770 msgr2=0x7fd2a41043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:32.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.818+0000 7fd2aa24d640 1 -- 172.21.15.63:0/2221391081 shutdown_connections 2024-09-21T06:34:32.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:32.818+0000 7fd2aa24d640 1 -- 172.21.15.63:0/2221391081 wait complete. 2024-09-21T06:34:33.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:33 smithi071 ceph-mon[34844]: pgmap v513: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:34:33.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:33.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:34:33.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:34:33.557 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:33 smithi063 ceph-mon[31150]: pgmap v513: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:34:33.557 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:33.558 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:34:33.558 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:34:33.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:33 smithi175 ceph-mon[34510]: pgmap v513: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:34:33.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:33.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:34:33.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:34:34.591 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:34:34.591 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:34:34.867 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:35.286 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:35 smithi063 ceph-mon[31150]: pgmap v514: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:34:35.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.381+0000 7efd75de4640 1 -- 172.21.15.63:0/3804423485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd70108d10 msgr2=0x7efd7010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:35.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.381+0000 7efd75de4640 1 --2- 172.21.15.63:0/3804423485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd70108d10 0x7efd7010f540 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7efd68009ca0 tx=0x7efd6802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.381+0000 7efd75de4640 1 -- 172.21.15.63:0/3804423485 shutdown_connections 2024-09-21T06:34:35.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.381+0000 7efd75de4640 1 --2- 172.21.15.63:0/3804423485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd70108d10 0x7efd7010f540 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.381+0000 7efd75de4640 1 --2- 172.21.15.63:0/3804423485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd701083c0 0x7efd701087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.381+0000 7efd75de4640 1 --2- 172.21.15.63:0/3804423485 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd70102a80 0x7efd70102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.381+0000 7efd75de4640 1 -- 172.21.15.63:0/3804423485 >> 172.21.15.63:0/3804423485 conn(0x7efd70079740 msgr2=0x7efd70079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:35.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.381+0000 7efd75de4640 1 -- 172.21.15.63:0/3804423485 shutdown_connections 2024-09-21T06:34:35.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.381+0000 7efd75de4640 1 -- 172.21.15.63:0/3804423485 wait complete. 2024-09-21T06:34:35.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.382+0000 7efd75de4640 1 Processor -- start 2024-09-21T06:34:35.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.382+0000 7efd75de4640 1 -- start start 2024-09-21T06:34:35.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.382+0000 7efd75de4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd70102a80 0x7efd70199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.382+0000 7efd75de4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd701083c0 0x7efd70199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.382+0000 7efd75de4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd70108d10 0x7efd7019ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.382+0000 7efd75de4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7efd70112980 con 0x7efd70108d10 2024-09-21T06:34:35.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.382+0000 7efd75de4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efd70112800 con 0x7efd70102a80 2024-09-21T06:34:35.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.382+0000 7efd75de4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efd70112b00 con 0x7efd701083c0 2024-09-21T06:34:35.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.382+0000 7efd6ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd70108d10 0x7efd7019ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.383+0000 7efd6ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd70108d10 0x7efd7019ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42932/0 (socket says 172.21.15.63:42932) 2024-09-21T06:34:35.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.383+0000 7efd6f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd70102a80 0x7efd70199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.383+0000 7efd6ffff640 1 -- 172.21.15.63:0/2372826814 learned_addr learned my addr 172.21.15.63:0/2372826814 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:35.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.383+0000 7efd6effd640 1 --2- 172.21.15.63:0/2372826814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd701083c0 0x7efd70199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.383+0000 7efd6ffff640 1 -- 172.21.15.63:0/2372826814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd701083c0 msgr2=0x7efd70199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:35.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.383+0000 7efd6ffff640 1 --2- 172.21.15.63:0/2372826814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd701083c0 0x7efd70199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.383+0000 7efd6ffff640 1 -- 172.21.15.63:0/2372826814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd70102a80 msgr2=0x7efd70199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:35.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.383+0000 7efd6ffff640 1 --2- 172.21.15.63:0/2372826814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd70102a80 0x7efd70199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.383+0000 7efd6ffff640 1 -- 172.21.15.63:0/2372826814 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7019f2e0 con 0x7efd70108d10 2024-09-21T06:34:35.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.383+0000 7efd6f7fe640 1 --2- 172.21.15.63:0/2372826814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd70102a80 0x7efd70199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:34:35.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.383+0000 7efd6ffff640 1 --2- 172.21.15.63:0/2372826814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd70108d10 0x7efd7019ebb0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7efd68005cc0 tx=0x7efd6802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:35.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.383+0000 7efd6cff9640 1 -- 172.21.15.63:0/2372826814 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68003bf0 con 0x7efd70108d10 2024-09-21T06:34:35.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.383+0000 7efd75de4640 1 -- 172.21.15.63:0/2372826814 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd7019f570 con 0x7efd70108d10 2024-09-21T06:34:35.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.383+0000 7efd6cff9640 1 -- 172.21.15.63:0/2372826814 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd68003d90 con 0x7efd70108d10 2024-09-21T06:34:35.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.383+0000 7efd6cff9640 1 -- 172.21.15.63:0/2372826814 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6802fbc0 con 0x7efd70108d10 2024-09-21T06:34:35.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.383+0000 7efd75de4640 1 -- 172.21.15.63:0/2372826814 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd701a5d30 con 0x7efd70108d10 2024-09-21T06:34:35.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.386+0000 7efd7c358740 1 Processor -- start 2024-09-21T06:34:35.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.386+0000 7efd6cff9640 1 -- 172.21.15.63:0/2372826814 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7efd6802fd60 con 0x7efd70108d10 2024-09-21T06:34:35.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.386+0000 7efd7c358740 1 -- start start 2024-09-21T06:34:35.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.386+0000 7efd7c358740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56336904a350 0x5633693f1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.386+0000 7efd7c358740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369021490 0x5633693f1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.386+0000 7efd7c358740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563369029670 0x5633693f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.386+0000 7efd7c358740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563369367e60 con 0x56336904a350 2024-09-21T06:34:35.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.386+0000 7efd7c358740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563369357290 con 0x563369029670 2024-09-21T06:34:35.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.386+0000 7efd7c358740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56336935b0a0 con 0x563369021490 2024-09-21T06:34:35.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.386+0000 7efd6effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56336904a350 0x5633693f1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.387+0000 7efd6effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56336904a350 0x5633693f1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42934/0 (socket says 172.21.15.63:42934) 2024-09-21T06:34:35.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.387+0000 7efd6effd640 1 -- 172.21.15.63:0/213241852 learned_addr learned my addr 172.21.15.63:0/213241852 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:35.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.387+0000 7efd6f7fe640 1 --2- 172.21.15.63:0/213241852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369021490 0x5633693f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.387+0000 7efd6effd640 1 --2- 172.21.15.63:0/213241852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563369029670 0x5633693f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.387+0000 7efd6effd640 1 -- 172.21.15.63:0/213241852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369021490 msgr2=0x5633693f1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:35.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.387+0000 7efd6effd640 1 --2- 172.21.15.63:0/213241852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369021490 0x5633693f1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.387+0000 7efd6effd640 1 -- 172.21.15.63:0/213241852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563369029670 msgr2=0x5633693f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:35.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.387+0000 7efd6effd640 1 --2- 172.21.15.63:0/213241852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563369029670 0x5633693f1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.387+0000 7efd6effd640 1 -- 172.21.15.63:0/213241852 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633690b5930 con 0x56336904a350 2024-09-21T06:34:35.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.387+0000 7efd6cff9640 1 --2- 172.21.15.63:0/2372826814 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efd580b6680 0x7efd580b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.387+0000 7efd6effd640 1 --2- 172.21.15.63:0/213241852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56336904a350 0x5633693f1430 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7efd640106e0 tx=0x7efd6400b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806037d6d86536ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:35.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.387+0000 7efd6f7fe640 1 --2- 172.21.15.63:0/2372826814 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efd580b6680 0x7efd580b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.387+0000 7efd55ffb640 1 -- 172.21.15.63:0/213241852 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd64004220 con 0x56336904a350 2024-09-21T06:34:35.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.387+0000 7efd6cff9640 1 -- 172.21.15.63:0/2372826814 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7efd68108c10 con 0x7efd70108d10 2024-09-21T06:34:35.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.387+0000 7efd55ffb640 1 -- 172.21.15.63:0/213241852 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd64014030 con 0x56336904a350 2024-09-21T06:34:35.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.387+0000 7efd55ffb640 1 -- 172.21.15.63:0/213241852 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd64004c70 con 0x56336904a350 2024-09-21T06:34:35.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.388+0000 7efd7c358740 1 -- 172.21.15.63:0/213241852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56336904a350 msgr2=0x5633693f1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:35.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.388+0000 7efd6f7fe640 1 --2- 172.21.15.63:0/2372826814 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efd580b6680 0x7efd580b8b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x5633693f00b0 tx=0x7efd6000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:35.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.388+0000 7efd7c358740 1 --2- 172.21.15.63:0/213241852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56336904a350 0x5633693f1430 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7efd640106e0 tx=0x7efd6400b650 comp rx=0 tx=0).stop 2024-09-21T06:34:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.388+0000 7efd7c358740 1 -- 172.21.15.63:0/213241852 shutdown_connections 2024-09-21T06:34:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.388+0000 7efd7c358740 1 --2- 172.21.15.63:0/213241852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563369029670 0x5633693f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.388+0000 7efd7c358740 1 --2- 172.21.15.63:0/213241852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369021490 0x5633693f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.388+0000 7efd7c358740 1 --2- 172.21.15.63:0/213241852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56336904a350 0x5633693f1430 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.388+0000 7efd7c358740 1 -- 172.21.15.63:0/213241852 >> 172.21.15.63:0/213241852 conn(0x56336903e740 msgr2=0x5633693ef320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.388+0000 7efd7c358740 1 -- 172.21.15.63:0/213241852 shutdown_connections 2024-09-21T06:34:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.389+0000 7efd7c358740 1 -- 172.21.15.63:0/213241852 wait complete. 2024-09-21T06:34:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.389+0000 7efd7c358740 1 -- start start 2024-09-21T06:34:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.389+0000 7efd7c358740 1 Processor -- start 2024-09-21T06:34:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd7c358740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563369021490 0x5633693fd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd7c358740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369029670 0x5633693fd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd7c358740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56336904a350 0x563369408f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd7c358740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5633691b8890 con 0x563369021490 2024-09-21T06:34:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd7c358740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5633692f1d40 con 0x56336904a350 2024-09-21T06:34:35.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd7c358740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5633693ffc10 con 0x563369029670 2024-09-21T06:34:35.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd7c358740 10 client.0 _ll_register_callbacks cb 0x563369355c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:34:35.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd6f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563369021490 0x5633693fd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd6f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563369021490 0x5633693fd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42940/0 (socket says 172.21.15.63:42940) 2024-09-21T06:34:35.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd6f7fe640 1 -- 172.21.15.63:0/3708400317 learned_addr learned my addr 172.21.15.63:0/3708400317 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:35.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd6effd640 1 --2- 172.21.15.63:0/3708400317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369029670 0x5633693fd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd6ffff640 1 --2- 172.21.15.63:0/3708400317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56336904a350 0x563369408f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd6f7fe640 1 -- 172.21.15.63:0/3708400317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369029670 msgr2=0x5633693fd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:35.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd6f7fe640 1 --2- 172.21.15.63:0/3708400317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369029670 0x5633693fd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd6f7fe640 1 -- 172.21.15.63:0/3708400317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56336904a350 msgr2=0x563369408f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:35.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd6f7fe640 1 --2- 172.21.15.63:0/3708400317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56336904a350 0x563369408f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd6f7fe640 1 -- 172.21.15.63:0/3708400317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633694094f0 con 0x563369021490 2024-09-21T06:34:35.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd6effd640 1 --2- 172.21.15.63:0/3708400317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369029670 0x5633693fd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:34:35.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd6ffff640 1 --2- 172.21.15.63:0/3708400317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56336904a350 0x563369408f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:34:35.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd6f7fe640 1 --2- 172.21.15.63:0/3708400317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563369021490 0x5633693fd010 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7efd600108b0 tx=0x7efd60004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474967212aff0242 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:35.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd4effd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:34:35.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.390+0000 7efd4effd640 1 -- 172.21.15.63:0/3708400317 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6001f9b0 con 0x563369021490 2024-09-21T06:34:35.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.391+0000 7efd4effd640 1 -- 172.21.15.63:0/3708400317 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7efd6001fb50 con 0x563369021490 2024-09-21T06:34:35.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.391+0000 7efd7c358740 1 -- 172.21.15.63:0/3708400317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd64014030 con 0x563369021490 2024-09-21T06:34:35.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.391+0000 7efd4effd640 1 -- 172.21.15.63:0/3708400317 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7efd6001fd50 con 0x563369021490 2024-09-21T06:34:35.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.391+0000 7efd7c358740 10 client.16851 fetch_fsmap learned FSMap version 53 2024-09-21T06:34:35.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.391+0000 7efd7c358740 1 -- 172.21.15.63:0/3708400317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x56336940be80 con 0x563369021490 2024-09-21T06:34:35.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.391+0000 7efd4effd640 1 -- 172.21.15.63:0/3708400317 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd64014030 con 0x563369021490 2024-09-21T06:34:35.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.391+0000 7efd4effd640 1 -- 172.21.15.63:0/3708400317 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7efd60026070 con 0x563369021490 2024-09-21T06:34:35.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.391+0000 7efd7c358740 10 client.16851 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:34:35.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.391+0000 7efd7c358740 10 client.16851 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:34:35.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.391+0000 7efd7c358740 20 client.16851 populate_metadata read hostname 'smithi063' 2024-09-21T06:34:35.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.391+0000 7efd7c358740 1 --2- 172.21.15.63:0/3708400317 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563369008cd0 0x56336940f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.391+0000 7efd7c358740 4 client.16851 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:34:35.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.391+0000 7efd7c358740 1 -- 172.21.15.63:0/3708400317 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563369369db0 con 0x563369008cd0 2024-09-21T06:34:35.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.392+0000 7efd6effd640 1 --2- 172.21.15.63:0/3708400317 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563369008cd0 0x56336940f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.392+0000 7efd6effd640 1 --2- 172.21.15.63:0/3708400317 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563369008cd0 0x56336940f3d0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ec3098c9245c48 server_cookie=1bebf3194f9ab02a in_seq=0 out_seq=0 2024-09-21T06:34:35.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.392+0000 7efd4effd640 10 client.16851 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:34:35.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.393+0000 7efd4effd640 1 -- 172.21.15.63:0/3708400317 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563369369db0 con 0x563369008cd0 2024-09-21T06:34:35.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.393+0000 7efd4effd640 10 client.16851 handle_command_reply: tid=0 2024-09-21T06:34:35.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.393+0000 7efd7c358740 1 client.16851 shutdown 2024-09-21T06:34:35.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.394+0000 7efd7c358740 1 -- 172.21.15.63:0/3708400317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563369021490 msgr2=0x5633693fd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:35.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.394+0000 7efd7c358740 1 --2- 172.21.15.63:0/3708400317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563369021490 0x5633693fd010 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7efd600108b0 tx=0x7efd60004730 comp rx=0 tx=0).stop 2024-09-21T06:34:35.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.394+0000 7efd7c358740 1 -- 172.21.15.63:0/3708400317 shutdown_connections 2024-09-21T06:34:35.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.394+0000 7efd7c358740 1 --2- 172.21.15.63:0/3708400317 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563369008cd0 0x56336940f3d0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.394+0000 7efd7c358740 1 --2- 172.21.15.63:0/3708400317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56336904a350 0x563369408f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.394+0000 7efd7c358740 1 --2- 172.21.15.63:0/3708400317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369029670 0x5633693fd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.394+0000 7efd7c358740 1 --2- 172.21.15.63:0/3708400317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563369021490 0x5633693fd010 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.394+0000 7efd7c358740 1 -- 172.21.15.63:0/3708400317 >> 172.21.15.63:0/3708400317 conn(0x56336903e740 msgr2=0x5633693f4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:35.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.394+0000 7efd4effd640 0 client.16851 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:34:35.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.394+0000 7efd7c358740 1 -- 172.21.15.63:0/3708400317 shutdown_connections 2024-09-21T06:34:35.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.394+0000 7efd7c358740 1 -- 172.21.15.63:0/3708400317 wait complete. 2024-09-21T06:34:35.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.394+0000 7efd7c358740 20 client.16851 trim_cache size 0 max 16384 2024-09-21T06:34:35.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.412+0000 7efd7c358740 1 Processor -- start 2024-09-21T06:34:35.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.412+0000 7efd7c358740 1 -- start start 2024-09-21T06:34:35.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.412+0000 7efd7c358740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369021490 0x5633693f7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.412+0000 7efd7c358740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563369029670 0x5633693f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.412+0000 7efd7c358740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56336904a350 0x5633693fa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.412+0000 7efd7c358740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7efd701ad460 con 0x56336904a350 2024-09-21T06:34:35.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.412+0000 7efd7c358740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efd701af060 con 0x563369029670 2024-09-21T06:34:35.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.412+0000 7efd7c358740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efd701adb30 con 0x563369021490 2024-09-21T06:34:35.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.412+0000 7efd6ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56336904a350 0x5633693fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.412+0000 7efd6ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56336904a350 0x5633693fa000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42942/0 (socket says 172.21.15.63:42942) 2024-09-21T06:34:35.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.412+0000 7efd6ffff640 1 -- 172.21.15.63:0/189262865 learned_addr learned my addr 172.21.15.63:0/189262865 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:35.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.412+0000 7efd6effd640 1 --2- 172.21.15.63:0/189262865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563369029670 0x5633693f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.412+0000 7efd6f7fe640 1 --2- 172.21.15.63:0/189262865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369021490 0x5633693f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.412+0000 7efd6ffff640 1 -- 172.21.15.63:0/189262865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369021490 msgr2=0x5633693f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:35.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.412+0000 7efd6ffff640 1 --2- 172.21.15.63:0/189262865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369021490 0x5633693f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.412+0000 7efd6ffff640 1 -- 172.21.15.63:0/189262865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563369029670 msgr2=0x5633693f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:35.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.412+0000 7efd6ffff640 1 --2- 172.21.15.63:0/189262865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563369029670 0x5633693f2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.412+0000 7efd6ffff640 1 -- 172.21.15.63:0/189262865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633693fbd70 con 0x56336904a350 2024-09-21T06:34:35.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.412+0000 7efd6effd640 1 --2- 172.21.15.63:0/189262865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563369029670 0x5633693f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:35.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.413+0000 7efd6ffff640 1 --2- 172.21.15.63:0/189262865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56336904a350 0x5633693fa000 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7efd680cb010 tx=0x7efd680ce450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db55f7a464956fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:35.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.413+0000 7efd557fa640 1 -- 172.21.15.63:0/189262865 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd680f20e0 con 0x56336904a350 2024-09-21T06:34:35.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.413+0000 7efd557fa640 1 -- 172.21.15.63:0/189262865 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd68036030 con 0x56336904a350 2024-09-21T06:34:35.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.413+0000 7efd557fa640 1 -- 172.21.15.63:0/189262865 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd680d8460 con 0x56336904a350 2024-09-21T06:34:35.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.414+0000 7efd7c358740 1 -- 172.21.15.63:0/189262865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56336904a350 msgr2=0x5633693fa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:35.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.414+0000 7efd7c358740 1 --2- 172.21.15.63:0/189262865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56336904a350 0x5633693fa000 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7efd680cb010 tx=0x7efd680ce450 comp rx=0 tx=0).stop 2024-09-21T06:34:35.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.414+0000 7efd7c358740 1 -- 172.21.15.63:0/189262865 shutdown_connections 2024-09-21T06:34:35.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.414+0000 7efd7c358740 1 --2- 172.21.15.63:0/189262865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56336904a350 0x5633693fa000 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.414+0000 7efd7c358740 1 --2- 172.21.15.63:0/189262865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563369029670 0x5633693f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.414+0000 7efd7c358740 1 --2- 172.21.15.63:0/189262865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369021490 0x5633693f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.414+0000 7efd7c358740 1 -- 172.21.15.63:0/189262865 >> 172.21.15.63:0/189262865 conn(0x56336903e740 msgr2=0x5633693f2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:35.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.414+0000 7efd7c358740 1 -- 172.21.15.63:0/189262865 shutdown_connections 2024-09-21T06:34:35.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.414+0000 7efd7c358740 1 -- 172.21.15.63:0/189262865 wait complete. 2024-09-21T06:34:35.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.414+0000 7efd7c358740 1 -- start start 2024-09-21T06:34:35.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.414+0000 7efd7c358740 1 Processor -- start 2024-09-21T06:34:35.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.415+0000 7efd7c358740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563369021490 0x563369405600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.415+0000 7efd7c358740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369029670 0x563369401ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.415+0000 7efd7c358740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56336904a350 0x563369402000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.415+0000 7efd7c358740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7efd701ae990 con 0x56336904a350 2024-09-21T06:34:35.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.415+0000 7efd7c358740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efd701ae290 con 0x563369021490 2024-09-21T06:34:35.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.415+0000 7efd7c358740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efd701ab440 con 0x563369029670 2024-09-21T06:34:35.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.415+0000 7efd7c358740 10 client.0 _ll_register_callbacks cb 0x7efd6000be50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:34:35.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.415+0000 7efd6ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56336904a350 0x563369402000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.415+0000 7efd6ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56336904a350 0x563369402000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42946/0 (socket says 172.21.15.63:42946) 2024-09-21T06:34:35.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.415+0000 7efd6effd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369029670 0x563369401ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.415+0000 7efd6ffff640 1 -- 172.21.15.63:0/2861038261 learned_addr learned my addr 172.21.15.63:0/2861038261 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:35.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.415+0000 7efd6f7fe640 1 --2- 172.21.15.63:0/2861038261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563369021490 0x563369405600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.415+0000 7efd6effd640 1 -- 172.21.15.63:0/2861038261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563369021490 msgr2=0x563369405600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:35.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.415+0000 7efd6effd640 1 --2- 172.21.15.63:0/2861038261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563369021490 0x563369405600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.415+0000 7efd6effd640 1 -- 172.21.15.63:0/2861038261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56336904a350 msgr2=0x563369402000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:35.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.415+0000 7efd6effd640 1 --2- 172.21.15.63:0/2861038261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56336904a350 0x563369402000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.415+0000 7efd6effd640 1 -- 172.21.15.63:0/2861038261 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633694026f0 con 0x563369029670 2024-09-21T06:34:35.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.416+0000 7efd6effd640 1 --2- 172.21.15.63:0/2861038261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369029670 0x563369401ac0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efd64005d00 tx=0x7efd6400b4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a922fa4fca3919a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:35.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.416+0000 7efd4effd640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:34:35.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.416+0000 7efd4effd640 1 -- 172.21.15.63:0/2861038261 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6400d9c0 con 0x563369029670 2024-09-21T06:34:35.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.416+0000 7efd7c358740 1 -- 172.21.15.63:0/2861038261 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd68036030 con 0x563369029670 2024-09-21T06:34:35.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.416+0000 7efd4effd640 1 -- 172.21.15.63:0/2861038261 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7efd6400db60 con 0x563369029670 2024-09-21T06:34:35.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.416+0000 7efd4effd640 1 -- 172.21.15.63:0/2861038261 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7efd6403f050 con 0x563369029670 2024-09-21T06:34:35.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.416+0000 7efd7c358740 10 client.26512 fetch_fsmap learned FSMap version 53 2024-09-21T06:34:35.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.416+0000 7efd7c358740 1 -- 172.21.15.63:0/2861038261 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x56336947ad10 con 0x563369029670 2024-09-21T06:34:35.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.416+0000 7efd4effd640 1 -- 172.21.15.63:0/2861038261 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd68036030 con 0x563369029670 2024-09-21T06:34:35.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.417+0000 7efd4effd640 1 -- 172.21.15.63:0/2861038261 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7efd6401d070 con 0x563369029670 2024-09-21T06:34:35.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.417+0000 7efd7c358740 10 client.26512 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:34:35.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.417+0000 7efd7c358740 10 client.26512 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:34:35.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.417+0000 7efd7c358740 20 client.26512 populate_metadata read hostname 'smithi063' 2024-09-21T06:34:35.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.417+0000 7efd7c358740 1 --2- 172.21.15.63:0/2861038261 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563368fde080 0x56336947d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.417+0000 7efd7c358740 4 client.26512 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:34:35.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.417+0000 7efd7c358740 1 -- 172.21.15.63:0/2861038261 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563369365860 con 0x563368fde080 2024-09-21T06:34:35.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.417+0000 7efd6f7fe640 1 --2- 172.21.15.63:0/2861038261 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563368fde080 0x56336947d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.417+0000 7efd4effd640 10 client.26512 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:34:35.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.417+0000 7efd6f7fe640 1 --2- 172.21.15.63:0/2861038261 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563368fde080 0x56336947d190 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=819a412ce5f2ecd8 server_cookie=8f0590633080c3dd in_seq=0 out_seq=0 2024-09-21T06:34:35.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.419+0000 7efd4effd640 1 -- 172.21.15.63:0/2861038261 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563369365860 con 0x563368fde080 2024-09-21T06:34:35.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.419+0000 7efd4effd640 10 client.26512 handle_command_reply: tid=0 2024-09-21T06:34:35.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.419+0000 7efd7c358740 1 client.26512 shutdown 2024-09-21T06:34:35.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.419+0000 7efd7c358740 1 -- 172.21.15.63:0/2861038261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369029670 msgr2=0x563369401ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:35.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.419+0000 7efd7c358740 1 --2- 172.21.15.63:0/2861038261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369029670 0x563369401ac0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efd64005d00 tx=0x7efd6400b4a0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.419+0000 7efd7c358740 1 -- 172.21.15.63:0/2861038261 shutdown_connections 2024-09-21T06:34:35.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.419+0000 7efd7c358740 1 --2- 172.21.15.63:0/2861038261 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563368fde080 0x56336947d190 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.419+0000 7efd7c358740 1 --2- 172.21.15.63:0/2861038261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56336904a350 0x563369402000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.419+0000 7efd7c358740 1 --2- 172.21.15.63:0/2861038261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563369029670 0x563369401ac0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.419+0000 7efd4effd640 0 client.26512 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:34:35.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.419+0000 7efd7c358740 1 --2- 172.21.15.63:0/2861038261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563369021490 0x563369405600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.419+0000 7efd7c358740 1 -- 172.21.15.63:0/2861038261 >> 172.21.15.63:0/2861038261 conn(0x56336903e740 msgr2=0x5633693fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:35.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.420+0000 7efd7c358740 1 -- 172.21.15.63:0/2861038261 shutdown_connections 2024-09-21T06:34:35.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.420+0000 7efd7c358740 1 -- 172.21.15.63:0/2861038261 wait complete. 2024-09-21T06:34:35.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.420+0000 7efd7c358740 20 client.26512 trim_cache size 0 max 16384 2024-09-21T06:34:35.425 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:34:35.425 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0, 2024-09-21T06:34:35.425 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_tag": "4f099144-5170-453b-a745-ddc222860f34", 2024-09-21T06:34:35.425 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": "asynchronous" 2024-09-21T06:34:35.425 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:34:35.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.420+0000 7efd75de4640 1 -- 172.21.15.63:0/2372826814 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efd580b6680 msgr2=0x7efd580b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:35.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.420+0000 7efd75de4640 1 --2- 172.21.15.63:0/2372826814 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efd580b6680 0x7efd580b8b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x5633693f00b0 tx=0x7efd6000b390 comp rx=0 tx=0).stop 2024-09-21T06:34:35.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.420+0000 7efd75de4640 1 -- 172.21.15.63:0/2372826814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd70108d10 msgr2=0x7efd7019ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:35.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.420+0000 7efd75de4640 1 --2- 172.21.15.63:0/2372826814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd70108d10 0x7efd7019ebb0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7efd68005cc0 tx=0x7efd6802f380 comp rx=0 tx=0).stop 2024-09-21T06:34:35.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.421+0000 7efd75de4640 1 -- 172.21.15.63:0/2372826814 shutdown_connections 2024-09-21T06:34:35.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.421+0000 7efd75de4640 1 --2- 172.21.15.63:0/2372826814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd70108d10 0x7efd7019ebb0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.421+0000 7efd75de4640 1 --2- 172.21.15.63:0/2372826814 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7efd580b6680 0x7efd580b8b90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.421+0000 7efd75de4640 1 --2- 172.21.15.63:0/2372826814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd701083c0 0x7efd70199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.421+0000 7efd75de4640 1 --2- 172.21.15.63:0/2372826814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd70102a80 0x7efd70199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.421+0000 7efd75de4640 1 -- 172.21.15.63:0/2372826814 >> 172.21.15.63:0/2372826814 conn(0x7efd70079740 msgr2=0x7efd70104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:35.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.421+0000 7efd75de4640 1 -- 172.21.15.63:0/2372826814 shutdown_connections 2024-09-21T06:34:35.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:35.421+0000 7efd75de4640 1 -- 172.21.15.63:0/2372826814 wait complete. 2024-09-21T06:34:35.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:35 smithi071 ceph-mon[34844]: pgmap v514: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:34:35.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:35 smithi175 ceph-mon[34510]: pgmap v514: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:34:36.071 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:34:36.331 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:36.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:36 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:34:36.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:36 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:34:36.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:36 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:34:36.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:36 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:34:36.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:36 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:34:36.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:36 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:34:36.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.803+0000 7f4ea8a86640 1 -- 172.21.15.63:0/550653915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ea4103b60 msgr2=0x7f4ea4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:36.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.803+0000 7f4ea8a86640 1 --2- 172.21.15.63:0/550653915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ea4103b60 0x7f4ea4103f70 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009900 tx=0x7f4e9402a410 comp rx=0 tx=0).stop 2024-09-21T06:34:36.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.803+0000 7f4ea8a86640 1 -- 172.21.15.63:0/550653915 shutdown_connections 2024-09-21T06:34:36.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.803+0000 7f4ea8a86640 1 --2- 172.21.15.63:0/550653915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ea4109df0 0x7f4ea4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.803+0000 7f4ea8a86640 1 --2- 172.21.15.63:0/550653915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ea41094a0 0x7f4ea41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.803+0000 7f4ea8a86640 1 --2- 172.21.15.63:0/550653915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ea4103b60 0x7f4ea4103f70 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.803+0000 7f4ea8a86640 1 -- 172.21.15.63:0/550653915 >> 172.21.15.63:0/550653915 conn(0x7f4ea407b850 msgr2=0x7f4ea407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:36.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.803+0000 7f4ea8a86640 1 -- 172.21.15.63:0/550653915 shutdown_connections 2024-09-21T06:34:36.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.803+0000 7f4ea8a86640 1 -- 172.21.15.63:0/550653915 wait complete. 2024-09-21T06:34:36.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.804+0000 7f4ea8a86640 1 Processor -- start 2024-09-21T06:34:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.804+0000 7f4ea8a86640 1 -- start start 2024-09-21T06:34:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.804+0000 7f4ea8a86640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ea4103b60 0x7f4ea419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.804+0000 7f4ea8a86640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ea41094a0 0x7f4ea419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.804+0000 7f4ea8a86640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ea4109df0 0x7f4ea419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.804+0000 7f4ea8a86640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea4113ab0 con 0x7f4ea41094a0 2024-09-21T06:34:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.804+0000 7f4ea8a86640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea4113930 con 0x7f4ea4109df0 2024-09-21T06:34:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.804+0000 7f4ea8a86640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea4113c30 con 0x7f4ea4103b60 2024-09-21T06:34:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.804+0000 7f4ea1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ea41094a0 0x7f4ea419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.804+0000 7f4ea1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ea41094a0 0x7f4ea419aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33122/0 (socket says 172.21.15.63:33122) 2024-09-21T06:34:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.804+0000 7f4ea1d9b640 1 -- 172.21.15.63:0/2326808908 learned_addr learned my addr 172.21.15.63:0/2326808908 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.805+0000 7f4ea259c640 1 --2- 172.21.15.63:0/2326808908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ea4103b60 0x7f4ea419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.805+0000 7f4ea2d9d640 1 --2- 172.21.15.63:0/2326808908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ea4109df0 0x7f4ea419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.805+0000 7f4ea1d9b640 1 -- 172.21.15.63:0/2326808908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ea4103b60 msgr2=0x7f4ea419a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:36.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.805+0000 7f4ea1d9b640 1 --2- 172.21.15.63:0/2326808908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ea4103b60 0x7f4ea419a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.805+0000 7f4ea1d9b640 1 -- 172.21.15.63:0/2326808908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ea4109df0 msgr2=0x7f4ea419fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:36.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.805+0000 7f4ea1d9b640 1 --2- 172.21.15.63:0/2326808908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ea4109df0 0x7f4ea419fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.805+0000 7f4ea1d9b640 1 -- 172.21.15.63:0/2326808908 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea41a0490 con 0x7f4ea41094a0 2024-09-21T06:34:36.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.805+0000 7f4ea2d9d640 1 --2- 172.21.15.63:0/2326808908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ea4109df0 0x7f4ea419fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:36.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.805+0000 7f4ea259c640 1 --2- 172.21.15.63:0/2326808908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ea4103b60 0x7f4ea419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:36.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.805+0000 7f4ea1d9b640 1 --2- 172.21.15.63:0/2326808908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ea41094a0 0x7f4ea419aac0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800cce0 tx=0x7f4e9800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:36.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.805+0000 7f4e937fe640 1 -- 172.21.15.63:0/2326808908 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e98004b20 con 0x7f4ea41094a0 2024-09-21T06:34:36.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.805+0000 7f4ea8a86640 1 -- 172.21.15.63:0/2326808908 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea41a0780 con 0x7f4ea41094a0 2024-09-21T06:34:36.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.805+0000 7f4e937fe640 1 -- 172.21.15.63:0/2326808908 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e98004cc0 con 0x7f4ea41094a0 2024-09-21T06:34:36.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.805+0000 7f4e937fe640 1 -- 172.21.15.63:0/2326808908 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9800f6f0 con 0x7f4ea41094a0 2024-09-21T06:34:36.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.805+0000 7f4ea8a86640 1 -- 172.21.15.63:0/2326808908 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea41a6ee0 con 0x7f4ea41094a0 2024-09-21T06:34:36.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.808+0000 7f4eaeffa740 1 Processor -- start 2024-09-21T06:34:36.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.808+0000 7f4eaeffa740 1 -- start start 2024-09-21T06:34:36.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.808+0000 7f4e937fe640 1 -- 172.21.15.63:0/2326808908 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f4e9800f8d0 con 0x7f4ea41094a0 2024-09-21T06:34:36.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.808+0000 7f4eaeffa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2177070 0x5616a251e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:36.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.808+0000 7f4eaeffa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a214e1b0 0x5616a251e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:36.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.808+0000 7f4eaeffa740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a2156390 0x5616a251ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:36.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.808+0000 7f4eaeffa740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5616a2494e50 con 0x5616a2156390 2024-09-21T06:34:36.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.808+0000 7f4eaeffa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5616a2484280 con 0x5616a214e1b0 2024-09-21T06:34:36.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.808+0000 7f4eaeffa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5616a2488090 con 0x5616a2177070 2024-09-21T06:34:36.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.808+0000 7f4ea1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a2156390 0x5616a251ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:36.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.808+0000 7f4ea2d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2177070 0x5616a251e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:36.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.809+0000 7f4ea2d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2177070 0x5616a251e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:52380/0 (socket says 172.21.15.63:52380) 2024-09-21T06:34:36.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.809+0000 7f4ea2d9d640 1 -- 172.21.15.63:0/3629529263 learned_addr learned my addr 172.21.15.63:0/3629529263 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:36.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.809+0000 7f4ea259c640 1 --2- 172.21.15.63:0/3629529263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a214e1b0 0x5616a251e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:36.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.809+0000 7f4ea2d9d640 1 -- 172.21.15.63:0/3629529263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a214e1b0 msgr2=0x5616a251e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.809+0000 7f4ea2d9d640 1 --2- 172.21.15.63:0/3629529263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a214e1b0 0x5616a251e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.809+0000 7f4ea2d9d640 1 -- 172.21.15.63:0/3629529263 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a2156390 msgr2=0x5616a251ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.809+0000 7f4ea2d9d640 1 --2- 172.21.15.63:0/3629529263 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a2156390 0x5616a251ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.809+0000 7f4ea2d9d640 1 -- 172.21.15.63:0/3629529263 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a21e2650 con 0x5616a2177070 2024-09-21T06:34:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.809+0000 7f4ea2d9d640 1 --2- 172.21.15.63:0/3629529263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2177070 0x5616a251e270 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00cbc0 tx=0x7f4e9c00e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef41d9a65b6ce52f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.809+0000 7f4e937fe640 1 --2- 172.21.15.63:0/2326808908 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4e8c0b6680 0x7f4e8c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.809+0000 7f4e90ff9640 1 -- 172.21.15.63:0/3629529263 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c004220 con 0x5616a2177070 2024-09-21T06:34:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.810+0000 7f4e90ff9640 1 -- 172.21.15.63:0/3629529263 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e9c0043c0 con 0x5616a2177070 2024-09-21T06:34:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.810+0000 7f4e90ff9640 1 -- 172.21.15.63:0/3629529263 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c004d40 con 0x5616a2177070 2024-09-21T06:34:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.810+0000 7f4ea259c640 1 --2- 172.21.15.63:0/2326808908 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4e8c0b6680 0x7f4e8c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.810+0000 7f4e937fe640 1 -- 172.21.15.63:0/2326808908 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f4e980e7870 con 0x7f4ea41094a0 2024-09-21T06:34:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.811+0000 7f4eaeffa740 1 -- 172.21.15.63:0/3629529263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2177070 msgr2=0x5616a251e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.811+0000 7f4ea259c640 1 --2- 172.21.15.63:0/2326808908 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4e8c0b6680 0x7f4e8c0b8b90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4e94031440 tx=0x7f4e94005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.811+0000 7f4eaeffa740 1 --2- 172.21.15.63:0/3629529263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2177070 0x5616a251e270 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00cbc0 tx=0x7f4e9c00e720 comp rx=0 tx=0).stop 2024-09-21T06:34:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.811+0000 7f4eaeffa740 1 -- 172.21.15.63:0/3629529263 shutdown_connections 2024-09-21T06:34:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.811+0000 7f4eaeffa740 1 --2- 172.21.15.63:0/3629529263 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a2156390 0x5616a251ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.811+0000 7f4eaeffa740 1 --2- 172.21.15.63:0/3629529263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a214e1b0 0x5616a251e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.811+0000 7f4eaeffa740 1 --2- 172.21.15.63:0/3629529263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2177070 0x5616a251e270 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.811+0000 7f4eaeffa740 1 -- 172.21.15.63:0/3629529263 >> 172.21.15.63:0/3629529263 conn(0x5616a216b460 msgr2=0x5616a251c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.811+0000 7f4eaeffa740 1 -- 172.21.15.63:0/3629529263 shutdown_connections 2024-09-21T06:34:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.811+0000 7f4eaeffa740 1 -- 172.21.15.63:0/3629529263 wait complete. 2024-09-21T06:34:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.811+0000 7f4eaeffa740 1 -- start start 2024-09-21T06:34:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.811+0000 7f4eaeffa740 1 Processor -- start 2024-09-21T06:34:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4eaeffa740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a214e1b0 0x5616a252dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4eaeffa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2156390 0x5616a252e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4eaeffa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a2177070 0x5616a253a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4eaeffa740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5616a22e5700 con 0x5616a214e1b0 2024-09-21T06:34:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4eaeffa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5616a241f110 con 0x5616a2177070 2024-09-21T06:34:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4eaeffa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5616a2530d80 con 0x5616a2156390 2024-09-21T06:34:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4eaeffa740 10 client.0 _ll_register_callbacks cb 0x5616a2438990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:34:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4ea259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a214e1b0 0x5616a252dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4ea259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a214e1b0 0x5616a252dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33140/0 (socket says 172.21.15.63:33140) 2024-09-21T06:34:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4ea259c640 1 -- 172.21.15.63:0/1972679612 learned_addr learned my addr 172.21.15.63:0/1972679612 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4ea1d9b640 1 --2- 172.21.15.63:0/1972679612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2156390 0x5616a252e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4ea2d9d640 1 --2- 172.21.15.63:0/1972679612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a2177070 0x5616a253a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4ea259c640 1 -- 172.21.15.63:0/1972679612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2156390 msgr2=0x5616a252e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4ea259c640 1 --2- 172.21.15.63:0/1972679612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2156390 0x5616a252e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4ea259c640 1 -- 172.21.15.63:0/1972679612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a2177070 msgr2=0x5616a253a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4ea259c640 1 --2- 172.21.15.63:0/1972679612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a2177070 0x5616a253a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4ea259c640 1 -- 172.21.15.63:0/1972679612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616a244cc40 con 0x5616a214e1b0 2024-09-21T06:34:36.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4ea2d9d640 1 --2- 172.21.15.63:0/1972679612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a2177070 0x5616a253a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:36.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4ea259c640 1 --2- 172.21.15.63:0/1972679612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a214e1b0 0x5616a252dd30 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4e94033000 tx=0x7f4e94009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9538f99d4a61bce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:36.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4e89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:34:36.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.812+0000 7f4e89ffb640 1 -- 172.21.15.63:0/1972679612 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9404d070 con 0x5616a214e1b0 2024-09-21T06:34:36.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.813+0000 7f4e89ffb640 1 -- 172.21.15.63:0/1972679612 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f4e94003a00 con 0x5616a214e1b0 2024-09-21T06:34:36.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.813+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1972679612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e9c0043c0 con 0x5616a214e1b0 2024-09-21T06:34:36.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.813+0000 7f4e89ffb640 1 -- 172.21.15.63:0/1972679612 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f4e94059050 con 0x5616a214e1b0 2024-09-21T06:34:36.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.813+0000 7f4eaeffa740 10 client.16869 fetch_fsmap learned FSMap version 53 2024-09-21T06:34:36.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.813+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1972679612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5616a253cb00 con 0x5616a214e1b0 2024-09-21T06:34:36.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.813+0000 7f4e89ffb640 1 -- 172.21.15.63:0/1972679612 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e9c0043c0 con 0x5616a214e1b0 2024-09-21T06:34:36.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.813+0000 7f4e89ffb640 1 -- 172.21.15.63:0/1972679612 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7f4e94049c60 con 0x5616a214e1b0 2024-09-21T06:34:36.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.813+0000 7f4eaeffa740 10 client.16869 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:34:36.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.813+0000 7f4eaeffa740 10 client.16869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:34:36.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.813+0000 7f4eaeffa740 20 client.16869 populate_metadata read hostname 'smithi063' 2024-09-21T06:34:36.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.813+0000 7f4eaeffa740 1 --2- 172.21.15.63:0/1972679612 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5616a21359f0 0x5616a2540000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:36.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.813+0000 7f4eaeffa740 4 client.16869 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:34:36.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.813+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1972679612 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616a2496da0 con 0x5616a21359f0 2024-09-21T06:34:36.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.813+0000 7f4ea1d9b640 1 --2- 172.21.15.63:0/1972679612 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5616a21359f0 0x5616a2540000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:36.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.814+0000 7f4ea1d9b640 1 --2- 172.21.15.63:0/1972679612 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5616a21359f0 0x5616a2540000 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfd371e9c66d114f server_cookie=4e132c43e132ee57 in_seq=0 out_seq=0 2024-09-21T06:34:36.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.814+0000 7f4e89ffb640 10 client.16869 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:34:36.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.815+0000 7f4e89ffb640 1 -- 172.21.15.63:0/1972679612 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5616a2496da0 con 0x5616a21359f0 2024-09-21T06:34:36.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.815+0000 7f4e89ffb640 10 client.16869 handle_command_reply: tid=0 2024-09-21T06:34:36.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.815+0000 7f4eaeffa740 1 client.16869 shutdown 2024-09-21T06:34:36.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.815+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1972679612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a214e1b0 msgr2=0x5616a252dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:36.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.815+0000 7f4eaeffa740 1 --2- 172.21.15.63:0/1972679612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a214e1b0 0x5616a252dd30 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4e94033000 tx=0x7f4e94009260 comp rx=0 tx=0).stop 2024-09-21T06:34:36.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.815+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1972679612 shutdown_connections 2024-09-21T06:34:36.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.815+0000 7f4eaeffa740 1 --2- 172.21.15.63:0/1972679612 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5616a21359f0 0x5616a2540000 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.815+0000 7f4eaeffa740 1 --2- 172.21.15.63:0/1972679612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a2177070 0x5616a253a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.815+0000 7f4eaeffa740 1 --2- 172.21.15.63:0/1972679612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2156390 0x5616a252e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.815+0000 7f4e89ffb640 0 client.16869 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:34:36.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.815+0000 7f4eaeffa740 1 --2- 172.21.15.63:0/1972679612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a214e1b0 0x5616a252dd30 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.815+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1972679612 >> 172.21.15.63:0/1972679612 conn(0x5616a216b460 msgr2=0x5616a25213c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:36.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.815+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1972679612 shutdown_connections 2024-09-21T06:34:36.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.815+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1972679612 wait complete. 2024-09-21T06:34:36.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.815+0000 7f4eaeffa740 20 client.16869 trim_cache size 0 max 16384 2024-09-21T06:34:36.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.832+0000 7f4eaeffa740 1 Processor -- start 2024-09-21T06:34:36.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.833+0000 7f4eaeffa740 1 -- start start 2024-09-21T06:34:36.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.833+0000 7f4eaeffa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a214e1b0 0x5616a252f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:36.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.833+0000 7f4eaeffa740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a2156390 0x5616a251b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:36.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.833+0000 7f4eaeffa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2177070 0x5616a251bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:36.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.833+0000 7f4eaeffa740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea41ad660 con 0x5616a2156390 2024-09-21T06:34:36.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.833+0000 7f4eaeffa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea41af260 con 0x5616a214e1b0 2024-09-21T06:34:36.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.833+0000 7f4eaeffa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea41add30 con 0x5616a2177070 2024-09-21T06:34:36.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.833+0000 7f4ea1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a2156390 0x5616a251b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:36.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.833+0000 7f4ea1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a2156390 0x5616a251b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33152/0 (socket says 172.21.15.63:33152) 2024-09-21T06:34:36.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.833+0000 7f4ea1d9b640 1 -- 172.21.15.63:0/1124413590 learned_addr learned my addr 172.21.15.63:0/1124413590 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:36.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.833+0000 7f4ea2d9d640 1 --2- 172.21.15.63:0/1124413590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2177070 0x5616a251bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:36.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.833+0000 7f4ea259c640 1 --2- 172.21.15.63:0/1124413590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a214e1b0 0x5616a252f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:36.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.833+0000 7f4ea1d9b640 1 -- 172.21.15.63:0/1124413590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2177070 msgr2=0x5616a251bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:36.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.833+0000 7f4ea1d9b640 1 --2- 172.21.15.63:0/1124413590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2177070 0x5616a251bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.833+0000 7f4ea1d9b640 1 -- 172.21.15.63:0/1124413590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a214e1b0 msgr2=0x5616a252f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:36.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.833+0000 7f4ea1d9b640 1 --2- 172.21.15.63:0/1124413590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a214e1b0 0x5616a252f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.833+0000 7f4ea1d9b640 1 -- 172.21.15.63:0/1124413590 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a2530100 con 0x5616a2156390 2024-09-21T06:34:36.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.833+0000 7f4ea2d9d640 1 --2- 172.21.15.63:0/1124413590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2177070 0x5616a251bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:36.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.833+0000 7f4ea259c640 1 --2- 172.21.15.63:0/1124413590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a214e1b0 0x5616a252f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:34:36.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.834+0000 7f4ea1d9b640 1 --2- 172.21.15.63:0/1124413590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a2156390 0x5616a251b710 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4e980ad630 tx=0x7f4e980a9700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e951eabf5cd19b52 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:36.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.834+0000 7f4e8bfff640 1 -- 172.21.15.63:0/1124413590 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9801d040 con 0x5616a2156390 2024-09-21T06:34:36.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.834+0000 7f4e8bfff640 1 -- 172.21.15.63:0/1124413590 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e980ad1b0 con 0x5616a2156390 2024-09-21T06:34:36.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.834+0000 7f4e8bfff640 1 -- 172.21.15.63:0/1124413590 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e980b70c0 con 0x5616a2156390 2024-09-21T06:34:36.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.834+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1124413590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a2156390 msgr2=0x5616a251b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:36.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.834+0000 7f4eaeffa740 1 --2- 172.21.15.63:0/1124413590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a2156390 0x5616a251b710 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4e980ad630 tx=0x7f4e980a9700 comp rx=0 tx=0).stop 2024-09-21T06:34:36.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.835+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1124413590 shutdown_connections 2024-09-21T06:34:36.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.835+0000 7f4eaeffa740 1 --2- 172.21.15.63:0/1124413590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2177070 0x5616a251bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.835+0000 7f4eaeffa740 1 --2- 172.21.15.63:0/1124413590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a2156390 0x5616a251b710 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.835+0000 7f4eaeffa740 1 --2- 172.21.15.63:0/1124413590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a214e1b0 0x5616a252f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.835+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1124413590 >> 172.21.15.63:0/1124413590 conn(0x5616a216b460 msgr2=0x5616a251fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:36.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.835+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1124413590 shutdown_connections 2024-09-21T06:34:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.835+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1124413590 wait complete. 2024-09-21T06:34:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.835+0000 7f4eaeffa740 1 -- start start 2024-09-21T06:34:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.835+0000 7f4eaeffa740 1 Processor -- start 2024-09-21T06:34:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.835+0000 7f4eaeffa740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a214e1b0 0x5616a25320d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.835+0000 7f4eaeffa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a2156390 0x5616a2532610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.835+0000 7f4eaeffa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2177070 0x5616a2532b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.835+0000 7f4eaeffa740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea41aeb90 con 0x5616a214e1b0 2024-09-21T06:34:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.835+0000 7f4eaeffa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea41ae490 con 0x5616a2156390 2024-09-21T06:34:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.835+0000 7f4eaeffa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea41ab640 con 0x5616a2177070 2024-09-21T06:34:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.835+0000 7f4eaeffa740 10 client.0 _ll_register_callbacks cb 0x7f4e94031970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:34:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.836+0000 7f4ea259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a214e1b0 0x5616a25320d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.836+0000 7f4ea259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a214e1b0 0x5616a25320d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33166/0 (socket says 172.21.15.63:33166) 2024-09-21T06:34:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.836+0000 7f4ea259c640 1 -- 172.21.15.63:0/1633929996 learned_addr learned my addr 172.21.15.63:0/1633929996 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:34:36.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.836+0000 7f4ea2d9d640 1 --2- 172.21.15.63:0/1633929996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2177070 0x5616a2532b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.836+0000 7f4ea1d9b640 1 --2- 172.21.15.63:0/1633929996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a2156390 0x5616a2532610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.836+0000 7f4ea259c640 1 -- 172.21.15.63:0/1633929996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2177070 msgr2=0x5616a2532b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.836+0000 7f4ea259c640 1 --2- 172.21.15.63:0/1633929996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2177070 0x5616a2532b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.836+0000 7f4ea259c640 1 -- 172.21.15.63:0/1633929996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a2156390 msgr2=0x5616a2532610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:34:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.836+0000 7f4ea259c640 1 --2- 172.21.15.63:0/1633929996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a2156390 0x5616a2532610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.836+0000 7f4ea259c640 1 -- 172.21.15.63:0/1633929996 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616a25a9a70 con 0x5616a214e1b0 2024-09-21T06:34:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.836+0000 7f4ea1d9b640 1 --2- 172.21.15.63:0/1633929996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a2156390 0x5616a2532610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.836+0000 7f4ea259c640 1 --2- 172.21.15.63:0/1633929996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a214e1b0 0x5616a25320d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4e9402a930 tx=0x7f4e9403c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffdcf381867dc22b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.836+0000 7f4e89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:34:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.836+0000 7f4e89ffb640 1 -- 172.21.15.63:0/1633929996 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9404d050 con 0x5616a214e1b0 2024-09-21T06:34:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.836+0000 7f4e89ffb640 1 -- 172.21.15.63:0/1633929996 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8549+0+0 (secure 0 0 0) 0x7f4e94003800 con 0x5616a214e1b0 2024-09-21T06:34:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.836+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1633929996 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e980ad1b0 con 0x5616a214e1b0 2024-09-21T06:34:36.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.837+0000 7f4e89ffb640 1 -- 172.21.15.63:0/1633929996 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f4e94035040 con 0x5616a214e1b0 2024-09-21T06:34:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.837+0000 7f4eaeffa740 10 client.16875 fetch_fsmap learned FSMap version 53 2024-09-21T06:34:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.837+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1633929996 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5616a25aaca0 con 0x5616a214e1b0 2024-09-21T06:34:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.837+0000 7f4e89ffb640 1 -- 172.21.15.63:0/1633929996 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e980ad1b0 con 0x5616a214e1b0 2024-09-21T06:34:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.837+0000 7f4e89ffb640 1 -- 172.21.15.63:0/1633929996 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7f4e94049a70 con 0x5616a214e1b0 2024-09-21T06:34:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.837+0000 7f4eaeffa740 10 client.16875 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:34:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.837+0000 7f4eaeffa740 10 client.16875 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:34:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.837+0000 7f4eaeffa740 20 client.16875 populate_metadata read hostname 'smithi063' 2024-09-21T06:34:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.837+0000 7f4eaeffa740 1 --2- 172.21.15.63:0/1633929996 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5616a210ada0 0x5616a25ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.837+0000 7f4eaeffa740 4 client.16875 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:34:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.837+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1633929996 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5616a2492850 con 0x5616a210ada0 2024-09-21T06:34:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.837+0000 7f4ea1d9b640 1 --2- 172.21.15.63:0/1633929996 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5616a210ada0 0x5616a25ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.838+0000 7f4e89ffb640 10 client.16875 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:34:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.838+0000 7f4ea1d9b640 1 --2- 172.21.15.63:0/1633929996 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5616a210ada0 0x5616a25ad460 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b34b9b3c044d5872 server_cookie=3107f960c0eb6ea2 in_seq=0 out_seq=0 2024-09-21T06:34:36.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.838+0000 7f4e89ffb640 1 -- 172.21.15.63:0/1633929996 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x5616a2492850 con 0x5616a210ada0 2024-09-21T06:34:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.838+0000 7f4e89ffb640 10 client.16875 handle_command_reply: tid=0 2024-09-21T06:34:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.838+0000 7f4eaeffa740 1 client.16875 shutdown 2024-09-21T06:34:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.838+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1633929996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a214e1b0 msgr2=0x5616a25320d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.838+0000 7f4eaeffa740 1 --2- 172.21.15.63:0/1633929996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a214e1b0 0x5616a25320d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4e9402a930 tx=0x7f4e9403c8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.838+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1633929996 shutdown_connections 2024-09-21T06:34:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.838+0000 7f4eaeffa740 1 --2- 172.21.15.63:0/1633929996 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5616a210ada0 0x5616a25ad460 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.838+0000 7f4e89ffb640 0 client.16875 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:34:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.838+0000 7f4eaeffa740 1 --2- 172.21.15.63:0/1633929996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a2177070 0x5616a2532b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.838+0000 7f4eaeffa740 1 --2- 172.21.15.63:0/1633929996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5616a2156390 0x5616a2532610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.838+0000 7f4eaeffa740 1 --2- 172.21.15.63:0/1633929996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5616a214e1b0 0x5616a25320d0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.838+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1633929996 >> 172.21.15.63:0/1633929996 conn(0x5616a216b460 msgr2=0x5616a251fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.838+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1633929996 shutdown_connections 2024-09-21T06:34:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.838+0000 7f4eaeffa740 1 -- 172.21.15.63:0/1633929996 wait complete. 2024-09-21T06:34:36.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.839+0000 7f4eaeffa740 20 client.16875 trim_cache size 0 max 16384 2024-09-21T06:34:36.850 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:34:36.850 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:34:36.850 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": { 2024-09-21T06:34:36.850 INFO:teuthology.orchestra.run.smithi063.stdout: "4f099144-5170-453b-a745-ddc222860f34": { 2024-09-21T06:34:36.850 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:34:36.850 INFO:teuthology.orchestra.run.smithi063.stdout: "tag": "4f099144-5170-453b-a745-ddc222860f34", 2024-09-21T06:34:36.850 INFO:teuthology.orchestra.run.smithi063.stdout: "options": "recursive,force" 2024-09-21T06:34:36.850 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:34:36.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:34:36.851 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:34:36.851 INFO:teuthology.orchestra.run.smithi063.stdout: "4f099144-5170-453b-a745-ddc222860f34": { 2024-09-21T06:34:36.851 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:34:35.417817+0000", 2024-09-21T06:34:36.851 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:34:36.851 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:34:36.851 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:34:36.851 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:34:36.851 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:34:36.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:34:36.851 INFO:teuthology.orchestra.run.smithi063.stdout: "91ae0a75-6a3f-452f-8bda-0f19862a5724": { 2024-09-21T06:34:36.851 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:50.316590+0000", 2024-09-21T06:34:36.851 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:34:36.851 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:34:36.851 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:34:36.852 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:34:36.852 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:34:36.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:34:36.852 INFO:teuthology.orchestra.run.smithi063.stdout: "5396028b-35f4-48fe-b54d-385784e97de3": { 2024-09-21T06:34:36.852 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:04.523378+0000", 2024-09-21T06:34:36.852 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:34:36.852 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:34:36.852 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:34:36.852 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:34:36.852 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:34:36.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:34:36.852 INFO:teuthology.orchestra.run.smithi063.stdout: "024d3c59-0b67-49a9-bf4a-e02d36691942": { 2024-09-21T06:34:36.852 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:32:14.282244+0000", 2024-09-21T06:34:36.852 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:34:36.853 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:34:36.853 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:34:36.853 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:34:36.853 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:34:36.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:34:36.853 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:34:36.853 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:31:27.507051+0000", 2024-09-21T06:34:36.853 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:34:36.853 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:34:36.853 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:34:36.853 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:34:36.853 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:34:36.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:34:36.853 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:34:36.854 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:34:36.854 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:34:36.854 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:34:36.854 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:34:36.854 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:34:36.854 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:34:36.854 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:34:36.854 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:34:36.854 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:34:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.839+0000 7f4ea8a86640 1 -- 172.21.15.63:0/2326808908 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4e8c0b6680 msgr2=0x7f4e8c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.839+0000 7f4ea8a86640 1 --2- 172.21.15.63:0/2326808908 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4e8c0b6680 0x7f4e8c0b8b90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4e94031440 tx=0x7f4e94005a20 comp rx=0 tx=0).stop 2024-09-21T06:34:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.839+0000 7f4ea8a86640 1 -- 172.21.15.63:0/2326808908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ea41094a0 msgr2=0x7f4ea419aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.839+0000 7f4ea8a86640 1 --2- 172.21.15.63:0/2326808908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ea41094a0 0x7f4ea419aac0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800cce0 tx=0x7f4e9800a620 comp rx=0 tx=0).stop 2024-09-21T06:34:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.839+0000 7f4ea8a86640 1 -- 172.21.15.63:0/2326808908 shutdown_connections 2024-09-21T06:34:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.839+0000 7f4ea8a86640 1 --2- 172.21.15.63:0/2326808908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ea4109df0 0x7f4ea419fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.839+0000 7f4ea8a86640 1 --2- 172.21.15.63:0/2326808908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ea41094a0 0x7f4ea419aac0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.839+0000 7f4ea8a86640 1 --2- 172.21.15.63:0/2326808908 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4e8c0b6680 0x7f4e8c0b8b90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.839+0000 7f4ea8a86640 1 --2- 172.21.15.63:0/2326808908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ea4103b60 0x7f4ea419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.839+0000 7f4ea8a86640 1 -- 172.21.15.63:0/2326808908 >> 172.21.15.63:0/2326808908 conn(0x7f4ea407b850 msgr2=0x7f4ea41075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:36.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.839+0000 7f4ea8a86640 1 -- 172.21.15.63:0/2326808908 shutdown_connections 2024-09-21T06:34:36.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:34:36.839+0000 7f4ea8a86640 1 -- 172.21.15.63:0/2326808908 wait complete. 2024-09-21T06:34:37.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:37 smithi071 ceph-mon[34844]: scrub queued for path: / 2024-09-21T06:34:37.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:37 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:34:37.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:37 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:34:37.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:37 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:34:37.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:37 smithi071 ceph-mon[34844]: pgmap v515: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:34:37.548 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:37 smithi063 ceph-mon[31150]: scrub queued for path: / 2024-09-21T06:34:37.548 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:37 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:34:37.548 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:37 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:34:37.549 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:37 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:34:37.549 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:37 smithi063 ceph-mon[31150]: pgmap v515: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:34:37.579 INFO:tasks.cephfs.filesystem:scrub status for tag:4f099144-5170-453b-a745-ddc222860f34 - {'path': '/', 'tag': '4f099144-5170-453b-a745-ddc222860f34', 'options': 'recursive,force'} 2024-09-21T06:34:37.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:37 smithi175 ceph-mon[34510]: scrub queued for path: / 2024-09-21T06:34:37.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:37 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:34:37.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:37 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:34:37.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:37 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:34:37.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:37 smithi175 ceph-mon[34510]: pgmap v515: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:34:39.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:39 smithi071 ceph-mon[34844]: pgmap v516: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-21T06:34:39.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:39 smithi063 ceph-mon[31150]: pgmap v516: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-21T06:34:39.598 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:39 smithi175 ceph-mon[34510]: pgmap v516: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-21T06:34:41.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:41 smithi071 ceph-mon[34844]: pgmap v517: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T06:34:41.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:41 smithi063 ceph-mon[31150]: pgmap v517: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T06:34:41.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:41 smithi175 ceph-mon[34510]: pgmap v517: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T06:34:43.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:43 smithi071 ceph-mon[34844]: pgmap v518: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T06:34:43.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:43 smithi063 ceph-mon[31150]: pgmap v518: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T06:34:43.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:43 smithi175 ceph-mon[34510]: pgmap v518: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T06:34:44.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:44 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:34:44.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:44 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:34:44.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:44 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:34:44.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:44 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:34:44.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:44 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:34:44.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:44 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:34:45.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:45 smithi071 ceph-mon[34844]: pgmap v519: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T06:34:45.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:45 smithi063 ceph-mon[31150]: pgmap v519: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T06:34:45.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:45 smithi175 ceph-mon[34510]: pgmap v519: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T06:34:47.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:47 smithi071 ceph-mon[34844]: pgmap v520: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T06:34:47.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:47 smithi063 ceph-mon[31150]: pgmap v520: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T06:34:47.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:47 smithi175 ceph-mon[34510]: pgmap v520: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T06:34:49.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:49 smithi071 ceph-mon[34844]: pgmap v521: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-21T06:34:49.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:49 smithi063 ceph-mon[31150]: pgmap v521: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-21T06:34:49.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:49 smithi175 ceph-mon[34510]: pgmap v521: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-21T06:34:51.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:51 smithi071 ceph-mon[34844]: pgmap v522: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 11 op/s 2024-09-21T06:34:51.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:51 smithi063 ceph-mon[31150]: pgmap v522: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 11 op/s 2024-09-21T06:34:51.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:51 smithi175 ceph-mon[34510]: pgmap v522: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 11 op/s 2024-09-21T06:34:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:53 smithi071 ceph-mon[34844]: pgmap v523: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:34:53.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:53 smithi063 ceph-mon[31150]: pgmap v523: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:34:53.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:53 smithi175 ceph-mon[34510]: pgmap v523: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:34:55.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:55 smithi071 ceph-mon[34844]: pgmap v524: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:34:55.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:55 smithi063 ceph-mon[31150]: pgmap v524: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:34:55.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:55 smithi175 ceph-mon[34510]: pgmap v524: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:34:57.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:57 smithi071 ceph-mon[34844]: pgmap v525: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:34:57.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:57 smithi063 ceph-mon[31150]: pgmap v525: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:34:57.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:57 smithi175 ceph-mon[34510]: pgmap v525: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:34:59.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:34:59 smithi071 ceph-mon[34844]: pgmap v526: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:34:59.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:34:59 smithi063 ceph-mon[31150]: pgmap v526: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:34:59.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:34:59 smithi175 ceph-mon[34510]: pgmap v526: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:35:01.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:01 smithi071 ceph-mon[34844]: pgmap v527: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:35:01.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:01 smithi063 ceph-mon[31150]: pgmap v527: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:35:01.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:01 smithi175 ceph-mon[34510]: pgmap v527: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:35:03.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:03 smithi071 ceph-mon[34844]: pgmap v528: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T06:35:03.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:03 smithi063 ceph-mon[31150]: pgmap v528: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T06:35:03.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:03 smithi175 ceph-mon[34510]: pgmap v528: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T06:35:05.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:05 smithi071 ceph-mon[34844]: pgmap v529: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:35:05.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:05 smithi063 ceph-mon[31150]: pgmap v529: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:35:05.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:05 smithi175 ceph-mon[34510]: pgmap v529: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:35:07.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:07 smithi071 ceph-mon[34844]: pgmap v530: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-21T06:35:07.580 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:35:07.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:07 smithi063 ceph-mon[31150]: pgmap v530: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-21T06:35:07.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:07 smithi175 ceph-mon[34510]: pgmap v530: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-21T06:35:07.855 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:08.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.537+0000 7fa436af5640 1 -- 172.21.15.63:0/2013388168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa430075dd0 msgr2=0x7fa4300761e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:08.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.537+0000 7fa436af5640 1 --2- 172.21.15.63:0/2013388168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa430075dd0 0x7fa4300761e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa420009900 tx=0x7fa42002a400 comp rx=0 tx=0).stop 2024-09-21T06:35:08.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.537+0000 7fa436af5640 1 -- 172.21.15.63:0/2013388168 shutdown_connections 2024-09-21T06:35:08.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.537+0000 7fa436af5640 1 --2- 172.21.15.63:0/2013388168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa430114260 0x7fa430116730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.537+0000 7fa436af5640 1 --2- 172.21.15.63:0/2013388168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa430075dd0 0x7fa4300761e0 secure :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa420009900 tx=0x7fa42002a400 comp rx=0 tx=0).stop 2024-09-21T06:35:08.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.537+0000 7fa436af5640 1 --2- 172.21.15.63:0/2013388168 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa430077380 0x7fa4300757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.537+0000 7fa436af5640 1 -- 172.21.15.63:0/2013388168 >> 172.21.15.63:0/2013388168 conn(0x7fa4300ff440 msgr2=0x7fa430101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:08.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.539+0000 7fa436af5640 1 -- 172.21.15.63:0/2013388168 shutdown_connections 2024-09-21T06:35:08.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.539+0000 7fa436af5640 1 -- 172.21.15.63:0/2013388168 wait complete. 2024-09-21T06:35:08.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.540+0000 7fa436af5640 1 Processor -- start 2024-09-21T06:35:08.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.540+0000 7fa436af5640 1 -- start start 2024-09-21T06:35:08.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.541+0000 7fa436af5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa430077380 0x7fa430075030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.541+0000 7fa436af5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa430114260 0x7fa43006e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.541+0000 7fa436af5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa43006e8a0 0x7fa430073be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.541+0000 7fa436af5640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa430119ea0 con 0x7fa43006e8a0 2024-09-21T06:35:08.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.541+0000 7fa436af5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa430119d20 con 0x7fa430114260 2024-09-21T06:35:08.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.541+0000 7fa436af5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa43011a020 con 0x7fa430077380 2024-09-21T06:35:08.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.542+0000 7fa435af3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa430077380 0x7fa430075030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.542+0000 7fa4362f4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa43006e8a0 0x7fa430073be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.542+0000 7fa4362f4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa43006e8a0 0x7fa430073be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55076/0 (socket says 172.21.15.63:55076) 2024-09-21T06:35:08.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.542+0000 7fa4362f4640 1 -- 172.21.15.63:0/2305643985 learned_addr learned my addr 172.21.15.63:0/2305643985 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:08.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.542+0000 7fa4352f2640 1 --2- 172.21.15.63:0/2305643985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa430114260 0x7fa43006e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.543+0000 7fa4352f2640 1 -- 172.21.15.63:0/2305643985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa430077380 msgr2=0x7fa430075030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:08.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.543+0000 7fa4352f2640 1 --2- 172.21.15.63:0/2305643985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa430077380 0x7fa430075030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.543+0000 7fa4352f2640 1 -- 172.21.15.63:0/2305643985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa43006e8a0 msgr2=0x7fa430073be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:08.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.543+0000 7fa4352f2640 1 --2- 172.21.15.63:0/2305643985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa43006e8a0 0x7fa430073be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.543+0000 7fa4352f2640 1 -- 172.21.15.63:0/2305643985 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43006f080 con 0x7fa430114260 2024-09-21T06:35:08.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.543+0000 7fa4362f4640 1 --2- 172.21.15.63:0/2305643985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa43006e8a0 0x7fa430073be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:08.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.543+0000 7fa4352f2640 1 --2- 172.21.15.63:0/2305643985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa430114260 0x7fa43006e240 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa43006c790 tx=0x7fa4200045e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:08.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.545+0000 7fa426ffd640 1 -- 172.21.15.63:0/2305643985 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420035030 con 0x7fa430114260 2024-09-21T06:35:08.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.545+0000 7fa426ffd640 1 -- 172.21.15.63:0/2305643985 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa420003d30 con 0x7fa430114260 2024-09-21T06:35:08.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.545+0000 7fa426ffd640 1 -- 172.21.15.63:0/2305643985 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4200318a0 con 0x7fa430114260 2024-09-21T06:35:08.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.545+0000 7fa436af5640 1 -- 172.21.15.63:0/2305643985 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4300741e0 con 0x7fa430114260 2024-09-21T06:35:08.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.545+0000 7fa436af5640 1 -- 172.21.15.63:0/2305643985 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa430074640 con 0x7fa430114260 2024-09-21T06:35:08.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.549+0000 7fa43e2cb740 1 Processor -- start 2024-09-21T06:35:08.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.549+0000 7fa43e2cb740 1 -- start start 2024-09-21T06:35:08.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.549+0000 7fa43e2cb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 0x55b927eea410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.549+0000 7fa43e2cb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b1a1b0 0x55b927eea950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.549+0000 7fa43e2cb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b22390 0x55b927eeae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.549+0000 7fa43e2cb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55b927e60e50 con 0x55b927b43070 2024-09-21T06:35:08.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.550+0000 7fa43e2cb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b927e50280 con 0x55b927b22390 2024-09-21T06:35:08.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.550+0000 7fa43e2cb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b927e54090 con 0x55b927b1a1b0 2024-09-21T06:35:08.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.551+0000 7fa426ffd640 1 -- 172.21.15.63:0/2305643985 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fa420003880 con 0x7fa430114260 2024-09-21T06:35:08.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.552+0000 7fa435af3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b1a1b0 0x55b927eea950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.552+0000 7fa435af3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b1a1b0 0x55b927eea950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:35592/0 (socket says 172.21.15.63:35592) 2024-09-21T06:35:08.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.552+0000 7fa435af3640 1 -- 172.21.15.63:0/868615497 learned_addr learned my addr 172.21.15.63:0/868615497 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:08.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.552+0000 7fa4362f4640 1 --2- 172.21.15.63:0/868615497 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 0x55b927eea410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.552+0000 7fa4352f2640 1 --2- 172.21.15.63:0/868615497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b22390 0x55b927eeae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.552+0000 7fa4362f4640 1 -- 172.21.15.63:0/868615497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b1a1b0 msgr2=0x55b927eea950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:08.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.552+0000 7fa4362f4640 1 --2- 172.21.15.63:0/868615497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b1a1b0 0x55b927eea950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.552+0000 7fa4362f4640 1 -- 172.21.15.63:0/868615497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b22390 msgr2=0x55b927eeae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:08.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.552+0000 7fa4362f4640 1 --2- 172.21.15.63:0/868615497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b22390 0x55b927eeae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.552+0000 7fa4362f4640 1 -- 172.21.15.63:0/868615497 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b927bae650 con 0x55b927b43070 2024-09-21T06:35:08.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.553+0000 7fa4362f4640 1 --2- 172.21.15.63:0/868615497 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 0x55b927eea410 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa428009fa0 tx=0x7fa428010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72ceded70c11ed4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:08.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.554+0000 7fa41bfff640 1 -- 172.21.15.63:0/868615497 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa428016070 con 0x55b927b43070 2024-09-21T06:35:08.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.554+0000 7fa41bfff640 1 -- 172.21.15.63:0/868615497 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa42801bb10 con 0x55b927b43070 2024-09-21T06:35:08.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.554+0000 7fa426ffd640 1 --2- 172.21.15.63:0/2305643985 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa41c0b6850 0x7fa41c0b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.554+0000 7fa426ffd640 1 -- 172.21.15.63:0/2305643985 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8637+0+0 (secure 0 0 0) 0x7fa420107ef0 con 0x7fa430114260 2024-09-21T06:35:08.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.554+0000 7fa41bfff640 1 -- 172.21.15.63:0/868615497 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa428012c20 con 0x55b927b43070 2024-09-21T06:35:08.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.555+0000 7fa435af3640 1 --2- 172.21.15.63:0/2305643985 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa41c0b6850 0x7fa41c0b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.555+0000 7fa43e2cb740 1 -- 172.21.15.63:0/868615497 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 msgr2=0x55b927eea410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:08.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.555+0000 7fa43e2cb740 1 --2- 172.21.15.63:0/868615497 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 0x55b927eea410 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa428009fa0 tx=0x7fa428010800 comp rx=0 tx=0).stop 2024-09-21T06:35:08.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.555+0000 7fa43e2cb740 1 -- 172.21.15.63:0/868615497 shutdown_connections 2024-09-21T06:35:08.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.555+0000 7fa43e2cb740 1 --2- 172.21.15.63:0/868615497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b22390 0x55b927eeae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.555+0000 7fa43e2cb740 1 --2- 172.21.15.63:0/868615497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b1a1b0 0x55b927eea950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.555+0000 7fa43e2cb740 1 --2- 172.21.15.63:0/868615497 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 0x55b927eea410 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.555+0000 7fa43e2cb740 1 -- 172.21.15.63:0/868615497 >> 172.21.15.63:0/868615497 conn(0x55b927b37460 msgr2=0x55b927ee8300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:08.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.556+0000 7fa435af3640 1 --2- 172.21.15.63:0/2305643985 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa41c0b6850 0x7fa41c0b8d60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa42c005cc0 tx=0x7fa42c005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:08.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.557+0000 7fa43e2cb740 1 -- 172.21.15.63:0/868615497 shutdown_connections 2024-09-21T06:35:08.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.557+0000 7fa43e2cb740 1 -- 172.21.15.63:0/868615497 wait complete. 2024-09-21T06:35:08.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.558+0000 7fa43e2cb740 1 -- start start 2024-09-21T06:35:08.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.558+0000 7fa43e2cb740 1 Processor -- start 2024-09-21T06:35:08.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.559+0000 7fa43e2cb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b1a1b0 0x55b927ef5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.559+0000 7fa43e2cb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b22390 0x55b927ef5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.559+0000 7fa43e2cb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 0x55b927ef63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.559+0000 7fa43e2cb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55b927cb1700 con 0x55b927b43070 2024-09-21T06:35:08.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.559+0000 7fa43e2cb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b927deb110 con 0x55b927b1a1b0 2024-09-21T06:35:08.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.559+0000 7fa43e2cb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b927ef8c40 con 0x55b927b22390 2024-09-21T06:35:08.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.559+0000 7fa43e2cb740 10 client.0 _ll_register_callbacks cb 0x55b927e04990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:08.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.560+0000 7fa4362f4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 0x55b927ef63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.560+0000 7fa4352f2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b22390 0x55b927ef5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.560+0000 7fa4362f4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 0x55b927ef63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55096/0 (socket says 172.21.15.63:55096) 2024-09-21T06:35:08.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.560+0000 7fa4362f4640 1 -- 172.21.15.63:0/1923736054 learned_addr learned my addr 172.21.15.63:0/1923736054 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:08.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.561+0000 7fa4362f4640 1 -- 172.21.15.63:0/1923736054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b22390 msgr2=0x55b927ef5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:08.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.561+0000 7fa4362f4640 1 --2- 172.21.15.63:0/1923736054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b22390 0x55b927ef5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.561+0000 7fa4362f4640 1 -- 172.21.15.63:0/1923736054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b1a1b0 msgr2=0x55b927ef5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:08.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.561+0000 7fa4362f4640 1 --2- 172.21.15.63:0/1923736054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b1a1b0 0x55b927ef5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.561+0000 7fa4362f4640 1 -- 172.21.15.63:0/1923736054 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b927e18c40 con 0x55b927b43070 2024-09-21T06:35:08.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.562+0000 7fa4362f4640 1 --2- 172.21.15.63:0/1923736054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 0x55b927ef63f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa4280128a0 tx=0x7fa42801cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71d1ba25390ed7e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:08.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.562+0000 7fa4197fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:35:08.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.562+0000 7fa4197fa640 1 -- 172.21.15.63:0/1923736054 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa428016040 con 0x55b927b43070 2024-09-21T06:35:08.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.562+0000 7fa43e2cb740 1 -- 172.21.15.63:0/1923736054 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa42801bb10 con 0x55b927b43070 2024-09-21T06:35:08.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.562+0000 7fa4197fa640 1 -- 172.21.15.63:0/1923736054 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8637+0+0 (secure 0 0 0) 0x7fa428012a00 con 0x55b927b43070 2024-09-21T06:35:08.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.563+0000 7fa4197fa640 1 -- 172.21.15.63:0/1923736054 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fa428032050 con 0x55b927b43070 2024-09-21T06:35:08.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.563+0000 7fa43e2cb740 10 client.16887 fetch_fsmap learned FSMap version 53 2024-09-21T06:35:08.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.564+0000 7fa43e2cb740 1 -- 172.21.15.63:0/1923736054 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55b927f04840 con 0x55b927b43070 2024-09-21T06:35:08.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.564+0000 7fa4197fa640 1 -- 172.21.15.63:0/1923736054 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa42801bb10 con 0x55b927b43070 2024-09-21T06:35:08.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.564+0000 7fa4197fa640 1 -- 172.21.15.63:0/1923736054 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7fa42800f040 con 0x55b927b43070 2024-09-21T06:35:08.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.564+0000 7fa43e2cb740 10 client.16887 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:35:08.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.564+0000 7fa43e2cb740 10 client.16887 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:35:08.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.564+0000 7fa43e2cb740 20 client.16887 populate_metadata read hostname 'smithi063' 2024-09-21T06:35:08.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.564+0000 7fa43e2cb740 1 --2- 172.21.15.63:0/1923736054 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b927b019f0 0x55b927f08110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.564+0000 7fa43e2cb740 4 client.16887 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:35:08.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.564+0000 7fa43e2cb740 1 -- 172.21.15.63:0/1923736054 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b927e62da0 con 0x55b927b019f0 2024-09-21T06:35:08.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.565+0000 7fa435af3640 1 --2- 172.21.15.63:0/1923736054 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b927b019f0 0x55b927f08110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.566+0000 7fa435af3640 1 --2- 172.21.15.63:0/1923736054 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b927b019f0 0x55b927f08110 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5aff6512fe8d546e server_cookie=556a92b539e2a72e in_seq=0 out_seq=0 2024-09-21T06:35:08.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.566+0000 7fa4197fa640 10 client.16887 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:35:08.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.567+0000 7fa4197fa640 1 -- 172.21.15.63:0/1923736054 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b927e62da0 con 0x55b927b019f0 2024-09-21T06:35:08.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.567+0000 7fa4197fa640 10 client.16887 handle_command_reply: tid=0 2024-09-21T06:35:08.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.567+0000 7fa43e2cb740 1 client.16887 shutdown 2024-09-21T06:35:08.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.569+0000 7fa43e2cb740 1 -- 172.21.15.63:0/1923736054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 msgr2=0x55b927ef63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:08.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.569+0000 7fa43e2cb740 1 --2- 172.21.15.63:0/1923736054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 0x55b927ef63f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa4280128a0 tx=0x7fa42801cf00 comp rx=0 tx=0).stop 2024-09-21T06:35:08.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.569+0000 7fa43e2cb740 1 -- 172.21.15.63:0/1923736054 shutdown_connections 2024-09-21T06:35:08.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.569+0000 7fa43e2cb740 1 --2- 172.21.15.63:0/1923736054 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b927b019f0 0x55b927f08110 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.569+0000 7fa43e2cb740 1 --2- 172.21.15.63:0/1923736054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 0x55b927ef63f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.569+0000 7fa43e2cb740 1 --2- 172.21.15.63:0/1923736054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b22390 0x55b927ef5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.569+0000 7fa43e2cb740 1 --2- 172.21.15.63:0/1923736054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b1a1b0 0x55b927ef5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.569+0000 7fa43e2cb740 1 -- 172.21.15.63:0/1923736054 >> 172.21.15.63:0/1923736054 conn(0x55b927b37460 msgr2=0x55b927eed5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:08.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.569+0000 7fa4197fa640 0 client.16887 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:35:08.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.571+0000 7fa43e2cb740 1 -- 172.21.15.63:0/1923736054 shutdown_connections 2024-09-21T06:35:08.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.571+0000 7fa43e2cb740 1 -- 172.21.15.63:0/1923736054 wait complete. 2024-09-21T06:35:08.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.572+0000 7fa43e2cb740 20 client.16887 trim_cache size 0 max 16384 2024-09-21T06:35:08.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.609+0000 7fa43e2cb740 1 Processor -- start 2024-09-21T06:35:08.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.609+0000 7fa43e2cb740 1 -- start start 2024-09-21T06:35:08.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.609+0000 7fa43e2cb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b1a1b0 0x55b927ef7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.609+0000 7fa43e2cb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b22390 0x55b927eebb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.609+0000 7fa43e2cb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 0x55b927ee7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.609+0000 7fa43e2cb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa43010ffe0 con 0x55b927b43070 2024-09-21T06:35:08.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.609+0000 7fa43e2cb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa4301c8e00 con 0x55b927b1a1b0 2024-09-21T06:35:08.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.609+0000 7fa43e2cb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa4301c78d0 con 0x55b927b22390 2024-09-21T06:35:08.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.609+0000 7fa435af3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b1a1b0 0x55b927ef7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.610+0000 7fa435af3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b1a1b0 0x55b927ef7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:52538/0 (socket says 172.21.15.63:52538) 2024-09-21T06:35:08.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.610+0000 7fa435af3640 1 -- 172.21.15.63:0/2984274693 learned_addr learned my addr 172.21.15.63:0/2984274693 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:08.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.610+0000 7fa4362f4640 1 --2- 172.21.15.63:0/2984274693 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 0x55b927ee7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.610+0000 7fa435af3640 1 -- 172.21.15.63:0/2984274693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b22390 msgr2=0x55b927eebb50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:35:08.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.610+0000 7fa435af3640 1 --2- 172.21.15.63:0/2984274693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b22390 0x55b927eebb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.610+0000 7fa435af3640 1 -- 172.21.15.63:0/2984274693 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 msgr2=0x55b927ee7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:08.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.610+0000 7fa435af3640 1 --2- 172.21.15.63:0/2984274693 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 0x55b927ee7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.610+0000 7fa435af3640 1 -- 172.21.15.63:0/2984274693 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b927eed270 con 0x55b927b1a1b0 2024-09-21T06:35:08.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.611+0000 7fa435af3640 1 --2- 172.21.15.63:0/2984274693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b1a1b0 0x55b927ef7850 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa42c005fd0 tx=0x7fa42c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92059802126957e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:08.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.611+0000 7fa41b7fe640 1 -- 172.21.15.63:0/2984274693 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42c004220 con 0x55b927b1a1b0 2024-09-21T06:35:08.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.611+0000 7fa41b7fe640 1 -- 172.21.15.63:0/2984274693 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa42c0043c0 con 0x55b927b1a1b0 2024-09-21T06:35:08.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.613+0000 7fa43e2cb740 1 -- 172.21.15.63:0/2984274693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b1a1b0 msgr2=0x55b927ef7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:08.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.613+0000 7fa43e2cb740 1 --2- 172.21.15.63:0/2984274693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b1a1b0 0x55b927ef7850 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa42c005fd0 tx=0x7fa42c014000 comp rx=0 tx=0).stop 2024-09-21T06:35:08.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.614+0000 7fa43e2cb740 1 -- 172.21.15.63:0/2984274693 shutdown_connections 2024-09-21T06:35:08.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.614+0000 7fa43e2cb740 1 --2- 172.21.15.63:0/2984274693 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 0x55b927ee7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.614+0000 7fa43e2cb740 1 --2- 172.21.15.63:0/2984274693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b22390 0x55b927eebb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.614+0000 7fa43e2cb740 1 --2- 172.21.15.63:0/2984274693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b1a1b0 0x55b927ef7850 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.614+0000 7fa43e2cb740 1 -- 172.21.15.63:0/2984274693 >> 172.21.15.63:0/2984274693 conn(0x55b927b37460 msgr2=0x55b927eeb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:08.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.614+0000 7fa43e2cb740 1 -- 172.21.15.63:0/2984274693 shutdown_connections 2024-09-21T06:35:08.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.614+0000 7fa43e2cb740 1 -- 172.21.15.63:0/2984274693 wait complete. 2024-09-21T06:35:08.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.615+0000 7fa43e2cb740 1 -- start start 2024-09-21T06:35:08.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.615+0000 7fa43e2cb740 1 Processor -- start 2024-09-21T06:35:08.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.616+0000 7fa43e2cb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b1a1b0 0x55b927ef96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.616+0000 7fa43e2cb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b22390 0x55b927ef9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.616+0000 7fa43e2cb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 0x55b927f70b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.616+0000 7fa43e2cb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa4301c8730 con 0x55b927b43070 2024-09-21T06:35:08.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.616+0000 7fa43e2cb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa4301c8030 con 0x55b927b1a1b0 2024-09-21T06:35:08.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.616+0000 7fa43e2cb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa43010dfe0 con 0x55b927b22390 2024-09-21T06:35:08.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.616+0000 7fa43e2cb740 10 client.0 _ll_register_callbacks cb 0x7fa428009e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:08.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.616+0000 7fa435af3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b1a1b0 0x55b927ef96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.616+0000 7fa435af3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b1a1b0 0x55b927ef96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:52542/0 (socket says 172.21.15.63:52542) 2024-09-21T06:35:08.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.616+0000 7fa4352f2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b22390 0x55b927ef9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.616+0000 7fa435af3640 1 -- 172.21.15.63:0/3556088843 learned_addr learned my addr 172.21.15.63:0/3556088843 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:08.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.617+0000 7fa4362f4640 1 --2- 172.21.15.63:0/3556088843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 0x55b927f70b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.618+0000 7fa4352f2640 1 -- 172.21.15.63:0/3556088843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b1a1b0 msgr2=0x55b927ef96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:08.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.618+0000 7fa4352f2640 1 --2- 172.21.15.63:0/3556088843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b1a1b0 0x55b927ef96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.618+0000 7fa4352f2640 1 -- 172.21.15.63:0/3556088843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 msgr2=0x55b927f70b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:08.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.618+0000 7fa4352f2640 1 --2- 172.21.15.63:0/3556088843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 0x55b927f70b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.618+0000 7fa4352f2640 1 -- 172.21.15.63:0/3556088843 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b927f71090 con 0x55b927b22390 2024-09-21T06:35:08.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.618+0000 7fa4352f2640 1 --2- 172.21.15.63:0/3556088843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b22390 0x55b927ef9bf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa420105570 tx=0x7fa42010b520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3db851632927638 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:08.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.618+0000 7fa4197fa640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T06:35:08.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.618+0000 7fa4197fa640 1 -- 172.21.15.63:0/3556088843 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4200cda40 con 0x55b927b22390 2024-09-21T06:35:08.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.619+0000 7fa4197fa640 1 -- 172.21.15.63:0/3556088843 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8637+0+0 (secure 0 0 0) 0x7fa4200f1070 con 0x55b927b22390 2024-09-21T06:35:08.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.620+0000 7fa43e2cb740 1 -- 172.21.15.63:0/3556088843 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa42c0043c0 con 0x55b927b22390 2024-09-21T06:35:08.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.621+0000 7fa4197fa640 1 -- 172.21.15.63:0/3556088843 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fa4200c93e0 con 0x55b927b22390 2024-09-21T06:35:08.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.623+0000 7fa43e2cb740 10 client.26542 fetch_fsmap learned FSMap version 53 2024-09-21T06:35:08.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.623+0000 7fa43e2cb740 1 -- 172.21.15.63:0/3556088843 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55b927f72300 con 0x55b927b22390 2024-09-21T06:35:08.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.623+0000 7fa4197fa640 1 -- 172.21.15.63:0/3556088843 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa42c0043c0 con 0x55b927b22390 2024-09-21T06:35:08.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.624+0000 7fa4197fa640 1 -- 172.21.15.63:0/3556088843 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7fa42004cb70 con 0x55b927b22390 2024-09-21T06:35:08.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.624+0000 7fa43e2cb740 10 client.26542 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:35:08.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.624+0000 7fa43e2cb740 10 client.26542 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:35:08.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.624+0000 7fa43e2cb740 20 client.26542 populate_metadata read hostname 'smithi063' 2024-09-21T06:35:08.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.624+0000 7fa43e2cb740 1 --2- 172.21.15.63:0/3556088843 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b927ad6da0 0x55b927f74b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.624+0000 7fa43e2cb740 4 client.26542 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:35:08.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.624+0000 7fa43e2cb740 1 -- 172.21.15.63:0/3556088843 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b927e5e850 con 0x55b927ad6da0 2024-09-21T06:35:08.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.625+0000 7fa435af3640 1 --2- 172.21.15.63:0/3556088843 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b927ad6da0 0x55b927f74b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.628+0000 7fa435af3640 1 --2- 172.21.15.63:0/3556088843 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b927ad6da0 0x55b927f74b60 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c911f0ec4d868c3 server_cookie=5de7c82dc070ce38 in_seq=0 out_seq=0 2024-09-21T06:35:08.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.628+0000 7fa4197fa640 10 client.26542 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:35:08.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.630+0000 7fa4197fa640 1 -- 172.21.15.63:0/3556088843 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x55b927e5e850 con 0x55b927ad6da0 2024-09-21T06:35:08.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.630+0000 7fa4197fa640 10 client.26542 handle_command_reply: tid=0 2024-09-21T06:35:08.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.630+0000 7fa43e2cb740 1 client.26542 shutdown 2024-09-21T06:35:08.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.631+0000 7fa43e2cb740 1 -- 172.21.15.63:0/3556088843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b22390 msgr2=0x55b927ef9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:08.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.631+0000 7fa43e2cb740 1 --2- 172.21.15.63:0/3556088843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b22390 0x55b927ef9bf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa420105570 tx=0x7fa42010b520 comp rx=0 tx=0).stop 2024-09-21T06:35:08.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.631+0000 7fa43e2cb740 1 -- 172.21.15.63:0/3556088843 shutdown_connections 2024-09-21T06:35:08.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.631+0000 7fa43e2cb740 1 --2- 172.21.15.63:0/3556088843 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b927ad6da0 0x55b927f74b60 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.631+0000 7fa43e2cb740 1 --2- 172.21.15.63:0/3556088843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b927b43070 0x55b927f70b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.631+0000 7fa43e2cb740 1 --2- 172.21.15.63:0/3556088843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b927b22390 0x55b927ef9bf0 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa420105570 tx=0x7fa42010b520 comp rx=0 tx=0).stop 2024-09-21T06:35:08.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.631+0000 7fa43e2cb740 1 --2- 172.21.15.63:0/3556088843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b927b1a1b0 0x55b927ef96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.631+0000 7fa43e2cb740 1 -- 172.21.15.63:0/3556088843 >> 172.21.15.63:0/3556088843 conn(0x55b927b37460 msgr2=0x55b927ef75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:08.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.631+0000 7fa4197fa640 0 client.26542 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:35:08.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.632+0000 7fa43e2cb740 1 -- 172.21.15.63:0/3556088843 shutdown_connections 2024-09-21T06:35:08.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.632+0000 7fa43e2cb740 1 -- 172.21.15.63:0/3556088843 wait complete. 2024-09-21T06:35:08.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.632+0000 7fa43e2cb740 20 client.26542 trim_cache size 0 max 16384 2024-09-21T06:35:08.635 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:35:08.635 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "no active scrubs running", 2024-09-21T06:35:08.635 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": {}, 2024-09-21T06:35:08.635 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:35:08.636 INFO:teuthology.orchestra.run.smithi063.stdout: "4f099144-5170-453b-a745-ddc222860f34": { 2024-09-21T06:35:08.636 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:34:35.417817+0000", 2024-09-21T06:35:08.636 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:08.636 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:35:08.636 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:35:08.636 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:35:08.636 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:35:08.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:35:08.636 INFO:teuthology.orchestra.run.smithi063.stdout: "91ae0a75-6a3f-452f-8bda-0f19862a5724": { 2024-09-21T06:35:08.636 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:50.316590+0000", 2024-09-21T06:35:08.636 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:08.636 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:35:08.636 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:35:08.636 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:35:08.637 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:35:08.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:35:08.637 INFO:teuthology.orchestra.run.smithi063.stdout: "5396028b-35f4-48fe-b54d-385784e97de3": { 2024-09-21T06:35:08.637 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:04.523378+0000", 2024-09-21T06:35:08.637 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:08.637 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:35:08.637 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:35:08.637 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:35:08.637 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:35:08.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:35:08.637 INFO:teuthology.orchestra.run.smithi063.stdout: "024d3c59-0b67-49a9-bf4a-e02d36691942": { 2024-09-21T06:35:08.637 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:32:14.282244+0000", 2024-09-21T06:35:08.637 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:08.637 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:35:08.637 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:35:08.638 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:35:08.638 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:35:08.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:35:08.638 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:35:08.638 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:31:27.507051+0000", 2024-09-21T06:35:08.638 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:08.638 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:35:08.638 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:35:08.638 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:35:08.638 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:35:08.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:35:08.638 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:35:08.638 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:35:08.638 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:08.638 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:35:08.638 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:35:08.639 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:35:08.639 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:35:08.639 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:35:08.639 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:35:08.639 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:35:08.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.634+0000 7fa436af5640 1 -- 172.21.15.63:0/2305643985 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa41c0b6850 msgr2=0x7fa41c0b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:08.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.634+0000 7fa436af5640 1 --2- 172.21.15.63:0/2305643985 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa41c0b6850 0x7fa41c0b8d60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa42c005cc0 tx=0x7fa42c005c50 comp rx=0 tx=0).stop 2024-09-21T06:35:08.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.634+0000 7fa436af5640 1 -- 172.21.15.63:0/2305643985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa430114260 msgr2=0x7fa43006e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:08.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.634+0000 7fa436af5640 1 --2- 172.21.15.63:0/2305643985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa430114260 0x7fa43006e240 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa43006c790 tx=0x7fa4200045e0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.634+0000 7fa436af5640 1 -- 172.21.15.63:0/2305643985 shutdown_connections 2024-09-21T06:35:08.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.634+0000 7fa436af5640 1 --2- 172.21.15.63:0/2305643985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa43006e8a0 0x7fa430073be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.634+0000 7fa436af5640 1 --2- 172.21.15.63:0/2305643985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa430114260 0x7fa43006e240 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.634+0000 7fa436af5640 1 --2- 172.21.15.63:0/2305643985 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fa41c0b6850 0x7fa41c0b8d60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.634+0000 7fa436af5640 1 --2- 172.21.15.63:0/2305643985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa430077380 0x7fa430075030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.634+0000 7fa436af5640 1 -- 172.21.15.63:0/2305643985 >> 172.21.15.63:0/2305643985 conn(0x7fa4300ff440 msgr2=0x7fa430110160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:08.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.635+0000 7fa436af5640 1 -- 172.21.15.63:0/2305643985 shutdown_connections 2024-09-21T06:35:08.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:08.635+0000 7fa436af5640 1 -- 172.21.15.63:0/2305643985 wait complete. 2024-09-21T06:35:09.515 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:09 smithi063 ceph-mon[31150]: pgmap v531: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-21T06:35:09.515 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:09 smithi063 ceph-mon[31150]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T06:35:09.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:09 smithi071 ceph-mon[34844]: pgmap v531: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-21T06:35:09.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:09 smithi071 ceph-mon[34844]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T06:35:09.543 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:35:09.543 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:35:09.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:09 smithi175 ceph-mon[34510]: pgmap v531: 97 pgs: 97 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-21T06:35:09.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:09 smithi175 ceph-mon[34510]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T06:35:09.801 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:10.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.524+0000 7f472a5df640 1 -- 172.21.15.63:0/1417063009 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47241083a0 msgr2=0x7f47241087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:10.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.524+0000 7f472a5df640 1 --2- 172.21.15.63:0/1417063009 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47241083a0 0x7f47241087b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f4718009900 tx=0x7f471802a410 comp rx=0 tx=0).stop 2024-09-21T06:35:10.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.524+0000 7f472a5df640 1 -- 172.21.15.63:0/1417063009 shutdown_connections 2024-09-21T06:35:10.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.524+0000 7f472a5df640 1 --2- 172.21.15.63:0/1417063009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4724108cf0 0x7f472410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:10.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.524+0000 7f472a5df640 1 --2- 172.21.15.63:0/1417063009 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47241083a0 0x7f47241087b0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:10.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.524+0000 7f472a5df640 1 --2- 172.21.15.63:0/1417063009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4724102a60 0x7f4724102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:10.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.524+0000 7f472a5df640 1 -- 172.21.15.63:0/1417063009 >> 172.21.15.63:0/1417063009 conn(0x7f4724079730 msgr2=0x7f4724079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:10.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.524+0000 7f472a5df640 1 -- 172.21.15.63:0/1417063009 shutdown_connections 2024-09-21T06:35:10.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.524+0000 7f472a5df640 1 -- 172.21.15.63:0/1417063009 wait complete. 2024-09-21T06:35:10.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.525+0000 7f472a5df640 1 Processor -- start 2024-09-21T06:35:10.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.525+0000 7f472a5df640 1 -- start start 2024-09-21T06:35:10.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.526+0000 7f472a5df640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4724102a60 0x7f472419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:10.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.526+0000 7f472a5df640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47241083a0 0x7f472419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:10.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.526+0000 7f472a5df640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4724108cf0 0x7f472419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:10.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.526+0000 7f472a5df640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4724113a80 con 0x7f4724102a60 2024-09-21T06:35:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.526+0000 7f472a5df640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4724113900 con 0x7f47241083a0 2024-09-21T06:35:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.526+0000 7f472a5df640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4724113c00 con 0x7f4724108cf0 2024-09-21T06:35:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.526+0000 7f4723fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4724102a60 0x7f472419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.526+0000 7f4723fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4724102a60 0x7f472419a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55128/0 (socket says 172.21.15.63:55128) 2024-09-21T06:35:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.526+0000 7f4723fff640 1 -- 172.21.15.63:0/2119025955 learned_addr learned my addr 172.21.15.63:0/2119025955 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.526+0000 7f4728b7c640 1 --2- 172.21.15.63:0/2119025955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4724108cf0 0x7f472419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.526+0000 7f47237fe640 1 --2- 172.21.15.63:0/2119025955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47241083a0 0x7f472419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.526+0000 7f4723fff640 1 -- 172.21.15.63:0/2119025955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4724108cf0 msgr2=0x7f472419fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.526+0000 7f4723fff640 1 --2- 172.21.15.63:0/2119025955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4724108cf0 0x7f472419fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.526+0000 7f4723fff640 1 -- 172.21.15.63:0/2119025955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47241083a0 msgr2=0x7f472419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.526+0000 7f4723fff640 1 --2- 172.21.15.63:0/2119025955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47241083a0 0x7f472419aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.526+0000 7f4723fff640 1 -- 172.21.15.63:0/2119025955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47241a0480 con 0x7f4724102a60 2024-09-21T06:35:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.526+0000 7f4723fff640 1 --2- 172.21.15.63:0/2119025955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4724102a60 0x7f472419a510 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f471400e9f0 tx=0x7f471400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:10.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.526+0000 7f47217fa640 1 -- 172.21.15.63:0/2119025955 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471400cd80 con 0x7f4724102a60 2024-09-21T06:35:10.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.527+0000 7f47217fa640 1 -- 172.21.15.63:0/2119025955 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47140108e0 con 0x7f4724102a60 2024-09-21T06:35:10.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.527+0000 7f47217fa640 1 -- 172.21.15.63:0/2119025955 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4714018980 con 0x7f4724102a60 2024-09-21T06:35:10.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.527+0000 7f472a5df640 1 -- 172.21.15.63:0/2119025955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47241a0770 con 0x7f4724102a60 2024-09-21T06:35:10.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.527+0000 7f472a5df640 1 -- 172.21.15.63:0/2119025955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47241a6ed0 con 0x7f4724102a60 2024-09-21T06:35:10.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.528+0000 7f472a5df640 1 -- 172.21.15.63:0/2119025955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4724102e70 con 0x7f4724102a60 2024-09-21T06:35:10.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.530+0000 7f47217fa640 1 -- 172.21.15.63:0/2119025955 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f4714010430 con 0x7f4724102a60 2024-09-21T06:35:10.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.531+0000 7f47217fa640 1 --2- 172.21.15.63:0/2119025955 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f470c0b6680 0x7f470c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:10.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.531+0000 7f47237fe640 1 --2- 172.21.15.63:0/2119025955 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f470c0b6680 0x7f470c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:10.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.531+0000 7f47217fa640 1 -- 172.21.15.63:0/2119025955 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8637+0+0 (secure 0 0 0) 0x7f47140e7ff0 con 0x7f4724102a60 2024-09-21T06:35:10.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.532+0000 7f47237fe640 1 --2- 172.21.15.63:0/2119025955 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f470c0b6680 0x7f470c0b8b90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4718000c00 tx=0x7f4718031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:10.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.534+0000 7f47217fa640 1 -- 172.21.15.63:0/2119025955 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f47140ae4d0 con 0x7f4724102a60 2024-09-21T06:35:10.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.759+0000 7f472a5df640 1 -- 172.21.15.63:0/2119025955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f472402e640 con 0x7f4724102a60 2024-09-21T06:35:10.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.760+0000 7f47217fa640 1 -- 172.21.15.63:0/2119025955 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+11983 (secure 0 0 0) 0x7f47140b28b0 con 0x7f4724102a60 2024-09-21T06:35:10.762 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:35:10.762 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":53,"btime":"2024-09-21T06:34:09:066423+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":53,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:34:08.127095+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24659,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":34,"state":"up:active","state_seq":69,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25637":{"gid":25637,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3354670524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3354670524},{"type":"v1","addr":"172.21.15.71:6839","nonce":3354670524}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24659,"qdb_cluster":[24694,24670,24659,24676,14835]},"id":1}]} 2024-09-21T06:35:10.762 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 53 2024-09-21T06:35:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.762+0000 7f472a5df640 1 -- 172.21.15.63:0/2119025955 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f470c0b6680 msgr2=0x7f470c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.762+0000 7f472a5df640 1 --2- 172.21.15.63:0/2119025955 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f470c0b6680 0x7f470c0b8b90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4718000c00 tx=0x7f4718031400 comp rx=0 tx=0).stop 2024-09-21T06:35:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.762+0000 7f472a5df640 1 -- 172.21.15.63:0/2119025955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4724102a60 msgr2=0x7f472419a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.762+0000 7f472a5df640 1 --2- 172.21.15.63:0/2119025955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4724102a60 0x7f472419a510 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f471400e9f0 tx=0x7f471400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:35:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.762+0000 7f472a5df640 1 -- 172.21.15.63:0/2119025955 shutdown_connections 2024-09-21T06:35:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.762+0000 7f472a5df640 1 --2- 172.21.15.63:0/2119025955 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f470c0b6680 0x7f470c0b8b90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.762+0000 7f472a5df640 1 --2- 172.21.15.63:0/2119025955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4724108cf0 0x7f472419fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.762+0000 7f472a5df640 1 --2- 172.21.15.63:0/2119025955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47241083a0 0x7f472419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.762+0000 7f472a5df640 1 --2- 172.21.15.63:0/2119025955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4724102a60 0x7f472419a510 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:10.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.762+0000 7f472a5df640 1 -- 172.21.15.63:0/2119025955 >> 172.21.15.63:0/2119025955 conn(0x7f4724079730 msgr2=0x7f47241044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:10.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.762+0000 7f472a5df640 1 -- 172.21.15.63:0/2119025955 shutdown_connections 2024-09-21T06:35:10.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:10.762+0000 7f472a5df640 1 -- 172.21.15.63:0/2119025955 wait complete. 2024-09-21T06:35:11.445 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:11 smithi063 ceph-mon[31150]: pgmap v533: 97 pgs: 3 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 90 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-21T06:35:11.445 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:11 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2119025955' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:11.475 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T06:35:11.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:11 smithi071 ceph-mon[34844]: pgmap v533: 97 pgs: 3 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 90 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-21T06:35:11.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:11 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2119025955' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:11 smithi175 ceph-mon[34510]: pgmap v533: 97 pgs: 3 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 90 active+clean; 257 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-21T06:35:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:11 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2119025955' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:11.734 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:12.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.234+0000 7f736d5ce640 1 -- 172.21.15.63:0/2028674169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7368103210 msgr2=0x7f7368103620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:12.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.234+0000 7f736d5ce640 1 --2- 172.21.15.63:0/2028674169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7368103210 0x7f7368103620 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f7358009900 tx=0x7f735802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.234+0000 7f736d5ce640 1 -- 172.21.15.63:0/2028674169 shutdown_connections 2024-09-21T06:35:12.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.234+0000 7f736d5ce640 1 --2- 172.21.15.63:0/2028674169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7368105b30 0x7f736810f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.234+0000 7f736d5ce640 1 --2- 172.21.15.63:0/2028674169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73681051e0 0x7f73681055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.234+0000 7f736d5ce640 1 --2- 172.21.15.63:0/2028674169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7368103210 0x7f7368103620 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.234+0000 7f736d5ce640 1 -- 172.21.15.63:0/2028674169 >> 172.21.15.63:0/2028674169 conn(0x7f7368079f90 msgr2=0x7f736807a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:12.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.234+0000 7f736d5ce640 1 -- 172.21.15.63:0/2028674169 shutdown_connections 2024-09-21T06:35:12.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.234+0000 7f736d5ce640 1 -- 172.21.15.63:0/2028674169 wait complete. 2024-09-21T06:35:12.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.235+0000 7f736d5ce640 1 Processor -- start 2024-09-21T06:35:12.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.235+0000 7f736d5ce640 1 -- start start 2024-09-21T06:35:12.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.235+0000 7f736d5ce640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7368103210 0x7f73680fedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.235+0000 7f736d5ce640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73681051e0 0x7f73680ff330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.235+0000 7f736d5ce640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7368105b30 0x7f73680ff870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.235+0000 7f736d5ce640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f73681129d0 con 0x7f7368103210 2024-09-21T06:35:12.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.235+0000 7f736d5ce640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7368112850 con 0x7f7368105b30 2024-09-21T06:35:12.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.235+0000 7f736d5ce640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7368112b50 con 0x7f73681051e0 2024-09-21T06:35:12.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.235+0000 7f7366ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7368103210 0x7f73680fedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.235+0000 7f7366ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7368103210 0x7f73680fedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55146/0 (socket says 172.21.15.63:55146) 2024-09-21T06:35:12.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.235+0000 7f7366ffd640 1 -- 172.21.15.63:0/1111348081 learned_addr learned my addr 172.21.15.63:0/1111348081 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:12.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.235+0000 7f73667fc640 1 --2- 172.21.15.63:0/1111348081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73681051e0 0x7f73680ff330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.235+0000 7f73677fe640 1 --2- 172.21.15.63:0/1111348081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7368105b30 0x7f73680ff870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.236+0000 7f7366ffd640 1 -- 172.21.15.63:0/1111348081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73681051e0 msgr2=0x7f73680ff330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:12.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.236+0000 7f7366ffd640 1 --2- 172.21.15.63:0/1111348081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73681051e0 0x7f73680ff330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.236+0000 7f7366ffd640 1 -- 172.21.15.63:0/1111348081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7368105b30 msgr2=0x7f73680ff870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:12.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.236+0000 7f7366ffd640 1 --2- 172.21.15.63:0/1111348081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7368105b30 0x7f73680ff870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.236+0000 7f7366ffd640 1 -- 172.21.15.63:0/1111348081 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73681a8700 con 0x7f7368103210 2024-09-21T06:35:12.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.236+0000 7f7366ffd640 1 --2- 172.21.15.63:0/1111348081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7368103210 0x7f73680fedf0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7358005940 tx=0x7f73580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:12.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.236+0000 7f734ffff640 1 -- 172.21.15.63:0/1111348081 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735803f030 con 0x7f7368103210 2024-09-21T06:35:12.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.236+0000 7f734ffff640 1 -- 172.21.15.63:0/1111348081 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7358003cb0 con 0x7f7368103210 2024-09-21T06:35:12.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.236+0000 7f736d5ce640 1 -- 172.21.15.63:0/1111348081 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73681a8990 con 0x7f7368103210 2024-09-21T06:35:12.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.236+0000 7f734ffff640 1 -- 172.21.15.63:0/1111348081 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358035070 con 0x7f7368103210 2024-09-21T06:35:12.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.236+0000 7f736d5ce640 1 -- 172.21.15.63:0/1111348081 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73681a8e70 con 0x7f7368103210 2024-09-21T06:35:12.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.238+0000 7f7373b42740 1 Processor -- start 2024-09-21T06:35:12.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.239+0000 7f7373b42740 1 -- start start 2024-09-21T06:35:12.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.239+0000 7f734ffff640 1 -- 172.21.15.63:0/1111348081 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f7358042030 con 0x7f7368103210 2024-09-21T06:35:12.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.239+0000 7f7373b42740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613b612c070 0x5613b64d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.239+0000 7f7373b42740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b61031b0 0x5613b64d3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.239+0000 7f7373b42740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b610b390 0x5613b64d3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.239+0000 7f7373b42740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5613b6449ea0 con 0x5613b61031b0 2024-09-21T06:35:12.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.239+0000 7f7373b42740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5613b64392d0 con 0x5613b610b390 2024-09-21T06:35:12.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.239+0000 7f7373b42740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5613b643d0e0 con 0x5613b612c070 2024-09-21T06:35:12.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.239+0000 7f7366ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b61031b0 0x5613b64d3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.239+0000 7f73677fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613b612c070 0x5613b64d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.239+0000 7f7366ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b61031b0 0x5613b64d3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55162/0 (socket says 172.21.15.63:55162) 2024-09-21T06:35:12.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.239+0000 7f7366ffd640 1 -- 172.21.15.63:0/1800304626 learned_addr learned my addr 172.21.15.63:0/1800304626 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:12.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.239+0000 7f73667fc640 1 --2- 172.21.15.63:0/1800304626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b610b390 0x5613b64d3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.239+0000 7f7366ffd640 1 -- 172.21.15.63:0/1800304626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613b612c070 msgr2=0x5613b64d32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:12.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.239+0000 7f7366ffd640 1 --2- 172.21.15.63:0/1800304626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613b612c070 0x5613b64d32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.239+0000 7f7366ffd640 1 -- 172.21.15.63:0/1800304626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b610b390 msgr2=0x5613b64d3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:12.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.239+0000 7f7366ffd640 1 --2- 172.21.15.63:0/1800304626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b610b390 0x5613b64d3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.239+0000 7f7366ffd640 1 -- 172.21.15.63:0/1800304626 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613b6197650 con 0x5613b61031b0 2024-09-21T06:35:12.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.239+0000 7f73667fc640 1 --2- 172.21.15.63:0/1800304626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b610b390 0x5613b64d3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:12.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.240+0000 7f7366ffd640 1 --2- 172.21.15.63:0/1800304626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b61031b0 0x5613b64d3800 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7358105740 tx=0x7f7358110540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45dda0749b5f4ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:12.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.240+0000 7f734ffff640 1 --2- 172.21.15.63:0/1111348081 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f73500b6680 0x7f73500b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.240+0000 7f734d7fa640 1 -- 172.21.15.63:0/1800304626 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73580ca520 con 0x5613b61031b0 2024-09-21T06:35:12.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.240+0000 7f73677fe640 1 --2- 172.21.15.63:0/1111348081 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f73500b6680 0x7f73500b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.240+0000 7f734ffff640 1 -- 172.21.15.63:0/1111348081 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8637+0+0 (secure 0 0 0) 0x7f73581080f0 con 0x7f7368103210 2024-09-21T06:35:12.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.240+0000 7f734d7fa640 1 -- 172.21.15.63:0/1800304626 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7358115030 con 0x5613b61031b0 2024-09-21T06:35:12.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.240+0000 7f734d7fa640 1 -- 172.21.15.63:0/1800304626 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73580cd640 con 0x5613b61031b0 2024-09-21T06:35:12.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.241+0000 7f7373b42740 1 -- 172.21.15.63:0/1800304626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b61031b0 msgr2=0x5613b64d3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:12.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.241+0000 7f73677fe640 1 --2- 172.21.15.63:0/1111348081 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f73500b6680 0x7f73500b8b90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7360005fd0 tx=0x7f73600096e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:12.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.241+0000 7f7373b42740 1 --2- 172.21.15.63:0/1800304626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b61031b0 0x5613b64d3800 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7358105740 tx=0x7f7358110540 comp rx=0 tx=0).stop 2024-09-21T06:35:12.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.241+0000 7f7373b42740 1 -- 172.21.15.63:0/1800304626 shutdown_connections 2024-09-21T06:35:12.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.241+0000 7f7373b42740 1 --2- 172.21.15.63:0/1800304626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b610b390 0x5613b64d3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.241+0000 7f7373b42740 1 --2- 172.21.15.63:0/1800304626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b61031b0 0x5613b64d3800 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.241+0000 7f7373b42740 1 --2- 172.21.15.63:0/1800304626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613b612c070 0x5613b64d32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.241+0000 7f7373b42740 1 -- 172.21.15.63:0/1800304626 >> 172.21.15.63:0/1800304626 conn(0x5613b6120460 msgr2=0x5613b64d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:12.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.241+0000 7f7373b42740 1 -- 172.21.15.63:0/1800304626 shutdown_connections 2024-09-21T06:35:12.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.241+0000 7f7373b42740 1 -- 172.21.15.63:0/1800304626 wait complete. 2024-09-21T06:35:12.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.241+0000 7f7373b42740 1 -- start start 2024-09-21T06:35:12.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.241+0000 7f7373b42740 1 Processor -- start 2024-09-21T06:35:12.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.242+0000 7f7373b42740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b61031b0 0x5613b64de990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.242+0000 7f7373b42740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b610b390 0x5613b64deed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.242+0000 7f7373b42740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613b612c070 0x5613b64eaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.242+0000 7f7373b42740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5613b629a700 con 0x5613b610b390 2024-09-21T06:35:12.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.242+0000 7f7373b42740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5613b63d4160 con 0x5613b61031b0 2024-09-21T06:35:12.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.242+0000 7f7373b42740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5613b64e1860 con 0x5613b612c070 2024-09-21T06:35:12.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.242+0000 7f7373b42740 10 client.0 _ll_register_callbacks cb 0x5613b63ed9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:12.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.242+0000 7f73667fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b610b390 0x5613b64deed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.242+0000 7f73667fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b610b390 0x5613b64deed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55176/0 (socket says 172.21.15.63:55176) 2024-09-21T06:35:12.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.242+0000 7f73667fc640 1 -- 172.21.15.63:0/3005326672 learned_addr learned my addr 172.21.15.63:0/3005326672 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:12.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.242+0000 7f7366ffd640 1 --2- 172.21.15.63:0/3005326672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b61031b0 0x5613b64de990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.242+0000 7f73677fe640 1 --2- 172.21.15.63:0/3005326672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613b612c070 0x5613b64eaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.242+0000 7f73667fc640 1 -- 172.21.15.63:0/3005326672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613b612c070 msgr2=0x5613b64eaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:12.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.242+0000 7f73667fc640 1 --2- 172.21.15.63:0/3005326672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613b612c070 0x5613b64eaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.242+0000 7f73667fc640 1 -- 172.21.15.63:0/3005326672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b61031b0 msgr2=0x5613b64de990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:12.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.242+0000 7f73667fc640 1 --2- 172.21.15.63:0/3005326672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b61031b0 0x5613b64de990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.242+0000 7f73667fc640 1 -- 172.21.15.63:0/3005326672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613b6401c90 con 0x5613b610b390 2024-09-21T06:35:12.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.243+0000 7f73667fc640 1 --2- 172.21.15.63:0/3005326672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b610b390 0x5613b64deed0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f735c010810 tx=0x7f735c010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68696db6a19fcd99 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:12.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.243+0000 7f734aff5640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:35:12.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.243+0000 7f734aff5640 1 -- 172.21.15.63:0/3005326672 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c00ed40 con 0x5613b610b390 2024-09-21T06:35:12.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.243+0000 7f734aff5640 1 -- 172.21.15.63:0/3005326672 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8637+0+0 (secure 0 0 0) 0x7f735c01c480 con 0x5613b610b390 2024-09-21T06:35:12.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.243+0000 7f7373b42740 1 -- 172.21.15.63:0/3005326672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7358115030 con 0x5613b610b390 2024-09-21T06:35:12.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.243+0000 7f734aff5640 1 -- 172.21.15.63:0/3005326672 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f735c01c680 con 0x5613b610b390 2024-09-21T06:35:12.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.243+0000 7f7373b42740 10 client.16911 fetch_fsmap learned FSMap version 53 2024-09-21T06:35:12.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.243+0000 7f7373b42740 1 -- 172.21.15.63:0/3005326672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5613b64ed500 con 0x5613b610b390 2024-09-21T06:35:12.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.243+0000 7f734aff5640 1 -- 172.21.15.63:0/3005326672 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7358115030 con 0x5613b610b390 2024-09-21T06:35:12.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.243+0000 7f734aff5640 1 -- 172.21.15.63:0/3005326672 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7f735c011750 con 0x5613b610b390 2024-09-21T06:35:12.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.243+0000 7f7373b42740 10 client.16911 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:35:12.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.243+0000 7f7373b42740 10 client.16911 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:35:12.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.243+0000 7f7373b42740 20 client.16911 populate_metadata read hostname 'smithi063' 2024-09-21T06:35:12.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.243+0000 7f7373b42740 1 --2- 172.21.15.63:0/3005326672 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5613b60ea9f0 0x5613b64f0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.243+0000 7f7373b42740 4 client.16911 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:35:12.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.243+0000 7f7373b42740 1 -- 172.21.15.63:0/3005326672 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613b644bdf0 con 0x5613b60ea9f0 2024-09-21T06:35:12.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.244+0000 7f7366ffd640 1 --2- 172.21.15.63:0/3005326672 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5613b60ea9f0 0x5613b64f0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.244+0000 7f734aff5640 10 client.16911 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:35:12.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.244+0000 7f7366ffd640 1 --2- 172.21.15.63:0/3005326672 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5613b60ea9f0 0x5613b64f0a80 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7bd331a1dd740616 server_cookie=933478ac66ed89e7 in_seq=0 out_seq=0 2024-09-21T06:35:12.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.245+0000 7f734aff5640 1 -- 172.21.15.63:0/3005326672 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5613b644bdf0 con 0x5613b60ea9f0 2024-09-21T06:35:12.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.245+0000 7f734aff5640 10 client.16911 handle_command_reply: tid=0 2024-09-21T06:35:12.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.245+0000 7f7373b42740 1 client.16911 shutdown 2024-09-21T06:35:12.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.245+0000 7f7373b42740 1 -- 172.21.15.63:0/3005326672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b610b390 msgr2=0x5613b64deed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:12.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.245+0000 7f7373b42740 1 --2- 172.21.15.63:0/3005326672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b610b390 0x5613b64deed0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f735c010810 tx=0x7f735c010cd0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.245+0000 7f7373b42740 1 -- 172.21.15.63:0/3005326672 shutdown_connections 2024-09-21T06:35:12.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.245+0000 7f7373b42740 1 --2- 172.21.15.63:0/3005326672 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5613b60ea9f0 0x5613b64f0a80 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.245+0000 7f7373b42740 1 --2- 172.21.15.63:0/3005326672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613b612c070 0x5613b64eaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.245+0000 7f7373b42740 1 --2- 172.21.15.63:0/3005326672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b610b390 0x5613b64deed0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.245+0000 7f7373b42740 1 --2- 172.21.15.63:0/3005326672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b61031b0 0x5613b64de990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.245+0000 7f7373b42740 1 -- 172.21.15.63:0/3005326672 >> 172.21.15.63:0/3005326672 conn(0x5613b6120460 msgr2=0x5613b64d42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:12.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.245+0000 7f734aff5640 0 client.16911 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:35:12.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.245+0000 7f7373b42740 1 -- 172.21.15.63:0/3005326672 shutdown_connections 2024-09-21T06:35:12.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.245+0000 7f7373b42740 1 -- 172.21.15.63:0/3005326672 wait complete. 2024-09-21T06:35:12.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.245+0000 7f7373b42740 20 client.16911 trim_cache size 0 max 16384 2024-09-21T06:35:12.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.258+0000 7f7373b42740 1 Processor -- start 2024-09-21T06:35:12.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.258+0000 7f7373b42740 1 -- start start 2024-09-21T06:35:12.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.258+0000 7f7373b42740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b61031b0 0x5613b64d4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.258+0000 7f7373b42740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613b610b390 0x5613b64d0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.258+0000 7f7373b42740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b612c070 0x5613b64d0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.258+0000 7f7373b42740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f73681b1a40 con 0x5613b61031b0 2024-09-21T06:35:12.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.258+0000 7f7373b42740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f73681b3640 con 0x5613b612c070 2024-09-21T06:35:12.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.258+0000 7f7373b42740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f73681b2110 con 0x5613b610b390 2024-09-21T06:35:12.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.259+0000 7f7366ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b61031b0 0x5613b64d4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.259+0000 7f7366ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b61031b0 0x5613b64d4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55178/0 (socket says 172.21.15.63:55178) 2024-09-21T06:35:12.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.259+0000 7f7366ffd640 1 -- 172.21.15.63:0/2117909371 learned_addr learned my addr 172.21.15.63:0/2117909371 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:12.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.259+0000 7f73667fc640 1 --2- 172.21.15.63:0/2117909371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613b610b390 0x5613b64d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.259+0000 7f7366ffd640 1 -- 172.21.15.63:0/2117909371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613b610b390 msgr2=0x5613b64d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:12.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.259+0000 7f7366ffd640 1 --2- 172.21.15.63:0/2117909371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613b610b390 0x5613b64d0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.259+0000 7f7366ffd640 1 -- 172.21.15.63:0/2117909371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b612c070 msgr2=0x5613b64d0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:12.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.259+0000 7f73677fe640 1 --2- 172.21.15.63:0/2117909371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b612c070 0x5613b64d0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.259+0000 7f7366ffd640 1 --2- 172.21.15.63:0/2117909371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b612c070 0x5613b64d0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.259+0000 7f7366ffd640 1 -- 172.21.15.63:0/2117909371 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613b64d6120 con 0x5613b61031b0 2024-09-21T06:35:12.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.259+0000 7f73677fe640 1 --2- 172.21.15.63:0/2117909371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b612c070 0x5613b64d0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:12.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.259+0000 7f7366ffd640 1 --2- 172.21.15.63:0/2117909371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b61031b0 0x5613b64d4a00 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f73580cdbd0 tx=0x7f735802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583cb1e910970975 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:12.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.259+0000 7f734cff9640 1 -- 172.21.15.63:0/2117909371 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358049040 con 0x5613b61031b0 2024-09-21T06:35:12.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.259+0000 7f734cff9640 1 -- 172.21.15.63:0/2117909371 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7358115040 con 0x5613b61031b0 2024-09-21T06:35:12.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.259+0000 7f734cff9640 1 -- 172.21.15.63:0/2117909371 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73580cd820 con 0x5613b61031b0 2024-09-21T06:35:12.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.260+0000 7f7373b42740 1 -- 172.21.15.63:0/2117909371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b61031b0 msgr2=0x5613b64d4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:12.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.260+0000 7f7373b42740 1 --2- 172.21.15.63:0/2117909371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b61031b0 0x5613b64d4a00 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f73580cdbd0 tx=0x7f735802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.260+0000 7f7373b42740 1 -- 172.21.15.63:0/2117909371 shutdown_connections 2024-09-21T06:35:12.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.260+0000 7f7373b42740 1 --2- 172.21.15.63:0/2117909371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b612c070 0x5613b64d0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.260+0000 7f7373b42740 1 --2- 172.21.15.63:0/2117909371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613b610b390 0x5613b64d0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.260+0000 7f7373b42740 1 --2- 172.21.15.63:0/2117909371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b61031b0 0x5613b64d4a00 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.260+0000 7f7373b42740 1 -- 172.21.15.63:0/2117909371 >> 172.21.15.63:0/2117909371 conn(0x5613b6120460 msgr2=0x5613b64d42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:12.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.260+0000 7f7373b42740 1 -- 172.21.15.63:0/2117909371 shutdown_connections 2024-09-21T06:35:12.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.260+0000 7f7373b42740 1 -- 172.21.15.63:0/2117909371 wait complete. 2024-09-21T06:35:12.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.261+0000 7f7373b42740 1 -- start start 2024-09-21T06:35:12.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.261+0000 7f7373b42740 1 Processor -- start 2024-09-21T06:35:12.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.261+0000 7f7373b42740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b61031b0 0x5613b64e2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.261+0000 7f7373b42740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b610b390 0x5613b64e2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.261+0000 7f7373b42740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613b612c070 0x5613b64e3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.261+0000 7f7373b42740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f73681b2f70 con 0x5613b610b390 2024-09-21T06:35:12.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.261+0000 7f7373b42740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f73681b2870 con 0x5613b61031b0 2024-09-21T06:35:12.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.261+0000 7f7373b42740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f73681afa40 con 0x5613b612c070 2024-09-21T06:35:12.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.261+0000 7f7373b42740 10 client.0 _ll_register_callbacks cb 0x7f735c00c410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:12.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.261+0000 7f73667fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b610b390 0x5613b64e2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.261+0000 7f73667fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b610b390 0x5613b64e2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55180/0 (socket says 172.21.15.63:55180) 2024-09-21T06:35:12.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.261+0000 7f73667fc640 1 -- 172.21.15.63:0/2883376086 learned_addr learned my addr 172.21.15.63:0/2883376086 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:12.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.261+0000 7f7366ffd640 1 --2- 172.21.15.63:0/2883376086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b61031b0 0x5613b64e2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.261+0000 7f73677fe640 1 --2- 172.21.15.63:0/2883376086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613b612c070 0x5613b64e3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.262+0000 7f73667fc640 1 -- 172.21.15.63:0/2883376086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613b612c070 msgr2=0x5613b64e3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:12.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.262+0000 7f73667fc640 1 --2- 172.21.15.63:0/2883376086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613b612c070 0x5613b64e3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.262+0000 7f73667fc640 1 -- 172.21.15.63:0/2883376086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b61031b0 msgr2=0x5613b64e2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:12.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.262+0000 7f73667fc640 1 --2- 172.21.15.63:0/2883376086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b61031b0 0x5613b64e2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.262+0000 7f73667fc640 1 -- 172.21.15.63:0/2883376086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613b655a4f0 con 0x5613b610b390 2024-09-21T06:35:12.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.262+0000 7f73667fc640 1 --2- 172.21.15.63:0/2883376086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b610b390 0x5613b64e2f50 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f735c011bf0 tx=0x7f735c00e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d509088135a187 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:12.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.262+0000 7f734aff5640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:35:12.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.262+0000 7f734aff5640 1 -- 172.21.15.63:0/2883376086 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c028040 con 0x5613b610b390 2024-09-21T06:35:12.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.262+0000 7f734aff5640 1 -- 172.21.15.63:0/2883376086 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8637+0+0 (secure 0 0 0) 0x7f735c01c480 con 0x5613b610b390 2024-09-21T06:35:12.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.262+0000 7f7373b42740 1 -- 172.21.15.63:0/2883376086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7358115040 con 0x5613b610b390 2024-09-21T06:35:12.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.262+0000 7f734aff5640 1 -- 172.21.15.63:0/2883376086 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f735c03a050 con 0x5613b610b390 2024-09-21T06:35:12.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.262+0000 7f7373b42740 10 client.16917 fetch_fsmap learned FSMap version 53 2024-09-21T06:35:12.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.262+0000 7f7373b42740 1 -- 172.21.15.63:0/2883376086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5613b655b6e0 con 0x5613b610b390 2024-09-21T06:35:12.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.262+0000 7f734aff5640 1 -- 172.21.15.63:0/2883376086 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7358115040 con 0x5613b610b390 2024-09-21T06:35:12.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.263+0000 7f734aff5640 1 -- 172.21.15.63:0/2883376086 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7f735c005140 con 0x5613b610b390 2024-09-21T06:35:12.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.263+0000 7f7373b42740 10 client.16917 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:35:12.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.263+0000 7f7373b42740 10 client.16917 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:35:12.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.263+0000 7f7373b42740 20 client.16917 populate_metadata read hostname 'smithi063' 2024-09-21T06:35:12.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.263+0000 7f7373b42740 1 --2- 172.21.15.63:0/2883376086 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5613b60bfda0 0x5613b655df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.263+0000 7f7373b42740 4 client.16917 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:35:12.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.263+0000 7f7373b42740 1 -- 172.21.15.63:0/2883376086 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5613b64478a0 con 0x5613b60bfda0 2024-09-21T06:35:12.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.263+0000 7f7366ffd640 1 --2- 172.21.15.63:0/2883376086 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5613b60bfda0 0x5613b655df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.263+0000 7f734aff5640 10 client.16917 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:35:12.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.263+0000 7f7366ffd640 1 --2- 172.21.15.63:0/2883376086 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5613b60bfda0 0x5613b655df70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=91c11e287443d242 server_cookie=fd9b2379b203858a in_seq=0 out_seq=0 2024-09-21T06:35:12.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.263+0000 7f734aff5640 1 -- 172.21.15.63:0/2883376086 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5613b64478a0 con 0x5613b60bfda0 2024-09-21T06:35:12.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.263+0000 7f734aff5640 10 client.16917 handle_command_reply: tid=0 2024-09-21T06:35:12.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.263+0000 7f7373b42740 1 client.16917 shutdown 2024-09-21T06:35:12.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.264+0000 7f7373b42740 1 -- 172.21.15.63:0/2883376086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b610b390 msgr2=0x5613b64e2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:12.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.264+0000 7f7373b42740 1 --2- 172.21.15.63:0/2883376086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b610b390 0x5613b64e2f50 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f735c011bf0 tx=0x7f735c00e7c0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.264+0000 7f7373b42740 1 -- 172.21.15.63:0/2883376086 shutdown_connections 2024-09-21T06:35:12.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.264+0000 7f7373b42740 1 --2- 172.21.15.63:0/2883376086 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5613b60bfda0 0x5613b655df70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.264+0000 7f7373b42740 1 --2- 172.21.15.63:0/2883376086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5613b612c070 0x5613b64e3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.264+0000 7f7373b42740 1 --2- 172.21.15.63:0/2883376086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5613b610b390 0x5613b64e2f50 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.264+0000 7f7373b42740 1 --2- 172.21.15.63:0/2883376086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5613b61031b0 0x5613b64e2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.264+0000 7f7373b42740 1 -- 172.21.15.63:0/2883376086 >> 172.21.15.63:0/2883376086 conn(0x5613b6120460 msgr2=0x5613b64d42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:12.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.264+0000 7f734aff5640 0 client.16917 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:35:12.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.264+0000 7f7373b42740 1 -- 172.21.15.63:0/2883376086 shutdown_connections 2024-09-21T06:35:12.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.264+0000 7f7373b42740 1 -- 172.21.15.63:0/2883376086 wait complete. 2024-09-21T06:35:12.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.264+0000 7f7373b42740 20 client.16917 trim_cache size 0 max 16384 2024-09-21T06:35:12.271 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:35:12.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.264+0000 7f736d5ce640 1 -- 172.21.15.63:0/1111348081 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f73500b6680 msgr2=0x7f73500b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:12.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.264+0000 7f736d5ce640 1 --2- 172.21.15.63:0/1111348081 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f73500b6680 0x7f73500b8b90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7360005fd0 tx=0x7f73600096e0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.264+0000 7f736d5ce640 1 -- 172.21.15.63:0/1111348081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7368103210 msgr2=0x7f73680fedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:12.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.264+0000 7f736d5ce640 1 --2- 172.21.15.63:0/1111348081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7368103210 0x7f73680fedf0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7358005940 tx=0x7f73580042f0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.265+0000 7f736d5ce640 1 -- 172.21.15.63:0/1111348081 shutdown_connections 2024-09-21T06:35:12.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.265+0000 7f736d5ce640 1 --2- 172.21.15.63:0/1111348081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7368105b30 0x7f73680ff870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.265+0000 7f736d5ce640 1 --2- 172.21.15.63:0/1111348081 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f73500b6680 0x7f73500b8b90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.265+0000 7f736d5ce640 1 --2- 172.21.15.63:0/1111348081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73681051e0 0x7f73680ff330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.265+0000 7f736d5ce640 1 --2- 172.21.15.63:0/1111348081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7368103210 0x7f73680fedf0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.265+0000 7f736d5ce640 1 -- 172.21.15.63:0/1111348081 >> 172.21.15.63:0/1111348081 conn(0x7f7368079f90 msgr2=0x7f7368101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:12.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.265+0000 7f736d5ce640 1 -- 172.21.15.63:0/1111348081 shutdown_connections 2024-09-21T06:35:12.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:12.265+0000 7f736d5ce640 1 -- 172.21.15.63:0/1111348081 wait complete. 2024-09-21T06:35:13.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:13 smithi071 ceph-mon[34844]: pgmap v534: 97 pgs: 3 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 90 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:35:13.522 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:13 smithi063 ceph-mon[31150]: pgmap v534: 97 pgs: 3 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 90 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:35:13.558 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:35:13.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:13 smithi175 ceph-mon[34510]: pgmap v534: 97 pgs: 3 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 90 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:35:13.824 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:14.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.285+0000 7f318f9bf640 1 -- 172.21.15.63:0/734659581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f318810de40 msgr2=0x7f3188110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:14.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.285+0000 7f318f9bf640 1 --2- 172.21.15.63:0/734659581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f318810de40 0x7f3188110330 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3178009ca0 tx=0x7f317802a8e0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.285+0000 7f318f9bf640 1 -- 172.21.15.63:0/734659581 shutdown_connections 2024-09-21T06:35:14.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.285+0000 7f318f9bf640 1 --2- 172.21.15.63:0/734659581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f318810de40 0x7f3188110330 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.285+0000 7f318f9bf640 1 --2- 172.21.15.63:0/734659581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3188105330 0x7f318810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.285+0000 7f318f9bf640 1 --2- 172.21.15.63:0/734659581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31881049e0 0x7f3188104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.285+0000 7f318f9bf640 1 -- 172.21.15.63:0/734659581 >> 172.21.15.63:0/734659581 conn(0x7f3188079750 msgr2=0x7f3188079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:14.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.285+0000 7f318f9bf640 1 -- 172.21.15.63:0/734659581 shutdown_connections 2024-09-21T06:35:14.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.285+0000 7f318f9bf640 1 -- 172.21.15.63:0/734659581 wait complete. 2024-09-21T06:35:14.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.286+0000 7f318f9bf640 1 Processor -- start 2024-09-21T06:35:14.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.286+0000 7f318f9bf640 1 -- start start 2024-09-21T06:35:14.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.286+0000 7f318f9bf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31881049e0 0x7f3188102720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.286+0000 7f318f9bf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3188105330 0x7f3188102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.286+0000 7f318f9bf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f318810de40 0x7f31881031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.286+0000 7f318f9bf640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3188113ba0 con 0x7f31881049e0 2024-09-21T06:35:14.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.286+0000 7f318f9bf640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3188113a20 con 0x7f318810de40 2024-09-21T06:35:14.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.286+0000 7f318f9bf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3188113d20 con 0x7f3188105330 2024-09-21T06:35:14.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.286+0000 7f318d75b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31881049e0 0x7f3188102720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.286+0000 7f318d75b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31881049e0 0x7f3188102720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55194/0 (socket says 172.21.15.63:55194) 2024-09-21T06:35:14.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.286+0000 7f318d75b640 1 -- 172.21.15.63:0/3446121159 learned_addr learned my addr 172.21.15.63:0/3446121159 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:14.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.287+0000 7f318cf5a640 1 --2- 172.21.15.63:0/3446121159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3188105330 0x7f3188102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.287+0000 7f318df5c640 1 --2- 172.21.15.63:0/3446121159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f318810de40 0x7f31881031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.287+0000 7f318d75b640 1 -- 172.21.15.63:0/3446121159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3188105330 msgr2=0x7f3188102c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:14.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.287+0000 7f318d75b640 1 --2- 172.21.15.63:0/3446121159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3188105330 0x7f3188102c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.287+0000 7f318d75b640 1 -- 172.21.15.63:0/3446121159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f318810de40 msgr2=0x7f31881031a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:14.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.287+0000 7f318d75b640 1 --2- 172.21.15.63:0/3446121159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f318810de40 0x7f31881031a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.287+0000 7f318d75b640 1 -- 172.21.15.63:0/3446121159 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31881a8870 con 0x7f31881049e0 2024-09-21T06:35:14.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.287+0000 7f318d75b640 1 --2- 172.21.15.63:0/3446121159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31881049e0 0x7f3188102720 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f318000b450 tx=0x7f318000b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:14.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.287+0000 7f31867fc640 1 -- 172.21.15.63:0/3446121159 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3180015020 con 0x7f31881049e0 2024-09-21T06:35:14.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.287+0000 7f31867fc640 1 -- 172.21.15.63:0/3446121159 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3180011ce0 con 0x7f31881049e0 2024-09-21T06:35:14.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.287+0000 7f318f9bf640 1 -- 172.21.15.63:0/3446121159 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31881a8b60 con 0x7f31881049e0 2024-09-21T06:35:14.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.287+0000 7f31867fc640 1 -- 172.21.15.63:0/3446121159 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3180010dc0 con 0x7f31881049e0 2024-09-21T06:35:14.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.287+0000 7f318f9bf640 1 -- 172.21.15.63:0/3446121159 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31881a90a0 con 0x7f31881049e0 2024-09-21T06:35:14.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.290+0000 7f3195f33740 1 Processor -- start 2024-09-21T06:35:14.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.290+0000 7f3195f33740 1 -- start start 2024-09-21T06:35:14.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.291+0000 7f3195f33740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68e6070 0x55f7e6c8d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.291+0000 7f31867fc640 1 -- 172.21.15.63:0/3446121159 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f3180018020 con 0x7f31881049e0 2024-09-21T06:35:14.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.291+0000 7f3195f33740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68bd1b0 0x55f7e6c8dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.291+0000 7f3195f33740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68c5390 0x55f7e6c8e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.291+0000 7f3195f33740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f7e6c03ea0 con 0x55f7e68e6070 2024-09-21T06:35:14.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.291+0000 7f3195f33740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f7e6bf32d0 con 0x55f7e68c5390 2024-09-21T06:35:14.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.291+0000 7f3195f33740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f7e6bf70e0 con 0x55f7e68bd1b0 2024-09-21T06:35:14.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.291+0000 7f318df5c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68e6070 0x55f7e6c8d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.291+0000 7f318df5c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68e6070 0x55f7e6c8d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55204/0 (socket says 172.21.15.63:55204) 2024-09-21T06:35:14.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.291+0000 7f318df5c640 1 -- 172.21.15.63:0/2589962142 learned_addr learned my addr 172.21.15.63:0/2589962142 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:14.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.291+0000 7f318cf5a640 1 --2- 172.21.15.63:0/2589962142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68c5390 0x55f7e6c8e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.291+0000 7f318d75b640 1 --2- 172.21.15.63:0/2589962142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68bd1b0 0x55f7e6c8dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.291+0000 7f318df5c640 1 -- 172.21.15.63:0/2589962142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68bd1b0 msgr2=0x55f7e6c8dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:14.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.291+0000 7f318df5c640 1 --2- 172.21.15.63:0/2589962142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68bd1b0 0x55f7e6c8dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.291+0000 7f318df5c640 1 -- 172.21.15.63:0/2589962142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68c5390 msgr2=0x55f7e6c8e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:14.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.291+0000 7f318df5c640 1 --2- 172.21.15.63:0/2589962142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68c5390 0x55f7e6c8e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.291+0000 7f318df5c640 1 -- 172.21.15.63:0/2589962142 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7e6951650 con 0x55f7e68e6070 2024-09-21T06:35:14.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.291+0000 7f318df5c640 1 --2- 172.21.15.63:0/2589962142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68e6070 0x55f7e6c8d6a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f31780315a0 tx=0x7f3178009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74bcf71df11588a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:14.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.292+0000 7f316f7fe640 1 -- 172.21.15.63:0/2589962142 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178031ad0 con 0x55f7e68e6070 2024-09-21T06:35:14.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.292+0000 7f316f7fe640 1 -- 172.21.15.63:0/2589962142 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3178036040 con 0x55f7e68e6070 2024-09-21T06:35:14.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.292+0000 7f316f7fe640 1 -- 172.21.15.63:0/2589962142 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31780044f0 con 0x55f7e68e6070 2024-09-21T06:35:14.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.292+0000 7f31867fc640 1 --2- 172.21.15.63:0/3446121159 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f31700b6680 0x7f31700b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.292+0000 7f318d75b640 1 --2- 172.21.15.63:0/3446121159 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f31700b6680 0x7f31700b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.292+0000 7f31867fc640 1 -- 172.21.15.63:0/3446121159 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8637+0+0 (secure 0 0 0) 0x7f31800e6f80 con 0x7f31881049e0 2024-09-21T06:35:14.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.293+0000 7f3195f33740 1 -- 172.21.15.63:0/2589962142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68e6070 msgr2=0x55f7e6c8d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:14.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.293+0000 7f318d75b640 1 --2- 172.21.15.63:0/3446121159 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f31700b6680 0x7f31700b8b90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f31800e4710 tx=0x7f31800e9040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:14.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.293+0000 7f3195f33740 1 --2- 172.21.15.63:0/2589962142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68e6070 0x55f7e6c8d6a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f31780315a0 tx=0x7f3178009a20 comp rx=0 tx=0).stop 2024-09-21T06:35:14.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.293+0000 7f3195f33740 1 -- 172.21.15.63:0/2589962142 shutdown_connections 2024-09-21T06:35:14.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.293+0000 7f3195f33740 1 --2- 172.21.15.63:0/2589962142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68c5390 0x55f7e6c8e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.293+0000 7f3195f33740 1 --2- 172.21.15.63:0/2589962142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68bd1b0 0x55f7e6c8dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.293+0000 7f3195f33740 1 --2- 172.21.15.63:0/2589962142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68e6070 0x55f7e6c8d6a0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.293+0000 7f3195f33740 1 -- 172.21.15.63:0/2589962142 >> 172.21.15.63:0/2589962142 conn(0x55f7e68da460 msgr2=0x55f7e6c8b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:14.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.293+0000 7f3195f33740 1 -- 172.21.15.63:0/2589962142 shutdown_connections 2024-09-21T06:35:14.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.293+0000 7f3195f33740 1 -- 172.21.15.63:0/2589962142 wait complete. 2024-09-21T06:35:14.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.293+0000 7f3195f33740 1 -- start start 2024-09-21T06:35:14.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.293+0000 7f3195f33740 1 Processor -- start 2024-09-21T06:35:14.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.294+0000 7f3195f33740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68bd1b0 0x55f7e6c98cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.294+0000 7f3195f33740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68c5390 0x55f7e6c99200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.294+0000 7f3195f33740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68e6070 0x55f7e6c99760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.294+0000 7f3195f33740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f7e6a54700 con 0x55f7e68bd1b0 2024-09-21T06:35:14.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.294+0000 7f3195f33740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f7e6b8e160 con 0x55f7e68e6070 2024-09-21T06:35:14.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.294+0000 7f3195f33740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f7e6c9be20 con 0x55f7e68c5390 2024-09-21T06:35:14.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.294+0000 7f3195f33740 10 client.0 _ll_register_callbacks cb 0x55f7e6ba79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:14.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.294+0000 7f318df5c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68bd1b0 0x55f7e6c98cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.294+0000 7f318df5c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68bd1b0 0x55f7e6c98cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55206/0 (socket says 172.21.15.63:55206) 2024-09-21T06:35:14.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.294+0000 7f318df5c640 1 -- 172.21.15.63:0/1479966803 learned_addr learned my addr 172.21.15.63:0/1479966803 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:14.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.294+0000 7f318df5c640 1 --2- 172.21.15.63:0/1479966803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68e6070 0x55f7e6c99760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.294+0000 7f318cf5a640 1 --2- 172.21.15.63:0/1479966803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68c5390 0x55f7e6c99200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.294+0000 7f318df5c640 1 -- 172.21.15.63:0/1479966803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68c5390 msgr2=0x55f7e6c99200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:14.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.294+0000 7f318df5c640 1 --2- 172.21.15.63:0/1479966803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68c5390 0x55f7e6c99200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.294+0000 7f318df5c640 1 -- 172.21.15.63:0/1479966803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68e6070 msgr2=0x55f7e6c99760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:14.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.294+0000 7f318df5c640 1 --2- 172.21.15.63:0/1479966803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68e6070 0x55f7e6c99760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.294+0000 7f318df5c640 1 -- 172.21.15.63:0/1479966803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7e6bbbc90 con 0x55f7e68bd1b0 2024-09-21T06:35:14.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.294+0000 7f318cf5a640 1 --2- 172.21.15.63:0/1479966803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68c5390 0x55f7e6c99200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:14.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.295+0000 7f318df5c640 1 --2- 172.21.15.63:0/1479966803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68bd1b0 0x55f7e6c98cc0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3178004150 tx=0x7f3178009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106554d697b49bf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:14.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.295+0000 7f316cff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:35:14.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.295+0000 7f316cff9640 1 -- 172.21.15.63:0/1479966803 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178056060 con 0x55f7e68bd1b0 2024-09-21T06:35:14.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.295+0000 7f316cff9640 1 -- 172.21.15.63:0/1479966803 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8637+0+0 (secure 0 0 0) 0x7f3178003970 con 0x55f7e68bd1b0 2024-09-21T06:35:14.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.295+0000 7f3195f33740 1 -- 172.21.15.63:0/1479966803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3178036040 con 0x55f7e68bd1b0 2024-09-21T06:35:14.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.295+0000 7f316cff9640 1 -- 172.21.15.63:0/1479966803 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f3178003b70 con 0x55f7e68bd1b0 2024-09-21T06:35:14.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.295+0000 7f3195f33740 10 client.16929 fetch_fsmap learned FSMap version 53 2024-09-21T06:35:14.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.295+0000 7f3195f33740 1 -- 172.21.15.63:0/1479966803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55f7e6ca7aa0 con 0x55f7e68bd1b0 2024-09-21T06:35:14.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.295+0000 7f316cff9640 1 -- 172.21.15.63:0/1479966803 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3178036040 con 0x55f7e68bd1b0 2024-09-21T06:35:14.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.295+0000 7f316cff9640 1 -- 172.21.15.63:0/1479966803 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7f31780307e0 con 0x55f7e68bd1b0 2024-09-21T06:35:14.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.295+0000 7f3195f33740 10 client.16929 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:35:14.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.295+0000 7f3195f33740 10 client.16929 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:35:14.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.295+0000 7f3195f33740 20 client.16929 populate_metadata read hostname 'smithi063' 2024-09-21T06:35:14.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.295+0000 7f3195f33740 1 --2- 172.21.15.63:0/1479966803 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f7e68a49f0 0x55f7e6caae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.296+0000 7f3195f33740 4 client.16929 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:35:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.296+0000 7f3195f33740 1 -- 172.21.15.63:0/1479966803 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7e6c05df0 con 0x55f7e68a49f0 2024-09-21T06:35:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.296+0000 7f318cf5a640 1 --2- 172.21.15.63:0/1479966803 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f7e68a49f0 0x55f7e6caae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.296+0000 7f318cf5a640 1 --2- 172.21.15.63:0/1479966803 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f7e68a49f0 0x55f7e6caae00 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a726c9e42a88c08d server_cookie=753d86ffdfdfc681 in_seq=0 out_seq=0 2024-09-21T06:35:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.296+0000 7f316cff9640 10 client.16929 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:35:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.297+0000 7f316cff9640 1 -- 172.21.15.63:0/1479966803 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f7e6c05df0 con 0x55f7e68a49f0 2024-09-21T06:35:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.297+0000 7f316cff9640 10 client.16929 handle_command_reply: tid=0 2024-09-21T06:35:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.297+0000 7f3195f33740 1 client.16929 shutdown 2024-09-21T06:35:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.297+0000 7f3195f33740 1 -- 172.21.15.63:0/1479966803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68bd1b0 msgr2=0x55f7e6c98cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.297+0000 7f3195f33740 1 --2- 172.21.15.63:0/1479966803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68bd1b0 0x55f7e6c98cc0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3178004150 tx=0x7f3178009c30 comp rx=0 tx=0).stop 2024-09-21T06:35:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.297+0000 7f3195f33740 1 -- 172.21.15.63:0/1479966803 shutdown_connections 2024-09-21T06:35:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.297+0000 7f3195f33740 1 --2- 172.21.15.63:0/1479966803 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f7e68a49f0 0x55f7e6caae00 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.297+0000 7f3195f33740 1 --2- 172.21.15.63:0/1479966803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68e6070 0x55f7e6c99760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.297+0000 7f3195f33740 1 --2- 172.21.15.63:0/1479966803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68c5390 0x55f7e6c99200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.297+0000 7f316cff9640 0 client.16929 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:35:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.297+0000 7f3195f33740 1 --2- 172.21.15.63:0/1479966803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68bd1b0 0x55f7e6c98cc0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.297+0000 7f3195f33740 1 -- 172.21.15.63:0/1479966803 >> 172.21.15.63:0/1479966803 conn(0x55f7e68da460 msgr2=0x55f7e6c90880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:14.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.297+0000 7f3195f33740 1 -- 172.21.15.63:0/1479966803 shutdown_connections 2024-09-21T06:35:14.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.297+0000 7f3195f33740 1 -- 172.21.15.63:0/1479966803 wait complete. 2024-09-21T06:35:14.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.298+0000 7f3195f33740 20 client.16929 trim_cache size 0 max 16384 2024-09-21T06:35:14.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.311+0000 7f3195f33740 1 Processor -- start 2024-09-21T06:35:14.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.311+0000 7f3195f33740 1 -- start start 2024-09-21T06:35:14.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.312+0000 7f3195f33740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68bd1b0 0x55f7e6c98a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.312+0000 7f3195f33740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68c5390 0x55f7e6c98fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.312+0000 7f3195f33740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68e6070 0x55f7e6c95eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.312+0000 7f3195f33740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f31881b1b90 con 0x55f7e68e6070 2024-09-21T06:35:14.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.312+0000 7f3195f33740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f31881b3790 con 0x55f7e68c5390 2024-09-21T06:35:14.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.312+0000 7f3195f33740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f31881b2260 con 0x55f7e68bd1b0 2024-09-21T06:35:14.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.312+0000 7f318df5c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68e6070 0x55f7e6c95eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.312+0000 7f318df5c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68e6070 0x55f7e6c95eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55222/0 (socket says 172.21.15.63:55222) 2024-09-21T06:35:14.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.312+0000 7f318cf5a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68c5390 0x55f7e6c98fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.312+0000 7f318df5c640 1 -- 172.21.15.63:0/1566655920 learned_addr learned my addr 172.21.15.63:0/1566655920 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:14.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.313+0000 7f318df5c640 1 --2- 172.21.15.63:0/1566655920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68bd1b0 0x55f7e6c98a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.313+0000 7f318df5c640 1 -- 172.21.15.63:0/1566655920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68bd1b0 msgr2=0x55f7e6c98a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:14.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.313+0000 7f318df5c640 1 --2- 172.21.15.63:0/1566655920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68bd1b0 0x55f7e6c98a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.313+0000 7f318df5c640 1 -- 172.21.15.63:0/1566655920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68c5390 msgr2=0x55f7e6c98fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:14.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.313+0000 7f318df5c640 1 --2- 172.21.15.63:0/1566655920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68c5390 0x55f7e6c98fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.313+0000 7f318df5c640 1 -- 172.21.15.63:0/1566655920 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7e6c971c0 con 0x55f7e68e6070 2024-09-21T06:35:14.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.313+0000 7f318cf5a640 1 --2- 172.21.15.63:0/1566655920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68c5390 0x55f7e6c98fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:35:14.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.313+0000 7f318df5c640 1 --2- 172.21.15.63:0/1566655920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68e6070 0x55f7e6c95eb0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3178005d50 tx=0x7f317803d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4db713872895b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:14.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.313+0000 7f316effd640 1 -- 172.21.15.63:0/1566655920 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178030dd0 con 0x55f7e68e6070 2024-09-21T06:35:14.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.313+0000 7f316effd640 1 -- 172.21.15.63:0/1566655920 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f317804a040 con 0x55f7e68e6070 2024-09-21T06:35:14.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.313+0000 7f316effd640 1 -- 172.21.15.63:0/1566655920 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178030920 con 0x55f7e68e6070 2024-09-21T06:35:14.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.314+0000 7f3195f33740 1 -- 172.21.15.63:0/1566655920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68e6070 msgr2=0x55f7e6c95eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:14.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.314+0000 7f3195f33740 1 --2- 172.21.15.63:0/1566655920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68e6070 0x55f7e6c95eb0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3178005d50 tx=0x7f317803d040 comp rx=0 tx=0).stop 2024-09-21T06:35:14.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.314+0000 7f3195f33740 1 -- 172.21.15.63:0/1566655920 shutdown_connections 2024-09-21T06:35:14.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.314+0000 7f3195f33740 1 --2- 172.21.15.63:0/1566655920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68e6070 0x55f7e6c95eb0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.314+0000 7f3195f33740 1 --2- 172.21.15.63:0/1566655920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68c5390 0x55f7e6c98fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.314+0000 7f3195f33740 1 --2- 172.21.15.63:0/1566655920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68bd1b0 0x55f7e6c98a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.314+0000 7f3195f33740 1 -- 172.21.15.63:0/1566655920 >> 172.21.15.63:0/1566655920 conn(0x55f7e68da460 msgr2=0x55f7e6c97540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:14.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.314+0000 7f3195f33740 1 -- 172.21.15.63:0/1566655920 shutdown_connections 2024-09-21T06:35:14.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.314+0000 7f3195f33740 1 -- 172.21.15.63:0/1566655920 wait complete. 2024-09-21T06:35:14.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.315+0000 7f3195f33740 1 -- start start 2024-09-21T06:35:14.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.315+0000 7f3195f33740 1 Processor -- start 2024-09-21T06:35:14.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.315+0000 7f3195f33740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68bd1b0 0x55f7e6cae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.315+0000 7f3195f33740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68c5390 0x55f7e6cabc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.315+0000 7f3195f33740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68e6070 0x55f7e6cac350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.315+0000 7f3195f33740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f31881b30c0 con 0x55f7e68c5390 2024-09-21T06:35:14.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.315+0000 7f3195f33740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f31881b29c0 con 0x55f7e68e6070 2024-09-21T06:35:14.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.315+0000 7f3195f33740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f31881afb90 con 0x55f7e68bd1b0 2024-09-21T06:35:14.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.315+0000 7f3195f33740 10 client.0 _ll_register_callbacks cb 0x7f317c0093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:14.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.316+0000 7f318cf5a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68c5390 0x55f7e6cabc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.316+0000 7f318cf5a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68c5390 0x55f7e6cabc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55238/0 (socket says 172.21.15.63:55238) 2024-09-21T06:35:14.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.316+0000 7f318df5c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68bd1b0 0x55f7e6cae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.316+0000 7f318cf5a640 1 -- 172.21.15.63:0/3102578887 learned_addr learned my addr 172.21.15.63:0/3102578887 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:14.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.316+0000 7f318df5c640 1 --2- 172.21.15.63:0/3102578887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68e6070 0x55f7e6cac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.316+0000 7f318cf5a640 1 -- 172.21.15.63:0/3102578887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68bd1b0 msgr2=0x55f7e6cae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:14.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.316+0000 7f318cf5a640 1 --2- 172.21.15.63:0/3102578887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68bd1b0 0x55f7e6cae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.316+0000 7f318cf5a640 1 -- 172.21.15.63:0/3102578887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68e6070 msgr2=0x55f7e6cac350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:14.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.316+0000 7f318cf5a640 1 --2- 172.21.15.63:0/3102578887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68e6070 0x55f7e6cac350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.316+0000 7f318cf5a640 1 -- 172.21.15.63:0/3102578887 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7e6d1cd90 con 0x55f7e68c5390 2024-09-21T06:35:14.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.316+0000 7f318df5c640 1 --2- 172.21.15.63:0/3102578887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68bd1b0 0x55f7e6cae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:35:14.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.316+0000 7f318cf5a640 1 --2- 172.21.15.63:0/3102578887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68c5390 0x55f7e6cabc80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f317c004810 tx=0x7f317c016af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1796647b46e4980c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:14.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.316+0000 7f316cff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:35:14.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.316+0000 7f316cff9640 1 -- 172.21.15.63:0/3102578887 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c0157b0 con 0x55f7e68c5390 2024-09-21T06:35:14.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.316+0000 7f316cff9640 1 -- 172.21.15.63:0/3102578887 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8637+0+0 (secure 0 0 0) 0x7f317c015950 con 0x55f7e68c5390 2024-09-21T06:35:14.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.317+0000 7f3195f33740 1 -- 172.21.15.63:0/3102578887 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f317804a040 con 0x55f7e68c5390 2024-09-21T06:35:14.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.317+0000 7f316cff9640 1 -- 172.21.15.63:0/3102578887 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f317c015b50 con 0x55f7e68c5390 2024-09-21T06:35:14.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.317+0000 7f3195f33740 10 client.16935 fetch_fsmap learned FSMap version 53 2024-09-21T06:35:14.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.317+0000 7f3195f33740 1 -- 172.21.15.63:0/3102578887 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55f7e6d1dec0 con 0x55f7e68c5390 2024-09-21T06:35:14.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.317+0000 7f316cff9640 1 -- 172.21.15.63:0/3102578887 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f317804a040 con 0x55f7e68c5390 2024-09-21T06:35:14.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.317+0000 7f316cff9640 1 -- 172.21.15.63:0/3102578887 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7f317c02e420 con 0x55f7e68c5390 2024-09-21T06:35:14.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.317+0000 7f3195f33740 10 client.16935 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:35:14.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.318+0000 7f3195f33740 10 client.16935 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:35:14.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.318+0000 7f3195f33740 20 client.16935 populate_metadata read hostname 'smithi063' 2024-09-21T06:35:14.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.318+0000 7f3195f33740 1 --2- 172.21.15.63:0/3102578887 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f7e6879da0 0x55f7e6d20600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.318+0000 7f3195f33740 4 client.16935 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:35:14.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.318+0000 7f3195f33740 1 -- 172.21.15.63:0/3102578887 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f7e6c018a0 con 0x55f7e6879da0 2024-09-21T06:35:14.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.318+0000 7f318df5c640 1 --2- 172.21.15.63:0/3102578887 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f7e6879da0 0x55f7e6d20600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.318+0000 7f316cff9640 10 client.16935 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:35:14.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.318+0000 7f318df5c640 1 --2- 172.21.15.63:0/3102578887 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f7e6879da0 0x55f7e6d20600 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6508773789758c6c server_cookie=833d00a526f8f0db in_seq=0 out_seq=0 2024-09-21T06:35:14.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.318+0000 7f316cff9640 1 -- 172.21.15.63:0/3102578887 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f7e6c018a0 con 0x55f7e6879da0 2024-09-21T06:35:14.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.318+0000 7f316cff9640 10 client.16935 handle_command_reply: tid=0 2024-09-21T06:35:14.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.318+0000 7f3195f33740 1 client.16935 shutdown 2024-09-21T06:35:14.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.319+0000 7f3195f33740 1 -- 172.21.15.63:0/3102578887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68c5390 msgr2=0x55f7e6cabc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:14.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.319+0000 7f3195f33740 1 --2- 172.21.15.63:0/3102578887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68c5390 0x55f7e6cabc80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f317c004810 tx=0x7f317c016af0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.319+0000 7f3195f33740 1 -- 172.21.15.63:0/3102578887 shutdown_connections 2024-09-21T06:35:14.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.319+0000 7f3195f33740 1 --2- 172.21.15.63:0/3102578887 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f7e6879da0 0x55f7e6d20600 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.319+0000 7f3195f33740 1 --2- 172.21.15.63:0/3102578887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f7e68e6070 0x55f7e6cac350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.319+0000 7f3195f33740 1 --2- 172.21.15.63:0/3102578887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f7e68c5390 0x55f7e6cabc80 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.319+0000 7f316cff9640 0 client.16935 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:35:14.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.319+0000 7f3195f33740 1 --2- 172.21.15.63:0/3102578887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7e68bd1b0 0x55f7e6cae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.319+0000 7f3195f33740 1 -- 172.21.15.63:0/3102578887 >> 172.21.15.63:0/3102578887 conn(0x55f7e68da460 msgr2=0x55f7e6c973d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:14.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.319+0000 7f3195f33740 1 -- 172.21.15.63:0/3102578887 shutdown_connections 2024-09-21T06:35:14.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.319+0000 7f3195f33740 1 -- 172.21.15.63:0/3102578887 wait complete. 2024-09-21T06:35:14.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.319+0000 7f3195f33740 20 client.16935 trim_cache size 0 max 16384 2024-09-21T06:35:14.324 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:35:14.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.320+0000 7f318f9bf640 1 -- 172.21.15.63:0/3446121159 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f31700b6680 msgr2=0x7f31700b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:14.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.320+0000 7f318f9bf640 1 --2- 172.21.15.63:0/3446121159 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f31700b6680 0x7f31700b8b90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f31800e4710 tx=0x7f31800e9040 comp rx=0 tx=0).stop 2024-09-21T06:35:14.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.320+0000 7f318f9bf640 1 -- 172.21.15.63:0/3446121159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31881049e0 msgr2=0x7f3188102720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:14.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.320+0000 7f318f9bf640 1 --2- 172.21.15.63:0/3446121159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31881049e0 0x7f3188102720 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f318000b450 tx=0x7f318000b850 comp rx=0 tx=0).stop 2024-09-21T06:35:14.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.320+0000 7f318f9bf640 1 -- 172.21.15.63:0/3446121159 shutdown_connections 2024-09-21T06:35:14.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.320+0000 7f318f9bf640 1 --2- 172.21.15.63:0/3446121159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f318810de40 0x7f31881031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.320+0000 7f318f9bf640 1 --2- 172.21.15.63:0/3446121159 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f31700b6680 0x7f31700b8b90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.320+0000 7f318f9bf640 1 --2- 172.21.15.63:0/3446121159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3188105330 0x7f3188102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.320+0000 7f318f9bf640 1 --2- 172.21.15.63:0/3446121159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31881049e0 0x7f3188102720 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.320+0000 7f318f9bf640 1 -- 172.21.15.63:0/3446121159 >> 172.21.15.63:0/3446121159 conn(0x7f3188079750 msgr2=0x7f3188100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:14.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.320+0000 7f318f9bf640 1 -- 172.21.15.63:0/3446121159 shutdown_connections 2024-09-21T06:35:14.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:14.320+0000 7f318f9bf640 1 -- 172.21.15.63:0/3446121159 wait complete. 2024-09-21T06:35:15.079 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T06:35:15.340 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:15.475 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:15 smithi063 ceph-mon[31150]: pgmap v535: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:35:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:15 smithi071 ceph-mon[34844]: pgmap v535: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:35:15.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:15 smithi175 ceph-mon[34510]: pgmap v535: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:35:15.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.861+0000 7f719ad2d640 1 -- 172.21.15.63:0/3294226583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7194106c80 msgr2=0x7f71941106d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:15.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.861+0000 7f719ad2d640 1 --2- 172.21.15.63:0/3294226583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7194106c80 0x7f71941106d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f718c009900 tx=0x7f718c02a410 comp rx=0 tx=0).stop 2024-09-21T06:35:15.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.861+0000 7f719ad2d640 1 -- 172.21.15.63:0/3294226583 shutdown_connections 2024-09-21T06:35:15.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.861+0000 7f719ad2d640 1 --2- 172.21.15.63:0/3294226583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7194106c80 0x7f71941106d0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.861+0000 7f719ad2d640 1 --2- 172.21.15.63:0/3294226583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7194106330 0x7f7194106740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.861+0000 7f719ad2d640 1 --2- 172.21.15.63:0/3294226583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7194102140 0x7f7194102550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.861+0000 7f719ad2d640 1 -- 172.21.15.63:0/3294226583 >> 172.21.15.63:0/3294226583 conn(0x7f7194079ea0 msgr2=0x7f719407a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:15.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.862+0000 7f719ad2d640 1 -- 172.21.15.63:0/3294226583 shutdown_connections 2024-09-21T06:35:15.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.862+0000 7f719ad2d640 1 -- 172.21.15.63:0/3294226583 wait complete. 2024-09-21T06:35:15.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.862+0000 7f719ad2d640 1 Processor -- start 2024-09-21T06:35:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.862+0000 7f719ad2d640 1 -- start start 2024-09-21T06:35:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.863+0000 7f719ad2d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7194102140 0x7f719419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.863+0000 7f719ad2d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7194106330 0x7f719419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.863+0000 7f719ad2d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7194106c80 0x7f719419fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.863+0000 7f719ad2d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7194113b70 con 0x7f7194106330 2024-09-21T06:35:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.863+0000 7f719ad2d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f71941139f0 con 0x7f7194102140 2024-09-21T06:35:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.863+0000 7f719ad2d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7194113cf0 con 0x7f7194106c80 2024-09-21T06:35:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.863+0000 7f718bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7194106330 0x7f719419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.863+0000 7f718bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7194106330 0x7f719419ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55246/0 (socket says 172.21.15.63:55246) 2024-09-21T06:35:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.863+0000 7f718bfff640 1 -- 172.21.15.63:0/4087887662 learned_addr learned my addr 172.21.15.63:0/4087887662 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.863+0000 7f7198ac9640 1 --2- 172.21.15.63:0/4087887662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7194102140 0x7f719419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.863+0000 7f71992ca640 1 --2- 172.21.15.63:0/4087887662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7194106c80 0x7f719419fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.863+0000 7f718bfff640 1 -- 172.21.15.63:0/4087887662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7194106c80 msgr2=0x7f719419fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:15.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.863+0000 7f718bfff640 1 --2- 172.21.15.63:0/4087887662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7194106c80 0x7f719419fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.863+0000 7f718bfff640 1 -- 172.21.15.63:0/4087887662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7194102140 msgr2=0x7f719419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:15.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.863+0000 7f718bfff640 1 --2- 172.21.15.63:0/4087887662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7194102140 0x7f719419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.863+0000 7f718bfff640 1 -- 172.21.15.63:0/4087887662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71941a0530 con 0x7f7194106330 2024-09-21T06:35:15.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.863+0000 7f7198ac9640 1 --2- 172.21.15.63:0/4087887662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7194102140 0x7f719419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:15.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.863+0000 7f718bfff640 1 --2- 172.21.15.63:0/4087887662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7194106330 0x7f719419ab60 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f718400d740 tx=0x7f718400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:15.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.864+0000 7f7189ffb640 1 -- 172.21.15.63:0/4087887662 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7184017070 con 0x7f7194106330 2024-09-21T06:35:15.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.864+0000 7f7189ffb640 1 -- 172.21.15.63:0/4087887662 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f718400de50 con 0x7f7194106330 2024-09-21T06:35:15.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.864+0000 7f719ad2d640 1 -- 172.21.15.63:0/4087887662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71941a0820 con 0x7f7194106330 2024-09-21T06:35:15.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.864+0000 7f7189ffb640 1 -- 172.21.15.63:0/4087887662 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7184004ce0 con 0x7f7194106330 2024-09-21T06:35:15.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.864+0000 7f719ad2d640 1 -- 172.21.15.63:0/4087887662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71941a6f80 con 0x7f7194106330 2024-09-21T06:35:15.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.866+0000 7f7189ffb640 1 -- 172.21.15.63:0/4087887662 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f7184004e80 con 0x7f7194106330 2024-09-21T06:35:15.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.867+0000 7f71a12a1740 1 Processor -- start 2024-09-21T06:35:15.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.867+0000 7f71a12a1740 1 -- start start 2024-09-21T06:35:15.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.867+0000 7f71a12a1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557011258070 0x5570115ff2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.867+0000 7f71a12a1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55701122f1b0 0x5570115ff800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.867+0000 7f71a12a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557011237390 0x5570115ffd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.867+0000 7f71a12a1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x557011575ea0 con 0x55701122f1b0 2024-09-21T06:35:15.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.867+0000 7f71a12a1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5570115652d0 con 0x557011258070 2024-09-21T06:35:15.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.867+0000 7f71a12a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5570115690e0 con 0x557011237390 2024-09-21T06:35:15.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.867+0000 7f7198ac9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55701122f1b0 0x5570115ff800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.867+0000 7f7198ac9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55701122f1b0 0x5570115ff800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55256/0 (socket says 172.21.15.63:55256) 2024-09-21T06:35:15.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.867+0000 7f7198ac9640 1 -- 172.21.15.63:0/1379981363 learned_addr learned my addr 172.21.15.63:0/1379981363 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:15.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.867+0000 7f71992ca640 1 --2- 172.21.15.63:0/1379981363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557011258070 0x5570115ff2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.867+0000 7f718bfff640 1 --2- 172.21.15.63:0/1379981363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557011237390 0x5570115ffd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.868+0000 7f7189ffb640 1 --2- 172.21.15.63:0/4087887662 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f717c0b6700 0x7f717c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.868+0000 7f7198ac9640 1 -- 172.21.15.63:0/1379981363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557011237390 msgr2=0x5570115ffd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.868+0000 7f7198ac9640 1 --2- 172.21.15.63:0/1379981363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557011237390 0x5570115ffd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.868+0000 7f7198ac9640 1 -- 172.21.15.63:0/1379981363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557011258070 msgr2=0x5570115ff2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.868+0000 7f7198ac9640 1 --2- 172.21.15.63:0/1379981363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557011258070 0x5570115ff2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.868+0000 7f7198ac9640 1 -- 172.21.15.63:0/1379981363 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570112c3650 con 0x55701122f1b0 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.868+0000 7f71992ca640 1 --2- 172.21.15.63:0/4087887662 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f717c0b6700 0x7f717c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.868+0000 7f7189ffb640 1 -- 172.21.15.63:0/4087887662 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8637+0+0 (secure 0 0 0) 0x7f71840e7120 con 0x7f7194106330 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.868+0000 7f7198ac9640 1 --2- 172.21.15.63:0/1379981363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55701122f1b0 0x5570115ff800 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f71900103a0 tx=0x7f7190010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7bdd4a920b678b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.868+0000 7f717affd640 1 -- 172.21.15.63:0/1379981363 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7190016070 con 0x55701122f1b0 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.868+0000 7f717affd640 1 -- 172.21.15.63:0/1379981363 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7190012bc0 con 0x55701122f1b0 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.868+0000 7f717affd640 1 -- 172.21.15.63:0/1379981363 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719001bcb0 con 0x55701122f1b0 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.869+0000 7f71a12a1740 1 -- 172.21.15.63:0/1379981363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55701122f1b0 msgr2=0x5570115ff800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.869+0000 7f71a12a1740 1 --2- 172.21.15.63:0/1379981363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55701122f1b0 0x5570115ff800 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f71900103a0 tx=0x7f7190010860 comp rx=0 tx=0).stop 2024-09-21T06:35:15.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.869+0000 7f71992ca640 1 --2- 172.21.15.63:0/4087887662 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f717c0b6700 0x7f717c0b8c10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f718c031440 tx=0x7f718c009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:15.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.869+0000 7f71a12a1740 1 -- 172.21.15.63:0/1379981363 shutdown_connections 2024-09-21T06:35:15.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.869+0000 7f71a12a1740 1 --2- 172.21.15.63:0/1379981363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557011237390 0x5570115ffd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.869+0000 7f71a12a1740 1 --2- 172.21.15.63:0/1379981363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55701122f1b0 0x5570115ff800 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.869+0000 7f71a12a1740 1 --2- 172.21.15.63:0/1379981363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557011258070 0x5570115ff2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.869+0000 7f71a12a1740 1 -- 172.21.15.63:0/1379981363 >> 172.21.15.63:0/1379981363 conn(0x55701124c460 msgr2=0x5570115fd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:15.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.869+0000 7f71a12a1740 1 -- 172.21.15.63:0/1379981363 shutdown_connections 2024-09-21T06:35:15.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.869+0000 7f71a12a1740 1 -- 172.21.15.63:0/1379981363 wait complete. 2024-09-21T06:35:15.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.870+0000 7f71a12a1740 1 -- start start 2024-09-21T06:35:15.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.870+0000 7f71a12a1740 1 Processor -- start 2024-09-21T06:35:15.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.871+0000 7f71a12a1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55701122f1b0 0x55701160a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.871+0000 7f71a12a1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557011237390 0x55701160aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.871+0000 7f71a12a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557011258070 0x557011616dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.871+0000 7f71a12a1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5570113c6700 con 0x557011237390 2024-09-21T06:35:15.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.871+0000 7f71a12a1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557011500160 con 0x55701122f1b0 2024-09-21T06:35:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.871+0000 7f71a12a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55701160daa0 con 0x557011258070 2024-09-21T06:35:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.871+0000 7f71a12a1740 10 client.0 _ll_register_callbacks cb 0x5570115199e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.871+0000 7f718bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557011237390 0x55701160aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.871+0000 7f718bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557011237390 0x55701160aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55264/0 (socket says 172.21.15.63:55264) 2024-09-21T06:35:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.871+0000 7f718bfff640 1 -- 172.21.15.63:0/4108184844 learned_addr learned my addr 172.21.15.63:0/4108184844 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.871+0000 7f71992ca640 1 --2- 172.21.15.63:0/4108184844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557011258070 0x557011616dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.871+0000 7f7198ac9640 1 --2- 172.21.15.63:0/4108184844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55701122f1b0 0x55701160a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.871+0000 7f718bfff640 1 -- 172.21.15.63:0/4108184844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557011258070 msgr2=0x557011616dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.871+0000 7f718bfff640 1 --2- 172.21.15.63:0/4108184844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557011258070 0x557011616dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.871+0000 7f718bfff640 1 -- 172.21.15.63:0/4108184844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55701122f1b0 msgr2=0x55701160a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.871+0000 7f718bfff640 1 --2- 172.21.15.63:0/4108184844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55701122f1b0 0x55701160a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.871+0000 7f718bfff640 1 -- 172.21.15.63:0/4108184844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55701152dc90 con 0x557011237390 2024-09-21T06:35:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.871+0000 7f718bfff640 1 --2- 172.21.15.63:0/4108184844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557011237390 0x55701160aec0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7184009610 tx=0x7f71840ea850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62959c080e18dfae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.871+0000 7f7173fff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:35:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.872+0000 7f7173fff640 1 -- 172.21.15.63:0/4108184844 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7184020070 con 0x557011237390 2024-09-21T06:35:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.872+0000 7f7173fff640 1 -- 172.21.15.63:0/4108184844 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8637+0+0 (secure 0 0 0) 0x7f71840942f0 con 0x557011237390 2024-09-21T06:35:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.872+0000 7f71a12a1740 1 -- 172.21.15.63:0/4108184844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7190012bc0 con 0x557011237390 2024-09-21T06:35:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.872+0000 7f7173fff640 1 -- 172.21.15.63:0/4108184844 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f71840a8da0 con 0x557011237390 2024-09-21T06:35:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.872+0000 7f71a12a1740 10 client.16947 fetch_fsmap learned FSMap version 53 2024-09-21T06:35:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.872+0000 7f71a12a1740 1 -- 172.21.15.63:0/4108184844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5570116197d0 con 0x557011237390 2024-09-21T06:35:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.872+0000 7f7173fff640 1 -- 172.21.15.63:0/4108184844 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7190012bc0 con 0x557011237390 2024-09-21T06:35:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.872+0000 7f7173fff640 1 -- 172.21.15.63:0/4108184844 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7f71840a8850 con 0x557011237390 2024-09-21T06:35:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.872+0000 7f71a12a1740 10 client.16947 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:35:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.872+0000 7f71a12a1740 10 client.16947 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:35:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.872+0000 7f71a12a1740 20 client.16947 populate_metadata read hostname 'smithi063' 2024-09-21T06:35:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.872+0000 7f71a12a1740 1 --2- 172.21.15.63:0/4108184844 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5570112169f0 0x55701161cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.872+0000 7f71a12a1740 4 client.16947 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:35:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.872+0000 7f71a12a1740 1 -- 172.21.15.63:0/4108184844 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557011577df0 con 0x5570112169f0 2024-09-21T06:35:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.873+0000 7f7198ac9640 1 --2- 172.21.15.63:0/4108184844 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5570112169f0 0x55701161cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.873+0000 7f7198ac9640 1 --2- 172.21.15.63:0/4108184844 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5570112169f0 0x55701161cca0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=299956d27dc17e51 server_cookie=f0c639fd88fd44e3 in_seq=0 out_seq=0 2024-09-21T06:35:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.873+0000 7f7173fff640 10 client.16947 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:35:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.874+0000 7f7173fff640 1 -- 172.21.15.63:0/4108184844 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557011577df0 con 0x5570112169f0 2024-09-21T06:35:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.874+0000 7f7173fff640 10 client.16947 handle_command_reply: tid=0 2024-09-21T06:35:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.874+0000 7f71a12a1740 1 client.16947 shutdown 2024-09-21T06:35:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.874+0000 7f71a12a1740 1 -- 172.21.15.63:0/4108184844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557011237390 msgr2=0x55701160aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.874+0000 7f71a12a1740 1 --2- 172.21.15.63:0/4108184844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557011237390 0x55701160aec0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7184009610 tx=0x7f71840ea850 comp rx=0 tx=0).stop 2024-09-21T06:35:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.874+0000 7f71a12a1740 1 -- 172.21.15.63:0/4108184844 shutdown_connections 2024-09-21T06:35:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.874+0000 7f71a12a1740 1 --2- 172.21.15.63:0/4108184844 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5570112169f0 0x55701161cca0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.874+0000 7f71a12a1740 1 --2- 172.21.15.63:0/4108184844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557011258070 0x557011616dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.874+0000 7f71a12a1740 1 --2- 172.21.15.63:0/4108184844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557011237390 0x55701160aec0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.874+0000 7f71a12a1740 1 --2- 172.21.15.63:0/4108184844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55701122f1b0 0x55701160a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.874+0000 7f7173fff640 0 client.16947 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:35:15.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.874+0000 7f71a12a1740 1 -- 172.21.15.63:0/4108184844 >> 172.21.15.63:0/4108184844 conn(0x55701124c460 msgr2=0x557011602450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:15.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.874+0000 7f71a12a1740 1 -- 172.21.15.63:0/4108184844 shutdown_connections 2024-09-21T06:35:15.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.874+0000 7f71a12a1740 1 -- 172.21.15.63:0/4108184844 wait complete. 2024-09-21T06:35:15.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.875+0000 7f71a12a1740 20 client.16947 trim_cache size 0 max 16384 2024-09-21T06:35:15.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.888+0000 7f71a12a1740 1 Processor -- start 2024-09-21T06:35:15.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.888+0000 7f71a12a1740 1 -- start start 2024-09-21T06:35:15.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.888+0000 7f71a12a1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55701122f1b0 0x557011600cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.888+0000 7f71a12a1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557011237390 0x55701160c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.888+0000 7f71a12a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557011258070 0x557011616cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.888+0000 7f71a12a1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f71941af9a0 con 0x557011237390 2024-09-21T06:35:15.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.888+0000 7f71a12a1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f71941b15a0 con 0x55701122f1b0 2024-09-21T06:35:15.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.888+0000 7f71a12a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f71941b0070 con 0x557011258070 2024-09-21T06:35:15.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.888+0000 7f718bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557011237390 0x55701160c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.888+0000 7f718bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557011237390 0x55701160c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55274/0 (socket says 172.21.15.63:55274) 2024-09-21T06:35:15.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.888+0000 7f718bfff640 1 -- 172.21.15.63:0/3419110883 learned_addr learned my addr 172.21.15.63:0/3419110883 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:15.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.888+0000 7f7198ac9640 1 --2- 172.21.15.63:0/3419110883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55701122f1b0 0x557011600cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.888+0000 7f718bfff640 1 -- 172.21.15.63:0/3419110883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557011258070 msgr2=0x557011616cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:15.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.888+0000 7f718bfff640 1 --2- 172.21.15.63:0/3419110883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557011258070 0x557011616cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.888+0000 7f718bfff640 1 -- 172.21.15.63:0/3419110883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55701122f1b0 msgr2=0x557011600cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:15.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.888+0000 7f718bfff640 1 --2- 172.21.15.63:0/3419110883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55701122f1b0 0x557011600cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.888+0000 7f718bfff640 1 -- 172.21.15.63:0/3419110883 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55701160b270 con 0x557011237390 2024-09-21T06:35:15.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.889+0000 7f718bfff640 1 --2- 172.21.15.63:0/3419110883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557011237390 0x55701160c5b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f7184012040 tx=0x7f7184009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f97dad636e322b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:15.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.889+0000 7f717a7fc640 1 -- 172.21.15.63:0/3419110883 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7184020070 con 0x557011237390 2024-09-21T06:35:15.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.889+0000 7f717a7fc640 1 -- 172.21.15.63:0/3419110883 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71840ad600 con 0x557011237390 2024-09-21T06:35:15.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.889+0000 7f717a7fc640 1 -- 172.21.15.63:0/3419110883 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71840e4c90 con 0x557011237390 2024-09-21T06:35:15.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.890+0000 7f71a12a1740 1 -- 172.21.15.63:0/3419110883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557011237390 msgr2=0x55701160c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:15.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.890+0000 7f71a12a1740 1 --2- 172.21.15.63:0/3419110883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557011237390 0x55701160c5b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f7184012040 tx=0x7f7184009e40 comp rx=0 tx=0).stop 2024-09-21T06:35:15.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.890+0000 7f71a12a1740 1 -- 172.21.15.63:0/3419110883 shutdown_connections 2024-09-21T06:35:15.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.890+0000 7f71a12a1740 1 --2- 172.21.15.63:0/3419110883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557011258070 0x557011616cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.890+0000 7f71a12a1740 1 --2- 172.21.15.63:0/3419110883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557011237390 0x55701160c5b0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.890+0000 7f71a12a1740 1 --2- 172.21.15.63:0/3419110883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55701122f1b0 0x557011600cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.890+0000 7f71a12a1740 1 -- 172.21.15.63:0/3419110883 >> 172.21.15.63:0/3419110883 conn(0x55701124c460 msgr2=0x55701160bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:15.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.890+0000 7f71a12a1740 1 -- 172.21.15.63:0/3419110883 shutdown_connections 2024-09-21T06:35:15.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.890+0000 7f71a12a1740 1 -- 172.21.15.63:0/3419110883 wait complete. 2024-09-21T06:35:15.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.890+0000 7f71a12a1740 1 -- start start 2024-09-21T06:35:15.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.890+0000 7f71a12a1740 1 Processor -- start 2024-09-21T06:35:15.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f71a12a1740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55701122f1b0 0x557011613600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f71a12a1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557011237390 0x55701160eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f71a12a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557011258070 0x55701160f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f71a12a1740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f71941b0ed0 con 0x55701122f1b0 2024-09-21T06:35:15.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f71a12a1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f71941b07d0 con 0x557011237390 2024-09-21T06:35:15.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f71a12a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f71941ad9a0 con 0x557011258070 2024-09-21T06:35:15.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f71a12a1740 10 client.0 _ll_register_callbacks cb 0x7f7184005ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:15.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f718bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557011237390 0x55701160eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f7198ac9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55701122f1b0 0x557011613600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f718bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557011237390 0x55701160eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:52740/0 (socket says 172.21.15.63:52740) 2024-09-21T06:35:15.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f718bfff640 1 -- 172.21.15.63:0/2026131136 learned_addr learned my addr 172.21.15.63:0/2026131136 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:15.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f7198ac9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55701122f1b0 0x557011613600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55276/0 (socket says 172.21.15.63:55276) 2024-09-21T06:35:15.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f71992ca640 1 --2- 172.21.15.63:0/2026131136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557011258070 0x55701160f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f718bfff640 1 -- 172.21.15.63:0/2026131136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557011258070 msgr2=0x55701160f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:15.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f718bfff640 1 --2- 172.21.15.63:0/2026131136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557011258070 0x55701160f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f718bfff640 1 -- 172.21.15.63:0/2026131136 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55701122f1b0 msgr2=0x557011613600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:15.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f718bfff640 1 --2- 172.21.15.63:0/2026131136 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55701122f1b0 0x557011613600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f718bfff640 1 -- 172.21.15.63:0/2026131136 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55701160f870 con 0x557011237390 2024-09-21T06:35:15.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f71992ca640 1 --2- 172.21.15.63:0/2026131136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557011258070 0x55701160f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:15.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f7198ac9640 1 --2- 172.21.15.63:0/2026131136 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55701122f1b0 0x557011613600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:35:15.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f718bfff640 1 --2- 172.21.15.63:0/2026131136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557011237390 0x55701160eab0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f71840acc00 tx=0x7f71840943a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c98a19526ce3e891 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:15.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.891+0000 7f7173fff640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:35:15.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.892+0000 7f7173fff640 1 -- 172.21.15.63:0/2026131136 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7184020040 con 0x557011237390 2024-09-21T06:35:15.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.892+0000 7f71a12a1740 1 -- 172.21.15.63:0/2026131136 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71840ad600 con 0x557011237390 2024-09-21T06:35:15.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.892+0000 7f7173fff640 1 -- 172.21.15.63:0/2026131136 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8637+0+0 (secure 0 0 0) 0x7f71840d41b0 con 0x557011237390 2024-09-21T06:35:15.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.892+0000 7f7173fff640 1 -- 172.21.15.63:0/2026131136 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f71840ac670 con 0x557011237390 2024-09-21T06:35:15.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.892+0000 7f71a12a1740 10 client.26525 fetch_fsmap learned FSMap version 53 2024-09-21T06:35:15.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.892+0000 7f71a12a1740 1 -- 172.21.15.63:0/2026131136 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5570116876a0 con 0x557011237390 2024-09-21T06:35:15.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.892+0000 7f7173fff640 1 -- 172.21.15.63:0/2026131136 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71840c6070 con 0x557011237390 2024-09-21T06:35:15.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.892+0000 7f7173fff640 1 -- 172.21.15.63:0/2026131136 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7f718405c080 con 0x557011237390 2024-09-21T06:35:15.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.892+0000 7f71a12a1740 10 client.26525 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:35:15.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.893+0000 7f71a12a1740 10 client.26525 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:35:15.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.893+0000 7f71a12a1740 20 client.26525 populate_metadata read hostname 'smithi063' 2024-09-21T06:35:15.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.893+0000 7f71a12a1740 1 --2- 172.21.15.63:0/2026131136 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5570111ebda0 0x557011689a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.893+0000 7f71a12a1740 4 client.26525 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:35:15.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.893+0000 7f71a12a1740 1 -- 172.21.15.63:0/2026131136 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5570115738a0 con 0x5570111ebda0 2024-09-21T06:35:15.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.893+0000 7f7198ac9640 1 --2- 172.21.15.63:0/2026131136 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5570111ebda0 0x557011689a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.893+0000 7f7173fff640 10 client.26525 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:35:15.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.893+0000 7f7198ac9640 1 --2- 172.21.15.63:0/2026131136 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5570111ebda0 0x557011689a20 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c85d15fb0d2b2991 server_cookie=95145c938344a199 in_seq=0 out_seq=0 2024-09-21T06:35:15.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.893+0000 7f7173fff640 1 -- 172.21.15.63:0/2026131136 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5570115738a0 con 0x5570111ebda0 2024-09-21T06:35:15.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.894+0000 7f7173fff640 10 client.26525 handle_command_reply: tid=0 2024-09-21T06:35:15.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.894+0000 7f71a12a1740 1 client.26525 shutdown 2024-09-21T06:35:15.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.894+0000 7f71a12a1740 1 -- 172.21.15.63:0/2026131136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557011237390 msgr2=0x55701160eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:15.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.894+0000 7f71a12a1740 1 --2- 172.21.15.63:0/2026131136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557011237390 0x55701160eab0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f71840acc00 tx=0x7f71840943a0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.894+0000 7f71a12a1740 1 -- 172.21.15.63:0/2026131136 shutdown_connections 2024-09-21T06:35:15.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.894+0000 7f71a12a1740 1 --2- 172.21.15.63:0/2026131136 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x5570111ebda0 0x557011689a20 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.894+0000 7f71a12a1740 1 --2- 172.21.15.63:0/2026131136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557011258070 0x55701160f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.894+0000 7f71a12a1740 1 --2- 172.21.15.63:0/2026131136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557011237390 0x55701160eab0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.894+0000 7f71a12a1740 1 --2- 172.21.15.63:0/2026131136 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55701122f1b0 0x557011613600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.894+0000 7f71a12a1740 1 -- 172.21.15.63:0/2026131136 >> 172.21.15.63:0/2026131136 conn(0x55701124c460 msgr2=0x557011600a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:15.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.894+0000 7f7173fff640 0 client.26525 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:35:15.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.894+0000 7f71a12a1740 1 -- 172.21.15.63:0/2026131136 shutdown_connections 2024-09-21T06:35:15.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.894+0000 7f71a12a1740 1 -- 172.21.15.63:0/2026131136 wait complete. 2024-09-21T06:35:15.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.894+0000 7f71a12a1740 20 client.26525 trim_cache size 0 max 16384 2024-09-21T06:35:15.901 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:35:15.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.894+0000 7f719ad2d640 1 -- 172.21.15.63:0/4087887662 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f717c0b6700 msgr2=0x7f717c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:15.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.895+0000 7f719ad2d640 1 --2- 172.21.15.63:0/4087887662 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f717c0b6700 0x7f717c0b8c10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f718c031440 tx=0x7f718c009260 comp rx=0 tx=0).stop 2024-09-21T06:35:15.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.895+0000 7f719ad2d640 1 -- 172.21.15.63:0/4087887662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7194106330 msgr2=0x7f719419ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:15.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.895+0000 7f719ad2d640 1 --2- 172.21.15.63:0/4087887662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7194106330 0x7f719419ab60 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f718400d740 tx=0x7f718400dc00 comp rx=0 tx=0).stop 2024-09-21T06:35:15.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.895+0000 7f719ad2d640 1 -- 172.21.15.63:0/4087887662 shutdown_connections 2024-09-21T06:35:15.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.895+0000 7f719ad2d640 1 --2- 172.21.15.63:0/4087887662 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f717c0b6700 0x7f717c0b8c10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.895+0000 7f719ad2d640 1 --2- 172.21.15.63:0/4087887662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7194106c80 0x7f719419fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.895+0000 7f719ad2d640 1 --2- 172.21.15.63:0/4087887662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7194106330 0x7f719419ab60 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.895+0000 7f719ad2d640 1 --2- 172.21.15.63:0/4087887662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7194102140 0x7f719419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.895+0000 7f719ad2d640 1 -- 172.21.15.63:0/4087887662 >> 172.21.15.63:0/4087887662 conn(0x7f7194079ea0 msgr2=0x7f71941075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:15.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.895+0000 7f719ad2d640 1 -- 172.21.15.63:0/4087887662 shutdown_connections 2024-09-21T06:35:15.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:15.895+0000 7f719ad2d640 1 -- 172.21.15.63:0/4087887662 wait complete. 2024-09-21T06:35:16.535 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:35:16.792 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:17.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.270+0000 7fcc79e7c640 1 -- 172.21.15.63:0/243178783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc741062e0 msgr2=0x7fcc741066f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:17.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.270+0000 7fcc79e7c640 1 --2- 172.21.15.63:0/243178783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc741062e0 0x7fcc741066f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fcc64009900 tx=0x7fcc6402a410 comp rx=0 tx=0).stop 2024-09-21T06:35:17.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.270+0000 7fcc79e7c640 1 -- 172.21.15.63:0/243178783 shutdown_connections 2024-09-21T06:35:17.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.270+0000 7fcc79e7c640 1 --2- 172.21.15.63:0/243178783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc74106c30 0x7fcc74110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.270+0000 7fcc79e7c640 1 --2- 172.21.15.63:0/243178783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc741062e0 0x7fcc741066f0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.270+0000 7fcc79e7c640 1 --2- 172.21.15.63:0/243178783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc74102000 0x7fcc74102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.270+0000 7fcc79e7c640 1 -- 172.21.15.63:0/243178783 >> 172.21.15.63:0/243178783 conn(0x7fcc74079e40 msgr2=0x7fcc7407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:17.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.270+0000 7fcc79e7c640 1 -- 172.21.15.63:0/243178783 shutdown_connections 2024-09-21T06:35:17.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.270+0000 7fcc79e7c640 1 -- 172.21.15.63:0/243178783 wait complete. 2024-09-21T06:35:17.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.271+0000 7fcc79e7c640 1 Processor -- start 2024-09-21T06:35:17.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.271+0000 7fcc79e7c640 1 -- start start 2024-09-21T06:35:17.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.271+0000 7fcc79e7c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc74102000 0x7fcc7419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.271+0000 7fcc79e7c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc741062e0 0x7fcc7419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.272+0000 7fcc79e7c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc74106c30 0x7fcc7419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.272+0000 7fcc79e7c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcc74113ad0 con 0x7fcc74106c30 2024-09-21T06:35:17.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.272+0000 7fcc79e7c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcc74113950 con 0x7fcc741062e0 2024-09-21T06:35:17.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.272+0000 7fcc79e7c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcc74113c50 con 0x7fcc74102000 2024-09-21T06:35:17.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.272+0000 7fcc73fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc74106c30 0x7fcc7419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.272+0000 7fcc73fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc74106c30 0x7fcc7419fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56154/0 (socket says 172.21.15.63:56154) 2024-09-21T06:35:17.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.272+0000 7fcc73fff640 1 -- 172.21.15.63:0/265553205 learned_addr learned my addr 172.21.15.63:0/265553205 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:17.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.272+0000 7fcc737fe640 1 --2- 172.21.15.63:0/265553205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc74102000 0x7fcc7419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.272+0000 7fcc72ffd640 1 --2- 172.21.15.63:0/265553205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc741062e0 0x7fcc7419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.272+0000 7fcc73fff640 1 -- 172.21.15.63:0/265553205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc74102000 msgr2=0x7fcc7419a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:17.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.272+0000 7fcc73fff640 1 --2- 172.21.15.63:0/265553205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc74102000 0x7fcc7419a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.272+0000 7fcc73fff640 1 -- 172.21.15.63:0/265553205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc741062e0 msgr2=0x7fcc7419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:17.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.272+0000 7fcc73fff640 1 --2- 172.21.15.63:0/265553205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc741062e0 0x7fcc7419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.272+0000 7fcc73fff640 1 -- 172.21.15.63:0/265553205 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc741a0390 con 0x7fcc74106c30 2024-09-21T06:35:17.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.272+0000 7fcc73fff640 1 --2- 172.21.15.63:0/265553205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc74106c30 0x7fcc7419fc60 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00eb10 tx=0x7fcc6c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:17.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.272+0000 7fcc70ff9640 1 -- 172.21.15.63:0/265553205 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c004b20 con 0x7fcc74106c30 2024-09-21T06:35:17.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.272+0000 7fcc70ff9640 1 -- 172.21.15.63:0/265553205 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc6c004cc0 con 0x7fcc74106c30 2024-09-21T06:35:17.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.272+0000 7fcc79e7c640 1 -- 172.21.15.63:0/265553205 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc741a0680 con 0x7fcc74106c30 2024-09-21T06:35:17.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.272+0000 7fcc70ff9640 1 -- 172.21.15.63:0/265553205 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c010670 con 0x7fcc74106c30 2024-09-21T06:35:17.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.273+0000 7fcc79e7c640 1 -- 172.21.15.63:0/265553205 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc741a6de0 con 0x7fcc74106c30 2024-09-21T06:35:17.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.275+0000 7fcc803f0740 1 Processor -- start 2024-09-21T06:35:17.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.275+0000 7fcc70ff9640 1 -- 172.21.15.63:0/265553205 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fcc6c005020 con 0x7fcc74106c30 2024-09-21T06:35:17.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.275+0000 7fcc803f0740 1 -- start start 2024-09-21T06:35:17.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.276+0000 7fcc803f0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ec1070 0x5565b72686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.276+0000 7fcc803f0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b6e981b0 0x5565b7268be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.276+0000 7fcc803f0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ea0390 0x5565b7269120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.276+0000 7fcc803f0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5565b71deea0 con 0x5565b6ea0390 2024-09-21T06:35:17.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.276+0000 7fcc803f0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5565b71ce2d0 con 0x5565b6e981b0 2024-09-21T06:35:17.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.276+0000 7fcc803f0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5565b71d20e0 con 0x5565b6ec1070 2024-09-21T06:35:17.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.276+0000 7fcc72ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ea0390 0x5565b7269120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.276+0000 7fcc72ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ea0390 0x5565b7269120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56168/0 (socket says 172.21.15.63:56168) 2024-09-21T06:35:17.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.276+0000 7fcc72ffd640 1 -- 172.21.15.63:0/1144516538 learned_addr learned my addr 172.21.15.63:0/1144516538 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:17.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.276+0000 7fcc72ffd640 1 --2- 172.21.15.63:0/1144516538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ec1070 0x5565b72686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.276+0000 7fcc737fe640 1 --2- 172.21.15.63:0/1144516538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b6e981b0 0x5565b7268be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.276+0000 7fcc72ffd640 1 -- 172.21.15.63:0/1144516538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ec1070 msgr2=0x5565b72686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:17.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.276+0000 7fcc72ffd640 1 --2- 172.21.15.63:0/1144516538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ec1070 0x5565b72686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.276+0000 7fcc72ffd640 1 -- 172.21.15.63:0/1144516538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b6e981b0 msgr2=0x5565b7268be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:17.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.276+0000 7fcc70ff9640 1 --2- 172.21.15.63:0/265553205 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcc600b6680 0x7fcc600b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.276+0000 7fcc72ffd640 1 --2- 172.21.15.63:0/1144516538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b6e981b0 0x5565b7268be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.276+0000 7fcc72ffd640 1 -- 172.21.15.63:0/1144516538 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565b6f2c650 con 0x5565b6ea0390 2024-09-21T06:35:17.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.276+0000 7fcc73fff640 1 --2- 172.21.15.63:0/265553205 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcc600b6680 0x7fcc600b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.277+0000 7fcc72ffd640 1 --2- 172.21.15.63:0/1144516538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ea0390 0x5565b7269120 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fcc740758b0 tx=0x7fcc64005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3fbf812770156c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:17.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.277+0000 7fcc70ff9640 1 -- 172.21.15.63:0/265553205 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8637+0+0 (secure 0 0 0) 0x7fcc6c0e7d10 con 0x7fcc74106c30 2024-09-21T06:35:17.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.277+0000 7fcc69ffb640 1 -- 172.21.15.63:0/1144516538 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc64035070 con 0x5565b6ea0390 2024-09-21T06:35:17.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.278+0000 7fcc69ffb640 1 -- 172.21.15.63:0/1144516538 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc640318c0 con 0x5565b6ea0390 2024-09-21T06:35:17.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.278+0000 7fcc73fff640 1 --2- 172.21.15.63:0/265553205 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcc600b6680 0x7fcc600b8b90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0e54a0 tx=0x7fcc6c0139b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:17.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.278+0000 7fcc69ffb640 1 -- 172.21.15.63:0/1144516538 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc64003970 con 0x5565b6ea0390 2024-09-21T06:35:17.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.278+0000 7fcc803f0740 1 -- 172.21.15.63:0/1144516538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ea0390 msgr2=0x5565b7269120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:17.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.278+0000 7fcc803f0740 1 --2- 172.21.15.63:0/1144516538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ea0390 0x5565b7269120 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fcc740758b0 tx=0x7fcc64005780 comp rx=0 tx=0).stop 2024-09-21T06:35:17.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.279+0000 7fcc803f0740 1 -- 172.21.15.63:0/1144516538 shutdown_connections 2024-09-21T06:35:17.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.279+0000 7fcc803f0740 1 --2- 172.21.15.63:0/1144516538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ea0390 0x5565b7269120 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.279+0000 7fcc803f0740 1 --2- 172.21.15.63:0/1144516538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b6e981b0 0x5565b7268be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.279+0000 7fcc803f0740 1 --2- 172.21.15.63:0/1144516538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ec1070 0x5565b72686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.279+0000 7fcc803f0740 1 -- 172.21.15.63:0/1144516538 >> 172.21.15.63:0/1144516538 conn(0x5565b6eb5460 msgr2=0x5565b7266590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:17.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.279+0000 7fcc803f0740 1 -- 172.21.15.63:0/1144516538 shutdown_connections 2024-09-21T06:35:17.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.279+0000 7fcc803f0740 1 -- 172.21.15.63:0/1144516538 wait complete. 2024-09-21T06:35:17.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.279+0000 7fcc803f0740 1 -- start start 2024-09-21T06:35:17.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.279+0000 7fcc803f0740 1 Processor -- start 2024-09-21T06:35:17.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.280+0000 7fcc803f0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b6e981b0 0x5565b7278120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.280+0000 7fcc803f0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ea0390 0x5565b7278660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.280+0000 7fcc803f0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ec1070 0x5565b72844b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.280+0000 7fcc803f0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5565b702f700 con 0x5565b6ec1070 2024-09-21T06:35:17.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.280+0000 7fcc803f0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5565b7169160 con 0x5565b6e981b0 2024-09-21T06:35:17.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.280+0000 7fcc803f0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5565b727b150 con 0x5565b6ea0390 2024-09-21T06:35:17.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.280+0000 7fcc803f0740 10 client.0 _ll_register_callbacks cb 0x5565b71829e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:17.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.280+0000 7fcc72ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ec1070 0x5565b72844b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.280+0000 7fcc72ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ec1070 0x5565b72844b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56172/0 (socket says 172.21.15.63:56172) 2024-09-21T06:35:17.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.280+0000 7fcc72ffd640 1 -- 172.21.15.63:0/4121884539 learned_addr learned my addr 172.21.15.63:0/4121884539 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:17.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.280+0000 7fcc737fe640 1 --2- 172.21.15.63:0/4121884539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ea0390 0x5565b7278660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.280+0000 7fcc72ffd640 1 --2- 172.21.15.63:0/4121884539 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b6e981b0 0x5565b7278120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.280+0000 7fcc72ffd640 1 -- 172.21.15.63:0/4121884539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ea0390 msgr2=0x5565b7278660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:17.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.280+0000 7fcc72ffd640 1 --2- 172.21.15.63:0/4121884539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ea0390 0x5565b7278660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.280+0000 7fcc72ffd640 1 -- 172.21.15.63:0/4121884539 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b6e981b0 msgr2=0x5565b7278120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:17.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.280+0000 7fcc72ffd640 1 --2- 172.21.15.63:0/4121884539 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b6e981b0 0x5565b7278120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.280+0000 7fcc72ffd640 1 -- 172.21.15.63:0/4121884539 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565b7196c90 con 0x5565b6ec1070 2024-09-21T06:35:17.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.280+0000 7fcc737fe640 1 --2- 172.21.15.63:0/4121884539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ea0390 0x5565b7278660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:35:17.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.281+0000 7fcc72ffd640 1 --2- 172.21.15.63:0/4121884539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ec1070 0x5565b72844b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fcc64003650 tx=0x7fcc64005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13e6440a959c5bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:17.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.281+0000 7fcc52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:35:17.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.281+0000 7fcc52ffd640 1 -- 172.21.15.63:0/4121884539 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc64035040 con 0x5565b6ec1070 2024-09-21T06:35:17.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.281+0000 7fcc52ffd640 1 -- 172.21.15.63:0/4121884539 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8637+0+0 (secure 0 0 0) 0x7fcc6403d660 con 0x5565b6ec1070 2024-09-21T06:35:17.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.281+0000 7fcc803f0740 1 -- 172.21.15.63:0/4121884539 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc640318c0 con 0x5565b6ec1070 2024-09-21T06:35:17.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.281+0000 7fcc52ffd640 1 -- 172.21.15.63:0/4121884539 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fcc6403d860 con 0x5565b6ec1070 2024-09-21T06:35:17.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.281+0000 7fcc803f0740 10 client.16965 fetch_fsmap learned FSMap version 53 2024-09-21T06:35:17.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.281+0000 7fcc803f0740 1 -- 172.21.15.63:0/4121884539 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5565b7286e90 con 0x5565b6ec1070 2024-09-21T06:35:17.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.281+0000 7fcc52ffd640 1 -- 172.21.15.63:0/4121884539 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc640318c0 con 0x5565b6ec1070 2024-09-21T06:35:17.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.281+0000 7fcc52ffd640 1 -- 172.21.15.63:0/4121884539 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7fcc6403c820 con 0x5565b6ec1070 2024-09-21T06:35:17.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.281+0000 7fcc803f0740 10 client.16965 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:35:17.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.281+0000 7fcc803f0740 10 client.16965 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:35:17.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.282+0000 7fcc803f0740 20 client.16965 populate_metadata read hostname 'smithi063' 2024-09-21T06:35:17.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.282+0000 7fcc803f0740 1 --2- 172.21.15.63:0/4121884539 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5565b6e7f9f0 0x5565b728a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.282+0000 7fcc803f0740 4 client.16965 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:35:17.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.282+0000 7fcc803f0740 1 -- 172.21.15.63:0/4121884539 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565b71e0df0 con 0x5565b6e7f9f0 2024-09-21T06:35:17.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.282+0000 7fcc737fe640 1 --2- 172.21.15.63:0/4121884539 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5565b6e7f9f0 0x5565b728a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.282+0000 7fcc52ffd640 10 client.16965 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:35:17.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.282+0000 7fcc737fe640 1 --2- 172.21.15.63:0/4121884539 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5565b6e7f9f0 0x5565b728a1f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d0e0f88f803caeba server_cookie=52390382f149f1c in_seq=0 out_seq=0 2024-09-21T06:35:17.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.283+0000 7fcc52ffd640 1 -- 172.21.15.63:0/4121884539 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5565b71e0df0 con 0x5565b6e7f9f0 2024-09-21T06:35:17.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.283+0000 7fcc52ffd640 10 client.16965 handle_command_reply: tid=0 2024-09-21T06:35:17.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.283+0000 7fcc803f0740 1 client.16965 shutdown 2024-09-21T06:35:17.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.283+0000 7fcc803f0740 1 -- 172.21.15.63:0/4121884539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ec1070 msgr2=0x5565b72844b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:17.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.283+0000 7fcc803f0740 1 --2- 172.21.15.63:0/4121884539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ec1070 0x5565b72844b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fcc64003650 tx=0x7fcc64005db0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.283+0000 7fcc803f0740 1 -- 172.21.15.63:0/4121884539 shutdown_connections 2024-09-21T06:35:17.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.283+0000 7fcc803f0740 1 --2- 172.21.15.63:0/4121884539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ec1070 0x5565b72844b0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.283+0000 7fcc803f0740 1 --2- 172.21.15.63:0/4121884539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ea0390 0x5565b7278660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.283+0000 7fcc803f0740 1 --2- 172.21.15.63:0/4121884539 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5565b6e7f9f0 0x5565b728a1f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.283+0000 7fcc803f0740 1 --2- 172.21.15.63:0/4121884539 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b6e981b0 0x5565b7278120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.283+0000 7fcc52ffd640 0 client.16965 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:35:17.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.283+0000 7fcc803f0740 1 -- 172.21.15.63:0/4121884539 >> 172.21.15.63:0/4121884539 conn(0x5565b6eb5460 msgr2=0x5565b7264bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:17.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.283+0000 7fcc803f0740 1 -- 172.21.15.63:0/4121884539 shutdown_connections 2024-09-21T06:35:17.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.283+0000 7fcc803f0740 1 -- 172.21.15.63:0/4121884539 wait complete. 2024-09-21T06:35:17.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.284+0000 7fcc803f0740 20 client.16965 trim_cache size 0 max 16384 2024-09-21T06:35:17.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.297+0000 7fcc803f0740 1 Processor -- start 2024-09-21T06:35:17.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.297+0000 7fcc803f0740 1 -- start start 2024-09-21T06:35:17.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.297+0000 7fcc803f0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b6e981b0 0x5565b726df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.297+0000 7fcc803f0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ea0390 0x5565b7269de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.297+0000 7fcc803f0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ec1070 0x5565b7275310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.297+0000 7fcc803f0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcc741ad620 con 0x5565b6ec1070 2024-09-21T06:35:17.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.297+0000 7fcc803f0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcc741af220 con 0x5565b6e981b0 2024-09-21T06:35:17.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.297+0000 7fcc803f0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcc741adcf0 con 0x5565b6ea0390 2024-09-21T06:35:17.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.297+0000 7fcc72ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ec1070 0x5565b7275310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.297+0000 7fcc72ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ec1070 0x5565b7275310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56186/0 (socket says 172.21.15.63:56186) 2024-09-21T06:35:17.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.297+0000 7fcc72ffd640 1 -- 172.21.15.63:0/3405410382 learned_addr learned my addr 172.21.15.63:0/3405410382 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:17.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.297+0000 7fcc72ffd640 1 --2- 172.21.15.63:0/3405410382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b6e981b0 0x5565b726df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.297+0000 7fcc737fe640 1 --2- 172.21.15.63:0/3405410382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ea0390 0x5565b7269de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.298+0000 7fcc72ffd640 1 -- 172.21.15.63:0/3405410382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ea0390 msgr2=0x5565b7269de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:17.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.298+0000 7fcc72ffd640 1 --2- 172.21.15.63:0/3405410382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ea0390 0x5565b7269de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.298+0000 7fcc72ffd640 1 -- 172.21.15.63:0/3405410382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b6e981b0 msgr2=0x5565b726df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:17.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.298+0000 7fcc72ffd640 1 --2- 172.21.15.63:0/3405410382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b6e981b0 0x5565b726df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.298+0000 7fcc72ffd640 1 -- 172.21.15.63:0/3405410382 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565b7279070 con 0x5565b6ec1070 2024-09-21T06:35:17.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.298+0000 7fcc72ffd640 1 --2- 172.21.15.63:0/3405410382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ec1070 0x5565b7275310 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fcc6403cbc0 tx=0x7fcc64041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909883ded7939b53 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:17.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.298+0000 7fcc697fa640 1 -- 172.21.15.63:0/3405410382 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc64035070 con 0x5565b6ec1070 2024-09-21T06:35:17.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.298+0000 7fcc697fa640 1 -- 172.21.15.63:0/3405410382 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc6404e030 con 0x5565b6ec1070 2024-09-21T06:35:17.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.298+0000 7fcc697fa640 1 -- 172.21.15.63:0/3405410382 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6403dd60 con 0x5565b6ec1070 2024-09-21T06:35:17.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.299+0000 7fcc803f0740 1 -- 172.21.15.63:0/3405410382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ec1070 msgr2=0x5565b7275310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:17.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.299+0000 7fcc803f0740 1 --2- 172.21.15.63:0/3405410382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ec1070 0x5565b7275310 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fcc6403cbc0 tx=0x7fcc64041040 comp rx=0 tx=0).stop 2024-09-21T06:35:17.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.299+0000 7fcc803f0740 1 -- 172.21.15.63:0/3405410382 shutdown_connections 2024-09-21T06:35:17.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.299+0000 7fcc803f0740 1 --2- 172.21.15.63:0/3405410382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6ec1070 0x5565b7275310 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.299+0000 7fcc803f0740 1 --2- 172.21.15.63:0/3405410382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ea0390 0x5565b7269de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.299+0000 7fcc803f0740 1 --2- 172.21.15.63:0/3405410382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b6e981b0 0x5565b726df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.299+0000 7fcc803f0740 1 -- 172.21.15.63:0/3405410382 >> 172.21.15.63:0/3405410382 conn(0x5565b6eb5460 msgr2=0x5565b72696d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:17.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.299+0000 7fcc803f0740 1 -- 172.21.15.63:0/3405410382 shutdown_connections 2024-09-21T06:35:17.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.299+0000 7fcc803f0740 1 -- 172.21.15.63:0/3405410382 wait complete. 2024-09-21T06:35:17.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.299+0000 7fcc803f0740 1 -- start start 2024-09-21T06:35:17.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.299+0000 7fcc803f0740 1 Processor -- start 2024-09-21T06:35:17.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.300+0000 7fcc803f0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6e981b0 0x5565b728ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.300+0000 7fcc803f0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b6ea0390 0x5565b728d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.300+0000 7fcc803f0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ec1070 0x5565b72eb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.300+0000 7fcc803f0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcc741aeb50 con 0x5565b6e981b0 2024-09-21T06:35:17.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.300+0000 7fcc803f0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcc741ae450 con 0x5565b6ea0390 2024-09-21T06:35:17.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.300+0000 7fcc803f0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcc741ab620 con 0x5565b6ec1070 2024-09-21T06:35:17.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.300+0000 7fcc803f0740 10 client.0 _ll_register_callbacks cb 0x7fcc64032cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:17.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.300+0000 7fcc72ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6e981b0 0x5565b728ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.300+0000 7fcc72ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6e981b0 0x5565b728ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56192/0 (socket says 172.21.15.63:56192) 2024-09-21T06:35:17.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.300+0000 7fcc72ffd640 1 -- 172.21.15.63:0/3453548687 learned_addr learned my addr 172.21.15.63:0/3453548687 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:17.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.300+0000 7fcc737fe640 1 --2- 172.21.15.63:0/3453548687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b6ea0390 0x5565b728d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.300+0000 7fcc72ffd640 1 --2- 172.21.15.63:0/3453548687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ec1070 0x5565b72eb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.300+0000 7fcc72ffd640 1 -- 172.21.15.63:0/3453548687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ec1070 msgr2=0x5565b72eb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:17.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.300+0000 7fcc72ffd640 1 --2- 172.21.15.63:0/3453548687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ec1070 0x5565b72eb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.300+0000 7fcc72ffd640 1 -- 172.21.15.63:0/3453548687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b6ea0390 msgr2=0x5565b728d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:17.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.300+0000 7fcc72ffd640 1 --2- 172.21.15.63:0/3453548687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b6ea0390 0x5565b728d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.300+0000 7fcc72ffd640 1 -- 172.21.15.63:0/3453548687 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565b72ebfa0 con 0x5565b6e981b0 2024-09-21T06:35:17.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.301+0000 7fcc72ffd640 1 --2- 172.21.15.63:0/3453548687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6e981b0 0x5565b728ccb0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fcc6403d830 tx=0x7fcc6403da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46e0512b4699ae2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:17.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.301+0000 7fcc52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:35:17.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.301+0000 7fcc52ffd640 1 -- 172.21.15.63:0/3453548687 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6406c060 con 0x5565b6e981b0 2024-09-21T06:35:17.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.301+0000 7fcc52ffd640 1 -- 172.21.15.63:0/3453548687 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8637+0+0 (secure 0 0 0) 0x7fcc6403dcf0 con 0x5565b6e981b0 2024-09-21T06:35:17.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.301+0000 7fcc803f0740 1 -- 172.21.15.63:0/3453548687 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc6404e030 con 0x5565b6e981b0 2024-09-21T06:35:17.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.301+0000 7fcc52ffd640 1 -- 172.21.15.63:0/3453548687 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fcc64035040 con 0x5565b6e981b0 2024-09-21T06:35:17.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.301+0000 7fcc803f0740 10 client.16971 fetch_fsmap learned FSMap version 53 2024-09-21T06:35:17.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.301+0000 7fcc803f0740 1 -- 172.21.15.63:0/3453548687 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5565b72f4460 con 0x5565b6e981b0 2024-09-21T06:35:17.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.301+0000 7fcc52ffd640 1 -- 172.21.15.63:0/3453548687 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc6404e030 con 0x5565b6e981b0 2024-09-21T06:35:17.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.301+0000 7fcc52ffd640 1 -- 172.21.15.63:0/3453548687 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7fcc6403c6e0 con 0x5565b6e981b0 2024-09-21T06:35:17.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.301+0000 7fcc803f0740 10 client.16971 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:35:17.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.301+0000 7fcc803f0740 10 client.16971 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:35:17.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.301+0000 7fcc803f0740 20 client.16971 populate_metadata read hostname 'smithi063' 2024-09-21T06:35:17.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.301+0000 7fcc803f0740 1 --2- 172.21.15.63:0/3453548687 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5565b6e54da0 0x5565b72f6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.301+0000 7fcc803f0740 4 client.16971 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:35:17.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.301+0000 7fcc803f0740 1 -- 172.21.15.63:0/3453548687 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5565b71dc8a0 con 0x5565b6e54da0 2024-09-21T06:35:17.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.302+0000 7fcc737fe640 1 --2- 172.21.15.63:0/3453548687 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5565b6e54da0 0x5565b72f6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.302+0000 7fcc52ffd640 10 client.16971 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:35:17.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.302+0000 7fcc737fe640 1 --2- 172.21.15.63:0/3453548687 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5565b6e54da0 0x5565b72f6bc0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=82a80ef1c43c37df server_cookie=27b503c91b439f21 in_seq=0 out_seq=0 2024-09-21T06:35:17.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.302+0000 7fcc52ffd640 1 -- 172.21.15.63:0/3453548687 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5565b71dc8a0 con 0x5565b6e54da0 2024-09-21T06:35:17.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.302+0000 7fcc52ffd640 10 client.16971 handle_command_reply: tid=0 2024-09-21T06:35:17.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.302+0000 7fcc803f0740 1 client.16971 shutdown 2024-09-21T06:35:17.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.302+0000 7fcc803f0740 1 -- 172.21.15.63:0/3453548687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6e981b0 msgr2=0x5565b728ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:17.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.302+0000 7fcc803f0740 1 --2- 172.21.15.63:0/3453548687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6e981b0 0x5565b728ccb0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fcc6403d830 tx=0x7fcc6403da00 comp rx=0 tx=0).stop 2024-09-21T06:35:17.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.303+0000 7fcc803f0740 1 -- 172.21.15.63:0/3453548687 shutdown_connections 2024-09-21T06:35:17.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.303+0000 7fcc803f0740 1 --2- 172.21.15.63:0/3453548687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565b6ec1070 0x5565b72eb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.303+0000 7fcc803f0740 1 --2- 172.21.15.63:0/3453548687 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5565b6e54da0 0x5565b72f6bc0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.303+0000 7fcc803f0740 1 --2- 172.21.15.63:0/3453548687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b6ea0390 0x5565b728d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.303+0000 7fcc803f0740 1 --2- 172.21.15.63:0/3453548687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565b6e981b0 0x5565b728ccb0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.303+0000 7fcc803f0740 1 -- 172.21.15.63:0/3453548687 >> 172.21.15.63:0/3453548687 conn(0x5565b6eb5460 msgr2=0x5565b726a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:17.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.303+0000 7fcc52ffd640 0 client.16971 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:35:17.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.303+0000 7fcc803f0740 1 -- 172.21.15.63:0/3453548687 shutdown_connections 2024-09-21T06:35:17.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.303+0000 7fcc803f0740 1 -- 172.21.15.63:0/3453548687 wait complete. 2024-09-21T06:35:17.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.303+0000 7fcc803f0740 20 client.16971 trim_cache size 0 max 16384 2024-09-21T06:35:17.309 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:35:17.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.303+0000 7fcc79e7c640 1 -- 172.21.15.63:0/265553205 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcc600b6680 msgr2=0x7fcc600b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:17.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.303+0000 7fcc79e7c640 1 --2- 172.21.15.63:0/265553205 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcc600b6680 0x7fcc600b8b90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0e54a0 tx=0x7fcc6c0139b0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.303+0000 7fcc79e7c640 1 -- 172.21.15.63:0/265553205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc74106c30 msgr2=0x7fcc7419fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:17.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.303+0000 7fcc79e7c640 1 --2- 172.21.15.63:0/265553205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc74106c30 0x7fcc7419fc60 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00eb10 tx=0x7fcc6c00c2d0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.303+0000 7fcc79e7c640 1 -- 172.21.15.63:0/265553205 shutdown_connections 2024-09-21T06:35:17.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.303+0000 7fcc79e7c640 1 --2- 172.21.15.63:0/265553205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc74106c30 0x7fcc7419fc60 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.303+0000 7fcc79e7c640 1 --2- 172.21.15.63:0/265553205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc741062e0 0x7fcc7419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.303+0000 7fcc79e7c640 1 --2- 172.21.15.63:0/265553205 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcc600b6680 0x7fcc600b8b90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.303+0000 7fcc79e7c640 1 --2- 172.21.15.63:0/265553205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc74102000 0x7fcc7419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.303+0000 7fcc79e7c640 1 -- 172.21.15.63:0/265553205 >> 172.21.15.63:0/265553205 conn(0x7fcc74079e40 msgr2=0x7fcc74107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:17.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.304+0000 7fcc79e7c640 1 -- 172.21.15.63:0/265553205 shutdown_connections 2024-09-21T06:35:17.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:17.304+0000 7fcc79e7c640 1 -- 172.21.15.63:0/265553205 wait complete. 2024-09-21T06:35:17.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:17 smithi071 ceph-mon[34844]: pgmap v536: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:35:17.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:17 smithi063 ceph-mon[31150]: pgmap v536: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:35:17.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:17 smithi175 ceph-mon[34510]: pgmap v536: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:35:18.041 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:35:18.300 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:18.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.793+0000 7f303738c640 1 -- 172.21.15.63:0/2554427552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3030106350 msgr2=0x7f3030106760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:18.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.793+0000 7f303738c640 1 --2- 172.21.15.63:0/2554427552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3030106350 0x7f3030106760 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3024009900 tx=0x7f302402a410 comp rx=0 tx=0).stop 2024-09-21T06:35:18.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.794+0000 7f303738c640 1 -- 172.21.15.63:0/2554427552 shutdown_connections 2024-09-21T06:35:18.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.794+0000 7f303738c640 1 --2- 172.21.15.63:0/2554427552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3030106ca0 0x7f3030110710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.794+0000 7f303738c640 1 --2- 172.21.15.63:0/2554427552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3030106350 0x7f3030106760 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.794+0000 7f303738c640 1 --2- 172.21.15.63:0/2554427552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3030102100 0x7f3030102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.794+0000 7f303738c640 1 -- 172.21.15.63:0/2554427552 >> 172.21.15.63:0/2554427552 conn(0x7f3030079ec0 msgr2=0x7f303007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:18.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.794+0000 7f303738c640 1 -- 172.21.15.63:0/2554427552 shutdown_connections 2024-09-21T06:35:18.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.794+0000 7f303738c640 1 -- 172.21.15.63:0/2554427552 wait complete. 2024-09-21T06:35:18.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.794+0000 7f303738c640 1 Processor -- start 2024-09-21T06:35:18.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.794+0000 7f303738c640 1 -- start start 2024-09-21T06:35:18.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.795+0000 7f303738c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3030102100 0x7f30301030a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.795+0000 7f303738c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3030106350 0x7f30301035e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.795+0000 7f303738c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3030106ca0 0x7f3030103b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.795+0000 7f303738c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3030113b50 con 0x7f3030106350 2024-09-21T06:35:18.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.795+0000 7f303738c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f30301139d0 con 0x7f3030106ca0 2024-09-21T06:35:18.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.795+0000 7f303738c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3030113cd0 con 0x7f3030102100 2024-09-21T06:35:18.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.795+0000 7f3034927640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3030106350 0x7f30301035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.795+0000 7f3034927640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3030106350 0x7f30301035e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56214/0 (socket says 172.21.15.63:56214) 2024-09-21T06:35:18.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.795+0000 7f3034927640 1 -- 172.21.15.63:0/2402497684 learned_addr learned my addr 172.21.15.63:0/2402497684 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:18.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.795+0000 7f3035128640 1 --2- 172.21.15.63:0/2402497684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3030102100 0x7f30301030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.795+0000 7f3035929640 1 --2- 172.21.15.63:0/2402497684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3030106ca0 0x7f3030103b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.795+0000 7f3034927640 1 -- 172.21.15.63:0/2402497684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3030102100 msgr2=0x7f30301030a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:18.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.795+0000 7f3034927640 1 --2- 172.21.15.63:0/2402497684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3030102100 0x7f30301030a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.795+0000 7f3034927640 1 -- 172.21.15.63:0/2402497684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3030106ca0 msgr2=0x7f3030103b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:18.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.795+0000 7f3034927640 1 --2- 172.21.15.63:0/2402497684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3030106ca0 0x7f3030103b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.795+0000 7f3034927640 1 -- 172.21.15.63:0/2402497684 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30301a8800 con 0x7f3030106350 2024-09-21T06:35:18.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.795+0000 7f3034927640 1 --2- 172.21.15.63:0/2402497684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3030106350 0x7f30301035e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3024005940 tx=0x7f30240040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:18.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.795+0000 7f30227fc640 1 -- 172.21.15.63:0/2402497684 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302403f030 con 0x7f3030106350 2024-09-21T06:35:18.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.796+0000 7f30227fc640 1 -- 172.21.15.63:0/2402497684 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30240044c0 con 0x7f3030106350 2024-09-21T06:35:18.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.796+0000 7f303738c640 1 -- 172.21.15.63:0/2402497684 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30301a8a90 con 0x7f3030106350 2024-09-21T06:35:18.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.796+0000 7f30227fc640 1 -- 172.21.15.63:0/2402497684 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3024035070 con 0x7f3030106350 2024-09-21T06:35:18.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.796+0000 7f303738c640 1 -- 172.21.15.63:0/2402497684 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30301a8f70 con 0x7f3030106350 2024-09-21T06:35:18.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.798+0000 7f303d900740 1 Processor -- start 2024-09-21T06:35:18.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.799+0000 7f303d900740 1 -- start start 2024-09-21T06:35:18.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.799+0000 7f30227fc640 1 -- 172.21.15.63:0/2402497684 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f3024042030 con 0x7f3030106350 2024-09-21T06:35:18.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.799+0000 7f303d900740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e38c070 0x55c41e7332c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.799+0000 7f303d900740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e3631b0 0x55c41e733800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.799+0000 7f303d900740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e36b390 0x55c41e733d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.799+0000 7f303d900740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c41e6a9ea0 con 0x55c41e38c070 2024-09-21T06:35:18.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.799+0000 7f303d900740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c41e6992d0 con 0x55c41e36b390 2024-09-21T06:35:18.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.799+0000 7f303d900740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c41e69d0e0 con 0x55c41e3631b0 2024-09-21T06:35:18.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.799+0000 7f3035929640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e38c070 0x55c41e7332c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.799+0000 7f3035929640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e38c070 0x55c41e7332c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56216/0 (socket says 172.21.15.63:56216) 2024-09-21T06:35:18.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.799+0000 7f3035929640 1 -- 172.21.15.63:0/1105896883 learned_addr learned my addr 172.21.15.63:0/1105896883 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:18.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.799+0000 7f3035128640 1 --2- 172.21.15.63:0/1105896883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e3631b0 0x55c41e733800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.799+0000 7f3034927640 1 --2- 172.21.15.63:0/1105896883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e36b390 0x55c41e733d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.799+0000 7f3035929640 1 -- 172.21.15.63:0/1105896883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e3631b0 msgr2=0x55c41e733800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:18.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.799+0000 7f3035929640 1 --2- 172.21.15.63:0/1105896883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e3631b0 0x55c41e733800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.799+0000 7f3035929640 1 -- 172.21.15.63:0/1105896883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e36b390 msgr2=0x55c41e733d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:18.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.799+0000 7f3035929640 1 --2- 172.21.15.63:0/1105896883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e36b390 0x55c41e733d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.799+0000 7f3035929640 1 -- 172.21.15.63:0/1105896883 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c41e3f7650 con 0x55c41e38c070 2024-09-21T06:35:18.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.799+0000 7f3034927640 1 --2- 172.21.15.63:0/1105896883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e36b390 0x55c41e733d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:18.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.800+0000 7f30227fc640 1 --2- 172.21.15.63:0/2402497684 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f301c0b6680 0x7f301c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.800+0000 7f3035128640 1 --2- 172.21.15.63:0/2402497684 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f301c0b6680 0x7f301c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.800+0000 7f3035929640 1 --2- 172.21.15.63:0/1105896883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e38c070 0x55c41e7332c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3028009ee0 tx=0x7f3028010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de7e0dead1e4cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:18.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.800+0000 7f30227fc640 1 -- 172.21.15.63:0/2402497684 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8637+0+0 (secure 0 0 0) 0x7f3024107cc0 con 0x7f3030106350 2024-09-21T06:35:18.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.800+0000 7f301b7fe640 1 -- 172.21.15.63:0/1105896883 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3028016070 con 0x55c41e38c070 2024-09-21T06:35:18.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.800+0000 7f301b7fe640 1 -- 172.21.15.63:0/1105896883 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3028004d20 con 0x55c41e38c070 2024-09-21T06:35:18.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.800+0000 7f301b7fe640 1 -- 172.21.15.63:0/1105896883 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3028012730 con 0x55c41e38c070 2024-09-21T06:35:18.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.801+0000 7f303d900740 1 -- 172.21.15.63:0/1105896883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e38c070 msgr2=0x55c41e7332c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:18.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.801+0000 7f3035128640 1 --2- 172.21.15.63:0/2402497684 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f301c0b6680 0x7f301c0b8b90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55c41e731f40 tx=0x7f302c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:18.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.801+0000 7f303d900740 1 --2- 172.21.15.63:0/1105896883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e38c070 0x55c41e7332c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3028009ee0 tx=0x7f3028010740 comp rx=0 tx=0).stop 2024-09-21T06:35:18.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.801+0000 7f303d900740 1 -- 172.21.15.63:0/1105896883 shutdown_connections 2024-09-21T06:35:18.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.801+0000 7f303d900740 1 --2- 172.21.15.63:0/1105896883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e36b390 0x55c41e733d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.801+0000 7f303d900740 1 --2- 172.21.15.63:0/1105896883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e3631b0 0x55c41e733800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.801+0000 7f303d900740 1 --2- 172.21.15.63:0/1105896883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e38c070 0x55c41e7332c0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.801+0000 7f303d900740 1 -- 172.21.15.63:0/1105896883 >> 172.21.15.63:0/1105896883 conn(0x55c41e380460 msgr2=0x55c41e7311b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:18.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.801+0000 7f303d900740 1 -- 172.21.15.63:0/1105896883 shutdown_connections 2024-09-21T06:35:18.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.801+0000 7f303d900740 1 -- 172.21.15.63:0/1105896883 wait complete. 2024-09-21T06:35:18.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.801+0000 7f303d900740 1 -- start start 2024-09-21T06:35:18.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.802+0000 7f303d900740 1 Processor -- start 2024-09-21T06:35:18.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.802+0000 7f303d900740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e3631b0 0x55c41e73e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.802+0000 7f303d900740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e36b390 0x55c41e73eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.802+0000 7f303d900740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e38c070 0x55c41e74adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.802+0000 7f303d900740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c41e4fa700 con 0x55c41e36b390 2024-09-21T06:35:18.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.802+0000 7f303d900740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c41e634160 con 0x55c41e38c070 2024-09-21T06:35:18.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.802+0000 7f303d900740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c41e741aa0 con 0x55c41e3631b0 2024-09-21T06:35:18.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.802+0000 7f303d900740 10 client.0 _ll_register_callbacks cb 0x55c41e64d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:18.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.802+0000 7f3034927640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e36b390 0x55c41e73eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.802+0000 7f3034927640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e36b390 0x55c41e73eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56224/0 (socket says 172.21.15.63:56224) 2024-09-21T06:35:18.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.802+0000 7f3034927640 1 -- 172.21.15.63:0/3620381892 learned_addr learned my addr 172.21.15.63:0/3620381892 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:18.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.802+0000 7f3035929640 1 --2- 172.21.15.63:0/3620381892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e38c070 0x55c41e74adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.802+0000 7f3035128640 1 --2- 172.21.15.63:0/3620381892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e3631b0 0x55c41e73e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.802+0000 7f3034927640 1 -- 172.21.15.63:0/3620381892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e3631b0 msgr2=0x55c41e73e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:18.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.802+0000 7f3034927640 1 --2- 172.21.15.63:0/3620381892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e3631b0 0x55c41e73e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.802+0000 7f3034927640 1 -- 172.21.15.63:0/3620381892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e38c070 msgr2=0x55c41e74adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:18.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.802+0000 7f3034927640 1 --2- 172.21.15.63:0/3620381892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e38c070 0x55c41e74adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.802+0000 7f3034927640 1 -- 172.21.15.63:0/3620381892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c41e661c90 con 0x55c41e36b390 2024-09-21T06:35:18.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.803+0000 7f3034927640 1 --2- 172.21.15.63:0/3620381892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e36b390 0x55c41e73eef0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3024000c00 tx=0x7f30240c9a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea316988fb8aa8f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:18.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.803+0000 7f3018ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:35:18.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.803+0000 7f3018ff9640 1 -- 172.21.15.63:0/3620381892 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3024109070 con 0x55c41e36b390 2024-09-21T06:35:18.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.803+0000 7f3018ff9640 1 -- 172.21.15.63:0/3620381892 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8637+0+0 (secure 0 0 0) 0x7f302403ba90 con 0x55c41e36b390 2024-09-21T06:35:18.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.803+0000 7f303d900740 1 -- 172.21.15.63:0/3620381892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3028004d20 con 0x55c41e36b390 2024-09-21T06:35:18.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.803+0000 7f3018ff9640 1 -- 172.21.15.63:0/3620381892 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f3024049070 con 0x55c41e36b390 2024-09-21T06:35:18.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.803+0000 7f303d900740 10 client.16983 fetch_fsmap learned FSMap version 53 2024-09-21T06:35:18.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.803+0000 7f303d900740 1 -- 172.21.15.63:0/3620381892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55c41e74d7e0 con 0x55c41e36b390 2024-09-21T06:35:18.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.803+0000 7f3018ff9640 1 -- 172.21.15.63:0/3620381892 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3028004d20 con 0x55c41e36b390 2024-09-21T06:35:18.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.803+0000 7f3018ff9640 1 -- 172.21.15.63:0/3620381892 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7f30240d7030 con 0x55c41e36b390 2024-09-21T06:35:18.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.803+0000 7f303d900740 10 client.16983 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:35:18.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.803+0000 7f303d900740 10 client.16983 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:35:18.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.803+0000 7f303d900740 20 client.16983 populate_metadata read hostname 'smithi063' 2024-09-21T06:35:18.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.803+0000 7f303d900740 1 --2- 172.21.15.63:0/3620381892 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55c41e34a9f0 0x55c41e750bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.804+0000 7f303d900740 4 client.16983 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:35:18.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.804+0000 7f303d900740 1 -- 172.21.15.63:0/3620381892 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c41e6abdf0 con 0x55c41e34a9f0 2024-09-21T06:35:18.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.804+0000 7f3035128640 1 --2- 172.21.15.63:0/3620381892 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55c41e34a9f0 0x55c41e750bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.804+0000 7f3035128640 1 --2- 172.21.15.63:0/3620381892 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55c41e34a9f0 0x55c41e750bf0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d63e68705d7f2e45 server_cookie=68222e7a17ab9053 in_seq=0 out_seq=0 2024-09-21T06:35:18.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.804+0000 7f3018ff9640 10 client.16983 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:35:18.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.805+0000 7f3018ff9640 1 -- 172.21.15.63:0/3620381892 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c41e6abdf0 con 0x55c41e34a9f0 2024-09-21T06:35:18.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.805+0000 7f3018ff9640 10 client.16983 handle_command_reply: tid=0 2024-09-21T06:35:18.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.805+0000 7f303d900740 1 client.16983 shutdown 2024-09-21T06:35:18.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.805+0000 7f303d900740 1 -- 172.21.15.63:0/3620381892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e36b390 msgr2=0x55c41e73eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:18.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.805+0000 7f303d900740 1 --2- 172.21.15.63:0/3620381892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e36b390 0x55c41e73eef0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3024000c00 tx=0x7f30240c9a00 comp rx=0 tx=0).stop 2024-09-21T06:35:18.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.805+0000 7f303d900740 1 -- 172.21.15.63:0/3620381892 shutdown_connections 2024-09-21T06:35:18.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.805+0000 7f303d900740 1 --2- 172.21.15.63:0/3620381892 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55c41e34a9f0 0x55c41e750bf0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.806+0000 7f303d900740 1 --2- 172.21.15.63:0/3620381892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e38c070 0x55c41e74adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.806+0000 7f303d900740 1 --2- 172.21.15.63:0/3620381892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e36b390 0x55c41e73eef0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.806+0000 7f3018ff9640 0 client.16983 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:35:18.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.806+0000 7f303d900740 1 --2- 172.21.15.63:0/3620381892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e3631b0 0x55c41e73e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.806+0000 7f303d900740 1 -- 172.21.15.63:0/3620381892 >> 172.21.15.63:0/3620381892 conn(0x55c41e380460 msgr2=0x55c41e7364a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:18.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.806+0000 7f303d900740 1 -- 172.21.15.63:0/3620381892 shutdown_connections 2024-09-21T06:35:18.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.806+0000 7f303d900740 1 -- 172.21.15.63:0/3620381892 wait complete. 2024-09-21T06:35:18.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.806+0000 7f303d900740 20 client.16983 trim_cache size 0 max 16384 2024-09-21T06:35:18.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.819+0000 7f303d900740 1 Processor -- start 2024-09-21T06:35:18.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.819+0000 7f303d900740 1 -- start start 2024-09-21T06:35:18.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.819+0000 7f303d900740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e3631b0 0x55c41e73ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.819+0000 7f303d900740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e36b390 0x55c41e74acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.819+0000 7f303d900740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e38c070 0x55c41e73bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.819+0000 7f303d900740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f30301b1a70 con 0x55c41e36b390 2024-09-21T06:35:18.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.819+0000 7f303d900740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f30301b3670 con 0x55c41e3631b0 2024-09-21T06:35:18.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.819+0000 7f303d900740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f30301b2140 con 0x55c41e38c070 2024-09-21T06:35:18.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.819+0000 7f3034927640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e36b390 0x55c41e74acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.819+0000 7f3034927640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e36b390 0x55c41e74acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56226/0 (socket says 172.21.15.63:56226) 2024-09-21T06:35:18.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.819+0000 7f3034927640 1 -- 172.21.15.63:0/3617407723 learned_addr learned my addr 172.21.15.63:0/3617407723 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:18.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.820+0000 7f3035929640 1 --2- 172.21.15.63:0/3617407723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e38c070 0x55c41e73bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.820+0000 7f3035128640 1 --2- 172.21.15.63:0/3617407723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e3631b0 0x55c41e73ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.820+0000 7f3034927640 1 -- 172.21.15.63:0/3617407723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e38c070 msgr2=0x55c41e73bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:18.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.820+0000 7f3034927640 1 --2- 172.21.15.63:0/3617407723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e38c070 0x55c41e73bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.820+0000 7f3034927640 1 -- 172.21.15.63:0/3617407723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e3631b0 msgr2=0x55c41e73ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:18.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.820+0000 7f3034927640 1 --2- 172.21.15.63:0/3617407723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e3631b0 0x55c41e73ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.820+0000 7f3034927640 1 -- 172.21.15.63:0/3617407723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c41e73ceb0 con 0x55c41e36b390 2024-09-21T06:35:18.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.820+0000 7f3035929640 1 --2- 172.21.15.63:0/3617407723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e38c070 0x55c41e73bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:18.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.820+0000 7f3035128640 1 --2- 172.21.15.63:0/3617407723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e3631b0 0x55c41e73ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:18.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.820+0000 7f3034927640 1 --2- 172.21.15.63:0/3617407723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e36b390 0x55c41e74acf0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f30240d7550 tx=0x7f3024009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a624f4a26fe09616 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:18.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.820+0000 7f301affd640 1 -- 172.21.15.63:0/3617407723 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30240cd5b0 con 0x55c41e36b390 2024-09-21T06:35:18.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.820+0000 7f301affd640 1 -- 172.21.15.63:0/3617407723 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30240d2580 con 0x55c41e36b390 2024-09-21T06:35:18.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.820+0000 7f301affd640 1 -- 172.21.15.63:0/3617407723 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3024105af0 con 0x55c41e36b390 2024-09-21T06:35:18.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.821+0000 7f303d900740 1 -- 172.21.15.63:0/3617407723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e36b390 msgr2=0x55c41e74acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:18.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.821+0000 7f303d900740 1 --2- 172.21.15.63:0/3617407723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e36b390 0x55c41e74acf0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f30240d7550 tx=0x7f3024009630 comp rx=0 tx=0).stop 2024-09-21T06:35:18.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.821+0000 7f303d900740 1 -- 172.21.15.63:0/3617407723 shutdown_connections 2024-09-21T06:35:18.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.821+0000 7f303d900740 1 --2- 172.21.15.63:0/3617407723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e38c070 0x55c41e73bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.821+0000 7f303d900740 1 --2- 172.21.15.63:0/3617407723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e36b390 0x55c41e74acf0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.821+0000 7f303d900740 1 --2- 172.21.15.63:0/3617407723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e3631b0 0x55c41e73ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.821+0000 7f303d900740 1 -- 172.21.15.63:0/3617407723 >> 172.21.15.63:0/3617407723 conn(0x55c41e380460 msgr2=0x55c41e73e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:18.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.821+0000 7f303d900740 1 -- 172.21.15.63:0/3617407723 shutdown_connections 2024-09-21T06:35:18.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.821+0000 7f303d900740 1 -- 172.21.15.63:0/3617407723 wait complete. 2024-09-21T06:35:18.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.821+0000 7f303d900740 1 -- start start 2024-09-21T06:35:18.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.821+0000 7f303d900740 1 Processor -- start 2024-09-21T06:35:18.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.822+0000 7f303d900740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e3631b0 0x55c41e743420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.822+0000 7f303d900740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e36b390 0x55c41e743960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.822+0000 7f303d900740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e38c070 0x55c41e7ba5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.822+0000 7f303d900740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f30301b2fa0 con 0x55c41e38c070 2024-09-21T06:35:18.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.822+0000 7f303d900740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f30301b28a0 con 0x55c41e3631b0 2024-09-21T06:35:18.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.822+0000 7f303d900740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f30301afa70 con 0x55c41e36b390 2024-09-21T06:35:18.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.822+0000 7f303d900740 10 client.0 _ll_register_callbacks cb 0x7f3024005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:18.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.822+0000 7f3035929640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e38c070 0x55c41e7ba5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.822+0000 7f3035929640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e38c070 0x55c41e7ba5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56232/0 (socket says 172.21.15.63:56232) 2024-09-21T06:35:18.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.822+0000 7f3035929640 1 -- 172.21.15.63:0/1581746190 learned_addr learned my addr 172.21.15.63:0/1581746190 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:18.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.822+0000 7f3035128640 1 --2- 172.21.15.63:0/1581746190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e3631b0 0x55c41e743420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.822+0000 7f3034927640 1 --2- 172.21.15.63:0/1581746190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e36b390 0x55c41e743960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.822+0000 7f3035929640 1 -- 172.21.15.63:0/1581746190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e36b390 msgr2=0x55c41e743960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:18.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.822+0000 7f3035929640 1 --2- 172.21.15.63:0/1581746190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e36b390 0x55c41e743960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.822+0000 7f3035929640 1 -- 172.21.15.63:0/1581746190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e3631b0 msgr2=0x55c41e743420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:18.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.822+0000 7f3035929640 1 --2- 172.21.15.63:0/1581746190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e3631b0 0x55c41e743420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.822+0000 7f3035929640 1 -- 172.21.15.63:0/1581746190 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c41e7bab30 con 0x55c41e38c070 2024-09-21T06:35:18.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.823+0000 7f3035929640 1 --2- 172.21.15.63:0/1581746190 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e38c070 0x55c41e7ba5f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3028005a00 tx=0x7f3028012680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38297da5774abf3f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:18.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.823+0000 7f3018ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:35:18.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.823+0000 7f3018ff9640 1 -- 172.21.15.63:0/1581746190 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3028016040 con 0x55c41e38c070 2024-09-21T06:35:18.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.823+0000 7f3018ff9640 1 -- 172.21.15.63:0/1581746190 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8637+0+0 (secure 0 0 0) 0x7f3028012c00 con 0x55c41e38c070 2024-09-21T06:35:18.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.823+0000 7f303d900740 1 -- 172.21.15.63:0/1581746190 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30240d2580 con 0x55c41e38c070 2024-09-21T06:35:18.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.823+0000 7f3018ff9640 1 -- 172.21.15.63:0/1581746190 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f3028034050 con 0x55c41e38c070 2024-09-21T06:35:18.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.823+0000 7f303d900740 10 client.16989 fetch_fsmap learned FSMap version 53 2024-09-21T06:35:18.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.823+0000 7f303d900740 1 -- 172.21.15.63:0/1581746190 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55c41e7bbd60 con 0x55c41e38c070 2024-09-21T06:35:18.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.823+0000 7f3018ff9640 1 -- 172.21.15.63:0/1581746190 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30240d2580 con 0x55c41e38c070 2024-09-21T06:35:18.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.823+0000 7f3018ff9640 1 -- 172.21.15.63:0/1581746190 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7f302800f040 con 0x55c41e38c070 2024-09-21T06:35:18.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.824+0000 7f303d900740 10 client.16989 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:35:18.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.824+0000 7f303d900740 10 client.16989 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:35:18.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.824+0000 7f303d900740 20 client.16989 populate_metadata read hostname 'smithi063' 2024-09-21T06:35:18.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.824+0000 7f303d900740 1 --2- 172.21.15.63:0/1581746190 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55c41e31fda0 0x55c41e7be240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.824+0000 7f303d900740 4 client.16989 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:35:18.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.824+0000 7f303d900740 1 -- 172.21.15.63:0/1581746190 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c41e6a78a0 con 0x55c41e31fda0 2024-09-21T06:35:18.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.824+0000 7f3035128640 1 --2- 172.21.15.63:0/1581746190 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55c41e31fda0 0x55c41e7be240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.824+0000 7f3018ff9640 10 client.16989 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:35:18.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.824+0000 7f3035128640 1 --2- 172.21.15.63:0/1581746190 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55c41e31fda0 0x55c41e7be240 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=415fcac1ea72ea16 server_cookie=ffe5b5c4046df0ed in_seq=0 out_seq=0 2024-09-21T06:35:18.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.825+0000 7f3018ff9640 1 -- 172.21.15.63:0/1581746190 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c41e6a78a0 con 0x55c41e31fda0 2024-09-21T06:35:18.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.825+0000 7f3018ff9640 10 client.16989 handle_command_reply: tid=0 2024-09-21T06:35:18.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.825+0000 7f303d900740 1 client.16989 shutdown 2024-09-21T06:35:18.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.825+0000 7f303d900740 1 -- 172.21.15.63:0/1581746190 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e38c070 msgr2=0x55c41e7ba5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:18.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.825+0000 7f303d900740 1 --2- 172.21.15.63:0/1581746190 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e38c070 0x55c41e7ba5f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3028005a00 tx=0x7f3028012680 comp rx=0 tx=0).stop 2024-09-21T06:35:18.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.825+0000 7f303d900740 1 -- 172.21.15.63:0/1581746190 shutdown_connections 2024-09-21T06:35:18.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.825+0000 7f303d900740 1 --2- 172.21.15.63:0/1581746190 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55c41e31fda0 0x55c41e7be240 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.825+0000 7f303d900740 1 --2- 172.21.15.63:0/1581746190 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c41e38c070 0x55c41e7ba5f0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.825+0000 7f303d900740 1 --2- 172.21.15.63:0/1581746190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c41e36b390 0x55c41e743960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.825+0000 7f3018ff9640 0 client.16989 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:35:18.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.825+0000 7f303d900740 1 --2- 172.21.15.63:0/1581746190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c41e3631b0 0x55c41e743420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.825+0000 7f303d900740 1 -- 172.21.15.63:0/1581746190 >> 172.21.15.63:0/1581746190 conn(0x55c41e380460 msgr2=0x55c41e734260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:18.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.825+0000 7f303d900740 1 -- 172.21.15.63:0/1581746190 shutdown_connections 2024-09-21T06:35:18.963 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:35:18.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.825+0000 7f303d900740 1 -- 172.21.15.63:0/1581746190 wait complete. 2024-09-21T06:35:18.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.825+0000 7f303d900740 20 client.16989 trim_cache size 0 max 16384 2024-09-21T06:35:18.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.826+0000 7f303738c640 1 -- 172.21.15.63:0/2402497684 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f301c0b6680 msgr2=0x7f301c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:18.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.826+0000 7f303738c640 1 --2- 172.21.15.63:0/2402497684 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f301c0b6680 0x7f301c0b8b90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55c41e731f40 tx=0x7f302c005f90 comp rx=0 tx=0).stop 2024-09-21T06:35:18.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.826+0000 7f303738c640 1 -- 172.21.15.63:0/2402497684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3030106350 msgr2=0x7f30301035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:18.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.826+0000 7f303738c640 1 --2- 172.21.15.63:0/2402497684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3030106350 0x7f30301035e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3024005940 tx=0x7f30240040c0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.826+0000 7f303738c640 1 -- 172.21.15.63:0/2402497684 shutdown_connections 2024-09-21T06:35:18.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.826+0000 7f303738c640 1 --2- 172.21.15.63:0/2402497684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3030106ca0 0x7f3030103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.826+0000 7f303738c640 1 --2- 172.21.15.63:0/2402497684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3030106350 0x7f30301035e0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.826+0000 7f303738c640 1 --2- 172.21.15.63:0/2402497684 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f301c0b6680 0x7f301c0b8b90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.826+0000 7f303738c640 1 --2- 172.21.15.63:0/2402497684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3030102100 0x7f30301030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.826+0000 7f303738c640 1 -- 172.21.15.63:0/2402497684 >> 172.21.15.63:0/2402497684 conn(0x7f3030079ec0 msgr2=0x7f3030105580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:18.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.826+0000 7f303738c640 1 -- 172.21.15.63:0/2402497684 shutdown_connections 2024-09-21T06:35:18.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:18.826+0000 7f303738c640 1 -- 172.21.15.63:0/2402497684 wait complete. 2024-09-21T06:35:19.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:19 smithi071 ceph-mon[34844]: pgmap v537: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:35:19.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:19 smithi071 ceph-mon[34844]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T06:35:20.658 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:19 smithi175 ceph-mon[34510]: pgmap v537: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:35:20.658 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:19 smithi175 ceph-mon[34510]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T06:35:20.658 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:19 smithi063 ceph-mon[31150]: pgmap v537: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:35:20.658 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:19 smithi063 ceph-mon[31150]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T06:35:21.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:21 smithi071 ceph-mon[34844]: pgmap v539: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:35:21.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:21 smithi063 ceph-mon[31150]: pgmap v539: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:35:21.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:21 smithi175 ceph-mon[34510]: pgmap v539: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:35:21.659 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:35:21.660 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:35:21.932 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:22.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.457+0000 7f0abd980640 1 -- 172.21.15.63:0/1449553422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ab8105300 msgr2=0x7f0ab810d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:22.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.457+0000 7f0abd980640 1 --2- 172.21.15.63:0/1449553422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ab8105300 0x7f0ab810d850 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009900 tx=0x7f0aa002a410 comp rx=0 tx=0).stop 2024-09-21T06:35:22.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.457+0000 7f0abd980640 1 -- 172.21.15.63:0/1449553422 shutdown_connections 2024-09-21T06:35:22.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.457+0000 7f0abd980640 1 --2- 172.21.15.63:0/1449553422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab810de10 0x7f0ab8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.457+0000 7f0abd980640 1 --2- 172.21.15.63:0/1449553422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ab8105300 0x7f0ab810d850 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.457+0000 7f0abd980640 1 --2- 172.21.15.63:0/1449553422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab81049b0 0x7f0ab8104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.457+0000 7f0abd980640 1 -- 172.21.15.63:0/1449553422 >> 172.21.15.63:0/1449553422 conn(0x7f0ab8079730 msgr2=0x7f0ab8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:22.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.457+0000 7f0abd980640 1 -- 172.21.15.63:0/1449553422 shutdown_connections 2024-09-21T06:35:22.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.457+0000 7f0abd980640 1 -- 172.21.15.63:0/1449553422 wait complete. 2024-09-21T06:35:22.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.457+0000 7f0abd980640 1 Processor -- start 2024-09-21T06:35:22.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.458+0000 7f0abd980640 1 -- start start 2024-09-21T06:35:22.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.458+0000 7f0abd980640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab81049b0 0x7f0ab819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.458+0000 7f0abd980640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ab8105300 0x7f0ab819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.458+0000 7f0abd980640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab810de10 0x7f0ab819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.458+0000 7f0abd980640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab8113a70 con 0x7f0ab8105300 2024-09-21T06:35:22.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.458+0000 7f0abd980640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81138f0 con 0x7f0ab81049b0 2024-09-21T06:35:22.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.458+0000 7f0abd980640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab8113bf0 con 0x7f0ab810de10 2024-09-21T06:35:22.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.458+0000 7f0ab67fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ab8105300 0x7f0ab819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.458+0000 7f0ab67fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ab8105300 0x7f0ab819aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56248/0 (socket says 172.21.15.63:56248) 2024-09-21T06:35:22.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.458+0000 7f0ab67fc640 1 -- 172.21.15.63:0/4060351391 learned_addr learned my addr 172.21.15.63:0/4060351391 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:22.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.458+0000 7f0ab6ffd640 1 --2- 172.21.15.63:0/4060351391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab81049b0 0x7f0ab819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.458+0000 7f0ab77fe640 1 --2- 172.21.15.63:0/4060351391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab810de10 0x7f0ab819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.458+0000 7f0ab67fc640 1 -- 172.21.15.63:0/4060351391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab810de10 msgr2=0x7f0ab819fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.458+0000 7f0ab67fc640 1 --2- 172.21.15.63:0/4060351391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab810de10 0x7f0ab819fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.458+0000 7f0ab67fc640 1 -- 172.21.15.63:0/4060351391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab81049b0 msgr2=0x7f0ab819a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.458+0000 7f0ab67fc640 1 --2- 172.21.15.63:0/4060351391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab81049b0 0x7f0ab819a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.458+0000 7f0ab67fc640 1 -- 172.21.15.63:0/4060351391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab81a03d0 con 0x7f0ab8105300 2024-09-21T06:35:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.459+0000 7f0ab67fc640 1 --2- 172.21.15.63:0/4060351391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ab8105300 0x7f0ab819aa00 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f0aa002a930 tx=0x7f0aa0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.459+0000 7f0abc97e640 1 -- 172.21.15.63:0/4060351391 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa003f030 con 0x7f0ab8105300 2024-09-21T06:35:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.459+0000 7f0abc97e640 1 -- 172.21.15.63:0/4060351391 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aa0003aa0 con 0x7f0ab8105300 2024-09-21T06:35:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.459+0000 7f0abc97e640 1 -- 172.21.15.63:0/4060351391 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0035070 con 0x7f0ab8105300 2024-09-21T06:35:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.459+0000 7f0abd980640 1 -- 172.21.15.63:0/4060351391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab81a0660 con 0x7f0ab8105300 2024-09-21T06:35:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.459+0000 7f0abd980640 1 -- 172.21.15.63:0/4060351391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab81a6e20 con 0x7f0ab8105300 2024-09-21T06:35:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.461+0000 7f0ac3ef4740 1 Processor -- start 2024-09-21T06:35:22.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.461+0000 7f0ac3ef4740 1 -- start start 2024-09-21T06:35:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.462+0000 7f0abc97e640 1 -- 172.21.15.63:0/4060351391 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f0aa0042030 con 0x7f0ab8105300 2024-09-21T06:35:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.462+0000 7f0ac3ef4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c23a350 0x55b24c5e1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.462+0000 7f0ac3ef4740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c211490 0x55b24c5e1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.462+0000 7f0ac3ef4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c219670 0x55b24c5e1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.462+0000 7f0ac3ef4740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55b24c557e60 con 0x55b24c211490 2024-09-21T06:35:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.462+0000 7f0ac3ef4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b24c547290 con 0x55b24c23a350 2024-09-21T06:35:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.462+0000 7f0ac3ef4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b24c54b0a0 con 0x55b24c219670 2024-09-21T06:35:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.462+0000 7f0ab6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c211490 0x55b24c5e1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.462+0000 7f0ab6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c211490 0x55b24c5e1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56260/0 (socket says 172.21.15.63:56260) 2024-09-21T06:35:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.462+0000 7f0ab6ffd640 1 -- 172.21.15.63:0/226181931 learned_addr learned my addr 172.21.15.63:0/226181931 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.462+0000 7f0ab67fc640 1 --2- 172.21.15.63:0/226181931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c219670 0x55b24c5e1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.462+0000 7f0ab77fe640 1 --2- 172.21.15.63:0/226181931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c23a350 0x55b24c5e1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.462+0000 7f0ab6ffd640 1 -- 172.21.15.63:0/226181931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c219670 msgr2=0x55b24c5e1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:22.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.462+0000 7f0ab6ffd640 1 --2- 172.21.15.63:0/226181931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c219670 0x55b24c5e1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.462+0000 7f0ab6ffd640 1 -- 172.21.15.63:0/226181931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c23a350 msgr2=0x55b24c5e1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:22.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.462+0000 7f0ab6ffd640 1 --2- 172.21.15.63:0/226181931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c23a350 0x55b24c5e1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.462+0000 7f0ab6ffd640 1 -- 172.21.15.63:0/226181931 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b24c2a5930 con 0x55b24c211490 2024-09-21T06:35:22.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.463+0000 7f0ab6ffd640 1 --2- 172.21.15.63:0/226181931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c211490 0x55b24c5e1970 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0ab000bcb0 tx=0x7f0ab00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3508e668e27b0f0d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:22.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.463+0000 7f0aadffb640 1 -- 172.21.15.63:0/226181931 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0004020 con 0x55b24c211490 2024-09-21T06:35:22.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.463+0000 7f0aadffb640 1 -- 172.21.15.63:0/226181931 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ab00054d0 con 0x55b24c211490 2024-09-21T06:35:22.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.463+0000 7f0aadffb640 1 -- 172.21.15.63:0/226181931 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0004c80 con 0x55b24c211490 2024-09-21T06:35:22.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.463+0000 7f0abc97e640 1 --2- 172.21.15.63:0/4060351391 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0aa40b6680 0x7f0aa40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.463+0000 7f0ab77fe640 1 --2- 172.21.15.63:0/4060351391 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0aa40b6680 0x7f0aa40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.463+0000 7f0abc97e640 1 -- 172.21.15.63:0/4060351391 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7f0aa0107eb0 con 0x7f0ab8105300 2024-09-21T06:35:22.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.464+0000 7f0ab77fe640 1 --2- 172.21.15.63:0/4060351391 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0aa40b6680 0x7f0aa40b8b90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8005fd0 tx=0x7f0aa80097f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:22.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.464+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/226181931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c211490 msgr2=0x55b24c5e1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:22.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.464+0000 7f0ac3ef4740 1 --2- 172.21.15.63:0/226181931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c211490 0x55b24c5e1970 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0ab000bcb0 tx=0x7f0ab00107a0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.464+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/226181931 shutdown_connections 2024-09-21T06:35:22.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.464+0000 7f0ac3ef4740 1 --2- 172.21.15.63:0/226181931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c219670 0x55b24c5e1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.464+0000 7f0ac3ef4740 1 --2- 172.21.15.63:0/226181931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c211490 0x55b24c5e1970 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.464+0000 7f0ac3ef4740 1 --2- 172.21.15.63:0/226181931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c23a350 0x55b24c5e1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.464+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/226181931 >> 172.21.15.63:0/226181931 conn(0x55b24c22e740 msgr2=0x55b24c5df320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:22.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.464+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/226181931 shutdown_connections 2024-09-21T06:35:22.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.464+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/226181931 wait complete. 2024-09-21T06:35:22.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.464+0000 7f0ac3ef4740 1 -- start start 2024-09-21T06:35:22.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.465+0000 7f0ac3ef4740 1 Processor -- start 2024-09-21T06:35:22.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.465+0000 7f0ac3ef4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c211490 0x55b24c5ed050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.465+0000 7f0ac3ef4740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c219670 0x55b24c5ed5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.465+0000 7f0ac3ef4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c23a350 0x55b24c5f8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.465+0000 7f0ac3ef4740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55b24c3a8890 con 0x55b24c219670 2024-09-21T06:35:22.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.465+0000 7f0ac3ef4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b24c4e1d40 con 0x55b24c211490 2024-09-21T06:35:22.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.465+0000 7f0ac3ef4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b24c5efc10 con 0x55b24c23a350 2024-09-21T06:35:22.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.465+0000 7f0ac3ef4740 10 client.0 _ll_register_callbacks cb 0x55b24c545c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:22.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.465+0000 7f0ab67fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c219670 0x55b24c5ed5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.465+0000 7f0ab67fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c219670 0x55b24c5ed5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56262/0 (socket says 172.21.15.63:56262) 2024-09-21T06:35:22.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.465+0000 7f0ab67fc640 1 -- 172.21.15.63:0/1434734307 learned_addr learned my addr 172.21.15.63:0/1434734307 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:22.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.465+0000 7f0ab6ffd640 1 --2- 172.21.15.63:0/1434734307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c211490 0x55b24c5ed050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.465+0000 7f0ab77fe640 1 --2- 172.21.15.63:0/1434734307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c23a350 0x55b24c5f8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.466+0000 7f0ab67fc640 1 -- 172.21.15.63:0/1434734307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c23a350 msgr2=0x55b24c5f8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.466+0000 7f0ab67fc640 1 --2- 172.21.15.63:0/1434734307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c23a350 0x55b24c5f8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.466+0000 7f0ab67fc640 1 -- 172.21.15.63:0/1434734307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c211490 msgr2=0x55b24c5ed050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.466+0000 7f0ab67fc640 1 --2- 172.21.15.63:0/1434734307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c211490 0x55b24c5ed050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.466+0000 7f0ab67fc640 1 -- 172.21.15.63:0/1434734307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b24c5f9540 con 0x55b24c219670 2024-09-21T06:35:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.466+0000 7f0ab77fe640 1 --2- 172.21.15.63:0/1434734307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c23a350 0x55b24c5f8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.466+0000 7f0ab67fc640 1 --2- 172.21.15.63:0/1434734307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c219670 0x55b24c5ed5d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0105610 tx=0x7f0aa0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9c43a845cd97e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.466+0000 7f0a96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:35:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.466+0000 7f0a96ffd640 1 -- 172.21.15.63:0/1434734307 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0049070 con 0x55b24c219670 2024-09-21T06:35:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.466+0000 7f0a96ffd640 1 -- 172.21.15.63:0/1434734307 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7f0aa0105830 con 0x55b24c219670 2024-09-21T06:35:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.466+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/1434734307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ab00054d0 con 0x55b24c219670 2024-09-21T06:35:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.466+0000 7f0a96ffd640 1 -- 172.21.15.63:0/1434734307 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f0aa00cda80 con 0x55b24c219670 2024-09-21T06:35:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.466+0000 7f0ac3ef4740 10 client.17001 fetch_fsmap learned FSMap version 53 2024-09-21T06:35:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.466+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/1434734307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55b24c5fbe70 con 0x55b24c219670 2024-09-21T06:35:22.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.466+0000 7f0a96ffd640 1 -- 172.21.15.63:0/1434734307 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ab00054d0 con 0x55b24c219670 2024-09-21T06:35:22.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.467+0000 7f0a96ffd640 1 -- 172.21.15.63:0/1434734307 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7f0aa00f1110 con 0x55b24c219670 2024-09-21T06:35:22.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.467+0000 7f0ac3ef4740 10 client.17001 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:35:22.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.467+0000 7f0ac3ef4740 10 client.17001 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:35:22.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.467+0000 7f0ac3ef4740 20 client.17001 populate_metadata read hostname 'smithi063' 2024-09-21T06:35:22.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.467+0000 7f0ac3ef4740 1 --2- 172.21.15.63:0/1434734307 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b24c1f8cd0 0x55b24c5ff3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.467+0000 7f0ac3ef4740 4 client.17001 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:35:22.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.467+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/1434734307 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b24c559db0 con 0x55b24c1f8cd0 2024-09-21T06:35:22.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.467+0000 7f0ab6ffd640 1 --2- 172.21.15.63:0/1434734307 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b24c1f8cd0 0x55b24c5ff3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.467+0000 7f0a96ffd640 10 client.17001 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:35:22.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.467+0000 7f0ab6ffd640 1 --2- 172.21.15.63:0/1434734307 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b24c1f8cd0 0x55b24c5ff3e0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbc13805458821ef server_cookie=6c457c26daa2e51 in_seq=0 out_seq=0 2024-09-21T06:35:22.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.468+0000 7f0a96ffd640 1 -- 172.21.15.63:0/1434734307 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b24c559db0 con 0x55b24c1f8cd0 2024-09-21T06:35:22.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.468+0000 7f0a96ffd640 10 client.17001 handle_command_reply: tid=0 2024-09-21T06:35:22.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.468+0000 7f0ac3ef4740 1 client.17001 shutdown 2024-09-21T06:35:22.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.468+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/1434734307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c219670 msgr2=0x55b24c5ed5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:22.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.468+0000 7f0ac3ef4740 1 --2- 172.21.15.63:0/1434734307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c219670 0x55b24c5ed5d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0105610 tx=0x7f0aa0009260 comp rx=0 tx=0).stop 2024-09-21T06:35:22.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.469+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/1434734307 shutdown_connections 2024-09-21T06:35:22.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.469+0000 7f0ac3ef4740 1 --2- 172.21.15.63:0/1434734307 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b24c1f8cd0 0x55b24c5ff3e0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.469+0000 7f0a96ffd640 0 client.17001 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:35:22.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.469+0000 7f0ac3ef4740 1 --2- 172.21.15.63:0/1434734307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c23a350 0x55b24c5f8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.469+0000 7f0ac3ef4740 1 --2- 172.21.15.63:0/1434734307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c219670 0x55b24c5ed5d0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.469+0000 7f0ac3ef4740 1 --2- 172.21.15.63:0/1434734307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c211490 0x55b24c5ed050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.469+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/1434734307 >> 172.21.15.63:0/1434734307 conn(0x55b24c22e740 msgr2=0x55b24c5e45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:22.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.469+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/1434734307 shutdown_connections 2024-09-21T06:35:22.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.469+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/1434734307 wait complete. 2024-09-21T06:35:22.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.469+0000 7f0ac3ef4740 20 client.17001 trim_cache size 0 max 16384 2024-09-21T06:35:22.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.486+0000 7f0ac3ef4740 1 Processor -- start 2024-09-21T06:35:22.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.486+0000 7f0ac3ef4740 1 -- start start 2024-09-21T06:35:22.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.487+0000 7f0ac3ef4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c1f8cd0 0x55b24c5e6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.487+0000 7f0ac3ef4740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c211490 0x55b24c5e6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.487+0000 7f0ac3ef4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c219670 0x55b24c5ea040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.487+0000 7f0ac3ef4740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81af790 con 0x55b24c211490 2024-09-21T06:35:22.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.487+0000 7f0ac3ef4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81b1390 con 0x55b24c219670 2024-09-21T06:35:22.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.487+0000 7f0ac3ef4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81afe60 con 0x55b24c1f8cd0 2024-09-21T06:35:22.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.487+0000 7f0ab67fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c211490 0x55b24c5e6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.487+0000 7f0ab67fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c211490 0x55b24c5e6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56274/0 (socket says 172.21.15.63:56274) 2024-09-21T06:35:22.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.487+0000 7f0ab67fc640 1 -- 172.21.15.63:0/3936725602 learned_addr learned my addr 172.21.15.63:0/3936725602 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:22.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.487+0000 7f0ab6ffd640 1 --2- 172.21.15.63:0/3936725602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c1f8cd0 0x55b24c5e6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.487+0000 7f0ab77fe640 1 --2- 172.21.15.63:0/3936725602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c219670 0x55b24c5ea040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.487+0000 7f0ab67fc640 1 -- 172.21.15.63:0/3936725602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c1f8cd0 msgr2=0x55b24c5e6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:22.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.487+0000 7f0ab67fc640 1 --2- 172.21.15.63:0/3936725602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c1f8cd0 0x55b24c5e6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.487+0000 7f0ab67fc640 1 -- 172.21.15.63:0/3936725602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c219670 msgr2=0x55b24c5ea040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:22.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.487+0000 7f0ab67fc640 1 --2- 172.21.15.63:0/3936725602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c219670 0x55b24c5ea040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.487+0000 7f0ab67fc640 1 -- 172.21.15.63:0/3936725602 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b24c5dfc10 con 0x55b24c211490 2024-09-21T06:35:22.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.487+0000 7f0ab77fe640 1 --2- 172.21.15.63:0/3936725602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c219670 0x55b24c5ea040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:22.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.487+0000 7f0ab67fc640 1 --2- 172.21.15.63:0/3936725602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c211490 0x55b24c5e6a80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0031440 tx=0x7f0aa0031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14519f4da4546f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:22.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.488+0000 7f0aad7fa640 1 -- 172.21.15.63:0/3936725602 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0049020 con 0x55b24c211490 2024-09-21T06:35:22.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.488+0000 7f0aad7fa640 1 -- 172.21.15.63:0/3936725602 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aa00cd7c0 con 0x55b24c211490 2024-09-21T06:35:22.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.488+0000 7f0aad7fa640 1 -- 172.21.15.63:0/3936725602 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa00c9420 con 0x55b24c211490 2024-09-21T06:35:22.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.488+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/3936725602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c211490 msgr2=0x55b24c5e6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:22.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.488+0000 7f0ac3ef4740 1 --2- 172.21.15.63:0/3936725602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c211490 0x55b24c5e6a80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0031440 tx=0x7f0aa0031a10 comp rx=0 tx=0).stop 2024-09-21T06:35:22.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.488+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/3936725602 shutdown_connections 2024-09-21T06:35:22.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.488+0000 7f0ac3ef4740 1 --2- 172.21.15.63:0/3936725602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c219670 0x55b24c5ea040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.488+0000 7f0ac3ef4740 1 --2- 172.21.15.63:0/3936725602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c211490 0x55b24c5e6a80 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.488+0000 7f0ac3ef4740 1 --2- 172.21.15.63:0/3936725602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c1f8cd0 0x55b24c5e6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.488+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/3936725602 >> 172.21.15.63:0/3936725602 conn(0x55b24c22e740 msgr2=0x55b24c5eb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:22.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.488+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/3936725602 shutdown_connections 2024-09-21T06:35:22.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.488+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/3936725602 wait complete. 2024-09-21T06:35:22.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.489+0000 7f0ac3ef4740 1 -- start start 2024-09-21T06:35:22.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.489+0000 7f0ac3ef4740 1 Processor -- start 2024-09-21T06:35:22.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.489+0000 7f0ac3ef4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c1f8cd0 0x55b24c5f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.489+0000 7f0ac3ef4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c211490 0x55b24c5f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.489+0000 7f0ac3ef4740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c219670 0x55b24c662d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.489+0000 7f0ac3ef4740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81b0cc0 con 0x55b24c219670 2024-09-21T06:35:22.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.489+0000 7f0ac3ef4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81b05c0 con 0x55b24c1f8cd0 2024-09-21T06:35:22.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.489+0000 7f0ac3ef4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81ad790 con 0x55b24c211490 2024-09-21T06:35:22.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.489+0000 7f0ac3ef4740 10 client.0 _ll_register_callbacks cb 0x7f0aa0005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:22.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.490+0000 7f0ab77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c219670 0x55b24c662d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.490+0000 7f0ab77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c219670 0x55b24c662d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56276/0 (socket says 172.21.15.63:56276) 2024-09-21T06:35:22.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.490+0000 7f0ab77fe640 1 -- 172.21.15.63:0/674678444 learned_addr learned my addr 172.21.15.63:0/674678444 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:22.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.490+0000 7f0ab6ffd640 1 --2- 172.21.15.63:0/674678444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c1f8cd0 0x55b24c5f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.490+0000 7f0ab67fc640 1 --2- 172.21.15.63:0/674678444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c211490 0x55b24c5f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.490+0000 7f0ab77fe640 1 -- 172.21.15.63:0/674678444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c211490 msgr2=0x55b24c5f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:22.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.490+0000 7f0ab77fe640 1 --2- 172.21.15.63:0/674678444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c211490 0x55b24c5f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.490+0000 7f0ab77fe640 1 -- 172.21.15.63:0/674678444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c1f8cd0 msgr2=0x55b24c5f17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:22.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.490+0000 7f0ab77fe640 1 --2- 172.21.15.63:0/674678444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c1f8cd0 0x55b24c5f17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.490+0000 7f0ab77fe640 1 -- 172.21.15.63:0/674678444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b24c6633e0 con 0x55b24c219670 2024-09-21T06:35:22.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.490+0000 7f0ab67fc640 1 --2- 172.21.15.63:0/674678444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c211490 0x55b24c5f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:22.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.490+0000 7f0ab77fe640 1 --2- 172.21.15.63:0/674678444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c219670 0x55b24c662d70 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8012a70 tx=0x7f0aa8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e0a4269af1f06e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:22.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.490+0000 7f0a96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:35:22.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.490+0000 7f0a96ffd640 1 -- 172.21.15.63:0/674678444 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa802c060 con 0x55b24c219670 2024-09-21T06:35:22.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.490+0000 7f0a96ffd640 1 -- 172.21.15.63:0/674678444 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7f0aa801f9f0 con 0x55b24c219670 2024-09-21T06:35:22.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.490+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/674678444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0aa00cd7c0 con 0x55b24c219670 2024-09-21T06:35:22.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.491+0000 7f0a96ffd640 1 -- 172.21.15.63:0/674678444 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f0aa801fbf0 con 0x55b24c219670 2024-09-21T06:35:22.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.491+0000 7f0ac3ef4740 10 client.17007 fetch_fsmap learned FSMap version 53 2024-09-21T06:35:22.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.491+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/674678444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55b24c66a710 con 0x55b24c219670 2024-09-21T06:35:22.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.491+0000 7f0a96ffd640 1 -- 172.21.15.63:0/674678444 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aa00cd7c0 con 0x55b24c219670 2024-09-21T06:35:22.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.491+0000 7f0a96ffd640 1 -- 172.21.15.63:0/674678444 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7f0aa8026030 con 0x55b24c219670 2024-09-21T06:35:22.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.491+0000 7f0ac3ef4740 10 client.17007 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:35:22.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.491+0000 7f0ac3ef4740 10 client.17007 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:35:22.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.491+0000 7f0ac3ef4740 20 client.17007 populate_metadata read hostname 'smithi063' 2024-09-21T06:35:22.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.491+0000 7f0ac3ef4740 1 --2- 172.21.15.63:0/674678444 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b24c23a350 0x55b24c66ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.491+0000 7f0ac3ef4740 4 client.17007 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:35:22.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.491+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/674678444 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b24c555860 con 0x55b24c23a350 2024-09-21T06:35:22.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.491+0000 7f0ab6ffd640 1 --2- 172.21.15.63:0/674678444 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b24c23a350 0x55b24c66ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.492+0000 7f0a96ffd640 10 client.17007 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:35:22.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.492+0000 7f0ab6ffd640 1 --2- 172.21.15.63:0/674678444 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b24c23a350 0x55b24c66ce80 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cff257db1f218e2 server_cookie=c8e75fef78fca84c in_seq=0 out_seq=0 2024-09-21T06:35:22.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.494+0000 7f0a96ffd640 1 -- 172.21.15.63:0/674678444 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b24c555860 con 0x55b24c23a350 2024-09-21T06:35:22.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.494+0000 7f0a96ffd640 10 client.17007 handle_command_reply: tid=0 2024-09-21T06:35:22.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.494+0000 7f0ac3ef4740 1 client.17007 shutdown 2024-09-21T06:35:22.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.494+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/674678444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c219670 msgr2=0x55b24c662d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:22.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.494+0000 7f0ac3ef4740 1 --2- 172.21.15.63:0/674678444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c219670 0x55b24c662d70 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8012a70 tx=0x7f0aa8004a40 comp rx=0 tx=0).stop 2024-09-21T06:35:22.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.494+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/674678444 shutdown_connections 2024-09-21T06:35:22.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.494+0000 7f0ac3ef4740 1 --2- 172.21.15.63:0/674678444 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55b24c23a350 0x55b24c66ce80 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.494+0000 7f0ac3ef4740 1 --2- 172.21.15.63:0/674678444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b24c219670 0x55b24c662d70 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.494+0000 7f0ac3ef4740 1 --2- 172.21.15.63:0/674678444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b24c211490 0x55b24c5f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.494+0000 7f0ac3ef4740 1 --2- 172.21.15.63:0/674678444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24c1f8cd0 0x55b24c5f17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.494+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/674678444 >> 172.21.15.63:0/674678444 conn(0x55b24c22e740 msgr2=0x55b24c5e6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:22.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.494+0000 7f0a96ffd640 0 client.17007 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:35:22.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.494+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/674678444 shutdown_connections 2024-09-21T06:35:22.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.494+0000 7f0ac3ef4740 1 -- 172.21.15.63:0/674678444 wait complete. 2024-09-21T06:35:22.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.494+0000 7f0ac3ef4740 20 client.17007 trim_cache size 0 max 16384 2024-09-21T06:35:22.500 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:35:22.500 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0, 2024-09-21T06:35:22.501 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_tag": "0c926bc7-90f8-47ce-a0d2-d02e676a73e9", 2024-09-21T06:35:22.501 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": "asynchronous" 2024-09-21T06:35:22.501 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:35:22.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.495+0000 7f0abd980640 1 -- 172.21.15.63:0/4060351391 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0aa40b6680 msgr2=0x7f0aa40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:22.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.495+0000 7f0abd980640 1 --2- 172.21.15.63:0/4060351391 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0aa40b6680 0x7f0aa40b8b90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8005fd0 tx=0x7f0aa80097f0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.495+0000 7f0abd980640 1 -- 172.21.15.63:0/4060351391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ab8105300 msgr2=0x7f0ab819aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:22.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.495+0000 7f0abd980640 1 --2- 172.21.15.63:0/4060351391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ab8105300 0x7f0ab819aa00 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f0aa002a930 tx=0x7f0aa0004270 comp rx=0 tx=0).stop 2024-09-21T06:35:22.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.495+0000 7f0abd980640 1 -- 172.21.15.63:0/4060351391 shutdown_connections 2024-09-21T06:35:22.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.495+0000 7f0abd980640 1 --2- 172.21.15.63:0/4060351391 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0aa40b6680 0x7f0aa40b8b90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.495+0000 7f0abd980640 1 --2- 172.21.15.63:0/4060351391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab810de10 0x7f0ab819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.495+0000 7f0abd980640 1 --2- 172.21.15.63:0/4060351391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ab8105300 0x7f0ab819aa00 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.495+0000 7f0abd980640 1 --2- 172.21.15.63:0/4060351391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab81049b0 0x7f0ab819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.495+0000 7f0abd980640 1 -- 172.21.15.63:0/4060351391 >> 172.21.15.63:0/4060351391 conn(0x7f0ab8079730 msgr2=0x7f0ab8100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:22.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.495+0000 7f0abd980640 1 -- 172.21.15.63:0/4060351391 shutdown_connections 2024-09-21T06:35:22.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:22.495+0000 7f0abd980640 1 -- 172.21.15.63:0/4060351391 wait complete. 2024-09-21T06:35:23.233 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:35:23.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:23 smithi063 ceph-mon[31150]: pgmap v540: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:35:23.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:23 smithi063 ceph-mon[31150]: scrub queued for path: / 2024-09-21T06:35:23.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:23 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:35:23.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:23 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:35:23.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:23 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:35:23.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:23 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:35:23.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:23 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:35:23.491 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:23.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:23 smithi071 ceph-mon[34844]: pgmap v540: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:35:23.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:23 smithi071 ceph-mon[34844]: scrub queued for path: / 2024-09-21T06:35:23.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:23 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:35:23.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:23 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:35:23.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:23 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:35:23.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:23 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:35:23.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:23 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:35:23.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:23 smithi175 ceph-mon[34510]: pgmap v540: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:35:23.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:23 smithi175 ceph-mon[34510]: scrub queued for path: / 2024-09-21T06:35:23.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:23 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:35:23.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:23 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:35:23.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:23 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:35:23.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:23 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:35:23.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:23 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:35:24.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.076+0000 7fbef78b0640 1 -- 172.21.15.63:0/2634246028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbef01094e0 msgr2=0x7fbef01098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.076+0000 7fbef78b0640 1 --2- 172.21.15.63:0/2634246028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbef01094e0 0x7fbef01098f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fbee4009900 tx=0x7fbee402a410 comp rx=0 tx=0).stop 2024-09-21T06:35:24.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.076+0000 7fbef78b0640 1 -- 172.21.15.63:0/2634246028 shutdown_connections 2024-09-21T06:35:24.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.076+0000 7fbef78b0640 1 --2- 172.21.15.63:0/2634246028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbef0109e30 0x7fbef0110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.076+0000 7fbef78b0640 1 --2- 172.21.15.63:0/2634246028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbef01094e0 0x7fbef01098f0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.076+0000 7fbef78b0640 1 --2- 172.21.15.63:0/2634246028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbef0103ba0 0x7fbef0103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.076+0000 7fbef78b0640 1 -- 172.21.15.63:0/2634246028 >> 172.21.15.63:0/2634246028 conn(0x7fbef00ff630 msgr2=0x7fbef0101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:24.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.076+0000 7fbef78b0640 1 -- 172.21.15.63:0/2634246028 shutdown_connections 2024-09-21T06:35:24.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.076+0000 7fbef78b0640 1 -- 172.21.15.63:0/2634246028 wait complete. 2024-09-21T06:35:24.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.077+0000 7fbef78b0640 1 Processor -- start 2024-09-21T06:35:24.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.077+0000 7fbef78b0640 1 -- start start 2024-09-21T06:35:24.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.077+0000 7fbef78b0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbef0103ba0 0x7fbef0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.077+0000 7fbef78b0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbef01094e0 0x7fbef0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.077+0000 7fbef78b0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbef0109e30 0x7fbef0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.077+0000 7fbef78b0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbef0113af0 con 0x7fbef01094e0 2024-09-21T06:35:24.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.077+0000 7fbef78b0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbef0113970 con 0x7fbef0109e30 2024-09-21T06:35:24.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.077+0000 7fbef78b0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbef0113c70 con 0x7fbef0103ba0 2024-09-21T06:35:24.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.077+0000 7fbef4e4b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbef01094e0 0x7fbef0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.077+0000 7fbef4e4b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbef01094e0 0x7fbef0075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56296/0 (socket says 172.21.15.63:56296) 2024-09-21T06:35:24.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.078+0000 7fbef4e4b640 1 -- 172.21.15.63:0/2564728105 learned_addr learned my addr 172.21.15.63:0/2564728105 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:24.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.078+0000 7fbef564c640 1 --2- 172.21.15.63:0/2564728105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbef0103ba0 0x7fbef0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.078+0000 7fbef5e4d640 1 --2- 172.21.15.63:0/2564728105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbef0109e30 0x7fbef0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.078+0000 7fbef4e4b640 1 -- 172.21.15.63:0/2564728105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbef0103ba0 msgr2=0x7fbef0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.078+0000 7fbef4e4b640 1 --2- 172.21.15.63:0/2564728105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbef0103ba0 0x7fbef0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.078+0000 7fbef4e4b640 1 -- 172.21.15.63:0/2564728105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbef0109e30 msgr2=0x7fbef0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.078+0000 7fbef4e4b640 1 --2- 172.21.15.63:0/2564728105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbef0109e30 0x7fbef0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.078+0000 7fbef4e4b640 1 -- 172.21.15.63:0/2564728105 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef01a8710 con 0x7fbef01094e0 2024-09-21T06:35:24.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.078+0000 7fbef4e4b640 1 --2- 172.21.15.63:0/2564728105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbef01094e0 0x7fbef0075c50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fbee402a930 tx=0x7fbee4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:24.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.078+0000 7fbee27fc640 1 -- 172.21.15.63:0/2564728105 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee403f030 con 0x7fbef01094e0 2024-09-21T06:35:24.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.078+0000 7fbee27fc640 1 -- 172.21.15.63:0/2564728105 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbee4003aa0 con 0x7fbef01094e0 2024-09-21T06:35:24.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.078+0000 7fbef78b0640 1 -- 172.21.15.63:0/2564728105 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef01a89a0 con 0x7fbef01094e0 2024-09-21T06:35:24.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.078+0000 7fbee27fc640 1 -- 172.21.15.63:0/2564728105 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee4035070 con 0x7fbef01094e0 2024-09-21T06:35:24.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.078+0000 7fbef78b0640 1 -- 172.21.15.63:0/2564728105 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef01a8ed0 con 0x7fbef01094e0 2024-09-21T06:35:24.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.081+0000 7fbee27fc640 1 -- 172.21.15.63:0/2564728105 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fbee4042030 con 0x7fbef01094e0 2024-09-21T06:35:24.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.081+0000 7fbefde24740 1 Processor -- start 2024-09-21T06:35:24.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.081+0000 7fbefde24740 1 -- start start 2024-09-21T06:35:24.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.082+0000 7fbefde24740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaed1070 0x5646eb278650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.082+0000 7fbefde24740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaea81b0 0x5646eb278b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.082+0000 7fbefde24740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaeb0390 0x5646eb2790d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.082+0000 7fbefde24740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5646eb1eee50 con 0x5646eaeb0390 2024-09-21T06:35:24.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.082+0000 7fbefde24740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5646eb1de280 con 0x5646eaea81b0 2024-09-21T06:35:24.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.082+0000 7fbefde24740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5646eb1e2090 con 0x5646eaed1070 2024-09-21T06:35:24.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.082+0000 7fbef4e4b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaeb0390 0x5646eb2790d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.082+0000 7fbef4e4b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaeb0390 0x5646eb2790d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56300/0 (socket says 172.21.15.63:56300) 2024-09-21T06:35:24.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.082+0000 7fbef4e4b640 1 -- 172.21.15.63:0/2237421896 learned_addr learned my addr 172.21.15.63:0/2237421896 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:24.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.082+0000 7fbef564c640 1 --2- 172.21.15.63:0/2237421896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaea81b0 0x5646eb278b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.082+0000 7fbef5e4d640 1 --2- 172.21.15.63:0/2237421896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaed1070 0x5646eb278650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.082+0000 7fbee27fc640 1 --2- 172.21.15.63:0/2564728105 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbedc0b6700 0x7fbedc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.082+0000 7fbef4e4b640 1 -- 172.21.15.63:0/2237421896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaed1070 msgr2=0x5646eb278650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:24.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.082+0000 7fbef4e4b640 1 --2- 172.21.15.63:0/2237421896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaed1070 0x5646eb278650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.082+0000 7fbef4e4b640 1 -- 172.21.15.63:0/2237421896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaea81b0 msgr2=0x5646eb278b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:24.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.082+0000 7fbef4e4b640 1 --2- 172.21.15.63:0/2237421896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaea81b0 0x5646eb278b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.082+0000 7fbef4e4b640 1 -- 172.21.15.63:0/2237421896 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646eaf3c650 con 0x5646eaeb0390 2024-09-21T06:35:24.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.082+0000 7fbef5e4d640 1 --2- 172.21.15.63:0/2564728105 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbedc0b6700 0x7fbedc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.082+0000 7fbef564c640 1 --2- 172.21.15.63:0/2237421896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaea81b0 0x5646eb278b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:35:24.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.083+0000 7fbee27fc640 1 -- 172.21.15.63:0/2564728105 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7fbee4107f00 con 0x7fbef01094e0 2024-09-21T06:35:24.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.083+0000 7fbef4e4b640 1 --2- 172.21.15.63:0/2237421896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaeb0390 0x5646eb2790d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fbee4105570 tx=0x7fbee4091d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81aef19c82373d4e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:24.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.083+0000 7fbedb7fe640 1 -- 172.21.15.63:0/2237421896 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee40cd650 con 0x5646eaeb0390 2024-09-21T06:35:24.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.083+0000 7fbef5e4d640 1 --2- 172.21.15.63:0/2564728105 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbedc0b6700 0x7fbedc0b8c10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbee8008ea0 tx=0x7fbee8004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:24.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.083+0000 7fbedb7fe640 1 -- 172.21.15.63:0/2237421896 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbee40cd810 con 0x5646eaeb0390 2024-09-21T06:35:24.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.083+0000 7fbedb7fe640 1 -- 172.21.15.63:0/2237421896 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee40cd470 con 0x5646eaeb0390 2024-09-21T06:35:24.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.084+0000 7fbefde24740 1 -- 172.21.15.63:0/2237421896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaeb0390 msgr2=0x5646eb2790d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.084+0000 7fbefde24740 1 --2- 172.21.15.63:0/2237421896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaeb0390 0x5646eb2790d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fbee4105570 tx=0x7fbee4091d40 comp rx=0 tx=0).stop 2024-09-21T06:35:24.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.084+0000 7fbefde24740 1 -- 172.21.15.63:0/2237421896 shutdown_connections 2024-09-21T06:35:24.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.084+0000 7fbefde24740 1 --2- 172.21.15.63:0/2237421896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaeb0390 0x5646eb2790d0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.084+0000 7fbefde24740 1 --2- 172.21.15.63:0/2237421896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaea81b0 0x5646eb278b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.084+0000 7fbefde24740 1 --2- 172.21.15.63:0/2237421896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaed1070 0x5646eb278650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.084+0000 7fbefde24740 1 -- 172.21.15.63:0/2237421896 >> 172.21.15.63:0/2237421896 conn(0x5646eaec5460 msgr2=0x5646eb276540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:24.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.084+0000 7fbefde24740 1 -- 172.21.15.63:0/2237421896 shutdown_connections 2024-09-21T06:35:24.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.084+0000 7fbefde24740 1 -- 172.21.15.63:0/2237421896 wait complete. 2024-09-21T06:35:24.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.084+0000 7fbefde24740 1 -- start start 2024-09-21T06:35:24.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.085+0000 7fbefde24740 1 Processor -- start 2024-09-21T06:35:24.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.085+0000 7fbefde24740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaea81b0 0x5646eb283ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.085+0000 7fbefde24740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaeb0390 0x5646eb2841e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.085+0000 7fbefde24740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaed1070 0x5646eb28fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.085+0000 7fbefde24740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5646eb03f700 con 0x5646eaed1070 2024-09-21T06:35:24.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.085+0000 7fbefde24740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5646eb179110 con 0x5646eaea81b0 2024-09-21T06:35:24.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.085+0000 7fbefde24740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5646eb286bf0 con 0x5646eaeb0390 2024-09-21T06:35:24.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.085+0000 7fbefde24740 10 client.0 _ll_register_callbacks cb 0x5646eb192990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:24.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.085+0000 7fbef5e4d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaed1070 0x5646eb28fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.085+0000 7fbef5e4d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaed1070 0x5646eb28fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56304/0 (socket says 172.21.15.63:56304) 2024-09-21T06:35:24.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.085+0000 7fbef5e4d640 1 -- 172.21.15.63:0/647774668 learned_addr learned my addr 172.21.15.63:0/647774668 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:24.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.085+0000 7fbef564c640 1 --2- 172.21.15.63:0/647774668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaea81b0 0x5646eb283ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.085+0000 7fbef4e4b640 1 --2- 172.21.15.63:0/647774668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaeb0390 0x5646eb2841e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.086+0000 7fbef5e4d640 1 -- 172.21.15.63:0/647774668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaeb0390 msgr2=0x5646eb2841e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:24.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.086+0000 7fbef5e4d640 1 --2- 172.21.15.63:0/647774668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaeb0390 0x5646eb2841e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.086+0000 7fbef5e4d640 1 -- 172.21.15.63:0/647774668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaea81b0 msgr2=0x5646eb283ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:24.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.086+0000 7fbef5e4d640 1 --2- 172.21.15.63:0/647774668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaea81b0 0x5646eb283ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.086+0000 7fbef5e4d640 1 -- 172.21.15.63:0/647774668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646eb1a6c40 con 0x5646eaed1070 2024-09-21T06:35:24.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.086+0000 7fbef4e4b640 1 --2- 172.21.15.63:0/647774668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaeb0390 0x5646eb2841e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:24.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.086+0000 7fbef5e4d640 1 --2- 172.21.15.63:0/647774668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaed1070 0x5646eb28fe10 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fbee8012e50 tx=0x7fbee8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878b0db0d6359d18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:24.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.086+0000 7fbed8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:35:24.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.086+0000 7fbed8ff9640 1 -- 172.21.15.63:0/647774668 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee8008b60 con 0x5646eaed1070 2024-09-21T06:35:24.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.086+0000 7fbed8ff9640 1 -- 172.21.15.63:0/647774668 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7fbee8027670 con 0x5646eaed1070 2024-09-21T06:35:24.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.086+0000 7fbefde24740 1 -- 172.21.15.63:0/647774668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbee40cd810 con 0x5646eaed1070 2024-09-21T06:35:24.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.086+0000 7fbed8ff9640 1 -- 172.21.15.63:0/647774668 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fbee8027870 con 0x5646eaed1070 2024-09-21T06:35:24.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.086+0000 7fbefde24740 10 client.17019 fetch_fsmap learned FSMap version 53 2024-09-21T06:35:24.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.086+0000 7fbefde24740 1 -- 172.21.15.63:0/647774668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5646eb292830 con 0x5646eaed1070 2024-09-21T06:35:24.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.086+0000 7fbed8ff9640 1 -- 172.21.15.63:0/647774668 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbee40cd810 con 0x5646eaed1070 2024-09-21T06:35:24.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.087+0000 7fbed8ff9640 1 -- 172.21.15.63:0/647774668 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7fbee801b670 con 0x5646eaed1070 2024-09-21T06:35:24.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.087+0000 7fbefde24740 10 client.17019 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:35:24.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.087+0000 7fbefde24740 10 client.17019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:35:24.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.087+0000 7fbefde24740 20 client.17019 populate_metadata read hostname 'smithi063' 2024-09-21T06:35:24.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.087+0000 7fbefde24740 1 --2- 172.21.15.63:0/647774668 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5646eae8f9f0 0x5646eb295d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.087+0000 7fbefde24740 4 client.17019 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:35:24.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.087+0000 7fbefde24740 1 -- 172.21.15.63:0/647774668 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646eb1f0da0 con 0x5646eae8f9f0 2024-09-21T06:35:24.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.087+0000 7fbef564c640 1 --2- 172.21.15.63:0/647774668 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5646eae8f9f0 0x5646eb295d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.087+0000 7fbef564c640 1 --2- 172.21.15.63:0/647774668 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5646eae8f9f0 0x5646eb295d80 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e83972f98674a8f6 server_cookie=a02dee4ace39b287 in_seq=0 out_seq=0 2024-09-21T06:35:24.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.087+0000 7fbed8ff9640 10 client.17019 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:35:24.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.088+0000 7fbed8ff9640 1 -- 172.21.15.63:0/647774668 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5646eb1f0da0 con 0x5646eae8f9f0 2024-09-21T06:35:24.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.088+0000 7fbed8ff9640 10 client.17019 handle_command_reply: tid=0 2024-09-21T06:35:24.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.088+0000 7fbefde24740 1 client.17019 shutdown 2024-09-21T06:35:24.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.088+0000 7fbefde24740 1 -- 172.21.15.63:0/647774668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaed1070 msgr2=0x5646eb28fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.088+0000 7fbefde24740 1 --2- 172.21.15.63:0/647774668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaed1070 0x5646eb28fe10 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fbee8012e50 tx=0x7fbee8004ab0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.088+0000 7fbefde24740 1 -- 172.21.15.63:0/647774668 shutdown_connections 2024-09-21T06:35:24.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.088+0000 7fbefde24740 1 --2- 172.21.15.63:0/647774668 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5646eae8f9f0 0x5646eb295d80 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.088+0000 7fbefde24740 1 --2- 172.21.15.63:0/647774668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaed1070 0x5646eb28fe10 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.088+0000 7fbefde24740 1 --2- 172.21.15.63:0/647774668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaeb0390 0x5646eb2841e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.088+0000 7fbefde24740 1 --2- 172.21.15.63:0/647774668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaea81b0 0x5646eb283ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.089+0000 7fbefde24740 1 -- 172.21.15.63:0/647774668 >> 172.21.15.63:0/647774668 conn(0x5646eaec5460 msgr2=0x5646eb27a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:24.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.089+0000 7fbed8ff9640 0 client.17019 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:35:24.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.089+0000 7fbefde24740 1 -- 172.21.15.63:0/647774668 shutdown_connections 2024-09-21T06:35:24.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.089+0000 7fbefde24740 1 -- 172.21.15.63:0/647774668 wait complete. 2024-09-21T06:35:24.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.089+0000 7fbefde24740 20 client.17019 trim_cache size 0 max 16384 2024-09-21T06:35:24.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.106+0000 7fbefde24740 1 Processor -- start 2024-09-21T06:35:24.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.106+0000 7fbefde24740 1 -- start start 2024-09-21T06:35:24.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.107+0000 7fbefde24740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaea81b0 0x5646eb284160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.107+0000 7fbefde24740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaeb0390 0x5646eb27e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.107+0000 7fbefde24740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaed1070 0x5646eb28fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.107+0000 7fbefde24740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbef01b19c0 con 0x5646eaeb0390 2024-09-21T06:35:24.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.107+0000 7fbefde24740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbef01b35c0 con 0x5646eaea81b0 2024-09-21T06:35:24.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.107+0000 7fbefde24740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbef01b2090 con 0x5646eaed1070 2024-09-21T06:35:24.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.107+0000 7fbef4e4b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaeb0390 0x5646eb27e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.107+0000 7fbef4e4b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaeb0390 0x5646eb27e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56320/0 (socket says 172.21.15.63:56320) 2024-09-21T06:35:24.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.107+0000 7fbef4e4b640 1 -- 172.21.15.63:0/885326197 learned_addr learned my addr 172.21.15.63:0/885326197 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:24.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.107+0000 7fbef564c640 1 --2- 172.21.15.63:0/885326197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaea81b0 0x5646eb284160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.107+0000 7fbef5e4d640 1 --2- 172.21.15.63:0/885326197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaed1070 0x5646eb28fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.107+0000 7fbef4e4b640 1 -- 172.21.15.63:0/885326197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaed1070 msgr2=0x5646eb28fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:24.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.107+0000 7fbef4e4b640 1 --2- 172.21.15.63:0/885326197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaed1070 0x5646eb28fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.107+0000 7fbef4e4b640 1 -- 172.21.15.63:0/885326197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaea81b0 msgr2=0x5646eb284160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:24.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.107+0000 7fbef4e4b640 1 --2- 172.21.15.63:0/885326197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaea81b0 0x5646eb284160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.107+0000 7fbef4e4b640 1 -- 172.21.15.63:0/885326197 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646eb282c00 con 0x5646eaeb0390 2024-09-21T06:35:24.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.107+0000 7fbef5e4d640 1 --2- 172.21.15.63:0/885326197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaed1070 0x5646eb28fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:24.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.107+0000 7fbef564c640 1 --2- 172.21.15.63:0/885326197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaea81b0 0x5646eb284160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:24.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.107+0000 7fbef4e4b640 1 --2- 172.21.15.63:0/885326197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaeb0390 0x5646eb27e0b0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fbee40caf70 tx=0x7fbee402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0943bb0a567f8f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:24.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.108+0000 7fbedaffd640 1 -- 172.21.15.63:0/885326197 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee4049070 con 0x5646eaeb0390 2024-09-21T06:35:24.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.108+0000 7fbedaffd640 1 -- 172.21.15.63:0/885326197 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbee40cd810 con 0x5646eaeb0390 2024-09-21T06:35:24.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.108+0000 7fbedaffd640 1 -- 172.21.15.63:0/885326197 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee40d7720 con 0x5646eaeb0390 2024-09-21T06:35:24.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.109+0000 7fbefde24740 1 -- 172.21.15.63:0/885326197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaeb0390 msgr2=0x5646eb27e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.109+0000 7fbefde24740 1 --2- 172.21.15.63:0/885326197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaeb0390 0x5646eb27e0b0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fbee40caf70 tx=0x7fbee402a410 comp rx=0 tx=0).stop 2024-09-21T06:35:24.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.109+0000 7fbefde24740 1 -- 172.21.15.63:0/885326197 shutdown_connections 2024-09-21T06:35:24.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.109+0000 7fbefde24740 1 --2- 172.21.15.63:0/885326197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaed1070 0x5646eb28fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.109+0000 7fbefde24740 1 --2- 172.21.15.63:0/885326197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaeb0390 0x5646eb27e0b0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.109+0000 7fbefde24740 1 --2- 172.21.15.63:0/885326197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaea81b0 0x5646eb284160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.109+0000 7fbefde24740 1 -- 172.21.15.63:0/885326197 >> 172.21.15.63:0/885326197 conn(0x5646eaec5460 msgr2=0x5646eb283a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.109+0000 7fbefde24740 1 -- 172.21.15.63:0/885326197 shutdown_connections 2024-09-21T06:35:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.109+0000 7fbefde24740 1 -- 172.21.15.63:0/885326197 wait complete. 2024-09-21T06:35:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.109+0000 7fbefde24740 1 -- start start 2024-09-21T06:35:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.109+0000 7fbefde24740 1 Processor -- start 2024-09-21T06:35:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.110+0000 7fbefde24740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaea81b0 0x5646eb28c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.110+0000 7fbefde24740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaeb0390 0x5646eb287c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.110+0000 7fbefde24740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaed1070 0x5646eb2882f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.110+0000 7fbefde24740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbef01b2ef0 con 0x5646eaed1070 2024-09-21T06:35:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.110+0000 7fbefde24740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbef01b27f0 con 0x5646eaeb0390 2024-09-21T06:35:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.110+0000 7fbefde24740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbef01af9c0 con 0x5646eaea81b0 2024-09-21T06:35:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.110+0000 7fbefde24740 10 client.0 _ll_register_callbacks cb 0x7fbee8008ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:24.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.110+0000 7fbef5e4d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaed1070 0x5646eb2882f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.110+0000 7fbef5e4d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaed1070 0x5646eb2882f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56334/0 (socket says 172.21.15.63:56334) 2024-09-21T06:35:24.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.110+0000 7fbef5e4d640 1 -- 172.21.15.63:0/3909875838 learned_addr learned my addr 172.21.15.63:0/3909875838 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:24.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.110+0000 7fbef4e4b640 1 --2- 172.21.15.63:0/3909875838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaeb0390 0x5646eb287c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.110+0000 7fbef564c640 1 --2- 172.21.15.63:0/3909875838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaea81b0 0x5646eb28c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.110+0000 7fbef5e4d640 1 -- 172.21.15.63:0/3909875838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaea81b0 msgr2=0x5646eb28c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:24.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.110+0000 7fbef5e4d640 1 --2- 172.21.15.63:0/3909875838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaea81b0 0x5646eb28c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.110+0000 7fbef5e4d640 1 -- 172.21.15.63:0/3909875838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaeb0390 msgr2=0x5646eb287c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:24.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.110+0000 7fbef5e4d640 1 --2- 172.21.15.63:0/3909875838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaeb0390 0x5646eb287c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.110+0000 7fbef5e4d640 1 -- 172.21.15.63:0/3909875838 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646eb2ff760 con 0x5646eaed1070 2024-09-21T06:35:24.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.110+0000 7fbef5e4d640 1 --2- 172.21.15.63:0/3909875838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaed1070 0x5646eb2882f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fbee801dc40 tx=0x7fbee8027720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee33a9c94ad4f738 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:24.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.110+0000 7fbed8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:35:24.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.111+0000 7fbed8ff9640 1 -- 172.21.15.63:0/3909875838 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee801b650 con 0x5646eaed1070 2024-09-21T06:35:24.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.111+0000 7fbed8ff9640 1 -- 172.21.15.63:0/3909875838 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7fbee801b7f0 con 0x5646eaed1070 2024-09-21T06:35:24.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.111+0000 7fbefde24740 1 -- 172.21.15.63:0/3909875838 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbee40cd810 con 0x5646eaed1070 2024-09-21T06:35:24.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.111+0000 7fbed8ff9640 1 -- 172.21.15.63:0/3909875838 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fbee8027a10 con 0x5646eaed1070 2024-09-21T06:35:24.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.111+0000 7fbefde24740 10 client.17025 fetch_fsmap learned FSMap version 53 2024-09-21T06:35:24.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.111+0000 7fbefde24740 1 -- 172.21.15.63:0/3909875838 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5646eb300740 con 0x5646eaed1070 2024-09-21T06:35:24.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.111+0000 7fbed8ff9640 1 -- 172.21.15.63:0/3909875838 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbee40cd810 con 0x5646eaed1070 2024-09-21T06:35:24.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.111+0000 7fbed8ff9640 1 -- 172.21.15.63:0/3909875838 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 53) ==== 8394+0+0 (secure 0 0 0) 0x7fbee802fca0 con 0x5646eaed1070 2024-09-21T06:35:24.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.111+0000 7fbefde24740 10 client.17025 fetch_fsmap finished waiting for FSMap version 53 2024-09-21T06:35:24.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.111+0000 7fbefde24740 10 client.17025 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:35:24.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.111+0000 7fbefde24740 20 client.17025 populate_metadata read hostname 'smithi063' 2024-09-21T06:35:24.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.111+0000 7fbefde24740 1 --2- 172.21.15.63:0/3909875838 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5646eae64da0 0x5646eb302f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.111+0000 7fbefde24740 4 client.17025 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:35:24.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.111+0000 7fbefde24740 1 -- 172.21.15.63:0/3909875838 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5646eb1ec850 con 0x5646eae64da0 2024-09-21T06:35:24.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.112+0000 7fbef564c640 1 --2- 172.21.15.63:0/3909875838 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5646eae64da0 0x5646eb302f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.112+0000 7fbef564c640 1 --2- 172.21.15.63:0/3909875838 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5646eae64da0 0x5646eb302f50 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75b7201d3c602205 server_cookie=a6318b3964932123 in_seq=0 out_seq=0 2024-09-21T06:35:24.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.112+0000 7fbed8ff9640 10 client.17025 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:35:24.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.112+0000 7fbed8ff9640 1 -- 172.21.15.63:0/3909875838 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2274 (crc 0 0 0) 0x5646eb1ec850 con 0x5646eae64da0 2024-09-21T06:35:24.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.112+0000 7fbed8ff9640 10 client.17025 handle_command_reply: tid=0 2024-09-21T06:35:24.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.112+0000 7fbefde24740 1 client.17025 shutdown 2024-09-21T06:35:24.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.112+0000 7fbefde24740 1 -- 172.21.15.63:0/3909875838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaed1070 msgr2=0x5646eb2882f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.112+0000 7fbefde24740 1 --2- 172.21.15.63:0/3909875838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaed1070 0x5646eb2882f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fbee801dc40 tx=0x7fbee8027720 comp rx=0 tx=0).stop 2024-09-21T06:35:24.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.112+0000 7fbefde24740 1 -- 172.21.15.63:0/3909875838 shutdown_connections 2024-09-21T06:35:24.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.112+0000 7fbefde24740 1 --2- 172.21.15.63:0/3909875838 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5646eae64da0 0x5646eb302f50 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.112+0000 7fbefde24740 1 --2- 172.21.15.63:0/3909875838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5646eaed1070 0x5646eb2882f0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.112+0000 7fbefde24740 1 --2- 172.21.15.63:0/3909875838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5646eaeb0390 0x5646eb287c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.112+0000 7fbefde24740 1 --2- 172.21.15.63:0/3909875838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646eaea81b0 0x5646eb28c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.112+0000 7fbefde24740 1 -- 172.21.15.63:0/3909875838 >> 172.21.15.63:0/3909875838 conn(0x5646eaec5460 msgr2=0x5646eb275e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:24.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.112+0000 7fbed8ff9640 0 client.17025 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:35:24.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.113+0000 7fbefde24740 1 -- 172.21.15.63:0/3909875838 shutdown_connections 2024-09-21T06:35:24.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.113+0000 7fbefde24740 1 -- 172.21.15.63:0/3909875838 wait complete. 2024-09-21T06:35:24.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.113+0000 7fbefde24740 20 client.17025 trim_cache size 0 max 16384 2024-09-21T06:35:24.121 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:35:24.121 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:35:24.121 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": { 2024-09-21T06:35:24.121 INFO:teuthology.orchestra.run.smithi063.stdout: "0c926bc7-90f8-47ce-a0d2-d02e676a73e9": { 2024-09-21T06:35:24.121 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:24.121 INFO:teuthology.orchestra.run.smithi063.stdout: "tag": "0c926bc7-90f8-47ce-a0d2-d02e676a73e9", 2024-09-21T06:35:24.121 INFO:teuthology.orchestra.run.smithi063.stdout: "options": "recursive,force" 2024-09-21T06:35:24.121 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:35:24.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:35:24.122 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:35:24.122 INFO:teuthology.orchestra.run.smithi063.stdout: "0c926bc7-90f8-47ce-a0d2-d02e676a73e9": { 2024-09-21T06:35:24.122 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:35:22.494015+0000", 2024-09-21T06:35:24.122 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:24.122 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:35:24.122 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:35:24.122 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:35:24.122 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:35:24.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:35:24.122 INFO:teuthology.orchestra.run.smithi063.stdout: "4f099144-5170-453b-a745-ddc222860f34": { 2024-09-21T06:35:24.122 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:34:35.417817+0000", 2024-09-21T06:35:24.122 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:24.122 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:35:24.123 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:35:24.123 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:35:24.123 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:35:24.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:35:24.123 INFO:teuthology.orchestra.run.smithi063.stdout: "91ae0a75-6a3f-452f-8bda-0f19862a5724": { 2024-09-21T06:35:24.123 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:50.316590+0000", 2024-09-21T06:35:24.123 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:24.123 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:35:24.123 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:35:24.123 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:35:24.123 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:35:24.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:35:24.123 INFO:teuthology.orchestra.run.smithi063.stdout: "5396028b-35f4-48fe-b54d-385784e97de3": { 2024-09-21T06:35:24.124 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:04.523378+0000", 2024-09-21T06:35:24.124 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:24.124 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:35:24.124 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:35:24.124 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:35:24.124 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:35:24.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:35:24.124 INFO:teuthology.orchestra.run.smithi063.stdout: "024d3c59-0b67-49a9-bf4a-e02d36691942": { 2024-09-21T06:35:24.124 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:32:14.282244+0000", 2024-09-21T06:35:24.124 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:24.124 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:35:24.124 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:35:24.124 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:35:24.124 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:35:24.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:35:24.124 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:35:24.125 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:31:27.507051+0000", 2024-09-21T06:35:24.125 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:24.125 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:35:24.125 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:35:24.125 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:35:24.125 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:35:24.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:35:24.125 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:35:24.125 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:35:24.125 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:24.125 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:35:24.125 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:35:24.125 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:35:24.125 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:35:24.125 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:35:24.126 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:35:24.126 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:35:24.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.113+0000 7fbef78b0640 1 -- 172.21.15.63:0/2564728105 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbedc0b6700 msgr2=0x7fbedc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.113+0000 7fbef78b0640 1 --2- 172.21.15.63:0/2564728105 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbedc0b6700 0x7fbedc0b8c10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbee8008ea0 tx=0x7fbee8004a40 comp rx=0 tx=0).stop 2024-09-21T06:35:24.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.113+0000 7fbef78b0640 1 -- 172.21.15.63:0/2564728105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbef01094e0 msgr2=0x7fbef0075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.113+0000 7fbef78b0640 1 --2- 172.21.15.63:0/2564728105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbef01094e0 0x7fbef0075c50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fbee402a930 tx=0x7fbee4004270 comp rx=0 tx=0).stop 2024-09-21T06:35:24.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.113+0000 7fbef78b0640 1 -- 172.21.15.63:0/2564728105 shutdown_connections 2024-09-21T06:35:24.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.113+0000 7fbef78b0640 1 --2- 172.21.15.63:0/2564728105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbef0109e30 0x7fbef0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.113+0000 7fbef78b0640 1 --2- 172.21.15.63:0/2564728105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbef01094e0 0x7fbef0075c50 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.113+0000 7fbef78b0640 1 --2- 172.21.15.63:0/2564728105 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbedc0b6700 0x7fbedc0b8c10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.113+0000 7fbef78b0640 1 --2- 172.21.15.63:0/2564728105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbef0103ba0 0x7fbef0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.113+0000 7fbef78b0640 1 -- 172.21.15.63:0/2564728105 >> 172.21.15.63:0/2564728105 conn(0x7fbef00ff630 msgr2=0x7fbef0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:24.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.114+0000 7fbef78b0640 1 -- 172.21.15.63:0/2564728105 shutdown_connections 2024-09-21T06:35:24.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:24.114+0000 7fbef78b0640 1 -- 172.21.15.63:0/2564728105 wait complete. 2024-09-21T06:35:24.810 INFO:tasks.cephfs.filesystem:scrub status for tag:0c926bc7-90f8-47ce-a0d2-d02e676a73e9 - {'path': '/', 'tag': '0c926bc7-90f8-47ce-a0d2-d02e676a73e9', 'options': 'recursive,force'} 2024-09-21T06:35:25.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:25 smithi071 ceph-mon[34844]: pgmap v541: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:35:25.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:25 smithi063 ceph-mon[31150]: pgmap v541: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:35:25.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:25 smithi175 ceph-mon[34510]: pgmap v541: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:35:27.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:27 smithi071 ceph-mon[34844]: pgmap v542: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-09-21T06:35:27.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:27 smithi063 ceph-mon[31150]: pgmap v542: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-09-21T06:35:27.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:27 smithi175 ceph-mon[34510]: pgmap v542: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-09-21T06:35:28.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:28 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:35:28.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:28 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:35:28.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:28 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:35:29.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:29 smithi071 ceph-mon[34844]: pgmap v543: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 op/s 2024-09-21T06:35:29.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:29 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:35:29.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:29 smithi063 ceph-mon[31150]: pgmap v543: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 op/s 2024-09-21T06:35:29.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:29 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:35:29.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:29 smithi175 ceph-mon[34510]: pgmap v543: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 op/s 2024-09-21T06:35:29.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:29 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:35:31.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:31 smithi071 ceph-mon[34844]: pgmap v544: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 11 op/s 2024-09-21T06:35:31.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:31 smithi063 ceph-mon[31150]: pgmap v544: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 11 op/s 2024-09-21T06:35:31.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:31 smithi175 ceph-mon[34510]: pgmap v544: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 11 op/s 2024-09-21T06:35:32.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:32 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:35:32.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:32 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:35:32.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:32 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:35:32.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:32 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:35:32.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:32 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:35:32.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:32 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:35:33.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: pgmap v545: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T06:35:33.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: Adjusting osd_memory_target on smithi175 to 176.0M 2024-09-21T06:35:33.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: Adjusting osd_memory_target on smithi071 to 176.0M 2024-09-21T06:35:33.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: Adjusting osd_memory_target on smithi063 to 176.0M 2024-09-21T06:35:33.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: Unable to set osd_memory_target on smithi175 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T06:35:33.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: Unable to set osd_memory_target on smithi071 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T06:35:33.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: Unable to set osd_memory_target on smithi063 to 184585318: error parsing value: Value '184585318' is below minimum 939524096 2024-09-21T06:35:33.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:35:33.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:35:33.584 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:35:33.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: pgmap v545: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T06:35:33.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: Adjusting osd_memory_target on smithi175 to 176.0M 2024-09-21T06:35:33.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: Adjusting osd_memory_target on smithi071 to 176.0M 2024-09-21T06:35:33.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: Adjusting osd_memory_target on smithi063 to 176.0M 2024-09-21T06:35:33.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: Unable to set osd_memory_target on smithi175 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T06:35:33.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: Unable to set osd_memory_target on smithi071 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T06:35:33.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: Unable to set osd_memory_target on smithi063 to 184585318: error parsing value: Value '184585318' is below minimum 939524096 2024-09-21T06:35:33.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:35:33.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:35:33.601 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:35:33.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: pgmap v545: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T06:35:33.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:35:33.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: Adjusting osd_memory_target on smithi175 to 176.0M 2024-09-21T06:35:33.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: Adjusting osd_memory_target on smithi071 to 176.0M 2024-09-21T06:35:33.770 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: Adjusting osd_memory_target on smithi063 to 176.0M 2024-09-21T06:35:33.770 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: Unable to set osd_memory_target on smithi175 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T06:35:33.770 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: Unable to set osd_memory_target on smithi071 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T06:35:33.770 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: Unable to set osd_memory_target on smithi063 to 184585318: error parsing value: Value '184585318' is below minimum 939524096 2024-09-21T06:35:33.770 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:35:33.770 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:35:33.770 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:35:35.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:35 smithi063 ceph-mon[31150]: pgmap v546: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T06:35:35.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:35 smithi175 ceph-mon[34510]: pgmap v546: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T06:35:35.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:35 smithi071 ceph-mon[34844]: pgmap v546: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T06:35:37.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:37 smithi063 ceph-mon[31150]: pgmap v547: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 11 op/s 2024-09-21T06:35:37.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:37 smithi175 ceph-mon[34510]: pgmap v547: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 11 op/s 2024-09-21T06:35:37.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:37 smithi071 ceph-mon[34844]: pgmap v547: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 11 op/s 2024-09-21T06:35:39.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:39 smithi063 ceph-mon[31150]: pgmap v548: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-21T06:35:39.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:39 smithi175 ceph-mon[34510]: pgmap v548: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-21T06:35:39.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:39 smithi071 ceph-mon[34844]: pgmap v548: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-21T06:35:41.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:41 smithi063 ceph-mon[31150]: pgmap v549: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:35:41.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:41 smithi175 ceph-mon[34510]: pgmap v549: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:35:41.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:41 smithi071 ceph-mon[34844]: pgmap v549: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:35:43.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:43 smithi063 ceph-mon[31150]: pgmap v550: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:35:43.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:43 smithi175 ceph-mon[34510]: pgmap v550: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:35:43.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:43 smithi071 ceph-mon[34844]: pgmap v550: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:35:45.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:45 smithi063 ceph-mon[31150]: pgmap v551: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:35:45.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:45 smithi175 ceph-mon[34510]: pgmap v551: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:35:45.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:45 smithi071 ceph-mon[34844]: pgmap v551: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:35:47.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:47 smithi063 ceph-mon[31150]: pgmap v552: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:35:47.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:47 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:35:47.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:47 smithi175 ceph-mon[34510]: pgmap v552: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:35:47.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:47 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:35:47.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:47 smithi071 ceph-mon[34844]: pgmap v552: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:35:47.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:47 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:35:49.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:49 smithi063 ceph-mon[31150]: pgmap v553: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:35:49.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:49 smithi175 ceph-mon[34510]: pgmap v553: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:35:49.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:49 smithi071 ceph-mon[34844]: pgmap v553: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:35:51.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:51 smithi063 ceph-mon[31150]: pgmap v554: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:35:51.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:51 smithi175 ceph-mon[34510]: pgmap v554: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:35:51.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:51 smithi071 ceph-mon[34844]: pgmap v554: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:35:53.570 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:53 smithi071 ceph-mon[34844]: pgmap v555: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:35:53.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:53 smithi063 ceph-mon[31150]: pgmap v555: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:35:53.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:53 smithi175 ceph-mon[34510]: pgmap v555: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:35:54.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:54 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:35:54.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:54 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:35:54.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:54 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:35:54.812 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:35:55.071 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:55.460 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:55 smithi063 ceph-mon[31150]: pgmap v556: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:35:55.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.553+0000 7ff76b1f0640 1 -- 172.21.15.63:0/2756301839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff764103140 msgr2=0x7ff764103550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:55.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.553+0000 7ff76b1f0640 1 --2- 172.21.15.63:0/2756301839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff764103140 0x7ff764103550 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff75c009900 tx=0x7ff75c02a410 comp rx=0 tx=0).stop 2024-09-21T06:35:55.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.553+0000 7ff76b1f0640 1 -- 172.21.15.63:0/2756301839 shutdown_connections 2024-09-21T06:35:55.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.553+0000 7ff76b1f0640 1 --2- 172.21.15.63:0/2756301839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff764108d00 0x7ff76410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.553+0000 7ff76b1f0640 1 --2- 172.21.15.63:0/2756301839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7641083b0 0x7ff7641087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.553+0000 7ff76b1f0640 1 --2- 172.21.15.63:0/2756301839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff764103140 0x7ff764103550 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.553+0000 7ff76b1f0640 1 -- 172.21.15.63:0/2756301839 >> 172.21.15.63:0/2756301839 conn(0x7ff764077c60 msgr2=0x7ff7640780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:55.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.553+0000 7ff76b1f0640 1 -- 172.21.15.63:0/2756301839 shutdown_connections 2024-09-21T06:35:55.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.553+0000 7ff76b1f0640 1 -- 172.21.15.63:0/2756301839 wait complete. 2024-09-21T06:35:55.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.554+0000 7ff76b1f0640 1 Processor -- start 2024-09-21T06:35:55.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.554+0000 7ff76b1f0640 1 -- start start 2024-09-21T06:35:55.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.554+0000 7ff76b1f0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff764103140 0x7ff7640fede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.554+0000 7ff76b1f0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7641083b0 0x7ff7640ff320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.554+0000 7ff76b1f0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff764108d00 0x7ff7640ff860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.554+0000 7ff76b1f0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641129c0 con 0x7ff7641083b0 2024-09-21T06:35:55.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.554+0000 7ff76b1f0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff764112840 con 0x7ff764108d00 2024-09-21T06:35:55.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.554+0000 7ff76b1f0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff764112b40 con 0x7ff764103140 2024-09-21T06:35:55.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.554+0000 7ff763fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7641083b0 0x7ff7640ff320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.554+0000 7ff763fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7641083b0 0x7ff7640ff320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58146/0 (socket says 172.21.15.63:58146) 2024-09-21T06:35:55.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.554+0000 7ff763fff640 1 -- 172.21.15.63:0/1268573714 learned_addr learned my addr 172.21.15.63:0/1268573714 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:55.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.554+0000 7ff768f8c640 1 --2- 172.21.15.63:0/1268573714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff764103140 0x7ff7640fede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.554+0000 7ff76978d640 1 --2- 172.21.15.63:0/1268573714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff764108d00 0x7ff7640ff860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.555+0000 7ff763fff640 1 -- 172.21.15.63:0/1268573714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff764103140 msgr2=0x7ff7640fede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:55.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.555+0000 7ff763fff640 1 --2- 172.21.15.63:0/1268573714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff764103140 0x7ff7640fede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.555+0000 7ff763fff640 1 -- 172.21.15.63:0/1268573714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff764108d00 msgr2=0x7ff7640ff860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:55.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.555+0000 7ff763fff640 1 --2- 172.21.15.63:0/1268573714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff764108d00 0x7ff7640ff860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.555+0000 7ff763fff640 1 -- 172.21.15.63:0/1268573714 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7641a8780 con 0x7ff7641083b0 2024-09-21T06:35:55.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.555+0000 7ff768f8c640 1 --2- 172.21.15.63:0/1268573714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff764103140 0x7ff7640fede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:55.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.555+0000 7ff763fff640 1 --2- 172.21.15.63:0/1268573714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7641083b0 0x7ff7640ff320 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ff75400db20 tx=0x7ff75400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:55.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.555+0000 7ff761ffb640 1 -- 172.21.15.63:0/1268573714 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754017070 con 0x7ff7641083b0 2024-09-21T06:35:55.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.555+0000 7ff761ffb640 1 -- 172.21.15.63:0/1268573714 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff754003e20 con 0x7ff7641083b0 2024-09-21T06:35:55.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.555+0000 7ff761ffb640 1 -- 172.21.15.63:0/1268573714 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7540106c0 con 0x7ff7641083b0 2024-09-21T06:35:55.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.555+0000 7ff76b1f0640 1 -- 172.21.15.63:0/1268573714 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7641a8a70 con 0x7ff7641083b0 2024-09-21T06:35:55.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.555+0000 7ff76b1f0640 1 -- 172.21.15.63:0/1268573714 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7641a9000 con 0x7ff7641083b0 2024-09-21T06:35:55.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.558+0000 7ff761ffb640 1 -- 172.21.15.63:0/1268573714 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7ff754004140 con 0x7ff7641083b0 2024-09-21T06:35:55.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.558+0000 7ff771764740 1 Processor -- start 2024-09-21T06:35:55.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.558+0000 7ff771764740 1 -- start start 2024-09-21T06:35:55.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.558+0000 7ff771764740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a4a070 0x55f8f9df1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.558+0000 7ff771764740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a211b0 0x55f8f9df17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.558+0000 7ff771764740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a29390 0x55f8f9df1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.558+0000 7ff771764740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f8f9d67e50 con 0x55f8f9a29390 2024-09-21T06:35:55.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.558+0000 7ff771764740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f8f9d57280 con 0x55f8f9a211b0 2024-09-21T06:35:55.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.558+0000 7ff771764740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f8f9d5b090 con 0x55f8f9a4a070 2024-09-21T06:35:55.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.558+0000 7ff763fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a29390 0x55f8f9df1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.558+0000 7ff763fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a29390 0x55f8f9df1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58148/0 (socket says 172.21.15.63:58148) 2024-09-21T06:35:55.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.558+0000 7ff763fff640 1 -- 172.21.15.63:0/3157915242 learned_addr learned my addr 172.21.15.63:0/3157915242 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:55.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.559+0000 7ff76978d640 1 --2- 172.21.15.63:0/3157915242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a4a070 0x55f8f9df1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.559+0000 7ff768f8c640 1 --2- 172.21.15.63:0/3157915242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a211b0 0x55f8f9df17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.559+0000 7ff763fff640 1 -- 172.21.15.63:0/3157915242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a4a070 msgr2=0x55f8f9df1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:55.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.559+0000 7ff763fff640 1 --2- 172.21.15.63:0/3157915242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a4a070 0x55f8f9df1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.559+0000 7ff763fff640 1 -- 172.21.15.63:0/3157915242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a211b0 msgr2=0x55f8f9df17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:55.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.559+0000 7ff763fff640 1 --2- 172.21.15.63:0/3157915242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a211b0 0x55f8f9df17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.559+0000 7ff763fff640 1 -- 172.21.15.63:0/3157915242 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8f9ab5650 con 0x55f8f9a29390 2024-09-21T06:35:55.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.559+0000 7ff768f8c640 1 --2- 172.21.15.63:0/3157915242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a211b0 0x55f8f9df17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:55.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.559+0000 7ff761ffb640 1 --2- 172.21.15.63:0/1268573714 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7500b6700 0x7ff7500b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.559+0000 7ff76978d640 1 --2- 172.21.15.63:0/1268573714 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7500b6700 0x7ff7500b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.559+0000 7ff763fff640 1 --2- 172.21.15.63:0/3157915242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a29390 0x55f8f9df1cf0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ff7540e4c10 tx=0x7ff7540ef690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea4da0af73d78ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:55.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.559+0000 7ff761ffb640 1 -- 172.21.15.63:0/1268573714 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7ff7540e75a0 con 0x7ff7641083b0 2024-09-21T06:35:55.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.559+0000 7ff75affd640 1 -- 172.21.15.63:0/3157915242 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754020020 con 0x55f8f9a29390 2024-09-21T06:35:55.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.559+0000 7ff75affd640 1 -- 172.21.15.63:0/3157915242 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7540aceb0 con 0x55f8f9a29390 2024-09-21T06:35:55.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.559+0000 7ff75affd640 1 -- 172.21.15.63:0/3157915242 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754094030 con 0x55f8f9a29390 2024-09-21T06:35:55.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.560+0000 7ff771764740 1 -- 172.21.15.63:0/3157915242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a29390 msgr2=0x55f8f9df1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:55.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.560+0000 7ff76978d640 1 --2- 172.21.15.63:0/1268573714 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7500b6700 0x7ff7500b8c10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff74c009c70 tx=0x7ff74c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:55.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.560+0000 7ff771764740 1 --2- 172.21.15.63:0/3157915242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a29390 0x55f8f9df1cf0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ff7540e4c10 tx=0x7ff7540ef690 comp rx=0 tx=0).stop 2024-09-21T06:35:55.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.560+0000 7ff771764740 1 -- 172.21.15.63:0/3157915242 shutdown_connections 2024-09-21T06:35:55.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.560+0000 7ff771764740 1 --2- 172.21.15.63:0/3157915242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a29390 0x55f8f9df1cf0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.560+0000 7ff771764740 1 --2- 172.21.15.63:0/3157915242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a211b0 0x55f8f9df17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.560+0000 7ff771764740 1 --2- 172.21.15.63:0/3157915242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a4a070 0x55f8f9df1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.560+0000 7ff771764740 1 -- 172.21.15.63:0/3157915242 >> 172.21.15.63:0/3157915242 conn(0x55f8f9a3e460 msgr2=0x55f8f9def160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:55.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.560+0000 7ff771764740 1 -- 172.21.15.63:0/3157915242 shutdown_connections 2024-09-21T06:35:55.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.560+0000 7ff771764740 1 -- 172.21.15.63:0/3157915242 wait complete. 2024-09-21T06:35:55.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.561+0000 7ff771764740 1 -- start start 2024-09-21T06:35:55.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.561+0000 7ff771764740 1 Processor -- start 2024-09-21T06:35:55.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.561+0000 7ff771764740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a211b0 0x55f8f9dfc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.561+0000 7ff771764740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a29390 0x55f8f9dfce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.561+0000 7ff771764740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a4a070 0x55f8f9e08d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.561+0000 7ff771764740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f8f9bb8700 con 0x55f8f9a211b0 2024-09-21T06:35:55.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.561+0000 7ff771764740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f8f9cf2110 con 0x55f8f9a29390 2024-09-21T06:35:55.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.561+0000 7ff771764740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f8f9dffa50 con 0x55f8f9a4a070 2024-09-21T06:35:55.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.561+0000 7ff771764740 10 client.0 _ll_register_callbacks cb 0x55f8f9d0b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:55.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.561+0000 7ff768f8c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a211b0 0x55f8f9dfc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.562+0000 7ff768f8c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a211b0 0x55f8f9dfc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58154/0 (socket says 172.21.15.63:58154) 2024-09-21T06:35:55.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.562+0000 7ff768f8c640 1 -- 172.21.15.63:0/2829399515 learned_addr learned my addr 172.21.15.63:0/2829399515 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:55.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.562+0000 7ff76978d640 1 --2- 172.21.15.63:0/2829399515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a4a070 0x55f8f9e08d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.562+0000 7ff763fff640 1 --2- 172.21.15.63:0/2829399515 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a29390 0x55f8f9dfce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.562+0000 7ff768f8c640 1 -- 172.21.15.63:0/2829399515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a4a070 msgr2=0x55f8f9e08d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:55.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.562+0000 7ff768f8c640 1 --2- 172.21.15.63:0/2829399515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a4a070 0x55f8f9e08d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.562+0000 7ff768f8c640 1 -- 172.21.15.63:0/2829399515 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a29390 msgr2=0x55f8f9dfce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:55.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.562+0000 7ff768f8c640 1 --2- 172.21.15.63:0/2829399515 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a29390 0x55f8f9dfce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.562+0000 7ff768f8c640 1 -- 172.21.15.63:0/2829399515 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8f9d1fc40 con 0x55f8f9a211b0 2024-09-21T06:35:55.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.562+0000 7ff768f8c640 1 --2- 172.21.15.63:0/2829399515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a211b0 0x55f8f9dfc930 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7ff75c02a930 tx=0x7ff75c031750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58eacb35d9dcc16a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:55.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.562+0000 7ff743fff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:35:55.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.562+0000 7ff743fff640 1 -- 172.21.15.63:0/2829399515 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c035070 con 0x55f8f9a211b0 2024-09-21T06:35:55.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.562+0000 7ff743fff640 1 -- 172.21.15.63:0/2829399515 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7ff75c004240 con 0x55f8f9a211b0 2024-09-21T06:35:55.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.562+0000 7ff771764740 1 -- 172.21.15.63:0/2829399515 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7540aceb0 con 0x55f8f9a211b0 2024-09-21T06:35:55.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.563+0000 7ff743fff640 1 -- 172.21.15.63:0/2829399515 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7ff75c004440 con 0x55f8f9a211b0 2024-09-21T06:35:55.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.563+0000 7ff771764740 10 client.17037 fetch_fsmap learned FSMap version 56 2024-09-21T06:35:55.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.563+0000 7ff771764740 1 -- 172.21.15.63:0/2829399515 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55f8f9e0b760 con 0x55f8f9a211b0 2024-09-21T06:35:55.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.563+0000 7ff743fff640 1 -- 172.21.15.63:0/2829399515 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7540aceb0 con 0x55f8f9a211b0 2024-09-21T06:35:55.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.563+0000 7ff743fff640 1 -- 172.21.15.63:0/2829399515 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 56) ==== 8382+0+0 (secure 0 0 0) 0x7ff75c004a80 con 0x55f8f9a211b0 2024-09-21T06:35:55.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.563+0000 7ff771764740 10 client.17037 fetch_fsmap finished waiting for FSMap version 56 2024-09-21T06:35:55.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.563+0000 7ff771764740 10 client.17037 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:35:55.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.563+0000 7ff771764740 20 client.17037 populate_metadata read hostname 'smithi063' 2024-09-21T06:35:55.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.563+0000 7ff771764740 1 --2- 172.21.15.63:0/2829399515 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f8f9a089f0 0x55f8f9e0eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.563+0000 7ff771764740 4 client.17037 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:35:55.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.563+0000 7ff771764740 1 -- 172.21.15.63:0/2829399515 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8f9d69da0 con 0x55f8f9a089f0 2024-09-21T06:35:55.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.563+0000 7ff763fff640 1 --2- 172.21.15.63:0/2829399515 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f8f9a089f0 0x55f8f9e0eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.564+0000 7ff743fff640 10 client.17037 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:35:55.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.564+0000 7ff763fff640 1 --2- 172.21.15.63:0/2829399515 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f8f9a089f0 0x55f8f9e0eca0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c9366fef0510425 server_cookie=c2e92f27aa8c3056 in_seq=0 out_seq=0 2024-09-21T06:35:55.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.565+0000 7ff743fff640 1 -- 172.21.15.63:0/2829399515 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f8f9d69da0 con 0x55f8f9a089f0 2024-09-21T06:35:55.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.565+0000 7ff743fff640 10 client.17037 handle_command_reply: tid=0 2024-09-21T06:35:55.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.565+0000 7ff771764740 1 client.17037 shutdown 2024-09-21T06:35:55.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.565+0000 7ff771764740 1 -- 172.21.15.63:0/2829399515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a211b0 msgr2=0x55f8f9dfc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:55.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.565+0000 7ff771764740 1 --2- 172.21.15.63:0/2829399515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a211b0 0x55f8f9dfc930 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7ff75c02a930 tx=0x7ff75c031750 comp rx=0 tx=0).stop 2024-09-21T06:35:55.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.565+0000 7ff771764740 1 -- 172.21.15.63:0/2829399515 shutdown_connections 2024-09-21T06:35:55.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.565+0000 7ff771764740 1 --2- 172.21.15.63:0/2829399515 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f8f9a089f0 0x55f8f9e0eca0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.565+0000 7ff771764740 1 --2- 172.21.15.63:0/2829399515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a4a070 0x55f8f9e08d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.565+0000 7ff771764740 1 --2- 172.21.15.63:0/2829399515 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a29390 0x55f8f9dfce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.565+0000 7ff771764740 1 --2- 172.21.15.63:0/2829399515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a211b0 0x55f8f9dfc930 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.565+0000 7ff743fff640 0 client.17037 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:35:55.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.565+0000 7ff771764740 1 -- 172.21.15.63:0/2829399515 >> 172.21.15.63:0/2829399515 conn(0x55f8f9a3e460 msgr2=0x55f8f9df4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:55.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.565+0000 7ff771764740 1 -- 172.21.15.63:0/2829399515 shutdown_connections 2024-09-21T06:35:55.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.565+0000 7ff771764740 1 -- 172.21.15.63:0/2829399515 wait complete. 2024-09-21T06:35:55.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.565+0000 7ff771764740 20 client.17037 trim_cache size 0 max 16384 2024-09-21T06:35:55.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.583+0000 7ff771764740 1 Processor -- start 2024-09-21T06:35:55.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.583+0000 7ff771764740 1 -- start start 2024-09-21T06:35:55.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.583+0000 7ff771764740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a089f0 0x55f8f9dfb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.583+0000 7ff771764740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a211b0 0x55f8f9dfe560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.583+0000 7ff771764740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a29390 0x55f8f9dee710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.583+0000 7ff771764740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641b19c0 con 0x55f8f9a29390 2024-09-21T06:35:55.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.583+0000 7ff771764740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641b3560 con 0x55f8f9a089f0 2024-09-21T06:35:55.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.583+0000 7ff771764740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641b2090 con 0x55f8f9a211b0 2024-09-21T06:35:55.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.583+0000 7ff76978d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a29390 0x55f8f9dee710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.583+0000 7ff76978d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a29390 0x55f8f9dee710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58158/0 (socket says 172.21.15.63:58158) 2024-09-21T06:35:55.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.583+0000 7ff76978d640 1 -- 172.21.15.63:0/3899757118 learned_addr learned my addr 172.21.15.63:0/3899757118 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:55.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.584+0000 7ff763fff640 1 --2- 172.21.15.63:0/3899757118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a211b0 0x55f8f9dfe560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.584+0000 7ff768f8c640 1 --2- 172.21.15.63:0/3899757118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a089f0 0x55f8f9dfb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.584+0000 7ff76978d640 1 -- 172.21.15.63:0/3899757118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a211b0 msgr2=0x55f8f9dfe560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:55.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.584+0000 7ff76978d640 1 --2- 172.21.15.63:0/3899757118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a211b0 0x55f8f9dfe560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.584+0000 7ff76978d640 1 -- 172.21.15.63:0/3899757118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a089f0 msgr2=0x55f8f9dfb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:55.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.584+0000 7ff76978d640 1 --2- 172.21.15.63:0/3899757118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a089f0 0x55f8f9dfb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.584+0000 7ff76978d640 1 -- 172.21.15.63:0/3899757118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8f9dff070 con 0x55f8f9a29390 2024-09-21T06:35:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.584+0000 7ff763fff640 1 --2- 172.21.15.63:0/3899757118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a211b0 0x55f8f9dfe560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.584+0000 7ff76978d640 1 --2- 172.21.15.63:0/3899757118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a29390 0x55f8f9dee710 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7ff74c01f5e0 tx=0x7ff74c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e9ef5d691f7884 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.584+0000 7ff75a7fc640 1 -- 172.21.15.63:0/3899757118 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74c004110 con 0x55f8f9a29390 2024-09-21T06:35:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.584+0000 7ff75a7fc640 1 -- 172.21.15.63:0/3899757118 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff74c0042b0 con 0x55f8f9a29390 2024-09-21T06:35:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.584+0000 7ff75a7fc640 1 -- 172.21.15.63:0/3899757118 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74c0118d0 con 0x55f8f9a29390 2024-09-21T06:35:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.585+0000 7ff771764740 1 -- 172.21.15.63:0/3899757118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a29390 msgr2=0x55f8f9dee710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.585+0000 7ff771764740 1 --2- 172.21.15.63:0/3899757118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a29390 0x55f8f9dee710 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7ff74c01f5e0 tx=0x7ff74c01a000 comp rx=0 tx=0).stop 2024-09-21T06:35:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.585+0000 7ff771764740 1 -- 172.21.15.63:0/3899757118 shutdown_connections 2024-09-21T06:35:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.585+0000 7ff771764740 1 --2- 172.21.15.63:0/3899757118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a29390 0x55f8f9dee710 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.585+0000 7ff771764740 1 --2- 172.21.15.63:0/3899757118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a211b0 0x55f8f9dfe560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.585+0000 7ff771764740 1 --2- 172.21.15.63:0/3899757118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a089f0 0x55f8f9dfb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.585+0000 7ff771764740 1 -- 172.21.15.63:0/3899757118 >> 172.21.15.63:0/3899757118 conn(0x55f8f9a3e460 msgr2=0x55f8f9dfde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.585+0000 7ff771764740 1 -- 172.21.15.63:0/3899757118 shutdown_connections 2024-09-21T06:35:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.585+0000 7ff771764740 1 -- 172.21.15.63:0/3899757118 wait complete. 2024-09-21T06:35:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.585+0000 7ff771764740 1 -- start start 2024-09-21T06:35:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.586+0000 7ff771764740 1 Processor -- start 2024-09-21T06:35:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.586+0000 7ff771764740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a089f0 0x55f8f9e00cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.586+0000 7ff771764740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a211b0 0x55f8f9e01200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.586+0000 7ff771764740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a29390 0x55f8f9e01740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.586+0000 7ff771764740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641b2e90 con 0x55f8f9a211b0 2024-09-21T06:35:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.586+0000 7ff771764740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641b2790 con 0x55f8f9a089f0 2024-09-21T06:35:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.586+0000 7ff771764740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641af9c0 con 0x55f8f9a29390 2024-09-21T06:35:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.586+0000 7ff763fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a211b0 0x55f8f9e01200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.586+0000 7ff763fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a211b0 0x55f8f9e01200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58164/0 (socket says 172.21.15.63:58164) 2024-09-21T06:35:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.586+0000 7ff763fff640 1 -- 172.21.15.63:0/680979237 learned_addr learned my addr 172.21.15.63:0/680979237 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.586+0000 7ff768f8c640 1 --2- 172.21.15.63:0/680979237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a089f0 0x55f8f9e00cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.586+0000 7ff771764740 10 client.0 _ll_register_callbacks cb 0x7ff74c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:55.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.586+0000 7ff76978d640 1 --2- 172.21.15.63:0/680979237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a29390 0x55f8f9e01740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.587+0000 7ff763fff640 1 -- 172.21.15.63:0/680979237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a29390 msgr2=0x55f8f9e01740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:55.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.587+0000 7ff763fff640 1 --2- 172.21.15.63:0/680979237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a29390 0x55f8f9e01740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.587+0000 7ff763fff640 1 -- 172.21.15.63:0/680979237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a089f0 msgr2=0x55f8f9e00cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:55.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.587+0000 7ff763fff640 1 --2- 172.21.15.63:0/680979237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a089f0 0x55f8f9e00cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.587+0000 7ff763fff640 1 -- 172.21.15.63:0/680979237 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8f9e786f0 con 0x55f8f9a211b0 2024-09-21T06:35:55.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.587+0000 7ff768f8c640 1 --2- 172.21.15.63:0/680979237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a089f0 0x55f8f9e00cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:35:55.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.587+0000 7ff763fff640 1 --2- 172.21.15.63:0/680979237 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a211b0 0x55f8f9e01200 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff7540e52a0 tx=0x7ff7540040b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94fe9fa05d4baa45 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:55.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.587+0000 7ff743fff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:35:55.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.587+0000 7ff743fff640 1 -- 172.21.15.63:0/680979237 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75405c030 con 0x55f8f9a211b0 2024-09-21T06:35:55.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.587+0000 7ff743fff640 1 -- 172.21.15.63:0/680979237 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7ff7540e4f20 con 0x55f8f9a211b0 2024-09-21T06:35:55.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.587+0000 7ff771764740 1 -- 172.21.15.63:0/680979237 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff74c0042b0 con 0x55f8f9a211b0 2024-09-21T06:35:55.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.587+0000 7ff743fff640 1 -- 172.21.15.63:0/680979237 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7ff754020040 con 0x55f8f9a211b0 2024-09-21T06:35:55.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.587+0000 7ff771764740 10 client.17043 fetch_fsmap learned FSMap version 56 2024-09-21T06:35:55.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.587+0000 7ff771764740 1 -- 172.21.15.63:0/680979237 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55f8f9e79960 con 0x55f8f9a211b0 2024-09-21T06:35:55.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.588+0000 7ff743fff640 1 -- 172.21.15.63:0/680979237 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff74c0042b0 con 0x55f8f9a211b0 2024-09-21T06:35:55.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.588+0000 7ff743fff640 1 -- 172.21.15.63:0/680979237 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 56) ==== 8382+0+0 (secure 0 0 0) 0x7ff7540a9610 con 0x55f8f9a211b0 2024-09-21T06:35:55.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.588+0000 7ff771764740 10 client.17043 fetch_fsmap finished waiting for FSMap version 56 2024-09-21T06:35:55.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.588+0000 7ff771764740 10 client.17043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:35:55.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.588+0000 7ff771764740 20 client.17043 populate_metadata read hostname 'smithi063' 2024-09-21T06:35:55.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.588+0000 7ff771764740 1 --2- 172.21.15.63:0/680979237 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f8f9a4a070 0x55f8f9e7bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.588+0000 7ff771764740 4 client.17043 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:35:55.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.588+0000 7ff771764740 1 -- 172.21.15.63:0/680979237 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f8f9d65850 con 0x55f8f9a4a070 2024-09-21T06:35:55.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.588+0000 7ff768f8c640 1 --2- 172.21.15.63:0/680979237 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f8f9a4a070 0x55f8f9e7bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.589+0000 7ff768f8c640 1 --2- 172.21.15.63:0/680979237 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f8f9a4a070 0x55f8f9e7bc50 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afec2a5fb3f5dfbf server_cookie=9f70f6ab64e37f2a in_seq=0 out_seq=0 2024-09-21T06:35:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.589+0000 7ff743fff640 10 client.17043 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:35:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.589+0000 7ff743fff640 1 -- 172.21.15.63:0/680979237 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x55f8f9d65850 con 0x55f8f9a4a070 2024-09-21T06:35:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.589+0000 7ff743fff640 10 client.17043 handle_command_reply: tid=0 2024-09-21T06:35:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.589+0000 7ff771764740 1 client.17043 shutdown 2024-09-21T06:35:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.589+0000 7ff771764740 1 -- 172.21.15.63:0/680979237 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a211b0 msgr2=0x55f8f9e01200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.589+0000 7ff771764740 1 --2- 172.21.15.63:0/680979237 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a211b0 0x55f8f9e01200 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff7540e52a0 tx=0x7ff7540040b0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.589+0000 7ff771764740 1 -- 172.21.15.63:0/680979237 shutdown_connections 2024-09-21T06:35:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.589+0000 7ff771764740 1 --2- 172.21.15.63:0/680979237 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f8f9a4a070 0x55f8f9e7bc50 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.589+0000 7ff771764740 1 --2- 172.21.15.63:0/680979237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8f9a29390 0x55f8f9e01740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.589+0000 7ff771764740 1 --2- 172.21.15.63:0/680979237 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f8f9a211b0 0x55f8f9e01200 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.589+0000 7ff771764740 1 --2- 172.21.15.63:0/680979237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f8f9a089f0 0x55f8f9e00cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.589+0000 7ff743fff640 0 client.17043 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:35:55.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.589+0000 7ff771764740 1 -- 172.21.15.63:0/680979237 >> 172.21.15.63:0/680979237 conn(0x55f8f9a3e460 msgr2=0x55f8f9dfdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:55.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.589+0000 7ff771764740 1 -- 172.21.15.63:0/680979237 shutdown_connections 2024-09-21T06:35:55.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.589+0000 7ff771764740 1 -- 172.21.15.63:0/680979237 wait complete. 2024-09-21T06:35:55.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.589+0000 7ff771764740 20 client.17043 trim_cache size 0 max 16384 2024-09-21T06:35:55.598 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:35:55.598 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "no active scrubs running", 2024-09-21T06:35:55.598 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": {}, 2024-09-21T06:35:55.598 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:35:55.598 INFO:teuthology.orchestra.run.smithi063.stdout: "0c926bc7-90f8-47ce-a0d2-d02e676a73e9": { 2024-09-21T06:35:55.599 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:35:22.494015+0000", 2024-09-21T06:35:55.599 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:55.599 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:35:55.599 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:35:55.599 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:35:55.599 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:35:55.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:35:55.599 INFO:teuthology.orchestra.run.smithi063.stdout: "4f099144-5170-453b-a745-ddc222860f34": { 2024-09-21T06:35:55.599 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:34:35.417817+0000", 2024-09-21T06:35:55.599 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:55.599 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:35:55.600 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:35:55.600 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:35:55.600 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:35:55.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:35:55.600 INFO:teuthology.orchestra.run.smithi063.stdout: "91ae0a75-6a3f-452f-8bda-0f19862a5724": { 2024-09-21T06:35:55.600 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:50.316590+0000", 2024-09-21T06:35:55.600 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:55.600 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:35:55.600 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:35:55.600 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:35:55.600 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:35:55.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:35:55.600 INFO:teuthology.orchestra.run.smithi063.stdout: "5396028b-35f4-48fe-b54d-385784e97de3": { 2024-09-21T06:35:55.601 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:04.523378+0000", 2024-09-21T06:35:55.601 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:55.601 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:35:55.601 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:35:55.601 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:35:55.601 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:35:55.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:35:55.601 INFO:teuthology.orchestra.run.smithi063.stdout: "024d3c59-0b67-49a9-bf4a-e02d36691942": { 2024-09-21T06:35:55.601 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:32:14.282244+0000", 2024-09-21T06:35:55.601 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:55.601 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:35:55.601 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:35:55.601 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:35:55.601 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:35:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:35:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:35:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:31:27.507051+0000", 2024-09-21T06:35:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:35:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:35:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:35:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:35:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:35:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:35:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:35:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:35:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:35:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:35:55.603 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:35:55.603 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:35:55.603 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:35:55.603 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:35:55.603 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:35:55.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.590+0000 7ff76b1f0640 1 -- 172.21.15.63:0/1268573714 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7500b6700 msgr2=0x7ff7500b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:55.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.590+0000 7ff76b1f0640 1 --2- 172.21.15.63:0/1268573714 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7500b6700 0x7ff7500b8c10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff74c009c70 tx=0x7ff74c005f90 comp rx=0 tx=0).stop 2024-09-21T06:35:55.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.590+0000 7ff76b1f0640 1 -- 172.21.15.63:0/1268573714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7641083b0 msgr2=0x7ff7640ff320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:55.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.590+0000 7ff76b1f0640 1 --2- 172.21.15.63:0/1268573714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7641083b0 0x7ff7640ff320 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ff75400db20 tx=0x7ff75400b260 comp rx=0 tx=0).stop 2024-09-21T06:35:55.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.590+0000 7ff76b1f0640 1 -- 172.21.15.63:0/1268573714 shutdown_connections 2024-09-21T06:35:55.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.590+0000 7ff76b1f0640 1 --2- 172.21.15.63:0/1268573714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff764108d00 0x7ff7640ff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.590+0000 7ff76b1f0640 1 --2- 172.21.15.63:0/1268573714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7641083b0 0x7ff7640ff320 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.590+0000 7ff76b1f0640 1 --2- 172.21.15.63:0/1268573714 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ff7500b6700 0x7ff7500b8c10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.590+0000 7ff76b1f0640 1 --2- 172.21.15.63:0/1268573714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff764103140 0x7ff7640fede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.590+0000 7ff76b1f0640 1 -- 172.21.15.63:0/1268573714 >> 172.21.15.63:0/1268573714 conn(0x7ff764077c60 msgr2=0x7ff764101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:55.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.590+0000 7ff76b1f0640 1 -- 172.21.15.63:0/1268573714 shutdown_connections 2024-09-21T06:35:55.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:55.590+0000 7ff76b1f0640 1 -- 172.21.15.63:0/1268573714 wait complete. 2024-09-21T06:35:55.605 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:55 smithi175 ceph-mon[34510]: pgmap v556: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:35:55.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:55 smithi071 ceph-mon[34844]: pgmap v556: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:35:56.423 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:35:56.424 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:35:56.688 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:57.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.212+0000 7f52a1cc9640 1 -- 172.21.15.63:0/2846503310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f529c1083c0 msgr2=0x7f529c1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:57.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.212+0000 7f52a1cc9640 1 --2- 172.21.15.63:0/2846503310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f529c1083c0 0x7f529c1087d0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f5290009900 tx=0x7f529002a410 comp rx=0 tx=0).stop 2024-09-21T06:35:57.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.212+0000 7f52a1cc9640 1 -- 172.21.15.63:0/2846503310 shutdown_connections 2024-09-21T06:35:57.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.212+0000 7f52a1cc9640 1 --2- 172.21.15.63:0/2846503310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f529c108d10 0x7f529c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.212+0000 7f52a1cc9640 1 --2- 172.21.15.63:0/2846503310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f529c1083c0 0x7f529c1087d0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.212+0000 7f52a1cc9640 1 --2- 172.21.15.63:0/2846503310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f529c102a80 0x7f529c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.212+0000 7f52a1cc9640 1 -- 172.21.15.63:0/2846503310 >> 172.21.15.63:0/2846503310 conn(0x7f529c079740 msgr2=0x7f529c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:57.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.212+0000 7f52a1cc9640 1 -- 172.21.15.63:0/2846503310 shutdown_connections 2024-09-21T06:35:57.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.212+0000 7f52a1cc9640 1 -- 172.21.15.63:0/2846503310 wait complete. 2024-09-21T06:35:57.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.212+0000 7f52a1cc9640 1 Processor -- start 2024-09-21T06:35:57.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.213+0000 7f52a1cc9640 1 -- start start 2024-09-21T06:35:57.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.213+0000 7f52a1cc9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f529c102a80 0x7f529c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:57.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.213+0000 7f52a1cc9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f529c1083c0 0x7f529c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:57.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.213+0000 7f52a1cc9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f529c108d10 0x7f529c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:57.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.213+0000 7f52a1cc9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f529c112980 con 0x7f529c102a80 2024-09-21T06:35:57.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.213+0000 7f52a1cc9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f529c112800 con 0x7f529c108d10 2024-09-21T06:35:57.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.213+0000 7f52a1cc9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f529c112b00 con 0x7f529c1083c0 2024-09-21T06:35:57.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.213+0000 7f529b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f529c102a80 0x7f529c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:57.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.213+0000 7f529b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f529c102a80 0x7f529c19a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52788/0 (socket says 172.21.15.63:52788) 2024-09-21T06:35:57.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.213+0000 7f529bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f529c108d10 0x7f529c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:57.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.213+0000 7f529b7fe640 1 -- 172.21.15.63:0/891125361 learned_addr learned my addr 172.21.15.63:0/891125361 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:57.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.213+0000 7f529affd640 1 --2- 172.21.15.63:0/891125361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f529c1083c0 0x7f529c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:57.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.214+0000 7f529b7fe640 1 -- 172.21.15.63:0/891125361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f529c1083c0 msgr2=0x7f529c19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:57.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.214+0000 7f529b7fe640 1 --2- 172.21.15.63:0/891125361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f529c1083c0 0x7f529c19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.214+0000 7f529b7fe640 1 -- 172.21.15.63:0/891125361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f529c108d10 msgr2=0x7f529c19fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:57.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.214+0000 7f529b7fe640 1 --2- 172.21.15.63:0/891125361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f529c108d10 0x7f529c19fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.214+0000 7f529b7fe640 1 -- 172.21.15.63:0/891125361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529c1a0410 con 0x7f529c102a80 2024-09-21T06:35:57.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.214+0000 7f529bfff640 1 --2- 172.21.15.63:0/891125361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f529c108d10 0x7f529c19fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:35:57.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.214+0000 7f529b7fe640 1 --2- 172.21.15.63:0/891125361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f529c102a80 0x7f529c19a4a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f528c00d950 tx=0x7f528c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:57.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.214+0000 7f5298ff9640 1 -- 172.21.15.63:0/891125361 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528c017070 con 0x7f529c102a80 2024-09-21T06:35:57.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.214+0000 7f5298ff9640 1 -- 172.21.15.63:0/891125361 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f528c009c30 con 0x7f529c102a80 2024-09-21T06:35:57.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.214+0000 7f5298ff9640 1 -- 172.21.15.63:0/891125361 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528c00f620 con 0x7f529c102a80 2024-09-21T06:35:57.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.214+0000 7f52a1cc9640 1 -- 172.21.15.63:0/891125361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f529c1a0700 con 0x7f529c102a80 2024-09-21T06:35:57.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.214+0000 7f52a1cc9640 1 -- 172.21.15.63:0/891125361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f529c1a6e60 con 0x7f529c102a80 2024-09-21T06:35:57.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.215+0000 7f52a1cc9640 1 -- 172.21.15.63:0/891125361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f529c103d00 con 0x7f529c102a80 2024-09-21T06:35:57.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.217+0000 7f5298ff9640 1 -- 172.21.15.63:0/891125361 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f528c005030 con 0x7f529c102a80 2024-09-21T06:35:57.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.217+0000 7f5298ff9640 1 --2- 172.21.15.63:0/891125361 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f52840b6680 0x7f52840b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:57.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.217+0000 7f5298ff9640 1 -- 172.21.15.63:0/891125361 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7f528c0e72b0 con 0x7f529c102a80 2024-09-21T06:35:57.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.217+0000 7f529affd640 1 --2- 172.21.15.63:0/891125361 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f52840b6680 0x7f52840b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:57.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.218+0000 7f529affd640 1 --2- 172.21.15.63:0/891125361 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f52840b6680 0x7f52840b8b90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5290000c00 tx=0x7f5290031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:57.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.221+0000 7f5298ff9640 1 -- 172.21.15.63:0/891125361 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f528c009de0 con 0x7f529c102a80 2024-09-21T06:35:57.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.445+0000 7f52a1cc9640 1 -- 172.21.15.63:0/891125361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f529c102e90 con 0x7f529c102a80 2024-09-21T06:35:57.449 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:57 smithi063 ceph-mon[31150]: pgmap v557: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:35:57.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.446+0000 7f5298ff9640 1 -- 172.21.15.63:0/891125361 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+11977 (secure 0 0 0) 0x7f528c0b1b90 con 0x7f529c102a80 2024-09-21T06:35:57.449 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:35:57.450 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":56,"btime":"2024-09-21T06:35:53:317431+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":56,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:35:52.512358+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24659,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":34,"state":"up:active","state_seq":69,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25637":{"gid":25637,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3354670524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3354670524},{"type":"v1","addr":"172.21.15.71:6839","nonce":3354670524}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24659,"qdb_cluster":[14835,24676,24659,24670,24694]},"id":1}]} 2024-09-21T06:35:57.450 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 56 2024-09-21T06:35:57.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.449+0000 7f52a1cc9640 1 -- 172.21.15.63:0/891125361 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f52840b6680 msgr2=0x7f52840b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:57.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.449+0000 7f52a1cc9640 1 --2- 172.21.15.63:0/891125361 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f52840b6680 0x7f52840b8b90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5290000c00 tx=0x7f5290031400 comp rx=0 tx=0).stop 2024-09-21T06:35:57.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.449+0000 7f52a1cc9640 1 -- 172.21.15.63:0/891125361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f529c102a80 msgr2=0x7f529c19a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:57.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.449+0000 7f52a1cc9640 1 --2- 172.21.15.63:0/891125361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f529c102a80 0x7f529c19a4a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f528c00d950 tx=0x7f528c00de10 comp rx=0 tx=0).stop 2024-09-21T06:35:57.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.449+0000 7f52a1cc9640 1 -- 172.21.15.63:0/891125361 shutdown_connections 2024-09-21T06:35:57.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.449+0000 7f52a1cc9640 1 --2- 172.21.15.63:0/891125361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f529c108d10 0x7f529c19fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.449+0000 7f52a1cc9640 1 --2- 172.21.15.63:0/891125361 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f52840b6680 0x7f52840b8b90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.449+0000 7f52a1cc9640 1 --2- 172.21.15.63:0/891125361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f529c1083c0 0x7f529c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.449+0000 7f52a1cc9640 1 --2- 172.21.15.63:0/891125361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f529c102a80 0x7f529c19a4a0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.449+0000 7f52a1cc9640 1 -- 172.21.15.63:0/891125361 >> 172.21.15.63:0/891125361 conn(0x7f529c079740 msgr2=0x7f529c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:57.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.450+0000 7f52a1cc9640 1 -- 172.21.15.63:0/891125361 shutdown_connections 2024-09-21T06:35:57.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:57.450+0000 7f52a1cc9640 1 -- 172.21.15.63:0/891125361 wait complete. 2024-09-21T06:35:57.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:57 smithi175 ceph-mon[34510]: pgmap v557: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:35:57.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:57 smithi071 ceph-mon[34844]: pgmap v557: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:35:58.081 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T06:35:58.343 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:58.598 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:58 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/891125361' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:58.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:58 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/891125361' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:58.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:58 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/891125361' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:58.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.839+0000 7fe5b0d62640 1 -- 172.21.15.63:0/1893009102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5ac108cf0 msgr2=0x7fe5ac10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.839+0000 7fe5b0d62640 1 --2- 172.21.15.63:0/1893009102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5ac108cf0 0x7fe5ac10f520 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4009ca0 tx=0x7fe5a402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.839+0000 7fe5b0d62640 1 -- 172.21.15.63:0/1893009102 shutdown_connections 2024-09-21T06:35:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.839+0000 7fe5b0d62640 1 --2- 172.21.15.63:0/1893009102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5ac108cf0 0x7fe5ac10f520 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.839+0000 7fe5b0d62640 1 --2- 172.21.15.63:0/1893009102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5ac1083a0 0x7fe5ac1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.839+0000 7fe5b0d62640 1 --2- 172.21.15.63:0/1893009102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5ac102a60 0x7fe5ac102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.839+0000 7fe5b0d62640 1 -- 172.21.15.63:0/1893009102 >> 172.21.15.63:0/1893009102 conn(0x7fe5ac079730 msgr2=0x7fe5ac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.839+0000 7fe5b0d62640 1 -- 172.21.15.63:0/1893009102 shutdown_connections 2024-09-21T06:35:58.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.840+0000 7fe5b0d62640 1 -- 172.21.15.63:0/1893009102 wait complete. 2024-09-21T06:35:58.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.840+0000 7fe5b0d62640 1 Processor -- start 2024-09-21T06:35:58.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.840+0000 7fe5b0d62640 1 -- start start 2024-09-21T06:35:58.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.841+0000 7fe5b0d62640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5ac102a60 0x7fe5ac199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.841+0000 7fe5b0d62640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5ac1083a0 0x7fe5ac199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.841+0000 7fe5b0d62640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5ac108cf0 0x7fe5ac19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.841+0000 7fe5b0d62640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac112960 con 0x7fe5ac1083a0 2024-09-21T06:35:58.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.841+0000 7fe5b0d62640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac1127e0 con 0x7fe5ac108cf0 2024-09-21T06:35:58.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.841+0000 7fe5b0d62640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac112ae0 con 0x7fe5ac102a60 2024-09-21T06:35:58.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.841+0000 7fe5a9d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5ac1083a0 0x7fe5ac199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.841+0000 7fe5a9d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5ac1083a0 0x7fe5ac199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52798/0 (socket says 172.21.15.63:52798) 2024-09-21T06:35:58.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.841+0000 7fe5a9d9b640 1 -- 172.21.15.63:0/151031568 learned_addr learned my addr 172.21.15.63:0/151031568 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:58.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.841+0000 7fe5aad9d640 1 --2- 172.21.15.63:0/151031568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5ac108cf0 0x7fe5ac19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.841+0000 7fe5aa59c640 1 --2- 172.21.15.63:0/151031568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5ac102a60 0x7fe5ac199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.841+0000 7fe5a9d9b640 1 -- 172.21.15.63:0/151031568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5ac102a60 msgr2=0x7fe5ac199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:58.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.841+0000 7fe5a9d9b640 1 --2- 172.21.15.63:0/151031568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5ac102a60 0x7fe5ac199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.841+0000 7fe5a9d9b640 1 -- 172.21.15.63:0/151031568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5ac108cf0 msgr2=0x7fe5ac19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:58.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.841+0000 7fe5a9d9b640 1 --2- 172.21.15.63:0/151031568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5ac108cf0 0x7fe5ac19ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.841+0000 7fe5a9d9b640 1 -- 172.21.15.63:0/151031568 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5ac19f2e0 con 0x7fe5ac1083a0 2024-09-21T06:35:58.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.841+0000 7fe5aad9d640 1 --2- 172.21.15.63:0/151031568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5ac108cf0 0x7fe5ac19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:58.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.842+0000 7fe5a9d9b640 1 --2- 172.21.15.63:0/151031568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5ac1083a0 0x7fe5ac199910 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fe594005fd0 tx=0x7fe59400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:58.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.842+0000 7fe5a37fe640 1 -- 172.21.15.63:0/151031568 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe594017070 con 0x7fe5ac1083a0 2024-09-21T06:35:58.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.842+0000 7fe5a37fe640 1 -- 172.21.15.63:0/151031568 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe594009c30 con 0x7fe5ac1083a0 2024-09-21T06:35:58.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.842+0000 7fe5a37fe640 1 -- 172.21.15.63:0/151031568 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe594003d30 con 0x7fe5ac1083a0 2024-09-21T06:35:58.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.842+0000 7fe5b0d62640 1 -- 172.21.15.63:0/151031568 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5ac19f5d0 con 0x7fe5ac1083a0 2024-09-21T06:35:58.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.842+0000 7fe5b0d62640 1 -- 172.21.15.63:0/151031568 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5ac1a5d30 con 0x7fe5ac1083a0 2024-09-21T06:35:58.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.844+0000 7fe5b72d6740 1 Processor -- start 2024-09-21T06:35:58.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.845+0000 7fe5b72d6740 1 -- start start 2024-09-21T06:35:58.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.845+0000 7fe5a37fe640 1 -- 172.21.15.63:0/151031568 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fe594003ed0 con 0x7fe5ac1083a0 2024-09-21T06:35:58.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.845+0000 7fe5b72d6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e1b0070 0x557d6e5576a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.845+0000 7fe5b72d6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e1871b0 0x557d6e557be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.845+0000 7fe5b72d6740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e18f390 0x557d6e558120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.845+0000 7fe5b72d6740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x557d6e4cdea0 con 0x557d6e18f390 2024-09-21T06:35:58.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.845+0000 7fe5b72d6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557d6e4bd2d0 con 0x557d6e1b0070 2024-09-21T06:35:58.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.845+0000 7fe5b72d6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557d6e4c10e0 con 0x557d6e1871b0 2024-09-21T06:35:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.845+0000 7fe5a9d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e18f390 0x557d6e558120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.845+0000 7fe5a9d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e18f390 0x557d6e558120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52814/0 (socket says 172.21.15.63:52814) 2024-09-21T06:35:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.845+0000 7fe5a9d9b640 1 -- 172.21.15.63:0/1420459979 learned_addr learned my addr 172.21.15.63:0/1420459979 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.845+0000 7fe5aad9d640 1 --2- 172.21.15.63:0/1420459979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e1b0070 0x557d6e5576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.845+0000 7fe5aa59c640 1 --2- 172.21.15.63:0/1420459979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e1871b0 0x557d6e557be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.846+0000 7fe5a9d9b640 1 -- 172.21.15.63:0/1420459979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e1871b0 msgr2=0x557d6e557be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.846+0000 7fe5a9d9b640 1 --2- 172.21.15.63:0/1420459979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e1871b0 0x557d6e557be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.846+0000 7fe5a9d9b640 1 -- 172.21.15.63:0/1420459979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e1b0070 msgr2=0x557d6e5576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.846+0000 7fe5a9d9b640 1 --2- 172.21.15.63:0/1420459979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e1b0070 0x557d6e5576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.846+0000 7fe5a9d9b640 1 -- 172.21.15.63:0/1420459979 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d6e21b650 con 0x557d6e18f390 2024-09-21T06:35:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.846+0000 7fe5aad9d640 1 --2- 172.21.15.63:0/1420459979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e1b0070 0x557d6e5576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:35:58.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.846+0000 7fe5a37fe640 1 --2- 172.21.15.63:0/151031568 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe5980b6680 0x7fe5980b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.846+0000 7fe5aad9d640 1 --2- 172.21.15.63:0/151031568 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe5980b6680 0x7fe5980b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.846+0000 7fe5a9d9b640 1 --2- 172.21.15.63:0/1420459979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e18f390 0x557d6e558120 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe5940e4ab0 tx=0x7fe5940edab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab7fc689f5c84aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:58.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.846+0000 7fe5a37fe640 1 -- 172.21.15.63:0/151031568 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7fe5940e7410 con 0x7fe5ac1083a0 2024-09-21T06:35:58.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.846+0000 7fe5a0ff9640 1 -- 172.21.15.63:0/1420459979 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5940a9860 con 0x557d6e18f390 2024-09-21T06:35:58.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.846+0000 7fe5a0ff9640 1 -- 172.21.15.63:0/1420459979 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5940acd20 con 0x557d6e18f390 2024-09-21T06:35:58.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.846+0000 7fe5a0ff9640 1 -- 172.21.15.63:0/1420459979 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5940ac980 con 0x557d6e18f390 2024-09-21T06:35:58.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.847+0000 7fe5b72d6740 1 -- 172.21.15.63:0/1420459979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e18f390 msgr2=0x557d6e558120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.847+0000 7fe5aad9d640 1 --2- 172.21.15.63:0/151031568 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe5980b6680 0x7fe5980b8b90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4004af0 tx=0x7fe5a4005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.847+0000 7fe5b72d6740 1 --2- 172.21.15.63:0/1420459979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e18f390 0x557d6e558120 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe5940e4ab0 tx=0x7fe5940edab0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.848+0000 7fe5b72d6740 1 -- 172.21.15.63:0/1420459979 shutdown_connections 2024-09-21T06:35:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.848+0000 7fe5b72d6740 1 --2- 172.21.15.63:0/1420459979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e18f390 0x557d6e558120 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.848+0000 7fe5b72d6740 1 --2- 172.21.15.63:0/1420459979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e1871b0 0x557d6e557be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.848+0000 7fe5b72d6740 1 --2- 172.21.15.63:0/1420459979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e1b0070 0x557d6e5576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.848+0000 7fe5b72d6740 1 -- 172.21.15.63:0/1420459979 >> 172.21.15.63:0/1420459979 conn(0x557d6e1a4460 msgr2=0x557d6e555590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.848+0000 7fe5b72d6740 1 -- 172.21.15.63:0/1420459979 shutdown_connections 2024-09-21T06:35:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.848+0000 7fe5b72d6740 1 -- 172.21.15.63:0/1420459979 wait complete. 2024-09-21T06:35:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.848+0000 7fe5b72d6740 1 -- start start 2024-09-21T06:35:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.848+0000 7fe5b72d6740 1 Processor -- start 2024-09-21T06:35:58.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.849+0000 7fe5b72d6740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e1871b0 0x557d6e564f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.849+0000 7fe5b72d6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e18f390 0x557d6e565460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.849+0000 7fe5b72d6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e1b0070 0x557d6e5659e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.849+0000 7fe5b72d6740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x557d6e31e700 con 0x557d6e1871b0 2024-09-21T06:35:58.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.849+0000 7fe5b72d6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557d6e458160 con 0x557d6e18f390 2024-09-21T06:35:58.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.849+0000 7fe5b72d6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557d6e567fe0 con 0x557d6e1b0070 2024-09-21T06:35:58.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.849+0000 7fe5aa59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e1871b0 0x557d6e564f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.849+0000 7fe5b72d6740 10 client.0 _ll_register_callbacks cb 0x557d6e4719e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:58.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.849+0000 7fe5aa59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e1871b0 0x557d6e564f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52828/0 (socket says 172.21.15.63:52828) 2024-09-21T06:35:58.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.849+0000 7fe5aa59c640 1 -- 172.21.15.63:0/3834947505 learned_addr learned my addr 172.21.15.63:0/3834947505 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:58.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.849+0000 7fe5a9d9b640 1 --2- 172.21.15.63:0/3834947505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e18f390 0x557d6e565460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.849+0000 7fe5aad9d640 1 --2- 172.21.15.63:0/3834947505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e1b0070 0x557d6e5659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.849+0000 7fe5aa59c640 1 -- 172.21.15.63:0/3834947505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e1b0070 msgr2=0x557d6e5659e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:58.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.849+0000 7fe5aa59c640 1 --2- 172.21.15.63:0/3834947505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e1b0070 0x557d6e5659e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.849+0000 7fe5aa59c640 1 -- 172.21.15.63:0/3834947505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e18f390 msgr2=0x557d6e565460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:58.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.849+0000 7fe5aa59c640 1 --2- 172.21.15.63:0/3834947505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e18f390 0x557d6e565460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.849+0000 7fe5aa59c640 1 -- 172.21.15.63:0/3834947505 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d6e485c90 con 0x557d6e1871b0 2024-09-21T06:35:58.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.849+0000 7fe5aa59c640 1 --2- 172.21.15.63:0/3834947505 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e1871b0 0x557d6e564f20 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00bf00 tx=0x7fe59c012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f25bd6ef0da4957 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:58.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.849+0000 7fe591ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:35:58.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.850+0000 7fe591ffb640 1 -- 172.21.15.63:0/3834947505 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c0108a0 con 0x557d6e1871b0 2024-09-21T06:35:58.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.850+0000 7fe591ffb640 1 -- 172.21.15.63:0/3834947505 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7fe59c010a40 con 0x557d6e1871b0 2024-09-21T06:35:58.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.850+0000 7fe5b72d6740 1 -- 172.21.15.63:0/3834947505 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5940acd20 con 0x557d6e1871b0 2024-09-21T06:35:58.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.850+0000 7fe591ffb640 1 -- 172.21.15.63:0/3834947505 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7fe59c010c40 con 0x557d6e1871b0 2024-09-21T06:35:58.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.850+0000 7fe5b72d6740 10 client.17061 fetch_fsmap learned FSMap version 57 2024-09-21T06:35:58.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.850+0000 7fe5b72d6740 1 -- 172.21.15.63:0/3834947505 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) -- 0x557d6e573d50 con 0x557d6e1871b0 2024-09-21T06:35:58.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.850+0000 7fe591ffb640 1 -- 172.21.15.63:0/3834947505 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5940acd20 con 0x557d6e1871b0 2024-09-21T06:35:58.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.850+0000 7fe591ffb640 1 -- 172.21.15.63:0/3834947505 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 57) ==== 8378+0+0 (secure 0 0 0) 0x7fe59c019070 con 0x557d6e1871b0 2024-09-21T06:35:58.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.850+0000 7fe5b72d6740 10 client.17061 fetch_fsmap finished waiting for FSMap version 57 2024-09-21T06:35:58.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.850+0000 7fe5b72d6740 10 client.17061 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:35:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.850+0000 7fe5b72d6740 20 client.17061 populate_metadata read hostname 'smithi063' 2024-09-21T06:35:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.850+0000 7fe5b72d6740 1 --2- 172.21.15.63:0/3834947505 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x557d6e16e9f0 0x557d6e577390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.850+0000 7fe5b72d6740 4 client.17061 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:35:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.850+0000 7fe5b72d6740 1 -- 172.21.15.63:0/3834947505 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d6e4cfdf0 con 0x557d6e16e9f0 2024-09-21T06:35:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.851+0000 7fe5a9d9b640 1 --2- 172.21.15.63:0/3834947505 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x557d6e16e9f0 0x557d6e577390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.851+0000 7fe591ffb640 10 client.17061 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:35:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.851+0000 7fe5a9d9b640 1 --2- 172.21.15.63:0/3834947505 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x557d6e16e9f0 0x557d6e577390 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=42ffbb543aca744 server_cookie=e41f85f092aa8527 in_seq=0 out_seq=0 2024-09-21T06:35:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.852+0000 7fe591ffb640 1 -- 172.21.15.63:0/3834947505 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fe59408df90 con 0x557d6e16e9f0 2024-09-21T06:35:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.852+0000 7fe591ffb640 10 client.17061 handle_command_reply: tid=0 2024-09-21T06:35:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.852+0000 7fe5b72d6740 1 client.17061 shutdown 2024-09-21T06:35:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.852+0000 7fe5b72d6740 1 -- 172.21.15.63:0/3834947505 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e1871b0 msgr2=0x557d6e564f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.852+0000 7fe5b72d6740 1 --2- 172.21.15.63:0/3834947505 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e1871b0 0x557d6e564f20 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00bf00 tx=0x7fe59c012820 comp rx=0 tx=0).stop 2024-09-21T06:35:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.852+0000 7fe5b72d6740 1 -- 172.21.15.63:0/3834947505 shutdown_connections 2024-09-21T06:35:58.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.852+0000 7fe5b72d6740 1 --2- 172.21.15.63:0/3834947505 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x557d6e16e9f0 0x557d6e577390 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.852+0000 7fe5b72d6740 1 --2- 172.21.15.63:0/3834947505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e1b0070 0x557d6e5659e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.852+0000 7fe5b72d6740 1 --2- 172.21.15.63:0/3834947505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e18f390 0x557d6e565460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.852+0000 7fe5b72d6740 1 --2- 172.21.15.63:0/3834947505 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e1871b0 0x557d6e564f20 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.852+0000 7fe5b72d6740 1 -- 172.21.15.63:0/3834947505 >> 172.21.15.63:0/3834947505 conn(0x557d6e1a4460 msgr2=0x557d6e559090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.852+0000 7fe591ffb640 0 client.17061 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:35:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.852+0000 7fe5b72d6740 1 -- 172.21.15.63:0/3834947505 shutdown_connections 2024-09-21T06:35:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.852+0000 7fe5b72d6740 1 -- 172.21.15.63:0/3834947505 wait complete. 2024-09-21T06:35:58.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.852+0000 7fe5b72d6740 20 client.17061 trim_cache size 0 max 16384 2024-09-21T06:35:58.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.866+0000 7fe5b72d6740 1 Processor -- start 2024-09-21T06:35:58.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.866+0000 7fe5b72d6740 1 -- start start 2024-09-21T06:35:58.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.866+0000 7fe5b72d6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e1871b0 0x557d6e555600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.866+0000 7fe5b72d6740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e18f390 0x557d6e562110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.866+0000 7fe5b72d6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e1b0070 0x557d6e562650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.866+0000 7fe5b72d6740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac1ad610 con 0x557d6e18f390 2024-09-21T06:35:58.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.866+0000 7fe5b72d6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac1af1b0 con 0x557d6e1b0070 2024-09-21T06:35:58.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.866+0000 7fe5b72d6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac1adce0 con 0x557d6e1871b0 2024-09-21T06:35:58.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.866+0000 7fe5a9d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e18f390 0x557d6e562110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.866+0000 7fe5a9d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e18f390 0x557d6e562110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52832/0 (socket says 172.21.15.63:52832) 2024-09-21T06:35:58.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.866+0000 7fe5a9d9b640 1 -- 172.21.15.63:0/3876004520 learned_addr learned my addr 172.21.15.63:0/3876004520 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:58.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.866+0000 7fe5aad9d640 1 --2- 172.21.15.63:0/3876004520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e1b0070 0x557d6e562650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.866+0000 7fe5aa59c640 1 --2- 172.21.15.63:0/3876004520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e1871b0 0x557d6e555600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.866+0000 7fe5a9d9b640 1 -- 172.21.15.63:0/3876004520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e1871b0 msgr2=0x557d6e555600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:58.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.866+0000 7fe5a9d9b640 1 --2- 172.21.15.63:0/3876004520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e1871b0 0x557d6e555600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.866+0000 7fe5a9d9b640 1 -- 172.21.15.63:0/3876004520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e1b0070 msgr2=0x557d6e562650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:58.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.866+0000 7fe5a9d9b640 1 --2- 172.21.15.63:0/3876004520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e1b0070 0x557d6e562650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.866+0000 7fe5a9d9b640 1 -- 172.21.15.63:0/3876004520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d6e560a20 con 0x557d6e18f390 2024-09-21T06:35:58.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.866+0000 7fe5aa59c640 1 --2- 172.21.15.63:0/3876004520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e1871b0 0x557d6e555600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:58.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.867+0000 7fe5a9d9b640 1 --2- 172.21.15.63:0/3876004520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e18f390 0x557d6e562110 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe5940e5110 tx=0x7fe5940eaad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6300ed4097ae43f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:58.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.867+0000 7fe593fff640 1 -- 172.21.15.63:0/3876004520 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5940acb60 con 0x557d6e18f390 2024-09-21T06:35:58.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.867+0000 7fe593fff640 1 -- 172.21.15.63:0/3876004520 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557d6e4cfdf0 con 0x557d6e18f390 2024-09-21T06:35:58.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.867+0000 7fe593fff640 1 -- 172.21.15.63:0/3876004520 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5940acfe0 con 0x557d6e18f390 2024-09-21T06:35:58.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.868+0000 7fe5b72d6740 1 -- 172.21.15.63:0/3876004520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e18f390 msgr2=0x557d6e562110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:58.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.868+0000 7fe5b72d6740 1 --2- 172.21.15.63:0/3876004520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e18f390 0x557d6e562110 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe5940e5110 tx=0x7fe5940eaad0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.868+0000 7fe5b72d6740 1 -- 172.21.15.63:0/3876004520 shutdown_connections 2024-09-21T06:35:58.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.868+0000 7fe5b72d6740 1 --2- 172.21.15.63:0/3876004520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e1b0070 0x557d6e562650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.868+0000 7fe5b72d6740 1 --2- 172.21.15.63:0/3876004520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e18f390 0x557d6e562110 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.868+0000 7fe5b72d6740 1 --2- 172.21.15.63:0/3876004520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e1871b0 0x557d6e555600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.868+0000 7fe5b72d6740 1 -- 172.21.15.63:0/3876004520 >> 172.21.15.63:0/3876004520 conn(0x557d6e1a4460 msgr2=0x557d6e554ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:58.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.868+0000 7fe5b72d6740 1 -- 172.21.15.63:0/3876004520 shutdown_connections 2024-09-21T06:35:58.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.868+0000 7fe5b72d6740 1 -- 172.21.15.63:0/3876004520 wait complete. 2024-09-21T06:35:58.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.868+0000 7fe5b72d6740 1 -- start start 2024-09-21T06:35:58.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.868+0000 7fe5b72d6740 1 Processor -- start 2024-09-21T06:35:58.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.868+0000 7fe5b72d6740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e1871b0 0x557d6e56dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.868+0000 7fe5b72d6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e18f390 0x557d6e5690e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.868+0000 7fe5b72d6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e1b0070 0x557d6e5697d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.868+0000 7fe5b72d6740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac1aeae0 con 0x557d6e1871b0 2024-09-21T06:35:58.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.868+0000 7fe5b72d6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac1ae3e0 con 0x557d6e1b0070 2024-09-21T06:35:58.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.868+0000 7fe5b72d6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac1ab610 con 0x557d6e18f390 2024-09-21T06:35:58.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.869+0000 7fe5b72d6740 10 client.0 _ll_register_callbacks cb 0x7fe59c00b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:58.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.869+0000 7fe5aa59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e1871b0 0x557d6e56dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.869+0000 7fe5aa59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e1871b0 0x557d6e56dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52836/0 (socket says 172.21.15.63:52836) 2024-09-21T06:35:58.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.869+0000 7fe5aa59c640 1 -- 172.21.15.63:0/4074182676 learned_addr learned my addr 172.21.15.63:0/4074182676 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:35:58.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.869+0000 7fe5aad9d640 1 --2- 172.21.15.63:0/4074182676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e1b0070 0x557d6e5697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.869+0000 7fe5a9d9b640 1 --2- 172.21.15.63:0/4074182676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e18f390 0x557d6e5690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.869+0000 7fe5aa59c640 1 -- 172.21.15.63:0/4074182676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e18f390 msgr2=0x557d6e5690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:58.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.869+0000 7fe5aa59c640 1 --2- 172.21.15.63:0/4074182676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e18f390 0x557d6e5690e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.869+0000 7fe5aa59c640 1 -- 172.21.15.63:0/4074182676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e1b0070 msgr2=0x557d6e5697d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:58.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.869+0000 7fe5aa59c640 1 --2- 172.21.15.63:0/4074182676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e1b0070 0x557d6e5697d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.869+0000 7fe5aa59c640 1 -- 172.21.15.63:0/4074182676 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d6e5e0d50 con 0x557d6e1871b0 2024-09-21T06:35:58.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.869+0000 7fe5aa59c640 1 --2- 172.21.15.63:0/4074182676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e1871b0 0x557d6e56dc30 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe59c000c00 tx=0x7fe59c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcddcd8818656e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:58.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.869+0000 7fe591ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:35:58.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.869+0000 7fe591ffb640 1 -- 172.21.15.63:0/4074182676 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c0106a0 con 0x557d6e1871b0 2024-09-21T06:35:58.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.869+0000 7fe591ffb640 1 -- 172.21.15.63:0/4074182676 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7fe59c010840 con 0x557d6e1871b0 2024-09-21T06:35:58.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.869+0000 7fe5b72d6740 1 -- 172.21.15.63:0/4074182676 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557d6e4cfdf0 con 0x557d6e1871b0 2024-09-21T06:35:58.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.870+0000 7fe591ffb640 1 -- 172.21.15.63:0/4074182676 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7fe59c010a60 con 0x557d6e1871b0 2024-09-21T06:35:58.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.870+0000 7fe5b72d6740 10 client.17067 fetch_fsmap learned FSMap version 57 2024-09-21T06:35:58.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.870+0000 7fe5b72d6740 1 -- 172.21.15.63:0/4074182676 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) -- 0x557d6e5e1db0 con 0x557d6e1871b0 2024-09-21T06:35:58.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.870+0000 7fe591ffb640 1 -- 172.21.15.63:0/4074182676 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557d6e4cfdf0 con 0x557d6e1871b0 2024-09-21T06:35:58.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.870+0000 7fe591ffb640 1 -- 172.21.15.63:0/4074182676 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 57) ==== 8378+0+0 (secure 0 0 0) 0x7fe59c019040 con 0x557d6e1871b0 2024-09-21T06:35:58.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.870+0000 7fe5b72d6740 10 client.17067 fetch_fsmap finished waiting for FSMap version 57 2024-09-21T06:35:58.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.870+0000 7fe5b72d6740 10 client.17067 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:35:58.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.870+0000 7fe5b72d6740 20 client.17067 populate_metadata read hostname 'smithi063' 2024-09-21T06:35:58.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.870+0000 7fe5b72d6740 1 --2- 172.21.15.63:0/4074182676 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x557d6e143da0 0x557d6e5e4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.870+0000 7fe5b72d6740 4 client.17067 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:35:58.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.870+0000 7fe5b72d6740 1 -- 172.21.15.63:0/4074182676 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557d6e4cb8a0 con 0x557d6e143da0 2024-09-21T06:35:58.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.870+0000 7fe5a9d9b640 1 --2- 172.21.15.63:0/4074182676 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x557d6e143da0 0x557d6e5e4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.871+0000 7fe591ffb640 10 client.17067 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:35:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.871+0000 7fe5a9d9b640 1 --2- 172.21.15.63:0/4074182676 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x557d6e143da0 0x557d6e5e4590 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5678a460bb0116e server_cookie=bbf2d31896399e35 in_seq=0 out_seq=0 2024-09-21T06:35:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.871+0000 7fe591ffb640 1 -- 172.21.15.63:0/4074182676 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557d6e4cb8a0 con 0x557d6e143da0 2024-09-21T06:35:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.871+0000 7fe591ffb640 10 client.17067 handle_command_reply: tid=0 2024-09-21T06:35:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.871+0000 7fe5b72d6740 1 client.17067 shutdown 2024-09-21T06:35:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.871+0000 7fe5b72d6740 1 -- 172.21.15.63:0/4074182676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e1871b0 msgr2=0x557d6e56dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.871+0000 7fe5b72d6740 1 --2- 172.21.15.63:0/4074182676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e1871b0 0x557d6e56dc30 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe59c000c00 tx=0x7fe59c00bbe0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.871+0000 7fe5b72d6740 1 -- 172.21.15.63:0/4074182676 shutdown_connections 2024-09-21T06:35:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.871+0000 7fe5b72d6740 1 --2- 172.21.15.63:0/4074182676 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x557d6e143da0 0x557d6e5e4590 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.871+0000 7fe5b72d6740 1 --2- 172.21.15.63:0/4074182676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557d6e1b0070 0x557d6e5697d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.871+0000 7fe5b72d6740 1 --2- 172.21.15.63:0/4074182676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d6e18f390 0x557d6e5690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.871+0000 7fe5b72d6740 1 --2- 172.21.15.63:0/4074182676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d6e1871b0 0x557d6e56dc30 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.871+0000 7fe5b72d6740 1 -- 172.21.15.63:0/4074182676 >> 172.21.15.63:0/4074182676 conn(0x557d6e1a4460 msgr2=0x557d6e5586d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:58.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.871+0000 7fe591ffb640 0 client.17067 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:35:58.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.871+0000 7fe5b72d6740 1 -- 172.21.15.63:0/4074182676 shutdown_connections 2024-09-21T06:35:58.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.871+0000 7fe5b72d6740 1 -- 172.21.15.63:0/4074182676 wait complete. 2024-09-21T06:35:58.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.871+0000 7fe5b72d6740 20 client.17067 trim_cache size 0 max 16384 2024-09-21T06:35:58.879 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:35:58.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.872+0000 7fe5b0d62640 1 -- 172.21.15.63:0/151031568 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe5980b6680 msgr2=0x7fe5980b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:58.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.872+0000 7fe5b0d62640 1 --2- 172.21.15.63:0/151031568 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe5980b6680 0x7fe5980b8b90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4004af0 tx=0x7fe5a4005c30 comp rx=0 tx=0).stop 2024-09-21T06:35:58.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.872+0000 7fe5b0d62640 1 -- 172.21.15.63:0/151031568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5ac1083a0 msgr2=0x7fe5ac199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:58.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.872+0000 7fe5b0d62640 1 --2- 172.21.15.63:0/151031568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5ac1083a0 0x7fe5ac199910 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fe594005fd0 tx=0x7fe59400dde0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.872+0000 7fe5b0d62640 1 -- 172.21.15.63:0/151031568 shutdown_connections 2024-09-21T06:35:58.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.872+0000 7fe5b0d62640 1 --2- 172.21.15.63:0/151031568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5ac108cf0 0x7fe5ac19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.872+0000 7fe5b0d62640 1 --2- 172.21.15.63:0/151031568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5ac1083a0 0x7fe5ac199910 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.872+0000 7fe5b0d62640 1 --2- 172.21.15.63:0/151031568 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe5980b6680 0x7fe5980b8b90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.872+0000 7fe5b0d62640 1 --2- 172.21.15.63:0/151031568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5ac102a60 0x7fe5ac199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.872+0000 7fe5b0d62640 1 -- 172.21.15.63:0/151031568 >> 172.21.15.63:0/151031568 conn(0x7fe5ac079730 msgr2=0x7fe5ac104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:58.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.872+0000 7fe5b0d62640 1 -- 172.21.15.63:0/151031568 shutdown_connections 2024-09-21T06:35:58.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:35:58.872+0000 7fe5b0d62640 1 -- 172.21.15.63:0/151031568 wait complete. 2024-09-21T06:35:59.518 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:59 smithi063 ceph-mon[31150]: pgmap v558: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:35:59.518 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:35:59 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:35:59.547 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:35:59.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:59 smithi175 ceph-mon[34510]: pgmap v558: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:35:59.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:35:59 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:35:59.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:59 smithi071 ceph-mon[34844]: pgmap v558: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:35:59.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:35:59 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:35:59.805 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:00.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.464+0000 7f40bd4fd640 1 -- 172.21.15.63:0/2815036963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40b81083d0 msgr2=0x7f40b81087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:00.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.464+0000 7f40bd4fd640 1 --2- 172.21.15.63:0/2815036963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40b81083d0 0x7f40b81087e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009900 tx=0x7f40a002a410 comp rx=0 tx=0).stop 2024-09-21T06:36:00.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.464+0000 7f40bd4fd640 1 -- 172.21.15.63:0/2815036963 shutdown_connections 2024-09-21T06:36:00.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.464+0000 7f40bd4fd640 1 --2- 172.21.15.63:0/2815036963 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40b8108d20 0x7f40b810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.464+0000 7f40bd4fd640 1 --2- 172.21.15.63:0/2815036963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40b81083d0 0x7f40b81087e0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.464+0000 7f40bd4fd640 1 --2- 172.21.15.63:0/2815036963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b8102ae0 0x7f40b8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.464+0000 7f40bd4fd640 1 -- 172.21.15.63:0/2815036963 >> 172.21.15.63:0/2815036963 conn(0x7f40b8079760 msgr2=0x7f40b8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:00.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.464+0000 7f40bd4fd640 1 -- 172.21.15.63:0/2815036963 shutdown_connections 2024-09-21T06:36:00.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.464+0000 7f40bd4fd640 1 -- 172.21.15.63:0/2815036963 wait complete. 2024-09-21T06:36:00.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.465+0000 7f40bd4fd640 1 Processor -- start 2024-09-21T06:36:00.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.465+0000 7f40bd4fd640 1 -- start start 2024-09-21T06:36:00.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.465+0000 7f40bd4fd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40b8102ae0 0x7f40b810fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.465+0000 7f40bd4fd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40b81083d0 0x7f40b8110320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.466+0000 7f40bd4fd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b8108d20 0x7f40b8110860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.466+0000 7f40bd4fd640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f40b8113aa0 con 0x7f40b81083d0 2024-09-21T06:36:00.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.466+0000 7f40bd4fd640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f40b8113920 con 0x7f40b8102ae0 2024-09-21T06:36:00.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.466+0000 7f40bd4fd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f40b8113c20 con 0x7f40b8108d20 2024-09-21T06:36:00.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.466+0000 7f40affff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40b81083d0 0x7f40b8110320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.466+0000 7f40affff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40b81083d0 0x7f40b8110320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52856/0 (socket says 172.21.15.63:52856) 2024-09-21T06:36:00.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.466+0000 7f40affff640 1 -- 172.21.15.63:0/1705208102 learned_addr learned my addr 172.21.15.63:0/1705208102 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:00.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.466+0000 7f40b6ffd640 1 --2- 172.21.15.63:0/1705208102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40b8102ae0 0x7f40b810fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.466+0000 7f40b77fe640 1 --2- 172.21.15.63:0/1705208102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b8108d20 0x7f40b8110860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.466+0000 7f40affff640 1 -- 172.21.15.63:0/1705208102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b8108d20 msgr2=0x7f40b8110860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:00.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.466+0000 7f40affff640 1 --2- 172.21.15.63:0/1705208102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b8108d20 0x7f40b8110860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.466+0000 7f40affff640 1 -- 172.21.15.63:0/1705208102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40b8102ae0 msgr2=0x7f40b810fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:00.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.466+0000 7f40affff640 1 --2- 172.21.15.63:0/1705208102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40b8102ae0 0x7f40b810fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.466+0000 7f40affff640 1 -- 172.21.15.63:0/1705208102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b81a8620 con 0x7f40b81083d0 2024-09-21T06:36:00.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.466+0000 7f40b77fe640 1 --2- 172.21.15.63:0/1705208102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b8108d20 0x7f40b8110860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:00.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.466+0000 7f40affff640 1 --2- 172.21.15.63:0/1705208102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40b81083d0 0x7f40b8110320 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f40a0031a90 tx=0x7f40a0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:00.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.466+0000 7f40b4ff9640 1 -- 172.21.15.63:0/1705208102 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a003f030 con 0x7f40b81083d0 2024-09-21T06:36:00.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.467+0000 7f40b4ff9640 1 -- 172.21.15.63:0/1705208102 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40a0004490 con 0x7f40b81083d0 2024-09-21T06:36:00.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.467+0000 7f40b4ff9640 1 -- 172.21.15.63:0/1705208102 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0035070 con 0x7f40b81083d0 2024-09-21T06:36:00.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.467+0000 7f40bd4fd640 1 -- 172.21.15.63:0/1705208102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b81a88b0 con 0x7f40b81083d0 2024-09-21T06:36:00.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.467+0000 7f40bd4fd640 1 -- 172.21.15.63:0/1705208102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b81a8d40 con 0x7f40b81083d0 2024-09-21T06:36:00.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.469+0000 7f40c3a71740 1 Processor -- start 2024-09-21T06:36:00.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.469+0000 7f40c3a71740 1 -- start start 2024-09-21T06:36:00.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.470+0000 7f40b4ff9640 1 -- 172.21.15.63:0/1705208102 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f40a0042030 con 0x7f40b81083d0 2024-09-21T06:36:00.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.470+0000 7f40c3a71740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b29c62070 0x563b2a0096a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.470+0000 7f40c3a71740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c391b0 0x563b2a009be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.470+0000 7f40c3a71740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c41390 0x563b2a00a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.470+0000 7f40c3a71740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563b29f7fea0 con 0x563b29c41390 2024-09-21T06:36:00.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.470+0000 7f40c3a71740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563b29f6f2d0 con 0x563b29c391b0 2024-09-21T06:36:00.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.470+0000 7f40c3a71740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563b29f730e0 con 0x563b29c62070 2024-09-21T06:36:00.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.470+0000 7f40affff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c41390 0x563b2a00a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.470+0000 7f40affff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c41390 0x563b2a00a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52868/0 (socket says 172.21.15.63:52868) 2024-09-21T06:36:00.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.470+0000 7f40affff640 1 -- 172.21.15.63:0/3334419973 learned_addr learned my addr 172.21.15.63:0/3334419973 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:00.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.470+0000 7f40b77fe640 1 --2- 172.21.15.63:0/3334419973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b29c62070 0x563b2a0096a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.470+0000 7f40b6ffd640 1 --2- 172.21.15.63:0/3334419973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c391b0 0x563b2a009be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.471+0000 7f40b6ffd640 1 -- 172.21.15.63:0/3334419973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b29c62070 msgr2=0x563b2a0096a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:00.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.471+0000 7f40b6ffd640 1 --2- 172.21.15.63:0/3334419973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b29c62070 0x563b2a0096a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.471+0000 7f40b6ffd640 1 -- 172.21.15.63:0/3334419973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c41390 msgr2=0x563b2a00a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:00.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.471+0000 7f40b6ffd640 1 --2- 172.21.15.63:0/3334419973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c41390 0x563b2a00a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.471+0000 7f40b6ffd640 1 -- 172.21.15.63:0/3334419973 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b29ccd650 con 0x563b29c391b0 2024-09-21T06:36:00.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.471+0000 7f40affff640 1 --2- 172.21.15.63:0/3334419973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c41390 0x563b2a00a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:00.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.471+0000 7f40b4ff9640 1 --2- 172.21.15.63:0/1705208102 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f40a40b6700 0x7f40a40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.471+0000 7f40b77fe640 1 --2- 172.21.15.63:0/1705208102 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f40a40b6700 0x7f40a40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.471+0000 7f40b6ffd640 1 --2- 172.21.15.63:0/3334419973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c391b0 0x563b2a009be0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f40a800aba0 tx=0x7f40a800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78e6ccdc0d8d8fda server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:00.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.471+0000 7f40b4ff9640 1 -- 172.21.15.63:0/1705208102 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7f40a0107d20 con 0x7f40b81083d0 2024-09-21T06:36:00.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.471+0000 7f40ad7fa640 1 -- 172.21.15.63:0/3334419973 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a8005220 con 0x563b29c391b0 2024-09-21T06:36:00.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.471+0000 7f40ad7fa640 1 -- 172.21.15.63:0/3334419973 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40a80047a0 con 0x563b29c391b0 2024-09-21T06:36:00.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.471+0000 7f40ad7fa640 1 -- 172.21.15.63:0/3334419973 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a80187b0 con 0x563b29c391b0 2024-09-21T06:36:00.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.472+0000 7f40c3a71740 1 -- 172.21.15.63:0/3334419973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c391b0 msgr2=0x563b2a009be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:00.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.472+0000 7f40b77fe640 1 --2- 172.21.15.63:0/1705208102 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f40a40b6700 0x7f40a40b8c10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f40b0005fd0 tx=0x7f40b00086a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:00.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.472+0000 7f40c3a71740 1 --2- 172.21.15.63:0/3334419973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c391b0 0x563b2a009be0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f40a800aba0 tx=0x7f40a800f790 comp rx=0 tx=0).stop 2024-09-21T06:36:00.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.472+0000 7f40c3a71740 1 -- 172.21.15.63:0/3334419973 shutdown_connections 2024-09-21T06:36:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.472+0000 7f40c3a71740 1 --2- 172.21.15.63:0/3334419973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c41390 0x563b2a00a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.472+0000 7f40c3a71740 1 --2- 172.21.15.63:0/3334419973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c391b0 0x563b2a009be0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.472+0000 7f40c3a71740 1 --2- 172.21.15.63:0/3334419973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b29c62070 0x563b2a0096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.472+0000 7f40c3a71740 1 -- 172.21.15.63:0/3334419973 >> 172.21.15.63:0/3334419973 conn(0x563b29c56460 msgr2=0x563b2a007590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.472+0000 7f40c3a71740 1 -- 172.21.15.63:0/3334419973 shutdown_connections 2024-09-21T06:36:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.472+0000 7f40c3a71740 1 -- 172.21.15.63:0/3334419973 wait complete. 2024-09-21T06:36:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.473+0000 7f40c3a71740 1 -- start start 2024-09-21T06:36:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.473+0000 7f40c3a71740 1 Processor -- start 2024-09-21T06:36:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.473+0000 7f40c3a71740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c391b0 0x563b2a014cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.473+0000 7f40c3a71740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b29c41390 0x563b2a0151f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.473+0000 7f40c3a71740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c62070 0x563b2a015750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.473+0000 7f40c3a71740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563b29dd0700 con 0x563b29c391b0 2024-09-21T06:36:00.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.473+0000 7f40c3a71740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563b29f0a160 con 0x563b29c62070 2024-09-21T06:36:00.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.473+0000 7f40c3a71740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563b2a017e80 con 0x563b29c41390 2024-09-21T06:36:00.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.473+0000 7f40c3a71740 10 client.0 _ll_register_callbacks cb 0x563b29f239e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:00.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.473+0000 7f40b6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c391b0 0x563b2a014cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.473+0000 7f40b6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c391b0 0x563b2a014cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52876/0 (socket says 172.21.15.63:52876) 2024-09-21T06:36:00.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.473+0000 7f40b6ffd640 1 -- 172.21.15.63:0/3278628296 learned_addr learned my addr 172.21.15.63:0/3278628296 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:00.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.473+0000 7f40b77fe640 1 --2- 172.21.15.63:0/3278628296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c62070 0x563b2a015750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.473+0000 7f40affff640 1 --2- 172.21.15.63:0/3278628296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b29c41390 0x563b2a0151f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.474+0000 7f40b6ffd640 1 -- 172.21.15.63:0/3278628296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b29c41390 msgr2=0x563b2a0151f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:00.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.474+0000 7f40b6ffd640 1 --2- 172.21.15.63:0/3278628296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b29c41390 0x563b2a0151f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.474+0000 7f40b6ffd640 1 -- 172.21.15.63:0/3278628296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c62070 msgr2=0x563b2a015750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:00.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.474+0000 7f40b6ffd640 1 --2- 172.21.15.63:0/3278628296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c62070 0x563b2a015750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.474+0000 7f40b6ffd640 1 -- 172.21.15.63:0/3278628296 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b29f37c90 con 0x563b29c391b0 2024-09-21T06:36:00.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.474+0000 7f40b6ffd640 1 --2- 172.21.15.63:0/3278628296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c391b0 0x563b2a014cb0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f40a801a040 tx=0x7f40a80052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc757d1498fbbc2b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:00.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.474+0000 7f409e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.474+0000 7f409e7fc640 1 -- 172.21.15.63:0/3278628296 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a8027070 con 0x563b29c391b0 2024-09-21T06:36:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.474+0000 7f409e7fc640 1 -- 172.21.15.63:0/3278628296 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7f40a80184b0 con 0x563b29c391b0 2024-09-21T06:36:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.474+0000 7f40c3a71740 1 -- 172.21.15.63:0/3278628296 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40a80047a0 con 0x563b29c391b0 2024-09-21T06:36:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.474+0000 7f409e7fc640 1 -- 172.21.15.63:0/3278628296 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f40a8033050 con 0x563b29c391b0 2024-09-21T06:36:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.474+0000 7f40c3a71740 10 client.17079 fetch_fsmap learned FSMap version 57 2024-09-21T06:36:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.474+0000 7f40c3a71740 1 -- 172.21.15.63:0/3278628296 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) -- 0x563b2a023b30 con 0x563b29c391b0 2024-09-21T06:36:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.475+0000 7f409e7fc640 1 -- 172.21.15.63:0/3278628296 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40a80047a0 con 0x563b29c391b0 2024-09-21T06:36:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.475+0000 7f409e7fc640 1 -- 172.21.15.63:0/3278628296 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 57) ==== 8378+0+0 (secure 0 0 0) 0x7f40a8023430 con 0x563b29c391b0 2024-09-21T06:36:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.475+0000 7f40c3a71740 10 client.17079 fetch_fsmap finished waiting for FSMap version 57 2024-09-21T06:36:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.475+0000 7f40c3a71740 10 client.17079 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:36:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.475+0000 7f40c3a71740 20 client.17079 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.475+0000 7f40c3a71740 1 --2- 172.21.15.63:0/3278628296 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563b29c209f0 0x563b2a026ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.475+0000 7f40c3a71740 4 client.17079 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.475+0000 7f40c3a71740 1 -- 172.21.15.63:0/3278628296 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b29f81df0 con 0x563b29c209f0 2024-09-21T06:36:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.475+0000 7f40affff640 1 --2- 172.21.15.63:0/3278628296 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563b29c209f0 0x563b2a026ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.476+0000 7f409e7fc640 10 client.17079 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.476+0000 7f40affff640 1 --2- 172.21.15.63:0/3278628296 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563b29c209f0 0x563b2a026ef0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6167d213c884604b server_cookie=fc11322229a3fa2b in_seq=0 out_seq=0 2024-09-21T06:36:00.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.476+0000 7f409e7fc640 1 -- 172.21.15.63:0/3278628296 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563b29f81df0 con 0x563b29c209f0 2024-09-21T06:36:00.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.476+0000 7f409e7fc640 10 client.17079 handle_command_reply: tid=0 2024-09-21T06:36:00.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.477+0000 7f40c3a71740 1 client.17079 shutdown 2024-09-21T06:36:00.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.477+0000 7f40c3a71740 1 -- 172.21.15.63:0/3278628296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c391b0 msgr2=0x563b2a014cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:00.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.477+0000 7f40c3a71740 1 --2- 172.21.15.63:0/3278628296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c391b0 0x563b2a014cb0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f40a801a040 tx=0x7f40a80052d0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.477+0000 7f40c3a71740 1 -- 172.21.15.63:0/3278628296 shutdown_connections 2024-09-21T06:36:00.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.477+0000 7f40c3a71740 1 --2- 172.21.15.63:0/3278628296 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563b29c209f0 0x563b2a026ef0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.477+0000 7f40c3a71740 1 --2- 172.21.15.63:0/3278628296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c62070 0x563b2a015750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.477+0000 7f40c3a71740 1 --2- 172.21.15.63:0/3278628296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b29c41390 0x563b2a0151f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.477+0000 7f40c3a71740 1 --2- 172.21.15.63:0/3278628296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c391b0 0x563b2a014cb0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.477+0000 7f40c3a71740 1 -- 172.21.15.63:0/3278628296 >> 172.21.15.63:0/3278628296 conn(0x563b29c56460 msgr2=0x563b2a00c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:00.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.477+0000 7f409e7fc640 0 client.17079 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:00.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.477+0000 7f40c3a71740 1 -- 172.21.15.63:0/3278628296 shutdown_connections 2024-09-21T06:36:00.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.477+0000 7f40c3a71740 1 -- 172.21.15.63:0/3278628296 wait complete. 2024-09-21T06:36:00.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.477+0000 7f40c3a71740 20 client.17079 trim_cache size 0 max 16384 2024-09-21T06:36:00.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.490+0000 7f40c3a71740 1 Processor -- start 2024-09-21T06:36:00.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.490+0000 7f40c3a71740 1 -- start start 2024-09-21T06:36:00.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.491+0000 7f40c3a71740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c391b0 0x563b2a00d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.491+0000 7f40c3a71740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b29c41390 0x563b2a00ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.491+0000 7f40c3a71740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c62070 0x563b2a011ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.491+0000 7f40c3a71740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f40b81b1890 con 0x563b29c391b0 2024-09-21T06:36:00.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.491+0000 7f40c3a71740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f40b81b3430 con 0x563b29c62070 2024-09-21T06:36:00.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.491+0000 7f40c3a71740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f40b81b1f60 con 0x563b29c41390 2024-09-21T06:36:00.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.491+0000 7f40b6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c391b0 0x563b2a00d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.491+0000 7f40b6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c391b0 0x563b2a00d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52890/0 (socket says 172.21.15.63:52890) 2024-09-21T06:36:00.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.491+0000 7f40b6ffd640 1 -- 172.21.15.63:0/908816885 learned_addr learned my addr 172.21.15.63:0/908816885 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:00.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.491+0000 7f40affff640 1 --2- 172.21.15.63:0/908816885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b29c41390 0x563b2a00ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.491+0000 7f40b77fe640 1 --2- 172.21.15.63:0/908816885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c62070 0x563b2a011ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.491+0000 7f40b6ffd640 1 -- 172.21.15.63:0/908816885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b29c41390 msgr2=0x563b2a00ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:00.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.491+0000 7f40b6ffd640 1 --2- 172.21.15.63:0/908816885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b29c41390 0x563b2a00ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.491+0000 7f40b6ffd640 1 -- 172.21.15.63:0/908816885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c62070 msgr2=0x563b2a011ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:00.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.491+0000 7f40b6ffd640 1 --2- 172.21.15.63:0/908816885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c62070 0x563b2a011ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.491+0000 7f40b6ffd640 1 -- 172.21.15.63:0/908816885 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b2a0131b0 con 0x563b29c391b0 2024-09-21T06:36:00.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.491+0000 7f40b77fe640 1 --2- 172.21.15.63:0/908816885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c62070 0x563b2a011ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:00.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.491+0000 7f40b6ffd640 1 --2- 172.21.15.63:0/908816885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c391b0 0x563b2a00d160 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f40a8000c00 tx=0x7f40a800aa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d438860fc4f45acd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:00.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.492+0000 7f40acff9640 1 -- 172.21.15.63:0/908816885 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a803c070 con 0x563b29c391b0 2024-09-21T06:36:00.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.492+0000 7f40acff9640 1 -- 172.21.15.63:0/908816885 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40a8005340 con 0x563b29c391b0 2024-09-21T06:36:00.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.492+0000 7f40acff9640 1 -- 172.21.15.63:0/908816885 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a8027040 con 0x563b29c391b0 2024-09-21T06:36:00.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.492+0000 7f40c3a71740 1 -- 172.21.15.63:0/908816885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c391b0 msgr2=0x563b2a00d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:00.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.492+0000 7f40c3a71740 1 --2- 172.21.15.63:0/908816885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c391b0 0x563b2a00d160 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f40a8000c00 tx=0x7f40a800aa20 comp rx=0 tx=0).stop 2024-09-21T06:36:00.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.492+0000 7f40c3a71740 1 -- 172.21.15.63:0/908816885 shutdown_connections 2024-09-21T06:36:00.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.492+0000 7f40c3a71740 1 --2- 172.21.15.63:0/908816885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c62070 0x563b2a011ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.492+0000 7f40c3a71740 1 --2- 172.21.15.63:0/908816885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b29c41390 0x563b2a00ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.492+0000 7f40c3a71740 1 --2- 172.21.15.63:0/908816885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c391b0 0x563b2a00d160 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.492+0000 7f40c3a71740 1 -- 172.21.15.63:0/908816885 >> 172.21.15.63:0/908816885 conn(0x563b29c56460 msgr2=0x563b2a00a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:00.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.493+0000 7f40c3a71740 1 -- 172.21.15.63:0/908816885 shutdown_connections 2024-09-21T06:36:00.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.493+0000 7f40c3a71740 1 -- 172.21.15.63:0/908816885 wait complete. 2024-09-21T06:36:00.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.493+0000 7f40c3a71740 1 -- start start 2024-09-21T06:36:00.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.493+0000 7f40c3a71740 1 Processor -- start 2024-09-21T06:36:00.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.493+0000 7f40c3a71740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c391b0 0x563b2a01aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.493+0000 7f40c3a71740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c41390 0x563b2a01b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.493+0000 7f40c3a71740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b29c62070 0x563b2a089870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.493+0000 7f40c3a71740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f40b81b2d60 con 0x563b29c41390 2024-09-21T06:36:00.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.493+0000 7f40c3a71740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f40b81b2660 con 0x563b29c391b0 2024-09-21T06:36:00.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.493+0000 7f40c3a71740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f40b81af890 con 0x563b29c62070 2024-09-21T06:36:00.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.493+0000 7f40c3a71740 10 client.0 _ll_register_callbacks cb 0x7f40a010b740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:00.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.493+0000 7f40affff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c41390 0x563b2a01b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.493+0000 7f40affff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c41390 0x563b2a01b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52894/0 (socket says 172.21.15.63:52894) 2024-09-21T06:36:00.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.493+0000 7f40affff640 1 -- 172.21.15.63:0/3544761577 learned_addr learned my addr 172.21.15.63:0/3544761577 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:00.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.494+0000 7f40b77fe640 1 --2- 172.21.15.63:0/3544761577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b29c62070 0x563b2a089870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.494+0000 7f40b6ffd640 1 --2- 172.21.15.63:0/3544761577 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c391b0 0x563b2a01aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.494+0000 7f40affff640 1 -- 172.21.15.63:0/3544761577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b29c62070 msgr2=0x563b2a089870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:00.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.494+0000 7f40affff640 1 --2- 172.21.15.63:0/3544761577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b29c62070 0x563b2a089870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.494+0000 7f40affff640 1 -- 172.21.15.63:0/3544761577 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c391b0 msgr2=0x563b2a01aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:00.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.494+0000 7f40affff640 1 --2- 172.21.15.63:0/3544761577 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c391b0 0x563b2a01aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.494+0000 7f40affff640 1 -- 172.21.15.63:0/3544761577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b2a089ee0 con 0x563b29c41390 2024-09-21T06:36:00.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.494+0000 7f40affff640 1 --2- 172.21.15.63:0/3544761577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c41390 0x563b2a01b280 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f40a00cad90 tx=0x7f40a010b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ecad5f43220649a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:00.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.494+0000 7f409e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:00.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.494+0000 7f409e7fc640 1 -- 172.21.15.63:0/3544761577 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a00d0e60 con 0x563b29c41390 2024-09-21T06:36:00.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.494+0000 7f409e7fc640 1 -- 172.21.15.63:0/3544761577 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7f40a01056a0 con 0x563b29c41390 2024-09-21T06:36:00.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.494+0000 7f40c3a71740 1 -- 172.21.15.63:0/3544761577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40a8005340 con 0x563b29c41390 2024-09-21T06:36:00.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.494+0000 7f409e7fc640 1 -- 172.21.15.63:0/3544761577 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f40a0049040 con 0x563b29c41390 2024-09-21T06:36:00.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.494+0000 7f40c3a71740 10 client.17085 fetch_fsmap learned FSMap version 57 2024-09-21T06:36:00.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.494+0000 7f40c3a71740 1 -- 172.21.15.63:0/3544761577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) -- 0x563b2a0912a0 con 0x563b29c41390 2024-09-21T06:36:00.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.495+0000 7f409e7fc640 1 -- 172.21.15.63:0/3544761577 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40a8005340 con 0x563b29c41390 2024-09-21T06:36:00.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.495+0000 7f409e7fc640 1 -- 172.21.15.63:0/3544761577 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 57) ==== 8378+0+0 (secure 0 0 0) 0x7f40a00c9d90 con 0x563b29c41390 2024-09-21T06:36:00.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.495+0000 7f40c3a71740 10 client.17085 fetch_fsmap finished waiting for FSMap version 57 2024-09-21T06:36:00.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.495+0000 7f40c3a71740 10 client.17085 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:36:00.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.495+0000 7f40c3a71740 20 client.17085 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:00.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.495+0000 7f40c3a71740 1 --2- 172.21.15.63:0/3544761577 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563b29bf5da0 0x563b2a093a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.495+0000 7f40c3a71740 4 client.17085 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:36:00.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.495+0000 7f40c3a71740 1 -- 172.21.15.63:0/3544761577 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563b29f7d8a0 con 0x563b29bf5da0 2024-09-21T06:36:00.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.495+0000 7f40b6ffd640 1 --2- 172.21.15.63:0/3544761577 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563b29bf5da0 0x563b2a093a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.495+0000 7f409e7fc640 10 client.17085 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:00.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.495+0000 7f40b6ffd640 1 --2- 172.21.15.63:0/3544761577 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563b29bf5da0 0x563b2a093a10 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d4c5d1a6bb9d5a4 server_cookie=1154fe7f00cce124 in_seq=0 out_seq=0 2024-09-21T06:36:00.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.496+0000 7f409e7fc640 1 -- 172.21.15.63:0/3544761577 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563b29f7d8a0 con 0x563b29bf5da0 2024-09-21T06:36:00.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.496+0000 7f409e7fc640 10 client.17085 handle_command_reply: tid=0 2024-09-21T06:36:00.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.496+0000 7f40c3a71740 1 client.17085 shutdown 2024-09-21T06:36:00.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.496+0000 7f40c3a71740 1 -- 172.21.15.63:0/3544761577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c41390 msgr2=0x563b2a01b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:00.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.496+0000 7f40c3a71740 1 --2- 172.21.15.63:0/3544761577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c41390 0x563b2a01b280 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f40a00cad90 tx=0x7f40a010b870 comp rx=0 tx=0).stop 2024-09-21T06:36:00.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.496+0000 7f40c3a71740 1 -- 172.21.15.63:0/3544761577 shutdown_connections 2024-09-21T06:36:00.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.496+0000 7f40c3a71740 1 --2- 172.21.15.63:0/3544761577 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x563b29bf5da0 0x563b2a093a10 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.496+0000 7f40c3a71740 1 --2- 172.21.15.63:0/3544761577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b29c62070 0x563b2a089870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.496+0000 7f40c3a71740 1 --2- 172.21.15.63:0/3544761577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563b29c41390 0x563b2a01b280 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.496+0000 7f409e7fc640 0 client.17085 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:00.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.496+0000 7f40c3a71740 1 --2- 172.21.15.63:0/3544761577 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563b29c391b0 0x563b2a01aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.496+0000 7f40c3a71740 1 -- 172.21.15.63:0/3544761577 >> 172.21.15.63:0/3544761577 conn(0x563b29c56460 msgr2=0x563b2a00cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:00.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.496+0000 7f40c3a71740 1 -- 172.21.15.63:0/3544761577 shutdown_connections 2024-09-21T06:36:00.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.496+0000 7f40c3a71740 1 -- 172.21.15.63:0/3544761577 wait complete. 2024-09-21T06:36:00.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.496+0000 7f40c3a71740 20 client.17085 trim_cache size 0 max 16384 2024-09-21T06:36:00.503 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:36:00.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.497+0000 7f40bd4fd640 1 -- 172.21.15.63:0/1705208102 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f40a40b6700 msgr2=0x7f40a40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:00.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.497+0000 7f40bd4fd640 1 --2- 172.21.15.63:0/1705208102 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f40a40b6700 0x7f40a40b8c10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f40b0005fd0 tx=0x7f40b00086a0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.497+0000 7f40bd4fd640 1 -- 172.21.15.63:0/1705208102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40b81083d0 msgr2=0x7f40b8110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:00.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.497+0000 7f40bd4fd640 1 --2- 172.21.15.63:0/1705208102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40b81083d0 0x7f40b8110320 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f40a0031a90 tx=0x7f40a0004270 comp rx=0 tx=0).stop 2024-09-21T06:36:00.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.497+0000 7f40bd4fd640 1 -- 172.21.15.63:0/1705208102 shutdown_connections 2024-09-21T06:36:00.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.497+0000 7f40bd4fd640 1 --2- 172.21.15.63:0/1705208102 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f40a40b6700 0x7f40a40b8c10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.497+0000 7f40bd4fd640 1 --2- 172.21.15.63:0/1705208102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b8108d20 0x7f40b8110860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.497+0000 7f40bd4fd640 1 --2- 172.21.15.63:0/1705208102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40b81083d0 0x7f40b8110320 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.497+0000 7f40bd4fd640 1 --2- 172.21.15.63:0/1705208102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40b8102ae0 0x7f40b810fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.497+0000 7f40bd4fd640 1 -- 172.21.15.63:0/1705208102 >> 172.21.15.63:0/1705208102 conn(0x7f40b8079760 msgr2=0x7f40b81043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:00.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.497+0000 7f40bd4fd640 1 -- 172.21.15.63:0/1705208102 shutdown_connections 2024-09-21T06:36:00.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:00.497+0000 7f40bd4fd640 1 -- 172.21.15.63:0/1705208102 wait complete. 2024-09-21T06:36:01.219 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T06:36:01.479 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:01.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:01 smithi063 ceph-mon[31150]: pgmap v559: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:36:01.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:01 smithi175 ceph-mon[34510]: pgmap v559: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:36:01.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:01 smithi071 ceph-mon[34844]: pgmap v559: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:36:01.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.974+0000 7f401f0fe640 1 -- 172.21.15.63:0/333201526 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40181049b0 msgr2=0x7f4018104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:01.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.974+0000 7f401f0fe640 1 --2- 172.21.15.63:0/333201526 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40181049b0 0x7f4018104dc0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f4008009900 tx=0x7f400802a410 comp rx=0 tx=0).stop 2024-09-21T06:36:01.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.975+0000 7f401f0fe640 1 -- 172.21.15.63:0/333201526 shutdown_connections 2024-09-21T06:36:01.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.975+0000 7f401f0fe640 1 --2- 172.21.15.63:0/333201526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f401810de10 0x7f4018110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.975+0000 7f401f0fe640 1 --2- 172.21.15.63:0/333201526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4018105300 0x7f401810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.975+0000 7f401f0fe640 1 --2- 172.21.15.63:0/333201526 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40181049b0 0x7f4018104dc0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.975+0000 7f401f0fe640 1 -- 172.21.15.63:0/333201526 >> 172.21.15.63:0/333201526 conn(0x7f4018079730 msgr2=0x7f4018079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:01.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.975+0000 7f401f0fe640 1 -- 172.21.15.63:0/333201526 shutdown_connections 2024-09-21T06:36:01.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.975+0000 7f401f0fe640 1 -- 172.21.15.63:0/333201526 wait complete. 2024-09-21T06:36:01.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.975+0000 7f401f0fe640 1 Processor -- start 2024-09-21T06:36:01.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.975+0000 7f401f0fe640 1 -- start start 2024-09-21T06:36:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.976+0000 7f401f0fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40181049b0 0x7f40181026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.976+0000 7f401f0fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4018105300 0x7f4018102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.976+0000 7f401f0fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f401810de10 0x7f4018103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.976+0000 7f401f0fe640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4018113a70 con 0x7f401810de10 2024-09-21T06:36:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.976+0000 7f401f0fe640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f40181138f0 con 0x7f40181049b0 2024-09-21T06:36:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.976+0000 7f401f0fe640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4018113bf0 con 0x7f4018105300 2024-09-21T06:36:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.976+0000 7f401d69b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f401810de10 0x7f4018103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.976+0000 7f401d69b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f401810de10 0x7f4018103170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52908/0 (socket says 172.21.15.63:52908) 2024-09-21T06:36:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.976+0000 7f401d69b640 1 -- 172.21.15.63:0/3454568571 learned_addr learned my addr 172.21.15.63:0/3454568571 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.976+0000 7f401ce9a640 1 --2- 172.21.15.63:0/3454568571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40181049b0 0x7f40181026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.976+0000 7f4017fff640 1 --2- 172.21.15.63:0/3454568571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4018105300 0x7f4018102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.976+0000 7f401d69b640 1 -- 172.21.15.63:0/3454568571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4018105300 msgr2=0x7f4018102c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.976+0000 7f401d69b640 1 --2- 172.21.15.63:0/3454568571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4018105300 0x7f4018102c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.976+0000 7f401d69b640 1 -- 172.21.15.63:0/3454568571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40181049b0 msgr2=0x7f40181026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.976+0000 7f401d69b640 1 --2- 172.21.15.63:0/3454568571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40181049b0 0x7f40181026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.976+0000 7f401d69b640 1 -- 172.21.15.63:0/3454568571 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40181a8750 con 0x7f401810de10 2024-09-21T06:36:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.977+0000 7f401d69b640 1 --2- 172.21.15.63:0/3454568571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f401810de10 0x7f4018103170 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f401000eaa0 tx=0x7f401000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.977+0000 7f4015ffb640 1 -- 172.21.15.63:0/3454568571 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401000cdb0 con 0x7f401810de10 2024-09-21T06:36:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.977+0000 7f4015ffb640 1 -- 172.21.15.63:0/3454568571 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4010005020 con 0x7f401810de10 2024-09-21T06:36:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.977+0000 7f401f0fe640 1 -- 172.21.15.63:0/3454568571 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40181a8a40 con 0x7f401810de10 2024-09-21T06:36:01.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.977+0000 7f4015ffb640 1 -- 172.21.15.63:0/3454568571 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40100116d0 con 0x7f401810de10 2024-09-21T06:36:01.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.977+0000 7f401f0fe640 1 -- 172.21.15.63:0/3454568571 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40181a8f30 con 0x7f401810de10 2024-09-21T06:36:01.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.980+0000 7f4025672740 1 Processor -- start 2024-09-21T06:36:01.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.980+0000 7f4015ffb640 1 -- 172.21.15.63:0/3454568571 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f40100051d0 con 0x7f401810de10 2024-09-21T06:36:01.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.980+0000 7f4025672740 1 -- start start 2024-09-21T06:36:01.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.980+0000 7f4025672740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06af8070 0x555f06e9f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.980+0000 7f4025672740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f06acf1b0 0x555f06e9fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.980+0000 7f4025672740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06ad7390 0x555f06ea0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.980+0000 7f4025672740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555f06e15ea0 con 0x555f06ad7390 2024-09-21T06:36:01.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.980+0000 7f4025672740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555f06e052d0 con 0x555f06acf1b0 2024-09-21T06:36:01.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.980+0000 7f4025672740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555f06e090e0 con 0x555f06af8070 2024-09-21T06:36:01.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.980+0000 7f4017fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06ad7390 0x555f06ea0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.980+0000 7f4017fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06ad7390 0x555f06ea0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52918/0 (socket says 172.21.15.63:52918) 2024-09-21T06:36:01.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.980+0000 7f4017fff640 1 -- 172.21.15.63:0/1971568129 learned_addr learned my addr 172.21.15.63:0/1971568129 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:01.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.980+0000 7f401ce9a640 1 --2- 172.21.15.63:0/1971568129 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f06acf1b0 0x555f06e9fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.980+0000 7f4017fff640 1 --2- 172.21.15.63:0/1971568129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06af8070 0x555f06e9f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.981+0000 7f4015ffb640 1 --2- 172.21.15.63:0/3454568571 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f40000b6680 0x7f40000b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.981+0000 7f4017fff640 1 -- 172.21.15.63:0/1971568129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06af8070 msgr2=0x555f06e9f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:01.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.981+0000 7f4017fff640 1 --2- 172.21.15.63:0/1971568129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06af8070 0x555f06e9f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.981+0000 7f4017fff640 1 -- 172.21.15.63:0/1971568129 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f06acf1b0 msgr2=0x555f06e9fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:01.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.981+0000 7f4017fff640 1 --2- 172.21.15.63:0/1971568129 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f06acf1b0 0x555f06e9fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.981+0000 7f4017fff640 1 -- 172.21.15.63:0/1971568129 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f06b63650 con 0x555f06ad7390 2024-09-21T06:36:01.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.981+0000 7f401d69b640 1 --2- 172.21.15.63:0/3454568571 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f40000b6680 0x7f40000b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.981+0000 7f401ce9a640 1 --2- 172.21.15.63:0/1971568129 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f06acf1b0 0x555f06e9fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:01.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.981+0000 7f4015ffb640 1 -- 172.21.15.63:0/3454568571 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7f40100e78c0 con 0x7f401810de10 2024-09-21T06:36:01.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.981+0000 7f4017fff640 1 --2- 172.21.15.63:0/1971568129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06ad7390 0x555f06ea0120 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f400c005fd0 tx=0x7f400c00b440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27128151c386c16f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:01.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.981+0000 7f3ffeffd640 1 -- 172.21.15.63:0/1971568129 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c00e920 con 0x555f06ad7390 2024-09-21T06:36:01.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.981+0000 7f3ffeffd640 1 -- 172.21.15.63:0/1971568129 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f400c011440 con 0x555f06ad7390 2024-09-21T06:36:01.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.981+0000 7f3ffeffd640 1 -- 172.21.15.63:0/1971568129 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c010690 con 0x555f06ad7390 2024-09-21T06:36:01.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.982+0000 7f4025672740 1 -- 172.21.15.63:0/1971568129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06ad7390 msgr2=0x555f06ea0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:01.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.982+0000 7f4025672740 1 --2- 172.21.15.63:0/1971568129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06ad7390 0x555f06ea0120 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f400c005fd0 tx=0x7f400c00b440 comp rx=0 tx=0).stop 2024-09-21T06:36:01.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.982+0000 7f401d69b640 1 --2- 172.21.15.63:0/3454568571 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f40000b6680 0x7f40000b8b90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4010004fa0 tx=0x7f401007a370 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:01.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.982+0000 7f4025672740 1 -- 172.21.15.63:0/1971568129 shutdown_connections 2024-09-21T06:36:01.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.982+0000 7f4025672740 1 --2- 172.21.15.63:0/1971568129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06ad7390 0x555f06ea0120 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.982+0000 7f4025672740 1 --2- 172.21.15.63:0/1971568129 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f06acf1b0 0x555f06e9fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.982+0000 7f4025672740 1 --2- 172.21.15.63:0/1971568129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06af8070 0x555f06e9f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.982+0000 7f4025672740 1 -- 172.21.15.63:0/1971568129 >> 172.21.15.63:0/1971568129 conn(0x555f06aec460 msgr2=0x555f06e9d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:01.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.982+0000 7f4025672740 1 -- 172.21.15.63:0/1971568129 shutdown_connections 2024-09-21T06:36:01.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.982+0000 7f4025672740 1 -- 172.21.15.63:0/1971568129 wait complete. 2024-09-21T06:36:01.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.983+0000 7f4025672740 1 -- start start 2024-09-21T06:36:01.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.983+0000 7f4025672740 1 Processor -- start 2024-09-21T06:36:01.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.983+0000 7f4025672740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06acf1b0 0x555f06eaad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.983+0000 7f4025672740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f06ad7390 0x555f06eab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.983+0000 7f4025672740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06af8070 0x555f06eb7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.983+0000 7f4025672740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555f06c66700 con 0x555f06acf1b0 2024-09-21T06:36:01.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.983+0000 7f4025672740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555f06da0160 con 0x555f06ad7390 2024-09-21T06:36:01.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.983+0000 7f4025672740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555f06eade80 con 0x555f06af8070 2024-09-21T06:36:01.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.983+0000 7f4025672740 10 client.0 _ll_register_callbacks cb 0x555f06db99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:01.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.983+0000 7f4017fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06acf1b0 0x555f06eaad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.983+0000 7f4017fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06acf1b0 0x555f06eaad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52930/0 (socket says 172.21.15.63:52930) 2024-09-21T06:36:01.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.983+0000 7f4017fff640 1 -- 172.21.15.63:0/841115232 learned_addr learned my addr 172.21.15.63:0/841115232 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:01.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.984+0000 7f4017fff640 1 --2- 172.21.15.63:0/841115232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06af8070 0x555f06eb7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.984+0000 7f401ce9a640 1 --2- 172.21.15.63:0/841115232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f06ad7390 0x555f06eab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.984+0000 7f4017fff640 1 -- 172.21.15.63:0/841115232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06af8070 msgr2=0x555f06eb7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:01.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.984+0000 7f4017fff640 1 --2- 172.21.15.63:0/841115232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06af8070 0x555f06eb7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.984+0000 7f4017fff640 1 -- 172.21.15.63:0/841115232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f06ad7390 msgr2=0x555f06eab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:01.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.984+0000 7f4017fff640 1 --2- 172.21.15.63:0/841115232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f06ad7390 0x555f06eab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.984+0000 7f4017fff640 1 -- 172.21.15.63:0/841115232 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f06dcdc90 con 0x555f06acf1b0 2024-09-21T06:36:01.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.984+0000 7f4017fff640 1 --2- 172.21.15.63:0/841115232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06acf1b0 0x555f06eaad60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f400c0058c0 tx=0x7f400c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f126d61e94e2c72 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:01.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.984+0000 7f3ff7fff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:01.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.984+0000 7f3ff7fff640 1 -- 172.21.15.63:0/841115232 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c027030 con 0x555f06acf1b0 2024-09-21T06:36:01.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.984+0000 7f3ff7fff640 1 -- 172.21.15.63:0/841115232 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7f400c011800 con 0x555f06acf1b0 2024-09-21T06:36:01.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.984+0000 7f4025672740 1 -- 172.21.15.63:0/841115232 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f400c011440 con 0x555f06acf1b0 2024-09-21T06:36:01.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.984+0000 7f3ff7fff640 1 -- 172.21.15.63:0/841115232 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f400c004020 con 0x555f06acf1b0 2024-09-21T06:36:01.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.984+0000 7f4025672740 10 client.17097 fetch_fsmap learned FSMap version 58 2024-09-21T06:36:01.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.984+0000 7f4025672740 1 -- 172.21.15.63:0/841115232 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x555f06eb9b60 con 0x555f06acf1b0 2024-09-21T06:36:01.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.985+0000 7f3ff7fff640 1 -- 172.21.15.63:0/841115232 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f400c011440 con 0x555f06acf1b0 2024-09-21T06:36:01.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.985+0000 7f3ff7fff640 1 -- 172.21.15.63:0/841115232 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 58) ==== 8374+0+0 (secure 0 0 0) 0x7f400c00ec30 con 0x555f06acf1b0 2024-09-21T06:36:01.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.985+0000 7f4025672740 10 client.17097 fetch_fsmap finished waiting for FSMap version 58 2024-09-21T06:36:01.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.985+0000 7f4025672740 10 client.17097 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:36:01.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.985+0000 7f4025672740 20 client.17097 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:01.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.985+0000 7f4025672740 1 --2- 172.21.15.63:0/841115232 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x555f06ab69f0 0x555f06ebcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.985+0000 7f4025672740 4 client.17097 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:01.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.985+0000 7f4025672740 1 -- 172.21.15.63:0/841115232 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f06e17df0 con 0x555f06ab69f0 2024-09-21T06:36:01.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.985+0000 7f401ce9a640 1 --2- 172.21.15.63:0/841115232 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x555f06ab69f0 0x555f06ebcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.986+0000 7f401ce9a640 1 --2- 172.21.15.63:0/841115232 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x555f06ab69f0 0x555f06ebcec0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a5cbbfda3014ba45 server_cookie=8d0e21d9016a2ff5 in_seq=0 out_seq=0 2024-09-21T06:36:01.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.986+0000 7f3ff7fff640 10 client.17097 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:36:01.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.987+0000 7f3ff7fff640 1 -- 172.21.15.63:0/841115232 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555f06e17df0 con 0x555f06ab69f0 2024-09-21T06:36:01.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.987+0000 7f3ff7fff640 10 client.17097 handle_command_reply: tid=0 2024-09-21T06:36:01.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.987+0000 7f4025672740 1 client.17097 shutdown 2024-09-21T06:36:01.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.987+0000 7f4025672740 1 -- 172.21.15.63:0/841115232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06acf1b0 msgr2=0x555f06eaad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:01.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.987+0000 7f4025672740 1 --2- 172.21.15.63:0/841115232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06acf1b0 0x555f06eaad60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f400c0058c0 tx=0x7f400c005850 comp rx=0 tx=0).stop 2024-09-21T06:36:01.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.987+0000 7f4025672740 1 -- 172.21.15.63:0/841115232 shutdown_connections 2024-09-21T06:36:01.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.987+0000 7f4025672740 1 --2- 172.21.15.63:0/841115232 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x555f06ab69f0 0x555f06ebcec0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.987+0000 7f4025672740 1 --2- 172.21.15.63:0/841115232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06af8070 0x555f06eb7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.987+0000 7f4025672740 1 --2- 172.21.15.63:0/841115232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f06ad7390 0x555f06eab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.987+0000 7f4025672740 1 --2- 172.21.15.63:0/841115232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06acf1b0 0x555f06eaad60 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.987+0000 7f4025672740 1 -- 172.21.15.63:0/841115232 >> 172.21.15.63:0/841115232 conn(0x555f06aec460 msgr2=0x555f06ea2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:02.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.987+0000 7f3ff7fff640 0 client.17097 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:36:02.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.987+0000 7f4025672740 1 -- 172.21.15.63:0/841115232 shutdown_connections 2024-09-21T06:36:02.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.987+0000 7f4025672740 1 -- 172.21.15.63:0/841115232 wait complete. 2024-09-21T06:36:02.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:01.987+0000 7f4025672740 20 client.17097 trim_cache size 0 max 16384 2024-09-21T06:36:02.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.000+0000 7f4025672740 1 Processor -- start 2024-09-21T06:36:02.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.000+0000 7f4025672740 1 -- start start 2024-09-21T06:36:02.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.001+0000 7f4025672740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f06acf1b0 0x555f06eacc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.001+0000 7f4025672740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06ad7390 0x555f06ea0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.001+0000 7f4025672740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06af8070 0x555f06e9cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.001+0000 7f4025672740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f40181b19b0 con 0x555f06af8070 2024-09-21T06:36:02.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.001+0000 7f4025672740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f40181b3520 con 0x555f06acf1b0 2024-09-21T06:36:02.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.001+0000 7f4025672740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f40181b2080 con 0x555f06ad7390 2024-09-21T06:36:02.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.001+0000 7f4017fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06af8070 0x555f06e9cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.001+0000 7f4017fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06af8070 0x555f06e9cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52932/0 (socket says 172.21.15.63:52932) 2024-09-21T06:36:02.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.001+0000 7f4017fff640 1 -- 172.21.15.63:0/692470926 learned_addr learned my addr 172.21.15.63:0/692470926 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:02.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.001+0000 7f4017fff640 1 --2- 172.21.15.63:0/692470926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f06acf1b0 0x555f06eacc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.001+0000 7f401ce9a640 1 --2- 172.21.15.63:0/692470926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06ad7390 0x555f06ea0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.001+0000 7f4017fff640 1 -- 172.21.15.63:0/692470926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06ad7390 msgr2=0x555f06ea0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:02.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.001+0000 7f4017fff640 1 --2- 172.21.15.63:0/692470926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06ad7390 0x555f06ea0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.001+0000 7f4017fff640 1 -- 172.21.15.63:0/692470926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f06acf1b0 msgr2=0x555f06eacc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:02.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.001+0000 7f4017fff640 1 --2- 172.21.15.63:0/692470926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f06acf1b0 0x555f06eacc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.001+0000 7f4017fff640 1 -- 172.21.15.63:0/692470926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f06ea9260 con 0x555f06af8070 2024-09-21T06:36:02.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.001+0000 7f401ce9a640 1 --2- 172.21.15.63:0/692470926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06ad7390 0x555f06ea0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:02.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.001+0000 7f4017fff640 1 --2- 172.21.15.63:0/692470926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06af8070 0x555f06e9cbc0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f400c003ac0 tx=0x7f400c005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb5bd66ac768f01 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:02.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.002+0000 7f3ffe7fc640 1 -- 172.21.15.63:0/692470926 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c027020 con 0x555f06af8070 2024-09-21T06:36:02.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.002+0000 7f3ffe7fc640 1 -- 172.21.15.63:0/692470926 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f400c011440 con 0x555f06af8070 2024-09-21T06:36:02.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.002+0000 7f3ffe7fc640 1 -- 172.21.15.63:0/692470926 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c00e720 con 0x555f06af8070 2024-09-21T06:36:02.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.002+0000 7f4025672740 1 -- 172.21.15.63:0/692470926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06af8070 msgr2=0x555f06e9cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:02.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.002+0000 7f4025672740 1 --2- 172.21.15.63:0/692470926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06af8070 0x555f06e9cbc0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f400c003ac0 tx=0x7f400c005b10 comp rx=0 tx=0).stop 2024-09-21T06:36:02.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.002+0000 7f4025672740 1 -- 172.21.15.63:0/692470926 shutdown_connections 2024-09-21T06:36:02.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.002+0000 7f4025672740 1 --2- 172.21.15.63:0/692470926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06af8070 0x555f06e9cbc0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.002+0000 7f4025672740 1 --2- 172.21.15.63:0/692470926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06ad7390 0x555f06ea0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.002+0000 7f4025672740 1 --2- 172.21.15.63:0/692470926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f06acf1b0 0x555f06eacc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.002+0000 7f4025672740 1 -- 172.21.15.63:0/692470926 >> 172.21.15.63:0/692470926 conn(0x555f06aec460 msgr2=0x555f06ea0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:02.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.002+0000 7f4025672740 1 -- 172.21.15.63:0/692470926 shutdown_connections 2024-09-21T06:36:02.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.002+0000 7f4025672740 1 -- 172.21.15.63:0/692470926 wait complete. 2024-09-21T06:36:02.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.003+0000 7f4025672740 1 -- start start 2024-09-21T06:36:02.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.003+0000 7f4025672740 1 Processor -- start 2024-09-21T06:36:02.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.003+0000 7f4025672740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06acf1b0 0x555f06ec0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.003+0000 7f4025672740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06ad7390 0x555f06ebda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.003+0000 7f4025672740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f06af8070 0x555f06ebdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.003+0000 7f4025672740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f40181b2e50 con 0x555f06acf1b0 2024-09-21T06:36:02.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.003+0000 7f4025672740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f40181b2780 con 0x555f06af8070 2024-09-21T06:36:02.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.003+0000 7f4025672740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f40181af9b0 con 0x555f06ad7390 2024-09-21T06:36:02.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.003+0000 7f4025672740 10 client.0 _ll_register_callbacks cb 0x7f4008009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:02.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.004+0000 7f4017fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06acf1b0 0x555f06ec0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.004+0000 7f4017fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06acf1b0 0x555f06ec0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52946/0 (socket says 172.21.15.63:52946) 2024-09-21T06:36:02.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.004+0000 7f4017fff640 1 -- 172.21.15.63:0/1325622506 learned_addr learned my addr 172.21.15.63:0/1325622506 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:02.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.004+0000 7f401ce9a640 1 --2- 172.21.15.63:0/1325622506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06ad7390 0x555f06ebda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.004+0000 7f4017fff640 1 -- 172.21.15.63:0/1325622506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06ad7390 msgr2=0x555f06ebda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:02.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.004+0000 7f4017fff640 1 --2- 172.21.15.63:0/1325622506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06ad7390 0x555f06ebda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.004+0000 7f4017fff640 1 -- 172.21.15.63:0/1325622506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f06af8070 msgr2=0x555f06ebdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:02.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.004+0000 7f4017fff640 1 --2- 172.21.15.63:0/1325622506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f06af8070 0x555f06ebdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.004+0000 7f4017fff640 1 -- 172.21.15.63:0/1325622506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f06ebe530 con 0x555f06acf1b0 2024-09-21T06:36:02.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.004+0000 7f4017fff640 1 --2- 172.21.15.63:0/1325622506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06acf1b0 0x555f06ec0510 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f400c003fc0 tx=0x7f400c00bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5893894319e457d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:02.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.004+0000 7f3ff7fff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:02.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.004+0000 7f3ff7fff640 1 -- 172.21.15.63:0/1325622506 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c027070 con 0x555f06acf1b0 2024-09-21T06:36:02.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.004+0000 7f3ff7fff640 1 -- 172.21.15.63:0/1325622506 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7f400c011a00 con 0x555f06acf1b0 2024-09-21T06:36:02.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.004+0000 7f4025672740 1 -- 172.21.15.63:0/1325622506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f400c011440 con 0x555f06acf1b0 2024-09-21T06:36:02.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.004+0000 7f3ff7fff640 1 -- 172.21.15.63:0/1325622506 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f400c046050 con 0x555f06acf1b0 2024-09-21T06:36:02.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.004+0000 7f4025672740 10 client.17103 fetch_fsmap learned FSMap version 58 2024-09-21T06:36:02.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.004+0000 7f4025672740 1 -- 172.21.15.63:0/1325622506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x555f06f27320 con 0x555f06acf1b0 2024-09-21T06:36:02.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.005+0000 7f3ff7fff640 1 -- 172.21.15.63:0/1325622506 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f400c011440 con 0x555f06acf1b0 2024-09-21T06:36:02.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.005+0000 7f3ff7fff640 1 -- 172.21.15.63:0/1325622506 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 58) ==== 8374+0+0 (secure 0 0 0) 0x7f400c034480 con 0x555f06acf1b0 2024-09-21T06:36:02.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.005+0000 7f4025672740 10 client.17103 fetch_fsmap finished waiting for FSMap version 58 2024-09-21T06:36:02.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.005+0000 7f4025672740 10 client.17103 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:36:02.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.005+0000 7f4025672740 20 client.17103 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:02.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.005+0000 7f4025672740 1 --2- 172.21.15.63:0/1325622506 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x555f06a8bda0 0x555f06f29a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.005+0000 7f4025672740 4 client.17103 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:36:02.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.005+0000 7f4025672740 1 -- 172.21.15.63:0/1325622506 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555f06eab650 con 0x555f06a8bda0 2024-09-21T06:36:02.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.005+0000 7f401ce9a640 1 --2- 172.21.15.63:0/1325622506 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x555f06a8bda0 0x555f06f29a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.006+0000 7f3ff7fff640 10 client.17103 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:36:02.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.006+0000 7f401ce9a640 1 --2- 172.21.15.63:0/1325622506 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x555f06a8bda0 0x555f06f29a40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=53978441b27b5d6c server_cookie=deef5bf66d432deb in_seq=0 out_seq=0 2024-09-21T06:36:02.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.006+0000 7f3ff7fff640 1 -- 172.21.15.63:0/1325622506 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555f06eab650 con 0x555f06a8bda0 2024-09-21T06:36:02.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.006+0000 7f3ff7fff640 10 client.17103 handle_command_reply: tid=0 2024-09-21T06:36:02.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.006+0000 7f4025672740 1 client.17103 shutdown 2024-09-21T06:36:02.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.006+0000 7f4025672740 1 -- 172.21.15.63:0/1325622506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06acf1b0 msgr2=0x555f06ec0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:02.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.006+0000 7f4025672740 1 --2- 172.21.15.63:0/1325622506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06acf1b0 0x555f06ec0510 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f400c003fc0 tx=0x7f400c00bb00 comp rx=0 tx=0).stop 2024-09-21T06:36:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.006+0000 7f4025672740 1 -- 172.21.15.63:0/1325622506 shutdown_connections 2024-09-21T06:36:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.006+0000 7f4025672740 1 --2- 172.21.15.63:0/1325622506 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x555f06a8bda0 0x555f06f29a40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.006+0000 7f4025672740 1 --2- 172.21.15.63:0/1325622506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f06af8070 0x555f06ebdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.006+0000 7f4025672740 1 --2- 172.21.15.63:0/1325622506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f06ad7390 0x555f06ebda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.006+0000 7f4025672740 1 --2- 172.21.15.63:0/1325622506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f06acf1b0 0x555f06ec0510 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.006+0000 7f3ff7fff640 0 client.17103 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:36:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.006+0000 7f4025672740 1 -- 172.21.15.63:0/1325622506 >> 172.21.15.63:0/1325622506 conn(0x555f06aec460 msgr2=0x555f06eacae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.006+0000 7f4025672740 1 -- 172.21.15.63:0/1325622506 shutdown_connections 2024-09-21T06:36:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.006+0000 7f4025672740 1 -- 172.21.15.63:0/1325622506 wait complete. 2024-09-21T06:36:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.006+0000 7f4025672740 20 client.17103 trim_cache size 0 max 16384 2024-09-21T06:36:02.016 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:36:02.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.007+0000 7f401f0fe640 1 -- 172.21.15.63:0/3454568571 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f40000b6680 msgr2=0x7f40000b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:02.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.007+0000 7f401f0fe640 1 --2- 172.21.15.63:0/3454568571 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f40000b6680 0x7f40000b8b90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4010004fa0 tx=0x7f401007a370 comp rx=0 tx=0).stop 2024-09-21T06:36:02.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.007+0000 7f401f0fe640 1 -- 172.21.15.63:0/3454568571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f401810de10 msgr2=0x7f4018103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:02.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.007+0000 7f401f0fe640 1 --2- 172.21.15.63:0/3454568571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f401810de10 0x7f4018103170 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f401000eaa0 tx=0x7f401000ef60 comp rx=0 tx=0).stop 2024-09-21T06:36:02.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.007+0000 7f401f0fe640 1 -- 172.21.15.63:0/3454568571 shutdown_connections 2024-09-21T06:36:02.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.007+0000 7f401f0fe640 1 --2- 172.21.15.63:0/3454568571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f401810de10 0x7f4018103170 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.007+0000 7f401f0fe640 1 --2- 172.21.15.63:0/3454568571 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f40000b6680 0x7f40000b8b90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.007+0000 7f401f0fe640 1 --2- 172.21.15.63:0/3454568571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4018105300 0x7f4018102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.007+0000 7f401f0fe640 1 --2- 172.21.15.63:0/3454568571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40181049b0 0x7f40181026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.007+0000 7f401f0fe640 1 -- 172.21.15.63:0/3454568571 >> 172.21.15.63:0/3454568571 conn(0x7f4018079730 msgr2=0x7f40180ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:02.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.007+0000 7f401f0fe640 1 -- 172.21.15.63:0/3454568571 shutdown_connections 2024-09-21T06:36:02.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:02.007+0000 7f401f0fe640 1 -- 172.21.15.63:0/3454568571 wait complete. 2024-09-21T06:36:02.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:02 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:36:02.718 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:36:02.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:02 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:36:02.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:02 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:36:02.975 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:03.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.477+0000 7fecf9041640 1 -- 172.21.15.63:0/2284889056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecf4103b60 msgr2=0x7fecf4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:03.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.477+0000 7fecf9041640 1 --2- 172.21.15.63:0/2284889056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecf4103b60 0x7fecf4103f70 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fecec009900 tx=0x7fecec02a410 comp rx=0 tx=0).stop 2024-09-21T06:36:03.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.477+0000 7fecf9041640 1 -- 172.21.15.63:0/2284889056 shutdown_connections 2024-09-21T06:36:03.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.477+0000 7fecf9041640 1 --2- 172.21.15.63:0/2284889056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecf4109df0 0x7fecf4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.477+0000 7fecf9041640 1 --2- 172.21.15.63:0/2284889056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf41094a0 0x7fecf41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.477+0000 7fecf9041640 1 --2- 172.21.15.63:0/2284889056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecf4103b60 0x7fecf4103f70 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.477+0000 7fecf9041640 1 -- 172.21.15.63:0/2284889056 >> 172.21.15.63:0/2284889056 conn(0x7fecf407b850 msgr2=0x7fecf407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:03.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.477+0000 7fecf9041640 1 -- 172.21.15.63:0/2284889056 shutdown_connections 2024-09-21T06:36:03.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.477+0000 7fecf9041640 1 -- 172.21.15.63:0/2284889056 wait complete. 2024-09-21T06:36:03.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.478+0000 7fecf9041640 1 Processor -- start 2024-09-21T06:36:03.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.478+0000 7fecf9041640 1 -- start start 2024-09-21T06:36:03.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.478+0000 7fecf9041640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecf4103b60 0x7fecf419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.478+0000 7fecf9041640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf41094a0 0x7fecf419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.478+0000 7fecf9041640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecf4109df0 0x7fecf419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.478+0000 7fecf9041640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fecf4113ab0 con 0x7fecf4109df0 2024-09-21T06:36:03.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.478+0000 7fecf9041640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fecf4113930 con 0x7fecf4103b60 2024-09-21T06:36:03.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.478+0000 7fecf9041640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fecf4113c30 con 0x7fecf41094a0 2024-09-21T06:36:03.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.478+0000 7fecf359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecf4109df0 0x7fecf419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.478+0000 7fecf359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecf4109df0 0x7fecf419fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52958/0 (socket says 172.21.15.63:52958) 2024-09-21T06:36:03.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.478+0000 7fecf359e640 1 -- 172.21.15.63:0/1784015267 learned_addr learned my addr 172.21.15.63:0/1784015267 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:03.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.478+0000 7fecf259c640 1 --2- 172.21.15.63:0/1784015267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf41094a0 0x7fecf419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.479+0000 7fecf2d9d640 1 --2- 172.21.15.63:0/1784015267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecf4103b60 0x7fecf419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.479+0000 7fecf359e640 1 -- 172.21.15.63:0/1784015267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf41094a0 msgr2=0x7fecf419aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:03.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.479+0000 7fecf359e640 1 --2- 172.21.15.63:0/1784015267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf41094a0 0x7fecf419aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.479+0000 7fecf359e640 1 -- 172.21.15.63:0/1784015267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecf4103b60 msgr2=0x7fecf419a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:03.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.479+0000 7fecf359e640 1 --2- 172.21.15.63:0/1784015267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecf4103b60 0x7fecf419a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.479+0000 7fecf359e640 1 -- 172.21.15.63:0/1784015267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf41a0490 con 0x7fecf4109df0 2024-09-21T06:36:03.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.479+0000 7fecf2d9d640 1 --2- 172.21.15.63:0/1784015267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecf4103b60 0x7fecf419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:03.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.479+0000 7fecf359e640 1 --2- 172.21.15.63:0/1784015267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecf4109df0 0x7fecf419fd60 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fece4009fd0 tx=0x7fece400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:03.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.479+0000 7fecebfff640 1 -- 172.21.15.63:0/1784015267 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4017070 con 0x7fecf4109df0 2024-09-21T06:36:03.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.479+0000 7fecf9041640 1 -- 172.21.15.63:0/1784015267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf41a0780 con 0x7fecf4109df0 2024-09-21T06:36:03.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.479+0000 7fecebfff640 1 -- 172.21.15.63:0/1784015267 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fece4003e20 con 0x7fecf4109df0 2024-09-21T06:36:03.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.479+0000 7fecebfff640 1 -- 172.21.15.63:0/1784015267 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4010460 con 0x7fecf4109df0 2024-09-21T06:36:03.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.479+0000 7fecf9041640 1 -- 172.21.15.63:0/1784015267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf41a6ee0 con 0x7fecf4109df0 2024-09-21T06:36:03.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.482+0000 7fecff5b5740 1 Processor -- start 2024-09-21T06:36:03.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.482+0000 7fecebfff640 1 -- 172.21.15.63:0/1784015267 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fece4003970 con 0x7fecf4109df0 2024-09-21T06:36:03.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.483+0000 7fecff5b5740 1 -- start start 2024-09-21T06:36:03.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.483+0000 7fecff5b5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556675323070 0x5566756ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.483+0000 7fecff5b5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5566752fa1b0 0x5566756cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.483+0000 7fecff5b5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675302390 0x5566756cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.483+0000 7fecff5b5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x556675640ea0 con 0x5566752fa1b0 2024-09-21T06:36:03.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.483+0000 7fecff5b5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5566756302d0 con 0x556675302390 2024-09-21T06:36:03.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.483+0000 7fecff5b5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5566756340e0 con 0x556675323070 2024-09-21T06:36:03.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.483+0000 7fecf2d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5566752fa1b0 0x5566756cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.483+0000 7fecf2d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5566752fa1b0 0x5566756cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52972/0 (socket says 172.21.15.63:52972) 2024-09-21T06:36:03.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.483+0000 7fecf2d9d640 1 -- 172.21.15.63:0/3901519673 learned_addr learned my addr 172.21.15.63:0/3901519673 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:03.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.483+0000 7fecf259c640 1 --2- 172.21.15.63:0/3901519673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556675323070 0x5566756ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.483+0000 7fecf259c640 1 --2- 172.21.15.63:0/3901519673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675302390 0x5566756cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.484+0000 7fecf259c640 1 -- 172.21.15.63:0/3901519673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675302390 msgr2=0x5566756cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.484+0000 7fecf259c640 1 --2- 172.21.15.63:0/3901519673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675302390 0x5566756cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.484+0000 7fecf259c640 1 -- 172.21.15.63:0/3901519673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5566752fa1b0 msgr2=0x5566756cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.484+0000 7fecf259c640 1 --2- 172.21.15.63:0/3901519673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5566752fa1b0 0x5566756cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.484+0000 7fecf259c640 1 -- 172.21.15.63:0/3901519673 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55667538e650 con 0x556675323070 2024-09-21T06:36:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.484+0000 7fecf2d9d640 1 --2- 172.21.15.63:0/3901519673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5566752fa1b0 0x5566756cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.484+0000 7fecebfff640 1 --2- 172.21.15.63:0/1784015267 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fece00b6680 0x7fece00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.484+0000 7fecf259c640 1 --2- 172.21.15.63:0/3901519673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556675323070 0x5566756ca6a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fecf41064c0 tx=0x7fecdc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e8cb816d6e369d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.484+0000 7fecf2d9d640 1 --2- 172.21.15.63:0/1784015267 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fece00b6680 0x7fece00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.484+0000 7fecebfff640 1 -- 172.21.15.63:0/1784015267 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7fece40e7490 con 0x7fecf4109df0 2024-09-21T06:36:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.484+0000 7fece97fa640 1 -- 172.21.15.63:0/3901519673 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc004050 con 0x556675323070 2024-09-21T06:36:03.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.484+0000 7fece97fa640 1 -- 172.21.15.63:0/3901519673 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecdc00fc40 con 0x556675323070 2024-09-21T06:36:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.484+0000 7fece97fa640 1 -- 172.21.15.63:0/3901519673 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc003880 con 0x556675323070 2024-09-21T06:36:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.485+0000 7fecff5b5740 1 -- 172.21.15.63:0/3901519673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556675323070 msgr2=0x5566756ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.485+0000 7fecf2d9d640 1 --2- 172.21.15.63:0/1784015267 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fece00b6680 0x7fece00b8b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x5566756c9320 tx=0x7fecec0058b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.485+0000 7fecff5b5740 1 --2- 172.21.15.63:0/3901519673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556675323070 0x5566756ca6a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fecf41064c0 tx=0x7fecdc004730 comp rx=0 tx=0).stop 2024-09-21T06:36:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.485+0000 7fecff5b5740 1 -- 172.21.15.63:0/3901519673 shutdown_connections 2024-09-21T06:36:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.485+0000 7fecff5b5740 1 --2- 172.21.15.63:0/3901519673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675302390 0x5566756cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.485+0000 7fecff5b5740 1 --2- 172.21.15.63:0/3901519673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5566752fa1b0 0x5566756cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.485+0000 7fecff5b5740 1 --2- 172.21.15.63:0/3901519673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556675323070 0x5566756ca6a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.485+0000 7fecff5b5740 1 -- 172.21.15.63:0/3901519673 >> 172.21.15.63:0/3901519673 conn(0x556675317460 msgr2=0x5566756c8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.485+0000 7fecff5b5740 1 -- 172.21.15.63:0/3901519673 shutdown_connections 2024-09-21T06:36:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.486+0000 7fecff5b5740 1 -- 172.21.15.63:0/3901519673 wait complete. 2024-09-21T06:36:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.486+0000 7fecff5b5740 1 -- start start 2024-09-21T06:36:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.486+0000 7fecff5b5740 1 Processor -- start 2024-09-21T06:36:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.486+0000 7fecff5b5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566752fa1b0 0x5566756d5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.486+0000 7fecff5b5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675302390 0x5566756d6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.486+0000 7fecff5b5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556675323070 0x5566756e21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.486+0000 7fecff5b5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x556675491700 con 0x556675323070 2024-09-21T06:36:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.486+0000 7fecff5b5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5566755cb160 con 0x556675302390 2024-09-21T06:36:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.486+0000 7fecff5b5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5566756d8e80 con 0x5566752fa1b0 2024-09-21T06:36:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.486+0000 7fecff5b5740 10 client.0 _ll_register_callbacks cb 0x5566755e49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.486+0000 7fecf359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556675323070 0x5566756e21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.486+0000 7fecf359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556675323070 0x5566756e21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52986/0 (socket says 172.21.15.63:52986) 2024-09-21T06:36:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.486+0000 7fecf359e640 1 -- 172.21.15.63:0/1170388016 learned_addr learned my addr 172.21.15.63:0/1170388016 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.487+0000 7fecf2d9d640 1 --2- 172.21.15.63:0/1170388016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566752fa1b0 0x5566756d5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.487+0000 7fecf259c640 1 --2- 172.21.15.63:0/1170388016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675302390 0x5566756d6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.487+0000 7fecf359e640 1 -- 172.21.15.63:0/1170388016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566752fa1b0 msgr2=0x5566756d5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.487+0000 7fecf359e640 1 --2- 172.21.15.63:0/1170388016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566752fa1b0 0x5566756d5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.487+0000 7fecf359e640 1 -- 172.21.15.63:0/1170388016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675302390 msgr2=0x5566756d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.487+0000 7fecf359e640 1 --2- 172.21.15.63:0/1170388016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675302390 0x5566756d6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.487+0000 7fecf359e640 1 -- 172.21.15.63:0/1170388016 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566755f8c90 con 0x556675323070 2024-09-21T06:36:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.487+0000 7fecf259c640 1 --2- 172.21.15.63:0/1170388016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675302390 0x5566756d6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.487+0000 7fecf359e640 1 --2- 172.21.15.63:0/1170388016 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556675323070 0x5566756e21a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fece40aa500 tx=0x7fece40acbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e0d538c01dedf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.487+0000 7fecda7fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.487+0000 7fecda7fc640 1 -- 172.21.15.63:0/1170388016 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4020040 con 0x556675323070 2024-09-21T06:36:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.487+0000 7fecda7fc640 1 -- 172.21.15.63:0/1170388016 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7fece40a8de0 con 0x556675323070 2024-09-21T06:36:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.487+0000 7fecff5b5740 1 -- 172.21.15.63:0/1170388016 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecdc00fc40 con 0x556675323070 2024-09-21T06:36:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.487+0000 7fecda7fc640 1 -- 172.21.15.63:0/1170388016 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7fece4003c60 con 0x556675323070 2024-09-21T06:36:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.487+0000 7fecff5b5740 10 client.17115 fetch_fsmap learned FSMap version 58 2024-09-21T06:36:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.487+0000 7fecff5b5740 1 -- 172.21.15.63:0/1170388016 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x5566756e4bf0 con 0x556675323070 2024-09-21T06:36:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.488+0000 7fecda7fc640 1 -- 172.21.15.63:0/1170388016 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecdc00fc40 con 0x556675323070 2024-09-21T06:36:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.488+0000 7fecda7fc640 1 -- 172.21.15.63:0/1170388016 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 58) ==== 8374+0+0 (secure 0 0 0) 0x7fece4098260 con 0x556675323070 2024-09-21T06:36:03.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.488+0000 7fecff5b5740 10 client.17115 fetch_fsmap finished waiting for FSMap version 58 2024-09-21T06:36:03.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.488+0000 7fecff5b5740 10 client.17115 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:36:03.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.488+0000 7fecff5b5740 20 client.17115 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:03.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.488+0000 7fecff5b5740 1 --2- 172.21.15.63:0/1170388016 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5566752e19f0 0x5566756e8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.488+0000 7fecff5b5740 4 client.17115 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:03.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.488+0000 7fecff5b5740 1 -- 172.21.15.63:0/1170388016 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556675642df0 con 0x5566752e19f0 2024-09-21T06:36:03.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.488+0000 7fecf2d9d640 1 --2- 172.21.15.63:0/1170388016 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5566752e19f0 0x5566756e8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.489+0000 7fecf2d9d640 1 --2- 172.21.15.63:0/1170388016 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5566752e19f0 0x5566756e8410 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9c32d47e297093d5 server_cookie=672e8cfaa59c2bf in_seq=0 out_seq=0 2024-09-21T06:36:03.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.489+0000 7fecda7fc640 10 client.17115 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:36:03.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.489+0000 7fecda7fc640 1 -- 172.21.15.63:0/1170388016 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556675642df0 con 0x5566752e19f0 2024-09-21T06:36:03.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.489+0000 7fecda7fc640 10 client.17115 handle_command_reply: tid=0 2024-09-21T06:36:03.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.490+0000 7fecff5b5740 1 client.17115 shutdown 2024-09-21T06:36:03.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.490+0000 7fecff5b5740 1 -- 172.21.15.63:0/1170388016 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556675323070 msgr2=0x5566756e21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:03.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.490+0000 7fecff5b5740 1 --2- 172.21.15.63:0/1170388016 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556675323070 0x5566756e21a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fece40aa500 tx=0x7fece40acbe0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.490+0000 7fecff5b5740 1 -- 172.21.15.63:0/1170388016 shutdown_connections 2024-09-21T06:36:03.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.490+0000 7fecff5b5740 1 --2- 172.21.15.63:0/1170388016 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556675323070 0x5566756e21a0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.490+0000 7fecff5b5740 1 --2- 172.21.15.63:0/1170388016 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5566752e19f0 0x5566756e8410 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.490+0000 7fecff5b5740 1 --2- 172.21.15.63:0/1170388016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675302390 0x5566756d6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.490+0000 7fecff5b5740 1 --2- 172.21.15.63:0/1170388016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566752fa1b0 0x5566756d5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.490+0000 7fecff5b5740 1 -- 172.21.15.63:0/1170388016 >> 172.21.15.63:0/1170388016 conn(0x556675317460 msgr2=0x5566756cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:03.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.490+0000 7fecda7fc640 0 client.17115 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:36:03.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.490+0000 7fecff5b5740 1 -- 172.21.15.63:0/1170388016 shutdown_connections 2024-09-21T06:36:03.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.490+0000 7fecff5b5740 1 -- 172.21.15.63:0/1170388016 wait complete. 2024-09-21T06:36:03.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.490+0000 7fecff5b5740 20 client.17115 trim_cache size 0 max 16384 2024-09-21T06:36:03.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.503+0000 7fecff5b5740 1 Processor -- start 2024-09-21T06:36:03.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.503+0000 7fecff5b5740 1 -- start start 2024-09-21T06:36:03.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.504+0000 7fecff5b5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566752fa1b0 0x5566756cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.504+0000 7fecff5b5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675302390 0x5566756e2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.504+0000 7fecff5b5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556675323070 0x5566756c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.504+0000 7fecff5b5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fecf41af870 con 0x556675323070 2024-09-21T06:36:03.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.504+0000 7fecff5b5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fecf41b13e0 con 0x556675302390 2024-09-21T06:36:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.504+0000 7fecff5b5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fecf41aff40 con 0x5566752fa1b0 2024-09-21T06:36:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.504+0000 7fecf359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556675323070 0x5566756c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.504+0000 7fecf359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556675323070 0x5566756c7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52996/0 (socket says 172.21.15.63:52996) 2024-09-21T06:36:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.504+0000 7fecf359e640 1 -- 172.21.15.63:0/2506715533 learned_addr learned my addr 172.21.15.63:0/2506715533 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.504+0000 7fecf2d9d640 1 --2- 172.21.15.63:0/2506715533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566752fa1b0 0x5566756cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.504+0000 7fecf259c640 1 --2- 172.21.15.63:0/2506715533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675302390 0x5566756e2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.504+0000 7fecf359e640 1 -- 172.21.15.63:0/2506715533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566752fa1b0 msgr2=0x5566756cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.504+0000 7fecf359e640 1 --2- 172.21.15.63:0/2506715533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566752fa1b0 0x5566756cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.504+0000 7fecf359e640 1 -- 172.21.15.63:0/2506715533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675302390 msgr2=0x5566756e2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.504+0000 7fecf359e640 1 --2- 172.21.15.63:0/2506715533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675302390 0x5566756e2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.504+0000 7fecf359e640 1 -- 172.21.15.63:0/2506715533 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566756ccbc0 con 0x556675323070 2024-09-21T06:36:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.504+0000 7fecf259c640 1 --2- 172.21.15.63:0/2506715533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675302390 0x5566756e2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.504+0000 7fecf359e640 1 --2- 172.21.15.63:0/2506715533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556675323070 0x5566756c7eb0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fece400dfd0 tx=0x7fece40e7420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a0f73b610d5c0f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.504+0000 7fece8ff9640 1 -- 172.21.15.63:0/2506715533 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4014070 con 0x556675323070 2024-09-21T06:36:03.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.505+0000 7fece8ff9640 1 -- 172.21.15.63:0/2506715533 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fece40acda0 con 0x556675323070 2024-09-21T06:36:03.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.505+0000 7fece8ff9640 1 -- 172.21.15.63:0/2506715533 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4020070 con 0x556675323070 2024-09-21T06:36:03.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.505+0000 7fecff5b5740 1 -- 172.21.15.63:0/2506715533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556675323070 msgr2=0x5566756c7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:03.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.505+0000 7fecff5b5740 1 --2- 172.21.15.63:0/2506715533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556675323070 0x5566756c7eb0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fece400dfd0 tx=0x7fece40e7420 comp rx=0 tx=0).stop 2024-09-21T06:36:03.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.505+0000 7fecff5b5740 1 -- 172.21.15.63:0/2506715533 shutdown_connections 2024-09-21T06:36:03.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.505+0000 7fecff5b5740 1 --2- 172.21.15.63:0/2506715533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556675323070 0x5566756c7eb0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.505+0000 7fecff5b5740 1 --2- 172.21.15.63:0/2506715533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675302390 0x5566756e2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.505+0000 7fecff5b5740 1 --2- 172.21.15.63:0/2506715533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566752fa1b0 0x5566756cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.505+0000 7fecff5b5740 1 -- 172.21.15.63:0/2506715533 >> 172.21.15.63:0/2506715533 conn(0x556675317460 msgr2=0x5566756cd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:03.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.505+0000 7fecff5b5740 1 -- 172.21.15.63:0/2506715533 shutdown_connections 2024-09-21T06:36:03.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.505+0000 7fecff5b5740 1 -- 172.21.15.63:0/2506715533 wait complete. 2024-09-21T06:36:03.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.506+0000 7fecff5b5740 1 -- start start 2024-09-21T06:36:03.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.506+0000 7fecff5b5740 1 Processor -- start 2024-09-21T06:36:03.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.506+0000 7fecff5b5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5566752fa1b0 0x5566756e8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.506+0000 7fecff5b5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556675302390 0x5566756e9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.506+0000 7fecff5b5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675323070 0x556675749d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.506+0000 7fecff5b5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fecf41b0d10 con 0x5566752fa1b0 2024-09-21T06:36:03.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.506+0000 7fecff5b5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fecf41b0640 con 0x556675323070 2024-09-21T06:36:03.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.506+0000 7fecff5b5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fecf41ad870 con 0x556675302390 2024-09-21T06:36:03.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.506+0000 7fecff5b5740 10 client.0 _ll_register_callbacks cb 0x7fece4004380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:03.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.506+0000 7fecf2d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5566752fa1b0 0x5566756e8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.506+0000 7fecf2d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5566752fa1b0 0x5566756e8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53006/0 (socket says 172.21.15.63:53006) 2024-09-21T06:36:03.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.506+0000 7fecf2d9d640 1 -- 172.21.15.63:0/3119324808 learned_addr learned my addr 172.21.15.63:0/3119324808 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:03.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.507+0000 7fecf259c640 1 --2- 172.21.15.63:0/3119324808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556675302390 0x5566756e9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.507+0000 7fecf359e640 1 --2- 172.21.15.63:0/3119324808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675323070 0x556675749d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.507+0000 7fecf2d9d640 1 -- 172.21.15.63:0/3119324808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556675302390 msgr2=0x5566756e9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:03.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.507+0000 7fecf2d9d640 1 --2- 172.21.15.63:0/3119324808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556675302390 0x5566756e9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.507+0000 7fecf2d9d640 1 -- 172.21.15.63:0/3119324808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675323070 msgr2=0x556675749d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:03.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.507+0000 7fecf2d9d640 1 --2- 172.21.15.63:0/3119324808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675323070 0x556675749d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.507+0000 7fecf2d9d640 1 -- 172.21.15.63:0/3119324808 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55667574a370 con 0x5566752fa1b0 2024-09-21T06:36:03.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.507+0000 7fecf2d9d640 1 --2- 172.21.15.63:0/3119324808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5566752fa1b0 0x5566756e8f70 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fecec031440 tx=0x7fecec009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ec3562559c524e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:03.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.507+0000 7fecda7fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:03.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.507+0000 7fecda7fc640 1 -- 172.21.15.63:0/3119324808 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec035040 con 0x5566752fa1b0 2024-09-21T06:36:03.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.507+0000 7fecda7fc640 1 -- 172.21.15.63:0/3119324808 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7fecec005240 con 0x5566752fa1b0 2024-09-21T06:36:03.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.507+0000 7fecff5b5740 1 -- 172.21.15.63:0/3119324808 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fece40acda0 con 0x5566752fa1b0 2024-09-21T06:36:03.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.507+0000 7fecda7fc640 1 -- 172.21.15.63:0/3119324808 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7fecec05f050 con 0x5566752fa1b0 2024-09-21T06:36:03.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.507+0000 7fecff5b5740 10 client.17121 fetch_fsmap learned FSMap version 58 2024-09-21T06:36:03.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.507+0000 7fecff5b5740 1 -- 172.21.15.63:0/3119324808 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x556675752860 con 0x5566752fa1b0 2024-09-21T06:36:03.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.508+0000 7fecda7fc640 1 -- 172.21.15.63:0/3119324808 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fece40acda0 con 0x5566752fa1b0 2024-09-21T06:36:03.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.508+0000 7fecda7fc640 1 -- 172.21.15.63:0/3119324808 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 58) ==== 8374+0+0 (secure 0 0 0) 0x7fecec0035f0 con 0x5566752fa1b0 2024-09-21T06:36:03.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.508+0000 7fecff5b5740 10 client.17121 fetch_fsmap finished waiting for FSMap version 58 2024-09-21T06:36:03.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.508+0000 7fecff5b5740 10 client.17121 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:36:03.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.508+0000 7fecff5b5740 20 client.17121 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:03.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.508+0000 7fecff5b5740 1 --2- 172.21.15.63:0/3119324808 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5566752b6da0 0x556675755080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.508+0000 7fecff5b5740 4 client.17121 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:36:03.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.508+0000 7fecff5b5740 1 -- 172.21.15.63:0/3119324808 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55667563e8a0 con 0x5566752b6da0 2024-09-21T06:36:03.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.508+0000 7fecf259c640 1 --2- 172.21.15.63:0/3119324808 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5566752b6da0 0x556675755080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.508+0000 7fecf259c640 1 --2- 172.21.15.63:0/3119324808 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5566752b6da0 0x556675755080 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=446e589d3f3f412c server_cookie=fe067682bc872192 in_seq=0 out_seq=0 2024-09-21T06:36:03.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.508+0000 7fecda7fc640 10 client.17121 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:36:03.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.509+0000 7fecda7fc640 1 -- 172.21.15.63:0/3119324808 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55667563e8a0 con 0x5566752b6da0 2024-09-21T06:36:03.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.509+0000 7fecda7fc640 10 client.17121 handle_command_reply: tid=0 2024-09-21T06:36:03.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.509+0000 7fecff5b5740 1 client.17121 shutdown 2024-09-21T06:36:03.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.509+0000 7fecff5b5740 1 -- 172.21.15.63:0/3119324808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5566752fa1b0 msgr2=0x5566756e8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:03.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.509+0000 7fecff5b5740 1 --2- 172.21.15.63:0/3119324808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5566752fa1b0 0x5566756e8f70 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fecec031440 tx=0x7fecec009260 comp rx=0 tx=0).stop 2024-09-21T06:36:03.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.509+0000 7fecff5b5740 1 -- 172.21.15.63:0/3119324808 shutdown_connections 2024-09-21T06:36:03.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.509+0000 7fecff5b5740 1 --2- 172.21.15.63:0/3119324808 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5566752b6da0 0x556675755080 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.509+0000 7fecff5b5740 1 --2- 172.21.15.63:0/3119324808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556675323070 0x556675749d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.509+0000 7fecff5b5740 1 --2- 172.21.15.63:0/3119324808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556675302390 0x5566756e9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.509+0000 7fecda7fc640 0 client.17121 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:36:03.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.509+0000 7fecff5b5740 1 --2- 172.21.15.63:0/3119324808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5566752fa1b0 0x5566756e8f70 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.509+0000 7fecff5b5740 1 -- 172.21.15.63:0/3119324808 >> 172.21.15.63:0/3119324808 conn(0x556675317460 msgr2=0x5566756c7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:03.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.509+0000 7fecff5b5740 1 -- 172.21.15.63:0/3119324808 shutdown_connections 2024-09-21T06:36:03.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.509+0000 7fecff5b5740 1 -- 172.21.15.63:0/3119324808 wait complete. 2024-09-21T06:36:03.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.509+0000 7fecff5b5740 20 client.17121 trim_cache size 0 max 16384 2024-09-21T06:36:03.519 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:36:03.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.510+0000 7fecf9041640 1 -- 172.21.15.63:0/1784015267 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fece00b6680 msgr2=0x7fece00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:03.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.510+0000 7fecf9041640 1 --2- 172.21.15.63:0/1784015267 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fece00b6680 0x7fece00b8b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x5566756c9320 tx=0x7fecec0058b0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.510+0000 7fecf9041640 1 -- 172.21.15.63:0/1784015267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecf4109df0 msgr2=0x7fecf419fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:03.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.510+0000 7fecf9041640 1 --2- 172.21.15.63:0/1784015267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecf4109df0 0x7fecf419fd60 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fece4009fd0 tx=0x7fece400b260 comp rx=0 tx=0).stop 2024-09-21T06:36:03.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.510+0000 7fecf9041640 1 -- 172.21.15.63:0/1784015267 shutdown_connections 2024-09-21T06:36:03.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.510+0000 7fecf9041640 1 --2- 172.21.15.63:0/1784015267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecf4109df0 0x7fecf419fd60 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.510+0000 7fecf9041640 1 --2- 172.21.15.63:0/1784015267 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fece00b6680 0x7fece00b8b90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.510+0000 7fecf9041640 1 --2- 172.21.15.63:0/1784015267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf41094a0 0x7fecf419aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.510+0000 7fecf9041640 1 --2- 172.21.15.63:0/1784015267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecf4103b60 0x7fecf419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.510+0000 7fecf9041640 1 -- 172.21.15.63:0/1784015267 >> 172.21.15.63:0/1784015267 conn(0x7fecf407b850 msgr2=0x7fecf41075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:03.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.510+0000 7fecf9041640 1 -- 172.21.15.63:0/1784015267 shutdown_connections 2024-09-21T06:36:03.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:03.510+0000 7fecf9041640 1 -- 172.21.15.63:0/1784015267 wait complete. 2024-09-21T06:36:03.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:03 smithi071 ceph-mon[34844]: pgmap v560: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T06:36:03.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:03 smithi063 ceph-mon[31150]: pgmap v560: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T06:36:03.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:03 smithi175 ceph-mon[34510]: pgmap v560: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T06:36:04.253 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:36:04.511 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:05.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.994+0000 7f94ecee1640 1 -- 172.21.15.63:0/367758417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94e8108d10 msgr2=0x7f94e810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:05.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.994+0000 7f94ecee1640 1 --2- 172.21.15.63:0/367758417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94e8108d10 0x7f94e810f540 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f94e0009ca0 tx=0x7f94e002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.994+0000 7f94ecee1640 1 -- 172.21.15.63:0/367758417 shutdown_connections 2024-09-21T06:36:05.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.994+0000 7f94ecee1640 1 --2- 172.21.15.63:0/367758417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94e8108d10 0x7f94e810f540 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.994+0000 7f94ecee1640 1 --2- 172.21.15.63:0/367758417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94e81083c0 0x7f94e81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.994+0000 7f94ecee1640 1 --2- 172.21.15.63:0/367758417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94e8102a80 0x7f94e8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.994+0000 7f94ecee1640 1 -- 172.21.15.63:0/367758417 >> 172.21.15.63:0/367758417 conn(0x7f94e8079740 msgr2=0x7f94e8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.994+0000 7f94ecee1640 1 -- 172.21.15.63:0/367758417 shutdown_connections 2024-09-21T06:36:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.994+0000 7f94ecee1640 1 -- 172.21.15.63:0/367758417 wait complete. 2024-09-21T06:36:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.995+0000 7f94ecee1640 1 Processor -- start 2024-09-21T06:36:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.995+0000 7f94ecee1640 1 -- start start 2024-09-21T06:36:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.995+0000 7f94ecee1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94e8102a80 0x7f94e819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.996+0000 7f94ecee1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94e81083c0 0x7f94e819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.996+0000 7f94ecee1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94e8108d10 0x7f94e819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.996+0000 7f94ecee1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f94e8112980 con 0x7f94e8102a80 2024-09-21T06:36:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.996+0000 7f94ecee1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f94e8112800 con 0x7f94e8108d10 2024-09-21T06:36:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.996+0000 7f94ecee1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f94e8112b00 con 0x7f94e81083c0 2024-09-21T06:36:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.996+0000 7f94e659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94e8102a80 0x7f94e819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.996+0000 7f94e659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94e8102a80 0x7f94e819a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53036/0 (socket says 172.21.15.63:53036) 2024-09-21T06:36:05.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.996+0000 7f94e659c640 1 -- 172.21.15.63:0/1424982329 learned_addr learned my addr 172.21.15.63:0/1424982329 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:05.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.996+0000 7f94e6d9d640 1 --2- 172.21.15.63:0/1424982329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94e8108d10 0x7f94e819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.996+0000 7f94e659c640 1 -- 172.21.15.63:0/1424982329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94e81083c0 msgr2=0x7f94e819aaa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:36:05.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.996+0000 7f94e659c640 1 --2- 172.21.15.63:0/1424982329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94e81083c0 0x7f94e819aaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.996+0000 7f94e659c640 1 -- 172.21.15.63:0/1424982329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94e8108d10 msgr2=0x7f94e819fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:05.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.996+0000 7f94e659c640 1 --2- 172.21.15.63:0/1424982329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94e8108d10 0x7f94e819fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.996+0000 7f94e659c640 1 -- 172.21.15.63:0/1424982329 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e81a03b0 con 0x7f94e8102a80 2024-09-21T06:36:05.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.996+0000 7f94e6d9d640 1 --2- 172.21.15.63:0/1424982329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94e8108d10 0x7f94e819fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:05.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.996+0000 7f94e659c640 1 --2- 172.21.15.63:0/1424982329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94e8102a80 0x7f94e819a500 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f94d000c890 tx=0x7f94d000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:05.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.997+0000 7f94df7fe640 1 -- 172.21.15.63:0/1424982329 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d0004220 con 0x7f94e8102a80 2024-09-21T06:36:05.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.997+0000 7f94df7fe640 1 -- 172.21.15.63:0/1424982329 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94d00043c0 con 0x7f94e8102a80 2024-09-21T06:36:05.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.997+0000 7f94ecee1640 1 -- 172.21.15.63:0/1424982329 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e81a06a0 con 0x7f94e8102a80 2024-09-21T06:36:05.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.997+0000 7f94df7fe640 1 -- 172.21.15.63:0/1424982329 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d0004a00 con 0x7f94e8102a80 2024-09-21T06:36:05.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.997+0000 7f94ecee1640 1 -- 172.21.15.63:0/1424982329 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e81a6ec0 con 0x7f94e8102a80 2024-09-21T06:36:05.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.999+0000 7f94f3455740 1 Processor -- start 2024-09-21T06:36:05.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:04.999+0000 7f94f3455740 1 -- start start 2024-09-21T06:36:05.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.000+0000 7f94df7fe640 1 -- 172.21.15.63:0/1424982329 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f94d00079b0 con 0x7f94e8102a80 2024-09-21T06:36:05.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.000+0000 7f94f3455740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95fa070 0x55b7d99a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.000+0000 7f94f3455740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95d11b0 0x55b7d99a1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.000+0000 7f94f3455740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95d9390 0x55b7d99a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.000+0000 7f94f3455740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55b7d9917ea0 con 0x55b7d95fa070 2024-09-21T06:36:05.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.000+0000 7f94f3455740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b7d99072d0 con 0x55b7d95d9390 2024-09-21T06:36:05.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.000+0000 7f94f3455740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b7d990b0e0 con 0x55b7d95d11b0 2024-09-21T06:36:05.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.000+0000 7f94e6d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95fa070 0x55b7d99a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.000+0000 7f94e6d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95fa070 0x55b7d99a12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53042/0 (socket says 172.21.15.63:53042) 2024-09-21T06:36:05.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.000+0000 7f94e6d9d640 1 -- 172.21.15.63:0/514964319 learned_addr learned my addr 172.21.15.63:0/514964319 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:05.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.000+0000 7f94e5d9b640 1 --2- 172.21.15.63:0/514964319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95d9390 0x55b7d99a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.000+0000 7f94e659c640 1 --2- 172.21.15.63:0/514964319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95d11b0 0x55b7d99a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.000+0000 7f94e6d9d640 1 -- 172.21.15.63:0/514964319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95d11b0 msgr2=0x55b7d99a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:05.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.000+0000 7f94e6d9d640 1 --2- 172.21.15.63:0/514964319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95d11b0 0x55b7d99a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.000+0000 7f94e6d9d640 1 -- 172.21.15.63:0/514964319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95d9390 msgr2=0x55b7d99a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:05.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.000+0000 7f94e6d9d640 1 --2- 172.21.15.63:0/514964319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95d9390 0x55b7d99a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.000+0000 7f94e6d9d640 1 -- 172.21.15.63:0/514964319 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7d9665650 con 0x55b7d95fa070 2024-09-21T06:36:05.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.000+0000 7f94e659c640 1 --2- 172.21.15.63:0/514964319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95d11b0 0x55b7d99a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:05.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.001+0000 7f94e6d9d640 1 --2- 172.21.15.63:0/514964319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95fa070 0x55b7d99a12c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f94e002f500 tx=0x7f94e00099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9244535a3e69c93d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:05.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.001+0000 7f94df7fe640 1 --2- 172.21.15.63:0/1424982329 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f94d40b6730 0x7f94d40b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.001+0000 7f94dcff9640 1 -- 172.21.15.63:0/514964319 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0031450 con 0x55b7d95fa070 2024-09-21T06:36:05.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.001+0000 7f94e659c640 1 --2- 172.21.15.63:0/1424982329 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f94d40b6730 0x7f94d40b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.001+0000 7f94dcff9640 1 -- 172.21.15.63:0/514964319 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94e0036040 con 0x55b7d95fa070 2024-09-21T06:36:05.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.001+0000 7f94df7fe640 1 -- 172.21.15.63:0/1424982329 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7f94d00e74e0 con 0x7f94e8102a80 2024-09-21T06:36:05.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.001+0000 7f94dcff9640 1 -- 172.21.15.63:0/514964319 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e00043e0 con 0x55b7d95fa070 2024-09-21T06:36:05.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.002+0000 7f94f3455740 1 -- 172.21.15.63:0/514964319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95fa070 msgr2=0x55b7d99a12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:05.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.002+0000 7f94e659c640 1 --2- 172.21.15.63:0/1424982329 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f94d40b6730 0x7f94d40b8c40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f94d00e4c90 tx=0x7f94d00e77e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:05.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.002+0000 7f94f3455740 1 --2- 172.21.15.63:0/514964319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95fa070 0x55b7d99a12c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f94e002f500 tx=0x7f94e00099c0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.002+0000 7f94f3455740 1 -- 172.21.15.63:0/514964319 shutdown_connections 2024-09-21T06:36:05.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.002+0000 7f94f3455740 1 --2- 172.21.15.63:0/514964319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95d9390 0x55b7d99a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.002+0000 7f94f3455740 1 --2- 172.21.15.63:0/514964319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95d11b0 0x55b7d99a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.002+0000 7f94f3455740 1 --2- 172.21.15.63:0/514964319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95fa070 0x55b7d99a12c0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.002+0000 7f94f3455740 1 -- 172.21.15.63:0/514964319 >> 172.21.15.63:0/514964319 conn(0x55b7d95ee460 msgr2=0x55b7d999f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:05.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.002+0000 7f94f3455740 1 -- 172.21.15.63:0/514964319 shutdown_connections 2024-09-21T06:36:05.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.002+0000 7f94f3455740 1 -- 172.21.15.63:0/514964319 wait complete. 2024-09-21T06:36:05.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.003+0000 7f94f3455740 1 -- start start 2024-09-21T06:36:05.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.003+0000 7f94f3455740 1 Processor -- start 2024-09-21T06:36:05.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.003+0000 7f94f3455740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95d11b0 0x55b7d99ac930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.003+0000 7f94f3455740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95d9390 0x55b7d99ace70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.003+0000 7f94f3455740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95fa070 0x55b7d99ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.003+0000 7f94f3455740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55b7d9768700 con 0x55b7d95d11b0 2024-09-21T06:36:05.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.003+0000 7f94f3455740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b7d98a2160 con 0x55b7d95fa070 2024-09-21T06:36:05.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.003+0000 7f94f3455740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b7d99afa90 con 0x55b7d95d9390 2024-09-21T06:36:05.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.003+0000 7f94f3455740 10 client.0 _ll_register_callbacks cb 0x55b7d98bb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:05.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.003+0000 7f94e6d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95d11b0 0x55b7d99ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.003+0000 7f94e6d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95d11b0 0x55b7d99ac930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53052/0 (socket says 172.21.15.63:53052) 2024-09-21T06:36:05.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.003+0000 7f94e6d9d640 1 -- 172.21.15.63:0/3052294851 learned_addr learned my addr 172.21.15.63:0/3052294851 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:05.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.003+0000 7f94e5d9b640 1 --2- 172.21.15.63:0/3052294851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95d9390 0x55b7d99ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.003+0000 7f94e6d9d640 1 --2- 172.21.15.63:0/3052294851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95fa070 0x55b7d99ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.004+0000 7f94e6d9d640 1 -- 172.21.15.63:0/3052294851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95d9390 msgr2=0x55b7d99ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:05.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.004+0000 7f94e6d9d640 1 --2- 172.21.15.63:0/3052294851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95d9390 0x55b7d99ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.004+0000 7f94e6d9d640 1 -- 172.21.15.63:0/3052294851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95fa070 msgr2=0x55b7d99ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.004+0000 7f94e6d9d640 1 --2- 172.21.15.63:0/3052294851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95fa070 0x55b7d99ad3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.004+0000 7f94e6d9d640 1 -- 172.21.15.63:0/3052294851 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7d98cfc90 con 0x55b7d95d11b0 2024-09-21T06:36:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.004+0000 7f94e6d9d640 1 --2- 172.21.15.63:0/3052294851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95d11b0 0x55b7d99ac930 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f94e0003f20 tx=0x7f94e0009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc5df52b27b7d2a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.004+0000 7f94cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.004+0000 7f94cdffb640 1 -- 172.21.15.63:0/3052294851 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0059060 con 0x55b7d95d11b0 2024-09-21T06:36:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.004+0000 7f94cdffb640 1 -- 172.21.15.63:0/3052294851 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7f94e0004140 con 0x55b7d95d11b0 2024-09-21T06:36:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.004+0000 7f94f3455740 1 -- 172.21.15.63:0/3052294851 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94e0036040 con 0x55b7d95d11b0 2024-09-21T06:36:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.004+0000 7f94cdffb640 1 -- 172.21.15.63:0/3052294851 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f94e0004340 con 0x55b7d95d11b0 2024-09-21T06:36:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.004+0000 7f94f3455740 10 client.17133 fetch_fsmap learned FSMap version 58 2024-09-21T06:36:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.004+0000 7f94f3455740 1 -- 172.21.15.63:0/3052294851 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x55b7d99bb6a0 con 0x55b7d95d11b0 2024-09-21T06:36:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.004+0000 7f94cdffb640 1 -- 172.21.15.63:0/3052294851 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94e0036040 con 0x55b7d95d11b0 2024-09-21T06:36:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.005+0000 7f94cdffb640 1 -- 172.21.15.63:0/3052294851 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 58) ==== 8374+0+0 (secure 0 0 0) 0x7f94e002fb50 con 0x55b7d95d11b0 2024-09-21T06:36:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.005+0000 7f94f3455740 10 client.17133 fetch_fsmap finished waiting for FSMap version 58 2024-09-21T06:36:05.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.005+0000 7f94f3455740 10 client.17133 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:36:05.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.005+0000 7f94f3455740 20 client.17133 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:05.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.005+0000 7f94f3455740 1 --2- 172.21.15.63:0/3052294851 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55b7d95b89f0 0x55b7d99bea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.005+0000 7f94f3455740 4 client.17133 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:05.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.005+0000 7f94f3455740 1 -- 172.21.15.63:0/3052294851 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7d9919df0 con 0x55b7d95b89f0 2024-09-21T06:36:05.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.005+0000 7f94e5d9b640 1 --2- 172.21.15.63:0/3052294851 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55b7d95b89f0 0x55b7d99bea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.006+0000 7f94e5d9b640 1 --2- 172.21.15.63:0/3052294851 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55b7d95b89f0 0x55b7d99bea00 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=13724c2b1c045b07 server_cookie=f49c4c83b0597734 in_seq=0 out_seq=0 2024-09-21T06:36:05.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.006+0000 7f94cdffb640 10 client.17133 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:36:05.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.006+0000 7f94cdffb640 1 -- 172.21.15.63:0/3052294851 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b7d9919df0 con 0x55b7d95b89f0 2024-09-21T06:36:05.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.007+0000 7f94cdffb640 10 client.17133 handle_command_reply: tid=0 2024-09-21T06:36:05.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.007+0000 7f94f3455740 1 client.17133 shutdown 2024-09-21T06:36:05.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.007+0000 7f94f3455740 1 -- 172.21.15.63:0/3052294851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95d11b0 msgr2=0x55b7d99ac930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:05.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.007+0000 7f94f3455740 1 --2- 172.21.15.63:0/3052294851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95d11b0 0x55b7d99ac930 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f94e0003f20 tx=0x7f94e0009590 comp rx=0 tx=0).stop 2024-09-21T06:36:05.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.007+0000 7f94f3455740 1 -- 172.21.15.63:0/3052294851 shutdown_connections 2024-09-21T06:36:05.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.007+0000 7f94f3455740 1 --2- 172.21.15.63:0/3052294851 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55b7d95b89f0 0x55b7d99bea00 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.007+0000 7f94f3455740 1 --2- 172.21.15.63:0/3052294851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95fa070 0x55b7d99ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.007+0000 7f94f3455740 1 --2- 172.21.15.63:0/3052294851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95d9390 0x55b7d99ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.007+0000 7f94cdffb640 0 client.17133 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:36:05.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.007+0000 7f94f3455740 1 --2- 172.21.15.63:0/3052294851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95d11b0 0x55b7d99ac930 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.007+0000 7f94f3455740 1 -- 172.21.15.63:0/3052294851 >> 172.21.15.63:0/3052294851 conn(0x55b7d95ee460 msgr2=0x55b7d99a22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:05.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.007+0000 7f94f3455740 1 -- 172.21.15.63:0/3052294851 shutdown_connections 2024-09-21T06:36:05.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.007+0000 7f94f3455740 1 -- 172.21.15.63:0/3052294851 wait complete. 2024-09-21T06:36:05.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.007+0000 7f94f3455740 20 client.17133 trim_cache size 0 max 16384 2024-09-21T06:36:05.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.020+0000 7f94f3455740 1 Processor -- start 2024-09-21T06:36:05.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.020+0000 7f94f3455740 1 -- start start 2024-09-21T06:36:05.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.020+0000 7f94f3455740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95d11b0 0x55b7d99ae810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.020+0000 7f94f3455740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95d9390 0x55b7d99a2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.020+0000 7f94f3455740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95fa070 0x55b7d999e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.020+0000 7f94f3455740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81af830 con 0x55b7d95fa070 2024-09-21T06:36:05.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.020+0000 7f94f3455740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81b13a0 con 0x55b7d95d11b0 2024-09-21T06:36:05.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.020+0000 7f94f3455740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81aff00 con 0x55b7d95d9390 2024-09-21T06:36:05.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.021+0000 7f94e6d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95fa070 0x55b7d999e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.021+0000 7f94e6d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95fa070 0x55b7d999e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53056/0 (socket says 172.21.15.63:53056) 2024-09-21T06:36:05.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.021+0000 7f94e6d9d640 1 -- 172.21.15.63:0/123007801 learned_addr learned my addr 172.21.15.63:0/123007801 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:05.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.021+0000 7f94e5d9b640 1 --2- 172.21.15.63:0/123007801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95d9390 0x55b7d99a2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.021+0000 7f94e6d9d640 1 --2- 172.21.15.63:0/123007801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95d11b0 0x55b7d99ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.021+0000 7f94e6d9d640 1 -- 172.21.15.63:0/123007801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95d9390 msgr2=0x55b7d99a2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.021+0000 7f94e6d9d640 1 --2- 172.21.15.63:0/123007801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95d9390 0x55b7d99a2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.021+0000 7f94e6d9d640 1 -- 172.21.15.63:0/123007801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95d11b0 msgr2=0x55b7d99ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.021+0000 7f94e6d9d640 1 --2- 172.21.15.63:0/123007801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95d11b0 0x55b7d99ae810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.021+0000 7f94e6d9d640 1 -- 172.21.15.63:0/123007801 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7d9999460 con 0x55b7d95fa070 2024-09-21T06:36:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.021+0000 7f94e6d9d640 1 --2- 172.21.15.63:0/123007801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95fa070 0x55b7d999e760 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x55b7d99a4300 tx=0x7f94e00021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00e27dcc280b0ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.021+0000 7f94cffff640 1 -- 172.21.15.63:0/123007801 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0059030 con 0x55b7d95fa070 2024-09-21T06:36:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.021+0000 7f94cffff640 1 -- 172.21.15.63:0/123007801 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94e0036070 con 0x55b7d95fa070 2024-09-21T06:36:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.021+0000 7f94cffff640 1 -- 172.21.15.63:0/123007801 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0030ab0 con 0x55b7d95fa070 2024-09-21T06:36:05.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.022+0000 7f94f3455740 1 -- 172.21.15.63:0/123007801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95fa070 msgr2=0x55b7d999e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:05.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.022+0000 7f94f3455740 1 --2- 172.21.15.63:0/123007801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95fa070 0x55b7d999e760 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x55b7d99a4300 tx=0x7f94e00021d0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.022+0000 7f94f3455740 1 -- 172.21.15.63:0/123007801 shutdown_connections 2024-09-21T06:36:05.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.022+0000 7f94f3455740 1 --2- 172.21.15.63:0/123007801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95fa070 0x55b7d999e760 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.022+0000 7f94f3455740 1 --2- 172.21.15.63:0/123007801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95d9390 0x55b7d99a2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.022+0000 7f94f3455740 1 --2- 172.21.15.63:0/123007801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95d11b0 0x55b7d99ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.022+0000 7f94f3455740 1 -- 172.21.15.63:0/123007801 >> 172.21.15.63:0/123007801 conn(0x55b7d95ee460 msgr2=0x55b7d99a22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:05.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.022+0000 7f94f3455740 1 -- 172.21.15.63:0/123007801 shutdown_connections 2024-09-21T06:36:05.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.022+0000 7f94f3455740 1 -- 172.21.15.63:0/123007801 wait complete. 2024-09-21T06:36:05.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.022+0000 7f94f3455740 1 -- start start 2024-09-21T06:36:05.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.023+0000 7f94f3455740 1 Processor -- start 2024-09-21T06:36:05.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.023+0000 7f94f3455740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95d11b0 0x55b7d99c00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.023+0000 7f94f3455740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95d9390 0x55b7d99c0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.023+0000 7f94f3455740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95fa070 0x55b7d9a28180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.023+0000 7f94f3455740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81b0cd0 con 0x55b7d95d11b0 2024-09-21T06:36:05.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.023+0000 7f94f3455740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81b0600 con 0x55b7d95d9390 2024-09-21T06:36:05.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.023+0000 7f94f3455740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81ad830 con 0x55b7d95fa070 2024-09-21T06:36:05.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.023+0000 7f94f3455740 10 client.0 _ll_register_callbacks cb 0x7f94e0009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:05.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.023+0000 7f94e6d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95d11b0 0x55b7d99c00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.023+0000 7f94e6d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95d11b0 0x55b7d99c00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53058/0 (socket says 172.21.15.63:53058) 2024-09-21T06:36:05.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.023+0000 7f94e6d9d640 1 -- 172.21.15.63:0/754845250 learned_addr learned my addr 172.21.15.63:0/754845250 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:05.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.023+0000 7f94e5d9b640 1 --2- 172.21.15.63:0/754845250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95d9390 0x55b7d99c0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.023+0000 7f94e6d9d640 1 --2- 172.21.15.63:0/754845250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95fa070 0x55b7d9a28180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.023+0000 7f94e6d9d640 1 -- 172.21.15.63:0/754845250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95fa070 msgr2=0x55b7d9a28180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:05.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.023+0000 7f94e6d9d640 1 --2- 172.21.15.63:0/754845250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95fa070 0x55b7d9a28180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.023+0000 7f94e6d9d640 1 -- 172.21.15.63:0/754845250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95d9390 msgr2=0x55b7d99c0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:05.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.023+0000 7f94e6d9d640 1 --2- 172.21.15.63:0/754845250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95d9390 0x55b7d99c0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.024+0000 7f94e6d9d640 1 -- 172.21.15.63:0/754845250 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7d9a286c0 con 0x55b7d95d11b0 2024-09-21T06:36:05.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.024+0000 7f94e5d9b640 1 --2- 172.21.15.63:0/754845250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95d9390 0x55b7d99c0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.024+0000 7f94e6d9d640 1 --2- 172.21.15.63:0/754845250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95d11b0 0x55b7d99c00c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f94e0030040 tx=0x7f94e00042b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5b90d10d9434bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.024+0000 7f94cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.024+0000 7f94cdffb640 1 -- 172.21.15.63:0/754845250 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e006d060 con 0x55b7d95d11b0 2024-09-21T06:36:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.024+0000 7f94cdffb640 1 -- 172.21.15.63:0/754845250 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7f94e0004b40 con 0x55b7d95d11b0 2024-09-21T06:36:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.024+0000 7f94f3455740 1 -- 172.21.15.63:0/754845250 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94e0036070 con 0x55b7d95d11b0 2024-09-21T06:36:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.024+0000 7f94cdffb640 1 -- 172.21.15.63:0/754845250 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f94e0059040 con 0x55b7d95d11b0 2024-09-21T06:36:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.024+0000 7f94f3455740 10 client.17139 fetch_fsmap learned FSMap version 58 2024-09-21T06:36:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.024+0000 7f94f3455740 1 -- 172.21.15.63:0/754845250 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x55b7d9a298a0 con 0x55b7d95d11b0 2024-09-21T06:36:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.024+0000 7f94cdffb640 1 -- 172.21.15.63:0/754845250 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94e0036070 con 0x55b7d95d11b0 2024-09-21T06:36:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.024+0000 7f94cdffb640 1 -- 172.21.15.63:0/754845250 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 58) ==== 8374+0+0 (secure 0 0 0) 0x7f94e0030c70 con 0x55b7d95d11b0 2024-09-21T06:36:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.025+0000 7f94f3455740 10 client.17139 fetch_fsmap finished waiting for FSMap version 58 2024-09-21T06:36:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.025+0000 7f94f3455740 10 client.17139 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:36:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.025+0000 7f94f3455740 20 client.17139 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.025+0000 7f94f3455740 1 --2- 172.21.15.63:0/754845250 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55b7d958dda0 0x55b7d9a2bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.025+0000 7f94f3455740 4 client.17139 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:36:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.025+0000 7f94f3455740 1 -- 172.21.15.63:0/754845250 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b7d99158a0 con 0x55b7d958dda0 2024-09-21T06:36:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.025+0000 7f94e5d9b640 1 --2- 172.21.15.63:0/754845250 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55b7d958dda0 0x55b7d9a2bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.025+0000 7f94cdffb640 10 client.17139 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:36:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.025+0000 7f94e5d9b640 1 --2- 172.21.15.63:0/754845250 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55b7d958dda0 0x55b7d9a2bdb0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8a66293648a0e51d server_cookie=9b07fdb76726a81c in_seq=0 out_seq=0 2024-09-21T06:36:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.025+0000 7f94cdffb640 1 -- 172.21.15.63:0/754845250 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b7d99158a0 con 0x55b7d958dda0 2024-09-21T06:36:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.025+0000 7f94cdffb640 10 client.17139 handle_command_reply: tid=0 2024-09-21T06:36:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.025+0000 7f94f3455740 1 client.17139 shutdown 2024-09-21T06:36:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94f3455740 1 -- 172.21.15.63:0/754845250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95d11b0 msgr2=0x55b7d99c00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94f3455740 1 --2- 172.21.15.63:0/754845250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95d11b0 0x55b7d99c00c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f94e0030040 tx=0x7f94e00042b0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94f3455740 1 -- 172.21.15.63:0/754845250 shutdown_connections 2024-09-21T06:36:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94f3455740 1 --2- 172.21.15.63:0/754845250 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55b7d958dda0 0x55b7d9a2bdb0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94f3455740 1 --2- 172.21.15.63:0/754845250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7d95fa070 0x55b7d9a28180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94f3455740 1 --2- 172.21.15.63:0/754845250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7d95d9390 0x55b7d99c0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94f3455740 1 --2- 172.21.15.63:0/754845250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7d95d11b0 0x55b7d99c00c0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94f3455740 1 -- 172.21.15.63:0/754845250 >> 172.21.15.63:0/754845250 conn(0x55b7d95ee460 msgr2=0x55b7d99ae570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:05.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94cdffb640 0 client.17139 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:36:05.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94f3455740 1 -- 172.21.15.63:0/754845250 shutdown_connections 2024-09-21T06:36:05.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94f3455740 1 -- 172.21.15.63:0/754845250 wait complete. 2024-09-21T06:36:05.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94f3455740 20 client.17139 trim_cache size 0 max 16384 2024-09-21T06:36:05.033 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:36:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94ecee1640 1 -- 172.21.15.63:0/1424982329 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f94d40b6730 msgr2=0x7f94d40b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94ecee1640 1 --2- 172.21.15.63:0/1424982329 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f94d40b6730 0x7f94d40b8c40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f94d00e4c90 tx=0x7f94d00e77e0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94ecee1640 1 -- 172.21.15.63:0/1424982329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94e8102a80 msgr2=0x7f94e819a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94ecee1640 1 --2- 172.21.15.63:0/1424982329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94e8102a80 0x7f94e819a500 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f94d000c890 tx=0x7f94d000cd50 comp rx=0 tx=0).stop 2024-09-21T06:36:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94ecee1640 1 -- 172.21.15.63:0/1424982329 shutdown_connections 2024-09-21T06:36:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94ecee1640 1 --2- 172.21.15.63:0/1424982329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94e8108d10 0x7f94e819fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94ecee1640 1 --2- 172.21.15.63:0/1424982329 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f94d40b6730 0x7f94d40b8c40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94ecee1640 1 --2- 172.21.15.63:0/1424982329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94e81083c0 0x7f94e819aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94ecee1640 1 --2- 172.21.15.63:0/1424982329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94e8102a80 0x7f94e819a500 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.026+0000 7f94ecee1640 1 -- 172.21.15.63:0/1424982329 >> 172.21.15.63:0/1424982329 conn(0x7f94e8079740 msgr2=0x7f94e81019c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:05.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.027+0000 7f94ecee1640 1 -- 172.21.15.63:0/1424982329 shutdown_connections 2024-09-21T06:36:05.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:05.027+0000 7f94ecee1640 1 -- 172.21.15.63:0/1424982329 wait complete. 2024-09-21T06:36:05.650 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:05 smithi063 ceph-mon[31150]: pgmap v561: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:36:05.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:05 smithi071 ceph-mon[34844]: pgmap v561: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:36:05.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:05 smithi175 ceph-mon[34510]: pgmap v561: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:36:06.761 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:36:06.761 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:36:07.035 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:07.415 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:07 smithi063 ceph-mon[31150]: pgmap v562: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-21T06:36:07.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.509+0000 7faba88bb640 1 -- 172.21.15.63:0/2513599994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faba4109e10 msgr2=0x7faba4110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:07.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.509+0000 7faba88bb640 1 --2- 172.21.15.63:0/2513599994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faba4109e10 0x7faba4110640 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009ca0 tx=0x7fab9c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.509+0000 7faba88bb640 1 -- 172.21.15.63:0/2513599994 shutdown_connections 2024-09-21T06:36:07.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.509+0000 7faba88bb640 1 --2- 172.21.15.63:0/2513599994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faba4109e10 0x7faba4110640 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.509+0000 7faba88bb640 1 --2- 172.21.15.63:0/2513599994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faba41094c0 0x7faba41098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.509+0000 7faba88bb640 1 --2- 172.21.15.63:0/2513599994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faba4103b80 0x7faba4103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.509+0000 7faba88bb640 1 -- 172.21.15.63:0/2513599994 >> 172.21.15.63:0/2513599994 conn(0x7faba40ff5d0 msgr2=0x7faba4101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:07.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.509+0000 7faba88bb640 1 -- 172.21.15.63:0/2513599994 shutdown_connections 2024-09-21T06:36:07.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.509+0000 7faba88bb640 1 -- 172.21.15.63:0/2513599994 wait complete. 2024-09-21T06:36:07.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.510+0000 7faba88bb640 1 Processor -- start 2024-09-21T06:36:07.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.510+0000 7faba88bb640 1 -- start start 2024-09-21T06:36:07.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.511+0000 7faba88bb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faba4103b80 0x7faba4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.511+0000 7faba88bb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faba41094c0 0x7faba4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.511+0000 7faba88bb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faba4109e10 0x7faba4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.511+0000 7faba88bb640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faba4113ad0 con 0x7faba4109e10 2024-09-21T06:36:07.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.511+0000 7faba88bb640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faba4113950 con 0x7faba4103b80 2024-09-21T06:36:07.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.511+0000 7faba88bb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faba4113c50 con 0x7faba41094c0 2024-09-21T06:36:07.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.511+0000 7faba2d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faba4109e10 0x7faba4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.511+0000 7faba2d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faba4109e10 0x7faba4076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38104/0 (socket says 172.21.15.63:38104) 2024-09-21T06:36:07.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.511+0000 7faba2d9d640 1 -- 172.21.15.63:0/3701739 learned_addr learned my addr 172.21.15.63:0/3701739 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:07.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.511+0000 7faba1d9b640 1 --2- 172.21.15.63:0/3701739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faba41094c0 0x7faba4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.511+0000 7faba259c640 1 --2- 172.21.15.63:0/3701739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faba4103b80 0x7faba4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.511+0000 7faba2d9d640 1 -- 172.21.15.63:0/3701739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faba41094c0 msgr2=0x7faba4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:07.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.511+0000 7faba2d9d640 1 --2- 172.21.15.63:0/3701739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faba41094c0 0x7faba4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.511+0000 7faba2d9d640 1 -- 172.21.15.63:0/3701739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faba4103b80 msgr2=0x7faba4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:07.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.511+0000 7faba2d9d640 1 --2- 172.21.15.63:0/3701739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faba4103b80 0x7faba4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.511+0000 7faba2d9d640 1 -- 172.21.15.63:0/3701739 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba41a8700 con 0x7faba4109e10 2024-09-21T06:36:07.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.511+0000 7faba1d9b640 1 --2- 172.21.15.63:0/3701739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faba41094c0 0x7faba4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:07.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.511+0000 7faba259c640 1 --2- 172.21.15.63:0/3701739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faba4103b80 0x7faba4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:07.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.511+0000 7faba2d9d640 1 --2- 172.21.15.63:0/3701739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faba4109e10 0x7faba4076190 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fab9c005cc0 tx=0x7fab9c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:07.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.511+0000 7fab937fe640 1 -- 172.21.15.63:0/3701739 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c003bf0 con 0x7faba4109e10 2024-09-21T06:36:07.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.512+0000 7faba88bb640 1 -- 172.21.15.63:0/3701739 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba41a8990 con 0x7faba4109e10 2024-09-21T06:36:07.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.512+0000 7fab937fe640 1 -- 172.21.15.63:0/3701739 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab9c003d90 con 0x7faba4109e10 2024-09-21T06:36:07.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.512+0000 7fab937fe640 1 -- 172.21.15.63:0/3701739 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c02fbc0 con 0x7faba4109e10 2024-09-21T06:36:07.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.512+0000 7faba88bb640 1 -- 172.21.15.63:0/3701739 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faba41a8f20 con 0x7faba4109e10 2024-09-21T06:36:07.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.514+0000 7fabaee2f740 1 Processor -- start 2024-09-21T06:36:07.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.514+0000 7fab937fe640 1 -- 172.21.15.63:0/3701739 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fab9c02fd60 con 0x7faba4109e10 2024-09-21T06:36:07.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.515+0000 7fabaee2f740 1 -- start start 2024-09-21T06:36:07.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.515+0000 7fabaee2f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09eb350 0x55f9b0d92430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.515+0000 7fabaee2f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09c2490 0x55f9b0d92970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.515+0000 7fabaee2f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9b09ca670 0x55f9b0d92eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.515+0000 7fabaee2f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f9b0d08e60 con 0x55f9b09eb350 2024-09-21T06:36:07.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.515+0000 7fabaee2f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f9b0cf8290 con 0x55f9b09ca670 2024-09-21T06:36:07.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.515+0000 7fabaee2f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f9b0cfc0a0 con 0x55f9b09c2490 2024-09-21T06:36:07.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.515+0000 7faba1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09eb350 0x55f9b0d92430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.515+0000 7faba1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09eb350 0x55f9b0d92430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38110/0 (socket says 172.21.15.63:38110) 2024-09-21T06:36:07.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.515+0000 7faba1d9b640 1 -- 172.21.15.63:0/1201770038 learned_addr learned my addr 172.21.15.63:0/1201770038 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:07.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.515+0000 7faba259c640 1 --2- 172.21.15.63:0/1201770038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09c2490 0x55f9b0d92970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.515+0000 7fab937fe640 1 --2- 172.21.15.63:0/3701739 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fab8c0b6680 0x7fab8c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.515+0000 7faba1d9b640 1 --2- 172.21.15.63:0/1201770038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9b09ca670 0x55f9b0d92eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.516+0000 7faba2d9d640 1 --2- 172.21.15.63:0/3701739 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fab8c0b6680 0x7fab8c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.516+0000 7faba1d9b640 1 -- 172.21.15.63:0/1201770038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09c2490 msgr2=0x55f9b0d92970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:07.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.516+0000 7faba1d9b640 1 --2- 172.21.15.63:0/1201770038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09c2490 0x55f9b0d92970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.516+0000 7faba1d9b640 1 -- 172.21.15.63:0/1201770038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9b09ca670 msgr2=0x55f9b0d92eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:07.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.516+0000 7faba1d9b640 1 --2- 172.21.15.63:0/1201770038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9b09ca670 0x55f9b0d92eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.516+0000 7faba1d9b640 1 -- 172.21.15.63:0/1201770038 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9b0a56930 con 0x55f9b09eb350 2024-09-21T06:36:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.516+0000 7fab937fe640 1 -- 172.21.15.63:0/3701739 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7fab9c108d90 con 0x7faba4109e10 2024-09-21T06:36:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.516+0000 7faba259c640 1 --2- 172.21.15.63:0/1201770038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09c2490 0x55f9b0d92970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.516+0000 7faba1d9b640 1 --2- 172.21.15.63:0/1201770038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09eb350 0x55f9b0d92430 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fab980135e0 tx=0x7fab9800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46fe02dd80e57bf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.516+0000 7fab90ff9640 1 -- 172.21.15.63:0/1201770038 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab98019030 con 0x55f9b09eb350 2024-09-21T06:36:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.516+0000 7faba2d9d640 1 --2- 172.21.15.63:0/3701739 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fab8c0b6680 0x7fab8c0b8b90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fab9c106540 tx=0x7fab9c0b6040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.516+0000 7fab90ff9640 1 -- 172.21.15.63:0/1201770038 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab98011970 con 0x55f9b09eb350 2024-09-21T06:36:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.516+0000 7fab90ff9640 1 -- 172.21.15.63:0/1201770038 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9800f8f0 con 0x55f9b09eb350 2024-09-21T06:36:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.517+0000 7fabaee2f740 1 -- 172.21.15.63:0/1201770038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09eb350 msgr2=0x55f9b0d92430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.517+0000 7fabaee2f740 1 --2- 172.21.15.63:0/1201770038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09eb350 0x55f9b0d92430 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fab980135e0 tx=0x7fab9800b6d0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.517+0000 7fabaee2f740 1 -- 172.21.15.63:0/1201770038 shutdown_connections 2024-09-21T06:36:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.517+0000 7fabaee2f740 1 --2- 172.21.15.63:0/1201770038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9b09ca670 0x55f9b0d92eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.517+0000 7fabaee2f740 1 --2- 172.21.15.63:0/1201770038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09c2490 0x55f9b0d92970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.517+0000 7fabaee2f740 1 --2- 172.21.15.63:0/1201770038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09eb350 0x55f9b0d92430 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.517+0000 7fabaee2f740 1 -- 172.21.15.63:0/1201770038 >> 172.21.15.63:0/1201770038 conn(0x55f9b09df740 msgr2=0x55f9b0d90320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.517+0000 7fabaee2f740 1 -- 172.21.15.63:0/1201770038 shutdown_connections 2024-09-21T06:36:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.517+0000 7fabaee2f740 1 -- 172.21.15.63:0/1201770038 wait complete. 2024-09-21T06:36:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.518+0000 7fabaee2f740 1 -- start start 2024-09-21T06:36:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.518+0000 7fabaee2f740 1 Processor -- start 2024-09-21T06:36:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.518+0000 7fabaee2f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09c2490 0x55f9b0d9e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.518+0000 7fabaee2f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9b09ca670 0x55f9b0d9e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.518+0000 7fabaee2f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09eb350 0x55f9b0da9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.518+0000 7fabaee2f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f9b0b59890 con 0x55f9b09eb350 2024-09-21T06:36:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.518+0000 7fabaee2f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f9b0c92d40 con 0x55f9b09ca670 2024-09-21T06:36:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.518+0000 7fabaee2f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f9b0da0c10 con 0x55f9b09c2490 2024-09-21T06:36:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.518+0000 7fabaee2f740 10 client.0 _ll_register_callbacks cb 0x55f9b0cf6c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.518+0000 7faba1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09eb350 0x55f9b0da9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.518+0000 7faba1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09eb350 0x55f9b0da9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38126/0 (socket says 172.21.15.63:38126) 2024-09-21T06:36:07.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.518+0000 7faba1d9b640 1 -- 172.21.15.63:0/4223841405 learned_addr learned my addr 172.21.15.63:0/4223841405 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.518+0000 7faba259c640 1 --2- 172.21.15.63:0/4223841405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9b09ca670 0x55f9b0d9e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.518+0000 7faba1d9b640 1 --2- 172.21.15.63:0/4223841405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09c2490 0x55f9b0d9e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.519+0000 7faba1d9b640 1 -- 172.21.15.63:0/4223841405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09c2490 msgr2=0x55f9b0d9e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.519+0000 7faba1d9b640 1 --2- 172.21.15.63:0/4223841405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09c2490 0x55f9b0d9e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.519+0000 7faba1d9b640 1 -- 172.21.15.63:0/4223841405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9b09ca670 msgr2=0x55f9b0d9e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.519+0000 7faba1d9b640 1 --2- 172.21.15.63:0/4223841405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9b09ca670 0x55f9b0d9e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.519+0000 7faba1d9b640 1 -- 172.21.15.63:0/4223841405 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9b0daa520 con 0x55f9b09eb350 2024-09-21T06:36:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.519+0000 7faba1d9b640 1 --2- 172.21.15.63:0/4223841405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09eb350 0x55f9b0da9f60 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fab9800f5d0 tx=0x7fab9800f4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a752e151c75b61a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.519+0000 7fab89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.519+0000 7fab89ffb640 1 -- 172.21.15.63:0/4223841405 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab98019040 con 0x55f9b09eb350 2024-09-21T06:36:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.519+0000 7fab89ffb640 1 -- 172.21.15.63:0/4223841405 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7fab98011dc0 con 0x55f9b09eb350 2024-09-21T06:36:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.519+0000 7fabaee2f740 1 -- 172.21.15.63:0/4223841405 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab98011970 con 0x55f9b09eb350 2024-09-21T06:36:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.519+0000 7fab89ffb640 1 -- 172.21.15.63:0/4223841405 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7fab98033050 con 0x55f9b09eb350 2024-09-21T06:36:07.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.519+0000 7fabaee2f740 10 client.17151 fetch_fsmap learned FSMap version 58 2024-09-21T06:36:07.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.519+0000 7fabaee2f740 1 -- 172.21.15.63:0/4223841405 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x55f9b0dace50 con 0x55f9b09eb350 2024-09-21T06:36:07.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.520+0000 7fab89ffb640 1 -- 172.21.15.63:0/4223841405 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab98011970 con 0x55f9b09eb350 2024-09-21T06:36:07.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.520+0000 7fab89ffb640 1 -- 172.21.15.63:0/4223841405 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 58) ==== 8374+0+0 (secure 0 0 0) 0x7fab9802b020 con 0x55f9b09eb350 2024-09-21T06:36:07.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.520+0000 7fabaee2f740 10 client.17151 fetch_fsmap finished waiting for FSMap version 58 2024-09-21T06:36:07.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.520+0000 7fabaee2f740 10 client.17151 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:36:07.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.520+0000 7fabaee2f740 20 client.17151 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:07.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.520+0000 7fabaee2f740 1 --2- 172.21.15.63:0/4223841405 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f9b09a9cd0 0x55f9b0db02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.520+0000 7fabaee2f740 4 client.17151 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:07.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.520+0000 7fabaee2f740 1 -- 172.21.15.63:0/4223841405 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9b0d0adb0 con 0x55f9b09a9cd0 2024-09-21T06:36:07.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.520+0000 7faba259c640 1 --2- 172.21.15.63:0/4223841405 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f9b09a9cd0 0x55f9b0db02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.521+0000 7fab89ffb640 10 client.17151 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:07.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.521+0000 7faba259c640 1 --2- 172.21.15.63:0/4223841405 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f9b09a9cd0 0x55f9b0db02c0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cd78902016bfc97 server_cookie=164681de04d67cac in_seq=0 out_seq=0 2024-09-21T06:36:07.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.521+0000 7fab89ffb640 1 -- 172.21.15.63:0/4223841405 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f9b0d0adb0 con 0x55f9b09a9cd0 2024-09-21T06:36:07.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.521+0000 7fab89ffb640 10 client.17151 handle_command_reply: tid=0 2024-09-21T06:36:07.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.521+0000 7fabaee2f740 1 client.17151 shutdown 2024-09-21T06:36:07.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.522+0000 7fabaee2f740 1 -- 172.21.15.63:0/4223841405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09eb350 msgr2=0x55f9b0da9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:07.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.522+0000 7fabaee2f740 1 --2- 172.21.15.63:0/4223841405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09eb350 0x55f9b0da9f60 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fab9800f5d0 tx=0x7fab9800f4d0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.522+0000 7fabaee2f740 1 -- 172.21.15.63:0/4223841405 shutdown_connections 2024-09-21T06:36:07.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.522+0000 7fabaee2f740 1 --2- 172.21.15.63:0/4223841405 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f9b09a9cd0 0x55f9b0db02c0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.522+0000 7fab89ffb640 0 client.17151 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:07.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.522+0000 7fabaee2f740 1 --2- 172.21.15.63:0/4223841405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09eb350 0x55f9b0da9f60 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.522+0000 7fabaee2f740 1 --2- 172.21.15.63:0/4223841405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9b09ca670 0x55f9b0d9e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.522+0000 7fabaee2f740 1 --2- 172.21.15.63:0/4223841405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09c2490 0x55f9b0d9e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.522+0000 7fabaee2f740 1 -- 172.21.15.63:0/4223841405 >> 172.21.15.63:0/4223841405 conn(0x55f9b09df740 msgr2=0x55f9b0d95610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:07.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.522+0000 7fabaee2f740 1 -- 172.21.15.63:0/4223841405 shutdown_connections 2024-09-21T06:36:07.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.522+0000 7fabaee2f740 1 -- 172.21.15.63:0/4223841405 wait complete. 2024-09-21T06:36:07.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.522+0000 7fabaee2f740 20 client.17151 trim_cache size 0 max 16384 2024-09-21T06:36:07.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.539+0000 7fabaee2f740 1 Processor -- start 2024-09-21T06:36:07.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.540+0000 7fabaee2f740 1 -- start start 2024-09-21T06:36:07.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.540+0000 7fabaee2f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09a9cd0 0x55f9b0d93b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.540+0000 7fabaee2f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9b09c2490 0x55f9b0d97510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.540+0000 7fabaee2f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09ca670 0x55f9b0d97a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.540+0000 7fabaee2f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faba41b1960 con 0x55f9b09ca670 2024-09-21T06:36:07.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.540+0000 7fabaee2f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faba41b34d0 con 0x55f9b09c2490 2024-09-21T06:36:07.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.540+0000 7fabaee2f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faba41b2030 con 0x55f9b09a9cd0 2024-09-21T06:36:07.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.540+0000 7faba1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09ca670 0x55f9b0d97a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.540+0000 7faba1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09ca670 0x55f9b0d97a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38142/0 (socket says 172.21.15.63:38142) 2024-09-21T06:36:07.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.540+0000 7faba1d9b640 1 -- 172.21.15.63:0/1419277090 learned_addr learned my addr 172.21.15.63:0/1419277090 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:07.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.540+0000 7faba259c640 1 --2- 172.21.15.63:0/1419277090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9b09c2490 0x55f9b0d97510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.540+0000 7faba1d9b640 1 --2- 172.21.15.63:0/1419277090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09a9cd0 0x55f9b0d93b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.540+0000 7faba1d9b640 1 -- 172.21.15.63:0/1419277090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09a9cd0 msgr2=0x55f9b0d93b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:07.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.540+0000 7faba1d9b640 1 --2- 172.21.15.63:0/1419277090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09a9cd0 0x55f9b0d93b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.540+0000 7faba1d9b640 1 -- 172.21.15.63:0/1419277090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9b09c2490 msgr2=0x55f9b0d97510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:07.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.540+0000 7faba1d9b640 1 --2- 172.21.15.63:0/1419277090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9b09c2490 0x55f9b0d97510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.540+0000 7faba1d9b640 1 -- 172.21.15.63:0/1419277090 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9b0d90860 con 0x55f9b09ca670 2024-09-21T06:36:07.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.541+0000 7faba1d9b640 1 --2- 172.21.15.63:0/1419277090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09ca670 0x55f9b0d97a50 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fab98013460 tx=0x7fab98005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c50a67bb4825503 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:07.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.541+0000 7fab8bfff640 1 -- 172.21.15.63:0/1419277090 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab98019070 con 0x55f9b09ca670 2024-09-21T06:36:07.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.541+0000 7fab8bfff640 1 -- 172.21.15.63:0/1419277090 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab9800fa30 con 0x55f9b09ca670 2024-09-21T06:36:07.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.541+0000 7fab8bfff640 1 -- 172.21.15.63:0/1419277090 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab98013030 con 0x55f9b09ca670 2024-09-21T06:36:07.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.541+0000 7fabaee2f740 1 -- 172.21.15.63:0/1419277090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09ca670 msgr2=0x55f9b0d97a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:07.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.541+0000 7fabaee2f740 1 --2- 172.21.15.63:0/1419277090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09ca670 0x55f9b0d97a50 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fab98013460 tx=0x7fab98005970 comp rx=0 tx=0).stop 2024-09-21T06:36:07.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.541+0000 7fabaee2f740 1 -- 172.21.15.63:0/1419277090 shutdown_connections 2024-09-21T06:36:07.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.541+0000 7fabaee2f740 1 --2- 172.21.15.63:0/1419277090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09ca670 0x55f9b0d97a50 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.541+0000 7fabaee2f740 1 --2- 172.21.15.63:0/1419277090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9b09c2490 0x55f9b0d97510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.541+0000 7fabaee2f740 1 --2- 172.21.15.63:0/1419277090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09a9cd0 0x55f9b0d93b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.541+0000 7fabaee2f740 1 -- 172.21.15.63:0/1419277090 >> 172.21.15.63:0/1419277090 conn(0x55f9b09df740 msgr2=0x55f9b0d93460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:07.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.542+0000 7fabaee2f740 1 -- 172.21.15.63:0/1419277090 shutdown_connections 2024-09-21T06:36:07.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.542+0000 7fabaee2f740 1 -- 172.21.15.63:0/1419277090 wait complete. 2024-09-21T06:36:07.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.542+0000 7fabaee2f740 1 -- start start 2024-09-21T06:36:07.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.542+0000 7fabaee2f740 1 Processor -- start 2024-09-21T06:36:07.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.542+0000 7fabaee2f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09a9cd0 0x55f9b0da6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.542+0000 7fabaee2f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9b09c2490 0x55f9b0da2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.542+0000 7fabaee2f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09ca670 0x55f9b0da2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.542+0000 7fabaee2f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faba41b2e00 con 0x55f9b09a9cd0 2024-09-21T06:36:07.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.542+0000 7fabaee2f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faba41b2730 con 0x55f9b09c2490 2024-09-21T06:36:07.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.542+0000 7fabaee2f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faba41af960 con 0x55f9b09ca670 2024-09-21T06:36:07.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.542+0000 7fabaee2f740 10 client.0 _ll_register_callbacks cb 0x7fab9400c3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:07.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.542+0000 7faba1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09a9cd0 0x55f9b0da6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.542+0000 7faba1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09a9cd0 0x55f9b0da6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38158/0 (socket says 172.21.15.63:38158) 2024-09-21T06:36:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.542+0000 7faba1d9b640 1 -- 172.21.15.63:0/2352466462 learned_addr learned my addr 172.21.15.63:0/2352466462 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.543+0000 7faba259c640 1 --2- 172.21.15.63:0/2352466462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9b09c2490 0x55f9b0da2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.543+0000 7faba1d9b640 1 --2- 172.21.15.63:0/2352466462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09ca670 0x55f9b0da2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.543+0000 7faba1d9b640 1 -- 172.21.15.63:0/2352466462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09ca670 msgr2=0x55f9b0da2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.543+0000 7faba1d9b640 1 --2- 172.21.15.63:0/2352466462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09ca670 0x55f9b0da2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.543+0000 7faba1d9b640 1 -- 172.21.15.63:0/2352466462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9b09c2490 msgr2=0x55f9b0da2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.543+0000 7faba1d9b640 1 --2- 172.21.15.63:0/2352466462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9b09c2490 0x55f9b0da2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.543+0000 7faba1d9b640 1 -- 172.21.15.63:0/2352466462 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9b0da33d0 con 0x55f9b09a9cd0 2024-09-21T06:36:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.543+0000 7faba1d9b640 1 --2- 172.21.15.63:0/2352466462 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09a9cd0 0x55f9b0da6440 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fab9800f690 tx=0x7fab9800b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a2b1df040dd269 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.543+0000 7fab89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.543+0000 7fab89ffb640 1 -- 172.21.15.63:0/2352466462 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab98019070 con 0x55f9b09a9cd0 2024-09-21T06:36:07.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.543+0000 7fab89ffb640 1 -- 172.21.15.63:0/2352466462 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8593+0+0 (secure 0 0 0) 0x7fab98013030 con 0x55f9b09a9cd0 2024-09-21T06:36:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.543+0000 7fabaee2f740 1 -- 172.21.15.63:0/2352466462 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab9800fa30 con 0x55f9b09a9cd0 2024-09-21T06:36:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.543+0000 7fab89ffb640 1 -- 172.21.15.63:0/2352466462 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7fab98013230 con 0x55f9b09a9cd0 2024-09-21T06:36:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.543+0000 7fabaee2f740 10 client.17157 fetch_fsmap learned FSMap version 58 2024-09-21T06:36:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.543+0000 7fabaee2f740 1 -- 172.21.15.63:0/2352466462 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x55f9b0e1b870 con 0x55f9b09a9cd0 2024-09-21T06:36:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.544+0000 7fab89ffb640 1 -- 172.21.15.63:0/2352466462 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab9800fa30 con 0x55f9b09a9cd0 2024-09-21T06:36:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.544+0000 7fab89ffb640 1 -- 172.21.15.63:0/2352466462 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 58) ==== 8374+0+0 (secure 0 0 0) 0x7fab9802b040 con 0x55f9b09a9cd0 2024-09-21T06:36:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.544+0000 7fabaee2f740 10 client.17157 fetch_fsmap finished waiting for FSMap version 58 2024-09-21T06:36:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.544+0000 7fabaee2f740 10 client.17157 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:36:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.544+0000 7fabaee2f740 20 client.17157 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.544+0000 7fabaee2f740 1 --2- 172.21.15.63:0/2352466462 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f9b09eb350 0x55f9b0e1e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.544+0000 7fabaee2f740 4 client.17157 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:36:07.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.544+0000 7fabaee2f740 1 -- 172.21.15.63:0/2352466462 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f9b0d06860 con 0x55f9b09eb350 2024-09-21T06:36:07.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.544+0000 7faba259c640 1 --2- 172.21.15.63:0/2352466462 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f9b09eb350 0x55f9b0e1e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.544+0000 7faba259c640 1 --2- 172.21.15.63:0/2352466462 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f9b09eb350 0x55f9b0e1e000 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b775c42a4b6f3d29 server_cookie=d7e7ebdd16bfb2d6 in_seq=0 out_seq=0 2024-09-21T06:36:07.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.544+0000 7fab89ffb640 10 client.17157 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:07.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.547+0000 7fab89ffb640 1 -- 172.21.15.63:0/2352466462 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f9b0d06860 con 0x55f9b09eb350 2024-09-21T06:36:07.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.547+0000 7fab89ffb640 10 client.17157 handle_command_reply: tid=0 2024-09-21T06:36:07.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.547+0000 7fabaee2f740 1 client.17157 shutdown 2024-09-21T06:36:07.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.547+0000 7fabaee2f740 1 -- 172.21.15.63:0/2352466462 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09a9cd0 msgr2=0x55f9b0da6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:07.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.547+0000 7fabaee2f740 1 --2- 172.21.15.63:0/2352466462 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09a9cd0 0x55f9b0da6440 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fab9800f690 tx=0x7fab9800b6b0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.547+0000 7fabaee2f740 1 -- 172.21.15.63:0/2352466462 shutdown_connections 2024-09-21T06:36:07.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.547+0000 7fabaee2f740 1 --2- 172.21.15.63:0/2352466462 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55f9b09eb350 0x55f9b0e1e000 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.547+0000 7fabaee2f740 1 --2- 172.21.15.63:0/2352466462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f9b09ca670 0x55f9b0da2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.547+0000 7fabaee2f740 1 --2- 172.21.15.63:0/2352466462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9b09c2490 0x55f9b0da2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.547+0000 7fabaee2f740 1 --2- 172.21.15.63:0/2352466462 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f9b09a9cd0 0x55f9b0da6440 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.547+0000 7fab89ffb640 0 client.17157 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:07.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.547+0000 7fabaee2f740 1 -- 172.21.15.63:0/2352466462 >> 172.21.15.63:0/2352466462 conn(0x55f9b09df740 msgr2=0x55f9b0d9f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:07.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.547+0000 7fabaee2f740 1 -- 172.21.15.63:0/2352466462 shutdown_connections 2024-09-21T06:36:07.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.547+0000 7fabaee2f740 1 -- 172.21.15.63:0/2352466462 wait complete. 2024-09-21T06:36:07.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.547+0000 7fabaee2f740 20 client.17157 trim_cache size 0 max 16384 2024-09-21T06:36:07.555 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:36:07.555 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0, 2024-09-21T06:36:07.555 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_tag": "1b9cca6e-2b23-49b2-a894-182a1054bc02", 2024-09-21T06:36:07.555 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": "asynchronous" 2024-09-21T06:36:07.555 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:36:07.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.548+0000 7faba88bb640 1 -- 172.21.15.63:0/3701739 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fab8c0b6680 msgr2=0x7fab8c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:07.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.548+0000 7faba88bb640 1 --2- 172.21.15.63:0/3701739 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fab8c0b6680 0x7fab8c0b8b90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fab9c106540 tx=0x7fab9c0b6040 comp rx=0 tx=0).stop 2024-09-21T06:36:07.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.548+0000 7faba88bb640 1 -- 172.21.15.63:0/3701739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faba4109e10 msgr2=0x7faba4076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:07.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.548+0000 7faba88bb640 1 --2- 172.21.15.63:0/3701739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faba4109e10 0x7faba4076190 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fab9c005cc0 tx=0x7fab9c02f380 comp rx=0 tx=0).stop 2024-09-21T06:36:07.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.548+0000 7faba88bb640 1 -- 172.21.15.63:0/3701739 shutdown_connections 2024-09-21T06:36:07.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.548+0000 7faba88bb640 1 --2- 172.21.15.63:0/3701739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faba4109e10 0x7faba4076190 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.548+0000 7faba88bb640 1 --2- 172.21.15.63:0/3701739 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fab8c0b6680 0x7fab8c0b8b90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.548+0000 7faba88bb640 1 --2- 172.21.15.63:0/3701739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faba41094c0 0x7faba4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.548+0000 7faba88bb640 1 --2- 172.21.15.63:0/3701739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faba4103b80 0x7faba4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.548+0000 7faba88bb640 1 -- 172.21.15.63:0/3701739 >> 172.21.15.63:0/3701739 conn(0x7faba40ff5d0 msgr2=0x7faba41019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.548+0000 7faba88bb640 1 -- 172.21.15.63:0/3701739 shutdown_connections 2024-09-21T06:36:07.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:07.548+0000 7faba88bb640 1 -- 172.21.15.63:0/3701739 wait complete. 2024-09-21T06:36:07.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:07 smithi071 ceph-mon[34844]: pgmap v562: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-21T06:36:07.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:07 smithi175 ceph-mon[34510]: pgmap v562: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-21T06:36:08.285 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:36:08.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:08 smithi063 ceph-mon[31150]: scrub queued for path: / 2024-09-21T06:36:08.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:08 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:08.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:08 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:36:08.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:08 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:36:08.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:08 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:08.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:08 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:08.700 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:08.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:08 smithi071 ceph-mon[34844]: scrub queued for path: / 2024-09-21T06:36:08.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:08 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:08.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:08 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:36:08.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:08 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:36:08.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:08 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:08.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:08 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:08.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:08 smithi175 ceph-mon[34510]: scrub queued for path: / 2024-09-21T06:36:08.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:08 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:08.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:08 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:36:08.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:08 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:36:08.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:08 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:08.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:08 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:09.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.300+0000 7fe64e457640 1 -- 172.21.15.63:0/3367042715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe648075dd0 msgr2=0x7fe6480761e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:09.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.300+0000 7fe64e457640 1 --2- 172.21.15.63:0/3367042715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe648075dd0 0x7fe6480761e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe638009900 tx=0x7fe63802a400 comp rx=0 tx=0).stop 2024-09-21T06:36:09.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.300+0000 7fe64e457640 1 -- 172.21.15.63:0/3367042715 shutdown_connections 2024-09-21T06:36:09.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.300+0000 7fe64e457640 1 --2- 172.21.15.63:0/3367042715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe648114450 0x7fe648116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.300+0000 7fe64e457640 1 --2- 172.21.15.63:0/3367042715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe648075dd0 0x7fe6480761e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.300+0000 7fe64e457640 1 --2- 172.21.15.63:0/3367042715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe648077380 0x7fe6480757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.300+0000 7fe64e457640 1 -- 172.21.15.63:0/3367042715 >> 172.21.15.63:0/3367042715 conn(0x7fe6480ff5d0 msgr2=0x7fe648101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:09.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.301+0000 7fe64e457640 1 -- 172.21.15.63:0/3367042715 shutdown_connections 2024-09-21T06:36:09.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.301+0000 7fe64e457640 1 -- 172.21.15.63:0/3367042715 wait complete. 2024-09-21T06:36:09.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.302+0000 7fe64e457640 1 Processor -- start 2024-09-21T06:36:09.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.303+0000 7fe64e457640 1 -- start start 2024-09-21T06:36:09.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.303+0000 7fe64e457640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe648075dd0 0x7fe648113c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.303+0000 7fe64e457640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe648077380 0x7fe64810cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.303+0000 7fe64e457640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe648114450 0x7fe64810d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.303+0000 7fe64e457640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe64811a0b0 con 0x7fe648075dd0 2024-09-21T06:36:09.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.303+0000 7fe64e457640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe648119f30 con 0x7fe648077380 2024-09-21T06:36:09.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.303+0000 7fe64e457640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe64811a230 con 0x7fe648114450 2024-09-21T06:36:09.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.303+0000 7fe647fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe648075dd0 0x7fe648113c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:09.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.303+0000 7fe647fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe648075dd0 0x7fe648113c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38178/0 (socket says 172.21.15.63:38178) 2024-09-21T06:36:09.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.303+0000 7fe647fff640 1 -- 172.21.15.63:0/4248544090 learned_addr learned my addr 172.21.15.63:0/4248544090 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:09.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.304+0000 7fe647fff640 1 -- 172.21.15.63:0/4248544090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe648114450 msgr2=0x7fe64810d500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:36:09.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.304+0000 7fe647fff640 1 --2- 172.21.15.63:0/4248544090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe648114450 0x7fe64810d500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.304+0000 7fe647fff640 1 -- 172.21.15.63:0/4248544090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe648077380 msgr2=0x7fe64810cf10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:36:09.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.304+0000 7fe63ffff640 1 --2- 172.21.15.63:0/4248544090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe648077380 0x7fe64810cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:09.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.304+0000 7fe647fff640 1 --2- 172.21.15.63:0/4248544090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe648077380 0x7fe64810cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.304+0000 7fe647fff640 1 -- 172.21.15.63:0/4248544090 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64810dd20 con 0x7fe648075dd0 2024-09-21T06:36:09.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.305+0000 7fe647fff640 1 --2- 172.21.15.63:0/4248544090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe648075dd0 0x7fe648113c40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fe63000c890 tx=0x7fe63000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:09.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.306+0000 7fe645ffb640 1 -- 172.21.15.63:0/4248544090 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe630004220 con 0x7fe648075dd0 2024-09-21T06:36:09.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.306+0000 7fe645ffb640 1 -- 172.21.15.63:0/4248544090 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6300043c0 con 0x7fe648075dd0 2024-09-21T06:36:09.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.306+0000 7fe645ffb640 1 -- 172.21.15.63:0/4248544090 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe630004a00 con 0x7fe648075dd0 2024-09-21T06:36:09.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.306+0000 7fe64e457640 1 -- 172.21.15.63:0/4248544090 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6481129d0 con 0x7fe648075dd0 2024-09-21T06:36:09.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.306+0000 7fe64e457640 1 -- 172.21.15.63:0/4248544090 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe648112e90 con 0x7fe648075dd0 2024-09-21T06:36:09.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.310+0000 7fe6549cb740 1 Processor -- start 2024-09-21T06:36:09.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.311+0000 7fe6549cb740 1 -- start start 2024-09-21T06:36:09.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.312+0000 7fe6549cb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710ab0070 0x558710e57650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.312+0000 7fe6549cb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a871b0 0x558710e57b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.312+0000 7fe6549cb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558710a8f390 0x558710e580d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.313+0000 7fe6549cb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558710dcde50 con 0x558710a871b0 2024-09-21T06:36:09.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.313+0000 7fe6549cb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558710dbd280 con 0x558710ab0070 2024-09-21T06:36:09.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.313+0000 7fe6549cb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558710dc1090 con 0x558710a8f390 2024-09-21T06:36:09.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.313+0000 7fe64c9f4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710ab0070 0x558710e57650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:09.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.313+0000 7fe64c9f4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710ab0070 0x558710e57650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:40670/0 (socket says 172.21.15.63:40670) 2024-09-21T06:36:09.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.313+0000 7fe64c9f4640 1 -- 172.21.15.63:0/4221397634 learned_addr learned my addr 172.21.15.63:0/4221397634 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:09.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.313+0000 7fe63ffff640 1 --2- 172.21.15.63:0/4221397634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558710a8f390 0x558710e580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:09.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.314+0000 7fe645ffb640 1 -- 172.21.15.63:0/4248544090 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fe6300079b0 con 0x7fe648075dd0 2024-09-21T06:36:09.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.314+0000 7fe647fff640 1 --2- 172.21.15.63:0/4221397634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a871b0 0x558710e57b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:09.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.314+0000 7fe647fff640 1 -- 172.21.15.63:0/4221397634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558710a8f390 msgr2=0x558710e580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:09.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.314+0000 7fe647fff640 1 --2- 172.21.15.63:0/4221397634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558710a8f390 0x558710e580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.314+0000 7fe647fff640 1 -- 172.21.15.63:0/4221397634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710ab0070 msgr2=0x558710e57650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:09.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.314+0000 7fe647fff640 1 --2- 172.21.15.63:0/4221397634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710ab0070 0x558710e57650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.314+0000 7fe647fff640 1 -- 172.21.15.63:0/4221397634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558710b1b650 con 0x558710a871b0 2024-09-21T06:36:09.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.315+0000 7fe645ffb640 1 --2- 172.21.15.63:0/4248544090 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe6340b6850 0x7fe6340b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.315+0000 7fe645ffb640 1 -- 172.21.15.63:0/4248544090 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8637+0+0 (secure 0 0 0) 0x7fe6300e7470 con 0x7fe648075dd0 2024-09-21T06:36:09.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.316+0000 7fe647fff640 1 --2- 172.21.15.63:0/4221397634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a871b0 0x558710e57b90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fe6300e4af0 tx=0x7fe6300edab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7838b85646bb5011 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:09.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.316+0000 7fe64c9f4640 1 --2- 172.21.15.63:0/4248544090 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe6340b6850 0x7fe6340b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:09.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.318+0000 7fe63e7fc640 1 -- 172.21.15.63:0/4221397634 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63001d030 con 0x558710a871b0 2024-09-21T06:36:09.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.318+0000 7fe64c9f4640 1 --2- 172.21.15.63:0/4248544090 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe6340b6850 0x7fe6340b8d60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe640005c40 tx=0x7fe640009580 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:09.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.318+0000 7fe63e7fc640 1 -- 172.21.15.63:0/4221397634 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6300acd00 con 0x558710a871b0 2024-09-21T06:36:09.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.318+0000 7fe63e7fc640 1 -- 172.21.15.63:0/4221397634 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6300a9840 con 0x558710a871b0 2024-09-21T06:36:09.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.319+0000 7fe6549cb740 1 -- 172.21.15.63:0/4221397634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a871b0 msgr2=0x558710e57b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:09.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.319+0000 7fe6549cb740 1 --2- 172.21.15.63:0/4221397634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a871b0 0x558710e57b90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fe6300e4af0 tx=0x7fe6300edab0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.319+0000 7fe6549cb740 1 -- 172.21.15.63:0/4221397634 shutdown_connections 2024-09-21T06:36:09.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.319+0000 7fe6549cb740 1 --2- 172.21.15.63:0/4221397634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558710a8f390 0x558710e580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.319+0000 7fe6549cb740 1 --2- 172.21.15.63:0/4221397634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a871b0 0x558710e57b90 secure :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fe6300e4af0 tx=0x7fe6300edab0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.319+0000 7fe6549cb740 1 --2- 172.21.15.63:0/4221397634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710ab0070 0x558710e57650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.319+0000 7fe6549cb740 1 -- 172.21.15.63:0/4221397634 >> 172.21.15.63:0/4221397634 conn(0x558710aa4460 msgr2=0x558710e55540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:09.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.320+0000 7fe6549cb740 1 -- 172.21.15.63:0/4221397634 shutdown_connections 2024-09-21T06:36:09.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.320+0000 7fe6549cb740 1 -- 172.21.15.63:0/4221397634 wait complete. 2024-09-21T06:36:09.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.320+0000 7fe6549cb740 1 -- start start 2024-09-21T06:36:09.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.321+0000 7fe6549cb740 1 Processor -- start 2024-09-21T06:36:09.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.321+0000 7fe6549cb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710a8f390 0x558710e62e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.321+0000 7fe6549cb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558710ab0070 0x558710e63380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.321+0000 7fe6549cb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a6e9f0 0x558710e6f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.322+0000 7fe6549cb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558710c1e700 con 0x558710a6e9f0 2024-09-21T06:36:09.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.322+0000 7fe6549cb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558710d58110 con 0x558710a8f390 2024-09-21T06:36:09.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.322+0000 7fe6549cb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558710e65e30 con 0x558710ab0070 2024-09-21T06:36:09.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.322+0000 7fe6549cb740 10 client.0 _ll_register_callbacks cb 0x558710d71990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:09.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.322+0000 7fe64c9f4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a6e9f0 0x558710e6f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:09.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.322+0000 7fe64c9f4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a6e9f0 0x558710e6f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38198/0 (socket says 172.21.15.63:38198) 2024-09-21T06:36:09.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.322+0000 7fe64c9f4640 1 -- 172.21.15.63:0/134612226 learned_addr learned my addr 172.21.15.63:0/134612226 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:09.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.322+0000 7fe647fff640 1 --2- 172.21.15.63:0/134612226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710a8f390 0x558710e62e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:09.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.322+0000 7fe63ffff640 1 --2- 172.21.15.63:0/134612226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558710ab0070 0x558710e63380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:09.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.322+0000 7fe64c9f4640 1 -- 172.21.15.63:0/134612226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558710ab0070 msgr2=0x558710e63380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:09.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.322+0000 7fe64c9f4640 1 --2- 172.21.15.63:0/134612226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558710ab0070 0x558710e63380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.322+0000 7fe64c9f4640 1 -- 172.21.15.63:0/134612226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710a8f390 msgr2=0x558710e62e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:09.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.322+0000 7fe64c9f4640 1 --2- 172.21.15.63:0/134612226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710a8f390 0x558710e62e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.322+0000 7fe64c9f4640 1 -- 172.21.15.63:0/134612226 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558710d85c40 con 0x558710a6e9f0 2024-09-21T06:36:09.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.324+0000 7fe64c9f4640 1 --2- 172.21.15.63:0/134612226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a6e9f0 0x558710e6f1b0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fe640012700 tx=0x7fe640004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06469a6ff1a551c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:09.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.324+0000 7fe6277fe640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:09.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.325+0000 7fe6277fe640 1 -- 172.21.15.63:0/134612226 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe640003b70 con 0x558710a6e9f0 2024-09-21T06:36:09.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.325+0000 7fe6277fe640 1 -- 172.21.15.63:0/134612226 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8637+0+0 (secure 0 0 0) 0x7fe640003d10 con 0x558710a6e9f0 2024-09-21T06:36:09.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.326+0000 7fe6549cb740 1 -- 172.21.15.63:0/134612226 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6300acd00 con 0x558710a6e9f0 2024-09-21T06:36:09.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.326+0000 7fe6277fe640 1 -- 172.21.15.63:0/134612226 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7fe64001d790 con 0x558710a6e9f0 2024-09-21T06:36:09.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.326+0000 7fe6549cb740 10 client.17169 fetch_fsmap learned FSMap version 58 2024-09-21T06:36:09.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.326+0000 7fe6549cb740 1 -- 172.21.15.63:0/134612226 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x558710e71d00 con 0x558710a6e9f0 2024-09-21T06:36:09.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.328+0000 7fe6277fe640 1 -- 172.21.15.63:0/134612226 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6300acd00 con 0x558710a6e9f0 2024-09-21T06:36:09.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.328+0000 7fe6277fe640 1 -- 172.21.15.63:0/134612226 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 58) ==== 8374+0+0 (secure 0 0 0) 0x7fe64000f040 con 0x558710a6e9f0 2024-09-21T06:36:09.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.328+0000 7fe6549cb740 10 client.17169 fetch_fsmap finished waiting for FSMap version 58 2024-09-21T06:36:09.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.328+0000 7fe6549cb740 10 client.17169 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:36:09.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.328+0000 7fe6549cb740 20 client.17169 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:09.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.329+0000 7fe6549cb740 1 --2- 172.21.15.63:0/134612226 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x558710a43da0 0x558710e75260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.329+0000 7fe6549cb740 4 client.17169 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:09.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.329+0000 7fe6549cb740 1 -- 172.21.15.63:0/134612226 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558710dcfda0 con 0x558710a43da0 2024-09-21T06:36:09.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.330+0000 7fe647fff640 1 --2- 172.21.15.63:0/134612226 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x558710a43da0 0x558710e75260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:09.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.332+0000 7fe647fff640 1 --2- 172.21.15.63:0/134612226 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x558710a43da0 0x558710e75260 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21b4a7ffb030f43a server_cookie=cead685f7a8c6e98 in_seq=0 out_seq=0 2024-09-21T06:36:09.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.332+0000 7fe6277fe640 10 client.17169 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:09.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.334+0000 7fe6277fe640 1 -- 172.21.15.63:0/134612226 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558710dcfda0 con 0x558710a43da0 2024-09-21T06:36:09.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.334+0000 7fe6277fe640 10 client.17169 handle_command_reply: tid=0 2024-09-21T06:36:09.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.334+0000 7fe6549cb740 1 client.17169 shutdown 2024-09-21T06:36:09.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.335+0000 7fe6549cb740 1 -- 172.21.15.63:0/134612226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a6e9f0 msgr2=0x558710e6f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:09.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.335+0000 7fe6549cb740 1 --2- 172.21.15.63:0/134612226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a6e9f0 0x558710e6f1b0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fe640012700 tx=0x7fe640004ab0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.335+0000 7fe6549cb740 1 -- 172.21.15.63:0/134612226 shutdown_connections 2024-09-21T06:36:09.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.335+0000 7fe6549cb740 1 --2- 172.21.15.63:0/134612226 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x558710a43da0 0x558710e75260 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.335+0000 7fe6549cb740 1 --2- 172.21.15.63:0/134612226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a6e9f0 0x558710e6f1b0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.335+0000 7fe6549cb740 1 --2- 172.21.15.63:0/134612226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558710ab0070 0x558710e63380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.335+0000 7fe6549cb740 1 --2- 172.21.15.63:0/134612226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710a8f390 0x558710e62e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.335+0000 7fe6549cb740 1 -- 172.21.15.63:0/134612226 >> 172.21.15.63:0/134612226 conn(0x558710aa4460 msgr2=0x558710e5a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:09.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.336+0000 7fe6277fe640 0 client.17169 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:09.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.336+0000 7fe6549cb740 1 -- 172.21.15.63:0/134612226 shutdown_connections 2024-09-21T06:36:09.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.336+0000 7fe6549cb740 1 -- 172.21.15.63:0/134612226 wait complete. 2024-09-21T06:36:09.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.337+0000 7fe6549cb740 20 client.17169 trim_cache size 0 max 16384 2024-09-21T06:36:09.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.372+0000 7fe6549cb740 1 Processor -- start 2024-09-21T06:36:09.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.373+0000 7fe6549cb740 1 -- start start 2024-09-21T06:36:09.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.373+0000 7fe6549cb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a6e9f0 0x558710e55570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.373+0000 7fe6549cb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558710a8f390 0x558710e6f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.373+0000 7fe6549cb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710ab0070 0x558710e6f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.373+0000 7fe6549cb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe62800e9c0 con 0x558710a6e9f0 2024-09-21T06:36:09.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.373+0000 7fe6549cb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe628010530 con 0x558710ab0070 2024-09-21T06:36:09.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.373+0000 7fe6549cb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe62800f090 con 0x558710a8f390 2024-09-21T06:36:09.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.373+0000 7fe63ffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558710a8f390 0x558710e6f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:09.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.374+0000 7fe647fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a6e9f0 0x558710e55570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:09.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.374+0000 7fe647fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a6e9f0 0x558710e55570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38204/0 (socket says 172.21.15.63:38204) 2024-09-21T06:36:09.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.374+0000 7fe647fff640 1 -- 172.21.15.63:0/3955554271 learned_addr learned my addr 172.21.15.63:0/3955554271 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:09.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.375+0000 7fe647fff640 1 -- 172.21.15.63:0/3955554271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558710a8f390 msgr2=0x558710e6f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:09.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.375+0000 7fe647fff640 1 --2- 172.21.15.63:0/3955554271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558710a8f390 0x558710e6f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.375+0000 7fe647fff640 1 -- 172.21.15.63:0/3955554271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710ab0070 msgr2=0x558710e6f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:09.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.375+0000 7fe647fff640 1 --2- 172.21.15.63:0/3955554271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710ab0070 0x558710e6f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.375+0000 7fe647fff640 1 -- 172.21.15.63:0/3955554271 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558710e61da0 con 0x558710a6e9f0 2024-09-21T06:36:09.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.375+0000 7fe647fff640 1 --2- 172.21.15.63:0/3955554271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a6e9f0 0x558710e55570 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fe6300054c0 tx=0x7fe6300eaf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19800331e0ceb19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:09.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.376+0000 7fe63dffb640 1 -- 172.21.15.63:0/3955554271 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe630098070 con 0x558710a6e9f0 2024-09-21T06:36:09.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.376+0000 7fe63dffb640 1 -- 172.21.15.63:0/3955554271 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6300ad8f0 con 0x558710a6e9f0 2024-09-21T06:36:09.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.376+0000 7fe63dffb640 1 -- 172.21.15.63:0/3955554271 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6300b6e60 con 0x558710a6e9f0 2024-09-21T06:36:09.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.377+0000 7fe6549cb740 1 -- 172.21.15.63:0/3955554271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a6e9f0 msgr2=0x558710e55570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:09.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.377+0000 7fe6549cb740 1 --2- 172.21.15.63:0/3955554271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a6e9f0 0x558710e55570 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fe6300054c0 tx=0x7fe6300eaf90 comp rx=0 tx=0).stop 2024-09-21T06:36:09.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.377+0000 7fe6549cb740 1 -- 172.21.15.63:0/3955554271 shutdown_connections 2024-09-21T06:36:09.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.377+0000 7fe6549cb740 1 --2- 172.21.15.63:0/3955554271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710ab0070 0x558710e6f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.377+0000 7fe6549cb740 1 --2- 172.21.15.63:0/3955554271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558710a8f390 0x558710e6f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.377+0000 7fe6549cb740 1 --2- 172.21.15.63:0/3955554271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a6e9f0 0x558710e55570 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.377+0000 7fe6549cb740 1 -- 172.21.15.63:0/3955554271 >> 172.21.15.63:0/3955554271 conn(0x558710aa4460 msgr2=0x558710e54e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:09.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.377+0000 7fe6549cb740 1 -- 172.21.15.63:0/3955554271 shutdown_connections 2024-09-21T06:36:09.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.377+0000 7fe6549cb740 1 -- 172.21.15.63:0/3955554271 wait complete. 2024-09-21T06:36:09.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.378+0000 7fe6549cb740 1 -- start start 2024-09-21T06:36:09.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.378+0000 7fe6549cb740 1 Processor -- start 2024-09-21T06:36:09.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.380+0000 7fe6549cb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558710a6e9f0 0x558710e671c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.380+0000 7fe6549cb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a8f390 0x558710e67700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.380+0000 7fe6549cb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710ab0070 0x558710e67c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.380+0000 7fe6549cb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe62800fe60 con 0x558710a8f390 2024-09-21T06:36:09.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.380+0000 7fe6549cb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe62800f790 con 0x558710ab0070 2024-09-21T06:36:09.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.380+0000 7fe6549cb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe62800c9c0 con 0x558710a6e9f0 2024-09-21T06:36:09.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.380+0000 7fe6549cb740 10 client.0 _ll_register_callbacks cb 0x7fe640009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:09.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.380+0000 7fe64c9f4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710ab0070 0x558710e67c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:09.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.380+0000 7fe64c9f4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710ab0070 0x558710e67c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:40702/0 (socket says 172.21.15.63:40702) 2024-09-21T06:36:09.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.381+0000 7fe64c9f4640 1 -- 172.21.15.63:0/1858137813 learned_addr learned my addr 172.21.15.63:0/1858137813 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:09.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.381+0000 7fe647fff640 1 --2- 172.21.15.63:0/1858137813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558710a6e9f0 0x558710e671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:09.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.381+0000 7fe63ffff640 1 --2- 172.21.15.63:0/1858137813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a8f390 0x558710e67700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:09.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.382+0000 7fe64c9f4640 1 -- 172.21.15.63:0/1858137813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558710a6e9f0 msgr2=0x558710e671c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:09.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.382+0000 7fe64c9f4640 1 --2- 172.21.15.63:0/1858137813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558710a6e9f0 0x558710e671c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.382+0000 7fe64c9f4640 1 -- 172.21.15.63:0/1858137813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a8f390 msgr2=0x558710e67700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:09.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.382+0000 7fe64c9f4640 1 --2- 172.21.15.63:0/1858137813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a8f390 0x558710e67700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.382+0000 7fe64c9f4640 1 -- 172.21.15.63:0/1858137813 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558710e5e6d0 con 0x558710ab0070 2024-09-21T06:36:09.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.383+0000 7fe64c9f4640 1 --2- 172.21.15.63:0/1858137813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710ab0070 0x558710e67c40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe640005bf0 tx=0x7fe64001dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4974b0a3f221540 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:09.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.383+0000 7fe6277fe640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:36:09.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.385+0000 7fe6277fe640 1 -- 172.21.15.63:0/1858137813 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe640036070 con 0x558710ab0070 2024-09-21T06:36:09.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.385+0000 7fe6277fe640 1 -- 172.21.15.63:0/1858137813 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8637+0+0 (secure 0 0 0) 0x7fe640004bc0 con 0x558710ab0070 2024-09-21T06:36:09.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.387+0000 7fe6549cb740 1 -- 172.21.15.63:0/1858137813 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6300ad8f0 con 0x558710ab0070 2024-09-21T06:36:09.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.387+0000 7fe6277fe640 1 -- 172.21.15.63:0/1858137813 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7fe640009ac0 con 0x558710ab0070 2024-09-21T06:36:09.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.388+0000 7fe6549cb740 10 client.26711 fetch_fsmap learned FSMap version 58 2024-09-21T06:36:09.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.388+0000 7fe6549cb740 1 -- 172.21.15.63:0/1858137813 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x558710edfdf0 con 0x558710ab0070 2024-09-21T06:36:09.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.388+0000 7fe6277fe640 1 -- 172.21.15.63:0/1858137813 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe640004e00 con 0x558710ab0070 2024-09-21T06:36:09.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.390+0000 7fe6277fe640 1 -- 172.21.15.63:0/1858137813 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 58) ==== 8374+0+0 (secure 0 0 0) 0x7fe640005450 con 0x558710ab0070 2024-09-21T06:36:09.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.390+0000 7fe6549cb740 10 client.26711 fetch_fsmap finished waiting for FSMap version 58 2024-09-21T06:36:09.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.390+0000 7fe6549cb740 10 client.26711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:36:09.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.390+0000 7fe6549cb740 20 client.26711 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:09.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.390+0000 7fe6549cb740 1 --2- 172.21.15.63:0/1858137813 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x558710ee0540 0x558710ee2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.392 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:09 smithi063 ceph-mon[31150]: pgmap v563: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-21T06:36:09.392 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:09 smithi063 ceph-mon[31150]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T06:36:09.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.390+0000 7fe6549cb740 4 client.26711 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:36:09.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.390+0000 7fe647fff640 1 --2- 172.21.15.63:0/1858137813 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x558710ee0540 0x558710ee2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:09.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.391+0000 7fe6549cb740 1 -- 172.21.15.63:0/1858137813 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fe6300ad8f0 con 0x558710ee0540 2024-09-21T06:36:09.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.392+0000 7fe647fff640 1 --2- 172.21.15.63:0/1858137813 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x558710ee0540 0x558710ee2960 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=777ef9e78497763c server_cookie=1f23247efbd5eb4d in_seq=0 out_seq=0 2024-09-21T06:36:09.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.392+0000 7fe6277fe640 10 client.26711 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:09.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.393+0000 7fe6277fe640 1 -- 172.21.15.63:0/1858137813 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x7fe6300ad8f0 con 0x558710ee0540 2024-09-21T06:36:09.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.393+0000 7fe6277fe640 10 client.26711 handle_command_reply: tid=0 2024-09-21T06:36:09.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.393+0000 7fe6549cb740 1 client.26711 shutdown 2024-09-21T06:36:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.396+0000 7fe6549cb740 1 -- 172.21.15.63:0/1858137813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710ab0070 msgr2=0x558710e67c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.396+0000 7fe6549cb740 1 --2- 172.21.15.63:0/1858137813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710ab0070 0x558710e67c40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe640005bf0 tx=0x7fe64001dbe0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.396+0000 7fe6549cb740 1 -- 172.21.15.63:0/1858137813 shutdown_connections 2024-09-21T06:36:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.396+0000 7fe6549cb740 1 --2- 172.21.15.63:0/1858137813 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x558710ee0540 0x558710ee2960 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.396+0000 7fe6549cb740 1 --2- 172.21.15.63:0/1858137813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558710ab0070 0x558710e67c40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.396+0000 7fe6549cb740 1 --2- 172.21.15.63:0/1858137813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558710a8f390 0x558710e67700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.396+0000 7fe6549cb740 1 --2- 172.21.15.63:0/1858137813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558710a6e9f0 0x558710e671c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.396+0000 7fe6549cb740 1 -- 172.21.15.63:0/1858137813 >> 172.21.15.63:0/1858137813 conn(0x558710aa4460 msgr2=0x558710e5a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.396+0000 7fe6277fe640 0 client.26711 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:09.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.398+0000 7fe6549cb740 1 -- 172.21.15.63:0/1858137813 shutdown_connections 2024-09-21T06:36:09.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.398+0000 7fe6549cb740 1 -- 172.21.15.63:0/1858137813 wait complete. 2024-09-21T06:36:09.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.399+0000 7fe6549cb740 20 client.26711 trim_cache size 0 max 16384 2024-09-21T06:36:09.401 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:36:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:36:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": { 2024-09-21T06:36:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: "1b9cca6e-2b23-49b2-a894-182a1054bc02": { 2024-09-21T06:36:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: "tag": "1b9cca6e-2b23-49b2-a894-182a1054bc02", 2024-09-21T06:36:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: "options": "recursive,force" 2024-09-21T06:36:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:36:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:36:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "0c926bc7-90f8-47ce-a0d2-d02e676a73e9": { 2024-09-21T06:36:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:35:22.494015+0000", 2024-09-21T06:36:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "4f099144-5170-453b-a745-ddc222860f34": { 2024-09-21T06:36:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:34:35.417817+0000", 2024-09-21T06:36:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "91ae0a75-6a3f-452f-8bda-0f19862a5724": { 2024-09-21T06:36:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:50.316590+0000", 2024-09-21T06:36:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "5396028b-35f4-48fe-b54d-385784e97de3": { 2024-09-21T06:36:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:04.523378+0000", 2024-09-21T06:36:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "1b9cca6e-2b23-49b2-a894-182a1054bc02": { 2024-09-21T06:36:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:36:07.545253+0000", 2024-09-21T06:36:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "024d3c59-0b67-49a9-bf4a-e02d36691942": { 2024-09-21T06:36:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:32:14.282244+0000", 2024-09-21T06:36:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:36:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:31:27.507051+0000", 2024-09-21T06:36:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:36:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:36:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:36:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:36:09.406 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:36:09.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.401+0000 7fe64e457640 1 -- 172.21.15.63:0/4248544090 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe6340b6850 msgr2=0x7fe6340b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:09.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.401+0000 7fe64e457640 1 --2- 172.21.15.63:0/4248544090 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe6340b6850 0x7fe6340b8d60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe640005c40 tx=0x7fe640009580 comp rx=0 tx=0).stop 2024-09-21T06:36:09.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.401+0000 7fe64e457640 1 -- 172.21.15.63:0/4248544090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe648075dd0 msgr2=0x7fe648113c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:09.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.401+0000 7fe64e457640 1 --2- 172.21.15.63:0/4248544090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe648075dd0 0x7fe648113c40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fe63000c890 tx=0x7fe63000cd50 comp rx=0 tx=0).stop 2024-09-21T06:36:09.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.402+0000 7fe64e457640 1 -- 172.21.15.63:0/4248544090 shutdown_connections 2024-09-21T06:36:09.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.402+0000 7fe64e457640 1 --2- 172.21.15.63:0/4248544090 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe6340b6850 0x7fe6340b8d60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.402+0000 7fe64e457640 1 --2- 172.21.15.63:0/4248544090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe648114450 0x7fe64810d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.402+0000 7fe64e457640 1 --2- 172.21.15.63:0/4248544090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe648077380 0x7fe64810cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.402+0000 7fe64e457640 1 --2- 172.21.15.63:0/4248544090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe648075dd0 0x7fe648113c40 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.402+0000 7fe64e457640 1 -- 172.21.15.63:0/4248544090 >> 172.21.15.63:0/4248544090 conn(0x7fe6480ff5d0 msgr2=0x7fe6481035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:09.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.404+0000 7fe64e457640 1 -- 172.21.15.63:0/4248544090 shutdown_connections 2024-09-21T06:36:09.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:09.404+0000 7fe64e457640 1 -- 172.21.15.63:0/4248544090 wait complete. 2024-09-21T06:36:09.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:09 smithi071 ceph-mon[34844]: pgmap v563: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-21T06:36:09.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:09 smithi071 ceph-mon[34844]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T06:36:09.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:09 smithi175 ceph-mon[34510]: pgmap v563: 97 pgs: 97 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-21T06:36:09.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:09 smithi175 ceph-mon[34510]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T06:36:10.092 INFO:tasks.cephfs.filesystem:scrub status for tag:1b9cca6e-2b23-49b2-a894-182a1054bc02 - {'path': '/', 'tag': '1b9cca6e-2b23-49b2-a894-182a1054bc02', 'options': 'recursive,force'} 2024-09-21T06:36:11.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:11 smithi071 ceph-mon[34844]: pgmap v565: 97 pgs: 3 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 89 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-09-21T06:36:11.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:11 smithi063 ceph-mon[31150]: pgmap v565: 97 pgs: 3 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 89 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-09-21T06:36:11.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:11 smithi175 ceph-mon[34510]: pgmap v565: 97 pgs: 3 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 89 active+clean; 257 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-09-21T06:36:13.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:13 smithi071 ceph-mon[34844]: pgmap v566: 97 pgs: 3 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 89 active+clean; 254 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-21T06:36:13.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:13 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:36:13.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:13 smithi063 ceph-mon[31150]: pgmap v566: 97 pgs: 3 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 89 active+clean; 254 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-21T06:36:13.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:13 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:36:13.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:13 smithi175 ceph-mon[34510]: pgmap v566: 97 pgs: 3 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 89 active+clean; 254 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-21T06:36:13.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:13 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:36:14.770 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:14 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:36:14.837 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:14 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:36:14.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:14 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:36:15.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:15 smithi071 ceph-mon[34844]: pgmap v567: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T06:36:15.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:15 smithi063 ceph-mon[31150]: pgmap v567: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T06:36:15.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:15 smithi175 ceph-mon[34510]: pgmap v567: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T06:36:17.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:17 smithi071 ceph-mon[34844]: pgmap v568: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 204 B/s wr, 11 op/s 2024-09-21T06:36:17.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:17 smithi063 ceph-mon[31150]: pgmap v568: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 204 B/s wr, 11 op/s 2024-09-21T06:36:17.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:17 smithi175 ceph-mon[34510]: pgmap v568: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 204 B/s wr, 11 op/s 2024-09-21T06:36:19.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:19 smithi071 ceph-mon[34844]: pgmap v569: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 204 B/s wr, 11 op/s 2024-09-21T06:36:19.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:19 smithi071 ceph-mon[34844]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T06:36:19.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:19 smithi063 ceph-mon[31150]: pgmap v569: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 204 B/s wr, 11 op/s 2024-09-21T06:36:19.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:19 smithi063 ceph-mon[31150]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T06:36:19.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:19 smithi175 ceph-mon[34510]: pgmap v569: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 204 B/s wr, 11 op/s 2024-09-21T06:36:19.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:19 smithi175 ceph-mon[34510]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T06:36:21.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:21 smithi071 ceph-mon[34844]: pgmap v571: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:36:21.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:21 smithi063 ceph-mon[31150]: pgmap v571: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:36:21.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:21 smithi175 ceph-mon[34510]: pgmap v571: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:36:23.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:23 smithi071 ceph-mon[34844]: pgmap v572: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:36:23.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:23 smithi063 ceph-mon[31150]: pgmap v572: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:36:23.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:23 smithi175 ceph-mon[34510]: pgmap v572: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:36:25.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:25 smithi071 ceph-mon[34844]: pgmap v573: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:36:25.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:25 smithi063 ceph-mon[31150]: pgmap v573: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:36:25.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:25 smithi175 ceph-mon[34510]: pgmap v573: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:36:27.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:27 smithi071 ceph-mon[34844]: pgmap v574: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:36:27.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:27 smithi063 ceph-mon[31150]: pgmap v574: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:36:27.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:27 smithi175 ceph-mon[34510]: pgmap v574: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:36:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:29 smithi071 ceph-mon[34844]: pgmap v575: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T06:36:29.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:29 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:36:29.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:29 smithi063 ceph-mon[31150]: pgmap v575: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T06:36:29.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:29 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:36:29.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:29 smithi175 ceph-mon[34510]: pgmap v575: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T06:36:29.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:29 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:36:31.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:31 smithi071 ceph-mon[34844]: pgmap v576: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 op/s 2024-09-21T06:36:31.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:31 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:36:31.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:31 smithi063 ceph-mon[31150]: pgmap v576: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 op/s 2024-09-21T06:36:31.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:31 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:36:31.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:31 smithi175 ceph-mon[34510]: pgmap v576: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 op/s 2024-09-21T06:36:31.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:31 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:36:33.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:33 smithi071 ceph-mon[34844]: pgmap v577: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:36:33.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:36:33.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:36:33.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:36:33.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:33 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:36:33.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:33 smithi063 ceph-mon[31150]: pgmap v577: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:36:33.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:36:33.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:36:33.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:36:33.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:33 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:36:33.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:33 smithi175 ceph-mon[34510]: pgmap v577: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:36:33.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:36:33.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:36:33.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:36:33.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:33 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:36:34.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:34 smithi071 ceph-mon[34844]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:36:34.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:34 smithi063 ceph-mon[31150]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:36:34.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:34 smithi175 ceph-mon[34510]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T06:36:35.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:35 smithi071 ceph-mon[34844]: pgmap v578: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:36:35.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:35 smithi063 ceph-mon[31150]: pgmap v578: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:36:35.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:35 smithi175 ceph-mon[34510]: pgmap v578: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:36:37.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:37 smithi071 ceph-mon[34844]: pgmap v579: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:36:37.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:37 smithi063 ceph-mon[31150]: pgmap v579: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:36:37.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:37 smithi175 ceph-mon[34510]: pgmap v579: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:36:39.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:39 smithi071 ceph-mon[34844]: pgmap v580: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:36:39.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:39 smithi063 ceph-mon[31150]: pgmap v580: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:36:39.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:39 smithi175 ceph-mon[34510]: pgmap v580: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:36:40.092 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:36:40.367 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:40.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.978+0000 7fea7bdbd640 1 -- 172.21.15.63:0/1788204117 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea740757b0 msgr2=0x7fea74075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:40.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.978+0000 7fea7bdbd640 1 --2- 172.21.15.63:0/1788204117 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea740757b0 0x7fea74075bc0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fea70009900 tx=0x7fea7002a410 comp rx=0 tx=0).stop 2024-09-21T06:36:40.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.978+0000 7fea7bdbd640 1 -- 172.21.15.63:0/1788204117 shutdown_connections 2024-09-21T06:36:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.978+0000 7fea7bdbd640 1 --2- 172.21.15.63:0/1788204117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea741100c0 0x7fea74112500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.978+0000 7fea7bdbd640 1 --2- 172.21.15.63:0/1788204117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea74076100 0x7fea7410fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.978+0000 7fea7bdbd640 1 --2- 172.21.15.63:0/1788204117 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea740757b0 0x7fea74075bc0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.978+0000 7fea7bdbd640 1 -- 172.21.15.63:0/1788204117 >> 172.21.15.63:0/1788204117 conn(0x7fea7407b850 msgr2=0x7fea7407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.978+0000 7fea7bdbd640 1 -- 172.21.15.63:0/1788204117 shutdown_connections 2024-09-21T06:36:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.978+0000 7fea7bdbd640 1 -- 172.21.15.63:0/1788204117 wait complete. 2024-09-21T06:36:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.978+0000 7fea7bdbd640 1 Processor -- start 2024-09-21T06:36:40.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.979+0000 7fea7bdbd640 1 -- start start 2024-09-21T06:36:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.979+0000 7fea7bdbd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea740757b0 0x7fea7419c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.979+0000 7fea7bdbd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea74076100 0x7fea7419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.979+0000 7fea7bdbd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea741100c0 0x7fea741a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.979+0000 7fea7bdbd640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fea74115cd0 con 0x7fea741100c0 2024-09-21T06:36:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.979+0000 7fea7bdbd640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fea74115b50 con 0x7fea74076100 2024-09-21T06:36:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.979+0000 7fea7bdbd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fea74115e50 con 0x7fea740757b0 2024-09-21T06:36:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.979+0000 7fea7a35a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea741100c0 0x7fea741a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.979+0000 7fea7a35a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea741100c0 0x7fea741a1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55118/0 (socket says 172.21.15.63:55118) 2024-09-21T06:36:40.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.979+0000 7fea7a35a640 1 -- 172.21.15.63:0/1379092669 learned_addr learned my addr 172.21.15.63:0/1379092669 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:40.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.979+0000 7fea79b59640 1 --2- 172.21.15.63:0/1379092669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea740757b0 0x7fea7419c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:40.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.979+0000 7fea79358640 1 --2- 172.21.15.63:0/1379092669 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea74076100 0x7fea7419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:40.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.979+0000 7fea7a35a640 1 -- 172.21.15.63:0/1379092669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea740757b0 msgr2=0x7fea7419c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:40.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.979+0000 7fea7a35a640 1 --2- 172.21.15.63:0/1379092669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea740757b0 0x7fea7419c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:40.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.979+0000 7fea7a35a640 1 -- 172.21.15.63:0/1379092669 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea74076100 msgr2=0x7fea7419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:40.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.979+0000 7fea7a35a640 1 --2- 172.21.15.63:0/1379092669 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea74076100 0x7fea7419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:40.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.979+0000 7fea7a35a640 1 -- 172.21.15.63:0/1379092669 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea741a2670 con 0x7fea741100c0 2024-09-21T06:36:40.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.980+0000 7fea7a35a640 1 --2- 172.21.15.63:0/1379092669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea741100c0 0x7fea741a1f40 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00cad0 tx=0x7fea6c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:40.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.980+0000 7fea6affd640 1 -- 172.21.15.63:0/1379092669 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c00ae20 con 0x7fea741100c0 2024-09-21T06:36:40.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.980+0000 7fea7bdbd640 1 -- 172.21.15.63:0/1379092669 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea741a2960 con 0x7fea741100c0 2024-09-21T06:36:40.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.980+0000 7fea6affd640 1 -- 172.21.15.63:0/1379092669 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea6c005020 con 0x7fea741100c0 2024-09-21T06:36:40.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.980+0000 7fea6affd640 1 -- 172.21.15.63:0/1379092669 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c00f6b0 con 0x7fea741100c0 2024-09-21T06:36:40.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.980+0000 7fea7bdbd640 1 -- 172.21.15.63:0/1379092669 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea741a90c0 con 0x7fea741100c0 2024-09-21T06:36:40.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.982+0000 7fea82331740 1 Processor -- start 2024-09-21T06:36:40.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.983+0000 7fea6affd640 1 -- 172.21.15.63:0/1379092669 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fea6c0051d0 con 0x7fea741100c0 2024-09-21T06:36:40.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.983+0000 7fea82331740 1 -- start start 2024-09-21T06:36:40.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.983+0000 7fea82331740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b880f070 0x55e3b8bb6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:40.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.983+0000 7fea82331740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87e61b0 0x55e3b8bb67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:40.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.983+0000 7fea82331740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3b87ee390 0x55e3b8bb6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:40.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.983+0000 7fea82331740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55e3b8b2ce50 con 0x55e3b87e61b0 2024-09-21T06:36:40.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.983+0000 7fea82331740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e3b8b1c280 con 0x55e3b880f070 2024-09-21T06:36:40.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.983+0000 7fea82331740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e3b8b20090 con 0x55e3b87ee390 2024-09-21T06:36:40.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.984+0000 7fea79b59640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87e61b0 0x55e3b8bb67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:40.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.984+0000 7fea79b59640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87e61b0 0x55e3b8bb67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55134/0 (socket says 172.21.15.63:55134) 2024-09-21T06:36:40.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.984+0000 7fea79b59640 1 -- 172.21.15.63:0/2209222746 learned_addr learned my addr 172.21.15.63:0/2209222746 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.984+0000 7fea79358640 1 --2- 172.21.15.63:0/2209222746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3b87ee390 0x55e3b8bb6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.984+0000 7fea79358640 1 --2- 172.21.15.63:0/2209222746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b880f070 0x55e3b8bb6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.984+0000 7fea6affd640 1 --2- 172.21.15.63:0/1379092669 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fea600b6680 0x7fea600b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.984+0000 7fea79b59640 1 -- 172.21.15.63:0/2209222746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3b87ee390 msgr2=0x55e3b8bb6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.984+0000 7fea79b59640 1 --2- 172.21.15.63:0/2209222746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3b87ee390 0x55e3b8bb6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.984+0000 7fea79b59640 1 -- 172.21.15.63:0/2209222746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b880f070 msgr2=0x55e3b8bb6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.984+0000 7fea79b59640 1 --2- 172.21.15.63:0/2209222746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b880f070 0x55e3b8bb6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.984+0000 7fea79b59640 1 -- 172.21.15.63:0/2209222746 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3b887a650 con 0x55e3b87e61b0 2024-09-21T06:36:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.984+0000 7fea7a35a640 1 --2- 172.21.15.63:0/1379092669 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fea600b6680 0x7fea600b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.984+0000 7fea6affd640 1 -- 172.21.15.63:0/1379092669 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7fea6c0e7890 con 0x7fea741100c0 2024-09-21T06:36:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.984+0000 7fea79b59640 1 --2- 172.21.15.63:0/2209222746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87e61b0 0x55e3b8bb67b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fea7002a930 tx=0x7fea70031cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f80de920d4a19f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.984+0000 7fea5ffff640 1 -- 172.21.15.63:0/2209222746 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7003f070 con 0x55e3b87e61b0 2024-09-21T06:36:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.985+0000 7fea5ffff640 1 -- 172.21.15.63:0/2209222746 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea700316a0 con 0x55e3b87e61b0 2024-09-21T06:36:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.985+0000 7fea5ffff640 1 -- 172.21.15.63:0/2209222746 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea70035070 con 0x55e3b87e61b0 2024-09-21T06:36:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.985+0000 7fea82331740 1 -- 172.21.15.63:0/2209222746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87e61b0 msgr2=0x55e3b8bb67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.985+0000 7fea82331740 1 --2- 172.21.15.63:0/2209222746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87e61b0 0x55e3b8bb67b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fea7002a930 tx=0x7fea70031cd0 comp rx=0 tx=0).stop 2024-09-21T06:36:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.985+0000 7fea82331740 1 -- 172.21.15.63:0/2209222746 shutdown_connections 2024-09-21T06:36:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.985+0000 7fea82331740 1 --2- 172.21.15.63:0/2209222746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3b87ee390 0x55e3b8bb6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.985+0000 7fea82331740 1 --2- 172.21.15.63:0/2209222746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87e61b0 0x55e3b8bb67b0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.985+0000 7fea82331740 1 --2- 172.21.15.63:0/2209222746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b880f070 0x55e3b8bb6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.986+0000 7fea7a35a640 1 --2- 172.21.15.63:0/1379092669 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fea600b6680 0x7fea600b8b90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0e5040 tx=0x7fea6c01bb40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.986+0000 7fea82331740 1 -- 172.21.15.63:0/2209222746 >> 172.21.15.63:0/2209222746 conn(0x55e3b8803460 msgr2=0x55e3b8bb4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.986+0000 7fea82331740 1 -- 172.21.15.63:0/2209222746 shutdown_connections 2024-09-21T06:36:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.986+0000 7fea82331740 1 -- 172.21.15.63:0/2209222746 wait complete. 2024-09-21T06:36:40.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.986+0000 7fea82331740 1 -- start start 2024-09-21T06:36:40.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.986+0000 7fea82331740 1 Processor -- start 2024-09-21T06:36:40.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.987+0000 7fea82331740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b87e61b0 0x55e3b8bc18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:40.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.987+0000 7fea82331740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3b87ee390 0x55e3b8bc1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:40.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.987+0000 7fea82331740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b880f070 0x55e3b8bc2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:40.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.987+0000 7fea82331740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55e3b897d700 con 0x55e3b880f070 2024-09-21T06:36:40.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.987+0000 7fea82331740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e3b8ab7110 con 0x55e3b87e61b0 2024-09-21T06:36:40.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.987+0000 7fea82331740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e3b8bc49f0 con 0x55e3b87ee390 2024-09-21T06:36:40.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.987+0000 7fea82331740 10 client.0 _ll_register_callbacks cb 0x55e3b8ad0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:40.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.987+0000 7fea79358640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b880f070 0x55e3b8bc2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:40.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.987+0000 7fea79358640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b880f070 0x55e3b8bc2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55142/0 (socket says 172.21.15.63:55142) 2024-09-21T06:36:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.987+0000 7fea79358640 1 -- 172.21.15.63:0/2605867351 learned_addr learned my addr 172.21.15.63:0/2605867351 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.987+0000 7fea79b59640 1 --2- 172.21.15.63:0/2605867351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3b87ee390 0x55e3b8bc1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.987+0000 7fea79358640 1 --2- 172.21.15.63:0/2605867351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b87e61b0 0x55e3b8bc18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.987+0000 7fea79358640 1 -- 172.21.15.63:0/2605867351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3b87ee390 msgr2=0x55e3b8bc1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.987+0000 7fea79358640 1 --2- 172.21.15.63:0/2605867351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3b87ee390 0x55e3b8bc1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.987+0000 7fea79358640 1 -- 172.21.15.63:0/2605867351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b87e61b0 msgr2=0x55e3b8bc18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.987+0000 7fea79358640 1 --2- 172.21.15.63:0/2605867351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b87e61b0 0x55e3b8bc18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.987+0000 7fea79358640 1 -- 172.21.15.63:0/2605867351 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3b8ae4c40 con 0x55e3b880f070 2024-09-21T06:36:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.987+0000 7fea79358640 1 --2- 172.21.15.63:0/2605867351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b880f070 0x55e3b8bc2380 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fea64006aa0 tx=0x7fea64008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e010d42d617413fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:41.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.987+0000 7fea5d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.988+0000 7fea5d7fa640 1 -- 172.21.15.63:0/2605867351 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea64015690 con 0x55e3b880f070 2024-09-21T06:36:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.988+0000 7fea5d7fa640 1 -- 172.21.15.63:0/2605867351 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7fea64015830 con 0x55e3b880f070 2024-09-21T06:36:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.988+0000 7fea82331740 1 -- 172.21.15.63:0/2605867351 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea700316a0 con 0x55e3b880f070 2024-09-21T06:36:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.988+0000 7fea5d7fa640 1 -- 172.21.15.63:0/2605867351 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fea64015a30 con 0x55e3b880f070 2024-09-21T06:36:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.988+0000 7fea82331740 10 client.17187 fetch_fsmap learned FSMap version 61 2024-09-21T06:36:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.988+0000 7fea82331740 1 -- 172.21.15.63:0/2605867351 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55e3b8bd0700 con 0x55e3b880f070 2024-09-21T06:36:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.988+0000 7fea5d7fa640 1 -- 172.21.15.63:0/2605867351 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea700316a0 con 0x55e3b880f070 2024-09-21T06:36:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.988+0000 7fea5d7fa640 1 -- 172.21.15.63:0/2605867351 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fea64006260 con 0x55e3b880f070 2024-09-21T06:36:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.988+0000 7fea82331740 10 client.17187 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:36:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.988+0000 7fea82331740 10 client.17187 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:36:41.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.988+0000 7fea82331740 20 client.17187 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.988+0000 7fea82331740 1 --2- 172.21.15.63:0/2605867351 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e3b87cd9f0 0x55e3b8bd3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.988+0000 7fea82331740 4 client.17187 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.988+0000 7fea82331740 1 -- 172.21.15.63:0/2605867351 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3b8b2eda0 con 0x55e3b87cd9f0 2024-09-21T06:36:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.989+0000 7fea79b59640 1 --2- 172.21.15.63:0/2605867351 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e3b87cd9f0 0x55e3b8bd3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.989+0000 7fea5d7fa640 10 client.17187 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.989+0000 7fea79b59640 1 --2- 172.21.15.63:0/2605867351 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e3b87cd9f0 0x55e3b8bd3c30 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57417badbb392a66 server_cookie=3ffb23bb81e24d46 in_seq=0 out_seq=0 2024-09-21T06:36:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.990+0000 7fea5d7fa640 1 -- 172.21.15.63:0/2605867351 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e3b8b2eda0 con 0x55e3b87cd9f0 2024-09-21T06:36:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.990+0000 7fea5d7fa640 10 client.17187 handle_command_reply: tid=0 2024-09-21T06:36:41.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.990+0000 7fea82331740 1 client.17187 shutdown 2024-09-21T06:36:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.990+0000 7fea82331740 1 -- 172.21.15.63:0/2605867351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b880f070 msgr2=0x55e3b8bc2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.990+0000 7fea82331740 1 --2- 172.21.15.63:0/2605867351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b880f070 0x55e3b8bc2380 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fea64006aa0 tx=0x7fea64008040 comp rx=0 tx=0).stop 2024-09-21T06:36:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.990+0000 7fea82331740 1 -- 172.21.15.63:0/2605867351 shutdown_connections 2024-09-21T06:36:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.990+0000 7fea82331740 1 --2- 172.21.15.63:0/2605867351 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e3b87cd9f0 0x55e3b8bd3c30 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.990+0000 7fea82331740 1 --2- 172.21.15.63:0/2605867351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b880f070 0x55e3b8bc2380 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.990+0000 7fea82331740 1 --2- 172.21.15.63:0/2605867351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3b87ee390 0x55e3b8bc1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.990+0000 7fea5d7fa640 0 client.17187 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.990+0000 7fea82331740 1 --2- 172.21.15.63:0/2605867351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b87e61b0 0x55e3b8bc18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.990+0000 7fea82331740 1 -- 172.21.15.63:0/2605867351 >> 172.21.15.63:0/2605867351 conn(0x55e3b8803460 msgr2=0x55e3b8bb9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:41.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.990+0000 7fea82331740 1 -- 172.21.15.63:0/2605867351 shutdown_connections 2024-09-21T06:36:41.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.990+0000 7fea82331740 1 -- 172.21.15.63:0/2605867351 wait complete. 2024-09-21T06:36:41.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:40.990+0000 7fea82331740 20 client.17187 trim_cache size 0 max 16384 2024-09-21T06:36:41.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.008+0000 7fea82331740 1 Processor -- start 2024-09-21T06:36:41.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.008+0000 7fea82331740 1 -- start start 2024-09-21T06:36:41.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.008+0000 7fea82331740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87e61b0 0x55e3b8bb7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:41.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.008+0000 7fea82331740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b87ee390 0x55e3b8bc3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:41.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.008+0000 7fea82331740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3b880f070 0x55e3b8bb3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:41.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.008+0000 7fea82331740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fea741b19f0 con 0x55e3b87e61b0 2024-09-21T06:36:41.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.008+0000 7fea82331740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fea741b3530 con 0x55e3b87ee390 2024-09-21T06:36:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.008+0000 7fea82331740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fea741b20c0 con 0x55e3b880f070 2024-09-21T06:36:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.008+0000 7fea79358640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87e61b0 0x55e3b8bb7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.008+0000 7fea79358640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87e61b0 0x55e3b8bb7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55154/0 (socket says 172.21.15.63:55154) 2024-09-21T06:36:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.008+0000 7fea79358640 1 -- 172.21.15.63:0/3900347449 learned_addr learned my addr 172.21.15.63:0/3900347449 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.008+0000 7fea79b59640 1 --2- 172.21.15.63:0/3900347449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b87ee390 0x55e3b8bc3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.009+0000 7fea79358640 1 -- 172.21.15.63:0/3900347449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3b880f070 msgr2=0x55e3b8bb3710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:36:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.009+0000 7fea79358640 1 --2- 172.21.15.63:0/3900347449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3b880f070 0x55e3b8bb3710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.009+0000 7fea79358640 1 -- 172.21.15.63:0/3900347449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b87ee390 msgr2=0x55e3b8bc3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.009+0000 7fea79358640 1 --2- 172.21.15.63:0/3900347449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b87ee390 0x55e3b8bc3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.009+0000 7fea79358640 1 -- 172.21.15.63:0/3900347449 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3b8bb8560 con 0x55e3b87e61b0 2024-09-21T06:36:41.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.009+0000 7fea79358640 1 --2- 172.21.15.63:0/3900347449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87e61b0 0x55e3b8bb7c60 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fea64006fd0 tx=0x7fea6400a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521776a13c7e49fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:41.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.009+0000 7fea5f7fe640 1 -- 172.21.15.63:0/3900347449 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6400a6a0 con 0x55e3b87e61b0 2024-09-21T06:36:41.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.009+0000 7fea5f7fe640 1 -- 172.21.15.63:0/3900347449 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea64030030 con 0x55e3b87e61b0 2024-09-21T06:36:41.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.009+0000 7fea5f7fe640 1 -- 172.21.15.63:0/3900347449 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6402bb40 con 0x55e3b87e61b0 2024-09-21T06:36:41.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.010+0000 7fea82331740 1 -- 172.21.15.63:0/3900347449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87e61b0 msgr2=0x55e3b8bb7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:41.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.010+0000 7fea82331740 1 --2- 172.21.15.63:0/3900347449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87e61b0 0x55e3b8bb7c60 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fea64006fd0 tx=0x7fea6400a230 comp rx=0 tx=0).stop 2024-09-21T06:36:41.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.010+0000 7fea82331740 1 -- 172.21.15.63:0/3900347449 shutdown_connections 2024-09-21T06:36:41.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.010+0000 7fea82331740 1 --2- 172.21.15.63:0/3900347449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3b880f070 0x55e3b8bb3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.010+0000 7fea82331740 1 --2- 172.21.15.63:0/3900347449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b87ee390 0x55e3b8bc3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.010+0000 7fea82331740 1 --2- 172.21.15.63:0/3900347449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87e61b0 0x55e3b8bb7c60 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.010+0000 7fea82331740 1 -- 172.21.15.63:0/3900347449 >> 172.21.15.63:0/3900347449 conn(0x55e3b8803460 msgr2=0x55e3b8bc2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:41.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.011+0000 7fea82331740 1 -- 172.21.15.63:0/3900347449 shutdown_connections 2024-09-21T06:36:41.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.011+0000 7fea82331740 1 -- 172.21.15.63:0/3900347449 wait complete. 2024-09-21T06:36:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.011+0000 7fea82331740 1 -- start start 2024-09-21T06:36:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.011+0000 7fea82331740 1 Processor -- start 2024-09-21T06:36:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.012+0000 7fea82331740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3b87e61b0 0x55e3b8bca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.012+0000 7fea82331740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87ee390 0x55e3b8bc58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.012+0000 7fea82331740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b880f070 0x55e3b8bc5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.012+0000 7fea82331740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fea741b2e60 con 0x55e3b87ee390 2024-09-21T06:36:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.012+0000 7fea82331740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fea741b2790 con 0x55e3b880f070 2024-09-21T06:36:41.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.012+0000 7fea82331740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fea741af9f0 con 0x55e3b87e61b0 2024-09-21T06:36:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.012+0000 7fea79b59640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87ee390 0x55e3b8bc58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.012+0000 7fea82331740 10 client.0 _ll_register_callbacks cb 0x7fea6400ae00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.012+0000 7fea79b59640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87ee390 0x55e3b8bc58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55164/0 (socket says 172.21.15.63:55164) 2024-09-21T06:36:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.012+0000 7fea79b59640 1 -- 172.21.15.63:0/3307427827 learned_addr learned my addr 172.21.15.63:0/3307427827 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.012+0000 7fea79358640 1 --2- 172.21.15.63:0/3307427827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3b87e61b0 0x55e3b8bca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.012+0000 7fea79358640 1 --2- 172.21.15.63:0/3307427827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b880f070 0x55e3b8bc5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.012+0000 7fea79b59640 1 -- 172.21.15.63:0/3307427827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3b87e61b0 msgr2=0x55e3b8bca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.012+0000 7fea79b59640 1 --2- 172.21.15.63:0/3307427827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3b87e61b0 0x55e3b8bca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.012+0000 7fea79b59640 1 -- 172.21.15.63:0/3307427827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b880f070 msgr2=0x55e3b8bc5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.012+0000 7fea79b59640 1 --2- 172.21.15.63:0/3307427827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b880f070 0x55e3b8bc5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.012+0000 7fea79b59640 1 -- 172.21.15.63:0/3307427827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3b8bc6460 con 0x55e3b87ee390 2024-09-21T06:36:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.012+0000 7fea79358640 1 --2- 172.21.15.63:0/3307427827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b880f070 0x55e3b8bc5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.013+0000 7fea79b59640 1 --2- 172.21.15.63:0/3307427827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87ee390 0x55e3b8bc58e0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fea7002a930 tx=0x7fea70031c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e8691b04f9e719 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.013+0000 7fea5d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.013+0000 7fea5d7fa640 1 -- 172.21.15.63:0/3307427827 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea70035070 con 0x55e3b87ee390 2024-09-21T06:36:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.013+0000 7fea5d7fa640 1 -- 172.21.15.63:0/3307427827 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7fea700317c0 con 0x55e3b87ee390 2024-09-21T06:36:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.013+0000 7fea82331740 1 -- 172.21.15.63:0/3307427827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea64030030 con 0x55e3b87ee390 2024-09-21T06:36:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.013+0000 7fea5d7fa640 1 -- 172.21.15.63:0/3307427827 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fea7003f040 con 0x55e3b87ee390 2024-09-21T06:36:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.013+0000 7fea82331740 10 client.17193 fetch_fsmap learned FSMap version 61 2024-09-21T06:36:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.013+0000 7fea82331740 1 -- 172.21.15.63:0/3307427827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55e3b8c3e430 con 0x55e3b87ee390 2024-09-21T06:36:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.013+0000 7fea5d7fa640 1 -- 172.21.15.63:0/3307427827 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea64030030 con 0x55e3b87ee390 2024-09-21T06:36:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.014+0000 7fea5d7fa640 1 -- 172.21.15.63:0/3307427827 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fea70003a30 con 0x55e3b87ee390 2024-09-21T06:36:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.014+0000 7fea82331740 10 client.17193 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:36:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.014+0000 7fea82331740 10 client.17193 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:36:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.014+0000 7fea82331740 20 client.17193 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:41.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.014+0000 7fea82331740 1 --2- 172.21.15.63:0/3307427827 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e3b87a2da0 0x55e3b8c40780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.014+0000 7fea82331740 4 client.17193 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:36:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.014+0000 7fea82331740 1 -- 172.21.15.63:0/3307427827 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e3b8b2a850 con 0x55e3b87a2da0 2024-09-21T06:36:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.014+0000 7fea79358640 1 --2- 172.21.15.63:0/3307427827 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e3b87a2da0 0x55e3b8c40780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.014+0000 7fea5d7fa640 10 client.17193 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.015+0000 7fea79358640 1 --2- 172.21.15.63:0/3307427827 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e3b87a2da0 0x55e3b8c40780 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=192a7218fea821b1 server_cookie=94577171a0564303 in_seq=0 out_seq=0 2024-09-21T06:36:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.015+0000 7fea5d7fa640 1 -- 172.21.15.63:0/3307427827 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x55e3b8b2a850 con 0x55e3b87a2da0 2024-09-21T06:36:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.015+0000 7fea5d7fa640 10 client.17193 handle_command_reply: tid=0 2024-09-21T06:36:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.015+0000 7fea82331740 1 client.17193 shutdown 2024-09-21T06:36:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.015+0000 7fea82331740 1 -- 172.21.15.63:0/3307427827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87ee390 msgr2=0x55e3b8bc58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.015+0000 7fea82331740 1 --2- 172.21.15.63:0/3307427827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87ee390 0x55e3b8bc58e0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fea7002a930 tx=0x7fea70031c50 comp rx=0 tx=0).stop 2024-09-21T06:36:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.015+0000 7fea82331740 1 -- 172.21.15.63:0/3307427827 shutdown_connections 2024-09-21T06:36:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.015+0000 7fea82331740 1 --2- 172.21.15.63:0/3307427827 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e3b87a2da0 0x55e3b8c40780 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.015+0000 7fea82331740 1 --2- 172.21.15.63:0/3307427827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3b880f070 0x55e3b8bc5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.015+0000 7fea82331740 1 --2- 172.21.15.63:0/3307427827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3b87ee390 0x55e3b8bc58e0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.015+0000 7fea5d7fa640 0 client.17193 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:41.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.015+0000 7fea82331740 1 --2- 172.21.15.63:0/3307427827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3b87e61b0 0x55e3b8bca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.015+0000 7fea82331740 1 -- 172.21.15.63:0/3307427827 >> 172.21.15.63:0/3307427827 conn(0x55e3b8803460 msgr2=0x55e3b8bb7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:41.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.015+0000 7fea82331740 1 -- 172.21.15.63:0/3307427827 shutdown_connections 2024-09-21T06:36:41.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.015+0000 7fea82331740 1 -- 172.21.15.63:0/3307427827 wait complete. 2024-09-21T06:36:41.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.016+0000 7fea82331740 20 client.17193 trim_cache size 0 max 16384 2024-09-21T06:36:41.026 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:36:41.026 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "no active scrubs running", 2024-09-21T06:36:41.027 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": {}, 2024-09-21T06:36:41.027 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:36:41.027 INFO:teuthology.orchestra.run.smithi063.stdout: "0c926bc7-90f8-47ce-a0d2-d02e676a73e9": { 2024-09-21T06:36:41.027 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:35:22.494015+0000", 2024-09-21T06:36:41.027 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:41.027 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:41.027 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:41.027 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:41.027 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:41.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:41.027 INFO:teuthology.orchestra.run.smithi063.stdout: "4f099144-5170-453b-a745-ddc222860f34": { 2024-09-21T06:36:41.028 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:34:35.417817+0000", 2024-09-21T06:36:41.028 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:41.028 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:41.028 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:41.028 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:41.028 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:41.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:41.028 INFO:teuthology.orchestra.run.smithi063.stdout: "91ae0a75-6a3f-452f-8bda-0f19862a5724": { 2024-09-21T06:36:41.028 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:50.316590+0000", 2024-09-21T06:36:41.028 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:41.028 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:41.028 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:41.028 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:41.029 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:41.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:41.029 INFO:teuthology.orchestra.run.smithi063.stdout: "5396028b-35f4-48fe-b54d-385784e97de3": { 2024-09-21T06:36:41.029 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:04.523378+0000", 2024-09-21T06:36:41.029 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:41.029 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:41.029 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:41.029 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:41.029 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:41.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:41.029 INFO:teuthology.orchestra.run.smithi063.stdout: "1b9cca6e-2b23-49b2-a894-182a1054bc02": { 2024-09-21T06:36:41.029 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:36:07.545253+0000", 2024-09-21T06:36:41.029 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:41.029 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:41.030 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:41.030 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:41.030 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:41.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:41.030 INFO:teuthology.orchestra.run.smithi063.stdout: "024d3c59-0b67-49a9-bf4a-e02d36691942": { 2024-09-21T06:36:41.030 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:32:14.282244+0000", 2024-09-21T06:36:41.030 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:41.030 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:41.030 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:41.030 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:41.030 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:41.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:41.031 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:36:41.031 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:31:27.507051+0000", 2024-09-21T06:36:41.031 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:41.031 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:41.031 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:41.031 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:41.031 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:41.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:41.031 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:36:41.031 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:36:41.032 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:41.032 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:41.032 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:41.032 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:41.032 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:41.032 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:36:41.032 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:36:41.032 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:36:41.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.016+0000 7fea7bdbd640 1 -- 172.21.15.63:0/1379092669 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fea600b6680 msgr2=0x7fea600b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:41.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.016+0000 7fea7bdbd640 1 --2- 172.21.15.63:0/1379092669 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fea600b6680 0x7fea600b8b90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0e5040 tx=0x7fea6c01bb40 comp rx=0 tx=0).stop 2024-09-21T06:36:41.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.016+0000 7fea7bdbd640 1 -- 172.21.15.63:0/1379092669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea741100c0 msgr2=0x7fea741a1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:41.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.016+0000 7fea7bdbd640 1 --2- 172.21.15.63:0/1379092669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea741100c0 0x7fea741a1f40 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00cad0 tx=0x7fea6c00cf90 comp rx=0 tx=0).stop 2024-09-21T06:36:41.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.016+0000 7fea7bdbd640 1 -- 172.21.15.63:0/1379092669 shutdown_connections 2024-09-21T06:36:41.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.016+0000 7fea7bdbd640 1 --2- 172.21.15.63:0/1379092669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea741100c0 0x7fea741a1f40 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.016+0000 7fea7bdbd640 1 --2- 172.21.15.63:0/1379092669 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea74076100 0x7fea7419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.016+0000 7fea7bdbd640 1 --2- 172.21.15.63:0/1379092669 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fea600b6680 0x7fea600b8b90 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.016+0000 7fea7bdbd640 1 --2- 172.21.15.63:0/1379092669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea740757b0 0x7fea7419c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:41.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.016+0000 7fea7bdbd640 1 -- 172.21.15.63:0/1379092669 >> 172.21.15.63:0/1379092669 conn(0x7fea7407b850 msgr2=0x7fea74109c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:41.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.017+0000 7fea7bdbd640 1 -- 172.21.15.63:0/1379092669 shutdown_connections 2024-09-21T06:36:41.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:41.017+0000 7fea7bdbd640 1 -- 172.21.15.63:0/1379092669 wait complete. 2024-09-21T06:36:41.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:41 smithi063 ceph-mon[31150]: pgmap v581: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:36:41.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:41 smithi071 ceph-mon[34844]: pgmap v581: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:36:41.847 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:36:41.847 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:36:41.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:41 smithi175 ceph-mon[34510]: pgmap v581: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:36:42.112 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:42.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.727+0000 7fb31df7e640 1 -- 172.21.15.63:0/797294634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3181083a0 msgr2=0x7fb3181087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:42.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.727+0000 7fb31df7e640 1 --2- 172.21.15.63:0/797294634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3181083a0 0x7fb3181087b0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb30c009900 tx=0x7fb30c02a410 comp rx=0 tx=0).stop 2024-09-21T06:36:42.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.727+0000 7fb31df7e640 1 -- 172.21.15.63:0/797294634 shutdown_connections 2024-09-21T06:36:42.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.727+0000 7fb31df7e640 1 --2- 172.21.15.63:0/797294634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb318108cf0 0x7fb31810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:42.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.727+0000 7fb31df7e640 1 --2- 172.21.15.63:0/797294634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3181083a0 0x7fb3181087b0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:42.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.727+0000 7fb31df7e640 1 --2- 172.21.15.63:0/797294634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb318102a60 0x7fb318102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:42.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.727+0000 7fb31df7e640 1 -- 172.21.15.63:0/797294634 >> 172.21.15.63:0/797294634 conn(0x7fb318079730 msgr2=0x7fb318079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:42.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.727+0000 7fb31df7e640 1 -- 172.21.15.63:0/797294634 shutdown_connections 2024-09-21T06:36:42.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.728+0000 7fb31df7e640 1 -- 172.21.15.63:0/797294634 wait complete. 2024-09-21T06:36:42.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.728+0000 7fb31df7e640 1 Processor -- start 2024-09-21T06:36:42.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.728+0000 7fb31df7e640 1 -- start start 2024-09-21T06:36:42.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.729+0000 7fb31df7e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb318102a60 0x7fb31810ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:42.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.729+0000 7fb31df7e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3181083a0 0x7fb3181104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:42.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.729+0000 7fb31df7e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb318108cf0 0x7fb318110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:42.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.729+0000 7fb31df7e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb318113a80 con 0x7fb3181083a0 2024-09-21T06:36:42.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.729+0000 7fb31df7e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb318113900 con 0x7fb318102a60 2024-09-21T06:36:42.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.729+0000 7fb31df7e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb318113c00 con 0x7fb318108cf0 2024-09-21T06:36:42.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.729+0000 7fb316ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3181083a0 0x7fb3181104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:42.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.729+0000 7fb316ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3181083a0 0x7fb3181104f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55172/0 (socket says 172.21.15.63:55172) 2024-09-21T06:36:42.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.729+0000 7fb316ffd640 1 -- 172.21.15.63:0/1642441526 learned_addr learned my addr 172.21.15.63:0/1642441526 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:42.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.729+0000 7fb317fff640 1 --2- 172.21.15.63:0/1642441526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb318108cf0 0x7fb318110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:42.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.729+0000 7fb3177fe640 1 --2- 172.21.15.63:0/1642441526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb318102a60 0x7fb31810ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:42.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.729+0000 7fb316ffd640 1 -- 172.21.15.63:0/1642441526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb318108cf0 msgr2=0x7fb318110a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:42.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.729+0000 7fb316ffd640 1 --2- 172.21.15.63:0/1642441526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb318108cf0 0x7fb318110a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:42.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.729+0000 7fb316ffd640 1 -- 172.21.15.63:0/1642441526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb318102a60 msgr2=0x7fb31810ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:42.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.729+0000 7fb316ffd640 1 --2- 172.21.15.63:0/1642441526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb318102a60 0x7fb31810ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:42.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.729+0000 7fb316ffd640 1 -- 172.21.15.63:0/1642441526 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3181a87d0 con 0x7fb3181083a0 2024-09-21T06:36:42.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.729+0000 7fb3177fe640 1 --2- 172.21.15.63:0/1642441526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb318102a60 0x7fb31810ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:42.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.729+0000 7fb317fff640 1 --2- 172.21.15.63:0/1642441526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb318108cf0 0x7fb318110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:42.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.729+0000 7fb316ffd640 1 --2- 172.21.15.63:0/1642441526 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3181083a0 0x7fb3181104f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb30c006010 tx=0x7fb30c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:42.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.730+0000 7fb314ff9640 1 -- 172.21.15.63:0/1642441526 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30c03f030 con 0x7fb3181083a0 2024-09-21T06:36:42.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.730+0000 7fb314ff9640 1 -- 172.21.15.63:0/1642441526 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb30c003aa0 con 0x7fb3181083a0 2024-09-21T06:36:42.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.730+0000 7fb31df7e640 1 -- 172.21.15.63:0/1642441526 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3181a8a60 con 0x7fb3181083a0 2024-09-21T06:36:42.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.730+0000 7fb314ff9640 1 -- 172.21.15.63:0/1642441526 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30c035070 con 0x7fb3181083a0 2024-09-21T06:36:42.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.730+0000 7fb31df7e640 1 -- 172.21.15.63:0/1642441526 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3181a8f40 con 0x7fb3181083a0 2024-09-21T06:36:42.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.731+0000 7fb31df7e640 1 -- 172.21.15.63:0/1642441526 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb318102e70 con 0x7fb3181083a0 2024-09-21T06:36:42.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.732+0000 7fb314ff9640 1 -- 172.21.15.63:0/1642441526 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fb30c042030 con 0x7fb3181083a0 2024-09-21T06:36:42.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.733+0000 7fb314ff9640 1 --2- 172.21.15.63:0/1642441526 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb3000b6680 0x7fb3000b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:42.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.733+0000 7fb3177fe640 1 --2- 172.21.15.63:0/1642441526 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb3000b6680 0x7fb3000b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:42.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.733+0000 7fb314ff9640 1 -- 172.21.15.63:0/1642441526 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7fb30c107cb0 con 0x7fb3181083a0 2024-09-21T06:36:42.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.734+0000 7fb3177fe640 1 --2- 172.21.15.63:0/1642441526 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb3000b6680 0x7fb3000b8b90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb318111a00 tx=0x7fb308005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:42.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.738+0000 7fb314ff9640 1 -- 172.21.15.63:0/1642441526 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb30c10d020 con 0x7fb3181083a0 2024-09-21T06:36:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.967+0000 7fb31df7e640 1 -- 172.21.15.63:0/1642441526 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb31802e640 con 0x7fb3181083a0 2024-09-21T06:36:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.968+0000 7fb314ff9640 1 -- 172.21.15.63:0/1642441526 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+11971 (secure 0 0 0) 0x7fb30c0c9020 con 0x7fb3181083a0 2024-09-21T06:36:42.970 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:36:42.970 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":61,"btime":"2024-09-21T06:36:33:430596+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":61,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:36:32.513212+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24659,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":34,"state":"up:active","state_seq":69,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25637":{"gid":25637,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3354670524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3354670524},{"type":"v1","addr":"172.21.15.71:6839","nonce":3354670524}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24659,"qdb_cluster":[24694,24670,24659,24676,14835]},"id":1}]} 2024-09-21T06:36:42.970 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 61 2024-09-21T06:36:42.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.970+0000 7fb31df7e640 1 -- 172.21.15.63:0/1642441526 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb3000b6680 msgr2=0x7fb3000b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:42.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.970+0000 7fb31df7e640 1 --2- 172.21.15.63:0/1642441526 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb3000b6680 0x7fb3000b8b90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb318111a00 tx=0x7fb308005f90 comp rx=0 tx=0).stop 2024-09-21T06:36:42.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.970+0000 7fb31df7e640 1 -- 172.21.15.63:0/1642441526 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3181083a0 msgr2=0x7fb3181104f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:42.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.970+0000 7fb31df7e640 1 --2- 172.21.15.63:0/1642441526 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3181083a0 0x7fb3181104f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb30c006010 tx=0x7fb30c004060 comp rx=0 tx=0).stop 2024-09-21T06:36:42.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.970+0000 7fb31df7e640 1 -- 172.21.15.63:0/1642441526 shutdown_connections 2024-09-21T06:36:42.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.970+0000 7fb31df7e640 1 --2- 172.21.15.63:0/1642441526 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb3000b6680 0x7fb3000b8b90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:42.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.970+0000 7fb31df7e640 1 --2- 172.21.15.63:0/1642441526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb318108cf0 0x7fb318110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:42.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.970+0000 7fb31df7e640 1 --2- 172.21.15.63:0/1642441526 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3181083a0 0x7fb3181104f0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:42.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.970+0000 7fb31df7e640 1 --2- 172.21.15.63:0/1642441526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb318102a60 0x7fb31810ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:42.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.970+0000 7fb31df7e640 1 -- 172.21.15.63:0/1642441526 >> 172.21.15.63:0/1642441526 conn(0x7fb318079730 msgr2=0x7fb3181052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:42.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.970+0000 7fb31df7e640 1 -- 172.21.15.63:0/1642441526 shutdown_connections 2024-09-21T06:36:42.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:42.970+0000 7fb31df7e640 1 -- 172.21.15.63:0/1642441526 wait complete. 2024-09-21T06:36:43.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:43 smithi063 ceph-mon[31150]: pgmap v582: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:36:43.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:43 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/1642441526' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:43.627 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T06:36:43.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:43 smithi071 ceph-mon[34844]: pgmap v582: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:36:43.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:43 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/1642441526' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:43.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:43 smithi175 ceph-mon[34510]: pgmap v582: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:36:43.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:43 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/1642441526' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:43.887 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:44.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.411+0000 7f18bd184640 1 -- 172.21.15.63:0/2734701340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18b81083c0 msgr2=0x7f18b81087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:44.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.411+0000 7f18bd184640 1 --2- 172.21.15.63:0/2734701340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18b81083c0 0x7f18b81087d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009900 tx=0x7f18ac02a3f0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.412+0000 7f18bd184640 1 -- 172.21.15.63:0/2734701340 shutdown_connections 2024-09-21T06:36:44.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.412+0000 7f18bd184640 1 --2- 172.21.15.63:0/2734701340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18b8108d10 0x7f18b810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.412+0000 7f18bd184640 1 --2- 172.21.15.63:0/2734701340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18b81083c0 0x7f18b81087d0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.412+0000 7f18bd184640 1 --2- 172.21.15.63:0/2734701340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18b8102a80 0x7f18b8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.412+0000 7f18bd184640 1 -- 172.21.15.63:0/2734701340 >> 172.21.15.63:0/2734701340 conn(0x7f18b8079740 msgr2=0x7f18b8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:44.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.412+0000 7f18bd184640 1 -- 172.21.15.63:0/2734701340 shutdown_connections 2024-09-21T06:36:44.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.412+0000 7f18bd184640 1 -- 172.21.15.63:0/2734701340 wait complete. 2024-09-21T06:36:44.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.412+0000 7f18bd184640 1 Processor -- start 2024-09-21T06:36:44.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.413+0000 7f18bd184640 1 -- start start 2024-09-21T06:36:44.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.413+0000 7f18bd184640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18b8102a80 0x7f18b819b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:44.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.413+0000 7f18bd184640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18b81083c0 0x7f18b819b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:44.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.413+0000 7f18bd184640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18b8108d10 0x7f18b819bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:44.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.413+0000 7f18bd184640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f18b8112980 con 0x7f18b8108d10 2024-09-21T06:36:44.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.413+0000 7f18bd184640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f18b8112800 con 0x7f18b81083c0 2024-09-21T06:36:44.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.413+0000 7f18bd184640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f18b8112b00 con 0x7f18b8102a80 2024-09-21T06:36:44.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.413+0000 7f18b759e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18b8108d10 0x7f18b819bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:44.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.413+0000 7f18b759e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18b8108d10 0x7f18b819bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55188/0 (socket says 172.21.15.63:55188) 2024-09-21T06:36:44.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.413+0000 7f18b759e640 1 -- 172.21.15.63:0/2352499234 learned_addr learned my addr 172.21.15.63:0/2352499234 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:44.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.413+0000 7f18b659c640 1 --2- 172.21.15.63:0/2352499234 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18b81083c0 0x7f18b819b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:44.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.413+0000 7f18b6d9d640 1 --2- 172.21.15.63:0/2352499234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18b8102a80 0x7f18b819b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:44.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.413+0000 7f18b759e640 1 -- 172.21.15.63:0/2352499234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18b8102a80 msgr2=0x7f18b819b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:44.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.413+0000 7f18b759e640 1 --2- 172.21.15.63:0/2352499234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18b8102a80 0x7f18b819b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.413+0000 7f18b759e640 1 -- 172.21.15.63:0/2352499234 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18b81083c0 msgr2=0x7f18b819b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:44.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.413+0000 7f18b759e640 1 --2- 172.21.15.63:0/2352499234 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18b81083c0 0x7f18b819b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.414+0000 7f18b759e640 1 -- 172.21.15.63:0/2352499234 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b81a6450 con 0x7f18b8108d10 2024-09-21T06:36:44.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.414+0000 7f18b759e640 1 --2- 172.21.15.63:0/2352499234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18b8108d10 0x7f18b819bcd0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f18b000cce0 tx=0x7f18b000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:44.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.414+0000 7f189ffff640 1 -- 172.21.15.63:0/2352499234 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b000f450 con 0x7f18b8108d10 2024-09-21T06:36:44.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.414+0000 7f18bd184640 1 -- 172.21.15.63:0/2352499234 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b81a6740 con 0x7f18b8108d10 2024-09-21T06:36:44.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.414+0000 7f189ffff640 1 -- 172.21.15.63:0/2352499234 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18b000faa0 con 0x7f18b8108d10 2024-09-21T06:36:44.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.414+0000 7f189ffff640 1 -- 172.21.15.63:0/2352499234 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0018a80 con 0x7f18b8108d10 2024-09-21T06:36:44.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.414+0000 7f18bd184640 1 -- 172.21.15.63:0/2352499234 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b81a6c50 con 0x7f18b8108d10 2024-09-21T06:36:44.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.417+0000 7f18c36f8740 1 Processor -- start 2024-09-21T06:36:44.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.417+0000 7f189ffff640 1 -- 172.21.15.63:0/2352499234 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f18b0018c20 con 0x7f18b8108d10 2024-09-21T06:36:44.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.417+0000 7f18c36f8740 1 -- start start 2024-09-21T06:36:44.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.418+0000 7f18c36f8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55becac0b070 0x55becafb22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:44.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.418+0000 7f18c36f8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becabe21b0 0x55becafb2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:44.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.418+0000 7f18c36f8740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 0x55becafb2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:44.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.418+0000 7f18c36f8740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55becaf28ea0 con 0x55becabea390 2024-09-21T06:36:44.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.418+0000 7f18c36f8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55becaf182d0 con 0x55becac0b070 2024-09-21T06:36:44.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.418+0000 7f18c36f8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55becaf1c0e0 con 0x55becabe21b0 2024-09-21T06:36:44.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.418+0000 7f18b659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 0x55becafb2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:44.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.418+0000 7f18b659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 0x55becafb2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55200/0 (socket says 172.21.15.63:55200) 2024-09-21T06:36:44.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.418+0000 7f18b659c640 1 -- 172.21.15.63:0/3731605276 learned_addr learned my addr 172.21.15.63:0/3731605276 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:44.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.418+0000 7f18b659c640 1 --2- 172.21.15.63:0/3731605276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55becac0b070 0x55becafb22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:44.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.418+0000 7f18b6d9d640 1 --2- 172.21.15.63:0/3731605276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becabe21b0 0x55becafb2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:44.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.418+0000 7f189ffff640 1 --2- 172.21.15.63:0/2352499234 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f18a00b66b0 0x7f18a00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:44.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.418+0000 7f18b659c640 1 -- 172.21.15.63:0/3731605276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becabe21b0 msgr2=0x55becafb2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:44.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.418+0000 7f18b659c640 1 --2- 172.21.15.63:0/3731605276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becabe21b0 0x55becafb2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.418+0000 7f18b659c640 1 -- 172.21.15.63:0/3731605276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55becac0b070 msgr2=0x55becafb22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:44.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.418+0000 7f18b659c640 1 --2- 172.21.15.63:0/3731605276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55becac0b070 0x55becafb22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.418+0000 7f18b659c640 1 -- 172.21.15.63:0/3731605276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55becac76650 con 0x55becabea390 2024-09-21T06:36:44.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.419+0000 7f18b759e640 1 --2- 172.21.15.63:0/2352499234 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f18a00b66b0 0x7f18a00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:44.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.419+0000 7f189ffff640 1 -- 172.21.15.63:0/2352499234 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7f18b00e7b50 con 0x7f18b8108d10 2024-09-21T06:36:44.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.419+0000 7f18b659c640 1 --2- 172.21.15.63:0/3731605276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 0x55becafb2d40 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009900 tx=0x7f18ac009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14c6692d895a28c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:44.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.419+0000 7f189d7fa640 1 -- 172.21.15.63:0/3731605276 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac035070 con 0x55becabea390 2024-09-21T06:36:44.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.419+0000 7f189d7fa640 1 -- 172.21.15.63:0/3731605276 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18ac031900 con 0x55becabea390 2024-09-21T06:36:44.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.419+0000 7f189d7fa640 1 -- 172.21.15.63:0/3731605276 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac005610 con 0x55becabea390 2024-09-21T06:36:44.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.420+0000 7f18b759e640 1 --2- 172.21.15.63:0/2352499234 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f18a00b66b0 0x7f18a00b8bc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f18b00aabc0 tx=0x7f18b007a600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:44.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.420+0000 7f18c36f8740 1 -- 172.21.15.63:0/3731605276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 msgr2=0x55becafb2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:44.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.420+0000 7f18c36f8740 1 --2- 172.21.15.63:0/3731605276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 0x55becafb2d40 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009900 tx=0x7f18ac009560 comp rx=0 tx=0).stop 2024-09-21T06:36:44.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.420+0000 7f18c36f8740 1 -- 172.21.15.63:0/3731605276 shutdown_connections 2024-09-21T06:36:44.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.420+0000 7f18c36f8740 1 --2- 172.21.15.63:0/3731605276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 0x55becafb2d40 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.420+0000 7f18c36f8740 1 --2- 172.21.15.63:0/3731605276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becabe21b0 0x55becafb2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.420+0000 7f18c36f8740 1 --2- 172.21.15.63:0/3731605276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55becac0b070 0x55becafb22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.420+0000 7f18c36f8740 1 -- 172.21.15.63:0/3731605276 >> 172.21.15.63:0/3731605276 conn(0x55becabff460 msgr2=0x55becafb01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:44.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.420+0000 7f18c36f8740 1 -- 172.21.15.63:0/3731605276 shutdown_connections 2024-09-21T06:36:44.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.420+0000 7f18c36f8740 1 -- 172.21.15.63:0/3731605276 wait complete. 2024-09-21T06:36:44.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.420+0000 7f18c36f8740 1 -- start start 2024-09-21T06:36:44.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.421+0000 7f18c36f8740 1 Processor -- start 2024-09-21T06:36:44.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.421+0000 7f18c36f8740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabe21b0 0x55becafbd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:44.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.421+0000 7f18c36f8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55becabea390 0x55becafbde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:44.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.421+0000 7f18c36f8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becac0b070 0x55becafbe380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:44.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.421+0000 7f18c36f8740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55becad79700 con 0x55becabe21b0 2024-09-21T06:36:44.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.421+0000 7f18c36f8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55becaeb3160 con 0x55becabea390 2024-09-21T06:36:44.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.421+0000 7f18c36f8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55becafc09e0 con 0x55becac0b070 2024-09-21T06:36:44.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.421+0000 7f18c36f8740 10 client.0 _ll_register_callbacks cb 0x55becaecc9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:44.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.421+0000 7f18b659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabe21b0 0x55becafbd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:44.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.421+0000 7f18b659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabe21b0 0x55becafbd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55214/0 (socket says 172.21.15.63:55214) 2024-09-21T06:36:44.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.421+0000 7f18b659c640 1 -- 172.21.15.63:0/3312678338 learned_addr learned my addr 172.21.15.63:0/3312678338 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:44.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.421+0000 7f18b6d9d640 1 --2- 172.21.15.63:0/3312678338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55becabea390 0x55becafbde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:44.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.421+0000 7f18b659c640 1 -- 172.21.15.63:0/3312678338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becac0b070 msgr2=0x55becafbe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:44.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.421+0000 7f18b659c640 1 --2- 172.21.15.63:0/3312678338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becac0b070 0x55becafbe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.421+0000 7f18b659c640 1 -- 172.21.15.63:0/3312678338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55becabea390 msgr2=0x55becafbde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:44.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.421+0000 7f18b659c640 1 --2- 172.21.15.63:0/3312678338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55becabea390 0x55becafbde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.421+0000 7f18b659c640 1 -- 172.21.15.63:0/3312678338 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55becaee0c90 con 0x55becabe21b0 2024-09-21T06:36:44.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.422+0000 7f18b659c640 1 --2- 172.21.15.63:0/3312678338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabe21b0 0x55becafbd8e0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f18ac006010 tx=0x7f18ac031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2568f10803ad6dfc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:44.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.422+0000 7f189aff5640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:44.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.422+0000 7f189aff5640 1 -- 172.21.15.63:0/3312678338 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac035040 con 0x55becabe21b0 2024-09-21T06:36:44.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.422+0000 7f189aff5640 1 -- 172.21.15.63:0/3312678338 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7f18ac031d10 con 0x55becabe21b0 2024-09-21T06:36:44.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.422+0000 7f18c36f8740 1 -- 172.21.15.63:0/3312678338 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55becaf2adf0 con 0x55becabe21b0 2024-09-21T06:36:44.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.422+0000 7f189aff5640 1 -- 172.21.15.63:0/3312678338 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f18ac058050 con 0x55becabe21b0 2024-09-21T06:36:44.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.422+0000 7f18c36f8740 10 client.17211 fetch_fsmap learned FSMap version 61 2024-09-21T06:36:44.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.422+0000 7f18c36f8740 1 -- 172.21.15.63:0/3312678338 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55becafcc660 con 0x55becabe21b0 2024-09-21T06:36:44.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.422+0000 7f189aff5640 1 -- 172.21.15.63:0/3312678338 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55becaf2adf0 con 0x55becabe21b0 2024-09-21T06:36:44.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.422+0000 7f189aff5640 1 -- 172.21.15.63:0/3312678338 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f18ac032160 con 0x55becabe21b0 2024-09-21T06:36:44.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.423+0000 7f18c36f8740 10 client.17211 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:36:44.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.423+0000 7f18c36f8740 10 client.17211 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:36:44.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.423+0000 7f18c36f8740 20 client.17211 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:44.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.423+0000 7f18c36f8740 1 --2- 172.21.15.63:0/3312678338 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55becabc99f0 0x55becafcf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:44.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.423+0000 7f18c36f8740 4 client.17211 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:44.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.423+0000 7f18c36f8740 1 -- 172.21.15.63:0/3312678338 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55becaf268a0 con 0x55becabc99f0 2024-09-21T06:36:44.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.423+0000 7f18b6d9d640 1 --2- 172.21.15.63:0/3312678338 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55becabc99f0 0x55becafcf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:44.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.423+0000 7f189aff5640 10 client.17211 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:36:44.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.423+0000 7f18b6d9d640 1 --2- 172.21.15.63:0/3312678338 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55becabc99f0 0x55becafcf9c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=28f8f259bbfa87b2 server_cookie=4e6b40e00d34b7c9 in_seq=0 out_seq=0 2024-09-21T06:36:44.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.424+0000 7f189aff5640 1 -- 172.21.15.63:0/3312678338 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55becaf268a0 con 0x55becabc99f0 2024-09-21T06:36:44.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.424+0000 7f189aff5640 10 client.17211 handle_command_reply: tid=0 2024-09-21T06:36:44.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.424+0000 7f18c36f8740 1 client.17211 shutdown 2024-09-21T06:36:44.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.424+0000 7f18c36f8740 1 -- 172.21.15.63:0/3312678338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabe21b0 msgr2=0x55becafbd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:44.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.424+0000 7f18c36f8740 1 --2- 172.21.15.63:0/3312678338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabe21b0 0x55becafbd8e0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f18ac006010 tx=0x7f18ac031400 comp rx=0 tx=0).stop 2024-09-21T06:36:44.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.424+0000 7f18c36f8740 1 -- 172.21.15.63:0/3312678338 shutdown_connections 2024-09-21T06:36:44.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.424+0000 7f18c36f8740 1 --2- 172.21.15.63:0/3312678338 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55becabc99f0 0x55becafcf9c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.424+0000 7f18c36f8740 1 --2- 172.21.15.63:0/3312678338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becac0b070 0x55becafbe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.424+0000 7f18c36f8740 1 --2- 172.21.15.63:0/3312678338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55becabea390 0x55becafbde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.424+0000 7f189aff5640 0 client.17211 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:36:44.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.424+0000 7f18c36f8740 1 --2- 172.21.15.63:0/3312678338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabe21b0 0x55becafbd8e0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.424+0000 7f18c36f8740 1 -- 172.21.15.63:0/3312678338 >> 172.21.15.63:0/3312678338 conn(0x55becabff460 msgr2=0x55becafb54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:44.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.424+0000 7f18c36f8740 1 -- 172.21.15.63:0/3312678338 shutdown_connections 2024-09-21T06:36:44.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.424+0000 7f18c36f8740 1 -- 172.21.15.63:0/3312678338 wait complete. 2024-09-21T06:36:44.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.424+0000 7f18c36f8740 20 client.17211 trim_cache size 0 max 16384 2024-09-21T06:36:44.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.437+0000 7f18c36f8740 1 Processor -- start 2024-09-21T06:36:44.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.437+0000 7f18c36f8740 1 -- start start 2024-09-21T06:36:44.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.438+0000 7f18c36f8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becabe21b0 0x55becafb3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:44.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.438+0000 7f18c36f8740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 0x55becafbf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:44.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.438+0000 7f18c36f8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55becac0b070 0x55becafaf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:44.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.438+0000 7f18c36f8740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81af650 con 0x55becabea390 2024-09-21T06:36:44.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.438+0000 7f18c36f8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81b1190 con 0x55becac0b070 2024-09-21T06:36:44.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.438+0000 7f18c36f8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81afd20 con 0x55becabe21b0 2024-09-21T06:36:44.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.438+0000 7f18b6d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 0x55becafbf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:44.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.438+0000 7f18b6d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 0x55becafbf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55228/0 (socket says 172.21.15.63:55228) 2024-09-21T06:36:44.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.438+0000 7f18b6d9d640 1 -- 172.21.15.63:0/3535147257 learned_addr learned my addr 172.21.15.63:0/3535147257 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:44.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.438+0000 7f18b659c640 1 --2- 172.21.15.63:0/3535147257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becabe21b0 0x55becafb3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:44.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.438+0000 7f18b659c640 1 --2- 172.21.15.63:0/3535147257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55becac0b070 0x55becafaf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:44.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.438+0000 7f18b6d9d640 1 -- 172.21.15.63:0/3535147257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becabe21b0 msgr2=0x55becafb3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:44.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.438+0000 7f18b6d9d640 1 --2- 172.21.15.63:0/3535147257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becabe21b0 0x55becafb3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.438+0000 7f18b6d9d640 1 -- 172.21.15.63:0/3535147257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55becac0b070 msgr2=0x55becafaf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:44.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.438+0000 7f18b6d9d640 1 --2- 172.21.15.63:0/3535147257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55becac0b070 0x55becafaf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.438+0000 7f18b6d9d640 1 -- 172.21.15.63:0/3535147257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55becafbeba0 con 0x55becabea390 2024-09-21T06:36:44.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.438+0000 7f18b659c640 1 --2- 172.21.15.63:0/3535147257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becabe21b0 0x55becafb3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:44.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.438+0000 7f18b6d9d640 1 --2- 172.21.15.63:0/3535147257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 0x55becafbf510 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x55becaf28f60 tx=0x7f18a800a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354ab7b3239a6cb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:44.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.439+0000 7f189cff9640 1 -- 172.21.15.63:0/3535147257 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8029070 con 0x55becabea390 2024-09-21T06:36:44.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.439+0000 7f189cff9640 1 -- 172.21.15.63:0/3535147257 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18a8024ac0 con 0x55becabea390 2024-09-21T06:36:44.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.439+0000 7f189cff9640 1 -- 172.21.15.63:0/3535147257 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a801db90 con 0x55becabea390 2024-09-21T06:36:44.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.439+0000 7f18c36f8740 1 -- 172.21.15.63:0/3535147257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 msgr2=0x55becafbf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:44.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.439+0000 7f18c36f8740 1 --2- 172.21.15.63:0/3535147257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 0x55becafbf510 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x55becaf28f60 tx=0x7f18a800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.439+0000 7f18c36f8740 1 -- 172.21.15.63:0/3535147257 shutdown_connections 2024-09-21T06:36:44.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.439+0000 7f18c36f8740 1 --2- 172.21.15.63:0/3535147257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55becac0b070 0x55becafaf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.439+0000 7f18c36f8740 1 --2- 172.21.15.63:0/3535147257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 0x55becafbf510 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.439+0000 7f18c36f8740 1 --2- 172.21.15.63:0/3535147257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becabe21b0 0x55becafb3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.439+0000 7f18c36f8740 1 -- 172.21.15.63:0/3535147257 >> 172.21.15.63:0/3535147257 conn(0x55becabff460 msgr2=0x55becafbee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:44.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.440+0000 7f18c36f8740 1 -- 172.21.15.63:0/3535147257 shutdown_connections 2024-09-21T06:36:44.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.440+0000 7f18c36f8740 1 -- 172.21.15.63:0/3535147257 wait complete. 2024-09-21T06:36:44.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.440+0000 7f18c36f8740 1 -- start start 2024-09-21T06:36:44.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.440+0000 7f18c36f8740 1 Processor -- start 2024-09-21T06:36:44.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.440+0000 7f18c36f8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55becabe21b0 0x55becafd0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:44.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.440+0000 7f18c36f8740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 0x55becafd0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:44.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.440+0000 7f18c36f8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becac0b070 0x55becafd13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:44.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.440+0000 7f18c36f8740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81b0ac0 con 0x55becabea390 2024-09-21T06:36:44.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.440+0000 7f18c36f8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81b03f0 con 0x55becabe21b0 2024-09-21T06:36:44.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.440+0000 7f18c36f8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81ad650 con 0x55becac0b070 2024-09-21T06:36:44.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.440+0000 7f18c36f8740 10 client.0 _ll_register_callbacks cb 0x7f18ac032ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:44.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.440+0000 7f18b6d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 0x55becafd0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:44.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.440+0000 7f18b6d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 0x55becafd0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55230/0 (socket says 172.21.15.63:55230) 2024-09-21T06:36:44.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.440+0000 7f18b6d9d640 1 -- 172.21.15.63:0/1714321390 learned_addr learned my addr 172.21.15.63:0/1714321390 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:44.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.441+0000 7f18b659c640 1 --2- 172.21.15.63:0/1714321390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becac0b070 0x55becafd13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:44.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.441+0000 7f18b659c640 1 --2- 172.21.15.63:0/1714321390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55becabe21b0 0x55becafd0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:44.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.441+0000 7f18b6d9d640 1 -- 172.21.15.63:0/1714321390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becac0b070 msgr2=0x55becafd13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:44.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.441+0000 7f18b6d9d640 1 --2- 172.21.15.63:0/1714321390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becac0b070 0x55becafd13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.441+0000 7f18b6d9d640 1 -- 172.21.15.63:0/1714321390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55becabe21b0 msgr2=0x55becafd0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:44.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.441+0000 7f18b6d9d640 1 --2- 172.21.15.63:0/1714321390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55becabe21b0 0x55becafd0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.441+0000 7f18b6d9d640 1 -- 172.21.15.63:0/1714321390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55becb039140 con 0x55becabea390 2024-09-21T06:36:44.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.441+0000 7f18b659c640 1 --2- 172.21.15.63:0/1714321390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becac0b070 0x55becafd13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:44.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.441+0000 7f18b6d9d640 1 --2- 172.21.15.63:0/1714321390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 0x55becafd0e70 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f18a801d870 tx=0x7f18a801d3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb1ff644125542c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:44.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.441+0000 7f189aff5640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:44.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.441+0000 7f189aff5640 1 -- 172.21.15.63:0/1714321390 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8029040 con 0x55becabea390 2024-09-21T06:36:44.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.441+0000 7f189aff5640 1 -- 172.21.15.63:0/1714321390 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7f18a8024620 con 0x55becabea390 2024-09-21T06:36:44.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.441+0000 7f18c36f8740 1 -- 172.21.15.63:0/1714321390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18a8024ac0 con 0x55becabea390 2024-09-21T06:36:44.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.441+0000 7f189aff5640 1 -- 172.21.15.63:0/1714321390 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f18a803b050 con 0x55becabea390 2024-09-21T06:36:44.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.441+0000 7f18c36f8740 10 client.17217 fetch_fsmap learned FSMap version 61 2024-09-21T06:36:44.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.441+0000 7f18c36f8740 1 -- 172.21.15.63:0/1714321390 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55becb03a300 con 0x55becabea390 2024-09-21T06:36:44.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.442+0000 7f189aff5640 1 -- 172.21.15.63:0/1714321390 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18a8024ac0 con 0x55becabea390 2024-09-21T06:36:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.442+0000 7f189aff5640 1 -- 172.21.15.63:0/1714321390 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f18a8004700 con 0x55becabea390 2024-09-21T06:36:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.442+0000 7f18c36f8740 10 client.17217 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:36:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.442+0000 7f18c36f8740 10 client.17217 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:36:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.442+0000 7f18c36f8740 20 client.17217 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.442+0000 7f18c36f8740 1 --2- 172.21.15.63:0/1714321390 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55becab9eda0 0x55becb03cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.442+0000 7f18c36f8740 4 client.17217 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:36:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.442+0000 7f18c36f8740 1 -- 172.21.15.63:0/1714321390 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55becaf23cd0 con 0x55becab9eda0 2024-09-21T06:36:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.442+0000 7f18b659c640 1 --2- 172.21.15.63:0/1714321390 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55becab9eda0 0x55becb03cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.442+0000 7f189aff5640 10 client.17217 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:36:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.442+0000 7f18b659c640 1 --2- 172.21.15.63:0/1714321390 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55becab9eda0 0x55becb03cb10 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4199bff2a3abdd7c server_cookie=2550cf76a3864554 in_seq=0 out_seq=0 2024-09-21T06:36:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.443+0000 7f189aff5640 1 -- 172.21.15.63:0/1714321390 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55becaf23cd0 con 0x55becab9eda0 2024-09-21T06:36:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.443+0000 7f189aff5640 10 client.17217 handle_command_reply: tid=0 2024-09-21T06:36:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.443+0000 7f18c36f8740 1 client.17217 shutdown 2024-09-21T06:36:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.443+0000 7f18c36f8740 1 -- 172.21.15.63:0/1714321390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 msgr2=0x55becafd0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:44.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.443+0000 7f18c36f8740 1 --2- 172.21.15.63:0/1714321390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 0x55becafd0e70 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f18a801d870 tx=0x7f18a801d3f0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.443+0000 7f18c36f8740 1 -- 172.21.15.63:0/1714321390 shutdown_connections 2024-09-21T06:36:44.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.443+0000 7f18c36f8740 1 --2- 172.21.15.63:0/1714321390 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x55becab9eda0 0x55becb03cb10 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.443+0000 7f18c36f8740 1 --2- 172.21.15.63:0/1714321390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55becac0b070 0x55becafd13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.443+0000 7f18c36f8740 1 --2- 172.21.15.63:0/1714321390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55becabea390 0x55becafd0e70 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.443+0000 7f18c36f8740 1 --2- 172.21.15.63:0/1714321390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55becabe21b0 0x55becafd0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.443+0000 7f18c36f8740 1 -- 172.21.15.63:0/1714321390 >> 172.21.15.63:0/1714321390 conn(0x55becabff460 msgr2=0x55becafb3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:44.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.443+0000 7f189aff5640 0 client.17217 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:36:44.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.443+0000 7f18c36f8740 1 -- 172.21.15.63:0/1714321390 shutdown_connections 2024-09-21T06:36:44.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.443+0000 7f18c36f8740 1 -- 172.21.15.63:0/1714321390 wait complete. 2024-09-21T06:36:44.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.443+0000 7f18c36f8740 20 client.17217 trim_cache size 0 max 16384 2024-09-21T06:36:44.450 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:36:44.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.444+0000 7f18bd184640 1 -- 172.21.15.63:0/2352499234 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f18a00b66b0 msgr2=0x7f18a00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:44.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.444+0000 7f18bd184640 1 --2- 172.21.15.63:0/2352499234 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f18a00b66b0 0x7f18a00b8bc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f18b00aabc0 tx=0x7f18b007a600 comp rx=0 tx=0).stop 2024-09-21T06:36:44.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.444+0000 7f18bd184640 1 -- 172.21.15.63:0/2352499234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18b8108d10 msgr2=0x7f18b819bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:44.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.444+0000 7f18bd184640 1 --2- 172.21.15.63:0/2352499234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18b8108d10 0x7f18b819bcd0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f18b000cce0 tx=0x7f18b000a620 comp rx=0 tx=0).stop 2024-09-21T06:36:44.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.444+0000 7f18bd184640 1 -- 172.21.15.63:0/2352499234 shutdown_connections 2024-09-21T06:36:44.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.444+0000 7f18bd184640 1 --2- 172.21.15.63:0/2352499234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18b8108d10 0x7f18b819bcd0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.444+0000 7f18bd184640 1 --2- 172.21.15.63:0/2352499234 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18b81083c0 0x7f18b819b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.444+0000 7f18bd184640 1 --2- 172.21.15.63:0/2352499234 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f18a00b66b0 0x7f18a00b8bc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.444+0000 7f18bd184640 1 --2- 172.21.15.63:0/2352499234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18b8102a80 0x7f18b819b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:44.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.444+0000 7f18bd184640 1 -- 172.21.15.63:0/2352499234 >> 172.21.15.63:0/2352499234 conn(0x7f18b8079740 msgr2=0x7f18b8104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:44.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.444+0000 7f18bd184640 1 -- 172.21.15.63:0/2352499234 shutdown_connections 2024-09-21T06:36:44.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:44.444+0000 7f18bd184640 1 -- 172.21.15.63:0/2352499234 wait complete. 2024-09-21T06:36:45.121 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:36:45.378 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:45.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:45 smithi071 ceph-mon[34844]: pgmap v583: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:36:45.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:45 smithi063 ceph-mon[31150]: pgmap v583: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:36:45.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:45 smithi175 ceph-mon[34510]: pgmap v583: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:36:46.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.039+0000 7fb0ac63c640 1 -- 172.21.15.63:0/2630166005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0a410de20 msgr2=0x7fb0a4110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:46.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.039+0000 7fb0ac63c640 1 --2- 172.21.15.63:0/2630166005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0a410de20 0x7fb0a4110310 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009ca0 tx=0x7fb09c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.040+0000 7fb0ac63c640 1 -- 172.21.15.63:0/2630166005 shutdown_connections 2024-09-21T06:36:46.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.040+0000 7fb0ac63c640 1 --2- 172.21.15.63:0/2630166005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0a410de20 0x7fb0a4110310 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.040+0000 7fb0ac63c640 1 --2- 172.21.15.63:0/2630166005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0a4105310 0x7fb0a410d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.040+0000 7fb0ac63c640 1 --2- 172.21.15.63:0/2630166005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0a41049c0 0x7fb0a4104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.040+0000 7fb0ac63c640 1 -- 172.21.15.63:0/2630166005 >> 172.21.15.63:0/2630166005 conn(0x7fb0a4079710 msgr2=0x7fb0a4079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.040+0000 7fb0ac63c640 1 -- 172.21.15.63:0/2630166005 shutdown_connections 2024-09-21T06:36:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.040+0000 7fb0ac63c640 1 -- 172.21.15.63:0/2630166005 wait complete. 2024-09-21T06:36:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.040+0000 7fb0ac63c640 1 Processor -- start 2024-09-21T06:36:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.040+0000 7fb0ac63c640 1 -- start start 2024-09-21T06:36:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.041+0000 7fb0ac63c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0a41049c0 0x7fb0a419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.041+0000 7fb0ac63c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0a4105310 0x7fb0a419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.041+0000 7fb0ac63c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0a410de20 0x7fb0a419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.041+0000 7fb0ac63c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a4113aa0 con 0x7fb0a41049c0 2024-09-21T06:36:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.041+0000 7fb0ac63c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a4113920 con 0x7fb0a4105310 2024-09-21T06:36:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.041+0000 7fb0ac63c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a4113c20 con 0x7fb0a410de20 2024-09-21T06:36:46.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.041+0000 7fb0aa3d8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0a41049c0 0x7fb0a419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.041+0000 7fb0aa3d8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0a41049c0 0x7fb0a419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55250/0 (socket says 172.21.15.63:55250) 2024-09-21T06:36:46.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.041+0000 7fb0aa3d8640 1 -- 172.21.15.63:0/2888818881 learned_addr learned my addr 172.21.15.63:0/2888818881 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:46.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.041+0000 7fb0aabd9640 1 --2- 172.21.15.63:0/2888818881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0a410de20 0x7fb0a419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.041+0000 7fb0a9bd7640 1 --2- 172.21.15.63:0/2888818881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0a4105310 0x7fb0a419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.041+0000 7fb0aa3d8640 1 -- 172.21.15.63:0/2888818881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0a410de20 msgr2=0x7fb0a419fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:46.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.041+0000 7fb0aa3d8640 1 --2- 172.21.15.63:0/2888818881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0a410de20 0x7fb0a419fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.041+0000 7fb0aa3d8640 1 -- 172.21.15.63:0/2888818881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0a4105310 msgr2=0x7fb0a419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:46.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.041+0000 7fb0aa3d8640 1 --2- 172.21.15.63:0/2888818881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0a4105310 0x7fb0a419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.041+0000 7fb0aa3d8640 1 -- 172.21.15.63:0/2888818881 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a41a0340 con 0x7fb0a41049c0 2024-09-21T06:36:46.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.041+0000 7fb0a9bd7640 1 --2- 172.21.15.63:0/2888818881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0a4105310 0x7fb0a419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:46.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.041+0000 7fb0aa3d8640 1 --2- 172.21.15.63:0/2888818881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0a41049c0 0x7fb0a419a490 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fb09800e9f0 tx=0x7fb09800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:46.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.042+0000 7fb0977fe640 1 -- 172.21.15.63:0/2888818881 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09800cd80 con 0x7fb0a41049c0 2024-09-21T06:36:46.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.042+0000 7fb0ac63c640 1 -- 172.21.15.63:0/2888818881 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a41a0630 con 0x7fb0a41049c0 2024-09-21T06:36:46.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.042+0000 7fb0977fe640 1 -- 172.21.15.63:0/2888818881 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0980054d0 con 0x7fb0a41049c0 2024-09-21T06:36:46.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.042+0000 7fb0977fe640 1 -- 172.21.15.63:0/2888818881 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb098010690 con 0x7fb0a41049c0 2024-09-21T06:36:46.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.042+0000 7fb0ac63c640 1 -- 172.21.15.63:0/2888818881 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a41a6e50 con 0x7fb0a41049c0 2024-09-21T06:36:46.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.045+0000 7fb0b2bb0740 1 Processor -- start 2024-09-21T06:36:46.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.045+0000 7fb0b2bb0740 1 -- start start 2024-09-21T06:36:46.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.045+0000 7fb0977fe640 1 -- 172.21.15.63:0/2888818881 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fb098004e50 con 0x7fb0a41049c0 2024-09-21T06:36:46.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.045+0000 7fb0b2bb0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce945070 0x55e3cecec2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.045+0000 7fb0b2bb0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 0x55e3cecec800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.045+0000 7fb0b2bb0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3ce924390 0x55e3cececd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.045+0000 7fb0b2bb0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55e3cec62ea0 con 0x55e3ce945070 2024-09-21T06:36:46.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.045+0000 7fb0b2bb0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e3cec522d0 con 0x55e3ce91c1b0 2024-09-21T06:36:46.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.045+0000 7fb0b2bb0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e3cec560e0 con 0x55e3ce924390 2024-09-21T06:36:46.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.045+0000 7fb0aabd9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce945070 0x55e3cecec2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.045+0000 7fb0aabd9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce945070 0x55e3cecec2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55266/0 (socket says 172.21.15.63:55266) 2024-09-21T06:36:46.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.045+0000 7fb0aabd9640 1 -- 172.21.15.63:0/599163380 learned_addr learned my addr 172.21.15.63:0/599163380 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:46.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.045+0000 7fb0a9bd7640 1 --2- 172.21.15.63:0/599163380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3ce924390 0x55e3cececd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.045+0000 7fb0aa3d8640 1 --2- 172.21.15.63:0/599163380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 0x55e3cecec800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.046+0000 7fb0aabd9640 1 -- 172.21.15.63:0/599163380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3ce924390 msgr2=0x55e3cececd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:46.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.046+0000 7fb0aabd9640 1 --2- 172.21.15.63:0/599163380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3ce924390 0x55e3cececd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.046+0000 7fb0aabd9640 1 -- 172.21.15.63:0/599163380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 msgr2=0x55e3cecec800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:46.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.046+0000 7fb0aabd9640 1 --2- 172.21.15.63:0/599163380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 0x55e3cecec800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.046+0000 7fb0aabd9640 1 -- 172.21.15.63:0/599163380 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3ce9b0650 con 0x55e3ce945070 2024-09-21T06:36:46.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.046+0000 7fb0aa3d8640 1 --2- 172.21.15.63:0/599163380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 0x55e3cecec800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:46.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.046+0000 7fb0aabd9640 1 --2- 172.21.15.63:0/599163380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce945070 0x55e3cecec2c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0098b0 tx=0x7fb09c0098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63df9a994ac0a9ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:46.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.046+0000 7fb0977fe640 1 --2- 172.21.15.63:0/2888818881 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb0900b66b0 0x7fb0900b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.046+0000 7fb094ff9640 1 -- 172.21.15.63:0/599163380 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c031d70 con 0x55e3ce945070 2024-09-21T06:36:46.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.046+0000 7fb094ff9640 1 -- 172.21.15.63:0/599163380 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb09c040070 con 0x55e3ce945070 2024-09-21T06:36:46.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.046+0000 7fb094ff9640 1 -- 172.21.15.63:0/599163380 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c0042a0 con 0x55e3ce945070 2024-09-21T06:36:46.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.046+0000 7fb0aa3d8640 1 --2- 172.21.15.63:0/2888818881 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb0900b66b0 0x7fb0900b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.046+0000 7fb0977fe640 1 -- 172.21.15.63:0/2888818881 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7fb0980e7c80 con 0x7fb0a41049c0 2024-09-21T06:36:46.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.047+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/599163380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce945070 msgr2=0x55e3cecec2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:46.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.047+0000 7fb0aa3d8640 1 --2- 172.21.15.63:0/2888818881 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb0900b66b0 0x7fb0900b8bc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb0980e5430 tx=0x7fb098004a90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:46.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.047+0000 7fb0b2bb0740 1 --2- 172.21.15.63:0/599163380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce945070 0x55e3cecec2c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0098b0 tx=0x7fb09c0098e0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.047+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/599163380 shutdown_connections 2024-09-21T06:36:46.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.047+0000 7fb0b2bb0740 1 --2- 172.21.15.63:0/599163380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3ce924390 0x55e3cececd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.047+0000 7fb0b2bb0740 1 --2- 172.21.15.63:0/599163380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 0x55e3cecec800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.047+0000 7fb0b2bb0740 1 --2- 172.21.15.63:0/599163380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce945070 0x55e3cecec2c0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.047+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/599163380 >> 172.21.15.63:0/599163380 conn(0x55e3ce939460 msgr2=0x55e3cecea1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:46.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.048+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/599163380 shutdown_connections 2024-09-21T06:36:46.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.048+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/599163380 wait complete. 2024-09-21T06:36:46.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.048+0000 7fb0b2bb0740 1 -- start start 2024-09-21T06:36:46.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.048+0000 7fb0b2bb0740 1 Processor -- start 2024-09-21T06:36:46.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.048+0000 7fb0b2bb0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 0x55e3cecfbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.048+0000 7fb0b2bb0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce924390 0x55e3cecfc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.048+0000 7fb0b2bb0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3ce945070 0x55e3ced080d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.048+0000 7fb0b2bb0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55e3ceab3700 con 0x55e3ce924390 2024-09-21T06:36:46.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.048+0000 7fb0b2bb0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e3cebed160 con 0x55e3ce91c1b0 2024-09-21T06:36:46.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.048+0000 7fb0b2bb0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e3cecfed70 con 0x55e3ce945070 2024-09-21T06:36:46.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.048+0000 7fb0b2bb0740 10 client.0 _ll_register_callbacks cb 0x55e3cec069e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:46.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.049+0000 7fb0a9bd7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce924390 0x55e3cecfc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.049+0000 7fb0a9bd7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce924390 0x55e3cecfc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55282/0 (socket says 172.21.15.63:55282) 2024-09-21T06:36:46.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.049+0000 7fb0a9bd7640 1 -- 172.21.15.63:0/2608826921 learned_addr learned my addr 172.21.15.63:0/2608826921 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:46.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.049+0000 7fb0aabd9640 1 --2- 172.21.15.63:0/2608826921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3ce945070 0x55e3ced080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.049+0000 7fb0a9bd7640 1 -- 172.21.15.63:0/2608826921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3ce945070 msgr2=0x55e3ced080d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.049+0000 7fb0aabd9640 1 --2- 172.21.15.63:0/2608826921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 0x55e3cecfbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.049+0000 7fb0a9bd7640 1 --2- 172.21.15.63:0/2608826921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3ce945070 0x55e3ced080d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.049+0000 7fb0a9bd7640 1 -- 172.21.15.63:0/2608826921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 msgr2=0x55e3cecfbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.049+0000 7fb0a9bd7640 1 --2- 172.21.15.63:0/2608826921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 0x55e3cecfbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.049+0000 7fb0a9bd7640 1 -- 172.21.15.63:0/2608826921 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3cec1ac90 con 0x55e3ce924390 2024-09-21T06:36:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.049+0000 7fb0aabd9640 1 --2- 172.21.15.63:0/2608826921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 0x55e3cecfbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.049+0000 7fb0a9bd7640 1 --2- 172.21.15.63:0/2608826921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce924390 0x55e3cecfc2e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0010820 tx=0x7fb0a0010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64db540b63a141a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.049+0000 7fb08dffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.049+0000 7fb08dffb640 1 -- 172.21.15.63:0/2608826921 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a001d060 con 0x55e3ce924390 2024-09-21T06:36:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.049+0000 7fb08dffb640 1 -- 172.21.15.63:0/2608826921 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7fb0a000eda0 con 0x55e3ce924390 2024-09-21T06:36:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.049+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/2608826921 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb09c040070 con 0x55e3ce924390 2024-09-21T06:36:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.049+0000 7fb08dffb640 1 -- 172.21.15.63:0/2608826921 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fb0a0018430 con 0x55e3ce924390 2024-09-21T06:36:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.050+0000 7fb0b2bb0740 10 client.17229 fetch_fsmap learned FSMap version 61 2024-09-21T06:36:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.050+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/2608826921 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55e3ced0ab60 con 0x55e3ce924390 2024-09-21T06:36:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.050+0000 7fb08dffb640 1 -- 172.21.15.63:0/2608826921 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb09c040070 con 0x55e3ce924390 2024-09-21T06:36:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.050+0000 7fb08dffb640 1 -- 172.21.15.63:0/2608826921 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fb0a000d530 con 0x55e3ce924390 2024-09-21T06:36:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.050+0000 7fb0b2bb0740 10 client.17229 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:36:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.050+0000 7fb0b2bb0740 10 client.17229 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:36:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.050+0000 7fb0b2bb0740 20 client.17229 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.050+0000 7fb0b2bb0740 1 --2- 172.21.15.63:0/2608826921 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e3ce9039f0 0x55e3ced0e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.050+0000 7fb0b2bb0740 4 client.17229 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.050+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/2608826921 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3cec64df0 con 0x55e3ce9039f0 2024-09-21T06:36:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.050+0000 7fb0aabd9640 1 --2- 172.21.15.63:0/2608826921 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e3ce9039f0 0x55e3ced0e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.051+0000 7fb0aabd9640 1 --2- 172.21.15.63:0/2608826921 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e3ce9039f0 0x55e3ced0e070 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c50a0c4b19354948 server_cookie=e9133a93b68c2a59 in_seq=0 out_seq=0 2024-09-21T06:36:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.051+0000 7fb08dffb640 10 client.17229 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.051+0000 7fb08dffb640 1 -- 172.21.15.63:0/2608826921 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e3cec64df0 con 0x55e3ce9039f0 2024-09-21T06:36:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.051+0000 7fb08dffb640 10 client.17229 handle_command_reply: tid=0 2024-09-21T06:36:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.052+0000 7fb0b2bb0740 1 client.17229 shutdown 2024-09-21T06:36:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.052+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/2608826921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce924390 msgr2=0x55e3cecfc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.052+0000 7fb0b2bb0740 1 --2- 172.21.15.63:0/2608826921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce924390 0x55e3cecfc2e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0010820 tx=0x7fb0a0010ce0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.052+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/2608826921 shutdown_connections 2024-09-21T06:36:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.052+0000 7fb0b2bb0740 1 --2- 172.21.15.63:0/2608826921 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e3ce9039f0 0x55e3ced0e070 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.052+0000 7fb0b2bb0740 1 --2- 172.21.15.63:0/2608826921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3ce945070 0x55e3ced080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.052+0000 7fb0b2bb0740 1 --2- 172.21.15.63:0/2608826921 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce924390 0x55e3cecfc2e0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.052+0000 7fb08dffb640 0 client.17229 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.052+0000 7fb0b2bb0740 1 --2- 172.21.15.63:0/2608826921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 0x55e3cecfbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.052+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/2608826921 >> 172.21.15.63:0/2608826921 conn(0x55e3ce939460 msgr2=0x55e3cecef450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.052+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/2608826921 shutdown_connections 2024-09-21T06:36:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.052+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/2608826921 wait complete. 2024-09-21T06:36:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.052+0000 7fb0b2bb0740 20 client.17229 trim_cache size 0 max 16384 2024-09-21T06:36:46.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.065+0000 7fb0b2bb0740 1 Processor -- start 2024-09-21T06:36:46.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.065+0000 7fb0b2bb0740 1 -- start start 2024-09-21T06:36:46.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.065+0000 7fb0b2bb0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3ce9039f0 0x55e3ceceda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.065+0000 7fb0b2bb0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 0x55e3ced07fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.065+0000 7fb0b2bb0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce924390 0x55e3cecf8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.066+0000 7fb0b2bb0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a41ad570 con 0x55e3ce924390 2024-09-21T06:36:46.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.066+0000 7fb0b2bb0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a41af0b0 con 0x55e3ce91c1b0 2024-09-21T06:36:46.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.066+0000 7fb0b2bb0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a41adc40 con 0x55e3ce9039f0 2024-09-21T06:36:46.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.066+0000 7fb0aabd9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce924390 0x55e3cecf8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.066+0000 7fb0aabd9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce924390 0x55e3cecf8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55284/0 (socket says 172.21.15.63:55284) 2024-09-21T06:36:46.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.066+0000 7fb0aabd9640 1 -- 172.21.15.63:0/1845121534 learned_addr learned my addr 172.21.15.63:0/1845121534 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:46.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.066+0000 7fb0aabd9640 1 --2- 172.21.15.63:0/1845121534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3ce9039f0 0x55e3ceceda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.066+0000 7fb0a9bd7640 1 --2- 172.21.15.63:0/1845121534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 0x55e3ced07fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.066+0000 7fb0aabd9640 1 -- 172.21.15.63:0/1845121534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3ce9039f0 msgr2=0x55e3ceceda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:46.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.066+0000 7fb0aabd9640 1 --2- 172.21.15.63:0/1845121534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3ce9039f0 0x55e3ceceda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.066+0000 7fb0aabd9640 1 -- 172.21.15.63:0/1845121534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 msgr2=0x55e3ced07fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:46.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.066+0000 7fb0aabd9640 1 --2- 172.21.15.63:0/1845121534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 0x55e3ced07fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.066+0000 7fb0aabd9640 1 -- 172.21.15.63:0/1845121534 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3ceceeb90 con 0x55e3ce924390 2024-09-21T06:36:46.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.066+0000 7fb0aabd9640 1 --2- 172.21.15.63:0/1845121534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce924390 0x55e3cecf8f90 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009950 tx=0x7fb09c0098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335a7e7226dd9aed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:46.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.066+0000 7fb08ffff640 1 -- 172.21.15.63:0/1845121534 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c031c70 con 0x55e3ce924390 2024-09-21T06:36:46.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.066+0000 7fb08ffff640 1 -- 172.21.15.63:0/1845121534 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb09c040050 con 0x55e3ce924390 2024-09-21T06:36:46.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.066+0000 7fb08ffff640 1 -- 172.21.15.63:0/1845121534 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c0046c0 con 0x55e3ce924390 2024-09-21T06:36:46.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.067+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/1845121534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce924390 msgr2=0x55e3cecf8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:46.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.067+0000 7fb0b2bb0740 1 --2- 172.21.15.63:0/1845121534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce924390 0x55e3cecf8f90 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009950 tx=0x7fb09c0098e0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.067+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/1845121534 shutdown_connections 2024-09-21T06:36:46.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.067+0000 7fb0b2bb0740 1 --2- 172.21.15.63:0/1845121534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce924390 0x55e3cecf8f90 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.067+0000 7fb0b2bb0740 1 --2- 172.21.15.63:0/1845121534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 0x55e3ced07fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.067+0000 7fb0b2bb0740 1 --2- 172.21.15.63:0/1845121534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3ce9039f0 0x55e3ceceda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.067+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/1845121534 >> 172.21.15.63:0/1845121534 conn(0x55e3ce939460 msgr2=0x55e3ceced2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:46.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.067+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/1845121534 shutdown_connections 2024-09-21T06:36:46.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.067+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/1845121534 wait complete. 2024-09-21T06:36:46.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.068+0000 7fb0b2bb0740 1 -- start start 2024-09-21T06:36:46.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.068+0000 7fb0b2bb0740 1 Processor -- start 2024-09-21T06:36:46.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.068+0000 7fb0b2bb0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce9039f0 0x55e3ced001a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.068+0000 7fb0b2bb0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 0x55e3ced006e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.068+0000 7fb0b2bb0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3ce924390 0x55e3ced00c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.068+0000 7fb0b2bb0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a41ae9e0 con 0x55e3ce9039f0 2024-09-21T06:36:46.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.068+0000 7fb0b2bb0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a41ae310 con 0x55e3ce91c1b0 2024-09-21T06:36:46.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.068+0000 7fb0b2bb0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a41ab570 con 0x55e3ce924390 2024-09-21T06:36:46.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.068+0000 7fb0b2bb0740 10 client.0 _ll_register_callbacks cb 0x7fb0a000b630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:46.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.068+0000 7fb0aabd9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce9039f0 0x55e3ced001a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.068+0000 7fb0aabd9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce9039f0 0x55e3ced001a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55292/0 (socket says 172.21.15.63:55292) 2024-09-21T06:36:46.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.068+0000 7fb0aabd9640 1 -- 172.21.15.63:0/4080525040 learned_addr learned my addr 172.21.15.63:0/4080525040 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:46.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.068+0000 7fb0a9bd7640 1 --2- 172.21.15.63:0/4080525040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 0x55e3ced006e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.068+0000 7fb0aabd9640 1 --2- 172.21.15.63:0/4080525040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3ce924390 0x55e3ced00c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.069+0000 7fb0aabd9640 1 -- 172.21.15.63:0/4080525040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3ce924390 msgr2=0x55e3ced00c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:46.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.069+0000 7fb0aabd9640 1 --2- 172.21.15.63:0/4080525040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3ce924390 0x55e3ced00c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.069+0000 7fb0aabd9640 1 -- 172.21.15.63:0/4080525040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 msgr2=0x55e3ced006e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:46.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.069+0000 7fb0aabd9640 1 --2- 172.21.15.63:0/4080525040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 0x55e3ced006e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.069+0000 7fb0aabd9640 1 -- 172.21.15.63:0/4080525040 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3ced77be0 con 0x55e3ce9039f0 2024-09-21T06:36:46.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.069+0000 7fb0aabd9640 1 --2- 172.21.15.63:0/4080525040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce9039f0 0x55e3ced001a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fb09c02f470 tx=0x7fb09c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f192cf9df53c64 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:46.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.069+0000 7fb08dffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:46.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.069+0000 7fb08dffb640 1 -- 172.21.15.63:0/4080525040 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c065060 con 0x55e3ce9039f0 2024-09-21T06:36:46.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.069+0000 7fb08dffb640 1 -- 172.21.15.63:0/4080525040 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7fb09c0047b0 con 0x55e3ce9039f0 2024-09-21T06:36:46.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.069+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/4080525040 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb09c040050 con 0x55e3ce9039f0 2024-09-21T06:36:46.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.069+0000 7fb08dffb640 1 -- 172.21.15.63:0/4080525040 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fb09c04d040 con 0x55e3ce9039f0 2024-09-21T06:36:46.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.069+0000 7fb0b2bb0740 10 client.17235 fetch_fsmap learned FSMap version 61 2024-09-21T06:36:46.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.069+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/4080525040 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55e3ced78e40 con 0x55e3ce9039f0 2024-09-21T06:36:46.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.069+0000 7fb08dffb640 1 -- 172.21.15.63:0/4080525040 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb09c040050 con 0x55e3ce9039f0 2024-09-21T06:36:46.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.070+0000 7fb08dffb640 1 -- 172.21.15.63:0/4080525040 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fb09c02fae0 con 0x55e3ce9039f0 2024-09-21T06:36:46.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.070+0000 7fb0b2bb0740 10 client.17235 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:36:46.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.070+0000 7fb0b2bb0740 10 client.17235 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:36:46.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.070+0000 7fb0b2bb0740 20 client.17235 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:46.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.070+0000 7fb0b2bb0740 1 --2- 172.21.15.63:0/4080525040 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e3ce945070 0x55e3ced7b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.070+0000 7fb0b2bb0740 4 client.17235 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:36:46.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.070+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/4080525040 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e3cec608a0 con 0x55e3ce945070 2024-09-21T06:36:46.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.070+0000 7fb0a9bd7640 1 --2- 172.21.15.63:0/4080525040 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e3ce945070 0x55e3ced7b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.070+0000 7fb0a9bd7640 1 --2- 172.21.15.63:0/4080525040 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e3ce945070 0x55e3ced7b020 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afa3b4420a92a26e server_cookie=f02757d88d56f68e in_seq=0 out_seq=0 2024-09-21T06:36:46.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.070+0000 7fb08dffb640 10 client.17235 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:46.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.071+0000 7fb08dffb640 1 -- 172.21.15.63:0/4080525040 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e3cec608a0 con 0x55e3ce945070 2024-09-21T06:36:46.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.071+0000 7fb08dffb640 10 client.17235 handle_command_reply: tid=0 2024-09-21T06:36:46.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.071+0000 7fb0b2bb0740 1 client.17235 shutdown 2024-09-21T06:36:46.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.071+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/4080525040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce9039f0 msgr2=0x55e3ced001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:46.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.071+0000 7fb0b2bb0740 1 --2- 172.21.15.63:0/4080525040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce9039f0 0x55e3ced001a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fb09c02f470 tx=0x7fb09c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.071+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/4080525040 shutdown_connections 2024-09-21T06:36:46.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.071+0000 7fb0b2bb0740 1 --2- 172.21.15.63:0/4080525040 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e3ce945070 0x55e3ced7b020 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.071+0000 7fb0b2bb0740 1 --2- 172.21.15.63:0/4080525040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3ce924390 0x55e3ced00c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.071+0000 7fb0b2bb0740 1 --2- 172.21.15.63:0/4080525040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e3ce91c1b0 0x55e3ced006e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.071+0000 7fb08dffb640 0 client.17235 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:46.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.071+0000 7fb0b2bb0740 1 --2- 172.21.15.63:0/4080525040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e3ce9039f0 0x55e3ced001a0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.071+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/4080525040 >> 172.21.15.63:0/4080525040 conn(0x55e3ce939460 msgr2=0x55e3cecedcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:46.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.071+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/4080525040 shutdown_connections 2024-09-21T06:36:46.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.071+0000 7fb0b2bb0740 1 -- 172.21.15.63:0/4080525040 wait complete. 2024-09-21T06:36:46.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.071+0000 7fb0b2bb0740 20 client.17235 trim_cache size 0 max 16384 2024-09-21T06:36:46.078 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:36:46.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.071+0000 7fb0ac63c640 1 -- 172.21.15.63:0/2888818881 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb0900b66b0 msgr2=0x7fb0900b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:46.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.071+0000 7fb0ac63c640 1 --2- 172.21.15.63:0/2888818881 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb0900b66b0 0x7fb0900b8bc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb0980e5430 tx=0x7fb098004a90 comp rx=0 tx=0).stop 2024-09-21T06:36:46.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.071+0000 7fb0ac63c640 1 -- 172.21.15.63:0/2888818881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0a41049c0 msgr2=0x7fb0a419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:46.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.071+0000 7fb0ac63c640 1 --2- 172.21.15.63:0/2888818881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0a41049c0 0x7fb0a419a490 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fb09800e9f0 tx=0x7fb09800edf0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.072+0000 7fb0ac63c640 1 -- 172.21.15.63:0/2888818881 shutdown_connections 2024-09-21T06:36:46.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.072+0000 7fb0ac63c640 1 --2- 172.21.15.63:0/2888818881 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb0900b66b0 0x7fb0900b8bc0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.072+0000 7fb0ac63c640 1 --2- 172.21.15.63:0/2888818881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0a410de20 0x7fb0a419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.072+0000 7fb0ac63c640 1 --2- 172.21.15.63:0/2888818881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0a4105310 0x7fb0a419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.072+0000 7fb0ac63c640 1 --2- 172.21.15.63:0/2888818881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0a41049c0 0x7fb0a419a490 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.072+0000 7fb0ac63c640 1 -- 172.21.15.63:0/2888818881 >> 172.21.15.63:0/2888818881 conn(0x7fb0a4079710 msgr2=0x7fb0a40ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:46.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.072+0000 7fb0ac63c640 1 -- 172.21.15.63:0/2888818881 shutdown_connections 2024-09-21T06:36:46.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:46.072+0000 7fb0ac63c640 1 -- 172.21.15.63:0/2888818881 wait complete. 2024-09-21T06:36:46.763 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T06:36:47.024 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:47.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.483+0000 7fb4c5e4f640 1 -- 172.21.15.63:0/3458193064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4c01083a0 msgr2=0x7fb4c01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:47.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.483+0000 7fb4c5e4f640 1 --2- 172.21.15.63:0/3458193064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4c01083a0 0x7fb4c01087b0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4009900 tx=0x7fb4b402a410 comp rx=0 tx=0).stop 2024-09-21T06:36:47.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.483+0000 7fb4c5e4f640 1 -- 172.21.15.63:0/3458193064 shutdown_connections 2024-09-21T06:36:47.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.483+0000 7fb4c5e4f640 1 --2- 172.21.15.63:0/3458193064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4c0108cf0 0x7fb4c010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.483+0000 7fb4c5e4f640 1 --2- 172.21.15.63:0/3458193064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4c01083a0 0x7fb4c01087b0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.483+0000 7fb4c5e4f640 1 --2- 172.21.15.63:0/3458193064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4c0102a60 0x7fb4c0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.483+0000 7fb4c5e4f640 1 -- 172.21.15.63:0/3458193064 >> 172.21.15.63:0/3458193064 conn(0x7fb4c0079730 msgr2=0x7fb4c0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:47.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.483+0000 7fb4c5e4f640 1 -- 172.21.15.63:0/3458193064 shutdown_connections 2024-09-21T06:36:47.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.483+0000 7fb4c5e4f640 1 -- 172.21.15.63:0/3458193064 wait complete. 2024-09-21T06:36:47.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.484+0000 7fb4c5e4f640 1 Processor -- start 2024-09-21T06:36:47.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.484+0000 7fb4c5e4f640 1 -- start start 2024-09-21T06:36:47.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.484+0000 7fb4c5e4f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4c0102a60 0x7fb4c019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:47.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.484+0000 7fb4c5e4f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4c01083a0 0x7fb4c019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:47.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.484+0000 7fb4c5e4f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4c0108cf0 0x7fb4c019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:47.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.484+0000 7fb4c5e4f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c0112960 con 0x7fb4c01083a0 2024-09-21T06:36:47.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.484+0000 7fb4c5e4f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c01127e0 con 0x7fb4c0102a60 2024-09-21T06:36:47.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.485+0000 7fb4c5e4f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c0112ae0 con 0x7fb4c0108cf0 2024-09-21T06:36:47.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.485+0000 7fb4beffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4c01083a0 0x7fb4c019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:47.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.485+0000 7fb4beffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4c01083a0 0x7fb4c019aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57280/0 (socket says 172.21.15.63:57280) 2024-09-21T06:36:47.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.485+0000 7fb4beffd640 1 -- 172.21.15.63:0/611528823 learned_addr learned my addr 172.21.15.63:0/611528823 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:47.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.485+0000 7fb4bf7fe640 1 --2- 172.21.15.63:0/611528823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4c0102a60 0x7fb4c019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:47.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.485+0000 7fb4bffff640 1 --2- 172.21.15.63:0/611528823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4c0108cf0 0x7fb4c019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:47.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.485+0000 7fb4beffd640 1 -- 172.21.15.63:0/611528823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4c0108cf0 msgr2=0x7fb4c019fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:47.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.485+0000 7fb4beffd640 1 --2- 172.21.15.63:0/611528823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4c0108cf0 0x7fb4c019fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.485+0000 7fb4beffd640 1 -- 172.21.15.63:0/611528823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4c0102a60 msgr2=0x7fb4c019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:47.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.485+0000 7fb4beffd640 1 --2- 172.21.15.63:0/611528823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4c0102a60 0x7fb4c019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.485+0000 7fb4beffd640 1 -- 172.21.15.63:0/611528823 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4c01a03d0 con 0x7fb4c01083a0 2024-09-21T06:36:47.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.485+0000 7fb4bffff640 1 --2- 172.21.15.63:0/611528823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4c0108cf0 0x7fb4c019fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:47.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.485+0000 7fb4beffd640 1 --2- 172.21.15.63:0/611528823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4c01083a0 0x7fb4c019aa00 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4032fd0 tx=0x7fb4b4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:47.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.485+0000 7fb4bcff9640 1 -- 172.21.15.63:0/611528823 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b403f030 con 0x7fb4c01083a0 2024-09-21T06:36:47.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.486+0000 7fb4c5e4f640 1 -- 172.21.15.63:0/611528823 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4c01a0660 con 0x7fb4c01083a0 2024-09-21T06:36:47.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.486+0000 7fb4bcff9640 1 -- 172.21.15.63:0/611528823 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4b4004490 con 0x7fb4c01083a0 2024-09-21T06:36:47.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.486+0000 7fb4bcff9640 1 -- 172.21.15.63:0/611528823 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4035070 con 0x7fb4c01083a0 2024-09-21T06:36:47.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.486+0000 7fb4c5e4f640 1 -- 172.21.15.63:0/611528823 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4c01a6e20 con 0x7fb4c01083a0 2024-09-21T06:36:47.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.488+0000 7fb4bcff9640 1 -- 172.21.15.63:0/611528823 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fb4b4042030 con 0x7fb4c01083a0 2024-09-21T06:36:47.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.489+0000 7fb4cc3c3740 1 Processor -- start 2024-09-21T06:36:47.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.489+0000 7fb4cc3c3740 1 -- start start 2024-09-21T06:36:47.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.489+0000 7fb4bcff9640 1 --2- 172.21.15.63:0/611528823 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb4a80b6680 0x7fb4a80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:47.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.489+0000 7fb4cc3c3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558146e46070 0x5581471ed6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:47.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.489+0000 7fb4cc3c3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e1d1b0 0x5581471edbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:47.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.489+0000 7fb4cc3c3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558146e25390 0x5581471ee120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:47.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.489+0000 7fb4cc3c3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558147163ea0 con 0x558146e1d1b0 2024-09-21T06:36:47.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.489+0000 7fb4cc3c3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5581471532d0 con 0x558146e46070 2024-09-21T06:36:47.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.489+0000 7fb4cc3c3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5581471570e0 con 0x558146e25390 2024-09-21T06:36:47.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.490+0000 7fb4bffff640 1 --2- 172.21.15.63:0/611528823 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb4a80b6680 0x7fb4a80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:47.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.490+0000 7fb4bcff9640 1 -- 172.21.15.63:0/611528823 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7fb4b4107ce0 con 0x7fb4c01083a0 2024-09-21T06:36:47.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.490+0000 7fb4beffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e1d1b0 0x5581471edbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:47.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.490+0000 7fb4beffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e1d1b0 0x5581471edbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57296/0 (socket says 172.21.15.63:57296) 2024-09-21T06:36:47.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.490+0000 7fb4beffd640 1 -- 172.21.15.63:0/1632777343 learned_addr learned my addr 172.21.15.63:0/1632777343 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:47.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.490+0000 7fb4bf7fe640 1 --2- 172.21.15.63:0/1632777343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558146e46070 0x5581471ed6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:47.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.490+0000 7fb4bffff640 1 --2- 172.21.15.63:0/1632777343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558146e25390 0x5581471ee120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:47.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.490+0000 7fb4beffd640 1 -- 172.21.15.63:0/1632777343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558146e25390 msgr2=0x5581471ee120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:47.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.490+0000 7fb4beffd640 1 --2- 172.21.15.63:0/1632777343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558146e25390 0x5581471ee120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.490+0000 7fb4beffd640 1 -- 172.21.15.63:0/1632777343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558146e46070 msgr2=0x5581471ed6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:47.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.490+0000 7fb4beffd640 1 --2- 172.21.15.63:0/1632777343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558146e46070 0x5581471ed6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.490+0000 7fb4beffd640 1 -- 172.21.15.63:0/1632777343 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558146eb1650 con 0x558146e1d1b0 2024-09-21T06:36:47.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.490+0000 7fb4bffff640 1 --2- 172.21.15.63:0/611528823 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb4a80b6680 0x7fb4a80b8b90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009270 tx=0x7fb4b8013a80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:47.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.490+0000 7fb4beffd640 1 --2- 172.21.15.63:0/1632777343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e1d1b0 0x5581471edbe0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4032af0 tx=0x7fb4b40cd8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969cbd233e1a3ccc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:47.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.490+0000 7fb4a5ffb640 1 -- 172.21.15.63:0/1632777343 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4049070 con 0x558146e1d1b0 2024-09-21T06:36:47.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.491+0000 7fb4a5ffb640 1 -- 172.21.15.63:0/1632777343 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4b40cd5f0 con 0x558146e1d1b0 2024-09-21T06:36:47.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.491+0000 7fb4a5ffb640 1 -- 172.21.15.63:0/1632777343 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b40d25c0 con 0x558146e1d1b0 2024-09-21T06:36:47.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.491+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/1632777343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e1d1b0 msgr2=0x5581471edbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:47.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.491+0000 7fb4cc3c3740 1 --2- 172.21.15.63:0/1632777343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e1d1b0 0x5581471edbe0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4032af0 tx=0x7fb4b40cd8b0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.491+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/1632777343 shutdown_connections 2024-09-21T06:36:47.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.491+0000 7fb4cc3c3740 1 --2- 172.21.15.63:0/1632777343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558146e25390 0x5581471ee120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.491+0000 7fb4cc3c3740 1 --2- 172.21.15.63:0/1632777343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e1d1b0 0x5581471edbe0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.491+0000 7fb4cc3c3740 1 --2- 172.21.15.63:0/1632777343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558146e46070 0x5581471ed6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.491+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/1632777343 >> 172.21.15.63:0/1632777343 conn(0x558146e3a460 msgr2=0x5581471eb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:47.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.491+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/1632777343 shutdown_connections 2024-09-21T06:36:47.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.492+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/1632777343 wait complete. 2024-09-21T06:36:47.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.492+0000 7fb4cc3c3740 1 -- start start 2024-09-21T06:36:47.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.492+0000 7fb4cc3c3740 1 Processor -- start 2024-09-21T06:36:47.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.492+0000 7fb4cc3c3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e1d1b0 0x5581471f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:47.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.492+0000 7fb4cc3c3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558146e25390 0x5581471f9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:47.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.492+0000 7fb4cc3c3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558146e46070 0x558147209230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:47.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.492+0000 7fb4cc3c3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558146fb4700 con 0x558146e1d1b0 2024-09-21T06:36:47.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.493+0000 7fb4cc3c3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5581470ee160 con 0x558146e46070 2024-09-21T06:36:47.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.493+0000 7fb4cc3c3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558147200050 con 0x558146e25390 2024-09-21T06:36:47.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.493+0000 7fb4cc3c3740 10 client.0 _ll_register_callbacks cb 0x5581471079e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:47.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.493+0000 7fb4bf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e1d1b0 0x5581471f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:47.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.493+0000 7fb4bf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e1d1b0 0x5581471f8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57304/0 (socket says 172.21.15.63:57304) 2024-09-21T06:36:47.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.493+0000 7fb4bf7fe640 1 -- 172.21.15.63:0/1710757101 learned_addr learned my addr 172.21.15.63:0/1710757101 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:47.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.493+0000 7fb4beffd640 1 --2- 172.21.15.63:0/1710757101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558146e25390 0x5581471f9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:47.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.493+0000 7fb4bffff640 1 --2- 172.21.15.63:0/1710757101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558146e46070 0x558147209230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:47.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.493+0000 7fb4bf7fe640 1 -- 172.21.15.63:0/1710757101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558146e25390 msgr2=0x5581471f9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:47.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.493+0000 7fb4bf7fe640 1 --2- 172.21.15.63:0/1710757101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558146e25390 0x5581471f9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.493+0000 7fb4bf7fe640 1 -- 172.21.15.63:0/1710757101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558146e46070 msgr2=0x558147209230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:47.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.493+0000 7fb4bf7fe640 1 --2- 172.21.15.63:0/1710757101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558146e46070 0x558147209230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.493+0000 7fb4bf7fe640 1 -- 172.21.15.63:0/1710757101 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55814711bc90 con 0x558146e1d1b0 2024-09-21T06:36:47.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.493+0000 7fb4bf7fe640 1 --2- 172.21.15.63:0/1710757101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e1d1b0 0x5581471f8dd0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb4b000ba80 tx=0x7fb4b000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f452434438374c0d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:47.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.493+0000 7fb49effd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:47.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.493+0000 7fb49effd640 1 -- 172.21.15.63:0/1710757101 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0003e00 con 0x558146e1d1b0 2024-09-21T06:36:47.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.493+0000 7fb49effd640 1 -- 172.21.15.63:0/1710757101 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7fb4b0011440 con 0x558146e1d1b0 2024-09-21T06:36:47.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.493+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/1710757101 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4b40cd5f0 con 0x558146e1d1b0 2024-09-21T06:36:47.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.494+0000 7fb49effd640 1 -- 172.21.15.63:0/1710757101 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fb4b0011680 con 0x558146e1d1b0 2024-09-21T06:36:47.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.494+0000 7fb4cc3c3740 10 client.17247 fetch_fsmap learned FSMap version 61 2024-09-21T06:36:47.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.494+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/1710757101 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55814720bd30 con 0x558146e1d1b0 2024-09-21T06:36:47.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.494+0000 7fb49effd640 1 -- 172.21.15.63:0/1710757101 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4b40cd5f0 con 0x558146e1d1b0 2024-09-21T06:36:47.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.494+0000 7fb49effd640 1 -- 172.21.15.63:0/1710757101 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fb4b001b970 con 0x558146e1d1b0 2024-09-21T06:36:47.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.494+0000 7fb4cc3c3740 10 client.17247 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:36:47.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.494+0000 7fb4cc3c3740 10 client.17247 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:36:47.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.494+0000 7fb4cc3c3740 20 client.17247 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:47.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.494+0000 7fb4cc3c3740 1 --2- 172.21.15.63:0/1710757101 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x558146e049f0 0x55814720f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:47.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.494+0000 7fb4cc3c3740 4 client.17247 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:47.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.494+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/1710757101 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558147165df0 con 0x558146e049f0 2024-09-21T06:36:47.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.494+0000 7fb4beffd640 1 --2- 172.21.15.63:0/1710757101 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x558146e049f0 0x55814720f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:47.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.495+0000 7fb49effd640 10 client.17247 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:36:47.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.495+0000 7fb4beffd640 1 --2- 172.21.15.63:0/1710757101 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x558146e049f0 0x55814720f290 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f76b5698725ae182 server_cookie=43edde6c5b94db7e in_seq=0 out_seq=0 2024-09-21T06:36:47.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.496+0000 7fb49effd640 1 -- 172.21.15.63:0/1710757101 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558147165df0 con 0x558146e049f0 2024-09-21T06:36:47.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.496+0000 7fb49effd640 10 client.17247 handle_command_reply: tid=0 2024-09-21T06:36:47.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.496+0000 7fb4cc3c3740 1 client.17247 shutdown 2024-09-21T06:36:47.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.496+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/1710757101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e1d1b0 msgr2=0x5581471f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:47.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.496+0000 7fb4cc3c3740 1 --2- 172.21.15.63:0/1710757101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e1d1b0 0x5581471f8dd0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb4b000ba80 tx=0x7fb4b000be80 comp rx=0 tx=0).stop 2024-09-21T06:36:47.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.496+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/1710757101 shutdown_connections 2024-09-21T06:36:47.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.496+0000 7fb4cc3c3740 1 --2- 172.21.15.63:0/1710757101 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x558146e049f0 0x55814720f290 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.496+0000 7fb4cc3c3740 1 --2- 172.21.15.63:0/1710757101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558146e46070 0x558147209230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.496+0000 7fb4cc3c3740 1 --2- 172.21.15.63:0/1710757101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558146e25390 0x5581471f9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.496+0000 7fb4cc3c3740 1 --2- 172.21.15.63:0/1710757101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e1d1b0 0x5581471f8dd0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.496+0000 7fb49effd640 0 client.17247 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:36:47.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.496+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/1710757101 >> 172.21.15.63:0/1710757101 conn(0x558146e3a460 msgr2=0x5581471ee6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:47.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.496+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/1710757101 shutdown_connections 2024-09-21T06:36:47.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.496+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/1710757101 wait complete. 2024-09-21T06:36:47.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.496+0000 7fb4cc3c3740 20 client.17247 trim_cache size 0 max 16384 2024-09-21T06:36:47.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.510+0000 7fb4cc3c3740 1 Processor -- start 2024-09-21T06:36:47.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.510+0000 7fb4cc3c3740 1 -- start start 2024-09-21T06:36:47.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.510+0000 7fb4cc3c3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558146e1d1b0 0x5581471faa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:47.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.510+0000 7fb4cc3c3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e25390 0x5581471eabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:47.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.510+0000 7fb4cc3c3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558146e46070 0x5581471eb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:47.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.510+0000 7fb4cc3c3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c01ad550 con 0x558146e25390 2024-09-21T06:36:47.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.510+0000 7fb4cc3c3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c01af090 con 0x558146e46070 2024-09-21T06:36:47.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.510+0000 7fb4cc3c3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c01adc20 con 0x558146e1d1b0 2024-09-21T06:36:47.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.510+0000 7fb4beffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e25390 0x5581471eabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:47.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.510+0000 7fb4beffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e25390 0x5581471eabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57308/0 (socket says 172.21.15.63:57308) 2024-09-21T06:36:47.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.510+0000 7fb4beffd640 1 -- 172.21.15.63:0/2500672062 learned_addr learned my addr 172.21.15.63:0/2500672062 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:47.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.510+0000 7fb4bf7fe640 1 --2- 172.21.15.63:0/2500672062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558146e1d1b0 0x5581471faa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:47.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.510+0000 7fb4bffff640 1 --2- 172.21.15.63:0/2500672062 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558146e46070 0x5581471eb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:47.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.510+0000 7fb4beffd640 1 -- 172.21.15.63:0/2500672062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558146e1d1b0 msgr2=0x5581471faa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:47.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.510+0000 7fb4beffd640 1 --2- 172.21.15.63:0/2500672062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558146e1d1b0 0x5581471faa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.510+0000 7fb4beffd640 1 -- 172.21.15.63:0/2500672062 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558146e46070 msgr2=0x5581471eb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:47.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.510+0000 7fb4beffd640 1 --2- 172.21.15.63:0/2500672062 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558146e46070 0x5581471eb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.510+0000 7fb4beffd640 1 -- 172.21.15.63:0/2500672062 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581471ef990 con 0x558146e25390 2024-09-21T06:36:47.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.511+0000 7fb4beffd640 1 --2- 172.21.15.63:0/2500672062 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e25390 0x5581471eabc0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fb4b41059e0 tx=0x7fb4b40057e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97ef24914b13628 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:47.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.511+0000 7fb4a57fa640 1 -- 172.21.15.63:0/2500672062 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4049040 con 0x558146e25390 2024-09-21T06:36:47.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.511+0000 7fb4a57fa640 1 -- 172.21.15.63:0/2500672062 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4b40cd5f0 con 0x558146e25390 2024-09-21T06:36:47.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.511+0000 7fb4a57fa640 1 -- 172.21.15.63:0/2500672062 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4105660 con 0x558146e25390 2024-09-21T06:36:47.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.512+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/2500672062 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e25390 msgr2=0x5581471eabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:47.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.512+0000 7fb4cc3c3740 1 --2- 172.21.15.63:0/2500672062 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e25390 0x5581471eabc0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fb4b41059e0 tx=0x7fb4b40057e0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.512+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/2500672062 shutdown_connections 2024-09-21T06:36:47.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.512+0000 7fb4cc3c3740 1 --2- 172.21.15.63:0/2500672062 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558146e46070 0x5581471eb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.512+0000 7fb4cc3c3740 1 --2- 172.21.15.63:0/2500672062 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e25390 0x5581471eabc0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.512+0000 7fb4cc3c3740 1 --2- 172.21.15.63:0/2500672062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558146e1d1b0 0x5581471faa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.512+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/2500672062 >> 172.21.15.63:0/2500672062 conn(0x558146e3a460 msgr2=0x5581471fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:47.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.512+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/2500672062 shutdown_connections 2024-09-21T06:36:47.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.512+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/2500672062 wait complete. 2024-09-21T06:36:47.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.512+0000 7fb4cc3c3740 1 -- start start 2024-09-21T06:36:47.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.512+0000 7fb4cc3c3740 1 Processor -- start 2024-09-21T06:36:47.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.513+0000 7fb4cc3c3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558146e1d1b0 0x5581471ff620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:47.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.513+0000 7fb4cc3c3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558146e25390 0x558147205180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:47.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.513+0000 7fb4cc3c3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e46070 0x5581472056c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:47.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.513+0000 7fb4cc3c3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c01ae9c0 con 0x558146e46070 2024-09-21T06:36:47.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.513+0000 7fb4cc3c3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c01ae2f0 con 0x558146e1d1b0 2024-09-21T06:36:47.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.513+0000 7fb4cc3c3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c01ab550 con 0x558146e25390 2024-09-21T06:36:47.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.513+0000 7fb4cc3c3740 10 client.0 _ll_register_callbacks cb 0x7fb4b0004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:47.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.513+0000 7fb4bffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e46070 0x5581472056c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:47.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.513+0000 7fb4bffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e46070 0x5581472056c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57318/0 (socket says 172.21.15.63:57318) 2024-09-21T06:36:47.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.513+0000 7fb4bffff640 1 -- 172.21.15.63:0/3340571637 learned_addr learned my addr 172.21.15.63:0/3340571637 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:47.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.513+0000 7fb4bf7fe640 1 --2- 172.21.15.63:0/3340571637 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558146e1d1b0 0x5581471ff620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:47.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.513+0000 7fb4beffd640 1 --2- 172.21.15.63:0/3340571637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558146e25390 0x558147205180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:47.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.513+0000 7fb4bffff640 1 -- 172.21.15.63:0/3340571637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558146e25390 msgr2=0x558147205180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:47.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.513+0000 7fb4bffff640 1 --2- 172.21.15.63:0/3340571637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558146e25390 0x558147205180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.513+0000 7fb4bffff640 1 -- 172.21.15.63:0/3340571637 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558146e1d1b0 msgr2=0x5581471ff620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:47.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.513+0000 7fb4bffff640 1 --2- 172.21.15.63:0/3340571637 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558146e1d1b0 0x5581471ff620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.513+0000 7fb4bffff640 1 -- 172.21.15.63:0/3340571637 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558147205c00 con 0x558146e46070 2024-09-21T06:36:47.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.513+0000 7fb4bffff640 1 --2- 172.21.15.63:0/3340571637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e46070 0x5581472056c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8013370 tx=0x7fb4b8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d08f4019973fe6d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:47.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.513+0000 7fb49effd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:47.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.514+0000 7fb49effd640 1 -- 172.21.15.63:0/3340571637 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8004b20 con 0x558146e46070 2024-09-21T06:36:47.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.514+0000 7fb49effd640 1 -- 172.21.15.63:0/3340571637 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7fb4b8004cc0 con 0x558146e46070 2024-09-21T06:36:47.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.514+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/3340571637 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4b40cd5f0 con 0x558146e46070 2024-09-21T06:36:47.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.514+0000 7fb49effd640 1 -- 172.21.15.63:0/3340571637 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fb4b8020780 con 0x558146e46070 2024-09-21T06:36:47.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.514+0000 7fb4cc3c3740 10 client.17253 fetch_fsmap learned FSMap version 61 2024-09-21T06:36:47.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.514+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/3340571637 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x5581471fd870 con 0x558146e46070 2024-09-21T06:36:47.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.514+0000 7fb49effd640 1 -- 172.21.15.63:0/3340571637 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4b40cd5f0 con 0x558146e46070 2024-09-21T06:36:47.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.514+0000 7fb49effd640 1 -- 172.21.15.63:0/3340571637 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fb4b80053c0 con 0x558146e46070 2024-09-21T06:36:47.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.514+0000 7fb4cc3c3740 10 client.17253 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:36:47.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.514+0000 7fb4cc3c3740 10 client.17253 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:36:47.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.514+0000 7fb4cc3c3740 20 client.17253 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:47.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.514+0000 7fb4cc3c3740 1 --2- 172.21.15.63:0/3340571637 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x558146dd9da0 0x5581472809c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:47.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.514+0000 7fb4cc3c3740 4 client.17253 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:36:47.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.514+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/3340571637 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5581471f4980 con 0x558146dd9da0 2024-09-21T06:36:47.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.515+0000 7fb4bf7fe640 1 --2- 172.21.15.63:0/3340571637 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x558146dd9da0 0x5581472809c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:47.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.515+0000 7fb4bf7fe640 1 --2- 172.21.15.63:0/3340571637 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x558146dd9da0 0x5581472809c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2d17a5f5a2c34b04 server_cookie=da0953d8cc9db7de in_seq=0 out_seq=0 2024-09-21T06:36:47.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.515+0000 7fb49effd640 10 client.17253 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:36:47.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.515+0000 7fb49effd640 1 -- 172.21.15.63:0/3340571637 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5581471f4980 con 0x558146dd9da0 2024-09-21T06:36:47.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.515+0000 7fb49effd640 10 client.17253 handle_command_reply: tid=0 2024-09-21T06:36:47.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.515+0000 7fb4cc3c3740 1 client.17253 shutdown 2024-09-21T06:36:47.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.516+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/3340571637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e46070 msgr2=0x5581472056c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:47.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.516+0000 7fb4cc3c3740 1 --2- 172.21.15.63:0/3340571637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e46070 0x5581472056c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8013370 tx=0x7fb4b8019000 comp rx=0 tx=0).stop 2024-09-21T06:36:47.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.516+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/3340571637 shutdown_connections 2024-09-21T06:36:47.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.516+0000 7fb4cc3c3740 1 --2- 172.21.15.63:0/3340571637 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x558146dd9da0 0x5581472809c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.516+0000 7fb4cc3c3740 1 --2- 172.21.15.63:0/3340571637 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558146e46070 0x5581472056c0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.516+0000 7fb4cc3c3740 1 --2- 172.21.15.63:0/3340571637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558146e25390 0x558147205180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.516+0000 7fb49effd640 0 client.17253 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:36:47.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.516+0000 7fb4cc3c3740 1 --2- 172.21.15.63:0/3340571637 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558146e1d1b0 0x5581471ff620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.516+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/3340571637 >> 172.21.15.63:0/3340571637 conn(0x558146e3a460 msgr2=0x5581471ee6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:47.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.516+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/3340571637 shutdown_connections 2024-09-21T06:36:47.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.516+0000 7fb4cc3c3740 1 -- 172.21.15.63:0/3340571637 wait complete. 2024-09-21T06:36:47.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.516+0000 7fb4cc3c3740 20 client.17253 trim_cache size 0 max 16384 2024-09-21T06:36:47.522 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:36:47.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.517+0000 7fb4c5e4f640 1 -- 172.21.15.63:0/611528823 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb4a80b6680 msgr2=0x7fb4a80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:47.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.517+0000 7fb4c5e4f640 1 --2- 172.21.15.63:0/611528823 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb4a80b6680 0x7fb4a80b8b90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009270 tx=0x7fb4b8013a80 comp rx=0 tx=0).stop 2024-09-21T06:36:47.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.517+0000 7fb4c5e4f640 1 -- 172.21.15.63:0/611528823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4c01083a0 msgr2=0x7fb4c019aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:47.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.517+0000 7fb4c5e4f640 1 --2- 172.21.15.63:0/611528823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4c01083a0 0x7fb4c019aa00 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4032fd0 tx=0x7fb4b4004270 comp rx=0 tx=0).stop 2024-09-21T06:36:47.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.517+0000 7fb4c5e4f640 1 -- 172.21.15.63:0/611528823 shutdown_connections 2024-09-21T06:36:47.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.517+0000 7fb4c5e4f640 1 --2- 172.21.15.63:0/611528823 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb4a80b6680 0x7fb4a80b8b90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.517+0000 7fb4c5e4f640 1 --2- 172.21.15.63:0/611528823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4c0108cf0 0x7fb4c019fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.517+0000 7fb4c5e4f640 1 --2- 172.21.15.63:0/611528823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4c01083a0 0x7fb4c019aa00 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.517+0000 7fb4c5e4f640 1 --2- 172.21.15.63:0/611528823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4c0102a60 0x7fb4c019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:47.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.517+0000 7fb4c5e4f640 1 -- 172.21.15.63:0/611528823 >> 172.21.15.63:0/611528823 conn(0x7fb4c0079730 msgr2=0x7fb4c006b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:47.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.517+0000 7fb4c5e4f640 1 -- 172.21.15.63:0/611528823 shutdown_connections 2024-09-21T06:36:47.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:47.517+0000 7fb4c5e4f640 1 -- 172.21.15.63:0/611528823 wait complete. 2024-09-21T06:36:47.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:47 smithi071 ceph-mon[34844]: pgmap v584: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:36:47.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:47 smithi063 ceph-mon[31150]: pgmap v584: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:36:47.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:47 smithi175 ceph-mon[34510]: pgmap v584: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:36:48.239 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:36:48.497 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:49.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:48.998+0000 7f81dc56f640 1 -- 172.21.15.63:0/1711197585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81d41083a0 msgr2=0x7f81d41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:49.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:48.998+0000 7f81dc56f640 1 --2- 172.21.15.63:0/1711197585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81d41083a0 0x7f81d41087b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009900 tx=0x7f81c802a410 comp rx=0 tx=0).stop 2024-09-21T06:36:49.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:48.998+0000 7f81dc56f640 1 -- 172.21.15.63:0/1711197585 shutdown_connections 2024-09-21T06:36:49.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:48.998+0000 7f81dc56f640 1 --2- 172.21.15.63:0/1711197585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d4108cf0 0x7f81d410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:48.998+0000 7f81dc56f640 1 --2- 172.21.15.63:0/1711197585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81d41083a0 0x7f81d41087b0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:48.998+0000 7f81dc56f640 1 --2- 172.21.15.63:0/1711197585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81d4102a60 0x7f81d4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:48.998+0000 7f81dc56f640 1 -- 172.21.15.63:0/1711197585 >> 172.21.15.63:0/1711197585 conn(0x7f81d4079730 msgr2=0x7f81d4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:49.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:48.998+0000 7f81dc56f640 1 -- 172.21.15.63:0/1711197585 shutdown_connections 2024-09-21T06:36:49.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:48.998+0000 7f81dc56f640 1 -- 172.21.15.63:0/1711197585 wait complete. 2024-09-21T06:36:49.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:48.999+0000 7f81dc56f640 1 Processor -- start 2024-09-21T06:36:49.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:48.999+0000 7f81dc56f640 1 -- start start 2024-09-21T06:36:49.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:48.999+0000 7f81dc56f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81d4102a60 0x7f81d40ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:49.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:48.999+0000 7f81dc56f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d41083a0 0x7f81d40ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:49.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:48.999+0000 7f81dc56f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81d4108cf0 0x7f81d41000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:49.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:48.999+0000 7f81dc56f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f81d41129a0 con 0x7f81d4102a60 2024-09-21T06:36:49.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:48.999+0000 7f81dc56f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81d4112820 con 0x7f81d4108cf0 2024-09-21T06:36:49.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:48.999+0000 7f81dc56f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f81d4112b20 con 0x7f81d41083a0 2024-09-21T06:36:49.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:48.999+0000 7f81da30b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81d4102a60 0x7f81d40ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:49.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:48.999+0000 7f81da30b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81d4102a60 0x7f81d40ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57338/0 (socket says 172.21.15.63:57338) 2024-09-21T06:36:49.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:48.999+0000 7f81da30b640 1 -- 172.21.15.63:0/2093395520 learned_addr learned my addr 172.21.15.63:0/2093395520 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:49.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.000+0000 7f81dab0c640 1 --2- 172.21.15.63:0/2093395520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81d4108cf0 0x7f81d41000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:49.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.000+0000 7f81da30b640 1 -- 172.21.15.63:0/2093395520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d41083a0 msgr2=0x7f81d40ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:49.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.000+0000 7f81da30b640 1 --2- 172.21.15.63:0/2093395520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d41083a0 0x7f81d40ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.000+0000 7f81da30b640 1 -- 172.21.15.63:0/2093395520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81d4108cf0 msgr2=0x7f81d41000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:49.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.000+0000 7f81da30b640 1 --2- 172.21.15.63:0/2093395520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81d4108cf0 0x7f81d41000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.000+0000 7f81da30b640 1 -- 172.21.15.63:0/2093395520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d41a8800 con 0x7f81d4102a60 2024-09-21T06:36:49.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.000+0000 7f81da30b640 1 --2- 172.21.15.63:0/2093395520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81d4102a60 0x7f81d40ff670 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00d950 tx=0x7f81cc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:49.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.000+0000 7f81d37fe640 1 -- 172.21.15.63:0/2093395520 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc017070 con 0x7f81d4102a60 2024-09-21T06:36:49.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.000+0000 7f81d37fe640 1 -- 172.21.15.63:0/2093395520 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81cc009c30 con 0x7f81d4102a60 2024-09-21T06:36:49.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.000+0000 7f81dc56f640 1 -- 172.21.15.63:0/2093395520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81d41a8af0 con 0x7f81d4102a60 2024-09-21T06:36:49.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.000+0000 7f81d37fe640 1 -- 172.21.15.63:0/2093395520 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc00f620 con 0x7f81d4102a60 2024-09-21T06:36:49.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.000+0000 7f81dc56f640 1 -- 172.21.15.63:0/2093395520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81d41a9030 con 0x7f81d4102a60 2024-09-21T06:36:49.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.003+0000 7f81d37fe640 1 -- 172.21.15.63:0/2093395520 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f81cc010460 con 0x7f81d4102a60 2024-09-21T06:36:49.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.003+0000 7f81e2ae3740 1 Processor -- start 2024-09-21T06:36:49.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.003+0000 7f81e2ae3740 1 -- start start 2024-09-21T06:36:49.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81e2ae3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1e4070 0x55a07b58b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:49.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81e2ae3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 0x55a07b58bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:49.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81e2ae3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 0x55a07b58c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:49.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81e2ae3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a07b501ea0 con 0x55a07b1c3390 2024-09-21T06:36:49.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81e2ae3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a07b4f12d0 con 0x55a07b1bb1b0 2024-09-21T06:36:49.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81e2ae3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a07b4f50e0 con 0x55a07b1e4070 2024-09-21T06:36:49.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81d9b0a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 0x55a07b58c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:49.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81d9b0a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 0x55a07b58c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57340/0 (socket says 172.21.15.63:57340) 2024-09-21T06:36:49.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81d9b0a640 1 -- 172.21.15.63:0/2683868902 learned_addr learned my addr 172.21.15.63:0/2683868902 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:49.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81dab0c640 1 --2- 172.21.15.63:0/2683868902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1e4070 0x55a07b58b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:49.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81da30b640 1 --2- 172.21.15.63:0/2683868902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 0x55a07b58bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:49.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81d37fe640 1 --2- 172.21.15.63:0/2093395520 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f81bc0b6680 0x7f81bc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:49.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81d9b0a640 1 -- 172.21.15.63:0/2683868902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1e4070 msgr2=0x55a07b58b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:49.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81d9b0a640 1 --2- 172.21.15.63:0/2683868902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1e4070 0x55a07b58b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81d9b0a640 1 -- 172.21.15.63:0/2683868902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 msgr2=0x55a07b58bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:49.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81d9b0a640 1 --2- 172.21.15.63:0/2683868902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 0x55a07b58bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81d9b0a640 1 -- 172.21.15.63:0/2683868902 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a07b24f650 con 0x55a07b1c3390 2024-09-21T06:36:49.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81dab0c640 1 --2- 172.21.15.63:0/2093395520 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f81bc0b6680 0x7f81bc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:49.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81d37fe640 1 -- 172.21.15.63:0/2093395520 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7f81cc0e73e0 con 0x7f81d4102a60 2024-09-21T06:36:49.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81d9b0a640 1 --2- 172.21.15.63:0/2683868902 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 0x55a07b58c120 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f81c802a930 tx=0x7f81c8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e1930fa3772f10 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:49.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.004+0000 7f81da30b640 1 --2- 172.21.15.63:0/2683868902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 0x55a07b58bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:49.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.005+0000 7f81d0ff9640 1 -- 172.21.15.63:0/2683868902 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8040070 con 0x55a07b1c3390 2024-09-21T06:36:49.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.005+0000 7f81d0ff9640 1 -- 172.21.15.63:0/2683868902 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81c8004040 con 0x55a07b1c3390 2024-09-21T06:36:49.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.005+0000 7f81d0ff9640 1 -- 172.21.15.63:0/2683868902 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8035040 con 0x55a07b1c3390 2024-09-21T06:36:49.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.006+0000 7f81e2ae3740 1 -- 172.21.15.63:0/2683868902 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 msgr2=0x55a07b58c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:49.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.006+0000 7f81e2ae3740 1 --2- 172.21.15.63:0/2683868902 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 0x55a07b58c120 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f81c802a930 tx=0x7f81c8000bc0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.006+0000 7f81dab0c640 1 --2- 172.21.15.63:0/2093395520 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f81bc0b6680 0x7f81bc0b8b90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009fd0 tx=0x7f81c4004b50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:49.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.006+0000 7f81e2ae3740 1 -- 172.21.15.63:0/2683868902 shutdown_connections 2024-09-21T06:36:49.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.006+0000 7f81e2ae3740 1 --2- 172.21.15.63:0/2683868902 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 0x55a07b58c120 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.006+0000 7f81e2ae3740 1 --2- 172.21.15.63:0/2683868902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 0x55a07b58bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.006+0000 7f81e2ae3740 1 --2- 172.21.15.63:0/2683868902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1e4070 0x55a07b58b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.006+0000 7f81e2ae3740 1 -- 172.21.15.63:0/2683868902 >> 172.21.15.63:0/2683868902 conn(0x55a07b1d8460 msgr2=0x55a07b589590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:49.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.006+0000 7f81e2ae3740 1 -- 172.21.15.63:0/2683868902 shutdown_connections 2024-09-21T06:36:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.006+0000 7f81e2ae3740 1 -- 172.21.15.63:0/2683868902 wait complete. 2024-09-21T06:36:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.007+0000 7f81e2ae3740 1 -- start start 2024-09-21T06:36:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.007+0000 7f81e2ae3740 1 Processor -- start 2024-09-21T06:36:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.007+0000 7f81e2ae3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 0x55a07b596d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.007+0000 7f81e2ae3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 0x55a07b597280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.007+0000 7f81e2ae3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1e4070 0x55a07b5a3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.007+0000 7f81e2ae3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a07b352700 con 0x55a07b1c3390 2024-09-21T06:36:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.007+0000 7f81e2ae3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a07b48c160 con 0x55a07b1bb1b0 2024-09-21T06:36:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.007+0000 7f81e2ae3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a07b599e20 con 0x55a07b1e4070 2024-09-21T06:36:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.007+0000 7f81d9b0a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 0x55a07b597280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.007+0000 7f81d9b0a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 0x55a07b597280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57356/0 (socket says 172.21.15.63:57356) 2024-09-21T06:36:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.007+0000 7f81e2ae3740 10 client.0 _ll_register_callbacks cb 0x55a07b4a59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.007+0000 7f81d9b0a640 1 -- 172.21.15.63:0/1362647773 learned_addr learned my addr 172.21.15.63:0/1362647773 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.007+0000 7f81da30b640 1 --2- 172.21.15.63:0/1362647773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 0x55a07b596d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.007+0000 7f81dab0c640 1 --2- 172.21.15.63:0/1362647773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1e4070 0x55a07b5a3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.008+0000 7f81d9b0a640 1 -- 172.21.15.63:0/1362647773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1e4070 msgr2=0x55a07b5a3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.008+0000 7f81d9b0a640 1 --2- 172.21.15.63:0/1362647773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1e4070 0x55a07b5a3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.008+0000 7f81d9b0a640 1 -- 172.21.15.63:0/1362647773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 msgr2=0x55a07b596d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.008+0000 7f81d9b0a640 1 --2- 172.21.15.63:0/1362647773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 0x55a07b596d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.008+0000 7f81d9b0a640 1 -- 172.21.15.63:0/1362647773 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a07b4b9c90 con 0x55a07b1c3390 2024-09-21T06:36:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.008+0000 7f81d9b0a640 1 --2- 172.21.15.63:0/1362647773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 0x55a07b597280 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f81c80036d0 tx=0x7f81c8032ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0bb929d1246189 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.008+0000 7f81b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.008+0000 7f81b9ffb640 1 -- 172.21.15.63:0/1362647773 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8035040 con 0x55a07b1c3390 2024-09-21T06:36:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.008+0000 7f81b9ffb640 1 -- 172.21.15.63:0/1362647773 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7f81c80316a0 con 0x55a07b1c3390 2024-09-21T06:36:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.008+0000 7f81e2ae3740 1 -- 172.21.15.63:0/1362647773 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81c8004040 con 0x55a07b1c3390 2024-09-21T06:36:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.008+0000 7f81b9ffb640 1 -- 172.21.15.63:0/1362647773 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f81c8040040 con 0x55a07b1c3390 2024-09-21T06:36:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.008+0000 7f81e2ae3740 10 client.17265 fetch_fsmap learned FSMap version 61 2024-09-21T06:36:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.008+0000 7f81e2ae3740 1 -- 172.21.15.63:0/1362647773 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55a07b5a5b10 con 0x55a07b1c3390 2024-09-21T06:36:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.009+0000 7f81b9ffb640 1 -- 172.21.15.63:0/1362647773 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81c8004040 con 0x55a07b1c3390 2024-09-21T06:36:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.009+0000 7f81b9ffb640 1 -- 172.21.15.63:0/1362647773 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f81c804e620 con 0x55a07b1c3390 2024-09-21T06:36:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.009+0000 7f81e2ae3740 10 client.17265 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:36:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.009+0000 7f81e2ae3740 10 client.17265 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:36:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.009+0000 7f81e2ae3740 20 client.17265 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.009+0000 7f81e2ae3740 1 --2- 172.21.15.63:0/1362647773 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55a07b1a29f0 0x55a07b5a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.009+0000 7f81e2ae3740 4 client.17265 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.009+0000 7f81e2ae3740 1 -- 172.21.15.63:0/1362647773 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a07b503df0 con 0x55a07b1a29f0 2024-09-21T06:36:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.009+0000 7f81da30b640 1 --2- 172.21.15.63:0/1362647773 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55a07b1a29f0 0x55a07b5a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.010+0000 7f81b9ffb640 10 client.17265 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:36:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.010+0000 7f81da30b640 1 --2- 172.21.15.63:0/1362647773 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55a07b1a29f0 0x55a07b5a8e70 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fa55b135b677ae87 server_cookie=96a30cdc7ab8f34c in_seq=0 out_seq=0 2024-09-21T06:36:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.011+0000 7f81b9ffb640 1 -- 172.21.15.63:0/1362647773 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a07b503df0 con 0x55a07b1a29f0 2024-09-21T06:36:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.011+0000 7f81b9ffb640 10 client.17265 handle_command_reply: tid=0 2024-09-21T06:36:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.011+0000 7f81e2ae3740 1 client.17265 shutdown 2024-09-21T06:36:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.011+0000 7f81e2ae3740 1 -- 172.21.15.63:0/1362647773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 msgr2=0x55a07b597280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:49.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.011+0000 7f81e2ae3740 1 --2- 172.21.15.63:0/1362647773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 0x55a07b597280 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f81c80036d0 tx=0x7f81c8032ed0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.011+0000 7f81e2ae3740 1 -- 172.21.15.63:0/1362647773 shutdown_connections 2024-09-21T06:36:49.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.011+0000 7f81e2ae3740 1 --2- 172.21.15.63:0/1362647773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1e4070 0x55a07b5a3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.011+0000 7f81e2ae3740 1 --2- 172.21.15.63:0/1362647773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 0x55a07b597280 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.011+0000 7f81e2ae3740 1 --2- 172.21.15.63:0/1362647773 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55a07b1a29f0 0x55a07b5a8e70 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.011+0000 7f81e2ae3740 1 --2- 172.21.15.63:0/1362647773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 0x55a07b596d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.011+0000 7f81b9ffb640 0 client.17265 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:36:49.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.011+0000 7f81e2ae3740 1 -- 172.21.15.63:0/1362647773 >> 172.21.15.63:0/1362647773 conn(0x55a07b1d8460 msgr2=0x55a07b58e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:49.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.011+0000 7f81e2ae3740 1 -- 172.21.15.63:0/1362647773 shutdown_connections 2024-09-21T06:36:49.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.011+0000 7f81e2ae3740 1 -- 172.21.15.63:0/1362647773 wait complete. 2024-09-21T06:36:49.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.011+0000 7f81e2ae3740 20 client.17265 trim_cache size 0 max 16384 2024-09-21T06:36:49.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.024+0000 7f81e2ae3740 1 Processor -- start 2024-09-21T06:36:49.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.024+0000 7f81e2ae3740 1 -- start start 2024-09-21T06:36:49.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.025+0000 7f81e2ae3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 0x55a07b58d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:49.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.025+0000 7f81e2ae3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 0x55a07b598970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:49.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.025+0000 7f81e2ae3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1e4070 0x55a07b588bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:49.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.025+0000 7f81e2ae3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f81d41b1960 con 0x55a07b1c3390 2024-09-21T06:36:49.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.025+0000 7f81e2ae3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81d41b34a0 con 0x55a07b1bb1b0 2024-09-21T06:36:49.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.025+0000 7f81e2ae3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f81d41b2030 con 0x55a07b1e4070 2024-09-21T06:36:49.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.025+0000 7f81d9b0a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 0x55a07b598970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:49.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.025+0000 7f81da30b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 0x55a07b58d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:49.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.025+0000 7f81dab0c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1e4070 0x55a07b588bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:49.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.025+0000 7f81d9b0a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 0x55a07b598970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57366/0 (socket says 172.21.15.63:57366) 2024-09-21T06:36:49.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.025+0000 7f81dab0c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1e4070 0x55a07b588bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:40504/0 (socket says 172.21.15.63:40504) 2024-09-21T06:36:49.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.025+0000 7f81d9b0a640 1 -- 172.21.15.63:0/3866338539 learned_addr learned my addr 172.21.15.63:0/3866338539 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:49.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.025+0000 7f81da30b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 0x55a07b58d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:36220/0 (socket says 172.21.15.63:36220) 2024-09-21T06:36:49.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.025+0000 7f81d9b0a640 1 -- 172.21.15.63:0/3866338539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1e4070 msgr2=0x55a07b588bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:49.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.025+0000 7f81d9b0a640 1 --2- 172.21.15.63:0/3866338539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1e4070 0x55a07b588bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.025+0000 7f81d9b0a640 1 -- 172.21.15.63:0/3866338539 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 msgr2=0x55a07b58d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:49.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.025+0000 7f81d9b0a640 1 --2- 172.21.15.63:0/3866338539 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 0x55a07b58d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.025+0000 7f81d9b0a640 1 -- 172.21.15.63:0/3866338539 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a07b5928b0 con 0x55a07b1c3390 2024-09-21T06:36:49.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.025+0000 7f81d9b0a640 1 --2- 172.21.15.63:0/3866338539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 0x55a07b598970 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f81c8000c00 tx=0x7f81c8003660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc1dd7562609a79 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:49.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.026+0000 7f81bbfff640 1 -- 172.21.15.63:0/3866338539 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8035040 con 0x55a07b1c3390 2024-09-21T06:36:49.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.026+0000 7f81bbfff640 1 -- 172.21.15.63:0/3866338539 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81c804e680 con 0x55a07b1c3390 2024-09-21T06:36:49.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.026+0000 7f81bbfff640 1 -- 172.21.15.63:0/3866338539 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8031700 con 0x55a07b1c3390 2024-09-21T06:36:49.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.026+0000 7f81e2ae3740 1 -- 172.21.15.63:0/3866338539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 msgr2=0x55a07b598970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:49.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.026+0000 7f81e2ae3740 1 --2- 172.21.15.63:0/3866338539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 0x55a07b598970 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f81c8000c00 tx=0x7f81c8003660 comp rx=0 tx=0).stop 2024-09-21T06:36:49.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.026+0000 7f81e2ae3740 1 -- 172.21.15.63:0/3866338539 shutdown_connections 2024-09-21T06:36:49.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.026+0000 7f81e2ae3740 1 --2- 172.21.15.63:0/3866338539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1e4070 0x55a07b588bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.026+0000 7f81e2ae3740 1 --2- 172.21.15.63:0/3866338539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1c3390 0x55a07b598970 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.026+0000 7f81e2ae3740 1 --2- 172.21.15.63:0/3866338539 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 0x55a07b58d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.027+0000 7f81e2ae3740 1 -- 172.21.15.63:0/3866338539 >> 172.21.15.63:0/3866338539 conn(0x55a07b1d8460 msgr2=0x55a07b598260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:49.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.027+0000 7f81e2ae3740 1 -- 172.21.15.63:0/3866338539 shutdown_connections 2024-09-21T06:36:49.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.027+0000 7f81e2ae3740 1 -- 172.21.15.63:0/3866338539 wait complete. 2024-09-21T06:36:49.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.027+0000 7f81e2ae3740 1 -- start start 2024-09-21T06:36:49.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.027+0000 7f81e2ae3740 1 Processor -- start 2024-09-21T06:36:49.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.027+0000 7f81e2ae3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 0x55a07b5a9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:49.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.027+0000 7f81e2ae3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1c3390 0x55a07b5a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:49.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.027+0000 7f81e2ae3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1e4070 0x55a07b60b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:49.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.027+0000 7f81e2ae3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f81d41b2dd0 con 0x55a07b1e4070 2024-09-21T06:36:49.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.027+0000 7f81e2ae3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81d41b2700 con 0x55a07b1bb1b0 2024-09-21T06:36:49.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.027+0000 7f81e2ae3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f81d41af960 con 0x55a07b1c3390 2024-09-21T06:36:49.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.027+0000 7f81e2ae3740 10 client.0 _ll_register_callbacks cb 0x7f81c4009990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:49.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.027+0000 7f81dab0c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1e4070 0x55a07b60b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:49.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.028+0000 7f81da30b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 0x55a07b5a9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:49.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.028+0000 7f81dab0c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1e4070 0x55a07b60b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57382/0 (socket says 172.21.15.63:57382) 2024-09-21T06:36:49.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.028+0000 7f81dab0c640 1 -- 172.21.15.63:0/878117186 learned_addr learned my addr 172.21.15.63:0/878117186 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:49.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.028+0000 7f81d9b0a640 1 --2- 172.21.15.63:0/878117186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1c3390 0x55a07b5a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:49.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.028+0000 7f81da30b640 1 -- 172.21.15.63:0/878117186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1c3390 msgr2=0x55a07b5a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:49.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.028+0000 7f81da30b640 1 --2- 172.21.15.63:0/878117186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1c3390 0x55a07b5a9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.028+0000 7f81da30b640 1 -- 172.21.15.63:0/878117186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1e4070 msgr2=0x55a07b60b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:49.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.028+0000 7f81da30b640 1 --2- 172.21.15.63:0/878117186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1e4070 0x55a07b60b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.028+0000 7f81da30b640 1 -- 172.21.15.63:0/878117186 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a07b60bdf0 con 0x55a07b1bb1b0 2024-09-21T06:36:49.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.028+0000 7f81dab0c640 1 --2- 172.21.15.63:0/878117186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1e4070 0x55a07b60b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:49.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.028+0000 7f81da30b640 1 --2- 172.21.15.63:0/878117186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 0x55a07b5a9a10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0e4ae0 tx=0x7f81cc0ad0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=627efd41f44f66b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:49.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.028+0000 7f81b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-21T06:36:49.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.029+0000 7f81b9ffb640 1 -- 172.21.15.63:0/878117186 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc020040 con 0x55a07b1bb1b0 2024-09-21T06:36:49.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.029+0000 7f81e2ae3740 1 -- 172.21.15.63:0/878117186 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81c804e680 con 0x55a07b1bb1b0 2024-09-21T06:36:49.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.029+0000 7f81b9ffb640 1 -- 172.21.15.63:0/878117186 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7f81cc0ac640 con 0x55a07b1bb1b0 2024-09-21T06:36:49.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.029+0000 7f81b9ffb640 1 -- 172.21.15.63:0/878117186 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f81cc0ad8e0 con 0x55a07b1bb1b0 2024-09-21T06:36:49.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.029+0000 7f81e2ae3740 10 client.26786 fetch_fsmap learned FSMap version 61 2024-09-21T06:36:49.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.029+0000 7f81e2ae3740 1 -- 172.21.15.63:0/878117186 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55a07b6131e0 con 0x55a07b1bb1b0 2024-09-21T06:36:49.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.029+0000 7f81b9ffb640 1 -- 172.21.15.63:0/878117186 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81c804e680 con 0x55a07b1bb1b0 2024-09-21T06:36:49.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.029+0000 7f81b9ffb640 1 -- 172.21.15.63:0/878117186 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f81cc0d0b60 con 0x55a07b1bb1b0 2024-09-21T06:36:49.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.029+0000 7f81e2ae3740 10 client.26786 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:36:49.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.029+0000 7f81e2ae3740 10 client.26786 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:36:49.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.029+0000 7f81e2ae3740 20 client.26786 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:49.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.029+0000 7f81e2ae3740 1 --2- 172.21.15.63:0/878117186 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55a07b177da0 0x55a07b615950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:49.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.029+0000 7f81e2ae3740 4 client.26786 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:36:49.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.029+0000 7f81e2ae3740 1 -- 172.21.15.63:0/878117186 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a07b4ff8a0 con 0x55a07b177da0 2024-09-21T06:36:49.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.030+0000 7f81d9b0a640 1 --2- 172.21.15.63:0/878117186 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55a07b177da0 0x55a07b615950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:49.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.030+0000 7f81d9b0a640 1 --2- 172.21.15.63:0/878117186 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55a07b177da0 0x55a07b615950 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1b6d705f6e23b7e4 server_cookie=62cedc0cea67aeb5 in_seq=0 out_seq=0 2024-09-21T06:36:49.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.030+0000 7f81b9ffb640 10 client.26786 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:36:49.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.030+0000 7f81b9ffb640 1 -- 172.21.15.63:0/878117186 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a07b4ff8a0 con 0x55a07b177da0 2024-09-21T06:36:49.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.030+0000 7f81b9ffb640 10 client.26786 handle_command_reply: tid=0 2024-09-21T06:36:49.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.030+0000 7f81e2ae3740 1 client.26786 shutdown 2024-09-21T06:36:49.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.030+0000 7f81e2ae3740 1 -- 172.21.15.63:0/878117186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 msgr2=0x55a07b5a9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:49.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.030+0000 7f81e2ae3740 1 --2- 172.21.15.63:0/878117186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 0x55a07b5a9a10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0e4ae0 tx=0x7f81cc0ad0d0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.030+0000 7f81e2ae3740 1 -- 172.21.15.63:0/878117186 shutdown_connections 2024-09-21T06:36:49.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.030+0000 7f81e2ae3740 1 --2- 172.21.15.63:0/878117186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a07b1e4070 0x55a07b60b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.030+0000 7f81e2ae3740 1 --2- 172.21.15.63:0/878117186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a07b1c3390 0x55a07b5a9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.030+0000 7f81e2ae3740 1 --2- 172.21.15.63:0/878117186 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55a07b177da0 0x55a07b615950 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.030+0000 7f81e2ae3740 1 --2- 172.21.15.63:0/878117186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a07b1bb1b0 0x55a07b5a9a10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.030+0000 7f81b9ffb640 0 client.26786 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:36:49.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.030+0000 7f81e2ae3740 1 -- 172.21.15.63:0/878117186 >> 172.21.15.63:0/878117186 conn(0x55a07b1d8460 msgr2=0x55a07b598bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:49.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.030+0000 7f81e2ae3740 1 -- 172.21.15.63:0/878117186 shutdown_connections 2024-09-21T06:36:49.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.030+0000 7f81e2ae3740 1 -- 172.21.15.63:0/878117186 wait complete. 2024-09-21T06:36:49.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.031+0000 7f81e2ae3740 20 client.26786 trim_cache size 0 max 16384 2024-09-21T06:36:49.038 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:36:49.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.031+0000 7f81dc56f640 1 -- 172.21.15.63:0/2093395520 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f81bc0b6680 msgr2=0x7f81bc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:49.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.031+0000 7f81dc56f640 1 --2- 172.21.15.63:0/2093395520 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f81bc0b6680 0x7f81bc0b8b90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009fd0 tx=0x7f81c4004b50 comp rx=0 tx=0).stop 2024-09-21T06:36:49.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.031+0000 7f81dc56f640 1 -- 172.21.15.63:0/2093395520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81d4102a60 msgr2=0x7f81d40ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:49.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.031+0000 7f81dc56f640 1 --2- 172.21.15.63:0/2093395520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81d4102a60 0x7f81d40ff670 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00d950 tx=0x7f81cc00de10 comp rx=0 tx=0).stop 2024-09-21T06:36:49.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.031+0000 7f81dc56f640 1 -- 172.21.15.63:0/2093395520 shutdown_connections 2024-09-21T06:36:49.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.031+0000 7f81dc56f640 1 --2- 172.21.15.63:0/2093395520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81d4108cf0 0x7f81d41000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.031+0000 7f81dc56f640 1 --2- 172.21.15.63:0/2093395520 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f81bc0b6680 0x7f81bc0b8b90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.031+0000 7f81dc56f640 1 --2- 172.21.15.63:0/2093395520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d41083a0 0x7f81d40ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.031+0000 7f81dc56f640 1 --2- 172.21.15.63:0/2093395520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81d4102a60 0x7f81d40ff670 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:49.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.031+0000 7f81dc56f640 1 -- 172.21.15.63:0/2093395520 >> 172.21.15.63:0/2093395520 conn(0x7f81d4079730 msgr2=0x7f81d406b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:49.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.031+0000 7f81dc56f640 1 -- 172.21.15.63:0/2093395520 shutdown_connections 2024-09-21T06:36:49.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:49.031+0000 7f81dc56f640 1 -- 172.21.15.63:0/2093395520 wait complete. 2024-09-21T06:36:49.739 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:49 smithi063 ceph-mon[31150]: pgmap v585: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:36:49.741 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:36:49.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:49 smithi071 ceph-mon[34844]: pgmap v585: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:36:49.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:49 smithi175 ceph-mon[34510]: pgmap v585: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:36:49.999 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:50.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.492+0000 7f730921f640 1 -- 172.21.15.63:0/3515418364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f730410ddf0 msgr2=0x7f7304110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:50.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.492+0000 7f730921f640 1 --2- 172.21.15.63:0/3515418364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f730410ddf0 0x7f7304110300 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009900 tx=0x7f72fc02a410 comp rx=0 tx=0).stop 2024-09-21T06:36:50.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.492+0000 7f730921f640 1 -- 172.21.15.63:0/3515418364 shutdown_connections 2024-09-21T06:36:50.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.492+0000 7f730921f640 1 --2- 172.21.15.63:0/3515418364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f730410ddf0 0x7f7304110300 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.492+0000 7f730921f640 1 --2- 172.21.15.63:0/3515418364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7304105270 0x7f730410d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.492+0000 7f730921f640 1 --2- 172.21.15.63:0/3515418364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7304104840 0x7f7304104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.492+0000 7f730921f640 1 -- 172.21.15.63:0/3515418364 >> 172.21.15.63:0/3515418364 conn(0x7f7304079730 msgr2=0x7f7304079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:50.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.492+0000 7f730921f640 1 -- 172.21.15.63:0/3515418364 shutdown_connections 2024-09-21T06:36:50.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.492+0000 7f730921f640 1 -- 172.21.15.63:0/3515418364 wait complete. 2024-09-21T06:36:50.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.493+0000 7f730921f640 1 Processor -- start 2024-09-21T06:36:50.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.493+0000 7f730921f640 1 -- start start 2024-09-21T06:36:50.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.493+0000 7f730921f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7304104840 0x7f730419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.493+0000 7f730921f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7304105270 0x7f730419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.493+0000 7f730921f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f730410ddf0 0x7f730419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.493+0000 7f730921f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7304113a90 con 0x7f7304104840 2024-09-21T06:36:50.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.493+0000 7f730921f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7304113910 con 0x7f730410ddf0 2024-09-21T06:36:50.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.493+0000 7f730921f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7304113c10 con 0x7f7304105270 2024-09-21T06:36:50.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.493+0000 7f7302d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7304104840 0x7f730419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.493+0000 7f7302d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7304104840 0x7f730419a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57414/0 (socket says 172.21.15.63:57414) 2024-09-21T06:36:50.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.493+0000 7f7302d9d640 1 -- 172.21.15.63:0/673752877 learned_addr learned my addr 172.21.15.63:0/673752877 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:50.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.493+0000 7f730259c640 1 --2- 172.21.15.63:0/673752877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7304105270 0x7f730419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.493+0000 7f730359e640 1 --2- 172.21.15.63:0/673752877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f730410ddf0 0x7f730419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.494+0000 7f7302d9d640 1 -- 172.21.15.63:0/673752877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7304105270 msgr2=0x7f730419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:50.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.494+0000 7f7302d9d640 1 --2- 172.21.15.63:0/673752877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7304105270 0x7f730419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.494+0000 7f7302d9d640 1 -- 172.21.15.63:0/673752877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f730410ddf0 msgr2=0x7f730419fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:50.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.494+0000 7f7302d9d640 1 --2- 172.21.15.63:0/673752877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f730410ddf0 0x7f730419fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.494+0000 7f7302d9d640 1 -- 172.21.15.63:0/673752877 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73041a03d0 con 0x7f7304104840 2024-09-21T06:36:50.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.494+0000 7f7302d9d640 1 --2- 172.21.15.63:0/673752877 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7304104840 0x7f730419a460 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f72f400eaa0 tx=0x7f72f400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:50.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.494+0000 7f72fbfff640 1 -- 172.21.15.63:0/673752877 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4016070 con 0x7f7304104840 2024-09-21T06:36:50.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.494+0000 7f730921f640 1 -- 172.21.15.63:0/673752877 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73041a06c0 con 0x7f7304104840 2024-09-21T06:36:50.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.494+0000 7f72fbfff640 1 -- 172.21.15.63:0/673752877 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72f4003e20 con 0x7f7304104840 2024-09-21T06:36:50.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.494+0000 7f72fbfff640 1 -- 172.21.15.63:0/673752877 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f40116d0 con 0x7f7304104840 2024-09-21T06:36:50.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.494+0000 7f730921f640 1 -- 172.21.15.63:0/673752877 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73041a6e20 con 0x7f7304104840 2024-09-21T06:36:50.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.497+0000 7f730f793740 1 Processor -- start 2024-09-21T06:36:50.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.497+0000 7f730f793740 1 -- start start 2024-09-21T06:36:50.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.497+0000 7f72fbfff640 1 -- 172.21.15.63:0/673752877 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f72f4019070 con 0x7f7304104840 2024-09-21T06:36:50.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.497+0000 7f730f793740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a1029070 0x5555a13d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.497+0000 7f730f793740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a10001b0 0x5555a13d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.497+0000 7f730f793740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555a1008390 0x5555a13d1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.497+0000 7f730f793740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5555a1346ea0 con 0x5555a1029070 2024-09-21T06:36:50.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.497+0000 7f730f793740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5555a13362d0 con 0x5555a10001b0 2024-09-21T06:36:50.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.497+0000 7f730f793740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5555a133a0e0 con 0x5555a1008390 2024-09-21T06:36:50.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.497+0000 7f730359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a1029070 0x5555a13d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.497+0000 7f730359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a1029070 0x5555a13d06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57420/0 (socket says 172.21.15.63:57420) 2024-09-21T06:36:50.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.497+0000 7f730359e640 1 -- 172.21.15.63:0/3040595117 learned_addr learned my addr 172.21.15.63:0/3040595117 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:50.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.497+0000 7f7302d9d640 1 --2- 172.21.15.63:0/3040595117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a10001b0 0x5555a13d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.498+0000 7f730259c640 1 --2- 172.21.15.63:0/3040595117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555a1008390 0x5555a13d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.498+0000 7f730359e640 1 -- 172.21.15.63:0/3040595117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555a1008390 msgr2=0x5555a13d1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:50.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.498+0000 7f730359e640 1 --2- 172.21.15.63:0/3040595117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555a1008390 0x5555a13d1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.498+0000 7f730359e640 1 -- 172.21.15.63:0/3040595117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a10001b0 msgr2=0x5555a13d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:50.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.498+0000 7f730359e640 1 --2- 172.21.15.63:0/3040595117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a10001b0 0x5555a13d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.498+0000 7f730359e640 1 -- 172.21.15.63:0/3040595117 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555a1094650 con 0x5555a1029070 2024-09-21T06:36:50.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.498+0000 7f7302d9d640 1 --2- 172.21.15.63:0/3040595117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a10001b0 0x5555a13d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:50.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.498+0000 7f72fbfff640 1 --2- 172.21.15.63:0/673752877 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f72f00b6680 0x7f72f00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.498+0000 7f730359e640 1 --2- 172.21.15.63:0/3040595117 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a1029070 0x5555a13d06a0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f72fc033000 tx=0x7f72fc032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e182be21190bd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:50.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.498+0000 7f7302d9d640 1 --2- 172.21.15.63:0/673752877 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f72f00b6680 0x7f72f00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.498+0000 7f72fbfff640 1 -- 172.21.15.63:0/673752877 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7f72f40e77c0 con 0x7f7304104840 2024-09-21T06:36:50.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.498+0000 7f72f97fa640 1 -- 172.21.15.63:0/3040595117 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc035040 con 0x5555a1029070 2024-09-21T06:36:50.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.498+0000 7f72f97fa640 1 -- 172.21.15.63:0/3040595117 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72fc0316a0 con 0x5555a1029070 2024-09-21T06:36:50.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.498+0000 7f72f97fa640 1 -- 172.21.15.63:0/3040595117 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc0046c0 con 0x5555a1029070 2024-09-21T06:36:50.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.499+0000 7f730f793740 1 -- 172.21.15.63:0/3040595117 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a1029070 msgr2=0x5555a13d06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:50.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.499+0000 7f7302d9d640 1 --2- 172.21.15.63:0/673752877 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f72f00b6680 0x7f72f00b8b90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f72f40e4f70 tx=0x7f72f40044f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:50.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.499+0000 7f730f793740 1 --2- 172.21.15.63:0/3040595117 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a1029070 0x5555a13d06a0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f72fc033000 tx=0x7f72fc032c60 comp rx=0 tx=0).stop 2024-09-21T06:36:50.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.499+0000 7f730f793740 1 -- 172.21.15.63:0/3040595117 shutdown_connections 2024-09-21T06:36:50.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.499+0000 7f730f793740 1 --2- 172.21.15.63:0/3040595117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555a1008390 0x5555a13d1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.499+0000 7f730f793740 1 --2- 172.21.15.63:0/3040595117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a10001b0 0x5555a13d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.499+0000 7f730f793740 1 --2- 172.21.15.63:0/3040595117 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a1029070 0x5555a13d06a0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.499+0000 7f730f793740 1 -- 172.21.15.63:0/3040595117 >> 172.21.15.63:0/3040595117 conn(0x5555a101d460 msgr2=0x5555a13ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:50.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.499+0000 7f730f793740 1 -- 172.21.15.63:0/3040595117 shutdown_connections 2024-09-21T06:36:50.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.499+0000 7f730f793740 1 -- 172.21.15.63:0/3040595117 wait complete. 2024-09-21T06:36:50.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.500+0000 7f730f793740 1 -- start start 2024-09-21T06:36:50.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.500+0000 7f730f793740 1 Processor -- start 2024-09-21T06:36:50.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.500+0000 7f730f793740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555a10001b0 0x5555a13e00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.500+0000 7f730f793740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a1008390 0x5555a13e0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.500+0000 7f730f793740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a1029070 0x5555a13e0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.500+0000 7f730f793740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5555a1197700 con 0x5555a1029070 2024-09-21T06:36:50.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.500+0000 7f730f793740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5555a12d1160 con 0x5555a1008390 2024-09-21T06:36:50.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.500+0000 7f730f793740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5555a13e3150 con 0x5555a10001b0 2024-09-21T06:36:50.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.500+0000 7f730f793740 10 client.0 _ll_register_callbacks cb 0x5555a12ea9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:50.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.500+0000 7f730359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a1029070 0x5555a13e0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.500+0000 7f730359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a1029070 0x5555a13e0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57436/0 (socket says 172.21.15.63:57436) 2024-09-21T06:36:50.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.500+0000 7f730359e640 1 -- 172.21.15.63:0/3723245324 learned_addr learned my addr 172.21.15.63:0/3723245324 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:50.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.501+0000 7f730359e640 1 --2- 172.21.15.63:0/3723245324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555a10001b0 0x5555a13e00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.501+0000 7f730259c640 1 --2- 172.21.15.63:0/3723245324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a1008390 0x5555a13e0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.501+0000 7f730359e640 1 -- 172.21.15.63:0/3723245324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555a10001b0 msgr2=0x5555a13e00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:50.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.501+0000 7f730359e640 1 --2- 172.21.15.63:0/3723245324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555a10001b0 0x5555a13e00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.501+0000 7f730359e640 1 -- 172.21.15.63:0/3723245324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a1008390 msgr2=0x5555a13e0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:50.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.501+0000 7f730359e640 1 --2- 172.21.15.63:0/3723245324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a1008390 0x5555a13e0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.501+0000 7f730359e640 1 -- 172.21.15.63:0/3723245324 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555a12fec90 con 0x5555a1029070 2024-09-21T06:36:50.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.501+0000 7f730359e640 1 --2- 172.21.15.63:0/3723245324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a1029070 0x5555a13e0b60 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f72fc006010 tx=0x7f72fc0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdc12b05330280a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:50.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.501+0000 7f72ea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:50.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.501+0000 7f72ea7fc640 1 -- 172.21.15.63:0/3723245324 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc035070 con 0x5555a1029070 2024-09-21T06:36:50.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.501+0000 7f72ea7fc640 1 -- 172.21.15.63:0/3723245324 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7f72fc0046c0 con 0x5555a1029070 2024-09-21T06:36:50.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.501+0000 7f730f793740 1 -- 172.21.15.63:0/3723245324 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72fc0316a0 con 0x5555a1029070 2024-09-21T06:36:50.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.501+0000 7f72ea7fc640 1 -- 172.21.15.63:0/3723245324 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f72fc005640 con 0x5555a1029070 2024-09-21T06:36:50.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.501+0000 7f730f793740 10 client.17283 fetch_fsmap learned FSMap version 61 2024-09-21T06:36:50.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.501+0000 7f730f793740 1 -- 172.21.15.63:0/3723245324 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x5555a13eee40 con 0x5555a1029070 2024-09-21T06:36:50.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.502+0000 7f72ea7fc640 1 -- 172.21.15.63:0/3723245324 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72fc0316a0 con 0x5555a1029070 2024-09-21T06:36:50.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.502+0000 7f72ea7fc640 1 -- 172.21.15.63:0/3723245324 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f72fc03c890 con 0x5555a1029070 2024-09-21T06:36:50.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.502+0000 7f730f793740 10 client.17283 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:36:50.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.502+0000 7f730f793740 10 client.17283 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:36:50.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.502+0000 7f730f793740 20 client.17283 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.502+0000 7f730f793740 1 --2- 172.21.15.63:0/3723245324 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x5555a0fe79f0 0x5555a13f21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.502+0000 7f730f793740 4 client.17283 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.502+0000 7f730f793740 1 -- 172.21.15.63:0/3723245324 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555a1348df0 con 0x5555a0fe79f0 2024-09-21T06:36:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.502+0000 7f730259c640 1 --2- 172.21.15.63:0/3723245324 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x5555a0fe79f0 0x5555a13f21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.503+0000 7f72ea7fc640 10 client.17283 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:36:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.503+0000 7f730259c640 1 --2- 172.21.15.63:0/3723245324 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x5555a0fe79f0 0x5555a13f21a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f3fabfa8d692ae40 server_cookie=be112c90bac7e511 in_seq=0 out_seq=0 2024-09-21T06:36:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.504+0000 7f72ea7fc640 1 -- 172.21.15.63:0/3723245324 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5555a1348df0 con 0x5555a0fe79f0 2024-09-21T06:36:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.504+0000 7f72ea7fc640 10 client.17283 handle_command_reply: tid=0 2024-09-21T06:36:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.504+0000 7f730f793740 1 client.17283 shutdown 2024-09-21T06:36:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.504+0000 7f730f793740 1 -- 172.21.15.63:0/3723245324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a1029070 msgr2=0x5555a13e0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.504+0000 7f730f793740 1 --2- 172.21.15.63:0/3723245324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a1029070 0x5555a13e0b60 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f72fc006010 tx=0x7f72fc0058d0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.504+0000 7f730f793740 1 -- 172.21.15.63:0/3723245324 shutdown_connections 2024-09-21T06:36:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.504+0000 7f730f793740 1 --2- 172.21.15.63:0/3723245324 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x5555a0fe79f0 0x5555a13f21a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.504+0000 7f730f793740 1 --2- 172.21.15.63:0/3723245324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a1029070 0x5555a13e0b60 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.504+0000 7f730f793740 1 --2- 172.21.15.63:0/3723245324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a1008390 0x5555a13e0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.504+0000 7f730f793740 1 --2- 172.21.15.63:0/3723245324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555a10001b0 0x5555a13e00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.504+0000 7f72ea7fc640 0 client.17283 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:36:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.504+0000 7f730f793740 1 -- 172.21.15.63:0/3723245324 >> 172.21.15.63:0/3723245324 conn(0x5555a101d460 msgr2=0x5555a13d3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.504+0000 7f730f793740 1 -- 172.21.15.63:0/3723245324 shutdown_connections 2024-09-21T06:36:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.504+0000 7f730f793740 1 -- 172.21.15.63:0/3723245324 wait complete. 2024-09-21T06:36:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.504+0000 7f730f793740 20 client.17283 trim_cache size 0 max 16384 2024-09-21T06:36:50.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.517+0000 7f730f793740 1 Processor -- start 2024-09-21T06:36:50.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.517+0000 7f730f793740 1 -- start start 2024-09-21T06:36:50.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.518+0000 7f730f793740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a10001b0 0x5555a13e15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.518+0000 7f730f793740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a1008390 0x5555a13cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.518+0000 7f730f793740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555a1029070 0x5555a13ce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.518+0000 7f730f793740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f73041ad580 con 0x5555a10001b0 2024-09-21T06:36:50.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.518+0000 7f730f793740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f73041af0c0 con 0x5555a1008390 2024-09-21T06:36:50.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.518+0000 7f730f793740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f73041adc50 con 0x5555a1029070 2024-09-21T06:36:50.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.518+0000 7f730359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a10001b0 0x5555a13e15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.518+0000 7f730359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a10001b0 0x5555a13e15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57442/0 (socket says 172.21.15.63:57442) 2024-09-21T06:36:50.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.518+0000 7f730359e640 1 -- 172.21.15.63:0/779394027 learned_addr learned my addr 172.21.15.63:0/779394027 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:50.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.518+0000 7f730259c640 1 --2- 172.21.15.63:0/779394027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a1008390 0x5555a13cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.518+0000 7f730359e640 1 -- 172.21.15.63:0/779394027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555a1029070 msgr2=0x5555a13ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:50.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.518+0000 7f730359e640 1 --2- 172.21.15.63:0/779394027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555a1029070 0x5555a13ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.518+0000 7f730359e640 1 -- 172.21.15.63:0/779394027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a1008390 msgr2=0x5555a13cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:50.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.518+0000 7f730359e640 1 --2- 172.21.15.63:0/779394027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a1008390 0x5555a13cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.518+0000 7f730359e640 1 -- 172.21.15.63:0/779394027 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555a13e2490 con 0x5555a10001b0 2024-09-21T06:36:50.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.518+0000 7f730259c640 1 --2- 172.21.15.63:0/779394027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a1008390 0x5555a13cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:50.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.519+0000 7f730359e640 1 --2- 172.21.15.63:0/779394027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a10001b0 0x5555a13e15e0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f72fc03ce20 tx=0x7f72fc031970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788ccb5a64c3db8f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:50.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.519+0000 7f72f8ff9640 1 -- 172.21.15.63:0/779394027 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc05e070 con 0x5555a10001b0 2024-09-21T06:36:50.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.519+0000 7f72f8ff9640 1 -- 172.21.15.63:0/779394027 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72fc005640 con 0x5555a10001b0 2024-09-21T06:36:50.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.519+0000 7f72f8ff9640 1 -- 172.21.15.63:0/779394027 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc03c8a0 con 0x5555a10001b0 2024-09-21T06:36:50.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.520+0000 7f730f793740 1 -- 172.21.15.63:0/779394027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a10001b0 msgr2=0x5555a13e15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:50.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.520+0000 7f730f793740 1 --2- 172.21.15.63:0/779394027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a10001b0 0x5555a13e15e0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f72fc03ce20 tx=0x7f72fc031970 comp rx=0 tx=0).stop 2024-09-21T06:36:50.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.520+0000 7f730f793740 1 -- 172.21.15.63:0/779394027 shutdown_connections 2024-09-21T06:36:50.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.520+0000 7f730f793740 1 --2- 172.21.15.63:0/779394027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555a1029070 0x5555a13ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.520+0000 7f730f793740 1 --2- 172.21.15.63:0/779394027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a1008390 0x5555a13cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.520+0000 7f730f793740 1 --2- 172.21.15.63:0/779394027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a10001b0 0x5555a13e15e0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.520+0000 7f730f793740 1 -- 172.21.15.63:0/779394027 >> 172.21.15.63:0/779394027 conn(0x5555a101d460 msgr2=0x5555a13d2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:50.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.520+0000 7f730f793740 1 -- 172.21.15.63:0/779394027 shutdown_connections 2024-09-21T06:36:50.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.520+0000 7f730f793740 1 -- 172.21.15.63:0/779394027 wait complete. 2024-09-21T06:36:50.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.520+0000 7f730f793740 1 -- start start 2024-09-21T06:36:50.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.520+0000 7f730f793740 1 Processor -- start 2024-09-21T06:36:50.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f730f793740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a10001b0 0x5555a13f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f730f793740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555a1008390 0x5555a13f3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f730f793740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a1029070 0x5555a13f3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f730f793740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f73041ae9f0 con 0x5555a10001b0 2024-09-21T06:36:50.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f730f793740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f73041ae320 con 0x5555a1029070 2024-09-21T06:36:50.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f730f793740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f73041ab560 con 0x5555a1008390 2024-09-21T06:36:50.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f730f793740 10 client.0 _ll_register_callbacks cb 0x7f72fc032bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:50.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f730359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a10001b0 0x5555a13f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f730359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a10001b0 0x5555a13f5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57458/0 (socket says 172.21.15.63:57458) 2024-09-21T06:36:50.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f730359e640 1 -- 172.21.15.63:0/236637279 learned_addr learned my addr 172.21.15.63:0/236637279 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:50.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f730259c640 1 --2- 172.21.15.63:0/236637279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555a1008390 0x5555a13f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f730359e640 1 -- 172.21.15.63:0/236637279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555a1008390 msgr2=0x5555a13f3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:50.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f730359e640 1 --2- 172.21.15.63:0/236637279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555a1008390 0x5555a13f3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f730359e640 1 -- 172.21.15.63:0/236637279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a1029070 msgr2=0x5555a13f3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:50.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f730359e640 1 --2- 172.21.15.63:0/236637279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a1029070 0x5555a13f3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f730359e640 1 -- 172.21.15.63:0/236637279 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555a145b920 con 0x5555a10001b0 2024-09-21T06:36:50.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f730259c640 1 --2- 172.21.15.63:0/236637279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555a1008390 0x5555a13f3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:50.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f730359e640 1 --2- 172.21.15.63:0/236637279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a10001b0 0x5555a13f5b60 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009850 tx=0x7f72fc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8012ebf03436524a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:50.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f72ea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:50.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f72ea7fc640 1 -- 172.21.15.63:0/236637279 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc067060 con 0x5555a10001b0 2024-09-21T06:36:50.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f72ea7fc640 1 -- 172.21.15.63:0/236637279 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7f72fc03c820 con 0x5555a10001b0 2024-09-21T06:36:50.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.521+0000 7f730f793740 1 -- 172.21.15.63:0/236637279 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72fc005640 con 0x5555a10001b0 2024-09-21T06:36:50.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.522+0000 7f72ea7fc640 1 -- 172.21.15.63:0/236637279 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f72fc05e040 con 0x5555a10001b0 2024-09-21T06:36:50.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.522+0000 7f730f793740 10 client.17289 fetch_fsmap learned FSMap version 61 2024-09-21T06:36:50.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.522+0000 7f730f793740 1 -- 172.21.15.63:0/236637279 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x5555a145ca10 con 0x5555a10001b0 2024-09-21T06:36:50.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.522+0000 7f72ea7fc640 1 -- 172.21.15.63:0/236637279 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72fc005640 con 0x5555a10001b0 2024-09-21T06:36:50.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.522+0000 7f72ea7fc640 1 -- 172.21.15.63:0/236637279 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f72fc061030 con 0x5555a10001b0 2024-09-21T06:36:50.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.522+0000 7f730f793740 10 client.17289 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:36:50.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.522+0000 7f730f793740 10 client.17289 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:36:50.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.522+0000 7f730f793740 20 client.17289 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:50.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.522+0000 7f730f793740 1 --2- 172.21.15.63:0/236637279 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x5555a0fbcda0 0x5555a145f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.522+0000 7f730f793740 4 client.17289 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:36:50.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.522+0000 7f730f793740 1 -- 172.21.15.63:0/236637279 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5555a13448a0 con 0x5555a0fbcda0 2024-09-21T06:36:50.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.522+0000 7f730259c640 1 --2- 172.21.15.63:0/236637279 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x5555a0fbcda0 0x5555a145f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.523+0000 7f72ea7fc640 10 client.17289 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:36:50.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.523+0000 7f730259c640 1 --2- 172.21.15.63:0/236637279 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x5555a0fbcda0 0x5555a145f030 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=366d62a1b51823f5 server_cookie=8d5f1966077ee60a in_seq=0 out_seq=0 2024-09-21T06:36:50.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.523+0000 7f72ea7fc640 1 -- 172.21.15.63:0/236637279 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5555a13448a0 con 0x5555a0fbcda0 2024-09-21T06:36:50.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.523+0000 7f72ea7fc640 10 client.17289 handle_command_reply: tid=0 2024-09-21T06:36:50.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.523+0000 7f730f793740 1 client.17289 shutdown 2024-09-21T06:36:50.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.523+0000 7f730f793740 1 -- 172.21.15.63:0/236637279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a10001b0 msgr2=0x5555a13f5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:50.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.523+0000 7f730f793740 1 --2- 172.21.15.63:0/236637279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a10001b0 0x5555a13f5b60 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009850 tx=0x7f72fc02a410 comp rx=0 tx=0).stop 2024-09-21T06:36:50.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.523+0000 7f730f793740 1 -- 172.21.15.63:0/236637279 shutdown_connections 2024-09-21T06:36:50.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.523+0000 7f730f793740 1 --2- 172.21.15.63:0/236637279 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x5555a0fbcda0 0x5555a145f030 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.523+0000 7f730f793740 1 --2- 172.21.15.63:0/236637279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5555a1029070 0x5555a13f3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.523+0000 7f730f793740 1 --2- 172.21.15.63:0/236637279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555a1008390 0x5555a13f3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.523+0000 7f730f793740 1 --2- 172.21.15.63:0/236637279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5555a10001b0 0x5555a13f5b60 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.523+0000 7f730f793740 1 -- 172.21.15.63:0/236637279 >> 172.21.15.63:0/236637279 conn(0x5555a101d460 msgr2=0x5555a13ebdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:50.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.523+0000 7f72ea7fc640 0 client.17289 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:36:50.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.524+0000 7f730f793740 1 -- 172.21.15.63:0/236637279 shutdown_connections 2024-09-21T06:36:50.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.524+0000 7f730f793740 1 -- 172.21.15.63:0/236637279 wait complete. 2024-09-21T06:36:50.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.524+0000 7f730f793740 20 client.17289 trim_cache size 0 max 16384 2024-09-21T06:36:50.530 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:36:50.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.524+0000 7f730921f640 1 -- 172.21.15.63:0/673752877 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f72f00b6680 msgr2=0x7f72f00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:50.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.524+0000 7f730921f640 1 --2- 172.21.15.63:0/673752877 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f72f00b6680 0x7f72f00b8b90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f72f40e4f70 tx=0x7f72f40044f0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.524+0000 7f730921f640 1 -- 172.21.15.63:0/673752877 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7304104840 msgr2=0x7f730419a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:50.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.524+0000 7f730921f640 1 --2- 172.21.15.63:0/673752877 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7304104840 0x7f730419a460 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f72f400eaa0 tx=0x7f72f400ef60 comp rx=0 tx=0).stop 2024-09-21T06:36:50.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.524+0000 7f730921f640 1 -- 172.21.15.63:0/673752877 shutdown_connections 2024-09-21T06:36:50.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.524+0000 7f730921f640 1 --2- 172.21.15.63:0/673752877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f730410ddf0 0x7f730419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.524+0000 7f730921f640 1 --2- 172.21.15.63:0/673752877 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f72f00b6680 0x7f72f00b8b90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.524+0000 7f730921f640 1 --2- 172.21.15.63:0/673752877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7304105270 0x7f730419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.524+0000 7f730921f640 1 --2- 172.21.15.63:0/673752877 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7304104840 0x7f730419a460 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.524+0000 7f730921f640 1 -- 172.21.15.63:0/673752877 >> 172.21.15.63:0/673752877 conn(0x7f7304079730 msgr2=0x7f7304107970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:50.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.524+0000 7f730921f640 1 -- 172.21.15.63:0/673752877 shutdown_connections 2024-09-21T06:36:50.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:50.524+0000 7f730921f640 1 -- 172.21.15.63:0/673752877 wait complete. 2024-09-21T06:36:51.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:51 smithi063 ceph-mon[31150]: pgmap v586: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:36:51.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:51 smithi071 ceph-mon[34844]: pgmap v586: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:36:51.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:51 smithi175 ceph-mon[34510]: pgmap v586: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:36:52.280 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:36:52.281 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:36:52.588 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:53.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.079+0000 7fd1dfe31640 1 -- 172.21.15.63:0/64581785 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1d8102ae0 msgr2=0x7fd1d8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:53.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.079+0000 7fd1dfe31640 1 --2- 172.21.15.63:0/64581785 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1d8102ae0 0x7fd1d8102ef0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009900 tx=0x7fd1d402a410 comp rx=0 tx=0).stop 2024-09-21T06:36:53.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.079+0000 7fd1dfe31640 1 -- 172.21.15.63:0/64581785 shutdown_connections 2024-09-21T06:36:53.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.079+0000 7fd1dfe31640 1 --2- 172.21.15.63:0/64581785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1d8108d20 0x7fd1d810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.079+0000 7fd1dfe31640 1 --2- 172.21.15.63:0/64581785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1d81083d0 0x7fd1d81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.079+0000 7fd1dfe31640 1 --2- 172.21.15.63:0/64581785 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1d8102ae0 0x7fd1d8102ef0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.079+0000 7fd1dfe31640 1 -- 172.21.15.63:0/64581785 >> 172.21.15.63:0/64581785 conn(0x7fd1d8079790 msgr2=0x7fd1d8079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:53.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.080+0000 7fd1dfe31640 1 -- 172.21.15.63:0/64581785 shutdown_connections 2024-09-21T06:36:53.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.080+0000 7fd1dfe31640 1 -- 172.21.15.63:0/64581785 wait complete. 2024-09-21T06:36:53.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.080+0000 7fd1dfe31640 1 Processor -- start 2024-09-21T06:36:53.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.080+0000 7fd1dfe31640 1 -- start start 2024-09-21T06:36:53.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.080+0000 7fd1dfe31640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1d8102ae0 0x7fd1d8199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:53.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1dfe31640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1d81083d0 0x7fd1d81996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:53.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1dfe31640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1d8108d20 0x7fd1d8199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:53.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1dfe31640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d8112a60 con 0x7fd1d8108d20 2024-09-21T06:36:53.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1dfe31640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d81128e0 con 0x7fd1d81083d0 2024-09-21T06:36:53.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1dfe31640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d8112be0 con 0x7fd1d8102ae0 2024-09-21T06:36:53.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1de3ce640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1d8108d20 0x7fd1d8199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:53.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1de3ce640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1d8108d20 0x7fd1d8199c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57488/0 (socket says 172.21.15.63:57488) 2024-09-21T06:36:53.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1de3ce640 1 -- 172.21.15.63:0/1947342782 learned_addr learned my addr 172.21.15.63:0/1947342782 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:53.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1ddbcd640 1 --2- 172.21.15.63:0/1947342782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1d8102ae0 0x7fd1d8199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:53.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1dd3cc640 1 --2- 172.21.15.63:0/1947342782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1d81083d0 0x7fd1d81996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:53.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1de3ce640 1 -- 172.21.15.63:0/1947342782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1d8102ae0 msgr2=0x7fd1d8199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:53.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1de3ce640 1 --2- 172.21.15.63:0/1947342782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1d8102ae0 0x7fd1d8199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1de3ce640 1 -- 172.21.15.63:0/1947342782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1d81083d0 msgr2=0x7fd1d81996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:53.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1de3ce640 1 --2- 172.21.15.63:0/1947342782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1d81083d0 0x7fd1d81996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1de3ce640 1 -- 172.21.15.63:0/1947342782 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d81a8830 con 0x7fd1d8108d20 2024-09-21T06:36:53.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1dd3cc640 1 --2- 172.21.15.63:0/1947342782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1d81083d0 0x7fd1d81996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:53.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1de3ce640 1 --2- 172.21.15.63:0/1947342782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1d8108d20 0x7fd1d8199c00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000b970 tx=0x7fd1d000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:53.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1ceffd640 1 -- 172.21.15.63:0/1947342782 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0019070 con 0x7fd1d8108d20 2024-09-21T06:36:53.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1dfe31640 1 -- 172.21.15.63:0/1947342782 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1d81a8b20 con 0x7fd1d8108d20 2024-09-21T06:36:53.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1ceffd640 1 -- 172.21.15.63:0/1947342782 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1d0014440 con 0x7fd1d8108d20 2024-09-21T06:36:53.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.081+0000 7fd1ceffd640 1 -- 172.21.15.63:0/1947342782 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00075d0 con 0x7fd1d8108d20 2024-09-21T06:36:53.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.082+0000 7fd1dfe31640 1 -- 172.21.15.63:0/1947342782 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1d81a9090 con 0x7fd1d8108d20 2024-09-21T06:36:53.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.085+0000 7fd1e63a5740 1 Processor -- start 2024-09-21T06:36:53.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.085+0000 7fd1ceffd640 1 -- 172.21.15.63:0/1947342782 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fd1d001c070 con 0x7fd1d8108d20 2024-09-21T06:36:53.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.086+0000 7fd1e63a5740 1 -- start start 2024-09-21T06:36:53.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.086+0000 7fd1e63a5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a0b8c6350 0x559a0bc6d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:53.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.086+0000 7fd1e63a5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b89d490 0x559a0bc6d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:53.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.086+0000 7fd1e63a5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b8a5670 0x559a0bc6deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:53.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.086+0000 7fd1e63a5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559a0bbe3e60 con 0x559a0b89d490 2024-09-21T06:36:53.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.086+0000 7fd1e63a5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559a0bbd3290 con 0x559a0b8c6350 2024-09-21T06:36:53.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.086+0000 7fd1e63a5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559a0bbd70a0 con 0x559a0b8a5670 2024-09-21T06:36:53.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.086+0000 7fd1ddbcd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b89d490 0x559a0bc6d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:53.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.086+0000 7fd1ddbcd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b89d490 0x559a0bc6d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57492/0 (socket says 172.21.15.63:57492) 2024-09-21T06:36:53.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.086+0000 7fd1ddbcd640 1 -- 172.21.15.63:0/75783513 learned_addr learned my addr 172.21.15.63:0/75783513 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:53.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.086+0000 7fd1dd3cc640 1 --2- 172.21.15.63:0/75783513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a0b8c6350 0x559a0bc6d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:53.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.086+0000 7fd1dd3cc640 1 --2- 172.21.15.63:0/75783513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b8a5670 0x559a0bc6deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:53.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.087+0000 7fd1ceffd640 1 --2- 172.21.15.63:0/1947342782 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd1c40b6680 0x7fd1c40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:53.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.087+0000 7fd1ddbcd640 1 -- 172.21.15.63:0/75783513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b8a5670 msgr2=0x559a0bc6deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:53.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.087+0000 7fd1ddbcd640 1 --2- 172.21.15.63:0/75783513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b8a5670 0x559a0bc6deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.087+0000 7fd1ddbcd640 1 -- 172.21.15.63:0/75783513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a0b8c6350 msgr2=0x559a0bc6d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:53.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.087+0000 7fd1ddbcd640 1 --2- 172.21.15.63:0/75783513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a0b8c6350 0x559a0bc6d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.087+0000 7fd1ddbcd640 1 -- 172.21.15.63:0/75783513 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a0b931930 con 0x559a0b89d490 2024-09-21T06:36:53.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.087+0000 7fd1de3ce640 1 --2- 172.21.15.63:0/1947342782 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd1c40b6680 0x7fd1c40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:53.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.087+0000 7fd1ddbcd640 1 --2- 172.21.15.63:0/75783513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b89d490 0x559a0bc6d970 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009900 tx=0x7fd1d4032df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2d5680ee605800 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:53.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.087+0000 7fd1ceffd640 1 -- 172.21.15.63:0/1947342782 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7fd1d00e6c70 con 0x7fd1d8108d20 2024-09-21T06:36:53.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.087+0000 7fd1c3fff640 1 -- 172.21.15.63:0/75783513 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4040070 con 0x559a0b89d490 2024-09-21T06:36:53.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.087+0000 7fd1c3fff640 1 -- 172.21.15.63:0/75783513 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1d4005db0 con 0x559a0b89d490 2024-09-21T06:36:53.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.087+0000 7fd1c3fff640 1 -- 172.21.15.63:0/75783513 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4035040 con 0x559a0b89d490 2024-09-21T06:36:53.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.088+0000 7fd1e63a5740 1 -- 172.21.15.63:0/75783513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b89d490 msgr2=0x559a0bc6d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:53.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.088+0000 7fd1e63a5740 1 --2- 172.21.15.63:0/75783513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b89d490 0x559a0bc6d970 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009900 tx=0x7fd1d4032df0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.088+0000 7fd1de3ce640 1 --2- 172.21.15.63:0/1947342782 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd1c40b6680 0x7fd1c40b8b90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00a9d90 tx=0x7fd1d00a91f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:53.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.088+0000 7fd1e63a5740 1 -- 172.21.15.63:0/75783513 shutdown_connections 2024-09-21T06:36:53.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.088+0000 7fd1e63a5740 1 --2- 172.21.15.63:0/75783513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b8a5670 0x559a0bc6deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.088+0000 7fd1e63a5740 1 --2- 172.21.15.63:0/75783513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b89d490 0x559a0bc6d970 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.088+0000 7fd1e63a5740 1 --2- 172.21.15.63:0/75783513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a0b8c6350 0x559a0bc6d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.088+0000 7fd1e63a5740 1 -- 172.21.15.63:0/75783513 >> 172.21.15.63:0/75783513 conn(0x559a0b8ba740 msgr2=0x559a0bc6b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:53.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.088+0000 7fd1e63a5740 1 -- 172.21.15.63:0/75783513 shutdown_connections 2024-09-21T06:36:53.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.088+0000 7fd1e63a5740 1 -- 172.21.15.63:0/75783513 wait complete. 2024-09-21T06:36:53.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.089+0000 7fd1e63a5740 1 -- start start 2024-09-21T06:36:53.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.089+0000 7fd1e63a5740 1 Processor -- start 2024-09-21T06:36:53.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.089+0000 7fd1e63a5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b89d490 0x559a0bc78ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:53.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.089+0000 7fd1e63a5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b8a5670 0x559a0bc79530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:53.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.089+0000 7fd1e63a5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a0b8c6350 0x559a0bc84ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:53.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.089+0000 7fd1e63a5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559a0ba34890 con 0x559a0b8a5670 2024-09-21T06:36:53.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.089+0000 7fd1e63a5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559a0bb6dd40 con 0x559a0b8c6350 2024-09-21T06:36:53.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.089+0000 7fd1e63a5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559a0bc7bbb0 con 0x559a0b89d490 2024-09-21T06:36:53.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.089+0000 7fd1e63a5740 10 client.0 _ll_register_callbacks cb 0x559a0bbd1c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:53.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.090+0000 7fd1ddbcd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b8a5670 0x559a0bc79530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:53.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.090+0000 7fd1ddbcd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b8a5670 0x559a0bc79530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57500/0 (socket says 172.21.15.63:57500) 2024-09-21T06:36:53.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.090+0000 7fd1ddbcd640 1 -- 172.21.15.63:0/432467287 learned_addr learned my addr 172.21.15.63:0/432467287 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:53.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.090+0000 7fd1dd3cc640 1 --2- 172.21.15.63:0/432467287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b89d490 0x559a0bc78ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:53.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.090+0000 7fd1dd3cc640 1 --2- 172.21.15.63:0/432467287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a0b8c6350 0x559a0bc84ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:53.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.090+0000 7fd1ddbcd640 1 -- 172.21.15.63:0/432467287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b89d490 msgr2=0x559a0bc78ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:53.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.090+0000 7fd1ddbcd640 1 --2- 172.21.15.63:0/432467287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b89d490 0x559a0bc78ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.090+0000 7fd1ddbcd640 1 -- 172.21.15.63:0/432467287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a0b8c6350 msgr2=0x559a0bc84ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:53.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.090+0000 7fd1ddbcd640 1 --2- 172.21.15.63:0/432467287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a0b8c6350 0x559a0bc84ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.090+0000 7fd1ddbcd640 1 -- 172.21.15.63:0/432467287 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a0bc85440 con 0x559a0b8a5670 2024-09-21T06:36:53.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.090+0000 7fd1dd3cc640 1 --2- 172.21.15.63:0/432467287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b89d490 0x559a0bc78ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:53.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.090+0000 7fd1ddbcd640 1 --2- 172.21.15.63:0/432467287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b8a5670 0x559a0bc79530 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fd1d402a930 tx=0x7fd1d4032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429f15e12a2fc0f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:53.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.090+0000 7fd1c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:53.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.090+0000 7fd1c17fa640 1 -- 172.21.15.63:0/432467287 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4035040 con 0x559a0b8a5670 2024-09-21T06:36:53.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.090+0000 7fd1c17fa640 1 -- 172.21.15.63:0/432467287 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7fd1d40314a0 con 0x559a0b8a5670 2024-09-21T06:36:53.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.090+0000 7fd1e63a5740 1 -- 172.21.15.63:0/432467287 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1d4005db0 con 0x559a0b8a5670 2024-09-21T06:36:53.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.091+0000 7fd1c17fa640 1 -- 172.21.15.63:0/432467287 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fd1d4040040 con 0x559a0b8a5670 2024-09-21T06:36:53.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.091+0000 7fd1e63a5740 10 client.17301 fetch_fsmap learned FSMap version 61 2024-09-21T06:36:53.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.091+0000 7fd1e63a5740 1 -- 172.21.15.63:0/432467287 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x559a0bc87d70 con 0x559a0b8a5670 2024-09-21T06:36:53.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.091+0000 7fd1c17fa640 1 -- 172.21.15.63:0/432467287 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1d4005db0 con 0x559a0b8a5670 2024-09-21T06:36:53.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.091+0000 7fd1c17fa640 1 -- 172.21.15.63:0/432467287 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fd1d404d450 con 0x559a0b8a5670 2024-09-21T06:36:53.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.091+0000 7fd1e63a5740 10 client.17301 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:36:53.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.091+0000 7fd1e63a5740 10 client.17301 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:36:53.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.091+0000 7fd1e63a5740 20 client.17301 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:53.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.091+0000 7fd1e63a5740 1 --2- 172.21.15.63:0/432467287 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x559a0b884cd0 0x559a0bc8b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:53.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.091+0000 7fd1e63a5740 4 client.17301 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:53.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.091+0000 7fd1e63a5740 1 -- 172.21.15.63:0/432467287 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a0bbe5db0 con 0x559a0b884cd0 2024-09-21T06:36:53.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.091+0000 7fd1dd3cc640 1 --2- 172.21.15.63:0/432467287 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x559a0b884cd0 0x559a0bc8b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:53.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.092+0000 7fd1dd3cc640 1 --2- 172.21.15.63:0/432467287 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x559a0b884cd0 0x559a0bc8b0d0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6780f8106a39d8af server_cookie=c58ac19b1b31a2ec in_seq=0 out_seq=0 2024-09-21T06:36:53.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.092+0000 7fd1c17fa640 10 client.17301 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:53.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.093+0000 7fd1c17fa640 1 -- 172.21.15.63:0/432467287 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a0bbe5db0 con 0x559a0b884cd0 2024-09-21T06:36:53.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.093+0000 7fd1c17fa640 10 client.17301 handle_command_reply: tid=0 2024-09-21T06:36:53.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.093+0000 7fd1e63a5740 1 client.17301 shutdown 2024-09-21T06:36:53.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.093+0000 7fd1e63a5740 1 -- 172.21.15.63:0/432467287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b8a5670 msgr2=0x559a0bc79530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:53.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.093+0000 7fd1e63a5740 1 --2- 172.21.15.63:0/432467287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b8a5670 0x559a0bc79530 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fd1d402a930 tx=0x7fd1d4032f60 comp rx=0 tx=0).stop 2024-09-21T06:36:53.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.093+0000 7fd1e63a5740 1 -- 172.21.15.63:0/432467287 shutdown_connections 2024-09-21T06:36:53.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.093+0000 7fd1e63a5740 1 --2- 172.21.15.63:0/432467287 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x559a0b884cd0 0x559a0bc8b0d0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.093+0000 7fd1e63a5740 1 --2- 172.21.15.63:0/432467287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a0b8c6350 0x559a0bc84ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.093+0000 7fd1e63a5740 1 --2- 172.21.15.63:0/432467287 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b8a5670 0x559a0bc79530 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.093+0000 7fd1c17fa640 0 client.17301 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:53.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.093+0000 7fd1e63a5740 1 --2- 172.21.15.63:0/432467287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b89d490 0x559a0bc78ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.093+0000 7fd1e63a5740 1 -- 172.21.15.63:0/432467287 >> 172.21.15.63:0/432467287 conn(0x559a0b8ba740 msgr2=0x559a0bc705c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:53.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.093+0000 7fd1e63a5740 1 -- 172.21.15.63:0/432467287 shutdown_connections 2024-09-21T06:36:53.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.093+0000 7fd1e63a5740 1 -- 172.21.15.63:0/432467287 wait complete. 2024-09-21T06:36:53.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.093+0000 7fd1e63a5740 20 client.17301 trim_cache size 0 max 16384 2024-09-21T06:36:53.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.111+0000 7fd1e63a5740 1 Processor -- start 2024-09-21T06:36:53.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.111+0000 7fd1e63a5740 1 -- start start 2024-09-21T06:36:53.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.111+0000 7fd1e63a5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b884cd0 0x559a0bc84e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:53.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.111+0000 7fd1e63a5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b89d490 0x559a0bc73550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:53.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.111+0000 7fd1e63a5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a0b8a5670 0x559a0bc75fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:53.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.111+0000 7fd1e63a5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d81b1a70 con 0x559a0b884cd0 2024-09-21T06:36:53.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.111+0000 7fd1e63a5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d81b35b0 con 0x559a0b8a5670 2024-09-21T06:36:53.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.111+0000 7fd1e63a5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d81b2140 con 0x559a0b89d490 2024-09-21T06:36:53.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.111+0000 7fd1dd3cc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b884cd0 0x559a0bc84e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:53.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.111+0000 7fd1dd3cc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b884cd0 0x559a0bc84e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57506/0 (socket says 172.21.15.63:57506) 2024-09-21T06:36:53.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.111+0000 7fd1dd3cc640 1 -- 172.21.15.63:0/2478136851 learned_addr learned my addr 172.21.15.63:0/2478136851 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:53.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.111+0000 7fd1ddbcd640 1 --2- 172.21.15.63:0/2478136851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b89d490 0x559a0bc73550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:53.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.111+0000 7fd1dd3cc640 1 --2- 172.21.15.63:0/2478136851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a0b8a5670 0x559a0bc75fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:53.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.111+0000 7fd1dd3cc640 1 -- 172.21.15.63:0/2478136851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b89d490 msgr2=0x559a0bc73550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:53.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.111+0000 7fd1dd3cc640 1 --2- 172.21.15.63:0/2478136851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b89d490 0x559a0bc73550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.111+0000 7fd1dd3cc640 1 -- 172.21.15.63:0/2478136851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a0b8a5670 msgr2=0x559a0bc75fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:53.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.111+0000 7fd1dd3cc640 1 --2- 172.21.15.63:0/2478136851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a0b8a5670 0x559a0bc75fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.112+0000 7fd1dd3cc640 1 -- 172.21.15.63:0/2478136851 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a0bc6f720 con 0x559a0b884cd0 2024-09-21T06:36:53.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.112+0000 7fd1dd3cc640 1 --2- 172.21.15.63:0/2478136851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b884cd0 0x559a0bc84e40 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8107f80 tx=0x7fd1c800b3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf1a9511d82c619 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:53.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.112+0000 7fd1c37fe640 1 -- 172.21.15.63:0/2478136851 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8014c80 con 0x559a0b884cd0 2024-09-21T06:36:53.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.112+0000 7fd1c37fe640 1 -- 172.21.15.63:0/2478136851 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1c8014e20 con 0x559a0b884cd0 2024-09-21T06:36:53.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.112+0000 7fd1c37fe640 1 -- 172.21.15.63:0/2478136851 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8011640 con 0x559a0b884cd0 2024-09-21T06:36:53.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.113+0000 7fd1e63a5740 1 -- 172.21.15.63:0/2478136851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b884cd0 msgr2=0x559a0bc84e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:53.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.113+0000 7fd1e63a5740 1 --2- 172.21.15.63:0/2478136851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b884cd0 0x559a0bc84e40 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8107f80 tx=0x7fd1c800b3c0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.113+0000 7fd1e63a5740 1 -- 172.21.15.63:0/2478136851 shutdown_connections 2024-09-21T06:36:53.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.113+0000 7fd1e63a5740 1 --2- 172.21.15.63:0/2478136851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a0b8a5670 0x559a0bc75fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.113+0000 7fd1e63a5740 1 --2- 172.21.15.63:0/2478136851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b89d490 0x559a0bc73550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.113+0000 7fd1e63a5740 1 --2- 172.21.15.63:0/2478136851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b884cd0 0x559a0bc84e40 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.113+0000 7fd1e63a5740 1 -- 172.21.15.63:0/2478136851 >> 172.21.15.63:0/2478136851 conn(0x559a0b8ba740 msgr2=0x559a0bc77670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:53.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.113+0000 7fd1e63a5740 1 -- 172.21.15.63:0/2478136851 shutdown_connections 2024-09-21T06:36:53.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.113+0000 7fd1e63a5740 1 -- 172.21.15.63:0/2478136851 wait complete. 2024-09-21T06:36:53.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.113+0000 7fd1e63a5740 1 -- start start 2024-09-21T06:36:53.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.113+0000 7fd1e63a5740 1 Processor -- start 2024-09-21T06:36:53.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.114+0000 7fd1e63a5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b884cd0 0x559a0bc8c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:53.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.114+0000 7fd1e63a5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a0b89d490 0x559a0bc8cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:53.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.114+0000 7fd1e63a5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b8a5670 0x559a0bcf4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:53.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.114+0000 7fd1e63a5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d81b2ee0 con 0x559a0b8a5670 2024-09-21T06:36:53.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.114+0000 7fd1e63a5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d81b2810 con 0x559a0b89d490 2024-09-21T06:36:53.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.114+0000 7fd1e63a5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d81afa70 con 0x559a0b884cd0 2024-09-21T06:36:53.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.114+0000 7fd1e63a5740 10 client.0 _ll_register_callbacks cb 0x7fd1c800b960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:53.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.114+0000 7fd1dd3cc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b8a5670 0x559a0bcf4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:53.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.114+0000 7fd1dd3cc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b8a5670 0x559a0bcf4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57522/0 (socket says 172.21.15.63:57522) 2024-09-21T06:36:53.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.114+0000 7fd1dd3cc640 1 -- 172.21.15.63:0/450130017 learned_addr learned my addr 172.21.15.63:0/450130017 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:53.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.114+0000 7fd1dd3cc640 1 --2- 172.21.15.63:0/450130017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b884cd0 0x559a0bc8c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:53.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.114+0000 7fd1ddbcd640 1 --2- 172.21.15.63:0/450130017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a0b89d490 0x559a0bc8cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:53.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.114+0000 7fd1dd3cc640 1 -- 172.21.15.63:0/450130017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b884cd0 msgr2=0x559a0bc8c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:53.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.114+0000 7fd1dd3cc640 1 --2- 172.21.15.63:0/450130017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b884cd0 0x559a0bc8c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.114+0000 7fd1dd3cc640 1 -- 172.21.15.63:0/450130017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a0b89d490 msgr2=0x559a0bc8cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:53.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.114+0000 7fd1dd3cc640 1 --2- 172.21.15.63:0/450130017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a0b89d490 0x559a0bc8cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.114+0000 7fd1dd3cc640 1 -- 172.21.15.63:0/450130017 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a0bcf4d90 con 0x559a0b8a5670 2024-09-21T06:36:53.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.115+0000 7fd1dd3cc640 1 --2- 172.21.15.63:0/450130017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b8a5670 0x559a0bcf4850 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8022f60 tx=0x7fd1c8022d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20d46c2030f2207 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:53.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.115+0000 7fd1c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:53.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.115+0000 7fd1c17fa640 1 -- 172.21.15.63:0/450130017 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c802e040 con 0x559a0b8a5670 2024-09-21T06:36:53.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.115+0000 7fd1c17fa640 1 -- 172.21.15.63:0/450130017 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7fd1c8013b20 con 0x559a0b8a5670 2024-09-21T06:36:53.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.115+0000 7fd1e63a5740 1 -- 172.21.15.63:0/450130017 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1c8014e20 con 0x559a0b8a5670 2024-09-21T06:36:53.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.115+0000 7fd1c17fa640 1 -- 172.21.15.63:0/450130017 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fd1c8005030 con 0x559a0b8a5670 2024-09-21T06:36:53.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.115+0000 7fd1e63a5740 10 client.17307 fetch_fsmap learned FSMap version 61 2024-09-21T06:36:53.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.115+0000 7fd1e63a5740 1 -- 172.21.15.63:0/450130017 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x559a0bcf6030 con 0x559a0b8a5670 2024-09-21T06:36:53.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.115+0000 7fd1c17fa640 1 -- 172.21.15.63:0/450130017 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1c8014e20 con 0x559a0b8a5670 2024-09-21T06:36:53.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.115+0000 7fd1c17fa640 1 -- 172.21.15.63:0/450130017 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fd1c800f040 con 0x559a0b8a5670 2024-09-21T06:36:53.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.115+0000 7fd1e63a5740 10 client.17307 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:36:53.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.115+0000 7fd1e63a5740 10 client.17307 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:36:53.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.115+0000 7fd1e63a5740 20 client.17307 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:53.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.115+0000 7fd1e63a5740 1 --2- 172.21.15.63:0/450130017 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x559a0b8c6350 0x559a0bcf87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:53.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.115+0000 7fd1e63a5740 4 client.17307 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:36:53.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.116+0000 7fd1e63a5740 1 -- 172.21.15.63:0/450130017 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559a0bbe1860 con 0x559a0b8c6350 2024-09-21T06:36:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.116+0000 7fd1ddbcd640 1 --2- 172.21.15.63:0/450130017 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x559a0b8c6350 0x559a0bcf87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.116+0000 7fd1ddbcd640 1 --2- 172.21.15.63:0/450130017 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x559a0b8c6350 0x559a0bcf87c0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71826fe98efa92ac server_cookie=ab5928f627be760f in_seq=0 out_seq=0 2024-09-21T06:36:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.116+0000 7fd1c17fa640 10 client.17307 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.118+0000 7fd1c17fa640 1 -- 172.21.15.63:0/450130017 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559a0bbe1860 con 0x559a0b8c6350 2024-09-21T06:36:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.118+0000 7fd1c17fa640 10 client.17307 handle_command_reply: tid=0 2024-09-21T06:36:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.118+0000 7fd1e63a5740 1 client.17307 shutdown 2024-09-21T06:36:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.118+0000 7fd1e63a5740 1 -- 172.21.15.63:0/450130017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b8a5670 msgr2=0x559a0bcf4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.118+0000 7fd1e63a5740 1 --2- 172.21.15.63:0/450130017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b8a5670 0x559a0bcf4850 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8022f60 tx=0x7fd1c8022d20 comp rx=0 tx=0).stop 2024-09-21T06:36:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.118+0000 7fd1e63a5740 1 -- 172.21.15.63:0/450130017 shutdown_connections 2024-09-21T06:36:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.118+0000 7fd1e63a5740 1 --2- 172.21.15.63:0/450130017 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x559a0b8c6350 0x559a0bcf87c0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.119+0000 7fd1e63a5740 1 --2- 172.21.15.63:0/450130017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a0b8a5670 0x559a0bcf4850 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.119+0000 7fd1e63a5740 1 --2- 172.21.15.63:0/450130017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a0b89d490 0x559a0bc8cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.119+0000 7fd1e63a5740 1 --2- 172.21.15.63:0/450130017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a0b884cd0 0x559a0bc8c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.119+0000 7fd1c17fa640 0 client.17307 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:53.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.119+0000 7fd1e63a5740 1 -- 172.21.15.63:0/450130017 >> 172.21.15.63:0/450130017 conn(0x559a0b8ba740 msgr2=0x559a0bc6e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:53.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.119+0000 7fd1e63a5740 1 -- 172.21.15.63:0/450130017 shutdown_connections 2024-09-21T06:36:53.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.119+0000 7fd1e63a5740 1 -- 172.21.15.63:0/450130017 wait complete. 2024-09-21T06:36:53.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.119+0000 7fd1e63a5740 20 client.17307 trim_cache size 0 max 16384 2024-09-21T06:36:53.123 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:36:53.123 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0, 2024-09-21T06:36:53.123 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_tag": "9ad8f980-759b-4f0b-a3d4-e748a05e78b0", 2024-09-21T06:36:53.124 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": "asynchronous" 2024-09-21T06:36:53.124 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:36:53.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.119+0000 7fd1dfe31640 1 -- 172.21.15.63:0/1947342782 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd1c40b6680 msgr2=0x7fd1c40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:53.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.119+0000 7fd1dfe31640 1 --2- 172.21.15.63:0/1947342782 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd1c40b6680 0x7fd1c40b8b90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00a9d90 tx=0x7fd1d00a91f0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.119+0000 7fd1dfe31640 1 -- 172.21.15.63:0/1947342782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1d8108d20 msgr2=0x7fd1d8199c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:53.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.119+0000 7fd1dfe31640 1 --2- 172.21.15.63:0/1947342782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1d8108d20 0x7fd1d8199c00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000b970 tx=0x7fd1d000be30 comp rx=0 tx=0).stop 2024-09-21T06:36:53.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.119+0000 7fd1dfe31640 1 -- 172.21.15.63:0/1947342782 shutdown_connections 2024-09-21T06:36:53.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.119+0000 7fd1dfe31640 1 --2- 172.21.15.63:0/1947342782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1d8108d20 0x7fd1d8199c00 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.119+0000 7fd1dfe31640 1 --2- 172.21.15.63:0/1947342782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1d81083d0 0x7fd1d81996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.119+0000 7fd1dfe31640 1 --2- 172.21.15.63:0/1947342782 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd1c40b6680 0x7fd1c40b8b90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.119+0000 7fd1dfe31640 1 --2- 172.21.15.63:0/1947342782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1d8102ae0 0x7fd1d8199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:53.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.120+0000 7fd1dfe31640 1 -- 172.21.15.63:0/1947342782 >> 172.21.15.63:0/1947342782 conn(0x7fd1d8079790 msgr2=0x7fd1d8106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:53.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.120+0000 7fd1dfe31640 1 -- 172.21.15.63:0/1947342782 shutdown_connections 2024-09-21T06:36:53.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:53.120+0000 7fd1dfe31640 1 -- 172.21.15.63:0/1947342782 wait complete. 2024-09-21T06:36:53.727 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:53 smithi063 ceph-mon[31150]: pgmap v587: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:36:53.727 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:53 smithi063 ceph-mon[31150]: scrub queued for path: / 2024-09-21T06:36:53.727 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:53 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:53.727 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:53 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:36:53.727 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:53 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:53.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:53 smithi071 ceph-mon[34844]: pgmap v587: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:36:53.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:53 smithi071 ceph-mon[34844]: scrub queued for path: / 2024-09-21T06:36:53.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:53 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:53.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:53 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:36:53.769 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:53 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:53.820 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:36:53.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:53 smithi175 ceph-mon[34510]: pgmap v587: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:36:53.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:53 smithi175 ceph-mon[34510]: scrub queued for path: / 2024-09-21T06:36:53.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:53 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:53.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:53 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:36:53.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:53 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:54.079 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:54.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.562+0000 7f90f84cd640 1 -- 172.21.15.63:0/226287774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90f0103b60 msgr2=0x7f90f0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:54.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.562+0000 7f90f84cd640 1 --2- 172.21.15.63:0/226287774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90f0103b60 0x7f90f0103f70 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009900 tx=0x7f90ec02a410 comp rx=0 tx=0).stop 2024-09-21T06:36:54.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.562+0000 7f90f84cd640 1 -- 172.21.15.63:0/226287774 shutdown_connections 2024-09-21T06:36:54.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.562+0000 7f90f84cd640 1 --2- 172.21.15.63:0/226287774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90f0109df0 0x7f90f0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.562+0000 7f90f84cd640 1 --2- 172.21.15.63:0/226287774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90f01094a0 0x7f90f01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.562+0000 7f90f84cd640 1 --2- 172.21.15.63:0/226287774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90f0103b60 0x7f90f0103f70 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.562+0000 7f90f84cd640 1 -- 172.21.15.63:0/226287774 >> 172.21.15.63:0/226287774 conn(0x7f90f007b850 msgr2=0x7f90f007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:54.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.562+0000 7f90f84cd640 1 -- 172.21.15.63:0/226287774 shutdown_connections 2024-09-21T06:36:54.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.562+0000 7f90f84cd640 1 -- 172.21.15.63:0/226287774 wait complete. 2024-09-21T06:36:54.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.563+0000 7f90f84cd640 1 Processor -- start 2024-09-21T06:36:54.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.563+0000 7f90f84cd640 1 -- start start 2024-09-21T06:36:54.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.563+0000 7f90f84cd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90f0103b60 0x7f90f019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.563+0000 7f90f84cd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90f01094a0 0x7f90f019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.563+0000 7f90f84cd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90f0109df0 0x7f90f019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.563+0000 7f90f84cd640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f90f0113b30 con 0x7f90f0109df0 2024-09-21T06:36:54.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.563+0000 7f90f84cd640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f90f01139b0 con 0x7f90f01094a0 2024-09-21T06:36:54.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.563+0000 7f90f84cd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f90f0113cb0 con 0x7f90f0103b60 2024-09-21T06:36:54.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.563+0000 7f90f6a6a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90f0109df0 0x7f90f019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.563+0000 7f90f6a6a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90f0109df0 0x7f90f019fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57546/0 (socket says 172.21.15.63:57546) 2024-09-21T06:36:54.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.563+0000 7f90f6a6a640 1 -- 172.21.15.63:0/1725701438 learned_addr learned my addr 172.21.15.63:0/1725701438 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:54.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.563+0000 7f90f6269640 1 --2- 172.21.15.63:0/1725701438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90f0103b60 0x7f90f019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.564+0000 7f90f5a68640 1 --2- 172.21.15.63:0/1725701438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90f01094a0 0x7f90f019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.564+0000 7f90f6a6a640 1 -- 172.21.15.63:0/1725701438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90f0103b60 msgr2=0x7f90f019a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:54.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.564+0000 7f90f6a6a640 1 --2- 172.21.15.63:0/1725701438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90f0103b60 0x7f90f019a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.564+0000 7f90f6a6a640 1 -- 172.21.15.63:0/1725701438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90f01094a0 msgr2=0x7f90f019aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:54.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.564+0000 7f90f6a6a640 1 --2- 172.21.15.63:0/1725701438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90f01094a0 0x7f90f019aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.564+0000 7f90f6a6a640 1 -- 172.21.15.63:0/1725701438 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f01a0490 con 0x7f90f0109df0 2024-09-21T06:36:54.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.564+0000 7f90f5a68640 1 --2- 172.21.15.63:0/1725701438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90f01094a0 0x7f90f019aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:54.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.564+0000 7f90f6a6a640 1 --2- 172.21.15.63:0/1725701438 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90f0109df0 0x7f90f019fd60 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f90e800b970 tx=0x7f90e800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:54.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.564+0000 7f90e77fe640 1 -- 172.21.15.63:0/1725701438 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e8019070 con 0x7f90f0109df0 2024-09-21T06:36:54.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.564+0000 7f90e77fe640 1 -- 172.21.15.63:0/1725701438 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90e8014440 con 0x7f90f0109df0 2024-09-21T06:36:54.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.564+0000 7f90f84cd640 1 -- 172.21.15.63:0/1725701438 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90f01a0780 con 0x7f90f0109df0 2024-09-21T06:36:54.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.564+0000 7f90e77fe640 1 -- 172.21.15.63:0/1725701438 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e80075d0 con 0x7f90f0109df0 2024-09-21T06:36:54.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.564+0000 7f90f84cd640 1 -- 172.21.15.63:0/1725701438 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90f01a6ee0 con 0x7f90f0109df0 2024-09-21T06:36:54.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.567+0000 7f90fea41740 1 Processor -- start 2024-09-21T06:36:54.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.567+0000 7f90e77fe640 1 -- 172.21.15.63:0/1725701438 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f90e801c070 con 0x7f90f0109df0 2024-09-21T06:36:54.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.567+0000 7f90fea41740 1 -- start start 2024-09-21T06:36:54.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.567+0000 7f90fea41740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565551e98070 0x56555223f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.567+0000 7f90fea41740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565551e6f1b0 0x56555223fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.567+0000 7f90fea41740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e77390 0x5655522400d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.567+0000 7f90fea41740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5655521b5e50 con 0x565551e77390 2024-09-21T06:36:54.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.567+0000 7f90fea41740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5655521a5280 con 0x565551e98070 2024-09-21T06:36:54.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.567+0000 7f90fea41740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5655521a9090 con 0x565551e6f1b0 2024-09-21T06:36:54.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.568+0000 7f90f5a68640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e77390 0x5655522400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.568+0000 7f90f5a68640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e77390 0x5655522400d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57562/0 (socket says 172.21.15.63:57562) 2024-09-21T06:36:54.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.568+0000 7f90f5a68640 1 -- 172.21.15.63:0/1227312479 learned_addr learned my addr 172.21.15.63:0/1227312479 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:54.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.568+0000 7f90f6269640 1 --2- 172.21.15.63:0/1227312479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565551e6f1b0 0x56555223fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.568+0000 7f90f5a68640 1 --2- 172.21.15.63:0/1227312479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565551e98070 0x56555223f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.568+0000 7f90e77fe640 1 --2- 172.21.15.63:0/1725701438 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f90dc0b6700 0x7f90dc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.568+0000 7f90f5a68640 1 -- 172.21.15.63:0/1227312479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565551e6f1b0 msgr2=0x56555223fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:54.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.568+0000 7f90f5a68640 1 --2- 172.21.15.63:0/1227312479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565551e6f1b0 0x56555223fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.568+0000 7f90f5a68640 1 -- 172.21.15.63:0/1227312479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565551e98070 msgr2=0x56555223f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:54.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.568+0000 7f90f5a68640 1 --2- 172.21.15.63:0/1227312479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565551e98070 0x56555223f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.568+0000 7f90f5a68640 1 -- 172.21.15.63:0/1227312479 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565551f03650 con 0x565551e77390 2024-09-21T06:36:54.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.568+0000 7f90e77fe640 1 -- 172.21.15.63:0/1725701438 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7f90e80e6be0 con 0x7f90f0109df0 2024-09-21T06:36:54.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.568+0000 7f90f6a6a640 1 --2- 172.21.15.63:0/1725701438 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f90dc0b6700 0x7f90dc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.568+0000 7f90f5a68640 1 --2- 172.21.15.63:0/1227312479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e77390 0x5655522400d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f90e0012540 tx=0x7f90e000b440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3083eec0094ff890 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:54.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.569+0000 7f90e4ff9640 1 -- 172.21.15.63:0/1227312479 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e0004020 con 0x565551e77390 2024-09-21T06:36:54.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.569+0000 7f90e4ff9640 1 -- 172.21.15.63:0/1227312479 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90e0010bb0 con 0x565551e77390 2024-09-21T06:36:54.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.569+0000 7f90e4ff9640 1 -- 172.21.15.63:0/1227312479 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e00038a0 con 0x565551e77390 2024-09-21T06:36:54.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.570+0000 7f90fea41740 1 -- 172.21.15.63:0/1227312479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e77390 msgr2=0x5655522400d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:54.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.570+0000 7f90f6a6a640 1 --2- 172.21.15.63:0/1725701438 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f90dc0b6700 0x7f90dc0b8c10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f90e80ac790 tx=0x7f90e8004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:54.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.570+0000 7f90fea41740 1 --2- 172.21.15.63:0/1227312479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e77390 0x5655522400d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f90e0012540 tx=0x7f90e000b440 comp rx=0 tx=0).stop 2024-09-21T06:36:54.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.570+0000 7f90fea41740 1 -- 172.21.15.63:0/1227312479 shutdown_connections 2024-09-21T06:36:54.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.570+0000 7f90fea41740 1 --2- 172.21.15.63:0/1227312479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e77390 0x5655522400d0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.570+0000 7f90fea41740 1 --2- 172.21.15.63:0/1227312479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565551e6f1b0 0x56555223fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.570+0000 7f90fea41740 1 --2- 172.21.15.63:0/1227312479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565551e98070 0x56555223f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.570+0000 7f90fea41740 1 -- 172.21.15.63:0/1227312479 >> 172.21.15.63:0/1227312479 conn(0x565551e8c460 msgr2=0x56555223d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:54.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.570+0000 7f90fea41740 1 -- 172.21.15.63:0/1227312479 shutdown_connections 2024-09-21T06:36:54.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.570+0000 7f90fea41740 1 -- 172.21.15.63:0/1227312479 wait complete. 2024-09-21T06:36:54.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.570+0000 7f90fea41740 1 -- start start 2024-09-21T06:36:54.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.570+0000 7f90fea41740 1 Processor -- start 2024-09-21T06:36:54.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.571+0000 7f90fea41740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565551e6f1b0 0x56555224ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.571+0000 7f90fea41740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565551e77390 0x56555224b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.571+0000 7f90fea41740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e98070 0x56555224b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.571+0000 7f90fea41740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x565552006700 con 0x565551e98070 2024-09-21T06:36:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.571+0000 7f90fea41740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x565552140110 con 0x565551e6f1b0 2024-09-21T06:36:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.571+0000 7f90fea41740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56555224de30 con 0x565551e77390 2024-09-21T06:36:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.571+0000 7f90fea41740 10 client.0 _ll_register_callbacks cb 0x565552159990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.571+0000 7f90f5a68640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e98070 0x56555224b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.571+0000 7f90f5a68640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e98070 0x56555224b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57576/0 (socket says 172.21.15.63:57576) 2024-09-21T06:36:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.571+0000 7f90f5a68640 1 -- 172.21.15.63:0/3377404937 learned_addr learned my addr 172.21.15.63:0/3377404937 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.571+0000 7f90f5a68640 1 --2- 172.21.15.63:0/3377404937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565551e6f1b0 0x56555224ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.571+0000 7f90f6269640 1 --2- 172.21.15.63:0/3377404937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565551e77390 0x56555224b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.571+0000 7f90f5a68640 1 -- 172.21.15.63:0/3377404937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565551e77390 msgr2=0x56555224b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:54.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.571+0000 7f90f5a68640 1 --2- 172.21.15.63:0/3377404937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565551e77390 0x56555224b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.571+0000 7f90f5a68640 1 -- 172.21.15.63:0/3377404937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565551e6f1b0 msgr2=0x56555224ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:54.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.571+0000 7f90f5a68640 1 --2- 172.21.15.63:0/3377404937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565551e6f1b0 0x56555224ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.571+0000 7f90f5a68640 1 -- 172.21.15.63:0/3377404937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56555216dc40 con 0x565551e98070 2024-09-21T06:36:54.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.571+0000 7f90f5a68640 1 --2- 172.21.15.63:0/3377404937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e98070 0x56555224b710 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x565552241f70 tx=0x7f90e0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe020b7c788f5b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:54.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.571+0000 7f90d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:54.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.572+0000 7f90d9ffb640 1 -- 172.21.15.63:0/3377404937 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e0021020 con 0x565551e98070 2024-09-21T06:36:54.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.572+0000 7f90d9ffb640 1 -- 172.21.15.63:0/3377404937 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7f90e0010900 con 0x565551e98070 2024-09-21T06:36:54.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.572+0000 7f90fea41740 1 -- 172.21.15.63:0/3377404937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90e0010bb0 con 0x565551e98070 2024-09-21T06:36:54.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.572+0000 7f90d9ffb640 1 -- 172.21.15.63:0/3377404937 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f90e0003a20 con 0x565551e98070 2024-09-21T06:36:54.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.572+0000 7f90fea41740 10 client.17319 fetch_fsmap learned FSMap version 61 2024-09-21T06:36:54.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.572+0000 7f90fea41740 1 -- 172.21.15.63:0/3377404937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x565552259ab0 con 0x565551e98070 2024-09-21T06:36:54.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.572+0000 7f90d9ffb640 1 -- 172.21.15.63:0/3377404937 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90e0010bb0 con 0x565551e98070 2024-09-21T06:36:54.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.572+0000 7f90d9ffb640 1 -- 172.21.15.63:0/3377404937 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f90e00046c0 con 0x565551e98070 2024-09-21T06:36:54.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.572+0000 7f90fea41740 10 client.17319 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:36:54.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.572+0000 7f90fea41740 10 client.17319 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:36:54.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.572+0000 7f90fea41740 20 client.17319 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:54.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.572+0000 7f90fea41740 1 --2- 172.21.15.63:0/3377404937 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x565551e569f0 0x56555225cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.572+0000 7f90fea41740 4 client.17319 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:54.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.572+0000 7f90fea41740 1 -- 172.21.15.63:0/3377404937 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5655521b7da0 con 0x565551e569f0 2024-09-21T06:36:54.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.573+0000 7f90f6269640 1 --2- 172.21.15.63:0/3377404937 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x565551e569f0 0x56555225cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.573+0000 7f90d9ffb640 10 client.17319 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:54.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.573+0000 7f90f6269640 1 --2- 172.21.15.63:0/3377404937 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x565551e569f0 0x56555225cec0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2a6ec788f45cf5e server_cookie=e7725b826be5fad in_seq=0 out_seq=0 2024-09-21T06:36:54.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.574+0000 7f90d9ffb640 1 -- 172.21.15.63:0/3377404937 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5655521b7da0 con 0x565551e569f0 2024-09-21T06:36:54.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.574+0000 7f90d9ffb640 10 client.17319 handle_command_reply: tid=0 2024-09-21T06:36:54.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.574+0000 7f90fea41740 1 client.17319 shutdown 2024-09-21T06:36:54.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.574+0000 7f90fea41740 1 -- 172.21.15.63:0/3377404937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e98070 msgr2=0x56555224b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:54.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.574+0000 7f90fea41740 1 --2- 172.21.15.63:0/3377404937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e98070 0x56555224b710 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x565552241f70 tx=0x7f90e0001e50 comp rx=0 tx=0).stop 2024-09-21T06:36:54.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.574+0000 7f90fea41740 1 -- 172.21.15.63:0/3377404937 shutdown_connections 2024-09-21T06:36:54.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.574+0000 7f90fea41740 1 --2- 172.21.15.63:0/3377404937 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x565551e569f0 0x56555225cec0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.574+0000 7f90d9ffb640 0 client.17319 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:54.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.574+0000 7f90fea41740 1 --2- 172.21.15.63:0/3377404937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e98070 0x56555224b710 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.574+0000 7f90fea41740 1 --2- 172.21.15.63:0/3377404937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565551e77390 0x56555224b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.574+0000 7f90fea41740 1 --2- 172.21.15.63:0/3377404937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565551e6f1b0 0x56555224ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.574+0000 7f90fea41740 1 -- 172.21.15.63:0/3377404937 >> 172.21.15.63:0/3377404937 conn(0x565551e8c460 msgr2=0x565552242830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:54.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.574+0000 7f90fea41740 1 -- 172.21.15.63:0/3377404937 shutdown_connections 2024-09-21T06:36:54.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.574+0000 7f90fea41740 1 -- 172.21.15.63:0/3377404937 wait complete. 2024-09-21T06:36:54.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.574+0000 7f90fea41740 20 client.17319 trim_cache size 0 max 16384 2024-09-21T06:36:54.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.591+0000 7f90fea41740 1 Processor -- start 2024-09-21T06:36:54.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.592+0000 7f90fea41740 1 -- start start 2024-09-21T06:36:54.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.592+0000 7f90fea41740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565551e569f0 0x565552241040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.592+0000 7f90fea41740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e6f1b0 0x56555224c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.592+0000 7f90fea41740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565551e77390 0x56555223cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.592+0000 7f90fea41740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f90f01af7f0 con 0x565551e6f1b0 2024-09-21T06:36:54.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.592+0000 7f90fea41740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f90f01b1330 con 0x565551e77390 2024-09-21T06:36:54.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.592+0000 7f90fea41740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f90f01afec0 con 0x565551e569f0 2024-09-21T06:36:54.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.592+0000 7f90f6269640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e6f1b0 0x56555224c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.592+0000 7f90f6269640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e6f1b0 0x56555224c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57592/0 (socket says 172.21.15.63:57592) 2024-09-21T06:36:54.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.592+0000 7f90f6269640 1 -- 172.21.15.63:0/3398520888 learned_addr learned my addr 172.21.15.63:0/3398520888 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:54.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.592+0000 7f90f5a68640 1 --2- 172.21.15.63:0/3398520888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565551e77390 0x56555223cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.592+0000 7f90f5a68640 1 --2- 172.21.15.63:0/3398520888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565551e569f0 0x565552241040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.592+0000 7f90f6269640 1 -- 172.21.15.63:0/3398520888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565551e569f0 msgr2=0x565552241040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:54.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.592+0000 7f90f6269640 1 --2- 172.21.15.63:0/3398520888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565551e569f0 0x565552241040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.592+0000 7f90f6269640 1 -- 172.21.15.63:0/3398520888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565551e77390 msgr2=0x56555223cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:54.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.592+0000 7f90f6269640 1 --2- 172.21.15.63:0/3398520888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565551e77390 0x56555223cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.592+0000 7f90f6269640 1 -- 172.21.15.63:0/3398520888 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565552257020 con 0x565551e6f1b0 2024-09-21T06:36:54.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.592+0000 7f90f5a68640 1 --2- 172.21.15.63:0/3398520888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565551e569f0 0x565552241040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:54.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.593+0000 7f90f6269640 1 --2- 172.21.15.63:0/3398520888 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e6f1b0 0x56555224c8a0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f90ec02a930 tx=0x7f90ec009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe190bce4455275 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:54.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.593+0000 7f90dbfff640 1 -- 172.21.15.63:0/3398520888 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec035040 con 0x565551e6f1b0 2024-09-21T06:36:54.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.593+0000 7f90dbfff640 1 -- 172.21.15.63:0/3398520888 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90ec031940 con 0x565551e6f1b0 2024-09-21T06:36:54.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.593+0000 7f90dbfff640 1 -- 172.21.15.63:0/3398520888 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec03c6a0 con 0x565551e6f1b0 2024-09-21T06:36:54.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.593+0000 7f90fea41740 1 -- 172.21.15.63:0/3398520888 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e6f1b0 msgr2=0x56555224c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:54.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.593+0000 7f90fea41740 1 --2- 172.21.15.63:0/3398520888 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e6f1b0 0x56555224c8a0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f90ec02a930 tx=0x7f90ec009260 comp rx=0 tx=0).stop 2024-09-21T06:36:54.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.593+0000 7f90fea41740 1 -- 172.21.15.63:0/3398520888 shutdown_connections 2024-09-21T06:36:54.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.594+0000 7f90fea41740 1 --2- 172.21.15.63:0/3398520888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565551e77390 0x56555223cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.594+0000 7f90fea41740 1 --2- 172.21.15.63:0/3398520888 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e6f1b0 0x56555224c8a0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.594+0000 7f90fea41740 1 --2- 172.21.15.63:0/3398520888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565551e569f0 0x565552241040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.594+0000 7f90fea41740 1 -- 172.21.15.63:0/3398520888 >> 172.21.15.63:0/3398520888 conn(0x565551e8c460 msgr2=0x56555224c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:54.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.594+0000 7f90fea41740 1 -- 172.21.15.63:0/3398520888 shutdown_connections 2024-09-21T06:36:54.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.594+0000 7f90fea41740 1 -- 172.21.15.63:0/3398520888 wait complete. 2024-09-21T06:36:54.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.594+0000 7f90fea41740 1 -- start start 2024-09-21T06:36:54.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.594+0000 7f90fea41740 1 Processor -- start 2024-09-21T06:36:54.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.594+0000 7f90fea41740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e569f0 0x565552253660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.594+0000 7f90fea41740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565551e6f1b0 0x56555224eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.594+0000 7f90fea41740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565551e77390 0x56555224f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.594+0000 7f90fea41740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f90f01b0c60 con 0x565551e569f0 2024-09-21T06:36:54.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.594+0000 7f90fea41740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f90f01b0590 con 0x565551e6f1b0 2024-09-21T06:36:54.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.594+0000 7f90fea41740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f90f01ad7f0 con 0x565551e77390 2024-09-21T06:36:54.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.594+0000 7f90fea41740 10 client.0 _ll_register_callbacks cb 0x7f90ec009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:54.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.594+0000 7f90f5a68640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e569f0 0x565552253660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.595+0000 7f90f5a68640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e569f0 0x565552253660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57608/0 (socket says 172.21.15.63:57608) 2024-09-21T06:36:54.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.595+0000 7f90f5a68640 1 -- 172.21.15.63:0/2212248537 learned_addr learned my addr 172.21.15.63:0/2212248537 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:36:54.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.595+0000 7f90f6269640 1 --2- 172.21.15.63:0/2212248537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565551e6f1b0 0x56555224eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.595+0000 7f90f5a68640 1 -- 172.21.15.63:0/2212248537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565551e77390 msgr2=0x56555224f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:54.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.595+0000 7f90f5a68640 1 --2- 172.21.15.63:0/2212248537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565551e77390 0x56555224f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.595+0000 7f90f5a68640 1 -- 172.21.15.63:0/2212248537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565551e6f1b0 msgr2=0x56555224eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:54.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.595+0000 7f90f5a68640 1 --2- 172.21.15.63:0/2212248537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565551e6f1b0 0x56555224eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.595+0000 7f90f5a68640 1 -- 172.21.15.63:0/2212248537 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56555224f610 con 0x565551e569f0 2024-09-21T06:36:54.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.595+0000 7f90f5a68640 1 --2- 172.21.15.63:0/2212248537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e569f0 0x565552253660 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f90e0004c80 tx=0x7f90e0010c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ebd78349749a892 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:54.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.595+0000 7f90d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:36:54.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.595+0000 7f90d9ffb640 1 -- 172.21.15.63:0/2212248537 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e003b020 con 0x565551e569f0 2024-09-21T06:36:54.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.595+0000 7f90d9ffb640 1 -- 172.21.15.63:0/2212248537 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8593+0+0 (secure 0 0 0) 0x7f90e0003ef0 con 0x565551e569f0 2024-09-21T06:36:54.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.595+0000 7f90fea41740 1 -- 172.21.15.63:0/2212248537 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90ec031940 con 0x565551e569f0 2024-09-21T06:36:54.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.595+0000 7f90d9ffb640 1 -- 172.21.15.63:0/2212248537 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f90e0046050 con 0x565551e569f0 2024-09-21T06:36:54.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.595+0000 7f90fea41740 10 client.17325 fetch_fsmap learned FSMap version 61 2024-09-21T06:36:54.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.595+0000 7f90fea41740 1 -- 172.21.15.63:0/2212248537 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x5655522c7420 con 0x565551e569f0 2024-09-21T06:36:54.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.596+0000 7f90d9ffb640 1 -- 172.21.15.63:0/2212248537 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90ec031940 con 0x565551e569f0 2024-09-21T06:36:54.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.596+0000 7f90d9ffb640 1 -- 172.21.15.63:0/2212248537 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f90e00051b0 con 0x565551e569f0 2024-09-21T06:36:54.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.596+0000 7f90fea41740 10 client.17325 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:36:54.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.596+0000 7f90fea41740 10 client.17325 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:36:54.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.596+0000 7f90fea41740 20 client.17325 populate_metadata read hostname 'smithi063' 2024-09-21T06:36:54.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.596+0000 7f90fea41740 1 --2- 172.21.15.63:0/2212248537 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x565551e98070 0x5655522c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.596+0000 7f90fea41740 4 client.17325 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:36:54.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.596+0000 7f90fea41740 1 -- 172.21.15.63:0/2212248537 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5655521b3850 con 0x565551e98070 2024-09-21T06:36:54.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.596+0000 7f90f6269640 1 --2- 172.21.15.63:0/2212248537 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x565551e98070 0x5655522c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.596+0000 7f90d9ffb640 10 client.17325 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:54.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.596+0000 7f90f6269640 1 --2- 172.21.15.63:0/2212248537 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x565551e98070 0x5655522c9bb0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b8a30582cb1ae2c server_cookie=c2288d8960295c3f in_seq=0 out_seq=0 2024-09-21T06:36:54.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.597+0000 7f90d9ffb640 1 -- 172.21.15.63:0/2212248537 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x5655521b3850 con 0x565551e98070 2024-09-21T06:36:54.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.597+0000 7f90d9ffb640 10 client.17325 handle_command_reply: tid=0 2024-09-21T06:36:54.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.597+0000 7f90fea41740 1 client.17325 shutdown 2024-09-21T06:36:54.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.597+0000 7f90fea41740 1 -- 172.21.15.63:0/2212248537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e569f0 msgr2=0x565552253660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:54.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.597+0000 7f90fea41740 1 --2- 172.21.15.63:0/2212248537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e569f0 0x565552253660 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f90e0004c80 tx=0x7f90e0010c40 comp rx=0 tx=0).stop 2024-09-21T06:36:54.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.597+0000 7f90fea41740 1 -- 172.21.15.63:0/2212248537 shutdown_connections 2024-09-21T06:36:54.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.597+0000 7f90fea41740 1 --2- 172.21.15.63:0/2212248537 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x565551e98070 0x5655522c9bb0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.597+0000 7f90fea41740 1 --2- 172.21.15.63:0/2212248537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565551e77390 0x56555224f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.597+0000 7f90fea41740 1 --2- 172.21.15.63:0/2212248537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x565551e6f1b0 0x56555224eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.597+0000 7f90d9ffb640 0 client.17325 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:36:54.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.597+0000 7f90fea41740 1 --2- 172.21.15.63:0/2212248537 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x565551e569f0 0x565552253660 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.597+0000 7f90fea41740 1 -- 172.21.15.63:0/2212248537 >> 172.21.15.63:0/2212248537 conn(0x565551e8c460 msgr2=0x565552240dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:54.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.597+0000 7f90fea41740 1 -- 172.21.15.63:0/2212248537 shutdown_connections 2024-09-21T06:36:54.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.597+0000 7f90fea41740 1 -- 172.21.15.63:0/2212248537 wait complete. 2024-09-21T06:36:54.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.597+0000 7f90fea41740 20 client.17325 trim_cache size 0 max 16384 2024-09-21T06:36:54.605 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:36:54.605 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:36:54.605 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": { 2024-09-21T06:36:54.606 INFO:teuthology.orchestra.run.smithi063.stdout: "9ad8f980-759b-4f0b-a3d4-e748a05e78b0": { 2024-09-21T06:36:54.606 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:54.606 INFO:teuthology.orchestra.run.smithi063.stdout: "tag": "9ad8f980-759b-4f0b-a3d4-e748a05e78b0", 2024-09-21T06:36:54.606 INFO:teuthology.orchestra.run.smithi063.stdout: "options": "recursive,force" 2024-09-21T06:36:54.606 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:36:54.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:54.606 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:36:54.606 INFO:teuthology.orchestra.run.smithi063.stdout: "9ad8f980-759b-4f0b-a3d4-e748a05e78b0": { 2024-09-21T06:36:54.606 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:36:53.116490+0000", 2024-09-21T06:36:54.606 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:54.606 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:54.606 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:54.607 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:54.607 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:54.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:54.607 INFO:teuthology.orchestra.run.smithi063.stdout: "0c926bc7-90f8-47ce-a0d2-d02e676a73e9": { 2024-09-21T06:36:54.607 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:35:22.494015+0000", 2024-09-21T06:36:54.607 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:54.607 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:54.607 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:54.607 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:54.607 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:54.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:54.607 INFO:teuthology.orchestra.run.smithi063.stdout: "4f099144-5170-453b-a745-ddc222860f34": { 2024-09-21T06:36:54.608 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:34:35.417817+0000", 2024-09-21T06:36:54.608 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:54.608 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:54.608 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:54.608 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:54.608 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:54.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:54.608 INFO:teuthology.orchestra.run.smithi063.stdout: "91ae0a75-6a3f-452f-8bda-0f19862a5724": { 2024-09-21T06:36:54.608 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:50.316590+0000", 2024-09-21T06:36:54.608 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:54.608 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:54.608 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:54.609 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:54.609 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:54.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:54.609 INFO:teuthology.orchestra.run.smithi063.stdout: "5396028b-35f4-48fe-b54d-385784e97de3": { 2024-09-21T06:36:54.609 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:04.523378+0000", 2024-09-21T06:36:54.609 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:54.609 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:54.609 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:54.609 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:54.609 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:54.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:54.609 INFO:teuthology.orchestra.run.smithi063.stdout: "1b9cca6e-2b23-49b2-a894-182a1054bc02": { 2024-09-21T06:36:54.609 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:36:07.545253+0000", 2024-09-21T06:36:54.610 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:54.610 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:54.610 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:54.610 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:54.610 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:54.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:54.610 INFO:teuthology.orchestra.run.smithi063.stdout: "024d3c59-0b67-49a9-bf4a-e02d36691942": { 2024-09-21T06:36:54.610 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:32:14.282244+0000", 2024-09-21T06:36:54.610 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:54.610 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:54.610 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:54.610 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:54.611 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:54.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:54.611 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:36:54.611 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:31:27.507051+0000", 2024-09-21T06:36:54.611 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:54.611 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:54.611 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:54.611 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:54.611 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:54.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:36:54.611 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:36:54.611 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:36:54.612 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:36:54.612 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:36:54.612 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:36:54.612 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:36:54.612 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:36:54.612 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:36:54.612 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:36:54.612 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:36:54.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.598+0000 7f90f84cd640 1 -- 172.21.15.63:0/1725701438 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f90dc0b6700 msgr2=0x7f90dc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:54.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.598+0000 7f90f84cd640 1 --2- 172.21.15.63:0/1725701438 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f90dc0b6700 0x7f90dc0b8c10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f90e80ac790 tx=0x7f90e8004a40 comp rx=0 tx=0).stop 2024-09-21T06:36:54.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.598+0000 7f90f84cd640 1 -- 172.21.15.63:0/1725701438 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90f0109df0 msgr2=0x7f90f019fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:54.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.598+0000 7f90f84cd640 1 --2- 172.21.15.63:0/1725701438 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90f0109df0 0x7f90f019fd60 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f90e800b970 tx=0x7f90e800be30 comp rx=0 tx=0).stop 2024-09-21T06:36:54.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.598+0000 7f90f84cd640 1 -- 172.21.15.63:0/1725701438 shutdown_connections 2024-09-21T06:36:54.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.598+0000 7f90f84cd640 1 --2- 172.21.15.63:0/1725701438 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90f0109df0 0x7f90f019fd60 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.598+0000 7f90f84cd640 1 --2- 172.21.15.63:0/1725701438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90f01094a0 0x7f90f019aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.598+0000 7f90f84cd640 1 --2- 172.21.15.63:0/1725701438 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f90dc0b6700 0x7f90dc0b8c10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.598+0000 7f90f84cd640 1 --2- 172.21.15.63:0/1725701438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90f0103b60 0x7f90f019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.598+0000 7f90f84cd640 1 -- 172.21.15.63:0/1725701438 >> 172.21.15.63:0/1725701438 conn(0x7f90f007b850 msgr2=0x7f90f0107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:54.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.598+0000 7f90f84cd640 1 -- 172.21.15.63:0/1725701438 shutdown_connections 2024-09-21T06:36:54.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:36:54.598+0000 7f90f84cd640 1 -- 172.21.15.63:0/1725701438 wait complete. 2024-09-21T06:36:54.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:54 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:36:54.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:54 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:54.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:54 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:36:54.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:54 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:54.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:54 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:36:54.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:54 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:55.261 INFO:tasks.cephfs.filesystem:scrub status for tag:9ad8f980-759b-4f0b-a3d4-e748a05e78b0 - {'path': '/', 'tag': '9ad8f980-759b-4f0b-a3d4-e748a05e78b0', 'options': 'recursive,force'} 2024-09-21T06:36:55.533 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:55 smithi063 ceph-mon[31150]: pgmap v588: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-21T06:36:55.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:55 smithi071 ceph-mon[34844]: pgmap v588: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-21T06:36:55.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:55 smithi175 ceph-mon[34510]: pgmap v588: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-21T06:36:57.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:57 smithi071 ceph-mon[34844]: pgmap v589: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 11 op/s 2024-09-21T06:36:57.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:57 smithi063 ceph-mon[31150]: pgmap v589: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 11 op/s 2024-09-21T06:36:57.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:57 smithi175 ceph-mon[34510]: pgmap v589: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 11 op/s 2024-09-21T06:36:58.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:58 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:36:58.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:58 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:36:58.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:58 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:36:59.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:59 smithi071 ceph-mon[34844]: pgmap v590: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-21T06:36:59.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:36:59 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:36:59.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:59 smithi063 ceph-mon[31150]: pgmap v590: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-21T06:36:59.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:36:59 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:36:59.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:59 smithi175 ceph-mon[34510]: pgmap v590: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-21T06:36:59.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:36:59 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:37:01.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:01 smithi071 ceph-mon[34844]: pgmap v591: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T06:37:01.833 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:01 smithi063 ceph-mon[31150]: pgmap v591: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T06:37:01.850 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:01 smithi175 ceph-mon[34510]: pgmap v591: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T06:37:03.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:03 smithi071 ceph-mon[34844]: pgmap v592: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-21T06:37:03.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:03 smithi063 ceph-mon[31150]: pgmap v592: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-21T06:37:03.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:03 smithi175 ceph-mon[34510]: pgmap v592: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-21T06:37:05.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:04 smithi071 ceph-mon[34844]: pgmap v593: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T06:37:05.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:04 smithi063 ceph-mon[31150]: pgmap v593: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T06:37:05.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:04 smithi175 ceph-mon[34510]: pgmap v593: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T06:37:07.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:07 smithi071 ceph-mon[34844]: pgmap v594: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-21T06:37:07.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:07 smithi063 ceph-mon[31150]: pgmap v594: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-21T06:37:07.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:07 smithi175 ceph-mon[34510]: pgmap v594: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-21T06:37:09.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:09 smithi071 ceph-mon[34844]: pgmap v595: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T06:37:09.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:09 smithi063 ceph-mon[31150]: pgmap v595: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T06:37:09.598 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:09 smithi175 ceph-mon[34510]: pgmap v595: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T06:37:10.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:10 smithi071 ceph-mon[34844]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T06:37:10.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:10 smithi063 ceph-mon[31150]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T06:37:10.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:10 smithi175 ceph-mon[34510]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T06:37:11.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:11 smithi071 ceph-mon[34844]: pgmap v597: 97 pgs: 4 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 89 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:37:11.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:11 smithi063 ceph-mon[31150]: pgmap v597: 97 pgs: 4 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 89 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:37:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:11 smithi175 ceph-mon[34510]: pgmap v597: 97 pgs: 4 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 89 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:37:13.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:13 smithi071 ceph-mon[34844]: pgmap v598: 97 pgs: 9 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 82 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:37:13.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:13 smithi063 ceph-mon[31150]: pgmap v598: 97 pgs: 9 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 82 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:37:13.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:13 smithi175 ceph-mon[34510]: pgmap v598: 97 pgs: 9 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 82 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:37:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:15 smithi071 ceph-mon[34844]: pgmap v599: 97 pgs: 9 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 82 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:37:15.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:15 smithi063 ceph-mon[31150]: pgmap v599: 97 pgs: 9 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 82 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:37:15.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:15 smithi175 ceph-mon[34510]: pgmap v599: 97 pgs: 9 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 82 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:37:17.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:17 smithi071 ceph-mon[34844]: pgmap v600: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:37:17.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:17 smithi063 ceph-mon[31150]: pgmap v600: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:37:17.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:17 smithi175 ceph-mon[34510]: pgmap v600: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:37:19.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:19 smithi071 ceph-mon[34844]: pgmap v601: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:37:19.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:19 smithi071 ceph-mon[34844]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T06:37:19.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:19 smithi063 ceph-mon[31150]: pgmap v601: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:37:19.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:19 smithi063 ceph-mon[31150]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T06:37:19.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:19 smithi175 ceph-mon[34510]: pgmap v601: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:37:19.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:19 smithi175 ceph-mon[34510]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T06:37:21.401 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:21 smithi175 ceph-mon[34510]: pgmap v603: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:37:21.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:21 smithi071 ceph-mon[34844]: pgmap v603: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:37:21.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:21 smithi063 ceph-mon[31150]: pgmap v603: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:37:23.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:23 smithi071 ceph-mon[34844]: pgmap v604: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:37:23.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:23 smithi063 ceph-mon[31150]: pgmap v604: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:37:23.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:23 smithi175 ceph-mon[34510]: pgmap v604: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:37:25.263 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:37:25.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:25 smithi071 ceph-mon[34844]: pgmap v605: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:37:25.539 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:25.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:25 smithi063 ceph-mon[31150]: pgmap v605: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:37:25.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:25 smithi175 ceph-mon[34510]: pgmap v605: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:37:26.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.048+0000 7f64b8744640 1 -- 172.21.15.63:0/3342070885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64b0109e10 msgr2=0x7f64b0110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.048+0000 7f64b8744640 1 --2- 172.21.15.63:0/3342070885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64b0109e10 0x7f64b0110640 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f64a8009ca0 tx=0x7f64a802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.048+0000 7f64b8744640 1 -- 172.21.15.63:0/3342070885 shutdown_connections 2024-09-21T06:37:26.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.048+0000 7f64b8744640 1 --2- 172.21.15.63:0/3342070885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64b0109e10 0x7f64b0110640 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.048+0000 7f64b8744640 1 --2- 172.21.15.63:0/3342070885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64b01094c0 0x7f64b01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.048+0000 7f64b8744640 1 --2- 172.21.15.63:0/3342070885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64b0103b80 0x7f64b0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.048+0000 7f64b8744640 1 -- 172.21.15.63:0/3342070885 >> 172.21.15.63:0/3342070885 conn(0x7f64b00ff610 msgr2=0x7f64b0101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:26.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.048+0000 7f64b8744640 1 -- 172.21.15.63:0/3342070885 shutdown_connections 2024-09-21T06:37:26.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.048+0000 7f64b8744640 1 -- 172.21.15.63:0/3342070885 wait complete. 2024-09-21T06:37:26.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.048+0000 7f64b8744640 1 Processor -- start 2024-09-21T06:37:26.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.049+0000 7f64b8744640 1 -- start start 2024-09-21T06:37:26.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.049+0000 7f64b8744640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64b0103b80 0x7f64b019c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.049+0000 7f64b8744640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64b01094c0 0x7f64b019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.049+0000 7f64b8744640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64b0109e10 0x7f64b01a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.049+0000 7f64b8744640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f64b0113ad0 con 0x7f64b0109e10 2024-09-21T06:37:26.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.049+0000 7f64b8744640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f64b0113950 con 0x7f64b01094c0 2024-09-21T06:37:26.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.049+0000 7f64b8744640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f64b0113c50 con 0x7f64b0103b80 2024-09-21T06:37:26.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.049+0000 7f64b6ce1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64b0109e10 0x7f64b01a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.049+0000 7f64b6ce1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64b0109e10 0x7f64b01a1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39298/0 (socket says 172.21.15.63:39298) 2024-09-21T06:37:26.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.049+0000 7f64b6ce1640 1 -- 172.21.15.63:0/3195044155 learned_addr learned my addr 172.21.15.63:0/3195044155 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:26.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.049+0000 7f64b5cdf640 1 --2- 172.21.15.63:0/3195044155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64b01094c0 0x7f64b019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.049+0000 7f64b64e0640 1 --2- 172.21.15.63:0/3195044155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64b0103b80 0x7f64b019c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.049+0000 7f64b6ce1640 1 -- 172.21.15.63:0/3195044155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64b0103b80 msgr2=0x7f64b019c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.049+0000 7f64b6ce1640 1 --2- 172.21.15.63:0/3195044155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64b0103b80 0x7f64b019c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.049+0000 7f64b6ce1640 1 -- 172.21.15.63:0/3195044155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64b01094c0 msgr2=0x7f64b019cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.049+0000 7f64b6ce1640 1 --2- 172.21.15.63:0/3195044155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64b01094c0 0x7f64b019cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.049+0000 7f64b6ce1640 1 -- 172.21.15.63:0/3195044155 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b01a25d0 con 0x7f64b0109e10 2024-09-21T06:37:26.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.049+0000 7f64b5cdf640 1 --2- 172.21.15.63:0/3195044155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64b01094c0 0x7f64b019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:26.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.049+0000 7f64b64e0640 1 --2- 172.21.15.63:0/3195044155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64b0103b80 0x7f64b019c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:26.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.050+0000 7f64b6ce1640 1 --2- 172.21.15.63:0/3195044155 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64b0109e10 0x7f64b01a1ea0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f64a80098d0 tx=0x7f64a80317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:26.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.050+0000 7f64a77fe640 1 -- 172.21.15.63:0/3195044155 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a8003b70 con 0x7f64b0109e10 2024-09-21T06:37:26.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.050+0000 7f64b8744640 1 -- 172.21.15.63:0/3195044155 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b01a2860 con 0x7f64b0109e10 2024-09-21T06:37:26.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.050+0000 7f64a77fe640 1 -- 172.21.15.63:0/3195044155 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64a8003d10 con 0x7f64b0109e10 2024-09-21T06:37:26.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.050+0000 7f64a77fe640 1 -- 172.21.15.63:0/3195044155 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a802fa20 con 0x7f64b0109e10 2024-09-21T06:37:26.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.050+0000 7f64b8744640 1 -- 172.21.15.63:0/3195044155 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b01a9020 con 0x7f64b0109e10 2024-09-21T06:37:26.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.053+0000 7f64becb8740 1 Processor -- start 2024-09-21T06:37:26.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.054+0000 7f64a77fe640 1 -- 172.21.15.63:0/3195044155 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f64a802fc40 con 0x7f64b0109e10 2024-09-21T06:37:26.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.054+0000 7f64becb8740 1 -- start start 2024-09-21T06:37:26.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.054+0000 7f64becb8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557574310070 0x5575746b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.054+0000 7f64becb8740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742e71b0 0x5575746b7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.054+0000 7f64becb8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742ef390 0x5575746b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.054+0000 7f64becb8740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55757462de50 con 0x5575742e71b0 2024-09-21T06:37:26.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.054+0000 7f64becb8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55757461d280 con 0x5575742ef390 2024-09-21T06:37:26.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.054+0000 7f64becb8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557574621090 con 0x557574310070 2024-09-21T06:37:26.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.055+0000 7f64b64e0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742e71b0 0x5575746b7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.055+0000 7f64b64e0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742e71b0 0x5575746b7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39308/0 (socket says 172.21.15.63:39308) 2024-09-21T06:37:26.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.055+0000 7f64b64e0640 1 -- 172.21.15.63:0/49062963 learned_addr learned my addr 172.21.15.63:0/49062963 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:26.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.055+0000 7f64b5cdf640 1 --2- 172.21.15.63:0/49062963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557574310070 0x5575746b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.055+0000 7f64b5cdf640 1 --2- 172.21.15.63:0/49062963 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742ef390 0x5575746b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.055+0000 7f64b64e0640 1 -- 172.21.15.63:0/49062963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557574310070 msgr2=0x5575746b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.055+0000 7f64b64e0640 1 --2- 172.21.15.63:0/49062963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557574310070 0x5575746b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.055+0000 7f64b64e0640 1 -- 172.21.15.63:0/49062963 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742ef390 msgr2=0x5575746b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.055+0000 7f64b64e0640 1 --2- 172.21.15.63:0/49062963 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742ef390 0x5575746b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.055+0000 7f64b64e0640 1 -- 172.21.15.63:0/49062963 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55757437b650 con 0x5575742e71b0 2024-09-21T06:37:26.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.055+0000 7f64b5cdf640 1 --2- 172.21.15.63:0/49062963 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742ef390 0x5575746b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:26.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.055+0000 7f64a77fe640 1 --2- 172.21.15.63:0/3195044155 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f649c0b6680 0x7f649c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.055+0000 7f64b64e0640 1 --2- 172.21.15.63:0/49062963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742e71b0 0x5575746b7b90 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f64ac00bd40 tx=0x7f64ac00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad5360c9c4e1a30 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:26.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.056+0000 7f64a4ff9640 1 -- 172.21.15.63:0/49062963 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac004220 con 0x5575742e71b0 2024-09-21T06:37:26.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.056+0000 7f64b5cdf640 1 --2- 172.21.15.63:0/3195044155 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f649c0b6680 0x7f649c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.056+0000 7f64a77fe640 1 -- 172.21.15.63:0/3195044155 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7f64a8108af0 con 0x7f64b0109e10 2024-09-21T06:37:26.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.056+0000 7f64a4ff9640 1 -- 172.21.15.63:0/49062963 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64ac00be30 con 0x5575742e71b0 2024-09-21T06:37:26.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.056+0000 7f64a4ff9640 1 -- 172.21.15.63:0/49062963 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac011640 con 0x5575742e71b0 2024-09-21T06:37:26.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.057+0000 7f64becb8740 1 -- 172.21.15.63:0/49062963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742e71b0 msgr2=0x5575746b7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.057+0000 7f64b5cdf640 1 --2- 172.21.15.63:0/3195044155 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f649c0b6680 0x7f649c0b8b90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f64b0109c90 tx=0x7f64a0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:26.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.057+0000 7f64becb8740 1 --2- 172.21.15.63:0/49062963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742e71b0 0x5575746b7b90 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f64ac00bd40 tx=0x7f64ac00f730 comp rx=0 tx=0).stop 2024-09-21T06:37:26.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.057+0000 7f64becb8740 1 -- 172.21.15.63:0/49062963 shutdown_connections 2024-09-21T06:37:26.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.057+0000 7f64becb8740 1 --2- 172.21.15.63:0/49062963 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742ef390 0x5575746b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.057+0000 7f64becb8740 1 --2- 172.21.15.63:0/49062963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742e71b0 0x5575746b7b90 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.057+0000 7f64becb8740 1 --2- 172.21.15.63:0/49062963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557574310070 0x5575746b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.057+0000 7f64becb8740 1 -- 172.21.15.63:0/49062963 >> 172.21.15.63:0/49062963 conn(0x557574304460 msgr2=0x5575746b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:26.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.057+0000 7f64becb8740 1 -- 172.21.15.63:0/49062963 shutdown_connections 2024-09-21T06:37:26.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.057+0000 7f64becb8740 1 -- 172.21.15.63:0/49062963 wait complete. 2024-09-21T06:37:26.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.057+0000 7f64becb8740 1 -- start start 2024-09-21T06:37:26.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.057+0000 7f64becb8740 1 Processor -- start 2024-09-21T06:37:26.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.058+0000 7f64becb8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742e71b0 0x5575746c2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.058+0000 7f64becb8740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ef390 0x5575746c3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.058+0000 7f64becb8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557574310070 0x5575746cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.058+0000 7f64becb8740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55757447e700 con 0x5575742ef390 2024-09-21T06:37:26.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.058+0000 7f64becb8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5575745b8110 con 0x5575742e71b0 2024-09-21T06:37:26.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.058+0000 7f64becb8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5575746c5e30 con 0x557574310070 2024-09-21T06:37:26.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.058+0000 7f64b5cdf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ef390 0x5575746c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.058+0000 7f64becb8740 10 client.0 _ll_register_callbacks cb 0x5575745d1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:26.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.058+0000 7f64b5cdf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ef390 0x5575746c3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39314/0 (socket says 172.21.15.63:39314) 2024-09-21T06:37:26.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.058+0000 7f64b5cdf640 1 -- 172.21.15.63:0/402505841 learned_addr learned my addr 172.21.15.63:0/402505841 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:26.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.058+0000 7f64b64e0640 1 --2- 172.21.15.63:0/402505841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742e71b0 0x5575746c2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.058+0000 7f64b6ce1640 1 --2- 172.21.15.63:0/402505841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557574310070 0x5575746cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.058+0000 7f64b5cdf640 1 -- 172.21.15.63:0/402505841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557574310070 msgr2=0x5575746cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.058+0000 7f64b5cdf640 1 --2- 172.21.15.63:0/402505841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557574310070 0x5575746cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.058+0000 7f64b5cdf640 1 -- 172.21.15.63:0/402505841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742e71b0 msgr2=0x5575746c2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.058+0000 7f64b5cdf640 1 --2- 172.21.15.63:0/402505841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742e71b0 0x5575746c2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.058+0000 7f64b5cdf640 1 -- 172.21.15.63:0/402505841 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575745e5c40 con 0x5575742ef390 2024-09-21T06:37:26.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.058+0000 7f64b64e0640 1 --2- 172.21.15.63:0/402505841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742e71b0 0x5575746c2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:26.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.059+0000 7f64b5cdf640 1 --2- 172.21.15.63:0/402505841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ef390 0x5575746c3250 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f64a0010c20 tx=0x7f64a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e17e7f98e9e6d33 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:26.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.059+0000 7f6499ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:37:26.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.059+0000 7f6499ffb640 1 -- 172.21.15.63:0/402505841 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a0025070 con 0x5575742ef390 2024-09-21T06:37:26.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.059+0000 7f6499ffb640 1 -- 172.21.15.63:0/402505841 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7f64a002a460 con 0x5575742ef390 2024-09-21T06:37:26.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.059+0000 7f64becb8740 1 -- 172.21.15.63:0/402505841 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64ac00be30 con 0x5575742ef390 2024-09-21T06:37:26.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.059+0000 7f6499ffb640 1 -- 172.21.15.63:0/402505841 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f64a0010e60 con 0x5575742ef390 2024-09-21T06:37:26.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.059+0000 7f64becb8740 10 client.17337 fetch_fsmap learned FSMap version 61 2024-09-21T06:37:26.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.059+0000 7f64becb8740 1 -- 172.21.15.63:0/402505841 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x5575746d1b70 con 0x5575742ef390 2024-09-21T06:37:26.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.059+0000 7f6499ffb640 1 -- 172.21.15.63:0/402505841 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64a000ee80 con 0x5575742ef390 2024-09-21T06:37:26.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.060+0000 7f6499ffb640 1 -- 172.21.15.63:0/402505841 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f64a0021800 con 0x5575742ef390 2024-09-21T06:37:26.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.060+0000 7f64becb8740 10 client.17337 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:37:26.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.060+0000 7f64becb8740 10 client.17337 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:37:26.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.060+0000 7f64becb8740 20 client.17337 populate_metadata read hostname 'smithi063' 2024-09-21T06:37:26.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.060+0000 7f64becb8740 1 --2- 172.21.15.63:0/402505841 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5575742ce9f0 0x5575746d50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.060+0000 7f64becb8740 4 client.17337 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:26.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.060+0000 7f64becb8740 1 -- 172.21.15.63:0/402505841 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f64ac00be30 con 0x5575742ce9f0 2024-09-21T06:37:26.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.060+0000 7f64b64e0640 1 --2- 172.21.15.63:0/402505841 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5575742ce9f0 0x5575746d50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.061+0000 7f6499ffb640 10 client.17337 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:37:26.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.061+0000 7f64b64e0640 1 --2- 172.21.15.63:0/402505841 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5575742ce9f0 0x5575746d50d0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3d09bc13a04d6aa server_cookie=16b26bb2dcb013ad in_seq=0 out_seq=0 2024-09-21T06:37:26.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.061+0000 7f6499ffb640 1 -- 172.21.15.63:0/402505841 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f64ac00be30 con 0x5575742ce9f0 2024-09-21T06:37:26.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.061+0000 7f6499ffb640 10 client.17337 handle_command_reply: tid=0 2024-09-21T06:37:26.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.061+0000 7f64becb8740 1 client.17337 shutdown 2024-09-21T06:37:26.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.062+0000 7f64becb8740 1 -- 172.21.15.63:0/402505841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ef390 msgr2=0x5575746c3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.062+0000 7f64becb8740 1 --2- 172.21.15.63:0/402505841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ef390 0x5575746c3250 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f64a0010c20 tx=0x7f64a00046c0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.062+0000 7f64becb8740 1 -- 172.21.15.63:0/402505841 shutdown_connections 2024-09-21T06:37:26.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.062+0000 7f64becb8740 1 --2- 172.21.15.63:0/402505841 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5575742ce9f0 0x5575746d50d0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.062+0000 7f64becb8740 1 --2- 172.21.15.63:0/402505841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557574310070 0x5575746cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.062+0000 7f64becb8740 1 --2- 172.21.15.63:0/402505841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ef390 0x5575746c3250 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.062+0000 7f6499ffb640 0 client.17337 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:37:26.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.062+0000 7f64becb8740 1 --2- 172.21.15.63:0/402505841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742e71b0 0x5575746c2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.062+0000 7f64becb8740 1 -- 172.21.15.63:0/402505841 >> 172.21.15.63:0/402505841 conn(0x557574304460 msgr2=0x5575746ba7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:26.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.062+0000 7f64becb8740 1 -- 172.21.15.63:0/402505841 shutdown_connections 2024-09-21T06:37:26.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.062+0000 7f64becb8740 1 -- 172.21.15.63:0/402505841 wait complete. 2024-09-21T06:37:26.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.062+0000 7f64becb8740 20 client.17337 trim_cache size 0 max 16384 2024-09-21T06:37:26.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.079+0000 7f64becb8740 1 Processor -- start 2024-09-21T06:37:26.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.079+0000 7f64becb8740 1 -- start start 2024-09-21T06:37:26.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.080+0000 7f64becb8740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ce9f0 0x5575746c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.080+0000 7f64becb8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575742e71b0 0x5575746b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.080+0000 7f64becb8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742ef390 0x5575746b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.080+0000 7f64becb8740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f64b01b1960 con 0x5575742ce9f0 2024-09-21T06:37:26.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.080+0000 7f64becb8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f64b01b34a0 con 0x5575742ef390 2024-09-21T06:37:26.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.080+0000 7f64becb8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f64b01b2030 con 0x5575742e71b0 2024-09-21T06:37:26.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.080+0000 7f64b64e0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ce9f0 0x5575746c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.080+0000 7f64b64e0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ce9f0 0x5575746c31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39330/0 (socket says 172.21.15.63:39330) 2024-09-21T06:37:26.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.080+0000 7f64b64e0640 1 -- 172.21.15.63:0/778525686 learned_addr learned my addr 172.21.15.63:0/778525686 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:26.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.080+0000 7f64b6ce1640 1 --2- 172.21.15.63:0/778525686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742ef390 0x5575746b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.080+0000 7f64b64e0640 1 -- 172.21.15.63:0/778525686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575742e71b0 msgr2=0x5575746b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.080+0000 7f64b64e0640 1 --2- 172.21.15.63:0/778525686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575742e71b0 0x5575746b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.080+0000 7f64b64e0640 1 -- 172.21.15.63:0/778525686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742ef390 msgr2=0x5575746b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.080+0000 7f64b64e0640 1 --2- 172.21.15.63:0/778525686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742ef390 0x5575746b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.080+0000 7f64b64e0640 1 -- 172.21.15.63:0/778525686 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575746b6300 con 0x5575742ce9f0 2024-09-21T06:37:26.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.080+0000 7f64b64e0640 1 --2- 172.21.15.63:0/778525686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ce9f0 0x5575746c31d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f64ac00bd40 tx=0x7f64ac00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfadda09ded6f6b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:26.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.081+0000 7f649bfff640 1 -- 172.21.15.63:0/778525686 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac0043b0 con 0x5575742ce9f0 2024-09-21T06:37:26.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.081+0000 7f649bfff640 1 -- 172.21.15.63:0/778525686 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64ac0054f0 con 0x5575742ce9f0 2024-09-21T06:37:26.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.081+0000 7f649bfff640 1 -- 172.21.15.63:0/778525686 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac004c40 con 0x5575742ce9f0 2024-09-21T06:37:26.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.081+0000 7f64becb8740 1 -- 172.21.15.63:0/778525686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ce9f0 msgr2=0x5575746c31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.081+0000 7f64becb8740 1 --2- 172.21.15.63:0/778525686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ce9f0 0x5575746c31d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f64ac00bd40 tx=0x7f64ac00b880 comp rx=0 tx=0).stop 2024-09-21T06:37:26.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.082+0000 7f64becb8740 1 -- 172.21.15.63:0/778525686 shutdown_connections 2024-09-21T06:37:26.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.082+0000 7f64becb8740 1 --2- 172.21.15.63:0/778525686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742ef390 0x5575746b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.082+0000 7f64becb8740 1 --2- 172.21.15.63:0/778525686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575742e71b0 0x5575746b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.082+0000 7f64becb8740 1 --2- 172.21.15.63:0/778525686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ce9f0 0x5575746c31d0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.082+0000 7f64becb8740 1 -- 172.21.15.63:0/778525686 >> 172.21.15.63:0/778525686 conn(0x557574304460 msgr2=0x5575746c2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:26.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.082+0000 7f64becb8740 1 -- 172.21.15.63:0/778525686 shutdown_connections 2024-09-21T06:37:26.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.082+0000 7f64becb8740 1 -- 172.21.15.63:0/778525686 wait complete. 2024-09-21T06:37:26.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.082+0000 7f64becb8740 1 -- start start 2024-09-21T06:37:26.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.082+0000 7f64becb8740 1 Processor -- start 2024-09-21T06:37:26.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.082+0000 7f64becb8740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ce9f0 0x5575746c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.082+0000 7f64becb8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742e71b0 0x5575746c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.082+0000 7f64becb8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575742ef390 0x55757473ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.083+0000 7f64becb8740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f64b01b2dd0 con 0x5575742ce9f0 2024-09-21T06:37:26.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.083+0000 7f64becb8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f64b01b2700 con 0x5575742e71b0 2024-09-21T06:37:26.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.083+0000 7f64becb8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f64b01af960 con 0x5575742ef390 2024-09-21T06:37:26.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.083+0000 7f64b64e0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ce9f0 0x5575746c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.083+0000 7f64becb8740 10 client.0 _ll_register_callbacks cb 0x7f64a0009c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:26.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.083+0000 7f64b64e0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ce9f0 0x5575746c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39346/0 (socket says 172.21.15.63:39346) 2024-09-21T06:37:26.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.083+0000 7f64b64e0640 1 -- 172.21.15.63:0/2210002614 learned_addr learned my addr 172.21.15.63:0/2210002614 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:26.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.083+0000 7f64b5cdf640 1 --2- 172.21.15.63:0/2210002614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742e71b0 0x5575746c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.083+0000 7f64b6ce1640 1 --2- 172.21.15.63:0/2210002614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575742ef390 0x55757473ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.083+0000 7f64b64e0640 1 -- 172.21.15.63:0/2210002614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575742ef390 msgr2=0x55757473ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.083+0000 7f64b64e0640 1 --2- 172.21.15.63:0/2210002614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575742ef390 0x55757473ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.083+0000 7f64b64e0640 1 -- 172.21.15.63:0/2210002614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742e71b0 msgr2=0x5575746c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.083+0000 7f64b64e0640 1 --2- 172.21.15.63:0/2210002614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742e71b0 0x5575746c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.083+0000 7f64b64e0640 1 -- 172.21.15.63:0/2210002614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55757473f010 con 0x5575742ce9f0 2024-09-21T06:37:26.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.083+0000 7f64b6ce1640 1 --2- 172.21.15.63:0/2210002614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575742ef390 0x55757473ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:26.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.083+0000 7f64b64e0640 1 --2- 172.21.15.63:0/2210002614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ce9f0 0x5575746c7460 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f64ac004920 tx=0x7f64ac00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcea2644ed4b06b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:26.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.083+0000 7f6499ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:37:26.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.083+0000 7f6499ffb640 1 -- 172.21.15.63:0/2210002614 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac03d020 con 0x5575742ce9f0 2024-09-21T06:37:26.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.083+0000 7f6499ffb640 1 -- 172.21.15.63:0/2210002614 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7f64ac0035f0 con 0x5575742ce9f0 2024-09-21T06:37:26.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.083+0000 7f64becb8740 1 -- 172.21.15.63:0/2210002614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64ac0054f0 con 0x5575742ce9f0 2024-09-21T06:37:26.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.084+0000 7f6499ffb640 1 -- 172.21.15.63:0/2210002614 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f64ac048050 con 0x5575742ce9f0 2024-09-21T06:37:26.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.084+0000 7f64becb8740 10 client.17343 fetch_fsmap learned FSMap version 61 2024-09-21T06:37:26.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.084+0000 7f64becb8740 1 -- 172.21.15.63:0/2210002614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x557574740140 con 0x5575742ce9f0 2024-09-21T06:37:26.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.084+0000 7f6499ffb640 1 -- 172.21.15.63:0/2210002614 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64ac0054f0 con 0x5575742ce9f0 2024-09-21T06:37:26.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.084+0000 7f6499ffb640 1 -- 172.21.15.63:0/2210002614 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f64ac004c30 con 0x5575742ce9f0 2024-09-21T06:37:26.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.084+0000 7f64becb8740 10 client.17343 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:37:26.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.084+0000 7f64becb8740 10 client.17343 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:37:26.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.084+0000 7f64becb8740 20 client.17343 populate_metadata read hostname 'smithi063' 2024-09-21T06:37:26.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.084+0000 7f64becb8740 1 --2- 172.21.15.63:0/2210002614 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x557574310070 0x5575747426a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.084+0000 7f64becb8740 4 client.17343 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:37:26.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.084+0000 7f64becb8740 1 -- 172.21.15.63:0/2210002614 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55757462fda0 con 0x557574310070 2024-09-21T06:37:26.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.084+0000 7f64b5cdf640 1 --2- 172.21.15.63:0/2210002614 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x557574310070 0x5575747426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.085+0000 7f6499ffb640 10 client.17343 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:37:26.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.085+0000 7f64b5cdf640 1 --2- 172.21.15.63:0/2210002614 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x557574310070 0x5575747426a0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c90583b7ee0299e0 server_cookie=7c10c7a6f305f2c7 in_seq=0 out_seq=0 2024-09-21T06:37:26.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.085+0000 7f6499ffb640 1 -- 172.21.15.63:0/2210002614 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x55757462fda0 con 0x557574310070 2024-09-21T06:37:26.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.085+0000 7f6499ffb640 10 client.17343 handle_command_reply: tid=0 2024-09-21T06:37:26.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.085+0000 7f64becb8740 1 client.17343 shutdown 2024-09-21T06:37:26.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.085+0000 7f64becb8740 1 -- 172.21.15.63:0/2210002614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ce9f0 msgr2=0x5575746c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.085+0000 7f64becb8740 1 --2- 172.21.15.63:0/2210002614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ce9f0 0x5575746c7460 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f64ac004920 tx=0x7f64ac00b480 comp rx=0 tx=0).stop 2024-09-21T06:37:26.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.085+0000 7f64becb8740 1 -- 172.21.15.63:0/2210002614 shutdown_connections 2024-09-21T06:37:26.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.085+0000 7f64becb8740 1 --2- 172.21.15.63:0/2210002614 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x557574310070 0x5575747426a0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.085+0000 7f64becb8740 1 --2- 172.21.15.63:0/2210002614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575742ef390 0x55757473ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.085+0000 7f64becb8740 1 --2- 172.21.15.63:0/2210002614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5575742e71b0 0x5575746c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.085+0000 7f64becb8740 1 --2- 172.21.15.63:0/2210002614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5575742ce9f0 0x5575746c7460 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.085+0000 7f64becb8740 1 -- 172.21.15.63:0/2210002614 >> 172.21.15.63:0/2210002614 conn(0x557574304460 msgr2=0x5575746b8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:26.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.085+0000 7f6499ffb640 0 client.17343 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:37:26.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.085+0000 7f64becb8740 1 -- 172.21.15.63:0/2210002614 shutdown_connections 2024-09-21T06:37:26.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.085+0000 7f64becb8740 1 -- 172.21.15.63:0/2210002614 wait complete. 2024-09-21T06:37:26.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.086+0000 7f64becb8740 20 client.17343 trim_cache size 0 max 16384 2024-09-21T06:37:26.092 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:37:26.092 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "no active scrubs running", 2024-09-21T06:37:26.092 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": {}, 2024-09-21T06:37:26.092 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:37:26.092 INFO:teuthology.orchestra.run.smithi063.stdout: "9ad8f980-759b-4f0b-a3d4-e748a05e78b0": { 2024-09-21T06:37:26.092 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:36:53.116490+0000", 2024-09-21T06:37:26.092 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:37:26.092 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:37:26.092 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:37:26.092 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:37:26.093 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:37:26.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:37:26.093 INFO:teuthology.orchestra.run.smithi063.stdout: "0c926bc7-90f8-47ce-a0d2-d02e676a73e9": { 2024-09-21T06:37:26.093 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:35:22.494015+0000", 2024-09-21T06:37:26.093 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:37:26.093 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:37:26.093 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:37:26.093 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:37:26.093 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:37:26.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:37:26.093 INFO:teuthology.orchestra.run.smithi063.stdout: "4f099144-5170-453b-a745-ddc222860f34": { 2024-09-21T06:37:26.093 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:34:35.417817+0000", 2024-09-21T06:37:26.093 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:37:26.093 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:37:26.094 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:37:26.094 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:37:26.094 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:37:26.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:37:26.094 INFO:teuthology.orchestra.run.smithi063.stdout: "91ae0a75-6a3f-452f-8bda-0f19862a5724": { 2024-09-21T06:37:26.094 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:50.316590+0000", 2024-09-21T06:37:26.094 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:37:26.094 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:37:26.094 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:37:26.094 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:37:26.094 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:37:26.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:37:26.094 INFO:teuthology.orchestra.run.smithi063.stdout: "5396028b-35f4-48fe-b54d-385784e97de3": { 2024-09-21T06:37:26.094 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:04.523378+0000", 2024-09-21T06:37:26.095 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:37:26.095 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:37:26.095 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:37:26.095 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:37:26.095 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:37:26.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:37:26.095 INFO:teuthology.orchestra.run.smithi063.stdout: "1b9cca6e-2b23-49b2-a894-182a1054bc02": { 2024-09-21T06:37:26.095 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:36:07.545253+0000", 2024-09-21T06:37:26.095 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:37:26.095 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:37:26.095 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:37:26.095 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:37:26.095 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:37:26.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:37:26.095 INFO:teuthology.orchestra.run.smithi063.stdout: "024d3c59-0b67-49a9-bf4a-e02d36691942": { 2024-09-21T06:37:26.096 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:32:14.282244+0000", 2024-09-21T06:37:26.096 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:37:26.096 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:37:26.096 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:37:26.096 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:37:26.096 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:37:26.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:37:26.096 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:37:26.096 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:31:27.507051+0000", 2024-09-21T06:37:26.096 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:37:26.096 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:37:26.096 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:37:26.096 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:37:26.096 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:37:26.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:37:26.096 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:37:26.097 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:37:26.097 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:37:26.097 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:37:26.097 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:37:26.097 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:37:26.097 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:37:26.097 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:37:26.097 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:37:26.097 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:37:26.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.086+0000 7f64b8744640 1 -- 172.21.15.63:0/3195044155 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f649c0b6680 msgr2=0x7f649c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.086+0000 7f64b8744640 1 --2- 172.21.15.63:0/3195044155 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f649c0b6680 0x7f649c0b8b90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f64b0109c90 tx=0x7f64a0005f90 comp rx=0 tx=0).stop 2024-09-21T06:37:26.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.086+0000 7f64b8744640 1 -- 172.21.15.63:0/3195044155 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64b0109e10 msgr2=0x7f64b01a1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.086+0000 7f64b8744640 1 --2- 172.21.15.63:0/3195044155 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64b0109e10 0x7f64b01a1ea0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f64a80098d0 tx=0x7f64a80317b0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.086+0000 7f64b8744640 1 -- 172.21.15.63:0/3195044155 shutdown_connections 2024-09-21T06:37:26.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.086+0000 7f64b8744640 1 --2- 172.21.15.63:0/3195044155 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64b0109e10 0x7f64b01a1ea0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.086+0000 7f64b8744640 1 --2- 172.21.15.63:0/3195044155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64b01094c0 0x7f64b019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.086+0000 7f64b8744640 1 --2- 172.21.15.63:0/3195044155 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f649c0b6680 0x7f649c0b8b90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.086+0000 7f64b8744640 1 --2- 172.21.15.63:0/3195044155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64b0103b80 0x7f64b019c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.086+0000 7f64b8744640 1 -- 172.21.15.63:0/3195044155 >> 172.21.15.63:0/3195044155 conn(0x7f64b00ff610 msgr2=0x7f64b0108ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:26.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.086+0000 7f64b8744640 1 -- 172.21.15.63:0/3195044155 shutdown_connections 2024-09-21T06:37:26.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:26.086+0000 7f64b8744640 1 -- 172.21.15.63:0/3195044155 wait complete. 2024-09-21T06:37:26.871 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:37:26.871 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:37:27.137 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:27.421 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:27 smithi063 ceph-mon[31150]: pgmap v606: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:37:27.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:27 smithi071 ceph-mon[34844]: pgmap v606: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:37:27.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:27 smithi175 ceph-mon[34510]: pgmap v606: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:37:27.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.680+0000 7fb30d612640 1 -- 172.21.15.63:0/2319387601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb308108d00 msgr2=0x7fb30810f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:27.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.680+0000 7fb30d612640 1 --2- 172.21.15.63:0/2319387601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb308108d00 0x7fb30810f530 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb300009ca0 tx=0x7fb30002c790 comp rx=0 tx=0).stop 2024-09-21T06:37:27.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.680+0000 7fb30d612640 1 -- 172.21.15.63:0/2319387601 shutdown_connections 2024-09-21T06:37:27.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.680+0000 7fb30d612640 1 --2- 172.21.15.63:0/2319387601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb308108d00 0x7fb30810f530 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:27.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.680+0000 7fb30d612640 1 --2- 172.21.15.63:0/2319387601 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3081083b0 0x7fb3081087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:27.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.680+0000 7fb30d612640 1 --2- 172.21.15.63:0/2319387601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb308102a70 0x7fb308102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:27.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.680+0000 7fb30d612640 1 -- 172.21.15.63:0/2319387601 >> 172.21.15.63:0/2319387601 conn(0x7fb308079730 msgr2=0x7fb308079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:27.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.680+0000 7fb30d612640 1 -- 172.21.15.63:0/2319387601 shutdown_connections 2024-09-21T06:37:27.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.680+0000 7fb30d612640 1 -- 172.21.15.63:0/2319387601 wait complete. 2024-09-21T06:37:27.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.681+0000 7fb30d612640 1 Processor -- start 2024-09-21T06:37:27.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.681+0000 7fb30d612640 1 -- start start 2024-09-21T06:37:27.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.682+0000 7fb30d612640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb308102a70 0x7fb308198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:27.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.682+0000 7fb30d612640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3081083b0 0x7fb308198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:27.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.682+0000 7fb30d612640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb308108d00 0x7fb30819d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:27.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.682+0000 7fb30d612640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb308111870 con 0x7fb308102a70 2024-09-21T06:37:27.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.682+0000 7fb30d612640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081116f0 con 0x7fb308108d00 2024-09-21T06:37:27.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.682+0000 7fb30d612640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081119f0 con 0x7fb3081083b0 2024-09-21T06:37:27.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.682+0000 7fb306ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb308102a70 0x7fb308198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:27.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.682+0000 7fb306ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb308102a70 0x7fb308198180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58366/0 (socket says 172.21.15.63:58366) 2024-09-21T06:37:27.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.682+0000 7fb306ffd640 1 -- 172.21.15.63:0/557342705 learned_addr learned my addr 172.21.15.63:0/557342705 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:27.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.682+0000 7fb3067fc640 1 --2- 172.21.15.63:0/557342705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3081083b0 0x7fb308198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:27.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.682+0000 7fb3077fe640 1 --2- 172.21.15.63:0/557342705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb308108d00 0x7fb30819d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:27.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.682+0000 7fb306ffd640 1 -- 172.21.15.63:0/557342705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3081083b0 msgr2=0x7fb308198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:27.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.682+0000 7fb306ffd640 1 --2- 172.21.15.63:0/557342705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3081083b0 0x7fb308198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:27.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.682+0000 7fb306ffd640 1 -- 172.21.15.63:0/557342705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb308108d00 msgr2=0x7fb30819d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:27.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.682+0000 7fb306ffd640 1 --2- 172.21.15.63:0/557342705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb308108d00 0x7fb30819d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:27.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.682+0000 7fb306ffd640 1 -- 172.21.15.63:0/557342705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30819e030 con 0x7fb308102a70 2024-09-21T06:37:27.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.682+0000 7fb306ffd640 1 --2- 172.21.15.63:0/557342705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb308102a70 0x7fb308198180 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800c920 tx=0x7fb2f800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:27.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.683+0000 7fb2effff640 1 -- 172.21.15.63:0/557342705 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8007c70 con 0x7fb308102a70 2024-09-21T06:37:27.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.683+0000 7fb30d612640 1 -- 172.21.15.63:0/557342705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb30819e320 con 0x7fb308102a70 2024-09-21T06:37:27.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.683+0000 7fb2effff640 1 -- 172.21.15.63:0/557342705 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2f8007e10 con 0x7fb308102a70 2024-09-21T06:37:27.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.683+0000 7fb2effff640 1 -- 172.21.15.63:0/557342705 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8018820 con 0x7fb308102a70 2024-09-21T06:37:27.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.683+0000 7fb30d612640 1 -- 172.21.15.63:0/557342705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3081a4b40 con 0x7fb308102a70 2024-09-21T06:37:27.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.684+0000 7fb30d612640 1 -- 172.21.15.63:0/557342705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb308102e80 con 0x7fb308102a70 2024-09-21T06:37:27.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.685+0000 7fb2effff640 1 -- 172.21.15.63:0/557342705 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fb2f800f450 con 0x7fb308102a70 2024-09-21T06:37:27.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.686+0000 7fb2effff640 1 --2- 172.21.15.63:0/557342705 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb2f00b66b0 0x7fb2f00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:27.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.686+0000 7fb3067fc640 1 --2- 172.21.15.63:0/557342705 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb2f00b66b0 0x7fb2f00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:27.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.686+0000 7fb2effff640 1 -- 172.21.15.63:0/557342705 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7fb2f80e7960 con 0x7fb308102a70 2024-09-21T06:37:27.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.687+0000 7fb3067fc640 1 --2- 172.21.15.63:0/557342705 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb2f00b66b0 0x7fb2f00b8bc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc005e10 tx=0x7fb2fc005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:27.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.690+0000 7fb2effff640 1 -- 172.21.15.63:0/557342705 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb2f8014030 con 0x7fb308102a70 2024-09-21T06:37:27.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.915+0000 7fb30d612640 1 -- 172.21.15.63:0/557342705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3081992b0 con 0x7fb308102a70 2024-09-21T06:37:27.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.916+0000 7fb2effff640 1 -- 172.21.15.63:0/557342705 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+11971 (secure 0 0 0) 0x7fb2f80ade60 con 0x7fb308102a70 2024-09-21T06:37:27.918 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:37:27.918 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":61,"btime":"2024-09-21T06:36:33:430596+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":61,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:36:32.513212+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24659,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":34,"state":"up:active","state_seq":69,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25637":{"gid":25637,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3354670524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3354670524},{"type":"v1","addr":"172.21.15.71:6839","nonce":3354670524}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24659,"qdb_cluster":[24694,24670,24659,24676,14835]},"id":1}]} 2024-09-21T06:37:27.918 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 61 2024-09-21T06:37:27.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.918+0000 7fb30d612640 1 -- 172.21.15.63:0/557342705 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb2f00b66b0 msgr2=0x7fb2f00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:27.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.918+0000 7fb30d612640 1 --2- 172.21.15.63:0/557342705 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb2f00b66b0 0x7fb2f00b8bc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc005e10 tx=0x7fb2fc005da0 comp rx=0 tx=0).stop 2024-09-21T06:37:27.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.918+0000 7fb30d612640 1 -- 172.21.15.63:0/557342705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb308102a70 msgr2=0x7fb308198180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:27.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.918+0000 7fb30d612640 1 --2- 172.21.15.63:0/557342705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb308102a70 0x7fb308198180 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800c920 tx=0x7fb2f800cde0 comp rx=0 tx=0).stop 2024-09-21T06:37:27.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.918+0000 7fb30d612640 1 -- 172.21.15.63:0/557342705 shutdown_connections 2024-09-21T06:37:27.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.918+0000 7fb30d612640 1 --2- 172.21.15.63:0/557342705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb308108d00 0x7fb30819d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:27.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.918+0000 7fb30d612640 1 --2- 172.21.15.63:0/557342705 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fb2f00b66b0 0x7fb2f00b8bc0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:27.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.918+0000 7fb30d612640 1 --2- 172.21.15.63:0/557342705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3081083b0 0x7fb308198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:27.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.918+0000 7fb30d612640 1 --2- 172.21.15.63:0/557342705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb308102a70 0x7fb308198180 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:27.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.918+0000 7fb30d612640 1 -- 172.21.15.63:0/557342705 >> 172.21.15.63:0/557342705 conn(0x7fb308079730 msgr2=0x7fb308104320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:27.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.918+0000 7fb30d612640 1 -- 172.21.15.63:0/557342705 shutdown_connections 2024-09-21T06:37:27.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:27.919+0000 7fb30d612640 1 -- 172.21.15.63:0/557342705 wait complete. 2024-09-21T06:37:28.292 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:28 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/557342705' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:37:28.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:28 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/557342705' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:37:28.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:28 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/557342705' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:37:28.606 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T06:37:28.865 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:29.289 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:29 smithi063 ceph-mon[31150]: pgmap v607: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T06:37:29.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.380+0000 7fe3e9fd8640 1 -- 172.21.15.63:0/4169057993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3e4102a60 msgr2=0x7fe3e4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:29.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.380+0000 7fe3e9fd8640 1 --2- 172.21.15.63:0/4169057993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3e4102a60 0x7fe3e4102e70 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4009900 tx=0x7fe3d402a410 comp rx=0 tx=0).stop 2024-09-21T06:37:29.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.380+0000 7fe3e9fd8640 1 -- 172.21.15.63:0/4169057993 shutdown_connections 2024-09-21T06:37:29.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.380+0000 7fe3e9fd8640 1 --2- 172.21.15.63:0/4169057993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3e4108cf0 0x7fe3e410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.380+0000 7fe3e9fd8640 1 --2- 172.21.15.63:0/4169057993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3e41083a0 0x7fe3e41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.380+0000 7fe3e9fd8640 1 --2- 172.21.15.63:0/4169057993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3e4102a60 0x7fe3e4102e70 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.380+0000 7fe3e9fd8640 1 -- 172.21.15.63:0/4169057993 >> 172.21.15.63:0/4169057993 conn(0x7fe3e4079730 msgr2=0x7fe3e4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:29.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.380+0000 7fe3e9fd8640 1 -- 172.21.15.63:0/4169057993 shutdown_connections 2024-09-21T06:37:29.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.380+0000 7fe3e9fd8640 1 -- 172.21.15.63:0/4169057993 wait complete. 2024-09-21T06:37:29.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.381+0000 7fe3e9fd8640 1 Processor -- start 2024-09-21T06:37:29.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.381+0000 7fe3e9fd8640 1 -- start start 2024-09-21T06:37:29.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.382+0000 7fe3e9fd8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3e4102a60 0x7fe3e419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.382+0000 7fe3e9fd8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3e41083a0 0x7fe3e419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.382+0000 7fe3e9fd8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3e4108cf0 0x7fe3e419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.382+0000 7fe3e9fd8640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e4113a80 con 0x7fe3e4108cf0 2024-09-21T06:37:29.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.382+0000 7fe3e9fd8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e4113900 con 0x7fe3e4102a60 2024-09-21T06:37:29.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.382+0000 7fe3e9fd8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e4113c00 con 0x7fe3e41083a0 2024-09-21T06:37:29.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.382+0000 7fe3e3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3e4108cf0 0x7fe3e419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.382+0000 7fe3e3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3e4108cf0 0x7fe3e419fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58382/0 (socket says 172.21.15.63:58382) 2024-09-21T06:37:29.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.382+0000 7fe3e3fff640 1 -- 172.21.15.63:0/2026002682 learned_addr learned my addr 172.21.15.63:0/2026002682 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:29.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.382+0000 7fe3e2ffd640 1 --2- 172.21.15.63:0/2026002682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3e41083a0 0x7fe3e419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.382+0000 7fe3e37fe640 1 --2- 172.21.15.63:0/2026002682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3e4102a60 0x7fe3e419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.382+0000 7fe3e3fff640 1 -- 172.21.15.63:0/2026002682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3e41083a0 msgr2=0x7fe3e419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:29.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.382+0000 7fe3e3fff640 1 --2- 172.21.15.63:0/2026002682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3e41083a0 0x7fe3e419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.382+0000 7fe3e3fff640 1 -- 172.21.15.63:0/2026002682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3e4102a60 msgr2=0x7fe3e419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:29.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.382+0000 7fe3e3fff640 1 --2- 172.21.15.63:0/2026002682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3e4102a60 0x7fe3e419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.382+0000 7fe3e3fff640 1 -- 172.21.15.63:0/2026002682 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e41a0400 con 0x7fe3e4108cf0 2024-09-21T06:37:29.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.382+0000 7fe3e37fe640 1 --2- 172.21.15.63:0/2026002682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3e4102a60 0x7fe3e419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:29.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.382+0000 7fe3e2ffd640 1 --2- 172.21.15.63:0/2026002682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3e41083a0 0x7fe3e419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:29.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.382+0000 7fe3e3fff640 1 --2- 172.21.15.63:0/2026002682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3e4108cf0 0x7fe3e419fcd0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009fd0 tx=0x7fe3dc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:29.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.383+0000 7fe3e0ff9640 1 -- 172.21.15.63:0/2026002682 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc017070 con 0x7fe3e4108cf0 2024-09-21T06:37:29.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.383+0000 7fe3e9fd8640 1 -- 172.21.15.63:0/2026002682 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e41a06f0 con 0x7fe3e4108cf0 2024-09-21T06:37:29.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.383+0000 7fe3e0ff9640 1 -- 172.21.15.63:0/2026002682 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3dc003e20 con 0x7fe3e4108cf0 2024-09-21T06:37:29.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.383+0000 7fe3e0ff9640 1 -- 172.21.15.63:0/2026002682 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc010460 con 0x7fe3e4108cf0 2024-09-21T06:37:29.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.383+0000 7fe3e9fd8640 1 -- 172.21.15.63:0/2026002682 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e41a6e50 con 0x7fe3e4108cf0 2024-09-21T06:37:29.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.385+0000 7fe3f054c740 1 Processor -- start 2024-09-21T06:37:29.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.386+0000 7fe3e0ff9640 1 -- 172.21.15.63:0/2026002682 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fe3dc003970 con 0x7fe3e4108cf0 2024-09-21T06:37:29.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.386+0000 7fe3f054c740 1 -- start start 2024-09-21T06:37:29.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.386+0000 7fe3f054c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a71070 0x557dc0e182c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.386+0000 7fe3f054c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a481b0 0x557dc0e18800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.386+0000 7fe3f054c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dc0a50390 0x557dc0e18d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.386+0000 7fe3f054c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x557dc0d8eea0 con 0x557dc0a481b0 2024-09-21T06:37:29.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.386+0000 7fe3f054c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557dc0d7e2d0 con 0x557dc0a71070 2024-09-21T06:37:29.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.386+0000 7fe3f054c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557dc0d820e0 con 0x557dc0a50390 2024-09-21T06:37:29.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.386+0000 7fe3e37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a481b0 0x557dc0e18800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.386+0000 7fe3e37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a481b0 0x557dc0e18800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58388/0 (socket says 172.21.15.63:58388) 2024-09-21T06:37:29.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.386+0000 7fe3e37fe640 1 -- 172.21.15.63:0/3272934615 learned_addr learned my addr 172.21.15.63:0/3272934615 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:29.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.386+0000 7fe3e2ffd640 1 --2- 172.21.15.63:0/3272934615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a71070 0x557dc0e182c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.387+0000 7fe3e37fe640 1 -- 172.21.15.63:0/3272934615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dc0a50390 msgr2=0x557dc0e18d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:29.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.387+0000 7fe3e37fe640 1 --2- 172.21.15.63:0/3272934615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dc0a50390 0x557dc0e18d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.387+0000 7fe3e37fe640 1 -- 172.21.15.63:0/3272934615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a71070 msgr2=0x557dc0e182c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:29.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.387+0000 7fe3e37fe640 1 --2- 172.21.15.63:0/3272934615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a71070 0x557dc0e182c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.387+0000 7fe3e37fe640 1 -- 172.21.15.63:0/3272934615 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dc0adc650 con 0x557dc0a481b0 2024-09-21T06:37:29.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.387+0000 7fe3e2ffd640 1 --2- 172.21.15.63:0/3272934615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a71070 0x557dc0e182c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:29.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.387+0000 7fe3e0ff9640 1 --2- 172.21.15.63:0/2026002682 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe3d00b6680 0x7fe3d00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.387+0000 7fe3e37fe640 1 --2- 172.21.15.63:0/3272934615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a481b0 0x557dc0e18800 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4009900 tx=0x7fe3d4032e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a440aeac95a11c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:29.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.387+0000 7fe3e2ffd640 1 --2- 172.21.15.63:0/2026002682 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe3d00b6680 0x7fe3d00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.387+0000 7fe3e0ff9640 1 -- 172.21.15.63:0/2026002682 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7fe3dc0e75a0 con 0x7fe3e4108cf0 2024-09-21T06:37:29.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.387+0000 7fe3d9ffb640 1 -- 172.21.15.63:0/3272934615 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d403f070 con 0x557dc0a481b0 2024-09-21T06:37:29.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.387+0000 7fe3d9ffb640 1 -- 172.21.15.63:0/3272934615 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3d40316a0 con 0x557dc0a481b0 2024-09-21T06:37:29.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.387+0000 7fe3d9ffb640 1 -- 172.21.15.63:0/3272934615 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4035070 con 0x557dc0a481b0 2024-09-21T06:37:29.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.388+0000 7fe3f054c740 1 -- 172.21.15.63:0/3272934615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a481b0 msgr2=0x557dc0e18800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:29.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.388+0000 7fe3f054c740 1 --2- 172.21.15.63:0/3272934615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a481b0 0x557dc0e18800 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4009900 tx=0x7fe3d4032e70 comp rx=0 tx=0).stop 2024-09-21T06:37:29.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.388+0000 7fe3e2ffd640 1 --2- 172.21.15.63:0/2026002682 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe3d00b6680 0x7fe3d00b8b90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc005fd0 tx=0x7fe3cc00c600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:29.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.388+0000 7fe3f054c740 1 -- 172.21.15.63:0/3272934615 shutdown_connections 2024-09-21T06:37:29.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.388+0000 7fe3f054c740 1 --2- 172.21.15.63:0/3272934615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dc0a50390 0x557dc0e18d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.388+0000 7fe3f054c740 1 --2- 172.21.15.63:0/3272934615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a481b0 0x557dc0e18800 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.388+0000 7fe3f054c740 1 --2- 172.21.15.63:0/3272934615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a71070 0x557dc0e182c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.388+0000 7fe3f054c740 1 -- 172.21.15.63:0/3272934615 >> 172.21.15.63:0/3272934615 conn(0x557dc0a65460 msgr2=0x557dc0e161b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:29.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.388+0000 7fe3f054c740 1 -- 172.21.15.63:0/3272934615 shutdown_connections 2024-09-21T06:37:29.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.388+0000 7fe3f054c740 1 -- 172.21.15.63:0/3272934615 wait complete. 2024-09-21T06:37:29.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.388+0000 7fe3f054c740 1 -- start start 2024-09-21T06:37:29.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.389+0000 7fe3f054c740 1 Processor -- start 2024-09-21T06:37:29.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.389+0000 7fe3f054c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a481b0 0x557dc0e27d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.389+0000 7fe3f054c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dc0a50390 0x557dc0e282d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.389+0000 7fe3f054c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a71070 0x557dc0e34100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.389+0000 7fe3f054c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x557dc0bdf700 con 0x557dc0a481b0 2024-09-21T06:37:29.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.389+0000 7fe3f054c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557dc0d19160 con 0x557dc0a71070 2024-09-21T06:37:29.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.389+0000 7fe3f054c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557dc0e2ada0 con 0x557dc0a50390 2024-09-21T06:37:29.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.389+0000 7fe3f054c740 10 client.0 _ll_register_callbacks cb 0x557dc0d329e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:29.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.389+0000 7fe3e37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a481b0 0x557dc0e27d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.389+0000 7fe3e37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a481b0 0x557dc0e27d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58404/0 (socket says 172.21.15.63:58404) 2024-09-21T06:37:29.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.389+0000 7fe3e37fe640 1 -- 172.21.15.63:0/3772527696 learned_addr learned my addr 172.21.15.63:0/3772527696 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:29.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.389+0000 7fe3e2ffd640 1 --2- 172.21.15.63:0/3772527696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dc0a50390 0x557dc0e282d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.389+0000 7fe3e3fff640 1 --2- 172.21.15.63:0/3772527696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a71070 0x557dc0e34100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.390+0000 7fe3e37fe640 1 -- 172.21.15.63:0/3772527696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dc0a50390 msgr2=0x557dc0e282d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:29.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.390+0000 7fe3e37fe640 1 --2- 172.21.15.63:0/3772527696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dc0a50390 0x557dc0e282d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.390+0000 7fe3e37fe640 1 -- 172.21.15.63:0/3772527696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a71070 msgr2=0x557dc0e34100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:29.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.390+0000 7fe3e37fe640 1 --2- 172.21.15.63:0/3772527696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a71070 0x557dc0e34100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.390+0000 7fe3e37fe640 1 -- 172.21.15.63:0/3772527696 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dc0d46c90 con 0x557dc0a481b0 2024-09-21T06:37:29.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.390+0000 7fe3e37fe640 1 --2- 172.21.15.63:0/3772527696 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a481b0 0x557dc0e27d90 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4000c00 tx=0x7fe3d402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f7f1a35c52d8df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:29.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.390+0000 7fe3c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:37:29.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.390+0000 7fe3c2ffd640 1 -- 172.21.15.63:0/3772527696 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d403f040 con 0x557dc0a481b0 2024-09-21T06:37:29.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.390+0000 7fe3c2ffd640 1 -- 172.21.15.63:0/3772527696 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7fe3d4031850 con 0x557dc0a481b0 2024-09-21T06:37:29.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.390+0000 7fe3f054c740 1 -- 172.21.15.63:0/3772527696 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3d40316a0 con 0x557dc0a481b0 2024-09-21T06:37:29.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.390+0000 7fe3c2ffd640 1 -- 172.21.15.63:0/3772527696 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fe3d4035040 con 0x557dc0a481b0 2024-09-21T06:37:29.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.390+0000 7fe3f054c740 10 client.17358 fetch_fsmap learned FSMap version 61 2024-09-21T06:37:29.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.390+0000 7fe3f054c740 1 -- 172.21.15.63:0/3772527696 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x557dc0e36af0 con 0x557dc0a481b0 2024-09-21T06:37:29.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.390+0000 7fe3c2ffd640 1 -- 172.21.15.63:0/3772527696 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3d40316a0 con 0x557dc0a481b0 2024-09-21T06:37:29.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.391+0000 7fe3c2ffd640 1 -- 172.21.15.63:0/3772527696 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fe3d4004330 con 0x557dc0a481b0 2024-09-21T06:37:29.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.391+0000 7fe3f054c740 10 client.17358 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:37:29.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.391+0000 7fe3f054c740 10 client.17358 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:37:29.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.391+0000 7fe3f054c740 20 client.17358 populate_metadata read hostname 'smithi063' 2024-09-21T06:37:29.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.391+0000 7fe3f054c740 1 --2- 172.21.15.63:0/3772527696 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x557dc0a2f9f0 0x557dc0e39e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.391+0000 7fe3f054c740 4 client.17358 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:29.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.391+0000 7fe3f054c740 1 -- 172.21.15.63:0/3772527696 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557dc0d90df0 con 0x557dc0a2f9f0 2024-09-21T06:37:29.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.391+0000 7fe3e2ffd640 1 --2- 172.21.15.63:0/3772527696 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x557dc0a2f9f0 0x557dc0e39e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.391+0000 7fe3c2ffd640 10 client.17358 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:37:29.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.391+0000 7fe3e2ffd640 1 --2- 172.21.15.63:0/3772527696 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x557dc0a2f9f0 0x557dc0e39e50 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=481ed23e9e801224 server_cookie=a782cdccdb21dba0 in_seq=0 out_seq=0 2024-09-21T06:37:29.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.392+0000 7fe3c2ffd640 1 -- 172.21.15.63:0/3772527696 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557dc0d90df0 con 0x557dc0a2f9f0 2024-09-21T06:37:29.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.392+0000 7fe3c2ffd640 10 client.17358 handle_command_reply: tid=0 2024-09-21T06:37:29.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.392+0000 7fe3f054c740 1 client.17358 shutdown 2024-09-21T06:37:29.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.392+0000 7fe3f054c740 1 -- 172.21.15.63:0/3772527696 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a481b0 msgr2=0x557dc0e27d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:29.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.392+0000 7fe3f054c740 1 --2- 172.21.15.63:0/3772527696 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a481b0 0x557dc0e27d90 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4000c00 tx=0x7fe3d402a410 comp rx=0 tx=0).stop 2024-09-21T06:37:29.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.392+0000 7fe3f054c740 1 -- 172.21.15.63:0/3772527696 shutdown_connections 2024-09-21T06:37:29.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.392+0000 7fe3f054c740 1 --2- 172.21.15.63:0/3772527696 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x557dc0a2f9f0 0x557dc0e39e50 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.392+0000 7fe3f054c740 1 --2- 172.21.15.63:0/3772527696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a71070 0x557dc0e34100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.392+0000 7fe3f054c740 1 --2- 172.21.15.63:0/3772527696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dc0a50390 0x557dc0e282d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.392+0000 7fe3f054c740 1 --2- 172.21.15.63:0/3772527696 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a481b0 0x557dc0e27d90 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.392+0000 7fe3c2ffd640 0 client.17358 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:37:29.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.392+0000 7fe3f054c740 1 -- 172.21.15.63:0/3772527696 >> 172.21.15.63:0/3772527696 conn(0x557dc0a65460 msgr2=0x557dc0e19cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:29.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.392+0000 7fe3f054c740 1 -- 172.21.15.63:0/3772527696 shutdown_connections 2024-09-21T06:37:29.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.392+0000 7fe3f054c740 1 -- 172.21.15.63:0/3772527696 wait complete. 2024-09-21T06:37:29.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.393+0000 7fe3f054c740 20 client.17358 trim_cache size 0 max 16384 2024-09-21T06:37:29.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.406+0000 7fe3f054c740 1 Processor -- start 2024-09-21T06:37:29.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.406+0000 7fe3f054c740 1 -- start start 2024-09-21T06:37:29.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.406+0000 7fe3f054c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dc0a481b0 0x557dc0e28250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.406+0000 7fe3f054c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a50390 0x557dc0e24f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.406+0000 7fe3f054c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a71070 0x557dc0e254c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.406+0000 7fe3f054c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e41ad520 con 0x557dc0a71070 2024-09-21T06:37:29.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.406+0000 7fe3f054c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e41af060 con 0x557dc0a50390 2024-09-21T06:37:29.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.406+0000 7fe3f054c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e41adbf0 con 0x557dc0a481b0 2024-09-21T06:37:29.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.406+0000 7fe3e3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a71070 0x557dc0e254c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.406+0000 7fe3e3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a71070 0x557dc0e254c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58418/0 (socket says 172.21.15.63:58418) 2024-09-21T06:37:29.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.406+0000 7fe3e3fff640 1 -- 172.21.15.63:0/3580514934 learned_addr learned my addr 172.21.15.63:0/3580514934 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:29.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.406+0000 7fe3e37fe640 1 --2- 172.21.15.63:0/3580514934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dc0a481b0 0x557dc0e28250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.406+0000 7fe3e2ffd640 1 --2- 172.21.15.63:0/3580514934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a50390 0x557dc0e24f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.407+0000 7fe3e3fff640 1 -- 172.21.15.63:0/3580514934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dc0a481b0 msgr2=0x557dc0e28250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:29.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.407+0000 7fe3e3fff640 1 --2- 172.21.15.63:0/3580514934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dc0a481b0 0x557dc0e28250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.407+0000 7fe3e3fff640 1 -- 172.21.15.63:0/3580514934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a50390 msgr2=0x557dc0e24f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:29.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.407+0000 7fe3e3fff640 1 --2- 172.21.15.63:0/3580514934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a50390 0x557dc0e24f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.407+0000 7fe3e3fff640 1 -- 172.21.15.63:0/3580514934 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dc0e26290 con 0x557dc0a71070 2024-09-21T06:37:29.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.407+0000 7fe3e2ffd640 1 --2- 172.21.15.63:0/3580514934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a50390 0x557dc0e24f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:29.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.407+0000 7fe3e3fff640 1 --2- 172.21.15.63:0/3580514934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a71070 0x557dc0e254c0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00bf50 tx=0x7fe3dc0acdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30052cff07863344 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:29.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.407+0000 7fe3d97fa640 1 -- 172.21.15.63:0/3580514934 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc094070 con 0x557dc0a71070 2024-09-21T06:37:29.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.407+0000 7fe3d97fa640 1 -- 172.21.15.63:0/3580514934 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3dc0aceb0 con 0x557dc0a71070 2024-09-21T06:37:29.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.407+0000 7fe3d97fa640 1 -- 172.21.15.63:0/3580514934 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc020040 con 0x557dc0a71070 2024-09-21T06:37:29.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.408+0000 7fe3f054c740 1 -- 172.21.15.63:0/3580514934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a71070 msgr2=0x557dc0e254c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:29.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.408+0000 7fe3f054c740 1 --2- 172.21.15.63:0/3580514934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a71070 0x557dc0e254c0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00bf50 tx=0x7fe3dc0acdb0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.408+0000 7fe3f054c740 1 -- 172.21.15.63:0/3580514934 shutdown_connections 2024-09-21T06:37:29.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.408+0000 7fe3f054c740 1 --2- 172.21.15.63:0/3580514934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a71070 0x557dc0e254c0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.408+0000 7fe3f054c740 1 --2- 172.21.15.63:0/3580514934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a50390 0x557dc0e24f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.408+0000 7fe3f054c740 1 --2- 172.21.15.63:0/3580514934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dc0a481b0 0x557dc0e28250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.408+0000 7fe3f054c740 1 -- 172.21.15.63:0/3580514934 >> 172.21.15.63:0/3580514934 conn(0x557dc0a65460 msgr2=0x557dc0e27b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:29.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.408+0000 7fe3f054c740 1 -- 172.21.15.63:0/3580514934 shutdown_connections 2024-09-21T06:37:29.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.408+0000 7fe3f054c740 1 -- 172.21.15.63:0/3580514934 wait complete. 2024-09-21T06:37:29.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.408+0000 7fe3f054c740 1 -- start start 2024-09-21T06:37:29.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.409+0000 7fe3f054c740 1 Processor -- start 2024-09-21T06:37:29.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.409+0000 7fe3f054c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dc0a481b0 0x557dc0e3b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.409+0000 7fe3f054c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a50390 0x557dc0e3b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.409+0000 7fe3f054c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a71070 0x557dc0ea35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.409+0000 7fe3f054c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e41ae990 con 0x557dc0a50390 2024-09-21T06:37:29.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.409+0000 7fe3f054c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e41ae2c0 con 0x557dc0a71070 2024-09-21T06:37:29.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.409+0000 7fe3f054c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e41ab520 con 0x557dc0a481b0 2024-09-21T06:37:29.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.409+0000 7fe3f054c740 10 client.0 _ll_register_callbacks cb 0x7fe3cc00c460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:29.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.409+0000 7fe3e2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a50390 0x557dc0e3b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.409+0000 7fe3e2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a50390 0x557dc0e3b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58434/0 (socket says 172.21.15.63:58434) 2024-09-21T06:37:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.409+0000 7fe3e2ffd640 1 -- 172.21.15.63:0/2233298987 learned_addr learned my addr 172.21.15.63:0/2233298987 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.409+0000 7fe3e3fff640 1 --2- 172.21.15.63:0/2233298987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a71070 0x557dc0ea35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.409+0000 7fe3e37fe640 1 --2- 172.21.15.63:0/2233298987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dc0a481b0 0x557dc0e3b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.409+0000 7fe3e2ffd640 1 -- 172.21.15.63:0/2233298987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dc0a481b0 msgr2=0x557dc0e3b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.409+0000 7fe3e2ffd640 1 --2- 172.21.15.63:0/2233298987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dc0a481b0 0x557dc0e3b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.409+0000 7fe3e2ffd640 1 -- 172.21.15.63:0/2233298987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a71070 msgr2=0x557dc0ea35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.409+0000 7fe3e2ffd640 1 --2- 172.21.15.63:0/2233298987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a71070 0x557dc0ea35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.409+0000 7fe3e2ffd640 1 -- 172.21.15.63:0/2233298987 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dc0ea3b10 con 0x557dc0a50390 2024-09-21T06:37:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.409+0000 7fe3e3fff640 1 --2- 172.21.15.63:0/2233298987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a71070 0x557dc0ea35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.410+0000 7fe3e2ffd640 1 --2- 172.21.15.63:0/2233298987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a50390 0x557dc0e3b800 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc0058c0 tx=0x7fe3cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a12285a13fa778 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.410+0000 7fe3c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:37:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.410+0000 7fe3c2ffd640 1 -- 172.21.15.63:0/2233298987 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc01fd40 con 0x557dc0a50390 2024-09-21T06:37:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.410+0000 7fe3c2ffd640 1 -- 172.21.15.63:0/2233298987 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7fe3cc0103d0 con 0x557dc0a50390 2024-09-21T06:37:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.410+0000 7fe3f054c740 1 -- 172.21.15.63:0/2233298987 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3dc0aceb0 con 0x557dc0a50390 2024-09-21T06:37:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.410+0000 7fe3c2ffd640 1 -- 172.21.15.63:0/2233298987 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fe3cc038050 con 0x557dc0a50390 2024-09-21T06:37:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.410+0000 7fe3f054c740 10 client.17364 fetch_fsmap learned FSMap version 61 2024-09-21T06:37:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.410+0000 7fe3f054c740 1 -- 172.21.15.63:0/2233298987 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x557dc0ea4c30 con 0x557dc0a50390 2024-09-21T06:37:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.410+0000 7fe3c2ffd640 1 -- 172.21.15.63:0/2233298987 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3dc0aceb0 con 0x557dc0a50390 2024-09-21T06:37:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.410+0000 7fe3c2ffd640 1 -- 172.21.15.63:0/2233298987 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fe3cc030530 con 0x557dc0a50390 2024-09-21T06:37:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.410+0000 7fe3f054c740 10 client.17364 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:37:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.410+0000 7fe3f054c740 10 client.17364 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:37:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.411+0000 7fe3f054c740 20 client.17364 populate_metadata read hostname 'smithi063' 2024-09-21T06:37:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.411+0000 7fe3f054c740 1 --2- 172.21.15.63:0/2233298987 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x557dc0a04da0 0x557dc0ea73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.411+0000 7fe3f054c740 4 client.17364 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:37:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.411+0000 7fe3f054c740 1 -- 172.21.15.63:0/2233298987 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557dc0d8c8a0 con 0x557dc0a04da0 2024-09-21T06:37:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.411+0000 7fe3e37fe640 1 --2- 172.21.15.63:0/2233298987 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x557dc0a04da0 0x557dc0ea73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.411+0000 7fe3c2ffd640 10 client.17364 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:37:29.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.411+0000 7fe3e37fe640 1 --2- 172.21.15.63:0/2233298987 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x557dc0a04da0 0x557dc0ea73d0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3517315636f44043 server_cookie=f1b39ceac73b66fe in_seq=0 out_seq=0 2024-09-21T06:37:29.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.411+0000 7fe3c2ffd640 1 -- 172.21.15.63:0/2233298987 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557dc0d8c8a0 con 0x557dc0a04da0 2024-09-21T06:37:29.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.411+0000 7fe3c2ffd640 10 client.17364 handle_command_reply: tid=0 2024-09-21T06:37:29.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.411+0000 7fe3f054c740 1 client.17364 shutdown 2024-09-21T06:37:29.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.412+0000 7fe3f054c740 1 -- 172.21.15.63:0/2233298987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a50390 msgr2=0x557dc0e3b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:29.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.412+0000 7fe3f054c740 1 --2- 172.21.15.63:0/2233298987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a50390 0x557dc0e3b800 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc0058c0 tx=0x7fe3cc0046c0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.412+0000 7fe3f054c740 1 -- 172.21.15.63:0/2233298987 shutdown_connections 2024-09-21T06:37:29.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.412+0000 7fe3f054c740 1 --2- 172.21.15.63:0/2233298987 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x557dc0a04da0 0x557dc0ea73d0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.412+0000 7fe3f054c740 1 --2- 172.21.15.63:0/2233298987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557dc0a71070 0x557dc0ea35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.412+0000 7fe3f054c740 1 --2- 172.21.15.63:0/2233298987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557dc0a50390 0x557dc0e3b800 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.412+0000 7fe3f054c740 1 --2- 172.21.15.63:0/2233298987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dc0a481b0 0x557dc0e3b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.412+0000 7fe3f054c740 1 -- 172.21.15.63:0/2233298987 >> 172.21.15.63:0/2233298987 conn(0x557dc0a65460 msgr2=0x557dc0e192f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:29.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.412+0000 7fe3c2ffd640 0 client.17364 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:37:29.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.412+0000 7fe3f054c740 1 -- 172.21.15.63:0/2233298987 shutdown_connections 2024-09-21T06:37:29.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.412+0000 7fe3f054c740 1 -- 172.21.15.63:0/2233298987 wait complete. 2024-09-21T06:37:29.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.412+0000 7fe3f054c740 20 client.17364 trim_cache size 0 max 16384 2024-09-21T06:37:29.419 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:37:29.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.412+0000 7fe3e9fd8640 1 -- 172.21.15.63:0/2026002682 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe3d00b6680 msgr2=0x7fe3d00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:29.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.413+0000 7fe3e9fd8640 1 --2- 172.21.15.63:0/2026002682 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe3d00b6680 0x7fe3d00b8b90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc005fd0 tx=0x7fe3cc00c600 comp rx=0 tx=0).stop 2024-09-21T06:37:29.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.413+0000 7fe3e9fd8640 1 -- 172.21.15.63:0/2026002682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3e4108cf0 msgr2=0x7fe3e419fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:29.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.413+0000 7fe3e9fd8640 1 --2- 172.21.15.63:0/2026002682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3e4108cf0 0x7fe3e419fcd0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009fd0 tx=0x7fe3dc00b260 comp rx=0 tx=0).stop 2024-09-21T06:37:29.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.413+0000 7fe3e9fd8640 1 -- 172.21.15.63:0/2026002682 shutdown_connections 2024-09-21T06:37:29.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.413+0000 7fe3e9fd8640 1 --2- 172.21.15.63:0/2026002682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3e4108cf0 0x7fe3e419fcd0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.413+0000 7fe3e9fd8640 1 --2- 172.21.15.63:0/2026002682 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe3d00b6680 0x7fe3d00b8b90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.413+0000 7fe3e9fd8640 1 --2- 172.21.15.63:0/2026002682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3e41083a0 0x7fe3e419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.413+0000 7fe3e9fd8640 1 --2- 172.21.15.63:0/2026002682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3e4102a60 0x7fe3e419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.413+0000 7fe3e9fd8640 1 -- 172.21.15.63:0/2026002682 >> 172.21.15.63:0/2026002682 conn(0x7fe3e4079730 msgr2=0x7fe3e4101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:29.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.413+0000 7fe3e9fd8640 1 -- 172.21.15.63:0/2026002682 shutdown_connections 2024-09-21T06:37:29.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:29.413+0000 7fe3e9fd8640 1 -- 172.21.15.63:0/2026002682 wait complete. 2024-09-21T06:37:29.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:29 smithi071 ceph-mon[34844]: pgmap v607: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T06:37:29.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:29 smithi175 ceph-mon[34510]: pgmap v607: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T06:37:30.097 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:37:30.356 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:30.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.841+0000 7f0cde235640 1 -- 172.21.15.63:0/2915147562 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cd8108cf0 msgr2=0x7f0cd810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:30.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.841+0000 7f0cde235640 1 --2- 172.21.15.63:0/2915147562 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cd8108cf0 0x7f0cd810f520 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009900 tx=0x7f0cd002a410 comp rx=0 tx=0).stop 2024-09-21T06:37:30.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.841+0000 7f0cde235640 1 -- 172.21.15.63:0/2915147562 shutdown_connections 2024-09-21T06:37:30.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.841+0000 7f0cde235640 1 --2- 172.21.15.63:0/2915147562 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cd8108cf0 0x7f0cd810f520 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.841+0000 7f0cde235640 1 --2- 172.21.15.63:0/2915147562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cd81083a0 0x7f0cd81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.841+0000 7f0cde235640 1 --2- 172.21.15.63:0/2915147562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0cd8102a60 0x7f0cd8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.841+0000 7f0cde235640 1 -- 172.21.15.63:0/2915147562 >> 172.21.15.63:0/2915147562 conn(0x7f0cd8079730 msgr2=0x7f0cd8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:30.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.841+0000 7f0cde235640 1 -- 172.21.15.63:0/2915147562 shutdown_connections 2024-09-21T06:37:30.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.841+0000 7f0cde235640 1 -- 172.21.15.63:0/2915147562 wait complete. 2024-09-21T06:37:30.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.842+0000 7f0cde235640 1 Processor -- start 2024-09-21T06:37:30.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.842+0000 7f0cde235640 1 -- start start 2024-09-21T06:37:30.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.842+0000 7f0cde235640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cd8102a60 0x7f0cd819b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.842+0000 7f0cde235640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0cd81083a0 0x7f0cd819b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.842+0000 7f0cde235640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cd8108cf0 0x7f0cd819bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.842+0000 7f0cde235640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd8112960 con 0x7f0cd8102a60 2024-09-21T06:37:30.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.842+0000 7f0cde235640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81127e0 con 0x7f0cd81083a0 2024-09-21T06:37:30.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.842+0000 7f0cde235640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd8112ae0 con 0x7f0cd8108cf0 2024-09-21T06:37:30.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.842+0000 7f0cd77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cd8102a60 0x7f0cd819b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.842+0000 7f0cd77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cd8102a60 0x7f0cd819b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58456/0 (socket says 172.21.15.63:58456) 2024-09-21T06:37:30.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.842+0000 7f0cd77fe640 1 -- 172.21.15.63:0/1211738338 learned_addr learned my addr 172.21.15.63:0/1211738338 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:30.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.842+0000 7f0cd7fff640 1 --2- 172.21.15.63:0/1211738338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cd8108cf0 0x7f0cd819bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.843+0000 7f0cd6ffd640 1 --2- 172.21.15.63:0/1211738338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0cd81083a0 0x7f0cd819b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.843+0000 7f0cd77fe640 1 -- 172.21.15.63:0/1211738338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cd8108cf0 msgr2=0x7f0cd819bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:30.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.843+0000 7f0cd77fe640 1 --2- 172.21.15.63:0/1211738338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cd8108cf0 0x7f0cd819bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.843+0000 7f0cd77fe640 1 -- 172.21.15.63:0/1211738338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0cd81083a0 msgr2=0x7f0cd819b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.843+0000 7f0cd77fe640 1 --2- 172.21.15.63:0/1211738338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0cd81083a0 0x7f0cd819b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.843+0000 7f0cd77fe640 1 -- 172.21.15.63:0/1211738338 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd81a64a0 con 0x7f0cd8102a60 2024-09-21T06:37:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.843+0000 7f0cd77fe640 1 --2- 172.21.15.63:0/1211738338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cd8102a60 0x7f0cd819b210 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800eab0 tx=0x7f0cc800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.843+0000 7f0cd4ff9640 1 -- 172.21.15.63:0/1211738338 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc800ce40 con 0x7f0cd8102a60 2024-09-21T06:37:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.843+0000 7f0cde235640 1 -- 172.21.15.63:0/1211738338 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd81a6790 con 0x7f0cd8102a60 2024-09-21T06:37:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.843+0000 7f0cd4ff9640 1 -- 172.21.15.63:0/1211738338 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cc8011920 con 0x7f0cd8102a60 2024-09-21T06:37:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.843+0000 7f0cd4ff9640 1 -- 172.21.15.63:0/1211738338 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8010a30 con 0x7f0cd8102a60 2024-09-21T06:37:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.843+0000 7f0cde235640 1 -- 172.21.15.63:0/1211738338 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd81a6d20 con 0x7f0cd8102a60 2024-09-21T06:37:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.846+0000 7f0ce47a9740 1 Processor -- start 2024-09-21T06:37:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.846+0000 7f0ce47a9740 1 -- start start 2024-09-21T06:37:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.846+0000 7f0cd4ff9640 1 -- 172.21.15.63:0/1211738338 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f0cc8010bd0 con 0x7f0cd8102a60 2024-09-21T06:37:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.846+0000 7f0ce47a9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e56070 0x55bfd21fd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.846+0000 7f0ce47a9740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e2d1b0 0x55bfd21fdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.846+0000 7f0ce47a9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfd1e35390 0x55bfd21fe120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.846+0000 7f0ce47a9740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55bfd2173ea0 con 0x55bfd1e2d1b0 2024-09-21T06:37:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.846+0000 7f0ce47a9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bfd21632d0 con 0x55bfd1e56070 2024-09-21T06:37:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.846+0000 7f0ce47a9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bfd21670e0 con 0x55bfd1e35390 2024-09-21T06:37:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.846+0000 7f0cd77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e2d1b0 0x55bfd21fdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.846+0000 7f0cd77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e2d1b0 0x55bfd21fdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58462/0 (socket says 172.21.15.63:58462) 2024-09-21T06:37:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.846+0000 7f0cd77fe640 1 -- 172.21.15.63:0/399969133 learned_addr learned my addr 172.21.15.63:0/399969133 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.847+0000 7f0cd7fff640 1 --2- 172.21.15.63:0/399969133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e56070 0x55bfd21fd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.847+0000 7f0cd6ffd640 1 --2- 172.21.15.63:0/399969133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfd1e35390 0x55bfd21fe120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.847+0000 7f0cd77fe640 1 -- 172.21.15.63:0/399969133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfd1e35390 msgr2=0x55bfd21fe120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.847+0000 7f0cd77fe640 1 --2- 172.21.15.63:0/399969133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfd1e35390 0x55bfd21fe120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.847+0000 7f0cd77fe640 1 -- 172.21.15.63:0/399969133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e56070 msgr2=0x55bfd21fd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.847+0000 7f0cd77fe640 1 --2- 172.21.15.63:0/399969133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e56070 0x55bfd21fd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.847+0000 7f0cd77fe640 1 -- 172.21.15.63:0/399969133 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfd1ec1650 con 0x55bfd1e2d1b0 2024-09-21T06:37:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.847+0000 7f0cd7fff640 1 --2- 172.21.15.63:0/399969133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e56070 0x55bfd21fd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.847+0000 7f0cd4ff9640 1 --2- 172.21.15.63:0/1211738338 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0cc00b66b0 0x7f0cc00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.847+0000 7f0cd77fe640 1 --2- 172.21.15.63:0/399969133 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e2d1b0 0x55bfd21fdbe0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80e5410 tx=0x7f0cc80f00e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24973780751d757a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.847+0000 7f0cd7fff640 1 --2- 172.21.15.63:0/1211738338 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0cc00b66b0 0x7f0cc00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.847+0000 7f0cd4ff9640 1 -- 172.21.15.63:0/1211738338 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7f0cc80e7da0 con 0x7f0cd8102a60 2024-09-21T06:37:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.847+0000 7f0cbdffb640 1 -- 172.21.15.63:0/399969133 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc80aa1f0 con 0x55bfd1e2d1b0 2024-09-21T06:37:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.847+0000 7f0cbdffb640 1 -- 172.21.15.63:0/399969133 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cc80ad6b0 con 0x55bfd1e2d1b0 2024-09-21T06:37:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.847+0000 7f0cbdffb640 1 -- 172.21.15.63:0/399969133 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc80ad310 con 0x55bfd1e2d1b0 2024-09-21T06:37:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.848+0000 7f0ce47a9740 1 -- 172.21.15.63:0/399969133 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e2d1b0 msgr2=0x55bfd21fdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.848+0000 7f0cd7fff640 1 --2- 172.21.15.63:0/1211738338 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0cc00b66b0 0x7f0cc00b8bc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0006010 tx=0x7f0cd00058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.848+0000 7f0ce47a9740 1 --2- 172.21.15.63:0/399969133 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e2d1b0 0x55bfd21fdbe0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80e5410 tx=0x7f0cc80f00e0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.848+0000 7f0ce47a9740 1 -- 172.21.15.63:0/399969133 shutdown_connections 2024-09-21T06:37:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.848+0000 7f0ce47a9740 1 --2- 172.21.15.63:0/399969133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfd1e35390 0x55bfd21fe120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.848+0000 7f0ce47a9740 1 --2- 172.21.15.63:0/399969133 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e2d1b0 0x55bfd21fdbe0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.848+0000 7f0ce47a9740 1 --2- 172.21.15.63:0/399969133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e56070 0x55bfd21fd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.848+0000 7f0ce47a9740 1 -- 172.21.15.63:0/399969133 >> 172.21.15.63:0/399969133 conn(0x55bfd1e4a460 msgr2=0x55bfd21fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:30.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.848+0000 7f0ce47a9740 1 -- 172.21.15.63:0/399969133 shutdown_connections 2024-09-21T06:37:30.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.848+0000 7f0ce47a9740 1 -- 172.21.15.63:0/399969133 wait complete. 2024-09-21T06:37:30.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.849+0000 7f0ce47a9740 1 -- start start 2024-09-21T06:37:30.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.849+0000 7f0ce47a9740 1 Processor -- start 2024-09-21T06:37:30.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.849+0000 7f0ce47a9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfd1e2d1b0 0x55bfd220d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.849+0000 7f0ce47a9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e35390 0x55bfd220d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.849+0000 7f0ce47a9740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e56070 0x55bfd2219510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.849+0000 7f0ce47a9740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55bfd1fc4700 con 0x55bfd1e56070 2024-09-21T06:37:30.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.849+0000 7f0ce47a9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bfd20fe160 con 0x55bfd1e35390 2024-09-21T06:37:30.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.849+0000 7f0ce47a9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bfd22101e0 con 0x55bfd1e2d1b0 2024-09-21T06:37:30.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.850+0000 7f0ce47a9740 10 client.0 _ll_register_callbacks cb 0x55bfd21179e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:30.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.850+0000 7f0cd7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e56070 0x55bfd2219510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.850+0000 7f0cd7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e56070 0x55bfd2219510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58474/0 (socket says 172.21.15.63:58474) 2024-09-21T06:37:30.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.850+0000 7f0cd7fff640 1 -- 172.21.15.63:0/2308332678 learned_addr learned my addr 172.21.15.63:0/2308332678 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:30.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.850+0000 7f0cd77fe640 1 --2- 172.21.15.63:0/2308332678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfd1e2d1b0 0x55bfd220d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.850+0000 7f0cd6ffd640 1 --2- 172.21.15.63:0/2308332678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e35390 0x55bfd220d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.850+0000 7f0cd7fff640 1 -- 172.21.15.63:0/2308332678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfd1e2d1b0 msgr2=0x55bfd220d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:30.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.850+0000 7f0cd7fff640 1 --2- 172.21.15.63:0/2308332678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfd1e2d1b0 0x55bfd220d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.850+0000 7f0cd7fff640 1 -- 172.21.15.63:0/2308332678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e35390 msgr2=0x55bfd220d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:30.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.850+0000 7f0cd7fff640 1 --2- 172.21.15.63:0/2308332678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e35390 0x55bfd220d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.850+0000 7f0cd7fff640 1 -- 172.21.15.63:0/2308332678 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfd212bc90 con 0x55bfd1e56070 2024-09-21T06:37:30.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.850+0000 7f0cd6ffd640 1 --2- 172.21.15.63:0/2308332678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e35390 0x55bfd220d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:30.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.850+0000 7f0cd7fff640 1 --2- 172.21.15.63:0/2308332678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e56070 0x55bfd2219510 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009900 tx=0x7f0cd0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fecf023d9623595 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:30.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.850+0000 7f0cb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:37:30.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.850+0000 7f0cb6ffd640 1 -- 172.21.15.63:0/2308332678 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd004c030 con 0x55bfd1e56070 2024-09-21T06:37:30.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.850+0000 7f0cb6ffd640 1 -- 172.21.15.63:0/2308332678 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7f0cd00043d0 con 0x55bfd1e56070 2024-09-21T06:37:30.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.850+0000 7f0ce47a9740 1 -- 172.21.15.63:0/2308332678 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cc80ad6b0 con 0x55bfd1e56070 2024-09-21T06:37:30.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.851+0000 7f0cb6ffd640 1 -- 172.21.15.63:0/2308332678 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f0cd0035040 con 0x55bfd1e56070 2024-09-21T06:37:30.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.851+0000 7f0ce47a9740 10 client.17376 fetch_fsmap learned FSMap version 61 2024-09-21T06:37:30.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.851+0000 7f0ce47a9740 1 -- 172.21.15.63:0/2308332678 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55bfd221bf60 con 0x55bfd1e56070 2024-09-21T06:37:30.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.851+0000 7f0cb6ffd640 1 -- 172.21.15.63:0/2308332678 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cc80ad6b0 con 0x55bfd1e56070 2024-09-21T06:37:30.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.851+0000 7f0cb6ffd640 1 -- 172.21.15.63:0/2308332678 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f0cd00484d0 con 0x55bfd1e56070 2024-09-21T06:37:30.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.851+0000 7f0ce47a9740 10 client.17376 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:37:30.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.851+0000 7f0ce47a9740 10 client.17376 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:37:30.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.851+0000 7f0ce47a9740 20 client.17376 populate_metadata read hostname 'smithi063' 2024-09-21T06:37:30.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.851+0000 7f0ce47a9740 1 --2- 172.21.15.63:0/2308332678 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55bfd1e149f0 0x55bfd221f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.851+0000 7f0ce47a9740 4 client.17376 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:30.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.851+0000 7f0ce47a9740 1 -- 172.21.15.63:0/2308332678 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfd2175df0 con 0x55bfd1e149f0 2024-09-21T06:37:30.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.851+0000 7f0cd77fe640 1 --2- 172.21.15.63:0/2308332678 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55bfd1e149f0 0x55bfd221f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.852+0000 7f0cd77fe640 1 --2- 172.21.15.63:0/2308332678 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55bfd1e149f0 0x55bfd221f4f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82033083b6c1a16a server_cookie=d8483decfc959bd9 in_seq=0 out_seq=0 2024-09-21T06:37:30.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.852+0000 7f0cb6ffd640 10 client.17376 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:37:30.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.852+0000 7f0cb6ffd640 1 -- 172.21.15.63:0/2308332678 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bfd2175df0 con 0x55bfd1e149f0 2024-09-21T06:37:30.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.852+0000 7f0cb6ffd640 10 client.17376 handle_command_reply: tid=0 2024-09-21T06:37:30.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.852+0000 7f0ce47a9740 1 client.17376 shutdown 2024-09-21T06:37:30.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.853+0000 7f0ce47a9740 1 -- 172.21.15.63:0/2308332678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e56070 msgr2=0x55bfd2219510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:30.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.853+0000 7f0ce47a9740 1 --2- 172.21.15.63:0/2308332678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e56070 0x55bfd2219510 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009900 tx=0x7f0cd0009260 comp rx=0 tx=0).stop 2024-09-21T06:37:30.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.853+0000 7f0ce47a9740 1 -- 172.21.15.63:0/2308332678 shutdown_connections 2024-09-21T06:37:30.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.853+0000 7f0ce47a9740 1 --2- 172.21.15.63:0/2308332678 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55bfd1e149f0 0x55bfd221f4f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.853+0000 7f0ce47a9740 1 --2- 172.21.15.63:0/2308332678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e56070 0x55bfd2219510 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.853+0000 7f0ce47a9740 1 --2- 172.21.15.63:0/2308332678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e35390 0x55bfd220d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.853+0000 7f0ce47a9740 1 --2- 172.21.15.63:0/2308332678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfd1e2d1b0 0x55bfd220d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.853+0000 7f0ce47a9740 1 -- 172.21.15.63:0/2308332678 >> 172.21.15.63:0/2308332678 conn(0x55bfd1e4a460 msgr2=0x55bfd21f9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:30.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.853+0000 7f0cb6ffd640 0 client.17376 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:37:30.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.853+0000 7f0ce47a9740 1 -- 172.21.15.63:0/2308332678 shutdown_connections 2024-09-21T06:37:30.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.853+0000 7f0ce47a9740 1 -- 172.21.15.63:0/2308332678 wait complete. 2024-09-21T06:37:30.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.853+0000 7f0ce47a9740 20 client.17376 trim_cache size 0 max 16384 2024-09-21T06:37:30.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.866+0000 7f0ce47a9740 1 Processor -- start 2024-09-21T06:37:30.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.866+0000 7f0ce47a9740 1 -- start start 2024-09-21T06:37:30.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.867+0000 7f0ce47a9740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e2d1b0 0x55bfd220edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.867+0000 7f0ce47a9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e35390 0x55bfd220a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.867+0000 7f0ce47a9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfd1e56070 0x55bfd220a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.867+0000 7f0ce47a9740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81ad5c0 con 0x55bfd1e2d1b0 2024-09-21T06:37:30.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.867+0000 7f0ce47a9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81af100 con 0x55bfd1e35390 2024-09-21T06:37:30.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.867+0000 7f0ce47a9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81adc90 con 0x55bfd1e56070 2024-09-21T06:37:30.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.867+0000 7f0cd77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e2d1b0 0x55bfd220edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.867+0000 7f0cd77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e2d1b0 0x55bfd220edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58490/0 (socket says 172.21.15.63:58490) 2024-09-21T06:37:30.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.867+0000 7f0cd77fe640 1 -- 172.21.15.63:0/336991103 learned_addr learned my addr 172.21.15.63:0/336991103 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:30.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.867+0000 7f0cd77fe640 1 -- 172.21.15.63:0/336991103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfd1e56070 msgr2=0x55bfd220a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:30.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.867+0000 7f0cd77fe640 1 --2- 172.21.15.63:0/336991103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfd1e56070 0x55bfd220a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.867+0000 7f0cd77fe640 1 -- 172.21.15.63:0/336991103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e35390 msgr2=0x55bfd220a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:30.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.867+0000 7f0cd6ffd640 1 --2- 172.21.15.63:0/336991103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e35390 0x55bfd220a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.867+0000 7f0cd77fe640 1 --2- 172.21.15.63:0/336991103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e35390 0x55bfd220a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.867+0000 7f0cd77fe640 1 -- 172.21.15.63:0/336991103 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfd1e14c20 con 0x55bfd1e2d1b0 2024-09-21T06:37:30.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.867+0000 7f0cd77fe640 1 --2- 172.21.15.63:0/336991103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e2d1b0 0x55bfd220edf0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80ad8a0 tx=0x7f0cc80094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e4ad62e2d69069 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:30.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.867+0000 7f0cbd7fa640 1 -- 172.21.15.63:0/336991103 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc80ad4f0 con 0x55bfd1e2d1b0 2024-09-21T06:37:30.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.867+0000 7f0cbd7fa640 1 -- 172.21.15.63:0/336991103 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cc80ad6b0 con 0x55bfd1e2d1b0 2024-09-21T06:37:30.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.867+0000 7f0cbd7fa640 1 -- 172.21.15.63:0/336991103 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc80ad970 con 0x55bfd1e2d1b0 2024-09-21T06:37:30.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.868+0000 7f0ce47a9740 1 -- 172.21.15.63:0/336991103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e2d1b0 msgr2=0x55bfd220edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:30.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.868+0000 7f0ce47a9740 1 --2- 172.21.15.63:0/336991103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e2d1b0 0x55bfd220edf0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80ad8a0 tx=0x7f0cc80094a0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.868+0000 7f0ce47a9740 1 -- 172.21.15.63:0/336991103 shutdown_connections 2024-09-21T06:37:30.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.868+0000 7f0ce47a9740 1 --2- 172.21.15.63:0/336991103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfd1e56070 0x55bfd220a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.868+0000 7f0ce47a9740 1 --2- 172.21.15.63:0/336991103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e35390 0x55bfd220a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.868+0000 7f0ce47a9740 1 --2- 172.21.15.63:0/336991103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e2d1b0 0x55bfd220edf0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.868+0000 7f0ce47a9740 1 -- 172.21.15.63:0/336991103 >> 172.21.15.63:0/336991103 conn(0x55bfd1e4a460 msgr2=0x55bfd220e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:30.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.868+0000 7f0ce47a9740 1 -- 172.21.15.63:0/336991103 shutdown_connections 2024-09-21T06:37:30.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.868+0000 7f0ce47a9740 1 -- 172.21.15.63:0/336991103 wait complete. 2024-09-21T06:37:30.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.869+0000 7f0ce47a9740 1 -- start start 2024-09-21T06:37:30.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.869+0000 7f0ce47a9740 1 Processor -- start 2024-09-21T06:37:30.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.869+0000 7f0ce47a9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e2d1b0 0x55bfd2212d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.869+0000 7f0ce47a9740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e35390 0x55bfd2213340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.869+0000 7f0ce47a9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfd1e56070 0x55bfd2281ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.869+0000 7f0ce47a9740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81aea30 con 0x55bfd1e35390 2024-09-21T06:37:30.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.869+0000 7f0ce47a9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81ae360 con 0x55bfd1e2d1b0 2024-09-21T06:37:30.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.869+0000 7f0ce47a9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81ab5c0 con 0x55bfd1e56070 2024-09-21T06:37:30.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.869+0000 7f0ce47a9740 10 client.0 _ll_register_callbacks cb 0x7f0cd0032be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:30.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.869+0000 7f0cd6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e35390 0x55bfd2213340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.869+0000 7f0cd6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e35390 0x55bfd2213340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58504/0 (socket says 172.21.15.63:58504) 2024-09-21T06:37:30.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.869+0000 7f0cd6ffd640 1 -- 172.21.15.63:0/292713708 learned_addr learned my addr 172.21.15.63:0/292713708 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:30.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.870+0000 7f0cd77fe640 1 --2- 172.21.15.63:0/292713708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e2d1b0 0x55bfd2212d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.870+0000 7f0cd7fff640 1 --2- 172.21.15.63:0/292713708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfd1e56070 0x55bfd2281ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.870+0000 7f0cd6ffd640 1 -- 172.21.15.63:0/292713708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfd1e56070 msgr2=0x55bfd2281ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:30.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.870+0000 7f0cd6ffd640 1 --2- 172.21.15.63:0/292713708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfd1e56070 0x55bfd2281ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.870+0000 7f0cd6ffd640 1 -- 172.21.15.63:0/292713708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e2d1b0 msgr2=0x55bfd2212d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:30.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.870+0000 7f0cd6ffd640 1 --2- 172.21.15.63:0/292713708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e2d1b0 0x55bfd2212d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.870+0000 7f0cd6ffd640 1 -- 172.21.15.63:0/292713708 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfd2282560 con 0x55bfd1e35390 2024-09-21T06:37:30.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.870+0000 7f0cd6ffd640 1 --2- 172.21.15.63:0/292713708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e35390 0x55bfd2213340 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc00ede0 tx=0x7f0ccc013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38d330b07f2dc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:30.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.870+0000 7f0cb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:37:30.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.870+0000 7f0cb6ffd640 1 -- 172.21.15.63:0/292713708 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc004030 con 0x55bfd1e35390 2024-09-21T06:37:30.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.870+0000 7f0cb6ffd640 1 -- 172.21.15.63:0/292713708 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7f0ccc0041d0 con 0x55bfd1e35390 2024-09-21T06:37:30.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.870+0000 7f0ce47a9740 1 -- 172.21.15.63:0/292713708 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cc80ad6b0 con 0x55bfd1e35390 2024-09-21T06:37:30.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.870+0000 7f0cb6ffd640 1 -- 172.21.15.63:0/292713708 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f0ccc0043d0 con 0x55bfd1e35390 2024-09-21T06:37:30.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.870+0000 7f0ce47a9740 10 client.17382 fetch_fsmap learned FSMap version 61 2024-09-21T06:37:30.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.870+0000 7f0ce47a9740 1 -- 172.21.15.63:0/292713708 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55bfd22898c0 con 0x55bfd1e35390 2024-09-21T06:37:30.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.871+0000 7f0cb6ffd640 1 -- 172.21.15.63:0/292713708 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cc80ad6b0 con 0x55bfd1e35390 2024-09-21T06:37:30.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.871+0000 7f0cb6ffd640 1 -- 172.21.15.63:0/292713708 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f0ccc0039c0 con 0x55bfd1e35390 2024-09-21T06:37:30.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.871+0000 7f0ce47a9740 10 client.17382 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:37:30.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.871+0000 7f0ce47a9740 10 client.17382 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:37:30.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.871+0000 7f0ce47a9740 20 client.17382 populate_metadata read hostname 'smithi063' 2024-09-21T06:37:30.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.871+0000 7f0ce47a9740 1 --2- 172.21.15.63:0/292713708 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55bfd1de9da0 0x55bfd228c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.871+0000 7f0ce47a9740 4 client.17382 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:37:30.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.871+0000 7f0ce47a9740 1 -- 172.21.15.63:0/292713708 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bfd21718a0 con 0x55bfd1de9da0 2024-09-21T06:37:30.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.871+0000 7f0cd77fe640 1 --2- 172.21.15.63:0/292713708 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55bfd1de9da0 0x55bfd228c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.871+0000 7f0cb6ffd640 10 client.17382 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:37:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.871+0000 7f0cd77fe640 1 --2- 172.21.15.63:0/292713708 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55bfd1de9da0 0x55bfd228c0e0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=376cb853a7c1006f server_cookie=8f83d58372606144 in_seq=0 out_seq=0 2024-09-21T06:37:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.872+0000 7f0cb6ffd640 1 -- 172.21.15.63:0/292713708 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bfd21718a0 con 0x55bfd1de9da0 2024-09-21T06:37:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.872+0000 7f0cb6ffd640 10 client.17382 handle_command_reply: tid=0 2024-09-21T06:37:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.872+0000 7f0ce47a9740 1 client.17382 shutdown 2024-09-21T06:37:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.872+0000 7f0ce47a9740 1 -- 172.21.15.63:0/292713708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e35390 msgr2=0x55bfd2213340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.872+0000 7f0ce47a9740 1 --2- 172.21.15.63:0/292713708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e35390 0x55bfd2213340 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc00ede0 tx=0x7f0ccc013830 comp rx=0 tx=0).stop 2024-09-21T06:37:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.872+0000 7f0ce47a9740 1 -- 172.21.15.63:0/292713708 shutdown_connections 2024-09-21T06:37:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.872+0000 7f0ce47a9740 1 --2- 172.21.15.63:0/292713708 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55bfd1de9da0 0x55bfd228c0e0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.872+0000 7f0ce47a9740 1 --2- 172.21.15.63:0/292713708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bfd1e56070 0x55bfd2281ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.872+0000 7f0ce47a9740 1 --2- 172.21.15.63:0/292713708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bfd1e35390 0x55bfd2213340 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.872+0000 7f0cb6ffd640 0 client.17382 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:37:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.872+0000 7f0ce47a9740 1 --2- 172.21.15.63:0/292713708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfd1e2d1b0 0x55bfd2212d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.872+0000 7f0ce47a9740 1 -- 172.21.15.63:0/292713708 >> 172.21.15.63:0/292713708 conn(0x55bfd1e4a460 msgr2=0x55bfd2202fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.872+0000 7f0ce47a9740 1 -- 172.21.15.63:0/292713708 shutdown_connections 2024-09-21T06:37:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.872+0000 7f0ce47a9740 1 -- 172.21.15.63:0/292713708 wait complete. 2024-09-21T06:37:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.872+0000 7f0ce47a9740 20 client.17382 trim_cache size 0 max 16384 2024-09-21T06:37:30.879 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:37:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.873+0000 7f0cde235640 1 -- 172.21.15.63:0/1211738338 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0cc00b66b0 msgr2=0x7f0cc00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.873+0000 7f0cde235640 1 --2- 172.21.15.63:0/1211738338 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0cc00b66b0 0x7f0cc00b8bc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0006010 tx=0x7f0cd00058d0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.873+0000 7f0cde235640 1 -- 172.21.15.63:0/1211738338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cd8102a60 msgr2=0x7f0cd819b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.873+0000 7f0cde235640 1 --2- 172.21.15.63:0/1211738338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cd8102a60 0x7f0cd819b210 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800eab0 tx=0x7f0cc800ef70 comp rx=0 tx=0).stop 2024-09-21T06:37:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.873+0000 7f0cde235640 1 -- 172.21.15.63:0/1211738338 shutdown_connections 2024-09-21T06:37:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.873+0000 7f0cde235640 1 --2- 172.21.15.63:0/1211738338 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0cc00b66b0 0x7f0cc00b8bc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.873+0000 7f0cde235640 1 --2- 172.21.15.63:0/1211738338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cd8108cf0 0x7f0cd819bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.873+0000 7f0cde235640 1 --2- 172.21.15.63:0/1211738338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0cd81083a0 0x7f0cd819b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.873+0000 7f0cde235640 1 --2- 172.21.15.63:0/1211738338 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cd8102a60 0x7f0cd819b210 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.873+0000 7f0cde235640 1 -- 172.21.15.63:0/1211738338 >> 172.21.15.63:0/1211738338 conn(0x7f0cd8079730 msgr2=0x7f0cd81043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:30.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.873+0000 7f0cde235640 1 -- 172.21.15.63:0/1211738338 shutdown_connections 2024-09-21T06:37:30.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:30.873+0000 7f0cde235640 1 -- 172.21.15.63:0/1211738338 wait complete. 2024-09-21T06:37:31.498 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:31 smithi063 ceph-mon[31150]: pgmap v608: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:37:31.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:31 smithi071 ceph-mon[34844]: pgmap v608: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:37:31.565 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T06:37:31.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:31 smithi175 ceph-mon[34510]: pgmap v608: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:37:31.823 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:32.386 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:37:32.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.332+0000 7f280bf09640 1 -- 172.21.15.63:0/3190856909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28041094a0 msgr2=0x7f28041098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:32.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.332+0000 7f280bf09640 1 --2- 172.21.15.63:0/3190856909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28041094a0 0x7f28041098b0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f27f4009900 tx=0x7f27f402a410 comp rx=0 tx=0).stop 2024-09-21T06:37:32.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.332+0000 7f280bf09640 1 -- 172.21.15.63:0/3190856909 shutdown_connections 2024-09-21T06:37:32.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.332+0000 7f280bf09640 1 --2- 172.21.15.63:0/3190856909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2804109df0 0x7f2804110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.332+0000 7f280bf09640 1 --2- 172.21.15.63:0/3190856909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f28041094a0 0x7f28041098b0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.332+0000 7f280bf09640 1 --2- 172.21.15.63:0/3190856909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2804103b60 0x7f2804103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.333+0000 7f280bf09640 1 -- 172.21.15.63:0/3190856909 >> 172.21.15.63:0/3190856909 conn(0x7f280407b850 msgr2=0x7f280407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:32.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.333+0000 7f280bf09640 1 -- 172.21.15.63:0/3190856909 shutdown_connections 2024-09-21T06:37:32.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.333+0000 7f280bf09640 1 -- 172.21.15.63:0/3190856909 wait complete. 2024-09-21T06:37:32.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.333+0000 7f280bf09640 1 Processor -- start 2024-09-21T06:37:32.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.333+0000 7f280bf09640 1 -- start start 2024-09-21T06:37:32.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.334+0000 7f280bf09640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2804103b60 0x7f280419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:32.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.334+0000 7f280bf09640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28041094a0 0x7f280419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:32.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.334+0000 7f280bf09640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2804109df0 0x7f280419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:32.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.334+0000 7f280bf09640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2804113af0 con 0x7f2804109df0 2024-09-21T06:37:32.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.334+0000 7f280bf09640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2804113970 con 0x7f2804103b60 2024-09-21T06:37:32.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.334+0000 7f280bf09640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2804113c70 con 0x7f28041094a0 2024-09-21T06:37:32.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.334+0000 7f280a4a6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2804109df0 0x7f280419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:32.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.334+0000 7f280a4a6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2804109df0 0x7f280419fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58524/0 (socket says 172.21.15.63:58524) 2024-09-21T06:37:32.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.334+0000 7f280a4a6640 1 -- 172.21.15.63:0/627026955 learned_addr learned my addr 172.21.15.63:0/627026955 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:32.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.334+0000 7f2809ca5640 1 --2- 172.21.15.63:0/627026955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2804103b60 0x7f280419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:32.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.334+0000 7f280a4a6640 1 -- 172.21.15.63:0/627026955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28041094a0 msgr2=0x7f280419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:32.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.334+0000 7f280a4a6640 1 --2- 172.21.15.63:0/627026955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28041094a0 0x7f280419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.334+0000 7f280a4a6640 1 -- 172.21.15.63:0/627026955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2804103b60 msgr2=0x7f280419a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:32.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.334+0000 7f280a4a6640 1 --2- 172.21.15.63:0/627026955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2804103b60 0x7f280419a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.334+0000 7f280a4a6640 1 -- 172.21.15.63:0/627026955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28041a04d0 con 0x7f2804109df0 2024-09-21T06:37:32.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.334+0000 7f280a4a6640 1 --2- 172.21.15.63:0/627026955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2804109df0 0x7f280419fda0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00b990 tx=0x7f27fc00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:32.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.335+0000 7f27faffd640 1 -- 172.21.15.63:0/627026955 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc019070 con 0x7f2804109df0 2024-09-21T06:37:32.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.335+0000 7f27faffd640 1 -- 172.21.15.63:0/627026955 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27fc00cba0 con 0x7f2804109df0 2024-09-21T06:37:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.335+0000 7f280bf09640 1 -- 172.21.15.63:0/627026955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28041a07c0 con 0x7f2804109df0 2024-09-21T06:37:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.335+0000 7f27faffd640 1 -- 172.21.15.63:0/627026955 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc0075d0 con 0x7f2804109df0 2024-09-21T06:37:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.335+0000 7f280bf09640 1 -- 172.21.15.63:0/627026955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28041a6f20 con 0x7f2804109df0 2024-09-21T06:37:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.337+0000 7f281247d740 1 Processor -- start 2024-09-21T06:37:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.337+0000 7f27faffd640 1 -- 172.21.15.63:0/627026955 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f27fc01c070 con 0x7f2804109df0 2024-09-21T06:37:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.338+0000 7f281247d740 1 -- start start 2024-09-21T06:37:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.338+0000 7f281247d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072ea070 0x55b7076912c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.338+0000 7f281247d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072c11b0 0x55b707691800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.338+0000 7f281247d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7072c9390 0x55b707691d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.338+0000 7f281247d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55b707607ea0 con 0x55b7072ea070 2024-09-21T06:37:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.338+0000 7f281247d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b7075f72d0 con 0x55b7072c11b0 2024-09-21T06:37:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.338+0000 7f281247d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b7075fb0e0 con 0x55b7072c9390 2024-09-21T06:37:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.338+0000 7f28094a4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072ea070 0x55b7076912c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.338+0000 7f28094a4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072ea070 0x55b7076912c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58540/0 (socket says 172.21.15.63:58540) 2024-09-21T06:37:32.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.338+0000 7f28094a4640 1 -- 172.21.15.63:0/3653004823 learned_addr learned my addr 172.21.15.63:0/3653004823 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:32.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.338+0000 7f2809ca5640 1 --2- 172.21.15.63:0/3653004823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072c11b0 0x55b707691800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:32.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.338+0000 7f28094a4640 1 --2- 172.21.15.63:0/3653004823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7072c9390 0x55b707691d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:32.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.339+0000 7f27faffd640 1 --2- 172.21.15.63:0/627026955 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27f00b6680 0x7f27f00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:32.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.339+0000 7f28094a4640 1 -- 172.21.15.63:0/3653004823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7072c9390 msgr2=0x55b707691d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:32.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.339+0000 7f28094a4640 1 --2- 172.21.15.63:0/3653004823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7072c9390 0x55b707691d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.339+0000 7f28094a4640 1 -- 172.21.15.63:0/3653004823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072c11b0 msgr2=0x55b707691800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:32.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.339+0000 7f28094a4640 1 --2- 172.21.15.63:0/3653004823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072c11b0 0x55b707691800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.339+0000 7f28094a4640 1 -- 172.21.15.63:0/3653004823 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b707355650 con 0x55b7072ea070 2024-09-21T06:37:32.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.339+0000 7f280a4a6640 1 --2- 172.21.15.63:0/627026955 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27f00b6680 0x7f27f00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:32.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.339+0000 7f28094a4640 1 --2- 172.21.15.63:0/3653004823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072ea070 0x55b7076912c0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f27f4033000 tx=0x7f27f4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bab6d0d3893723 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:32.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.339+0000 7f27faffd640 1 -- 172.21.15.63:0/627026955 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7f27fc0e6d50 con 0x7f2804109df0 2024-09-21T06:37:32.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.339+0000 7f27effff640 1 -- 172.21.15.63:0/3653004823 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f4035040 con 0x55b7072ea070 2024-09-21T06:37:32.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.339+0000 7f27effff640 1 -- 172.21.15.63:0/3653004823 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27f4044070 con 0x55b7072ea070 2024-09-21T06:37:32.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.339+0000 7f27effff640 1 -- 172.21.15.63:0/3653004823 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f4005560 con 0x55b7072ea070 2024-09-21T06:37:32.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.340+0000 7f281247d740 1 -- 172.21.15.63:0/3653004823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072ea070 msgr2=0x55b7076912c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:32.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.340+0000 7f280a4a6640 1 --2- 172.21.15.63:0/627026955 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27f00b6680 0x7f27f00b8b90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0e4500 tx=0x7f27fc014c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:32.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.340+0000 7f281247d740 1 --2- 172.21.15.63:0/3653004823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072ea070 0x55b7076912c0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f27f4033000 tx=0x7f27f4000bc0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.340+0000 7f281247d740 1 -- 172.21.15.63:0/3653004823 shutdown_connections 2024-09-21T06:37:32.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.340+0000 7f281247d740 1 --2- 172.21.15.63:0/3653004823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7072c9390 0x55b707691d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.340+0000 7f281247d740 1 --2- 172.21.15.63:0/3653004823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072c11b0 0x55b707691800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.340+0000 7f281247d740 1 --2- 172.21.15.63:0/3653004823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072ea070 0x55b7076912c0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.340+0000 7f281247d740 1 -- 172.21.15.63:0/3653004823 >> 172.21.15.63:0/3653004823 conn(0x55b7072de460 msgr2=0x55b70768f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:32.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.340+0000 7f281247d740 1 -- 172.21.15.63:0/3653004823 shutdown_connections 2024-09-21T06:37:32.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.340+0000 7f281247d740 1 -- 172.21.15.63:0/3653004823 wait complete. 2024-09-21T06:37:32.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.341+0000 7f281247d740 1 -- start start 2024-09-21T06:37:32.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.341+0000 7f281247d740 1 Processor -- start 2024-09-21T06:37:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.341+0000 7f281247d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072c11b0 0x55b70769c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.341+0000 7f281247d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7072c9390 0x55b70769ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.341+0000 7f281247d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072ea070 0x55b70769d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.341+0000 7f281247d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55b707458700 con 0x55b7072c11b0 2024-09-21T06:37:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.341+0000 7f281247d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b707592160 con 0x55b7072ea070 2024-09-21T06:37:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.341+0000 7f281247d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b70769fa40 con 0x55b7072c9390 2024-09-21T06:37:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.341+0000 7f281247d740 10 client.0 _ll_register_callbacks cb 0x55b7075ab9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.341+0000 7f28094a4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072c11b0 0x55b70769c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.341+0000 7f28094a4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072c11b0 0x55b70769c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58552/0 (socket says 172.21.15.63:58552) 2024-09-21T06:37:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.341+0000 7f28094a4640 1 -- 172.21.15.63:0/3761778642 learned_addr learned my addr 172.21.15.63:0/3761778642 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.342+0000 7f28094a4640 1 --2- 172.21.15.63:0/3761778642 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072ea070 0x55b70769d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.342+0000 7f28094a4640 1 -- 172.21.15.63:0/3761778642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7072c9390 msgr2=0x55b70769ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.342+0000 7f28094a4640 1 --2- 172.21.15.63:0/3761778642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7072c9390 0x55b70769ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.342+0000 7f28094a4640 1 -- 172.21.15.63:0/3761778642 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072ea070 msgr2=0x55b70769d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:32.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.342+0000 7f28094a4640 1 --2- 172.21.15.63:0/3761778642 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072ea070 0x55b70769d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.342+0000 7f28094a4640 1 -- 172.21.15.63:0/3761778642 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7075bfc90 con 0x55b7072c11b0 2024-09-21T06:37:32.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.342+0000 7f28094a4640 1 --2- 172.21.15.63:0/3761778642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072c11b0 0x55b70769c910 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f27f4031440 tx=0x7f27f402ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19615d3ea8dc8ce6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:32.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.342+0000 7f27ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:37:32.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.342+0000 7f27ed7fa640 1 -- 172.21.15.63:0/3761778642 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f4052060 con 0x55b7072c11b0 2024-09-21T06:37:32.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.342+0000 7f27ed7fa640 1 -- 172.21.15.63:0/3761778642 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7f27f4004050 con 0x55b7072c11b0 2024-09-21T06:37:32.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.342+0000 7f281247d740 1 -- 172.21.15.63:0/3761778642 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27f4044070 con 0x55b7072c11b0 2024-09-21T06:37:32.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.342+0000 7f27ed7fa640 1 -- 172.21.15.63:0/3761778642 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f27f4035070 con 0x55b7072c11b0 2024-09-21T06:37:32.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.342+0000 7f281247d740 10 client.17394 fetch_fsmap learned FSMap version 61 2024-09-21T06:37:32.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.342+0000 7f281247d740 1 -- 172.21.15.63:0/3761778642 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55b7076ab6c0 con 0x55b7072c11b0 2024-09-21T06:37:32.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.342+0000 7f27ed7fa640 1 -- 172.21.15.63:0/3761778642 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27f4044070 con 0x55b7072c11b0 2024-09-21T06:37:32.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.343+0000 7f27ed7fa640 1 -- 172.21.15.63:0/3761778642 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f27f4003ce0 con 0x55b7072c11b0 2024-09-21T06:37:32.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.343+0000 7f281247d740 10 client.17394 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:37:32.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.343+0000 7f281247d740 10 client.17394 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:37:32.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.343+0000 7f281247d740 20 client.17394 populate_metadata read hostname 'smithi063' 2024-09-21T06:37:32.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.343+0000 7f281247d740 1 --2- 172.21.15.63:0/3761778642 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55b7072a89f0 0x55b7076aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:32.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.343+0000 7f281247d740 4 client.17394 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:32.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.343+0000 7f281247d740 1 -- 172.21.15.63:0/3761778642 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b707609df0 con 0x55b7072a89f0 2024-09-21T06:37:32.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.343+0000 7f2809ca5640 1 --2- 172.21.15.63:0/3761778642 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55b7072a89f0 0x55b7076aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:32.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.344+0000 7f27ed7fa640 10 client.17394 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:37:32.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.344+0000 7f2809ca5640 1 --2- 172.21.15.63:0/3761778642 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55b7072a89f0 0x55b7076aea20 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9d1bd60628939e14 server_cookie=dd57ed6cf9ecdc0a in_seq=0 out_seq=0 2024-09-21T06:37:32.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.344+0000 7f27ed7fa640 1 -- 172.21.15.63:0/3761778642 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b707609df0 con 0x55b7072a89f0 2024-09-21T06:37:32.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.344+0000 7f27ed7fa640 10 client.17394 handle_command_reply: tid=0 2024-09-21T06:37:32.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.344+0000 7f281247d740 1 client.17394 shutdown 2024-09-21T06:37:32.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.344+0000 7f281247d740 1 -- 172.21.15.63:0/3761778642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072c11b0 msgr2=0x55b70769c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:32.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.344+0000 7f281247d740 1 --2- 172.21.15.63:0/3761778642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072c11b0 0x55b70769c910 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f27f4031440 tx=0x7f27f402ab90 comp rx=0 tx=0).stop 2024-09-21T06:37:32.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.345+0000 7f281247d740 1 -- 172.21.15.63:0/3761778642 shutdown_connections 2024-09-21T06:37:32.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.345+0000 7f281247d740 1 --2- 172.21.15.63:0/3761778642 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55b7072a89f0 0x55b7076aea20 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.345+0000 7f281247d740 1 --2- 172.21.15.63:0/3761778642 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072ea070 0x55b70769d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.345+0000 7f281247d740 1 --2- 172.21.15.63:0/3761778642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7072c9390 0x55b70769ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.345+0000 7f281247d740 1 --2- 172.21.15.63:0/3761778642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072c11b0 0x55b70769c910 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.345+0000 7f27ed7fa640 0 client.17394 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:37:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.345+0000 7f281247d740 1 -- 172.21.15.63:0/3761778642 >> 172.21.15.63:0/3761778642 conn(0x55b7072de460 msgr2=0x55b7076944a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.345+0000 7f281247d740 1 -- 172.21.15.63:0/3761778642 shutdown_connections 2024-09-21T06:37:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.345+0000 7f281247d740 1 -- 172.21.15.63:0/3761778642 wait complete. 2024-09-21T06:37:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.345+0000 7f281247d740 20 client.17394 trim_cache size 0 max 16384 2024-09-21T06:37:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.358+0000 7f281247d740 1 Processor -- start 2024-09-21T06:37:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.358+0000 7f281247d740 1 -- start start 2024-09-21T06:37:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.358+0000 7f281247d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072a89f0 0x55b707692cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.358+0000 7f281247d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072c11b0 0x55b70769e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.358+0000 7f281247d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7072c9390 0x55b70768e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.358+0000 7f281247d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f28041af710 con 0x55b7072a89f0 2024-09-21T06:37:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.358+0000 7f281247d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f28041b1250 con 0x55b7072c11b0 2024-09-21T06:37:32.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.358+0000 7f281247d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f28041afde0 con 0x55b7072c9390 2024-09-21T06:37:32.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.358+0000 7f28094a4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072a89f0 0x55b707692cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:32.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.358+0000 7f28094a4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072a89f0 0x55b707692cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58564/0 (socket says 172.21.15.63:58564) 2024-09-21T06:37:32.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.358+0000 7f28094a4640 1 -- 172.21.15.63:0/2703147912 learned_addr learned my addr 172.21.15.63:0/2703147912 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:32.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.358+0000 7f2809ca5640 1 --2- 172.21.15.63:0/2703147912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072c11b0 0x55b70769e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:32.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.359+0000 7f28094a4640 1 --2- 172.21.15.63:0/2703147912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7072c9390 0x55b70768e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:32.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.359+0000 7f28094a4640 1 -- 172.21.15.63:0/2703147912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7072c9390 msgr2=0x55b70768e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:32.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.359+0000 7f28094a4640 1 --2- 172.21.15.63:0/2703147912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7072c9390 0x55b70768e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.359+0000 7f28094a4640 1 -- 172.21.15.63:0/2703147912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072c11b0 msgr2=0x55b70769e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:32.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.359+0000 7f28094a4640 1 --2- 172.21.15.63:0/2703147912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072c11b0 0x55b70769e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.359+0000 7f28094a4640 1 -- 172.21.15.63:0/2703147912 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b70769f670 con 0x55b7072a89f0 2024-09-21T06:37:32.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.359+0000 7f28094a4640 1 --2- 172.21.15.63:0/2703147912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072a89f0 0x55b707692cb0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f27f40059d0 tx=0x7f27f4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248494f2e68bce5a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:32.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.359+0000 7f27ef7fe640 1 -- 172.21.15.63:0/2703147912 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f4052040 con 0x55b7072a89f0 2024-09-21T06:37:32.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.359+0000 7f27ef7fe640 1 -- 172.21.15.63:0/2703147912 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27f4044070 con 0x55b7072a89f0 2024-09-21T06:37:32.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.359+0000 7f27ef7fe640 1 -- 172.21.15.63:0/2703147912 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f403db30 con 0x55b7072a89f0 2024-09-21T06:37:32.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.360+0000 7f281247d740 1 -- 172.21.15.63:0/2703147912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072a89f0 msgr2=0x55b707692cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:32.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.360+0000 7f281247d740 1 --2- 172.21.15.63:0/2703147912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072a89f0 0x55b707692cb0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f27f40059d0 tx=0x7f27f4000bc0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.360+0000 7f281247d740 1 -- 172.21.15.63:0/2703147912 shutdown_connections 2024-09-21T06:37:32.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.360+0000 7f281247d740 1 --2- 172.21.15.63:0/2703147912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7072c9390 0x55b70768e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.360+0000 7f281247d740 1 --2- 172.21.15.63:0/2703147912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072c11b0 0x55b70769e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.360+0000 7f281247d740 1 --2- 172.21.15.63:0/2703147912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072a89f0 0x55b707692cb0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.360+0000 7f281247d740 1 -- 172.21.15.63:0/2703147912 >> 172.21.15.63:0/2703147912 conn(0x55b7072de460 msgr2=0x55b70769de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:32.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.360+0000 7f281247d740 1 -- 172.21.15.63:0/2703147912 shutdown_connections 2024-09-21T06:37:32.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.360+0000 7f281247d740 1 -- 172.21.15.63:0/2703147912 wait complete. 2024-09-21T06:37:32.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.360+0000 7f281247d740 1 -- start start 2024-09-21T06:37:32.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.360+0000 7f281247d740 1 Processor -- start 2024-09-21T06:37:32.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.361+0000 7f281247d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072a89f0 0x55b7076afb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:32.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.361+0000 7f281247d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072c11b0 0x55b7076b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:32.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.361+0000 7f281247d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7072c9390 0x55b7076b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:32.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.361+0000 7f281247d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f28041b0b80 con 0x55b7072c11b0 2024-09-21T06:37:32.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.361+0000 7f281247d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f28041b04b0 con 0x55b7072a89f0 2024-09-21T06:37:32.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.361+0000 7f281247d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f28041ad710 con 0x55b7072c9390 2024-09-21T06:37:32.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.361+0000 7f281247d740 10 client.0 _ll_register_callbacks cb 0x7f280000c2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:32.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.361+0000 7f2809ca5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072c11b0 0x55b7076b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:32.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.361+0000 7f2809ca5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072c11b0 0x55b7076b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58566/0 (socket says 172.21.15.63:58566) 2024-09-21T06:37:32.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.361+0000 7f2809ca5640 1 -- 172.21.15.63:0/3026055321 learned_addr learned my addr 172.21.15.63:0/3026055321 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:32.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.361+0000 7f28094a4640 1 --2- 172.21.15.63:0/3026055321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072a89f0 0x55b7076afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:32.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.361+0000 7f28094a4640 1 --2- 172.21.15.63:0/3026055321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7072c9390 0x55b7076b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:32.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.361+0000 7f2809ca5640 1 -- 172.21.15.63:0/3026055321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7072c9390 msgr2=0x55b7076b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:32.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.361+0000 7f2809ca5640 1 --2- 172.21.15.63:0/3026055321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7072c9390 0x55b7076b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.361+0000 7f2809ca5640 1 -- 172.21.15.63:0/3026055321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072a89f0 msgr2=0x55b7076afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.361+0000 7f2809ca5640 1 --2- 172.21.15.63:0/3026055321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072a89f0 0x55b7076afb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.361+0000 7f2809ca5640 1 -- 172.21.15.63:0/3026055321 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7077182d0 con 0x55b7072c11b0 2024-09-21T06:37:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.361+0000 7f28094a4640 1 --2- 172.21.15.63:0/3026055321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072a89f0 0x55b7076afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.361+0000 7f2809ca5640 1 --2- 172.21.15.63:0/3026055321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072c11b0 0x55b7076b00a0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x55b707592230 tx=0x7f2800005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=accc0b42dcc148ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.361+0000 7f27ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:37:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.362+0000 7f27ed7fa640 1 -- 172.21.15.63:0/3026055321 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2800004220 con 0x55b7072c11b0 2024-09-21T06:37:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.362+0000 7f27ed7fa640 1 -- 172.21.15.63:0/3026055321 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7f28000043c0 con 0x55b7072c11b0 2024-09-21T06:37:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.362+0000 7f281247d740 1 -- 172.21.15.63:0/3026055321 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27f4044070 con 0x55b7072c11b0 2024-09-21T06:37:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.362+0000 7f27ed7fa640 1 -- 172.21.15.63:0/3026055321 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f28000035f0 con 0x55b7072c11b0 2024-09-21T06:37:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.362+0000 7f281247d740 10 client.17400 fetch_fsmap learned FSMap version 61 2024-09-21T06:37:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.362+0000 7f281247d740 1 -- 172.21.15.63:0/3026055321 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55b7077195c0 con 0x55b7072c11b0 2024-09-21T06:37:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.362+0000 7f27ed7fa640 1 -- 172.21.15.63:0/3026055321 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27f4044070 con 0x55b7072c11b0 2024-09-21T06:37:32.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.362+0000 7f27ed7fa640 1 -- 172.21.15.63:0/3026055321 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f2800021760 con 0x55b7072c11b0 2024-09-21T06:37:32.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.362+0000 7f281247d740 10 client.17400 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:37:32.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.362+0000 7f281247d740 10 client.17400 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:37:32.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.362+0000 7f281247d740 20 client.17400 populate_metadata read hostname 'smithi063' 2024-09-21T06:37:32.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.362+0000 7f281247d740 1 --2- 172.21.15.63:0/3026055321 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55b7072ea070 0x55b70771bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:32.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.362+0000 7f281247d740 4 client.17400 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:37:32.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.362+0000 7f281247d740 1 -- 172.21.15.63:0/3026055321 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b7076058a0 con 0x55b7072ea070 2024-09-21T06:37:32.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.363+0000 7f28094a4640 1 --2- 172.21.15.63:0/3026055321 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55b7072ea070 0x55b70771bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:32.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.363+0000 7f27ed7fa640 10 client.17400 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:37:32.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.363+0000 7f28094a4640 1 --2- 172.21.15.63:0/3026055321 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55b7072ea070 0x55b70771bdb0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ee1e32f3c8d15ceb server_cookie=16ce6e52ba20b60a in_seq=0 out_seq=0 2024-09-21T06:37:32.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.364+0000 7f27ed7fa640 1 -- 172.21.15.63:0/3026055321 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b7076058a0 con 0x55b7072ea070 2024-09-21T06:37:32.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.364+0000 7f27ed7fa640 10 client.17400 handle_command_reply: tid=0 2024-09-21T06:37:32.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.364+0000 7f281247d740 1 client.17400 shutdown 2024-09-21T06:37:32.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.364+0000 7f281247d740 1 -- 172.21.15.63:0/3026055321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072c11b0 msgr2=0x55b7076b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:32.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.364+0000 7f281247d740 1 --2- 172.21.15.63:0/3026055321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072c11b0 0x55b7076b00a0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x55b707592230 tx=0x7f2800005520 comp rx=0 tx=0).stop 2024-09-21T06:37:32.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.364+0000 7f281247d740 1 -- 172.21.15.63:0/3026055321 shutdown_connections 2024-09-21T06:37:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.364+0000 7f281247d740 1 --2- 172.21.15.63:0/3026055321 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55b7072ea070 0x55b70771bdb0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.364+0000 7f281247d740 1 --2- 172.21.15.63:0/3026055321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7072c9390 0x55b7076b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.364+0000 7f281247d740 1 --2- 172.21.15.63:0/3026055321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b7072c11b0 0x55b7076b00a0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.364+0000 7f27ed7fa640 0 client.17400 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:37:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.364+0000 7f281247d740 1 --2- 172.21.15.63:0/3026055321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b7072a89f0 0x55b7076afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.364+0000 7f281247d740 1 -- 172.21.15.63:0/3026055321 >> 172.21.15.63:0/3026055321 conn(0x55b7072de460 msgr2=0x55b707692b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.364+0000 7f281247d740 1 -- 172.21.15.63:0/3026055321 shutdown_connections 2024-09-21T06:37:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.364+0000 7f281247d740 1 -- 172.21.15.63:0/3026055321 wait complete. 2024-09-21T06:37:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.364+0000 7f281247d740 20 client.17400 trim_cache size 0 max 16384 2024-09-21T06:37:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.364+0000 7f280bf09640 1 -- 172.21.15.63:0/627026955 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27f00b6680 msgr2=0x7f27f00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.364+0000 7f280bf09640 1 --2- 172.21.15.63:0/627026955 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27f00b6680 0x7f27f00b8b90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0e4500 tx=0x7f27fc014c50 comp rx=0 tx=0).stop 2024-09-21T06:37:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.364+0000 7f280bf09640 1 -- 172.21.15.63:0/627026955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2804109df0 msgr2=0x7f280419fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.364+0000 7f280bf09640 1 --2- 172.21.15.63:0/627026955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2804109df0 0x7f280419fda0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00b990 tx=0x7f27fc00be50 comp rx=0 tx=0).stop 2024-09-21T06:37:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.365+0000 7f280bf09640 1 -- 172.21.15.63:0/627026955 shutdown_connections 2024-09-21T06:37:32.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.365+0000 7f280bf09640 1 --2- 172.21.15.63:0/627026955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2804109df0 0x7f280419fda0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.365+0000 7f280bf09640 1 --2- 172.21.15.63:0/627026955 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f27f00b6680 0x7f27f00b8b90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.365+0000 7f280bf09640 1 --2- 172.21.15.63:0/627026955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28041094a0 0x7f280419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.365+0000 7f280bf09640 1 --2- 172.21.15.63:0/627026955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2804103b60 0x7f280419a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:32.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.365+0000 7f280bf09640 1 -- 172.21.15.63:0/627026955 >> 172.21.15.63:0/627026955 conn(0x7f280407b850 msgr2=0x7f2804107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:32.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.365+0000 7f280bf09640 1 -- 172.21.15.63:0/627026955 shutdown_connections 2024-09-21T06:37:32.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:32.365+0000 7f280bf09640 1 -- 172.21.15.63:0/627026955 wait complete. 2024-09-21T06:37:33.058 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:37:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:33.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:33 smithi063 ceph-mon[31150]: pgmap v609: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:37:33.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:33 smithi071 ceph-mon[34844]: pgmap v609: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:37:33.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:33 smithi175 ceph-mon[34510]: pgmap v609: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:37:33.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.858+0000 7f763d552640 1 -- 172.21.15.63:0/3766296993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7638105370 msgr2=0x7f763810d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:33.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.858+0000 7f763d552640 1 --2- 172.21.15.63:0/3766296993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7638105370 0x7f763810d8c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f7620009900 tx=0x7f762002a410 comp rx=0 tx=0).stop 2024-09-21T06:37:33.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.859+0000 7f763d552640 1 -- 172.21.15.63:0/3766296993 shutdown_connections 2024-09-21T06:37:33.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.859+0000 7f763d552640 1 --2- 172.21.15.63:0/3766296993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f763810de50 0x7f7638110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.859+0000 7f763d552640 1 --2- 172.21.15.63:0/3766296993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7638105370 0x7f763810d8c0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.859+0000 7f763d552640 1 --2- 172.21.15.63:0/3766296993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7638104a20 0x7f7638104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.859+0000 7f763d552640 1 -- 172.21.15.63:0/3766296993 >> 172.21.15.63:0/3766296993 conn(0x7f76380796d0 msgr2=0x7f7638079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:33.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.859+0000 7f763d552640 1 -- 172.21.15.63:0/3766296993 shutdown_connections 2024-09-21T06:37:33.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.859+0000 7f763d552640 1 -- 172.21.15.63:0/3766296993 wait complete. 2024-09-21T06:37:33.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.859+0000 7f763d552640 1 Processor -- start 2024-09-21T06:37:33.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.860+0000 7f763d552640 1 -- start start 2024-09-21T06:37:33.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.860+0000 7f763d552640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7638104a20 0x7f7638102760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:33.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.860+0000 7f763d552640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7638105370 0x7f7638102ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:33.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.860+0000 7f763d552640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f763810de50 0x7f76381031e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:33.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.860+0000 7f763d552640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7638113a90 con 0x7f763810de50 2024-09-21T06:37:33.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.860+0000 7f763d552640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7638113910 con 0x7f7638105370 2024-09-21T06:37:33.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.860+0000 7f763d552640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7638113c10 con 0x7f7638104a20 2024-09-21T06:37:33.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.860+0000 7f76377fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f763810de50 0x7f76381031e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:33.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.860+0000 7f7636ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7638104a20 0x7f7638102760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:33.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.860+0000 7f76377fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f763810de50 0x7f76381031e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58586/0 (socket says 172.21.15.63:58586) 2024-09-21T06:37:33.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.860+0000 7f76377fe640 1 -- 172.21.15.63:0/1692785455 learned_addr learned my addr 172.21.15.63:0/1692785455 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:33.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.860+0000 7f762e7fc640 1 --2- 172.21.15.63:0/1692785455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7638105370 0x7f7638102ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:33.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.860+0000 7f7636ffd640 1 -- 172.21.15.63:0/1692785455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7638105370 msgr2=0x7f7638102ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:33.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.860+0000 7f7636ffd640 1 --2- 172.21.15.63:0/1692785455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7638105370 0x7f7638102ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.860+0000 7f7636ffd640 1 -- 172.21.15.63:0/1692785455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f763810de50 msgr2=0x7f76381031e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:33.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.860+0000 7f7636ffd640 1 --2- 172.21.15.63:0/1692785455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f763810de50 0x7f76381031e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.860+0000 7f7636ffd640 1 -- 172.21.15.63:0/1692785455 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76381a8740 con 0x7f7638104a20 2024-09-21T06:37:33.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.860+0000 7f76377fe640 1 --2- 172.21.15.63:0/1692785455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f763810de50 0x7f76381031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:33.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.861+0000 7f7636ffd640 1 --2- 172.21.15.63:0/1692785455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7638104a20 0x7f7638102760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f762800e9f0 tx=0x7f762800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:33.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.861+0000 7f7634ff9640 1 -- 172.21.15.63:0/1692785455 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762800ccc0 con 0x7f7638104a20 2024-09-21T06:37:33.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.861+0000 7f7634ff9640 1 -- 172.21.15.63:0/1692785455 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76280108e0 con 0x7f7638104a20 2024-09-21T06:37:33.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.861+0000 7f763d552640 1 -- 172.21.15.63:0/1692785455 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76381a8a30 con 0x7f7638104a20 2024-09-21T06:37:33.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.861+0000 7f7634ff9640 1 -- 172.21.15.63:0/1692785455 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7628018880 con 0x7f7638104a20 2024-09-21T06:37:33.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.861+0000 7f763d552640 1 -- 172.21.15.63:0/1692785455 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76381a8f40 con 0x7f7638104a20 2024-09-21T06:37:33.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.864+0000 7f7643ac6740 1 Processor -- start 2024-09-21T06:37:33.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.864+0000 7f7634ff9640 1 -- 172.21.15.63:0/1692785455 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f7628010430 con 0x7f7638104a20 2024-09-21T06:37:33.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.864+0000 7f7643ac6740 1 -- start start 2024-09-21T06:37:33.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.864+0000 7f7643ac6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b916070 0x55d42bcbd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:33.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.864+0000 7f7643ac6740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8ed1b0 0x55d42bcbdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:33.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.864+0000 7f7643ac6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b8f5390 0x55d42bcbe120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:33.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.864+0000 7f7643ac6740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d42bc33ea0 con 0x55d42b8ed1b0 2024-09-21T06:37:33.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.864+0000 7f7643ac6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d42bc232d0 con 0x55d42b916070 2024-09-21T06:37:33.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.864+0000 7f7643ac6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d42bc270e0 con 0x55d42b8f5390 2024-09-21T06:37:33.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.864+0000 7f7636ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8ed1b0 0x55d42bcbdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:33.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.864+0000 7f762e7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b8f5390 0x55d42bcbe120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:33.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.864+0000 7f76377fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b916070 0x55d42bcbd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:33.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.864+0000 7f762e7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b8f5390 0x55d42bcbe120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:58850/0 (socket says 172.21.15.63:58850) 2024-09-21T06:37:33.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.864+0000 7f762e7fc640 1 -- 172.21.15.63:0/132544567 learned_addr learned my addr 172.21.15.63:0/132544567 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:33.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.865+0000 7f76377fe640 1 -- 172.21.15.63:0/132544567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b8f5390 msgr2=0x55d42bcbe120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:33.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.865+0000 7f76377fe640 1 --2- 172.21.15.63:0/132544567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b8f5390 0x55d42bcbe120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.865+0000 7f76377fe640 1 -- 172.21.15.63:0/132544567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8ed1b0 msgr2=0x55d42bcbdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:33.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.865+0000 7f76377fe640 1 --2- 172.21.15.63:0/132544567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8ed1b0 0x55d42bcbdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.865+0000 7f76377fe640 1 -- 172.21.15.63:0/132544567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d42b981650 con 0x55d42b916070 2024-09-21T06:37:33.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.865+0000 7f76377fe640 1 --2- 172.21.15.63:0/132544567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b916070 0x55d42bcbd6a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f76300117e0 tx=0x7f7630011ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60b283c0cd074293 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:33.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.865+0000 7f762d7fa640 1 -- 172.21.15.63:0/132544567 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7630011310 con 0x55d42b916070 2024-09-21T06:37:33.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.865+0000 7f762d7fa640 1 -- 172.21.15.63:0/132544567 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f763000f9a0 con 0x55d42b916070 2024-09-21T06:37:33.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.865+0000 7f762d7fa640 1 -- 172.21.15.63:0/132544567 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76300055f0 con 0x55d42b916070 2024-09-21T06:37:33.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.865+0000 7f7634ff9640 1 --2- 172.21.15.63:0/1692785455 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f76240b6680 0x7f76240b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:33.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.866+0000 7f7636ffd640 1 --2- 172.21.15.63:0/1692785455 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f76240b6680 0x7f76240b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:33.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.866+0000 7f7634ff9640 1 -- 172.21.15.63:0/1692785455 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7f76280e7aa0 con 0x7f7638104a20 2024-09-21T06:37:33.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.866+0000 7f7643ac6740 1 -- 172.21.15.63:0/132544567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b916070 msgr2=0x55d42bcbd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:33.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.866+0000 7f7636ffd640 1 --2- 172.21.15.63:0/1692785455 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f76240b6680 0x7f76240b8b90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f76280e5250 tx=0x7f76280eb5f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:33.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.866+0000 7f7643ac6740 1 --2- 172.21.15.63:0/132544567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b916070 0x55d42bcbd6a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f76300117e0 tx=0x7f7630011ca0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.866+0000 7f7643ac6740 1 -- 172.21.15.63:0/132544567 shutdown_connections 2024-09-21T06:37:33.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.866+0000 7f7643ac6740 1 --2- 172.21.15.63:0/132544567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b8f5390 0x55d42bcbe120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.866+0000 7f7643ac6740 1 --2- 172.21.15.63:0/132544567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8ed1b0 0x55d42bcbdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.866+0000 7f7643ac6740 1 --2- 172.21.15.63:0/132544567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b916070 0x55d42bcbd6a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.866+0000 7f7643ac6740 1 -- 172.21.15.63:0/132544567 >> 172.21.15.63:0/132544567 conn(0x55d42b90a460 msgr2=0x55d42bcbb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:33.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.866+0000 7f7643ac6740 1 -- 172.21.15.63:0/132544567 shutdown_connections 2024-09-21T06:37:33.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.866+0000 7f7643ac6740 1 -- 172.21.15.63:0/132544567 wait complete. 2024-09-21T06:37:33.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.867+0000 7f7643ac6740 1 -- start start 2024-09-21T06:37:33.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.867+0000 7f7643ac6740 1 Processor -- start 2024-09-21T06:37:33.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.867+0000 7f7643ac6740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8ed1b0 0x55d42bcc8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:33.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.867+0000 7f7643ac6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b8f5390 0x55d42bcc9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:33.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.867+0000 7f7643ac6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b916070 0x55d42bcc96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:33.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.867+0000 7f7643ac6740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d42ba84700 con 0x55d42b8ed1b0 2024-09-21T06:37:33.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.867+0000 7f7643ac6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d42bbbe160 con 0x55d42b8f5390 2024-09-21T06:37:33.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.867+0000 7f7643ac6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d42bccbe80 con 0x55d42b916070 2024-09-21T06:37:33.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.867+0000 7f7643ac6740 10 client.0 _ll_register_callbacks cb 0x55d42bbd79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:33.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.867+0000 7f76377fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8ed1b0 0x55d42bcc8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:33.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.867+0000 7f762e7fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b8f5390 0x55d42bcc9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:33.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.867+0000 7f76377fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8ed1b0 0x55d42bcc8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58612/0 (socket says 172.21.15.63:58612) 2024-09-21T06:37:33.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.867+0000 7f762e7fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b8f5390 0x55d42bcc9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:52608/0 (socket says 172.21.15.63:52608) 2024-09-21T06:37:33.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.867+0000 7f76377fe640 1 -- 172.21.15.63:0/972355412 learned_addr learned my addr 172.21.15.63:0/972355412 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:33.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.867+0000 7f76377fe640 1 --2- 172.21.15.63:0/972355412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b916070 0x55d42bcc96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:33.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.868+0000 7f76377fe640 1 -- 172.21.15.63:0/972355412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b916070 msgr2=0x55d42bcc96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:33.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.868+0000 7f76377fe640 1 --2- 172.21.15.63:0/972355412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b916070 0x55d42bcc96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.868+0000 7f76377fe640 1 -- 172.21.15.63:0/972355412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b8f5390 msgr2=0x55d42bcc9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:33.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.868+0000 7f76377fe640 1 --2- 172.21.15.63:0/972355412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b8f5390 0x55d42bcc9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.868+0000 7f76377fe640 1 -- 172.21.15.63:0/972355412 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d42bbebc90 con 0x55d42b8ed1b0 2024-09-21T06:37:33.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.868+0000 7f762e7fc640 1 --2- 172.21.15.63:0/972355412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b8f5390 0x55d42bcc9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:33.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.868+0000 7f76377fe640 1 --2- 172.21.15.63:0/972355412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8ed1b0 0x55d42bcc8c50 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f7630000f80 tx=0x7f7630005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6938c94c7cebfd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:33.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.868+0000 7f761e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:37:33.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.868+0000 7f761e7fc640 1 -- 172.21.15.63:0/972355412 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763002e060 con 0x55d42b8ed1b0 2024-09-21T06:37:33.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.868+0000 7f7643ac6740 1 -- 172.21.15.63:0/972355412 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f763000f9a0 con 0x55d42b8ed1b0 2024-09-21T06:37:33.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.868+0000 7f761e7fc640 1 -- 172.21.15.63:0/972355412 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7f7630005330 con 0x55d42b8ed1b0 2024-09-21T06:37:33.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.868+0000 7f761e7fc640 1 -- 172.21.15.63:0/972355412 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f7630005530 con 0x55d42b8ed1b0 2024-09-21T06:37:33.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.868+0000 7f7643ac6740 10 client.17412 fetch_fsmap learned FSMap version 61 2024-09-21T06:37:33.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.868+0000 7f7643ac6740 1 -- 172.21.15.63:0/972355412 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55d42bcd7a80 con 0x55d42b8ed1b0 2024-09-21T06:37:33.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.868+0000 7f761e7fc640 1 -- 172.21.15.63:0/972355412 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f763000f9a0 con 0x55d42b8ed1b0 2024-09-21T06:37:33.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.869+0000 7f761e7fc640 1 -- 172.21.15.63:0/972355412 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f7630018070 con 0x55d42b8ed1b0 2024-09-21T06:37:33.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.869+0000 7f7643ac6740 10 client.17412 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:37:33.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.869+0000 7f7643ac6740 10 client.17412 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:37:33.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.869+0000 7f7643ac6740 20 client.17412 populate_metadata read hostname 'smithi063' 2024-09-21T06:37:33.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.869+0000 7f7643ac6740 1 --2- 172.21.15.63:0/972355412 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d42b8d49f0 0x55d42bcdade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:33.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.869+0000 7f7643ac6740 4 client.17412 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:33.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.869+0000 7f7643ac6740 1 -- 172.21.15.63:0/972355412 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d42bc35df0 con 0x55d42b8d49f0 2024-09-21T06:37:33.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.869+0000 7f762e7fc640 1 --2- 172.21.15.63:0/972355412 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d42b8d49f0 0x55d42bcdade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:33.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.869+0000 7f761e7fc640 10 client.17412 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:37:33.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.869+0000 7f762e7fc640 1 --2- 172.21.15.63:0/972355412 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d42b8d49f0 0x55d42bcdade0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a038753834503bb9 server_cookie=76948aeb4a086c74 in_seq=0 out_seq=0 2024-09-21T06:37:33.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.870+0000 7f761e7fc640 1 -- 172.21.15.63:0/972355412 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d42bc35df0 con 0x55d42b8d49f0 2024-09-21T06:37:33.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.870+0000 7f761e7fc640 10 client.17412 handle_command_reply: tid=0 2024-09-21T06:37:33.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.870+0000 7f7643ac6740 1 client.17412 shutdown 2024-09-21T06:37:33.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.870+0000 7f7643ac6740 1 -- 172.21.15.63:0/972355412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8ed1b0 msgr2=0x55d42bcc8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:33.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.870+0000 7f7643ac6740 1 --2- 172.21.15.63:0/972355412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8ed1b0 0x55d42bcc8c50 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f7630000f80 tx=0x7f7630005000 comp rx=0 tx=0).stop 2024-09-21T06:37:33.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.870+0000 7f7643ac6740 1 -- 172.21.15.63:0/972355412 shutdown_connections 2024-09-21T06:37:33.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.870+0000 7f7643ac6740 1 --2- 172.21.15.63:0/972355412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b916070 0x55d42bcc96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.870+0000 7f7643ac6740 1 --2- 172.21.15.63:0/972355412 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d42b8d49f0 0x55d42bcdade0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.870+0000 7f7643ac6740 1 --2- 172.21.15.63:0/972355412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b8f5390 0x55d42bcc9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.870+0000 7f7643ac6740 1 --2- 172.21.15.63:0/972355412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8ed1b0 0x55d42bcc8c50 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.870+0000 7f761e7fc640 0 client.17412 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:37:33.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.870+0000 7f7643ac6740 1 -- 172.21.15.63:0/972355412 >> 172.21.15.63:0/972355412 conn(0x55d42b90a460 msgr2=0x55d42bcc0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:33.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.870+0000 7f7643ac6740 1 -- 172.21.15.63:0/972355412 shutdown_connections 2024-09-21T06:37:33.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.870+0000 7f7643ac6740 1 -- 172.21.15.63:0/972355412 wait complete. 2024-09-21T06:37:33.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.870+0000 7f7643ac6740 20 client.17412 trim_cache size 0 max 16384 2024-09-21T06:37:33.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.884+0000 7f7643ac6740 1 Processor -- start 2024-09-21T06:37:33.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.884+0000 7f7643ac6740 1 -- start start 2024-09-21T06:37:33.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.884+0000 7f7643ac6740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8d49f0 0x55d42bccab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:33.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.884+0000 7f7643ac6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b8ed1b0 0x55d42bcd4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:33.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.884+0000 7f7643ac6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b8f5390 0x55d42bcbabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:33.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.884+0000 7f7643ac6740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f76381b1a30 con 0x55d42b8d49f0 2024-09-21T06:37:33.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.884+0000 7f7643ac6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f76381b3570 con 0x55d42b8f5390 2024-09-21T06:37:33.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.884+0000 7f7643ac6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f76381b2100 con 0x55d42b8ed1b0 2024-09-21T06:37:33.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.884+0000 7f76377fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8d49f0 0x55d42bccab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:33.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.884+0000 7f76377fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8d49f0 0x55d42bccab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58616/0 (socket says 172.21.15.63:58616) 2024-09-21T06:37:33.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.884+0000 7f76377fe640 1 -- 172.21.15.63:0/3375621779 learned_addr learned my addr 172.21.15.63:0/3375621779 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:33.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.884+0000 7f76377fe640 1 --2- 172.21.15.63:0/3375621779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b8f5390 0x55d42bcbabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:33.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.884+0000 7f76377fe640 1 -- 172.21.15.63:0/3375621779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b8ed1b0 msgr2=0x55d42bcd4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:33.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.884+0000 7f762e7fc640 1 --2- 172.21.15.63:0/3375621779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b8ed1b0 0x55d42bcd4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:33.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.884+0000 7f76377fe640 1 --2- 172.21.15.63:0/3375621779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b8ed1b0 0x55d42bcd4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.884+0000 7f76377fe640 1 -- 172.21.15.63:0/3375621779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b8f5390 msgr2=0x55d42bcbabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:33.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.884+0000 7f76377fe640 1 --2- 172.21.15.63:0/3375621779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b8f5390 0x55d42bcbabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.885+0000 7f76377fe640 1 -- 172.21.15.63:0/3375621779 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d42bcbbaa0 con 0x55d42b8d49f0 2024-09-21T06:37:33.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.885+0000 7f762e7fc640 1 --2- 172.21.15.63:0/3375621779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b8ed1b0 0x55d42bcd4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:33.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.885+0000 7f76377fe640 1 --2- 172.21.15.63:0/3375621779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8d49f0 0x55d42bccab30 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f76300112d0 tx=0x7f76300021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd55a2bc2d46a33 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:33.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.885+0000 7f762cff9640 1 -- 172.21.15.63:0/3375621779 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763002e040 con 0x55d42b8d49f0 2024-09-21T06:37:33.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.885+0000 7f762cff9640 1 -- 172.21.15.63:0/3375621779 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f763001f040 con 0x55d42b8d49f0 2024-09-21T06:37:33.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.885+0000 7f762cff9640 1 -- 172.21.15.63:0/3375621779 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7630005930 con 0x55d42b8d49f0 2024-09-21T06:37:33.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.886+0000 7f7643ac6740 1 -- 172.21.15.63:0/3375621779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8d49f0 msgr2=0x55d42bccab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:33.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.886+0000 7f7643ac6740 1 --2- 172.21.15.63:0/3375621779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8d49f0 0x55d42bccab30 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f76300112d0 tx=0x7f76300021f0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.886+0000 7f7643ac6740 1 -- 172.21.15.63:0/3375621779 shutdown_connections 2024-09-21T06:37:33.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.886+0000 7f7643ac6740 1 --2- 172.21.15.63:0/3375621779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b8f5390 0x55d42bcbabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.886+0000 7f7643ac6740 1 --2- 172.21.15.63:0/3375621779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b8ed1b0 0x55d42bcd4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.886+0000 7f7643ac6740 1 --2- 172.21.15.63:0/3375621779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8d49f0 0x55d42bccab30 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.886+0000 7f7643ac6740 1 -- 172.21.15.63:0/3375621779 >> 172.21.15.63:0/3375621779 conn(0x55d42b90a460 msgr2=0x55d42bcd4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:33.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.886+0000 7f7643ac6740 1 -- 172.21.15.63:0/3375621779 shutdown_connections 2024-09-21T06:37:33.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.886+0000 7f7643ac6740 1 -- 172.21.15.63:0/3375621779 wait complete. 2024-09-21T06:37:33.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.886+0000 7f7643ac6740 1 -- start start 2024-09-21T06:37:33.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.886+0000 7f7643ac6740 1 Processor -- start 2024-09-21T06:37:33.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.887+0000 7f7643ac6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b8d49f0 0x55d42bcd19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:33.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.887+0000 7f7643ac6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b8ed1b0 0x55d42bcccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:33.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.887+0000 7f7643ac6740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8f5390 0x55d42bccd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:33.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.887+0000 7f7643ac6740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f76381b2ea0 con 0x55d42b8f5390 2024-09-21T06:37:33.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.887+0000 7f7643ac6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f76381b27d0 con 0x55d42b8ed1b0 2024-09-21T06:37:33.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.887+0000 7f7643ac6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f76381afa30 con 0x55d42b8d49f0 2024-09-21T06:37:33.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.887+0000 7f7643ac6740 10 client.0 _ll_register_callbacks cb 0x7f76300116e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:33.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.887+0000 7f76377fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8f5390 0x55d42bccd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:33.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.887+0000 7f76377fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8f5390 0x55d42bccd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58632/0 (socket says 172.21.15.63:58632) 2024-09-21T06:37:33.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.887+0000 7f76377fe640 1 -- 172.21.15.63:0/3999908166 learned_addr learned my addr 172.21.15.63:0/3999908166 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:33.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.887+0000 7f76377fe640 1 --2- 172.21.15.63:0/3999908166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b8d49f0 0x55d42bcd19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:33.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.887+0000 7f762e7fc640 1 --2- 172.21.15.63:0/3999908166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b8ed1b0 0x55d42bcccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:33.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.887+0000 7f76377fe640 1 -- 172.21.15.63:0/3999908166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b8d49f0 msgr2=0x55d42bcd19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:33.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.887+0000 7f76377fe640 1 --2- 172.21.15.63:0/3999908166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b8d49f0 0x55d42bcd19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.887+0000 7f76377fe640 1 -- 172.21.15.63:0/3999908166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b8ed1b0 msgr2=0x55d42bcccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:33.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.887+0000 7f76377fe640 1 --2- 172.21.15.63:0/3999908166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b8ed1b0 0x55d42bcccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.887+0000 7f76377fe640 1 -- 172.21.15.63:0/3999908166 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d42bccdcf0 con 0x55d42b8f5390 2024-09-21T06:37:33.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.887+0000 7f76377fe640 1 --2- 172.21.15.63:0/3999908166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8f5390 0x55d42bccd560 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f7630011050 tx=0x7f763000fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f23ffdb8c6e99e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:33.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.887+0000 7f761e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:37:33.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.887+0000 7f761e7fc640 1 -- 172.21.15.63:0/3999908166 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763002e070 con 0x55d42b8f5390 2024-09-21T06:37:33.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.888+0000 7f7643ac6740 1 -- 172.21.15.63:0/3999908166 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f763001f040 con 0x55d42b8f5390 2024-09-21T06:37:33.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.888+0000 7f761e7fc640 1 -- 172.21.15.63:0/3999908166 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7f7630010430 con 0x55d42b8f5390 2024-09-21T06:37:33.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.888+0000 7f761e7fc640 1 -- 172.21.15.63:0/3999908166 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f7630010630 con 0x55d42b8f5390 2024-09-21T06:37:33.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.888+0000 7f7643ac6740 10 client.17418 fetch_fsmap learned FSMap version 61 2024-09-21T06:37:33.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.888+0000 7f7643ac6740 1 -- 172.21.15.63:0/3999908166 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55d42bd45570 con 0x55d42b8f5390 2024-09-21T06:37:33.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.888+0000 7f761e7fc640 1 -- 172.21.15.63:0/3999908166 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f763001f040 con 0x55d42b8f5390 2024-09-21T06:37:33.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.888+0000 7f761e7fc640 1 -- 172.21.15.63:0/3999908166 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f7630018040 con 0x55d42b8f5390 2024-09-21T06:37:33.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.888+0000 7f7643ac6740 10 client.17418 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:37:33.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.888+0000 7f7643ac6740 10 client.17418 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:37:33.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.888+0000 7f7643ac6740 20 client.17418 populate_metadata read hostname 'smithi063' 2024-09-21T06:37:33.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.888+0000 7f7643ac6740 1 --2- 172.21.15.63:0/3999908166 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d42b916070 0x55d42bd47c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:33.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.888+0000 7f7643ac6740 4 client.17418 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:37:33.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.888+0000 7f7643ac6740 1 -- 172.21.15.63:0/3999908166 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d42bc318a0 con 0x55d42b916070 2024-09-21T06:37:33.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.888+0000 7f762e7fc640 1 --2- 172.21.15.63:0/3999908166 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d42b916070 0x55d42bd47c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:33.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.889+0000 7f761e7fc640 10 client.17418 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:37:33.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.889+0000 7f762e7fc640 1 --2- 172.21.15.63:0/3999908166 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d42b916070 0x55d42bd47c00 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e701fdbc4b6e4b6f server_cookie=bafd3c6aa32104ed in_seq=0 out_seq=0 2024-09-21T06:37:33.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.889+0000 7f761e7fc640 1 -- 172.21.15.63:0/3999908166 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d42bc318a0 con 0x55d42b916070 2024-09-21T06:37:33.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.889+0000 7f761e7fc640 10 client.17418 handle_command_reply: tid=0 2024-09-21T06:37:33.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.889+0000 7f7643ac6740 1 client.17418 shutdown 2024-09-21T06:37:33.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.889+0000 7f7643ac6740 1 -- 172.21.15.63:0/3999908166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8f5390 msgr2=0x55d42bccd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:33.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.889+0000 7f7643ac6740 1 --2- 172.21.15.63:0/3999908166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8f5390 0x55d42bccd560 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f7630011050 tx=0x7f763000fb20 comp rx=0 tx=0).stop 2024-09-21T06:37:33.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.889+0000 7f7643ac6740 1 -- 172.21.15.63:0/3999908166 shutdown_connections 2024-09-21T06:37:33.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.889+0000 7f7643ac6740 1 --2- 172.21.15.63:0/3999908166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d42b8f5390 0x55d42bccd560 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.889+0000 7f7643ac6740 1 --2- 172.21.15.63:0/3999908166 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55d42b916070 0x55d42bd47c00 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.889+0000 7f7643ac6740 1 --2- 172.21.15.63:0/3999908166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d42b8ed1b0 0x55d42bcccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.889+0000 7f7643ac6740 1 --2- 172.21.15.63:0/3999908166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d42b8d49f0 0x55d42bcd19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.889+0000 7f7643ac6740 1 -- 172.21.15.63:0/3999908166 >> 172.21.15.63:0/3999908166 conn(0x55d42b90a460 msgr2=0x55d42bcd4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:33.920 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:37:33.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.889+0000 7f761e7fc640 0 client.17418 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:37:33.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.889+0000 7f7643ac6740 1 -- 172.21.15.63:0/3999908166 shutdown_connections 2024-09-21T06:37:33.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.889+0000 7f7643ac6740 1 -- 172.21.15.63:0/3999908166 wait complete. 2024-09-21T06:37:33.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.889+0000 7f7643ac6740 20 client.17418 trim_cache size 0 max 16384 2024-09-21T06:37:33.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.890+0000 7f763d552640 1 -- 172.21.15.63:0/1692785455 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f76240b6680 msgr2=0x7f76240b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:33.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.890+0000 7f763d552640 1 --2- 172.21.15.63:0/1692785455 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f76240b6680 0x7f76240b8b90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f76280e5250 tx=0x7f76280eb5f0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.890+0000 7f763d552640 1 -- 172.21.15.63:0/1692785455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7638104a20 msgr2=0x7f7638102760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:33.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.890+0000 7f763d552640 1 --2- 172.21.15.63:0/1692785455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7638104a20 0x7f7638102760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f762800e9f0 tx=0x7f762800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.890+0000 7f763d552640 1 -- 172.21.15.63:0/1692785455 shutdown_connections 2024-09-21T06:37:33.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.890+0000 7f763d552640 1 --2- 172.21.15.63:0/1692785455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f763810de50 0x7f76381031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.890+0000 7f763d552640 1 --2- 172.21.15.63:0/1692785455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7638105370 0x7f7638102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.890+0000 7f763d552640 1 --2- 172.21.15.63:0/1692785455 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f76240b6680 0x7f76240b8b90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.890+0000 7f763d552640 1 --2- 172.21.15.63:0/1692785455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7638104a20 0x7f7638102760 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:33.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.890+0000 7f763d552640 1 -- 172.21.15.63:0/1692785455 >> 172.21.15.63:0/1692785455 conn(0x7f76380796d0 msgr2=0x7f76381008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:33.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.890+0000 7f763d552640 1 -- 172.21.15.63:0/1692785455 shutdown_connections 2024-09-21T06:37:33.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:33.890+0000 7f763d552640 1 -- 172.21.15.63:0/1692785455 wait complete. 2024-09-21T06:37:34.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:34 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:37:34.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:34 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:37:34.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:34 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:37:34.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:34 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:37:34.554 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:34 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:37:34.554 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:34 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:37:34.554 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:34 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:37:34.554 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:34 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:37:34.585 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:37:34.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:34 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:37:34.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:34 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:37:34.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:34 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:37:34.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:34 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:37:34.846 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:35.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.317+0000 7fe3c3d6e640 1 -- 172.21.15.63:0/624598353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3bc103b60 msgr2=0x7fe3bc103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:35.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.317+0000 7fe3c3d6e640 1 --2- 172.21.15.63:0/624598353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3bc103b60 0x7fe3bc103f70 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009900 tx=0x7fe3b802a410 comp rx=0 tx=0).stop 2024-09-21T06:37:35.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.317+0000 7fe3c3d6e640 1 -- 172.21.15.63:0/624598353 shutdown_connections 2024-09-21T06:37:35.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.317+0000 7fe3c3d6e640 1 --2- 172.21.15.63:0/624598353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3bc109df0 0x7fe3bc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.317+0000 7fe3c3d6e640 1 --2- 172.21.15.63:0/624598353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3bc1094a0 0x7fe3bc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.317+0000 7fe3c3d6e640 1 --2- 172.21.15.63:0/624598353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3bc103b60 0x7fe3bc103f70 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.317+0000 7fe3c3d6e640 1 -- 172.21.15.63:0/624598353 >> 172.21.15.63:0/624598353 conn(0x7fe3bc07b850 msgr2=0x7fe3bc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:35.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.317+0000 7fe3c3d6e640 1 -- 172.21.15.63:0/624598353 shutdown_connections 2024-09-21T06:37:35.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.317+0000 7fe3c3d6e640 1 -- 172.21.15.63:0/624598353 wait complete. 2024-09-21T06:37:35.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.318+0000 7fe3c3d6e640 1 Processor -- start 2024-09-21T06:37:35.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.318+0000 7fe3c3d6e640 1 -- start start 2024-09-21T06:37:35.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.318+0000 7fe3c3d6e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3bc103b60 0x7fe3bc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.318+0000 7fe3c3d6e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3bc1094a0 0x7fe3bc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.318+0000 7fe3c3d6e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3bc109df0 0x7fe3bc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.318+0000 7fe3c3d6e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc113ab0 con 0x7fe3bc103b60 2024-09-21T06:37:35.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.318+0000 7fe3c3d6e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc113930 con 0x7fe3bc1094a0 2024-09-21T06:37:35.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.318+0000 7fe3c3d6e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc113c30 con 0x7fe3bc109df0 2024-09-21T06:37:35.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.319+0000 7fe3c1b0a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3bc103b60 0x7fe3bc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.319+0000 7fe3c1b0a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3bc103b60 0x7fe3bc075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58662/0 (socket says 172.21.15.63:58662) 2024-09-21T06:37:35.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.319+0000 7fe3c1b0a640 1 -- 172.21.15.63:0/2684014095 learned_addr learned my addr 172.21.15.63:0/2684014095 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:35.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.319+0000 7fe3c230b640 1 --2- 172.21.15.63:0/2684014095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3bc109df0 0x7fe3bc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.319+0000 7fe3c1309640 1 --2- 172.21.15.63:0/2684014095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3bc1094a0 0x7fe3bc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.319+0000 7fe3c1b0a640 1 -- 172.21.15.63:0/2684014095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3bc109df0 msgr2=0x7fe3bc076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:35.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.319+0000 7fe3c1b0a640 1 --2- 172.21.15.63:0/2684014095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3bc109df0 0x7fe3bc076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.319+0000 7fe3c1b0a640 1 -- 172.21.15.63:0/2684014095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3bc1094a0 msgr2=0x7fe3bc075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:35.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.319+0000 7fe3c1b0a640 1 --2- 172.21.15.63:0/2684014095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3bc1094a0 0x7fe3bc075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.319+0000 7fe3c1b0a640 1 -- 172.21.15.63:0/2684014095 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3bc1a8840 con 0x7fe3bc103b60 2024-09-21T06:37:35.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.319+0000 7fe3c1309640 1 --2- 172.21.15.63:0/2684014095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3bc1094a0 0x7fe3bc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:35.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.319+0000 7fe3c1b0a640 1 --2- 172.21.15.63:0/2684014095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3bc103b60 0x7fe3bc075710 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8005940 tx=0x7fe3b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:35.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.319+0000 7fe3aeffd640 1 -- 172.21.15.63:0/2684014095 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b803f030 con 0x7fe3bc103b60 2024-09-21T06:37:35.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.320+0000 7fe3c3d6e640 1 -- 172.21.15.63:0/2684014095 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3bc1a8ad0 con 0x7fe3bc103b60 2024-09-21T06:37:35.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.320+0000 7fe3aeffd640 1 -- 172.21.15.63:0/2684014095 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3b8003cb0 con 0x7fe3bc103b60 2024-09-21T06:37:35.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.320+0000 7fe3aeffd640 1 -- 172.21.15.63:0/2684014095 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8035070 con 0x7fe3bc103b60 2024-09-21T06:37:35.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.320+0000 7fe3c3d6e640 1 -- 172.21.15.63:0/2684014095 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3bc1a8fb0 con 0x7fe3bc103b60 2024-09-21T06:37:35.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.322+0000 7fe3ca2e2740 1 Processor -- start 2024-09-21T06:37:35.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.322+0000 7fe3ca2e2740 1 -- start start 2024-09-21T06:37:35.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.322+0000 7fe3aeffd640 1 -- 172.21.15.63:0/2684014095 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fe3b8042030 con 0x7fe3bc103b60 2024-09-21T06:37:35.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.322+0000 7fe3ca2e2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e87070 0x560fa822e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.322+0000 7fe3ca2e2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e5e1b0 0x560fa822ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.322+0000 7fe3ca2e2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e66390 0x560fa822f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.322+0000 7fe3ca2e2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x560fa81a4ea0 con 0x560fa7e5e1b0 2024-09-21T06:37:35.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.322+0000 7fe3ca2e2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560fa81942d0 con 0x560fa7e87070 2024-09-21T06:37:35.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.322+0000 7fe3ca2e2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560fa81980e0 con 0x560fa7e66390 2024-09-21T06:37:35.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.323+0000 7fe3c1b0a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e5e1b0 0x560fa822ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.323+0000 7fe3c1b0a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e5e1b0 0x560fa822ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58674/0 (socket says 172.21.15.63:58674) 2024-09-21T06:37:35.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.323+0000 7fe3c1b0a640 1 -- 172.21.15.63:0/3076004059 learned_addr learned my addr 172.21.15.63:0/3076004059 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:35.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.323+0000 7fe3c1309640 1 --2- 172.21.15.63:0/3076004059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e66390 0x560fa822f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.323+0000 7fe3c230b640 1 --2- 172.21.15.63:0/3076004059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e87070 0x560fa822e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.323+0000 7fe3c1b0a640 1 -- 172.21.15.63:0/3076004059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e66390 msgr2=0x560fa822f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:35.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.323+0000 7fe3c1b0a640 1 --2- 172.21.15.63:0/3076004059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e66390 0x560fa822f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.323+0000 7fe3c1b0a640 1 -- 172.21.15.63:0/3076004059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e87070 msgr2=0x560fa822e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:35.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.323+0000 7fe3c1b0a640 1 --2- 172.21.15.63:0/3076004059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e87070 0x560fa822e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.323+0000 7fe3c1b0a640 1 -- 172.21.15.63:0/3076004059 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fa7ef2650 con 0x560fa7e5e1b0 2024-09-21T06:37:35.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.323+0000 7fe3c1309640 1 --2- 172.21.15.63:0/3076004059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e66390 0x560fa822f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:35.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.323+0000 7fe3c1b0a640 1 --2- 172.21.15.63:0/3076004059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e5e1b0 0x560fa822ebe0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8105690 tx=0x7fe3b810bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d17aa26c4ff70c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:35.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.324+0000 7fe3aeffd640 1 --2- 172.21.15.63:0/2684014095 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe3a80b6680 0x7fe3a80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.324+0000 7fe3a7fff640 1 -- 172.21.15.63:0/3076004059 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b80ca470 con 0x560fa7e5e1b0 2024-09-21T06:37:35.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.324+0000 7fe3c230b640 1 --2- 172.21.15.63:0/2684014095 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe3a80b6680 0x7fe3a80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.324+0000 7fe3a7fff640 1 -- 172.21.15.63:0/3076004059 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3b8115030 con 0x560fa7e5e1b0 2024-09-21T06:37:35.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.324+0000 7fe3a7fff640 1 -- 172.21.15.63:0/3076004059 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b80cd770 con 0x560fa7e5e1b0 2024-09-21T06:37:35.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.324+0000 7fe3aeffd640 1 -- 172.21.15.63:0/2684014095 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7fe3b8108020 con 0x7fe3bc103b60 2024-09-21T06:37:35.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.325+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/3076004059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e5e1b0 msgr2=0x560fa822ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.325+0000 7fe3c230b640 1 --2- 172.21.15.63:0/2684014095 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe3a80b6680 0x7fe3a80b8b90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4005fd0 tx=0x7fe3b4009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.325+0000 7fe3ca2e2740 1 --2- 172.21.15.63:0/3076004059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e5e1b0 0x560fa822ebe0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8105690 tx=0x7fe3b810bf90 comp rx=0 tx=0).stop 2024-09-21T06:37:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.325+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/3076004059 shutdown_connections 2024-09-21T06:37:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.325+0000 7fe3ca2e2740 1 --2- 172.21.15.63:0/3076004059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e66390 0x560fa822f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.325+0000 7fe3ca2e2740 1 --2- 172.21.15.63:0/3076004059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e5e1b0 0x560fa822ebe0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.325+0000 7fe3ca2e2740 1 --2- 172.21.15.63:0/3076004059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e87070 0x560fa822e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.325+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/3076004059 >> 172.21.15.63:0/3076004059 conn(0x560fa7e7b460 msgr2=0x560fa822c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.325+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/3076004059 shutdown_connections 2024-09-21T06:37:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.325+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/3076004059 wait complete. 2024-09-21T06:37:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.325+0000 7fe3ca2e2740 1 -- start start 2024-09-21T06:37:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.325+0000 7fe3ca2e2740 1 Processor -- start 2024-09-21T06:37:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.326+0000 7fe3ca2e2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e5e1b0 0x560fa8239de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.326+0000 7fe3ca2e2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e66390 0x560fa823a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.326+0000 7fe3ca2e2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e87070 0x560fa8245ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.326+0000 7fe3ca2e2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x560fa7ff5700 con 0x560fa7e66390 2024-09-21T06:37:35.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.326+0000 7fe3ca2e2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560fa812f160 con 0x560fa7e5e1b0 2024-09-21T06:37:35.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.326+0000 7fe3ca2e2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560fa823cc40 con 0x560fa7e87070 2024-09-21T06:37:35.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.326+0000 7fe3ca2e2740 10 client.0 _ll_register_callbacks cb 0x560fa81489e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:35.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.326+0000 7fe3c1309640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e66390 0x560fa823a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.326+0000 7fe3c1309640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e66390 0x560fa823a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58676/0 (socket says 172.21.15.63:58676) 2024-09-21T06:37:35.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.326+0000 7fe3c1309640 1 -- 172.21.15.63:0/1733253449 learned_addr learned my addr 172.21.15.63:0/1733253449 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:35.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.326+0000 7fe3c1b0a640 1 --2- 172.21.15.63:0/1733253449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e5e1b0 0x560fa8239de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.326+0000 7fe3c230b640 1 --2- 172.21.15.63:0/1733253449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e87070 0x560fa8245ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.326+0000 7fe3c1309640 1 -- 172.21.15.63:0/1733253449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e87070 msgr2=0x560fa8245ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:35.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.326+0000 7fe3c1309640 1 --2- 172.21.15.63:0/1733253449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e87070 0x560fa8245ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.326+0000 7fe3c1309640 1 -- 172.21.15.63:0/1733253449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e5e1b0 msgr2=0x560fa8239de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:35.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.326+0000 7fe3c1309640 1 --2- 172.21.15.63:0/1733253449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e5e1b0 0x560fa8239de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.327+0000 7fe3c1309640 1 -- 172.21.15.63:0/1733253449 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fa815cc90 con 0x560fa7e66390 2024-09-21T06:37:35.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.327+0000 7fe3c230b640 1 --2- 172.21.15.63:0/1733253449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e87070 0x560fa8245ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:35.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.327+0000 7fe3c1309640 1 --2- 172.21.15.63:0/1733253449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e66390 0x560fa823a320 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0010750 tx=0x7fe3b0010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f371113aba83f7e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:35.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.327+0000 7fe3a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:37:35.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.327+0000 7fe3a57fa640 1 -- 172.21.15.63:0/1733253449 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b000ed40 con 0x560fa7e66390 2024-09-21T06:37:35.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.327+0000 7fe3a57fa640 1 -- 172.21.15.63:0/1733253449 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7fe3b001c480 con 0x560fa7e66390 2024-09-21T06:37:35.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.327+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/1733253449 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3b8115030 con 0x560fa7e66390 2024-09-21T06:37:35.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.327+0000 7fe3a57fa640 1 -- 172.21.15.63:0/1733253449 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fe3b0010e60 con 0x560fa7e66390 2024-09-21T06:37:35.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.327+0000 7fe3ca2e2740 10 client.17430 fetch_fsmap learned FSMap version 61 2024-09-21T06:37:35.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.327+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/1733253449 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x560fa8248950 con 0x560fa7e66390 2024-09-21T06:37:35.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.327+0000 7fe3a57fa640 1 -- 172.21.15.63:0/1733253449 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3b8115030 con 0x560fa7e66390 2024-09-21T06:37:35.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.328+0000 7fe3a57fa640 1 -- 172.21.15.63:0/1733253449 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fe3b0011810 con 0x560fa7e66390 2024-09-21T06:37:35.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.328+0000 7fe3ca2e2740 10 client.17430 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:37:35.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.328+0000 7fe3ca2e2740 10 client.17430 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:37:35.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.328+0000 7fe3ca2e2740 20 client.17430 populate_metadata read hostname 'smithi063' 2024-09-21T06:37:35.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.328+0000 7fe3ca2e2740 1 --2- 172.21.15.63:0/1733253449 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x560fa7e459f0 0x560fa824bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.328+0000 7fe3ca2e2740 4 client.17430 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:35.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.328+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/1733253449 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fa81a6df0 con 0x560fa7e459f0 2024-09-21T06:37:35.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.328+0000 7fe3c1b0a640 1 --2- 172.21.15.63:0/1733253449 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x560fa7e459f0 0x560fa824bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.328+0000 7fe3c1b0a640 1 --2- 172.21.15.63:0/1733253449 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x560fa7e459f0 0x560fa824bea0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=13269cb54b5a8243 server_cookie=1fec1c5a0cc2e40f in_seq=0 out_seq=0 2024-09-21T06:37:35.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.328+0000 7fe3a57fa640 10 client.17430 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:37:35.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.329+0000 7fe3a57fa640 1 -- 172.21.15.63:0/1733253449 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560fa81a6df0 con 0x560fa7e459f0 2024-09-21T06:37:35.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.329+0000 7fe3a57fa640 10 client.17430 handle_command_reply: tid=0 2024-09-21T06:37:35.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.329+0000 7fe3ca2e2740 1 client.17430 shutdown 2024-09-21T06:37:35.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.329+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/1733253449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e66390 msgr2=0x560fa823a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:35.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.329+0000 7fe3ca2e2740 1 --2- 172.21.15.63:0/1733253449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e66390 0x560fa823a320 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0010750 tx=0x7fe3b0010c10 comp rx=0 tx=0).stop 2024-09-21T06:37:35.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.329+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/1733253449 shutdown_connections 2024-09-21T06:37:35.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.330+0000 7fe3ca2e2740 1 --2- 172.21.15.63:0/1733253449 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x560fa7e459f0 0x560fa824bea0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.330+0000 7fe3ca2e2740 1 --2- 172.21.15.63:0/1733253449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e87070 0x560fa8245ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.330+0000 7fe3ca2e2740 1 --2- 172.21.15.63:0/1733253449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e66390 0x560fa823a320 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.330+0000 7fe3a57fa640 0 client.17430 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:37:35.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.330+0000 7fe3ca2e2740 1 --2- 172.21.15.63:0/1733253449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e5e1b0 0x560fa8239de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.330+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/1733253449 >> 172.21.15.63:0/1733253449 conn(0x560fa7e7b460 msgr2=0x560fa8231830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:35.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.330+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/1733253449 shutdown_connections 2024-09-21T06:37:35.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.330+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/1733253449 wait complete. 2024-09-21T06:37:35.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.330+0000 7fe3ca2e2740 20 client.17430 trim_cache size 0 max 16384 2024-09-21T06:37:35.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.343+0000 7fe3ca2e2740 1 Processor -- start 2024-09-21T06:37:35.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.343+0000 7fe3ca2e2740 1 -- start start 2024-09-21T06:37:35.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.343+0000 7fe3ca2e2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e459f0 0x560fa823a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.343+0000 7fe3ca2e2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e5e1b0 0x560fa8245d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.343+0000 7fe3ca2e2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e66390 0x560fa8236fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.343+0000 7fe3ca2e2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc1b1a50 con 0x560fa7e459f0 2024-09-21T06:37:35.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.343+0000 7fe3ca2e2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc1b3590 con 0x560fa7e66390 2024-09-21T06:37:35.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.343+0000 7fe3ca2e2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc1b2120 con 0x560fa7e5e1b0 2024-09-21T06:37:35.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.343+0000 7fe3c1b0a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e459f0 0x560fa823a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.343+0000 7fe3c1b0a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e459f0 0x560fa823a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58684/0 (socket says 172.21.15.63:58684) 2024-09-21T06:37:35.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.343+0000 7fe3c1b0a640 1 -- 172.21.15.63:0/523268018 learned_addr learned my addr 172.21.15.63:0/523268018 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:35.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.343+0000 7fe3c1309640 1 --2- 172.21.15.63:0/523268018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e5e1b0 0x560fa8245d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.343+0000 7fe3c230b640 1 --2- 172.21.15.63:0/523268018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e66390 0x560fa8236fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.344+0000 7fe3c1b0a640 1 -- 172.21.15.63:0/523268018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e5e1b0 msgr2=0x560fa8245d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:35.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.344+0000 7fe3c1b0a640 1 --2- 172.21.15.63:0/523268018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e5e1b0 0x560fa8245d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.344+0000 7fe3c1b0a640 1 -- 172.21.15.63:0/523268018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e66390 msgr2=0x560fa8236fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:35.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.344+0000 7fe3c1b0a640 1 --2- 172.21.15.63:0/523268018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e66390 0x560fa8236fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.344+0000 7fe3c1b0a640 1 -- 172.21.15.63:0/523268018 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fa822cf00 con 0x560fa7e459f0 2024-09-21T06:37:35.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.344+0000 7fe3c230b640 1 --2- 172.21.15.63:0/523268018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e66390 0x560fa8236fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:35.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.344+0000 7fe3c1b0a640 1 --2- 172.21.15.63:0/523268018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e459f0 0x560fa823a2a0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fe3b80cd930 tx=0x7fe3b80045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba01869a8c920e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:35.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.344+0000 7fe3a77fe640 1 -- 172.21.15.63:0/523268018 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8049040 con 0x560fa7e459f0 2024-09-21T06:37:35.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.344+0000 7fe3a77fe640 1 -- 172.21.15.63:0/523268018 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3b8115040 con 0x560fa7e459f0 2024-09-21T06:37:35.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.344+0000 7fe3a77fe640 1 -- 172.21.15.63:0/523268018 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b80cd960 con 0x560fa7e459f0 2024-09-21T06:37:35.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.345+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/523268018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e459f0 msgr2=0x560fa823a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:35.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.345+0000 7fe3ca2e2740 1 --2- 172.21.15.63:0/523268018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e459f0 0x560fa823a2a0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fe3b80cd930 tx=0x7fe3b80045a0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.345+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/523268018 shutdown_connections 2024-09-21T06:37:35.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.345+0000 7fe3ca2e2740 1 --2- 172.21.15.63:0/523268018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e66390 0x560fa8236fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.345+0000 7fe3ca2e2740 1 --2- 172.21.15.63:0/523268018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e5e1b0 0x560fa8245d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.345+0000 7fe3ca2e2740 1 --2- 172.21.15.63:0/523268018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e459f0 0x560fa823a2a0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.345+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/523268018 >> 172.21.15.63:0/523268018 conn(0x560fa7e7b460 msgr2=0x560fa8239b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.345+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/523268018 shutdown_connections 2024-09-21T06:37:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.345+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/523268018 wait complete. 2024-09-21T06:37:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.345+0000 7fe3ca2e2740 1 -- start start 2024-09-21T06:37:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.345+0000 7fe3ca2e2740 1 Processor -- start 2024-09-21T06:37:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.346+0000 7fe3ca2e2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e459f0 0x560fa823de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.346+0000 7fe3ca2e2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e5e1b0 0x560fa823e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.346+0000 7fe3ca2e2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e66390 0x560fa823e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.346+0000 7fe3ca2e2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc1b2ec0 con 0x560fa7e5e1b0 2024-09-21T06:37:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.346+0000 7fe3ca2e2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc1b27f0 con 0x560fa7e459f0 2024-09-21T06:37:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.346+0000 7fe3ca2e2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc1afa50 con 0x560fa7e66390 2024-09-21T06:37:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.346+0000 7fe3ca2e2740 10 client.0 _ll_register_callbacks cb 0x7fe3b000c410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.346+0000 7fe3c1309640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e5e1b0 0x560fa823e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.346+0000 7fe3c1309640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e5e1b0 0x560fa823e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58690/0 (socket says 172.21.15.63:58690) 2024-09-21T06:37:35.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.346+0000 7fe3c1309640 1 -- 172.21.15.63:0/3958314875 learned_addr learned my addr 172.21.15.63:0/3958314875 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:35.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.346+0000 7fe3c230b640 1 --2- 172.21.15.63:0/3958314875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e66390 0x560fa823e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.346+0000 7fe3c1b0a640 1 --2- 172.21.15.63:0/3958314875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e459f0 0x560fa823de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.346+0000 7fe3c1309640 1 -- 172.21.15.63:0/3958314875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e66390 msgr2=0x560fa823e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:35.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.346+0000 7fe3c1309640 1 --2- 172.21.15.63:0/3958314875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e66390 0x560fa823e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.346+0000 7fe3c1309640 1 -- 172.21.15.63:0/3958314875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e459f0 msgr2=0x560fa823de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:35.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.346+0000 7fe3c1309640 1 --2- 172.21.15.63:0/3958314875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e459f0 0x560fa823de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.346+0000 7fe3c1309640 1 -- 172.21.15.63:0/3958314875 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fa82b5870 con 0x560fa7e5e1b0 2024-09-21T06:37:35.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.346+0000 7fe3c1b0a640 1 --2- 172.21.15.63:0/3958314875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e459f0 0x560fa823de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:35.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.347+0000 7fe3c1309640 1 --2- 172.21.15.63:0/3958314875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e5e1b0 0x560fa823e350 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0010750 tx=0x7fe3b00116f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d72c8af800b66e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:35.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.347+0000 7fe3a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:37:35.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.347+0000 7fe3a57fa640 1 -- 172.21.15.63:0/3958314875 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b0028040 con 0x560fa7e5e1b0 2024-09-21T06:37:35.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.347+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/3958314875 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3b8115040 con 0x560fa7e5e1b0 2024-09-21T06:37:35.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.347+0000 7fe3a57fa640 1 -- 172.21.15.63:0/3958314875 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7fe3b0005040 con 0x560fa7e5e1b0 2024-09-21T06:37:35.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.347+0000 7fe3a57fa640 1 -- 172.21.15.63:0/3958314875 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fe3b000e720 con 0x560fa7e5e1b0 2024-09-21T06:37:35.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.347+0000 7fe3ca2e2740 10 client.17436 fetch_fsmap learned FSMap version 61 2024-09-21T06:37:35.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.347+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/3958314875 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x560fa82b6af0 con 0x560fa7e5e1b0 2024-09-21T06:37:35.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.347+0000 7fe3a57fa640 1 -- 172.21.15.63:0/3958314875 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3b8115040 con 0x560fa7e5e1b0 2024-09-21T06:37:35.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.347+0000 7fe3a57fa640 1 -- 172.21.15.63:0/3958314875 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fe3b001c480 con 0x560fa7e5e1b0 2024-09-21T06:37:35.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.347+0000 7fe3ca2e2740 10 client.17436 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:37:35.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.347+0000 7fe3ca2e2740 10 client.17436 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:37:35.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.347+0000 7fe3ca2e2740 20 client.17436 populate_metadata read hostname 'smithi063' 2024-09-21T06:37:35.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.347+0000 7fe3ca2e2740 1 --2- 172.21.15.63:0/3958314875 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x560fa7e87070 0x560fa82b9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.347+0000 7fe3ca2e2740 4 client.17436 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:37:35.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.347+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/3958314875 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560fa81a28a0 con 0x560fa7e87070 2024-09-21T06:37:35.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.348+0000 7fe3c1b0a640 1 --2- 172.21.15.63:0/3958314875 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x560fa7e87070 0x560fa82b9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.348+0000 7fe3a57fa640 10 client.17436 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:37:35.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.348+0000 7fe3c1b0a640 1 --2- 172.21.15.63:0/3958314875 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x560fa7e87070 0x560fa82b9290 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e0f5457e0979494f server_cookie=2898486c2914e028 in_seq=0 out_seq=0 2024-09-21T06:37:35.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.348+0000 7fe3a57fa640 1 -- 172.21.15.63:0/3958314875 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560fa81a28a0 con 0x560fa7e87070 2024-09-21T06:37:35.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.348+0000 7fe3a57fa640 10 client.17436 handle_command_reply: tid=0 2024-09-21T06:37:35.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.348+0000 7fe3ca2e2740 1 client.17436 shutdown 2024-09-21T06:37:35.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.349+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/3958314875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e5e1b0 msgr2=0x560fa823e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:35.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.349+0000 7fe3ca2e2740 1 --2- 172.21.15.63:0/3958314875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e5e1b0 0x560fa823e350 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0010750 tx=0x7fe3b00116f0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.349+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/3958314875 shutdown_connections 2024-09-21T06:37:35.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.349+0000 7fe3ca2e2740 1 --2- 172.21.15.63:0/3958314875 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x560fa7e87070 0x560fa82b9290 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.349+0000 7fe3ca2e2740 1 --2- 172.21.15.63:0/3958314875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fa7e66390 0x560fa823e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.349+0000 7fe3ca2e2740 1 --2- 172.21.15.63:0/3958314875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560fa7e5e1b0 0x560fa823e350 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.349+0000 7fe3ca2e2740 1 --2- 172.21.15.63:0/3958314875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560fa7e459f0 0x560fa823de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.349+0000 7fe3a57fa640 0 client.17436 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:37:35.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.349+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/3958314875 >> 172.21.15.63:0/3958314875 conn(0x560fa7e7b460 msgr2=0x560fa822f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:35.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.349+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/3958314875 shutdown_connections 2024-09-21T06:37:35.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.349+0000 7fe3ca2e2740 1 -- 172.21.15.63:0/3958314875 wait complete. 2024-09-21T06:37:35.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.349+0000 7fe3ca2e2740 20 client.17436 trim_cache size 0 max 16384 2024-09-21T06:37:35.356 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:37:35.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.349+0000 7fe3c3d6e640 1 -- 172.21.15.63:0/2684014095 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe3a80b6680 msgr2=0x7fe3a80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:35.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.349+0000 7fe3c3d6e640 1 --2- 172.21.15.63:0/2684014095 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe3a80b6680 0x7fe3a80b8b90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4005fd0 tx=0x7fe3b4009600 comp rx=0 tx=0).stop 2024-09-21T06:37:35.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.349+0000 7fe3c3d6e640 1 -- 172.21.15.63:0/2684014095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3bc103b60 msgr2=0x7fe3bc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:35.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.349+0000 7fe3c3d6e640 1 --2- 172.21.15.63:0/2684014095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3bc103b60 0x7fe3bc075710 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8005940 tx=0x7fe3b80042f0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.349+0000 7fe3c3d6e640 1 -- 172.21.15.63:0/2684014095 shutdown_connections 2024-09-21T06:37:35.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.349+0000 7fe3c3d6e640 1 --2- 172.21.15.63:0/2684014095 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe3a80b6680 0x7fe3a80b8b90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.349+0000 7fe3c3d6e640 1 --2- 172.21.15.63:0/2684014095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3bc109df0 0x7fe3bc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.349+0000 7fe3c3d6e640 1 --2- 172.21.15.63:0/2684014095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3bc1094a0 0x7fe3bc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.350+0000 7fe3c3d6e640 1 --2- 172.21.15.63:0/2684014095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3bc103b60 0x7fe3bc075710 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.350+0000 7fe3c3d6e640 1 -- 172.21.15.63:0/2684014095 >> 172.21.15.63:0/2684014095 conn(0x7fe3bc07b850 msgr2=0x7fe3bc107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:35.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.350+0000 7fe3c3d6e640 1 -- 172.21.15.63:0/2684014095 shutdown_connections 2024-09-21T06:37:35.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:35.350+0000 7fe3c3d6e640 1 -- 172.21.15.63:0/2684014095 wait complete. 2024-09-21T06:37:36.014 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:35 smithi063 ceph-mon[31150]: pgmap v610: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:37:36.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:35 smithi175 ceph-mon[34510]: pgmap v610: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:37:36.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:35 smithi071 ceph-mon[34844]: pgmap v610: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:37:37.048 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:37:37.048 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:37:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:37.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.830+0000 7fde96f4c640 1 -- 172.21.15.63:0/3233861887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde90102ae0 msgr2=0x7fde90102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.830+0000 7fde96f4c640 1 --2- 172.21.15.63:0/3233861887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde90102ae0 0x7fde90102ef0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fde84009900 tx=0x7fde8402a410 comp rx=0 tx=0).stop 2024-09-21T06:37:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.830+0000 7fde96f4c640 1 -- 172.21.15.63:0/3233861887 shutdown_connections 2024-09-21T06:37:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.830+0000 7fde96f4c640 1 --2- 172.21.15.63:0/3233861887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde90108d20 0x7fde9010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.830+0000 7fde96f4c640 1 --2- 172.21.15.63:0/3233861887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde901083d0 0x7fde901087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.830+0000 7fde96f4c640 1 --2- 172.21.15.63:0/3233861887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde90102ae0 0x7fde90102ef0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.830+0000 7fde96f4c640 1 -- 172.21.15.63:0/3233861887 >> 172.21.15.63:0/3233861887 conn(0x7fde90079760 msgr2=0x7fde90079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.830+0000 7fde96f4c640 1 -- 172.21.15.63:0/3233861887 shutdown_connections 2024-09-21T06:37:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.830+0000 7fde96f4c640 1 -- 172.21.15.63:0/3233861887 wait complete. 2024-09-21T06:37:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.830+0000 7fde96f4c640 1 Processor -- start 2024-09-21T06:37:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.830+0000 7fde96f4c640 1 -- start start 2024-09-21T06:37:37.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.831+0000 7fde96f4c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde90102ae0 0x7fde9019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.831+0000 7fde96f4c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde901083d0 0x7fde9019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.831+0000 7fde96f4c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde90108d20 0x7fde9019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.831+0000 7fde96f4c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fde90113ab0 con 0x7fde901083d0 2024-09-21T06:37:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.831+0000 7fde96f4c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fde90113930 con 0x7fde90108d20 2024-09-21T06:37:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.831+0000 7fde96f4c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fde90113c30 con 0x7fde90102ae0 2024-09-21T06:37:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.831+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde901083d0 0x7fde9019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.831+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde901083d0 0x7fde9019aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52678/0 (socket says 172.21.15.63:52678) 2024-09-21T06:37:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.831+0000 7fde8ffff640 1 -- 172.21.15.63:0/3708260391 learned_addr learned my addr 172.21.15.63:0/3708260391 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.831+0000 7fde94ce8640 1 --2- 172.21.15.63:0/3708260391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde90102ae0 0x7fde9019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.831+0000 7fde954e9640 1 --2- 172.21.15.63:0/3708260391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde90108d20 0x7fde9019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.831+0000 7fde8ffff640 1 -- 172.21.15.63:0/3708260391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde90102ae0 msgr2=0x7fde9019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.831+0000 7fde8ffff640 1 --2- 172.21.15.63:0/3708260391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde90102ae0 0x7fde9019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.831+0000 7fde8ffff640 1 -- 172.21.15.63:0/3708260391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde90108d20 msgr2=0x7fde9019fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.831+0000 7fde8ffff640 1 --2- 172.21.15.63:0/3708260391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde90108d20 0x7fde9019fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.831+0000 7fde8ffff640 1 -- 172.21.15.63:0/3708260391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde901a03d0 con 0x7fde901083d0 2024-09-21T06:37:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.831+0000 7fde954e9640 1 --2- 172.21.15.63:0/3708260391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde90108d20 0x7fde9019fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.831+0000 7fde8ffff640 1 --2- 172.21.15.63:0/3708260391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde901083d0 0x7fde9019aa00 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fde7c005fd0 tx=0x7fde7c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.832+0000 7fde8dffb640 1 -- 172.21.15.63:0/3708260391 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c017070 con 0x7fde901083d0 2024-09-21T06:37:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.832+0000 7fde96f4c640 1 -- 172.21.15.63:0/3708260391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde901a06c0 con 0x7fde901083d0 2024-09-21T06:37:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.832+0000 7fde8dffb640 1 -- 172.21.15.63:0/3708260391 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde7c009c30 con 0x7fde901083d0 2024-09-21T06:37:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.832+0000 7fde8dffb640 1 -- 172.21.15.63:0/3708260391 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c003d30 con 0x7fde901083d0 2024-09-21T06:37:37.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.832+0000 7fde96f4c640 1 -- 172.21.15.63:0/3708260391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde901a6e20 con 0x7fde901083d0 2024-09-21T06:37:37.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.834+0000 7fde9d4c0740 1 Processor -- start 2024-09-21T06:37:37.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.834+0000 7fde8dffb640 1 -- 172.21.15.63:0/3708260391 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fde7c003ed0 con 0x7fde901083d0 2024-09-21T06:37:37.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.834+0000 7fde9d4c0740 1 -- start start 2024-09-21T06:37:37.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.835+0000 7fde9d4c0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9bab350 0x559bf9f52430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.835+0000 7fde9d4c0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 0x559bf9f52970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.835+0000 7fde9d4c0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9b8a670 0x559bf9f52eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.835+0000 7fde9d4c0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559bf9ec8e60 con 0x559bf9b8a670 2024-09-21T06:37:37.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.835+0000 7fde9d4c0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559bf9eb8290 con 0x559bf9b82490 2024-09-21T06:37:37.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.835+0000 7fde9d4c0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559bf9ebc0a0 con 0x559bf9bab350 2024-09-21T06:37:37.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.835+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9b8a670 0x559bf9f52eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.835+0000 7fde94ce8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 0x559bf9f52970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.835+0000 7fde94ce8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 0x559bf9f52970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:53726/0 (socket says 172.21.15.63:53726) 2024-09-21T06:37:37.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.835+0000 7fde94ce8640 1 -- 172.21.15.63:0/1226149209 learned_addr learned my addr 172.21.15.63:0/1226149209 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:37.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.835+0000 7fde954e9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9bab350 0x559bf9f52430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.835+0000 7fde8ffff640 1 -- 172.21.15.63:0/1226149209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9bab350 msgr2=0x559bf9f52430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:37.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.835+0000 7fde8ffff640 1 --2- 172.21.15.63:0/1226149209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9bab350 0x559bf9f52430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.835+0000 7fde8ffff640 1 -- 172.21.15.63:0/1226149209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 msgr2=0x559bf9f52970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:37.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.835+0000 7fde8ffff640 1 --2- 172.21.15.63:0/1226149209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 0x559bf9f52970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.835+0000 7fde8ffff640 1 -- 172.21.15.63:0/1226149209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bf9c16930 con 0x559bf9b8a670 2024-09-21T06:37:37.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.836+0000 7fde8ffff640 1 --2- 172.21.15.63:0/1226149209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9b8a670 0x559bf9f52eb0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0e4c30 tx=0x7fde7c0edb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e5678bd65063e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:37.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.836+0000 7fde8dffb640 1 --2- 172.21.15.63:0/3708260391 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fde800b6680 0x7fde800b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.836+0000 7fde954e9640 1 --2- 172.21.15.63:0/3708260391 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fde800b6680 0x7fde800b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.836+0000 7fde7affd640 1 -- 172.21.15.63:0/1226149209 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0fa070 con 0x559bf9b8a670 2024-09-21T06:37:37.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.836+0000 7fde8dffb640 1 -- 172.21.15.63:0/3708260391 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7fde7c0e7590 con 0x7fde901083d0 2024-09-21T06:37:37.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.836+0000 7fde7affd640 1 -- 172.21.15.63:0/1226149209 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde7c0ace40 con 0x559bf9b8a670 2024-09-21T06:37:37.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.836+0000 7fde7affd640 1 -- 172.21.15.63:0/1226149209 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0ad100 con 0x559bf9b8a670 2024-09-21T06:37:37.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.837+0000 7fde9d4c0740 1 -- 172.21.15.63:0/1226149209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9b8a670 msgr2=0x559bf9f52eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:37.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.837+0000 7fde9d4c0740 1 --2- 172.21.15.63:0/1226149209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9b8a670 0x559bf9f52eb0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0e4c30 tx=0x7fde7c0edb60 comp rx=0 tx=0).stop 2024-09-21T06:37:37.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.837+0000 7fde954e9640 1 --2- 172.21.15.63:0/3708260391 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fde800b6680 0x7fde800b8b90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fde88005fd0 tx=0x7fde88009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:37.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.837+0000 7fde9d4c0740 1 -- 172.21.15.63:0/1226149209 shutdown_connections 2024-09-21T06:37:37.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.837+0000 7fde9d4c0740 1 --2- 172.21.15.63:0/1226149209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9b8a670 0x559bf9f52eb0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.837+0000 7fde9d4c0740 1 --2- 172.21.15.63:0/1226149209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 0x559bf9f52970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.837+0000 7fde9d4c0740 1 --2- 172.21.15.63:0/1226149209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9bab350 0x559bf9f52430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.837+0000 7fde9d4c0740 1 -- 172.21.15.63:0/1226149209 >> 172.21.15.63:0/1226149209 conn(0x559bf9b9f740 msgr2=0x559bf9f50320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:37.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.837+0000 7fde9d4c0740 1 -- 172.21.15.63:0/1226149209 shutdown_connections 2024-09-21T06:37:37.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.837+0000 7fde9d4c0740 1 -- 172.21.15.63:0/1226149209 wait complete. 2024-09-21T06:37:37.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.837+0000 7fde9d4c0740 1 -- start start 2024-09-21T06:37:37.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.838+0000 7fde9d4c0740 1 Processor -- start 2024-09-21T06:37:37.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.838+0000 7fde9d4c0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 0x559bf9f5dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.838+0000 7fde9d4c0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9b8a670 0x559bf9f5e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.838+0000 7fde9d4c0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9bab350 0x559bf9f6e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.838+0000 7fde9d4c0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559bf9d19890 con 0x559bf9bab350 2024-09-21T06:37:37.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.838+0000 7fde9d4c0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559bf9e52d40 con 0x559bf9b82490 2024-09-21T06:37:37.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.838+0000 7fde9d4c0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559bf9f65020 con 0x559bf9b8a670 2024-09-21T06:37:37.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.838+0000 7fde9d4c0740 10 client.0 _ll_register_callbacks cb 0x559bf9eb6c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:37.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.838+0000 7fde954e9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9bab350 0x559bf9f6e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.838+0000 7fde954e9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9bab350 0x559bf9f6e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52690/0 (socket says 172.21.15.63:52690) 2024-09-21T06:37:37.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.838+0000 7fde954e9640 1 -- 172.21.15.63:0/3466939472 learned_addr learned my addr 172.21.15.63:0/3466939472 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:37.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.838+0000 7fde94ce8640 1 --2- 172.21.15.63:0/3466939472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 0x559bf9f5dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.838+0000 7fde8ffff640 1 --2- 172.21.15.63:0/3466939472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9b8a670 0x559bf9f5e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.839+0000 7fde954e9640 1 -- 172.21.15.63:0/3466939472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9b8a670 msgr2=0x559bf9f5e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:37.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.839+0000 7fde954e9640 1 --2- 172.21.15.63:0/3466939472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9b8a670 0x559bf9f5e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.839+0000 7fde954e9640 1 -- 172.21.15.63:0/3466939472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 msgr2=0x559bf9f5dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:37.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.839+0000 7fde954e9640 1 --2- 172.21.15.63:0/3466939472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 0x559bf9f5dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.839+0000 7fde954e9640 1 -- 172.21.15.63:0/3466939472 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bf9f6e930 con 0x559bf9bab350 2024-09-21T06:37:37.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.839+0000 7fde94ce8640 1 --2- 172.21.15.63:0/3466939472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 0x559bf9f5dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:37.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.839+0000 7fde954e9640 1 --2- 172.21.15.63:0/3466939472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9bab350 0x559bf9f6e340 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fde88012930 tx=0x7fde88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff25b6840d5067a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:37.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.839+0000 7fde6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:37:37.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.839+0000 7fde6ffff640 1 -- 172.21.15.63:0/3466939472 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8800fcf0 con 0x559bf9bab350 2024-09-21T06:37:37.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.839+0000 7fde6ffff640 1 -- 172.21.15.63:0/3466939472 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7fde8801f420 con 0x559bf9bab350 2024-09-21T06:37:37.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.839+0000 7fde9d4c0740 1 -- 172.21.15.63:0/3466939472 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde7c0ace40 con 0x559bf9bab350 2024-09-21T06:37:37.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.839+0000 7fde6ffff640 1 -- 172.21.15.63:0/3466939472 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fde8801f620 con 0x559bf9bab350 2024-09-21T06:37:37.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.839+0000 7fde9d4c0740 10 client.17448 fetch_fsmap learned FSMap version 61 2024-09-21T06:37:37.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.839+0000 7fde9d4c0740 1 -- 172.21.15.63:0/3466939472 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x559bf9f712a0 con 0x559bf9bab350 2024-09-21T06:37:37.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.840+0000 7fde6ffff640 1 -- 172.21.15.63:0/3466939472 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde7c0ace40 con 0x559bf9bab350 2024-09-21T06:37:37.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.840+0000 7fde6ffff640 1 -- 172.21.15.63:0/3466939472 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fde880277a0 con 0x559bf9bab350 2024-09-21T06:37:37.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.840+0000 7fde9d4c0740 10 client.17448 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:37:37.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.840+0000 7fde9d4c0740 10 client.17448 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:37:37.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.840+0000 7fde9d4c0740 20 client.17448 populate_metadata read hostname 'smithi063' 2024-09-21T06:37:37.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.840+0000 7fde9d4c0740 1 --2- 172.21.15.63:0/3466939472 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x559bf9b69cd0 0x559bf9f747f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.840+0000 7fde9d4c0740 4 client.17448 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:37.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.840+0000 7fde9d4c0740 1 -- 172.21.15.63:0/3466939472 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bf9ecadb0 con 0x559bf9b69cd0 2024-09-21T06:37:37.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.840+0000 7fde94ce8640 1 --2- 172.21.15.63:0/3466939472 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x559bf9b69cd0 0x559bf9f747f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.841+0000 7fde6ffff640 10 client.17448 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:37:37.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.841+0000 7fde94ce8640 1 --2- 172.21.15.63:0/3466939472 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x559bf9b69cd0 0x559bf9f747f0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84cbe30c3821193a server_cookie=25e2b734f749be7b in_seq=0 out_seq=0 2024-09-21T06:37:37.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.841+0000 7fde6ffff640 1 -- 172.21.15.63:0/3466939472 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559bf9ecadb0 con 0x559bf9b69cd0 2024-09-21T06:37:37.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.841+0000 7fde6ffff640 10 client.17448 handle_command_reply: tid=0 2024-09-21T06:37:37.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.841+0000 7fde9d4c0740 1 client.17448 shutdown 2024-09-21T06:37:37.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.842+0000 7fde9d4c0740 1 -- 172.21.15.63:0/3466939472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9bab350 msgr2=0x559bf9f6e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:37.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.842+0000 7fde9d4c0740 1 --2- 172.21.15.63:0/3466939472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9bab350 0x559bf9f6e340 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fde88012930 tx=0x7fde88004a40 comp rx=0 tx=0).stop 2024-09-21T06:37:37.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.842+0000 7fde9d4c0740 1 -- 172.21.15.63:0/3466939472 shutdown_connections 2024-09-21T06:37:37.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.842+0000 7fde9d4c0740 1 --2- 172.21.15.63:0/3466939472 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x559bf9b69cd0 0x559bf9f747f0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.842+0000 7fde9d4c0740 1 --2- 172.21.15.63:0/3466939472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9bab350 0x559bf9f6e340 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.842+0000 7fde9d4c0740 1 --2- 172.21.15.63:0/3466939472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9b8a670 0x559bf9f5e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.842+0000 7fde9d4c0740 1 --2- 172.21.15.63:0/3466939472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 0x559bf9f5dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.842+0000 7fde9d4c0740 1 -- 172.21.15.63:0/3466939472 >> 172.21.15.63:0/3466939472 conn(0x559bf9b9f740 msgr2=0x559bf9f555c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:37.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.842+0000 7fde6ffff640 0 client.17448 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:37:37.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.842+0000 7fde9d4c0740 1 -- 172.21.15.63:0/3466939472 shutdown_connections 2024-09-21T06:37:37.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.842+0000 7fde9d4c0740 1 -- 172.21.15.63:0/3466939472 wait complete. 2024-09-21T06:37:37.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.842+0000 7fde9d4c0740 20 client.17448 trim_cache size 0 max 16384 2024-09-21T06:37:37.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.860+0000 7fde9d4c0740 1 Processor -- start 2024-09-21T06:37:37.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.860+0000 7fde9d4c0740 1 -- start start 2024-09-21T06:37:37.862 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:37 smithi063 ceph-mon[31150]: pgmap v611: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:37:37.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.860+0000 7fde9d4c0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 0x559bf9f595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.860+0000 7fde9d4c0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9b8a670 0x559bf9f53e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.860+0000 7fde9d4c0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9bab350 0x559bf9f6e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.860+0000 7fde9d4c0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fde901ad690 con 0x559bf9b8a670 2024-09-21T06:37:37.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.860+0000 7fde9d4c0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fde901af1d0 con 0x559bf9b82490 2024-09-21T06:37:37.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.860+0000 7fde9d4c0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fde901add60 con 0x559bf9bab350 2024-09-21T06:37:37.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.860+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9b8a670 0x559bf9f53e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.860+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9b8a670 0x559bf9f53e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52692/0 (socket says 172.21.15.63:52692) 2024-09-21T06:37:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.860+0000 7fde8ffff640 1 -- 172.21.15.63:0/1463624406 learned_addr learned my addr 172.21.15.63:0/1463624406 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.860+0000 7fde94ce8640 1 --2- 172.21.15.63:0/1463624406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 0x559bf9f595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.861+0000 7fde8ffff640 1 -- 172.21.15.63:0/1463624406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9bab350 msgr2=0x559bf9f6e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.861+0000 7fde954e9640 1 --2- 172.21.15.63:0/1463624406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9bab350 0x559bf9f6e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.861+0000 7fde8ffff640 1 --2- 172.21.15.63:0/1463624406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9bab350 0x559bf9f6e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.861+0000 7fde8ffff640 1 -- 172.21.15.63:0/1463624406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 msgr2=0x559bf9f595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.861+0000 7fde8ffff640 1 --2- 172.21.15.63:0/1463624406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 0x559bf9f595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.861+0000 7fde8ffff640 1 -- 172.21.15.63:0/1463624406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bf9f54720 con 0x559bf9b8a670 2024-09-21T06:37:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.861+0000 7fde954e9640 1 --2- 172.21.15.63:0/1463624406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9bab350 0x559bf9f6e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.861+0000 7fde8ffff640 1 --2- 172.21.15.63:0/1463624406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9b8a670 0x559bf9f53e20 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fde7c000c00 tx=0x7fde7c0a91d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d28a42d39c423cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.861+0000 7fde7a7fc640 1 -- 172.21.15.63:0/1463624406 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0acaa0 con 0x559bf9b8a670 2024-09-21T06:37:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.861+0000 7fde7a7fc640 1 -- 172.21.15.63:0/1463624406 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde7c0ace40 con 0x559bf9b8a670 2024-09-21T06:37:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.861+0000 7fde7a7fc640 1 -- 172.21.15.63:0/1463624406 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0acc80 con 0x559bf9b8a670 2024-09-21T06:37:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.862+0000 7fde9d4c0740 1 -- 172.21.15.63:0/1463624406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9b8a670 msgr2=0x559bf9f53e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.862+0000 7fde9d4c0740 1 --2- 172.21.15.63:0/1463624406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9b8a670 0x559bf9f53e20 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fde7c000c00 tx=0x7fde7c0a91d0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.862+0000 7fde9d4c0740 1 -- 172.21.15.63:0/1463624406 shutdown_connections 2024-09-21T06:37:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.862+0000 7fde9d4c0740 1 --2- 172.21.15.63:0/1463624406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9bab350 0x559bf9f6e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.862+0000 7fde9d4c0740 1 --2- 172.21.15.63:0/1463624406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9b8a670 0x559bf9f53e20 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.862+0000 7fde9d4c0740 1 --2- 172.21.15.63:0/1463624406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 0x559bf9f595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.862+0000 7fde9d4c0740 1 -- 172.21.15.63:0/1463624406 >> 172.21.15.63:0/1463624406 conn(0x559bf9b9f740 msgr2=0x559bf9f5f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.862+0000 7fde9d4c0740 1 -- 172.21.15.63:0/1463624406 shutdown_connections 2024-09-21T06:37:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.862+0000 7fde9d4c0740 1 -- 172.21.15.63:0/1463624406 wait complete. 2024-09-21T06:37:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.863+0000 7fde9d4c0740 1 -- start start 2024-09-21T06:37:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.863+0000 7fde9d4c0740 1 Processor -- start 2024-09-21T06:37:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.863+0000 7fde9d4c0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 0x559bf9f663c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.863+0000 7fde9d4c0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9b8a670 0x559bf9f66900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.864+0000 7fde9d4c0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9bab350 0x559bf9f66e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.864+0000 7fde9d4c0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fde901aeb00 con 0x559bf9bab350 2024-09-21T06:37:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.864+0000 7fde9d4c0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fde901ae430 con 0x559bf9b82490 2024-09-21T06:37:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.864+0000 7fde9d4c0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fde901ab690 con 0x559bf9b8a670 2024-09-21T06:37:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.864+0000 7fde9d4c0740 10 client.0 _ll_register_callbacks cb 0x7fde880125e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.864+0000 7fde954e9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9bab350 0x559bf9f66e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.864+0000 7fde954e9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9bab350 0x559bf9f66e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52696/0 (socket says 172.21.15.63:52696) 2024-09-21T06:37:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.864+0000 7fde954e9640 1 -- 172.21.15.63:0/423148197 learned_addr learned my addr 172.21.15.63:0/423148197 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.864+0000 7fde94ce8640 1 --2- 172.21.15.63:0/423148197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 0x559bf9f663c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.864+0000 7fde8ffff640 1 --2- 172.21.15.63:0/423148197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9b8a670 0x559bf9f66900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.864+0000 7fde954e9640 1 -- 172.21.15.63:0/423148197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9b8a670 msgr2=0x559bf9f66900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.864+0000 7fde954e9640 1 --2- 172.21.15.63:0/423148197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9b8a670 0x559bf9f66900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.864+0000 7fde954e9640 1 -- 172.21.15.63:0/423148197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 msgr2=0x559bf9f663c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.864+0000 7fde954e9640 1 --2- 172.21.15.63:0/423148197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 0x559bf9f663c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.864+0000 7fde954e9640 1 -- 172.21.15.63:0/423148197 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bf9fde310 con 0x559bf9bab350 2024-09-21T06:37:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.864+0000 7fde8ffff640 1 --2- 172.21.15.63:0/423148197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9b8a670 0x559bf9f66900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.864+0000 7fde94ce8640 1 --2- 172.21.15.63:0/423148197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 0x559bf9f663c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.864+0000 7fde954e9640 1 --2- 172.21.15.63:0/423148197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9bab350 0x559bf9f66e40 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fde88012fd0 tx=0x7fde88027630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0209976f82abfe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:37.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.864+0000 7fde6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:37:37.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.865+0000 7fde6ffff640 1 -- 172.21.15.63:0/423148197 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8803c020 con 0x559bf9bab350 2024-09-21T06:37:37.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.865+0000 7fde6ffff640 1 -- 172.21.15.63:0/423148197 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7fde88027820 con 0x559bf9bab350 2024-09-21T06:37:37.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.865+0000 7fde9d4c0740 1 -- 172.21.15.63:0/423148197 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde7c0ace40 con 0x559bf9bab350 2024-09-21T06:37:37.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.865+0000 7fde6ffff640 1 -- 172.21.15.63:0/423148197 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fde88033040 con 0x559bf9bab350 2024-09-21T06:37:37.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.865+0000 7fde9d4c0740 10 client.17454 fetch_fsmap learned FSMap version 61 2024-09-21T06:37:37.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.865+0000 7fde9d4c0740 1 -- 172.21.15.63:0/423148197 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x559bf9fdf580 con 0x559bf9bab350 2024-09-21T06:37:37.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.865+0000 7fde6ffff640 1 -- 172.21.15.63:0/423148197 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde7c0ace40 con 0x559bf9bab350 2024-09-21T06:37:37.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.865+0000 7fde6ffff640 1 -- 172.21.15.63:0/423148197 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fde8802f430 con 0x559bf9bab350 2024-09-21T06:37:37.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.865+0000 7fde9d4c0740 10 client.17454 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:37:37.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.865+0000 7fde9d4c0740 10 client.17454 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:37:37.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.865+0000 7fde9d4c0740 20 client.17454 populate_metadata read hostname 'smithi063' 2024-09-21T06:37:37.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.865+0000 7fde9d4c0740 1 --2- 172.21.15.63:0/423148197 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x559bf9b3f080 0x559bf9fe1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.865+0000 7fde9d4c0740 4 client.17454 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:37:37.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.865+0000 7fde9d4c0740 1 -- 172.21.15.63:0/423148197 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559bf9ec6860 con 0x559bf9b3f080 2024-09-21T06:37:37.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.866+0000 7fde94ce8640 1 --2- 172.21.15.63:0/423148197 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x559bf9b3f080 0x559bf9fe1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.866+0000 7fde94ce8640 1 --2- 172.21.15.63:0/423148197 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x559bf9b3f080 0x559bf9fe1dc0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46f80e3472fa4812 server_cookie=447ffb774aade242 in_seq=0 out_seq=0 2024-09-21T06:37:37.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.866+0000 7fde6ffff640 10 client.17454 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:37:37.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.868+0000 7fde6ffff640 1 -- 172.21.15.63:0/423148197 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559bf9ec6860 con 0x559bf9b3f080 2024-09-21T06:37:37.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.868+0000 7fde6ffff640 10 client.17454 handle_command_reply: tid=0 2024-09-21T06:37:37.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.868+0000 7fde9d4c0740 1 client.17454 shutdown 2024-09-21T06:37:37.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.868+0000 7fde9d4c0740 1 -- 172.21.15.63:0/423148197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9bab350 msgr2=0x559bf9f66e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:37.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.868+0000 7fde9d4c0740 1 --2- 172.21.15.63:0/423148197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9bab350 0x559bf9f66e40 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fde88012fd0 tx=0x7fde88027630 comp rx=0 tx=0).stop 2024-09-21T06:37:37.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.868+0000 7fde9d4c0740 1 -- 172.21.15.63:0/423148197 shutdown_connections 2024-09-21T06:37:37.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.868+0000 7fde9d4c0740 1 --2- 172.21.15.63:0/423148197 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x559bf9b3f080 0x559bf9fe1dc0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.868+0000 7fde9d4c0740 1 --2- 172.21.15.63:0/423148197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559bf9bab350 0x559bf9f66e40 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.868+0000 7fde9d4c0740 1 --2- 172.21.15.63:0/423148197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf9b8a670 0x559bf9f66900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.868+0000 7fde9d4c0740 1 --2- 172.21.15.63:0/423148197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559bf9b82490 0x559bf9f663c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.868+0000 7fde6ffff640 0 client.17454 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:37:37.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.868+0000 7fde9d4c0740 1 -- 172.21.15.63:0/423148197 >> 172.21.15.63:0/423148197 conn(0x559bf9b9f740 msgr2=0x559bf9f53ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:37.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.869+0000 7fde9d4c0740 1 -- 172.21.15.63:0/423148197 shutdown_connections 2024-09-21T06:37:37.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.869+0000 7fde9d4c0740 1 -- 172.21.15.63:0/423148197 wait complete. 2024-09-21T06:37:37.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.869+0000 7fde9d4c0740 20 client.17454 trim_cache size 0 max 16384 2024-09-21T06:37:37.873 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:37:37.873 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0, 2024-09-21T06:37:37.873 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_tag": "7f2a9ce4-d90a-4ac2-9e03-b14126f1aa0d", 2024-09-21T06:37:37.873 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": "asynchronous" 2024-09-21T06:37:37.873 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:37:37.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.869+0000 7fde96f4c640 1 -- 172.21.15.63:0/3708260391 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fde800b6680 msgr2=0x7fde800b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:37.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.869+0000 7fde96f4c640 1 --2- 172.21.15.63:0/3708260391 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fde800b6680 0x7fde800b8b90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fde88005fd0 tx=0x7fde88009680 comp rx=0 tx=0).stop 2024-09-21T06:37:37.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.869+0000 7fde96f4c640 1 -- 172.21.15.63:0/3708260391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde901083d0 msgr2=0x7fde9019aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:37.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.869+0000 7fde96f4c640 1 --2- 172.21.15.63:0/3708260391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde901083d0 0x7fde9019aa00 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fde7c005fd0 tx=0x7fde7c00dde0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.869+0000 7fde96f4c640 1 -- 172.21.15.63:0/3708260391 shutdown_connections 2024-09-21T06:37:37.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.870+0000 7fde96f4c640 1 --2- 172.21.15.63:0/3708260391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde90108d20 0x7fde9019fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.870+0000 7fde96f4c640 1 --2- 172.21.15.63:0/3708260391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde901083d0 0x7fde9019aa00 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.870+0000 7fde96f4c640 1 --2- 172.21.15.63:0/3708260391 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fde800b6680 0x7fde800b8b90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.870+0000 7fde96f4c640 1 --2- 172.21.15.63:0/3708260391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde90102ae0 0x7fde9019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.870+0000 7fde96f4c640 1 -- 172.21.15.63:0/3708260391 >> 172.21.15.63:0/3708260391 conn(0x7fde90079760 msgr2=0x7fde90101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:37.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.870+0000 7fde96f4c640 1 -- 172.21.15.63:0/3708260391 shutdown_connections 2024-09-21T06:37:37.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:37.870+0000 7fde96f4c640 1 -- 172.21.15.63:0/3708260391 wait complete. 2024-09-21T06:37:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:37 smithi175 ceph-mon[34510]: pgmap v611: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:37:38.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:37 smithi071 ceph-mon[34844]: pgmap v611: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:37:38.593 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:37:38.854 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:39.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:38 smithi063 ceph-mon[31150]: scrub queued for path: / 2024-09-21T06:37:39.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:38 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:39.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:38 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:37:39.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:38 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:38 smithi175 ceph-mon[34510]: scrub queued for path: / 2024-09-21T06:37:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:38 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:38 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:37:39.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:38 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:39.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:38 smithi071 ceph-mon[34844]: scrub queued for path: / 2024-09-21T06:37:39.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:38 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:39.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:38 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:37:39.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:38 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:39.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.461+0000 7fc3d607f640 1 -- 172.21.15.63:0/2866361508 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3d01094a0 msgr2=0x7fc3d01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.461+0000 7fc3d607f640 1 --2- 172.21.15.63:0/2866361508 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3d01094a0 0x7fc3d01098b0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009900 tx=0x7fc3c402a410 comp rx=0 tx=0).stop 2024-09-21T06:37:39.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.461+0000 7fc3d607f640 1 -- 172.21.15.63:0/2866361508 shutdown_connections 2024-09-21T06:37:39.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.461+0000 7fc3d607f640 1 --2- 172.21.15.63:0/2866361508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3d0109df0 0x7fc3d0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.461+0000 7fc3d607f640 1 --2- 172.21.15.63:0/2866361508 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3d01094a0 0x7fc3d01098b0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.461+0000 7fc3d607f640 1 --2- 172.21.15.63:0/2866361508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d0103b60 0x7fc3d0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.461+0000 7fc3d607f640 1 -- 172.21.15.63:0/2866361508 >> 172.21.15.63:0/2866361508 conn(0x7fc3d007b850 msgr2=0x7fc3d007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:39.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.461+0000 7fc3d607f640 1 -- 172.21.15.63:0/2866361508 shutdown_connections 2024-09-21T06:37:39.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.461+0000 7fc3d607f640 1 -- 172.21.15.63:0/2866361508 wait complete. 2024-09-21T06:37:39.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.462+0000 7fc3d607f640 1 Processor -- start 2024-09-21T06:37:39.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.462+0000 7fc3d607f640 1 -- start start 2024-09-21T06:37:39.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.462+0000 7fc3d607f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d0103b60 0x7fc3d019c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.462+0000 7fc3d607f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3d01094a0 0x7fc3d019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.462+0000 7fc3d607f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3d0109df0 0x7fc3d01a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.462+0000 7fc3d607f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d0113ab0 con 0x7fc3d0109df0 2024-09-21T06:37:39.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.462+0000 7fc3d607f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d0113930 con 0x7fc3d0103b60 2024-09-21T06:37:39.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.462+0000 7fc3d607f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d0113c30 con 0x7fc3d01094a0 2024-09-21T06:37:39.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.462+0000 7fc3cffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3d0109df0 0x7fc3d01a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.462+0000 7fc3cffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3d0109df0 0x7fc3d01a1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52714/0 (socket says 172.21.15.63:52714) 2024-09-21T06:37:39.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.462+0000 7fc3cffff640 1 -- 172.21.15.63:0/1005285996 learned_addr learned my addr 172.21.15.63:0/1005285996 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:39.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.462+0000 7fc3cf7fe640 1 --2- 172.21.15.63:0/1005285996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d0103b60 0x7fc3d019c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.462+0000 7fc3ceffd640 1 --2- 172.21.15.63:0/1005285996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3d01094a0 0x7fc3d019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.463+0000 7fc3cffff640 1 -- 172.21.15.63:0/1005285996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3d01094a0 msgr2=0x7fc3d019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.463+0000 7fc3cffff640 1 --2- 172.21.15.63:0/1005285996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3d01094a0 0x7fc3d019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.463+0000 7fc3cffff640 1 -- 172.21.15.63:0/1005285996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d0103b60 msgr2=0x7fc3d019c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.463+0000 7fc3cffff640 1 --2- 172.21.15.63:0/1005285996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d0103b60 0x7fc3d019c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.463+0000 7fc3cffff640 1 -- 172.21.15.63:0/1005285996 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d01a2610 con 0x7fc3d0109df0 2024-09-21T06:37:39.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.463+0000 7fc3cffff640 1 --2- 172.21.15.63:0/1005285996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3d0109df0 0x7fc3d01a1ee0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009fd0 tx=0x7fc3c800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:39.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.463+0000 7fc3ccff9640 1 -- 172.21.15.63:0/1005285996 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8017070 con 0x7fc3d0109df0 2024-09-21T06:37:39.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.463+0000 7fc3d607f640 1 -- 172.21.15.63:0/1005285996 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d01a2900 con 0x7fc3d0109df0 2024-09-21T06:37:39.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.463+0000 7fc3ccff9640 1 -- 172.21.15.63:0/1005285996 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3c8003e20 con 0x7fc3d0109df0 2024-09-21T06:37:39.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.463+0000 7fc3ccff9640 1 -- 172.21.15.63:0/1005285996 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8010460 con 0x7fc3d0109df0 2024-09-21T06:37:39.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.463+0000 7fc3d607f640 1 -- 172.21.15.63:0/1005285996 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d01a9060 con 0x7fc3d0109df0 2024-09-21T06:37:39.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.466+0000 7fc3dc5f3740 1 Processor -- start 2024-09-21T06:37:39.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.466+0000 7fc3ccff9640 1 -- 172.21.15.63:0/1005285996 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fc3c8003970 con 0x7fc3d0109df0 2024-09-21T06:37:39.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.466+0000 7fc3dc5f3740 1 -- start start 2024-09-21T06:37:39.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.466+0000 7fc3dc5f3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5a31f1070 0x55d5a3598650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.466+0000 7fc3dc5f3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31c81b0 0x55d5a3598b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.466+0000 7fc3dc5f3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31d0390 0x55d5a35990d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.466+0000 7fc3dc5f3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d5a350ee50 con 0x55d5a31d0390 2024-09-21T06:37:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.466+0000 7fc3dc5f3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d5a34fe280 con 0x55d5a31f1070 2024-09-21T06:37:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.466+0000 7fc3dc5f3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d5a3502090 con 0x55d5a31c81b0 2024-09-21T06:37:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.466+0000 7fc3ceffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31d0390 0x55d5a35990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.466+0000 7fc3ceffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31d0390 0x55d5a35990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52716/0 (socket says 172.21.15.63:52716) 2024-09-21T06:37:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.466+0000 7fc3ceffd640 1 -- 172.21.15.63:0/2525657772 learned_addr learned my addr 172.21.15.63:0/2525657772 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.467+0000 7fc3ceffd640 1 --2- 172.21.15.63:0/2525657772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5a31f1070 0x55d5a3598650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.467+0000 7fc3cf7fe640 1 --2- 172.21.15.63:0/2525657772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31c81b0 0x55d5a3598b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.467+0000 7fc3ccff9640 1 --2- 172.21.15.63:0/1005285996 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc3b80b6680 0x7fc3b80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.467+0000 7fc3cf7fe640 1 -- 172.21.15.63:0/2525657772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5a31f1070 msgr2=0x55d5a3598650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.467+0000 7fc3cf7fe640 1 --2- 172.21.15.63:0/2525657772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5a31f1070 0x55d5a3598650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.467+0000 7fc3cf7fe640 1 -- 172.21.15.63:0/2525657772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31d0390 msgr2=0x55d5a35990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.467+0000 7fc3cf7fe640 1 --2- 172.21.15.63:0/2525657772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31d0390 0x55d5a35990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.467+0000 7fc3cf7fe640 1 -- 172.21.15.63:0/2525657772 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5a325c650 con 0x55d5a31c81b0 2024-09-21T06:37:39.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.467+0000 7fc3ccff9640 1 -- 172.21.15.63:0/1005285996 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7fc3c80e7450 con 0x7fc3d0109df0 2024-09-21T06:37:39.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.467+0000 7fc3cf7fe640 1 --2- 172.21.15.63:0/2525657772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31c81b0 0x55d5a3598b90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000bbf0 tx=0x7fc3c00107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c24d7c79d132d57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:39.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.467+0000 7fc3cffff640 1 --2- 172.21.15.63:0/1005285996 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc3b80b6680 0x7fc3b80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.467+0000 7fc3b5ffb640 1 -- 172.21.15.63:0/2525657772 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0004030 con 0x55d5a31c81b0 2024-09-21T06:37:39.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.467+0000 7fc3b5ffb640 1 -- 172.21.15.63:0/2525657772 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3c00035f0 con 0x55d5a31c81b0 2024-09-21T06:37:39.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.467+0000 7fc3b5ffb640 1 -- 172.21.15.63:0/2525657772 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c00116a0 con 0x55d5a31c81b0 2024-09-21T06:37:39.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.468+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/2525657772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31c81b0 msgr2=0x55d5a3598b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.468+0000 7fc3cffff640 1 --2- 172.21.15.63:0/1005285996 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc3b80b6680 0x7fc3b80b8b90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80ad000 tx=0x7fc3c800b910 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:39.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.468+0000 7fc3dc5f3740 1 --2- 172.21.15.63:0/2525657772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31c81b0 0x55d5a3598b90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000bbf0 tx=0x7fc3c00107a0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.468+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/2525657772 shutdown_connections 2024-09-21T06:37:39.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.468+0000 7fc3dc5f3740 1 --2- 172.21.15.63:0/2525657772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31d0390 0x55d5a35990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.468+0000 7fc3dc5f3740 1 --2- 172.21.15.63:0/2525657772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31c81b0 0x55d5a3598b90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.468+0000 7fc3dc5f3740 1 --2- 172.21.15.63:0/2525657772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5a31f1070 0x55d5a3598650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.468+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/2525657772 >> 172.21.15.63:0/2525657772 conn(0x55d5a31e5460 msgr2=0x55d5a3596540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:39.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.468+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/2525657772 shutdown_connections 2024-09-21T06:37:39.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.468+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/2525657772 wait complete. 2024-09-21T06:37:39.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.469+0000 7fc3dc5f3740 1 -- start start 2024-09-21T06:37:39.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.469+0000 7fc3dc5f3740 1 Processor -- start 2024-09-21T06:37:39.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.469+0000 7fc3dc5f3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31c81b0 0x55d5a35a3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.469+0000 7fc3dc5f3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31d0390 0x55d5a35a4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.469+0000 7fc3dc5f3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5a31f1070 0x55d5a35b0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.469+0000 7fc3dc5f3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d5a335f700 con 0x55d5a31d0390 2024-09-21T06:37:39.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.469+0000 7fc3dc5f3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d5a3499110 con 0x55d5a31f1070 2024-09-21T06:37:39.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.469+0000 7fc3dc5f3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d5a35a6e30 con 0x55d5a31c81b0 2024-09-21T06:37:39.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.469+0000 7fc3dc5f3740 10 client.0 _ll_register_callbacks cb 0x55d5a34b2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:39.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.470+0000 7fc3cf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31d0390 0x55d5a35a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.470+0000 7fc3cf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31d0390 0x55d5a35a4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52720/0 (socket says 172.21.15.63:52720) 2024-09-21T06:37:39.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.470+0000 7fc3cf7fe640 1 -- 172.21.15.63:0/3267626578 learned_addr learned my addr 172.21.15.63:0/3267626578 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:39.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.470+0000 7fc3ceffd640 1 --2- 172.21.15.63:0/3267626578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31c81b0 0x55d5a35a3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.470+0000 7fc3ceffd640 1 --2- 172.21.15.63:0/3267626578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5a31f1070 0x55d5a35b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.470+0000 7fc3cf7fe640 1 -- 172.21.15.63:0/3267626578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31c81b0 msgr2=0x55d5a35a3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.470+0000 7fc3cf7fe640 1 --2- 172.21.15.63:0/3267626578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31c81b0 0x55d5a35a3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.470+0000 7fc3cf7fe640 1 -- 172.21.15.63:0/3267626578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5a31f1070 msgr2=0x55d5a35b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.470+0000 7fc3cf7fe640 1 --2- 172.21.15.63:0/3267626578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5a31f1070 0x55d5a35b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.470+0000 7fc3cf7fe640 1 -- 172.21.15.63:0/3267626578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5a34c6c40 con 0x55d5a31d0390 2024-09-21T06:37:39.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.470+0000 7fc3cf7fe640 1 --2- 172.21.15.63:0/3267626578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31d0390 0x55d5a35a4230 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0000c00 tx=0x7fc3c000bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f0e3365de6f6bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:39.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.470+0000 7fc3aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:37:39.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.470+0000 7fc3aeffd640 1 -- 172.21.15.63:0/3267626578 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c002a060 con 0x55d5a31d0390 2024-09-21T06:37:39.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.470+0000 7fc3aeffd640 1 -- 172.21.15.63:0/3267626578 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7fc3c0004290 con 0x55d5a31d0390 2024-09-21T06:37:39.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.470+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/3267626578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3c00035f0 con 0x55d5a31d0390 2024-09-21T06:37:39.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.471+0000 7fc3aeffd640 1 -- 172.21.15.63:0/3267626578 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fc3c00044d0 con 0x55d5a31d0390 2024-09-21T06:37:39.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.471+0000 7fc3dc5f3740 10 client.17466 fetch_fsmap learned FSMap version 61 2024-09-21T06:37:39.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.471+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/3267626578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55d5a35b2b50 con 0x55d5a31d0390 2024-09-21T06:37:39.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.471+0000 7fc3aeffd640 1 -- 172.21.15.63:0/3267626578 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3c00035f0 con 0x55d5a31d0390 2024-09-21T06:37:39.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.471+0000 7fc3aeffd640 1 -- 172.21.15.63:0/3267626578 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fc3c00046c0 con 0x55d5a31d0390 2024-09-21T06:37:39.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.471+0000 7fc3dc5f3740 10 client.17466 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:37:39.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.471+0000 7fc3dc5f3740 10 client.17466 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:37:39.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.471+0000 7fc3dc5f3740 20 client.17466 populate_metadata read hostname 'smithi063' 2024-09-21T06:37:39.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.471+0000 7fc3dc5f3740 1 --2- 172.21.15.63:0/3267626578 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d5a31af9f0 0x55d5a35b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.471+0000 7fc3dc5f3740 4 client.17466 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:39.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.471+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/3267626578 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5a3510da0 con 0x55d5a31af9f0 2024-09-21T06:37:39.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.471+0000 7fc3ceffd640 1 --2- 172.21.15.63:0/3267626578 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d5a31af9f0 0x55d5a35b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.472+0000 7fc3ceffd640 1 --2- 172.21.15.63:0/3267626578 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d5a31af9f0 0x55d5a35b5eb0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b964ef303dae1d8 server_cookie=24b2bda492b6a7fe in_seq=0 out_seq=0 2024-09-21T06:37:39.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.472+0000 7fc3aeffd640 10 client.17466 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:37:39.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.473+0000 7fc3aeffd640 1 -- 172.21.15.63:0/3267626578 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d5a3510da0 con 0x55d5a31af9f0 2024-09-21T06:37:39.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.473+0000 7fc3aeffd640 10 client.17466 handle_command_reply: tid=0 2024-09-21T06:37:39.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.473+0000 7fc3dc5f3740 1 client.17466 shutdown 2024-09-21T06:37:39.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.473+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/3267626578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31d0390 msgr2=0x55d5a35a4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.473+0000 7fc3dc5f3740 1 --2- 172.21.15.63:0/3267626578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31d0390 0x55d5a35a4230 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0000c00 tx=0x7fc3c000bf80 comp rx=0 tx=0).stop 2024-09-21T06:37:39.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.473+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/3267626578 shutdown_connections 2024-09-21T06:37:39.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.473+0000 7fc3dc5f3740 1 --2- 172.21.15.63:0/3267626578 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d5a31af9f0 0x55d5a35b5eb0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.473+0000 7fc3dc5f3740 1 --2- 172.21.15.63:0/3267626578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5a31f1070 0x55d5a35b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.473+0000 7fc3dc5f3740 1 --2- 172.21.15.63:0/3267626578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31d0390 0x55d5a35a4230 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.473+0000 7fc3dc5f3740 1 --2- 172.21.15.63:0/3267626578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31c81b0 0x55d5a35a3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.473+0000 7fc3aeffd640 0 client.17466 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:37:39.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.473+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/3267626578 >> 172.21.15.63:0/3267626578 conn(0x55d5a31e5460 msgr2=0x55d5a359b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:39.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.473+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/3267626578 shutdown_connections 2024-09-21T06:37:39.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.473+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/3267626578 wait complete. 2024-09-21T06:37:39.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.473+0000 7fc3dc5f3740 20 client.17466 trim_cache size 0 max 16384 2024-09-21T06:37:39.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.491+0000 7fc3dc5f3740 1 Processor -- start 2024-09-21T06:37:39.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.491+0000 7fc3dc5f3740 1 -- start start 2024-09-21T06:37:39.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.491+0000 7fc3dc5f3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31c81b0 0x55d5a35a2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.491+0000 7fc3dc5f3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5a31d0390 0x55d5a3599d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.491+0000 7fc3dc5f3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31f1070 0x55d5a35b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.491+0000 7fc3dc5f3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d01b1a10 con 0x55d5a31f1070 2024-09-21T06:37:39.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.491+0000 7fc3dc5f3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d01b3550 con 0x55d5a31d0390 2024-09-21T06:37:39.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.491+0000 7fc3dc5f3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d01b20e0 con 0x55d5a31c81b0 2024-09-21T06:37:39.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.491+0000 7fc3ceffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31f1070 0x55d5a35b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.491+0000 7fc3ceffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31f1070 0x55d5a35b00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52726/0 (socket says 172.21.15.63:52726) 2024-09-21T06:37:39.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.491+0000 7fc3ceffd640 1 -- 172.21.15.63:0/2037240518 learned_addr learned my addr 172.21.15.63:0/2037240518 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:39.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.491+0000 7fc3cf7fe640 1 --2- 172.21.15.63:0/2037240518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5a31d0390 0x55d5a3599d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.491+0000 7fc3ceffd640 1 --2- 172.21.15.63:0/2037240518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31c81b0 0x55d5a35a2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.491+0000 7fc3ceffd640 1 -- 172.21.15.63:0/2037240518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31c81b0 msgr2=0x55d5a35a2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.491+0000 7fc3ceffd640 1 --2- 172.21.15.63:0/2037240518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31c81b0 0x55d5a35a2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.491+0000 7fc3ceffd640 1 -- 172.21.15.63:0/2037240518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5a31d0390 msgr2=0x55d5a3599d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.491+0000 7fc3ceffd640 1 --2- 172.21.15.63:0/2037240518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5a31d0390 0x55d5a3599d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.491+0000 7fc3ceffd640 1 -- 172.21.15.63:0/2037240518 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5a359a940 con 0x55d5a31f1070 2024-09-21T06:37:39.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.492+0000 7fc3ceffd640 1 --2- 172.21.15.63:0/2037240518 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31f1070 0x55d5a35b00c0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4006010 tx=0x7fc3c4031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7535ae8959d690b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:39.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.492+0000 7fc3b57fa640 1 -- 172.21.15.63:0/2037240518 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4035040 con 0x55d5a31f1070 2024-09-21T06:37:39.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.492+0000 7fc3b57fa640 1 -- 172.21.15.63:0/2037240518 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3c40054f0 con 0x55d5a31f1070 2024-09-21T06:37:39.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.492+0000 7fc3b57fa640 1 -- 172.21.15.63:0/2037240518 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4004c20 con 0x55d5a31f1070 2024-09-21T06:37:39.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.493+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/2037240518 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31f1070 msgr2=0x55d5a35b00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.493+0000 7fc3dc5f3740 1 --2- 172.21.15.63:0/2037240518 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31f1070 0x55d5a35b00c0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4006010 tx=0x7fc3c4031400 comp rx=0 tx=0).stop 2024-09-21T06:37:39.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.493+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/2037240518 shutdown_connections 2024-09-21T06:37:39.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.493+0000 7fc3dc5f3740 1 --2- 172.21.15.63:0/2037240518 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31f1070 0x55d5a35b00c0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.493+0000 7fc3dc5f3740 1 --2- 172.21.15.63:0/2037240518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5a31d0390 0x55d5a3599d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.493+0000 7fc3dc5f3740 1 --2- 172.21.15.63:0/2037240518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31c81b0 0x55d5a35a2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.493+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/2037240518 >> 172.21.15.63:0/2037240518 conn(0x55d5a31e5460 msgr2=0x55d5a3599680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:39.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.493+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/2037240518 shutdown_connections 2024-09-21T06:37:39.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.493+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/2037240518 wait complete. 2024-09-21T06:37:39.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.493+0000 7fc3dc5f3740 1 -- start start 2024-09-21T06:37:39.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.493+0000 7fc3dc5f3740 1 Processor -- start 2024-09-21T06:37:39.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.494+0000 7fc3dc5f3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5a31c81b0 0x55d5a35b6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.494+0000 7fc3dc5f3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31d0390 0x55d5a35b7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.494+0000 7fc3dc5f3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31f1070 0x55d5a35b7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.494+0000 7fc3dc5f3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d01b2e80 con 0x55d5a31d0390 2024-09-21T06:37:39.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.494+0000 7fc3dc5f3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d01b27b0 con 0x55d5a31c81b0 2024-09-21T06:37:39.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.494+0000 7fc3dc5f3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d01afa10 con 0x55d5a31f1070 2024-09-21T06:37:39.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.494+0000 7fc3dc5f3740 10 client.0 _ll_register_callbacks cb 0x7fc3c4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:39.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.494+0000 7fc3cf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31d0390 0x55d5a35b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.494+0000 7fc3cf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31d0390 0x55d5a35b7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52728/0 (socket says 172.21.15.63:52728) 2024-09-21T06:37:39.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.494+0000 7fc3cf7fe640 1 -- 172.21.15.63:0/3132178906 learned_addr learned my addr 172.21.15.63:0/3132178906 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:37:39.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.494+0000 7fc3ceffd640 1 --2- 172.21.15.63:0/3132178906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5a31c81b0 0x55d5a35b6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.494+0000 7fc3ceffd640 1 --2- 172.21.15.63:0/3132178906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31f1070 0x55d5a35b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.494+0000 7fc3cf7fe640 1 -- 172.21.15.63:0/3132178906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31f1070 msgr2=0x55d5a35b7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.494+0000 7fc3cf7fe640 1 --2- 172.21.15.63:0/3132178906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31f1070 0x55d5a35b7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.494+0000 7fc3cf7fe640 1 -- 172.21.15.63:0/3132178906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5a31c81b0 msgr2=0x55d5a35b6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.494+0000 7fc3cf7fe640 1 --2- 172.21.15.63:0/3132178906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5a31c81b0 0x55d5a35b6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.494+0000 7fc3cf7fe640 1 -- 172.21.15.63:0/3132178906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5a361f660 con 0x55d5a31d0390 2024-09-21T06:37:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.494+0000 7fc3cf7fe640 1 --2- 172.21.15.63:0/3132178906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31d0390 0x55d5a35b7450 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0004c30 tx=0x7fc3c000b570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9ee9aaf7846837 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.494+0000 7fc3aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:37:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.495+0000 7fc3aeffd640 1 -- 172.21.15.63:0/3132178906 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c000ba40 con 0x55d5a31d0390 2024-09-21T06:37:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.495+0000 7fc3aeffd640 1 -- 172.21.15.63:0/3132178906 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8593+0+0 (secure 0 0 0) 0x7fc3c0003800 con 0x55d5a31d0390 2024-09-21T06:37:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.495+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/3132178906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3c40054f0 con 0x55d5a31d0390 2024-09-21T06:37:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.495+0000 7fc3aeffd640 1 -- 172.21.15.63:0/3132178906 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fc3c0003a00 con 0x55d5a31d0390 2024-09-21T06:37:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.495+0000 7fc3dc5f3740 10 client.17472 fetch_fsmap learned FSMap version 61 2024-09-21T06:37:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.495+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/3132178906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55d5a36208f0 con 0x55d5a31d0390 2024-09-21T06:37:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.495+0000 7fc3aeffd640 1 -- 172.21.15.63:0/3132178906 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3c40054f0 con 0x55d5a31d0390 2024-09-21T06:37:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.495+0000 7fc3aeffd640 1 -- 172.21.15.63:0/3132178906 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fc3c0034020 con 0x55d5a31d0390 2024-09-21T06:37:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.495+0000 7fc3dc5f3740 10 client.17472 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:37:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.495+0000 7fc3dc5f3740 10 client.17472 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:37:39.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.495+0000 7fc3dc5f3740 20 client.17472 populate_metadata read hostname 'smithi063' 2024-09-21T06:37:39.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.495+0000 7fc3dc5f3740 1 --2- 172.21.15.63:0/3132178906 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d5a3184da0 0x55d5a3623070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.495+0000 7fc3dc5f3740 4 client.17472 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:37:39.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.495+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/3132178906 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d5a350c850 con 0x55d5a3184da0 2024-09-21T06:37:39.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.496+0000 7fc3ceffd640 1 --2- 172.21.15.63:0/3132178906 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d5a3184da0 0x55d5a3623070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.496+0000 7fc3ceffd640 1 --2- 172.21.15.63:0/3132178906 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d5a3184da0 0x55d5a3623070 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f07e00df7ee267ed server_cookie=eff72a97d841e038 in_seq=0 out_seq=0 2024-09-21T06:37:39.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.496+0000 7fc3aeffd640 10 client.17472 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:37:39.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.496+0000 7fc3aeffd640 1 -- 172.21.15.63:0/3132178906 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x55d5a350c850 con 0x55d5a3184da0 2024-09-21T06:37:39.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.496+0000 7fc3aeffd640 10 client.17472 handle_command_reply: tid=0 2024-09-21T06:37:39.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.497+0000 7fc3dc5f3740 1 client.17472 shutdown 2024-09-21T06:37:39.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.497+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/3132178906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31d0390 msgr2=0x55d5a35b7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.497+0000 7fc3dc5f3740 1 --2- 172.21.15.63:0/3132178906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31d0390 0x55d5a35b7450 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0004c30 tx=0x7fc3c000b570 comp rx=0 tx=0).stop 2024-09-21T06:37:39.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.497+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/3132178906 shutdown_connections 2024-09-21T06:37:39.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.497+0000 7fc3dc5f3740 1 --2- 172.21.15.63:0/3132178906 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d5a3184da0 0x55d5a3623070 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.497+0000 7fc3dc5f3740 1 --2- 172.21.15.63:0/3132178906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d5a31f1070 0x55d5a35b7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.497+0000 7fc3dc5f3740 1 --2- 172.21.15.63:0/3132178906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d5a31d0390 0x55d5a35b7450 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.497+0000 7fc3dc5f3740 1 --2- 172.21.15.63:0/3132178906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5a31c81b0 0x55d5a35b6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.497+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/3132178906 >> 172.21.15.63:0/3132178906 conn(0x55d5a31e5460 msgr2=0x55d5a35a51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:39.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.497+0000 7fc3aeffd640 0 client.17472 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:37:39.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.497+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/3132178906 shutdown_connections 2024-09-21T06:37:39.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.497+0000 7fc3dc5f3740 1 -- 172.21.15.63:0/3132178906 wait complete. 2024-09-21T06:37:39.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.497+0000 7fc3dc5f3740 20 client.17472 trim_cache size 0 max 16384 2024-09-21T06:37:39.504 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:37:39.504 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:37:39.504 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": { 2024-09-21T06:37:39.504 INFO:teuthology.orchestra.run.smithi063.stdout: "7f2a9ce4-d90a-4ac2-9e03-b14126f1aa0d": { 2024-09-21T06:37:39.504 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:37:39.504 INFO:teuthology.orchestra.run.smithi063.stdout: "tag": "7f2a9ce4-d90a-4ac2-9e03-b14126f1aa0d", 2024-09-21T06:37:39.504 INFO:teuthology.orchestra.run.smithi063.stdout: "options": "recursive,force" 2024-09-21T06:37:39.504 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:37:39.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:37:39.504 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:37:39.504 INFO:teuthology.orchestra.run.smithi063.stdout: "7f2a9ce4-d90a-4ac2-9e03-b14126f1aa0d": { 2024-09-21T06:37:39.504 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:37:37.866745+0000", 2024-09-21T06:37:39.505 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:37:39.505 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:37:39.505 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:37:39.505 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:37:39.505 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:37:39.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:37:39.505 INFO:teuthology.orchestra.run.smithi063.stdout: "9ad8f980-759b-4f0b-a3d4-e748a05e78b0": { 2024-09-21T06:37:39.505 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:36:53.116490+0000", 2024-09-21T06:37:39.505 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:37:39.505 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:37:39.505 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:37:39.505 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:37:39.505 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:37:39.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:37:39.506 INFO:teuthology.orchestra.run.smithi063.stdout: "0c926bc7-90f8-47ce-a0d2-d02e676a73e9": { 2024-09-21T06:37:39.506 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:35:22.494015+0000", 2024-09-21T06:37:39.506 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:37:39.506 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:37:39.506 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:37:39.506 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:37:39.506 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:37:39.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:37:39.506 INFO:teuthology.orchestra.run.smithi063.stdout: "4f099144-5170-453b-a745-ddc222860f34": { 2024-09-21T06:37:39.506 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:34:35.417817+0000", 2024-09-21T06:37:39.506 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:37:39.506 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:37:39.506 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:37:39.507 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:37:39.507 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:37:39.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:37:39.507 INFO:teuthology.orchestra.run.smithi063.stdout: "91ae0a75-6a3f-452f-8bda-0f19862a5724": { 2024-09-21T06:37:39.507 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:50.316590+0000", 2024-09-21T06:37:39.507 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:37:39.507 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:37:39.507 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:37:39.507 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:37:39.507 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:37:39.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:37:39.507 INFO:teuthology.orchestra.run.smithi063.stdout: "5396028b-35f4-48fe-b54d-385784e97de3": { 2024-09-21T06:37:39.507 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:04.523378+0000", 2024-09-21T06:37:39.507 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:37:39.508 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:37:39.508 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:37:39.508 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:37:39.508 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:37:39.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:37:39.508 INFO:teuthology.orchestra.run.smithi063.stdout: "1b9cca6e-2b23-49b2-a894-182a1054bc02": { 2024-09-21T06:37:39.508 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:36:07.545253+0000", 2024-09-21T06:37:39.508 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:37:39.508 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:37:39.508 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:37:39.508 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:37:39.508 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:37:39.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:37:39.508 INFO:teuthology.orchestra.run.smithi063.stdout: "024d3c59-0b67-49a9-bf4a-e02d36691942": { 2024-09-21T06:37:39.509 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:32:14.282244+0000", 2024-09-21T06:37:39.509 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:37:39.509 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:37:39.509 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:37:39.509 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:37:39.509 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:37:39.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:37:39.509 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:37:39.509 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:31:27.507051+0000", 2024-09-21T06:37:39.509 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:37:39.509 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:37:39.509 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:37:39.509 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:37:39.510 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:37:39.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:37:39.510 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:37:39.510 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:37:39.510 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:37:39.510 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:37:39.510 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:37:39.510 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:37:39.510 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:37:39.510 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:37:39.510 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:37:39.510 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:37:39.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.497+0000 7fc3d607f640 1 -- 172.21.15.63:0/1005285996 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc3b80b6680 msgr2=0x7fc3b80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.497+0000 7fc3d607f640 1 --2- 172.21.15.63:0/1005285996 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc3b80b6680 0x7fc3b80b8b90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80ad000 tx=0x7fc3c800b910 comp rx=0 tx=0).stop 2024-09-21T06:37:39.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.497+0000 7fc3d607f640 1 -- 172.21.15.63:0/1005285996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3d0109df0 msgr2=0x7fc3d01a1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.497+0000 7fc3d607f640 1 --2- 172.21.15.63:0/1005285996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3d0109df0 0x7fc3d01a1ee0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009fd0 tx=0x7fc3c800b260 comp rx=0 tx=0).stop 2024-09-21T06:37:39.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.498+0000 7fc3d607f640 1 -- 172.21.15.63:0/1005285996 shutdown_connections 2024-09-21T06:37:39.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.498+0000 7fc3d607f640 1 --2- 172.21.15.63:0/1005285996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3d0109df0 0x7fc3d01a1ee0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.498+0000 7fc3d607f640 1 --2- 172.21.15.63:0/1005285996 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc3b80b6680 0x7fc3b80b8b90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.498+0000 7fc3d607f640 1 --2- 172.21.15.63:0/1005285996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3d01094a0 0x7fc3d019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.498+0000 7fc3d607f640 1 --2- 172.21.15.63:0/1005285996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d0103b60 0x7fc3d019c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.498+0000 7fc3d607f640 1 -- 172.21.15.63:0/1005285996 >> 172.21.15.63:0/1005285996 conn(0x7fc3d007b850 msgr2=0x7fc3d01052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:39.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.498+0000 7fc3d607f640 1 -- 172.21.15.63:0/1005285996 shutdown_connections 2024-09-21T06:37:39.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:37:39.498+0000 7fc3d607f640 1 -- 172.21.15.63:0/1005285996 wait complete. 2024-09-21T06:37:40.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:39 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:37:40.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:39 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:40.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:39 smithi063 ceph-mon[31150]: pgmap v612: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:37:40.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:39 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:37:40.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:39 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:40.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:39 smithi175 ceph-mon[34510]: pgmap v612: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:37:40.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:39 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:37:40.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:39 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:40.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:39 smithi071 ceph-mon[34844]: pgmap v612: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:37:40.278 INFO:tasks.cephfs.filesystem:scrub status for tag:7f2a9ce4-d90a-4ac2-9e03-b14126f1aa0d - {'path': '/', 'tag': '7f2a9ce4-d90a-4ac2-9e03-b14126f1aa0d', 'options': 'recursive,force'} 2024-09-21T06:37:42.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:41 smithi063 ceph-mon[31150]: pgmap v613: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 11 op/s 2024-09-21T06:37:42.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:41 smithi175 ceph-mon[34510]: pgmap v613: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 11 op/s 2024-09-21T06:37:42.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:41 smithi071 ceph-mon[34844]: pgmap v613: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 11 op/s 2024-09-21T06:37:44.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:43 smithi063 ceph-mon[31150]: pgmap v614: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-21T06:37:44.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:43 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:37:44.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:43 smithi175 ceph-mon[34510]: pgmap v614: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-21T06:37:44.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:43 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:37:44.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:43 smithi071 ceph-mon[34844]: pgmap v614: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-21T06:37:44.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:43 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:37:45.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:44 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:37:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:44 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:37:45.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:44 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:37:46.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:45 smithi063 ceph-mon[31150]: pgmap v615: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T06:37:46.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:45 smithi175 ceph-mon[34510]: pgmap v615: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T06:37:46.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:45 smithi071 ceph-mon[34844]: pgmap v615: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T06:37:48.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:47 smithi063 ceph-mon[31150]: pgmap v616: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T06:37:48.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:47 smithi175 ceph-mon[34510]: pgmap v616: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T06:37:48.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:47 smithi071 ceph-mon[34844]: pgmap v616: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T06:37:50.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:49 smithi063 ceph-mon[31150]: pgmap v617: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-21T06:37:50.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:49 smithi175 ceph-mon[34510]: pgmap v617: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-21T06:37:50.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:49 smithi071 ceph-mon[34844]: pgmap v617: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-21T06:37:51.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:50 smithi063 ceph-mon[31150]: pgmap v618: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T06:37:51.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:50 smithi175 ceph-mon[34510]: pgmap v618: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T06:37:51.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:50 smithi071 ceph-mon[34844]: pgmap v618: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T06:37:53.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:53 smithi071 ceph-mon[34844]: pgmap v619: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-21T06:37:53.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:53 smithi063 ceph-mon[31150]: pgmap v619: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-21T06:37:53.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:53 smithi175 ceph-mon[34510]: pgmap v619: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-21T06:37:55.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:55 smithi071 ceph-mon[34844]: pgmap v620: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-21T06:37:55.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:55 smithi063 ceph-mon[31150]: pgmap v620: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-21T06:37:55.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:55 smithi175 ceph-mon[34510]: pgmap v620: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-21T06:37:57.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:57 smithi071 ceph-mon[34844]: pgmap v621: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:37:57.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:57 smithi063 ceph-mon[31150]: pgmap v621: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:37:57.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:57 smithi175 ceph-mon[34510]: pgmap v621: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:37:59.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:37:59 smithi071 ceph-mon[34844]: pgmap v622: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:37:59.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:37:59 smithi063 ceph-mon[31150]: pgmap v622: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:37:59.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:37:59 smithi175 ceph-mon[34510]: pgmap v622: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:38:01.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:01 smithi071 ceph-mon[34844]: pgmap v623: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T06:38:01.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:01 smithi063 ceph-mon[31150]: pgmap v623: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T06:38:01.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:01 smithi175 ceph-mon[34510]: pgmap v623: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T06:38:03.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:03 smithi071 ceph-mon[34844]: pgmap v624: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-21T06:38:03.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:03 smithi063 ceph-mon[31150]: pgmap v624: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-21T06:38:03.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:03 smithi175 ceph-mon[34510]: pgmap v624: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-21T06:38:05.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:05 smithi071 ceph-mon[34844]: pgmap v625: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:38:05.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:05 smithi063 ceph-mon[31150]: pgmap v625: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:38:05.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:05 smithi175 ceph-mon[34510]: pgmap v625: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:38:07.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:07 smithi071 ceph-mon[34844]: pgmap v626: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-21T06:38:07.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:07 smithi063 ceph-mon[31150]: pgmap v626: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-21T06:38:07.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:07 smithi175 ceph-mon[34510]: pgmap v626: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-21T06:38:09.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:09 smithi071 ceph-mon[34844]: pgmap v627: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T06:38:09.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:09 smithi071 ceph-mon[34844]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T06:38:09.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:09 smithi063 ceph-mon[31150]: pgmap v627: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T06:38:09.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:09 smithi063 ceph-mon[31150]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T06:38:09.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:09 smithi175 ceph-mon[34510]: pgmap v627: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T06:38:09.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:09 smithi175 ceph-mon[34510]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T06:38:10.279 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:38:10.554 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:11.291 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:11 smithi063 ceph-mon[31150]: pgmap v629: 97 pgs: 3 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 92 active+clean; 251 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:38:11.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.283+0000 7fcad2c97640 1 -- 172.21.15.63:0/1343280965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcacc102a60 msgr2=0x7fcacc102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:11.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.283+0000 7fcad2c97640 1 --2- 172.21.15.63:0/1343280965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcacc102a60 0x7fcacc102e70 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009900 tx=0x7fcac402a410 comp rx=0 tx=0).stop 2024-09-21T06:38:11.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.283+0000 7fcad2c97640 1 -- 172.21.15.63:0/1343280965 shutdown_connections 2024-09-21T06:38:11.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.283+0000 7fcad2c97640 1 --2- 172.21.15.63:0/1343280965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcacc108cf0 0x7fcacc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.283+0000 7fcad2c97640 1 --2- 172.21.15.63:0/1343280965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcacc1083a0 0x7fcacc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.283+0000 7fcad2c97640 1 --2- 172.21.15.63:0/1343280965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcacc102a60 0x7fcacc102e70 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.283+0000 7fcad2c97640 1 -- 172.21.15.63:0/1343280965 >> 172.21.15.63:0/1343280965 conn(0x7fcacc079730 msgr2=0x7fcacc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:11.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.283+0000 7fcad2c97640 1 -- 172.21.15.63:0/1343280965 shutdown_connections 2024-09-21T06:38:11.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.283+0000 7fcad2c97640 1 -- 172.21.15.63:0/1343280965 wait complete. 2024-09-21T06:38:11.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.284+0000 7fcad2c97640 1 Processor -- start 2024-09-21T06:38:11.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.284+0000 7fcad2c97640 1 -- start start 2024-09-21T06:38:11.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.284+0000 7fcad2c97640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcacc102a60 0x7fcacc19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.284+0000 7fcad2c97640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcacc1083a0 0x7fcacc19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.284+0000 7fcad2c97640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcacc108cf0 0x7fcacc19fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.284+0000 7fcad2c97640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc113b40 con 0x7fcacc1083a0 2024-09-21T06:38:11.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.284+0000 7fcad2c97640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1139c0 con 0x7fcacc102a60 2024-09-21T06:38:11.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.284+0000 7fcad2c97640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc113cc0 con 0x7fcacc108cf0 2024-09-21T06:38:11.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.284+0000 7fcacbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcacc1083a0 0x7fcacc19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.284+0000 7fcacbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcacc1083a0 0x7fcacc19ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37812/0 (socket says 172.21.15.63:37812) 2024-09-21T06:38:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.284+0000 7fcacbfff640 1 -- 172.21.15.63:0/3916254737 learned_addr learned my addr 172.21.15.63:0/3916254737 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.284+0000 7fcad0a33640 1 --2- 172.21.15.63:0/3916254737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcacc102a60 0x7fcacc19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.284+0000 7fcad1234640 1 --2- 172.21.15.63:0/3916254737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcacc108cf0 0x7fcacc19fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.284+0000 7fcacbfff640 1 -- 172.21.15.63:0/3916254737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcacc108cf0 msgr2=0x7fcacc19fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.284+0000 7fcacbfff640 1 --2- 172.21.15.63:0/3916254737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcacc108cf0 0x7fcacc19fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.284+0000 7fcacbfff640 1 -- 172.21.15.63:0/3916254737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcacc102a60 msgr2=0x7fcacc19a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.284+0000 7fcacbfff640 1 --2- 172.21.15.63:0/3916254737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcacc102a60 0x7fcacc19a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.284+0000 7fcacbfff640 1 -- 172.21.15.63:0/3916254737 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcacc1a0520 con 0x7fcacc1083a0 2024-09-21T06:38:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.284+0000 7fcad1234640 1 --2- 172.21.15.63:0/3916254737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcacc108cf0 0x7fcacc19fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.285+0000 7fcacbfff640 1 --2- 172.21.15.63:0/3916254737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcacc1083a0 0x7fcacc19ab50 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fcab400b470 tx=0x7fcab400b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.285+0000 7fcac9ffb640 1 -- 172.21.15.63:0/3916254737 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab4015020 con 0x7fcacc1083a0 2024-09-21T06:38:11.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.285+0000 7fcac9ffb640 1 -- 172.21.15.63:0/3916254737 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcab4011d40 con 0x7fcacc1083a0 2024-09-21T06:38:11.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.285+0000 7fcac9ffb640 1 -- 172.21.15.63:0/3916254737 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab400f340 con 0x7fcacc1083a0 2024-09-21T06:38:11.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.285+0000 7fcad2c97640 1 -- 172.21.15.63:0/3916254737 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcacc1a0810 con 0x7fcacc1083a0 2024-09-21T06:38:11.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.285+0000 7fcad2c97640 1 -- 172.21.15.63:0/3916254737 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcacc1a6f70 con 0x7fcacc1083a0 2024-09-21T06:38:11.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.288+0000 7fcac9ffb640 1 -- 172.21.15.63:0/3916254737 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fcab4018020 con 0x7fcacc1083a0 2024-09-21T06:38:11.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.288+0000 7fcad920b740 1 Processor -- start 2024-09-21T06:38:11.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.288+0000 7fcad920b740 1 -- start start 2024-09-21T06:38:11.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.288+0000 7fcad920b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1321070 0x5580e16c8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.288+0000 7fcad920b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e12f81b0 0x5580e16c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.288+0000 7fcad920b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e1300390 0x5580e16c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.288+0000 7fcad920b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5580e163ee50 con 0x5580e1321070 2024-09-21T06:38:11.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.288+0000 7fcad920b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5580e162e280 con 0x5580e1300390 2024-09-21T06:38:11.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.288+0000 7fcad920b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5580e1632090 con 0x5580e12f81b0 2024-09-21T06:38:11.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.288+0000 7fcad1234640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1321070 0x5580e16c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.288+0000 7fcad1234640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1321070 0x5580e16c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37824/0 (socket says 172.21.15.63:37824) 2024-09-21T06:38:11.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.288+0000 7fcad1234640 1 -- 172.21.15.63:0/3410547753 learned_addr learned my addr 172.21.15.63:0/3410547753 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:11.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.288+0000 7fcacbfff640 1 --2- 172.21.15.63:0/3410547753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e1300390 0x5580e16c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.288+0000 7fcad0a33640 1 --2- 172.21.15.63:0/3410547753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e12f81b0 0x5580e16c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.289+0000 7fcac9ffb640 1 --2- 172.21.15.63:0/3916254737 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcab80b6680 0x7fcab80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.289+0000 7fcad1234640 1 -- 172.21.15.63:0/3410547753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e12f81b0 msgr2=0x5580e16c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:11.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.289+0000 7fcad1234640 1 --2- 172.21.15.63:0/3410547753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e12f81b0 0x5580e16c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.289+0000 7fcad1234640 1 -- 172.21.15.63:0/3410547753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e1300390 msgr2=0x5580e16c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:11.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.289+0000 7fcad1234640 1 --2- 172.21.15.63:0/3410547753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e1300390 0x5580e16c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.289+0000 7fcad1234640 1 -- 172.21.15.63:0/3410547753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580e138c650 con 0x5580e1321070 2024-09-21T06:38:11.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.289+0000 7fcac9ffb640 1 -- 172.21.15.63:0/3916254737 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8637+0+0 (secure 0 0 0) 0x7fcab40e7170 con 0x7fcacc1083a0 2024-09-21T06:38:11.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.289+0000 7fcad1234640 1 --2- 172.21.15.63:0/3916254737 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcab80b6680 0x7fcab80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.289+0000 7fcad1234640 1 --2- 172.21.15.63:0/3410547753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1321070 0x5580e16c8270 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00c370 tx=0x7fcabc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fdbc9300d8710b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:11.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.289+0000 7fcac2ffd640 1 -- 172.21.15.63:0/3410547753 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcabc016070 con 0x5580e1321070 2024-09-21T06:38:11.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.289+0000 7fcac2ffd640 1 -- 172.21.15.63:0/3410547753 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcabc011cd0 con 0x5580e1321070 2024-09-21T06:38:11.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.289+0000 7fcac2ffd640 1 -- 172.21.15.63:0/3410547753 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcabc01bb10 con 0x5580e1321070 2024-09-21T06:38:11.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.290+0000 7fcad1234640 1 --2- 172.21.15.63:0/3916254737 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcab80b6680 0x7fcab80b8b90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcabc01d000 tx=0x7fcabc01e000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:11.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.290+0000 7fcad920b740 1 -- 172.21.15.63:0/3410547753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1321070 msgr2=0x5580e16c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:11.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.290+0000 7fcad920b740 1 --2- 172.21.15.63:0/3410547753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1321070 0x5580e16c8270 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00c370 tx=0x7fcabc00c830 comp rx=0 tx=0).stop 2024-09-21T06:38:11.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.290+0000 7fcad920b740 1 -- 172.21.15.63:0/3410547753 shutdown_connections 2024-09-21T06:38:11.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.290+0000 7fcad920b740 1 --2- 172.21.15.63:0/3410547753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e1300390 0x5580e16c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.290+0000 7fcad920b740 1 --2- 172.21.15.63:0/3410547753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e12f81b0 0x5580e16c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.290+0000 7fcad920b740 1 --2- 172.21.15.63:0/3410547753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1321070 0x5580e16c8270 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.291+0000 7fcad920b740 1 -- 172.21.15.63:0/3410547753 >> 172.21.15.63:0/3410547753 conn(0x5580e1315460 msgr2=0x5580e16c6160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:11.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.291+0000 7fcad920b740 1 -- 172.21.15.63:0/3410547753 shutdown_connections 2024-09-21T06:38:11.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.291+0000 7fcad920b740 1 -- 172.21.15.63:0/3410547753 wait complete. 2024-09-21T06:38:11.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.291+0000 7fcad920b740 1 -- start start 2024-09-21T06:38:11.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.291+0000 7fcad920b740 1 Processor -- start 2024-09-21T06:38:11.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.291+0000 7fcad920b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e12f81b0 0x5580e16d3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcad920b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e1300390 0x5580e16d3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcad920b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e1321070 0x5580e16d42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcad920b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5580e148f700 con 0x5580e12f81b0 2024-09-21T06:38:11.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcad920b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5580e15c9110 con 0x5580e1300390 2024-09-21T06:38:11.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcad920b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5580e16d6a50 con 0x5580e1321070 2024-09-21T06:38:11.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcad920b740 10 client.0 _ll_register_callbacks cb 0x5580e15e2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:11.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcad0a33640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e12f81b0 0x5580e16d3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcad0a33640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e12f81b0 0x5580e16d3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37834/0 (socket says 172.21.15.63:37834) 2024-09-21T06:38:11.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcad0a33640 1 -- 172.21.15.63:0/453244427 learned_addr learned my addr 172.21.15.63:0/453244427 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:11.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcad1234640 1 --2- 172.21.15.63:0/453244427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e1321070 0x5580e16d42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcacbfff640 1 --2- 172.21.15.63:0/453244427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e1300390 0x5580e16d3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcad0a33640 1 -- 172.21.15.63:0/453244427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e1321070 msgr2=0x5580e16d42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:11.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcad0a33640 1 --2- 172.21.15.63:0/453244427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e1321070 0x5580e16d42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcad0a33640 1 -- 172.21.15.63:0/453244427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e1300390 msgr2=0x5580e16d3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:11.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcad0a33640 1 --2- 172.21.15.63:0/453244427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e1300390 0x5580e16d3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcad0a33640 1 -- 172.21.15.63:0/453244427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580e15f6c40 con 0x5580e12f81b0 2024-09-21T06:38:11.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcacbfff640 1 --2- 172.21.15.63:0/453244427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e1300390 0x5580e16d3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:11.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcad0a33640 1 --2- 172.21.15.63:0/453244427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e12f81b0 0x5580e16d3840 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009900 tx=0x7fcac40316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dcc7dee218e8732 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:11.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcaabfff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:38:11.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcaabfff640 1 -- 172.21.15.63:0/453244427 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac4035040 con 0x5580e12f81b0 2024-09-21T06:38:11.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcaabfff640 1 -- 172.21.15.63:0/453244427 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8637+0+0 (secure 0 0 0) 0x7fcac4004040 con 0x5580e12f81b0 2024-09-21T06:38:11.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.292+0000 7fcad920b740 1 -- 172.21.15.63:0/453244427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcabc011cd0 con 0x5580e12f81b0 2024-09-21T06:38:11.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.293+0000 7fcaabfff640 1 -- 172.21.15.63:0/453244427 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fcac4004240 con 0x5580e12f81b0 2024-09-21T06:38:11.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.293+0000 7fcad920b740 10 client.17484 fetch_fsmap learned FSMap version 61 2024-09-21T06:38:11.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.293+0000 7fcad920b740 1 -- 172.21.15.63:0/453244427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x5580e16e2680 con 0x5580e12f81b0 2024-09-21T06:38:11.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.293+0000 7fcaabfff640 1 -- 172.21.15.63:0/453244427 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcabc011cd0 con 0x5580e12f81b0 2024-09-21T06:38:11.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.293+0000 7fcaabfff640 1 -- 172.21.15.63:0/453244427 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fcac4046640 con 0x5580e12f81b0 2024-09-21T06:38:11.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.293+0000 7fcad920b740 10 client.17484 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:38:11.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.293+0000 7fcad920b740 10 client.17484 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:38:11.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.293+0000 7fcad920b740 20 client.17484 populate_metadata read hostname 'smithi063' 2024-09-21T06:38:11.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.293+0000 7fcad920b740 1 --2- 172.21.15.63:0/453244427 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5580e12df9f0 0x5580e16e5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.293+0000 7fcad920b740 4 client.17484 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:11.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.293+0000 7fcad920b740 1 -- 172.21.15.63:0/453244427 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580e1640da0 con 0x5580e12df9f0 2024-09-21T06:38:11.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.293+0000 7fcacbfff640 1 --2- 172.21.15.63:0/453244427 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5580e12df9f0 0x5580e16e5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.294+0000 7fcacbfff640 1 --2- 172.21.15.63:0/453244427 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5580e12df9f0 0x5580e16e5c00 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=927be3403d1c13f2 server_cookie=c8f83dbe9f5db333 in_seq=0 out_seq=0 2024-09-21T06:38:11.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.294+0000 7fcaabfff640 10 client.17484 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:38:11.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.295+0000 7fcaabfff640 1 -- 172.21.15.63:0/453244427 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5580e1640da0 con 0x5580e12df9f0 2024-09-21T06:38:11.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.295+0000 7fcaabfff640 10 client.17484 handle_command_reply: tid=0 2024-09-21T06:38:11.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.295+0000 7fcad920b740 1 client.17484 shutdown 2024-09-21T06:38:11.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.295+0000 7fcad920b740 1 -- 172.21.15.63:0/453244427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e12f81b0 msgr2=0x5580e16d3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:11.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.295+0000 7fcad920b740 1 --2- 172.21.15.63:0/453244427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e12f81b0 0x5580e16d3840 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009900 tx=0x7fcac40316d0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.295+0000 7fcad920b740 1 -- 172.21.15.63:0/453244427 shutdown_connections 2024-09-21T06:38:11.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.295+0000 7fcad920b740 1 --2- 172.21.15.63:0/453244427 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5580e12df9f0 0x5580e16e5c00 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.295+0000 7fcad920b740 1 --2- 172.21.15.63:0/453244427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e1321070 0x5580e16d42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.295+0000 7fcad920b740 1 --2- 172.21.15.63:0/453244427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e1300390 0x5580e16d3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.295+0000 7fcaabfff640 0 client.17484 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:38:11.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.295+0000 7fcad920b740 1 --2- 172.21.15.63:0/453244427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e12f81b0 0x5580e16d3840 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.295+0000 7fcad920b740 1 -- 172.21.15.63:0/453244427 >> 172.21.15.63:0/453244427 conn(0x5580e1315460 msgr2=0x5580e16cb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:11.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.295+0000 7fcad920b740 1 -- 172.21.15.63:0/453244427 shutdown_connections 2024-09-21T06:38:11.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.295+0000 7fcad920b740 1 -- 172.21.15.63:0/453244427 wait complete. 2024-09-21T06:38:11.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.295+0000 7fcad920b740 20 client.17484 trim_cache size 0 max 16384 2024-09-21T06:38:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.313+0000 7fcad920b740 1 Processor -- start 2024-09-21T06:38:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.313+0000 7fcad920b740 1 -- start start 2024-09-21T06:38:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.313+0000 7fcad920b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e12f81b0 0x5580e16d5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.313+0000 7fcad920b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1300390 0x5580e16c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.313+0000 7fcad920b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e1321070 0x5580e16d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.313+0000 7fcad920b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1af930 con 0x5580e1300390 2024-09-21T06:38:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.313+0000 7fcad920b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1b1470 con 0x5580e1321070 2024-09-21T06:38:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.313+0000 7fcad920b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1b0000 con 0x5580e12f81b0 2024-09-21T06:38:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.313+0000 7fcacbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1300390 0x5580e16c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.313+0000 7fcacbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1300390 0x5580e16c99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37836/0 (socket says 172.21.15.63:37836) 2024-09-21T06:38:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.313+0000 7fcacbfff640 1 -- 172.21.15.63:0/3737448320 learned_addr learned my addr 172.21.15.63:0/3737448320 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.313+0000 7fcad0a33640 1 --2- 172.21.15.63:0/3737448320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e12f81b0 0x5580e16d5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.313+0000 7fcad1234640 1 --2- 172.21.15.63:0/3737448320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e1321070 0x5580e16d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.313+0000 7fcacbfff640 1 -- 172.21.15.63:0/3737448320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e12f81b0 msgr2=0x5580e16d5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:11.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.314+0000 7fcacbfff640 1 --2- 172.21.15.63:0/3737448320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e12f81b0 0x5580e16d5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.314+0000 7fcacbfff640 1 -- 172.21.15.63:0/3737448320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e1321070 msgr2=0x5580e16d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:11.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.314+0000 7fcacbfff640 1 --2- 172.21.15.63:0/3737448320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e1321070 0x5580e16d0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.314+0000 7fcacbfff640 1 -- 172.21.15.63:0/3737448320 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580e16c03f0 con 0x5580e1300390 2024-09-21T06:38:11.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.314+0000 7fcad0a33640 1 --2- 172.21.15.63:0/3737448320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e12f81b0 0x5580e16d5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:11.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.314+0000 7fcad1234640 1 --2- 172.21.15.63:0/3737448320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e1321070 0x5580e16d0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:11.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.314+0000 7fcacbfff640 1 --2- 172.21.15.63:0/3737448320 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1300390 0x5580e16c99b0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fcab40acee0 tx=0x7fcab40e9680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53fc6702efadac9d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:11.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.314+0000 7fcac27fc640 1 -- 172.21.15.63:0/3737448320 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab40ac6c0 con 0x5580e1300390 2024-09-21T06:38:11.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.314+0000 7fcac27fc640 1 -- 172.21.15.63:0/3737448320 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcab40aca60 con 0x5580e1300390 2024-09-21T06:38:11.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.314+0000 7fcac27fc640 1 -- 172.21.15.63:0/3737448320 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab4010ed0 con 0x5580e1300390 2024-09-21T06:38:11.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.315+0000 7fcad920b740 1 -- 172.21.15.63:0/3737448320 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1300390 msgr2=0x5580e16c99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:11.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.315+0000 7fcad920b740 1 --2- 172.21.15.63:0/3737448320 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1300390 0x5580e16c99b0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fcab40acee0 tx=0x7fcab40e9680 comp rx=0 tx=0).stop 2024-09-21T06:38:11.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.315+0000 7fcad920b740 1 -- 172.21.15.63:0/3737448320 shutdown_connections 2024-09-21T06:38:11.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.315+0000 7fcad920b740 1 --2- 172.21.15.63:0/3737448320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e1321070 0x5580e16d0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.315+0000 7fcad920b740 1 --2- 172.21.15.63:0/3737448320 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1300390 0x5580e16c99b0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.315+0000 7fcad920b740 1 --2- 172.21.15.63:0/3737448320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e12f81b0 0x5580e16d5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.315+0000 7fcad920b740 1 -- 172.21.15.63:0/3737448320 >> 172.21.15.63:0/3737448320 conn(0x5580e1315460 msgr2=0x5580e16c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:11.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.315+0000 7fcad920b740 1 -- 172.21.15.63:0/3737448320 shutdown_connections 2024-09-21T06:38:11.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.315+0000 7fcad920b740 1 -- 172.21.15.63:0/3737448320 wait complete. 2024-09-21T06:38:11.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.315+0000 7fcad920b740 1 -- start start 2024-09-21T06:38:11.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.315+0000 7fcad920b740 1 Processor -- start 2024-09-21T06:38:11.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.316+0000 7fcad920b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e12f81b0 0x5580e16d83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.316+0000 7fcad920b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1300390 0x5580e16d8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.316+0000 7fcad920b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e1321070 0x5580e174f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.316+0000 7fcad920b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1b0da0 con 0x5580e1300390 2024-09-21T06:38:11.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.316+0000 7fcad920b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1b06d0 con 0x5580e12f81b0 2024-09-21T06:38:11.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.316+0000 7fcad920b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1ad930 con 0x5580e1321070 2024-09-21T06:38:11.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.316+0000 7fcad920b740 10 client.0 _ll_register_callbacks cb 0x7fcac4031b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:11.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.316+0000 7fcacbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1300390 0x5580e16d8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.316+0000 7fcacbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1300390 0x5580e16d8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37844/0 (socket says 172.21.15.63:37844) 2024-09-21T06:38:11.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.316+0000 7fcacbfff640 1 -- 172.21.15.63:0/1619352310 learned_addr learned my addr 172.21.15.63:0/1619352310 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:11.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.316+0000 7fcad1234640 1 --2- 172.21.15.63:0/1619352310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e1321070 0x5580e174f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.316+0000 7fcad0a33640 1 --2- 172.21.15.63:0/1619352310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e12f81b0 0x5580e16d83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.316+0000 7fcacbfff640 1 -- 172.21.15.63:0/1619352310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e1321070 msgr2=0x5580e174f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:11.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.316+0000 7fcacbfff640 1 --2- 172.21.15.63:0/1619352310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e1321070 0x5580e174f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.316+0000 7fcacbfff640 1 -- 172.21.15.63:0/1619352310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e12f81b0 msgr2=0x5580e16d83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:11.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.316+0000 7fcacbfff640 1 --2- 172.21.15.63:0/1619352310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e12f81b0 0x5580e16d83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.316+0000 7fcacbfff640 1 -- 172.21.15.63:0/1619352310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580e174fb50 con 0x5580e1300390 2024-09-21T06:38:11.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.317+0000 7fcacbfff640 1 --2- 172.21.15.63:0/1619352310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1300390 0x5580e16d8930 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fcab40e4e50 tx=0x7fcab40ac6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153b567e0069d1da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:11.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.317+0000 7fcaabfff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:38:11.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.317+0000 7fcaabfff640 1 -- 172.21.15.63:0/1619352310 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab40b1a30 con 0x5580e1300390 2024-09-21T06:38:11.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.317+0000 7fcaabfff640 1 -- 172.21.15.63:0/1619352310 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8637+0+0 (secure 0 0 0) 0x7fcab40940c0 con 0x5580e1300390 2024-09-21T06:38:11.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.317+0000 7fcad920b740 1 -- 172.21.15.63:0/1619352310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcab40aca60 con 0x5580e1300390 2024-09-21T06:38:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.317+0000 7fcaabfff640 1 -- 172.21.15.63:0/1619352310 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fcab40b6970 con 0x5580e1300390 2024-09-21T06:38:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.317+0000 7fcad920b740 10 client.17490 fetch_fsmap learned FSMap version 61 2024-09-21T06:38:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.317+0000 7fcad920b740 1 -- 172.21.15.63:0/1619352310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x5580e1750ca0 con 0x5580e1300390 2024-09-21T06:38:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.317+0000 7fcaabfff640 1 -- 172.21.15.63:0/1619352310 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcab40aca60 con 0x5580e1300390 2024-09-21T06:38:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.317+0000 7fcaabfff640 1 -- 172.21.15.63:0/1619352310 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fcab40a8a30 con 0x5580e1300390 2024-09-21T06:38:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.317+0000 7fcad920b740 10 client.17490 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:38:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.317+0000 7fcad920b740 10 client.17490 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:38:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.318+0000 7fcad920b740 20 client.17490 populate_metadata read hostname 'smithi063' 2024-09-21T06:38:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.318+0000 7fcad920b740 1 --2- 172.21.15.63:0/1619352310 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5580e12b4da0 0x5580e1753380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.318+0000 7fcad920b740 4 client.17490 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:38:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.318+0000 7fcad920b740 1 -- 172.21.15.63:0/1619352310 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5580e16cf3f0 con 0x5580e12b4da0 2024-09-21T06:38:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.318+0000 7fcad0a33640 1 --2- 172.21.15.63:0/1619352310 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5580e12b4da0 0x5580e1753380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.318+0000 7fcad0a33640 1 --2- 172.21.15.63:0/1619352310 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5580e12b4da0 0x5580e1753380 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddd2fea2974e7825 server_cookie=b286c55091efff15 in_seq=0 out_seq=0 2024-09-21T06:38:11.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.318+0000 7fcaabfff640 10 client.17490 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:38:11.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.319+0000 7fcaabfff640 1 -- 172.21.15.63:0/1619352310 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x5580e16cf3f0 con 0x5580e12b4da0 2024-09-21T06:38:11.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.319+0000 7fcaabfff640 10 client.17490 handle_command_reply: tid=0 2024-09-21T06:38:11.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.319+0000 7fcad920b740 1 client.17490 shutdown 2024-09-21T06:38:11.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.319+0000 7fcad920b740 1 -- 172.21.15.63:0/1619352310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1300390 msgr2=0x5580e16d8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:11.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.319+0000 7fcad920b740 1 --2- 172.21.15.63:0/1619352310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1300390 0x5580e16d8930 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fcab40e4e50 tx=0x7fcab40ac6c0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.319+0000 7fcad920b740 1 -- 172.21.15.63:0/1619352310 shutdown_connections 2024-09-21T06:38:11.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.319+0000 7fcad920b740 1 --2- 172.21.15.63:0/1619352310 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5580e12b4da0 0x5580e1753380 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.319+0000 7fcad920b740 1 --2- 172.21.15.63:0/1619352310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5580e1321070 0x5580e174f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.319+0000 7fcad920b740 1 --2- 172.21.15.63:0/1619352310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5580e1300390 0x5580e16d8930 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.319+0000 7fcad920b740 1 --2- 172.21.15.63:0/1619352310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580e12f81b0 0x5580e16d83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.319+0000 7fcad920b740 1 -- 172.21.15.63:0/1619352310 >> 172.21.15.63:0/1619352310 conn(0x5580e1315460 msgr2=0x5580e16cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:11.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.319+0000 7fcaabfff640 0 client.17490 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:38:11.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.319+0000 7fcad920b740 1 -- 172.21.15.63:0/1619352310 shutdown_connections 2024-09-21T06:38:11.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.319+0000 7fcad920b740 1 -- 172.21.15.63:0/1619352310 wait complete. 2024-09-21T06:38:11.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.319+0000 7fcad920b740 20 client.17490 trim_cache size 0 max 16384 2024-09-21T06:38:11.326 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:38:11.326 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "no active scrubs running", 2024-09-21T06:38:11.326 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": {}, 2024-09-21T06:38:11.326 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:38:11.326 INFO:teuthology.orchestra.run.smithi063.stdout: "7f2a9ce4-d90a-4ac2-9e03-b14126f1aa0d": { 2024-09-21T06:38:11.327 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:37:37.866745+0000", 2024-09-21T06:38:11.327 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:11.327 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:11.327 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:11.327 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:11.327 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:11.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:11.327 INFO:teuthology.orchestra.run.smithi063.stdout: "9ad8f980-759b-4f0b-a3d4-e748a05e78b0": { 2024-09-21T06:38:11.327 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:36:53.116490+0000", 2024-09-21T06:38:11.327 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:11.327 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:11.327 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:11.327 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:11.328 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:11.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:11.328 INFO:teuthology.orchestra.run.smithi063.stdout: "0c926bc7-90f8-47ce-a0d2-d02e676a73e9": { 2024-09-21T06:38:11.328 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:35:22.494015+0000", 2024-09-21T06:38:11.328 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:11.328 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:11.328 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:11.328 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:11.328 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:11.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:11.328 INFO:teuthology.orchestra.run.smithi063.stdout: "4f099144-5170-453b-a745-ddc222860f34": { 2024-09-21T06:38:11.328 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:34:35.417817+0000", 2024-09-21T06:38:11.329 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:11.329 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:11.329 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:11.329 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:11.329 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:11.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:11.329 INFO:teuthology.orchestra.run.smithi063.stdout: "91ae0a75-6a3f-452f-8bda-0f19862a5724": { 2024-09-21T06:38:11.329 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:50.316590+0000", 2024-09-21T06:38:11.329 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:11.329 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:11.329 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:11.329 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:11.329 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:11.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:11.330 INFO:teuthology.orchestra.run.smithi063.stdout: "5396028b-35f4-48fe-b54d-385784e97de3": { 2024-09-21T06:38:11.330 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:04.523378+0000", 2024-09-21T06:38:11.330 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:11.330 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:11.330 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:11.330 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:11.330 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:11.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:11.330 INFO:teuthology.orchestra.run.smithi063.stdout: "1b9cca6e-2b23-49b2-a894-182a1054bc02": { 2024-09-21T06:38:11.330 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:36:07.545253+0000", 2024-09-21T06:38:11.330 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:11.330 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:11.330 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:11.331 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:11.331 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:11.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:11.331 INFO:teuthology.orchestra.run.smithi063.stdout: "024d3c59-0b67-49a9-bf4a-e02d36691942": { 2024-09-21T06:38:11.331 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:32:14.282244+0000", 2024-09-21T06:38:11.331 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:11.331 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:11.331 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:11.331 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:11.331 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:11.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:11.331 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:38:11.331 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:31:27.507051+0000", 2024-09-21T06:38:11.331 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:11.332 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:11.332 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:11.332 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:11.332 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:11.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:11.332 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:38:11.332 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:38:11.332 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:11.332 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:11.332 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:11.332 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:11.332 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:11.332 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:38:11.332 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:38:11.333 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:38:11.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.320+0000 7fcad2c97640 1 -- 172.21.15.63:0/3916254737 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcab80b6680 msgr2=0x7fcab80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:11.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.320+0000 7fcad2c97640 1 --2- 172.21.15.63:0/3916254737 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcab80b6680 0x7fcab80b8b90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcabc01d000 tx=0x7fcabc01e000 comp rx=0 tx=0).stop 2024-09-21T06:38:11.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.320+0000 7fcad2c97640 1 -- 172.21.15.63:0/3916254737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcacc1083a0 msgr2=0x7fcacc19ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:11.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.320+0000 7fcad2c97640 1 --2- 172.21.15.63:0/3916254737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcacc1083a0 0x7fcacc19ab50 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fcab400b470 tx=0x7fcab400b930 comp rx=0 tx=0).stop 2024-09-21T06:38:11.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.320+0000 7fcad2c97640 1 -- 172.21.15.63:0/3916254737 shutdown_connections 2024-09-21T06:38:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.320+0000 7fcad2c97640 1 --2- 172.21.15.63:0/3916254737 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fcab80b6680 0x7fcab80b8b90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.320+0000 7fcad2c97640 1 --2- 172.21.15.63:0/3916254737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcacc108cf0 0x7fcacc19fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.320+0000 7fcad2c97640 1 --2- 172.21.15.63:0/3916254737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcacc1083a0 0x7fcacc19ab50 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.320+0000 7fcad2c97640 1 --2- 172.21.15.63:0/3916254737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcacc102a60 0x7fcacc19a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.320+0000 7fcad2c97640 1 -- 172.21.15.63:0/3916254737 >> 172.21.15.63:0/3916254737 conn(0x7fcacc079730 msgr2=0x7fcacc101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.320+0000 7fcad2c97640 1 -- 172.21.15.63:0/3916254737 shutdown_connections 2024-09-21T06:38:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:11.320+0000 7fcad2c97640 1 -- 172.21.15.63:0/3916254737 wait complete. 2024-09-21T06:38:11.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:11 smithi071 ceph-mon[34844]: pgmap v629: 97 pgs: 3 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 92 active+clean; 251 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:38:11.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:11 smithi175 ceph-mon[34510]: pgmap v629: 97 pgs: 3 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 92 active+clean; 251 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:38:12.160 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:38:12.161 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:38:12.422 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:13.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.138+0000 7f532e803640 1 -- 172.21.15.63:0/1278288292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53281048a0 msgr2=0x7f5328104cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:13.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.138+0000 7f532e803640 1 --2- 172.21.15.63:0/1278288292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53281048a0 0x7f5328104cb0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f5318009900 tx=0x7f531802a410 comp rx=0 tx=0).stop 2024-09-21T06:38:13.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.138+0000 7f532e803640 1 -- 172.21.15.63:0/1278288292 shutdown_connections 2024-09-21T06:38:13.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.138+0000 7f532e803640 1 --2- 172.21.15.63:0/1278288292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f532810de50 0x7f5328110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:13.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.138+0000 7f532e803640 1 --2- 172.21.15.63:0/1278288292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53281052d0 0x7f532810d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:13.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.138+0000 7f532e803640 1 --2- 172.21.15.63:0/1278288292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53281048a0 0x7f5328104cb0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:13.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.138+0000 7f532e803640 1 -- 172.21.15.63:0/1278288292 >> 172.21.15.63:0/1278288292 conn(0x7f5328079740 msgr2=0x7f5328079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:13.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.138+0000 7f532e803640 1 -- 172.21.15.63:0/1278288292 shutdown_connections 2024-09-21T06:38:13.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.138+0000 7f532e803640 1 -- 172.21.15.63:0/1278288292 wait complete. 2024-09-21T06:38:13.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.139+0000 7f532e803640 1 Processor -- start 2024-09-21T06:38:13.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.139+0000 7f532e803640 1 -- start start 2024-09-21T06:38:13.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.140+0000 7f532e803640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53281048a0 0x7f532819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:13.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.140+0000 7f532e803640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53281052d0 0x7f532819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:13.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.140+0000 7f532e803640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f532810de50 0x7f532819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:13.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.140+0000 7f532e803640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5328113a90 con 0x7f53281048a0 2024-09-21T06:38:13.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.140+0000 7f532e803640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5328113910 con 0x7f53281052d0 2024-09-21T06:38:13.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.140+0000 7f532e803640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5328113c10 con 0x7f532810de50 2024-09-21T06:38:13.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.140+0000 7f5327fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53281048a0 0x7f532819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:13.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.140+0000 7f5327fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53281048a0 0x7f532819a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37856/0 (socket says 172.21.15.63:37856) 2024-09-21T06:38:13.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.140+0000 7f5327fff640 1 -- 172.21.15.63:0/3104319606 learned_addr learned my addr 172.21.15.63:0/3104319606 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:13.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.140+0000 7f53277fe640 1 --2- 172.21.15.63:0/3104319606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53281052d0 0x7f532819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:13.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.140+0000 7f5327fff640 1 -- 172.21.15.63:0/3104319606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f532810de50 msgr2=0x7f532819fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:13.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.140+0000 7f5327fff640 1 --2- 172.21.15.63:0/3104319606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f532810de50 0x7f532819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:13.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.140+0000 7f5327fff640 1 -- 172.21.15.63:0/3104319606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53281052d0 msgr2=0x7f532819aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:13.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.140+0000 7f5327fff640 1 --2- 172.21.15.63:0/3104319606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53281052d0 0x7f532819aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:13.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.140+0000 7f5327fff640 1 -- 172.21.15.63:0/3104319606 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53281a0450 con 0x7f53281048a0 2024-09-21T06:38:13.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.140+0000 7f5327fff640 1 --2- 172.21.15.63:0/3104319606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53281048a0 0x7f532819a4e0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f5318032fd0 tx=0x7f5318004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:13.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.140+0000 7f53257fa640 1 -- 172.21.15.63:0/3104319606 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531803f030 con 0x7f53281048a0 2024-09-21T06:38:13.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.141+0000 7f532e803640 1 -- 172.21.15.63:0/3104319606 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53281a06e0 con 0x7f53281048a0 2024-09-21T06:38:13.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.141+0000 7f53257fa640 1 -- 172.21.15.63:0/3104319606 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5318004490 con 0x7f53281048a0 2024-09-21T06:38:13.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.141+0000 7f53257fa640 1 -- 172.21.15.63:0/3104319606 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5318035070 con 0x7f53281048a0 2024-09-21T06:38:13.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.141+0000 7f532e803640 1 -- 172.21.15.63:0/3104319606 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53281a6ea0 con 0x7f53281048a0 2024-09-21T06:38:13.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.142+0000 7f532e803640 1 -- 172.21.15.63:0/3104319606 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f532806c1a0 con 0x7f53281048a0 2024-09-21T06:38:13.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.143+0000 7f53257fa640 1 -- 172.21.15.63:0/3104319606 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f5318042030 con 0x7f53281048a0 2024-09-21T06:38:13.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.144+0000 7f53257fa640 1 --2- 172.21.15.63:0/3104319606 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f53100b6700 0x7f53100b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:13.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.144+0000 7f53277fe640 1 --2- 172.21.15.63:0/3104319606 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f53100b6700 0x7f53100b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:13.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.144+0000 7f53257fa640 1 -- 172.21.15.63:0/3104319606 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8637+0+0 (secure 0 0 0) 0x7f53181078c0 con 0x7f53281048a0 2024-09-21T06:38:13.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.145+0000 7f53277fe640 1 --2- 172.21.15.63:0/3104319606 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f53100b6700 0x7f53100b8c10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5328102520 tx=0x7f531c00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:13.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.149+0000 7f53257fa640 1 -- 172.21.15.63:0/3104319606 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f53180cdda0 con 0x7f53281048a0 2024-09-21T06:38:13.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:13 smithi063 ceph-mon[31150]: pgmap v630: 97 pgs: 3 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 92 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:38:13.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.375+0000 7f532e803640 1 -- 172.21.15.63:0/3104319606 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5328104cb0 con 0x7f53281048a0 2024-09-21T06:38:13.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.376+0000 7f53257fa640 1 -- 172.21.15.63:0/3104319606 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+11971 (secure 0 0 0) 0x7f53180d2180 con 0x7f53281048a0 2024-09-21T06:38:13.378 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:38:13.378 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":61,"btime":"2024-09-21T06:36:33:430596+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":61,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:36:32.513212+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24659,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":34,"state":"up:active","state_seq":69,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25637":{"gid":25637,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3354670524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3354670524},{"type":"v1","addr":"172.21.15.71:6839","nonce":3354670524}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24659,"qdb_cluster":[24694,24670,24659,24676,14835]},"id":1}]} 2024-09-21T06:38:13.379 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 61 2024-09-21T06:38:13.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.379+0000 7f532e803640 1 -- 172.21.15.63:0/3104319606 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f53100b6700 msgr2=0x7f53100b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:13.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.379+0000 7f532e803640 1 --2- 172.21.15.63:0/3104319606 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f53100b6700 0x7f53100b8c10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5328102520 tx=0x7f531c00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:38:13.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.379+0000 7f532e803640 1 -- 172.21.15.63:0/3104319606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53281048a0 msgr2=0x7f532819a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:13.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.379+0000 7f532e803640 1 --2- 172.21.15.63:0/3104319606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53281048a0 0x7f532819a4e0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f5318032fd0 tx=0x7f5318004270 comp rx=0 tx=0).stop 2024-09-21T06:38:13.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.379+0000 7f532e803640 1 -- 172.21.15.63:0/3104319606 shutdown_connections 2024-09-21T06:38:13.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.379+0000 7f532e803640 1 --2- 172.21.15.63:0/3104319606 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f53100b6700 0x7f53100b8c10 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:13.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.379+0000 7f532e803640 1 --2- 172.21.15.63:0/3104319606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f532810de50 0x7f532819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:13.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.379+0000 7f532e803640 1 --2- 172.21.15.63:0/3104319606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53281052d0 0x7f532819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:13.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.379+0000 7f532e803640 1 --2- 172.21.15.63:0/3104319606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53281048a0 0x7f532819a4e0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:13.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.379+0000 7f532e803640 1 -- 172.21.15.63:0/3104319606 >> 172.21.15.63:0/3104319606 conn(0x7f5328079740 msgr2=0x7f53280ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:13.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.379+0000 7f532e803640 1 -- 172.21.15.63:0/3104319606 shutdown_connections 2024-09-21T06:38:13.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:13.379+0000 7f532e803640 1 -- 172.21.15.63:0/3104319606 wait complete. 2024-09-21T06:38:13.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:13 smithi071 ceph-mon[34844]: pgmap v630: 97 pgs: 3 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 92 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:38:13.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:13 smithi175 ceph-mon[34510]: pgmap v630: 97 pgs: 3 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 92 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:38:14.051 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T06:38:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:14.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:14 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3104319606' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:38:14.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:14 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3104319606' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:38:14.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:14 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3104319606' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:38:14.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.791+0000 7faa5316a640 1 -- 172.21.15.63:0/3973264941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa4c109e10 msgr2=0x7faa4c110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:14.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.791+0000 7faa5316a640 1 --2- 172.21.15.63:0/3973264941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa4c109e10 0x7faa4c110640 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7faa44009ca0 tx=0x7faa4402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.791+0000 7faa5316a640 1 -- 172.21.15.63:0/3973264941 shutdown_connections 2024-09-21T06:38:14.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.791+0000 7faa5316a640 1 --2- 172.21.15.63:0/3973264941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa4c109e10 0x7faa4c110640 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.791+0000 7faa5316a640 1 --2- 172.21.15.63:0/3973264941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4c1094c0 0x7faa4c1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.791+0000 7faa5316a640 1 --2- 172.21.15.63:0/3973264941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa4c103b80 0x7faa4c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.791+0000 7faa5316a640 1 -- 172.21.15.63:0/3973264941 >> 172.21.15.63:0/3973264941 conn(0x7faa4c0ff5d0 msgr2=0x7faa4c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:14.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.791+0000 7faa5316a640 1 -- 172.21.15.63:0/3973264941 shutdown_connections 2024-09-21T06:38:14.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.791+0000 7faa5316a640 1 -- 172.21.15.63:0/3973264941 wait complete. 2024-09-21T06:38:14.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.792+0000 7faa5316a640 1 Processor -- start 2024-09-21T06:38:14.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.792+0000 7faa5316a640 1 -- start start 2024-09-21T06:38:14.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.792+0000 7faa5316a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4c103b80 0x7faa4c19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:14.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.792+0000 7faa5316a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa4c1094c0 0x7faa4c19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:14.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.792+0000 7faa5316a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa4c109e10 0x7faa4c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:14.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.792+0000 7faa5316a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c113ad0 con 0x7faa4c1094c0 2024-09-21T06:38:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.792+0000 7faa5316a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c113950 con 0x7faa4c109e10 2024-09-21T06:38:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.792+0000 7faa5316a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c113c50 con 0x7faa4c103b80 2024-09-21T06:38:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.792+0000 7faa4bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa4c1094c0 0x7faa4c19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.792+0000 7faa4bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa4c1094c0 0x7faa4c19aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37876/0 (socket says 172.21.15.63:37876) 2024-09-21T06:38:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.792+0000 7faa4bfff640 1 -- 172.21.15.63:0/3433560382 learned_addr learned my addr 172.21.15.63:0/3433560382 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.792+0000 7faa50f06640 1 --2- 172.21.15.63:0/3433560382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4c103b80 0x7faa4c19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.792+0000 7faa51707640 1 --2- 172.21.15.63:0/3433560382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa4c109e10 0x7faa4c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.793+0000 7faa4bfff640 1 -- 172.21.15.63:0/3433560382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4c103b80 msgr2=0x7faa4c19a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.793+0000 7faa4bfff640 1 --2- 172.21.15.63:0/3433560382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4c103b80 0x7faa4c19a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.793+0000 7faa4bfff640 1 -- 172.21.15.63:0/3433560382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa4c109e10 msgr2=0x7faa4c19fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.793+0000 7faa4bfff640 1 --2- 172.21.15.63:0/3433560382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa4c109e10 0x7faa4c19fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.793+0000 7faa4bfff640 1 -- 172.21.15.63:0/3433560382 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa4c1a0470 con 0x7faa4c1094c0 2024-09-21T06:38:14.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.793+0000 7faa4bfff640 1 --2- 172.21.15.63:0/3433560382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa4c1094c0 0x7faa4c19aaa0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7faa4000d750 tx=0x7faa4000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:14.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.793+0000 7faa49ffb640 1 -- 172.21.15.63:0/3433560382 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa40017070 con 0x7faa4c1094c0 2024-09-21T06:38:14.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.793+0000 7faa49ffb640 1 -- 172.21.15.63:0/3433560382 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa400054d0 con 0x7faa4c1094c0 2024-09-21T06:38:14.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.793+0000 7faa5316a640 1 -- 172.21.15.63:0/3433560382 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa4c1a0760 con 0x7faa4c1094c0 2024-09-21T06:38:14.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.793+0000 7faa49ffb640 1 -- 172.21.15.63:0/3433560382 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa40004c30 con 0x7faa4c1094c0 2024-09-21T06:38:14.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.793+0000 7faa5316a640 1 -- 172.21.15.63:0/3433560382 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa4c1a6ec0 con 0x7faa4c1094c0 2024-09-21T06:38:14.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.796+0000 7faa49ffb640 1 -- 172.21.15.63:0/3433560382 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7faa40004dd0 con 0x7faa4c1094c0 2024-09-21T06:38:14.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.796+0000 7faa596de740 1 Processor -- start 2024-09-21T06:38:14.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.796+0000 7faa596de740 1 -- start start 2024-09-21T06:38:14.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.796+0000 7faa596de740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2b0b070 0x5583f2eb22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:14.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.796+0000 7faa596de740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2ae21b0 0x5583f2eb2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:14.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.796+0000 7faa596de740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2aea390 0x5583f2eb2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:14.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.796+0000 7faa596de740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5583f2e28ea0 con 0x5583f2aea390 2024-09-21T06:38:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.796+0000 7faa596de740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5583f2e182d0 con 0x5583f2b0b070 2024-09-21T06:38:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.796+0000 7faa596de740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5583f2e1c0e0 con 0x5583f2ae21b0 2024-09-21T06:38:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.796+0000 7faa4bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2aea390 0x5583f2eb2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.796+0000 7faa4bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2aea390 0x5583f2eb2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37880/0 (socket says 172.21.15.63:37880) 2024-09-21T06:38:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.797+0000 7faa4bfff640 1 -- 172.21.15.63:0/1807382448 learned_addr learned my addr 172.21.15.63:0/1807382448 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.797+0000 7faa51707640 1 --2- 172.21.15.63:0/1807382448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2b0b070 0x5583f2eb22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.797+0000 7faa50f06640 1 --2- 172.21.15.63:0/1807382448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2ae21b0 0x5583f2eb2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.797+0000 7faa49ffb640 1 --2- 172.21.15.63:0/3433560382 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7faa340b6680 0x7faa340b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.797+0000 7faa51707640 1 --2- 172.21.15.63:0/3433560382 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7faa340b6680 0x7faa340b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.797+0000 7faa50f06640 1 -- 172.21.15.63:0/1807382448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2b0b070 msgr2=0x5583f2eb22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.797+0000 7faa49ffb640 1 -- 172.21.15.63:0/3433560382 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8637+0+0 (secure 0 0 0) 0x7faa400e7060 con 0x7faa4c1094c0 2024-09-21T06:38:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.797+0000 7faa50f06640 1 --2- 172.21.15.63:0/1807382448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2b0b070 0x5583f2eb22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.797+0000 7faa50f06640 1 -- 172.21.15.63:0/1807382448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2aea390 msgr2=0x5583f2eb2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:14.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.797+0000 7faa50f06640 1 --2- 172.21.15.63:0/1807382448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2aea390 0x5583f2eb2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.797+0000 7faa50f06640 1 -- 172.21.15.63:0/1807382448 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583f2b76650 con 0x5583f2ae21b0 2024-09-21T06:38:14.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.797+0000 7faa51707640 1 --2- 172.21.15.63:0/1807382448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2b0b070 0x5583f2eb22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:38:14.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.797+0000 7faa4bfff640 1 --2- 172.21.15.63:0/1807382448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2aea390 0x5583f2eb2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:38:14.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.797+0000 7faa50f06640 1 --2- 172.21.15.63:0/1807382448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2ae21b0 0x5583f2eb2800 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faa3c005fd0 tx=0x7faa3c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19a5f8b4583e9da3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:14.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.797+0000 7faa51707640 1 --2- 172.21.15.63:0/3433560382 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7faa340b6680 0x7faa340b8b90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faa44009a60 tx=0x7faa4402a8c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:14.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.798+0000 7faa32ffd640 1 -- 172.21.15.63:0/1807382448 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c01c480 con 0x5583f2ae21b0 2024-09-21T06:38:14.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.798+0000 7faa32ffd640 1 -- 172.21.15.63:0/1807382448 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa3c01cad0 con 0x5583f2ae21b0 2024-09-21T06:38:14.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.798+0000 7faa32ffd640 1 -- 172.21.15.63:0/1807382448 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c011b60 con 0x5583f2ae21b0 2024-09-21T06:38:14.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.798+0000 7faa596de740 1 -- 172.21.15.63:0/1807382448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2ae21b0 msgr2=0x5583f2eb2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:14.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.798+0000 7faa596de740 1 --2- 172.21.15.63:0/1807382448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2ae21b0 0x5583f2eb2800 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faa3c005fd0 tx=0x7faa3c0107a0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.798+0000 7faa596de740 1 -- 172.21.15.63:0/1807382448 shutdown_connections 2024-09-21T06:38:14.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.798+0000 7faa596de740 1 --2- 172.21.15.63:0/1807382448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2aea390 0x5583f2eb2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.799+0000 7faa596de740 1 --2- 172.21.15.63:0/1807382448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2ae21b0 0x5583f2eb2800 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.799+0000 7faa596de740 1 --2- 172.21.15.63:0/1807382448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2b0b070 0x5583f2eb22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.799+0000 7faa596de740 1 -- 172.21.15.63:0/1807382448 >> 172.21.15.63:0/1807382448 conn(0x5583f2aff460 msgr2=0x5583f2eb01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:14.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.799+0000 7faa596de740 1 -- 172.21.15.63:0/1807382448 shutdown_connections 2024-09-21T06:38:14.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.799+0000 7faa596de740 1 -- 172.21.15.63:0/1807382448 wait complete. 2024-09-21T06:38:14.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.799+0000 7faa596de740 1 -- start start 2024-09-21T06:38:14.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.799+0000 7faa596de740 1 Processor -- start 2024-09-21T06:38:14.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa596de740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ae21b0 0x5583f2ebd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:14.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa596de740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2aea390 0x5583f2ebde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:14.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa596de740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2b0b070 0x5583f2ec9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:14.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa596de740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5583f2c79700 con 0x5583f2ae21b0 2024-09-21T06:38:14.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa596de740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5583f2db3160 con 0x5583f2b0b070 2024-09-21T06:38:14.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa596de740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5583f2ec0aa0 con 0x5583f2aea390 2024-09-21T06:38:14.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa596de740 10 client.0 _ll_register_callbacks cb 0x5583f2dcc9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:14.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa50f06640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ae21b0 0x5583f2ebd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:14.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa50f06640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ae21b0 0x5583f2ebd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37892/0 (socket says 172.21.15.63:37892) 2024-09-21T06:38:14.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa50f06640 1 -- 172.21.15.63:0/3091253843 learned_addr learned my addr 172.21.15.63:0/3091253843 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:14.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa51707640 1 --2- 172.21.15.63:0/3091253843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2b0b070 0x5583f2ec9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:14.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa4bfff640 1 --2- 172.21.15.63:0/3091253843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2aea390 0x5583f2ebde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:14.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa50f06640 1 -- 172.21.15.63:0/3091253843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2aea390 msgr2=0x5583f2ebde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:14.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa50f06640 1 --2- 172.21.15.63:0/3091253843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2aea390 0x5583f2ebde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa50f06640 1 -- 172.21.15.63:0/3091253843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2b0b070 msgr2=0x5583f2ec9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:14.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa50f06640 1 --2- 172.21.15.63:0/3091253843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2b0b070 0x5583f2ec9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa50f06640 1 -- 172.21.15.63:0/3091253843 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583f2de0c90 con 0x5583f2ae21b0 2024-09-21T06:38:14.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa51707640 1 --2- 172.21.15.63:0/3091253843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2b0b070 0x5583f2ec9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:14.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa50f06640 1 --2- 172.21.15.63:0/3091253843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ae21b0 0x5583f2ebd920 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7faa3c01cee0 tx=0x7faa3c01cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61bd889c3db2fd98 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:14.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:38:14.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.800+0000 7faa2bfff640 1 -- 172.21.15.63:0/3091253843 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c02a060 con 0x5583f2ae21b0 2024-09-21T06:38:14.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.801+0000 7faa2bfff640 1 -- 172.21.15.63:0/3091253843 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8637+0+0 (secure 0 0 0) 0x7faa3c01c480 con 0x5583f2ae21b0 2024-09-21T06:38:14.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.801+0000 7faa596de740 1 -- 172.21.15.63:0/3091253843 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa3c01cad0 con 0x5583f2ae21b0 2024-09-21T06:38:14.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.801+0000 7faa2bfff640 1 -- 172.21.15.63:0/3091253843 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7faa3c01c680 con 0x5583f2ae21b0 2024-09-21T06:38:14.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.801+0000 7faa596de740 10 client.17508 fetch_fsmap learned FSMap version 61 2024-09-21T06:38:14.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.801+0000 7faa596de740 1 -- 172.21.15.63:0/3091253843 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x5583f2ecc780 con 0x5583f2ae21b0 2024-09-21T06:38:14.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.801+0000 7faa2bfff640 1 -- 172.21.15.63:0/3091253843 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa3c01cad0 con 0x5583f2ae21b0 2024-09-21T06:38:14.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.801+0000 7faa2bfff640 1 -- 172.21.15.63:0/3091253843 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7faa3c011b60 con 0x5583f2ae21b0 2024-09-21T06:38:14.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.801+0000 7faa596de740 10 client.17508 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:38:14.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.801+0000 7faa596de740 10 client.17508 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:38:14.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.801+0000 7faa596de740 20 client.17508 populate_metadata read hostname 'smithi063' 2024-09-21T06:38:14.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.801+0000 7faa596de740 1 --2- 172.21.15.63:0/3091253843 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5583f2ac99f0 0x5583f2ecfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:14.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.801+0000 7faa596de740 4 client.17508 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:14.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.801+0000 7faa596de740 1 -- 172.21.15.63:0/3091253843 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583f2e2adf0 con 0x5583f2ac99f0 2024-09-21T06:38:14.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.801+0000 7faa4bfff640 1 --2- 172.21.15.63:0/3091253843 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5583f2ac99f0 0x5583f2ecfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:14.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.802+0000 7faa2bfff640 10 client.17508 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:38:14.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.802+0000 7faa4bfff640 1 --2- 172.21.15.63:0/3091253843 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5583f2ac99f0 0x5583f2ecfae0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7f311220e077eb40 server_cookie=653ea8bcd476ec15 in_seq=0 out_seq=0 2024-09-21T06:38:14.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.802+0000 7faa2bfff640 1 -- 172.21.15.63:0/3091253843 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5583f2e2adf0 con 0x5583f2ac99f0 2024-09-21T06:38:14.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.802+0000 7faa2bfff640 10 client.17508 handle_command_reply: tid=0 2024-09-21T06:38:14.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.803+0000 7faa596de740 1 client.17508 shutdown 2024-09-21T06:38:14.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.803+0000 7faa596de740 1 -- 172.21.15.63:0/3091253843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ae21b0 msgr2=0x5583f2ebd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:14.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.803+0000 7faa596de740 1 --2- 172.21.15.63:0/3091253843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ae21b0 0x5583f2ebd920 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7faa3c01cee0 tx=0x7faa3c01cf10 comp rx=0 tx=0).stop 2024-09-21T06:38:14.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.803+0000 7faa596de740 1 -- 172.21.15.63:0/3091253843 shutdown_connections 2024-09-21T06:38:14.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.803+0000 7faa596de740 1 --2- 172.21.15.63:0/3091253843 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5583f2ac99f0 0x5583f2ecfae0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.803+0000 7faa2bfff640 0 client.17508 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:38:14.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.803+0000 7faa596de740 1 --2- 172.21.15.63:0/3091253843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2b0b070 0x5583f2ec9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.803+0000 7faa596de740 1 --2- 172.21.15.63:0/3091253843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2aea390 0x5583f2ebde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.803+0000 7faa596de740 1 --2- 172.21.15.63:0/3091253843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ae21b0 0x5583f2ebd920 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.803+0000 7faa596de740 1 -- 172.21.15.63:0/3091253843 >> 172.21.15.63:0/3091253843 conn(0x5583f2aff460 msgr2=0x5583f2eb5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:14.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.803+0000 7faa596de740 1 -- 172.21.15.63:0/3091253843 shutdown_connections 2024-09-21T06:38:14.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.803+0000 7faa596de740 1 -- 172.21.15.63:0/3091253843 wait complete. 2024-09-21T06:38:14.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.803+0000 7faa596de740 20 client.17508 trim_cache size 0 max 16384 2024-09-21T06:38:14.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.816+0000 7faa596de740 1 Processor -- start 2024-09-21T06:38:14.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.816+0000 7faa596de740 1 -- start start 2024-09-21T06:38:14.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.817+0000 7faa596de740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ac99f0 0x5583f2ebf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:14.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.817+0000 7faa596de740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2ae21b0 0x5583f2eaf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:14.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.817+0000 7faa596de740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2aea390 0x5583f2eafca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:14.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.817+0000 7faa596de740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c1af950 con 0x5583f2ac99f0 2024-09-21T06:38:14.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.817+0000 7faa596de740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c1b1490 con 0x5583f2aea390 2024-09-21T06:38:14.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.817+0000 7faa596de740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c1b0020 con 0x5583f2ae21b0 2024-09-21T06:38:14.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.817+0000 7faa50f06640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ac99f0 0x5583f2ebf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:14.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.817+0000 7faa50f06640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ac99f0 0x5583f2ebf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37906/0 (socket says 172.21.15.63:37906) 2024-09-21T06:38:14.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.817+0000 7faa50f06640 1 -- 172.21.15.63:0/3170887967 learned_addr learned my addr 172.21.15.63:0/3170887967 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:14.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.817+0000 7faa4bfff640 1 --2- 172.21.15.63:0/3170887967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2ae21b0 0x5583f2eaf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:14.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.817+0000 7faa51707640 1 --2- 172.21.15.63:0/3170887967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2aea390 0x5583f2eafca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:14.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.817+0000 7faa50f06640 1 -- 172.21.15.63:0/3170887967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2ae21b0 msgr2=0x5583f2eaf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:14.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.817+0000 7faa50f06640 1 --2- 172.21.15.63:0/3170887967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2ae21b0 0x5583f2eaf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.817+0000 7faa50f06640 1 -- 172.21.15.63:0/3170887967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2aea390 msgr2=0x5583f2eafca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:14.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.817+0000 7faa50f06640 1 --2- 172.21.15.63:0/3170887967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2aea390 0x5583f2eafca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.817+0000 7faa50f06640 1 -- 172.21.15.63:0/3170887967 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583f2eab5d0 con 0x5583f2ac99f0 2024-09-21T06:38:14.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.817+0000 7faa4bfff640 1 --2- 172.21.15.63:0/3170887967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2ae21b0 0x5583f2eaf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:14.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.817+0000 7faa51707640 1 --2- 172.21.15.63:0/3170887967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2aea390 0x5583f2eafca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:14.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.817+0000 7faa50f06640 1 --2- 172.21.15.63:0/3170887967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ac99f0 0x5583f2ebf550 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7faa3c000c00 tx=0x7faa3c013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618766a57aac08a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:14.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.818+0000 7faa327fc640 1 -- 172.21.15.63:0/3170887967 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c02a070 con 0x5583f2ac99f0 2024-09-21T06:38:14.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.818+0000 7faa327fc640 1 -- 172.21.15.63:0/3170887967 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa3c005850 con 0x5583f2ac99f0 2024-09-21T06:38:14.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.818+0000 7faa327fc640 1 -- 172.21.15.63:0/3170887967 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c01ca80 con 0x5583f2ac99f0 2024-09-21T06:38:14.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.818+0000 7faa596de740 1 -- 172.21.15.63:0/3170887967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ac99f0 msgr2=0x5583f2ebf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:14.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.818+0000 7faa596de740 1 --2- 172.21.15.63:0/3170887967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ac99f0 0x5583f2ebf550 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7faa3c000c00 tx=0x7faa3c013040 comp rx=0 tx=0).stop 2024-09-21T06:38:14.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.819+0000 7faa596de740 1 -- 172.21.15.63:0/3170887967 shutdown_connections 2024-09-21T06:38:14.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.819+0000 7faa596de740 1 --2- 172.21.15.63:0/3170887967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2aea390 0x5583f2eafca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.819+0000 7faa596de740 1 --2- 172.21.15.63:0/3170887967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2ae21b0 0x5583f2eaf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.819+0000 7faa596de740 1 --2- 172.21.15.63:0/3170887967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ac99f0 0x5583f2ebf550 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.819+0000 7faa596de740 1 -- 172.21.15.63:0/3170887967 >> 172.21.15.63:0/3170887967 conn(0x5583f2aff460 msgr2=0x5583f2ebee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:14.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.819+0000 7faa596de740 1 -- 172.21.15.63:0/3170887967 shutdown_connections 2024-09-21T06:38:14.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.819+0000 7faa596de740 1 -- 172.21.15.63:0/3170887967 wait complete. 2024-09-21T06:38:14.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.819+0000 7faa596de740 1 -- start start 2024-09-21T06:38:14.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.819+0000 7faa596de740 1 Processor -- start 2024-09-21T06:38:14.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa596de740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ac99f0 0x5583f2ed3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:14.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa596de740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2ae21b0 0x5583f2f35240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:14.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa596de740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2aea390 0x5583f2f35780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:14.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa596de740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c1b0dc0 con 0x5583f2ac99f0 2024-09-21T06:38:14.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa596de740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c1b06f0 con 0x5583f2ae21b0 2024-09-21T06:38:14.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa596de740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c1ad950 con 0x5583f2aea390 2024-09-21T06:38:14.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa596de740 10 client.0 _ll_register_callbacks cb 0x7faa400a9540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:14.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa50f06640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ac99f0 0x5583f2ed3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:14.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa50f06640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ac99f0 0x5583f2ed3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37918/0 (socket says 172.21.15.63:37918) 2024-09-21T06:38:14.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa50f06640 1 -- 172.21.15.63:0/1846199717 learned_addr learned my addr 172.21.15.63:0/1846199717 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:14.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa4bfff640 1 --2- 172.21.15.63:0/1846199717 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2ae21b0 0x5583f2f35240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:14.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa51707640 1 --2- 172.21.15.63:0/1846199717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2aea390 0x5583f2f35780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:14.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa50f06640 1 -- 172.21.15.63:0/1846199717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2aea390 msgr2=0x5583f2f35780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:14.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa50f06640 1 --2- 172.21.15.63:0/1846199717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2aea390 0x5583f2f35780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa50f06640 1 -- 172.21.15.63:0/1846199717 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2ae21b0 msgr2=0x5583f2f35240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:14.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa50f06640 1 --2- 172.21.15.63:0/1846199717 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2ae21b0 0x5583f2f35240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa50f06640 1 -- 172.21.15.63:0/1846199717 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583f2f35cc0 con 0x5583f2ac99f0 2024-09-21T06:38:14.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa4bfff640 1 --2- 172.21.15.63:0/1846199717 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2ae21b0 0x5583f2f35240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:14.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa51707640 1 --2- 172.21.15.63:0/1846199717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2aea390 0x5583f2f35780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:14.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa50f06640 1 --2- 172.21.15.63:0/1846199717 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ac99f0 0x5583f2ed3080 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00c010 tx=0x7faa3c011a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7e1abfc4245a61 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:14.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.820+0000 7faa2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:38:14.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.821+0000 7faa2bfff640 1 -- 172.21.15.63:0/1846199717 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c02a040 con 0x5583f2ac99f0 2024-09-21T06:38:14.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.821+0000 7faa2bfff640 1 -- 172.21.15.63:0/1846199717 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8637+0+0 (secure 0 0 0) 0x7faa3c03a070 con 0x5583f2ac99f0 2024-09-21T06:38:14.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.821+0000 7faa596de740 1 -- 172.21.15.63:0/1846199717 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa3c005850 con 0x5583f2ac99f0 2024-09-21T06:38:14.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.821+0000 7faa2bfff640 1 -- 172.21.15.63:0/1846199717 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7faa3c01c480 con 0x5583f2ac99f0 2024-09-21T06:38:14.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.821+0000 7faa596de740 10 client.17514 fetch_fsmap learned FSMap version 61 2024-09-21T06:38:14.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.821+0000 7faa596de740 1 -- 172.21.15.63:0/1846199717 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x5583f2ed11a0 con 0x5583f2ac99f0 2024-09-21T06:38:14.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.821+0000 7faa2bfff640 1 -- 172.21.15.63:0/1846199717 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa3c005850 con 0x5583f2ac99f0 2024-09-21T06:38:14.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.821+0000 7faa2bfff640 1 -- 172.21.15.63:0/1846199717 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7faa3c034070 con 0x5583f2ac99f0 2024-09-21T06:38:14.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.821+0000 7faa596de740 10 client.17514 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:38:14.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.821+0000 7faa596de740 10 client.17514 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:38:14.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.821+0000 7faa596de740 20 client.17514 populate_metadata read hostname 'smithi063' 2024-09-21T06:38:14.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.821+0000 7faa596de740 1 --2- 172.21.15.63:0/1846199717 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5583f2b0b070 0x5583f2f40a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:14.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.821+0000 7faa596de740 4 client.17514 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:38:14.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.821+0000 7faa596de740 1 -- 172.21.15.63:0/1846199717 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5583f2e268a0 con 0x5583f2b0b070 2024-09-21T06:38:14.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.821+0000 7faa4bfff640 1 --2- 172.21.15.63:0/1846199717 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5583f2b0b070 0x5583f2f40a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:14.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.822+0000 7faa2bfff640 10 client.17514 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:38:14.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.822+0000 7faa4bfff640 1 --2- 172.21.15.63:0/1846199717 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5583f2b0b070 0x5583f2f40a20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=70440b98c59c60a1 server_cookie=7886a4c03d3be505 in_seq=0 out_seq=0 2024-09-21T06:38:14.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.822+0000 7faa2bfff640 1 -- 172.21.15.63:0/1846199717 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5583f2e268a0 con 0x5583f2b0b070 2024-09-21T06:38:14.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.822+0000 7faa2bfff640 10 client.17514 handle_command_reply: tid=0 2024-09-21T06:38:14.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.822+0000 7faa596de740 1 client.17514 shutdown 2024-09-21T06:38:14.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.822+0000 7faa596de740 1 -- 172.21.15.63:0/1846199717 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ac99f0 msgr2=0x5583f2ed3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:14.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.822+0000 7faa596de740 1 --2- 172.21.15.63:0/1846199717 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ac99f0 0x5583f2ed3080 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00c010 tx=0x7faa3c011a40 comp rx=0 tx=0).stop 2024-09-21T06:38:14.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.822+0000 7faa596de740 1 -- 172.21.15.63:0/1846199717 shutdown_connections 2024-09-21T06:38:14.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.822+0000 7faa596de740 1 --2- 172.21.15.63:0/1846199717 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5583f2b0b070 0x5583f2f40a20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.822+0000 7faa596de740 1 --2- 172.21.15.63:0/1846199717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583f2aea390 0x5583f2f35780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.822+0000 7faa596de740 1 --2- 172.21.15.63:0/1846199717 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5583f2ae21b0 0x5583f2f35240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.822+0000 7faa2bfff640 0 client.17514 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:38:14.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.822+0000 7faa596de740 1 --2- 172.21.15.63:0/1846199717 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5583f2ac99f0 0x5583f2ed3080 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.822+0000 7faa596de740 1 -- 172.21.15.63:0/1846199717 >> 172.21.15.63:0/1846199717 conn(0x5583f2aff460 msgr2=0x5583f2ebed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:14.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.823+0000 7faa596de740 1 -- 172.21.15.63:0/1846199717 shutdown_connections 2024-09-21T06:38:14.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.823+0000 7faa596de740 1 -- 172.21.15.63:0/1846199717 wait complete. 2024-09-21T06:38:14.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.823+0000 7faa596de740 20 client.17514 trim_cache size 0 max 16384 2024-09-21T06:38:14.829 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:38:14.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.823+0000 7faa5316a640 1 -- 172.21.15.63:0/3433560382 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7faa340b6680 msgr2=0x7faa340b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:14.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.823+0000 7faa5316a640 1 --2- 172.21.15.63:0/3433560382 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7faa340b6680 0x7faa340b8b90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faa44009a60 tx=0x7faa4402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.823+0000 7faa5316a640 1 -- 172.21.15.63:0/3433560382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa4c1094c0 msgr2=0x7faa4c19aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:14.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.823+0000 7faa5316a640 1 --2- 172.21.15.63:0/3433560382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa4c1094c0 0x7faa4c19aaa0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7faa4000d750 tx=0x7faa4000dc10 comp rx=0 tx=0).stop 2024-09-21T06:38:14.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.823+0000 7faa5316a640 1 -- 172.21.15.63:0/3433560382 shutdown_connections 2024-09-21T06:38:14.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.823+0000 7faa5316a640 1 --2- 172.21.15.63:0/3433560382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa4c109e10 0x7faa4c19fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.823+0000 7faa5316a640 1 --2- 172.21.15.63:0/3433560382 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa4c1094c0 0x7faa4c19aaa0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.823+0000 7faa5316a640 1 --2- 172.21.15.63:0/3433560382 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7faa340b6680 0x7faa340b8b90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.823+0000 7faa5316a640 1 --2- 172.21.15.63:0/3433560382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4c103b80 0x7faa4c19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:14.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.823+0000 7faa5316a640 1 -- 172.21.15.63:0/3433560382 >> 172.21.15.63:0/3433560382 conn(0x7faa4c0ff5d0 msgr2=0x7faa4c1019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:14.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.823+0000 7faa5316a640 1 -- 172.21.15.63:0/3433560382 shutdown_connections 2024-09-21T06:38:14.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:14.823+0000 7faa5316a640 1 -- 172.21.15.63:0/3433560382 wait complete. 2024-09-21T06:38:15.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:15 smithi071 ceph-mon[34844]: pgmap v631: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:38:15.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:15 smithi063 ceph-mon[31150]: pgmap v631: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:38:15.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:15 smithi175 ceph-mon[34510]: pgmap v631: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:38:15.621 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:38:15.883 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:16.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.368+0000 7f21d3f9d640 1 -- 172.21.15.63:0/1843290475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21cc102a60 msgr2=0x7f21cc102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:16.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.368+0000 7f21d3f9d640 1 --2- 172.21.15.63:0/1843290475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21cc102a60 0x7f21cc102e70 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009900 tx=0x7f21c802a410 comp rx=0 tx=0).stop 2024-09-21T06:38:16.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.368+0000 7f21d3f9d640 1 -- 172.21.15.63:0/1843290475 shutdown_connections 2024-09-21T06:38:16.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.368+0000 7f21d3f9d640 1 --2- 172.21.15.63:0/1843290475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21cc108cf0 0x7f21cc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.368+0000 7f21d3f9d640 1 --2- 172.21.15.63:0/1843290475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21cc1083a0 0x7f21cc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.368+0000 7f21d3f9d640 1 --2- 172.21.15.63:0/1843290475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21cc102a60 0x7f21cc102e70 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.368+0000 7f21d3f9d640 1 -- 172.21.15.63:0/1843290475 >> 172.21.15.63:0/1843290475 conn(0x7f21cc079730 msgr2=0x7f21cc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:16.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.368+0000 7f21d3f9d640 1 -- 172.21.15.63:0/1843290475 shutdown_connections 2024-09-21T06:38:16.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.368+0000 7f21d3f9d640 1 -- 172.21.15.63:0/1843290475 wait complete. 2024-09-21T06:38:16.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.369+0000 7f21d3f9d640 1 Processor -- start 2024-09-21T06:38:16.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.369+0000 7f21d3f9d640 1 -- start start 2024-09-21T06:38:16.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.369+0000 7f21d3f9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21cc102a60 0x7f21cc10ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:16.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.369+0000 7f21d3f9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21cc1083a0 0x7f21cc1104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:16.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.369+0000 7f21d3f9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21cc108cf0 0x7f21cc110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:16.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.369+0000 7f21d3f9d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc113ab0 con 0x7f21cc108cf0 2024-09-21T06:38:16.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.369+0000 7f21d3f9d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc113930 con 0x7f21cc102a60 2024-09-21T06:38:16.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.369+0000 7f21d3f9d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc113c30 con 0x7f21cc1083a0 2024-09-21T06:38:16.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.370+0000 7f21d253a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21cc108cf0 0x7f21cc110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:16.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.370+0000 7f21d253a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21cc108cf0 0x7f21cc110a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37934/0 (socket says 172.21.15.63:37934) 2024-09-21T06:38:16.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.370+0000 7f21d253a640 1 -- 172.21.15.63:0/3185543377 learned_addr learned my addr 172.21.15.63:0/3185543377 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:16.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.370+0000 7f21d1538640 1 --2- 172.21.15.63:0/3185543377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21cc1083a0 0x7f21cc1104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:16.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.370+0000 7f21d1d39640 1 --2- 172.21.15.63:0/3185543377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21cc102a60 0x7f21cc10ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:16.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.370+0000 7f21d253a640 1 -- 172.21.15.63:0/3185543377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21cc1083a0 msgr2=0x7f21cc1104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:16.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.370+0000 7f21d253a640 1 --2- 172.21.15.63:0/3185543377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21cc1083a0 0x7f21cc1104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.370+0000 7f21d253a640 1 -- 172.21.15.63:0/3185543377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21cc102a60 msgr2=0x7f21cc10ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:16.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.370+0000 7f21d253a640 1 --2- 172.21.15.63:0/3185543377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21cc102a60 0x7f21cc10ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.370+0000 7f21d253a640 1 -- 172.21.15.63:0/3185543377 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21cc1a86d0 con 0x7f21cc108cf0 2024-09-21T06:38:16.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.370+0000 7f21d253a640 1 --2- 172.21.15.63:0/3185543377 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21cc108cf0 0x7f21cc110a30 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f21c400eaa0 tx=0x7f21c400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:16.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.370+0000 7f21c2ffd640 1 -- 172.21.15.63:0/3185543377 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c4004d20 con 0x7f21cc108cf0 2024-09-21T06:38:16.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.370+0000 7f21c2ffd640 1 -- 172.21.15.63:0/3185543377 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21c4005020 con 0x7f21cc108cf0 2024-09-21T06:38:16.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.370+0000 7f21d3f9d640 1 -- 172.21.15.63:0/3185543377 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21cc1a89c0 con 0x7f21cc108cf0 2024-09-21T06:38:16.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.370+0000 7f21c2ffd640 1 -- 172.21.15.63:0/3185543377 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c40116b0 con 0x7f21cc108cf0 2024-09-21T06:38:16.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.370+0000 7f21d3f9d640 1 -- 172.21.15.63:0/3185543377 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21cc1a8f00 con 0x7f21cc108cf0 2024-09-21T06:38:16.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.373+0000 7f21da511740 1 Processor -- start 2024-09-21T06:38:16.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.373+0000 7f21c2ffd640 1 -- 172.21.15.63:0/3185543377 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f21c40051d0 con 0x7f21cc108cf0 2024-09-21T06:38:16.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.373+0000 7f21da511740 1 -- start start 2024-09-21T06:38:16.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21da511740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f217070 0x55ca6f5be6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:16.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21da511740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 0x55ca6f5bebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:16.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21da511740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f1f6390 0x55ca6f5bf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:16.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21da511740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ca6f534ea0 con 0x55ca6f1f6390 2024-09-21T06:38:16.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21da511740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ca6f5242d0 con 0x55ca6f217070 2024-09-21T06:38:16.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21da511740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ca6f5280e0 con 0x55ca6f1ee1b0 2024-09-21T06:38:16.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21d1538640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f1f6390 0x55ca6f5bf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:16.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21d1538640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f1f6390 0x55ca6f5bf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37940/0 (socket says 172.21.15.63:37940) 2024-09-21T06:38:16.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21d1d39640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 0x55ca6f5bebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:16.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21d1538640 1 -- 172.21.15.63:0/3970216117 learned_addr learned my addr 172.21.15.63:0/3970216117 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:16.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21d1538640 1 --2- 172.21.15.63:0/3970216117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f217070 0x55ca6f5be6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:16.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21c2ffd640 1 --2- 172.21.15.63:0/3185543377 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f21b80b6680 0x7f21b80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:16.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21d1d39640 1 -- 172.21.15.63:0/3970216117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f217070 msgr2=0x55ca6f5be6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:16.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21d1d39640 1 --2- 172.21.15.63:0/3970216117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f217070 0x55ca6f5be6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21d1d39640 1 -- 172.21.15.63:0/3970216117 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f1f6390 msgr2=0x55ca6f5bf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:16.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21d1d39640 1 --2- 172.21.15.63:0/3970216117 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f1f6390 0x55ca6f5bf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21d1d39640 1 -- 172.21.15.63:0/3970216117 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca6f282650 con 0x55ca6f1ee1b0 2024-09-21T06:38:16.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21d1538640 1 --2- 172.21.15.63:0/3970216117 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f1f6390 0x55ca6f5bf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:38:16.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21d253a640 1 --2- 172.21.15.63:0/3185543377 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f21b80b6680 0x7f21b80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:16.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21c2ffd640 1 -- 172.21.15.63:0/3185543377 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8637+0+0 (secure 0 0 0) 0x7f21c40e7940 con 0x7f21cc108cf0 2024-09-21T06:38:16.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.374+0000 7f21d1d39640 1 --2- 172.21.15.63:0/3970216117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 0x55ca6f5bebe0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f21c802aa00 tx=0x7f21c8004390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdc44ca9cdfbf6fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:16.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.375+0000 7f21b7fff640 1 -- 172.21.15.63:0/3970216117 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c8035030 con 0x55ca6f1ee1b0 2024-09-21T06:38:16.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.375+0000 7f21b7fff640 1 -- 172.21.15.63:0/3970216117 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21c8005de0 con 0x55ca6f1ee1b0 2024-09-21T06:38:16.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.375+0000 7f21b7fff640 1 -- 172.21.15.63:0/3970216117 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c8003830 con 0x55ca6f1ee1b0 2024-09-21T06:38:16.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.376+0000 7f21da511740 1 -- 172.21.15.63:0/3970216117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 msgr2=0x55ca6f5bebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:16.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.376+0000 7f21da511740 1 --2- 172.21.15.63:0/3970216117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 0x55ca6f5bebe0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f21c802aa00 tx=0x7f21c8004390 comp rx=0 tx=0).stop 2024-09-21T06:38:16.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.376+0000 7f21d253a640 1 --2- 172.21.15.63:0/3185543377 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f21b80b6680 0x7f21b80b8b90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f21c40e50d0 tx=0x7f21c4009190 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:16.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.376+0000 7f21da511740 1 -- 172.21.15.63:0/3970216117 shutdown_connections 2024-09-21T06:38:16.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.376+0000 7f21da511740 1 --2- 172.21.15.63:0/3970216117 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f1f6390 0x55ca6f5bf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.376+0000 7f21da511740 1 --2- 172.21.15.63:0/3970216117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 0x55ca6f5bebe0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.376+0000 7f21da511740 1 --2- 172.21.15.63:0/3970216117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f217070 0x55ca6f5be6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.376+0000 7f21da511740 1 -- 172.21.15.63:0/3970216117 >> 172.21.15.63:0/3970216117 conn(0x55ca6f20b460 msgr2=0x55ca6f5bc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:16.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.376+0000 7f21da511740 1 -- 172.21.15.63:0/3970216117 shutdown_connections 2024-09-21T06:38:16.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.376+0000 7f21da511740 1 -- 172.21.15.63:0/3970216117 wait complete. 2024-09-21T06:38:16.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.376+0000 7f21da511740 1 -- start start 2024-09-21T06:38:16.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.376+0000 7f21da511740 1 Processor -- start 2024-09-21T06:38:16.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.377+0000 7f21da511740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 0x55ca6f5c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:16.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.377+0000 7f21da511740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f1f6390 0x55ca6f5ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:16.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.377+0000 7f21da511740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 0x55ca6f5d6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:16.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.377+0000 7f21da511740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ca6f385700 con 0x55ca6f217070 2024-09-21T06:38:16.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.377+0000 7f21da511740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ca6f4bf160 con 0x55ca6f1f6390 2024-09-21T06:38:16.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.377+0000 7f21da511740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ca6f5cce20 con 0x55ca6f1ee1b0 2024-09-21T06:38:16.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.377+0000 7f21da511740 10 client.0 _ll_register_callbacks cb 0x55ca6f4d89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:16.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.377+0000 7f21d1538640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 0x55ca6f5d6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:16.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.377+0000 7f21d1538640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 0x55ca6f5d6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37956/0 (socket says 172.21.15.63:37956) 2024-09-21T06:38:16.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.377+0000 7f21d1538640 1 -- 172.21.15.63:0/2115395745 learned_addr learned my addr 172.21.15.63:0/2115395745 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:16.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.377+0000 7f21d1d39640 1 --2- 172.21.15.63:0/2115395745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f1f6390 0x55ca6f5ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:16.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.377+0000 7f21d1538640 1 --2- 172.21.15.63:0/2115395745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 0x55ca6f5c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:16.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.377+0000 7f21d1538640 1 -- 172.21.15.63:0/2115395745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 msgr2=0x55ca6f5c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:16.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.377+0000 7f21d1538640 1 --2- 172.21.15.63:0/2115395745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 0x55ca6f5c9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.377+0000 7f21d1538640 1 -- 172.21.15.63:0/2115395745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f1f6390 msgr2=0x55ca6f5ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:16.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.377+0000 7f21d1538640 1 --2- 172.21.15.63:0/2115395745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f1f6390 0x55ca6f5ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.377+0000 7f21d1538640 1 -- 172.21.15.63:0/2115395745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca6f4ecc90 con 0x55ca6f217070 2024-09-21T06:38:16.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.377+0000 7f21d1538640 1 --2- 172.21.15.63:0/2115395745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 0x55ca6f5d6110 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00ae00 tx=0x7f21bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfd662c6288fec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:16.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.377+0000 7f21b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:38:16.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.378+0000 7f21b57fa640 1 -- 172.21.15.63:0/2115395745 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc00fea0 con 0x55ca6f217070 2024-09-21T06:38:16.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.378+0000 7f21b57fa640 1 -- 172.21.15.63:0/2115395745 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8637+0+0 (secure 0 0 0) 0x7f21bc00d750 con 0x55ca6f217070 2024-09-21T06:38:16.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.378+0000 7f21da511740 1 -- 172.21.15.63:0/2115395745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ca6f536df0 con 0x55ca6f217070 2024-09-21T06:38:16.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.378+0000 7f21b57fa640 1 -- 172.21.15.63:0/2115395745 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f21bc02b050 con 0x55ca6f217070 2024-09-21T06:38:16.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.378+0000 7f21da511740 10 client.17526 fetch_fsmap learned FSMap version 61 2024-09-21T06:38:16.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.378+0000 7f21da511740 1 -- 172.21.15.63:0/2115395745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55ca6f5d8c10 con 0x55ca6f217070 2024-09-21T06:38:16.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.378+0000 7f21b57fa640 1 -- 172.21.15.63:0/2115395745 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ca6f536df0 con 0x55ca6f217070 2024-09-21T06:38:16.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.378+0000 7f21b57fa640 1 -- 172.21.15.63:0/2115395745 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f21bc023850 con 0x55ca6f217070 2024-09-21T06:38:16.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.378+0000 7f21da511740 10 client.17526 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:38:16.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.378+0000 7f21da511740 10 client.17526 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:38:16.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.378+0000 7f21da511740 20 client.17526 populate_metadata read hostname 'smithi063' 2024-09-21T06:38:16.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.378+0000 7f21da511740 1 --2- 172.21.15.63:0/2115395745 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55ca6f1d59f0 0x55ca6f5dc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:16.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.378+0000 7f21da511740 4 client.17526 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:16.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.379+0000 7f21da511740 1 -- 172.21.15.63:0/2115395745 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca6f5328a0 con 0x55ca6f1d59f0 2024-09-21T06:38:16.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.379+0000 7f21d1d39640 1 --2- 172.21.15.63:0/2115395745 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55ca6f1d59f0 0x55ca6f5dc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:16.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.379+0000 7f21d1d39640 1 --2- 172.21.15.63:0/2115395745 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55ca6f1d59f0 0x55ca6f5dc070 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbefa625f54e46f3 server_cookie=e71ecc5b917da428 in_seq=0 out_seq=0 2024-09-21T06:38:16.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.379+0000 7f21b57fa640 10 client.17526 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:38:16.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.380+0000 7f21b57fa640 1 -- 172.21.15.63:0/2115395745 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ca6f5328a0 con 0x55ca6f1d59f0 2024-09-21T06:38:16.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.380+0000 7f21b57fa640 10 client.17526 handle_command_reply: tid=0 2024-09-21T06:38:16.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.380+0000 7f21da511740 1 client.17526 shutdown 2024-09-21T06:38:16.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.380+0000 7f21da511740 1 -- 172.21.15.63:0/2115395745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 msgr2=0x55ca6f5d6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:16.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.380+0000 7f21da511740 1 --2- 172.21.15.63:0/2115395745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 0x55ca6f5d6110 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00ae00 tx=0x7f21bc004730 comp rx=0 tx=0).stop 2024-09-21T06:38:16.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.380+0000 7f21da511740 1 -- 172.21.15.63:0/2115395745 shutdown_connections 2024-09-21T06:38:16.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.380+0000 7f21da511740 1 --2- 172.21.15.63:0/2115395745 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55ca6f1d59f0 0x55ca6f5dc070 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.380+0000 7f21da511740 1 --2- 172.21.15.63:0/2115395745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 0x55ca6f5d6110 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.380+0000 7f21da511740 1 --2- 172.21.15.63:0/2115395745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f1f6390 0x55ca6f5ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.380+0000 7f21b57fa640 0 client.17526 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:38:16.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.380+0000 7f21da511740 1 --2- 172.21.15.63:0/2115395745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 0x55ca6f5c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.380+0000 7f21da511740 1 -- 172.21.15.63:0/2115395745 >> 172.21.15.63:0/2115395745 conn(0x55ca6f20b460 msgr2=0x55ca6f5c1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:16.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.380+0000 7f21da511740 1 -- 172.21.15.63:0/2115395745 shutdown_connections 2024-09-21T06:38:16.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.380+0000 7f21da511740 1 -- 172.21.15.63:0/2115395745 wait complete. 2024-09-21T06:38:16.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.380+0000 7f21da511740 20 client.17526 trim_cache size 0 max 16384 2024-09-21T06:38:16.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.394+0000 7f21da511740 1 Processor -- start 2024-09-21T06:38:16.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.394+0000 7f21da511740 1 -- start start 2024-09-21T06:38:16.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.394+0000 7f21da511740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 0x55ca6f5c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:16.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.394+0000 7f21da511740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f1f6390 0x55ca6f5c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:16.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.394+0000 7f21da511740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 0x55ca6f5ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:16.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.394+0000 7f21da511740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc1b19b0 con 0x55ca6f217070 2024-09-21T06:38:16.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.394+0000 7f21da511740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc1b34f0 con 0x55ca6f1f6390 2024-09-21T06:38:16.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.394+0000 7f21da511740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc1b2080 con 0x55ca6f1ee1b0 2024-09-21T06:38:16.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.394+0000 7f21d1538640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 0x55ca6f5ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:16.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.394+0000 7f21d1538640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 0x55ca6f5ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37964/0 (socket says 172.21.15.63:37964) 2024-09-21T06:38:16.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.394+0000 7f21d1538640 1 -- 172.21.15.63:0/2374255825 learned_addr learned my addr 172.21.15.63:0/2374255825 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:16.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.394+0000 7f21d1538640 1 --2- 172.21.15.63:0/2374255825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 0x55ca6f5c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:16.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.394+0000 7f21d1d39640 1 --2- 172.21.15.63:0/2374255825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f1f6390 0x55ca6f5c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:16.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.394+0000 7f21d1538640 1 -- 172.21.15.63:0/2374255825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 msgr2=0x55ca6f5c1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:16.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.394+0000 7f21d1538640 1 --2- 172.21.15.63:0/2374255825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 0x55ca6f5c1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.394+0000 7f21d1538640 1 -- 172.21.15.63:0/2374255825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f1f6390 msgr2=0x55ca6f5c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:16.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.394+0000 7f21d1538640 1 --2- 172.21.15.63:0/2374255825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f1f6390 0x55ca6f5c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.394+0000 7f21d1538640 1 -- 172.21.15.63:0/2374255825 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca6f5d68b0 con 0x55ca6f217070 2024-09-21T06:38:16.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.394+0000 7f21d1d39640 1 --2- 172.21.15.63:0/2374255825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f1f6390 0x55ca6f5c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:16.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.394+0000 7f21d1538640 1 --2- 172.21.15.63:0/2374255825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 0x55ca6f5ca0d0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f21bc023c50 tx=0x7f21bc013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59464cbec7d5502 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:16.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.395+0000 7f21b77fe640 1 -- 172.21.15.63:0/2374255825 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc00fea0 con 0x55ca6f217070 2024-09-21T06:38:16.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.395+0000 7f21b77fe640 1 -- 172.21.15.63:0/2374255825 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21bc023e40 con 0x55ca6f217070 2024-09-21T06:38:16.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.395+0000 7f21b77fe640 1 -- 172.21.15.63:0/2374255825 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc00d9f0 con 0x55ca6f217070 2024-09-21T06:38:16.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.395+0000 7f21da511740 1 -- 172.21.15.63:0/2374255825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 msgr2=0x55ca6f5ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:16.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.395+0000 7f21da511740 1 --2- 172.21.15.63:0/2374255825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 0x55ca6f5ca0d0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f21bc023c50 tx=0x7f21bc013040 comp rx=0 tx=0).stop 2024-09-21T06:38:16.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.396+0000 7f21da511740 1 -- 172.21.15.63:0/2374255825 shutdown_connections 2024-09-21T06:38:16.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.396+0000 7f21da511740 1 --2- 172.21.15.63:0/2374255825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 0x55ca6f5ca0d0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.396+0000 7f21da511740 1 --2- 172.21.15.63:0/2374255825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f1f6390 0x55ca6f5c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.396+0000 7f21da511740 1 --2- 172.21.15.63:0/2374255825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 0x55ca6f5c1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.396+0000 7f21da511740 1 -- 172.21.15.63:0/2374255825 >> 172.21.15.63:0/2374255825 conn(0x55ca6f20b460 msgr2=0x55ca6f5c17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:16.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.396+0000 7f21da511740 1 -- 172.21.15.63:0/2374255825 shutdown_connections 2024-09-21T06:38:16.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.396+0000 7f21da511740 1 -- 172.21.15.63:0/2374255825 wait complete. 2024-09-21T06:38:16.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.396+0000 7f21da511740 1 -- start start 2024-09-21T06:38:16.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.396+0000 7f21da511740 1 Processor -- start 2024-09-21T06:38:16.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21da511740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 0x55ca6f5d2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:16.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21da511740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f1f6390 0x55ca6f5cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:16.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21da511740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 0x55ca6f5ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:16.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21da511740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc1b2e20 con 0x55ca6f217070 2024-09-21T06:38:16.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21da511740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc1b2750 con 0x55ca6f1f6390 2024-09-21T06:38:16.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21da511740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc1af9b0 con 0x55ca6f1ee1b0 2024-09-21T06:38:16.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21da511740 10 client.0 _ll_register_callbacks cb 0x7f21bc00ad10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:16.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21d1538640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 0x55ca6f5ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:16.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21d1538640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 0x55ca6f5ce6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37974/0 (socket says 172.21.15.63:37974) 2024-09-21T06:38:16.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21d1538640 1 -- 172.21.15.63:0/667654568 learned_addr learned my addr 172.21.15.63:0/667654568 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:16.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21d1d39640 1 --2- 172.21.15.63:0/667654568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f1f6390 0x55ca6f5cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:16.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21d1538640 1 --2- 172.21.15.63:0/667654568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 0x55ca6f5d2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:16.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21d1538640 1 -- 172.21.15.63:0/667654568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 msgr2=0x55ca6f5d2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:16.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21d1538640 1 --2- 172.21.15.63:0/667654568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 0x55ca6f5d2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21d1538640 1 -- 172.21.15.63:0/667654568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f1f6390 msgr2=0x55ca6f5cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:16.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21d1538640 1 --2- 172.21.15.63:0/667654568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f1f6390 0x55ca6f5cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21d1538640 1 -- 172.21.15.63:0/667654568 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca6f645ac0 con 0x55ca6f217070 2024-09-21T06:38:16.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21d1538640 1 --2- 172.21.15.63:0/667654568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 0x55ca6f5ce6e0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00abe0 tx=0x7f21bc026040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e607bc9e771fef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:16.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:38:16.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21b57fa640 1 -- 172.21.15.63:0/667654568 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc033030 con 0x55ca6f217070 2024-09-21T06:38:16.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21b57fa640 1 -- 172.21.15.63:0/667654568 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8637+0+0 (secure 0 0 0) 0x7f21bc005050 con 0x55ca6f217070 2024-09-21T06:38:16.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.397+0000 7f21da511740 1 -- 172.21.15.63:0/667654568 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ca6f52fcd0 con 0x55ca6f217070 2024-09-21T06:38:16.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.398+0000 7f21b57fa640 1 -- 172.21.15.63:0/667654568 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f21bc00fea0 con 0x55ca6f217070 2024-09-21T06:38:16.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.398+0000 7f21da511740 10 client.17532 fetch_fsmap learned FSMap version 61 2024-09-21T06:38:16.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.398+0000 7f21da511740 1 -- 172.21.15.63:0/667654568 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55ca6f646bc0 con 0x55ca6f217070 2024-09-21T06:38:16.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.398+0000 7f21b57fa640 1 -- 172.21.15.63:0/667654568 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ca6f52fcd0 con 0x55ca6f217070 2024-09-21T06:38:16.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.398+0000 7f21b57fa640 1 -- 172.21.15.63:0/667654568 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f21bc004660 con 0x55ca6f217070 2024-09-21T06:38:16.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.398+0000 7f21da511740 10 client.17532 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:38:16.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.398+0000 7f21da511740 10 client.17532 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:38:16.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.398+0000 7f21da511740 20 client.17532 populate_metadata read hostname 'smithi063' 2024-09-21T06:38:16.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.398+0000 7f21da511740 1 --2- 172.21.15.63:0/667654568 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55ca6f1aada0 0x55ca6f6492e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:16.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.398+0000 7f21da511740 4 client.17532 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:38:16.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.398+0000 7f21da511740 1 -- 172.21.15.63:0/667654568 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ca6f4a5aa0 con 0x55ca6f1aada0 2024-09-21T06:38:16.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.398+0000 7f21d1d39640 1 --2- 172.21.15.63:0/667654568 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55ca6f1aada0 0x55ca6f6492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:16.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.399+0000 7f21d1d39640 1 --2- 172.21.15.63:0/667654568 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55ca6f1aada0 0x55ca6f6492e0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cdc119a54a18231 server_cookie=426629a1f8d73989 in_seq=0 out_seq=0 2024-09-21T06:38:16.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.399+0000 7f21b57fa640 10 client.17532 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:38:16.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.399+0000 7f21b57fa640 1 -- 172.21.15.63:0/667654568 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ca6f4a5aa0 con 0x55ca6f1aada0 2024-09-21T06:38:16.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.399+0000 7f21b57fa640 10 client.17532 handle_command_reply: tid=0 2024-09-21T06:38:16.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.399+0000 7f21da511740 1 client.17532 shutdown 2024-09-21T06:38:16.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.399+0000 7f21da511740 1 -- 172.21.15.63:0/667654568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 msgr2=0x55ca6f5ce6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:16.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.399+0000 7f21da511740 1 --2- 172.21.15.63:0/667654568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 0x55ca6f5ce6e0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00abe0 tx=0x7f21bc026040 comp rx=0 tx=0).stop 2024-09-21T06:38:16.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.399+0000 7f21da511740 1 -- 172.21.15.63:0/667654568 shutdown_connections 2024-09-21T06:38:16.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.399+0000 7f21da511740 1 --2- 172.21.15.63:0/667654568 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55ca6f1aada0 0x55ca6f6492e0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.399+0000 7f21da511740 1 --2- 172.21.15.63:0/667654568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca6f217070 0x55ca6f5ce6e0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.399+0000 7f21da511740 1 --2- 172.21.15.63:0/667654568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ca6f1f6390 0x55ca6f5cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.399+0000 7f21da511740 1 --2- 172.21.15.63:0/667654568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca6f1ee1b0 0x55ca6f5d2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.399+0000 7f21b57fa640 0 client.17532 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:38:16.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.399+0000 7f21da511740 1 -- 172.21.15.63:0/667654568 >> 172.21.15.63:0/667654568 conn(0x55ca6f20b460 msgr2=0x55ca6f5c9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:16.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.399+0000 7f21da511740 1 -- 172.21.15.63:0/667654568 shutdown_connections 2024-09-21T06:38:16.447 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:38:16.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.399+0000 7f21da511740 1 -- 172.21.15.63:0/667654568 wait complete. 2024-09-21T06:38:16.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.399+0000 7f21da511740 20 client.17532 trim_cache size 0 max 16384 2024-09-21T06:38:16.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.400+0000 7f21d3f9d640 1 -- 172.21.15.63:0/3185543377 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f21b80b6680 msgr2=0x7f21b80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:16.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.400+0000 7f21d3f9d640 1 --2- 172.21.15.63:0/3185543377 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f21b80b6680 0x7f21b80b8b90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f21c40e50d0 tx=0x7f21c4009190 comp rx=0 tx=0).stop 2024-09-21T06:38:16.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.400+0000 7f21d3f9d640 1 -- 172.21.15.63:0/3185543377 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21cc108cf0 msgr2=0x7f21cc110a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:16.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.400+0000 7f21d3f9d640 1 --2- 172.21.15.63:0/3185543377 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21cc108cf0 0x7f21cc110a30 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f21c400eaa0 tx=0x7f21c400eea0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.400+0000 7f21d3f9d640 1 -- 172.21.15.63:0/3185543377 shutdown_connections 2024-09-21T06:38:16.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.400+0000 7f21d3f9d640 1 --2- 172.21.15.63:0/3185543377 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21cc108cf0 0x7f21cc110a30 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.400+0000 7f21d3f9d640 1 --2- 172.21.15.63:0/3185543377 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f21b80b6680 0x7f21b80b8b90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.400+0000 7f21d3f9d640 1 --2- 172.21.15.63:0/3185543377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21cc1083a0 0x7f21cc1104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.400+0000 7f21d3f9d640 1 --2- 172.21.15.63:0/3185543377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21cc102a60 0x7f21cc10ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:16.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.400+0000 7f21d3f9d640 1 -- 172.21.15.63:0/3185543377 >> 172.21.15.63:0/3185543377 conn(0x7f21cc079730 msgr2=0x7f21cc1013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:16.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.400+0000 7f21d3f9d640 1 -- 172.21.15.63:0/3185543377 shutdown_connections 2024-09-21T06:38:16.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:16.400+0000 7f21d3f9d640 1 -- 172.21.15.63:0/3185543377 wait complete. 2024-09-21T06:38:17.087 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T06:38:17.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:17 smithi063 ceph-mon[31150]: pgmap v632: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:38:17.349 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:17.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:17 smithi071 ceph-mon[34844]: pgmap v632: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:38:17.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:17 smithi175 ceph-mon[34510]: pgmap v632: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:38:17.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.860+0000 7fe87af65640 1 -- 172.21.15.63:0/2791362135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8741094a0 msgr2=0x7fe8741098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:17.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.860+0000 7fe87af65640 1 --2- 172.21.15.63:0/2791362135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8741094a0 0x7fe8741098b0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fe860009900 tx=0x7fe86002a410 comp rx=0 tx=0).stop 2024-09-21T06:38:17.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.860+0000 7fe87af65640 1 -- 172.21.15.63:0/2791362135 shutdown_connections 2024-09-21T06:38:17.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.860+0000 7fe87af65640 1 --2- 172.21.15.63:0/2791362135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe874109df0 0x7fe874110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.860+0000 7fe87af65640 1 --2- 172.21.15.63:0/2791362135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8741094a0 0x7fe8741098b0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.860+0000 7fe87af65640 1 --2- 172.21.15.63:0/2791362135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe874103b60 0x7fe874103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.860+0000 7fe87af65640 1 -- 172.21.15.63:0/2791362135 >> 172.21.15.63:0/2791362135 conn(0x7fe87407b850 msgr2=0x7fe87407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:17.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.860+0000 7fe87af65640 1 -- 172.21.15.63:0/2791362135 shutdown_connections 2024-09-21T06:38:17.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.860+0000 7fe87af65640 1 -- 172.21.15.63:0/2791362135 wait complete. 2024-09-21T06:38:17.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.861+0000 7fe87af65640 1 Processor -- start 2024-09-21T06:38:17.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.861+0000 7fe87af65640 1 -- start start 2024-09-21T06:38:17.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.861+0000 7fe87af65640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe874103b60 0x7fe874075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:17.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.861+0000 7fe87af65640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8741094a0 0x7fe874075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:17.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.861+0000 7fe87af65640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe874109df0 0x7fe874076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:17.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.861+0000 7fe87af65640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe874113ab0 con 0x7fe874103b60 2024-09-21T06:38:17.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.861+0000 7fe87af65640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe874113930 con 0x7fe874109df0 2024-09-21T06:38:17.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.861+0000 7fe87af65640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe874113c30 con 0x7fe8741094a0 2024-09-21T06:38:17.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.861+0000 7fe878d01640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe874103b60 0x7fe874075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:17.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.861+0000 7fe878d01640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe874103b60 0x7fe874075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54396/0 (socket says 172.21.15.63:54396) 2024-09-21T06:38:17.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.861+0000 7fe878d01640 1 -- 172.21.15.63:0/180992342 learned_addr learned my addr 172.21.15.63:0/180992342 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:17.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.861+0000 7fe879502640 1 --2- 172.21.15.63:0/180992342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe874109df0 0x7fe874076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:17.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.861+0000 7fe878d01640 1 -- 172.21.15.63:0/180992342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8741094a0 msgr2=0x7fe874075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:17.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.861+0000 7fe878d01640 1 --2- 172.21.15.63:0/180992342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8741094a0 0x7fe874075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.861+0000 7fe878d01640 1 -- 172.21.15.63:0/180992342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe874109df0 msgr2=0x7fe874076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:17.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.861+0000 7fe878d01640 1 --2- 172.21.15.63:0/180992342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe874109df0 0x7fe874076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.861+0000 7fe878d01640 1 -- 172.21.15.63:0/180992342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8741a8760 con 0x7fe874103b60 2024-09-21T06:38:17.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.862+0000 7fe878d01640 1 --2- 172.21.15.63:0/180992342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe874103b60 0x7fe874075710 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fe86800d770 tx=0x7fe86800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:17.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.862+0000 7fe871ffb640 1 -- 172.21.15.63:0/180992342 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe868017070 con 0x7fe874103b60 2024-09-21T06:38:17.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.862+0000 7fe87af65640 1 -- 172.21.15.63:0/180992342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8741a8a50 con 0x7fe874103b60 2024-09-21T06:38:17.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.862+0000 7fe871ffb640 1 -- 172.21.15.63:0/180992342 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8680054d0 con 0x7fe874103b60 2024-09-21T06:38:17.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.862+0000 7fe871ffb640 1 -- 172.21.15.63:0/180992342 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe868004c30 con 0x7fe874103b60 2024-09-21T06:38:17.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.862+0000 7fe87af65640 1 -- 172.21.15.63:0/180992342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8741a8f40 con 0x7fe874103b60 2024-09-21T06:38:17.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.865+0000 7fe8814d9740 1 Processor -- start 2024-09-21T06:38:17.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.865+0000 7fe871ffb640 1 -- 172.21.15.63:0/180992342 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fe868004e10 con 0x7fe874103b60 2024-09-21T06:38:17.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.865+0000 7fe8814d9740 1 -- start start 2024-09-21T06:38:17.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.865+0000 7fe8814d9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de1747a070 0x55de178216a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:17.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.865+0000 7fe8814d9740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de174511b0 0x55de17821be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:17.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.865+0000 7fe8814d9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de17459390 0x55de17822120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:17.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.865+0000 7fe8814d9740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55de17797ea0 con 0x55de174511b0 2024-09-21T06:38:17.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.865+0000 7fe8814d9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55de177872d0 con 0x55de17459390 2024-09-21T06:38:17.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.865+0000 7fe8814d9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55de1778b0e0 con 0x55de1747a070 2024-09-21T06:38:17.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.865+0000 7fe878d01640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de174511b0 0x55de17821be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:17.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.865+0000 7fe878d01640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de174511b0 0x55de17821be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54402/0 (socket says 172.21.15.63:54402) 2024-09-21T06:38:17.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.865+0000 7fe878d01640 1 -- 172.21.15.63:0/148179278 learned_addr learned my addr 172.21.15.63:0/148179278 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:17.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.865+0000 7fe873fff640 1 --2- 172.21.15.63:0/148179278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de17459390 0x55de17822120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:17.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.865+0000 7fe878d01640 1 -- 172.21.15.63:0/148179278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de1747a070 msgr2=0x55de178216a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:17.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.865+0000 7fe879502640 1 --2- 172.21.15.63:0/148179278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de1747a070 0x55de178216a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:17.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.865+0000 7fe878d01640 1 --2- 172.21.15.63:0/148179278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de1747a070 0x55de178216a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.866+0000 7fe878d01640 1 -- 172.21.15.63:0/148179278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de17459390 msgr2=0x55de17822120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:17.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.866+0000 7fe878d01640 1 --2- 172.21.15.63:0/148179278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de17459390 0x55de17822120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.866+0000 7fe878d01640 1 -- 172.21.15.63:0/148179278 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de174e5650 con 0x55de174511b0 2024-09-21T06:38:17.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.866+0000 7fe871ffb640 1 --2- 172.21.15.63:0/180992342 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe8640b6680 0x7fe8640b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:17.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.866+0000 7fe879502640 1 --2- 172.21.15.63:0/148179278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de1747a070 0x55de178216a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:17.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.866+0000 7fe879502640 1 --2- 172.21.15.63:0/180992342 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe8640b6680 0x7fe8640b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:17.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.866+0000 7fe878d01640 1 --2- 172.21.15.63:0/148179278 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de174511b0 0x55de17821be0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fe8680e49d0 tx=0x7fe8680efa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88329bf1c46fff8e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:17.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.866+0000 7fe871ffb640 1 -- 172.21.15.63:0/180992342 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8637+0+0 (secure 0 0 0) 0x7fe8680e7350 con 0x7fe874103b60 2024-09-21T06:38:17.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.866+0000 7fe85effd640 1 -- 172.21.15.63:0/148179278 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe868020030 con 0x55de174511b0 2024-09-21T06:38:17.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.866+0000 7fe85effd640 1 -- 172.21.15.63:0/148179278 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8680acc40 con 0x55de174511b0 2024-09-21T06:38:17.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.866+0000 7fe85effd640 1 -- 172.21.15.63:0/148179278 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8680acf00 con 0x55de174511b0 2024-09-21T06:38:17.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.867+0000 7fe8814d9740 1 -- 172.21.15.63:0/148179278 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de174511b0 msgr2=0x55de17821be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:17.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.867+0000 7fe879502640 1 --2- 172.21.15.63:0/180992342 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe8640b6680 0x7fe8640b8b90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe86c005fd0 tx=0x7fe86c0094e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:17.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.867+0000 7fe8814d9740 1 --2- 172.21.15.63:0/148179278 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de174511b0 0x55de17821be0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fe8680e49d0 tx=0x7fe8680efa10 comp rx=0 tx=0).stop 2024-09-21T06:38:17.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.867+0000 7fe8814d9740 1 -- 172.21.15.63:0/148179278 shutdown_connections 2024-09-21T06:38:17.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.867+0000 7fe8814d9740 1 --2- 172.21.15.63:0/148179278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de17459390 0x55de17822120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.867+0000 7fe8814d9740 1 --2- 172.21.15.63:0/148179278 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de174511b0 0x55de17821be0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.867+0000 7fe8814d9740 1 --2- 172.21.15.63:0/148179278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de1747a070 0x55de178216a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.867+0000 7fe8814d9740 1 -- 172.21.15.63:0/148179278 >> 172.21.15.63:0/148179278 conn(0x55de1746e460 msgr2=0x55de1781f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:17.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.867+0000 7fe8814d9740 1 -- 172.21.15.63:0/148179278 shutdown_connections 2024-09-21T06:38:17.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.867+0000 7fe8814d9740 1 -- 172.21.15.63:0/148179278 wait complete. 2024-09-21T06:38:17.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.868+0000 7fe8814d9740 1 -- start start 2024-09-21T06:38:17.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.868+0000 7fe8814d9740 1 Processor -- start 2024-09-21T06:38:17.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.868+0000 7fe8814d9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de174511b0 0x55de1782cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:17.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.868+0000 7fe8814d9740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de17459390 0x55de1782d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:17.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.868+0000 7fe8814d9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de1747a070 0x55de1782d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:17.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.868+0000 7fe8814d9740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55de175e8700 con 0x55de17459390 2024-09-21T06:38:17.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.868+0000 7fe8814d9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55de17722160 con 0x55de174511b0 2024-09-21T06:38:17.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.868+0000 7fe8814d9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55de1782fe80 con 0x55de1747a070 2024-09-21T06:38:17.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.868+0000 7fe8814d9740 10 client.0 _ll_register_callbacks cb 0x55de1773b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:17.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.868+0000 7fe873fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de17459390 0x55de1782d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:17.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.868+0000 7fe873fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de17459390 0x55de1782d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54410/0 (socket says 172.21.15.63:54410) 2024-09-21T06:38:17.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.868+0000 7fe873fff640 1 -- 172.21.15.63:0/1207284107 learned_addr learned my addr 172.21.15.63:0/1207284107 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:17.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.869+0000 7fe879502640 1 --2- 172.21.15.63:0/1207284107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de1747a070 0x55de1782d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:17.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.869+0000 7fe878d01640 1 --2- 172.21.15.63:0/1207284107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de174511b0 0x55de1782cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:17.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.869+0000 7fe873fff640 1 -- 172.21.15.63:0/1207284107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de1747a070 msgr2=0x55de1782d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:17.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.869+0000 7fe873fff640 1 --2- 172.21.15.63:0/1207284107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de1747a070 0x55de1782d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.869+0000 7fe873fff640 1 -- 172.21.15.63:0/1207284107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de174511b0 msgr2=0x55de1782cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:17.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.869+0000 7fe873fff640 1 --2- 172.21.15.63:0/1207284107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de174511b0 0x55de1782cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.869+0000 7fe873fff640 1 -- 172.21.15.63:0/1207284107 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de1774fc90 con 0x55de17459390 2024-09-21T06:38:17.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.869+0000 7fe879502640 1 --2- 172.21.15.63:0/1207284107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de1747a070 0x55de1782d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:17.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.869+0000 7fe878d01640 1 --2- 172.21.15.63:0/1207284107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de174511b0 0x55de1782cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:17.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.869+0000 7fe873fff640 1 --2- 172.21.15.63:0/1207284107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de17459390 0x55de1782d1e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fe860009230 tx=0x7fe860031d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd1cced30842af6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:17.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.869+0000 7fe853fff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:38:17.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.869+0000 7fe853fff640 1 -- 172.21.15.63:0/1207284107 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860040070 con 0x55de17459390 2024-09-21T06:38:17.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.869+0000 7fe853fff640 1 -- 172.21.15.63:0/1207284107 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8637+0+0 (secure 0 0 0) 0x7fe8600318b0 con 0x55de17459390 2024-09-21T06:38:17.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.869+0000 7fe8814d9740 1 -- 172.21.15.63:0/1207284107 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8680acc40 con 0x55de17459390 2024-09-21T06:38:17.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.869+0000 7fe853fff640 1 -- 172.21.15.63:0/1207284107 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fe860035040 con 0x55de17459390 2024-09-21T06:38:17.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.869+0000 7fe8814d9740 10 client.17544 fetch_fsmap learned FSMap version 61 2024-09-21T06:38:17.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.869+0000 7fe8814d9740 1 -- 172.21.15.63:0/1207284107 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55de1783ba50 con 0x55de17459390 2024-09-21T06:38:17.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.870+0000 7fe853fff640 1 -- 172.21.15.63:0/1207284107 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8680acc40 con 0x55de17459390 2024-09-21T06:38:17.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.870+0000 7fe853fff640 1 -- 172.21.15.63:0/1207284107 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fe860003c80 con 0x55de17459390 2024-09-21T06:38:17.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.870+0000 7fe8814d9740 10 client.17544 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:38:17.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.870+0000 7fe8814d9740 10 client.17544 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:38:17.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.870+0000 7fe8814d9740 20 client.17544 populate_metadata read hostname 'smithi063' 2024-09-21T06:38:17.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.870+0000 7fe8814d9740 1 --2- 172.21.15.63:0/1207284107 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55de174389f0 0x55de1783ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:17.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.870+0000 7fe8814d9740 4 client.17544 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:17.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.870+0000 7fe8814d9740 1 -- 172.21.15.63:0/1207284107 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de17799df0 con 0x55de174389f0 2024-09-21T06:38:17.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.871+0000 7fe878d01640 1 --2- 172.21.15.63:0/1207284107 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55de174389f0 0x55de1783ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:17.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.872+0000 7fe878d01640 1 --2- 172.21.15.63:0/1207284107 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55de174389f0 0x55de1783ef40 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f6bb33e41dae7b20 server_cookie=c607ab6daaf3f1c5 in_seq=0 out_seq=0 2024-09-21T06:38:17.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.872+0000 7fe853fff640 10 client.17544 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:38:17.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.873+0000 7fe853fff640 1 -- 172.21.15.63:0/1207284107 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55de17799df0 con 0x55de174389f0 2024-09-21T06:38:17.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.873+0000 7fe853fff640 10 client.17544 handle_command_reply: tid=0 2024-09-21T06:38:17.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.873+0000 7fe8814d9740 1 client.17544 shutdown 2024-09-21T06:38:17.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.873+0000 7fe8814d9740 1 -- 172.21.15.63:0/1207284107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de17459390 msgr2=0x55de1782d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:17.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.873+0000 7fe8814d9740 1 --2- 172.21.15.63:0/1207284107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de17459390 0x55de1782d1e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fe860009230 tx=0x7fe860031d40 comp rx=0 tx=0).stop 2024-09-21T06:38:17.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.873+0000 7fe8814d9740 1 -- 172.21.15.63:0/1207284107 shutdown_connections 2024-09-21T06:38:17.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.873+0000 7fe8814d9740 1 --2- 172.21.15.63:0/1207284107 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55de174389f0 0x55de1783ef40 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.873+0000 7fe8814d9740 1 --2- 172.21.15.63:0/1207284107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de1747a070 0x55de1782d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.873+0000 7fe8814d9740 1 --2- 172.21.15.63:0/1207284107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de17459390 0x55de1782d1e0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.873+0000 7fe8814d9740 1 --2- 172.21.15.63:0/1207284107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de174511b0 0x55de1782cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.873+0000 7fe8814d9740 1 -- 172.21.15.63:0/1207284107 >> 172.21.15.63:0/1207284107 conn(0x55de1746e460 msgr2=0x55de17824830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:17.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.873+0000 7fe853fff640 0 client.17544 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:38:17.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.873+0000 7fe8814d9740 1 -- 172.21.15.63:0/1207284107 shutdown_connections 2024-09-21T06:38:17.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.873+0000 7fe8814d9740 1 -- 172.21.15.63:0/1207284107 wait complete. 2024-09-21T06:38:17.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.874+0000 7fe8814d9740 20 client.17544 trim_cache size 0 max 16384 2024-09-21T06:38:17.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.887+0000 7fe8814d9740 1 Processor -- start 2024-09-21T06:38:17.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.887+0000 7fe8814d9740 1 -- start start 2024-09-21T06:38:17.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.887+0000 7fe8814d9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de1746e460 0x55de17823090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:17.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.887+0000 7fe8814d9740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de174511b0 0x55de1782e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:17.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.887+0000 7fe8814d9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de17459390 0x55de1781ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:17.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.887+0000 7fe8814d9740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe8741b1b40 con 0x55de174511b0 2024-09-21T06:38:17.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.887+0000 7fe8814d9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe8741b3680 con 0x55de17459390 2024-09-21T06:38:17.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.887+0000 7fe8814d9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe8741b2210 con 0x55de1746e460 2024-09-21T06:38:17.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.887+0000 7fe873fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de174511b0 0x55de1782e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:17.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.887+0000 7fe873fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de174511b0 0x55de1782e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54420/0 (socket says 172.21.15.63:54420) 2024-09-21T06:38:17.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.887+0000 7fe873fff640 1 -- 172.21.15.63:0/3925189470 learned_addr learned my addr 172.21.15.63:0/3925189470 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:17.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.887+0000 7fe873fff640 1 -- 172.21.15.63:0/3925189470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de1746e460 msgr2=0x55de17823090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:17.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.887+0000 7fe878d01640 1 --2- 172.21.15.63:0/3925189470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de1746e460 0x55de17823090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:17.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.887+0000 7fe879502640 1 --2- 172.21.15.63:0/3925189470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de17459390 0x55de1781ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:17.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.887+0000 7fe873fff640 1 --2- 172.21.15.63:0/3925189470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de1746e460 0x55de17823090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.887+0000 7fe873fff640 1 -- 172.21.15.63:0/3925189470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de17459390 msgr2=0x55de1781ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:17.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.887+0000 7fe873fff640 1 --2- 172.21.15.63:0/3925189470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de17459390 0x55de1781ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.887+0000 7fe873fff640 1 -- 172.21.15.63:0/3925189470 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de1782dd40 con 0x55de174511b0 2024-09-21T06:38:17.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.887+0000 7fe878d01640 1 --2- 172.21.15.63:0/3925189470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de1746e460 0x55de17823090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:17.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.888+0000 7fe873fff640 1 --2- 172.21.15.63:0/3925189470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de174511b0 0x55de1782e8d0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fe86002a930 tx=0x7fe860005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9e4d661b5f9d41 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:17.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.888+0000 7fe85e7fc640 1 -- 172.21.15.63:0/3925189470 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860040070 con 0x55de174511b0 2024-09-21T06:38:17.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.888+0000 7fe85e7fc640 1 -- 172.21.15.63:0/3925189470 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8600316b0 con 0x55de174511b0 2024-09-21T06:38:17.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.888+0000 7fe85e7fc640 1 -- 172.21.15.63:0/3925189470 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860000e60 con 0x55de174511b0 2024-09-21T06:38:17.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.889+0000 7fe8814d9740 1 -- 172.21.15.63:0/3925189470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de174511b0 msgr2=0x55de1782e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:17.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.889+0000 7fe8814d9740 1 --2- 172.21.15.63:0/3925189470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de174511b0 0x55de1782e8d0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fe86002a930 tx=0x7fe860005a40 comp rx=0 tx=0).stop 2024-09-21T06:38:17.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.889+0000 7fe8814d9740 1 -- 172.21.15.63:0/3925189470 shutdown_connections 2024-09-21T06:38:17.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.889+0000 7fe8814d9740 1 --2- 172.21.15.63:0/3925189470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de17459390 0x55de1781ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.889+0000 7fe8814d9740 1 --2- 172.21.15.63:0/3925189470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de174511b0 0x55de1782e8d0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.889+0000 7fe8814d9740 1 --2- 172.21.15.63:0/3925189470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de1746e460 0x55de17823090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.889+0000 7fe8814d9740 1 -- 172.21.15.63:0/3925189470 >> 172.21.15.63:0/3925189470 conn(0x55de1783f290 msgr2=0x55de1782e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:17.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.889+0000 7fe8814d9740 1 -- 172.21.15.63:0/3925189470 shutdown_connections 2024-09-21T06:38:17.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.889+0000 7fe8814d9740 1 -- 172.21.15.63:0/3925189470 wait complete. 2024-09-21T06:38:17.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.889+0000 7fe8814d9740 1 -- start start 2024-09-21T06:38:17.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.889+0000 7fe8814d9740 1 Processor -- start 2024-09-21T06:38:17.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.890+0000 7fe8814d9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de174511b0 0x55de17835a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:17.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.890+0000 7fe8814d9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de17459390 0x55de17830f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:17.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.890+0000 7fe8814d9740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de1746e460 0x55de17831610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:17.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.890+0000 7fe8814d9740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe8741b2fb0 con 0x55de1746e460 2024-09-21T06:38:17.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.890+0000 7fe8814d9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe8741b28e0 con 0x55de17459390 2024-09-21T06:38:17.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.890+0000 7fe8814d9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe8741afb40 con 0x55de174511b0 2024-09-21T06:38:17.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.890+0000 7fe8814d9740 10 client.0 _ll_register_callbacks cb 0x7fe860005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:17.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.890+0000 7fe879502640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de1746e460 0x55de17831610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:17.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.890+0000 7fe879502640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de1746e460 0x55de17831610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54432/0 (socket says 172.21.15.63:54432) 2024-09-21T06:38:17.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.890+0000 7fe879502640 1 -- 172.21.15.63:0/4056780757 learned_addr learned my addr 172.21.15.63:0/4056780757 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:17.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.890+0000 7fe878d01640 1 --2- 172.21.15.63:0/4056780757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de174511b0 0x55de17835a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:17.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.890+0000 7fe873fff640 1 --2- 172.21.15.63:0/4056780757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de17459390 0x55de17830f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:17.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.890+0000 7fe879502640 1 -- 172.21.15.63:0/4056780757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de174511b0 msgr2=0x55de17835a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:17.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.890+0000 7fe879502640 1 --2- 172.21.15.63:0/4056780757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de174511b0 0x55de17835a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.890+0000 7fe879502640 1 -- 172.21.15.63:0/4056780757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de17459390 msgr2=0x55de17830f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:17.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.890+0000 7fe879502640 1 --2- 172.21.15.63:0/4056780757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de17459390 0x55de17830f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.890+0000 7fe879502640 1 -- 172.21.15.63:0/4056780757 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de17831da0 con 0x55de1746e460 2024-09-21T06:38:17.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.890+0000 7fe879502640 1 --2- 172.21.15.63:0/4056780757 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de1746e460 0x55de17831610 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fe86c012da0 tx=0x7fe86c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ec164327a4039c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:17.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.890+0000 7fe853fff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:38:17.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.891+0000 7fe853fff640 1 -- 172.21.15.63:0/4056780757 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c02c060 con 0x55de1746e460 2024-09-21T06:38:17.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.891+0000 7fe853fff640 1 -- 172.21.15.63:0/4056780757 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8637+0+0 (secure 0 0 0) 0x7fe86c01fdb0 con 0x55de1746e460 2024-09-21T06:38:17.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.891+0000 7fe8814d9740 1 -- 172.21.15.63:0/4056780757 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8600316b0 con 0x55de1746e460 2024-09-21T06:38:17.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.891+0000 7fe853fff640 1 -- 172.21.15.63:0/4056780757 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fe86c02f420 con 0x55de1746e460 2024-09-21T06:38:17.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.891+0000 7fe8814d9740 10 client.17550 fetch_fsmap learned FSMap version 61 2024-09-21T06:38:17.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.891+0000 7fe8814d9740 1 -- 172.21.15.63:0/4056780757 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55de178a9980 con 0x55de1746e460 2024-09-21T06:38:17.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.891+0000 7fe853fff640 1 -- 172.21.15.63:0/4056780757 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8600316b0 con 0x55de1746e460 2024-09-21T06:38:17.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.891+0000 7fe853fff640 1 -- 172.21.15.63:0/4056780757 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fe86c026030 con 0x55de1746e460 2024-09-21T06:38:17.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.891+0000 7fe8814d9740 10 client.17550 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:38:17.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.891+0000 7fe8814d9740 10 client.17550 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:38:17.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.891+0000 7fe8814d9740 20 client.17550 populate_metadata read hostname 'smithi063' 2024-09-21T06:38:17.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.891+0000 7fe8814d9740 1 --2- 172.21.15.63:0/4056780757 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55de1747a070 0x55de178ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:17.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.891+0000 7fe8814d9740 4 client.17550 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:38:17.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.891+0000 7fe8814d9740 1 -- 172.21.15.63:0/4056780757 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55de177958a0 con 0x55de1747a070 2024-09-21T06:38:17.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.892+0000 7fe878d01640 1 --2- 172.21.15.63:0/4056780757 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55de1747a070 0x55de178ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:17.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.895+0000 7fe878d01640 1 --2- 172.21.15.63:0/4056780757 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55de1747a070 0x55de178ac1a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=63f48f430a026124 server_cookie=afdf678d2893d759 in_seq=0 out_seq=0 2024-09-21T06:38:17.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.895+0000 7fe853fff640 10 client.17550 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:38:17.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.896+0000 7fe853fff640 1 -- 172.21.15.63:0/4056780757 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55de177958a0 con 0x55de1747a070 2024-09-21T06:38:17.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.896+0000 7fe853fff640 10 client.17550 handle_command_reply: tid=0 2024-09-21T06:38:17.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.896+0000 7fe8814d9740 1 client.17550 shutdown 2024-09-21T06:38:17.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.896+0000 7fe8814d9740 1 -- 172.21.15.63:0/4056780757 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de1746e460 msgr2=0x55de17831610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:17.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.896+0000 7fe8814d9740 1 --2- 172.21.15.63:0/4056780757 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de1746e460 0x55de17831610 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fe86c012da0 tx=0x7fe86c004a40 comp rx=0 tx=0).stop 2024-09-21T06:38:17.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.896+0000 7fe8814d9740 1 -- 172.21.15.63:0/4056780757 shutdown_connections 2024-09-21T06:38:17.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.896+0000 7fe8814d9740 1 --2- 172.21.15.63:0/4056780757 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55de1747a070 0x55de178ac1a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.896+0000 7fe8814d9740 1 --2- 172.21.15.63:0/4056780757 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55de1746e460 0x55de17831610 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.896+0000 7fe8814d9740 1 --2- 172.21.15.63:0/4056780757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55de17459390 0x55de17830f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.896+0000 7fe853fff640 0 client.17550 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:38:17.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.896+0000 7fe8814d9740 1 --2- 172.21.15.63:0/4056780757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de174511b0 0x55de17835a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.896+0000 7fe8814d9740 1 -- 172.21.15.63:0/4056780757 >> 172.21.15.63:0/4056780757 conn(0x55de1783f290 msgr2=0x55de1782b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:17.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.896+0000 7fe8814d9740 1 -- 172.21.15.63:0/4056780757 shutdown_connections 2024-09-21T06:38:17.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.896+0000 7fe8814d9740 1 -- 172.21.15.63:0/4056780757 wait complete. 2024-09-21T06:38:17.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.896+0000 7fe8814d9740 20 client.17550 trim_cache size 0 max 16384 2024-09-21T06:38:17.900 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:38:17.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.897+0000 7fe87af65640 1 -- 172.21.15.63:0/180992342 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe8640b6680 msgr2=0x7fe8640b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:17.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.897+0000 7fe87af65640 1 --2- 172.21.15.63:0/180992342 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe8640b6680 0x7fe8640b8b90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe86c005fd0 tx=0x7fe86c0094e0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.897+0000 7fe87af65640 1 -- 172.21.15.63:0/180992342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe874103b60 msgr2=0x7fe874075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:17.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.897+0000 7fe87af65640 1 --2- 172.21.15.63:0/180992342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe874103b60 0x7fe874075710 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fe86800d770 tx=0x7fe86800dc30 comp rx=0 tx=0).stop 2024-09-21T06:38:17.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.897+0000 7fe87af65640 1 -- 172.21.15.63:0/180992342 shutdown_connections 2024-09-21T06:38:17.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.897+0000 7fe87af65640 1 --2- 172.21.15.63:0/180992342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe874109df0 0x7fe874076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.897+0000 7fe87af65640 1 --2- 172.21.15.63:0/180992342 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fe8640b6680 0x7fe8640b8b90 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.897+0000 7fe87af65640 1 --2- 172.21.15.63:0/180992342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8741094a0 0x7fe874075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.897+0000 7fe87af65640 1 --2- 172.21.15.63:0/180992342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe874103b60 0x7fe874075710 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:17.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.897+0000 7fe87af65640 1 -- 172.21.15.63:0/180992342 >> 172.21.15.63:0/180992342 conn(0x7fe87407b850 msgr2=0x7fe874107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:17.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.897+0000 7fe87af65640 1 -- 172.21.15.63:0/180992342 shutdown_connections 2024-09-21T06:38:17.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:17.897+0000 7fe87af65640 1 -- 172.21.15.63:0/180992342 wait complete. 2024-09-21T06:38:18.844 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:38:19.115 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:19.493 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:19 smithi063 ceph-mon[31150]: pgmap v633: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:38:19.494 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:19 smithi063 ceph-mon[31150]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T06:38:19.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:19 smithi071 ceph-mon[34844]: pgmap v633: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:38:19.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:19 smithi071 ceph-mon[34844]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T06:38:19.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:19 smithi175 ceph-mon[34510]: pgmap v633: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:38:19.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:19 smithi175 ceph-mon[34510]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T06:38:19.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.585+0000 7f65a1d3e640 1 -- 172.21.15.63:0/4227095187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f659c1094b0 msgr2=0x7f659c1098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.585+0000 7f65a1d3e640 1 --2- 172.21.15.63:0/4227095187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f659c1094b0 0x7f659c1098c0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f6590009900 tx=0x7f659002a410 comp rx=0 tx=0).stop 2024-09-21T06:38:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.585+0000 7f65a1d3e640 1 -- 172.21.15.63:0/4227095187 shutdown_connections 2024-09-21T06:38:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.585+0000 7f65a1d3e640 1 --2- 172.21.15.63:0/4227095187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f659c109e00 0x7f659c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.585+0000 7f65a1d3e640 1 --2- 172.21.15.63:0/4227095187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f659c1094b0 0x7f659c1098c0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.585+0000 7f65a1d3e640 1 --2- 172.21.15.63:0/4227095187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f659c103bc0 0x7f659c103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.585+0000 7f65a1d3e640 1 -- 172.21.15.63:0/4227095187 >> 172.21.15.63:0/4227095187 conn(0x7f659c07b910 msgr2=0x7f659c07bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.585+0000 7f65a1d3e640 1 -- 172.21.15.63:0/4227095187 shutdown_connections 2024-09-21T06:38:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.585+0000 7f65a1d3e640 1 -- 172.21.15.63:0/4227095187 wait complete. 2024-09-21T06:38:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.586+0000 7f65a1d3e640 1 Processor -- start 2024-09-21T06:38:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.586+0000 7f65a1d3e640 1 -- start start 2024-09-21T06:38:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.586+0000 7f65a1d3e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f659c103bc0 0x7f659c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.586+0000 7f65a1d3e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f659c1094b0 0x7f659c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.586+0000 7f65a1d3e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f659c109e00 0x7f659c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.586+0000 7f65a1d3e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f659c113ac0 con 0x7f659c1094b0 2024-09-21T06:38:19.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.586+0000 7f65a1d3e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f659c113940 con 0x7f659c103bc0 2024-09-21T06:38:19.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.586+0000 7f65a1d3e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f659c113c40 con 0x7f659c109e00 2024-09-21T06:38:19.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.586+0000 7f659affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f659c1094b0 0x7f659c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.586+0000 7f659affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f659c1094b0 0x7f659c19aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54460/0 (socket says 172.21.15.63:54460) 2024-09-21T06:38:19.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.586+0000 7f659affd640 1 -- 172.21.15.63:0/1406484473 learned_addr learned my addr 172.21.15.63:0/1406484473 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:19.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.587+0000 7f659b7fe640 1 --2- 172.21.15.63:0/1406484473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f659c103bc0 0x7f659c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.587+0000 7f659affd640 1 -- 172.21.15.63:0/1406484473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f659c109e00 msgr2=0x7f659c19fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:19.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.587+0000 7f659affd640 1 --2- 172.21.15.63:0/1406484473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f659c109e00 0x7f659c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.587+0000 7f659affd640 1 -- 172.21.15.63:0/1406484473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f659c103bc0 msgr2=0x7f659c19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:19.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.587+0000 7f659affd640 1 --2- 172.21.15.63:0/1406484473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f659c103bc0 0x7f659c19a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.587+0000 7f659affd640 1 -- 172.21.15.63:0/1406484473 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f659c1a0440 con 0x7f659c1094b0 2024-09-21T06:38:19.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.587+0000 7f659affd640 1 --2- 172.21.15.63:0/1406484473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f659c1094b0 0x7f659c19aa70 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f659002a930 tx=0x7f6590004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.587+0000 7f6598ff9640 1 -- 172.21.15.63:0/1406484473 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659003f030 con 0x7f659c1094b0 2024-09-21T06:38:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.587+0000 7f65a1d3e640 1 -- 172.21.15.63:0/1406484473 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f659c1a06d0 con 0x7f659c1094b0 2024-09-21T06:38:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.587+0000 7f6598ff9640 1 -- 172.21.15.63:0/1406484473 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6590003cb0 con 0x7f659c1094b0 2024-09-21T06:38:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.587+0000 7f6598ff9640 1 -- 172.21.15.63:0/1406484473 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590035070 con 0x7f659c1094b0 2024-09-21T06:38:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.587+0000 7f65a1d3e640 1 -- 172.21.15.63:0/1406484473 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f659c1a6e90 con 0x7f659c1094b0 2024-09-21T06:38:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.590+0000 7f65a82b2740 1 Processor -- start 2024-09-21T06:38:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.590+0000 7f65a82b2740 1 -- start start 2024-09-21T06:38:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.590+0000 7f65a82b2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63ba070 0x5633b67616a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.590+0000 7f65a82b2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633b63911b0 0x5633b6761be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.590+0000 7f65a82b2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5633b6399390 0x5633b6762120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.590+0000 7f65a82b2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5633b66d7ea0 con 0x5633b63ba070 2024-09-21T06:38:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.590+0000 7f65a82b2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5633b66c72d0 con 0x5633b6399390 2024-09-21T06:38:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.590+0000 7f65a82b2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5633b66cb0e0 con 0x5633b63911b0 2024-09-21T06:38:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.590+0000 7f659bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63ba070 0x5633b67616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.590+0000 7f659bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63ba070 0x5633b67616a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54470/0 (socket says 172.21.15.63:54470) 2024-09-21T06:38:19.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.590+0000 7f659bfff640 1 -- 172.21.15.63:0/926676003 learned_addr learned my addr 172.21.15.63:0/926676003 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:19.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.590+0000 7f6598ff9640 1 -- 172.21.15.63:0/1406484473 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f6590042030 con 0x7f659c1094b0 2024-09-21T06:38:19.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.590+0000 7f659b7fe640 1 --2- 172.21.15.63:0/926676003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633b63911b0 0x5633b6761be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.591+0000 7f659bfff640 1 -- 172.21.15.63:0/926676003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633b63911b0 msgr2=0x5633b6761be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:19.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.591+0000 7f659bfff640 1 --2- 172.21.15.63:0/926676003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633b63911b0 0x5633b6761be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.591+0000 7f659bfff640 1 -- 172.21.15.63:0/926676003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5633b6399390 msgr2=0x5633b6762120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:19.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.591+0000 7f659bfff640 1 --2- 172.21.15.63:0/926676003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5633b6399390 0x5633b6762120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.591+0000 7f659bfff640 1 -- 172.21.15.63:0/926676003 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633b6425650 con 0x5633b63ba070 2024-09-21T06:38:19.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.591+0000 7f659bfff640 1 --2- 172.21.15.63:0/926676003 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63ba070 0x5633b67616a0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f659400a960 tx=0x7f659400ae20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37549c4a4aa49b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:19.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.591+0000 7f6581ffb640 1 -- 172.21.15.63:0/926676003 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659400cd80 con 0x5633b63ba070 2024-09-21T06:38:19.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.591+0000 7f6581ffb640 1 -- 172.21.15.63:0/926676003 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f659400f900 con 0x5633b63ba070 2024-09-21T06:38:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.591+0000 7f6581ffb640 1 -- 172.21.15.63:0/926676003 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6594018900 con 0x5633b63ba070 2024-09-21T06:38:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.591+0000 7f6598ff9640 1 --2- 172.21.15.63:0/1406484473 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f65840b6680 0x7f65840b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.591+0000 7f659b7fe640 1 --2- 172.21.15.63:0/1406484473 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f65840b6680 0x7f65840b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.591+0000 7f6598ff9640 1 -- 172.21.15.63:0/1406484473 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f6590107e70 con 0x7f659c1094b0 2024-09-21T06:38:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.592+0000 7f65a82b2740 1 -- 172.21.15.63:0/926676003 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63ba070 msgr2=0x5633b67616a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.592+0000 7f65a82b2740 1 --2- 172.21.15.63:0/926676003 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63ba070 0x5633b67616a0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f659400a960 tx=0x7f659400ae20 comp rx=0 tx=0).stop 2024-09-21T06:38:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.592+0000 7f659b7fe640 1 --2- 172.21.15.63:0/1406484473 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f65840b6680 0x7f65840b8b90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x5633b6760320 tx=0x7f658c00a470 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.592+0000 7f65a82b2740 1 -- 172.21.15.63:0/926676003 shutdown_connections 2024-09-21T06:38:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.592+0000 7f65a82b2740 1 --2- 172.21.15.63:0/926676003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5633b6399390 0x5633b6762120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.592+0000 7f65a82b2740 1 --2- 172.21.15.63:0/926676003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633b63911b0 0x5633b6761be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.592+0000 7f65a82b2740 1 --2- 172.21.15.63:0/926676003 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63ba070 0x5633b67616a0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.592+0000 7f65a82b2740 1 -- 172.21.15.63:0/926676003 >> 172.21.15.63:0/926676003 conn(0x5633b63ae460 msgr2=0x5633b675f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.592+0000 7f65a82b2740 1 -- 172.21.15.63:0/926676003 shutdown_connections 2024-09-21T06:38:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.592+0000 7f65a82b2740 1 -- 172.21.15.63:0/926676003 wait complete. 2024-09-21T06:38:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.592+0000 7f65a82b2740 1 -- start start 2024-09-21T06:38:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.593+0000 7f65a82b2740 1 Processor -- start 2024-09-21T06:38:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.593+0000 7f65a82b2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5633b63911b0 0x5633b676cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.593+0000 7f65a82b2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b6399390 0x5633b676d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.593+0000 7f65a82b2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633b63ba070 0x5633b6779170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.593+0000 7f65a82b2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5633b6528700 con 0x5633b6399390 2024-09-21T06:38:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.593+0000 7f65a82b2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5633b6662160 con 0x5633b63911b0 2024-09-21T06:38:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.593+0000 7f65a82b2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5633b676fe80 con 0x5633b63ba070 2024-09-21T06:38:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.593+0000 7f65a82b2740 10 client.0 _ll_register_callbacks cb 0x5633b667b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.593+0000 7f659affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b6399390 0x5633b676d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.593+0000 7f659affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b6399390 0x5633b676d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54482/0 (socket says 172.21.15.63:54482) 2024-09-21T06:38:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.593+0000 7f659affd640 1 -- 172.21.15.63:0/553372966 learned_addr learned my addr 172.21.15.63:0/553372966 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.593+0000 7f659bfff640 1 --2- 172.21.15.63:0/553372966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633b63ba070 0x5633b6779170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.593+0000 7f659b7fe640 1 --2- 172.21.15.63:0/553372966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5633b63911b0 0x5633b676cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.594+0000 7f659affd640 1 -- 172.21.15.63:0/553372966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633b63ba070 msgr2=0x5633b6779170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.594+0000 7f659affd640 1 --2- 172.21.15.63:0/553372966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633b63ba070 0x5633b6779170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.594+0000 7f659affd640 1 -- 172.21.15.63:0/553372966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5633b63911b0 msgr2=0x5633b676cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.594+0000 7f659affd640 1 --2- 172.21.15.63:0/553372966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5633b63911b0 0x5633b676cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.594+0000 7f659affd640 1 -- 172.21.15.63:0/553372966 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633b668fc90 con 0x5633b6399390 2024-09-21T06:38:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.594+0000 7f659b7fe640 1 --2- 172.21.15.63:0/553372966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5633b63911b0 0x5633b676cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.594+0000 7f659affd640 1 --2- 172.21.15.63:0/553372966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b6399390 0x5633b676d300 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f65900cd970 tx=0x7f65900ca380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3294c2993e95840e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.594+0000 7f657affd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:38:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.594+0000 7f657affd640 1 -- 172.21.15.63:0/553372966 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590049070 con 0x5633b6399390 2024-09-21T06:38:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.594+0000 7f657affd640 1 -- 172.21.15.63:0/553372966 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f65900f12d0 con 0x5633b6399390 2024-09-21T06:38:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.594+0000 7f65a82b2740 1 -- 172.21.15.63:0/553372966 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f659400f900 con 0x5633b6399390 2024-09-21T06:38:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.594+0000 7f657affd640 1 -- 172.21.15.63:0/553372966 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f65900cd3e0 con 0x5633b6399390 2024-09-21T06:38:19.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.594+0000 7f65a82b2740 10 client.17562 fetch_fsmap learned FSMap version 61 2024-09-21T06:38:19.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.594+0000 7f65a82b2740 1 -- 172.21.15.63:0/553372966 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x5633b677bbf0 con 0x5633b6399390 2024-09-21T06:38:19.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.594+0000 7f657affd640 1 -- 172.21.15.63:0/553372966 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f659400f900 con 0x5633b6399390 2024-09-21T06:38:19.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.594+0000 7f657affd640 1 -- 172.21.15.63:0/553372966 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f659003bbe0 con 0x5633b6399390 2024-09-21T06:38:19.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.594+0000 7f65a82b2740 10 client.17562 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:38:19.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.594+0000 7f65a82b2740 10 client.17562 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:38:19.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.595+0000 7f65a82b2740 20 client.17562 populate_metadata read hostname 'smithi063' 2024-09-21T06:38:19.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.595+0000 7f65a82b2740 1 --2- 172.21.15.63:0/553372966 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5633b63789f0 0x5633b677eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.595+0000 7f65a82b2740 4 client.17562 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:19.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.595+0000 7f65a82b2740 1 -- 172.21.15.63:0/553372966 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633b66d9df0 con 0x5633b63789f0 2024-09-21T06:38:19.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.596+0000 7f659b7fe640 1 --2- 172.21.15.63:0/553372966 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5633b63789f0 0x5633b677eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.597+0000 7f659b7fe640 1 --2- 172.21.15.63:0/553372966 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5633b63789f0 0x5633b677eff0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1c624418fd40d8fe server_cookie=2baa327db70980dd in_seq=0 out_seq=0 2024-09-21T06:38:19.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.597+0000 7f657affd640 10 client.17562 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:38:19.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.598+0000 7f657affd640 1 -- 172.21.15.63:0/553372966 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5633b66d9df0 con 0x5633b63789f0 2024-09-21T06:38:19.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.598+0000 7f657affd640 10 client.17562 handle_command_reply: tid=0 2024-09-21T06:38:19.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.598+0000 7f65a82b2740 1 client.17562 shutdown 2024-09-21T06:38:19.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.599+0000 7f65a82b2740 1 -- 172.21.15.63:0/553372966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b6399390 msgr2=0x5633b676d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:19.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.599+0000 7f65a82b2740 1 --2- 172.21.15.63:0/553372966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b6399390 0x5633b676d300 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f65900cd970 tx=0x7f65900ca380 comp rx=0 tx=0).stop 2024-09-21T06:38:19.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.599+0000 7f65a82b2740 1 -- 172.21.15.63:0/553372966 shutdown_connections 2024-09-21T06:38:19.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.599+0000 7f65a82b2740 1 --2- 172.21.15.63:0/553372966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633b63ba070 0x5633b6779170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.599+0000 7f65a82b2740 1 --2- 172.21.15.63:0/553372966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b6399390 0x5633b676d300 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.599+0000 7f65a82b2740 1 --2- 172.21.15.63:0/553372966 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5633b63789f0 0x5633b677eff0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.599+0000 7f657affd640 0 client.17562 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:38:19.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.599+0000 7f65a82b2740 1 --2- 172.21.15.63:0/553372966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5633b63911b0 0x5633b676cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.599+0000 7f65a82b2740 1 -- 172.21.15.63:0/553372966 >> 172.21.15.63:0/553372966 conn(0x5633b63ae460 msgr2=0x5633b67626d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:19.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.599+0000 7f65a82b2740 1 -- 172.21.15.63:0/553372966 shutdown_connections 2024-09-21T06:38:19.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.599+0000 7f65a82b2740 1 -- 172.21.15.63:0/553372966 wait complete. 2024-09-21T06:38:19.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.599+0000 7f65a82b2740 20 client.17562 trim_cache size 0 max 16384 2024-09-21T06:38:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.612+0000 7f65a82b2740 1 Processor -- start 2024-09-21T06:38:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.612+0000 7f65a82b2740 1 -- start start 2024-09-21T06:38:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.613+0000 7f65a82b2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63789f0 0x5633b676d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.613+0000 7f65a82b2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633b63911b0 0x5633b6769fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.613+0000 7f65a82b2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5633b6399390 0x5633b676a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.613+0000 7f65a82b2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f659c1af720 con 0x5633b63789f0 2024-09-21T06:38:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.613+0000 7f65a82b2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f659c1b1260 con 0x5633b6399390 2024-09-21T06:38:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.613+0000 7f65a82b2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f659c1afdf0 con 0x5633b63911b0 2024-09-21T06:38:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.613+0000 7f659b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63789f0 0x5633b676d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.613+0000 7f659b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63789f0 0x5633b676d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54496/0 (socket says 172.21.15.63:54496) 2024-09-21T06:38:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.613+0000 7f659b7fe640 1 -- 172.21.15.63:0/1626161646 learned_addr learned my addr 172.21.15.63:0/1626161646 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.613+0000 7f659b7fe640 1 -- 172.21.15.63:0/1626161646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633b63911b0 msgr2=0x5633b6769fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.613+0000 7f659b7fe640 1 --2- 172.21.15.63:0/1626161646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633b63911b0 0x5633b6769fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.613+0000 7f659b7fe640 1 -- 172.21.15.63:0/1626161646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5633b6399390 msgr2=0x5633b676a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.613+0000 7f659b7fe640 1 --2- 172.21.15.63:0/1626161646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5633b6399390 0x5633b676a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.613+0000 7f659b7fe640 1 -- 172.21.15.63:0/1626161646 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633b676e080 con 0x5633b63789f0 2024-09-21T06:38:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.613+0000 7f659b7fe640 1 --2- 172.21.15.63:0/1626161646 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63789f0 0x5633b676d280 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f658c012a90 tx=0x7f658c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392eef038be26b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.613+0000 7f65817fa640 1 -- 172.21.15.63:0/1626161646 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c020930 con 0x5633b63789f0 2024-09-21T06:38:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.614+0000 7f65817fa640 1 -- 172.21.15.63:0/1626161646 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f658c00f3d0 con 0x5633b63789f0 2024-09-21T06:38:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.614+0000 7f65817fa640 1 -- 172.21.15.63:0/1626161646 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c01e610 con 0x5633b63789f0 2024-09-21T06:38:19.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.614+0000 7f65a82b2740 1 -- 172.21.15.63:0/1626161646 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63789f0 msgr2=0x5633b676d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:19.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.614+0000 7f65a82b2740 1 --2- 172.21.15.63:0/1626161646 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63789f0 0x5633b676d280 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f658c012a90 tx=0x7f658c014000 comp rx=0 tx=0).stop 2024-09-21T06:38:19.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.614+0000 7f65a82b2740 1 -- 172.21.15.63:0/1626161646 shutdown_connections 2024-09-21T06:38:19.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.614+0000 7f65a82b2740 1 --2- 172.21.15.63:0/1626161646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5633b6399390 0x5633b676a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.614+0000 7f65a82b2740 1 --2- 172.21.15.63:0/1626161646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633b63911b0 0x5633b6769fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.614+0000 7f65a82b2740 1 --2- 172.21.15.63:0/1626161646 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63789f0 0x5633b676d280 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.614+0000 7f65a82b2740 1 -- 172.21.15.63:0/1626161646 >> 172.21.15.63:0/1626161646 conn(0x5633b63ae460 msgr2=0x5633b676cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.614+0000 7f65a82b2740 1 -- 172.21.15.63:0/1626161646 shutdown_connections 2024-09-21T06:38:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.614+0000 7f65a82b2740 1 -- 172.21.15.63:0/1626161646 wait complete. 2024-09-21T06:38:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.615+0000 7f65a82b2740 1 -- start start 2024-09-21T06:38:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.615+0000 7f65a82b2740 1 Processor -- start 2024-09-21T06:38:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.615+0000 7f65a82b2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633b63789f0 0x5633b6771400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.615+0000 7f65a82b2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63911b0 0x5633b6771940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.615+0000 7f65a82b2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5633b6399390 0x5633b67e8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.615+0000 7f65a82b2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f659c1b0b90 con 0x5633b63911b0 2024-09-21T06:38:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.615+0000 7f65a82b2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f659c1b04c0 con 0x5633b6399390 2024-09-21T06:38:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.615+0000 7f65a82b2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f659c1ad720 con 0x5633b63789f0 2024-09-21T06:38:19.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.615+0000 7f65a82b2740 10 client.0 _ll_register_callbacks cb 0x7f6590005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:19.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.615+0000 7f659affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63911b0 0x5633b6771940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.615+0000 7f659affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63911b0 0x5633b6771940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54498/0 (socket says 172.21.15.63:54498) 2024-09-21T06:38:19.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.616+0000 7f659affd640 1 -- 172.21.15.63:0/2004469047 learned_addr learned my addr 172.21.15.63:0/2004469047 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:19.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.616+0000 7f659bfff640 1 --2- 172.21.15.63:0/2004469047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5633b6399390 0x5633b67e8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.616+0000 7f659affd640 1 -- 172.21.15.63:0/2004469047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633b63789f0 msgr2=0x5633b6771400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:19.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.616+0000 7f659affd640 1 --2- 172.21.15.63:0/2004469047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633b63789f0 0x5633b6771400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.616+0000 7f659affd640 1 -- 172.21.15.63:0/2004469047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5633b6399390 msgr2=0x5633b67e8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:19.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.616+0000 7f659affd640 1 --2- 172.21.15.63:0/2004469047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5633b6399390 0x5633b67e8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.616+0000 7f659affd640 1 -- 172.21.15.63:0/2004469047 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633b6772230 con 0x5633b63911b0 2024-09-21T06:38:19.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.616+0000 7f659bfff640 1 --2- 172.21.15.63:0/2004469047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5633b6399390 0x5633b67e8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:19.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.616+0000 7f659affd640 1 --2- 172.21.15.63:0/2004469047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63911b0 0x5633b6771940 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f659003d040 tx=0x7f65900f1300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a1d9abf52fbabc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:19.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.616+0000 7f657affd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:38:19.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.616+0000 7f657affd640 1 -- 172.21.15.63:0/2004469047 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590049030 con 0x5633b63911b0 2024-09-21T06:38:19.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.616+0000 7f657affd640 1 -- 172.21.15.63:0/2004469047 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f65900d2470 con 0x5633b63911b0 2024-09-21T06:38:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.616+0000 7f65a82b2740 1 -- 172.21.15.63:0/2004469047 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f658c00f3d0 con 0x5633b63911b0 2024-09-21T06:38:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.616+0000 7f657affd640 1 -- 172.21.15.63:0/2004469047 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f65900e8050 con 0x5633b63911b0 2024-09-21T06:38:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.616+0000 7f65a82b2740 10 client.17568 fetch_fsmap learned FSMap version 61 2024-09-21T06:38:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.616+0000 7f65a82b2740 1 -- 172.21.15.63:0/2004469047 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x5633b67e9f10 con 0x5633b63911b0 2024-09-21T06:38:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.617+0000 7f657affd640 1 -- 172.21.15.63:0/2004469047 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f658c00f3d0 con 0x5633b63911b0 2024-09-21T06:38:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.617+0000 7f657affd640 1 -- 172.21.15.63:0/2004469047 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f65900cced0 con 0x5633b63911b0 2024-09-21T06:38:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.617+0000 7f65a82b2740 10 client.17568 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:38:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.617+0000 7f65a82b2740 10 client.17568 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:38:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.617+0000 7f65a82b2740 20 client.17568 populate_metadata read hostname 'smithi063' 2024-09-21T06:38:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.617+0000 7f65a82b2740 1 --2- 172.21.15.63:0/2004469047 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5633b63ba070 0x5633b67ec690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.617+0000 7f65a82b2740 4 client.17568 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:38:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.617+0000 7f65a82b2740 1 -- 172.21.15.63:0/2004469047 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5633b66d58a0 con 0x5633b63ba070 2024-09-21T06:38:19.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.617+0000 7f659b7fe640 1 --2- 172.21.15.63:0/2004469047 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5633b63ba070 0x5633b67ec690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.618+0000 7f657affd640 10 client.17568 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:38:19.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.618+0000 7f659b7fe640 1 --2- 172.21.15.63:0/2004469047 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5633b63ba070 0x5633b67ec690 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c0b4f3efcd2567e3 server_cookie=469d99620f0ccb5c in_seq=0 out_seq=0 2024-09-21T06:38:19.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.618+0000 7f657affd640 1 -- 172.21.15.63:0/2004469047 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5633b66d58a0 con 0x5633b63ba070 2024-09-21T06:38:19.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.618+0000 7f657affd640 10 client.17568 handle_command_reply: tid=0 2024-09-21T06:38:19.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.618+0000 7f65a82b2740 1 client.17568 shutdown 2024-09-21T06:38:19.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.618+0000 7f65a82b2740 1 -- 172.21.15.63:0/2004469047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63911b0 msgr2=0x5633b6771940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:19.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.618+0000 7f65a82b2740 1 --2- 172.21.15.63:0/2004469047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63911b0 0x5633b6771940 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f659003d040 tx=0x7f65900f1300 comp rx=0 tx=0).stop 2024-09-21T06:38:19.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.618+0000 7f65a82b2740 1 -- 172.21.15.63:0/2004469047 shutdown_connections 2024-09-21T06:38:19.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.618+0000 7f65a82b2740 1 --2- 172.21.15.63:0/2004469047 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x5633b63ba070 0x5633b67ec690 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.618+0000 7f65a82b2740 1 --2- 172.21.15.63:0/2004469047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5633b6399390 0x5633b67e8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.618+0000 7f65a82b2740 1 --2- 172.21.15.63:0/2004469047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5633b63911b0 0x5633b6771940 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.618+0000 7f65a82b2740 1 --2- 172.21.15.63:0/2004469047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633b63789f0 0x5633b6771400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.618+0000 7f65a82b2740 1 -- 172.21.15.63:0/2004469047 >> 172.21.15.63:0/2004469047 conn(0x5633b63ae460 msgr2=0x5633b676e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:19.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.618+0000 7f657affd640 0 client.17568 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:38:19.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.618+0000 7f65a82b2740 1 -- 172.21.15.63:0/2004469047 shutdown_connections 2024-09-21T06:38:19.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.618+0000 7f65a82b2740 1 -- 172.21.15.63:0/2004469047 wait complete. 2024-09-21T06:38:19.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.618+0000 7f65a82b2740 20 client.17568 trim_cache size 0 max 16384 2024-09-21T06:38:19.625 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:38:19.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.619+0000 7f65a1d3e640 1 -- 172.21.15.63:0/1406484473 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f65840b6680 msgr2=0x7f65840b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:19.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.619+0000 7f65a1d3e640 1 --2- 172.21.15.63:0/1406484473 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f65840b6680 0x7f65840b8b90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x5633b6760320 tx=0x7f658c00a470 comp rx=0 tx=0).stop 2024-09-21T06:38:19.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.619+0000 7f65a1d3e640 1 -- 172.21.15.63:0/1406484473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f659c1094b0 msgr2=0x7f659c19aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:19.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.619+0000 7f65a1d3e640 1 --2- 172.21.15.63:0/1406484473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f659c1094b0 0x7f659c19aa70 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f659002a930 tx=0x7f6590004270 comp rx=0 tx=0).stop 2024-09-21T06:38:19.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.619+0000 7f65a1d3e640 1 -- 172.21.15.63:0/1406484473 shutdown_connections 2024-09-21T06:38:19.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.619+0000 7f65a1d3e640 1 --2- 172.21.15.63:0/1406484473 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f65840b6680 0x7f65840b8b90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.619+0000 7f65a1d3e640 1 --2- 172.21.15.63:0/1406484473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f659c109e00 0x7f659c19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.619+0000 7f65a1d3e640 1 --2- 172.21.15.63:0/1406484473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f659c1094b0 0x7f659c19aa70 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.619+0000 7f65a1d3e640 1 --2- 172.21.15.63:0/1406484473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f659c103bc0 0x7f659c19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.619+0000 7f65a1d3e640 1 -- 172.21.15.63:0/1406484473 >> 172.21.15.63:0/1406484473 conn(0x7f659c07b910 msgr2=0x7f659c105580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:19.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.619+0000 7f65a1d3e640 1 -- 172.21.15.63:0/1406484473 shutdown_connections 2024-09-21T06:38:19.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:19.619+0000 7f65a1d3e640 1 -- 172.21.15.63:0/1406484473 wait complete. 2024-09-21T06:38:20.317 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:38:20.575 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:21.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.030+0000 7f5ef678e640 1 -- 172.21.15.63:0/3940931824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ef0102a80 msgr2=0x7f5ef0102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:21.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.030+0000 7f5ef678e640 1 --2- 172.21.15.63:0/3940931824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ef0102a80 0x7f5ef0102e90 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009900 tx=0x7f5ee002a410 comp rx=0 tx=0).stop 2024-09-21T06:38:21.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.030+0000 7f5ef678e640 1 -- 172.21.15.63:0/3940931824 shutdown_connections 2024-09-21T06:38:21.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.030+0000 7f5ef678e640 1 --2- 172.21.15.63:0/3940931824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef0108d10 0x7f5ef010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.030+0000 7f5ef678e640 1 --2- 172.21.15.63:0/3940931824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ef01083c0 0x7f5ef01087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.030+0000 7f5ef678e640 1 --2- 172.21.15.63:0/3940931824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ef0102a80 0x7f5ef0102e90 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.030+0000 7f5ef678e640 1 -- 172.21.15.63:0/3940931824 >> 172.21.15.63:0/3940931824 conn(0x7f5ef0079740 msgr2=0x7f5ef0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:21.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.030+0000 7f5ef678e640 1 -- 172.21.15.63:0/3940931824 shutdown_connections 2024-09-21T06:38:21.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.030+0000 7f5ef678e640 1 -- 172.21.15.63:0/3940931824 wait complete. 2024-09-21T06:38:21.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.031+0000 7f5ef678e640 1 Processor -- start 2024-09-21T06:38:21.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.031+0000 7f5ef678e640 1 -- start start 2024-09-21T06:38:21.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.031+0000 7f5ef678e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef0102a80 0x7f5ef0104270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:21.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.031+0000 7f5ef678e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ef01083c0 0x7f5ef01047b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:21.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.031+0000 7f5ef678e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ef0108d10 0x7f5ef0104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:21.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.031+0000 7f5ef678e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef0112980 con 0x7f5ef0108d10 2024-09-21T06:38:21.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.031+0000 7f5ef678e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef0112800 con 0x7f5ef01083c0 2024-09-21T06:38:21.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.031+0000 7f5ef678e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef0112b00 con 0x7f5ef0102a80 2024-09-21T06:38:21.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.032+0000 7f5ef4d2b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ef0108d10 0x7f5ef0104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:21.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.032+0000 7f5ef4d2b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ef0108d10 0x7f5ef0104cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54512/0 (socket says 172.21.15.63:54512) 2024-09-21T06:38:21.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.032+0000 7f5ef4d2b640 1 -- 172.21.15.63:0/714989063 learned_addr learned my addr 172.21.15.63:0/714989063 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:21.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.032+0000 7f5eeffff640 1 --2- 172.21.15.63:0/714989063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef0102a80 0x7f5ef0104270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:21.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.032+0000 7f5eef7fe640 1 --2- 172.21.15.63:0/714989063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ef01083c0 0x7f5ef01047b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:21.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.032+0000 7f5ef4d2b640 1 -- 172.21.15.63:0/714989063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef0102a80 msgr2=0x7f5ef0104270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:21.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.032+0000 7f5ef4d2b640 1 --2- 172.21.15.63:0/714989063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef0102a80 0x7f5ef0104270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.032+0000 7f5ef4d2b640 1 -- 172.21.15.63:0/714989063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ef01083c0 msgr2=0x7f5ef01047b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:21.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.032+0000 7f5ef4d2b640 1 --2- 172.21.15.63:0/714989063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ef01083c0 0x7f5ef01047b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.032+0000 7f5ef4d2b640 1 -- 172.21.15.63:0/714989063 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef01a8710 con 0x7f5ef0108d10 2024-09-21T06:38:21.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.032+0000 7f5eeffff640 1 --2- 172.21.15.63:0/714989063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef0102a80 0x7f5ef0104270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:21.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.032+0000 7f5ef4d2b640 1 --2- 172.21.15.63:0/714989063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ef0108d10 0x7f5ef0104cf0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f5ee800cad0 tx=0x7f5ee800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:21.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.032+0000 7f5eed7fa640 1 -- 172.21.15.63:0/714989063 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee800ae20 con 0x7f5ef0108d10 2024-09-21T06:38:21.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.032+0000 7f5eed7fa640 1 -- 172.21.15.63:0/714989063 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ee8005020 con 0x7f5ef0108d10 2024-09-21T06:38:21.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.032+0000 7f5ef678e640 1 -- 172.21.15.63:0/714989063 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef01a8a00 con 0x7f5ef0108d10 2024-09-21T06:38:21.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.032+0000 7f5eed7fa640 1 -- 172.21.15.63:0/714989063 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee800f6b0 con 0x7f5ef0108d10 2024-09-21T06:38:21.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.033+0000 7f5ef678e640 1 -- 172.21.15.63:0/714989063 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ef01a8f90 con 0x7f5ef0108d10 2024-09-21T06:38:21.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.035+0000 7f5eed7fa640 1 -- 172.21.15.63:0/714989063 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f5ee80051d0 con 0x7f5ef0108d10 2024-09-21T06:38:21.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.035+0000 7f5efcd02740 1 Processor -- start 2024-09-21T06:38:21.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.035+0000 7f5efcd02740 1 -- start start 2024-09-21T06:38:21.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.036+0000 7f5efcd02740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd86cd8070 0x55bd8707f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:21.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.036+0000 7f5efcd02740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86caf1b0 0x55bd8707f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:21.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.036+0000 7f5efcd02740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cb7390 0x55bd8707fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:21.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.036+0000 7f5efcd02740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55bd86ff5ea0 con 0x55bd86cb7390 2024-09-21T06:38:21.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.036+0000 7f5efcd02740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bd86fe52d0 con 0x55bd86caf1b0 2024-09-21T06:38:21.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.036+0000 7f5efcd02740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bd86fe90e0 con 0x55bd86cd8070 2024-09-21T06:38:21.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.036+0000 7f5eef7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cb7390 0x55bd8707fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:21.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.036+0000 7f5eef7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cb7390 0x55bd8707fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54516/0 (socket says 172.21.15.63:54516) 2024-09-21T06:38:21.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.036+0000 7f5eef7fe640 1 -- 172.21.15.63:0/313071290 learned_addr learned my addr 172.21.15.63:0/313071290 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:21.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.036+0000 7f5eeffff640 1 --2- 172.21.15.63:0/313071290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86caf1b0 0x55bd8707f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:21.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.036+0000 7f5eed7fa640 1 --2- 172.21.15.63:0/714989063 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f5ed80b6700 0x7f5ed80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:21.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.036+0000 7f5eef7fe640 1 --2- 172.21.15.63:0/313071290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd86cd8070 0x55bd8707f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:21.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.036+0000 7f5eef7fe640 1 -- 172.21.15.63:0/313071290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd86cd8070 msgr2=0x55bd8707f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:21.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.036+0000 7f5eef7fe640 1 --2- 172.21.15.63:0/313071290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd86cd8070 0x55bd8707f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.036+0000 7f5eef7fe640 1 -- 172.21.15.63:0/313071290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86caf1b0 msgr2=0x55bd8707f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:21.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.036+0000 7f5eef7fe640 1 --2- 172.21.15.63:0/313071290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86caf1b0 0x55bd8707f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.036+0000 7f5eef7fe640 1 -- 172.21.15.63:0/313071290 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd86d43650 con 0x55bd86cb7390 2024-09-21T06:38:21.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.036+0000 7f5eed7fa640 1 -- 172.21.15.63:0/714989063 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f5ee80e7760 con 0x7f5ef0108d10 2024-09-21T06:38:21.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.037+0000 7f5eef7fe640 1 --2- 172.21.15.63:0/313071290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cb7390 0x55bd8707fd40 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400bf70 tx=0x7f5ee400b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=543b1b8b182f742d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:21.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.037+0000 7f5ef4d2b640 1 --2- 172.21.15.63:0/714989063 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f5ed80b6700 0x7f5ed80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:21.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.037+0000 7f5ed67fc640 1 -- 172.21.15.63:0/313071290 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4018030 con 0x55bd86cb7390 2024-09-21T06:38:21.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.037+0000 7f5ed67fc640 1 -- 172.21.15.63:0/313071290 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ee40054d0 con 0x55bd86cb7390 2024-09-21T06:38:21.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.037+0000 7f5ed67fc640 1 -- 172.21.15.63:0/313071290 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4010720 con 0x55bd86cb7390 2024-09-21T06:38:21.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.038+0000 7f5efcd02740 1 -- 172.21.15.63:0/313071290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cb7390 msgr2=0x55bd8707fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:21.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.038+0000 7f5efcd02740 1 --2- 172.21.15.63:0/313071290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cb7390 0x55bd8707fd40 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400bf70 tx=0x7f5ee400b620 comp rx=0 tx=0).stop 2024-09-21T06:38:21.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.038+0000 7f5ef4d2b640 1 --2- 172.21.15.63:0/714989063 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f5ed80b6700 0x7f5ed80b8c10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80e4f10 tx=0x7f5ee807a210 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:21.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.038+0000 7f5efcd02740 1 -- 172.21.15.63:0/313071290 shutdown_connections 2024-09-21T06:38:21.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.038+0000 7f5efcd02740 1 --2- 172.21.15.63:0/313071290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cb7390 0x55bd8707fd40 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.038+0000 7f5efcd02740 1 --2- 172.21.15.63:0/313071290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86caf1b0 0x55bd8707f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.038+0000 7f5efcd02740 1 --2- 172.21.15.63:0/313071290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd86cd8070 0x55bd8707f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.038+0000 7f5efcd02740 1 -- 172.21.15.63:0/313071290 >> 172.21.15.63:0/313071290 conn(0x55bd86ccc460 msgr2=0x55bd8707d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:21.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.038+0000 7f5efcd02740 1 -- 172.21.15.63:0/313071290 shutdown_connections 2024-09-21T06:38:21.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.038+0000 7f5efcd02740 1 -- 172.21.15.63:0/313071290 wait complete. 2024-09-21T06:38:21.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.038+0000 7f5efcd02740 1 -- start start 2024-09-21T06:38:21.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.038+0000 7f5efcd02740 1 Processor -- start 2024-09-21T06:38:21.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.039+0000 7f5efcd02740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd86caf1b0 0x55bd8708a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:21.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.039+0000 7f5efcd02740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cb7390 0x55bd8708ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:21.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.039+0000 7f5efcd02740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86cd8070 0x55bd87096d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:21.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.039+0000 7f5efcd02740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55bd86e46700 con 0x55bd86cb7390 2024-09-21T06:38:21.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.039+0000 7f5efcd02740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bd86f80160 con 0x55bd86cd8070 2024-09-21T06:38:21.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.039+0000 7f5efcd02740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bd8708daa0 con 0x55bd86caf1b0 2024-09-21T06:38:21.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.039+0000 7f5efcd02740 10 client.0 _ll_register_callbacks cb 0x55bd86f999e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:21.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.039+0000 7f5eeffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cb7390 0x55bd8708ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:21.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.039+0000 7f5eeffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cb7390 0x55bd8708ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54518/0 (socket says 172.21.15.63:54518) 2024-09-21T06:38:21.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.039+0000 7f5eeffff640 1 -- 172.21.15.63:0/2946326464 learned_addr learned my addr 172.21.15.63:0/2946326464 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:21.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.039+0000 7f5eef7fe640 1 --2- 172.21.15.63:0/2946326464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86cd8070 0x55bd87096d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:21.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.039+0000 7f5eef7fe640 1 --2- 172.21.15.63:0/2946326464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd86caf1b0 0x55bd8708a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:21.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.039+0000 7f5eeffff640 1 -- 172.21.15.63:0/2946326464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd86caf1b0 msgr2=0x55bd8708a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:21.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.039+0000 7f5eeffff640 1 --2- 172.21.15.63:0/2946326464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd86caf1b0 0x55bd8708a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.039+0000 7f5eeffff640 1 -- 172.21.15.63:0/2946326464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86cd8070 msgr2=0x55bd87096d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:21.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.039+0000 7f5eeffff640 1 --2- 172.21.15.63:0/2946326464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86cd8070 0x55bd87096d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.039+0000 7f5eeffff640 1 -- 172.21.15.63:0/2946326464 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd86fadc90 con 0x55bd86cb7390 2024-09-21T06:38:21.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.039+0000 7f5eef7fe640 1 --2- 172.21.15.63:0/2946326464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86cd8070 0x55bd87096d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:21.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.040+0000 7f5eeffff640 1 --2- 172.21.15.63:0/2946326464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cb7390 0x55bd8708ae70 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0005ab0 tx=0x7f5ee0031810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e8c56c46515a1b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:21.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.040+0000 7f5ecf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:38:21.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.040+0000 7f5ecf7fe640 1 -- 172.21.15.63:0/2946326464 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0035040 con 0x55bd86cb7390 2024-09-21T06:38:21.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.040+0000 7f5efcd02740 1 -- 172.21.15.63:0/2946326464 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ee40054d0 con 0x55bd86cb7390 2024-09-21T06:38:21.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.040+0000 7f5ecf7fe640 1 -- 172.21.15.63:0/2946326464 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f5ee0004240 con 0x55bd86cb7390 2024-09-21T06:38:21.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.040+0000 7f5ecf7fe640 1 -- 172.21.15.63:0/2946326464 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f5ee0004440 con 0x55bd86cb7390 2024-09-21T06:38:21.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.040+0000 7f5efcd02740 10 client.17580 fetch_fsmap learned FSMap version 61 2024-09-21T06:38:21.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.040+0000 7f5efcd02740 1 -- 172.21.15.63:0/2946326464 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55bd870997c0 con 0x55bd86cb7390 2024-09-21T06:38:21.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.040+0000 7f5ecf7fe640 1 -- 172.21.15.63:0/2946326464 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ee40054d0 con 0x55bd86cb7390 2024-09-21T06:38:21.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.040+0000 7f5ecf7fe640 1 -- 172.21.15.63:0/2946326464 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f5ee003c710 con 0x55bd86cb7390 2024-09-21T06:38:21.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.040+0000 7f5efcd02740 10 client.17580 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:38:21.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.040+0000 7f5efcd02740 10 client.17580 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:38:21.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.040+0000 7f5efcd02740 20 client.17580 populate_metadata read hostname 'smithi063' 2024-09-21T06:38:21.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.041+0000 7f5efcd02740 1 --2- 172.21.15.63:0/2946326464 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55bd86c969f0 0x55bd8709cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:21.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.041+0000 7f5efcd02740 4 client.17580 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:21.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.041+0000 7f5efcd02740 1 -- 172.21.15.63:0/2946326464 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd86ff7df0 con 0x55bd86c969f0 2024-09-21T06:38:21.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.041+0000 7f5eef7fe640 1 --2- 172.21.15.63:0/2946326464 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55bd86c969f0 0x55bd8709cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:21.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.041+0000 7f5ecf7fe640 10 client.17580 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:38:21.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.041+0000 7f5eef7fe640 1 --2- 172.21.15.63:0/2946326464 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55bd86c969f0 0x55bd8709cc60 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6e0d496b9c6af4b4 server_cookie=7e56173c12c876d3 in_seq=0 out_seq=0 2024-09-21T06:38:21.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.042+0000 7f5ecf7fe640 1 -- 172.21.15.63:0/2946326464 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bd86ff7df0 con 0x55bd86c969f0 2024-09-21T06:38:21.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.042+0000 7f5ecf7fe640 10 client.17580 handle_command_reply: tid=0 2024-09-21T06:38:21.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.042+0000 7f5efcd02740 1 client.17580 shutdown 2024-09-21T06:38:21.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.042+0000 7f5efcd02740 1 -- 172.21.15.63:0/2946326464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cb7390 msgr2=0x55bd8708ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:21.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.042+0000 7f5efcd02740 1 --2- 172.21.15.63:0/2946326464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cb7390 0x55bd8708ae70 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0005ab0 tx=0x7f5ee0031810 comp rx=0 tx=0).stop 2024-09-21T06:38:21.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.042+0000 7f5efcd02740 1 -- 172.21.15.63:0/2946326464 shutdown_connections 2024-09-21T06:38:21.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.042+0000 7f5efcd02740 1 --2- 172.21.15.63:0/2946326464 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55bd86c969f0 0x55bd8709cc60 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.042+0000 7f5efcd02740 1 --2- 172.21.15.63:0/2946326464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86cd8070 0x55bd87096d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.042+0000 7f5efcd02740 1 --2- 172.21.15.63:0/2946326464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cb7390 0x55bd8708ae70 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.042+0000 7f5ecf7fe640 0 client.17580 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:38:21.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.042+0000 7f5efcd02740 1 --2- 172.21.15.63:0/2946326464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd86caf1b0 0x55bd8708a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.042+0000 7f5efcd02740 1 -- 172.21.15.63:0/2946326464 >> 172.21.15.63:0/2946326464 conn(0x55bd86ccc460 msgr2=0x55bd87082450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:21.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.043+0000 7f5efcd02740 1 -- 172.21.15.63:0/2946326464 shutdown_connections 2024-09-21T06:38:21.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.043+0000 7f5efcd02740 1 -- 172.21.15.63:0/2946326464 wait complete. 2024-09-21T06:38:21.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.043+0000 7f5efcd02740 20 client.17580 trim_cache size 0 max 16384 2024-09-21T06:38:21.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.056+0000 7f5efcd02740 1 Processor -- start 2024-09-21T06:38:21.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.056+0000 7f5efcd02740 1 -- start start 2024-09-21T06:38:21.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.056+0000 7f5efcd02740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86caf1b0 0x55bd87080cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:21.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.056+0000 7f5efcd02740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd86cb7390 0x55bd8708c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:21.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.056+0000 7f5efcd02740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cd8070 0x55bd87096c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:21.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.056+0000 7f5efcd02740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef01b19d0 con 0x55bd86cd8070 2024-09-21T06:38:21.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.056+0000 7f5efcd02740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef01b3510 con 0x55bd86caf1b0 2024-09-21T06:38:21.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.056+0000 7f5efcd02740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef01b20a0 con 0x55bd86cb7390 2024-09-21T06:38:21.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.056+0000 7f5eef7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cd8070 0x55bd87096c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:21.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.056+0000 7f5eef7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cd8070 0x55bd87096c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54522/0 (socket says 172.21.15.63:54522) 2024-09-21T06:38:21.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.056+0000 7f5eef7fe640 1 -- 172.21.15.63:0/3984993069 learned_addr learned my addr 172.21.15.63:0/3984993069 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:21.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.056+0000 7f5eef7fe640 1 --2- 172.21.15.63:0/3984993069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86caf1b0 0x55bd87080cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:21.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.056+0000 7f5eeffff640 1 --2- 172.21.15.63:0/3984993069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd86cb7390 0x55bd8708c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:21.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.057+0000 7f5eef7fe640 1 -- 172.21.15.63:0/3984993069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd86cb7390 msgr2=0x55bd8708c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:21.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.057+0000 7f5eef7fe640 1 --2- 172.21.15.63:0/3984993069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd86cb7390 0x55bd8708c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.057+0000 7f5eef7fe640 1 -- 172.21.15.63:0/3984993069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86caf1b0 msgr2=0x55bd87080cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:21.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.057+0000 7f5eef7fe640 1 --2- 172.21.15.63:0/3984993069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86caf1b0 0x55bd87080cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.057+0000 7f5eef7fe640 1 -- 172.21.15.63:0/3984993069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd870815b0 con 0x55bd86cd8070 2024-09-21T06:38:21.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.057+0000 7f5eef7fe640 1 --2- 172.21.15.63:0/3984993069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cd8070 0x55bd87096c90 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40058c0 tx=0x7f5ee400b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a395d6b4f631644f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.057+0000 7f5ed5ffb640 1 -- 172.21.15.63:0/3984993069 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4027040 con 0x55bd86cd8070 2024-09-21T06:38:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.057+0000 7f5ed5ffb640 1 -- 172.21.15.63:0/3984993069 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ee402d070 con 0x55bd86cd8070 2024-09-21T06:38:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.057+0000 7f5ed5ffb640 1 -- 172.21.15.63:0/3984993069 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4018040 con 0x55bd86cd8070 2024-09-21T06:38:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.058+0000 7f5efcd02740 1 -- 172.21.15.63:0/3984993069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cd8070 msgr2=0x55bd87096c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.058+0000 7f5efcd02740 1 --2- 172.21.15.63:0/3984993069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cd8070 0x55bd87096c90 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40058c0 tx=0x7f5ee400b620 comp rx=0 tx=0).stop 2024-09-21T06:38:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.058+0000 7f5efcd02740 1 -- 172.21.15.63:0/3984993069 shutdown_connections 2024-09-21T06:38:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.058+0000 7f5efcd02740 1 --2- 172.21.15.63:0/3984993069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cd8070 0x55bd87096c90 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.058+0000 7f5efcd02740 1 --2- 172.21.15.63:0/3984993069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd86cb7390 0x55bd8708c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.058+0000 7f5efcd02740 1 --2- 172.21.15.63:0/3984993069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86caf1b0 0x55bd87080cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.058+0000 7f5efcd02740 1 -- 172.21.15.63:0/3984993069 >> 172.21.15.63:0/3984993069 conn(0x55bd86ccc460 msgr2=0x55bd8708be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.058+0000 7f5efcd02740 1 -- 172.21.15.63:0/3984993069 shutdown_connections 2024-09-21T06:38:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.058+0000 7f5efcd02740 1 -- 172.21.15.63:0/3984993069 wait complete. 2024-09-21T06:38:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.058+0000 7f5efcd02740 1 -- start start 2024-09-21T06:38:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.058+0000 7f5efcd02740 1 Processor -- start 2024-09-21T06:38:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.059+0000 7f5efcd02740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd86caf1b0 0x55bd8708ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.059+0000 7f5efcd02740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86cb7390 0x55bd8708f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.059+0000 7f5efcd02740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cd8070 0x55bd8708f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.059+0000 7f5efcd02740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef01b2e40 con 0x55bd86cd8070 2024-09-21T06:38:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.059+0000 7f5efcd02740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef01b2770 con 0x55bd86cb7390 2024-09-21T06:38:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.059+0000 7f5efcd02740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef01af9d0 con 0x55bd86caf1b0 2024-09-21T06:38:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.059+0000 7f5efcd02740 10 client.0 _ll_register_callbacks cb 0x7f5ee0009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.059+0000 7f5eef7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cd8070 0x55bd8708f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.059+0000 7f5eef7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cd8070 0x55bd8708f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54538/0 (socket says 172.21.15.63:54538) 2024-09-21T06:38:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.059+0000 7f5eef7fe640 1 -- 172.21.15.63:0/1607179302 learned_addr learned my addr 172.21.15.63:0/1607179302 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.059+0000 7f5eeffff640 1 --2- 172.21.15.63:0/1607179302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86cb7390 0x55bd8708f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.059+0000 7f5eef7fe640 1 --2- 172.21.15.63:0/1607179302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd86caf1b0 0x55bd8708ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.059+0000 7f5eef7fe640 1 -- 172.21.15.63:0/1607179302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd86caf1b0 msgr2=0x55bd8708ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.059+0000 7f5eef7fe640 1 --2- 172.21.15.63:0/1607179302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd86caf1b0 0x55bd8708ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.059+0000 7f5eef7fe640 1 -- 172.21.15.63:0/1607179302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86cb7390 msgr2=0x55bd8708f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.059+0000 7f5eef7fe640 1 --2- 172.21.15.63:0/1607179302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86cb7390 0x55bd8708f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.059+0000 7f5eef7fe640 1 -- 172.21.15.63:0/1607179302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd87106780 con 0x55bd86cd8070 2024-09-21T06:38:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.059+0000 7f5eef7fe640 1 --2- 172.21.15.63:0/1607179302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cd8070 0x55bd8708f8c0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4004aa0 tx=0x7f5ee4010e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10d4212d6a849e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.059+0000 7f5ecf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:38:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.060+0000 7f5ecf7fe640 1 -- 172.21.15.63:0/1607179302 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4018050 con 0x55bd86cd8070 2024-09-21T06:38:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.060+0000 7f5ecf7fe640 1 -- 172.21.15.63:0/1607179302 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f5ee4010720 con 0x55bd86cd8070 2024-09-21T06:38:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.060+0000 7f5efcd02740 1 -- 172.21.15.63:0/1607179302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ee402d070 con 0x55bd86cd8070 2024-09-21T06:38:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.060+0000 7f5ecf7fe640 1 -- 172.21.15.63:0/1607179302 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f5ee4004840 con 0x55bd86cd8070 2024-09-21T06:38:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.060+0000 7f5efcd02740 10 client.17586 fetch_fsmap learned FSMap version 61 2024-09-21T06:38:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.060+0000 7f5efcd02740 1 -- 172.21.15.63:0/1607179302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55bd87107a00 con 0x55bd86cd8070 2024-09-21T06:38:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.060+0000 7f5ecf7fe640 1 -- 172.21.15.63:0/1607179302 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ee402d070 con 0x55bd86cd8070 2024-09-21T06:38:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.060+0000 7f5ecf7fe640 1 -- 172.21.15.63:0/1607179302 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f5ee40434d0 con 0x55bd86cd8070 2024-09-21T06:38:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.060+0000 7f5efcd02740 10 client.17586 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:38:21.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.060+0000 7f5efcd02740 10 client.17586 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:38:21.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.060+0000 7f5efcd02740 20 client.17586 populate_metadata read hostname 'smithi063' 2024-09-21T06:38:21.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.060+0000 7f5efcd02740 1 --2- 172.21.15.63:0/1607179302 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55bd86c6bda0 0x55bd87109e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:21.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.060+0000 7f5efcd02740 4 client.17586 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:38:21.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.060+0000 7f5efcd02740 1 -- 172.21.15.63:0/1607179302 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bd86ff38a0 con 0x55bd86c6bda0 2024-09-21T06:38:21.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.061+0000 7f5eeffff640 1 --2- 172.21.15.63:0/1607179302 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55bd86c6bda0 0x55bd87109e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:21.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.061+0000 7f5eeffff640 1 --2- 172.21.15.63:0/1607179302 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55bd86c6bda0 0x55bd87109e90 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=44d61bc2f61a1c93 server_cookie=8c16e381b50b632c in_seq=0 out_seq=0 2024-09-21T06:38:21.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.061+0000 7f5ecf7fe640 10 client.17586 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:38:21.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.061+0000 7f5ecf7fe640 1 -- 172.21.15.63:0/1607179302 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bd86ff38a0 con 0x55bd86c6bda0 2024-09-21T06:38:21.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.061+0000 7f5ecf7fe640 10 client.17586 handle_command_reply: tid=0 2024-09-21T06:38:21.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.061+0000 7f5efcd02740 1 client.17586 shutdown 2024-09-21T06:38:21.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.061+0000 7f5efcd02740 1 -- 172.21.15.63:0/1607179302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cd8070 msgr2=0x55bd8708f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:21.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.061+0000 7f5efcd02740 1 --2- 172.21.15.63:0/1607179302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cd8070 0x55bd8708f8c0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4004aa0 tx=0x7f5ee4010e30 comp rx=0 tx=0).stop 2024-09-21T06:38:21.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.062+0000 7f5efcd02740 1 -- 172.21.15.63:0/1607179302 shutdown_connections 2024-09-21T06:38:21.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.062+0000 7f5efcd02740 1 --2- 172.21.15.63:0/1607179302 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55bd86c6bda0 0x55bd87109e90 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.062+0000 7f5ecf7fe640 0 client.17586 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:38:21.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.062+0000 7f5efcd02740 1 --2- 172.21.15.63:0/1607179302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bd86cd8070 0x55bd8708f8c0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.062+0000 7f5efcd02740 1 --2- 172.21.15.63:0/1607179302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd86cb7390 0x55bd8708f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.062+0000 7f5efcd02740 1 --2- 172.21.15.63:0/1607179302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd86caf1b0 0x55bd8708ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.062+0000 7f5efcd02740 1 -- 172.21.15.63:0/1607179302 >> 172.21.15.63:0/1607179302 conn(0x55bd86ccc460 msgr2=0x55bd8708c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:21.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.062+0000 7f5efcd02740 1 -- 172.21.15.63:0/1607179302 shutdown_connections 2024-09-21T06:38:21.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.062+0000 7f5efcd02740 1 -- 172.21.15.63:0/1607179302 wait complete. 2024-09-21T06:38:21.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.062+0000 7f5efcd02740 20 client.17586 trim_cache size 0 max 16384 2024-09-21T06:38:21.068 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:38:21.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.062+0000 7f5ef678e640 1 -- 172.21.15.63:0/714989063 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f5ed80b6700 msgr2=0x7f5ed80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:21.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.062+0000 7f5ef678e640 1 --2- 172.21.15.63:0/714989063 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f5ed80b6700 0x7f5ed80b8c10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80e4f10 tx=0x7f5ee807a210 comp rx=0 tx=0).stop 2024-09-21T06:38:21.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.062+0000 7f5ef678e640 1 -- 172.21.15.63:0/714989063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ef0108d10 msgr2=0x7f5ef0104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:21.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.062+0000 7f5ef678e640 1 --2- 172.21.15.63:0/714989063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ef0108d10 0x7f5ef0104cf0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f5ee800cad0 tx=0x7f5ee800cf90 comp rx=0 tx=0).stop 2024-09-21T06:38:21.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.062+0000 7f5ef678e640 1 -- 172.21.15.63:0/714989063 shutdown_connections 2024-09-21T06:38:21.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.062+0000 7f5ef678e640 1 --2- 172.21.15.63:0/714989063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ef0108d10 0x7f5ef0104cf0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.062+0000 7f5ef678e640 1 --2- 172.21.15.63:0/714989063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ef01083c0 0x7f5ef01047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.062+0000 7f5ef678e640 1 --2- 172.21.15.63:0/714989063 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f5ed80b6700 0x7f5ed80b8c10 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.062+0000 7f5ef678e640 1 --2- 172.21.15.63:0/714989063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef0102a80 0x7f5ef0104270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:21.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.062+0000 7f5ef678e640 1 -- 172.21.15.63:0/714989063 >> 172.21.15.63:0/714989063 conn(0x7f5ef0079740 msgr2=0x7f5ef0101b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:21.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.063+0000 7f5ef678e640 1 -- 172.21.15.63:0/714989063 shutdown_connections 2024-09-21T06:38:21.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:21.063+0000 7f5ef678e640 1 -- 172.21.15.63:0/714989063 wait complete. 2024-09-21T06:38:21.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:21 smithi063 ceph-mon[31150]: pgmap v635: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:38:21.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:21 smithi071 ceph-mon[34844]: pgmap v635: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:38:21.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:21 smithi175 ceph-mon[34510]: pgmap v635: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:38:22.853 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:38:22.854 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:38:23.040 DEBUG:teuthology.orchestra.run.smithi063:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T06:38:23.127 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:23.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.163+0000 7ffb1e769640 1 -- 172.21.15.63:0/3836546845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb181029b0 msgr2=0x7ffb18102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:23.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.163+0000 7ffb1e769640 1 --2- 172.21.15.63:0/3836546845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb181029b0 0x7ffb18102dc0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009900 tx=0x7ffb0802a410 comp rx=0 tx=0).stop 2024-09-21T06:38:23.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.163+0000 7ffb1e769640 1 -- 172.21.15.63:0/3836546845 shutdown_connections 2024-09-21T06:38:23.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.163+0000 7ffb1e769640 1 --2- 172.21.15.63:0/3836546845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb18108c30 0x7ffb1810f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.163+0000 7ffb1e769640 1 --2- 172.21.15.63:0/3836546845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb181082e0 0x7ffb181086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.163+0000 7ffb1e769640 1 --2- 172.21.15.63:0/3836546845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb181029b0 0x7ffb18102dc0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.163+0000 7ffb1e769640 1 -- 172.21.15.63:0/3836546845 >> 172.21.15.63:0/3836546845 conn(0x7ffb1807a740 msgr2=0x7ffb1807ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:23.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.163+0000 7ffb1e769640 1 -- 172.21.15.63:0/3836546845 shutdown_connections 2024-09-21T06:38:23.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.163+0000 7ffb1e769640 1 -- 172.21.15.63:0/3836546845 wait complete. 2024-09-21T06:38:23.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.164+0000 7ffb1e769640 1 Processor -- start 2024-09-21T06:38:23.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.164+0000 7ffb1e769640 1 -- start start 2024-09-21T06:38:23.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.165+0000 7ffb1e769640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb181029b0 0x7ffb18199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.165+0000 7ffb1e769640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb181082e0 0x7ffb181998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.165+0000 7ffb1e769640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb18108c30 0x7ffb1819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.165+0000 7ffb1e769640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ffb181128f0 con 0x7ffb181082e0 2024-09-21T06:38:23.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.165+0000 7ffb1e769640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffb18112770 con 0x7ffb18108c30 2024-09-21T06:38:23.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.165+0000 7ffb1e769640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb18112a70 con 0x7ffb181029b0 2024-09-21T06:38:23.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.165+0000 7ffb177fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb181082e0 0x7ffb181998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.165+0000 7ffb177fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb181082e0 0x7ffb181998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54552/0 (socket says 172.21.15.63:54552) 2024-09-21T06:38:23.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.165+0000 7ffb177fe640 1 -- 172.21.15.63:0/3957550473 learned_addr learned my addr 172.21.15.63:0/3957550473 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:23.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.165+0000 7ffb1cd06640 1 --2- 172.21.15.63:0/3957550473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb18108c30 0x7ffb1819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.165+0000 7ffb177fe640 1 -- 172.21.15.63:0/3957550473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb181029b0 msgr2=0x7ffb18199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:23.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.165+0000 7ffb17fff640 1 --2- 172.21.15.63:0/3957550473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb181029b0 0x7ffb18199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.165+0000 7ffb177fe640 1 --2- 172.21.15.63:0/3957550473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb181029b0 0x7ffb18199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.165+0000 7ffb177fe640 1 -- 172.21.15.63:0/3957550473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb18108c30 msgr2=0x7ffb1819eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:23.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.165+0000 7ffb177fe640 1 --2- 172.21.15.63:0/3957550473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb18108c30 0x7ffb1819eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.165+0000 7ffb177fe640 1 -- 172.21.15.63:0/3957550473 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1819f260 con 0x7ffb181082e0 2024-09-21T06:38:23.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.165+0000 7ffb17fff640 1 --2- 172.21.15.63:0/3957550473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb181029b0 0x7ffb18199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:23.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.165+0000 7ffb177fe640 1 --2- 172.21.15.63:0/3957550473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb181082e0 0x7ffb181998d0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00d950 tx=0x7ffb0c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:23.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.166+0000 7ffb157fa640 1 -- 172.21.15.63:0/3957550473 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c017070 con 0x7ffb181082e0 2024-09-21T06:38:23.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.166+0000 7ffb1e769640 1 -- 172.21.15.63:0/3957550473 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb1819f550 con 0x7ffb181082e0 2024-09-21T06:38:23.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.166+0000 7ffb157fa640 1 -- 172.21.15.63:0/3957550473 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb0c009c30 con 0x7ffb181082e0 2024-09-21T06:38:23.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.166+0000 7ffb157fa640 1 -- 172.21.15.63:0/3957550473 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c0047a0 con 0x7ffb181082e0 2024-09-21T06:38:23.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.166+0000 7ffb1e769640 1 -- 172.21.15.63:0/3957550473 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb181a5ce0 con 0x7ffb181082e0 2024-09-21T06:38:23.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.167+0000 7ffb1e769640 1 -- 172.21.15.63:0/3957550473 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb18102dc0 con 0x7ffb181082e0 2024-09-21T06:38:23.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.168+0000 7ffb157fa640 1 -- 172.21.15.63:0/3957550473 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7ffb0c004020 con 0x7ffb181082e0 2024-09-21T06:38:23.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.169+0000 7ffb157fa640 1 --2- 172.21.15.63:0/3957550473 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffb000b6680 0x7ffb000b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.169+0000 7ffb17fff640 1 --2- 172.21.15.63:0/3957550473 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffb000b6680 0x7ffb000b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.169+0000 7ffb157fa640 1 -- 172.21.15.63:0/3957550473 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7ffb0c0e78f0 con 0x7ffb181082e0 2024-09-21T06:38:23.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.170+0000 7ffb17fff640 1 --2- 172.21.15.63:0/3957550473 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffb000b6680 0x7ffb000b8b90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ffb080096c0 tx=0x7ffb08031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:23.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.172+0000 7ffb157fa640 1 -- 172.21.15.63:0/3957550473 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffb0c020020 con 0x7ffb181082e0 2024-09-21T06:38:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.385+0000 7ffb1e769640 1 -- 172.21.15.63:0/3957550473 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7ffb18063800 con 0x7ffb000b6680 2024-09-21T06:38:23.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.394+0000 7ffb157fa640 1 -- 172.21.15.63:0/3957550473 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7ffb18063800 con 0x7ffb000b6680 2024-09-21T06:38:23.396 INFO:teuthology.orchestra.run.smithi063.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T06:28:21", "first": "2024-09-21T06:29:00", "last": "2024-09-21T06:38:00", "last_pruned": "2024-09-21T06:38:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-21T06:38:23.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.397+0000 7ffb1e769640 1 -- 172.21.15.63:0/3957550473 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffb000b6680 msgr2=0x7ffb000b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:23.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.397+0000 7ffb1e769640 1 --2- 172.21.15.63:0/3957550473 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffb000b6680 0x7ffb000b8b90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ffb080096c0 tx=0x7ffb08031400 comp rx=0 tx=0).stop 2024-09-21T06:38:23.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.397+0000 7ffb1e769640 1 -- 172.21.15.63:0/3957550473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb181082e0 msgr2=0x7ffb181998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:23.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.397+0000 7ffb1e769640 1 --2- 172.21.15.63:0/3957550473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb181082e0 0x7ffb181998d0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00d950 tx=0x7ffb0c00de10 comp rx=0 tx=0).stop 2024-09-21T06:38:23.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.397+0000 7ffb1e769640 1 -- 172.21.15.63:0/3957550473 shutdown_connections 2024-09-21T06:38:23.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.397+0000 7ffb1e769640 1 --2- 172.21.15.63:0/3957550473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb18108c30 0x7ffb1819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.397+0000 7ffb1e769640 1 --2- 172.21.15.63:0/3957550473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb181082e0 0x7ffb181998d0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.397+0000 7ffb1e769640 1 --2- 172.21.15.63:0/3957550473 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffb000b6680 0x7ffb000b8b90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.397+0000 7ffb1e769640 1 --2- 172.21.15.63:0/3957550473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb181029b0 0x7ffb18199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.397+0000 7ffb1e769640 1 -- 172.21.15.63:0/3957550473 >> 172.21.15.63:0/3957550473 conn(0x7ffb1807a740 msgr2=0x7ffb181063d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.397+0000 7ffb1e769640 1 -- 172.21.15.63:0/3957550473 shutdown_connections 2024-09-21T06:38:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.397+0000 7ffb1e769640 1 -- 172.21.15.63:0/3957550473 wait complete. 2024-09-21T06:38:23.409 DEBUG:teuthology.orchestra.run.smithi063:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T06:38:23.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:23 smithi071 ceph-mon[34844]: pgmap v636: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:38:23.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.524+0000 7fc3813da640 1 -- 172.21.15.63:0/1762161444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc37c10dde0 msgr2=0x7fc37c1102c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:23.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.524+0000 7fc3813da640 1 --2- 172.21.15.63:0/1762161444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc37c10dde0 0x7fc37c1102c0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fc374009900 tx=0x7fc37402a410 comp rx=0 tx=0).stop 2024-09-21T06:38:23.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.524+0000 7fc3813da640 1 -- 172.21.15.63:0/1762161444 shutdown_connections 2024-09-21T06:38:23.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.524+0000 7fc3813da640 1 --2- 172.21.15.63:0/1762161444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc37c10dde0 0x7fc37c1102c0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.524+0000 7fc3813da640 1 --2- 172.21.15.63:0/1762161444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc37c105310 0x7fc37c10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.524+0000 7fc3813da640 1 --2- 172.21.15.63:0/1762161444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc37c1049c0 0x7fc37c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.524+0000 7fc3813da640 1 -- 172.21.15.63:0/1762161444 >> 172.21.15.63:0/1762161444 conn(0x7fc37c0fe410 msgr2=0x7fc37c100860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:23.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.524+0000 7fc3813da640 1 -- 172.21.15.63:0/1762161444 shutdown_connections 2024-09-21T06:38:23.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.524+0000 7fc3813da640 1 -- 172.21.15.63:0/1762161444 wait complete. 2024-09-21T06:38:23.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.524+0000 7fc3813da640 1 Processor -- start 2024-09-21T06:38:23.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.525+0000 7fc3813da640 1 -- start start 2024-09-21T06:38:23.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.525+0000 7fc3813da640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc37c1049c0 0x7fc37c19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.525+0000 7fc3813da640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc37c105310 0x7fc37c19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.525+0000 7fc3813da640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc37c10dde0 0x7fc37c19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.525+0000 7fc3813da640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc37c113a30 con 0x7fc37c10dde0 2024-09-21T06:38:23.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.525+0000 7fc3813da640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc37c1138b0 con 0x7fc37c1049c0 2024-09-21T06:38:23.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.525+0000 7fc3813da640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc37c113bb0 con 0x7fc37c105310 2024-09-21T06:38:23.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.525+0000 7fc37b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc37c10dde0 0x7fc37c19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.525+0000 7fc37b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc37c10dde0 0x7fc37c19fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54582/0 (socket says 172.21.15.63:54582) 2024-09-21T06:38:23.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.525+0000 7fc37b7fe640 1 -- 172.21.15.63:0/160654310 learned_addr learned my addr 172.21.15.63:0/160654310 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:23.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.525+0000 7fc37affd640 1 --2- 172.21.15.63:0/160654310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc37c1049c0 0x7fc37c19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.525+0000 7fc37a7fc640 1 --2- 172.21.15.63:0/160654310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc37c105310 0x7fc37c19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.525+0000 7fc37b7fe640 1 -- 172.21.15.63:0/160654310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc37c105310 msgr2=0x7fc37c19a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:23.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.525+0000 7fc37b7fe640 1 --2- 172.21.15.63:0/160654310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc37c105310 0x7fc37c19a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.525+0000 7fc37b7fe640 1 -- 172.21.15.63:0/160654310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc37c1049c0 msgr2=0x7fc37c19a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:23.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.525+0000 7fc37b7fe640 1 --2- 172.21.15.63:0/160654310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc37c1049c0 0x7fc37c19a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.525+0000 7fc37b7fe640 1 -- 172.21.15.63:0/160654310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37c1a0320 con 0x7fc37c10dde0 2024-09-21T06:38:23.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.525+0000 7fc37a7fc640 1 --2- 172.21.15.63:0/160654310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc37c105310 0x7fc37c19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:23.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.525+0000 7fc37affd640 1 --2- 172.21.15.63:0/160654310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc37c1049c0 0x7fc37c19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:38:23.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.526+0000 7fc37b7fe640 1 --2- 172.21.15.63:0/160654310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc37c10dde0 0x7fc37c19fc20 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fc374004770 tx=0x7fc374004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:23.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.526+0000 7fc373fff640 1 -- 172.21.15.63:0/160654310 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37403f030 con 0x7fc37c10dde0 2024-09-21T06:38:23.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.526+0000 7fc3813da640 1 -- 172.21.15.63:0/160654310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc37c1a05b0 con 0x7fc37c10dde0 2024-09-21T06:38:23.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.526+0000 7fc373fff640 1 -- 172.21.15.63:0/160654310 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc374003aa0 con 0x7fc37c10dde0 2024-09-21T06:38:23.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.526+0000 7fc373fff640 1 -- 172.21.15.63:0/160654310 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc374035070 con 0x7fc37c10dde0 2024-09-21T06:38:23.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.526+0000 7fc3813da640 1 -- 172.21.15.63:0/160654310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc37c1a6da0 con 0x7fc37c10dde0 2024-09-21T06:38:23.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.527+0000 7fc3813da640 1 -- 172.21.15.63:0/160654310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc37c104dd0 con 0x7fc37c10dde0 2024-09-21T06:38:23.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.530+0000 7fc373fff640 1 -- 172.21.15.63:0/160654310 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fc374042030 con 0x7fc37c10dde0 2024-09-21T06:38:23.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.530+0000 7fc373fff640 1 --2- 172.21.15.63:0/160654310 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc3680b6680 0x7fc3680b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.530+0000 7fc37affd640 1 --2- 172.21.15.63:0/160654310 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc3680b6680 0x7fc3680b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.530+0000 7fc373fff640 1 -- 172.21.15.63:0/160654310 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7fc3741080d0 con 0x7fc37c10dde0 2024-09-21T06:38:23.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.531+0000 7fc37affd640 1 --2- 172.21.15.63:0/160654310 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc3680b6680 0x7fc3680b8b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc36c005fd0 tx=0x7fc36c009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:23.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.533+0000 7fc373fff640 1 -- 172.21.15.63:0/160654310 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc3740ce5d0 con 0x7fc37c10dde0 2024-09-21T06:38:23.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:23 smithi063 ceph-mon[31150]: pgmap v636: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:38:23.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:23 smithi175 ceph-mon[34510]: pgmap v636: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:38:23.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.749+0000 7fc3813da640 1 -- 172.21.15.63:0/160654310 --> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fc37c1015a0 con 0x7fc3680b6680 2024-09-21T06:38:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.737+0000 7f0aa11e0640 1 -- 172.21.15.63:0/2244129895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a9c102a60 msgr2=0x7f0a9c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.737+0000 7f0aa11e0640 1 --2- 172.21.15.63:0/2244129895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a9c102a60 0x7f0a9c102e70 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009900 tx=0x7f0a8c02a3f0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.737+0000 7f0aa11e0640 1 -- 172.21.15.63:0/2244129895 shutdown_connections 2024-09-21T06:38:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.737+0000 7f0aa11e0640 1 --2- 172.21.15.63:0/2244129895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a9c108cf0 0x7f0a9c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.737+0000 7f0aa11e0640 1 --2- 172.21.15.63:0/2244129895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a9c1083a0 0x7f0a9c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.737+0000 7f0aa11e0640 1 --2- 172.21.15.63:0/2244129895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a9c102a60 0x7f0a9c102e70 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.737+0000 7f0aa11e0640 1 -- 172.21.15.63:0/2244129895 >> 172.21.15.63:0/2244129895 conn(0x7f0a9c079730 msgr2=0x7f0a9c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.737+0000 7f0aa11e0640 1 -- 172.21.15.63:0/2244129895 shutdown_connections 2024-09-21T06:38:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.737+0000 7f0aa11e0640 1 -- 172.21.15.63:0/2244129895 wait complete. 2024-09-21T06:38:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.738+0000 7f0aa11e0640 1 Processor -- start 2024-09-21T06:38:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.738+0000 7f0aa11e0640 1 -- start start 2024-09-21T06:38:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.738+0000 7f0aa11e0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a9c102a60 0x7f0a9c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.738+0000 7f0aa11e0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a9c1083a0 0x7f0a9c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.738+0000 7f0aa11e0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a9c108cf0 0x7f0a9c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.738+0000 7f0aa11e0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c112960 con 0x7f0a9c108cf0 2024-09-21T06:38:23.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.738+0000 7f0aa11e0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c1127e0 con 0x7f0a9c1083a0 2024-09-21T06:38:23.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.738+0000 7f0aa11e0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c112ae0 con 0x7f0a9c102a60 2024-09-21T06:38:23.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.738+0000 7f0a9b59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a9c108cf0 0x7f0a9c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.738+0000 7f0a9b59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a9c108cf0 0x7f0a9c19fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54606/0 (socket says 172.21.15.63:54606) 2024-09-21T06:38:23.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.738+0000 7f0a9b59e640 1 -- 172.21.15.63:0/3919907459 learned_addr learned my addr 172.21.15.63:0/3919907459 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:23.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.739+0000 7f0a9ad9d640 1 --2- 172.21.15.63:0/3919907459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a9c102a60 0x7f0a9c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.739+0000 7f0a9a59c640 1 --2- 172.21.15.63:0/3919907459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a9c1083a0 0x7f0a9c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.739+0000 7f0a9b59e640 1 -- 172.21.15.63:0/3919907459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a9c102a60 msgr2=0x7f0a9c19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:23.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.739+0000 7f0a9b59e640 1 --2- 172.21.15.63:0/3919907459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a9c102a60 0x7f0a9c19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.739+0000 7f0a9b59e640 1 -- 172.21.15.63:0/3919907459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a9c1083a0 msgr2=0x7f0a9c19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.739+0000 7f0a9b59e640 1 --2- 172.21.15.63:0/3919907459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a9c1083a0 0x7f0a9c19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.739+0000 7f0a9b59e640 1 -- 172.21.15.63:0/3919907459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9c1a0350 con 0x7f0a9c108cf0 2024-09-21T06:38:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.739+0000 7f0a9b59e640 1 --2- 172.21.15.63:0/3919907459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a9c108cf0 0x7f0a9c19fce0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400eaa0 tx=0x7f0a9400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.739+0000 7f0a83fff640 1 -- 172.21.15.63:0/3919907459 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94004d20 con 0x7f0a9c108cf0 2024-09-21T06:38:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.739+0000 7f0aa11e0640 1 -- 172.21.15.63:0/3919907459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a9c1a0640 con 0x7f0a9c108cf0 2024-09-21T06:38:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.739+0000 7f0a83fff640 1 -- 172.21.15.63:0/3919907459 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a94005020 con 0x7f0a9c108cf0 2024-09-21T06:38:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.739+0000 7f0a83fff640 1 -- 172.21.15.63:0/3919907459 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a940116b0 con 0x7f0a9c108cf0 2024-09-21T06:38:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.739+0000 7f0aa11e0640 1 -- 172.21.15.63:0/3919907459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a9c1a6e60 con 0x7f0a9c108cf0 2024-09-21T06:38:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.742+0000 7f0aa7754740 1 Processor -- start 2024-09-21T06:38:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.742+0000 7f0a83fff640 1 -- 172.21.15.63:0/3919907459 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f0a940051d0 con 0x7f0a9c108cf0 2024-09-21T06:38:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.742+0000 7f0aa7754740 1 -- start start 2024-09-21T06:38:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.743+0000 7f0aa7754740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d991b92350 0x55d991f39430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.743+0000 7f0aa7754740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d991b69490 0x55d991f39970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.743+0000 7f0aa7754740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b71670 0x55d991f39eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.743+0000 7f0aa7754740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d991eafe60 con 0x55d991b71670 2024-09-21T06:38:23.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.743+0000 7f0aa7754740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d991e9f290 con 0x55d991b69490 2024-09-21T06:38:23.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.743+0000 7f0aa7754740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d991ea30a0 con 0x55d991b92350 2024-09-21T06:38:23.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.743+0000 7f0a9a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b71670 0x55d991f39eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.743+0000 7f0a9a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b71670 0x55d991f39eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54612/0 (socket says 172.21.15.63:54612) 2024-09-21T06:38:23.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.743+0000 7f0a9a59c640 1 -- 172.21.15.63:0/469350241 learned_addr learned my addr 172.21.15.63:0/469350241 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:23.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.743+0000 7f0a9ad9d640 1 --2- 172.21.15.63:0/469350241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d991b69490 0x55d991f39970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.743+0000 7f0a83fff640 1 --2- 172.21.15.63:0/3919907459 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0a840b66b0 0x7f0a840b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.743+0000 7f0a9a59c640 1 -- 172.21.15.63:0/469350241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d991b92350 msgr2=0x55d991f39430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:23.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.743+0000 7f0a9a59c640 1 --2- 172.21.15.63:0/469350241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d991b92350 0x55d991f39430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.743+0000 7f0a9a59c640 1 -- 172.21.15.63:0/469350241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d991b69490 msgr2=0x55d991f39970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:23.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.743+0000 7f0a9a59c640 1 --2- 172.21.15.63:0/469350241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d991b69490 0x55d991f39970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.743+0000 7f0a9a59c640 1 -- 172.21.15.63:0/469350241 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d991bfd930 con 0x55d991b71670 2024-09-21T06:38:23.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.743+0000 7f0a9b59e640 1 --2- 172.21.15.63:0/3919907459 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0a840b66b0 0x7f0a840b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.744+0000 7f0a9a59c640 1 --2- 172.21.15.63:0/469350241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b71670 0x55d991f39eb0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000ada0 tx=0x7f0a9000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980c3d6936f92481 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:23.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.744+0000 7f0a83fff640 1 -- 172.21.15.63:0/3919907459 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f0a940e7830 con 0x7f0a9c108cf0 2024-09-21T06:38:23.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.744+0000 7f0a817fa640 1 -- 172.21.15.63:0/469350241 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9001d070 con 0x55d991b71670 2024-09-21T06:38:23.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.744+0000 7f0a817fa640 1 -- 172.21.15.63:0/469350241 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a9000ae90 con 0x55d991b71670 2024-09-21T06:38:23.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.744+0000 7f0a817fa640 1 -- 172.21.15.63:0/469350241 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90018bc0 con 0x55d991b71670 2024-09-21T06:38:23.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.745+0000 7f0aa7754740 1 -- 172.21.15.63:0/469350241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b71670 msgr2=0x55d991f39eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:23.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.745+0000 7f0a9b59e640 1 --2- 172.21.15.63:0/3919907459 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0a840b66b0 0x7f0a840b8bc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0a940a9c00 tx=0x7f0a9407a2e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:23.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.745+0000 7f0aa7754740 1 --2- 172.21.15.63:0/469350241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b71670 0x55d991f39eb0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000ada0 tx=0x7f0a9000f790 comp rx=0 tx=0).stop 2024-09-21T06:38:23.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.745+0000 7f0aa7754740 1 -- 172.21.15.63:0/469350241 shutdown_connections 2024-09-21T06:38:23.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.745+0000 7f0aa7754740 1 --2- 172.21.15.63:0/469350241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b71670 0x55d991f39eb0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.745+0000 7f0aa7754740 1 --2- 172.21.15.63:0/469350241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d991b69490 0x55d991f39970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.745+0000 7f0aa7754740 1 --2- 172.21.15.63:0/469350241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d991b92350 0x55d991f39430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.745+0000 7f0aa7754740 1 -- 172.21.15.63:0/469350241 >> 172.21.15.63:0/469350241 conn(0x55d991b86740 msgr2=0x55d991f37320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:23.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.745+0000 7f0aa7754740 1 -- 172.21.15.63:0/469350241 shutdown_connections 2024-09-21T06:38:23.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.745+0000 7f0aa7754740 1 -- 172.21.15.63:0/469350241 wait complete. 2024-09-21T06:38:23.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.745+0000 7f0aa7754740 1 -- start start 2024-09-21T06:38:23.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.745+0000 7f0aa7754740 1 Processor -- start 2024-09-21T06:38:23.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.746+0000 7f0aa7754740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b69490 0x55d991f49420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.746+0000 7f0aa7754740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d991b71670 0x55d991f49980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.746+0000 7f0aa7754740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d991b92350 0x55d991f55270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.746+0000 7f0aa7754740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d991d00890 con 0x55d991b69490 2024-09-21T06:38:23.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.746+0000 7f0aa7754740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d991e39d40 con 0x55d991b92350 2024-09-21T06:38:23.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.746+0000 7f0aa7754740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d991f4bf40 con 0x55d991b71670 2024-09-21T06:38:23.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.746+0000 7f0aa7754740 10 client.0 _ll_register_callbacks cb 0x55d991e9dc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:23.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.746+0000 7f0a9a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b69490 0x55d991f49420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.746+0000 7f0a9a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b69490 0x55d991f49420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54628/0 (socket says 172.21.15.63:54628) 2024-09-21T06:38:23.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.746+0000 7f0a9a59c640 1 -- 172.21.15.63:0/3306028668 learned_addr learned my addr 172.21.15.63:0/3306028668 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:23.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.746+0000 7f0a9ad9d640 1 --2- 172.21.15.63:0/3306028668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d991b71670 0x55d991f49980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.746+0000 7f0a9a59c640 1 -- 172.21.15.63:0/3306028668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d991b71670 msgr2=0x55d991f49980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:23.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.746+0000 7f0a9a59c640 1 --2- 172.21.15.63:0/3306028668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d991b71670 0x55d991f49980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.746+0000 7f0a9a59c640 1 -- 172.21.15.63:0/3306028668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d991b92350 msgr2=0x55d991f55270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:23.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.746+0000 7f0a9a59c640 1 --2- 172.21.15.63:0/3306028668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d991b92350 0x55d991f55270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.746+0000 7f0a9a59c640 1 -- 172.21.15.63:0/3306028668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d991f55860 con 0x55d991b69490 2024-09-21T06:38:23.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.746+0000 7f0a9ad9d640 1 --2- 172.21.15.63:0/3306028668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d991b71670 0x55d991f49980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:23.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.746+0000 7f0a9a59c640 1 --2- 172.21.15.63:0/3306028668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b69490 0x55d991f49420 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000a6b0 tx=0x7f0a90018670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8207122c345a15a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:23.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.746+0000 7f0a7eff5640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:38:23.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.747+0000 7f0a7eff5640 1 -- 172.21.15.63:0/3306028668 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90028060 con 0x55d991b69490 2024-09-21T06:38:23.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.747+0000 7f0a7eff5640 1 -- 172.21.15.63:0/3306028668 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f0a90018cc0 con 0x55d991b69490 2024-09-21T06:38:23.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.747+0000 7f0aa7754740 1 -- 172.21.15.63:0/3306028668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a9000ae90 con 0x55d991b69490 2024-09-21T06:38:23.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.747+0000 7f0a7eff5640 1 -- 172.21.15.63:0/3306028668 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f0a9001d040 con 0x55d991b69490 2024-09-21T06:38:23.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.747+0000 7f0aa7754740 10 client.17610 fetch_fsmap learned FSMap version 61 2024-09-21T06:38:23.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.747+0000 7f0aa7754740 1 -- 172.21.15.63:0/3306028668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55d991f58190 con 0x55d991b69490 2024-09-21T06:38:23.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.747+0000 7f0a7eff5640 1 -- 172.21.15.63:0/3306028668 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a9000ae90 con 0x55d991b69490 2024-09-21T06:38:23.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.747+0000 7f0a7eff5640 1 -- 172.21.15.63:0/3306028668 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f0a90010640 con 0x55d991b69490 2024-09-21T06:38:23.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.747+0000 7f0aa7754740 10 client.17610 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:38:23.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.747+0000 7f0aa7754740 10 client.17610 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:38:23.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.747+0000 7f0aa7754740 20 client.17610 populate_metadata read hostname 'smithi063' 2024-09-21T06:38:23.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.747+0000 7f0aa7754740 1 --2- 172.21.15.63:0/3306028668 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d991b50cd0 0x55d991f5b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.747+0000 7f0aa7754740 4 client.17610 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:23.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.747+0000 7f0aa7754740 1 -- 172.21.15.63:0/3306028668 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d991eb1db0 con 0x55d991b50cd0 2024-09-21T06:38:23.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.756+0000 7fc373fff640 1 -- 172.21.15.63:0/160654310 <== mgr.14223 v2:172.21.15.63:6800/651259686 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fc37c1015a0 con 0x7fc3680b6680 2024-09-21T06:38:23.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.748+0000 7f0a9ad9d640 1 --2- 172.21.15.63:0/3306028668 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d991b50cd0 0x55d991f5b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.748+0000 7f0a7eff5640 10 client.17610 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:38:23.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.748+0000 7f0a9ad9d640 1 --2- 172.21.15.63:0/3306028668 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d991b50cd0 0x55d991f5b550 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9355d0470064ec32 server_cookie=ab6971af81aa683f in_seq=0 out_seq=0 2024-09-21T06:38:23.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.749+0000 7f0a7eff5640 1 -- 172.21.15.63:0/3306028668 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d991eb1db0 con 0x55d991b50cd0 2024-09-21T06:38:23.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.749+0000 7f0a7eff5640 10 client.17610 handle_command_reply: tid=0 2024-09-21T06:38:23.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.749+0000 7f0aa7754740 1 client.17610 shutdown 2024-09-21T06:38:23.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.749+0000 7f0aa7754740 1 -- 172.21.15.63:0/3306028668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b69490 msgr2=0x55d991f49420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:23.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.749+0000 7f0aa7754740 1 --2- 172.21.15.63:0/3306028668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b69490 0x55d991f49420 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000a6b0 tx=0x7f0a90018670 comp rx=0 tx=0).stop 2024-09-21T06:38:23.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.749+0000 7f0aa7754740 1 -- 172.21.15.63:0/3306028668 shutdown_connections 2024-09-21T06:38:23.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.749+0000 7f0aa7754740 1 --2- 172.21.15.63:0/3306028668 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d991b50cd0 0x55d991f5b550 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.749+0000 7f0aa7754740 1 --2- 172.21.15.63:0/3306028668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d991b92350 0x55d991f55270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.749+0000 7f0aa7754740 1 --2- 172.21.15.63:0/3306028668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d991b71670 0x55d991f49980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.749+0000 7f0aa7754740 1 --2- 172.21.15.63:0/3306028668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b69490 0x55d991f49420 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.749+0000 7f0aa7754740 1 -- 172.21.15.63:0/3306028668 >> 172.21.15.63:0/3306028668 conn(0x55d991b86740 msgr2=0x55d991f3c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:23.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.749+0000 7f0a7eff5640 0 client.17610 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:38:23.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.749+0000 7f0aa7754740 1 -- 172.21.15.63:0/3306028668 shutdown_connections 2024-09-21T06:38:23.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.749+0000 7f0aa7754740 1 -- 172.21.15.63:0/3306028668 wait complete. 2024-09-21T06:38:23.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.749+0000 7f0aa7754740 20 client.17610 trim_cache size 0 max 16384 2024-09-21T06:38:23.769 INFO:teuthology.orchestra.run.smithi063.stdout:/ 1m 6m3h 2024-09-21T06:38:23.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.760+0000 7fc3813da640 1 -- 172.21.15.63:0/160654310 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc3680b6680 msgr2=0x7fc3680b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:23.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.760+0000 7fc3813da640 1 --2- 172.21.15.63:0/160654310 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc3680b6680 0x7fc3680b8b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc36c005fd0 tx=0x7fc36c009500 comp rx=0 tx=0).stop 2024-09-21T06:38:23.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.760+0000 7fc3813da640 1 -- 172.21.15.63:0/160654310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc37c10dde0 msgr2=0x7fc37c19fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:23.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.760+0000 7fc3813da640 1 --2- 172.21.15.63:0/160654310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc37c10dde0 0x7fc37c19fc20 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fc374004770 tx=0x7fc374004270 comp rx=0 tx=0).stop 2024-09-21T06:38:23.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.760+0000 7fc3813da640 1 -- 172.21.15.63:0/160654310 shutdown_connections 2024-09-21T06:38:23.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.760+0000 7fc3813da640 1 --2- 172.21.15.63:0/160654310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc37c10dde0 0x7fc37c19fc20 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.760+0000 7fc3813da640 1 --2- 172.21.15.63:0/160654310 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc3680b6680 0x7fc3680b8b90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.760+0000 7fc3813da640 1 --2- 172.21.15.63:0/160654310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc37c105310 0x7fc37c19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.760+0000 7fc3813da640 1 --2- 172.21.15.63:0/160654310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc37c1049c0 0x7fc37c19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.760+0000 7fc3813da640 1 -- 172.21.15.63:0/160654310 >> 172.21.15.63:0/160654310 conn(0x7fc37c0fe410 msgr2=0x7fc37c100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:23.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.760+0000 7fc3813da640 1 -- 172.21.15.63:0/160654310 shutdown_connections 2024-09-21T06:38:23.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.760+0000 7fc3813da640 1 -- 172.21.15.63:0/160654310 wait complete. 2024-09-21T06:38:23.777 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-21T06:38:23.787 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-21T06:38:23.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.776+0000 7f0aa7754740 1 Processor -- start 2024-09-21T06:38:23.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.776+0000 7f0aa7754740 1 -- start start 2024-09-21T06:38:23.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.776+0000 7f0aa7754740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d991b69490 0x55d991f3e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.776+0000 7f0aa7754740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b71670 0x55d991f3ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.776+0000 7f0aa7754740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d991b92350 0x55d991f46410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.776+0000 7f0aa7754740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c1ad5b0 con 0x55d991b71670 2024-09-21T06:38:23.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.776+0000 7f0aa7754740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c1af0f0 con 0x55d991b92350 2024-09-21T06:38:23.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.776+0000 7f0aa7754740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c1adc80 con 0x55d991b69490 2024-09-21T06:38:23.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.777+0000 7f0a9ad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b71670 0x55d991f3ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.777+0000 7f0a9ad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b71670 0x55d991f3ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54636/0 (socket says 172.21.15.63:54636) 2024-09-21T06:38:23.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.777+0000 7f0a9ad9d640 1 -- 172.21.15.63:0/3346848967 learned_addr learned my addr 172.21.15.63:0/3346848967 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:23.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.777+0000 7f0a9a59c640 1 --2- 172.21.15.63:0/3346848967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d991b69490 0x55d991f3e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.777+0000 7f0a9a59c640 1 --2- 172.21.15.63:0/3346848967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d991b92350 0x55d991f46410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.777+0000 7f0a9ad9d640 1 -- 172.21.15.63:0/3346848967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d991b69490 msgr2=0x55d991f3e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:23.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.777+0000 7f0a9ad9d640 1 --2- 172.21.15.63:0/3346848967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d991b69490 0x55d991f3e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.777+0000 7f0a9ad9d640 1 -- 172.21.15.63:0/3346848967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d991b92350 msgr2=0x55d991f46410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:23.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.777+0000 7f0a9ad9d640 1 --2- 172.21.15.63:0/3346848967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d991b92350 0x55d991f46410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.777+0000 7f0a9ad9d640 1 -- 172.21.15.63:0/3346848967 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d991f37860 con 0x55d991b71670 2024-09-21T06:38:23.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.777+0000 7f0a9a59c640 1 --2- 172.21.15.63:0/3346848967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d991b92350 0x55d991f46410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:23.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.777+0000 7f0a9ad9d640 1 --2- 172.21.15.63:0/3346848967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b71670 0x55d991f3ec60 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c02a910 tx=0x7f0a8c032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31211363a07c3af4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:23.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.777+0000 7f0a80ff9640 1 -- 172.21.15.63:0/3346848967 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c035040 con 0x55d991b71670 2024-09-21T06:38:23.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.777+0000 7f0a80ff9640 1 -- 172.21.15.63:0/3346848967 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a8c049070 con 0x55d991b71670 2024-09-21T06:38:23.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.777+0000 7f0a80ff9640 1 -- 172.21.15.63:0/3346848967 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c004990 con 0x55d991b71670 2024-09-21T06:38:23.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.778+0000 7f0aa7754740 1 -- 172.21.15.63:0/3346848967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b71670 msgr2=0x55d991f3ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:23.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.778+0000 7f0aa7754740 1 --2- 172.21.15.63:0/3346848967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b71670 0x55d991f3ec60 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c02a910 tx=0x7f0a8c032bd0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.778+0000 7f0aa7754740 1 -- 172.21.15.63:0/3346848967 shutdown_connections 2024-09-21T06:38:23.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.778+0000 7f0aa7754740 1 --2- 172.21.15.63:0/3346848967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d991b92350 0x55d991f46410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.778+0000 7f0aa7754740 1 --2- 172.21.15.63:0/3346848967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b71670 0x55d991f3ec60 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.778+0000 7f0aa7754740 1 --2- 172.21.15.63:0/3346848967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d991b69490 0x55d991f3e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.778+0000 7f0aa7754740 1 -- 172.21.15.63:0/3346848967 >> 172.21.15.63:0/3346848967 conn(0x55d991b86740 msgr2=0x55d991f47aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:23.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.778+0000 7f0aa7754740 1 -- 172.21.15.63:0/3346848967 shutdown_connections 2024-09-21T06:38:23.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.778+0000 7f0aa7754740 1 -- 172.21.15.63:0/3346848967 wait complete. 2024-09-21T06:38:23.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.779+0000 7f0aa7754740 1 -- start start 2024-09-21T06:38:23.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.779+0000 7f0aa7754740 1 Processor -- start 2024-09-21T06:38:23.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.779+0000 7f0aa7754740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d991b69490 0x55d991f5eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.779+0000 7f0aa7754740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d991b71670 0x55d991f5c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.779+0000 7f0aa7754740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b92350 0x55d991f5cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.779+0000 7f0aa7754740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c1aea20 con 0x55d991b92350 2024-09-21T06:38:23.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.779+0000 7f0aa7754740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c1ae350 con 0x55d991b69490 2024-09-21T06:38:23.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.779+0000 7f0aa7754740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c1ab5b0 con 0x55d991b71670 2024-09-21T06:38:23.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.779+0000 7f0aa7754740 10 client.0 _ll_register_callbacks cb 0x7f0a9001b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:23.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.779+0000 7f0a9a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b92350 0x55d991f5cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.779+0000 7f0a9a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b92350 0x55d991f5cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54644/0 (socket says 172.21.15.63:54644) 2024-09-21T06:38:23.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.779+0000 7f0a9a59c640 1 -- 172.21.15.63:0/2561633920 learned_addr learned my addr 172.21.15.63:0/2561633920 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:23.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.779+0000 7f0a9a59c640 1 --2- 172.21.15.63:0/2561633920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d991b69490 0x55d991f5eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.780+0000 7f0a9ad9d640 1 --2- 172.21.15.63:0/2561633920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d991b71670 0x55d991f5c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.780+0000 7f0a9a59c640 1 -- 172.21.15.63:0/2561633920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d991b71670 msgr2=0x55d991f5c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:23.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.780+0000 7f0a9a59c640 1 --2- 172.21.15.63:0/2561633920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d991b71670 0x55d991f5c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.780+0000 7f0a9a59c640 1 -- 172.21.15.63:0/2561633920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d991b69490 msgr2=0x55d991f5eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:23.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.780+0000 7f0a9a59c640 1 --2- 172.21.15.63:0/2561633920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d991b69490 0x55d991f5eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.780+0000 7f0a9a59c640 1 -- 172.21.15.63:0/2561633920 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d991fc4cd0 con 0x55d991b92350 2024-09-21T06:38:23.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.780+0000 7f0a9a59c640 1 --2- 172.21.15.63:0/2561633920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b92350 0x55d991f5cb00 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f0a90012000 tx=0x7f0a90018670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c071a95e4a89650f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.780+0000 7f0a7eff5640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:38:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.780+0000 7f0a7eff5640 1 -- 172.21.15.63:0/2561633920 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90028070 con 0x55d991b92350 2024-09-21T06:38:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.780+0000 7f0a7eff5640 1 -- 172.21.15.63:0/2561633920 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f0a900189a0 con 0x55d991b92350 2024-09-21T06:38:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.780+0000 7f0aa7754740 1 -- 172.21.15.63:0/2561633920 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a8c049070 con 0x55d991b92350 2024-09-21T06:38:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.780+0000 7f0a7eff5640 1 -- 172.21.15.63:0/2561633920 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f0a90004b60 con 0x55d991b92350 2024-09-21T06:38:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.780+0000 7f0aa7754740 10 client.17616 fetch_fsmap learned FSMap version 61 2024-09-21T06:38:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.780+0000 7f0aa7754740 1 -- 172.21.15.63:0/2561633920 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55d991fc5d50 con 0x55d991b92350 2024-09-21T06:38:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.781+0000 7f0a7eff5640 1 -- 172.21.15.63:0/2561633920 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a8c049070 con 0x55d991b92350 2024-09-21T06:38:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.781+0000 7f0a7eff5640 1 -- 172.21.15.63:0/2561633920 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f0a90005370 con 0x55d991b92350 2024-09-21T06:38:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.781+0000 7f0aa7754740 10 client.17616 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:38:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.781+0000 7f0aa7754740 10 client.17616 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:38:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.781+0000 7f0aa7754740 20 client.17616 populate_metadata read hostname 'smithi063' 2024-09-21T06:38:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.781+0000 7f0aa7754740 1 --2- 172.21.15.63:0/2561633920 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d991b26080 0x55d991fc8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.781+0000 7f0aa7754740 4 client.17616 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:38:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.781+0000 7f0aa7754740 1 -- 172.21.15.63:0/2561633920 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d991ead860 con 0x55d991b26080 2024-09-21T06:38:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.781+0000 7f0a9ad9d640 1 --2- 172.21.15.63:0/2561633920 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d991b26080 0x55d991fc8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.781+0000 7f0a7eff5640 10 client.17616 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:38:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.781+0000 7f0a9ad9d640 1 --2- 172.21.15.63:0/2561633920 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d991b26080 0x55d991fc8420 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1007c45d1bbaabfa server_cookie=bd9b88a265e37627 in_seq=0 out_seq=0 2024-09-21T06:38:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.783+0000 7f0a7eff5640 1 -- 172.21.15.63:0/2561633920 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d991ead860 con 0x55d991b26080 2024-09-21T06:38:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.783+0000 7f0a7eff5640 10 client.17616 handle_command_reply: tid=0 2024-09-21T06:38:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.783+0000 7f0aa7754740 1 client.17616 shutdown 2024-09-21T06:38:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.783+0000 7f0aa7754740 1 -- 172.21.15.63:0/2561633920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b92350 msgr2=0x55d991f5cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.783+0000 7f0aa7754740 1 --2- 172.21.15.63:0/2561633920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b92350 0x55d991f5cb00 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f0a90012000 tx=0x7f0a90018670 comp rx=0 tx=0).stop 2024-09-21T06:38:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.783+0000 7f0aa7754740 1 -- 172.21.15.63:0/2561633920 shutdown_connections 2024-09-21T06:38:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.783+0000 7f0aa7754740 1 --2- 172.21.15.63:0/2561633920 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55d991b26080 0x55d991fc8420 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.783+0000 7f0aa7754740 1 --2- 172.21.15.63:0/2561633920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d991b92350 0x55d991f5cb00 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.783+0000 7f0aa7754740 1 --2- 172.21.15.63:0/2561633920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d991b71670 0x55d991f5c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.783+0000 7f0aa7754740 1 --2- 172.21.15.63:0/2561633920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d991b69490 0x55d991f5eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.783+0000 7f0a7eff5640 0 client.17616 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:38:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.783+0000 7f0aa7754740 1 -- 172.21.15.63:0/2561633920 >> 172.21.15.63:0/2561633920 conn(0x55d991b86740 msgr2=0x55d991f476a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.784+0000 7f0aa7754740 1 -- 172.21.15.63:0/2561633920 shutdown_connections 2024-09-21T06:38:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.784+0000 7f0aa7754740 1 -- 172.21.15.63:0/2561633920 wait complete. 2024-09-21T06:38:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.784+0000 7f0aa7754740 20 client.17616 trim_cache size 0 max 16384 2024-09-21T06:38:23.799 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:38:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0, 2024-09-21T06:38:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_tag": "6f95aade-6765-45da-bb69-5ba4c2704d89", 2024-09-21T06:38:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": "asynchronous" 2024-09-21T06:38:23.800 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:38:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.784+0000 7f0aa11e0640 1 -- 172.21.15.63:0/3919907459 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0a840b66b0 msgr2=0x7f0a840b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.784+0000 7f0aa11e0640 1 --2- 172.21.15.63:0/3919907459 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0a840b66b0 0x7f0a840b8bc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0a940a9c00 tx=0x7f0a9407a2e0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.784+0000 7f0aa11e0640 1 -- 172.21.15.63:0/3919907459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a9c108cf0 msgr2=0x7f0a9c19fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.784+0000 7f0aa11e0640 1 --2- 172.21.15.63:0/3919907459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a9c108cf0 0x7f0a9c19fce0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400eaa0 tx=0x7f0a9400eea0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.784+0000 7f0aa11e0640 1 -- 172.21.15.63:0/3919907459 shutdown_connections 2024-09-21T06:38:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.784+0000 7f0aa11e0640 1 --2- 172.21.15.63:0/3919907459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a9c108cf0 0x7f0a9c19fce0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.784+0000 7f0aa11e0640 1 --2- 172.21.15.63:0/3919907459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a9c1083a0 0x7f0a9c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.784+0000 7f0aa11e0640 1 --2- 172.21.15.63:0/3919907459 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f0a840b66b0 0x7f0a840b8bc0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.784+0000 7f0aa11e0640 1 --2- 172.21.15.63:0/3919907459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a9c102a60 0x7f0a9c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.784+0000 7f0aa11e0640 1 -- 172.21.15.63:0/3919907459 >> 172.21.15.63:0/3919907459 conn(0x7f0a9c079730 msgr2=0x7f0a9c101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.785+0000 7f0aa11e0640 1 -- 172.21.15.63:0/3919907459 shutdown_connections 2024-09-21T06:38:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:23.785+0000 7f0aa11e0640 1 -- 172.21.15.63:0/3919907459 wait complete. 2024-09-21T06:38:24.465 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:24 smithi063 ceph-mon[31150]: from='client.17592 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:38:24.465 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:24 smithi063 ceph-mon[31150]: from='client.17598 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:38:24.465 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:24 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:38:24.465 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:24 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:24.498 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:38:24.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:24 smithi071 ceph-mon[34844]: from='client.17592 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:38:24.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:24 smithi071 ceph-mon[34844]: from='client.17598 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:38:24.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:24 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:38:24.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:24 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:24.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:24 smithi175 ceph-mon[34510]: from='client.17592 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:38:24.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:24 smithi175 ceph-mon[34510]: from='client.17598 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:38:24.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:24 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:38:24.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:24 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:24.804 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:25.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.287+0000 7f3014702640 1 -- 172.21.15.63:0/402534042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f300c102ae0 msgr2=0x7f300c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:25.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.287+0000 7f3014702640 1 --2- 172.21.15.63:0/402534042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f300c102ae0 0x7f300c102ef0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f3000009ca0 tx=0x7f300002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.287+0000 7f3014702640 1 -- 172.21.15.63:0/402534042 shutdown_connections 2024-09-21T06:38:25.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.287+0000 7f3014702640 1 --2- 172.21.15.63:0/402534042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f300c108d20 0x7f300c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.287+0000 7f3014702640 1 --2- 172.21.15.63:0/402534042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f300c1083d0 0x7f300c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.287+0000 7f3014702640 1 --2- 172.21.15.63:0/402534042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f300c102ae0 0x7f300c102ef0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.287+0000 7f3014702640 1 -- 172.21.15.63:0/402534042 >> 172.21.15.63:0/402534042 conn(0x7f300c079760 msgr2=0x7f300c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:25.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.287+0000 7f3014702640 1 -- 172.21.15.63:0/402534042 shutdown_connections 2024-09-21T06:38:25.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.287+0000 7f3014702640 1 -- 172.21.15.63:0/402534042 wait complete. 2024-09-21T06:38:25.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.288+0000 7f3014702640 1 Processor -- start 2024-09-21T06:38:25.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.288+0000 7f3014702640 1 -- start start 2024-09-21T06:38:25.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.288+0000 7f3014702640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f300c102ae0 0x7f300c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:25.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.288+0000 7f3014702640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f300c1083d0 0x7f300c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:25.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.288+0000 7f3014702640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f300c108d20 0x7f300c19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:25.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.288+0000 7f3014702640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f300c112990 con 0x7f300c108d20 2024-09-21T06:38:25.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.288+0000 7f3014702640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f300c112810 con 0x7f300c1083d0 2024-09-21T06:38:25.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.288+0000 7f3014702640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f300c112b10 con 0x7f300c102ae0 2024-09-21T06:38:25.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.289+0000 7f3012c9f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f300c108d20 0x7f300c19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:25.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.289+0000 7f3012c9f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f300c108d20 0x7f300c19fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54658/0 (socket says 172.21.15.63:54658) 2024-09-21T06:38:25.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.289+0000 7f3012c9f640 1 -- 172.21.15.63:0/2074999869 learned_addr learned my addr 172.21.15.63:0/2074999869 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:25.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.289+0000 7f3011c9d640 1 --2- 172.21.15.63:0/2074999869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f300c1083d0 0x7f300c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:25.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.289+0000 7f301249e640 1 --2- 172.21.15.63:0/2074999869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f300c102ae0 0x7f300c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:25.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.289+0000 7f3012c9f640 1 -- 172.21.15.63:0/2074999869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f300c102ae0 msgr2=0x7f300c19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:25.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.289+0000 7f3012c9f640 1 --2- 172.21.15.63:0/2074999869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f300c102ae0 0x7f300c19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.289+0000 7f3012c9f640 1 -- 172.21.15.63:0/2074999869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f300c1083d0 msgr2=0x7f300c19aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:25.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.289+0000 7f3012c9f640 1 --2- 172.21.15.63:0/2074999869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f300c1083d0 0x7f300c19aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.289+0000 7f3012c9f640 1 -- 172.21.15.63:0/2074999869 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f300c1a03e0 con 0x7f300c108d20 2024-09-21T06:38:25.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.289+0000 7f3012c9f640 1 --2- 172.21.15.63:0/2074999869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f300c108d20 0x7f300c19fcb0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f300400c970 tx=0x7f300400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:25.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.289+0000 7f2fff7fe640 1 -- 172.21.15.63:0/2074999869 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3004007bb0 con 0x7f300c108d20 2024-09-21T06:38:25.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.289+0000 7f2fff7fe640 1 -- 172.21.15.63:0/2074999869 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3004007d50 con 0x7f300c108d20 2024-09-21T06:38:25.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.289+0000 7f2fff7fe640 1 -- 172.21.15.63:0/2074999869 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3004004e60 con 0x7f300c108d20 2024-09-21T06:38:25.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.289+0000 7f3014702640 1 -- 172.21.15.63:0/2074999869 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f300c1a06d0 con 0x7f300c108d20 2024-09-21T06:38:25.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.289+0000 7f3014702640 1 -- 172.21.15.63:0/2074999869 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f300c1a6e30 con 0x7f300c108d20 2024-09-21T06:38:25.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.292+0000 7f301ac76740 1 Processor -- start 2024-09-21T06:38:25.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.292+0000 7f2fff7fe640 1 -- 172.21.15.63:0/2074999869 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f3004005020 con 0x7f300c108d20 2024-09-21T06:38:25.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.292+0000 7f301ac76740 1 -- start start 2024-09-21T06:38:25.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.293+0000 7f301ac76740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa942a070 0x55cfa97d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:25.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.293+0000 7f301ac76740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa94011b0 0x55cfa97d1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:25.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.293+0000 7f301ac76740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cfa9409390 0x55cfa97d20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:25.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.293+0000 7f301ac76740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55cfa9747e50 con 0x55cfa942a070 2024-09-21T06:38:25.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.293+0000 7f301ac76740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cfa9737280 con 0x55cfa9409390 2024-09-21T06:38:25.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.293+0000 7f301ac76740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cfa973b090 con 0x55cfa94011b0 2024-09-21T06:38:25.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.293+0000 7f3011c9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa942a070 0x55cfa97d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:25.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.293+0000 7f3011c9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa942a070 0x55cfa97d1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54662/0 (socket says 172.21.15.63:54662) 2024-09-21T06:38:25.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.293+0000 7f3011c9d640 1 -- 172.21.15.63:0/1640212994 learned_addr learned my addr 172.21.15.63:0/1640212994 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:25.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.293+0000 7f301249e640 1 --2- 172.21.15.63:0/1640212994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa94011b0 0x55cfa97d1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:25.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.293+0000 7f3011c9d640 1 --2- 172.21.15.63:0/1640212994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cfa9409390 0x55cfa97d20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:25.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.293+0000 7f2fff7fe640 1 --2- 172.21.15.63:0/2074999869 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2ff80b6680 0x7f2ff80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:25.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.293+0000 7f301249e640 1 -- 172.21.15.63:0/1640212994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cfa9409390 msgr2=0x55cfa97d20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:25.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.293+0000 7f301249e640 1 --2- 172.21.15.63:0/1640212994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cfa9409390 0x55cfa97d20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.293+0000 7f301249e640 1 -- 172.21.15.63:0/1640212994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa942a070 msgr2=0x55cfa97d1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:25.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.293+0000 7f301249e640 1 --2- 172.21.15.63:0/1640212994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa942a070 0x55cfa97d1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.293+0000 7f301249e640 1 -- 172.21.15.63:0/1640212994 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfa9495650 con 0x55cfa94011b0 2024-09-21T06:38:25.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.293+0000 7f3011c9d640 1 --2- 172.21.15.63:0/1640212994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa942a070 0x55cfa97d1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:38:25.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.293+0000 7f3012c9f640 1 --2- 172.21.15.63:0/2074999869 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2ff80b6680 0x7f2ff80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:25.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.294+0000 7f301249e640 1 --2- 172.21.15.63:0/1640212994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa94011b0 0x55cfa97d1b90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3000000f80 tx=0x7f3000009940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=663fc1462e56615c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:25.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.294+0000 7f2fff7fe640 1 -- 172.21.15.63:0/2074999869 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f30040e7370 con 0x7f300c108d20 2024-09-21T06:38:25.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.294+0000 7f2ffcff9640 1 -- 172.21.15.63:0/1640212994 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3000031450 con 0x55cfa94011b0 2024-09-21T06:38:25.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.294+0000 7f3012c9f640 1 --2- 172.21.15.63:0/2074999869 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2ff80b6680 0x7f2ff80b8b90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f30040ad1b0 tx=0x7f30040e4940 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:25.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.294+0000 7f2ffcff9640 1 -- 172.21.15.63:0/1640212994 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3000036030 con 0x55cfa94011b0 2024-09-21T06:38:25.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.294+0000 7f2ffcff9640 1 -- 172.21.15.63:0/1640212994 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3000004310 con 0x55cfa94011b0 2024-09-21T06:38:25.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.295+0000 7f301ac76740 1 -- 172.21.15.63:0/1640212994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa94011b0 msgr2=0x55cfa97d1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:25.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.295+0000 7f301ac76740 1 --2- 172.21.15.63:0/1640212994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa94011b0 0x55cfa97d1b90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3000000f80 tx=0x7f3000009940 comp rx=0 tx=0).stop 2024-09-21T06:38:25.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.295+0000 7f301ac76740 1 -- 172.21.15.63:0/1640212994 shutdown_connections 2024-09-21T06:38:25.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.295+0000 7f301ac76740 1 --2- 172.21.15.63:0/1640212994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cfa9409390 0x55cfa97d20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.295+0000 7f301ac76740 1 --2- 172.21.15.63:0/1640212994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa94011b0 0x55cfa97d1b90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.295+0000 7f301ac76740 1 --2- 172.21.15.63:0/1640212994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa942a070 0x55cfa97d1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.295+0000 7f301ac76740 1 -- 172.21.15.63:0/1640212994 >> 172.21.15.63:0/1640212994 conn(0x55cfa941e460 msgr2=0x55cfa97cf540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:25.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.295+0000 7f301ac76740 1 -- 172.21.15.63:0/1640212994 shutdown_connections 2024-09-21T06:38:25.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.295+0000 7f301ac76740 1 -- 172.21.15.63:0/1640212994 wait complete. 2024-09-21T06:38:25.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.295+0000 7f301ac76740 1 -- start start 2024-09-21T06:38:25.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.295+0000 7f301ac76740 1 Processor -- start 2024-09-21T06:38:25.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.296+0000 7f301ac76740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa94011b0 0x55cfa97dcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:25.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.296+0000 7f301ac76740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa9409390 0x55cfa97dd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:25.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.296+0000 7f301ac76740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cfa942a070 0x55cfa97e8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:25.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.296+0000 7f301ac76740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55cfa9598700 con 0x55cfa94011b0 2024-09-21T06:38:25.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.296+0000 7f301ac76740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cfa96d2110 con 0x55cfa942a070 2024-09-21T06:38:25.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.296+0000 7f301ac76740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cfa97dfc50 con 0x55cfa9409390 2024-09-21T06:38:25.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.296+0000 7f301ac76740 10 client.0 _ll_register_callbacks cb 0x55cfa96eb990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:25.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.296+0000 7f3011c9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa94011b0 0x55cfa97dcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:25.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.296+0000 7f3011c9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa94011b0 0x55cfa97dcd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54678/0 (socket says 172.21.15.63:54678) 2024-09-21T06:38:25.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.296+0000 7f3011c9d640 1 -- 172.21.15.63:0/2671033461 learned_addr learned my addr 172.21.15.63:0/2671033461 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:25.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.296+0000 7f301249e640 1 --2- 172.21.15.63:0/2671033461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa9409390 0x55cfa97dd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:25.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.296+0000 7f3011c9d640 1 --2- 172.21.15.63:0/2671033461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cfa942a070 0x55cfa97e8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:25.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.296+0000 7f3011c9d640 1 -- 172.21.15.63:0/2671033461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa9409390 msgr2=0x55cfa97dd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:25.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.296+0000 7f3011c9d640 1 --2- 172.21.15.63:0/2671033461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa9409390 0x55cfa97dd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.296+0000 7f3011c9d640 1 -- 172.21.15.63:0/2671033461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cfa942a070 msgr2=0x55cfa97e8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:25.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.296+0000 7f3011c9d640 1 --2- 172.21.15.63:0/2671033461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cfa942a070 0x55cfa97e8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.296+0000 7f3011c9d640 1 -- 172.21.15.63:0/2671033461 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfa96ffc40 con 0x55cfa94011b0 2024-09-21T06:38:25.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.297+0000 7f3011c9d640 1 --2- 172.21.15.63:0/2671033461 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa94011b0 0x55cfa97dcd10 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f3008004510 tx=0x7f300800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54b751b24c005ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:25.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.297+0000 7f2ff5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:38:25.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.297+0000 7f2ff5ffb640 1 -- 172.21.15.63:0/2671033461 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300801f030 con 0x55cfa94011b0 2024-09-21T06:38:25.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.297+0000 7f2ff5ffb640 1 -- 172.21.15.63:0/2671033461 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f3008005020 con 0x55cfa94011b0 2024-09-21T06:38:25.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.297+0000 7f301ac76740 1 -- 172.21.15.63:0/2671033461 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3000036030 con 0x55cfa94011b0 2024-09-21T06:38:25.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.297+0000 7f2ff5ffb640 1 -- 172.21.15.63:0/2671033461 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f3008029050 con 0x55cfa94011b0 2024-09-21T06:38:25.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.297+0000 7f301ac76740 10 client.17628 fetch_fsmap learned FSMap version 61 2024-09-21T06:38:25.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.297+0000 7f301ac76740 1 -- 172.21.15.63:0/2671033461 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55cfa97eb990 con 0x55cfa94011b0 2024-09-21T06:38:25.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.297+0000 7f2ff5ffb640 1 -- 172.21.15.63:0/2671033461 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3000036030 con 0x55cfa94011b0 2024-09-21T06:38:25.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.297+0000 7f2ff5ffb640 1 -- 172.21.15.63:0/2671033461 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f30080047a0 con 0x55cfa94011b0 2024-09-21T06:38:25.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.297+0000 7f301ac76740 10 client.17628 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:38:25.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.297+0000 7f301ac76740 10 client.17628 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:38:25.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.297+0000 7f301ac76740 20 client.17628 populate_metadata read hostname 'smithi063' 2024-09-21T06:38:25.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.297+0000 7f301ac76740 1 --2- 172.21.15.63:0/2671033461 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55cfa93e89f0 0x55cfa97eee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:25.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.297+0000 7f301ac76740 4 client.17628 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:25.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.297+0000 7f301ac76740 1 -- 172.21.15.63:0/2671033461 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfa9749da0 con 0x55cfa93e89f0 2024-09-21T06:38:25.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.298+0000 7f301249e640 1 --2- 172.21.15.63:0/2671033461 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55cfa93e89f0 0x55cfa97eee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:25.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.298+0000 7f2ff5ffb640 10 client.17628 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:38:25.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.298+0000 7f301249e640 1 --2- 172.21.15.63:0/2671033461 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55cfa93e89f0 0x55cfa97eee80 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7519e51c19e82ef server_cookie=7e8d3001d462b0a2 in_seq=0 out_seq=0 2024-09-21T06:38:25.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.299+0000 7f2ff5ffb640 1 -- 172.21.15.63:0/2671033461 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cfa9749da0 con 0x55cfa93e89f0 2024-09-21T06:38:25.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.299+0000 7f2ff5ffb640 10 client.17628 handle_command_reply: tid=0 2024-09-21T06:38:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.299+0000 7f301ac76740 1 client.17628 shutdown 2024-09-21T06:38:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.299+0000 7f301ac76740 1 -- 172.21.15.63:0/2671033461 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa94011b0 msgr2=0x55cfa97dcd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.299+0000 7f301ac76740 1 --2- 172.21.15.63:0/2671033461 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa94011b0 0x55cfa97dcd10 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f3008004510 tx=0x7f300800b390 comp rx=0 tx=0).stop 2024-09-21T06:38:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.299+0000 7f301ac76740 1 -- 172.21.15.63:0/2671033461 shutdown_connections 2024-09-21T06:38:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.299+0000 7f301ac76740 1 --2- 172.21.15.63:0/2671033461 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55cfa93e89f0 0x55cfa97eee80 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.299+0000 7f301ac76740 1 --2- 172.21.15.63:0/2671033461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cfa942a070 0x55cfa97e8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.299+0000 7f301ac76740 1 --2- 172.21.15.63:0/2671033461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa9409390 0x55cfa97dd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.299+0000 7f301ac76740 1 --2- 172.21.15.63:0/2671033461 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa94011b0 0x55cfa97dcd10 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.299+0000 7f2ff5ffb640 0 client.17628 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:38:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.299+0000 7f301ac76740 1 -- 172.21.15.63:0/2671033461 >> 172.21.15.63:0/2671033461 conn(0x55cfa941e460 msgr2=0x55cfa97d4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.299+0000 7f301ac76740 1 -- 172.21.15.63:0/2671033461 shutdown_connections 2024-09-21T06:38:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.299+0000 7f301ac76740 1 -- 172.21.15.63:0/2671033461 wait complete. 2024-09-21T06:38:25.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.300+0000 7f301ac76740 20 client.17628 trim_cache size 0 max 16384 2024-09-21T06:38:25.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.317+0000 7f301ac76740 1 Processor -- start 2024-09-21T06:38:25.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.317+0000 7f301ac76740 1 -- start start 2024-09-21T06:38:25.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.317+0000 7f301ac76740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cfa94011b0 0x55cfa97dbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:25.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.317+0000 7f301ac76740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa9409390 0x55cfa97d2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:25.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.317+0000 7f301ac76740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa942a070 0x55cfa97ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:25.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.317+0000 7f301ac76740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f300c1af6e0 con 0x55cfa9409390 2024-09-21T06:38:25.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.317+0000 7f301ac76740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f300c1b1220 con 0x55cfa94011b0 2024-09-21T06:38:25.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.317+0000 7f301ac76740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f300c1afdb0 con 0x55cfa942a070 2024-09-21T06:38:25.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.317+0000 7f301249e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa9409390 0x55cfa97d2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:25.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.317+0000 7f301249e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa9409390 0x55cfa97d2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54692/0 (socket says 172.21.15.63:54692) 2024-09-21T06:38:25.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.317+0000 7f301249e640 1 -- 172.21.15.63:0/819069757 learned_addr learned my addr 172.21.15.63:0/819069757 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:25.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.318+0000 7f3011c9d640 1 --2- 172.21.15.63:0/819069757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa942a070 0x55cfa97ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:25.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.318+0000 7f3011c9d640 1 --2- 172.21.15.63:0/819069757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cfa94011b0 0x55cfa97dbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:25.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.318+0000 7f301249e640 1 -- 172.21.15.63:0/819069757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa942a070 msgr2=0x55cfa97ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:25.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.318+0000 7f301249e640 1 --2- 172.21.15.63:0/819069757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa942a070 0x55cfa97ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.318+0000 7f301249e640 1 -- 172.21.15.63:0/819069757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cfa94011b0 msgr2=0x55cfa97dbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:25.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.318+0000 7f301249e640 1 --2- 172.21.15.63:0/819069757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cfa94011b0 0x55cfa97dbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.318+0000 7f301249e640 1 -- 172.21.15.63:0/819069757 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfa97d3940 con 0x55cfa9409390 2024-09-21T06:38:25.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.318+0000 7f301249e640 1 --2- 172.21.15.63:0/819069757 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa9409390 0x55cfa97d2d90 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f3000000f80 tx=0x7f3000003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ecfc09317ac2e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:25.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.318+0000 7f2ff7fff640 1 -- 172.21.15.63:0/819069757 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300004a040 con 0x55cfa9409390 2024-09-21T06:38:25.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.318+0000 7f2ff7fff640 1 -- 172.21.15.63:0/819069757 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3000036040 con 0x55cfa9409390 2024-09-21T06:38:25.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.318+0000 7f2ff7fff640 1 -- 172.21.15.63:0/819069757 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30000045f0 con 0x55cfa9409390 2024-09-21T06:38:25.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.319+0000 7f301ac76740 1 -- 172.21.15.63:0/819069757 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa9409390 msgr2=0x55cfa97d2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:25.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.319+0000 7f301ac76740 1 --2- 172.21.15.63:0/819069757 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa9409390 0x55cfa97d2d90 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f3000000f80 tx=0x7f3000003ee0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.319+0000 7f301ac76740 1 -- 172.21.15.63:0/819069757 shutdown_connections 2024-09-21T06:38:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.319+0000 7f301ac76740 1 --2- 172.21.15.63:0/819069757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa942a070 0x55cfa97ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.319+0000 7f301ac76740 1 --2- 172.21.15.63:0/819069757 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa9409390 0x55cfa97d2d90 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.319+0000 7f301ac76740 1 --2- 172.21.15.63:0/819069757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cfa94011b0 0x55cfa97dbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.319+0000 7f301ac76740 1 -- 172.21.15.63:0/819069757 >> 172.21.15.63:0/819069757 conn(0x55cfa941e460 msgr2=0x55cfa97d2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.319+0000 7f301ac76740 1 -- 172.21.15.63:0/819069757 shutdown_connections 2024-09-21T06:38:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.319+0000 7f301ac76740 1 -- 172.21.15.63:0/819069757 wait complete. 2024-09-21T06:38:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.319+0000 7f301ac76740 1 -- start start 2024-09-21T06:38:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.320+0000 7f301ac76740 1 Processor -- start 2024-09-21T06:38:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.320+0000 7f301ac76740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa94011b0 0x55cfa97e57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.320+0000 7f301ac76740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cfa9409390 0x55cfa97e0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.320+0000 7f301ac76740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa942a070 0x55cfa97e1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:25.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.320+0000 7f301ac76740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f300c1b0b50 con 0x55cfa942a070 2024-09-21T06:38:25.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.320+0000 7f301ac76740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f300c1b0480 con 0x55cfa9409390 2024-09-21T06:38:25.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.320+0000 7f301ac76740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f300c1ad6e0 con 0x55cfa94011b0 2024-09-21T06:38:25.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.320+0000 7f301ac76740 10 client.0 _ll_register_callbacks cb 0x7f30080043a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:25.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.320+0000 7f3011c9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa942a070 0x55cfa97e1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:25.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.320+0000 7f3011c9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa942a070 0x55cfa97e1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54696/0 (socket says 172.21.15.63:54696) 2024-09-21T06:38:25.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.320+0000 7f3011c9d640 1 -- 172.21.15.63:0/1799042998 learned_addr learned my addr 172.21.15.63:0/1799042998 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:25.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.320+0000 7f301249e640 1 --2- 172.21.15.63:0/1799042998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cfa9409390 0x55cfa97e0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:25.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.320+0000 7f3011c9d640 1 --2- 172.21.15.63:0/1799042998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa94011b0 0x55cfa97e57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:25.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.320+0000 7f3011c9d640 1 -- 172.21.15.63:0/1799042998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa94011b0 msgr2=0x55cfa97e57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:25.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.320+0000 7f3011c9d640 1 --2- 172.21.15.63:0/1799042998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa94011b0 0x55cfa97e57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.320+0000 7f3011c9d640 1 -- 172.21.15.63:0/1799042998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cfa9409390 msgr2=0x55cfa97e0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:25.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.320+0000 7f3011c9d640 1 --2- 172.21.15.63:0/1799042998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cfa9409390 0x55cfa97e0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.320+0000 7f3011c9d640 1 -- 172.21.15.63:0/1799042998 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfa97e1ab0 con 0x55cfa942a070 2024-09-21T06:38:25.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.321+0000 7f3011c9d640 1 --2- 172.21.15.63:0/1799042998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa942a070 0x55cfa97e1320 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f300800b4e0 tx=0x7f300800bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38c10d3931bdcff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:25.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.321+0000 7f2ff5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:38:25.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.321+0000 7f2ff5ffb640 1 -- 172.21.15.63:0/1799042998 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300801f020 con 0x55cfa942a070 2024-09-21T06:38:25.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.321+0000 7f2ff5ffb640 1 -- 172.21.15.63:0/1799042998 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f3008010b00 con 0x55cfa942a070 2024-09-21T06:38:25.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.321+0000 7f301ac76740 1 -- 172.21.15.63:0/1799042998 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3000036040 con 0x55cfa942a070 2024-09-21T06:38:25.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.321+0000 7f2ff5ffb640 1 -- 172.21.15.63:0/1799042998 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f3008004970 con 0x55cfa942a070 2024-09-21T06:38:25.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.321+0000 7f301ac76740 10 client.17634 fetch_fsmap learned FSMap version 61 2024-09-21T06:38:25.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.321+0000 7f301ac76740 1 -- 172.21.15.63:0/1799042998 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55cfa98598a0 con 0x55cfa942a070 2024-09-21T06:38:25.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.321+0000 7f2ff5ffb640 1 -- 172.21.15.63:0/1799042998 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3000036040 con 0x55cfa942a070 2024-09-21T06:38:25.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.321+0000 7f2ff5ffb640 1 -- 172.21.15.63:0/1799042998 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f3008005480 con 0x55cfa942a070 2024-09-21T06:38:25.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.321+0000 7f301ac76740 10 client.17634 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:38:25.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.321+0000 7f301ac76740 10 client.17634 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:38:25.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.321+0000 7f301ac76740 20 client.17634 populate_metadata read hostname 'smithi063' 2024-09-21T06:38:25.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.321+0000 7f301ac76740 1 --2- 172.21.15.63:0/1799042998 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55cfa93bdda0 0x55cfa985bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:25.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.321+0000 7f301ac76740 4 client.17634 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:38:25.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.321+0000 7f301ac76740 1 -- 172.21.15.63:0/1799042998 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cfa9745850 con 0x55cfa93bdda0 2024-09-21T06:38:25.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.322+0000 7f301249e640 1 --2- 172.21.15.63:0/1799042998 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55cfa93bdda0 0x55cfa985bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:25.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.322+0000 7f301249e640 1 --2- 172.21.15.63:0/1799042998 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55cfa93bdda0 0x55cfa985bf40 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3b09f8ef2b7a58e server_cookie=84c7b68f14284614 in_seq=0 out_seq=0 2024-09-21T06:38:25.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.322+0000 7f2ff5ffb640 10 client.17634 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:38:25.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.322+0000 7f2ff5ffb640 1 -- 172.21.15.63:0/1799042998 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x55cfa9745850 con 0x55cfa93bdda0 2024-09-21T06:38:25.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.322+0000 7f2ff5ffb640 10 client.17634 handle_command_reply: tid=0 2024-09-21T06:38:25.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.322+0000 7f301ac76740 1 client.17634 shutdown 2024-09-21T06:38:25.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.322+0000 7f301ac76740 1 -- 172.21.15.63:0/1799042998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa942a070 msgr2=0x55cfa97e1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:25.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.322+0000 7f301ac76740 1 --2- 172.21.15.63:0/1799042998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa942a070 0x55cfa97e1320 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f300800b4e0 tx=0x7f300800bf20 comp rx=0 tx=0).stop 2024-09-21T06:38:25.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.323+0000 7f301ac76740 1 -- 172.21.15.63:0/1799042998 shutdown_connections 2024-09-21T06:38:25.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.323+0000 7f301ac76740 1 --2- 172.21.15.63:0/1799042998 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55cfa93bdda0 0x55cfa985bf40 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.323+0000 7f301ac76740 1 --2- 172.21.15.63:0/1799042998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cfa942a070 0x55cfa97e1320 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.323+0000 7f301ac76740 1 --2- 172.21.15.63:0/1799042998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cfa9409390 0x55cfa97e0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.323+0000 7f301ac76740 1 --2- 172.21.15.63:0/1799042998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cfa94011b0 0x55cfa97e57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.323+0000 7f301ac76740 1 -- 172.21.15.63:0/1799042998 >> 172.21.15.63:0/1799042998 conn(0x55cfa941e460 msgr2=0x55cfa97d4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:25.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.323+0000 7f2ff5ffb640 0 client.17634 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:38:25.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.323+0000 7f301ac76740 1 -- 172.21.15.63:0/1799042998 shutdown_connections 2024-09-21T06:38:25.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.323+0000 7f301ac76740 1 -- 172.21.15.63:0/1799042998 wait complete. 2024-09-21T06:38:25.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.323+0000 7f301ac76740 20 client.17634 trim_cache size 0 max 16384 2024-09-21T06:38:25.330 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:38:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:38:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": { 2024-09-21T06:38:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: "6f95aade-6765-45da-bb69-5ba4c2704d89": { 2024-09-21T06:38:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: "tag": "6f95aade-6765-45da-bb69-5ba4c2704d89", 2024-09-21T06:38:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: "options": "recursive,force" 2024-09-21T06:38:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:38:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:38:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: "7f2a9ce4-d90a-4ac2-9e03-b14126f1aa0d": { 2024-09-21T06:38:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:37:37.866745+0000", 2024-09-21T06:38:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "9ad8f980-759b-4f0b-a3d4-e748a05e78b0": { 2024-09-21T06:38:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:36:53.116490+0000", 2024-09-21T06:38:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:25.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:25.333 INFO:teuthology.orchestra.run.smithi063.stdout: "6f95aade-6765-45da-bb69-5ba4c2704d89": { 2024-09-21T06:38:25.333 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:38:23.781983+0000", 2024-09-21T06:38:25.333 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:25.333 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:25.333 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:25.333 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:25.333 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:25.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:25.333 INFO:teuthology.orchestra.run.smithi063.stdout: "0c926bc7-90f8-47ce-a0d2-d02e676a73e9": { 2024-09-21T06:38:25.333 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:35:22.494015+0000", 2024-09-21T06:38:25.333 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:25.334 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:25.334 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:25.334 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:25.334 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:25.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:25.334 INFO:teuthology.orchestra.run.smithi063.stdout: "4f099144-5170-453b-a745-ddc222860f34": { 2024-09-21T06:38:25.334 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:34:35.417817+0000", 2024-09-21T06:38:25.334 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:25.334 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:25.334 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:25.334 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:25.335 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:25.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:25.335 INFO:teuthology.orchestra.run.smithi063.stdout: "91ae0a75-6a3f-452f-8bda-0f19862a5724": { 2024-09-21T06:38:25.335 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:50.316590+0000", 2024-09-21T06:38:25.335 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:25.335 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:25.335 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:25.335 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:25.335 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:25.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:25.335 INFO:teuthology.orchestra.run.smithi063.stdout: "5396028b-35f4-48fe-b54d-385784e97de3": { 2024-09-21T06:38:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:04.523378+0000", 2024-09-21T06:38:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: "1b9cca6e-2b23-49b2-a894-182a1054bc02": { 2024-09-21T06:38:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:36:07.545253+0000", 2024-09-21T06:38:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: "024d3c59-0b67-49a9-bf4a-e02d36691942": { 2024-09-21T06:38:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:32:14.282244+0000", 2024-09-21T06:38:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:38:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:31:27.507051+0000", 2024-09-21T06:38:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:38:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:38:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:25.339 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:38:25.339 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:38:25.339 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:38:25.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.323+0000 7f3014702640 1 -- 172.21.15.63:0/2074999869 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2ff80b6680 msgr2=0x7f2ff80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:25.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.323+0000 7f3014702640 1 --2- 172.21.15.63:0/2074999869 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2ff80b6680 0x7f2ff80b8b90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f30040ad1b0 tx=0x7f30040e4940 comp rx=0 tx=0).stop 2024-09-21T06:38:25.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.323+0000 7f3014702640 1 -- 172.21.15.63:0/2074999869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f300c108d20 msgr2=0x7f300c19fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:25.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.323+0000 7f3014702640 1 --2- 172.21.15.63:0/2074999869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f300c108d20 0x7f300c19fcb0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f300400c970 tx=0x7f300400ce30 comp rx=0 tx=0).stop 2024-09-21T06:38:25.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.323+0000 7f3014702640 1 -- 172.21.15.63:0/2074999869 shutdown_connections 2024-09-21T06:38:25.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.323+0000 7f3014702640 1 --2- 172.21.15.63:0/2074999869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f300c108d20 0x7f300c19fcb0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.323+0000 7f3014702640 1 --2- 172.21.15.63:0/2074999869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f300c1083d0 0x7f300c19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.323+0000 7f3014702640 1 --2- 172.21.15.63:0/2074999869 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f2ff80b6680 0x7f2ff80b8b90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.323+0000 7f3014702640 1 --2- 172.21.15.63:0/2074999869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f300c102ae0 0x7f300c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:25.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.323+0000 7f3014702640 1 -- 172.21.15.63:0/2074999869 >> 172.21.15.63:0/2074999869 conn(0x7f300c079760 msgr2=0x7f300c101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:25.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.324+0000 7f3014702640 1 -- 172.21.15.63:0/2074999869 shutdown_connections 2024-09-21T06:38:25.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:25.324+0000 7f3014702640 1 -- 172.21.15.63:0/2074999869 wait complete. 2024-09-21T06:38:25.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:25 smithi071 ceph-mon[34844]: scrub queued for path: / 2024-09-21T06:38:25.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:25 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:25.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:25 smithi071 ceph-mon[34844]: scrub summary: active paths [/] 2024-09-21T06:38:25.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:25 smithi071 ceph-mon[34844]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:25.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:25 smithi071 ceph-mon[34844]: pgmap v637: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 13 op/s 2024-09-21T06:38:25.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:25 smithi063 ceph-mon[31150]: scrub queued for path: / 2024-09-21T06:38:25.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:25 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:25.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:25 smithi063 ceph-mon[31150]: scrub summary: active paths [/] 2024-09-21T06:38:25.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:25 smithi063 ceph-mon[31150]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:25.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:25 smithi063 ceph-mon[31150]: pgmap v637: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 13 op/s 2024-09-21T06:38:25.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:25 smithi175 ceph-mon[34510]: scrub queued for path: / 2024-09-21T06:38:25.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:25 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:25.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:25 smithi175 ceph-mon[34510]: scrub summary: active paths [/] 2024-09-21T06:38:25.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:25 smithi175 ceph-mon[34510]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:25.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:25 smithi175 ceph-mon[34510]: pgmap v637: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 13 op/s 2024-09-21T06:38:26.087 INFO:tasks.cephfs.filesystem:scrub status for tag:6f95aade-6765-45da-bb69-5ba4c2704d89 - {'path': '/', 'tag': '6f95aade-6765-45da-bb69-5ba4c2704d89', 'options': 'recursive,force'} 2024-09-21T06:38:27.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:27 smithi071 ceph-mon[34844]: pgmap v638: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 102 B/s wr, 13 op/s 2024-09-21T06:38:27.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:27 smithi063 ceph-mon[31150]: pgmap v638: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 102 B/s wr, 13 op/s 2024-09-21T06:38:27.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:27 smithi175 ceph-mon[34510]: pgmap v638: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 102 B/s wr, 13 op/s 2024-09-21T06:38:29.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:29 smithi071 ceph-mon[34844]: pgmap v639: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-21T06:38:29.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:29 smithi063 ceph-mon[31150]: pgmap v639: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-21T06:38:29.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:29 smithi175 ceph-mon[34510]: pgmap v639: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-21T06:38:31.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:31 smithi071 ceph-mon[34844]: pgmap v640: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-21T06:38:31.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:31 smithi063 ceph-mon[31150]: pgmap v640: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-21T06:38:31.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:31 smithi175 ceph-mon[34510]: pgmap v640: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-21T06:38:33.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:33 smithi071 ceph-mon[34844]: pgmap v641: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-21T06:38:33.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:33 smithi063 ceph-mon[31150]: pgmap v641: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-21T06:38:33.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:33 smithi175 ceph-mon[34510]: pgmap v641: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-21T06:38:34.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:34 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:38:34.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:34 smithi071 ceph-mon[34844]: scrub summary: idle 2024-09-21T06:38:34.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:34 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:38:34.561 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:34 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:38:34.561 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:34 smithi175 ceph-mon[34510]: scrub summary: idle 2024-09-21T06:38:34.561 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:34 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:38:34.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:34 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:38:34.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:34 smithi063 ceph-mon[31150]: scrub summary: idle 2024-09-21T06:38:34.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:34 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:38:35.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:35 smithi071 ceph-mon[34844]: pgmap v642: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-21T06:38:35.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:35 smithi063 ceph-mon[31150]: pgmap v642: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-21T06:38:35.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:35 smithi175 ceph-mon[34510]: pgmap v642: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-21T06:38:36.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:36.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:36.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:36.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:36.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:36.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:36.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:38:36.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:38:36.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:36 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:36.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:36.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:36.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:36.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:36.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:36.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:36.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:38:36.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:38:36.583 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:36 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:36.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:36.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:36.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:36.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:36.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:36.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:36.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:38:36.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:38:36.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:36 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:38:38.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:37 smithi071 ceph-mon[34844]: pgmap v643: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T06:38:38.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:37 smithi063 ceph-mon[31150]: pgmap v643: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T06:38:38.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:37 smithi175 ceph-mon[34510]: pgmap v643: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T06:38:40.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:39 smithi071 ceph-mon[34844]: pgmap v644: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:38:40.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:39 smithi063 ceph-mon[31150]: pgmap v644: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:38:40.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:39 smithi175 ceph-mon[34510]: pgmap v644: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:38:42.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:41 smithi071 ceph-mon[34844]: pgmap v645: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 10 op/s 2024-09-21T06:38:42.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:41 smithi063 ceph-mon[31150]: pgmap v645: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 10 op/s 2024-09-21T06:38:42.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:41 smithi175 ceph-mon[34510]: pgmap v645: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 10 op/s 2024-09-21T06:38:44.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:43 smithi071 ceph-mon[34844]: pgmap v646: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:38:44.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:43 smithi063 ceph-mon[31150]: pgmap v646: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:38:44.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:43 smithi175 ceph-mon[34510]: pgmap v646: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:38:46.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:45 smithi071 ceph-mon[34844]: pgmap v647: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:38:46.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:45 smithi063 ceph-mon[31150]: pgmap v647: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:38:46.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:45 smithi175 ceph-mon[34510]: pgmap v647: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:38:48.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:47 smithi071 ceph-mon[34844]: pgmap v648: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:38:48.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:47 smithi063 ceph-mon[31150]: pgmap v648: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:38:48.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:47 smithi175 ceph-mon[34510]: pgmap v648: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:38:50.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:49 smithi071 ceph-mon[34844]: pgmap v649: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:38:50.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:49 smithi063 ceph-mon[31150]: pgmap v649: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:38:50.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:49 smithi175 ceph-mon[34510]: pgmap v649: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:38:52.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:51 smithi071 ceph-mon[34844]: pgmap v650: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:38:52.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:51 smithi063 ceph-mon[31150]: pgmap v650: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:38:52.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:51 smithi175 ceph-mon[34510]: pgmap v650: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:38:54.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:53 smithi071 ceph-mon[34844]: pgmap v651: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:38:54.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:53 smithi063 ceph-mon[31150]: pgmap v651: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:38:54.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:53 smithi175 ceph-mon[34510]: pgmap v651: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:38:56.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:55 smithi071 ceph-mon[34844]: pgmap v652: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:38:56.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:55 smithi063 ceph-mon[31150]: pgmap v652: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:38:56.088 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:38:56.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:55 smithi175 ceph-mon[34510]: pgmap v652: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:38:56.361 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:56.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.833+0000 7f5811ef4640 1 -- 172.21.15.63:0/1339269018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f580c10de10 msgr2=0x7f580c110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:56.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.833+0000 7f5811ef4640 1 --2- 172.21.15.63:0/1339269018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f580c10de10 0x7f580c110320 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f5804009ca0 tx=0x7f580402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.833+0000 7f5811ef4640 1 -- 172.21.15.63:0/1339269018 shutdown_connections 2024-09-21T06:38:56.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.833+0000 7f5811ef4640 1 --2- 172.21.15.63:0/1339269018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f580c10de10 0x7f580c110320 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.833+0000 7f5811ef4640 1 --2- 172.21.15.63:0/1339269018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f580c105290 0x7f580c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.833+0000 7f5811ef4640 1 --2- 172.21.15.63:0/1339269018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f580c104860 0x7f580c104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.833+0000 7f5811ef4640 1 -- 172.21.15.63:0/1339269018 >> 172.21.15.63:0/1339269018 conn(0x7f580c079740 msgr2=0x7f580c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:56.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.834+0000 7f5811ef4640 1 -- 172.21.15.63:0/1339269018 shutdown_connections 2024-09-21T06:38:56.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.834+0000 7f5811ef4640 1 -- 172.21.15.63:0/1339269018 wait complete. 2024-09-21T06:38:56.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.834+0000 7f5811ef4640 1 Processor -- start 2024-09-21T06:38:56.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.834+0000 7f5811ef4640 1 -- start start 2024-09-21T06:38:56.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.835+0000 7f5811ef4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f580c104860 0x7f580c19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:56.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.835+0000 7f5811ef4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f580c105290 0x7f580c19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:56.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.835+0000 7f5811ef4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f580c10de10 0x7f580c19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:56.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.835+0000 7f5811ef4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f580c113b30 con 0x7f580c10de10 2024-09-21T06:38:56.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.835+0000 7f5811ef4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f580c1139b0 con 0x7f580c104860 2024-09-21T06:38:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.835+0000 7f5811ef4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f580c113cb0 con 0x7f580c105290 2024-09-21T06:38:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.835+0000 7f580bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f580c10de10 0x7f580c19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.835+0000 7f580bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f580c10de10 0x7f580c19fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58718/0 (socket says 172.21.15.63:58718) 2024-09-21T06:38:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.835+0000 7f580bfff640 1 -- 172.21.15.63:0/2830563468 learned_addr learned my addr 172.21.15.63:0/2830563468 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.835+0000 7f580b7fe640 1 --2- 172.21.15.63:0/2830563468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f580c104860 0x7f580c19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.835+0000 7f580affd640 1 --2- 172.21.15.63:0/2830563468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f580c105290 0x7f580c19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.835+0000 7f580bfff640 1 -- 172.21.15.63:0/2830563468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f580c105290 msgr2=0x7f580c19ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.835+0000 7f580bfff640 1 --2- 172.21.15.63:0/2830563468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f580c105290 0x7f580c19ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.835+0000 7f580bfff640 1 -- 172.21.15.63:0/2830563468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f580c104860 msgr2=0x7f580c19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.835+0000 7f580bfff640 1 --2- 172.21.15.63:0/2830563468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f580c104860 0x7f580c19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.835+0000 7f580bfff640 1 -- 172.21.15.63:0/2830563468 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f580c1a0410 con 0x7f580c10de10 2024-09-21T06:38:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.836+0000 7f580bfff640 1 --2- 172.21.15.63:0/2830563468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f580c10de10 0x7f580c19fda0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f5804005cc0 tx=0x7f580402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.836+0000 7f5808ff9640 1 -- 172.21.15.63:0/2830563468 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5804003cf0 con 0x7f580c10de10 2024-09-21T06:38:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.836+0000 7f5811ef4640 1 -- 172.21.15.63:0/2830563468 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f580c1a06a0 con 0x7f580c10de10 2024-09-21T06:38:56.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.836+0000 7f5808ff9640 1 -- 172.21.15.63:0/2830563468 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58040044f0 con 0x7f580c10de10 2024-09-21T06:38:56.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.836+0000 7f5808ff9640 1 -- 172.21.15.63:0/2830563468 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580402fc30 con 0x7f580c10de10 2024-09-21T06:38:56.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.836+0000 7f5811ef4640 1 -- 172.21.15.63:0/2830563468 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f580c1a6f20 con 0x7f580c10de10 2024-09-21T06:38:56.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.838+0000 7f5818468740 1 Processor -- start 2024-09-21T06:38:56.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.839+0000 7f5808ff9640 1 -- 172.21.15.63:0/2830563468 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f58040046a0 con 0x7f580c10de10 2024-09-21T06:38:56.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.839+0000 7f5818468740 1 -- start start 2024-09-21T06:38:56.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.839+0000 7f5818468740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5591053a4070 0x55910574b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:56.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.839+0000 7f5818468740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55910537b1b0 0x55910574bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:56.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.839+0000 7f5818468740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559105383390 0x55910574c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:56.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.839+0000 7f5818468740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5591056c1e50 con 0x559105383390 2024-09-21T06:38:56.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.839+0000 7f5818468740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5591056b1280 con 0x55910537b1b0 2024-09-21T06:38:56.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.839+0000 7f5818468740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5591056b5090 con 0x5591053a4070 2024-09-21T06:38:56.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.839+0000 7f580affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559105383390 0x55910574c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:56.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.839+0000 7f580affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559105383390 0x55910574c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58722/0 (socket says 172.21.15.63:58722) 2024-09-21T06:38:56.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.839+0000 7f580affd640 1 -- 172.21.15.63:0/413339413 learned_addr learned my addr 172.21.15.63:0/413339413 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:56.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.839+0000 7f580b7fe640 1 --2- 172.21.15.63:0/413339413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55910537b1b0 0x55910574bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:56.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.839+0000 7f580affd640 1 --2- 172.21.15.63:0/413339413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5591053a4070 0x55910574b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:56.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.840+0000 7f5808ff9640 1 --2- 172.21.15.63:0/2830563468 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f57f40b66b0 0x7f57f40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:56.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.840+0000 7f580affd640 1 -- 172.21.15.63:0/413339413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5591053a4070 msgr2=0x55910574b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:56.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.840+0000 7f580affd640 1 --2- 172.21.15.63:0/413339413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5591053a4070 0x55910574b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.840+0000 7f580affd640 1 -- 172.21.15.63:0/413339413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55910537b1b0 msgr2=0x55910574bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:56.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.840+0000 7f580affd640 1 --2- 172.21.15.63:0/413339413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55910537b1b0 0x55910574bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.840+0000 7f580affd640 1 -- 172.21.15.63:0/413339413 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55910540f650 con 0x559105383390 2024-09-21T06:38:56.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.840+0000 7f580b7fe640 1 --2- 172.21.15.63:0/413339413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55910537b1b0 0x55910574bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:38:56.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.840+0000 7f5808ff9640 1 -- 172.21.15.63:0/2830563468 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f5804108e40 con 0x7f580c10de10 2024-09-21T06:38:56.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.840+0000 7f580bfff640 1 --2- 172.21.15.63:0/2830563468 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f57f40b66b0 0x7f57f40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:56.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.840+0000 7f580affd640 1 --2- 172.21.15.63:0/413339413 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559105383390 0x55910574c0d0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f5800005fd0 tx=0x7f580000b440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30b7d98a29b2305 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:56.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.840+0000 7f57f1ffb640 1 -- 172.21.15.63:0/413339413 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580000e920 con 0x559105383390 2024-09-21T06:38:56.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.840+0000 7f57f1ffb640 1 -- 172.21.15.63:0/413339413 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5800010430 con 0x559105383390 2024-09-21T06:38:56.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.840+0000 7f57f1ffb640 1 -- 172.21.15.63:0/413339413 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580000f620 con 0x559105383390 2024-09-21T06:38:56.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.841+0000 7f5818468740 1 -- 172.21.15.63:0/413339413 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559105383390 msgr2=0x55910574c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.841+0000 7f5818468740 1 --2- 172.21.15.63:0/413339413 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559105383390 0x55910574c0d0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f5800005fd0 tx=0x7f580000b440 comp rx=0 tx=0).stop 2024-09-21T06:38:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.841+0000 7f580bfff640 1 --2- 172.21.15.63:0/2830563468 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f57f40b66b0 0x7f57f40b8bc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f58041065f0 tx=0x7f58040095c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.841+0000 7f5818468740 1 -- 172.21.15.63:0/413339413 shutdown_connections 2024-09-21T06:38:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.841+0000 7f5818468740 1 --2- 172.21.15.63:0/413339413 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559105383390 0x55910574c0d0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.841+0000 7f5818468740 1 --2- 172.21.15.63:0/413339413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55910537b1b0 0x55910574bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.841+0000 7f5818468740 1 --2- 172.21.15.63:0/413339413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5591053a4070 0x55910574b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.841+0000 7f5818468740 1 -- 172.21.15.63:0/413339413 >> 172.21.15.63:0/413339413 conn(0x559105398460 msgr2=0x559105749540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.841+0000 7f5818468740 1 -- 172.21.15.63:0/413339413 shutdown_connections 2024-09-21T06:38:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.841+0000 7f5818468740 1 -- 172.21.15.63:0/413339413 wait complete. 2024-09-21T06:38:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.842+0000 7f5818468740 1 -- start start 2024-09-21T06:38:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.842+0000 7f5818468740 1 Processor -- start 2024-09-21T06:38:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.842+0000 7f5818468740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55910537b1b0 0x559105756ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:56.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.842+0000 7f5818468740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559105383390 0x559105757220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.842+0000 7f5818468740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5591053a4070 0x559105763120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.842+0000 7f5818468740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559105512700 con 0x5591053a4070 2024-09-21T06:38:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.842+0000 7f5818468740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55910564c110 con 0x559105383390 2024-09-21T06:38:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.842+0000 7f5818468740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559105759e30 con 0x55910537b1b0 2024-09-21T06:38:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.842+0000 7f5818468740 10 client.0 _ll_register_callbacks cb 0x559105665990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.842+0000 7f580affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5591053a4070 0x559105763120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.842+0000 7f580affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5591053a4070 0x559105763120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58730/0 (socket says 172.21.15.63:58730) 2024-09-21T06:38:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.842+0000 7f580affd640 1 -- 172.21.15.63:0/3345230402 learned_addr learned my addr 172.21.15.63:0/3345230402 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.843+0000 7f580affd640 1 --2- 172.21.15.63:0/3345230402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55910537b1b0 0x559105756ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.843+0000 7f580b7fe640 1 --2- 172.21.15.63:0/3345230402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559105383390 0x559105757220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.843+0000 7f580affd640 1 -- 172.21.15.63:0/3345230402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55910537b1b0 msgr2=0x559105756ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.843+0000 7f580affd640 1 --2- 172.21.15.63:0/3345230402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55910537b1b0 0x559105756ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.843+0000 7f580affd640 1 -- 172.21.15.63:0/3345230402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559105383390 msgr2=0x559105757220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:56.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.843+0000 7f580affd640 1 --2- 172.21.15.63:0/3345230402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559105383390 0x559105757220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.843+0000 7f580affd640 1 -- 172.21.15.63:0/3345230402 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559105679c40 con 0x5591053a4070 2024-09-21T06:38:56.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.843+0000 7f580affd640 1 --2- 172.21.15.63:0/3345230402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5591053a4070 0x559105763120 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x55910574df00 tx=0x7f5800010db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae255c49f5094b36 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:56.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.843+0000 7f57eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:38:56.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.843+0000 7f57eaffd640 1 -- 172.21.15.63:0/3345230402 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58000105e0 con 0x5591053a4070 2024-09-21T06:38:56.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.843+0000 7f57eaffd640 1 -- 172.21.15.63:0/3345230402 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f5800010780 con 0x5591053a4070 2024-09-21T06:38:56.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.843+0000 7f5818468740 1 -- 172.21.15.63:0/3345230402 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5800010430 con 0x5591053a4070 2024-09-21T06:38:56.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.844+0000 7f57eaffd640 1 -- 172.21.15.63:0/3345230402 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f5800010980 con 0x5591053a4070 2024-09-21T06:38:56.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.844+0000 7f5818468740 10 client.17646 fetch_fsmap learned FSMap version 61 2024-09-21T06:38:56.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.844+0000 7f5818468740 1 -- 172.21.15.63:0/3345230402 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x559105765b10 con 0x5591053a4070 2024-09-21T06:38:56.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.844+0000 7f57eaffd640 1 -- 172.21.15.63:0/3345230402 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5800010430 con 0x5591053a4070 2024-09-21T06:38:56.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.844+0000 7f57eaffd640 1 -- 172.21.15.63:0/3345230402 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f580000eb90 con 0x5591053a4070 2024-09-21T06:38:56.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.844+0000 7f5818468740 10 client.17646 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:38:56.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.844+0000 7f5818468740 10 client.17646 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:38:56.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.844+0000 7f5818468740 20 client.17646 populate_metadata read hostname 'smithi063' 2024-09-21T06:38:56.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.844+0000 7f5818468740 1 --2- 172.21.15.63:0/3345230402 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5591053629f0 0x5591057691f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:56.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.844+0000 7f5818468740 4 client.17646 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:56.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.844+0000 7f5818468740 1 -- 172.21.15.63:0/3345230402 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591056c3da0 con 0x5591053629f0 2024-09-21T06:38:56.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.844+0000 7f580b7fe640 1 --2- 172.21.15.63:0/3345230402 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5591053629f0 0x5591057691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:56.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.845+0000 7f580b7fe640 1 --2- 172.21.15.63:0/3345230402 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5591053629f0 0x5591057691f0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7aa1fbb7d6a3b139 server_cookie=530201ef059337d4 in_seq=0 out_seq=0 2024-09-21T06:38:56.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.845+0000 7f57eaffd640 10 client.17646 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:38:56.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.846+0000 7f57eaffd640 1 -- 172.21.15.63:0/3345230402 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5591056c3da0 con 0x5591053629f0 2024-09-21T06:38:56.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.846+0000 7f57eaffd640 10 client.17646 handle_command_reply: tid=0 2024-09-21T06:38:56.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.846+0000 7f5818468740 1 client.17646 shutdown 2024-09-21T06:38:56.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.846+0000 7f5818468740 1 -- 172.21.15.63:0/3345230402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5591053a4070 msgr2=0x559105763120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:56.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.846+0000 7f5818468740 1 --2- 172.21.15.63:0/3345230402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5591053a4070 0x559105763120 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x55910574df00 tx=0x7f5800010db0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.846+0000 7f5818468740 1 -- 172.21.15.63:0/3345230402 shutdown_connections 2024-09-21T06:38:56.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.846+0000 7f5818468740 1 --2- 172.21.15.63:0/3345230402 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x5591053629f0 0x5591057691f0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.846+0000 7f5818468740 1 --2- 172.21.15.63:0/3345230402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5591053a4070 0x559105763120 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.846+0000 7f5818468740 1 --2- 172.21.15.63:0/3345230402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559105383390 0x559105757220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.846+0000 7f5818468740 1 --2- 172.21.15.63:0/3345230402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55910537b1b0 0x559105756ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.846+0000 7f5818468740 1 -- 172.21.15.63:0/3345230402 >> 172.21.15.63:0/3345230402 conn(0x559105398460 msgr2=0x55910574e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:56.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.846+0000 7f57eaffd640 0 client.17646 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:38:56.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.846+0000 7f5818468740 1 -- 172.21.15.63:0/3345230402 shutdown_connections 2024-09-21T06:38:56.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.846+0000 7f5818468740 1 -- 172.21.15.63:0/3345230402 wait complete. 2024-09-21T06:38:56.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.846+0000 7f5818468740 20 client.17646 trim_cache size 0 max 16384 2024-09-21T06:38:56.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.864+0000 7f5818468740 1 Processor -- start 2024-09-21T06:38:56.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.864+0000 7f5818468740 1 -- start start 2024-09-21T06:38:56.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.864+0000 7f5818468740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55910537b1b0 0x559105758910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:56.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.864+0000 7f5818468740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559105383390 0x559105763020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:56.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.864+0000 7f5818468740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5591053a4070 0x559105753ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:56.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.864+0000 7f5818468740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f580c1af860 con 0x559105383390 2024-09-21T06:38:56.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.864+0000 7f5818468740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f580c1b13a0 con 0x55910537b1b0 2024-09-21T06:38:56.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.864+0000 7f5818468740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f580c1aff30 con 0x5591053a4070 2024-09-21T06:38:56.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.864+0000 7f580b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559105383390 0x559105763020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:56.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.864+0000 7f580b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559105383390 0x559105763020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58744/0 (socket says 172.21.15.63:58744) 2024-09-21T06:38:56.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.864+0000 7f580b7fe640 1 -- 172.21.15.63:0/972841361 learned_addr learned my addr 172.21.15.63:0/972841361 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:56.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.864+0000 7f580affd640 1 --2- 172.21.15.63:0/972841361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55910537b1b0 0x559105758910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:56.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.864+0000 7f580affd640 1 --2- 172.21.15.63:0/972841361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5591053a4070 0x559105753ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:56.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.864+0000 7f580b7fe640 1 -- 172.21.15.63:0/972841361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5591053a4070 msgr2=0x559105753ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:56.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.864+0000 7f580b7fe640 1 --2- 172.21.15.63:0/972841361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5591053a4070 0x559105753ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.864+0000 7f580b7fe640 1 -- 172.21.15.63:0/972841361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55910537b1b0 msgr2=0x559105758910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:56.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.864+0000 7f580b7fe640 1 --2- 172.21.15.63:0/972841361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55910537b1b0 0x559105758910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.864+0000 7f580b7fe640 1 -- 172.21.15.63:0/972841361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55910574e550 con 0x559105383390 2024-09-21T06:38:56.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.864+0000 7f580affd640 1 --2- 172.21.15.63:0/972841361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55910537b1b0 0x559105758910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:56.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.865+0000 7f580b7fe640 1 --2- 172.21.15.63:0/972841361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559105383390 0x559105763020 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009a10 tx=0x7f57fc009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26227af72ae49ad0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:56.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.865+0000 7f57f17fa640 1 -- 172.21.15.63:0/972841361 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57fc015a80 con 0x559105383390 2024-09-21T06:38:56.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.865+0000 7f57f17fa640 1 -- 172.21.15.63:0/972841361 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57fc015c20 con 0x559105383390 2024-09-21T06:38:56.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.865+0000 7f57f17fa640 1 -- 172.21.15.63:0/972841361 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57fc014670 con 0x559105383390 2024-09-21T06:38:56.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.866+0000 7f5818468740 1 -- 172.21.15.63:0/972841361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559105383390 msgr2=0x559105763020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:56.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.866+0000 7f5818468740 1 --2- 172.21.15.63:0/972841361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559105383390 0x559105763020 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009a10 tx=0x7f57fc009110 comp rx=0 tx=0).stop 2024-09-21T06:38:56.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.866+0000 7f5818468740 1 -- 172.21.15.63:0/972841361 shutdown_connections 2024-09-21T06:38:56.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.866+0000 7f5818468740 1 --2- 172.21.15.63:0/972841361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5591053a4070 0x559105753ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.866+0000 7f5818468740 1 --2- 172.21.15.63:0/972841361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559105383390 0x559105763020 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.866+0000 7f5818468740 1 --2- 172.21.15.63:0/972841361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55910537b1b0 0x559105758910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.866+0000 7f5818468740 1 -- 172.21.15.63:0/972841361 >> 172.21.15.63:0/972841361 conn(0x559105398460 msgr2=0x559105758200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:56.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.866+0000 7f5818468740 1 -- 172.21.15.63:0/972841361 shutdown_connections 2024-09-21T06:38:56.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.866+0000 7f5818468740 1 -- 172.21.15.63:0/972841361 wait complete. 2024-09-21T06:38:56.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.866+0000 7f5818468740 1 -- start start 2024-09-21T06:38:56.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.866+0000 7f5818468740 1 Processor -- start 2024-09-21T06:38:56.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.867+0000 7f5818468740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55910537b1b0 0x55910575f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:56.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.867+0000 7f5818468740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559105383390 0x55910575ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:56.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.867+0000 7f5818468740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5591053a4070 0x55910575b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:56.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.867+0000 7f5818468740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f580c1b0cd0 con 0x5591053a4070 2024-09-21T06:38:56.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.867+0000 7f5818468740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f580c1b0600 con 0x559105383390 2024-09-21T06:38:56.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.867+0000 7f5818468740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f580c1ad860 con 0x55910537b1b0 2024-09-21T06:38:56.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.867+0000 7f5818468740 10 client.0 _ll_register_callbacks cb 0x7f57fc0093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:56.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.867+0000 7f580affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5591053a4070 0x55910575b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:56.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.867+0000 7f580affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5591053a4070 0x55910575b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58752/0 (socket says 172.21.15.63:58752) 2024-09-21T06:38:56.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.867+0000 7f580affd640 1 -- 172.21.15.63:0/2673688068 learned_addr learned my addr 172.21.15.63:0/2673688068 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:56.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.867+0000 7f580affd640 1 --2- 172.21.15.63:0/2673688068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55910537b1b0 0x55910575f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:56.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.867+0000 7f580b7fe640 1 --2- 172.21.15.63:0/2673688068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559105383390 0x55910575ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:56.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.867+0000 7f580affd640 1 -- 172.21.15.63:0/2673688068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55910537b1b0 msgr2=0x55910575f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:56.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.867+0000 7f580affd640 1 --2- 172.21.15.63:0/2673688068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55910537b1b0 0x55910575f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.867+0000 7f580affd640 1 -- 172.21.15.63:0/2673688068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559105383390 msgr2=0x55910575ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:56.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.867+0000 7f580affd640 1 --2- 172.21.15.63:0/2673688068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559105383390 0x55910575ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.867+0000 7f580affd640 1 -- 172.21.15.63:0/2673688068 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55910575bae0 con 0x5591053a4070 2024-09-21T06:38:56.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.867+0000 7f580affd640 1 --2- 172.21.15.63:0/2673688068 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5591053a4070 0x55910575b350 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x55910574e4f0 tx=0x7f5800005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780f6fa61a99fb61 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:56.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.867+0000 7f57eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:38:56.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.868+0000 7f57eaffd640 1 -- 172.21.15.63:0/2673688068 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5800010c10 con 0x5591053a4070 2024-09-21T06:38:56.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.868+0000 7f57eaffd640 1 -- 172.21.15.63:0/2673688068 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f5800032040 con 0x5591053a4070 2024-09-21T06:38:56.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.868+0000 7f5818468740 1 -- 172.21.15.63:0/2673688068 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57fc015c20 con 0x5591053a4070 2024-09-21T06:38:56.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.868+0000 7f57eaffd640 1 -- 172.21.15.63:0/2673688068 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f580000e9a0 con 0x5591053a4070 2024-09-21T06:38:56.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.868+0000 7f5818468740 10 client.17652 fetch_fsmap learned FSMap version 61 2024-09-21T06:38:56.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.868+0000 7f5818468740 1 -- 172.21.15.63:0/2673688068 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x5591057d3b50 con 0x5591053a4070 2024-09-21T06:38:56.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.868+0000 7f57eaffd640 1 -- 172.21.15.63:0/2673688068 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57fc015c20 con 0x5591053a4070 2024-09-21T06:38:56.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.868+0000 7f57eaffd640 1 -- 172.21.15.63:0/2673688068 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f58000050c0 con 0x5591053a4070 2024-09-21T06:38:56.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.868+0000 7f5818468740 10 client.17652 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:38:56.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.868+0000 7f5818468740 10 client.17652 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:38:56.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.868+0000 7f5818468740 20 client.17652 populate_metadata read hostname 'smithi063' 2024-09-21T06:38:56.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.868+0000 7f5818468740 1 --2- 172.21.15.63:0/2673688068 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x559105337da0 0x5591057d6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:56.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.868+0000 7f5818468740 4 client.17652 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:38:56.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.868+0000 7f5818468740 1 -- 172.21.15.63:0/2673688068 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5591056bf850 con 0x559105337da0 2024-09-21T06:38:56.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.869+0000 7f580b7fe640 1 --2- 172.21.15.63:0/2673688068 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x559105337da0 0x5591057d6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:56.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.869+0000 7f580b7fe640 1 --2- 172.21.15.63:0/2673688068 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x559105337da0 0x5591057d6250 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31d0d770c49dd010 server_cookie=78012fb0cbc11f81 in_seq=0 out_seq=0 2024-09-21T06:38:56.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.869+0000 7f57eaffd640 10 client.17652 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:38:56.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.869+0000 7f57eaffd640 1 -- 172.21.15.63:0/2673688068 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x5591056bf850 con 0x559105337da0 2024-09-21T06:38:56.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.869+0000 7f57eaffd640 10 client.17652 handle_command_reply: tid=0 2024-09-21T06:38:56.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.869+0000 7f5818468740 1 client.17652 shutdown 2024-09-21T06:38:56.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5818468740 1 -- 172.21.15.63:0/2673688068 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5591053a4070 msgr2=0x55910575b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:56.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5818468740 1 --2- 172.21.15.63:0/2673688068 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5591053a4070 0x55910575b350 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x55910574e4f0 tx=0x7f5800005f10 comp rx=0 tx=0).stop 2024-09-21T06:38:56.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5818468740 1 -- 172.21.15.63:0/2673688068 shutdown_connections 2024-09-21T06:38:56.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5818468740 1 --2- 172.21.15.63:0/2673688068 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x559105337da0 0x5591057d6250 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5818468740 1 --2- 172.21.15.63:0/2673688068 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5591053a4070 0x55910575b350 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5818468740 1 --2- 172.21.15.63:0/2673688068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559105383390 0x55910575ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5818468740 1 --2- 172.21.15.63:0/2673688068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55910537b1b0 0x55910575f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5818468740 1 -- 172.21.15.63:0/2673688068 >> 172.21.15.63:0/2673688068 conn(0x559105398460 msgr2=0x559105758140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:56.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f57eaffd640 0 client.17652 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:38:56.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5818468740 1 -- 172.21.15.63:0/2673688068 shutdown_connections 2024-09-21T06:38:56.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5818468740 1 -- 172.21.15.63:0/2673688068 wait complete. 2024-09-21T06:38:56.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5818468740 20 client.17652 trim_cache size 0 max 16384 2024-09-21T06:38:56.878 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:38:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "no active scrubs running", 2024-09-21T06:38:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": {}, 2024-09-21T06:38:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_stats": { 2024-09-21T06:38:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: "7f2a9ce4-d90a-4ac2-9e03-b14126f1aa0d": { 2024-09-21T06:38:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:37:37.866745+0000", 2024-09-21T06:38:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "9ad8f980-759b-4f0b-a3d4-e748a05e78b0": { 2024-09-21T06:38:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:36:53.116490+0000", 2024-09-21T06:38:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "6f95aade-6765-45da-bb69-5ba4c2704d89": { 2024-09-21T06:38:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:38:23.781983+0000", 2024-09-21T06:38:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: "0c926bc7-90f8-47ce-a0d2-d02e676a73e9": { 2024-09-21T06:38:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:35:22.494015+0000", 2024-09-21T06:38:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: "4f099144-5170-453b-a745-ddc222860f34": { 2024-09-21T06:38:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:34:35.417817+0000", 2024-09-21T06:38:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "91ae0a75-6a3f-452f-8bda-0f19862a5724": { 2024-09-21T06:38:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:50.316590+0000", 2024-09-21T06:38:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "5396028b-35f4-48fe-b54d-385784e97de3": { 2024-09-21T06:38:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:33:04.523378+0000", 2024-09-21T06:38:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: "1b9cca6e-2b23-49b2-a894-182a1054bc02": { 2024-09-21T06:38:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:36:07.545253+0000", 2024-09-21T06:38:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: "024d3c59-0b67-49a9-bf4a-e02d36691942": { 2024-09-21T06:38:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:32:14.282244+0000", 2024-09-21T06:38:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: "9cd302bc-b682-49ab-bf6f-dee8f0549ead": { 2024-09-21T06:38:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:31:27.507051+0000", 2024-09-21T06:38:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:38:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: "5cef1d6e-b4d8-4a94-b290-40167760d82c": { 2024-09-21T06:38:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: "start_time": "2024-09-21T06:30:41.047852+0000", 2024-09-21T06:38:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-21T06:38:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:38:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_passed": 0, 2024-09-21T06:38:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_failed": 0, 2024-09-21T06:38:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_skipped": 0 2024-09-21T06:38:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:38:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:38:56.884 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:38:56.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5811ef4640 1 -- 172.21.15.63:0/2830563468 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f57f40b66b0 msgr2=0x7f57f40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:56.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5811ef4640 1 --2- 172.21.15.63:0/2830563468 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f57f40b66b0 0x7f57f40b8bc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f58041065f0 tx=0x7f58040095c0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5811ef4640 1 -- 172.21.15.63:0/2830563468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f580c10de10 msgr2=0x7f580c19fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:56.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5811ef4640 1 --2- 172.21.15.63:0/2830563468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f580c10de10 0x7f580c19fda0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f5804005cc0 tx=0x7f580402f470 comp rx=0 tx=0).stop 2024-09-21T06:38:56.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5811ef4640 1 -- 172.21.15.63:0/2830563468 shutdown_connections 2024-09-21T06:38:56.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5811ef4640 1 --2- 172.21.15.63:0/2830563468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f580c10de10 0x7f580c19fda0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5811ef4640 1 --2- 172.21.15.63:0/2830563468 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f57f40b66b0 0x7f57f40b8bc0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5811ef4640 1 --2- 172.21.15.63:0/2830563468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f580c105290 0x7f580c19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5811ef4640 1 --2- 172.21.15.63:0/2830563468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f580c104860 0x7f580c19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:56.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.870+0000 7f5811ef4640 1 -- 172.21.15.63:0/2830563468 >> 172.21.15.63:0/2830563468 conn(0x7f580c079740 msgr2=0x7f580c0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:56.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.871+0000 7f5811ef4640 1 -- 172.21.15.63:0/2830563468 shutdown_connections 2024-09-21T06:38:56.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:56.871+0000 7f5811ef4640 1 -- 172.21.15.63:0/2830563468 wait complete. 2024-09-21T06:38:57.697 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:38:57.698 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:38:57.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:57 smithi063 ceph-mon[31150]: pgmap v653: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:38:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:58.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:57 smithi071 ceph-mon[34844]: pgmap v653: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:38:58.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:57 smithi175 ceph-mon[34510]: pgmap v653: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:38:58.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.468+0000 7fce26b6f640 1 -- 172.21.15.63:0/3862399623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce201083a0 msgr2=0x7fce201087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:58.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.468+0000 7fce26b6f640 1 --2- 172.21.15.63:0/3862399623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce201083a0 0x7fce201087b0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fce08009900 tx=0x7fce0802a410 comp rx=0 tx=0).stop 2024-09-21T06:38:58.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.468+0000 7fce26b6f640 1 -- 172.21.15.63:0/3862399623 shutdown_connections 2024-09-21T06:38:58.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.468+0000 7fce26b6f640 1 --2- 172.21.15.63:0/3862399623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce20108cf0 0x7fce2010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:58.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.468+0000 7fce26b6f640 1 --2- 172.21.15.63:0/3862399623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce201083a0 0x7fce201087b0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:58.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.468+0000 7fce26b6f640 1 --2- 172.21.15.63:0/3862399623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce20102a60 0x7fce20102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:58.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.468+0000 7fce26b6f640 1 -- 172.21.15.63:0/3862399623 >> 172.21.15.63:0/3862399623 conn(0x7fce20079730 msgr2=0x7fce20079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:58.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.468+0000 7fce26b6f640 1 -- 172.21.15.63:0/3862399623 shutdown_connections 2024-09-21T06:38:58.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.468+0000 7fce26b6f640 1 -- 172.21.15.63:0/3862399623 wait complete. 2024-09-21T06:38:58.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.469+0000 7fce26b6f640 1 Processor -- start 2024-09-21T06:38:58.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.469+0000 7fce26b6f640 1 -- start start 2024-09-21T06:38:58.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.469+0000 7fce26b6f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce20102a60 0x7fce2019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:58.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.469+0000 7fce26b6f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce201083a0 0x7fce2019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:58.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.469+0000 7fce26b6f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce20108cf0 0x7fce2019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:58.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.469+0000 7fce26b6f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fce20113a80 con 0x7fce201083a0 2024-09-21T06:38:58.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.469+0000 7fce26b6f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fce20113900 con 0x7fce20108cf0 2024-09-21T06:38:58.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.469+0000 7fce26b6f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fce20113c00 con 0x7fce20102a60 2024-09-21T06:38:58.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.469+0000 7fce1ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce201083a0 0x7fce2019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:58.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.469+0000 7fce1ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce201083a0 0x7fce2019aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58778/0 (socket says 172.21.15.63:58778) 2024-09-21T06:38:58.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.469+0000 7fce1ffff640 1 -- 172.21.15.63:0/582464844 learned_addr learned my addr 172.21.15.63:0/582464844 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:38:58.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.469+0000 7fce2490b640 1 --2- 172.21.15.63:0/582464844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce20102a60 0x7fce2019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:58.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.470+0000 7fce2510c640 1 --2- 172.21.15.63:0/582464844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce20108cf0 0x7fce2019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:58.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.470+0000 7fce1ffff640 1 -- 172.21.15.63:0/582464844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce20102a60 msgr2=0x7fce2019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:58.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.470+0000 7fce1ffff640 1 --2- 172.21.15.63:0/582464844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce20102a60 0x7fce2019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:58.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.470+0000 7fce1ffff640 1 -- 172.21.15.63:0/582464844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce20108cf0 msgr2=0x7fce2019fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:58.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.470+0000 7fce1ffff640 1 --2- 172.21.15.63:0/582464844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce20108cf0 0x7fce2019fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:58.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.470+0000 7fce1ffff640 1 -- 172.21.15.63:0/582464844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce201a0480 con 0x7fce201083a0 2024-09-21T06:38:58.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.470+0000 7fce1ffff640 1 --2- 172.21.15.63:0/582464844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce201083a0 0x7fce2019aab0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fce08032fd0 tx=0x7fce08004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:58.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.470+0000 7fce1dffb640 1 -- 172.21.15.63:0/582464844 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0803f030 con 0x7fce201083a0 2024-09-21T06:38:58.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.470+0000 7fce1dffb640 1 -- 172.21.15.63:0/582464844 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce08004490 con 0x7fce201083a0 2024-09-21T06:38:58.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.470+0000 7fce26b6f640 1 -- 172.21.15.63:0/582464844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce201a0710 con 0x7fce201083a0 2024-09-21T06:38:58.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.470+0000 7fce1dffb640 1 -- 172.21.15.63:0/582464844 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce08035070 con 0x7fce201083a0 2024-09-21T06:38:58.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.470+0000 7fce26b6f640 1 -- 172.21.15.63:0/582464844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce201a6ed0 con 0x7fce201083a0 2024-09-21T06:38:58.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.472+0000 7fce26b6f640 1 -- 172.21.15.63:0/582464844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce20103ce0 con 0x7fce201083a0 2024-09-21T06:38:58.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.473+0000 7fce1dffb640 1 -- 172.21.15.63:0/582464844 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fce08042030 con 0x7fce201083a0 2024-09-21T06:38:58.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.474+0000 7fce1dffb640 1 --2- 172.21.15.63:0/582464844 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fce0c0b6680 0x7fce0c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:58.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.474+0000 7fce2490b640 1 --2- 172.21.15.63:0/582464844 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fce0c0b6680 0x7fce0c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:58.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.474+0000 7fce1dffb640 1 -- 172.21.15.63:0/582464844 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7fce08108060 con 0x7fce201083a0 2024-09-21T06:38:58.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.475+0000 7fce2490b640 1 --2- 172.21.15.63:0/582464844 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fce0c0b6680 0x7fce0c0b8b90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fce18005d00 tx=0x7fce1800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:58.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.478+0000 7fce1dffb640 1 -- 172.21.15.63:0/582464844 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce080d2940 con 0x7fce201083a0 2024-09-21T06:38:58.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.702+0000 7fce26b6f640 1 -- 172.21.15.63:0/582464844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce20102e70 con 0x7fce201083a0 2024-09-21T06:38:58.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.703+0000 7fce1dffb640 1 -- 172.21.15.63:0/582464844 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+11971 (secure 0 0 0) 0x7fce20102e70 con 0x7fce201083a0 2024-09-21T06:38:58.706 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:38:58.706 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":61,"btime":"2024-09-21T06:36:33:430596+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":61,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:36:32.513212+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24659,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":34,"state":"up:active","state_seq":69,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25637":{"gid":25637,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3354670524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3354670524},{"type":"v1","addr":"172.21.15.71:6839","nonce":3354670524}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24659,"qdb_cluster":[24694,24670,24659,24676,14835]},"id":1}]} 2024-09-21T06:38:58.706 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 61 2024-09-21T06:38:58.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.706+0000 7fce26b6f640 1 -- 172.21.15.63:0/582464844 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fce0c0b6680 msgr2=0x7fce0c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:58.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.706+0000 7fce26b6f640 1 --2- 172.21.15.63:0/582464844 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fce0c0b6680 0x7fce0c0b8b90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fce18005d00 tx=0x7fce1800b410 comp rx=0 tx=0).stop 2024-09-21T06:38:58.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.706+0000 7fce26b6f640 1 -- 172.21.15.63:0/582464844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce201083a0 msgr2=0x7fce2019aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:58.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.706+0000 7fce26b6f640 1 --2- 172.21.15.63:0/582464844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce201083a0 0x7fce2019aab0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fce08032fd0 tx=0x7fce08004270 comp rx=0 tx=0).stop 2024-09-21T06:38:58.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.706+0000 7fce26b6f640 1 -- 172.21.15.63:0/582464844 shutdown_connections 2024-09-21T06:38:58.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.706+0000 7fce26b6f640 1 --2- 172.21.15.63:0/582464844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce20108cf0 0x7fce2019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:58.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.706+0000 7fce26b6f640 1 --2- 172.21.15.63:0/582464844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce201083a0 0x7fce2019aab0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:58.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.706+0000 7fce26b6f640 1 --2- 172.21.15.63:0/582464844 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fce0c0b6680 0x7fce0c0b8b90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:58.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.706+0000 7fce26b6f640 1 --2- 172.21.15.63:0/582464844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce20102a60 0x7fce2019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:58.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.706+0000 7fce26b6f640 1 -- 172.21.15.63:0/582464844 >> 172.21.15.63:0/582464844 conn(0x7fce20079730 msgr2=0x7fce201052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:58.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.706+0000 7fce26b6f640 1 -- 172.21.15.63:0/582464844 shutdown_connections 2024-09-21T06:38:58.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:38:58.706+0000 7fce26b6f640 1 -- 172.21.15.63:0/582464844 wait complete. 2024-09-21T06:38:59.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:58 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/582464844' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:38:59.067 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:58 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/582464844' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:38:59.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:58 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/582464844' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:38:59.390 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T06:38:59.650 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:00.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:38:59 smithi071 ceph-mon[34844]: pgmap v654: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:39:00.038 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:38:59 smithi063 ceph-mon[31150]: pgmap v654: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:39:00.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:38:59 smithi175 ceph-mon[34510]: pgmap v654: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T06:39:00.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.130+0000 7f07957ed640 1 -- 172.21.15.63:0/1119489999 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079010de30 msgr2=0x7f0790110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:00.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.130+0000 7f07957ed640 1 --2- 172.21.15.63:0/1119489999 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079010de30 0x7f0790110320 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f0788009ca0 tx=0x7f078802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.130+0000 7f07957ed640 1 -- 172.21.15.63:0/1119489999 shutdown_connections 2024-09-21T06:39:00.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.130+0000 7f07957ed640 1 --2- 172.21.15.63:0/1119489999 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079010de30 0x7f0790110320 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.130+0000 7f07957ed640 1 --2- 172.21.15.63:0/1119489999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0790105320 0x7f079010d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.130+0000 7f07957ed640 1 --2- 172.21.15.63:0/1119489999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07901049d0 0x7f0790104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.130+0000 7f07957ed640 1 -- 172.21.15.63:0/1119489999 >> 172.21.15.63:0/1119489999 conn(0x7f0790079740 msgr2=0x7f0790079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:00.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.130+0000 7f07957ed640 1 -- 172.21.15.63:0/1119489999 shutdown_connections 2024-09-21T06:39:00.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.130+0000 7f07957ed640 1 -- 172.21.15.63:0/1119489999 wait complete. 2024-09-21T06:39:00.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.131+0000 7f07957ed640 1 Processor -- start 2024-09-21T06:39:00.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.131+0000 7f07957ed640 1 -- start start 2024-09-21T06:39:00.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.132+0000 7f07957ed640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07901049d0 0x7f0790102710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:00.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.132+0000 7f07957ed640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0790105320 0x7f0790102c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:00.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.132+0000 7f07957ed640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079010de30 0x7f0790103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:00.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.132+0000 7f07957ed640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0790113a90 con 0x7f079010de30 2024-09-21T06:39:00.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.132+0000 7f07957ed640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0790113910 con 0x7f07901049d0 2024-09-21T06:39:00.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.132+0000 7f07957ed640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0790113c10 con 0x7f0790105320 2024-09-21T06:39:00.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.132+0000 7f078f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079010de30 0x7f0790103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:00.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.132+0000 7f078f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079010de30 0x7f0790103190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58792/0 (socket says 172.21.15.63:58792) 2024-09-21T06:39:00.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.132+0000 7f078f7fe640 1 -- 172.21.15.63:0/1214709606 learned_addr learned my addr 172.21.15.63:0/1214709606 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:00.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.132+0000 7f078e7fc640 1 --2- 172.21.15.63:0/1214709606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0790105320 0x7f0790102c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:00.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.132+0000 7f078effd640 1 --2- 172.21.15.63:0/1214709606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07901049d0 0x7f0790102710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:00.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.132+0000 7f078f7fe640 1 -- 172.21.15.63:0/1214709606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0790105320 msgr2=0x7f0790102c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:00.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.132+0000 7f078f7fe640 1 --2- 172.21.15.63:0/1214709606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0790105320 0x7f0790102c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.132+0000 7f078f7fe640 1 -- 172.21.15.63:0/1214709606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07901049d0 msgr2=0x7f0790102710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:00.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.132+0000 7f078f7fe640 1 --2- 172.21.15.63:0/1214709606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07901049d0 0x7f0790102710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.132+0000 7f078f7fe640 1 -- 172.21.15.63:0/1214709606 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07901a86f0 con 0x7f079010de30 2024-09-21T06:39:00.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.132+0000 7f078f7fe640 1 --2- 172.21.15.63:0/1214709606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079010de30 0x7f0790103190 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f0788005cc0 tx=0x7f078802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:00.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.133+0000 7f0777fff640 1 -- 172.21.15.63:0/1214709606 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0788003bf0 con 0x7f079010de30 2024-09-21T06:39:00.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.133+0000 7f07957ed640 1 -- 172.21.15.63:0/1214709606 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07901a8980 con 0x7f079010de30 2024-09-21T06:39:00.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.133+0000 7f0777fff640 1 -- 172.21.15.63:0/1214709606 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0788003d90 con 0x7f079010de30 2024-09-21T06:39:00.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.133+0000 7f0777fff640 1 -- 172.21.15.63:0/1214709606 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078802fbc0 con 0x7f079010de30 2024-09-21T06:39:00.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.133+0000 7f07957ed640 1 -- 172.21.15.63:0/1214709606 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07901a8ec0 con 0x7f079010de30 2024-09-21T06:39:00.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.136+0000 7f079bd61740 1 Processor -- start 2024-09-21T06:39:00.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.136+0000 7f0777fff640 1 -- 172.21.15.63:0/1214709606 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f078802fd60 con 0x7f079010de30 2024-09-21T06:39:00.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.136+0000 7f079bd61740 1 -- start start 2024-09-21T06:39:00.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.136+0000 7f079bd61740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557054164070 0x55705450b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:00.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.136+0000 7f079bd61740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 0x55705450bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:00.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.136+0000 7f079bd61740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 0x55705450c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:00.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.136+0000 7f079bd61740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x557054481ea0 con 0x55705413b1b0 2024-09-21T06:39:00.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.136+0000 7f079bd61740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5570544712d0 con 0x557054143390 2024-09-21T06:39:00.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.136+0000 7f079bd61740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5570544750e0 con 0x557054164070 2024-09-21T06:39:00.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.137+0000 7f078effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 0x55705450bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:00.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.137+0000 7f078effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 0x55705450bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58804/0 (socket says 172.21.15.63:58804) 2024-09-21T06:39:00.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.137+0000 7f078effd640 1 -- 172.21.15.63:0/1488852813 learned_addr learned my addr 172.21.15.63:0/1488852813 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:00.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.137+0000 7f078e7fc640 1 --2- 172.21.15.63:0/1488852813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557054164070 0x55705450b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:00.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.137+0000 7f078e7fc640 1 --2- 172.21.15.63:0/1488852813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 0x55705450c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:00.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.137+0000 7f0777fff640 1 --2- 172.21.15.63:0/1214709606 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f07780b6680 0x7f07780b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:00.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.137+0000 7f078effd640 1 -- 172.21.15.63:0/1488852813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557054164070 msgr2=0x55705450b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:00.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.137+0000 7f078effd640 1 --2- 172.21.15.63:0/1488852813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557054164070 0x55705450b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.137+0000 7f078effd640 1 -- 172.21.15.63:0/1488852813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 msgr2=0x55705450c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:00.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.137+0000 7f078effd640 1 --2- 172.21.15.63:0/1488852813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 0x55705450c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.137+0000 7f078effd640 1 -- 172.21.15.63:0/1488852813 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570541cf650 con 0x55705413b1b0 2024-09-21T06:39:00.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.137+0000 7f078f7fe640 1 --2- 172.21.15.63:0/1214709606 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f07780b6680 0x7f07780b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:00.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.137+0000 7f078effd640 1 --2- 172.21.15.63:0/1488852813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 0x55705450bbe0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f078000ac30 tx=0x7f078000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38dfde227f629b1c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:00.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.137+0000 7f0777fff640 1 -- 172.21.15.63:0/1214709606 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f0788108c40 con 0x7f079010de30 2024-09-21T06:39:00.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.137+0000 7f07757fa640 1 -- 172.21.15.63:0/1488852813 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0780005220 con 0x55705413b1b0 2024-09-21T06:39:00.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.138+0000 7f07757fa640 1 -- 172.21.15.63:0/1488852813 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0780004c50 con 0x55705413b1b0 2024-09-21T06:39:00.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.138+0000 7f07757fa640 1 -- 172.21.15.63:0/1488852813 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07800187a0 con 0x55705413b1b0 2024-09-21T06:39:00.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.138+0000 7f079bd61740 1 -- 172.21.15.63:0/1488852813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 msgr2=0x55705450bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:00.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.138+0000 7f078f7fe640 1 --2- 172.21.15.63:0/1214709606 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f07780b6680 0x7f07780b8b90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f07881063f0 tx=0x7f07880f2040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:00.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.138+0000 7f079bd61740 1 --2- 172.21.15.63:0/1488852813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 0x55705450bbe0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f078000ac30 tx=0x7f078000f790 comp rx=0 tx=0).stop 2024-09-21T06:39:00.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.138+0000 7f079bd61740 1 -- 172.21.15.63:0/1488852813 shutdown_connections 2024-09-21T06:39:00.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.138+0000 7f079bd61740 1 --2- 172.21.15.63:0/1488852813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 0x55705450c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.138+0000 7f079bd61740 1 --2- 172.21.15.63:0/1488852813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 0x55705450bbe0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.138+0000 7f079bd61740 1 --2- 172.21.15.63:0/1488852813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557054164070 0x55705450b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.138+0000 7f079bd61740 1 -- 172.21.15.63:0/1488852813 >> 172.21.15.63:0/1488852813 conn(0x557054158460 msgr2=0x557054509590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:00.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.139+0000 7f079bd61740 1 -- 172.21.15.63:0/1488852813 shutdown_connections 2024-09-21T06:39:00.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.139+0000 7f079bd61740 1 -- 172.21.15.63:0/1488852813 wait complete. 2024-09-21T06:39:00.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.139+0000 7f079bd61740 1 -- start start 2024-09-21T06:39:00.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.139+0000 7f079bd61740 1 Processor -- start 2024-09-21T06:39:00.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.139+0000 7f079bd61740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 0x557054516cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:00.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.139+0000 7f079bd61740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 0x557054517200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:00.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.139+0000 7f079bd61740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557054164070 0x557054517740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:00.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.139+0000 7f079bd61740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5570542d2700 con 0x55705413b1b0 2024-09-21T06:39:00.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.139+0000 7f079bd61740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55705440c160 con 0x557054143390 2024-09-21T06:39:00.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.139+0000 7f079bd61740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557054519e80 con 0x557054164070 2024-09-21T06:39:00.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.139+0000 7f079bd61740 10 client.0 _ll_register_callbacks cb 0x5570544259e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:00.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.140+0000 7f078e7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 0x557054516cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:00.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.140+0000 7f078e7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 0x557054516cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58816/0 (socket says 172.21.15.63:58816) 2024-09-21T06:39:00.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.140+0000 7f078e7fc640 1 -- 172.21.15.63:0/2006210638 learned_addr learned my addr 172.21.15.63:0/2006210638 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:00.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.140+0000 7f078effd640 1 --2- 172.21.15.63:0/2006210638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 0x557054517200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:00.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.140+0000 7f078e7fc640 1 -- 172.21.15.63:0/2006210638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557054164070 msgr2=0x557054517740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:00.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.140+0000 7f078e7fc640 1 --2- 172.21.15.63:0/2006210638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557054164070 0x557054517740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.140+0000 7f078e7fc640 1 -- 172.21.15.63:0/2006210638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 msgr2=0x557054517200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:00.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.140+0000 7f078e7fc640 1 --2- 172.21.15.63:0/2006210638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 0x557054517200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.140+0000 7f078e7fc640 1 -- 172.21.15.63:0/2006210638 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557054439c90 con 0x55705413b1b0 2024-09-21T06:39:00.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.140+0000 7f078effd640 1 --2- 172.21.15.63:0/2006210638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 0x557054517200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:39:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.140+0000 7f078e7fc640 1 --2- 172.21.15.63:0/2006210638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 0x557054516cc0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f07840043e0 tx=0x7f07840039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f530c4dcd4f4365 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.140+0000 7f0772ff5640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:39:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.140+0000 7f0772ff5640 1 -- 172.21.15.63:0/2006210638 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784005020 con 0x55705413b1b0 2024-09-21T06:39:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.140+0000 7f079bd61740 1 -- 172.21.15.63:0/2006210638 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0780004c50 con 0x55705413b1b0 2024-09-21T06:39:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.140+0000 7f0772ff5640 1 -- 172.21.15.63:0/2006210638 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f07840051c0 con 0x55705413b1b0 2024-09-21T06:39:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.140+0000 7f0772ff5640 1 -- 172.21.15.63:0/2006210638 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f07840053c0 con 0x55705413b1b0 2024-09-21T06:39:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.140+0000 7f079bd61740 10 client.17670 fetch_fsmap learned FSMap version 61 2024-09-21T06:39:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.141+0000 7f079bd61740 1 -- 172.21.15.63:0/2006210638 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x557054525b50 con 0x55705413b1b0 2024-09-21T06:39:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.141+0000 7f0772ff5640 1 -- 172.21.15.63:0/2006210638 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0780004c50 con 0x55705413b1b0 2024-09-21T06:39:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.141+0000 7f0772ff5640 1 -- 172.21.15.63:0/2006210638 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f0784012860 con 0x55705413b1b0 2024-09-21T06:39:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.141+0000 7f079bd61740 10 client.17670 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:39:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.141+0000 7f079bd61740 10 client.17670 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:39:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.141+0000 7f079bd61740 20 client.17670 populate_metadata read hostname 'smithi063' 2024-09-21T06:39:00.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.141+0000 7f079bd61740 1 --2- 172.21.15.63:0/2006210638 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5570541229f0 0x557054528fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:00.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.141+0000 7f079bd61740 4 client.17670 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:00.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.141+0000 7f079bd61740 1 -- 172.21.15.63:0/2006210638 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557054483df0 con 0x5570541229f0 2024-09-21T06:39:00.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.141+0000 7f078effd640 1 --2- 172.21.15.63:0/2006210638 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5570541229f0 0x557054528fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:00.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.141+0000 7f0772ff5640 10 client.17670 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:39:00.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.141+0000 7f078effd640 1 --2- 172.21.15.63:0/2006210638 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5570541229f0 0x557054528fd0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3a92b3c58066c6f8 server_cookie=e34b9c17e4bee093 in_seq=0 out_seq=0 2024-09-21T06:39:00.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.142+0000 7f0772ff5640 1 -- 172.21.15.63:0/2006210638 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557054483df0 con 0x5570541229f0 2024-09-21T06:39:00.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.142+0000 7f0772ff5640 10 client.17670 handle_command_reply: tid=0 2024-09-21T06:39:00.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.142+0000 7f079bd61740 1 client.17670 shutdown 2024-09-21T06:39:00.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.142+0000 7f079bd61740 1 -- 172.21.15.63:0/2006210638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 msgr2=0x557054516cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:00.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.142+0000 7f079bd61740 1 --2- 172.21.15.63:0/2006210638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 0x557054516cc0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f07840043e0 tx=0x7f07840039c0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.142+0000 7f079bd61740 1 -- 172.21.15.63:0/2006210638 shutdown_connections 2024-09-21T06:39:00.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.142+0000 7f079bd61740 1 --2- 172.21.15.63:0/2006210638 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5570541229f0 0x557054528fd0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.142+0000 7f079bd61740 1 --2- 172.21.15.63:0/2006210638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557054164070 0x557054517740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.142+0000 7f079bd61740 1 --2- 172.21.15.63:0/2006210638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 0x557054517200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.142+0000 7f0772ff5640 0 client.17670 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:39:00.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.142+0000 7f079bd61740 1 --2- 172.21.15.63:0/2006210638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 0x557054516cc0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.142+0000 7f079bd61740 1 -- 172.21.15.63:0/2006210638 >> 172.21.15.63:0/2006210638 conn(0x557054158460 msgr2=0x55705450e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:00.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.142+0000 7f079bd61740 1 -- 172.21.15.63:0/2006210638 shutdown_connections 2024-09-21T06:39:00.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.142+0000 7f079bd61740 1 -- 172.21.15.63:0/2006210638 wait complete. 2024-09-21T06:39:00.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.143+0000 7f079bd61740 20 client.17670 trim_cache size 0 max 16384 2024-09-21T06:39:00.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.156+0000 7f079bd61740 1 Processor -- start 2024-09-21T06:39:00.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.156+0000 7f079bd61740 1 -- start start 2024-09-21T06:39:00.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.156+0000 7f079bd61740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55705413b1b0 0x55705450d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:00.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.156+0000 7f079bd61740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 0x5570545188f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:00.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.156+0000 7f079bd61740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557054164070 0x557054508bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:00.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.156+0000 7f079bd61740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f07901b1990 con 0x557054164070 2024-09-21T06:39:00.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.156+0000 7f079bd61740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f07901b34d0 con 0x557054143390 2024-09-21T06:39:00.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.156+0000 7f079bd61740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f07901b2060 con 0x55705413b1b0 2024-09-21T06:39:00.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.156+0000 7f078e7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557054164070 0x557054508bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:00.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.156+0000 7f078e7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557054164070 0x557054508bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58822/0 (socket says 172.21.15.63:58822) 2024-09-21T06:39:00.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.156+0000 7f078e7fc640 1 -- 172.21.15.63:0/2540501805 learned_addr learned my addr 172.21.15.63:0/2540501805 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:00.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.156+0000 7f078effd640 1 --2- 172.21.15.63:0/2540501805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 0x5570545188f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:00.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.156+0000 7f078e7fc640 1 --2- 172.21.15.63:0/2540501805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55705413b1b0 0x55705450d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:00.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.156+0000 7f078e7fc640 1 -- 172.21.15.63:0/2540501805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55705413b1b0 msgr2=0x55705450d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:00.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.156+0000 7f078e7fc640 1 --2- 172.21.15.63:0/2540501805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55705413b1b0 0x55705450d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.156+0000 7f078e7fc640 1 -- 172.21.15.63:0/2540501805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 msgr2=0x5570545188f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:00.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.156+0000 7f078e7fc640 1 --2- 172.21.15.63:0/2540501805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 0x5570545188f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.156+0000 7f078e7fc640 1 -- 172.21.15.63:0/2540501805 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55705450dbc0 con 0x557054164070 2024-09-21T06:39:00.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.157+0000 7f078e7fc640 1 --2- 172.21.15.63:0/2540501805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557054164070 0x557054508bc0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f078400b6b0 tx=0x7f078400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25222819b6654d42 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:00.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.157+0000 7f0774ff9640 1 -- 172.21.15.63:0/2540501805 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078402d050 con 0x557054164070 2024-09-21T06:39:00.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.157+0000 7f0774ff9640 1 -- 172.21.15.63:0/2540501805 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f078400be30 con 0x557054164070 2024-09-21T06:39:00.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.157+0000 7f0774ff9640 1 -- 172.21.15.63:0/2540501805 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784004730 con 0x557054164070 2024-09-21T06:39:00.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.158+0000 7f079bd61740 1 -- 172.21.15.63:0/2540501805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557054164070 msgr2=0x557054508bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:00.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.158+0000 7f079bd61740 1 --2- 172.21.15.63:0/2540501805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557054164070 0x557054508bc0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f078400b6b0 tx=0x7f078400b5b0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.158+0000 7f079bd61740 1 -- 172.21.15.63:0/2540501805 shutdown_connections 2024-09-21T06:39:00.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.158+0000 7f079bd61740 1 --2- 172.21.15.63:0/2540501805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557054164070 0x557054508bc0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.158+0000 7f079bd61740 1 --2- 172.21.15.63:0/2540501805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 0x5570545188f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.158+0000 7f079bd61740 1 --2- 172.21.15.63:0/2540501805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55705413b1b0 0x55705450d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.158+0000 7f079bd61740 1 -- 172.21.15.63:0/2540501805 >> 172.21.15.63:0/2540501805 conn(0x557054158460 msgr2=0x5570545181e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:00.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.158+0000 7f079bd61740 1 -- 172.21.15.63:0/2540501805 shutdown_connections 2024-09-21T06:39:00.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.158+0000 7f079bd61740 1 -- 172.21.15.63:0/2540501805 wait complete. 2024-09-21T06:39:00.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.158+0000 7f079bd61740 1 -- start start 2024-09-21T06:39:00.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.158+0000 7f079bd61740 1 Processor -- start 2024-09-21T06:39:00.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.158+0000 7f079bd61740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 0x55705451fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:00.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.158+0000 7f079bd61740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 0x55705451af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:00.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.158+0000 7f079bd61740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557054164070 0x55705451b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:00.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.158+0000 7f079bd61740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f07901b2e00 con 0x55705413b1b0 2024-09-21T06:39:00.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.158+0000 7f079bd61740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f07901b2730 con 0x557054143390 2024-09-21T06:39:00.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.158+0000 7f079bd61740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f07901af990 con 0x557054164070 2024-09-21T06:39:00.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.158+0000 7f079bd61740 10 client.0 _ll_register_callbacks cb 0x7f0784004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:00.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.158+0000 7f078e7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 0x55705451fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:00.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.159+0000 7f078e7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 0x55705451fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58830/0 (socket says 172.21.15.63:58830) 2024-09-21T06:39:00.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.159+0000 7f078e7fc640 1 -- 172.21.15.63:0/1320382955 learned_addr learned my addr 172.21.15.63:0/1320382955 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:00.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.159+0000 7f078e7fc640 1 --2- 172.21.15.63:0/1320382955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557054164070 0x55705451b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:00.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.159+0000 7f078effd640 1 --2- 172.21.15.63:0/1320382955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 0x55705451af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:00.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.159+0000 7f078e7fc640 1 -- 172.21.15.63:0/1320382955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557054164070 msgr2=0x55705451b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:00.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.159+0000 7f078e7fc640 1 --2- 172.21.15.63:0/1320382955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557054164070 0x55705451b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.159+0000 7f078e7fc640 1 -- 172.21.15.63:0/1320382955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 msgr2=0x55705451af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:00.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.159+0000 7f078e7fc640 1 --2- 172.21.15.63:0/1320382955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 0x55705451af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.159+0000 7f078e7fc640 1 -- 172.21.15.63:0/1320382955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557054592a20 con 0x55705413b1b0 2024-09-21T06:39:00.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.159+0000 7f078e7fc640 1 --2- 172.21.15.63:0/1320382955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 0x55705451fac0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f078400b3d0 tx=0x7f0784005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77965b88824f11de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:00.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.159+0000 7f0772ff5640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:39:00.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.159+0000 7f0772ff5640 1 -- 172.21.15.63:0/1320382955 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078401b040 con 0x55705413b1b0 2024-09-21T06:39:00.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.159+0000 7f0772ff5640 1 -- 172.21.15.63:0/1320382955 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f0784004650 con 0x55705413b1b0 2024-09-21T06:39:00.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.159+0000 7f079bd61740 1 -- 172.21.15.63:0/1320382955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f078400be30 con 0x55705413b1b0 2024-09-21T06:39:00.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.159+0000 7f0772ff5640 1 -- 172.21.15.63:0/1320382955 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f078402d040 con 0x55705413b1b0 2024-09-21T06:39:00.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.159+0000 7f079bd61740 10 client.17676 fetch_fsmap learned FSMap version 61 2024-09-21T06:39:00.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.159+0000 7f079bd61740 1 -- 172.21.15.63:0/1320382955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x557054593b10 con 0x55705413b1b0 2024-09-21T06:39:00.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.160+0000 7f0772ff5640 1 -- 172.21.15.63:0/1320382955 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f078400be30 con 0x55705413b1b0 2024-09-21T06:39:00.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.160+0000 7f0772ff5640 1 -- 172.21.15.63:0/1320382955 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f0784032040 con 0x55705413b1b0 2024-09-21T06:39:00.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.160+0000 7f079bd61740 10 client.17676 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:39:00.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.160+0000 7f079bd61740 10 client.17676 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-21T06:39:00.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.160+0000 7f079bd61740 20 client.17676 populate_metadata read hostname 'smithi063' 2024-09-21T06:39:00.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.160+0000 7f079bd61740 1 --2- 172.21.15.63:0/1320382955 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5570540f7da0 0x557054596220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:00.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.160+0000 7f079bd61740 4 client.17676 mds_command: new command op to 14835 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:39:00.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.160+0000 7f079bd61740 1 -- 172.21.15.63:0/1320382955 --> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55705447f8a0 con 0x5570540f7da0 2024-09-21T06:39:00.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.160+0000 7f078effd640 1 --2- 172.21.15.63:0/1320382955 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5570540f7da0 0x557054596220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:00.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.160+0000 7f078effd640 1 --2- 172.21.15.63:0/1320382955 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5570540f7da0 0x557054596220 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a92db6604b8c9279 server_cookie=1c74aeb36f20b93a in_seq=0 out_seq=0 2024-09-21T06:39:00.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.160+0000 7f0772ff5640 10 client.17676 ms_handle_connect on v2:172.21.15.63:6840/1426680017 2024-09-21T06:39:00.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.160+0000 7f0772ff5640 1 -- 172.21.15.63:0/1320382955 <== mds.4 v2:172.21.15.63:6840/1426680017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55705447f8a0 con 0x5570540f7da0 2024-09-21T06:39:00.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.160+0000 7f0772ff5640 10 client.17676 handle_command_reply: tid=0 2024-09-21T06:39:00.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.160+0000 7f079bd61740 1 client.17676 shutdown 2024-09-21T06:39:00.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.161+0000 7f079bd61740 1 -- 172.21.15.63:0/1320382955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 msgr2=0x55705451fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:00.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.161+0000 7f079bd61740 1 --2- 172.21.15.63:0/1320382955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 0x55705451fac0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f078400b3d0 tx=0x7f0784005850 comp rx=0 tx=0).stop 2024-09-21T06:39:00.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.161+0000 7f079bd61740 1 -- 172.21.15.63:0/1320382955 shutdown_connections 2024-09-21T06:39:00.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.161+0000 7f079bd61740 1 --2- 172.21.15.63:0/1320382955 >> [v2:172.21.15.63:6840/1426680017,v1:172.21.15.63:6841/1426680017] conn(0x5570540f7da0 0x557054596220 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.161+0000 7f0772ff5640 0 client.17676 ms_handle_reset on v2:172.21.15.63:6840/1426680017 2024-09-21T06:39:00.188 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:39:00.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.161+0000 7f079bd61740 1 --2- 172.21.15.63:0/1320382955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557054164070 0x55705451b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.161+0000 7f079bd61740 1 --2- 172.21.15.63:0/1320382955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557054143390 0x55705451af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.161+0000 7f079bd61740 1 --2- 172.21.15.63:0/1320382955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55705413b1b0 0x55705451fac0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.161+0000 7f079bd61740 1 -- 172.21.15.63:0/1320382955 >> 172.21.15.63:0/1320382955 conn(0x557054158460 msgr2=0x557054518b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:00.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.161+0000 7f079bd61740 1 -- 172.21.15.63:0/1320382955 shutdown_connections 2024-09-21T06:39:00.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.161+0000 7f079bd61740 1 -- 172.21.15.63:0/1320382955 wait complete. 2024-09-21T06:39:00.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.161+0000 7f079bd61740 20 client.17676 trim_cache size 0 max 16384 2024-09-21T06:39:00.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.161+0000 7f07957ed640 1 -- 172.21.15.63:0/1214709606 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f07780b6680 msgr2=0x7f07780b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:00.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.161+0000 7f07957ed640 1 --2- 172.21.15.63:0/1214709606 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f07780b6680 0x7f07780b8b90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f07881063f0 tx=0x7f07880f2040 comp rx=0 tx=0).stop 2024-09-21T06:39:00.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.161+0000 7f07957ed640 1 -- 172.21.15.63:0/1214709606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079010de30 msgr2=0x7f0790103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:00.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.161+0000 7f07957ed640 1 --2- 172.21.15.63:0/1214709606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079010de30 0x7f0790103190 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f0788005cc0 tx=0x7f078802f380 comp rx=0 tx=0).stop 2024-09-21T06:39:00.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.162+0000 7f07957ed640 1 -- 172.21.15.63:0/1214709606 shutdown_connections 2024-09-21T06:39:00.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.162+0000 7f07957ed640 1 --2- 172.21.15.63:0/1214709606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079010de30 0x7f0790103190 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.162+0000 7f07957ed640 1 --2- 172.21.15.63:0/1214709606 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f07780b6680 0x7f07780b8b90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.162+0000 7f07957ed640 1 --2- 172.21.15.63:0/1214709606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0790105320 0x7f0790102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.162+0000 7f07957ed640 1 --2- 172.21.15.63:0/1214709606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07901049d0 0x7f0790102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:00.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.162+0000 7f07957ed640 1 -- 172.21.15.63:0/1214709606 >> 172.21.15.63:0/1214709606 conn(0x7f0790079740 msgr2=0x7f07900ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:00.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.162+0000 7f07957ed640 1 -- 172.21.15.63:0/1214709606 shutdown_connections 2024-09-21T06:39:00.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:00.162+0000 7f07957ed640 1 -- 172.21.15.63:0/1214709606 wait complete. 2024-09-21T06:39:00.832 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:39:01.087 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.606+0000 7f8f5ab4f640 1 -- 172.21.15.63:0/1770118247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f54103bb0 msgr2=0x7f8f54103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.606+0000 7f8f5ab4f640 1 --2- 172.21.15.63:0/1770118247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f54103bb0 0x7f8f54103fc0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f8f48009900 tx=0x7f8f4802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.606+0000 7f8f5ab4f640 1 -- 172.21.15.63:0/1770118247 shutdown_connections 2024-09-21T06:39:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.606+0000 7f8f5ab4f640 1 --2- 172.21.15.63:0/1770118247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f54109e40 0x7f8f54110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.606+0000 7f8f5ab4f640 1 --2- 172.21.15.63:0/1770118247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f541094f0 0x7f8f54109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.606+0000 7f8f5ab4f640 1 --2- 172.21.15.63:0/1770118247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f54103bb0 0x7f8f54103fc0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.606+0000 7f8f5ab4f640 1 -- 172.21.15.63:0/1770118247 >> 172.21.15.63:0/1770118247 conn(0x7f8f540ff600 msgr2=0x7f8f54101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.606+0000 7f8f5ab4f640 1 -- 172.21.15.63:0/1770118247 shutdown_connections 2024-09-21T06:39:01.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.606+0000 7f8f5ab4f640 1 -- 172.21.15.63:0/1770118247 wait complete. 2024-09-21T06:39:01.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.607+0000 7f8f5ab4f640 1 Processor -- start 2024-09-21T06:39:01.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.607+0000 7f8f5ab4f640 1 -- start start 2024-09-21T06:39:01.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.607+0000 7f8f5ab4f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f54103bb0 0x7f8f5419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:01.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.607+0000 7f8f5ab4f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f541094f0 0x7f8f5419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:01.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.607+0000 7f8f5ab4f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f54109e40 0x7f8f5419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:01.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.607+0000 7f8f5ab4f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8f54113b00 con 0x7f8f541094f0 2024-09-21T06:39:01.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.607+0000 7f8f5ab4f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8f54113980 con 0x7f8f54103bb0 2024-09-21T06:39:01.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.607+0000 7f8f5ab4f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8f54113c80 con 0x7f8f54109e40 2024-09-21T06:39:01.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.607+0000 7f8f53fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f541094f0 0x7f8f5419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:01.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.607+0000 7f8f53fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f541094f0 0x7f8f5419aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58854/0 (socket says 172.21.15.63:58854) 2024-09-21T06:39:01.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.608+0000 7f8f53fff640 1 -- 172.21.15.63:0/3799473892 learned_addr learned my addr 172.21.15.63:0/3799473892 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:01.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.608+0000 7f8f588eb640 1 --2- 172.21.15.63:0/3799473892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f54103bb0 0x7f8f5419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:01.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.608+0000 7f8f590ec640 1 --2- 172.21.15.63:0/3799473892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f54109e40 0x7f8f5419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:01.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.608+0000 7f8f53fff640 1 -- 172.21.15.63:0/3799473892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f54109e40 msgr2=0x7f8f5419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:01.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.608+0000 7f8f53fff640 1 --2- 172.21.15.63:0/3799473892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f54109e40 0x7f8f5419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.608+0000 7f8f53fff640 1 -- 172.21.15.63:0/3799473892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f54103bb0 msgr2=0x7f8f5419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:01.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.608+0000 7f8f53fff640 1 --2- 172.21.15.63:0/3799473892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f54103bb0 0x7f8f5419a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.608+0000 7f8f53fff640 1 -- 172.21.15.63:0/3799473892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f541a03a0 con 0x7f8f541094f0 2024-09-21T06:39:01.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.608+0000 7f8f590ec640 1 --2- 172.21.15.63:0/3799473892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f54109e40 0x7f8f5419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:39:01.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.608+0000 7f8f588eb640 1 --2- 172.21.15.63:0/3799473892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f54103bb0 0x7f8f5419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:01.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.608+0000 7f8f53fff640 1 --2- 172.21.15.63:0/3799473892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f541094f0 0x7f8f5419aa90 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000c970 tx=0x7f8f4000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:01.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.608+0000 7f8f51ffb640 1 -- 172.21.15.63:0/3799473892 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40007bb0 con 0x7f8f541094f0 2024-09-21T06:39:01.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.608+0000 7f8f51ffb640 1 -- 172.21.15.63:0/3799473892 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f40007d50 con 0x7f8f541094f0 2024-09-21T06:39:01.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.608+0000 7f8f5ab4f640 1 -- 172.21.15.63:0/3799473892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f541a0690 con 0x7f8f541094f0 2024-09-21T06:39:01.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.608+0000 7f8f51ffb640 1 -- 172.21.15.63:0/3799473892 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4000f450 con 0x7f8f541094f0 2024-09-21T06:39:01.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.608+0000 7f8f5ab4f640 1 -- 172.21.15.63:0/3799473892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f541a6eb0 con 0x7f8f541094f0 2024-09-21T06:39:01.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.611+0000 7f8f610c3740 1 Processor -- start 2024-09-21T06:39:01.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.611+0000 7f8f610c3740 1 -- start start 2024-09-21T06:39:01.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.611+0000 7f8f51ffb640 1 -- 172.21.15.63:0/3799473892 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f8f40004eb0 con 0x7f8f541094f0 2024-09-21T06:39:01.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.611+0000 7f8f610c3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e609304070 0x55e6096ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:01.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.611+0000 7f8f610c3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092db1b0 0x55e6096abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:01.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.611+0000 7f8f610c3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092e3390 0x55e6096ac120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:01.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.611+0000 7f8f610c3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55e609621ea0 con 0x55e609304070 2024-09-21T06:39:01.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.611+0000 7f8f610c3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e6096112d0 con 0x55e6092e3390 2024-09-21T06:39:01.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.611+0000 7f8f610c3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e6096150e0 con 0x55e6092db1b0 2024-09-21T06:39:01.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.612+0000 7f8f590ec640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e609304070 0x55e6096ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:01.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.612+0000 7f8f590ec640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e609304070 0x55e6096ab6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58868/0 (socket says 172.21.15.63:58868) 2024-09-21T06:39:01.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.612+0000 7f8f590ec640 1 -- 172.21.15.63:0/295141275 learned_addr learned my addr 172.21.15.63:0/295141275 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:01.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.612+0000 7f8f588eb640 1 --2- 172.21.15.63:0/295141275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092db1b0 0x55e6096abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:01.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.612+0000 7f8f53fff640 1 --2- 172.21.15.63:0/295141275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092e3390 0x55e6096ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:01.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.612+0000 7f8f590ec640 1 -- 172.21.15.63:0/295141275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092db1b0 msgr2=0x55e6096abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:01.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.612+0000 7f8f590ec640 1 --2- 172.21.15.63:0/295141275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092db1b0 0x55e6096abbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.612+0000 7f8f590ec640 1 -- 172.21.15.63:0/295141275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092e3390 msgr2=0x55e6096ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:01.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.612+0000 7f8f590ec640 1 --2- 172.21.15.63:0/295141275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092e3390 0x55e6096ac120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.612+0000 7f8f590ec640 1 -- 172.21.15.63:0/295141275 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e60936f650 con 0x55e609304070 2024-09-21T06:39:01.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.612+0000 7f8f51ffb640 1 --2- 172.21.15.63:0/3799473892 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8f440b66b0 0x7f8f440b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:01.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.612+0000 7f8f590ec640 1 --2- 172.21.15.63:0/295141275 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e609304070 0x55e6096ab6a0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c008e60 tx=0x7f8f4c00d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a4ab3b933b935 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:01.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.612+0000 7f8f588eb640 1 --2- 172.21.15.63:0/3799473892 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8f440b66b0 0x7f8f440b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:01.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.612+0000 7f8f51ffb640 1 -- 172.21.15.63:0/3799473892 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f8f400e7530 con 0x7f8f541094f0 2024-09-21T06:39:01.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.612+0000 7f8f3effd640 1 -- 172.21.15.63:0/295141275 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c00f830 con 0x55e609304070 2024-09-21T06:39:01.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.612+0000 7f8f3effd640 1 -- 172.21.15.63:0/295141275 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f4c018480 con 0x55e609304070 2024-09-21T06:39:01.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.612+0000 7f8f3effd640 1 -- 172.21.15.63:0/295141275 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c00e610 con 0x55e609304070 2024-09-21T06:39:01.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.613+0000 7f8f610c3740 1 -- 172.21.15.63:0/295141275 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e609304070 msgr2=0x55e6096ab6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:01.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.613+0000 7f8f588eb640 1 --2- 172.21.15.63:0/3799473892 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8f440b66b0 0x7f8f440b8bc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8f48031440 tx=0x7f8f48005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:01.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.613+0000 7f8f610c3740 1 --2- 172.21.15.63:0/295141275 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e609304070 0x55e6096ab6a0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c008e60 tx=0x7f8f4c00d710 comp rx=0 tx=0).stop 2024-09-21T06:39:01.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.613+0000 7f8f610c3740 1 -- 172.21.15.63:0/295141275 shutdown_connections 2024-09-21T06:39:01.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.613+0000 7f8f610c3740 1 --2- 172.21.15.63:0/295141275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092e3390 0x55e6096ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.613+0000 7f8f610c3740 1 --2- 172.21.15.63:0/295141275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092db1b0 0x55e6096abbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.613+0000 7f8f610c3740 1 --2- 172.21.15.63:0/295141275 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e609304070 0x55e6096ab6a0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.613+0000 7f8f610c3740 1 -- 172.21.15.63:0/295141275 >> 172.21.15.63:0/295141275 conn(0x55e6092f8460 msgr2=0x55e6096a9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:01.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.614+0000 7f8f610c3740 1 -- 172.21.15.63:0/295141275 shutdown_connections 2024-09-21T06:39:01.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.614+0000 7f8f610c3740 1 -- 172.21.15.63:0/295141275 wait complete. 2024-09-21T06:39:01.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.614+0000 7f8f610c3740 1 -- start start 2024-09-21T06:39:01.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.614+0000 7f8f610c3740 1 Processor -- start 2024-09-21T06:39:01.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.615+0000 7f8f610c3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092db1b0 0x55e6096b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:01.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.615+0000 7f8f610c3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092e3390 0x55e6096b7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:01.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.615+0000 7f8f610c3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e609304070 0x55e6096c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:01.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.615+0000 7f8f610c3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55e609472700 con 0x55e609304070 2024-09-21T06:39:01.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.615+0000 7f8f610c3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e6095ac160 con 0x55e6092db1b0 2024-09-21T06:39:01.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.615+0000 7f8f610c3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e6096b9e80 con 0x55e6092e3390 2024-09-21T06:39:01.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.615+0000 7f8f610c3740 10 client.0 _ll_register_callbacks cb 0x55e6095c59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:01.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.615+0000 7f8f590ec640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e609304070 0x55e6096c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:01.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.615+0000 7f8f590ec640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e609304070 0x55e6096c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58874/0 (socket says 172.21.15.63:58874) 2024-09-21T06:39:01.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.615+0000 7f8f590ec640 1 -- 172.21.15.63:0/3603944127 learned_addr learned my addr 172.21.15.63:0/3603944127 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:01.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.615+0000 7f8f588eb640 1 --2- 172.21.15.63:0/3603944127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092db1b0 0x55e6096b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:01.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.615+0000 7f8f53fff640 1 --2- 172.21.15.63:0/3603944127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092e3390 0x55e6096b7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:01.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.615+0000 7f8f590ec640 1 -- 172.21.15.63:0/3603944127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092e3390 msgr2=0x55e6096b7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:01.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.615+0000 7f8f590ec640 1 --2- 172.21.15.63:0/3603944127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092e3390 0x55e6096b7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.615+0000 7f8f590ec640 1 -- 172.21.15.63:0/3603944127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092db1b0 msgr2=0x55e6096b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:01.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.615+0000 7f8f590ec640 1 --2- 172.21.15.63:0/3603944127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092db1b0 0x55e6096b6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.615+0000 7f8f590ec640 1 -- 172.21.15.63:0/3603944127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6095d9c90 con 0x55e609304070 2024-09-21T06:39:01.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.615+0000 7f8f588eb640 1 --2- 172.21.15.63:0/3603944127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092db1b0 0x55e6096b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:39:01.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.615+0000 7f8f590ec640 1 --2- 172.21.15.63:0/3603944127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e609304070 0x55e6096c3170 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c018ec0 tx=0x7f8f4c00dfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fa2a0f33d67e90 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:01.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.615+0000 7f8f33fff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:39:01.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.616+0000 7f8f33fff640 1 -- 172.21.15.63:0/3603944127 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c004c50 con 0x55e609304070 2024-09-21T06:39:01.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.616+0000 7f8f33fff640 1 -- 172.21.15.63:0/3603944127 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f8f4c004df0 con 0x55e609304070 2024-09-21T06:39:01.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.616+0000 7f8f610c3740 1 -- 172.21.15.63:0/3603944127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f4c018480 con 0x55e609304070 2024-09-21T06:39:01.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.616+0000 7f8f33fff640 1 -- 172.21.15.63:0/3603944127 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f8f4c02e050 con 0x55e609304070 2024-09-21T06:39:01.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.616+0000 7f8f610c3740 10 client.17688 fetch_fsmap learned FSMap version 61 2024-09-21T06:39:01.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.616+0000 7f8f610c3740 1 -- 172.21.15.63:0/3603944127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55e6096c5b70 con 0x55e609304070 2024-09-21T06:39:01.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.616+0000 7f8f33fff640 1 -- 172.21.15.63:0/3603944127 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f4c018480 con 0x55e609304070 2024-09-21T06:39:01.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.616+0000 7f8f33fff640 1 -- 172.21.15.63:0/3603944127 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f8f4c005450 con 0x55e609304070 2024-09-21T06:39:01.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.616+0000 7f8f610c3740 10 client.17688 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:39:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.616+0000 7f8f610c3740 10 client.17688 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:39:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.616+0000 7f8f610c3740 20 client.17688 populate_metadata read hostname 'smithi063' 2024-09-21T06:39:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.616+0000 7f8f610c3740 1 --2- 172.21.15.63:0/3603944127 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e6092c29f0 0x55e6096c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.616+0000 7f8f610c3740 4 client.17688 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.616+0000 7f8f610c3740 1 -- 172.21.15.63:0/3603944127 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e609623df0 con 0x55e6092c29f0 2024-09-21T06:39:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.617+0000 7f8f588eb640 1 --2- 172.21.15.63:0/3603944127 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e6092c29f0 0x55e6096c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.617+0000 7f8f588eb640 1 --2- 172.21.15.63:0/3603944127 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e6092c29f0 0x55e6096c8f80 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8309818fbe48288 server_cookie=890ba0a99095859d in_seq=0 out_seq=0 2024-09-21T06:39:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.617+0000 7f8f33fff640 10 client.17688 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:39:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.618+0000 7f8f33fff640 1 -- 172.21.15.63:0/3603944127 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e609623df0 con 0x55e6092c29f0 2024-09-21T06:39:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.618+0000 7f8f33fff640 10 client.17688 handle_command_reply: tid=0 2024-09-21T06:39:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.618+0000 7f8f610c3740 1 client.17688 shutdown 2024-09-21T06:39:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.618+0000 7f8f610c3740 1 -- 172.21.15.63:0/3603944127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e609304070 msgr2=0x55e6096c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.618+0000 7f8f610c3740 1 --2- 172.21.15.63:0/3603944127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e609304070 0x55e6096c3170 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c018ec0 tx=0x7f8f4c00dfc0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.618+0000 7f8f610c3740 1 -- 172.21.15.63:0/3603944127 shutdown_connections 2024-09-21T06:39:01.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.618+0000 7f8f610c3740 1 --2- 172.21.15.63:0/3603944127 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e6092c29f0 0x55e6096c8f80 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.618+0000 7f8f610c3740 1 --2- 172.21.15.63:0/3603944127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e609304070 0x55e6096c3170 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.618+0000 7f8f610c3740 1 --2- 172.21.15.63:0/3603944127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092e3390 0x55e6096b7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.618+0000 7f8f33fff640 0 client.17688 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:39:01.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.618+0000 7f8f610c3740 1 --2- 172.21.15.63:0/3603944127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092db1b0 0x55e6096b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.618+0000 7f8f610c3740 1 -- 172.21.15.63:0/3603944127 >> 172.21.15.63:0/3603944127 conn(0x55e6092f8460 msgr2=0x55e6096ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:01.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.618+0000 7f8f610c3740 1 -- 172.21.15.63:0/3603944127 shutdown_connections 2024-09-21T06:39:01.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.618+0000 7f8f610c3740 1 -- 172.21.15.63:0/3603944127 wait complete. 2024-09-21T06:39:01.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.618+0000 7f8f610c3740 20 client.17688 trim_cache size 0 max 16384 2024-09-21T06:39:01.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.632+0000 7f8f610c3740 1 Processor -- start 2024-09-21T06:39:01.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.632+0000 7f8f610c3740 1 -- start start 2024-09-21T06:39:01.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.632+0000 7f8f610c3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e6092c29f0 0x55e6096b8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:01.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.632+0000 7f8f610c3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092db1b0 0x55e6096a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:01.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.632+0000 7f8f610c3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092e3390 0x55e6096a9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:01.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.632+0000 7f8f610c3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8f541af810 con 0x55e6092c29f0 2024-09-21T06:39:01.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.632+0000 7f8f610c3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8f541b1350 con 0x55e6092db1b0 2024-09-21T06:39:01.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.632+0000 7f8f610c3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8f541afee0 con 0x55e6092e3390 2024-09-21T06:39:01.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.632+0000 7f8f588eb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e6092c29f0 0x55e6096b8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:01.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.632+0000 7f8f588eb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e6092c29f0 0x55e6096b8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58878/0 (socket says 172.21.15.63:58878) 2024-09-21T06:39:01.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.632+0000 7f8f588eb640 1 -- 172.21.15.63:0/4269018786 learned_addr learned my addr 172.21.15.63:0/4269018786 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:01.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.632+0000 7f8f53fff640 1 --2- 172.21.15.63:0/4269018786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092db1b0 0x55e6096a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:01.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.632+0000 7f8f590ec640 1 --2- 172.21.15.63:0/4269018786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092e3390 0x55e6096a9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:01.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.632+0000 7f8f588eb640 1 -- 172.21.15.63:0/4269018786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092e3390 msgr2=0x55e6096a9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:01.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.632+0000 7f8f588eb640 1 --2- 172.21.15.63:0/4269018786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092e3390 0x55e6096a9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.632+0000 7f8f588eb640 1 -- 172.21.15.63:0/4269018786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092db1b0 msgr2=0x55e6096a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:01.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.632+0000 7f8f588eb640 1 --2- 172.21.15.63:0/4269018786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092db1b0 0x55e6096a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.632+0000 7f8f588eb640 1 -- 172.21.15.63:0/4269018786 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6096adbc0 con 0x55e6092c29f0 2024-09-21T06:39:01.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.632+0000 7f8f590ec640 1 --2- 172.21.15.63:0/4269018786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092e3390 0x55e6096a9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:01.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.633+0000 7f8f588eb640 1 --2- 172.21.15.63:0/4269018786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e6092c29f0 0x55e6096b8970 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f8f4802a910 tx=0x7f8f4803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610ee13cab90bcca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:01.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.633+0000 7f8f3e7fc640 1 -- 172.21.15.63:0/4269018786 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f48035050 con 0x55e6092c29f0 2024-09-21T06:39:01.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.633+0000 7f8f3e7fc640 1 -- 172.21.15.63:0/4269018786 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f48055070 con 0x55e6092c29f0 2024-09-21T06:39:01.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.633+0000 7f8f3e7fc640 1 -- 172.21.15.63:0/4269018786 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4803b8d0 con 0x55e6092c29f0 2024-09-21T06:39:01.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.633+0000 7f8f610c3740 1 -- 172.21.15.63:0/4269018786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e6092c29f0 msgr2=0x55e6096b8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:01.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.633+0000 7f8f610c3740 1 --2- 172.21.15.63:0/4269018786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e6092c29f0 0x55e6096b8970 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f8f4802a910 tx=0x7f8f4803d000 comp rx=0 tx=0).stop 2024-09-21T06:39:01.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.634+0000 7f8f610c3740 1 -- 172.21.15.63:0/4269018786 shutdown_connections 2024-09-21T06:39:01.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.634+0000 7f8f610c3740 1 --2- 172.21.15.63:0/4269018786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092e3390 0x55e6096a9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.634+0000 7f8f610c3740 1 --2- 172.21.15.63:0/4269018786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092db1b0 0x55e6096a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.634+0000 7f8f610c3740 1 --2- 172.21.15.63:0/4269018786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e6092c29f0 0x55e6096b8970 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.634+0000 7f8f610c3740 1 -- 172.21.15.63:0/4269018786 >> 172.21.15.63:0/4269018786 conn(0x55e6092f8460 msgr2=0x55e6096b8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:01.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.634+0000 7f8f610c3740 1 -- 172.21.15.63:0/4269018786 shutdown_connections 2024-09-21T06:39:01.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.634+0000 7f8f610c3740 1 -- 172.21.15.63:0/4269018786 wait complete. 2024-09-21T06:39:01.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.634+0000 7f8f610c3740 1 -- start start 2024-09-21T06:39:01.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.634+0000 7f8f610c3740 1 Processor -- start 2024-09-21T06:39:01.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f610c3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092c29f0 0x55e6096bf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:01.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f610c3740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e6092db1b0 0x55e6096bad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:01.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f610c3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092e3390 0x55e6096bb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:01.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f610c3740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8f541b0c80 con 0x55e6092db1b0 2024-09-21T06:39:01.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f610c3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8f541b05b0 con 0x55e6092c29f0 2024-09-21T06:39:01.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f610c3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8f541ad810 con 0x55e6092e3390 2024-09-21T06:39:01.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f610c3740 10 client.0 _ll_register_callbacks cb 0x7f8f4c008cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:01.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f53fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e6092db1b0 0x55e6096bad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:01.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f53fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e6092db1b0 0x55e6096bad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58890/0 (socket says 172.21.15.63:58890) 2024-09-21T06:39:01.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f53fff640 1 -- 172.21.15.63:0/748401845 learned_addr learned my addr 172.21.15.63:0/748401845 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:01.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f588eb640 1 --2- 172.21.15.63:0/748401845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092c29f0 0x55e6096bf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:01.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f590ec640 1 --2- 172.21.15.63:0/748401845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092e3390 0x55e6096bb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:01.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f53fff640 1 -- 172.21.15.63:0/748401845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092e3390 msgr2=0x55e6096bb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:01.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f53fff640 1 --2- 172.21.15.63:0/748401845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092e3390 0x55e6096bb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f53fff640 1 -- 172.21.15.63:0/748401845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092c29f0 msgr2=0x55e6096bf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:01.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f53fff640 1 --2- 172.21.15.63:0/748401845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092c29f0 0x55e6096bf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f53fff640 1 -- 172.21.15.63:0/748401845 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6096bba80 con 0x55e6092db1b0 2024-09-21T06:39:01.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f590ec640 1 --2- 172.21.15.63:0/748401845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092e3390 0x55e6096bb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:01.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f53fff640 1 --2- 172.21.15.63:0/748401845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e6092db1b0 0x55e6096bad90 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000c940 tx=0x7f8f400057e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d17d26359a51b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:01.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f33fff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:39:01.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.635+0000 7f8f33fff640 1 -- 172.21.15.63:0/748401845 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4001d030 con 0x55e6092db1b0 2024-09-21T06:39:01.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.636+0000 7f8f33fff640 1 -- 172.21.15.63:0/748401845 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f8f400e7040 con 0x55e6092db1b0 2024-09-21T06:39:01.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.636+0000 7f8f610c3740 1 -- 172.21.15.63:0/748401845 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f48055070 con 0x55e6092db1b0 2024-09-21T06:39:01.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.636+0000 7f8f33fff640 1 -- 172.21.15.63:0/748401845 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f8f400acaa0 con 0x55e6092db1b0 2024-09-21T06:39:01.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.636+0000 7f8f610c3740 10 client.17694 fetch_fsmap learned FSMap version 61 2024-09-21T06:39:01.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.636+0000 7f8f610c3740 1 -- 172.21.15.63:0/748401845 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55e6097337a0 con 0x55e6092db1b0 2024-09-21T06:39:01.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.636+0000 7f8f33fff640 1 -- 172.21.15.63:0/748401845 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f48055070 con 0x55e6092db1b0 2024-09-21T06:39:01.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.636+0000 7f8f33fff640 1 -- 172.21.15.63:0/748401845 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f8f400a8c80 con 0x55e6092db1b0 2024-09-21T06:39:01.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.636+0000 7f8f610c3740 10 client.17694 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:39:01.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.636+0000 7f8f610c3740 10 client.17694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.h 2024-09-21T06:39:01.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.636+0000 7f8f610c3740 20 client.17694 populate_metadata read hostname 'smithi063' 2024-09-21T06:39:01.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.636+0000 7f8f610c3740 1 --2- 172.21.15.63:0/748401845 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e609304070 0x55e609735f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:01.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.636+0000 7f8f610c3740 4 client.17694 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:39:01.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.636+0000 7f8f610c3740 1 -- 172.21.15.63:0/748401845 --> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e60961f8a0 con 0x55e609304070 2024-09-21T06:39:01.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.637+0000 7f8f588eb640 1 --2- 172.21.15.63:0/748401845 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e609304070 0x55e609735f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:01.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.637+0000 7f8f33fff640 10 client.17694 ms_handle_connect on v2:172.21.15.71:6836/1168849842 2024-09-21T06:39:01.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.637+0000 7f8f588eb640 1 --2- 172.21.15.63:0/748401845 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e609304070 0x55e609735f10 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bed5f09ca4057a9 server_cookie=5e07ced42d19edfa in_seq=0 out_seq=0 2024-09-21T06:39:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.637+0000 7f8f33fff640 1 -- 172.21.15.63:0/748401845 <== mds.0 v2:172.21.15.71:6836/1168849842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e60961f8a0 con 0x55e609304070 2024-09-21T06:39:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.637+0000 7f8f33fff640 10 client.17694 handle_command_reply: tid=0 2024-09-21T06:39:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.637+0000 7f8f610c3740 1 client.17694 shutdown 2024-09-21T06:39:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.637+0000 7f8f610c3740 1 -- 172.21.15.63:0/748401845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e6092db1b0 msgr2=0x55e6096bad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.637+0000 7f8f610c3740 1 --2- 172.21.15.63:0/748401845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e6092db1b0 0x55e6096bad90 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000c940 tx=0x7f8f400057e0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.637+0000 7f8f610c3740 1 -- 172.21.15.63:0/748401845 shutdown_connections 2024-09-21T06:39:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.637+0000 7f8f610c3740 1 --2- 172.21.15.63:0/748401845 >> [v2:172.21.15.71:6836/1168849842,v1:172.21.15.71:6837/1168849842] conn(0x55e609304070 0x55e609735f10 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.637+0000 7f8f610c3740 1 --2- 172.21.15.63:0/748401845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6092e3390 0x55e6096bb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.637+0000 7f8f610c3740 1 --2- 172.21.15.63:0/748401845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55e6092db1b0 0x55e6096bad90 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.637+0000 7f8f610c3740 1 --2- 172.21.15.63:0/748401845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6092c29f0 0x55e6096bf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.637+0000 7f8f610c3740 1 -- 172.21.15.63:0/748401845 >> 172.21.15.63:0/748401845 conn(0x55e6092f8460 msgr2=0x55e6096b7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.637+0000 7f8f33fff640 0 client.17694 ms_handle_reset on v2:172.21.15.71:6836/1168849842 2024-09-21T06:39:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.638+0000 7f8f610c3740 1 -- 172.21.15.63:0/748401845 shutdown_connections 2024-09-21T06:39:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.638+0000 7f8f610c3740 1 -- 172.21.15.63:0/748401845 wait complete. 2024-09-21T06:39:01.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.638+0000 7f8f610c3740 20 client.17694 trim_cache size 0 max 16384 2024-09-21T06:39:01.645 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:39:01.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.638+0000 7f8f5ab4f640 1 -- 172.21.15.63:0/3799473892 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8f440b66b0 msgr2=0x7f8f440b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:01.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.638+0000 7f8f5ab4f640 1 --2- 172.21.15.63:0/3799473892 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8f440b66b0 0x7f8f440b8bc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8f48031440 tx=0x7f8f48005e80 comp rx=0 tx=0).stop 2024-09-21T06:39:01.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.638+0000 7f8f5ab4f640 1 -- 172.21.15.63:0/3799473892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f541094f0 msgr2=0x7f8f5419aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:01.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.638+0000 7f8f5ab4f640 1 --2- 172.21.15.63:0/3799473892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f541094f0 0x7f8f5419aa90 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000c970 tx=0x7f8f4000ce30 comp rx=0 tx=0).stop 2024-09-21T06:39:01.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.638+0000 7f8f5ab4f640 1 -- 172.21.15.63:0/3799473892 shutdown_connections 2024-09-21T06:39:01.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.638+0000 7f8f5ab4f640 1 --2- 172.21.15.63:0/3799473892 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f8f440b66b0 0x7f8f440b8bc0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.638+0000 7f8f5ab4f640 1 --2- 172.21.15.63:0/3799473892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f54109e40 0x7f8f5419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.638+0000 7f8f5ab4f640 1 --2- 172.21.15.63:0/3799473892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f541094f0 0x7f8f5419aa90 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.638+0000 7f8f5ab4f640 1 --2- 172.21.15.63:0/3799473892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f54103bb0 0x7f8f5419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:01.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.638+0000 7f8f5ab4f640 1 -- 172.21.15.63:0/3799473892 >> 172.21.15.63:0/3799473892 conn(0x7f8f540ff600 msgr2=0x7f8f54101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:01.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.639+0000 7f8f5ab4f640 1 -- 172.21.15.63:0/3799473892 shutdown_connections 2024-09-21T06:39:01.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:01.639+0000 7f8f5ab4f640 1 -- 172.21.15.63:0/3799473892 wait complete. 2024-09-21T06:39:01.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:01 smithi063 ceph-mon[31150]: pgmap v655: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:39:02.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:01 smithi071 ceph-mon[34844]: pgmap v655: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:39:02.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:01 smithi175 ceph-mon[34510]: pgmap v655: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:39:02.452 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T06:39:02.708 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:03.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.210+0000 7ffb301e1640 1 -- 172.21.15.63:0/4116206278 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb28102a80 msgr2=0x7ffb28102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:03.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.210+0000 7ffb301e1640 1 --2- 172.21.15.63:0/4116206278 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb28102a80 0x7ffb28102e90 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7ffb24009900 tx=0x7ffb2402a410 comp rx=0 tx=0).stop 2024-09-21T06:39:03.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.210+0000 7ffb301e1640 1 -- 172.21.15.63:0/4116206278 shutdown_connections 2024-09-21T06:39:03.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.210+0000 7ffb301e1640 1 --2- 172.21.15.63:0/4116206278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb28108d10 0x7ffb2810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.210+0000 7ffb301e1640 1 --2- 172.21.15.63:0/4116206278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb281083c0 0x7ffb281087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.210+0000 7ffb301e1640 1 --2- 172.21.15.63:0/4116206278 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb28102a80 0x7ffb28102e90 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.210+0000 7ffb301e1640 1 -- 172.21.15.63:0/4116206278 >> 172.21.15.63:0/4116206278 conn(0x7ffb28079740 msgr2=0x7ffb28079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:03.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.211+0000 7ffb301e1640 1 -- 172.21.15.63:0/4116206278 shutdown_connections 2024-09-21T06:39:03.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.211+0000 7ffb301e1640 1 -- 172.21.15.63:0/4116206278 wait complete. 2024-09-21T06:39:03.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.211+0000 7ffb301e1640 1 Processor -- start 2024-09-21T06:39:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.211+0000 7ffb301e1640 1 -- start start 2024-09-21T06:39:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.212+0000 7ffb301e1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb28102a80 0x7ffb28199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.212+0000 7ffb301e1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb281083c0 0x7ffb28199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.212+0000 7ffb301e1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb28108d10 0x7ffb2819ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.212+0000 7ffb301e1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28112980 con 0x7ffb28108d10 2024-09-21T06:39:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.212+0000 7ffb301e1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28112800 con 0x7ffb281083c0 2024-09-21T06:39:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.212+0000 7ffb301e1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28112b00 con 0x7ffb28102a80 2024-09-21T06:39:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.212+0000 7ffb2e77e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb28108d10 0x7ffb2819ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.212+0000 7ffb2e77e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb28108d10 0x7ffb2819ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58908/0 (socket says 172.21.15.63:58908) 2024-09-21T06:39:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.212+0000 7ffb2e77e640 1 -- 172.21.15.63:0/1808491857 learned_addr learned my addr 172.21.15.63:0/1808491857 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.212+0000 7ffb2d77c640 1 --2- 172.21.15.63:0/1808491857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb281083c0 0x7ffb28199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.212+0000 7ffb2df7d640 1 --2- 172.21.15.63:0/1808491857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb28102a80 0x7ffb28199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.212+0000 7ffb2e77e640 1 -- 172.21.15.63:0/1808491857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb28102a80 msgr2=0x7ffb28199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:03.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.212+0000 7ffb2e77e640 1 --2- 172.21.15.63:0/1808491857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb28102a80 0x7ffb28199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.212+0000 7ffb2e77e640 1 -- 172.21.15.63:0/1808491857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb281083c0 msgr2=0x7ffb28199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:03.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.212+0000 7ffb2e77e640 1 --2- 172.21.15.63:0/1808491857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb281083c0 0x7ffb28199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.212+0000 7ffb2e77e640 1 -- 172.21.15.63:0/1808491857 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2819f2e0 con 0x7ffb28108d10 2024-09-21T06:39:03.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.212+0000 7ffb2df7d640 1 --2- 172.21.15.63:0/1808491857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb28102a80 0x7ffb28199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:03.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.212+0000 7ffb2e77e640 1 --2- 172.21.15.63:0/1808491857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb28108d10 0x7ffb2819ebb0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000eaa0 tx=0x7ffb2000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:03.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.212+0000 7ffb1effd640 1 -- 172.21.15.63:0/1808491857 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2000cdb0 con 0x7ffb28108d10 2024-09-21T06:39:03.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.213+0000 7ffb1effd640 1 -- 172.21.15.63:0/1808491857 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb20005020 con 0x7ffb28108d10 2024-09-21T06:39:03.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.213+0000 7ffb1effd640 1 -- 172.21.15.63:0/1808491857 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb200116d0 con 0x7ffb28108d10 2024-09-21T06:39:03.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.213+0000 7ffb301e1640 1 -- 172.21.15.63:0/1808491857 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb2819f5d0 con 0x7ffb28108d10 2024-09-21T06:39:03.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.213+0000 7ffb301e1640 1 -- 172.21.15.63:0/1808491857 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb281a5d30 con 0x7ffb28108d10 2024-09-21T06:39:03.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.216+0000 7ffb36755740 1 Processor -- start 2024-09-21T06:39:03.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.216+0000 7ffb1effd640 1 -- 172.21.15.63:0/1808491857 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7ffb200051d0 con 0x7ffb28108d10 2024-09-21T06:39:03.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.216+0000 7ffb36755740 1 -- start start 2024-09-21T06:39:03.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.217+0000 7ffb36755740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a4b7070 0x55ed8a85e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:03.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.217+0000 7ffb36755740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a48e1b0 0x55ed8a85ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:03.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.217+0000 7ffb36755740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a496390 0x55ed8a85f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:03.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.217+0000 7ffb36755740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ed8a7d4ea0 con 0x55ed8a496390 2024-09-21T06:39:03.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.217+0000 7ffb36755740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ed8a7c42d0 con 0x55ed8a4b7070 2024-09-21T06:39:03.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.217+0000 7ffb36755740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ed8a7c80e0 con 0x55ed8a48e1b0 2024-09-21T06:39:03.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.217+0000 7ffb2d77c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a496390 0x55ed8a85f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:03.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.217+0000 7ffb2d77c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a496390 0x55ed8a85f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58922/0 (socket says 172.21.15.63:58922) 2024-09-21T06:39:03.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.217+0000 7ffb2d77c640 1 -- 172.21.15.63:0/1154517186 learned_addr learned my addr 172.21.15.63:0/1154517186 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:03.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.217+0000 7ffb2d77c640 1 --2- 172.21.15.63:0/1154517186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a4b7070 0x55ed8a85e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:03.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.217+0000 7ffb2df7d640 1 --2- 172.21.15.63:0/1154517186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a48e1b0 0x55ed8a85ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:03.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.217+0000 7ffb2d77c640 1 -- 172.21.15.63:0/1154517186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a48e1b0 msgr2=0x55ed8a85ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:03.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.217+0000 7ffb2d77c640 1 --2- 172.21.15.63:0/1154517186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a48e1b0 0x55ed8a85ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.217+0000 7ffb2d77c640 1 -- 172.21.15.63:0/1154517186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a4b7070 msgr2=0x55ed8a85e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:03.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.217+0000 7ffb2d77c640 1 --2- 172.21.15.63:0/1154517186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a4b7070 0x55ed8a85e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.217+0000 7ffb2d77c640 1 -- 172.21.15.63:0/1154517186 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed8a522650 con 0x55ed8a496390 2024-09-21T06:39:03.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.217+0000 7ffb1effd640 1 --2- 172.21.15.63:0/1808491857 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffb140b6700 0x7ffb140b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:03.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.217+0000 7ffb2d77c640 1 --2- 172.21.15.63:0/1154517186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a496390 0x55ed8a85f120 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7ffb18012580 tx=0x7ffb1800b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb822b0eafaca166 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:03.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.217+0000 7ffb2df7d640 1 --2- 172.21.15.63:0/1808491857 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffb140b6700 0x7ffb140b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:03.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.217+0000 7ffb1effd640 1 -- 172.21.15.63:0/1808491857 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7ffb200e7890 con 0x7ffb28108d10 2024-09-21T06:39:03.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.218+0000 7ffb13fff640 1 -- 172.21.15.63:0/1154517186 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1801e640 con 0x55ed8a496390 2024-09-21T06:39:03.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.218+0000 7ffb13fff640 1 -- 172.21.15.63:0/1154517186 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb180108e0 con 0x55ed8a496390 2024-09-21T06:39:03.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.218+0000 7ffb13fff640 1 -- 172.21.15.63:0/1154517186 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1801d8e0 con 0x55ed8a496390 2024-09-21T06:39:03.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.219+0000 7ffb36755740 1 -- 172.21.15.63:0/1154517186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a496390 msgr2=0x55ed8a85f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:03.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.219+0000 7ffb2df7d640 1 --2- 172.21.15.63:0/1808491857 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffb140b6700 0x7ffb140b8c10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ffb24031440 tx=0x7ffb240058b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:03.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.219+0000 7ffb36755740 1 --2- 172.21.15.63:0/1154517186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a496390 0x55ed8a85f120 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7ffb18012580 tx=0x7ffb1800b9d0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.219+0000 7ffb36755740 1 -- 172.21.15.63:0/1154517186 shutdown_connections 2024-09-21T06:39:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.219+0000 7ffb36755740 1 --2- 172.21.15.63:0/1154517186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a496390 0x55ed8a85f120 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.219+0000 7ffb36755740 1 --2- 172.21.15.63:0/1154517186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a48e1b0 0x55ed8a85ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.219+0000 7ffb36755740 1 --2- 172.21.15.63:0/1154517186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a4b7070 0x55ed8a85e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.219+0000 7ffb36755740 1 -- 172.21.15.63:0/1154517186 >> 172.21.15.63:0/1154517186 conn(0x55ed8a4ab460 msgr2=0x55ed8a85c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.219+0000 7ffb36755740 1 -- 172.21.15.63:0/1154517186 shutdown_connections 2024-09-21T06:39:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.219+0000 7ffb36755740 1 -- 172.21.15.63:0/1154517186 wait complete. 2024-09-21T06:39:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.219+0000 7ffb36755740 1 -- start start 2024-09-21T06:39:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.219+0000 7ffb36755740 1 Processor -- start 2024-09-21T06:39:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.220+0000 7ffb36755740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a48e1b0 0x55ed8a86c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.220+0000 7ffb36755740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a496390 0x55ed8a86c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.220+0000 7ffb36755740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a4b7070 0x55ed8a878340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.220+0000 7ffb36755740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ed8a625700 con 0x55ed8a4b7070 2024-09-21T06:39:03.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.220+0000 7ffb36755740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ed8a75f160 con 0x55ed8a48e1b0 2024-09-21T06:39:03.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.220+0000 7ffb36755740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ed8a86efe0 con 0x55ed8a496390 2024-09-21T06:39:03.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.220+0000 7ffb36755740 10 client.0 _ll_register_callbacks cb 0x55ed8a7789e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:03.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.220+0000 7ffb2e77e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a4b7070 0x55ed8a878340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:03.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.220+0000 7ffb2e77e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a4b7070 0x55ed8a878340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58924/0 (socket says 172.21.15.63:58924) 2024-09-21T06:39:03.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.220+0000 7ffb2e77e640 1 -- 172.21.15.63:0/1709445230 learned_addr learned my addr 172.21.15.63:0/1709445230 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:03.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.220+0000 7ffb2df7d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a48e1b0 0x55ed8a86c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:03.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.220+0000 7ffb2d77c640 1 --2- 172.21.15.63:0/1709445230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a496390 0x55ed8a86c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:03.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.220+0000 7ffb2e77e640 1 -- 172.21.15.63:0/1709445230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a496390 msgr2=0x55ed8a86c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:03.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.220+0000 7ffb2e77e640 1 --2- 172.21.15.63:0/1709445230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a496390 0x55ed8a86c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.220+0000 7ffb2e77e640 1 -- 172.21.15.63:0/1709445230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a48e1b0 msgr2=0x55ed8a86c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:03.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.220+0000 7ffb2e77e640 1 --2- 172.21.15.63:0/1709445230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a48e1b0 0x55ed8a86c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.220+0000 7ffb2e77e640 1 -- 172.21.15.63:0/1709445230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed8a78cc90 con 0x55ed8a4b7070 2024-09-21T06:39:03.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.221+0000 7ffb2d77c640 1 --2- 172.21.15.63:0/1709445230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a496390 0x55ed8a86c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:03.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.221+0000 7ffb2e77e640 1 --2- 172.21.15.63:0/1709445230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a4b7070 0x55ed8a878340 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ffb200ad390 tx=0x7ffb200ad1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469c04be3f87e7f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:03.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.221+0000 7ffb117fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:39:03.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.221+0000 7ffb117fa640 1 -- 172.21.15.63:0/1709445230 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2001f030 con 0x55ed8a4b7070 2024-09-21T06:39:03.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.221+0000 7ffb117fa640 1 -- 172.21.15.63:0/1709445230 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7ffb200b6040 con 0x55ed8a4b7070 2024-09-21T06:39:03.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.221+0000 7ffb36755740 1 -- 172.21.15.63:0/1709445230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb180108e0 con 0x55ed8a4b7070 2024-09-21T06:39:03.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.221+0000 7ffb117fa640 1 -- 172.21.15.63:0/1709445230 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7ffb200b2170 con 0x55ed8a4b7070 2024-09-21T06:39:03.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.221+0000 7ffb36755740 10 client.17706 fetch_fsmap learned FSMap version 61 2024-09-21T06:39:03.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.221+0000 7ffb36755740 1 -- 172.21.15.63:0/1709445230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55ed8a87ae20 con 0x55ed8a4b7070 2024-09-21T06:39:03.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.221+0000 7ffb117fa640 1 -- 172.21.15.63:0/1709445230 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb180108e0 con 0x55ed8a4b7070 2024-09-21T06:39:03.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.221+0000 7ffb117fa640 1 -- 172.21.15.63:0/1709445230 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7ffb2000f040 con 0x55ed8a4b7070 2024-09-21T06:39:03.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.222+0000 7ffb36755740 10 client.17706 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:39:03.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.222+0000 7ffb36755740 10 client.17706 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:39:03.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.222+0000 7ffb36755740 20 client.17706 populate_metadata read hostname 'smithi063' 2024-09-21T06:39:03.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.222+0000 7ffb36755740 1 --2- 172.21.15.63:0/1709445230 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55ed8a4759f0 0x55ed8a87e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:03.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.222+0000 7ffb36755740 4 client.17706 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:03.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.222+0000 7ffb36755740 1 -- 172.21.15.63:0/1709445230 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed8a7d6df0 con 0x55ed8a4759f0 2024-09-21T06:39:03.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.222+0000 7ffb2df7d640 1 --2- 172.21.15.63:0/1709445230 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55ed8a4759f0 0x55ed8a87e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:03.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.222+0000 7ffb117fa640 10 client.17706 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:39:03.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.222+0000 7ffb2df7d640 1 --2- 172.21.15.63:0/1709445230 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55ed8a4759f0 0x55ed8a87e320 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d98516347ad8b849 server_cookie=db7f2274816504d0 in_seq=0 out_seq=0 2024-09-21T06:39:03.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.223+0000 7ffb117fa640 1 -- 172.21.15.63:0/1709445230 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ed8a7d6df0 con 0x55ed8a4759f0 2024-09-21T06:39:03.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.223+0000 7ffb117fa640 10 client.17706 handle_command_reply: tid=0 2024-09-21T06:39:03.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.223+0000 7ffb36755740 1 client.17706 shutdown 2024-09-21T06:39:03.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.223+0000 7ffb36755740 1 -- 172.21.15.63:0/1709445230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a4b7070 msgr2=0x55ed8a878340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:03.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.223+0000 7ffb36755740 1 --2- 172.21.15.63:0/1709445230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a4b7070 0x55ed8a878340 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ffb200ad390 tx=0x7ffb200ad1a0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.223+0000 7ffb36755740 1 -- 172.21.15.63:0/1709445230 shutdown_connections 2024-09-21T06:39:03.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.223+0000 7ffb36755740 1 --2- 172.21.15.63:0/1709445230 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55ed8a4759f0 0x55ed8a87e320 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.223+0000 7ffb36755740 1 --2- 172.21.15.63:0/1709445230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a4b7070 0x55ed8a878340 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.223+0000 7ffb36755740 1 --2- 172.21.15.63:0/1709445230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a496390 0x55ed8a86c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.223+0000 7ffb117fa640 0 client.17706 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:39:03.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.223+0000 7ffb36755740 1 --2- 172.21.15.63:0/1709445230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a48e1b0 0x55ed8a86c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.223+0000 7ffb36755740 1 -- 172.21.15.63:0/1709445230 >> 172.21.15.63:0/1709445230 conn(0x55ed8a4ab460 msgr2=0x55ed8a860090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:03.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.224+0000 7ffb36755740 1 -- 172.21.15.63:0/1709445230 shutdown_connections 2024-09-21T06:39:03.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.224+0000 7ffb36755740 1 -- 172.21.15.63:0/1709445230 wait complete. 2024-09-21T06:39:03.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.224+0000 7ffb36755740 20 client.17706 trim_cache size 0 max 16384 2024-09-21T06:39:03.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.237+0000 7ffb36755740 1 Processor -- start 2024-09-21T06:39:03.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.237+0000 7ffb36755740 1 -- start start 2024-09-21T06:39:03.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.237+0000 7ffb36755740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a4ab460 0x55ed8a86c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:03.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.237+0000 7ffb36755740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a4759f0 0x55ed8a878240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:03.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.237+0000 7ffb36755740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a48e1b0 0x55ed8a85beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:03.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.237+0000 7ffb36755740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281ad5c0 con 0x55ed8a4ab460 2024-09-21T06:39:03.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.237+0000 7ffb36755740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281af100 con 0x55ed8a48e1b0 2024-09-21T06:39:03.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.237+0000 7ffb36755740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281adc90 con 0x55ed8a4759f0 2024-09-21T06:39:03.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.237+0000 7ffb2df7d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a4ab460 0x55ed8a86c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:03.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.237+0000 7ffb2df7d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a4ab460 0x55ed8a86c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58936/0 (socket says 172.21.15.63:58936) 2024-09-21T06:39:03.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.237+0000 7ffb2df7d640 1 -- 172.21.15.63:0/2599396188 learned_addr learned my addr 172.21.15.63:0/2599396188 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:03.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.238+0000 7ffb2e77e640 1 --2- 172.21.15.63:0/2599396188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a48e1b0 0x55ed8a85beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:03.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.238+0000 7ffb2d77c640 1 --2- 172.21.15.63:0/2599396188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a4759f0 0x55ed8a878240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:03.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.238+0000 7ffb2df7d640 1 -- 172.21.15.63:0/2599396188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a4759f0 msgr2=0x55ed8a878240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:03.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.238+0000 7ffb2df7d640 1 --2- 172.21.15.63:0/2599396188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a4759f0 0x55ed8a878240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.238+0000 7ffb2df7d640 1 -- 172.21.15.63:0/2599396188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a48e1b0 msgr2=0x55ed8a85beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:03.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.238+0000 7ffb2df7d640 1 --2- 172.21.15.63:0/2599396188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a48e1b0 0x55ed8a85beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.238+0000 7ffb2df7d640 1 -- 172.21.15.63:0/2599396188 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed8a86a500 con 0x55ed8a4ab460 2024-09-21T06:39:03.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.238+0000 7ffb2e77e640 1 --2- 172.21.15.63:0/2599396188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a48e1b0 0x55ed8a85beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:03.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.238+0000 7ffb2df7d640 1 --2- 172.21.15.63:0/2599396188 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a4ab460 0x55ed8a86c4c0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ffb2402a930 tx=0x7ffb2403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ee368b1cc840b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:03.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.238+0000 7ffb137fe640 1 -- 172.21.15.63:0/2599396188 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24035050 con 0x55ed8a4ab460 2024-09-21T06:39:03.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.238+0000 7ffb137fe640 1 -- 172.21.15.63:0/2599396188 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb24054070 con 0x55ed8a4ab460 2024-09-21T06:39:03.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.238+0000 7ffb137fe640 1 -- 172.21.15.63:0/2599396188 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24004920 con 0x55ed8a4ab460 2024-09-21T06:39:03.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.239+0000 7ffb36755740 1 -- 172.21.15.63:0/2599396188 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a4ab460 msgr2=0x55ed8a86c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:03.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.239+0000 7ffb36755740 1 --2- 172.21.15.63:0/2599396188 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a4ab460 0x55ed8a86c4c0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ffb2402a930 tx=0x7ffb2403d000 comp rx=0 tx=0).stop 2024-09-21T06:39:03.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.239+0000 7ffb36755740 1 -- 172.21.15.63:0/2599396188 shutdown_connections 2024-09-21T06:39:03.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.239+0000 7ffb36755740 1 --2- 172.21.15.63:0/2599396188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a48e1b0 0x55ed8a85beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.239+0000 7ffb36755740 1 --2- 172.21.15.63:0/2599396188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a4759f0 0x55ed8a878240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.239+0000 7ffb36755740 1 --2- 172.21.15.63:0/2599396188 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a4ab460 0x55ed8a86c4c0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.239+0000 7ffb36755740 1 -- 172.21.15.63:0/2599396188 >> 172.21.15.63:0/2599396188 conn(0x55ed8a864480 msgr2=0x55ed8a86bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:03.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.239+0000 7ffb36755740 1 -- 172.21.15.63:0/2599396188 shutdown_connections 2024-09-21T06:39:03.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.239+0000 7ffb36755740 1 -- 172.21.15.63:0/2599396188 wait complete. 2024-09-21T06:39:03.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.240+0000 7ffb36755740 1 -- start start 2024-09-21T06:39:03.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.240+0000 7ffb36755740 1 Processor -- start 2024-09-21T06:39:03.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.240+0000 7ffb36755740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a4759f0 0x55ed8a870970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:03.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.240+0000 7ffb36755740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a48e1b0 0x55ed8a870eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:03.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.240+0000 7ffb36755740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a4ab460 0x55ed8a8e7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:03.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.240+0000 7ffb36755740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281aea30 con 0x55ed8a48e1b0 2024-09-21T06:39:03.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.240+0000 7ffb36755740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281ae360 con 0x55ed8a4ab460 2024-09-21T06:39:03.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.240+0000 7ffb36755740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281ab5c0 con 0x55ed8a4759f0 2024-09-21T06:39:03.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.240+0000 7ffb36755740 10 client.0 _ll_register_callbacks cb 0x7ffb200a9da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:03.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.240+0000 7ffb2d77c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a48e1b0 0x55ed8a870eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:03.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.240+0000 7ffb2d77c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a48e1b0 0x55ed8a870eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58950/0 (socket says 172.21.15.63:58950) 2024-09-21T06:39:03.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.240+0000 7ffb2d77c640 1 -- 172.21.15.63:0/1219355508 learned_addr learned my addr 172.21.15.63:0/1219355508 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:03.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.240+0000 7ffb2df7d640 1 --2- 172.21.15.63:0/1219355508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a4759f0 0x55ed8a870970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:03.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.241+0000 7ffb2d77c640 1 -- 172.21.15.63:0/1219355508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a4759f0 msgr2=0x55ed8a870970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.241+0000 7ffb2e77e640 1 --2- 172.21.15.63:0/1219355508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a4ab460 0x55ed8a8e7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.241+0000 7ffb2d77c640 1 --2- 172.21.15.63:0/1219355508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a4759f0 0x55ed8a870970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.241+0000 7ffb2d77c640 1 -- 172.21.15.63:0/1219355508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a4ab460 msgr2=0x55ed8a8e7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.241+0000 7ffb2d77c640 1 --2- 172.21.15.63:0/1219355508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a4ab460 0x55ed8a8e7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.241+0000 7ffb2d77c640 1 -- 172.21.15.63:0/1219355508 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed8a8e8200 con 0x55ed8a48e1b0 2024-09-21T06:39:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.241+0000 7ffb2e77e640 1 --2- 172.21.15.63:0/1219355508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a4ab460 0x55ed8a8e7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:39:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.241+0000 7ffb2d77c640 1 --2- 172.21.15.63:0/1219355508 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a48e1b0 0x55ed8a870eb0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7ffb18012550 tx=0x7ffb1800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc69c5a896bc72e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.241+0000 7ffb117fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:39:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.241+0000 7ffb117fa640 1 -- 172.21.15.63:0/1219355508 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1802c070 con 0x55ed8a48e1b0 2024-09-21T06:39:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.241+0000 7ffb117fa640 1 -- 172.21.15.63:0/1219355508 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7ffb180053c0 con 0x55ed8a48e1b0 2024-09-21T06:39:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.241+0000 7ffb36755740 1 -- 172.21.15.63:0/1219355508 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb24054070 con 0x55ed8a48e1b0 2024-09-21T06:39:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.241+0000 7ffb117fa640 1 -- 172.21.15.63:0/1219355508 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7ffb18038050 con 0x55ed8a48e1b0 2024-09-21T06:39:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.241+0000 7ffb36755740 10 client.17712 fetch_fsmap learned FSMap version 61 2024-09-21T06:39:03.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.241+0000 7ffb36755740 1 -- 172.21.15.63:0/1219355508 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55ed8a8e9430 con 0x55ed8a48e1b0 2024-09-21T06:39:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.242+0000 7ffb117fa640 1 -- 172.21.15.63:0/1219355508 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb24054070 con 0x55ed8a48e1b0 2024-09-21T06:39:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.242+0000 7ffb117fa640 1 -- 172.21.15.63:0/1219355508 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7ffb1801c070 con 0x55ed8a48e1b0 2024-09-21T06:39:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.242+0000 7ffb36755740 10 client.17712 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:39:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.242+0000 7ffb36755740 10 client.17712 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-21T06:39:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.242+0000 7ffb36755740 20 client.17712 populate_metadata read hostname 'smithi063' 2024-09-21T06:39:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.242+0000 7ffb36755740 1 --2- 172.21.15.63:0/1219355508 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55ed8a496390 0x55ed8a8eb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.242+0000 7ffb36755740 4 client.17712 mds_command: new command op to 24670 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:39:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.242+0000 7ffb36755740 1 -- 172.21.15.63:0/1219355508 --> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ed8a7d28a0 con 0x55ed8a496390 2024-09-21T06:39:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.242+0000 7ffb2df7d640 1 --2- 172.21.15.63:0/1219355508 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55ed8a496390 0x55ed8a8eb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.243+0000 7ffb117fa640 10 client.17712 ms_handle_connect on v2:172.21.15.175:6834/3140987446 2024-09-21T06:39:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.243+0000 7ffb2df7d640 1 --2- 172.21.15.63:0/1219355508 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55ed8a496390 0x55ed8a8eb900 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ef47f5e1fda380e8 server_cookie=2c66a7dcdd934dba in_seq=0 out_seq=0 2024-09-21T06:39:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.243+0000 7ffb117fa640 1 -- 172.21.15.63:0/1219355508 <== mds.3 v2:172.21.15.175:6834/3140987446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ed8a7d28a0 con 0x55ed8a496390 2024-09-21T06:39:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.243+0000 7ffb117fa640 10 client.17712 handle_command_reply: tid=0 2024-09-21T06:39:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.243+0000 7ffb36755740 1 client.17712 shutdown 2024-09-21T06:39:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.243+0000 7ffb36755740 1 -- 172.21.15.63:0/1219355508 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a48e1b0 msgr2=0x55ed8a870eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.243+0000 7ffb36755740 1 --2- 172.21.15.63:0/1219355508 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a48e1b0 0x55ed8a870eb0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7ffb18012550 tx=0x7ffb1800bea0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.243+0000 7ffb36755740 1 -- 172.21.15.63:0/1219355508 shutdown_connections 2024-09-21T06:39:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.243+0000 7ffb36755740 1 --2- 172.21.15.63:0/1219355508 >> [v2:172.21.15.175:6834/3140987446,v1:172.21.15.175:6835/3140987446] conn(0x55ed8a496390 0x55ed8a8eb900 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.243+0000 7ffb36755740 1 --2- 172.21.15.63:0/1219355508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed8a4ab460 0x55ed8a8e7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.243+0000 7ffb36755740 1 --2- 172.21.15.63:0/1219355508 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed8a48e1b0 0x55ed8a870eb0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.243+0000 7ffb117fa640 0 client.17712 ms_handle_reset on v2:172.21.15.175:6834/3140987446 2024-09-21T06:39:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.243+0000 7ffb36755740 1 --2- 172.21.15.63:0/1219355508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed8a4759f0 0x55ed8a870970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.243+0000 7ffb36755740 1 -- 172.21.15.63:0/1219355508 >> 172.21.15.63:0/1219355508 conn(0x55ed8a864480 msgr2=0x55ed8a85be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.243+0000 7ffb36755740 1 -- 172.21.15.63:0/1219355508 shutdown_connections 2024-09-21T06:39:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.243+0000 7ffb36755740 1 -- 172.21.15.63:0/1219355508 wait complete. 2024-09-21T06:39:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.243+0000 7ffb36755740 20 client.17712 trim_cache size 0 max 16384 2024-09-21T06:39:03.249 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:39:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.244+0000 7ffb301e1640 1 -- 172.21.15.63:0/1808491857 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffb140b6700 msgr2=0x7ffb140b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.244+0000 7ffb301e1640 1 --2- 172.21.15.63:0/1808491857 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffb140b6700 0x7ffb140b8c10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ffb24031440 tx=0x7ffb240058b0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.244+0000 7ffb301e1640 1 -- 172.21.15.63:0/1808491857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb28108d10 msgr2=0x7ffb2819ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.244+0000 7ffb301e1640 1 --2- 172.21.15.63:0/1808491857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb28108d10 0x7ffb2819ebb0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000eaa0 tx=0x7ffb2000ef60 comp rx=0 tx=0).stop 2024-09-21T06:39:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.244+0000 7ffb301e1640 1 -- 172.21.15.63:0/1808491857 shutdown_connections 2024-09-21T06:39:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.244+0000 7ffb301e1640 1 --2- 172.21.15.63:0/1808491857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb28108d10 0x7ffb2819ebb0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.244+0000 7ffb301e1640 1 --2- 172.21.15.63:0/1808491857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb281083c0 0x7ffb28199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.244+0000 7ffb301e1640 1 --2- 172.21.15.63:0/1808491857 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7ffb140b6700 0x7ffb140b8c10 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.244+0000 7ffb301e1640 1 --2- 172.21.15.63:0/1808491857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb28102a80 0x7ffb28199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.244+0000 7ffb301e1640 1 -- 172.21.15.63:0/1808491857 >> 172.21.15.63:0/1808491857 conn(0x7ffb28079740 msgr2=0x7ffb28101470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.244+0000 7ffb301e1640 1 -- 172.21.15.63:0/1808491857 shutdown_connections 2024-09-21T06:39:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:03.244+0000 7ffb301e1640 1 -- 172.21.15.63:0/1808491857 wait complete. 2024-09-21T06:39:03.931 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:03 smithi063 ceph-mon[31150]: pgmap v656: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-21T06:39:03.965 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:39:04.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:03 smithi071 ceph-mon[34844]: pgmap v656: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-21T06:39:04.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:03 smithi175 ceph-mon[34510]: pgmap v656: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-21T06:39:04.228 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:04.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.710+0000 7fd4b11ad640 1 -- 172.21.15.63:0/822027044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4ac10dec0 msgr2=0x7fd4ac1103b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:04.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.710+0000 7fd4b11ad640 1 --2- 172.21.15.63:0/822027044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4ac10dec0 0x7fd4ac1103b0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009ca0 tx=0x7fd4a402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.710+0000 7fd4b11ad640 1 -- 172.21.15.63:0/822027044 shutdown_connections 2024-09-21T06:39:04.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.710+0000 7fd4b11ad640 1 --2- 172.21.15.63:0/822027044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4ac10dec0 0x7fd4ac1103b0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.710+0000 7fd4b11ad640 1 --2- 172.21.15.63:0/822027044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4ac1053b0 0x7fd4ac10d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.710+0000 7fd4b11ad640 1 --2- 172.21.15.63:0/822027044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4ac104a60 0x7fd4ac104e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.710+0000 7fd4b11ad640 1 -- 172.21.15.63:0/822027044 >> 172.21.15.63:0/822027044 conn(0x7fd4ac0796d0 msgr2=0x7fd4ac079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:04.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.710+0000 7fd4b11ad640 1 -- 172.21.15.63:0/822027044 shutdown_connections 2024-09-21T06:39:04.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.710+0000 7fd4b11ad640 1 -- 172.21.15.63:0/822027044 wait complete. 2024-09-21T06:39:04.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.711+0000 7fd4b11ad640 1 Processor -- start 2024-09-21T06:39:04.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.711+0000 7fd4b11ad640 1 -- start start 2024-09-21T06:39:04.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.712+0000 7fd4b11ad640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4ac104a60 0x7fd4ac19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:04.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.712+0000 7fd4b11ad640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4ac1053b0 0x7fd4ac19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:04.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.712+0000 7fd4b11ad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4ac10dec0 0x7fd4ac19fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:04.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.712+0000 7fd4b11ad640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac113b40 con 0x7fd4ac1053b0 2024-09-21T06:39:04.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.712+0000 7fd4b11ad640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac1139c0 con 0x7fd4ac104a60 2024-09-21T06:39:04.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.712+0000 7fd4b11ad640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac113cc0 con 0x7fd4ac10dec0 2024-09-21T06:39:04.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.712+0000 7fd4aa59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4ac1053b0 0x7fd4ac19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:04.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.712+0000 7fd4aa59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4ac1053b0 0x7fd4ac19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58962/0 (socket says 172.21.15.63:58962) 2024-09-21T06:39:04.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.712+0000 7fd4aa59c640 1 -- 172.21.15.63:0/1983072551 learned_addr learned my addr 172.21.15.63:0/1983072551 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:04.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.712+0000 7fd4aad9d640 1 --2- 172.21.15.63:0/1983072551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4ac104a60 0x7fd4ac19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:04.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.712+0000 7fd4ab59e640 1 --2- 172.21.15.63:0/1983072551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4ac10dec0 0x7fd4ac19fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:04.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.712+0000 7fd4aa59c640 1 -- 172.21.15.63:0/1983072551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4ac10dec0 msgr2=0x7fd4ac19fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:04.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.712+0000 7fd4aa59c640 1 --2- 172.21.15.63:0/1983072551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4ac10dec0 0x7fd4ac19fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.712+0000 7fd4aa59c640 1 -- 172.21.15.63:0/1983072551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4ac104a60 msgr2=0x7fd4ac19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:04.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.712+0000 7fd4aa59c640 1 --2- 172.21.15.63:0/1983072551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4ac104a60 0x7fd4ac19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.712+0000 7fd4aa59c640 1 -- 172.21.15.63:0/1983072551 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4ac1a0580 con 0x7fd4ac1053b0 2024-09-21T06:39:04.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.712+0000 7fd4aa59c640 1 --2- 172.21.15.63:0/1983072551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4ac1053b0 0x7fd4ac19abb0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000d740 tx=0x7fd4a000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:04.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.713+0000 7fd493fff640 1 -- 172.21.15.63:0/1983072551 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0017070 con 0x7fd4ac1053b0 2024-09-21T06:39:04.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.713+0000 7fd4b11ad640 1 -- 172.21.15.63:0/1983072551 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4ac1a0870 con 0x7fd4ac1053b0 2024-09-21T06:39:04.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.713+0000 7fd493fff640 1 -- 172.21.15.63:0/1983072551 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4a000de50 con 0x7fd4ac1053b0 2024-09-21T06:39:04.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.713+0000 7fd493fff640 1 -- 172.21.15.63:0/1983072551 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a000f620 con 0x7fd4ac1053b0 2024-09-21T06:39:04.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.713+0000 7fd4b11ad640 1 -- 172.21.15.63:0/1983072551 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4ac1a6fd0 con 0x7fd4ac1053b0 2024-09-21T06:39:04.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.715+0000 7fd4b7721740 1 Processor -- start 2024-09-21T06:39:04.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.716+0000 7fd4b7721740 1 -- start start 2024-09-21T06:39:04.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.716+0000 7fd493fff640 1 -- 172.21.15.63:0/1983072551 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fd4a001a070 con 0x7fd4ac1053b0 2024-09-21T06:39:04.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.716+0000 7fd4b7721740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f224070 0x55714f5cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:04.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.716+0000 7fd4b7721740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1fb1b0 0x55714f5cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:04.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.716+0000 7fd4b7721740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55714f203390 0x55714f5cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:04.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.716+0000 7fd4b7721740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55714f541ea0 con 0x55714f1fb1b0 2024-09-21T06:39:04.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.716+0000 7fd4b7721740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55714f5312d0 con 0x55714f203390 2024-09-21T06:39:04.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.716+0000 7fd4b7721740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55714f5350e0 con 0x55714f224070 2024-09-21T06:39:04.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.716+0000 7fd4aad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1fb1b0 0x55714f5cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:04.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.716+0000 7fd4aad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1fb1b0 0x55714f5cbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58978/0 (socket says 172.21.15.63:58978) 2024-09-21T06:39:04.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.716+0000 7fd4aad9d640 1 -- 172.21.15.63:0/2798508971 learned_addr learned my addr 172.21.15.63:0/2798508971 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:04.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.716+0000 7fd4ab59e640 1 --2- 172.21.15.63:0/2798508971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f224070 0x55714f5cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:04.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.716+0000 7fd4aa59c640 1 --2- 172.21.15.63:0/2798508971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55714f203390 0x55714f5cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:04.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.716+0000 7fd4aad9d640 1 -- 172.21.15.63:0/2798508971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f224070 msgr2=0x55714f5cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:04.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.716+0000 7fd4aad9d640 1 --2- 172.21.15.63:0/2798508971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f224070 0x55714f5cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.716+0000 7fd4aad9d640 1 -- 172.21.15.63:0/2798508971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55714f203390 msgr2=0x55714f5cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:04.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.716+0000 7fd4aad9d640 1 --2- 172.21.15.63:0/2798508971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55714f203390 0x55714f5cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.716+0000 7fd4aad9d640 1 -- 172.21.15.63:0/2798508971 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55714f28f650 con 0x55714f1fb1b0 2024-09-21T06:39:04.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.716+0000 7fd4ab59e640 1 --2- 172.21.15.63:0/2798508971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f224070 0x55714f5cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:04.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.717+0000 7fd4aad9d640 1 --2- 172.21.15.63:0/2798508971 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1fb1b0 0x55714f5cbbe0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00b760 tx=0x7fd49c00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8bcfefc9d29f72 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:04.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.717+0000 7fd493fff640 1 --2- 172.21.15.63:0/1983072551 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd4940b6680 0x7fd4940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:04.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.717+0000 7fd4917fa640 1 -- 172.21.15.63:0/2798508971 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49c003dd0 con 0x55714f1fb1b0 2024-09-21T06:39:04.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.717+0000 7fd4917fa640 1 -- 172.21.15.63:0/2798508971 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd49c015070 con 0x55714f1fb1b0 2024-09-21T06:39:04.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.717+0000 7fd4917fa640 1 -- 172.21.15.63:0/2798508971 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49c004d90 con 0x55714f1fb1b0 2024-09-21T06:39:04.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.717+0000 7fd4ab59e640 1 --2- 172.21.15.63:0/1983072551 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd4940b6680 0x7fd4940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:04.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.717+0000 7fd493fff640 1 -- 172.21.15.63:0/1983072551 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7fd4a00e7100 con 0x7fd4ac1053b0 2024-09-21T06:39:04.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.718+0000 7fd4b7721740 1 -- 172.21.15.63:0/2798508971 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1fb1b0 msgr2=0x55714f5cbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:04.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.718+0000 7fd4b7721740 1 --2- 172.21.15.63:0/2798508971 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1fb1b0 0x55714f5cbbe0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00b760 tx=0x7fd49c00bc20 comp rx=0 tx=0).stop 2024-09-21T06:39:04.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.718+0000 7fd4ab59e640 1 --2- 172.21.15.63:0/1983072551 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd4940b6680 0x7fd4940b8b90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd4a40094e0 tx=0x7fd4a40093f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:04.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.718+0000 7fd4b7721740 1 -- 172.21.15.63:0/2798508971 shutdown_connections 2024-09-21T06:39:04.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.718+0000 7fd4b7721740 1 --2- 172.21.15.63:0/2798508971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55714f203390 0x55714f5cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.718+0000 7fd4b7721740 1 --2- 172.21.15.63:0/2798508971 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1fb1b0 0x55714f5cbbe0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.718+0000 7fd4b7721740 1 --2- 172.21.15.63:0/2798508971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f224070 0x55714f5cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.718+0000 7fd4b7721740 1 -- 172.21.15.63:0/2798508971 >> 172.21.15.63:0/2798508971 conn(0x55714f218460 msgr2=0x55714f5c9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:04.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.718+0000 7fd4b7721740 1 -- 172.21.15.63:0/2798508971 shutdown_connections 2024-09-21T06:39:04.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.718+0000 7fd4b7721740 1 -- 172.21.15.63:0/2798508971 wait complete. 2024-09-21T06:39:04.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.718+0000 7fd4b7721740 1 -- start start 2024-09-21T06:39:04.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.719+0000 7fd4b7721740 1 Processor -- start 2024-09-21T06:39:04.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.719+0000 7fd4b7721740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f1fb1b0 0x55714f5d6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:04.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.719+0000 7fd4b7721740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f203390 0x55714f5d7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:04.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.719+0000 7fd4b7721740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55714f224070 0x55714f5e31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:04.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.719+0000 7fd4b7721740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55714f392700 con 0x55714f203390 2024-09-21T06:39:04.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.719+0000 7fd4b7721740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55714f4cc160 con 0x55714f224070 2024-09-21T06:39:04.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.719+0000 7fd4b7721740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55714f5d9e80 con 0x55714f1fb1b0 2024-09-21T06:39:04.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.719+0000 7fd4b7721740 10 client.0 _ll_register_callbacks cb 0x55714f4e59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:04.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.719+0000 7fd4aa59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f203390 0x55714f5d7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:04.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.719+0000 7fd4aa59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f203390 0x55714f5d7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58986/0 (socket says 172.21.15.63:58986) 2024-09-21T06:39:04.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.719+0000 7fd4aa59c640 1 -- 172.21.15.63:0/926273980 learned_addr learned my addr 172.21.15.63:0/926273980 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:04.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.719+0000 7fd4ab59e640 1 --2- 172.21.15.63:0/926273980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55714f224070 0x55714f5e31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:04.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.719+0000 7fd4aad9d640 1 --2- 172.21.15.63:0/926273980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f1fb1b0 0x55714f5d6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:04.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.719+0000 7fd4aa59c640 1 -- 172.21.15.63:0/926273980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f1fb1b0 msgr2=0x55714f5d6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:04.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.719+0000 7fd4aa59c640 1 --2- 172.21.15.63:0/926273980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f1fb1b0 0x55714f5d6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.719+0000 7fd4aa59c640 1 -- 172.21.15.63:0/926273980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55714f224070 msgr2=0x55714f5e31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:04.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.719+0000 7fd4aa59c640 1 --2- 172.21.15.63:0/926273980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55714f224070 0x55714f5e31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.719+0000 7fd4aa59c640 1 -- 172.21.15.63:0/926273980 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55714f4f9c90 con 0x55714f203390 2024-09-21T06:39:04.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.720+0000 7fd4aa59c640 1 --2- 172.21.15.63:0/926273980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f203390 0x55714f5d7320 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fd4a00e4860 tx=0x7fd4a00ea810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4928b31cf96cef06 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:04.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.720+0000 7fd48eff5640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:39:04.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.720+0000 7fd48eff5640 1 -- 172.21.15.63:0/926273980 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0021030 con 0x55714f203390 2024-09-21T06:39:04.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.720+0000 7fd48eff5640 1 -- 172.21.15.63:0/926273980 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7fd4a0094270 con 0x55714f203390 2024-09-21T06:39:04.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.720+0000 7fd4b7721740 1 -- 172.21.15.63:0/926273980 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd49c015070 con 0x55714f203390 2024-09-21T06:39:04.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.720+0000 7fd48eff5640 1 -- 172.21.15.63:0/926273980 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fd4a00ac850 con 0x55714f203390 2024-09-21T06:39:04.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.720+0000 7fd4b7721740 10 client.17724 fetch_fsmap learned FSMap version 61 2024-09-21T06:39:04.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.720+0000 7fd4b7721740 1 -- 172.21.15.63:0/926273980 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55714f5e5bf0 con 0x55714f203390 2024-09-21T06:39:04.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.720+0000 7fd48eff5640 1 -- 172.21.15.63:0/926273980 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd49c015070 con 0x55714f203390 2024-09-21T06:39:04.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.720+0000 7fd48eff5640 1 -- 172.21.15.63:0/926273980 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fd4a00a8850 con 0x55714f203390 2024-09-21T06:39:04.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.720+0000 7fd4b7721740 10 client.17724 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:39:04.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.720+0000 7fd4b7721740 10 client.17724 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:39:04.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.720+0000 7fd4b7721740 20 client.17724 populate_metadata read hostname 'smithi063' 2024-09-21T06:39:04.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.720+0000 7fd4b7721740 1 --2- 172.21.15.63:0/926273980 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55714f1e29f0 0x55714f5e90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:04.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.720+0000 7fd4b7721740 4 client.17724 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:04.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.720+0000 7fd4b7721740 1 -- 172.21.15.63:0/926273980 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55714f543df0 con 0x55714f1e29f0 2024-09-21T06:39:04.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.721+0000 7fd4aad9d640 1 --2- 172.21.15.63:0/926273980 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55714f1e29f0 0x55714f5e90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:04.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.721+0000 7fd4aad9d640 1 --2- 172.21.15.63:0/926273980 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55714f1e29f0 0x55714f5e90d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=666d45528610f2a8 server_cookie=da7dbd75804f5512 in_seq=0 out_seq=0 2024-09-21T06:39:04.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.721+0000 7fd48eff5640 10 client.17724 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:39:04.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.722+0000 7fd48eff5640 1 -- 172.21.15.63:0/926273980 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55714f543df0 con 0x55714f1e29f0 2024-09-21T06:39:04.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.722+0000 7fd48eff5640 10 client.17724 handle_command_reply: tid=0 2024-09-21T06:39:04.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.722+0000 7fd4b7721740 1 client.17724 shutdown 2024-09-21T06:39:04.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.722+0000 7fd4b7721740 1 -- 172.21.15.63:0/926273980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f203390 msgr2=0x55714f5d7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:04.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.722+0000 7fd4b7721740 1 --2- 172.21.15.63:0/926273980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f203390 0x55714f5d7320 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fd4a00e4860 tx=0x7fd4a00ea810 comp rx=0 tx=0).stop 2024-09-21T06:39:04.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.722+0000 7fd4b7721740 1 -- 172.21.15.63:0/926273980 shutdown_connections 2024-09-21T06:39:04.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.722+0000 7fd4b7721740 1 --2- 172.21.15.63:0/926273980 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55714f1e29f0 0x55714f5e90d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.722+0000 7fd4b7721740 1 --2- 172.21.15.63:0/926273980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55714f224070 0x55714f5e31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.722+0000 7fd4b7721740 1 --2- 172.21.15.63:0/926273980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f203390 0x55714f5d7320 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.722+0000 7fd48eff5640 0 client.17724 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:39:04.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.722+0000 7fd4b7721740 1 --2- 172.21.15.63:0/926273980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f1fb1b0 0x55714f5d6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.722+0000 7fd4b7721740 1 -- 172.21.15.63:0/926273980 >> 172.21.15.63:0/926273980 conn(0x55714f218460 msgr2=0x55714f5ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:04.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.722+0000 7fd4b7721740 1 -- 172.21.15.63:0/926273980 shutdown_connections 2024-09-21T06:39:04.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.722+0000 7fd4b7721740 1 -- 172.21.15.63:0/926273980 wait complete. 2024-09-21T06:39:04.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.722+0000 7fd4b7721740 20 client.17724 trim_cache size 0 max 16384 2024-09-21T06:39:04.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.736+0000 7fd4b7721740 1 Processor -- start 2024-09-21T06:39:04.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.736+0000 7fd4b7721740 1 -- start start 2024-09-21T06:39:04.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.736+0000 7fd4b7721740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1e29f0 0x55714f5ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:04.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.736+0000 7fd4b7721740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f1fb1b0 0x55714f5e30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:04.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.736+0000 7fd4b7721740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55714f203390 0x55714f5d3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:04.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.736+0000 7fd4b7721740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac1af8d0 con 0x55714f1e29f0 2024-09-21T06:39:04.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.736+0000 7fd4b7721740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac1b1410 con 0x55714f203390 2024-09-21T06:39:04.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.736+0000 7fd4b7721740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac1affa0 con 0x55714f1fb1b0 2024-09-21T06:39:04.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.736+0000 7fd4aad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1e29f0 0x55714f5ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:04.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.736+0000 7fd4aad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1e29f0 0x55714f5ceeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58990/0 (socket says 172.21.15.63:58990) 2024-09-21T06:39:04.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.736+0000 7fd4aad9d640 1 -- 172.21.15.63:0/1213637137 learned_addr learned my addr 172.21.15.63:0/1213637137 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:04.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.737+0000 7fd4ab59e640 1 --2- 172.21.15.63:0/1213637137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55714f203390 0x55714f5d3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:04.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.737+0000 7fd4aa59c640 1 --2- 172.21.15.63:0/1213637137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f1fb1b0 0x55714f5e30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:04.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.737+0000 7fd4aad9d640 1 -- 172.21.15.63:0/1213637137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f1fb1b0 msgr2=0x55714f5e30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:04.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.737+0000 7fd4aad9d640 1 --2- 172.21.15.63:0/1213637137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f1fb1b0 0x55714f5e30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.737+0000 7fd4aad9d640 1 -- 172.21.15.63:0/1213637137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55714f203390 msgr2=0x55714f5d3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:04.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.737+0000 7fd4aad9d640 1 --2- 172.21.15.63:0/1213637137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55714f203390 0x55714f5d3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.737+0000 7fd4aad9d640 1 -- 172.21.15.63:0/1213637137 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55714f5d80a0 con 0x55714f1e29f0 2024-09-21T06:39:04.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.737+0000 7fd4aad9d640 1 --2- 172.21.15.63:0/1213637137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1e29f0 0x55714f5ceeb0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fd49c0048a0 tx=0x7fd49c004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d3efbd78f4b013 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:04.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.737+0000 7fd490ff9640 1 -- 172.21.15.63:0/1213637137 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49c003dd0 con 0x55714f1e29f0 2024-09-21T06:39:04.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.737+0000 7fd490ff9640 1 -- 172.21.15.63:0/1213637137 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd49c015050 con 0x55714f1e29f0 2024-09-21T06:39:04.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.737+0000 7fd490ff9640 1 -- 172.21.15.63:0/1213637137 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49c019620 con 0x55714f1e29f0 2024-09-21T06:39:04.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.738+0000 7fd4b7721740 1 -- 172.21.15.63:0/1213637137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1e29f0 msgr2=0x55714f5ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:04.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.738+0000 7fd4b7721740 1 --2- 172.21.15.63:0/1213637137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1e29f0 0x55714f5ceeb0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fd49c0048a0 tx=0x7fd49c004970 comp rx=0 tx=0).stop 2024-09-21T06:39:04.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.738+0000 7fd4b7721740 1 -- 172.21.15.63:0/1213637137 shutdown_connections 2024-09-21T06:39:04.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.738+0000 7fd4b7721740 1 --2- 172.21.15.63:0/1213637137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55714f203390 0x55714f5d3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.738+0000 7fd4b7721740 1 --2- 172.21.15.63:0/1213637137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f1fb1b0 0x55714f5e30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.738+0000 7fd4b7721740 1 --2- 172.21.15.63:0/1213637137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1e29f0 0x55714f5ceeb0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.738+0000 7fd4b7721740 1 -- 172.21.15.63:0/1213637137 >> 172.21.15.63:0/1213637137 conn(0x55714f218460 msgr2=0x55714f5ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:04.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.738+0000 7fd4b7721740 1 -- 172.21.15.63:0/1213637137 shutdown_connections 2024-09-21T06:39:04.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.738+0000 7fd4b7721740 1 -- 172.21.15.63:0/1213637137 wait complete. 2024-09-21T06:39:04.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.739+0000 7fd4b7721740 1 -- start start 2024-09-21T06:39:04.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.739+0000 7fd4b7721740 1 Processor -- start 2024-09-21T06:39:04.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.739+0000 7fd4b7721740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1e29f0 0x55714f5db1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:04.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.739+0000 7fd4b7721740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f1fb1b0 0x55714f5db720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:04.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.739+0000 7fd4b7721740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55714f203390 0x55714f5dbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:04.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.739+0000 7fd4b7721740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac1b0d40 con 0x55714f1e29f0 2024-09-21T06:39:04.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.739+0000 7fd4b7721740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac1b0670 con 0x55714f203390 2024-09-21T06:39:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.739+0000 7fd4b7721740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac1ad8d0 con 0x55714f1fb1b0 2024-09-21T06:39:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.739+0000 7fd4b7721740 10 client.0 _ll_register_callbacks cb 0x7fd4a0009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.739+0000 7fd4aad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1e29f0 0x55714f5db1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.739+0000 7fd4aad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1e29f0 0x55714f5db1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59000/0 (socket says 172.21.15.63:59000) 2024-09-21T06:39:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.739+0000 7fd4aad9d640 1 -- 172.21.15.63:0/3573255425 learned_addr learned my addr 172.21.15.63:0/3573255425 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.739+0000 7fd4aa59c640 1 --2- 172.21.15.63:0/3573255425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f1fb1b0 0x55714f5db720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.740+0000 7fd4ab59e640 1 --2- 172.21.15.63:0/3573255425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55714f203390 0x55714f5dbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.740+0000 7fd4aad9d640 1 -- 172.21.15.63:0/3573255425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f1fb1b0 msgr2=0x55714f5db720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.740+0000 7fd4aad9d640 1 --2- 172.21.15.63:0/3573255425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f1fb1b0 0x55714f5db720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.740+0000 7fd4aad9d640 1 -- 172.21.15.63:0/3573255425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55714f203390 msgr2=0x55714f5dbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.740+0000 7fd4aad9d640 1 --2- 172.21.15.63:0/3573255425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55714f203390 0x55714f5dbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.740+0000 7fd4aad9d640 1 -- 172.21.15.63:0/3573255425 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55714f652b40 con 0x55714f1e29f0 2024-09-21T06:39:04.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.740+0000 7fd4aad9d640 1 --2- 172.21.15.63:0/3573255425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1e29f0 0x55714f5db1e0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fd49c026040 tx=0x7fd49c00bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e7b31907a0ebdd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.740+0000 7fd48eff5640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:39:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.740+0000 7fd48eff5640 1 -- 172.21.15.63:0/3573255425 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49c003e40 con 0x55714f1e29f0 2024-09-21T06:39:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.740+0000 7fd4b7721740 1 -- 172.21.15.63:0/3573255425 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd49c015050 con 0x55714f1e29f0 2024-09-21T06:39:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.740+0000 7fd48eff5640 1 -- 172.21.15.63:0/3573255425 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7fd49c011440 con 0x55714f1e29f0 2024-09-21T06:39:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.740+0000 7fd48eff5640 1 -- 172.21.15.63:0/3573255425 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fd49c011640 con 0x55714f1e29f0 2024-09-21T06:39:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.740+0000 7fd4b7721740 10 client.17730 fetch_fsmap learned FSMap version 61 2024-09-21T06:39:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.740+0000 7fd4b7721740 1 -- 172.21.15.63:0/3573255425 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55714f653dc0 con 0x55714f1e29f0 2024-09-21T06:39:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.741+0000 7fd48eff5640 1 -- 172.21.15.63:0/3573255425 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd49c015050 con 0x55714f1e29f0 2024-09-21T06:39:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.741+0000 7fd48eff5640 1 -- 172.21.15.63:0/3573255425 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7fd49c03cba0 con 0x55714f1e29f0 2024-09-21T06:39:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.741+0000 7fd4b7721740 10 client.17730 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:39:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.741+0000 7fd4b7721740 10 client.17730 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:39:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.741+0000 7fd4b7721740 20 client.17730 populate_metadata read hostname 'smithi063' 2024-09-21T06:39:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.741+0000 7fd4b7721740 1 --2- 172.21.15.63:0/3573255425 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55714f224070 0x55714f656290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:04.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.741+0000 7fd4b7721740 4 client.17730 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:39:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.741+0000 7fd4b7721740 1 -- 172.21.15.63:0/3573255425 --> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55714f53f8a0 con 0x55714f224070 2024-09-21T06:39:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.741+0000 7fd4aa59c640 1 --2- 172.21.15.63:0/3573255425 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55714f224070 0x55714f656290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.742+0000 7fd4aa59c640 1 --2- 172.21.15.63:0/3573255425 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55714f224070 0x55714f656290 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f713285339303236 server_cookie=778d3fc05675b205 in_seq=0 out_seq=0 2024-09-21T06:39:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.742+0000 7fd48eff5640 10 client.17730 ms_handle_connect on v2:172.21.15.175:6836/2825611591 2024-09-21T06:39:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.742+0000 7fd48eff5640 1 -- 172.21.15.63:0/3573255425 <== mds.2 v2:172.21.15.175:6836/2825611591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55714f53f8a0 con 0x55714f224070 2024-09-21T06:39:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.742+0000 7fd48eff5640 10 client.17730 handle_command_reply: tid=0 2024-09-21T06:39:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.742+0000 7fd4b7721740 1 client.17730 shutdown 2024-09-21T06:39:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.742+0000 7fd4b7721740 1 -- 172.21.15.63:0/3573255425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1e29f0 msgr2=0x55714f5db1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.742+0000 7fd4b7721740 1 --2- 172.21.15.63:0/3573255425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1e29f0 0x55714f5db1e0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fd49c026040 tx=0x7fd49c00bf00 comp rx=0 tx=0).stop 2024-09-21T06:39:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.742+0000 7fd4b7721740 1 -- 172.21.15.63:0/3573255425 shutdown_connections 2024-09-21T06:39:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.742+0000 7fd4b7721740 1 --2- 172.21.15.63:0/3573255425 >> [v2:172.21.15.175:6836/2825611591,v1:172.21.15.175:6837/2825611591] conn(0x55714f224070 0x55714f656290 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.742+0000 7fd4b7721740 1 --2- 172.21.15.63:0/3573255425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55714f203390 0x55714f5dbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.742+0000 7fd4b7721740 1 --2- 172.21.15.63:0/3573255425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55714f1fb1b0 0x55714f5db720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.742+0000 7fd4b7721740 1 --2- 172.21.15.63:0/3573255425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55714f1e29f0 0x55714f5db1e0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.742+0000 7fd4b7721740 1 -- 172.21.15.63:0/3573255425 >> 172.21.15.63:0/3573255425 conn(0x55714f218460 msgr2=0x55714f5d8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:04.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.742+0000 7fd48eff5640 0 client.17730 ms_handle_reset on v2:172.21.15.175:6836/2825611591 2024-09-21T06:39:04.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.742+0000 7fd4b7721740 1 -- 172.21.15.63:0/3573255425 shutdown_connections 2024-09-21T06:39:04.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.742+0000 7fd4b7721740 1 -- 172.21.15.63:0/3573255425 wait complete. 2024-09-21T06:39:04.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.743+0000 7fd4b7721740 20 client.17730 trim_cache size 0 max 16384 2024-09-21T06:39:04.755 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:39:04.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.743+0000 7fd4b11ad640 1 -- 172.21.15.63:0/1983072551 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd4940b6680 msgr2=0x7fd4940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:04.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.743+0000 7fd4b11ad640 1 --2- 172.21.15.63:0/1983072551 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd4940b6680 0x7fd4940b8b90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd4a40094e0 tx=0x7fd4a40093f0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.743+0000 7fd4b11ad640 1 -- 172.21.15.63:0/1983072551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4ac1053b0 msgr2=0x7fd4ac19abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:04.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.743+0000 7fd4b11ad640 1 --2- 172.21.15.63:0/1983072551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4ac1053b0 0x7fd4ac19abb0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000d740 tx=0x7fd4a000dc00 comp rx=0 tx=0).stop 2024-09-21T06:39:04.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.743+0000 7fd4b11ad640 1 -- 172.21.15.63:0/1983072551 shutdown_connections 2024-09-21T06:39:04.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.743+0000 7fd4b11ad640 1 --2- 172.21.15.63:0/1983072551 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fd4940b6680 0x7fd4940b8b90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.743+0000 7fd4b11ad640 1 --2- 172.21.15.63:0/1983072551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4ac10dec0 0x7fd4ac19fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.743+0000 7fd4b11ad640 1 --2- 172.21.15.63:0/1983072551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4ac1053b0 0x7fd4ac19abb0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.743+0000 7fd4b11ad640 1 --2- 172.21.15.63:0/1983072551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4ac104a60 0x7fd4ac19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:04.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.743+0000 7fd4b11ad640 1 -- 172.21.15.63:0/1983072551 >> 172.21.15.63:0/1983072551 conn(0x7fd4ac0796d0 msgr2=0x7fd4ac0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:04.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.743+0000 7fd4b11ad640 1 -- 172.21.15.63:0/1983072551 shutdown_connections 2024-09-21T06:39:04.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:04.743+0000 7fd4b11ad640 1 -- 172.21.15.63:0/1983072551 wait complete. 2024-09-21T06:39:05.454 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:39:05.717 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:05.999 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:05 smithi063 ceph-mon[31150]: pgmap v657: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:39:06.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:05 smithi071 ceph-mon[34844]: pgmap v657: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:39:06.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:05 smithi175 ceph-mon[34510]: pgmap v657: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T06:39:06.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.196+0000 7f980b7b8640 1 -- 172.21.15.63:0/459138880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f980410de10 msgr2=0x7f9804110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:06.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.196+0000 7f980b7b8640 1 --2- 172.21.15.63:0/459138880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f980410de10 0x7f9804110300 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009900 tx=0x7f97fc02a410 comp rx=0 tx=0).stop 2024-09-21T06:39:06.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.196+0000 7f980b7b8640 1 -- 172.21.15.63:0/459138880 shutdown_connections 2024-09-21T06:39:06.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.196+0000 7f980b7b8640 1 --2- 172.21.15.63:0/459138880 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f980410de10 0x7f9804110300 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.196+0000 7f980b7b8640 1 --2- 172.21.15.63:0/459138880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9804105300 0x7f980410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.196+0000 7f980b7b8640 1 --2- 172.21.15.63:0/459138880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98041049b0 0x7f9804104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.196+0000 7f980b7b8640 1 -- 172.21.15.63:0/459138880 >> 172.21.15.63:0/459138880 conn(0x7f9804079730 msgr2=0x7f9804079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:06.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.196+0000 7f980b7b8640 1 -- 172.21.15.63:0/459138880 shutdown_connections 2024-09-21T06:39:06.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.196+0000 7f980b7b8640 1 -- 172.21.15.63:0/459138880 wait complete. 2024-09-21T06:39:06.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.197+0000 7f980b7b8640 1 Processor -- start 2024-09-21T06:39:06.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.197+0000 7f980b7b8640 1 -- start start 2024-09-21T06:39:06.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.197+0000 7f980b7b8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98041049b0 0x7f980419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:06.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.197+0000 7f980b7b8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9804105300 0x7f980419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:06.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.197+0000 7f980b7b8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f980410de10 0x7f980419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:06.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.197+0000 7f980b7b8640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9804113a90 con 0x7f9804105300 2024-09-21T06:39:06.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.197+0000 7f980b7b8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9804113910 con 0x7f980410de10 2024-09-21T06:39:06.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.197+0000 7f980b7b8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9804113c10 con 0x7f98041049b0 2024-09-21T06:39:06.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.198+0000 7f9808d53640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9804105300 0x7f980419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:06.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.198+0000 7f9809554640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98041049b0 0x7f980419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:06.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.198+0000 7f9808d53640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9804105300 0x7f980419ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59024/0 (socket says 172.21.15.63:59024) 2024-09-21T06:39:06.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.198+0000 7f9809554640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98041049b0 0x7f980419a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:44954/0 (socket says 172.21.15.63:44954) 2024-09-21T06:39:06.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.198+0000 7f9808d53640 1 -- 172.21.15.63:0/2239842968 learned_addr learned my addr 172.21.15.63:0/2239842968 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:06.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.198+0000 7f9809d55640 1 --2- 172.21.15.63:0/2239842968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f980410de10 0x7f980419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:06.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.198+0000 7f9808d53640 1 -- 172.21.15.63:0/2239842968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98041049b0 msgr2=0x7f980419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:06.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.198+0000 7f9808d53640 1 --2- 172.21.15.63:0/2239842968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98041049b0 0x7f980419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.198+0000 7f9808d53640 1 -- 172.21.15.63:0/2239842968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f980410de10 msgr2=0x7f980419fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:06.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.198+0000 7f9808d53640 1 --2- 172.21.15.63:0/2239842968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f980410de10 0x7f980419fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.198+0000 7f9808d53640 1 -- 172.21.15.63:0/2239842968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98041a0510 con 0x7f9804105300 2024-09-21T06:39:06.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.198+0000 7f9809d55640 1 --2- 172.21.15.63:0/2239842968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f980410de10 0x7f980419fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:06.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.198+0000 7f9808d53640 1 --2- 172.21.15.63:0/2239842968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9804105300 0x7f980419ab40 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f97f800e9c0 tx=0x7f97f800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:06.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.198+0000 7f98027fc640 1 -- 172.21.15.63:0/2239842968 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f800ccc0 con 0x7f9804105300 2024-09-21T06:39:06.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.198+0000 7f98027fc640 1 -- 172.21.15.63:0/2239842968 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97f80054d0 con 0x7f9804105300 2024-09-21T06:39:06.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.198+0000 7f980b7b8640 1 -- 172.21.15.63:0/2239842968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98041a0800 con 0x7f9804105300 2024-09-21T06:39:06.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.198+0000 7f98027fc640 1 -- 172.21.15.63:0/2239842968 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f8010430 con 0x7f9804105300 2024-09-21T06:39:06.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.199+0000 7f980b7b8640 1 -- 172.21.15.63:0/2239842968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98041a6f60 con 0x7f9804105300 2024-09-21T06:39:06.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.201+0000 7f9811d2c740 1 Processor -- start 2024-09-21T06:39:06.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.201+0000 7f9811d2c740 1 -- start start 2024-09-21T06:39:06.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.202+0000 7f98027fc640 1 -- 172.21.15.63:0/2239842968 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f97f8005020 con 0x7f9804105300 2024-09-21T06:39:06.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.202+0000 7f9811d2c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb7f070 0x55a74cf266a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:06.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.202+0000 7f9811d2c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb561b0 0x55a74cf26be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:06.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.202+0000 7f9811d2c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb5e390 0x55a74cf27120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:06.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.202+0000 7f9811d2c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a74ce9cea0 con 0x55a74cb561b0 2024-09-21T06:39:06.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.202+0000 7f9811d2c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a74ce8c2d0 con 0x55a74cb5e390 2024-09-21T06:39:06.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.202+0000 7f9811d2c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a74ce900e0 con 0x55a74cb7f070 2024-09-21T06:39:06.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.202+0000 7f9809554640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb561b0 0x55a74cf26be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:06.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.202+0000 7f9809554640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb561b0 0x55a74cf26be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59026/0 (socket says 172.21.15.63:59026) 2024-09-21T06:39:06.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.202+0000 7f9809554640 1 -- 172.21.15.63:0/2319160703 learned_addr learned my addr 172.21.15.63:0/2319160703 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:06.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.202+0000 7f9808d53640 1 --2- 172.21.15.63:0/2319160703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb5e390 0x55a74cf27120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:06.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.202+0000 7f9809d55640 1 --2- 172.21.15.63:0/2319160703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb7f070 0x55a74cf266a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:06.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.202+0000 7f9809554640 1 -- 172.21.15.63:0/2319160703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb7f070 msgr2=0x55a74cf266a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:06.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.202+0000 7f9809554640 1 --2- 172.21.15.63:0/2319160703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb7f070 0x55a74cf266a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.202+0000 7f9809554640 1 -- 172.21.15.63:0/2319160703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb5e390 msgr2=0x55a74cf27120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:06.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.202+0000 7f9809554640 1 --2- 172.21.15.63:0/2319160703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb5e390 0x55a74cf27120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.202+0000 7f9809554640 1 -- 172.21.15.63:0/2319160703 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a74cbea650 con 0x55a74cb561b0 2024-09-21T06:39:06.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.202+0000 7f9809d55640 1 --2- 172.21.15.63:0/2319160703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb7f070 0x55a74cf266a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:06.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.203+0000 7f9809554640 1 --2- 172.21.15.63:0/2319160703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb561b0 0x55a74cf26be0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f97f4011470 tx=0x7f97f4011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd17d90e5cfe134 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:06.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.203+0000 7f97eb7fe640 1 -- 172.21.15.63:0/2319160703 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f4003970 con 0x55a74cb561b0 2024-09-21T06:39:06.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.203+0000 7f98027fc640 1 --2- 172.21.15.63:0/2239842968 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f97ec0b6680 0x7f97ec0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:06.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.203+0000 7f97eb7fe640 1 -- 172.21.15.63:0/2319160703 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97f4004020 con 0x55a74cb561b0 2024-09-21T06:39:06.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.203+0000 7f97eb7fe640 1 -- 172.21.15.63:0/2319160703 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f400f8f0 con 0x55a74cb561b0 2024-09-21T06:39:06.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.203+0000 7f9809d55640 1 --2- 172.21.15.63:0/2239842968 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f97ec0b6680 0x7f97ec0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:06.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.203+0000 7f98027fc640 1 -- 172.21.15.63:0/2239842968 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f97f80e7ad0 con 0x7f9804105300 2024-09-21T06:39:06.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.204+0000 7f9811d2c740 1 -- 172.21.15.63:0/2319160703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb561b0 msgr2=0x55a74cf26be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:06.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.204+0000 7f9811d2c740 1 --2- 172.21.15.63:0/2319160703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb561b0 0x55a74cf26be0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f97f4011470 tx=0x7f97f4011930 comp rx=0 tx=0).stop 2024-09-21T06:39:06.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.204+0000 7f9809d55640 1 --2- 172.21.15.63:0/2239842968 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f97ec0b6680 0x7f97ec0b8b90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f97fc005940 tx=0x7f97fc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:06.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.204+0000 7f9811d2c740 1 -- 172.21.15.63:0/2319160703 shutdown_connections 2024-09-21T06:39:06.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.204+0000 7f9811d2c740 1 --2- 172.21.15.63:0/2319160703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb5e390 0x55a74cf27120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.204+0000 7f9811d2c740 1 --2- 172.21.15.63:0/2319160703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb561b0 0x55a74cf26be0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.204+0000 7f9811d2c740 1 --2- 172.21.15.63:0/2319160703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb7f070 0x55a74cf266a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.204+0000 7f9811d2c740 1 -- 172.21.15.63:0/2319160703 >> 172.21.15.63:0/2319160703 conn(0x55a74cb73460 msgr2=0x55a74cf24590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:06.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.204+0000 7f9811d2c740 1 -- 172.21.15.63:0/2319160703 shutdown_connections 2024-09-21T06:39:06.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.204+0000 7f9811d2c740 1 -- 172.21.15.63:0/2319160703 wait complete. 2024-09-21T06:39:06.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.204+0000 7f9811d2c740 1 -- start start 2024-09-21T06:39:06.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.205+0000 7f9811d2c740 1 Processor -- start 2024-09-21T06:39:06.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.205+0000 7f9811d2c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb561b0 0x55a74cf31de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:06.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.205+0000 7f9811d2c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb5e390 0x55a74cf32320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:06.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.205+0000 7f9811d2c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb7f070 0x55a74cf3e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:06.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.205+0000 7f9811d2c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a74cced700 con 0x55a74cb561b0 2024-09-21T06:39:06.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.205+0000 7f9811d2c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a74ce27160 con 0x55a74cb5e390 2024-09-21T06:39:06.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.205+0000 7f9811d2c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a74cf34e80 con 0x55a74cb7f070 2024-09-21T06:39:06.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.205+0000 7f9811d2c740 10 client.0 _ll_register_callbacks cb 0x55a74ce409e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:06.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.205+0000 7f9809554640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb561b0 0x55a74cf31de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:06.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.205+0000 7f9809554640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb561b0 0x55a74cf31de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59042/0 (socket says 172.21.15.63:59042) 2024-09-21T06:39:06.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.205+0000 7f9809554640 1 -- 172.21.15.63:0/1409439789 learned_addr learned my addr 172.21.15.63:0/1409439789 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:06.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.205+0000 7f9808d53640 1 --2- 172.21.15.63:0/1409439789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb5e390 0x55a74cf32320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:06.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.205+0000 7f9809d55640 1 --2- 172.21.15.63:0/1409439789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb7f070 0x55a74cf3e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:06.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.206+0000 7f9809554640 1 -- 172.21.15.63:0/1409439789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb7f070 msgr2=0x55a74cf3e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:06.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.206+0000 7f9809554640 1 --2- 172.21.15.63:0/1409439789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb7f070 0x55a74cf3e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.206+0000 7f9809554640 1 -- 172.21.15.63:0/1409439789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb5e390 msgr2=0x55a74cf32320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:06.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.206+0000 7f9809554640 1 --2- 172.21.15.63:0/1409439789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb5e390 0x55a74cf32320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.206+0000 7f9809554640 1 -- 172.21.15.63:0/1409439789 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a74ce54c90 con 0x55a74cb561b0 2024-09-21T06:39:06.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.206+0000 7f9808d53640 1 --2- 172.21.15.63:0/1409439789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb5e390 0x55a74cf32320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:06.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.206+0000 7f9809554640 1 --2- 172.21.15.63:0/1409439789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb561b0 0x55a74cf31de0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f97f401b040 tx=0x7f97f4004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f905e379ff1f00d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:06.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.206+0000 7f97e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:39:06.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.206+0000 7f97e8ff9640 1 -- 172.21.15.63:0/1409439789 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f4004e60 con 0x55a74cb561b0 2024-09-21T06:39:06.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.206+0000 7f9811d2c740 1 -- 172.21.15.63:0/1409439789 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97f4004020 con 0x55a74cb561b0 2024-09-21T06:39:06.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.206+0000 7f97e8ff9640 1 -- 172.21.15.63:0/1409439789 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f97f4003b80 con 0x55a74cb561b0 2024-09-21T06:39:06.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.206+0000 7f97e8ff9640 1 -- 172.21.15.63:0/1409439789 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f97f4009c00 con 0x55a74cb561b0 2024-09-21T06:39:06.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.206+0000 7f9811d2c740 10 client.17742 fetch_fsmap learned FSMap version 61 2024-09-21T06:39:06.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.206+0000 7f9811d2c740 1 -- 172.21.15.63:0/1409439789 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55a74cf40bf0 con 0x55a74cb561b0 2024-09-21T06:39:06.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.207+0000 7f97e8ff9640 1 -- 172.21.15.63:0/1409439789 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97f4004020 con 0x55a74cb561b0 2024-09-21T06:39:06.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.207+0000 7f97e8ff9640 1 -- 172.21.15.63:0/1409439789 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f97f40215d0 con 0x55a74cb561b0 2024-09-21T06:39:06.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.207+0000 7f9811d2c740 10 client.17742 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:39:06.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.207+0000 7f9811d2c740 10 client.17742 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:39:06.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.207+0000 7f9811d2c740 20 client.17742 populate_metadata read hostname 'smithi063' 2024-09-21T06:39:06.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.207+0000 7f9811d2c740 1 --2- 172.21.15.63:0/1409439789 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55a74cb3d9f0 0x55a74cf44130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:06.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.207+0000 7f9811d2c740 4 client.17742 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:06.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.207+0000 7f9811d2c740 1 -- 172.21.15.63:0/1409439789 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a74ce9edf0 con 0x55a74cb3d9f0 2024-09-21T06:39:06.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.207+0000 7f9808d53640 1 --2- 172.21.15.63:0/1409439789 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55a74cb3d9f0 0x55a74cf44130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:06.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.208+0000 7f9808d53640 1 --2- 172.21.15.63:0/1409439789 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55a74cb3d9f0 0x55a74cf44130 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b62458a93fe32585 server_cookie=8e31684262a4881f in_seq=0 out_seq=0 2024-09-21T06:39:06.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.208+0000 7f97e8ff9640 10 client.17742 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:39:06.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.208+0000 7f97e8ff9640 1 -- 172.21.15.63:0/1409439789 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a74ce9edf0 con 0x55a74cb3d9f0 2024-09-21T06:39:06.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.208+0000 7f97e8ff9640 10 client.17742 handle_command_reply: tid=0 2024-09-21T06:39:06.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.208+0000 7f9811d2c740 1 client.17742 shutdown 2024-09-21T06:39:06.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.209+0000 7f9811d2c740 1 -- 172.21.15.63:0/1409439789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb561b0 msgr2=0x55a74cf31de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:06.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.209+0000 7f9811d2c740 1 --2- 172.21.15.63:0/1409439789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb561b0 0x55a74cf31de0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f97f401b040 tx=0x7f97f4004c70 comp rx=0 tx=0).stop 2024-09-21T06:39:06.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.209+0000 7f9811d2c740 1 -- 172.21.15.63:0/1409439789 shutdown_connections 2024-09-21T06:39:06.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.209+0000 7f9811d2c740 1 --2- 172.21.15.63:0/1409439789 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55a74cb3d9f0 0x55a74cf44130 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.209+0000 7f9811d2c740 1 --2- 172.21.15.63:0/1409439789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb7f070 0x55a74cf3e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.209+0000 7f9811d2c740 1 --2- 172.21.15.63:0/1409439789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb5e390 0x55a74cf32320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.209+0000 7f9811d2c740 1 --2- 172.21.15.63:0/1409439789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb561b0 0x55a74cf31de0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.209+0000 7f9811d2c740 1 -- 172.21.15.63:0/1409439789 >> 172.21.15.63:0/1409439789 conn(0x55a74cb73460 msgr2=0x55a74cf29830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:06.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.209+0000 7f97e8ff9640 0 client.17742 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:39:06.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.209+0000 7f9811d2c740 1 -- 172.21.15.63:0/1409439789 shutdown_connections 2024-09-21T06:39:06.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.209+0000 7f9811d2c740 1 -- 172.21.15.63:0/1409439789 wait complete. 2024-09-21T06:39:06.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.209+0000 7f9811d2c740 20 client.17742 trim_cache size 0 max 16384 2024-09-21T06:39:06.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.222+0000 7f9811d2c740 1 Processor -- start 2024-09-21T06:39:06.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.222+0000 7f9811d2c740 1 -- start start 2024-09-21T06:39:06.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.222+0000 7f9811d2c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb561b0 0x55a74cf322a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:06.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.222+0000 7f9811d2c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb5e390 0x55a74cf3e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:06.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.222+0000 7f9811d2c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb7f070 0x55a74cf23ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:06.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.222+0000 7f9811d2c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f98041ad6c0 con 0x55a74cb7f070 2024-09-21T06:39:06.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.222+0000 7f9811d2c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f98041af200 con 0x55a74cb561b0 2024-09-21T06:39:06.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.222+0000 7f9811d2c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f98041add90 con 0x55a74cb5e390 2024-09-21T06:39:06.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.223+0000 7f9809d55640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb7f070 0x55a74cf23ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:06.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.223+0000 7f9809d55640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb7f070 0x55a74cf23ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59046/0 (socket says 172.21.15.63:59046) 2024-09-21T06:39:06.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.223+0000 7f9809d55640 1 -- 172.21.15.63:0/651482413 learned_addr learned my addr 172.21.15.63:0/651482413 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:06.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.223+0000 7f9809554640 1 --2- 172.21.15.63:0/651482413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb561b0 0x55a74cf322a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:06.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.223+0000 7f9808d53640 1 --2- 172.21.15.63:0/651482413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb5e390 0x55a74cf3e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:06.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.223+0000 7f9809d55640 1 -- 172.21.15.63:0/651482413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb5e390 msgr2=0x55a74cf3e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:06.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.223+0000 7f9809d55640 1 --2- 172.21.15.63:0/651482413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb5e390 0x55a74cf3e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.223+0000 7f9809d55640 1 -- 172.21.15.63:0/651482413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb561b0 msgr2=0x55a74cf322a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:06.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.223+0000 7f9809d55640 1 --2- 172.21.15.63:0/651482413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb561b0 0x55a74cf322a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.223+0000 7f9809d55640 1 -- 172.21.15.63:0/651482413 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a74cf330a0 con 0x55a74cb7f070 2024-09-21T06:39:06.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.223+0000 7f9809d55640 1 --2- 172.21.15.63:0/651482413 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb7f070 0x55a74cf23ed0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009900 tx=0x7f97fc03d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d1d9c4d91b2b45 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:06.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.223+0000 7f97eaffd640 1 -- 172.21.15.63:0/651482413 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97fc035050 con 0x55a74cb7f070 2024-09-21T06:39:06.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.223+0000 7f97eaffd640 1 -- 172.21.15.63:0/651482413 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97fc0054d0 con 0x55a74cb7f070 2024-09-21T06:39:06.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.223+0000 7f97eaffd640 1 -- 172.21.15.63:0/651482413 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97fc004bc0 con 0x55a74cb7f070 2024-09-21T06:39:06.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.224+0000 7f9811d2c740 1 -- 172.21.15.63:0/651482413 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb7f070 msgr2=0x55a74cf23ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:06.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.224+0000 7f9811d2c740 1 --2- 172.21.15.63:0/651482413 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb7f070 0x55a74cf23ed0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009900 tx=0x7f97fc03d000 comp rx=0 tx=0).stop 2024-09-21T06:39:06.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.224+0000 7f9811d2c740 1 -- 172.21.15.63:0/651482413 shutdown_connections 2024-09-21T06:39:06.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.224+0000 7f9811d2c740 1 --2- 172.21.15.63:0/651482413 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb7f070 0x55a74cf23ed0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.224+0000 7f9811d2c740 1 --2- 172.21.15.63:0/651482413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb5e390 0x55a74cf3e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.224+0000 7f9811d2c740 1 --2- 172.21.15.63:0/651482413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb561b0 0x55a74cf322a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.224+0000 7f9811d2c740 1 -- 172.21.15.63:0/651482413 >> 172.21.15.63:0/651482413 conn(0x55a74cb73460 msgr2=0x55a74cf31b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:06.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.224+0000 7f9811d2c740 1 -- 172.21.15.63:0/651482413 shutdown_connections 2024-09-21T06:39:06.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.224+0000 7f9811d2c740 1 -- 172.21.15.63:0/651482413 wait complete. 2024-09-21T06:39:06.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.225+0000 7f9811d2c740 1 -- start start 2024-09-21T06:39:06.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.225+0000 7f9811d2c740 1 Processor -- start 2024-09-21T06:39:06.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.225+0000 7f9811d2c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb561b0 0x55a74cf44aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:06.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.225+0000 7f9811d2c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb5e390 0x55a74cf45080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:06.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.225+0000 7f9811d2c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb7f070 0x55a74cfa5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:06.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.225+0000 7f9811d2c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f98041aeb30 con 0x55a74cb5e390 2024-09-21T06:39:06.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.225+0000 7f9811d2c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f98041ae460 con 0x55a74cb7f070 2024-09-21T06:39:06.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.225+0000 7f9811d2c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f98041ab6c0 con 0x55a74cb561b0 2024-09-21T06:39:06.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.225+0000 7f9811d2c740 10 client.0 _ll_register_callbacks cb 0x7f97f4009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:06.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.225+0000 7f9808d53640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb5e390 0x55a74cf45080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:06.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.225+0000 7f9809554640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb561b0 0x55a74cf44aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:06.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.225+0000 7f9808d53640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb5e390 0x55a74cf45080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59062/0 (socket says 172.21.15.63:59062) 2024-09-21T06:39:06.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.226+0000 7f9808d53640 1 -- 172.21.15.63:0/3861867449 learned_addr learned my addr 172.21.15.63:0/3861867449 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:06.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.226+0000 7f9809d55640 1 --2- 172.21.15.63:0/3861867449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb7f070 0x55a74cfa5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:06.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.226+0000 7f9808d53640 1 -- 172.21.15.63:0/3861867449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb561b0 msgr2=0x55a74cf44aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:06.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.226+0000 7f9808d53640 1 --2- 172.21.15.63:0/3861867449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb561b0 0x55a74cf44aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.226+0000 7f9808d53640 1 -- 172.21.15.63:0/3861867449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb7f070 msgr2=0x55a74cfa5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:06.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.226+0000 7f9808d53640 1 --2- 172.21.15.63:0/3861867449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb7f070 0x55a74cfa5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.226+0000 7f9808d53640 1 -- 172.21.15.63:0/3861867449 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a74cfa5ed0 con 0x55a74cb5e390 2024-09-21T06:39:06.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.226+0000 7f9809d55640 1 --2- 172.21.15.63:0/3861867449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb7f070 0x55a74cfa5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:06.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.226+0000 7f9809554640 1 --2- 172.21.15.63:0/3861867449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb561b0 0x55a74cf44aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:06.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.226+0000 7f9808d53640 1 --2- 172.21.15.63:0/3861867449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb5e390 0x55a74cf45080 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f97f80e5280 tx=0x7f97f80d1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5dbbaf182316ca2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:06.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.226+0000 7f97e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T06:39:06.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.226+0000 7f97e8ff9640 1 -- 172.21.15.63:0/3861867449 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f800ce60 con 0x55a74cb5e390 2024-09-21T06:39:06.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.226+0000 7f97e8ff9640 1 -- 172.21.15.63:0/3861867449 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f97f80acd30 con 0x55a74cb5e390 2024-09-21T06:39:06.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.226+0000 7f9811d2c740 1 -- 172.21.15.63:0/3861867449 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97fc0054d0 con 0x55a74cb5e390 2024-09-21T06:39:06.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.227+0000 7f97e8ff9640 1 -- 172.21.15.63:0/3861867449 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f97f80a9f20 con 0x55a74cb5e390 2024-09-21T06:39:06.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.227+0000 7f9811d2c740 10 client.17748 fetch_fsmap learned FSMap version 61 2024-09-21T06:39:06.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.227+0000 7f9811d2c740 1 -- 172.21.15.63:0/3861867449 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55a74cfae410 con 0x55a74cb5e390 2024-09-21T06:39:06.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.227+0000 7f97e8ff9640 1 -- 172.21.15.63:0/3861867449 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97fc0054d0 con 0x55a74cb5e390 2024-09-21T06:39:06.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.227+0000 7f97e8ff9640 1 -- 172.21.15.63:0/3861867449 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 61) ==== 8362+0+0 (secure 0 0 0) 0x7f97f80ac5a0 con 0x55a74cb5e390 2024-09-21T06:39:06.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.227+0000 7f9811d2c740 10 client.17748 fetch_fsmap finished waiting for FSMap version 61 2024-09-21T06:39:06.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.227+0000 7f9811d2c740 10 client.17748 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:39:06.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.227+0000 7f9811d2c740 20 client.17748 populate_metadata read hostname 'smithi063' 2024-09-21T06:39:06.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.227+0000 7f9811d2c740 1 --2- 172.21.15.63:0/3861867449 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55a74cb12da0 0x55a74cfb0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:06.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.227+0000 7f9811d2c740 4 client.17748 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:39:06.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.227+0000 7f9811d2c740 1 -- 172.21.15.63:0/3861867449 --> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a74ce9a8a0 con 0x55a74cb12da0 2024-09-21T06:39:06.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.227+0000 7f9809554640 1 --2- 172.21.15.63:0/3861867449 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55a74cb12da0 0x55a74cfb0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:06.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.228+0000 7f9809554640 1 --2- 172.21.15.63:0/3861867449 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55a74cb12da0 0x55a74cfb0b80 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=317e84d88c8de626 server_cookie=ef6b842ab9b9bb81 in_seq=0 out_seq=0 2024-09-21T06:39:06.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.228+0000 7f97e8ff9640 10 client.17748 ms_handle_connect on v2:172.21.15.175:6838/3302221763 2024-09-21T06:39:06.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.228+0000 7f97e8ff9640 1 -- 172.21.15.63:0/3861867449 <== mds.1 v2:172.21.15.175:6838/3302221763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a74ce9a8a0 con 0x55a74cb12da0 2024-09-21T06:39:06.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.228+0000 7f97e8ff9640 10 client.17748 handle_command_reply: tid=0 2024-09-21T06:39:06.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.228+0000 7f9811d2c740 1 client.17748 shutdown 2024-09-21T06:39:06.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.228+0000 7f9811d2c740 1 -- 172.21.15.63:0/3861867449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb5e390 msgr2=0x55a74cf45080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:06.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.228+0000 7f9811d2c740 1 --2- 172.21.15.63:0/3861867449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb5e390 0x55a74cf45080 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f97f80e5280 tx=0x7f97f80d1040 comp rx=0 tx=0).stop 2024-09-21T06:39:06.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.228+0000 7f9811d2c740 1 -- 172.21.15.63:0/3861867449 shutdown_connections 2024-09-21T06:39:06.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.228+0000 7f9811d2c740 1 --2- 172.21.15.63:0/3861867449 >> [v2:172.21.15.175:6838/3302221763,v1:172.21.15.175:6839/3302221763] conn(0x55a74cb12da0 0x55a74cfb0b80 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.228+0000 7f9811d2c740 1 --2- 172.21.15.63:0/3861867449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a74cb7f070 0x55a74cfa5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.228+0000 7f9811d2c740 1 --2- 172.21.15.63:0/3861867449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a74cb5e390 0x55a74cf45080 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.228+0000 7f9811d2c740 1 --2- 172.21.15.63:0/3861867449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a74cb561b0 0x55a74cf44aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.228+0000 7f9811d2c740 1 -- 172.21.15.63:0/3861867449 >> 172.21.15.63:0/3861867449 conn(0x55a74cb73460 msgr2=0x55a74cf297a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:06.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.228+0000 7f97e8ff9640 0 client.17748 ms_handle_reset on v2:172.21.15.175:6838/3302221763 2024-09-21T06:39:06.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.228+0000 7f9811d2c740 1 -- 172.21.15.63:0/3861867449 shutdown_connections 2024-09-21T06:39:06.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.228+0000 7f9811d2c740 1 -- 172.21.15.63:0/3861867449 wait complete. 2024-09-21T06:39:06.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.229+0000 7f9811d2c740 20 client.17748 trim_cache size 0 max 16384 2024-09-21T06:39:06.235 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-21T06:39:06.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.229+0000 7f980b7b8640 1 -- 172.21.15.63:0/2239842968 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f97ec0b6680 msgr2=0x7f97ec0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:06.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.229+0000 7f980b7b8640 1 --2- 172.21.15.63:0/2239842968 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f97ec0b6680 0x7f97ec0b8b90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f97fc005940 tx=0x7f97fc0058d0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.229+0000 7f980b7b8640 1 -- 172.21.15.63:0/2239842968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9804105300 msgr2=0x7f980419ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:06.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.229+0000 7f980b7b8640 1 --2- 172.21.15.63:0/2239842968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9804105300 0x7f980419ab40 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f97f800e9c0 tx=0x7f97f800ee80 comp rx=0 tx=0).stop 2024-09-21T06:39:06.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.229+0000 7f980b7b8640 1 -- 172.21.15.63:0/2239842968 shutdown_connections 2024-09-21T06:39:06.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.229+0000 7f980b7b8640 1 --2- 172.21.15.63:0/2239842968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f980410de10 0x7f980419fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.229+0000 7f980b7b8640 1 --2- 172.21.15.63:0/2239842968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9804105300 0x7f980419ab40 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.229+0000 7f980b7b8640 1 --2- 172.21.15.63:0/2239842968 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f97ec0b6680 0x7f97ec0b8b90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.229+0000 7f980b7b8640 1 --2- 172.21.15.63:0/2239842968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98041049b0 0x7f980419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:06.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.229+0000 7f980b7b8640 1 -- 172.21.15.63:0/2239842968 >> 172.21.15.63:0/2239842968 conn(0x7f9804079730 msgr2=0x7f98040ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:06.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.229+0000 7f980b7b8640 1 -- 172.21.15.63:0/2239842968 shutdown_connections 2024-09-21T06:39:06.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:06.229+0000 7f980b7b8640 1 -- 172.21.15.63:0/2239842968 wait complete. 2024-09-21T06:39:06.943 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-21T06:39:06.944 INFO:tasks.fwd_scrub:done joining 2024-09-21T06:39:06.944 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T06:39:06.954 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:39:07.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.072+0000 7f34e363f640 1 -- 172.21.15.63:0/955821495 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34dc1082b0 msgr2=0x7f34dc1086c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:07.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.072+0000 7f34e363f640 1 --2- 172.21.15.63:0/955821495 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34dc1082b0 0x7f34dc1086c0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009900 tx=0x7f34cc02a410 comp rx=0 tx=0).stop 2024-09-21T06:39:07.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.073+0000 7f34e363f640 1 -- 172.21.15.63:0/955821495 shutdown_connections 2024-09-21T06:39:07.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.073+0000 7f34e363f640 1 --2- 172.21.15.63:0/955821495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34dc108c00 0x7f34dc10f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.073+0000 7f34e363f640 1 --2- 172.21.15.63:0/955821495 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34dc1082b0 0x7f34dc1086c0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.073+0000 7f34e363f640 1 --2- 172.21.15.63:0/955821495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34dc102980 0x7f34dc102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.073+0000 7f34e363f640 1 -- 172.21.15.63:0/955821495 >> 172.21.15.63:0/955821495 conn(0x7f34dc0fe380 msgr2=0x7f34dc1007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.073+0000 7f34e363f640 1 -- 172.21.15.63:0/955821495 shutdown_connections 2024-09-21T06:39:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.073+0000 7f34e363f640 1 -- 172.21.15.63:0/955821495 wait complete. 2024-09-21T06:39:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.073+0000 7f34e363f640 1 Processor -- start 2024-09-21T06:39:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.073+0000 7f34e363f640 1 -- start start 2024-09-21T06:39:07.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.074+0000 7f34e363f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34dc102980 0x7f34dc198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:07.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.074+0000 7f34e363f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34dc1082b0 0x7f34dc199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:07.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.074+0000 7f34e363f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34dc108c00 0x7f34dc199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:07.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.074+0000 7f34e363f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc1128c0 con 0x7f34dc1082b0 2024-09-21T06:39:07.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.074+0000 7f34e363f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc112740 con 0x7f34dc108c00 2024-09-21T06:39:07.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.074+0000 7f34e363f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc112a40 con 0x7f34dc102980 2024-09-21T06:39:07.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.074+0000 7f34e0bda640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34dc1082b0 0x7f34dc199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:07.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.074+0000 7f34e0bda640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34dc1082b0 0x7f34dc199520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60016/0 (socket says 172.21.15.63:60016) 2024-09-21T06:39:07.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.074+0000 7f34e0bda640 1 -- 172.21.15.63:0/2196118015 learned_addr learned my addr 172.21.15.63:0/2196118015 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:07.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.074+0000 7f34e1bdc640 1 --2- 172.21.15.63:0/2196118015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34dc108c00 0x7f34dc199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:07.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.074+0000 7f34e13db640 1 --2- 172.21.15.63:0/2196118015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34dc102980 0x7f34dc198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:07.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.074+0000 7f34e0bda640 1 -- 172.21.15.63:0/2196118015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34dc102980 msgr2=0x7f34dc198fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:07.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.074+0000 7f34e0bda640 1 --2- 172.21.15.63:0/2196118015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34dc102980 0x7f34dc198fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.074+0000 7f34e0bda640 1 -- 172.21.15.63:0/2196118015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34dc108c00 msgr2=0x7f34dc199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:07.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.074+0000 7f34e0bda640 1 --2- 172.21.15.63:0/2196118015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34dc108c00 0x7f34dc199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.074+0000 7f34e0bda640 1 -- 172.21.15.63:0/2196118015 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34dc1a8690 con 0x7f34dc1082b0 2024-09-21T06:39:07.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.074+0000 7f34e1bdc640 1 --2- 172.21.15.63:0/2196118015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34dc108c00 0x7f34dc199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:07.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.074+0000 7f34e0bda640 1 --2- 172.21.15.63:0/2196118015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34dc1082b0 0x7f34dc199520 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f34cc02a930 tx=0x7f34cc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:07.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.074+0000 7f34d27fc640 1 -- 172.21.15.63:0/2196118015 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc03f030 con 0x7f34dc1082b0 2024-09-21T06:39:07.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.075+0000 7f34e363f640 1 -- 172.21.15.63:0/2196118015 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34dc1a8920 con 0x7f34dc1082b0 2024-09-21T06:39:07.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.075+0000 7f34d27fc640 1 -- 172.21.15.63:0/2196118015 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34cc003aa0 con 0x7f34dc1082b0 2024-09-21T06:39:07.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.075+0000 7f34d27fc640 1 -- 172.21.15.63:0/2196118015 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc035070 con 0x7f34dc1082b0 2024-09-21T06:39:07.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.075+0000 7f34e363f640 1 -- 172.21.15.63:0/2196118015 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34dc1a8e60 con 0x7f34dc1082b0 2024-09-21T06:39:07.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.076+0000 7f34e363f640 1 -- 172.21.15.63:0/2196118015 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34dc103bf0 con 0x7f34dc1082b0 2024-09-21T06:39:07.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.077+0000 7f34d27fc640 1 -- 172.21.15.63:0/2196118015 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f34cc042030 con 0x7f34dc1082b0 2024-09-21T06:39:07.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.078+0000 7f34d27fc640 1 --2- 172.21.15.63:0/2196118015 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f34c80b6680 0x7f34c80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:07.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.078+0000 7f34e13db640 1 --2- 172.21.15.63:0/2196118015 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f34c80b6680 0x7f34c80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:07.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.078+0000 7f34d27fc640 1 -- 172.21.15.63:0/2196118015 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f34cc1083b0 con 0x7f34dc1082b0 2024-09-21T06:39:07.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.079+0000 7f34e13db640 1 --2- 172.21.15.63:0/2196118015 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f34c80b6680 0x7f34c80b8b90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f34d8005d00 tx=0x7f34d8005c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:07.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.081+0000 7f34d27fc640 1 -- 172.21.15.63:0/2196118015 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f34cc0ce8b0 con 0x7f34dc1082b0 2024-09-21T06:39:07.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.271+0000 7f34e363f640 1 -- 172.21.15.63:0/2196118015 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f34dc10aa50 con 0x7f34dc1082b0 2024-09-21T06:39:07.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.272+0000 7f34d27fc640 1 -- 172.21.15.63:0/2196118015 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+23269 (secure 0 0 0) 0x7f34cc0d2c90 con 0x7f34dc1082b0 2024-09-21T06:39:07.274 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:39:07.275 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":86,"fsid":"140899c8-77e1-11ef-baf5-efdc52797490","created":"2024-09-21T06:17:48.089366+0000","modified":"2024-09-21T06:38:18.930706+0000","last_up_change":"2024-09-21T06:25:29.072128+0000","last_in_change":"2024-09-21T06:25:06.097647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:21:36.236868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:26:15.016085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:26:17.072883+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":85,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df4162c1-dd66-4d11-99bc-0ae36ea130f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6803","nonce":2090653772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6805","nonce":2090653772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6809","nonce":2090653772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6807","nonce":2090653772}]},"public_addr":"172.21.15.63:6803/2090653772","cluster_addr":"172.21.15.63:6805/2090653772","heartbeat_back_addr":"172.21.15.63:6809/2090653772","heartbeat_front_addr":"172.21.15.63:6807/2090653772","state":["exists","up"]},{"osd":1,"uuid":"65a12def-9f66-4153-8f1a-2ebfbbfeba99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6801","nonce":1676297548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6803","nonce":1676297548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6807","nonce":1676297548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6805","nonce":1676297548}]},"public_addr":"172.21.15.71:6801/1676297548","cluster_addr":"172.21.15.71:6803/1676297548","heartbeat_back_addr":"172.21.15.71:6807/1676297548","heartbeat_front_addr":"172.21.15.71:6805/1676297548","state":["exists","up"]},{"osd":2,"uuid":"031daa9e-9d4a-4901-95e8-695db5671fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6801","nonce":2356865390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6803","nonce":2356865390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6807","nonce":2356865390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6805","nonce":2356865390}]},"public_addr":"172.21.15.175:6801/2356865390","cluster_addr":"172.21.15.175:6803/2356865390","heartbeat_back_addr":"172.21.15.175:6807/2356865390","heartbeat_front_addr":"172.21.15.175:6805/2356865390","state":["exists","up"]},{"osd":3,"uuid":"75d23a7a-c560-4b26-84a4-74d6772a37ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6811","nonce":31683339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6813","nonce":31683339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6817","nonce":31683339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6815","nonce":31683339}]},"public_addr":"172.21.15.63:6811/31683339","cluster_addr":"172.21.15.63:6813/31683339","heartbeat_back_addr":"172.21.15.63:6817/31683339","heartbeat_front_addr":"172.21.15.63:6815/31683339","state":["exists","up"]},{"osd":4,"uuid":"6aaefd09-93dd-4f21-9b3c-701a7ff97f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6809","nonce":829449898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6811","nonce":829449898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6815","nonce":829449898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6813","nonce":829449898}]},"public_addr":"172.21.15.71:6809/829449898","cluster_addr":"172.21.15.71:6811/829449898","heartbeat_back_addr":"172.21.15.71:6815/829449898","heartbeat_front_addr":"172.21.15.71:6813/829449898","state":["exists","up"]},{"osd":5,"uuid":"91f28121-c94e-4012-b74c-dd4597545e3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6809","nonce":3005600597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6811","nonce":3005600597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6815","nonce":3005600597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6813","nonce":3005600597}]},"public_addr":"172.21.15.175:6809/3005600597","cluster_addr":"172.21.15.175:6811/3005600597","heartbeat_back_addr":"172.21.15.175:6815/3005600597","heartbeat_front_addr":"172.21.15.175:6813/3005600597","state":["exists","up"]},{"osd":6,"uuid":"bda28014-4dca-40f1-bb23-3ef61605c1ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6819","nonce":4044730408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6821","nonce":4044730408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6825","nonce":4044730408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6823","nonce":4044730408}]},"public_addr":"172.21.15.63:6819/4044730408","cluster_addr":"172.21.15.63:6821/4044730408","heartbeat_back_addr":"172.21.15.63:6825/4044730408","heartbeat_front_addr":"172.21.15.63:6823/4044730408","state":["exists","up"]},{"osd":7,"uuid":"a9026588-ccdc-4e6c-b628-1ac8a7dbfa64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6817","nonce":2913027708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6819","nonce":2913027708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6823","nonce":2913027708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6821","nonce":2913027708}]},"public_addr":"172.21.15.71:6817/2913027708","cluster_addr":"172.21.15.71:6819/2913027708","heartbeat_back_addr":"172.21.15.71:6823/2913027708","heartbeat_front_addr":"172.21.15.71:6821/2913027708","state":["exists","up"]},{"osd":8,"uuid":"2e1dacea-483c-4587-8d19-5c77a7b98667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6817","nonce":2058692148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6819","nonce":2058692148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6823","nonce":2058692148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6821","nonce":2058692148}]},"public_addr":"172.21.15.175:6817/2058692148","cluster_addr":"172.21.15.175:6819/2058692148","heartbeat_back_addr":"172.21.15.175:6823/2058692148","heartbeat_front_addr":"172.21.15.175:6821/2058692148","state":["exists","up"]},{"osd":9,"uuid":"7077ba4d-1fce-4197-a556-8b6a859c6f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6827","nonce":3278012285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6829","nonce":3278012285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6833","nonce":3278012285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6831","nonce":3278012285}]},"public_addr":"172.21.15.63:6827/3278012285","cluster_addr":"172.21.15.63:6829/3278012285","heartbeat_back_addr":"172.21.15.63:6833/3278012285","heartbeat_front_addr":"172.21.15.63:6831/3278012285","state":["exists","up"]},{"osd":10,"uuid":"99965496-91ee-4eef-9f2e-8f9c8dc54f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6825","nonce":3297929438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6827","nonce":3297929438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6831","nonce":3297929438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6829","nonce":3297929438}]},"public_addr":"172.21.15.71:6825/3297929438","cluster_addr":"172.21.15.71:6827/3297929438","heartbeat_back_addr":"172.21.15.71:6831/3297929438","heartbeat_front_addr":"172.21.15.71:6829/3297929438","state":["exists","up"]},{"osd":11,"uuid":"1b26d1a8-91a4-4877-ad1c-18160a1b3b6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6825","nonce":1970094291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6827","nonce":1970094291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6831","nonce":1970094291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6829","nonce":1970094291}]},"public_addr":"172.21.15.175:6825/1970094291","cluster_addr":"172.21.15.175:6827/1970094291","heartbeat_back_addr":"172.21.15.175:6831/1970094291","heartbeat_front_addr":"172.21.15.175:6829/1970094291","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:20:43.732676+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:08.957775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:34.157788+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:00.134410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:25.502998+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:51.739501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:18.325642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:44.430626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:10.776017+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:36.482831+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:01.898216+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:27.644941+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:6839/3472481253":"2024-09-22T06:30:16.107900+0000","172.21.15.71:6838/3472481253":"2024-09-22T06:30:16.107900+0000","172.21.15.63:0/1652196301":"2024-09-22T06:19:37.776447+0000","172.21.15.63:6801/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/2740830999":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6801/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6801/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/2958589237":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/1398493582":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/3529491525":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/363262068":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6800/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/3928056461":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/128321401":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/39222803":"2024-09-22T06:19:37.776447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:39:07.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.274+0000 7f34e363f640 1 -- 172.21.15.63:0/2196118015 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f34c80b6680 msgr2=0x7f34c80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:07.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.274+0000 7f34e363f640 1 --2- 172.21.15.63:0/2196118015 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f34c80b6680 0x7f34c80b8b90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f34d8005d00 tx=0x7f34d8005c70 comp rx=0 tx=0).stop 2024-09-21T06:39:07.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.274+0000 7f34e363f640 1 -- 172.21.15.63:0/2196118015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34dc1082b0 msgr2=0x7f34dc199520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:07.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.274+0000 7f34e363f640 1 --2- 172.21.15.63:0/2196118015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34dc1082b0 0x7f34dc199520 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f34cc02a930 tx=0x7f34cc004270 comp rx=0 tx=0).stop 2024-09-21T06:39:07.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.274+0000 7f34e363f640 1 -- 172.21.15.63:0/2196118015 shutdown_connections 2024-09-21T06:39:07.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.274+0000 7f34e363f640 1 --2- 172.21.15.63:0/2196118015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34dc108c00 0x7f34dc199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.274+0000 7f34e363f640 1 --2- 172.21.15.63:0/2196118015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34dc1082b0 0x7f34dc199520 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.274+0000 7f34e363f640 1 --2- 172.21.15.63:0/2196118015 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f34c80b6680 0x7f34c80b8b90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.274+0000 7f34e363f640 1 --2- 172.21.15.63:0/2196118015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34dc102980 0x7f34dc198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.274+0000 7f34e363f640 1 -- 172.21.15.63:0/2196118015 >> 172.21.15.63:0/2196118015 conn(0x7f34dc0fe380 msgr2=0x7f34dc107930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:07.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.275+0000 7f34e363f640 1 -- 172.21.15.63:0/2196118015 shutdown_connections 2024-09-21T06:39:07.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.275+0000 7f34e363f640 1 -- 172.21.15.63:0/2196118015 wait complete. 2024-09-21T06:39:07.288 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:21:36.236868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T06:26:15.016085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T06:26:17.072883+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 85, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:39:07.288 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:39:07.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.403+0000 7f34eca7e640 1 -- 172.21.15.63:0/174415910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34e8109d30 msgr2=0x7f34e8110560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:07.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.403+0000 7f34eca7e640 1 --2- 172.21.15.63:0/174415910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34e8109d30 0x7f34e8110560 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f34e0009ca0 tx=0x7f34e002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.403+0000 7f34eca7e640 1 -- 172.21.15.63:0/174415910 shutdown_connections 2024-09-21T06:39:07.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.403+0000 7f34eca7e640 1 --2- 172.21.15.63:0/174415910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34e8109d30 0x7f34e8110560 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.403+0000 7f34eca7e640 1 --2- 172.21.15.63:0/174415910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e81093e0 0x7f34e81097f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.403+0000 7f34eca7e640 1 --2- 172.21.15.63:0/174415910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34e8103ab0 0x7f34e8103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.403+0000 7f34eca7e640 1 -- 172.21.15.63:0/174415910 >> 172.21.15.63:0/174415910 conn(0x7f34e80ff4d0 msgr2=0x7f34e8101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:07.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.403+0000 7f34eca7e640 1 -- 172.21.15.63:0/174415910 shutdown_connections 2024-09-21T06:39:07.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.403+0000 7f34eca7e640 1 -- 172.21.15.63:0/174415910 wait complete. 2024-09-21T06:39:07.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.404+0000 7f34eca7e640 1 Processor -- start 2024-09-21T06:39:07.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.404+0000 7f34eca7e640 1 -- start start 2024-09-21T06:39:07.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.404+0000 7f34eca7e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e8103ab0 0x7f34e819a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:07.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.404+0000 7f34eca7e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34e81093e0 0x7f34e819a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:07.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.404+0000 7f34eca7e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34e8109d30 0x7f34e819fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:07.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.404+0000 7f34eca7e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f34e81139f0 con 0x7f34e8109d30 2024-09-21T06:39:07.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.404+0000 7f34eca7e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f34e8113870 con 0x7f34e8103ab0 2024-09-21T06:39:07.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.404+0000 7f34eca7e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f34e8113b70 con 0x7f34e81093e0 2024-09-21T06:39:07.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.404+0000 7f34e6d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34e8109d30 0x7f34e819fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:07.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.404+0000 7f34e6d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34e8109d30 0x7f34e819fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60028/0 (socket says 172.21.15.63:60028) 2024-09-21T06:39:07.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.404+0000 7f34e6d9d640 1 -- 172.21.15.63:0/2776729445 learned_addr learned my addr 172.21.15.63:0/2776729445 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:07.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.404+0000 7f34e5d9b640 1 --2- 172.21.15.63:0/2776729445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34e81093e0 0x7f34e819a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:07.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.404+0000 7f34e659c640 1 --2- 172.21.15.63:0/2776729445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e8103ab0 0x7f34e819a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:07.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.404+0000 7f34e6d9d640 1 -- 172.21.15.63:0/2776729445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34e81093e0 msgr2=0x7f34e819a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:07.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.404+0000 7f34e6d9d640 1 --2- 172.21.15.63:0/2776729445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34e81093e0 0x7f34e819a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.404+0000 7f34e6d9d640 1 -- 172.21.15.63:0/2776729445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e8103ab0 msgr2=0x7f34e819a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:07.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.404+0000 7f34e6d9d640 1 --2- 172.21.15.63:0/2776729445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e8103ab0 0x7f34e819a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.404+0000 7f34e6d9d640 1 -- 172.21.15.63:0/2776729445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e81a0230 con 0x7f34e8109d30 2024-09-21T06:39:07.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.405+0000 7f34e6d9d640 1 --2- 172.21.15.63:0/2776729445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34e8109d30 0x7f34e819fbc0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f34e0005cc0 tx=0x7f34e002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:07.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.405+0000 7f34d77fe640 1 -- 172.21.15.63:0/2776729445 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e0003bf0 con 0x7f34e8109d30 2024-09-21T06:39:07.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.405+0000 7f34d77fe640 1 -- 172.21.15.63:0/2776729445 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34e0003d90 con 0x7f34e8109d30 2024-09-21T06:39:07.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.405+0000 7f34eca7e640 1 -- 172.21.15.63:0/2776729445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e81a04c0 con 0x7f34e8109d30 2024-09-21T06:39:07.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.405+0000 7f34d77fe640 1 -- 172.21.15.63:0/2776729445 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e002fb20 con 0x7f34e8109d30 2024-09-21T06:39:07.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.405+0000 7f34eca7e640 1 -- 172.21.15.63:0/2776729445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e81a6d40 con 0x7f34e8109d30 2024-09-21T06:39:07.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.406+0000 7f34eca7e640 1 -- 172.21.15.63:0/2776729445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34e8103ec0 con 0x7f34e8109d30 2024-09-21T06:39:07.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.408+0000 7f34d77fe640 1 -- 172.21.15.63:0/2776729445 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f34e0004580 con 0x7f34e8109d30 2024-09-21T06:39:07.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.408+0000 7f34d77fe640 1 --2- 172.21.15.63:0/2776729445 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f34d00b6700 0x7f34d00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:07.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.409+0000 7f34e659c640 1 --2- 172.21.15.63:0/2776729445 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f34d00b6700 0x7f34d00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:07.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.409+0000 7f34d77fe640 1 -- 172.21.15.63:0/2776729445 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f34e0108b50 con 0x7f34e8109d30 2024-09-21T06:39:07.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.409+0000 7f34e659c640 1 --2- 172.21.15.63:0/2776729445 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f34d00b6700 0x7f34d00b8c10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f34d800abe0 tx=0x7f34d800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:07.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.412+0000 7f34d77fe640 1 -- 172.21.15.63:0/2776729445 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f34e00cf050 con 0x7f34e8109d30 2024-09-21T06:39:07.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.599+0000 7f34eca7e640 1 -- 172.21.15.63:0/2776729445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f34e810bb20 con 0x7f34e8109d30 2024-09-21T06:39:07.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.600+0000 7f34d77fe640 1 -- 172.21.15.63:0/2776729445 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) ==== 93+0+10 (secure 0 0 0) 0x7f34e00098b0 con 0x7f34e8109d30 2024-09-21T06:39:07.602 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-09-21T06:39:07.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.602+0000 7f34eca7e640 1 -- 172.21.15.63:0/2776729445 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f34d00b6700 msgr2=0x7f34d00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:07.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.602+0000 7f34eca7e640 1 --2- 172.21.15.63:0/2776729445 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f34d00b6700 0x7f34d00b8c10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f34d800abe0 tx=0x7f34d800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.602+0000 7f34eca7e640 1 -- 172.21.15.63:0/2776729445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34e8109d30 msgr2=0x7f34e819fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:07.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.602+0000 7f34eca7e640 1 --2- 172.21.15.63:0/2776729445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34e8109d30 0x7f34e819fbc0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f34e0005cc0 tx=0x7f34e002f380 comp rx=0 tx=0).stop 2024-09-21T06:39:07.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.602+0000 7f34eca7e640 1 -- 172.21.15.63:0/2776729445 shutdown_connections 2024-09-21T06:39:07.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.602+0000 7f34eca7e640 1 --2- 172.21.15.63:0/2776729445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34e8109d30 0x7f34e819fbc0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.602+0000 7f34eca7e640 1 --2- 172.21.15.63:0/2776729445 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f34d00b6700 0x7f34d00b8c10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.602+0000 7f34eca7e640 1 --2- 172.21.15.63:0/2776729445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34e81093e0 0x7f34e819a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.602+0000 7f34eca7e640 1 --2- 172.21.15.63:0/2776729445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e8103ab0 0x7f34e819a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.602+0000 7f34eca7e640 1 -- 172.21.15.63:0/2776729445 >> 172.21.15.63:0/2776729445 conn(0x7f34e80ff4d0 msgr2=0x7f34e81018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:07.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.602+0000 7f34eca7e640 1 -- 172.21.15.63:0/2776729445 shutdown_connections 2024-09-21T06:39:07.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.602+0000 7f34eca7e640 1 -- 172.21.15.63:0/2776729445 wait complete. 2024-09-21T06:39:07.615 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T06:39:07.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.729+0000 7f4727215640 1 -- 172.21.15.63:0/3120062000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4720102a20 msgr2=0x7f4720102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:07.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.729+0000 7f4727215640 1 --2- 172.21.15.63:0/3120062000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4720102a20 0x7f4720102e30 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f4708009900 tx=0x7f470802a410 comp rx=0 tx=0).stop 2024-09-21T06:39:07.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.729+0000 7f4727215640 1 -- 172.21.15.63:0/3120062000 shutdown_connections 2024-09-21T06:39:07.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.729+0000 7f4727215640 1 --2- 172.21.15.63:0/3120062000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4720108c50 0x7f472010f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.729+0000 7f4727215640 1 --2- 172.21.15.63:0/3120062000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4720108300 0x7f4720108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.729+0000 7f4727215640 1 --2- 172.21.15.63:0/3120062000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4720102a20 0x7f4720102e30 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.729+0000 7f4727215640 1 -- 172.21.15.63:0/3120062000 >> 172.21.15.63:0/3120062000 conn(0x7f4720079630 msgr2=0x7f4720079a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:07.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.729+0000 7f4727215640 1 -- 172.21.15.63:0/3120062000 shutdown_connections 2024-09-21T06:39:07.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.729+0000 7f4727215640 1 -- 172.21.15.63:0/3120062000 wait complete. 2024-09-21T06:39:07.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.730+0000 7f4727215640 1 Processor -- start 2024-09-21T06:39:07.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.730+0000 7f4727215640 1 -- start start 2024-09-21T06:39:07.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.730+0000 7f4727215640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4720102a20 0x7f472010ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:07.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.730+0000 7f4727215640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4720108300 0x7f47201104a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:07.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.730+0000 7f4727215640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4720108c50 0x7f47201109e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:07.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.730+0000 7f4727215640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4720113a30 con 0x7f4720108c50 2024-09-21T06:39:07.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.730+0000 7f4727215640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f47201138b0 con 0x7f4720108300 2024-09-21T06:39:07.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.730+0000 7f4727215640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4720113bb0 con 0x7f4720102a20 2024-09-21T06:39:07.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.730+0000 7f47257b2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4720108c50 0x7f47201109e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:07.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.730+0000 7f47257b2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4720108c50 0x7f47201109e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60058/0 (socket says 172.21.15.63:60058) 2024-09-21T06:39:07.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.730+0000 7f47257b2640 1 -- 172.21.15.63:0/2576991662 learned_addr learned my addr 172.21.15.63:0/2576991662 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:07.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.731+0000 7f4724fb1640 1 --2- 172.21.15.63:0/2576991662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4720102a20 0x7f472010ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:07.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.731+0000 7f471ffff640 1 --2- 172.21.15.63:0/2576991662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4720108300 0x7f47201104a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:07.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.731+0000 7f47257b2640 1 -- 172.21.15.63:0/2576991662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4720102a20 msgr2=0x7f472010ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:07.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.731+0000 7f47257b2640 1 --2- 172.21.15.63:0/2576991662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4720102a20 0x7f472010ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.731+0000 7f47257b2640 1 -- 172.21.15.63:0/2576991662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4720108300 msgr2=0x7f47201104a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:07.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.731+0000 7f47257b2640 1 --2- 172.21.15.63:0/2576991662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4720108300 0x7f47201104a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.731+0000 7f47257b2640 1 -- 172.21.15.63:0/2576991662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47201a86e0 con 0x7f4720108c50 2024-09-21T06:39:07.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.731+0000 7f471ffff640 1 --2- 172.21.15.63:0/2576991662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4720108300 0x7f47201104a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:07.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.731+0000 7f47257b2640 1 --2- 172.21.15.63:0/2576991662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4720108c50 0x7f47201109e0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f471800d750 tx=0x7f471800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:07.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.731+0000 7f471dffb640 1 -- 172.21.15.63:0/2576991662 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718017070 con 0x7f4720108c50 2024-09-21T06:39:07.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.731+0000 7f471dffb640 1 -- 172.21.15.63:0/2576991662 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47180054d0 con 0x7f4720108c50 2024-09-21T06:39:07.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.731+0000 7f4727215640 1 -- 172.21.15.63:0/2576991662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47201a89d0 con 0x7f4720108c50 2024-09-21T06:39:07.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.731+0000 7f471dffb640 1 -- 172.21.15.63:0/2576991662 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718004c60 con 0x7f4720108c50 2024-09-21T06:39:07.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.731+0000 7f4727215640 1 -- 172.21.15.63:0/2576991662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47201a8f20 con 0x7f4720108c50 2024-09-21T06:39:07.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.733+0000 7f4727215640 1 -- 172.21.15.63:0/2576991662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4720102e30 con 0x7f4720108c50 2024-09-21T06:39:07.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.734+0000 7f471dffb640 1 -- 172.21.15.63:0/2576991662 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f4718009bd0 con 0x7f4720108c50 2024-09-21T06:39:07.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.735+0000 7f471dffb640 1 --2- 172.21.15.63:0/2576991662 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f470c0b66b0 0x7f470c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:07.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.735+0000 7f4724fb1640 1 --2- 172.21.15.63:0/2576991662 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f470c0b66b0 0x7f470c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:07.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.735+0000 7f471dffb640 1 -- 172.21.15.63:0/2576991662 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f47180e75a0 con 0x7f4720108c50 2024-09-21T06:39:07.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.736+0000 7f4724fb1640 1 --2- 172.21.15.63:0/2576991662 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f470c0b66b0 0x7f470c0b8bc0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4708000c00 tx=0x7f4708031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:07.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.738+0000 7f471dffb640 1 -- 172.21.15.63:0/2576991662 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f47180ada40 con 0x7f4720108c50 2024-09-21T06:39:07.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.924+0000 7f4727215640 1 -- 172.21.15.63:0/2576991662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f472002e640 con 0x7f4720108c50 2024-09-21T06:39:07.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.925+0000 7f471dffb640 1 -- 172.21.15.63:0/2576991662 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) ==== 104+0+11 (secure 0 0 0) 0x7f47180b1e20 con 0x7f4720108c50 2024-09-21T06:39:07.927 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-09-21T06:39:07.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.927+0000 7f4727215640 1 -- 172.21.15.63:0/2576991662 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f470c0b66b0 msgr2=0x7f470c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:07.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.927+0000 7f4727215640 1 --2- 172.21.15.63:0/2576991662 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f470c0b66b0 0x7f470c0b8bc0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4708000c00 tx=0x7f4708031400 comp rx=0 tx=0).stop 2024-09-21T06:39:07.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.927+0000 7f4727215640 1 -- 172.21.15.63:0/2576991662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4720108c50 msgr2=0x7f47201109e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:07.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.927+0000 7f4727215640 1 --2- 172.21.15.63:0/2576991662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4720108c50 0x7f47201109e0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f471800d750 tx=0x7f471800dc10 comp rx=0 tx=0).stop 2024-09-21T06:39:07.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.927+0000 7f4727215640 1 -- 172.21.15.63:0/2576991662 shutdown_connections 2024-09-21T06:39:07.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.927+0000 7f4727215640 1 --2- 172.21.15.63:0/2576991662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4720108c50 0x7f47201109e0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.927+0000 7f4727215640 1 --2- 172.21.15.63:0/2576991662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4720108300 0x7f47201104a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.927+0000 7f4727215640 1 --2- 172.21.15.63:0/2576991662 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f470c0b66b0 0x7f470c0b8bc0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.927+0000 7f4727215640 1 --2- 172.21.15.63:0/2576991662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4720102a20 0x7f472010ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:07.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.927+0000 7f4727215640 1 -- 172.21.15.63:0/2576991662 >> 172.21.15.63:0/2576991662 conn(0x7f4720079630 msgr2=0x7f47201063f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:07.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.927+0000 7f4727215640 1 -- 172.21.15.63:0/2576991662 shutdown_connections 2024-09-21T06:39:07.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:07.927+0000 7f4727215640 1 -- 172.21.15.63:0/2576991662 wait complete. 2024-09-21T06:39:07.939 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:07 smithi063 ceph-mon[31150]: pgmap v658: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-21T06:39:07.939 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:07 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2196118015' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:39:07.939 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:07 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2776729445' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:39:07.940 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T06:39:08.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:07 smithi071 ceph-mon[34844]: pgmap v658: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-21T06:39:08.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:07 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2196118015' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:39:08.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:07 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2776729445' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:39:08.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.054+0000 7f4da7830640 1 -- 172.21.15.63:0/661809726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4da0102990 msgr2=0x7f4da0102da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:08.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.054+0000 7f4da7830640 1 --2- 172.21.15.63:0/661809726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4da0102990 0x7f4da0102da0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f4d90009ca0 tx=0x7f4d9002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:39:08.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.054+0000 7f4da7830640 1 -- 172.21.15.63:0/661809726 shutdown_connections 2024-09-21T06:39:08.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.054+0000 7f4da7830640 1 --2- 172.21.15.63:0/661809726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da0108c10 0x7f4da010f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:08.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.054+0000 7f4da7830640 1 --2- 172.21.15.63:0/661809726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4da01082c0 0x7f4da01086d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:08.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.054+0000 7f4da7830640 1 --2- 172.21.15.63:0/661809726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4da0102990 0x7f4da0102da0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:08.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.054+0000 7f4da7830640 1 -- 172.21.15.63:0/661809726 >> 172.21.15.63:0/661809726 conn(0x7f4da00fe3b0 msgr2=0x7f4da0100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:08.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.054+0000 7f4da7830640 1 -- 172.21.15.63:0/661809726 shutdown_connections 2024-09-21T06:39:08.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.054+0000 7f4da7830640 1 -- 172.21.15.63:0/661809726 wait complete. 2024-09-21T06:39:08.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.055+0000 7f4da7830640 1 Processor -- start 2024-09-21T06:39:08.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.055+0000 7f4da7830640 1 -- start start 2024-09-21T06:39:08.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.055+0000 7f4da7830640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4da0102990 0x7f4da0199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:08.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.055+0000 7f4da7830640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da01082c0 0x7f4da01998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:08.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.055+0000 7f4da7830640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4da0108c10 0x7f4da019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:08.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.055+0000 7f4da7830640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4da01128d0 con 0x7f4da0102990 2024-09-21T06:39:08.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.055+0000 7f4da7830640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4da0112750 con 0x7f4da0108c10 2024-09-21T06:39:08.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.055+0000 7f4da7830640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4da0112a50 con 0x7f4da01082c0 2024-09-21T06:39:08.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.055+0000 7f4da55cc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4da0102990 0x7f4da0199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:08.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.055+0000 7f4da55cc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4da0102990 0x7f4da0199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60068/0 (socket says 172.21.15.63:60068) 2024-09-21T06:39:08.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.055+0000 7f4da55cc640 1 -- 172.21.15.63:0/3104378226 learned_addr learned my addr 172.21.15.63:0/3104378226 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:08.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.055+0000 7f4da5dcd640 1 --2- 172.21.15.63:0/3104378226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4da0108c10 0x7f4da019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:08.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.055+0000 7f4da4dcb640 1 --2- 172.21.15.63:0/3104378226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da01082c0 0x7f4da01998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:08.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.056+0000 7f4da55cc640 1 -- 172.21.15.63:0/3104378226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da01082c0 msgr2=0x7f4da01998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:08.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.056+0000 7f4da55cc640 1 --2- 172.21.15.63:0/3104378226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da01082c0 0x7f4da01998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:08.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.056+0000 7f4da55cc640 1 -- 172.21.15.63:0/3104378226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4da0108c10 msgr2=0x7f4da019eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:08.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.056+0000 7f4da55cc640 1 --2- 172.21.15.63:0/3104378226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4da0108c10 0x7f4da019eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:08.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.056+0000 7f4da55cc640 1 -- 172.21.15.63:0/3104378226 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da019f260 con 0x7f4da0102990 2024-09-21T06:39:08.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.056+0000 7f4da5dcd640 1 --2- 172.21.15.63:0/3104378226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4da0108c10 0x7f4da019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:08.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.056+0000 7f4da55cc640 1 --2- 172.21.15.63:0/3104378226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4da0102990 0x7f4da0199330 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f4d90006010 tx=0x7f4d900319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:08.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.056+0000 7f4d9e7fc640 1 -- 172.21.15.63:0/3104378226 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d90003bf0 con 0x7f4da0102990 2024-09-21T06:39:08.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.056+0000 7f4d9e7fc640 1 -- 172.21.15.63:0/3104378226 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d90003d90 con 0x7f4da0102990 2024-09-21T06:39:08.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.056+0000 7f4da7830640 1 -- 172.21.15.63:0/3104378226 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da019f4f0 con 0x7f4da0102990 2024-09-21T06:39:08.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.056+0000 7f4d9e7fc640 1 -- 172.21.15.63:0/3104378226 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9002fc20 con 0x7f4da0102990 2024-09-21T06:39:08.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.056+0000 7f4da7830640 1 -- 172.21.15.63:0/3104378226 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da01a5ce0 con 0x7f4da0102990 2024-09-21T06:39:08.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.057+0000 7f4da7830640 1 -- 172.21.15.63:0/3104378226 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4da0102da0 con 0x7f4da0102990 2024-09-21T06:39:08.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.060+0000 7f4d9e7fc640 1 -- 172.21.15.63:0/3104378226 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f4d900046a0 con 0x7f4da0102990 2024-09-21T06:39:08.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.060+0000 7f4d9e7fc640 1 --2- 172.21.15.63:0/3104378226 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4d880b6700 0x7f4d880b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:08.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.061+0000 7f4da4dcb640 1 --2- 172.21.15.63:0/3104378226 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4d880b6700 0x7f4d880b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:08.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.061+0000 7f4d9e7fc640 1 -- 172.21.15.63:0/3104378226 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f4d90108cb0 con 0x7f4da0102990 2024-09-21T06:39:08.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.061+0000 7f4da4dcb640 1 --2- 172.21.15.63:0/3104378226 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4d880b6700 0x7f4d880b8c10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4d94005fd0 tx=0x7f4d94005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:08.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.064+0000 7f4d9e7fc640 1 -- 172.21.15.63:0/3104378226 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4d900cf240 con 0x7f4da0102990 2024-09-21T06:39:08.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:07 smithi175 ceph-mon[34510]: pgmap v658: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-21T06:39:08.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:07 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2196118015' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:39:08.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:07 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2776729445' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:39:08.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.252+0000 7f4da7830640 1 -- 172.21.15.63:0/3104378226 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4da002e640 con 0x7f4da0102990 2024-09-21T06:39:08.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.252+0000 7f4d9e7fc640 1 -- 172.21.15.63:0/3104378226 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) ==== 100+0+11 (secure 0 0 0) 0x7f4d900d3620 con 0x7f4da0102990 2024-09-21T06:39:08.254 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-09-21T06:39:08.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.255+0000 7f4da7830640 1 -- 172.21.15.63:0/3104378226 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4d880b6700 msgr2=0x7f4d880b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:08.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.255+0000 7f4da7830640 1 --2- 172.21.15.63:0/3104378226 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4d880b6700 0x7f4d880b8c10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4d94005fd0 tx=0x7f4d94005850 comp rx=0 tx=0).stop 2024-09-21T06:39:08.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.255+0000 7f4da7830640 1 -- 172.21.15.63:0/3104378226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4da0102990 msgr2=0x7f4da0199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:08.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.255+0000 7f4da7830640 1 --2- 172.21.15.63:0/3104378226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4da0102990 0x7f4da0199330 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f4d90006010 tx=0x7f4d900319f0 comp rx=0 tx=0).stop 2024-09-21T06:39:08.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.255+0000 7f4da7830640 1 -- 172.21.15.63:0/3104378226 shutdown_connections 2024-09-21T06:39:08.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.255+0000 7f4da7830640 1 --2- 172.21.15.63:0/3104378226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4da0108c10 0x7f4da019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:08.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.255+0000 7f4da7830640 1 --2- 172.21.15.63:0/3104378226 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f4d880b6700 0x7f4d880b8c10 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:08.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.255+0000 7f4da7830640 1 --2- 172.21.15.63:0/3104378226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da01082c0 0x7f4da01998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:08.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.255+0000 7f4da7830640 1 --2- 172.21.15.63:0/3104378226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4da0102990 0x7f4da0199330 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:08.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.255+0000 7f4da7830640 1 -- 172.21.15.63:0/3104378226 >> 172.21.15.63:0/3104378226 conn(0x7f4da00fe3b0 msgr2=0x7f4da01007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:08.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.255+0000 7f4da7830640 1 -- 172.21.15.63:0/3104378226 shutdown_connections 2024-09-21T06:39:08.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.255+0000 7f4da7830640 1 -- 172.21.15.63:0/3104378226 wait complete. 2024-09-21T06:39:08.268 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T06:39:08.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.378+0000 7f957768b640 1 -- 172.21.15.63:0/881700514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9570108c00 msgr2=0x7f957010f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:08.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.378+0000 7f957768b640 1 --2- 172.21.15.63:0/881700514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9570108c00 0x7f957010f430 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f9568009ca0 tx=0x7f956802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:39:08.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.378+0000 7f957768b640 1 -- 172.21.15.63:0/881700514 shutdown_connections 2024-09-21T06:39:08.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.378+0000 7f957768b640 1 --2- 172.21.15.63:0/881700514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9570108c00 0x7f957010f430 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:08.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.378+0000 7f957768b640 1 --2- 172.21.15.63:0/881700514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95701082b0 0x7f95701086c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:08.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.378+0000 7f957768b640 1 --2- 172.21.15.63:0/881700514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9570102980 0x7f9570102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:08.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.378+0000 7f957768b640 1 -- 172.21.15.63:0/881700514 >> 172.21.15.63:0/881700514 conn(0x7f95700fe380 msgr2=0x7f95701007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:08.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.379+0000 7f957768b640 1 -- 172.21.15.63:0/881700514 shutdown_connections 2024-09-21T06:39:08.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.379+0000 7f957768b640 1 -- 172.21.15.63:0/881700514 wait complete. 2024-09-21T06:39:08.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.379+0000 7f957768b640 1 Processor -- start 2024-09-21T06:39:08.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.379+0000 7f957768b640 1 -- start start 2024-09-21T06:39:08.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f957768b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9570102980 0x7f957019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:08.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f957768b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95701082b0 0x7f957019a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:08.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f957768b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9570108c00 0x7f957019fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:08.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f957768b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f95701139e0 con 0x7f95701082b0 2024-09-21T06:39:08.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f957768b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9570113860 con 0x7f9570102980 2024-09-21T06:39:08.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f957768b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9570113b60 con 0x7f9570108c00 2024-09-21T06:39:08.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f9574c26640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95701082b0 0x7f957019a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:08.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f9574c26640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95701082b0 0x7f957019a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60086/0 (socket says 172.21.15.63:60086) 2024-09-21T06:39:08.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f9574c26640 1 -- 172.21.15.63:0/447170572 learned_addr learned my addr 172.21.15.63:0/447170572 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:08.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f9575427640 1 --2- 172.21.15.63:0/447170572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9570102980 0x7f957019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:08.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f9575c28640 1 --2- 172.21.15.63:0/447170572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9570108c00 0x7f957019fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:08.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f9574c26640 1 -- 172.21.15.63:0/447170572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9570108c00 msgr2=0x7f957019fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:08.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f9574c26640 1 --2- 172.21.15.63:0/447170572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9570108c00 0x7f957019fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:08.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f9574c26640 1 -- 172.21.15.63:0/447170572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9570102980 msgr2=0x7f957019a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:08.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f9574c26640 1 --2- 172.21.15.63:0/447170572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9570102980 0x7f957019a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:08.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f9574c26640 1 -- 172.21.15.63:0/447170572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95701a0290 con 0x7f95701082b0 2024-09-21T06:39:08.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f9575427640 1 --2- 172.21.15.63:0/447170572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9570102980 0x7f957019a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:08.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f9574c26640 1 --2- 172.21.15.63:0/447170572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95701082b0 0x7f957019a900 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f956000d950 tx=0x7f956000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:08.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f95667fc640 1 -- 172.21.15.63:0/447170572 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9560017070 con 0x7f95701082b0 2024-09-21T06:39:08.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f95667fc640 1 -- 172.21.15.63:0/447170572 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9560009c30 con 0x7f95701082b0 2024-09-21T06:39:08.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f957768b640 1 -- 172.21.15.63:0/447170572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95701a0580 con 0x7f95701082b0 2024-09-21T06:39:08.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f95667fc640 1 -- 172.21.15.63:0/447170572 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95600047a0 con 0x7f95701082b0 2024-09-21T06:39:08.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.380+0000 7f957768b640 1 -- 172.21.15.63:0/447170572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95701a6d10 con 0x7f95701082b0 2024-09-21T06:39:08.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.381+0000 7f957768b640 1 -- 172.21.15.63:0/447170572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9570102d90 con 0x7f95701082b0 2024-09-21T06:39:08.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.383+0000 7f95667fc640 1 -- 172.21.15.63:0/447170572 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f9560004020 con 0x7f95701082b0 2024-09-21T06:39:08.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.384+0000 7f95667fc640 1 --2- 172.21.15.63:0/447170572 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f955c0b6680 0x7f955c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:08.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.384+0000 7f9575427640 1 --2- 172.21.15.63:0/447170572 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f955c0b6680 0x7f955c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:08.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.384+0000 7f95667fc640 1 -- 172.21.15.63:0/447170572 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8593+0+0 (secure 0 0 0) 0x7f95600e78f0 con 0x7f95701082b0 2024-09-21T06:39:08.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.384+0000 7f9575427640 1 --2- 172.21.15.63:0/447170572 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f955c0b6680 0x7f955c0b8b90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f956c009c20 tx=0x7f956c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:08.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.387+0000 7f95667fc640 1 -- 172.21.15.63:0/447170572 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9560020020 con 0x7f95701082b0 2024-09-21T06:39:08.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.630+0000 7f957768b640 1 -- 172.21.15.63:0/447170572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f957002e640 con 0x7f95701082b0 2024-09-21T06:39:08.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.638+0000 7f95667fc640 1 -- 172.21.15.63:0/447170572 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+834048 (secure 0 0 0) 0x7f95600addf0 con 0x7f95701082b0 2024-09-21T06:39:08.650 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:39:08.650 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:39:08.650 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 25, 2024-09-21T06:39:08.650 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.650 INFO:teuthology.orchestra.run.smithi063.stdout: "active_gid": 14223, 2024-09-21T06:39:08.650 INFO:teuthology.orchestra.run.smithi063.stdout: "active_name": "x", 2024-09-21T06:39:08.650 INFO:teuthology.orchestra.run.smithi063.stdout: "active_addrs": { 2024-09-21T06:39:08.650 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-21T06:39:08.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.650 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-21T06:39:08.651 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6800", 2024-09-21T06:39:08.651 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 651259686 2024-09-21T06:39:08.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.651 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-21T06:39:08.651 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6801", 2024-09-21T06:39:08.651 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 651259686 2024-09-21T06:39:08.651 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.651 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-21T06:39:08.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.651 INFO:teuthology.orchestra.run.smithi063.stdout: "active_addr": "172.21.15.63:6801/651259686", 2024-09-21T06:39:08.651 INFO:teuthology.orchestra.run.smithi063.stdout: "active_change": "2024-09-21T06:19:37.776620+0000", 2024-09-21T06:39:08.651 INFO:teuthology.orchestra.run.smithi063.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T06:39:08.652 INFO:teuthology.orchestra.run.smithi063.stdout: "available": true, 2024-09-21T06:39:08.652 INFO:teuthology.orchestra.run.smithi063.stdout: "standbys": [ 2024-09-21T06:39:08.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.652 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 24175, 2024-09-21T06:39:08.652 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "z", 2024-09-21T06:39:08.652 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_features": 4540719139924082687, 2024-09-21T06:39:08.652 INFO:teuthology.orchestra.run.smithi063.stdout: "available_modules": [ 2024-09-21T06:39:08.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.652 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "alerts", 2024-09-21T06:39:08.652 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:08.652 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:08.652 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:08.653 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-21T06:39:08.653 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-21T06:39:08.653 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:08.653 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.653 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.653 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-21T06:39:08.653 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.653 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.653 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.653 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:39:08.653 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.653 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.653 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.654 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:08.654 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:08.654 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.654 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.654 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.654 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.654 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.654 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.654 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.655 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.655 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.655 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.655 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.655 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.655 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.655 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.655 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.655 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.655 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.655 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.656 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:08.656 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:08.656 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.656 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.656 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.656 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.656 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.656 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.656 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.656 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.656 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.656 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.657 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.657 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:08.657 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:08.657 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.657 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.657 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.657 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:08.657 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.657 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.657 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.657 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.658 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.658 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.658 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.658 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.658 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.658 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.658 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.658 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.658 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.658 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.658 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:08.659 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:08.659 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.659 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.659 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.659 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.659 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.659 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.659 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.659 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.659 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.659 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.659 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.660 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_destination": { 2024-09-21T06:39:08.660 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_destination", 2024-09-21T06:39:08.660 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.660 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.660 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.660 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.660 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.660 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.660 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.660 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:39:08.660 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.660 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.661 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.661 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_from_name": { 2024-09-21T06:39:08.661 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_from_name", 2024-09-21T06:39:08.661 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.661 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.661 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.661 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "Ceph", 2024-09-21T06:39:08.661 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.661 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.662 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.662 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Email From: name", 2024-09-21T06:39:08.662 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.662 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.662 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.662 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_host": { 2024-09-21T06:39:08.662 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_host", 2024-09-21T06:39:08.662 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.662 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.662 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.662 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.663 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.663 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.663 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.663 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SMTP server", 2024-09-21T06:39:08.663 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.663 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.663 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.663 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_password": { 2024-09-21T06:39:08.663 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_password", 2024-09-21T06:39:08.664 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.664 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.664 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.664 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.664 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.664 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.664 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.664 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Password to authenticate with", 2024-09-21T06:39:08.664 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.664 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.664 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.664 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_port": { 2024-09-21T06:39:08.665 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_port", 2024-09-21T06:39:08.665 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.665 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.665 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.665 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "465", 2024-09-21T06:39:08.665 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.665 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.665 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.665 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SMTP port", 2024-09-21T06:39:08.666 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.666 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.666 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.666 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_sender": { 2024-09-21T06:39:08.666 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_sender", 2024-09-21T06:39:08.666 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.666 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.666 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.666 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.666 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.666 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.667 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.667 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:39:08.667 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.667 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.667 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.667 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_ssl": { 2024-09-21T06:39:08.667 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_ssl", 2024-09-21T06:39:08.667 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.668 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.668 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.668 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.668 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.668 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.668 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.668 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:39:08.668 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.668 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.668 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.669 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_user": { 2024-09-21T06:39:08.669 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_user", 2024-09-21T06:39:08.669 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.669 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.669 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.669 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.669 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.669 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.669 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.670 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "User to authenticate as", 2024-09-21T06:39:08.670 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.670 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.670 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.670 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:08.670 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:08.670 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.670 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:08.671 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.671 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.671 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.671 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.671 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.671 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.671 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.671 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.671 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.672 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.672 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.672 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "balancer", 2024-09-21T06:39:08.672 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:08.672 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:08.672 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:08.673 INFO:teuthology.orchestra.run.smithi063.stdout: "active": { 2024-09-21T06:39:08.673 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "active", 2024-09-21T06:39:08.673 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.673 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.673 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.673 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.673 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.673 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.673 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.673 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:39:08.674 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.674 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.674 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.674 INFO:teuthology.orchestra.run.smithi063.stdout: "begin_time": { 2024-09-21T06:39:08.674 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "begin_time", 2024-09-21T06:39:08.674 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.674 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.674 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.674 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0000", 2024-09-21T06:39:08.674 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.674 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.675 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.675 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:39:08.675 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:39:08.675 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.675 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.675 INFO:teuthology.orchestra.run.smithi063.stdout: "begin_weekday": { 2024-09-21T06:39:08.675 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "begin_weekday", 2024-09-21T06:39:08.675 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-21T06:39:08.675 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.675 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.675 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.675 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "0", 2024-09-21T06:39:08.676 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "6", 2024-09-21T06:39:08.676 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.676 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:39:08.676 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:39:08.676 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.676 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.676 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_compat_max_iterations": { 2024-09-21T06:39:08.676 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:39:08.676 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-21T06:39:08.676 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.676 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.676 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "25", 2024-09-21T06:39:08.676 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-21T06:39:08.676 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "250", 2024-09-21T06:39:08.677 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.677 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:39:08.677 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.677 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.677 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.677 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_compat_metrics": { 2024-09-21T06:39:08.677 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crush_compat_metrics", 2024-09-21T06:39:08.677 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.677 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.677 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.677 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:39:08.677 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.677 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.678 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.678 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:39:08.678 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:39:08.678 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.678 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.678 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_compat_step": { 2024-09-21T06:39:08.678 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crush_compat_step", 2024-09-21T06:39:08.678 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:08.678 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.678 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.678 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0.5", 2024-09-21T06:39:08.678 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "0.001", 2024-09-21T06:39:08.679 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "0.999", 2024-09-21T06:39:08.679 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.679 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:39:08.679 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:39:08.679 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.679 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.679 INFO:teuthology.orchestra.run.smithi063.stdout: "end_time": { 2024-09-21T06:39:08.679 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "end_time", 2024-09-21T06:39:08.679 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.679 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.679 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.679 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "2359", 2024-09-21T06:39:08.679 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.680 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.680 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.680 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:39:08.680 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:39:08.680 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.680 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.680 INFO:teuthology.orchestra.run.smithi063.stdout: "end_weekday": { 2024-09-21T06:39:08.680 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "end_weekday", 2024-09-21T06:39:08.680 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-21T06:39:08.680 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.680 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.680 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.681 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "0", 2024-09-21T06:39:08.681 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "6", 2024-09-21T06:39:08.681 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.681 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:39:08.681 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:39:08.681 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.681 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.681 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:08.681 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:08.681 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.681 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.681 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.681 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.682 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.682 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.682 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.682 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.682 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.682 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.682 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.682 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.682 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.682 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.682 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.682 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.683 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.683 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.683 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:08.683 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:08.683 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.683 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.683 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.683 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.683 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.683 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.683 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.683 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.683 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.684 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.684 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.684 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:08.684 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:08.684 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.684 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.684 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.684 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:08.684 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.684 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.684 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.684 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.684 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.685 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.685 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.685 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.685 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.685 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.685 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.685 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.685 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.685 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.685 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:08.685 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:08.685 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.685 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.686 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.686 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.686 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.686 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.686 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.686 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.686 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.686 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.686 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.686 INFO:teuthology.orchestra.run.smithi063.stdout: "min_score": { 2024-09-21T06:39:08.686 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "min_score", 2024-09-21T06:39:08.686 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:08.687 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.687 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.687 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.687 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.687 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.687 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.687 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:39:08.687 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.687 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.687 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.687 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": { 2024-09-21T06:39:08.687 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mode", 2024-09-21T06:39:08.687 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.688 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.688 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.688 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "upmap", 2024-09-21T06:39:08.688 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.688 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.688 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.688 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-compat", 2024-09-21T06:39:08.688 INFO:teuthology.orchestra.run.smithi063.stdout: "none", 2024-09-21T06:39:08.688 INFO:teuthology.orchestra.run.smithi063.stdout: "read", 2024-09-21T06:39:08.688 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap", 2024-09-21T06:39:08.688 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap-read" 2024-09-21T06:39:08.688 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.688 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Balancer mode", 2024-09-21T06:39:08.689 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.689 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.689 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.689 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ids": { 2024-09-21T06:39:08.689 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pool_ids", 2024-09-21T06:39:08.689 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.689 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.689 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.689 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.689 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.689 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.689 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.690 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:39:08.690 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.690 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.690 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.690 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-21T06:39:08.690 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-21T06:39:08.690 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:08.690 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.690 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.690 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-21T06:39:08.691 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.691 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.691 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.691 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:39:08.691 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.691 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.691 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.691 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:08.691 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:08.691 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.691 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:08.691 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.692 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.692 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.692 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.692 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.692 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.692 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.692 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.692 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.692 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap_max_deviation": { 2024-09-21T06:39:08.692 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "upmap_max_deviation", 2024-09-21T06:39:08.693 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.693 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.693 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.693 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-21T06:39:08.693 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-21T06:39:08.693 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.693 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.693 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:39:08.693 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:39:08.693 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.693 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.694 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap_max_optimizations": { 2024-09-21T06:39:08.694 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:39:08.694 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-21T06:39:08.694 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.694 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.694 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:08.694 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.694 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.694 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.694 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:39:08.694 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.695 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.695 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.695 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.695 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.695 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephadm", 2024-09-21T06:39:08.695 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:08.695 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:08.695 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:08.695 INFO:teuthology.orchestra.run.smithi063.stdout: "agent_down_multiplier": { 2024-09-21T06:39:08.696 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "agent_down_multiplier", 2024-09-21T06:39:08.696 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:08.696 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.696 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.696 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3.0", 2024-09-21T06:39:08.696 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.696 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.696 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.696 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:39:08.696 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.696 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.696 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.697 INFO:teuthology.orchestra.run.smithi063.stdout: "agent_refresh_rate": { 2024-09-21T06:39:08.697 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "agent_refresh_rate", 2024-09-21T06:39:08.697 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:08.697 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.697 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.697 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "20", 2024-09-21T06:39:08.697 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.697 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.697 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.698 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:39:08.698 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.698 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.698 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.698 INFO:teuthology.orchestra.run.smithi063.stdout: "agent_starting_port": { 2024-09-21T06:39:08.698 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "agent_starting_port", 2024-09-21T06:39:08.698 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.698 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.698 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.699 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "4721", 2024-09-21T06:39:08.699 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.699 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.699 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.699 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:39:08.699 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.699 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.699 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.699 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_ptrace": { 2024-09-21T06:39:08.699 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "allow_ptrace", 2024-09-21T06:39:08.700 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.700 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.700 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.700 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.700 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.700 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.700 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.700 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:39:08.700 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:39:08.701 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.701 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.701 INFO:teuthology.orchestra.run.smithi063.stdout: "autotune_interval": { 2024-09-21T06:39:08.701 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "autotune_interval", 2024-09-21T06:39:08.701 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:08.701 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.701 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.701 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-21T06:39:08.701 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.702 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.702 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.702 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:39:08.702 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.702 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.702 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.702 INFO:teuthology.orchestra.run.smithi063.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:39:08.702 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:39:08.702 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:08.702 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.703 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.703 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0.7", 2024-09-21T06:39:08.703 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.703 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.703 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.703 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:39:08.703 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.703 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.703 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.703 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm_log_destination": { 2024-09-21T06:39:08.703 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephadm_log_destination", 2024-09-21T06:39:08.704 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.704 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.704 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.704 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.704 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.704 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.704 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.704 INFO:teuthology.orchestra.run.smithi063.stdout: "file", 2024-09-21T06:39:08.704 INFO:teuthology.orchestra.run.smithi063.stdout: "file,syslog", 2024-09-21T06:39:08.704 INFO:teuthology.orchestra.run.smithi063.stdout: "syslog" 2024-09-21T06:39:08.704 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.704 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:39:08.704 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.704 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.705 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.705 INFO:teuthology.orchestra.run.smithi063.stdout: "cgroups_split": { 2024-09-21T06:39:08.705 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cgroups_split", 2024-09-21T06:39:08.705 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.705 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.705 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.705 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.706 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.706 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.706 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.706 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:39:08.706 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.706 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.706 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.707 INFO:teuthology.orchestra.run.smithi063.stdout: "config_checks_enabled": { 2024-09-21T06:39:08.707 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "config_checks_enabled", 2024-09-21T06:39:08.707 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.707 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.707 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.707 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.707 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.707 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.707 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.707 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:39:08.707 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.708 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.708 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.708 INFO:teuthology.orchestra.run.smithi063.stdout: "config_dashboard": { 2024-09-21T06:39:08.708 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "config_dashboard", 2024-09-21T06:39:08.708 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.708 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.708 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.708 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.708 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.708 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.708 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.708 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:39:08.708 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.709 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.709 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.709 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_alertmanager": { 2024-09-21T06:39:08.709 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_alertmanager", 2024-09-21T06:39:08.709 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.709 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.709 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.709 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:39:08.709 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.709 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.709 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.709 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-21T06:39:08.710 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.710 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.710 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.710 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_base": { 2024-09-21T06:39:08.710 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_base", 2024-09-21T06:39:08.710 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.710 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.710 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.710 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:39:08.710 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.710 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.710 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.711 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:39:08.711 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.711 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.711 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.711 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_elasticsearch": { 2024-09-21T06:39:08.711 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:39:08.711 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.711 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.711 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.711 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:39:08.711 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.711 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.711 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.712 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "elasticsearch container image", 2024-09-21T06:39:08.712 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.712 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.712 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.712 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_grafana": { 2024-09-21T06:39:08.712 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_grafana", 2024-09-21T06:39:08.712 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.712 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.712 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.712 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:39:08.712 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.713 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.713 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.713 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-21T06:39:08.713 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.713 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.713 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.713 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.713 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_haproxy": { 2024-09-21T06:39:08.713 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_haproxy", 2024-09-21T06:39:08.713 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.713 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.713 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.713 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:39:08.713 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.714 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.714 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.714 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "HAproxy container image", 2024-09-21T06:39:08.714 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.714 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.714 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.714 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_jaeger_agent": { 2024-09-21T06:39:08.714 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:39:08.714 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.714 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.714 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.715 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:39:08.715 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.715 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.715 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.715 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:39:08.715 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.715 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.715 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.715 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_jaeger_collector": { 2024-09-21T06:39:08.715 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:39:08.715 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.715 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.715 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.716 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:39:08.716 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.716 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.716 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.716 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:39:08.716 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.716 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.716 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.716 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_jaeger_query": { 2024-09-21T06:39:08.716 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:39:08.716 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.716 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.716 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.717 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:39:08.717 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.717 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.717 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.717 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Jaeger query container image", 2024-09-21T06:39:08.717 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.717 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.717 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.717 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_keepalived": { 2024-09-21T06:39:08.717 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_keepalived", 2024-09-21T06:39:08.717 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.717 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.718 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.718 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:39:08.718 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.718 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.718 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.718 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Keepalived container image", 2024-09-21T06:39:08.718 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.718 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.718 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.718 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_loki": { 2024-09-21T06:39:08.718 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_loki", 2024-09-21T06:39:08.718 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.719 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.719 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.719 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:39:08.719 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.719 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.719 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.719 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Loki container image", 2024-09-21T06:39:08.719 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.719 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.719 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.719 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_nginx": { 2024-09-21T06:39:08.719 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_nginx", 2024-09-21T06:39:08.720 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.720 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.720 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.720 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:39:08.720 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.720 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.720 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.720 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Nginx container image", 2024-09-21T06:39:08.720 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.720 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.720 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.720 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_node_exporter": { 2024-09-21T06:39:08.720 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_node_exporter", 2024-09-21T06:39:08.721 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.721 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.721 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.721 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:39:08.721 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.721 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.721 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.721 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-21T06:39:08.721 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.721 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.721 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.721 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_nvmeof": { 2024-09-21T06:39:08.721 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_nvmeof", 2024-09-21T06:39:08.722 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.722 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.722 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.722 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:39:08.722 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.722 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.722 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.722 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Nvme-of container image", 2024-09-21T06:39:08.722 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.722 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.722 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.722 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:39:08.722 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:39:08.723 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.723 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.723 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.723 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:39:08.723 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.723 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.723 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.723 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:39:08.723 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.723 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.723 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.723 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_prometheus": { 2024-09-21T06:39:08.723 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_prometheus", 2024-09-21T06:39:08.724 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.724 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.724 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.724 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:39:08.724 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.724 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.724 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.724 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-21T06:39:08.724 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.724 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.724 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.725 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_promtail": { 2024-09-21T06:39:08.725 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_promtail", 2024-09-21T06:39:08.725 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.725 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.725 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.725 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:39:08.725 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.725 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.725 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.725 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Promtail container image", 2024-09-21T06:39:08.725 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.725 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.725 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.726 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_samba": { 2024-09-21T06:39:08.726 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_samba", 2024-09-21T06:39:08.726 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.726 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.726 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.726 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:39:08.726 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.726 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.726 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.726 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:39:08.726 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.726 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.727 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.727 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_samba_metrics": { 2024-09-21T06:39:08.727 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:39:08.727 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.727 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.727 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.727 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:39:08.727 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.727 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.728 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.728 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:39:08.728 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.728 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.728 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.728 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_snmp_gateway": { 2024-09-21T06:39:08.728 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:39:08.728 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.728 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.728 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.729 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:39:08.729 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.729 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.729 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.729 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:39:08.729 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.729 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.729 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.729 INFO:teuthology.orchestra.run.smithi063.stdout: "container_init": { 2024-09-21T06:39:08.729 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_init", 2024-09-21T06:39:08.729 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.730 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.730 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.730 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.730 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.730 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.730 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.730 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:39:08.730 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.730 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.730 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.731 INFO:teuthology.orchestra.run.smithi063.stdout: "daemon_cache_timeout": { 2024-09-21T06:39:08.731 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:39:08.731 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:08.731 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.731 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.731 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-21T06:39:08.731 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.731 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.731 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.731 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:39:08.731 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.732 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.732 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.732 INFO:teuthology.orchestra.run.smithi063.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:39:08.732 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:39:08.732 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.732 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.732 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.732 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "900", 2024-09-21T06:39:08.732 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.732 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.733 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.733 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:39:08.733 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.733 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.733 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.733 INFO:teuthology.orchestra.run.smithi063.stdout: "default_registry": { 2024-09-21T06:39:08.733 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "default_registry", 2024-09-21T06:39:08.733 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.733 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.733 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.733 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io", 2024-09-21T06:39:08.733 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.734 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.734 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.734 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:39:08.734 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.734 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.734 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.734 INFO:teuthology.orchestra.run.smithi063.stdout: "device_cache_timeout": { 2024-09-21T06:39:08.734 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_cache_timeout", 2024-09-21T06:39:08.734 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:08.735 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.735 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.735 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "1800", 2024-09-21T06:39:08.735 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.735 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.735 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.735 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:39:08.735 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.735 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.735 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.736 INFO:teuthology.orchestra.run.smithi063.stdout: "device_enhanced_scan": { 2024-09-21T06:39:08.736 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_enhanced_scan", 2024-09-21T06:39:08.736 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.736 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.736 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.736 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.736 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.736 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.736 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.737 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:39:08.737 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.737 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.737 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.737 INFO:teuthology.orchestra.run.smithi063.stdout: "facts_cache_timeout": { 2024-09-21T06:39:08.737 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "facts_cache_timeout", 2024-09-21T06:39:08.737 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:08.737 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.737 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.738 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-21T06:39:08.738 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.738 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.738 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.738 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:39:08.738 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.738 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.738 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.738 INFO:teuthology.orchestra.run.smithi063.stdout: "grafana_dashboards_path": { 2024-09-21T06:39:08.739 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:39:08.739 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.739 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.739 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.739 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:39:08.739 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.739 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.739 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.740 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:39:08.740 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.740 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.740 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.740 INFO:teuthology.orchestra.run.smithi063.stdout: "host_check_interval": { 2024-09-21T06:39:08.740 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "host_check_interval", 2024-09-21T06:39:08.740 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:08.740 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.740 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.740 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-21T06:39:08.740 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.740 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.741 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.741 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:39:08.741 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.741 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.741 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.741 INFO:teuthology.orchestra.run.smithi063.stdout: "hw_monitoring": { 2024-09-21T06:39:08.741 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "hw_monitoring", 2024-09-21T06:39:08.741 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.741 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.741 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.741 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.741 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.741 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.741 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.742 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:39:08.742 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.742 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.742 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.742 INFO:teuthology.orchestra.run.smithi063.stdout: "inventory_list_all": { 2024-09-21T06:39:08.742 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "inventory_list_all", 2024-09-21T06:39:08.742 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.742 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.742 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.742 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.742 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.742 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.742 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.743 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:39:08.743 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.743 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.743 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.743 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:08.743 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:08.743 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.743 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.743 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.743 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.743 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.743 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.744 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.744 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.744 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.744 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.744 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.744 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.744 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.744 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.744 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.744 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.744 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.744 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.744 INFO:teuthology.orchestra.run.smithi063.stdout: "log_refresh_metadata": { 2024-09-21T06:39:08.745 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_refresh_metadata", 2024-09-21T06:39:08.745 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.745 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.745 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.745 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.745 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.745 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.745 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.745 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:39:08.745 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.745 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.745 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.746 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:08.746 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:08.746 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.746 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.746 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.746 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.746 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.746 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.746 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.746 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:39:08.746 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.746 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.746 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.747 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:08.747 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:08.747 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.747 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.747 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.747 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:08.747 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.747 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.747 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.747 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.747 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.747 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.747 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.747 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.748 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.748 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.748 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.748 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.748 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.748 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.748 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:08.748 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:08.748 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.748 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.748 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.748 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.748 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.749 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.749 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.749 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.749 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.749 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.749 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.749 INFO:teuthology.orchestra.run.smithi063.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:39:08.749 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:39:08.749 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.749 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.749 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.749 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.750 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.750 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.750 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.750 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:39:08.750 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.750 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.750 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.750 INFO:teuthology.orchestra.run.smithi063.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:39:08.750 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:39:08.750 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.750 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.750 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.750 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "*", 2024-09-21T06:39:08.751 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.751 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.751 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.751 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:39:08.751 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.751 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.751 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.751 INFO:teuthology.orchestra.run.smithi063.stdout: "max_count_per_host": { 2024-09-21T06:39:08.751 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_count_per_host", 2024-09-21T06:39:08.751 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.751 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.751 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.752 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:08.752 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.752 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.752 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.752 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:39:08.752 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.752 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.752 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.752 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd_draining_count": { 2024-09-21T06:39:08.752 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_osd_draining_count", 2024-09-21T06:39:08.752 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.752 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.753 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.753 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:08.753 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.753 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.753 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.753 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:39:08.753 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.753 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.753 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.753 INFO:teuthology.orchestra.run.smithi063.stdout: "migration_current": { 2024-09-21T06:39:08.753 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "migration_current", 2024-09-21T06:39:08.753 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.754 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.754 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.754 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.754 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.754 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.754 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.754 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "internal - do not modify", 2024-09-21T06:39:08.754 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.754 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.754 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.754 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": { 2024-09-21T06:39:08.754 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mode", 2024-09-21T06:39:08.755 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.755 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.755 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.755 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "root", 2024-09-21T06:39:08.755 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.755 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.755 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.755 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm-package", 2024-09-21T06:39:08.755 INFO:teuthology.orchestra.run.smithi063.stdout: "root" 2024-09-21T06:39:08.755 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.755 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:39:08.755 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.756 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.756 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.756 INFO:teuthology.orchestra.run.smithi063.stdout: "oob_default_addr": { 2024-09-21T06:39:08.756 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "oob_default_addr", 2024-09-21T06:39:08.756 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.756 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.756 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.756 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "169.254.1.1", 2024-09-21T06:39:08.756 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.756 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.756 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.756 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:39:08.757 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.757 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.757 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.757 INFO:teuthology.orchestra.run.smithi063.stdout: "prometheus_alerts_path": { 2024-09-21T06:39:08.757 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:39:08.757 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.757 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.757 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.757 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:39:08.757 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.757 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.758 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.758 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:39:08.758 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.758 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.758 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.758 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_insecure": { 2024-09-21T06:39:08.758 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_insecure", 2024-09-21T06:39:08.758 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.758 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.758 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.758 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.758 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.759 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.759 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.759 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:39:08.759 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.759 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.759 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.759 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_password": { 2024-09-21T06:39:08.759 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_password", 2024-09-21T06:39:08.759 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.760 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.760 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.760 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.760 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.760 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.760 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.760 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:39:08.760 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.760 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.760 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.760 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_url": { 2024-09-21T06:39:08.761 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_url", 2024-09-21T06:39:08.761 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.761 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.761 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.761 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.761 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.761 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.761 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.761 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:39:08.761 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.761 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.761 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.762 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_username": { 2024-09-21T06:39:08.762 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_username", 2024-09-21T06:39:08.762 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.762 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.762 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.762 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.762 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.762 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.762 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.762 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:39:08.763 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.763 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.763 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.763 INFO:teuthology.orchestra.run.smithi063.stdout: "secure_monitoring_stack": { 2024-09-21T06:39:08.763 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:39:08.763 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.763 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.763 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.763 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.763 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.763 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.763 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.764 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:39:08.764 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.764 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.764 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.764 INFO:teuthology.orchestra.run.smithi063.stdout: "service_discovery_port": { 2024-09-21T06:39:08.764 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "service_discovery_port", 2024-09-21T06:39:08.764 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.764 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.764 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.764 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8765", 2024-09-21T06:39:08.765 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.765 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.765 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.765 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:39:08.765 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.765 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.765 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.765 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:08.765 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:08.765 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.766 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:08.766 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.766 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.766 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.766 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.766 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.766 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.766 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.766 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.766 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.767 INFO:teuthology.orchestra.run.smithi063.stdout: "ssh_config_file": { 2024-09-21T06:39:08.767 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssh_config_file", 2024-09-21T06:39:08.767 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.767 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.767 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.767 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.767 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.767 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.768 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.768 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:39:08.768 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.768 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.768 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.768 INFO:teuthology.orchestra.run.smithi063.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:39:08.768 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:39:08.768 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.768 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.768 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.769 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3", 2024-09-21T06:39:08.769 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.769 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.769 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.769 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:39:08.769 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.769 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.769 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.770 INFO:teuthology.orchestra.run.smithi063.stdout: "ssh_keepalive_interval": { 2024-09-21T06:39:08.770 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:39:08.770 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.770 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.770 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.770 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "7", 2024-09-21T06:39:08.770 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.770 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.770 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.771 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:39:08.771 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.771 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.771 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.771 INFO:teuthology.orchestra.run.smithi063.stdout: "use_agent": { 2024-09-21T06:39:08.771 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "use_agent", 2024-09-21T06:39:08.771 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.771 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.771 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.771 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.771 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.771 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.772 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.772 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:39:08.772 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.772 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.772 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.772 INFO:teuthology.orchestra.run.smithi063.stdout: "use_repo_digest": { 2024-09-21T06:39:08.772 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "use_repo_digest", 2024-09-21T06:39:08.772 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.772 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.772 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.772 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.772 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.773 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.773 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.773 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:39:08.773 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.773 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.773 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.773 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.773 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_on_failed_host_check": { 2024-09-21T06:39:08.774 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:39:08.774 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.774 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.774 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.774 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.774 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.774 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.774 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.774 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:39:08.774 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.774 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.774 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.774 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.775 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_on_stray_daemons": { 2024-09-21T06:39:08.775 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:39:08.775 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.775 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.775 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.775 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.775 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.775 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.775 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.775 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:39:08.775 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.775 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.775 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.776 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_on_stray_hosts": { 2024-09-21T06:39:08.776 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:39:08.776 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.776 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.776 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.776 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.776 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.776 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.776 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.776 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:39:08.776 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.776 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.776 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.776 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.777 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.777 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.777 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crash", 2024-09-21T06:39:08.777 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:08.777 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:08.777 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:08.777 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:08.777 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:08.777 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.777 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.777 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.777 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.777 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.778 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.778 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.778 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.778 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.778 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.778 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.778 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.778 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.778 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.778 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.778 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.778 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.778 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.778 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.779 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:08.779 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:08.779 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.779 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.779 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.779 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.779 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.779 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.779 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.779 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.779 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.779 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.779 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.780 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:08.780 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:08.780 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.780 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.780 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.780 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:08.780 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.780 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.780 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.780 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.780 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.780 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.780 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.781 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.781 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.781 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.781 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.781 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.781 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.781 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.781 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.781 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:08.781 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:08.781 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.781 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.781 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.781 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.782 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.782 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.782 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.782 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.782 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.782 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.782 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.782 INFO:teuthology.orchestra.run.smithi063.stdout: "retain_interval": { 2024-09-21T06:39:08.782 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "retain_interval", 2024-09-21T06:39:08.782 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:08.783 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.783 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.783 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "31536000", 2024-09-21T06:39:08.783 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.783 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.783 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.783 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:39:08.783 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.783 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.783 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.783 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.783 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:08.783 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:08.783 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.784 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:08.784 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.784 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.784 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.784 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.784 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.784 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.784 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.784 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.784 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.784 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.784 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_recent_interval": { 2024-09-21T06:39:08.784 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_recent_interval", 2024-09-21T06:39:08.784 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:08.785 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.785 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.785 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "1209600", 2024-09-21T06:39:08.785 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.785 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.785 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.785 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:39:08.785 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.785 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.785 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.785 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.785 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.785 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.786 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.786 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "dashboard", 2024-09-21T06:39:08.786 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:08.786 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:08.786 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:08.786 INFO:teuthology.orchestra.run.smithi063.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:39:08.786 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:39:08.786 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.786 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.786 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.786 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:08.786 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.786 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.786 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.787 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.787 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.787 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.787 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.787 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.787 INFO:teuthology.orchestra.run.smithi063.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:39:08.787 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:39:08.787 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.787 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.787 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.787 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.787 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.787 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.788 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.788 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.788 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.788 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.788 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.788 INFO:teuthology.orchestra.run.smithi063.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:39:08.788 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:39:08.788 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.788 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.788 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.788 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.788 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.789 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.789 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.789 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.789 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.789 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.789 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.789 INFO:teuthology.orchestra.run.smithi063.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:39:08.789 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:39:08.789 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.789 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.789 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.789 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.789 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.790 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.790 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.790 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.790 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.790 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.790 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.790 INFO:teuthology.orchestra.run.smithi063.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:39:08.790 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:39:08.790 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.790 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.790 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.790 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.791 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.791 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.791 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.791 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.791 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.791 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.791 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.791 INFO:teuthology.orchestra.run.smithi063.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:39:08.791 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:39:08.791 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.791 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.791 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.791 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.792 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.792 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.792 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.792 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.792 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.792 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.792 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.792 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:39:08.792 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:39:08.792 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.792 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.792 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.792 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.793 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.793 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.793 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.793 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.793 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.793 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.793 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.793 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:39:08.793 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:39:08.793 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.793 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.794 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.794 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.794 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.794 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.794 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.794 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.794 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.794 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.794 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.795 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:39:08.795 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:39:08.795 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.795 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.795 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.795 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.795 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.795 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.795 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.795 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.795 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.795 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.795 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.796 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:39:08.796 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:39:08.796 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.796 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.796 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.796 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.796 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.796 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.797 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.797 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.797 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.797 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.797 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.797 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:39:08.797 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:39:08.797 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.797 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.797 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.797 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.798 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.798 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.798 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.798 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.798 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.798 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.798 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.798 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:39:08.798 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:39:08.799 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.799 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.799 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.799 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.799 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.799 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.799 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.799 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.799 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.799 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.799 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.800 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:39:08.800 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:39:08.800 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.800 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.800 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.800 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.800 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.800 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.801 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.801 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.801 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.801 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.801 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.801 INFO:teuthology.orchestra.run.smithi063.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:39:08.801 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:39:08.801 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.801 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.801 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.802 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.802 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.802 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.802 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.802 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.802 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.802 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.802 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.802 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:39:08.803 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:39:08.803 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.803 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.803 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.803 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "admin", 2024-09-21T06:39:08.803 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.803 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.803 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.803 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.803 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.804 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.804 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.804 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:39:08.804 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:39:08.804 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.804 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.804 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.804 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.804 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.805 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.805 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.805 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.805 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.805 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.805 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.805 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_URL": { 2024-09-21T06:39:08.805 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:39:08.805 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.806 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.806 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.806 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.806 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.806 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.806 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.806 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.806 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.806 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.806 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.807 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:39:08.807 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:39:08.807 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.807 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.807 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.807 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "admin", 2024-09-21T06:39:08.807 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.807 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.807 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.807 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.807 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.807 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.808 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.808 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:39:08.808 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:39:08.808 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.808 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.808 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.808 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.808 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.808 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.808 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.808 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.808 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.809 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.809 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.809 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:39:08.809 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:39:08.809 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.809 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.809 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.809 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.809 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.809 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.809 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.810 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.810 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.810 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.810 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.810 INFO:teuthology.orchestra.run.smithi063.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:39:08.810 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:39:08.810 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.810 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.810 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.810 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.810 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.811 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.811 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.811 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.811 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.811 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.811 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.811 INFO:teuthology.orchestra.run.smithi063.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:39:08.811 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:39:08.811 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.811 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.811 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.812 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.812 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.812 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.812 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.812 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.812 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.812 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.812 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.812 INFO:teuthology.orchestra.run.smithi063.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:39:08.812 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:39:08.812 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.812 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.813 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.813 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "[]", 2024-09-21T06:39:08.813 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.813 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.813 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.813 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.813 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.813 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.813 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.813 INFO:teuthology.orchestra.run.smithi063.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:39:08.813 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:39:08.814 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.814 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.814 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.814 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "{}", 2024-09-21T06:39:08.814 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.814 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.814 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.814 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.814 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.814 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.814 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.814 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.814 INFO:teuthology.orchestra.run.smithi063.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:39:08.814 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:39:08.815 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.815 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.815 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.815 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.815 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.815 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.815 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.815 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.815 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.815 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.815 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.815 INFO:teuthology.orchestra.run.smithi063.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:39:08.816 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:39:08.816 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.816 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.816 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.816 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.816 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.816 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.816 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.816 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.816 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.816 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.816 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.816 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:39:08.817 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:39:08.817 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.817 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.817 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.817 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.817 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.817 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.817 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.817 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.817 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.817 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.817 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.817 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:39:08.817 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:39:08.818 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.818 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.818 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.818 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.818 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.818 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.818 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.818 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.818 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.818 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.818 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.818 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:39:08.819 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:39:08.819 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.819 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.819 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.819 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.819 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.819 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.819 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.819 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.819 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.819 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.819 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.820 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:39:08.820 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:39:08.820 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.820 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.820 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.820 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.820 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.820 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.820 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.820 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.820 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.820 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.820 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.821 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:39:08.821 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:39:08.821 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.821 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.821 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.821 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.821 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.821 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.821 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.821 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.821 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.821 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.821 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.822 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:39:08.822 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:39:08.822 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.822 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.822 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.822 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.822 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.822 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.822 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.822 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.822 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.822 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.823 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.823 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:39:08.823 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:39:08.823 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.823 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.823 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.823 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.823 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.823 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.823 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.823 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.824 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.824 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.824 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.824 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:39:08.824 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:39:08.824 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.824 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.824 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.824 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.824 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.824 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.824 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.825 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.825 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.825 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.825 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.825 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:39:08.825 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:39:08.825 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.825 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.825 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.825 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:39:08.825 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.825 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.825 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.825 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.826 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.826 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.826 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.826 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:39:08.826 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:39:08.826 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.826 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.826 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.826 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:08.826 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.826 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.827 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.827 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.827 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.827 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.827 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.827 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:39:08.827 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:39:08.827 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.828 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.828 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.828 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8", 2024-09-21T06:39:08.828 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.828 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.828 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.828 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.828 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.828 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.828 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.828 INFO:teuthology.orchestra.run.smithi063.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:39:08.828 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:39:08.829 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.829 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.829 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.829 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "45", 2024-09-21T06:39:08.829 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.829 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.829 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.829 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.829 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.829 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.829 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.830 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:39:08.830 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:39:08.830 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.830 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.830 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.830 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.830 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.830 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.830 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.831 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.831 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.831 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.831 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.831 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:39:08.831 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:39:08.831 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.831 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.831 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.831 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "admin", 2024-09-21T06:39:08.832 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.832 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.832 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.832 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.832 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.832 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.832 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.832 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:39:08.832 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:39:08.832 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.833 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.833 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.833 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.833 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.833 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.833 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.833 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.833 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.833 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.833 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.834 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:39:08.834 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:39:08.834 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.834 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.834 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.834 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.834 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.834 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.834 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.835 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.835 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.835 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.835 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.835 INFO:teuthology.orchestra.run.smithi063.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:39:08.835 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:39:08.835 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.835 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.835 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.835 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.836 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.836 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.836 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.836 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.836 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.836 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.836 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.836 INFO:teuthology.orchestra.run.smithi063.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:39:08.836 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:39:08.837 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.837 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.837 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.837 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.837 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.837 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.837 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.837 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.837 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.837 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.837 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.838 INFO:teuthology.orchestra.run.smithi063.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:39:08.838 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:39:08.838 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.838 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.838 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.838 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:08.838 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.839 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.839 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.839 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.839 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.839 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.839 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.841 INFO:teuthology.orchestra.run.smithi063.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:39:08.842 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:39:08.842 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.842 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.842 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.842 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-21T06:39:08.842 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.842 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.842 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.842 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.842 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.842 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.842 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.843 INFO:teuthology.orchestra.run.smithi063.stdout: "cross_origin_url": { 2024-09-21T06:39:08.843 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cross_origin_url", 2024-09-21T06:39:08.843 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.843 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.843 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.843 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.843 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.843 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.843 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.843 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.843 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.843 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.844 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.844 INFO:teuthology.orchestra.run.smithi063.stdout: "crt_file": { 2024-09-21T06:39:08.844 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crt_file", 2024-09-21T06:39:08.844 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.844 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.844 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.844 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.844 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.844 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.844 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.844 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.845 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.845 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.845 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.845 INFO:teuthology.orchestra.run.smithi063.stdout: "debug": { 2024-09-21T06:39:08.845 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "debug", 2024-09-21T06:39:08.845 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.845 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.845 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.845 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.845 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.845 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.845 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.845 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:39:08.846 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.846 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.846 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.846 INFO:teuthology.orchestra.run.smithi063.stdout: "jwt_token_ttl": { 2024-09-21T06:39:08.846 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "jwt_token_ttl", 2024-09-21T06:39:08.846 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.846 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.846 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.846 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "28800", 2024-09-21T06:39:08.846 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.846 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.847 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.847 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.847 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.847 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.847 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.847 INFO:teuthology.orchestra.run.smithi063.stdout: "key_file": { 2024-09-21T06:39:08.847 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "key_file", 2024-09-21T06:39:08.847 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.847 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.847 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.847 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.848 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.848 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.848 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.848 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.848 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.848 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.848 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.848 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:08.848 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:08.848 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.848 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.848 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.849 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.849 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.849 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.849 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.849 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.849 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.849 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.849 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.849 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.849 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.849 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.849 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.849 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.849 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.850 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.850 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:08.850 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:08.850 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.850 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.850 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.850 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.850 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.850 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.850 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.850 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.850 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.851 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.851 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.851 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:08.851 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:08.851 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.851 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.851 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.851 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:08.851 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.851 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.851 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.852 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.852 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.852 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.852 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.852 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.852 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.852 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.852 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.852 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.852 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.852 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.852 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:08.853 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:08.853 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.853 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.853 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.853 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.853 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.853 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.853 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.853 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.853 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.853 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.853 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.853 INFO:teuthology.orchestra.run.smithi063.stdout: "motd": { 2024-09-21T06:39:08.854 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "motd", 2024-09-21T06:39:08.854 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.854 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.854 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.854 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.854 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.854 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.854 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.854 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "The message of the day", 2024-09-21T06:39:08.854 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.854 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.854 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.855 INFO:teuthology.orchestra.run.smithi063.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:39:08.855 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:39:08.855 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.855 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.855 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.855 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.855 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.855 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.855 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.855 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.855 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.855 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.855 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.856 INFO:teuthology.orchestra.run.smithi063.stdout: "server_addr": { 2024-09-21T06:39:08.856 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_addr", 2024-09-21T06:39:08.856 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.856 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.856 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.856 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "::", 2024-09-21T06:39:08.856 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.856 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.856 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.856 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.856 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.856 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.856 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.857 INFO:teuthology.orchestra.run.smithi063.stdout: "server_port": { 2024-09-21T06:39:08.857 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_port", 2024-09-21T06:39:08.857 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.857 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.857 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.857 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8080", 2024-09-21T06:39:08.857 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.857 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.857 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.857 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.857 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.858 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.858 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.858 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:08.858 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:08.858 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.858 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:08.858 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.858 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.858 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.858 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.858 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.858 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.858 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.859 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.859 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.859 INFO:teuthology.orchestra.run.smithi063.stdout: "ssl": { 2024-09-21T06:39:08.859 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssl", 2024-09-21T06:39:08.859 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.859 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.859 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.859 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.859 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.859 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.859 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.860 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.860 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.860 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.860 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.860 INFO:teuthology.orchestra.run.smithi063.stdout: "ssl_server_port": { 2024-09-21T06:39:08.860 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssl_server_port", 2024-09-21T06:39:08.860 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.860 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.860 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.860 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8443", 2024-09-21T06:39:08.860 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.860 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.861 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.861 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.861 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.861 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.861 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.861 INFO:teuthology.orchestra.run.smithi063.stdout: "sso_oauth2": { 2024-09-21T06:39:08.861 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sso_oauth2", 2024-09-21T06:39:08.861 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.861 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.861 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.861 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.861 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.862 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.862 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.862 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.862 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.862 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.862 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.862 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_behaviour": { 2024-09-21T06:39:08.862 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_behaviour", 2024-09-21T06:39:08.862 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.862 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.862 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.862 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "redirect", 2024-09-21T06:39:08.862 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.863 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.863 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.863 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.863 INFO:teuthology.orchestra.run.smithi063.stdout: "redirect" 2024-09-21T06:39:08.863 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.863 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.863 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.863 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.863 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.863 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_error_status_code": { 2024-09-21T06:39:08.863 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_error_status_code", 2024-09-21T06:39:08.863 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.863 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.864 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.864 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "500", 2024-09-21T06:39:08.864 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "400", 2024-09-21T06:39:08.864 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "599", 2024-09-21T06:39:08.864 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.864 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.864 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.864 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.864 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.864 INFO:teuthology.orchestra.run.smithi063.stdout: "url_prefix": { 2024-09-21T06:39:08.864 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "url_prefix", 2024-09-21T06:39:08.864 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.864 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.865 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.865 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.865 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.865 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.865 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.865 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.865 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.865 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.865 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.866 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.866 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.866 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "devicehealth", 2024-09-21T06:39:08.866 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:08.866 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:08.866 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:08.866 INFO:teuthology.orchestra.run.smithi063.stdout: "enable_monitoring": { 2024-09-21T06:39:08.866 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enable_monitoring", 2024-09-21T06:39:08.866 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.866 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.867 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.867 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.867 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.867 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.867 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.867 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "monitor device health metrics", 2024-09-21T06:39:08.867 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.867 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.867 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.867 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:08.868 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:08.868 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.868 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.868 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.868 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.868 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.868 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.868 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.868 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.868 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.868 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.869 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.869 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.869 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.869 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.869 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.869 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.869 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.869 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.869 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:08.869 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:08.869 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.869 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.870 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.870 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.870 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.870 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.870 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.870 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.870 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.870 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.870 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.871 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:08.871 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:08.871 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.871 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.871 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.871 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:08.871 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.871 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.871 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.871 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.871 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.872 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.872 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.872 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.872 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.872 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.872 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.872 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.872 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.872 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.872 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:08.873 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:08.873 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.873 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.873 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.873 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.873 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.873 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.873 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.873 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.874 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.874 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.874 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.874 INFO:teuthology.orchestra.run.smithi063.stdout: "mark_out_threshold": { 2024-09-21T06:39:08.874 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mark_out_threshold", 2024-09-21T06:39:08.874 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:08.874 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.874 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.874 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "2419200", 2024-09-21T06:39:08.875 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.875 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.875 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.875 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:39:08.875 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.875 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.875 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.875 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": { 2024-09-21T06:39:08.875 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pool_name", 2024-09-21T06:39:08.876 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.876 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.876 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.876 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "device_health_metrics", 2024-09-21T06:39:08.876 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.876 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.876 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.876 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:39:08.876 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.876 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.877 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.877 INFO:teuthology.orchestra.run.smithi063.stdout: "retention_period": { 2024-09-21T06:39:08.877 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "retention_period", 2024-09-21T06:39:08.877 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:08.877 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.877 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.877 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "15552000", 2024-09-21T06:39:08.878 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.878 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.878 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.878 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:39:08.878 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.878 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.878 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.878 INFO:teuthology.orchestra.run.smithi063.stdout: "scrape_frequency": { 2024-09-21T06:39:08.878 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "scrape_frequency", 2024-09-21T06:39:08.878 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:08.878 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.879 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.879 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "86400", 2024-09-21T06:39:08.879 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.879 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.879 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.879 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:39:08.879 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.879 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.879 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.879 INFO:teuthology.orchestra.run.smithi063.stdout: "self_heal": { 2024-09-21T06:39:08.879 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "self_heal", 2024-09-21T06:39:08.879 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.880 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.880 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.880 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:08.880 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.880 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.880 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.880 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:39:08.880 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.880 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.880 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.880 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-21T06:39:08.880 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-21T06:39:08.881 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:08.881 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.881 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.881 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-21T06:39:08.881 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.881 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.881 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.881 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:39:08.881 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.881 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.881 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.881 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:08.881 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:08.882 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.882 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:08.882 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.882 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.882 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.882 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.882 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.882 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.882 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.882 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.882 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.882 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_threshold": { 2024-09-21T06:39:08.882 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_threshold", 2024-09-21T06:39:08.883 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:08.883 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.883 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.883 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "7257600", 2024-09-21T06:39:08.883 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.883 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.883 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.883 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:39:08.883 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.883 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.883 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.883 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.883 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.884 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "diskprediction_local", 2024-09-21T06:39:08.884 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:08.884 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:08.884 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:08.884 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:08.884 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:08.884 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.884 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.884 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.884 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.884 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.884 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.884 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.884 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.885 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.885 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.885 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.885 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.885 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.885 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.885 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.885 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.885 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.885 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.885 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:08.885 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:08.885 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.885 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.886 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.886 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.886 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.886 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.886 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.886 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.886 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.886 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.886 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.886 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:08.886 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:08.886 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.887 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.887 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.887 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:08.887 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.887 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.887 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.887 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.887 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.887 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.887 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.887 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.887 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.887 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.888 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.888 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.888 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.888 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.888 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:08.888 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:08.888 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.888 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.888 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.888 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.888 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.888 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.889 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.889 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.889 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.889 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.889 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.889 INFO:teuthology.orchestra.run.smithi063.stdout: "predict_interval": { 2024-09-21T06:39:08.889 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "predict_interval", 2024-09-21T06:39:08.889 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.889 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.889 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.889 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "86400", 2024-09-21T06:39:08.889 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.889 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.890 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.890 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.890 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.890 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.890 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.890 INFO:teuthology.orchestra.run.smithi063.stdout: "predictor_model": { 2024-09-21T06:39:08.890 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "predictor_model", 2024-09-21T06:39:08.890 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.890 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.890 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.890 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "prophetstor", 2024-09-21T06:39:08.890 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.891 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.891 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.891 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.891 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.891 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.891 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.891 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-21T06:39:08.891 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-21T06:39:08.891 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.891 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.891 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.891 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-21T06:39:08.892 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.892 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.892 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.892 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.892 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.892 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.892 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.892 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:08.892 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:08.892 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.892 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:08.892 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.893 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.893 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.893 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.893 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.893 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.893 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.893 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.893 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.893 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.893 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.893 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "influx", 2024-09-21T06:39:08.893 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": false, 2024-09-21T06:39:08.894 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:39:08.894 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:08.894 INFO:teuthology.orchestra.run.smithi063.stdout: "batch_size": { 2024-09-21T06:39:08.894 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "batch_size", 2024-09-21T06:39:08.894 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.894 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.894 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.894 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5000", 2024-09-21T06:39:08.894 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.894 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.894 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.894 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:39:08.895 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.895 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.895 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.895 INFO:teuthology.orchestra.run.smithi063.stdout: "database": { 2024-09-21T06:39:08.895 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "database", 2024-09-21T06:39:08.895 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.895 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.895 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.895 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "ceph", 2024-09-21T06:39:08.895 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.895 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.895 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.895 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:39:08.896 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.896 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.896 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.896 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": { 2024-09-21T06:39:08.896 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "hostname", 2024-09-21T06:39:08.896 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.896 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.896 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.896 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.896 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.896 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.896 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.897 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:39:08.897 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.897 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.897 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.897 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-21T06:39:08.897 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-21T06:39:08.897 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:08.897 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.897 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.897 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "30", 2024-09-21T06:39:08.898 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "5", 2024-09-21T06:39:08.898 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.898 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.898 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:39:08.898 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.898 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.898 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.898 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:08.899 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:08.899 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.899 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.899 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.899 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.899 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.899 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.899 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.899 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.899 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.899 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.899 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.900 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.900 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.900 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.900 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.900 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.900 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.900 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.900 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:08.900 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:08.900 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.901 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.901 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.901 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.901 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.901 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.901 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.901 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.901 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.901 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.901 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.901 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:08.902 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:08.902 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.902 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.902 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.902 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:08.902 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.902 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.902 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.902 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.903 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.903 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.903 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.903 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.903 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.903 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.903 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.903 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.903 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.903 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.903 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:08.903 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:08.904 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.904 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.904 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.904 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.904 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.904 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.904 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.904 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.904 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.904 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.905 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.905 INFO:teuthology.orchestra.run.smithi063.stdout: "password": { 2024-09-21T06:39:08.905 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "password", 2024-09-21T06:39:08.905 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.905 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.905 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.905 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.905 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.905 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.905 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.905 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:39:08.906 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.906 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.906 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.906 INFO:teuthology.orchestra.run.smithi063.stdout: "port": { 2024-09-21T06:39:08.906 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "port", 2024-09-21T06:39:08.906 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.906 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.906 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.906 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8086", 2024-09-21T06:39:08.907 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.907 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.907 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.907 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "InfluxDB server port", 2024-09-21T06:39:08.907 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.907 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.907 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.907 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:08.908 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:08.908 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.908 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:08.908 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.908 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.908 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.908 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.908 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.908 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.908 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.909 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.909 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.909 INFO:teuthology.orchestra.run.smithi063.stdout: "ssl": { 2024-09-21T06:39:08.909 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssl", 2024-09-21T06:39:08.909 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.909 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.909 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.910 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "false", 2024-09-21T06:39:08.910 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.910 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.910 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.910 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:39:08.910 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.910 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.910 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.911 INFO:teuthology.orchestra.run.smithi063.stdout: "threads": { 2024-09-21T06:39:08.911 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "threads", 2024-09-21T06:39:08.911 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.911 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.911 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.911 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-21T06:39:08.911 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-21T06:39:08.911 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "32", 2024-09-21T06:39:08.911 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.911 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:39:08.911 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.911 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.911 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.912 INFO:teuthology.orchestra.run.smithi063.stdout: "username": { 2024-09-21T06:39:08.912 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "username", 2024-09-21T06:39:08.912 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.912 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.912 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.912 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.912 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.912 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.912 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.912 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:39:08.912 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.912 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.912 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.913 INFO:teuthology.orchestra.run.smithi063.stdout: "verify_ssl": { 2024-09-21T06:39:08.913 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "verify_ssl", 2024-09-21T06:39:08.913 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.913 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.913 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.913 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "true", 2024-09-21T06:39:08.913 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.913 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.913 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.913 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:39:08.913 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.913 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.914 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.914 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.914 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.914 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "insights", 2024-09-21T06:39:08.914 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:08.914 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:08.914 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:08.914 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:08.914 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:08.914 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.914 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.915 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.915 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.915 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.915 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.915 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.915 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.915 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.915 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.915 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.915 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.915 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.915 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.915 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.916 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.916 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.916 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.916 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:08.916 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:08.916 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.916 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.916 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.916 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.916 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.916 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.916 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.916 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.916 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.917 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.917 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.917 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:08.917 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:08.917 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.917 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.917 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.917 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:08.917 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.917 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.917 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.917 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.918 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.918 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.918 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.918 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.918 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.918 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.918 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.918 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.918 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.918 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.918 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:08.918 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:08.919 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.919 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.919 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.919 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.919 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.919 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.919 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.919 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.919 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.919 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.919 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.919 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:08.919 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:08.920 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.920 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:08.920 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.920 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.920 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.920 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.920 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.920 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.920 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.920 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.920 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.920 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.920 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.921 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "iostat", 2024-09-21T06:39:08.921 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:08.921 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:08.921 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:08.921 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:08.921 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:08.921 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.921 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.921 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.921 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.921 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.921 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.921 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.922 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.922 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.922 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.922 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.922 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.922 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.922 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.922 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.922 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.922 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.922 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.922 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:08.922 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:08.923 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.923 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.923 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.923 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.923 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.923 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.923 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.923 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.923 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.923 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.923 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.924 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:08.924 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:08.924 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.924 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.924 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.924 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:08.924 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.924 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.924 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.924 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.924 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.924 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.924 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.925 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.925 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.925 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.925 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.925 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.925 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.925 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.925 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:08.925 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:08.925 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.925 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.926 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.926 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.926 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.926 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.926 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.926 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.926 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.926 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.926 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.926 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:08.926 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:08.926 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.927 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:08.927 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.927 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.927 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.927 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.927 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.927 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.927 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.927 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.927 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.927 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.927 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.928 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "k8sevents", 2024-09-21T06:39:08.928 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:08.928 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:08.928 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:08.928 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_event_retention_days": { 2024-09-21T06:39:08.928 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:39:08.928 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.928 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.928 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.928 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "7", 2024-09-21T06:39:08.928 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.928 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.928 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.928 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:39:08.929 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.929 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.929 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.929 INFO:teuthology.orchestra.run.smithi063.stdout: "config_check_secs": { 2024-09-21T06:39:08.929 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "config_check_secs", 2024-09-21T06:39:08.929 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.929 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.929 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.929 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:08.929 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "10", 2024-09-21T06:39:08.929 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.929 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.930 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:39:08.930 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.930 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.930 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.930 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:08.930 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:08.930 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.930 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.930 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.930 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.930 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.930 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.931 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.931 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.931 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.931 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.931 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.931 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.931 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.931 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.932 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.932 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.932 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.932 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.932 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:08.932 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:08.932 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.932 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.932 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.932 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.932 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.932 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.932 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.933 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.933 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.933 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.933 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.933 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:08.933 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:08.933 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.933 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.933 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.933 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:08.934 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.934 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.934 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.934 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.934 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.934 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.934 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.934 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.934 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.934 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.934 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.934 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.935 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.935 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.935 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:08.935 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:08.935 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.935 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.935 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.935 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.935 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.935 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.935 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.935 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.935 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.936 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.936 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.936 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:08.936 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:08.936 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.936 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:08.936 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.936 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.936 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.936 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.936 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.936 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.937 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.937 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.937 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.937 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.937 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.937 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "localpool", 2024-09-21T06:39:08.937 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:08.937 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:08.937 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:08.938 INFO:teuthology.orchestra.run.smithi063.stdout: "failure_domain": { 2024-09-21T06:39:08.938 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "failure_domain", 2024-09-21T06:39:08.938 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.938 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.938 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.938 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "host", 2024-09-21T06:39:08.938 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.938 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.938 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.938 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:39:08.939 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:39:08.939 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.939 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.939 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:08.939 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:08.939 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.939 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.939 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.939 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.939 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.940 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.940 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.940 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.940 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.940 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.940 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.940 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.940 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.940 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.940 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.941 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.941 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.941 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.941 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:08.941 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:08.941 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.941 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.941 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.941 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.941 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.942 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.942 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.942 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.942 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.942 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.942 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.942 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:08.942 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:08.942 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.943 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.943 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.943 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:08.943 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.943 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.943 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.943 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.943 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.943 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.943 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.944 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.944 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.944 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.944 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.944 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.944 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.944 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.945 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:08.945 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:08.945 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.945 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.945 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.945 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.945 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.945 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.946 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.946 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.946 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.946 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.946 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.946 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": { 2024-09-21T06:39:08.946 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "min_size", 2024-09-21T06:39:08.946 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.946 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.946 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.946 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.946 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.947 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.947 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.947 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:39:08.947 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:39:08.947 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.947 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.947 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rep": { 2024-09-21T06:39:08.947 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "num_rep", 2024-09-21T06:39:08.947 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.947 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.947 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.947 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3", 2024-09-21T06:39:08.948 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.948 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.948 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.948 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:39:08.948 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.948 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.948 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.948 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": { 2024-09-21T06:39:08.948 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pg_num", 2024-09-21T06:39:08.948 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.948 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.948 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.948 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "128", 2024-09-21T06:39:08.949 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.949 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.949 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.949 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:39:08.949 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.949 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.949 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.949 INFO:teuthology.orchestra.run.smithi063.stdout: "prefix": { 2024-09-21T06:39:08.949 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "prefix", 2024-09-21T06:39:08.949 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.949 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.949 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.949 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.950 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.950 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.950 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.950 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:39:08.950 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.950 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.950 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.950 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:08.950 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:08.950 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.950 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:08.950 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.951 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.951 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.951 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.951 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.951 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.951 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.951 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.951 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.951 INFO:teuthology.orchestra.run.smithi063.stdout: "subtree": { 2024-09-21T06:39:08.951 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "subtree", 2024-09-21T06:39:08.951 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.951 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.951 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.951 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "rack", 2024-09-21T06:39:08.952 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.952 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.952 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.952 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:39:08.952 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:39:08.952 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.952 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.952 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.952 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.952 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mds_autoscaler", 2024-09-21T06:39:08.952 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:08.952 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:08.953 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:08.953 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:08.953 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:08.953 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.953 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.953 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.953 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.953 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.953 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.953 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.953 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.953 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.953 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.953 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.954 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.954 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.954 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.954 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.954 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.954 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.954 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.954 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:08.954 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:08.954 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.954 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.955 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.955 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.955 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.955 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.955 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.955 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.955 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.955 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.955 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.955 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:08.955 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:08.955 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.955 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.956 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.956 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:08.956 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.956 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.956 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.956 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.956 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.956 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.956 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.956 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.956 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.956 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.956 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.956 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.957 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.957 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.957 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:08.957 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:08.957 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.957 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.957 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.957 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.957 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.957 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.957 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.957 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.958 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.958 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.958 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.958 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:08.958 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:08.958 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.958 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:08.958 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.958 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.958 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.958 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.958 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.958 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.959 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.959 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.959 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.959 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.959 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.959 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mirroring", 2024-09-21T06:39:08.959 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:08.959 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:08.959 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:08.959 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:08.959 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:08.959 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.960 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.960 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.960 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.960 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.960 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.960 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.960 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.960 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.960 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.960 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.960 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.960 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.960 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.961 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.961 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.961 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.961 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.961 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:08.961 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:08.961 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.961 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.961 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.961 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.961 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.961 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.962 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.962 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.962 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.962 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.962 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.962 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:08.962 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:08.962 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.962 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.962 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.962 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:08.962 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.962 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.963 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.963 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.963 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.963 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.963 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.963 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.963 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.963 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.963 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.963 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.963 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.963 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.963 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:08.964 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:08.964 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.964 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.964 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.964 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.964 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.964 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.964 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.964 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.964 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.964 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.964 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.964 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "nfs", 2024-09-21T06:39:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "orchestrator", 2024-09-21T06:39:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: "fail_fs": { 2024-09-21T06:39:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "fail_fs", 2024-09-21T06:39:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:39:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: "orchestrator": { 2024-09-21T06:39:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "orchestrator", 2024-09-21T06:39:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm", 2024-09-21T06:39:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: "rook", 2024-09-21T06:39:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: "test_orchestrator" 2024-09-21T06:39:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Orchestrator backend", 2024-09-21T06:39:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "osd_perf_query", 2024-09-21T06:39:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "osd_support", 2024-09-21T06:39:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pg_autoscaler", 2024-09-21T06:39:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-21T06:39:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-21T06:39:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-21T06:39:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: "threshold": { 2024-09-21T06:39:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "threshold", 2024-09-21T06:39:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3.0", 2024-09-21T06:39:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1.0", 2024-09-21T06:39:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "scaling threshold", 2024-09-21T06:39:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:39:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "progress", 2024-09-21T06:39:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_pg_recovery_event": { 2024-09-21T06:39:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:39:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:39:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": { 2024-09-21T06:39:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enabled", 2024-09-21T06:39:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: "max_completed_events": { 2024-09-21T06:39:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_completed_events", 2024-09-21T06:39:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "50", 2024-09-21T06:39:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:39:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-21T06:39:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-21T06:39:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-21T06:39:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:39:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "prometheus", 2024-09-21T06:39:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: "cache": { 2024-09-21T06:39:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cache", 2024-09-21T06:39:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "exclude_perf_counters": { 2024-09-21T06:39:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "exclude_perf_counters", 2024-09-21T06:39:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:39:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:39:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_stats_pools": { 2024-09-21T06:39:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd_stats_pools", 2024-09-21T06:39:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:39:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:39:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "300", 2024-09-21T06:39:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "scrape_interval": { 2024-09-21T06:39:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "scrape_interval", 2024-09-21T06:39:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "15.0", 2024-09-21T06:39:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "server_addr": { 2024-09-21T06:39:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_addr", 2024-09-21T06:39:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "::", 2024-09-21T06:39:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:39:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: "server_port": { 2024-09-21T06:39:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_port", 2024-09-21T06:39:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "9283", 2024-09-21T06:39:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:39:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: "stale_cache_strategy": { 2024-09-21T06:39:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "stale_cache_strategy", 2024-09-21T06:39:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "log", 2024-09-21T06:39:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_behaviour": { 2024-09-21T06:39:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_behaviour", 2024-09-21T06:39:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "default", 2024-09-21T06:39:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: "default", 2024-09-21T06:39:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: "error" 2024-09-21T06:39:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_error_status_code": { 2024-09-21T06:39:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_error_status_code", 2024-09-21T06:39:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "500", 2024-09-21T06:39:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "400", 2024-09-21T06:39:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "599", 2024-09-21T06:39:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd_support", 2024-09-21T06:39:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: "max_concurrent_snap_create": { 2024-09-21T06:39:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:39:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:39:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:39:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: "trash_purge_schedule": { 2024-09-21T06:39:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "trash_purge_schedule", 2024-09-21T06:39:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "restful", 2024-09-21T06:39:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "enable_auth": { 2024-09-21T06:39:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enable_auth", 2024-09-21T06:39:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: "key_file": { 2024-09-21T06:39:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "key_file", 2024-09-21T06:39:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "max_requests": { 2024-09-21T06:39:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_requests", 2024-09-21T06:39:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "500", 2024-09-21T06:39:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:39:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "server_addr": { 2024-09-21T06:39:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_addr", 2024-09-21T06:39:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "server_port": { 2024-09-21T06:39:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_port", 2024-09-21T06:39:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rgw", 2024-09-21T06:39:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:39:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:39:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-21T06:39:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:39:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rook", 2024-09-21T06:39:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.081 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.081 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.081 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.081 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.081 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.081 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.081 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.082 INFO:teuthology.orchestra.run.smithi063.stdout: "storage_class": { 2024-09-21T06:39:09.082 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "storage_class", 2024-09-21T06:39:09.082 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.082 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.082 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.082 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "local", 2024-09-21T06:39:09.082 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.082 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.082 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.082 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:39:09.082 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.082 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.082 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.083 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.083 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.083 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "selftest", 2024-09-21T06:39:09.083 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.083 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.083 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.083 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.083 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.083 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.083 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.083 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.084 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.084 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.084 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.084 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.084 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.084 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.084 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.084 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.084 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.084 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.084 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.084 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.084 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.084 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.085 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.085 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.085 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.085 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.085 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.085 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.085 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.085 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.085 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.085 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.085 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.085 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.085 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.086 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.086 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.086 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.086 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.086 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.086 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.086 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.086 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.086 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.086 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.086 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.086 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.087 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.087 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.087 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.087 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.087 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.087 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.087 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.087 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.087 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.087 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.087 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.087 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.087 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.088 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.088 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.088 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.088 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.088 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.088 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.088 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.088 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.088 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.088 INFO:teuthology.orchestra.run.smithi063.stdout: "roption1": { 2024-09-21T06:39:09.088 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "roption1", 2024-09-21T06:39:09.088 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.088 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.089 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.089 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.089 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.089 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.089 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.089 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.089 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.089 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.089 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.089 INFO:teuthology.orchestra.run.smithi063.stdout: "roption2": { 2024-09-21T06:39:09.089 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "roption2", 2024-09-21T06:39:09.089 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.090 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.090 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.090 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "xyz", 2024-09-21T06:39:09.090 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.090 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.090 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.090 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.090 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.090 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.090 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.090 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption1": { 2024-09-21T06:39:09.090 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption1", 2024-09-21T06:39:09.090 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.091 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.091 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.091 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.091 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.091 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.091 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.091 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.091 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.091 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.091 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.091 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption2": { 2024-09-21T06:39:09.091 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption2", 2024-09-21T06:39:09.091 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.092 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.092 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.092 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.092 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.092 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.092 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.092 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.092 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.092 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.092 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.092 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption3": { 2024-09-21T06:39:09.092 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption3", 2024-09-21T06:39:09.092 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:09.093 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.093 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.093 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.093 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.093 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.093 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.093 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.093 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.093 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.093 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.093 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption4": { 2024-09-21T06:39:09.093 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption4", 2024-09-21T06:39:09.093 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.094 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.094 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.094 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.094 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.094 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.094 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.094 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.094 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.094 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.094 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.094 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption5": { 2024-09-21T06:39:09.094 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption5", 2024-09-21T06:39:09.095 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.095 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.095 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.095 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.095 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.095 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.095 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.095 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.095 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.095 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.095 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.095 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption6": { 2024-09-21T06:39:09.096 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption6", 2024-09-21T06:39:09.096 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.096 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.096 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.096 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.096 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.096 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.096 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.096 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.096 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.096 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.096 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.097 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption7": { 2024-09-21T06:39:09.097 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption7", 2024-09-21T06:39:09.097 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.097 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.097 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.097 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.097 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-21T06:39:09.097 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "42", 2024-09-21T06:39:09.097 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.097 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.097 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.097 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.097 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.098 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.098 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.098 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.098 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.098 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.098 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.098 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.098 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.098 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.098 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.098 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.098 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.098 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.099 INFO:teuthology.orchestra.run.smithi063.stdout: "testkey": { 2024-09-21T06:39:09.099 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "testkey", 2024-09-21T06:39:09.099 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.099 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.099 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.099 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.099 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.099 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.099 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.099 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.099 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.099 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.099 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.100 INFO:teuthology.orchestra.run.smithi063.stdout: "testlkey": { 2024-09-21T06:39:09.100 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "testlkey", 2024-09-21T06:39:09.100 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.100 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.100 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.100 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.100 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.100 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.100 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.100 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.100 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.100 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.100 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.101 INFO:teuthology.orchestra.run.smithi063.stdout: "testnewline": { 2024-09-21T06:39:09.101 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "testnewline", 2024-09-21T06:39:09.101 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.101 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.101 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.101 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.101 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.101 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.101 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.101 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.101 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.101 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.102 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.102 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.102 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.102 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smb", 2024-09-21T06:39:09.102 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.102 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.102 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.103 INFO:teuthology.orchestra.run.smithi063.stdout: "internal_store_backend": { 2024-09-21T06:39:09.103 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "internal_store_backend", 2024-09-21T06:39:09.103 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.103 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.103 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.103 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.103 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.103 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.103 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.103 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:39:09.103 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.103 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.103 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.104 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.104 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.104 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.104 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.104 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.104 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.104 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.104 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.104 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.104 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.104 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.105 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.105 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.105 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.105 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.105 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.105 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.105 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.105 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.105 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.105 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.105 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.105 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.106 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.106 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.106 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.106 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.106 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.106 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.106 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.106 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.106 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.106 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.107 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.107 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.107 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.107 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.107 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.107 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.107 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.107 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.107 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.107 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.107 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.107 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.107 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.108 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.108 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.108 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.108 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.108 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.108 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.108 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.108 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.108 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.109 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.109 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.109 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.109 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.109 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.109 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.109 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.109 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.109 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.109 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.109 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.109 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.110 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.110 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.110 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.110 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.110 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.110 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.110 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.110 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.110 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.110 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.111 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.111 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.111 INFO:teuthology.orchestra.run.smithi063.stdout: "update_orchestration": { 2024-09-21T06:39:09.111 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "update_orchestration", 2024-09-21T06:39:09.111 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.111 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.111 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.111 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.112 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.112 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.112 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.112 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:39:09.112 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.112 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.112 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.112 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.113 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.113 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "snap_schedule", 2024-09-21T06:39:09.113 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.113 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.113 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.113 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_m_granularity": { 2024-09-21T06:39:09.114 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "allow_m_granularity", 2024-09-21T06:39:09.114 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.114 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.114 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.114 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.114 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.114 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.114 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.114 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:39:09.115 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.115 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.115 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.115 INFO:teuthology.orchestra.run.smithi063.stdout: "dump_on_update": { 2024-09-21T06:39:09.115 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "dump_on_update", 2024-09-21T06:39:09.115 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.115 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.115 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.115 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.115 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.115 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.115 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.116 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:39:09.116 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.116 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.116 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.116 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.116 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.116 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.116 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.116 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.116 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.116 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.117 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.117 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.117 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.117 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.117 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.117 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.117 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.117 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.117 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.117 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.117 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.117 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.117 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.118 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.118 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.118 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.118 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.118 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.118 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.118 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.118 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.118 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.118 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.118 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.118 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.118 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.119 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.119 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.119 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.119 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.119 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.119 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.119 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.119 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.119 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.119 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.119 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.119 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.119 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.120 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.120 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.120 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.120 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.120 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.120 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.120 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.120 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.120 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.120 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.120 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.120 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.120 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.121 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.121 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.121 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.121 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.121 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.121 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.121 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.121 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.121 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.121 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.121 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.121 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.122 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.122 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.122 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.122 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.122 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.122 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.122 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.122 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.122 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.122 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.122 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "stats", 2024-09-21T06:39:09.123 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.123 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.123 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.123 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.123 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.123 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.123 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.123 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.123 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.123 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.123 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.123 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.123 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.123 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.124 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.124 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.124 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.124 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.124 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.124 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.124 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.124 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.124 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.124 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.124 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.124 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.124 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.125 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.125 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.125 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.125 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.125 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.125 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.125 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.125 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.125 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.125 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.125 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.125 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.125 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.126 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.126 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.126 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.126 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.126 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.126 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.126 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.126 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.126 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.126 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.126 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.126 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.126 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.126 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.127 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.127 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.127 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.127 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.127 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.127 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.127 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.127 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.127 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.127 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.127 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.128 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.128 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.128 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.128 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.128 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.128 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.128 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.128 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.128 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.128 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.128 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.128 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.129 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.129 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.129 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.129 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.129 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.129 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.129 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.129 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "status", 2024-09-21T06:39:09.129 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.129 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.129 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.130 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.130 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.130 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.130 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.130 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.130 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.130 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.130 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.130 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.130 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.130 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.130 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.130 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.131 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.131 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.131 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.131 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.131 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.131 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.131 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.131 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.131 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.131 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.131 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.131 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.131 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.132 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.132 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.132 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.132 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.132 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.132 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.132 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.132 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.132 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.132 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.132 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.132 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.133 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.133 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.133 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.133 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.133 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.133 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.133 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.133 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.133 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.133 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.133 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.133 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.133 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.134 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.134 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.134 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.134 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.134 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.134 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.134 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.134 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.134 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.135 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.135 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.135 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.135 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.135 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.135 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.135 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.135 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.135 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.135 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.136 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.136 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.136 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.136 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.136 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.136 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.136 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.136 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.136 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.136 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.136 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.137 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "telegraf", 2024-09-21T06:39:09.137 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.137 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.137 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.137 INFO:teuthology.orchestra.run.smithi063.stdout: "address": { 2024-09-21T06:39:09.137 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "address", 2024-09-21T06:39:09.137 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.137 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.137 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.137 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:39:09.138 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.138 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.138 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.138 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.138 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.138 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.138 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.138 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-21T06:39:09.138 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-21T06:39:09.138 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.138 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.139 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.139 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "15", 2024-09-21T06:39:09.139 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.139 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.139 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.139 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.139 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.139 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.139 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.140 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.140 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.140 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.140 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.140 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.140 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.140 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.140 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.140 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.140 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.140 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.140 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.141 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.141 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.141 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.141 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.141 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.141 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.141 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.141 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.141 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.141 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.142 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.142 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.142 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.142 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.142 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.142 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.142 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.142 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.142 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.142 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.142 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.143 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.143 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.143 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.143 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.143 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.143 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.143 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.143 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.144 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.144 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.144 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.144 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.144 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.144 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.144 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.144 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.144 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.144 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.144 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.144 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.144 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.145 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.145 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.145 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.145 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.145 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.145 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.145 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.145 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.145 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.145 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.145 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.145 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.146 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.146 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.146 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.146 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.146 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.146 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.146 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.146 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.146 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.146 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.146 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.146 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.146 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.147 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.147 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.147 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.147 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "telemetry", 2024-09-21T06:39:09.147 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.147 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.147 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.148 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_basic": { 2024-09-21T06:39:09.148 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_basic", 2024-09-21T06:39:09.148 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.148 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.148 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.148 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.148 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.148 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.149 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.149 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:39:09.149 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.149 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.149 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.149 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_crash": { 2024-09-21T06:39:09.149 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_crash", 2024-09-21T06:39:09.149 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.149 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.149 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.150 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.150 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.150 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.150 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.150 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:39:09.150 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.150 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.150 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.150 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_device": { 2024-09-21T06:39:09.150 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_device", 2024-09-21T06:39:09.150 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.150 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.150 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.151 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.151 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.151 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.151 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.151 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:39:09.151 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.151 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.151 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.151 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_ident": { 2024-09-21T06:39:09.151 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_ident", 2024-09-21T06:39:09.151 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.151 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.152 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.152 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.152 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.152 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.152 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.152 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:39:09.152 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.152 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.152 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.152 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_perf": { 2024-09-21T06:39:09.152 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_perf", 2024-09-21T06:39:09.152 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.152 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.153 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.153 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.153 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.153 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.153 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.153 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:39:09.153 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.153 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.153 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.153 INFO:teuthology.orchestra.run.smithi063.stdout: "contact": { 2024-09-21T06:39:09.153 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "contact", 2024-09-21T06:39:09.153 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.153 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.154 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.154 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.154 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.154 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.154 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.154 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.154 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.154 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.154 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.154 INFO:teuthology.orchestra.run.smithi063.stdout: "description": { 2024-09-21T06:39:09.154 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "description", 2024-09-21T06:39:09.154 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.155 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.155 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.155 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.155 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.155 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.155 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.155 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.155 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.155 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.155 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.155 INFO:teuthology.orchestra.run.smithi063.stdout: "device_url": { 2024-09-21T06:39:09.155 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_url", 2024-09-21T06:39:09.155 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.156 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.156 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.156 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:39:09.156 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.156 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.156 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.156 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.156 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.156 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.156 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.156 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": { 2024-09-21T06:39:09.156 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enabled", 2024-09-21T06:39:09.157 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.157 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.157 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.157 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.157 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.157 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.157 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.157 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.157 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.157 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.157 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.157 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-21T06:39:09.157 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-21T06:39:09.158 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.158 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.158 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.158 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "24", 2024-09-21T06:39:09.158 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "8", 2024-09-21T06:39:09.158 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.158 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.158 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.158 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.158 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.158 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.159 INFO:teuthology.orchestra.run.smithi063.stdout: "last_opt_revision": { 2024-09-21T06:39:09.159 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "last_opt_revision", 2024-09-21T06:39:09.159 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.159 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.159 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.159 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "1", 2024-09-21T06:39:09.159 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.159 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.159 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.159 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.159 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.159 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.159 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.160 INFO:teuthology.orchestra.run.smithi063.stdout: "leaderboard": { 2024-09-21T06:39:09.160 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "leaderboard", 2024-09-21T06:39:09.160 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.160 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.160 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.160 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.160 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.160 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.160 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.160 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.160 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.160 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.160 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.160 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.161 INFO:teuthology.orchestra.run.smithi063.stdout: "leaderboard_description": { 2024-09-21T06:39:09.161 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "leaderboard_description", 2024-09-21T06:39:09.161 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.161 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.161 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.161 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.161 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.161 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.161 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.161 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.161 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.161 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.161 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.162 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.162 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.162 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.162 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.162 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.162 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.162 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.162 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.162 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.162 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.162 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.162 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.163 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.163 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.163 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.163 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.163 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.163 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.163 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.163 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.163 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.163 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.163 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.163 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.164 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.164 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.164 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.164 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.164 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.164 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.164 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.164 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.164 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.164 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.164 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.164 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.164 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.164 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.165 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.165 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.165 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.165 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.165 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.165 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.165 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.165 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.165 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.165 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.165 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.165 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.166 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.166 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.166 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.166 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.166 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.166 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.166 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.166 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.166 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.166 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.166 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.166 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.166 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.167 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.167 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.167 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.167 INFO:teuthology.orchestra.run.smithi063.stdout: "organization": { 2024-09-21T06:39:09.167 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "organization", 2024-09-21T06:39:09.167 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.167 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.167 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.167 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.167 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.167 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.167 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.168 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.168 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.168 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.168 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.168 INFO:teuthology.orchestra.run.smithi063.stdout: "proxy": { 2024-09-21T06:39:09.168 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "proxy", 2024-09-21T06:39:09.168 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.168 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.168 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.168 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.168 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.168 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.169 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.169 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.169 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.169 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.169 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.169 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.169 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.169 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.169 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.169 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.170 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.170 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.170 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.170 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.170 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.170 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.170 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.170 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.170 INFO:teuthology.orchestra.run.smithi063.stdout: "url": { 2024-09-21T06:39:09.171 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "url", 2024-09-21T06:39:09.171 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.171 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.171 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.171 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:39:09.171 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.171 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.171 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.171 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.171 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.171 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.171 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.172 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.172 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.172 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "test_orchestrator", 2024-09-21T06:39:09.172 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.172 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.172 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.172 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.172 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.173 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.173 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.173 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.173 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.173 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.173 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.173 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.173 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.173 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.173 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.173 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.173 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.173 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.173 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.174 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.174 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.174 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.174 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.174 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.174 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.174 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.175 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.175 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.175 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.175 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.175 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.175 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.175 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.175 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.175 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.175 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.175 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.175 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.176 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.176 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.176 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.176 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.176 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.176 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.176 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.176 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.176 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.177 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.177 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.177 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.177 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.177 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.177 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.177 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.177 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.177 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.177 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.177 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.178 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.178 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.178 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.178 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.178 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.178 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.178 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.178 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.178 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.179 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.179 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.179 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.179 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.179 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.179 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.179 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.179 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.179 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.180 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.180 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.180 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.180 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.180 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.180 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.180 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.180 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.181 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "volumes", 2024-09-21T06:39:09.181 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.181 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.181 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.181 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.181 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.181 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.182 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.182 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.182 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.182 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.182 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.182 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.182 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.182 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.182 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.183 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.183 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.183 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.183 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.183 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.183 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.183 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.183 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.183 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.183 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.183 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.183 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.183 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.184 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.184 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.184 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.184 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.184 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.184 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.184 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.184 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.184 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.184 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.184 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.184 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.185 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.185 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.185 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.185 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.185 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.185 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.185 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.185 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.185 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.185 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.185 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.185 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.185 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.186 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.186 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.186 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.186 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.186 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.186 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.186 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.186 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.186 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.186 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.186 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.186 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.187 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.187 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.187 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.187 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.187 INFO:teuthology.orchestra.run.smithi063.stdout: "max_concurrent_clones": { 2024-09-21T06:39:09.187 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_concurrent_clones", 2024-09-21T06:39:09.187 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.187 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.187 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.187 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "4", 2024-09-21T06:39:09.187 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.187 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.188 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.188 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:39:09.188 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.188 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.188 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.188 INFO:teuthology.orchestra.run.smithi063.stdout: "periodic_async_work": { 2024-09-21T06:39:09.188 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "periodic_async_work", 2024-09-21T06:39:09.188 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.188 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.188 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.188 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.188 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.188 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.189 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.189 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Periodically check for async work", 2024-09-21T06:39:09.189 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.189 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.189 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.189 INFO:teuthology.orchestra.run.smithi063.stdout: "snapshot_clone_delay": { 2024-09-21T06:39:09.189 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:39:09.189 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.189 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.189 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.189 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.189 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.189 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.190 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.190 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:39:09.190 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.190 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.190 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.190 INFO:teuthology.orchestra.run.smithi063.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:39:09.190 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:39:09.190 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.190 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.190 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.191 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.191 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.191 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.191 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.191 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:39:09.191 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.191 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.191 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.191 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.191 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.191 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.191 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.192 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.192 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.192 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.192 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.192 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.192 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.192 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.192 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.192 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.192 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.192 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.193 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix", 2024-09-21T06:39:09.193 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.193 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.193 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.193 INFO:teuthology.orchestra.run.smithi063.stdout: "discovery_interval": { 2024-09-21T06:39:09.193 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "discovery_interval", 2024-09-21T06:39:09.193 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-21T06:39:09.193 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.193 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.193 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "100", 2024-09-21T06:39:09.193 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.193 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.194 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.194 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.194 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.194 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.194 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.194 INFO:teuthology.orchestra.run.smithi063.stdout: "identifier": { 2024-09-21T06:39:09.194 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "identifier", 2024-09-21T06:39:09.194 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.194 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.194 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.194 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.194 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.195 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.195 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.195 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.195 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.195 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.195 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.195 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-21T06:39:09.195 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-21T06:39:09.195 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.195 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.195 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.195 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-21T06:39:09.195 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.196 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.196 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.196 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.196 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.196 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.196 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.196 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.196 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.196 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.196 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.196 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.197 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.197 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.197 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.197 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.197 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.197 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.197 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.197 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.197 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.197 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.197 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.197 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.197 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.197 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.198 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.198 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.198 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.198 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.198 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.198 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.198 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.198 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.198 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.198 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.198 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.199 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.199 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.199 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.199 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.199 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.199 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.199 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.199 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.199 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.199 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.199 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.199 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.199 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.200 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.200 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.200 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.200 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.200 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.200 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.200 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.200 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.200 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.200 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.200 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.200 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.200 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.201 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.201 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.201 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.201 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.201 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.201 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.201 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.201 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.201 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.201 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.201 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.201 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.201 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.202 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.202 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.202 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.202 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.202 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.202 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.202 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.202 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.202 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.202 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.202 INFO:teuthology.orchestra.run.smithi063.stdout: "zabbix_host": { 2024-09-21T06:39:09.202 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix_host", 2024-09-21T06:39:09.202 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.203 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.203 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.203 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.203 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.203 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.203 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.203 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.203 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.204 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.204 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.204 INFO:teuthology.orchestra.run.smithi063.stdout: "zabbix_port": { 2024-09-21T06:39:09.204 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix_port", 2024-09-21T06:39:09.204 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.204 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.204 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.204 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10051", 2024-09-21T06:39:09.204 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.204 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.204 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.205 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.205 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.205 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.205 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.205 INFO:teuthology.orchestra.run.smithi063.stdout: "zabbix_sender": { 2024-09-21T06:39:09.205 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix_sender", 2024-09-21T06:39:09.205 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.205 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.205 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.205 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:39:09.206 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.206 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.206 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.206 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.206 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.206 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.206 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.206 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.206 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.206 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.206 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-21T06:39:09.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.207 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 24176, 2024-09-21T06:39:09.207 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "y", 2024-09-21T06:39:09.207 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_features": 4540719139924082687, 2024-09-21T06:39:09.207 INFO:teuthology.orchestra.run.smithi063.stdout: "available_modules": [ 2024-09-21T06:39:09.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.207 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "alerts", 2024-09-21T06:39:09.207 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.207 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.208 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.208 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-21T06:39:09.208 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-21T06:39:09.208 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.208 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.208 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.208 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-21T06:39:09.208 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.208 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.208 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.208 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:39:09.208 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.208 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.209 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.209 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.209 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.209 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.209 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.209 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.209 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.209 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.210 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.210 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.210 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.210 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.210 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.210 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.210 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.210 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.210 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.210 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.210 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.210 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.211 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.211 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.211 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.211 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.211 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.211 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.211 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.211 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.211 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.212 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.212 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.212 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.212 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.212 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.212 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.212 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.212 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.212 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.213 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.213 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.213 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.213 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.213 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.213 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.213 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.213 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.213 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.213 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.213 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.214 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.214 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.214 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.214 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.214 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.214 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.214 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.214 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.215 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.215 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.215 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.215 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.215 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.215 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.215 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.215 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.215 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.215 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.215 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_destination": { 2024-09-21T06:39:09.215 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_destination", 2024-09-21T06:39:09.215 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.216 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.216 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.216 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.216 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.216 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.216 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.216 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:39:09.216 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.216 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.216 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.216 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_from_name": { 2024-09-21T06:39:09.216 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_from_name", 2024-09-21T06:39:09.216 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.217 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.217 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.217 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "Ceph", 2024-09-21T06:39:09.217 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.217 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.217 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.217 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Email From: name", 2024-09-21T06:39:09.217 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.217 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.218 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.218 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_host": { 2024-09-21T06:39:09.218 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_host", 2024-09-21T06:39:09.218 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.218 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.218 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.218 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.218 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.218 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.218 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.219 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SMTP server", 2024-09-21T06:39:09.219 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.219 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.219 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.219 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_password": { 2024-09-21T06:39:09.219 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_password", 2024-09-21T06:39:09.219 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.219 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.219 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.219 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.219 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.219 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.219 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.220 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Password to authenticate with", 2024-09-21T06:39:09.220 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.220 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.220 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.220 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_port": { 2024-09-21T06:39:09.220 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_port", 2024-09-21T06:39:09.220 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.220 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.220 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.220 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "465", 2024-09-21T06:39:09.220 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.220 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.220 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.221 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SMTP port", 2024-09-21T06:39:09.221 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.221 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.221 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.221 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_sender": { 2024-09-21T06:39:09.221 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_sender", 2024-09-21T06:39:09.221 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.221 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.221 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.221 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.221 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.221 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.222 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.222 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:39:09.222 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.222 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.222 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.222 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_ssl": { 2024-09-21T06:39:09.222 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_ssl", 2024-09-21T06:39:09.222 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.222 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.222 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.222 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.223 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.223 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.223 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.223 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:39:09.223 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.223 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.223 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.223 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_user": { 2024-09-21T06:39:09.223 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_user", 2024-09-21T06:39:09.223 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.223 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.223 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.223 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.224 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.224 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.224 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.224 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "User to authenticate as", 2024-09-21T06:39:09.224 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.224 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.224 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.224 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.224 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.224 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.224 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.224 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.225 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.225 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.225 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.225 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.225 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.225 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.225 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.225 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.225 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.225 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.225 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "balancer", 2024-09-21T06:39:09.225 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.226 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.226 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.226 INFO:teuthology.orchestra.run.smithi063.stdout: "active": { 2024-09-21T06:39:09.226 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "active", 2024-09-21T06:39:09.226 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.226 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.226 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.226 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.226 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.226 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.226 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.226 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:39:09.226 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.227 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.227 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.227 INFO:teuthology.orchestra.run.smithi063.stdout: "begin_time": { 2024-09-21T06:39:09.227 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "begin_time", 2024-09-21T06:39:09.227 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.227 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.227 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.227 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0000", 2024-09-21T06:39:09.227 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.227 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.227 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.227 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:39:09.227 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:39:09.228 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.228 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.228 INFO:teuthology.orchestra.run.smithi063.stdout: "begin_weekday": { 2024-09-21T06:39:09.228 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "begin_weekday", 2024-09-21T06:39:09.228 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-21T06:39:09.228 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.228 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.228 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.228 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "0", 2024-09-21T06:39:09.228 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "6", 2024-09-21T06:39:09.228 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.228 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:39:09.228 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:39:09.229 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.229 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.229 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_compat_max_iterations": { 2024-09-21T06:39:09.229 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:39:09.229 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-21T06:39:09.229 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.229 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.229 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "25", 2024-09-21T06:39:09.229 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-21T06:39:09.229 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "250", 2024-09-21T06:39:09.229 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.229 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:39:09.229 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.230 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.230 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.230 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_compat_metrics": { 2024-09-21T06:39:09.230 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crush_compat_metrics", 2024-09-21T06:39:09.230 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.230 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.230 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.230 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:39:09.230 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.230 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.230 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.230 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:39:09.231 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:39:09.231 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.231 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.231 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_compat_step": { 2024-09-21T06:39:09.231 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crush_compat_step", 2024-09-21T06:39:09.231 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:09.231 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.231 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.231 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0.5", 2024-09-21T06:39:09.231 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "0.001", 2024-09-21T06:39:09.231 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "0.999", 2024-09-21T06:39:09.231 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.231 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:39:09.232 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:39:09.232 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.232 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.232 INFO:teuthology.orchestra.run.smithi063.stdout: "end_time": { 2024-09-21T06:39:09.232 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "end_time", 2024-09-21T06:39:09.232 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.232 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.232 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.232 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "2359", 2024-09-21T06:39:09.232 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.232 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.232 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.233 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:39:09.233 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:39:09.233 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.233 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.233 INFO:teuthology.orchestra.run.smithi063.stdout: "end_weekday": { 2024-09-21T06:39:09.233 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "end_weekday", 2024-09-21T06:39:09.233 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-21T06:39:09.233 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.233 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.233 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.233 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "0", 2024-09-21T06:39:09.233 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "6", 2024-09-21T06:39:09.233 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.234 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:39:09.234 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:39:09.234 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.234 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.234 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.234 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.234 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.234 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.234 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.234 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.234 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.234 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.235 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.235 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.235 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.235 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.235 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.235 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.235 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.235 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.235 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.235 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.235 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.235 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.236 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.236 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.236 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.236 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.236 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.236 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.236 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.236 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.236 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.236 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.236 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.236 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.236 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.237 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.237 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.237 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.237 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.237 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.237 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.237 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.237 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.237 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.237 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.237 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.237 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.238 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.238 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.238 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.238 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.238 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.238 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.238 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.238 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.238 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.238 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.238 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.238 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.239 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.239 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.239 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.239 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.239 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.239 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.239 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.239 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.239 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.240 INFO:teuthology.orchestra.run.smithi063.stdout: "min_score": { 2024-09-21T06:39:09.240 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "min_score", 2024-09-21T06:39:09.240 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:09.240 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.240 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.240 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.240 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.240 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.240 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.240 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:39:09.240 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.241 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.241 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.241 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": { 2024-09-21T06:39:09.241 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mode", 2024-09-21T06:39:09.241 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.241 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.241 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.241 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "upmap", 2024-09-21T06:39:09.242 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.242 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.242 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.242 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-compat", 2024-09-21T06:39:09.242 INFO:teuthology.orchestra.run.smithi063.stdout: "none", 2024-09-21T06:39:09.242 INFO:teuthology.orchestra.run.smithi063.stdout: "read", 2024-09-21T06:39:09.242 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap", 2024-09-21T06:39:09.242 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap-read" 2024-09-21T06:39:09.242 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.242 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Balancer mode", 2024-09-21T06:39:09.242 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.242 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.243 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.243 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ids": { 2024-09-21T06:39:09.243 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pool_ids", 2024-09-21T06:39:09.243 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.243 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.243 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.243 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.243 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.243 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.244 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.244 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:39:09.244 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.244 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.244 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.244 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-21T06:39:09.244 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-21T06:39:09.244 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.244 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.244 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.244 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-21T06:39:09.244 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.245 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.245 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.245 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:39:09.245 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.245 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.245 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.245 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.245 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.245 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.246 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.246 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.246 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.246 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.246 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.246 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.246 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.246 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.246 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.246 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.247 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap_max_deviation": { 2024-09-21T06:39:09.247 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "upmap_max_deviation", 2024-09-21T06:39:09.247 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.247 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.247 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.247 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-21T06:39:09.247 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-21T06:39:09.247 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.247 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.247 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:39:09.248 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:39:09.248 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.248 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.249 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap_max_optimizations": { 2024-09-21T06:39:09.249 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:39:09.250 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-21T06:39:09.250 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.250 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.250 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:09.250 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.250 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.250 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.250 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:39:09.251 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.251 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.251 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.251 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.251 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.251 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephadm", 2024-09-21T06:39:09.251 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.251 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.252 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.252 INFO:teuthology.orchestra.run.smithi063.stdout: "agent_down_multiplier": { 2024-09-21T06:39:09.252 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "agent_down_multiplier", 2024-09-21T06:39:09.252 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:09.252 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.252 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.252 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3.0", 2024-09-21T06:39:09.252 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.252 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.252 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.253 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:39:09.253 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.253 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.253 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.253 INFO:teuthology.orchestra.run.smithi063.stdout: "agent_refresh_rate": { 2024-09-21T06:39:09.253 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "agent_refresh_rate", 2024-09-21T06:39:09.253 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.253 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.253 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.253 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "20", 2024-09-21T06:39:09.253 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.254 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.254 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.254 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:39:09.254 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.254 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.254 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.254 INFO:teuthology.orchestra.run.smithi063.stdout: "agent_starting_port": { 2024-09-21T06:39:09.254 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "agent_starting_port", 2024-09-21T06:39:09.254 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.254 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.254 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.254 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "4721", 2024-09-21T06:39:09.255 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.255 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.255 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.255 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:39:09.255 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.255 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.255 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.255 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_ptrace": { 2024-09-21T06:39:09.255 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "allow_ptrace", 2024-09-21T06:39:09.255 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.255 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.255 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.256 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.256 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.256 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.256 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.256 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:39:09.256 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:39:09.256 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.256 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.256 INFO:teuthology.orchestra.run.smithi063.stdout: "autotune_interval": { 2024-09-21T06:39:09.256 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "autotune_interval", 2024-09-21T06:39:09.256 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.257 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.257 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.257 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-21T06:39:09.257 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.257 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.257 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.257 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:39:09.257 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.257 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.257 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.257 INFO:teuthology.orchestra.run.smithi063.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:39:09.257 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:39:09.258 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:09.258 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.258 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.258 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0.7", 2024-09-21T06:39:09.258 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.258 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.258 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.258 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:39:09.258 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.258 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.258 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.258 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm_log_destination": { 2024-09-21T06:39:09.259 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephadm_log_destination", 2024-09-21T06:39:09.259 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.259 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.259 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.259 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.259 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.259 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.259 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.259 INFO:teuthology.orchestra.run.smithi063.stdout: "file", 2024-09-21T06:39:09.259 INFO:teuthology.orchestra.run.smithi063.stdout: "file,syslog", 2024-09-21T06:39:09.259 INFO:teuthology.orchestra.run.smithi063.stdout: "syslog" 2024-09-21T06:39:09.259 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.259 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:39:09.259 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.260 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.260 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.260 INFO:teuthology.orchestra.run.smithi063.stdout: "cgroups_split": { 2024-09-21T06:39:09.260 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cgroups_split", 2024-09-21T06:39:09.260 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.260 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.260 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.260 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.260 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.260 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.260 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.260 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:39:09.260 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.261 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.261 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.261 INFO:teuthology.orchestra.run.smithi063.stdout: "config_checks_enabled": { 2024-09-21T06:39:09.261 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "config_checks_enabled", 2024-09-21T06:39:09.261 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.261 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.261 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.261 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.261 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.261 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.261 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.261 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:39:09.262 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.262 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.262 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.262 INFO:teuthology.orchestra.run.smithi063.stdout: "config_dashboard": { 2024-09-21T06:39:09.262 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "config_dashboard", 2024-09-21T06:39:09.262 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.262 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.262 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.262 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.262 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.262 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.262 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.263 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:39:09.263 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.263 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.263 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.263 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_alertmanager": { 2024-09-21T06:39:09.263 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_alertmanager", 2024-09-21T06:39:09.263 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.263 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.263 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.263 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:39:09.263 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.263 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.263 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.264 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-21T06:39:09.264 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.264 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.264 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.264 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_base": { 2024-09-21T06:39:09.264 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_base", 2024-09-21T06:39:09.264 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.264 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.264 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.264 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:39:09.264 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.264 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.264 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:39:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_elasticsearch": { 2024-09-21T06:39:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:39:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:39:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "elasticsearch container image", 2024-09-21T06:39:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_grafana": { 2024-09-21T06:39:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_grafana", 2024-09-21T06:39:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:39:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-21T06:39:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_haproxy": { 2024-09-21T06:39:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_haproxy", 2024-09-21T06:39:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:39:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "HAproxy container image", 2024-09-21T06:39:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_jaeger_agent": { 2024-09-21T06:39:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:39:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:39:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:39:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_jaeger_collector": { 2024-09-21T06:39:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:39:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:39:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:39:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_jaeger_query": { 2024-09-21T06:39:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:39:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:39:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Jaeger query container image", 2024-09-21T06:39:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_keepalived": { 2024-09-21T06:39:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_keepalived", 2024-09-21T06:39:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:39:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Keepalived container image", 2024-09-21T06:39:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_loki": { 2024-09-21T06:39:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_loki", 2024-09-21T06:39:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:39:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Loki container image", 2024-09-21T06:39:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_nginx": { 2024-09-21T06:39:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_nginx", 2024-09-21T06:39:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:39:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Nginx container image", 2024-09-21T06:39:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_node_exporter": { 2024-09-21T06:39:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_node_exporter", 2024-09-21T06:39:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:39:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-21T06:39:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_nvmeof": { 2024-09-21T06:39:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_nvmeof", 2024-09-21T06:39:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:39:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Nvme-of container image", 2024-09-21T06:39:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:39:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:39:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:39:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:39:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_prometheus": { 2024-09-21T06:39:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_prometheus", 2024-09-21T06:39:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:39:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-21T06:39:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_promtail": { 2024-09-21T06:39:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_promtail", 2024-09-21T06:39:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:39:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Promtail container image", 2024-09-21T06:39:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_samba": { 2024-09-21T06:39:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_samba", 2024-09-21T06:39:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:39:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:39:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_samba_metrics": { 2024-09-21T06:39:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:39:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:39:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:39:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.284 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.284 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.284 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_snmp_gateway": { 2024-09-21T06:39:09.284 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:39:09.284 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.284 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.284 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:39:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:39:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "container_init": { 2024-09-21T06:39:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_init", 2024-09-21T06:39:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:39:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "daemon_cache_timeout": { 2024-09-21T06:39:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:39:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-21T06:39:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:39:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:39:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:39:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "900", 2024-09-21T06:39:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:39:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "default_registry": { 2024-09-21T06:39:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "default_registry", 2024-09-21T06:39:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io", 2024-09-21T06:39:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:39:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "device_cache_timeout": { 2024-09-21T06:39:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_cache_timeout", 2024-09-21T06:39:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "1800", 2024-09-21T06:39:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:39:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "device_enhanced_scan": { 2024-09-21T06:39:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_enhanced_scan", 2024-09-21T06:39:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:39:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "facts_cache_timeout": { 2024-09-21T06:39:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "facts_cache_timeout", 2024-09-21T06:39:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-21T06:39:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:39:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "grafana_dashboards_path": { 2024-09-21T06:39:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:39:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:39:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:39:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "host_check_interval": { 2024-09-21T06:39:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "host_check_interval", 2024-09-21T06:39:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-21T06:39:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:39:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "hw_monitoring": { 2024-09-21T06:39:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "hw_monitoring", 2024-09-21T06:39:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:39:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "inventory_list_all": { 2024-09-21T06:39:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "inventory_list_all", 2024-09-21T06:39:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:39:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: "log_refresh_metadata": { 2024-09-21T06:39:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_refresh_metadata", 2024-09-21T06:39:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:39:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:39:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:39:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:39:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:39:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:39:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:39:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "*", 2024-09-21T06:39:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:39:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "max_count_per_host": { 2024-09-21T06:39:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_count_per_host", 2024-09-21T06:39:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:39:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd_draining_count": { 2024-09-21T06:39:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_osd_draining_count", 2024-09-21T06:39:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:39:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "migration_current": { 2024-09-21T06:39:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "migration_current", 2024-09-21T06:39:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "internal - do not modify", 2024-09-21T06:39:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": { 2024-09-21T06:39:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mode", 2024-09-21T06:39:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "root", 2024-09-21T06:39:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm-package", 2024-09-21T06:39:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "root" 2024-09-21T06:39:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:39:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "oob_default_addr": { 2024-09-21T06:39:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "oob_default_addr", 2024-09-21T06:39:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "169.254.1.1", 2024-09-21T06:39:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:39:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "prometheus_alerts_path": { 2024-09-21T06:39:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:39:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:39:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:39:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_insecure": { 2024-09-21T06:39:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_insecure", 2024-09-21T06:39:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:39:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_password": { 2024-09-21T06:39:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_password", 2024-09-21T06:39:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:39:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_url": { 2024-09-21T06:39:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_url", 2024-09-21T06:39:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:39:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_username": { 2024-09-21T06:39:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_username", 2024-09-21T06:39:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:39:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: "secure_monitoring_stack": { 2024-09-21T06:39:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:39:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:39:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "service_discovery_port": { 2024-09-21T06:39:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "service_discovery_port", 2024-09-21T06:39:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8765", 2024-09-21T06:39:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:39:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "ssh_config_file": { 2024-09-21T06:39:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssh_config_file", 2024-09-21T06:39:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:39:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:39:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:39:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3", 2024-09-21T06:39:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:39:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "ssh_keepalive_interval": { 2024-09-21T06:39:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:39:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "7", 2024-09-21T06:39:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:39:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "use_agent": { 2024-09-21T06:39:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "use_agent", 2024-09-21T06:39:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:39:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "use_repo_digest": { 2024-09-21T06:39:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "use_repo_digest", 2024-09-21T06:39:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:39:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_on_failed_host_check": { 2024-09-21T06:39:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:39:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:39:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_on_stray_daemons": { 2024-09-21T06:39:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:39:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:39:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_on_stray_hosts": { 2024-09-21T06:39:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:39:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:39:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crash", 2024-09-21T06:39:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "retain_interval": { 2024-09-21T06:39:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "retain_interval", 2024-09-21T06:39:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "31536000", 2024-09-21T06:39:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:39:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_recent_interval": { 2024-09-21T06:39:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_recent_interval", 2024-09-21T06:39:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "1209600", 2024-09-21T06:39:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:39:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "dashboard", 2024-09-21T06:39:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:39:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:39:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:39:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:39:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:39:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:39:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:39:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:39:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:39:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:39:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:39:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:39:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:39:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:39:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:39:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:39:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:39:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:39:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:39:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:39:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:39:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:39:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:39:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:39:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:39:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:39:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:39:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:39:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:39:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:39:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "admin", 2024-09-21T06:39:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.360 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.360 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:39:09.360 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:39:09.360 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.360 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.360 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.360 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.360 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.360 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.360 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.360 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_URL": { 2024-09-21T06:39:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:39:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:39:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:39:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "admin", 2024-09-21T06:39:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:39:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:39:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:39:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:39:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:39:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:39:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:39:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:39:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:39:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:39:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "[]", 2024-09-21T06:39:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:39:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:39:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "{}", 2024-09-21T06:39:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:39:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:39:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:39:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:39:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:39:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:39:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:39:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:39:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:39:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:39:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:39:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:39:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:39:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:39:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:39:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:39:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:39:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:39:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:39:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:39:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:39:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:39:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:39:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:39:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:39:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:39:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:39:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8", 2024-09-21T06:39:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:39:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:39:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "45", 2024-09-21T06:39:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:39:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:39:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:39:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:39:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "admin", 2024-09-21T06:39:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:39:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:39:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:39:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:39:09.391 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.391 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.391 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.391 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.391 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.391 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.391 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.391 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.391 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.391 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.391 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.391 INFO:teuthology.orchestra.run.smithi063.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:39:09.392 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:39:09.392 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.392 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.392 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.392 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.392 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.392 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.392 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.392 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.392 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.392 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.392 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.393 INFO:teuthology.orchestra.run.smithi063.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:39:09.393 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:39:09.393 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.393 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.393 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.393 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.393 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.393 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.393 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.393 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.393 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.393 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.393 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.394 INFO:teuthology.orchestra.run.smithi063.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:39:09.394 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:39:09.394 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.394 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.394 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.394 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:09.394 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.394 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.394 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.394 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.394 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.394 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.394 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.395 INFO:teuthology.orchestra.run.smithi063.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:39:09.395 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:39:09.395 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.395 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.395 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.395 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-21T06:39:09.395 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.395 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.395 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.395 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.395 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.395 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.396 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.396 INFO:teuthology.orchestra.run.smithi063.stdout: "cross_origin_url": { 2024-09-21T06:39:09.396 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cross_origin_url", 2024-09-21T06:39:09.396 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.396 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.396 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.396 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.396 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.396 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.396 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.396 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.396 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.396 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.397 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.397 INFO:teuthology.orchestra.run.smithi063.stdout: "crt_file": { 2024-09-21T06:39:09.397 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crt_file", 2024-09-21T06:39:09.397 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.397 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.397 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.397 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.397 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.397 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.397 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.397 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.397 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.397 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.398 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.398 INFO:teuthology.orchestra.run.smithi063.stdout: "debug": { 2024-09-21T06:39:09.398 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "debug", 2024-09-21T06:39:09.398 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.398 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.398 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.398 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.398 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.398 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.398 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.398 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:39:09.398 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.398 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.399 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.399 INFO:teuthology.orchestra.run.smithi063.stdout: "jwt_token_ttl": { 2024-09-21T06:39:09.399 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "jwt_token_ttl", 2024-09-21T06:39:09.399 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.399 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.399 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.399 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "28800", 2024-09-21T06:39:09.399 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.399 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.399 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.399 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.400 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.400 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.400 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.400 INFO:teuthology.orchestra.run.smithi063.stdout: "key_file": { 2024-09-21T06:39:09.400 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "key_file", 2024-09-21T06:39:09.400 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.400 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.400 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.400 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.400 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.400 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.400 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.400 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.401 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.402 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.403 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.404 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.405 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: "motd": { 2024-09-21T06:39:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "motd", 2024-09-21T06:39:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.406 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.407 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.407 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.407 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.407 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "The message of the day", 2024-09-21T06:39:09.407 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.407 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.407 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.407 INFO:teuthology.orchestra.run.smithi063.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:39:09.408 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:39:09.408 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.408 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.408 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.408 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.408 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.408 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.408 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.408 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.408 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.408 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.408 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.408 INFO:teuthology.orchestra.run.smithi063.stdout: "server_addr": { 2024-09-21T06:39:09.409 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_addr", 2024-09-21T06:39:09.409 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.409 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.409 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.409 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "::", 2024-09-21T06:39:09.409 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.409 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.409 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.409 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.409 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.410 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.410 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.410 INFO:teuthology.orchestra.run.smithi063.stdout: "server_port": { 2024-09-21T06:39:09.410 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_port", 2024-09-21T06:39:09.410 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.410 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.410 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.410 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8080", 2024-09-21T06:39:09.410 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.410 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.411 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.411 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.411 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.411 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.411 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.411 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.411 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.411 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.411 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.412 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.412 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.412 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.412 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.412 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.412 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.412 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.412 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.412 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.412 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.412 INFO:teuthology.orchestra.run.smithi063.stdout: "ssl": { 2024-09-21T06:39:09.412 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssl", 2024-09-21T06:39:09.413 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.413 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.413 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.413 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.413 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.413 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.413 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.413 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.413 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.413 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.414 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.414 INFO:teuthology.orchestra.run.smithi063.stdout: "ssl_server_port": { 2024-09-21T06:39:09.414 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssl_server_port", 2024-09-21T06:39:09.414 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.414 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.414 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.414 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8443", 2024-09-21T06:39:09.414 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.414 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.414 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.414 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.415 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.415 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.415 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.415 INFO:teuthology.orchestra.run.smithi063.stdout: "sso_oauth2": { 2024-09-21T06:39:09.415 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sso_oauth2", 2024-09-21T06:39:09.416 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.416 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.416 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.416 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.416 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.416 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.416 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.416 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.416 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.417 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.417 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.417 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_behaviour": { 2024-09-21T06:39:09.417 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_behaviour", 2024-09-21T06:39:09.417 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.417 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.417 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.417 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "redirect", 2024-09-21T06:39:09.417 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.418 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.418 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.418 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.418 INFO:teuthology.orchestra.run.smithi063.stdout: "redirect" 2024-09-21T06:39:09.418 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.418 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.418 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.418 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.419 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.419 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_error_status_code": { 2024-09-21T06:39:09.419 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_error_status_code", 2024-09-21T06:39:09.419 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.419 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.419 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.419 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "500", 2024-09-21T06:39:09.419 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "400", 2024-09-21T06:39:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "599", 2024-09-21T06:39:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: "url_prefix": { 2024-09-21T06:39:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "url_prefix", 2024-09-21T06:39:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "devicehealth", 2024-09-21T06:39:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.422 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.422 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.422 INFO:teuthology.orchestra.run.smithi063.stdout: "enable_monitoring": { 2024-09-21T06:39:09.422 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enable_monitoring", 2024-09-21T06:39:09.422 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.422 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.422 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.422 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.422 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.422 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.422 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.422 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "monitor device health metrics", 2024-09-21T06:39:09.422 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.423 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.423 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.423 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.423 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.423 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.423 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.423 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.423 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.423 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.423 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.423 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.423 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.423 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.424 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.424 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.424 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.424 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.424 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.424 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.424 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.424 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.424 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.424 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.424 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.424 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.424 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.425 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.425 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.425 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.425 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.425 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.425 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.425 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.425 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.425 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.425 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.425 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.425 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.425 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.426 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.426 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.426 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.426 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.426 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.426 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.426 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.426 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.426 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.426 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.426 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.426 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.426 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.427 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.427 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.427 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.427 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.427 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.427 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.427 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.427 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.427 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.427 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.427 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.427 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.427 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.428 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.428 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.428 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.428 INFO:teuthology.orchestra.run.smithi063.stdout: "mark_out_threshold": { 2024-09-21T06:39:09.428 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mark_out_threshold", 2024-09-21T06:39:09.428 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.428 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.428 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.428 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "2419200", 2024-09-21T06:39:09.428 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.428 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.428 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.428 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:39:09.429 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.429 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.429 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.429 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": { 2024-09-21T06:39:09.429 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pool_name", 2024-09-21T06:39:09.429 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.429 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.429 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.429 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "device_health_metrics", 2024-09-21T06:39:09.429 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.429 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.430 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.430 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:39:09.430 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.430 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.430 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.430 INFO:teuthology.orchestra.run.smithi063.stdout: "retention_period": { 2024-09-21T06:39:09.430 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "retention_period", 2024-09-21T06:39:09.430 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.430 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.430 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.430 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "15552000", 2024-09-21T06:39:09.430 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.431 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.431 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.431 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:39:09.431 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.431 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.431 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.431 INFO:teuthology.orchestra.run.smithi063.stdout: "scrape_frequency": { 2024-09-21T06:39:09.431 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "scrape_frequency", 2024-09-21T06:39:09.431 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.431 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.431 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.431 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "86400", 2024-09-21T06:39:09.432 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.432 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.432 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.432 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:39:09.432 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.432 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.432 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.432 INFO:teuthology.orchestra.run.smithi063.stdout: "self_heal": { 2024-09-21T06:39:09.432 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "self_heal", 2024-09-21T06:39:09.432 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.432 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.432 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.433 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.433 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.433 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.433 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.433 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:39:09.433 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.433 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.433 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.433 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-21T06:39:09.433 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-21T06:39:09.433 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.433 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.433 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.434 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-21T06:39:09.434 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.434 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.434 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.434 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:39:09.434 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.434 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.434 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.434 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.434 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.434 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.435 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.435 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.435 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.435 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.435 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.435 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.435 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.435 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.435 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.435 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.435 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_threshold": { 2024-09-21T06:39:09.435 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_threshold", 2024-09-21T06:39:09.436 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.436 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.436 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.436 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "7257600", 2024-09-21T06:39:09.436 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.436 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.436 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.436 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:39:09.436 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.436 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.436 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.436 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.436 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.437 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "diskprediction_local", 2024-09-21T06:39:09.437 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.437 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.437 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.437 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.437 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.437 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.437 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.437 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.437 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.437 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.437 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.438 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.438 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.438 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.438 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.438 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.438 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.438 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.438 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.438 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.438 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.438 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.438 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.438 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.439 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.439 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.439 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.439 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.439 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.439 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.439 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.439 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.439 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.439 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.439 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.440 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.440 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.440 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.440 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.440 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.440 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.440 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.440 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.440 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.441 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.441 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.441 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.441 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.441 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.441 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.441 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.441 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.441 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.441 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.441 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.441 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.442 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.442 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.442 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.442 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.442 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.442 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.442 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.442 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.442 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.443 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.443 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.443 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.443 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.443 INFO:teuthology.orchestra.run.smithi063.stdout: "predict_interval": { 2024-09-21T06:39:09.443 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "predict_interval", 2024-09-21T06:39:09.443 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.443 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.443 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.443 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "86400", 2024-09-21T06:39:09.443 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.444 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.444 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.444 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.444 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.444 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.444 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.444 INFO:teuthology.orchestra.run.smithi063.stdout: "predictor_model": { 2024-09-21T06:39:09.444 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "predictor_model", 2024-09-21T06:39:09.444 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.445 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.445 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.445 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "prophetstor", 2024-09-21T06:39:09.445 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.445 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.445 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.445 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.445 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.445 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.445 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.445 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-21T06:39:09.445 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-21T06:39:09.446 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.446 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.446 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.446 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-21T06:39:09.446 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.446 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.446 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.446 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.446 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.446 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.446 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.446 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.447 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.447 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.447 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.447 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.447 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.447 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.447 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.447 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.447 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.447 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.447 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.447 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.447 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.447 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.448 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "influx", 2024-09-21T06:39:09.448 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": false, 2024-09-21T06:39:09.448 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:39:09.448 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.448 INFO:teuthology.orchestra.run.smithi063.stdout: "batch_size": { 2024-09-21T06:39:09.448 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "batch_size", 2024-09-21T06:39:09.448 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.449 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.449 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.449 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5000", 2024-09-21T06:39:09.449 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.449 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.449 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.449 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:39:09.449 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.449 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.449 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.450 INFO:teuthology.orchestra.run.smithi063.stdout: "database": { 2024-09-21T06:39:09.450 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "database", 2024-09-21T06:39:09.450 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.450 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.450 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.450 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "ceph", 2024-09-21T06:39:09.450 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.450 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.450 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.451 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:39:09.451 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.451 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.451 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.451 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": { 2024-09-21T06:39:09.451 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "hostname", 2024-09-21T06:39:09.451 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.451 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.451 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.452 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.452 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.452 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.452 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.452 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:39:09.452 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.452 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.452 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.452 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-21T06:39:09.453 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-21T06:39:09.453 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.453 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.453 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.453 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "30", 2024-09-21T06:39:09.453 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "5", 2024-09-21T06:39:09.453 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.453 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.454 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:39:09.454 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.454 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.454 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.454 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.454 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.454 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.454 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.454 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.455 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.455 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.455 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.455 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.455 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.455 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.455 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.455 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.455 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.455 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.455 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.455 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.455 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.456 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.456 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.456 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.456 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.456 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.456 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.456 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.456 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.456 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.456 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.456 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.456 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.456 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.457 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.457 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.457 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.457 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.457 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.457 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.457 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.457 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.457 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.457 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.457 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.457 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.457 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.458 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.458 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.458 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.458 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.458 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.458 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.458 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.458 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.458 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.458 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.458 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.458 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.459 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.459 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.459 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.459 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.459 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.459 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.459 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.459 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.459 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.459 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.459 INFO:teuthology.orchestra.run.smithi063.stdout: "password": { 2024-09-21T06:39:09.459 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "password", 2024-09-21T06:39:09.460 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.460 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.460 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.460 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.460 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.460 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.460 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.460 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:39:09.460 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.460 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.460 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.460 INFO:teuthology.orchestra.run.smithi063.stdout: "port": { 2024-09-21T06:39:09.460 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "port", 2024-09-21T06:39:09.461 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.461 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.461 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.461 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8086", 2024-09-21T06:39:09.461 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.461 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.461 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.461 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "InfluxDB server port", 2024-09-21T06:39:09.461 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.461 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.461 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.461 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.461 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.461 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.462 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.462 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.462 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.462 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.462 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.462 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.462 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.462 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.462 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.462 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.462 INFO:teuthology.orchestra.run.smithi063.stdout: "ssl": { 2024-09-21T06:39:09.463 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssl", 2024-09-21T06:39:09.463 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.463 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.463 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.463 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "false", 2024-09-21T06:39:09.463 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.463 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.463 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.463 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:39:09.463 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.463 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.463 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.464 INFO:teuthology.orchestra.run.smithi063.stdout: "threads": { 2024-09-21T06:39:09.464 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "threads", 2024-09-21T06:39:09.464 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.464 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.464 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.464 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-21T06:39:09.464 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-21T06:39:09.464 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "32", 2024-09-21T06:39:09.464 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.464 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:39:09.464 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.464 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.464 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "username": { 2024-09-21T06:39:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "username", 2024-09-21T06:39:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:39:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "verify_ssl": { 2024-09-21T06:39:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "verify_ssl", 2024-09-21T06:39:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "true", 2024-09-21T06:39:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:39:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.466 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.467 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.467 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.467 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "insights", 2024-09-21T06:39:09.467 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.467 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.467 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.467 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.467 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.467 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.467 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.467 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.468 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.468 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.468 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.468 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.468 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.468 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.468 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.468 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.468 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.468 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.468 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.468 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.468 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.468 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.469 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.469 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.469 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.469 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.469 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.469 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.469 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.469 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.469 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.469 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.469 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.469 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.470 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.470 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.470 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.470 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.470 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.470 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.470 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.470 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.470 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.470 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.470 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.470 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.471 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.471 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.471 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.471 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.471 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.471 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.471 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.471 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.471 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.471 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.471 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.471 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.472 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.472 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.472 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.472 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.472 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.472 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.472 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.472 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.472 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.472 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.472 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.472 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.472 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.473 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.473 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.473 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.473 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.473 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.473 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.473 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.473 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.473 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.473 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.473 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.473 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.473 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "iostat", 2024-09-21T06:39:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "k8sevents", 2024-09-21T06:39:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_event_retention_days": { 2024-09-21T06:39:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:39:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "7", 2024-09-21T06:39:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:39:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "config_check_secs": { 2024-09-21T06:39:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "config_check_secs", 2024-09-21T06:39:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "10", 2024-09-21T06:39:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:39:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.485 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.485 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.485 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.485 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.485 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.485 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.485 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.485 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.485 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.486 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.486 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.486 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.486 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.486 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.486 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.486 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.486 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.486 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.486 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.486 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.487 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.487 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.487 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.487 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.487 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.487 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.487 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.487 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.488 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.488 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.488 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.488 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.488 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.488 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.488 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.488 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.489 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.489 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.489 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.489 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.489 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.489 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.489 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.489 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.489 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.489 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.489 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.489 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.489 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.490 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.490 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.490 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.490 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.490 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.490 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.490 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.490 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.490 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.490 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.490 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.490 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.490 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.491 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.491 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.491 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.491 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.491 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.491 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.491 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.491 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.491 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.491 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.491 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.491 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.492 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.492 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.492 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.492 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.492 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.492 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.492 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.492 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "localpool", 2024-09-21T06:39:09.492 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.492 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.492 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.492 INFO:teuthology.orchestra.run.smithi063.stdout: "failure_domain": { 2024-09-21T06:39:09.493 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "failure_domain", 2024-09-21T06:39:09.493 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.493 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.493 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.493 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "host", 2024-09-21T06:39:09.493 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.493 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.493 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.493 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:39:09.493 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:39:09.493 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.493 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.494 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.494 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.494 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.494 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.494 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.494 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.494 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.494 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.494 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.494 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.494 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.494 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.494 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.495 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.495 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.495 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.495 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.495 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.495 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.495 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.495 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.495 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.495 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.495 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.495 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.496 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.496 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.496 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.496 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.496 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.496 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.496 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.496 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.496 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.496 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.496 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.496 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.497 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.497 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.497 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.497 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.497 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.497 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.497 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.497 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.497 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.497 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.497 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.497 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.497 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.498 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.498 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.498 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.498 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.498 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.498 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.498 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.498 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.498 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.498 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.498 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.499 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.499 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.499 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.499 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.499 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.499 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": { 2024-09-21T06:39:09.499 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "min_size", 2024-09-21T06:39:09.499 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.499 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.499 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.499 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.499 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.499 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.500 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.500 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:39:09.500 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:39:09.500 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.500 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.500 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rep": { 2024-09-21T06:39:09.500 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "num_rep", 2024-09-21T06:39:09.500 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.500 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.500 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.500 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3", 2024-09-21T06:39:09.500 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.501 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.501 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.501 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:39:09.501 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.501 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.501 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.501 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": { 2024-09-21T06:39:09.501 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pg_num", 2024-09-21T06:39:09.501 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.501 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.501 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.501 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "128", 2024-09-21T06:39:09.501 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.501 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.502 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.502 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:39:09.502 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.502 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.502 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.502 INFO:teuthology.orchestra.run.smithi063.stdout: "prefix": { 2024-09-21T06:39:09.502 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "prefix", 2024-09-21T06:39:09.502 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.502 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.502 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.502 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.502 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.503 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.503 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.503 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:39:09.503 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.503 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.503 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.503 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.503 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.503 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.503 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.503 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.503 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.504 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.504 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.504 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.504 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.504 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.504 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.504 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.504 INFO:teuthology.orchestra.run.smithi063.stdout: "subtree": { 2024-09-21T06:39:09.504 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "subtree", 2024-09-21T06:39:09.504 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.504 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.504 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.504 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "rack", 2024-09-21T06:39:09.505 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.505 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.505 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.505 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:39:09.505 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:39:09.505 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.505 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.505 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.505 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.505 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mds_autoscaler", 2024-09-21T06:39:09.505 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.505 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.506 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.506 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.506 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.506 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.506 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.506 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.506 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.506 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.506 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.506 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.506 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.506 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.506 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.507 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.507 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.507 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.507 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.507 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.507 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.507 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.507 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.507 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.507 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.507 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.508 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.508 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.508 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.508 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.508 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.508 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.508 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.508 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.508 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.508 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.508 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.508 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.508 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.509 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.509 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.509 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.509 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.509 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.509 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.509 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.509 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.509 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.510 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.510 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.510 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.510 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.510 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.510 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.510 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.510 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.510 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.510 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.511 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.511 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.511 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.511 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.511 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.511 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.511 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.511 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.511 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.511 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.511 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.512 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.512 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.512 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.512 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.512 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.512 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.512 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.512 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.512 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.512 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.512 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.513 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.513 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.513 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.513 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.513 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mirroring", 2024-09-21T06:39:09.513 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.513 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.514 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.514 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.514 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.514 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.514 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.514 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.514 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.514 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.514 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.514 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.514 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.515 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.515 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.515 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.515 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.515 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.515 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.515 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.515 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.515 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.515 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.516 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.516 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.516 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.516 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.516 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.516 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.516 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.516 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.516 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.516 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.516 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.516 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.517 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.517 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.517 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.517 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.517 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.517 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.517 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.517 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.517 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.518 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.518 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.518 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.518 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.518 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.518 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.518 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.518 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.518 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.518 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.518 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.518 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.519 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.519 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.519 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.519 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.519 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.519 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.519 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.519 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.519 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.519 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.519 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.519 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.519 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.520 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.520 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.520 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.520 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.520 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.520 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.520 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.520 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.520 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.520 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.520 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.520 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.520 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.521 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.521 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.521 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "nfs", 2024-09-21T06:39:09.521 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.521 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.521 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.522 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.522 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.522 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.522 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.522 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.522 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.522 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.522 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.522 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.523 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.523 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.523 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.523 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.523 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.523 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.523 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.523 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.524 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.524 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.524 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.524 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.524 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.524 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.524 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.524 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.524 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.525 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.525 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.525 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.525 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.525 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.525 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.525 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.525 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.525 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.525 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.525 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.525 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.526 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.526 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.526 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.526 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.526 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.526 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.526 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.526 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.526 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.526 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.526 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.526 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.526 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.526 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.527 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.527 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.527 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.527 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.527 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.527 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.527 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.527 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.527 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.527 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.527 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.528 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.528 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.528 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.528 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.528 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.528 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.528 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.528 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.528 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.528 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.528 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.528 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.529 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.529 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.529 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.529 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.529 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.529 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.529 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "orchestrator", 2024-09-21T06:39:09.529 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.529 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.529 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.529 INFO:teuthology.orchestra.run.smithi063.stdout: "fail_fs": { 2024-09-21T06:39:09.530 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "fail_fs", 2024-09-21T06:39:09.530 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.530 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.530 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.530 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.530 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.530 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.530 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.530 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:39:09.530 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.530 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.530 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.531 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.531 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.531 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.531 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.531 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.531 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.531 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.531 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.531 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.531 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.531 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.531 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.531 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.531 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.532 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.532 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.532 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.532 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.532 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.532 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.532 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.532 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.532 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.532 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.532 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.532 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.533 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.533 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.533 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.533 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.533 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.533 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.533 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.533 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.533 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.533 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.533 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.533 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.533 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.534 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.534 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.534 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.534 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.534 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.534 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.534 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.534 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.534 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.534 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.534 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.534 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.535 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.535 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.535 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.535 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.535 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.535 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.535 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.535 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.535 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.535 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.535 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.535 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.535 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.536 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.536 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.536 INFO:teuthology.orchestra.run.smithi063.stdout: "orchestrator": { 2024-09-21T06:39:09.536 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "orchestrator", 2024-09-21T06:39:09.536 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.536 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.536 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.536 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.536 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.536 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.536 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.536 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm", 2024-09-21T06:39:09.536 INFO:teuthology.orchestra.run.smithi063.stdout: "rook", 2024-09-21T06:39:09.537 INFO:teuthology.orchestra.run.smithi063.stdout: "test_orchestrator" 2024-09-21T06:39:09.537 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.537 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Orchestrator backend", 2024-09-21T06:39:09.537 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.537 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.537 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.537 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.537 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.537 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.537 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.537 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.537 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.538 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.538 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.538 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.538 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.538 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.538 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.538 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.538 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.538 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.538 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "osd_perf_query", 2024-09-21T06:39:09.538 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.538 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.539 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.539 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.539 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.539 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.539 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.539 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.539 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.539 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.539 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.539 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.539 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.539 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.539 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.540 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.540 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.540 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.540 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.540 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.540 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.540 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.540 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.540 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.540 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.540 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.540 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.541 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.541 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.541 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.541 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.541 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.541 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.541 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.541 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.541 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.541 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.541 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.541 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.541 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.542 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.542 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.542 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.542 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.542 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.542 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.542 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.542 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.542 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.542 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.542 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.542 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.542 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.543 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.543 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.543 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.543 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.543 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.543 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.543 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.543 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.543 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.543 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.543 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.543 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.544 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.544 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.544 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.544 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.544 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.544 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.544 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.544 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.544 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.544 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.544 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.545 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.545 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.545 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.545 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.545 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.545 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.545 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.545 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.546 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "osd_support", 2024-09-21T06:39:09.546 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.546 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.546 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.546 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.546 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.546 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.546 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.546 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.546 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.546 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.546 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.547 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.547 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.547 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.547 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.547 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.547 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.547 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.547 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.547 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.548 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.548 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.548 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.548 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.548 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.548 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.548 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.548 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.548 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.548 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.548 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.548 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.548 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.549 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.549 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.549 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.549 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.549 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.549 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.549 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.549 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.549 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.550 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.550 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.550 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.550 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.550 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.550 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.550 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.550 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.550 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.550 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.550 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.550 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.551 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.551 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.551 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.551 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.551 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.551 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.551 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.551 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.551 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.552 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.552 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.552 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.552 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.552 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.552 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.552 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.552 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.552 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.552 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.553 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.553 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.553 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.553 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.553 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.553 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.553 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.553 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.553 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.553 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.554 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.554 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pg_autoscaler", 2024-09-21T06:39:09.554 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.554 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.554 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.554 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.554 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.554 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.555 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.555 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.555 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.555 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.555 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.555 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.555 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.555 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.556 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.556 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.556 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.556 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.556 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.556 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.556 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.556 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.556 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.557 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.557 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.557 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.557 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.557 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.557 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.557 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.557 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.557 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.557 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.558 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.558 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.558 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.558 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.558 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.558 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.558 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.558 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.558 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.558 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.558 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.558 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.559 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.559 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.559 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.559 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.559 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.559 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.559 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.559 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.559 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.559 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.559 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.559 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.559 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.560 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.560 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.560 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.560 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.560 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.560 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.560 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.560 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.560 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.560 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.560 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.560 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-21T06:39:09.561 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-21T06:39:09.561 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.561 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.561 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.561 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-21T06:39:09.561 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.561 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.561 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.561 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.561 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.561 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.561 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.561 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.562 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.562 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.562 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.562 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.562 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.562 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.562 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.562 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.562 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.562 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.562 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.562 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.563 INFO:teuthology.orchestra.run.smithi063.stdout: "threshold": { 2024-09-21T06:39:09.563 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "threshold", 2024-09-21T06:39:09.563 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:09.563 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.563 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.563 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3.0", 2024-09-21T06:39:09.563 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1.0", 2024-09-21T06:39:09.563 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.563 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.563 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "scaling threshold", 2024-09-21T06:39:09.563 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:39:09.563 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.563 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.563 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.564 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.564 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "progress", 2024-09-21T06:39:09.564 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.564 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.564 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.564 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_pg_recovery_event": { 2024-09-21T06:39:09.564 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:39:09.564 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.564 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.564 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.564 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.565 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.565 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.565 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.565 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:39:09.565 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.565 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.565 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.565 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": { 2024-09-21T06:39:09.565 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enabled", 2024-09-21T06:39:09.565 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.565 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.565 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.566 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.566 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.566 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.566 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.566 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.566 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.566 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.566 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.566 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.566 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.566 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.566 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.566 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.567 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.567 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.567 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.567 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.567 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.567 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.567 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.567 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.567 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.567 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.567 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.567 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.567 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.567 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.568 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.568 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.568 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.568 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.568 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.568 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.568 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.568 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.568 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.568 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.568 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.568 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.568 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.569 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.569 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.569 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.569 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.569 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.569 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.569 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.569 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.569 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.569 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.569 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.569 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.569 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.570 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.570 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.570 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.570 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.570 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.570 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.570 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.570 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.570 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.570 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.570 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.571 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.571 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.571 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.571 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.571 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.571 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.571 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.571 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.571 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.571 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.571 INFO:teuthology.orchestra.run.smithi063.stdout: "max_completed_events": { 2024-09-21T06:39:09.571 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_completed_events", 2024-09-21T06:39:09.572 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.572 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.572 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.572 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "50", 2024-09-21T06:39:09.572 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.572 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.572 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.572 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:39:09.572 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.572 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.572 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.572 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-21T06:39:09.573 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-21T06:39:09.573 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.573 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.573 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.573 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-21T06:39:09.573 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.573 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.573 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.573 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:39:09.573 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.573 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.573 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.573 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.574 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.574 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.574 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.574 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.574 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.574 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.574 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.574 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.574 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.574 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.574 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.574 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.575 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.575 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.575 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "prometheus", 2024-09-21T06:39:09.575 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.575 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.575 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.575 INFO:teuthology.orchestra.run.smithi063.stdout: "cache": { 2024-09-21T06:39:09.575 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cache", 2024-09-21T06:39:09.575 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.575 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.575 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.576 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.576 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.576 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.576 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.576 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.576 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.576 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.576 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.576 INFO:teuthology.orchestra.run.smithi063.stdout: "exclude_perf_counters": { 2024-09-21T06:39:09.576 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "exclude_perf_counters", 2024-09-21T06:39:09.576 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.576 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.577 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.577 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.577 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.577 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.577 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.577 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:39:09.577 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:39:09.577 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.577 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.577 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.577 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.577 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.578 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.578 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.578 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.578 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.578 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.578 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.578 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.578 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.579 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.579 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.579 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.579 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.579 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.579 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.579 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.579 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.579 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.579 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.579 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.579 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.580 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.580 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.580 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.580 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.580 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.580 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.580 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.580 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.580 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.580 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.581 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.581 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.581 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.581 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.581 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.581 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.581 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.581 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.581 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.581 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.581 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.581 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.581 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_stats_pools": { 2024-09-21T06:39:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd_stats_pools", 2024-09-21T06:39:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:39:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:39:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "300", 2024-09-21T06:39:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: "scrape_interval": { 2024-09-21T06:39:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "scrape_interval", 2024-09-21T06:39:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "15.0", 2024-09-21T06:39:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "server_addr": { 2024-09-21T06:39:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_addr", 2024-09-21T06:39:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "::", 2024-09-21T06:39:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:39:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "server_port": { 2024-09-21T06:39:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_port", 2024-09-21T06:39:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "9283", 2024-09-21T06:39:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:39:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: "stale_cache_strategy": { 2024-09-21T06:39:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "stale_cache_strategy", 2024-09-21T06:39:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "log", 2024-09-21T06:39:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_behaviour": { 2024-09-21T06:39:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_behaviour", 2024-09-21T06:39:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "default", 2024-09-21T06:39:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: "default", 2024-09-21T06:39:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: "error" 2024-09-21T06:39:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_error_status_code": { 2024-09-21T06:39:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_error_status_code", 2024-09-21T06:39:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "500", 2024-09-21T06:39:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "400", 2024-09-21T06:39:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "599", 2024-09-21T06:39:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd_support", 2024-09-21T06:39:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: "max_concurrent_snap_create": { 2024-09-21T06:39:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:39:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:39:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:39:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "trash_purge_schedule": { 2024-09-21T06:39:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "trash_purge_schedule", 2024-09-21T06:39:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "restful", 2024-09-21T06:39:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "enable_auth": { 2024-09-21T06:39:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enable_auth", 2024-09-21T06:39:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "key_file": { 2024-09-21T06:39:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "key_file", 2024-09-21T06:39:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: "max_requests": { 2024-09-21T06:39:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_requests", 2024-09-21T06:39:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "500", 2024-09-21T06:39:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:39:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: "server_addr": { 2024-09-21T06:39:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_addr", 2024-09-21T06:39:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "server_port": { 2024-09-21T06:39:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_port", 2024-09-21T06:39:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rgw", 2024-09-21T06:39:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:39:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:39:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-21T06:39:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:39:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rook", 2024-09-21T06:39:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "storage_class": { 2024-09-21T06:39:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "storage_class", 2024-09-21T06:39:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "local", 2024-09-21T06:39:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:39:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "selftest", 2024-09-21T06:39:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "roption1": { 2024-09-21T06:39:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "roption1", 2024-09-21T06:39:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "roption2": { 2024-09-21T06:39:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "roption2", 2024-09-21T06:39:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "xyz", 2024-09-21T06:39:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption1": { 2024-09-21T06:39:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption1", 2024-09-21T06:39:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption2": { 2024-09-21T06:39:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption2", 2024-09-21T06:39:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption3": { 2024-09-21T06:39:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption3", 2024-09-21T06:39:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption4": { 2024-09-21T06:39:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption4", 2024-09-21T06:39:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption5": { 2024-09-21T06:39:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption5", 2024-09-21T06:39:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption6": { 2024-09-21T06:39:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption6", 2024-09-21T06:39:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption7": { 2024-09-21T06:39:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption7", 2024-09-21T06:39:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-21T06:39:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "42", 2024-09-21T06:39:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "testkey": { 2024-09-21T06:39:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "testkey", 2024-09-21T06:39:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "testlkey": { 2024-09-21T06:39:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "testlkey", 2024-09-21T06:39:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "testnewline": { 2024-09-21T06:39:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "testnewline", 2024-09-21T06:39:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smb", 2024-09-21T06:39:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "internal_store_backend": { 2024-09-21T06:39:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "internal_store_backend", 2024-09-21T06:39:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:39:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "update_orchestration": { 2024-09-21T06:39:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "update_orchestration", 2024-09-21T06:39:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:39:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "snap_schedule", 2024-09-21T06:39:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_m_granularity": { 2024-09-21T06:39:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "allow_m_granularity", 2024-09-21T06:39:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:39:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "dump_on_update": { 2024-09-21T06:39:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "dump_on_update", 2024-09-21T06:39:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:39:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "stats", 2024-09-21T06:39:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "status", 2024-09-21T06:39:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.691 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.691 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.691 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.691 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.691 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.691 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.691 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.691 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.691 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.692 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.692 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.692 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.692 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.692 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.692 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.692 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.692 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.692 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.693 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.693 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "telegraf", 2024-09-21T06:39:09.693 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.693 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.693 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.693 INFO:teuthology.orchestra.run.smithi063.stdout: "address": { 2024-09-21T06:39:09.693 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "address", 2024-09-21T06:39:09.694 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.694 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.694 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.694 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:39:09.694 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.694 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.694 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.694 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.694 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.694 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.695 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.695 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-21T06:39:09.695 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-21T06:39:09.695 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.695 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.695 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.695 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "15", 2024-09-21T06:39:09.695 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.695 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.695 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.695 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.695 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.695 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.696 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.696 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.696 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.696 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.696 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.696 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.696 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.696 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.696 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.696 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.696 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.696 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.697 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.697 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.697 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.697 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.697 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.697 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.697 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.697 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.697 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.697 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.697 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.697 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.698 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.698 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.698 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.698 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.698 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.698 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.698 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.698 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.698 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.698 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.698 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.698 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.699 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.699 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.699 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.699 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.699 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.699 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.699 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.699 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.699 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.699 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.699 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.699 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.700 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.700 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.700 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.700 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.700 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.700 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.700 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.700 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.700 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.700 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.700 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.700 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.701 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.701 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.701 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.701 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.701 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.701 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.701 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.701 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.701 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.701 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.701 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.701 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.702 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.702 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.702 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.702 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.702 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.702 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.702 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.702 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.702 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.702 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.702 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "telemetry", 2024-09-21T06:39:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_basic": { 2024-09-21T06:39:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_basic", 2024-09-21T06:39:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:39:09.703 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.704 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.704 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.704 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_crash": { 2024-09-21T06:39:09.704 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_crash", 2024-09-21T06:39:09.704 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.704 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.704 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.704 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.704 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.704 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.704 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.704 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:39:09.704 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.705 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.705 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.705 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_device": { 2024-09-21T06:39:09.705 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_device", 2024-09-21T06:39:09.705 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.705 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.705 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.705 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.705 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.705 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.705 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.705 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:39:09.705 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.706 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.706 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.706 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_ident": { 2024-09-21T06:39:09.706 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_ident", 2024-09-21T06:39:09.706 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.706 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.706 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.706 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.706 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.706 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.706 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.707 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:39:09.707 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.707 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.707 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.707 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_perf": { 2024-09-21T06:39:09.707 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_perf", 2024-09-21T06:39:09.707 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.707 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.707 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.707 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.707 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.707 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.708 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.708 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:39:09.708 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.708 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.708 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.708 INFO:teuthology.orchestra.run.smithi063.stdout: "contact": { 2024-09-21T06:39:09.708 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "contact", 2024-09-21T06:39:09.708 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.708 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.708 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.708 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.708 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.709 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.709 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.709 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.709 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.709 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.709 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.709 INFO:teuthology.orchestra.run.smithi063.stdout: "description": { 2024-09-21T06:39:09.709 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "description", 2024-09-21T06:39:09.709 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.709 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.709 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.709 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.710 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.710 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.710 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.710 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.710 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.710 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.710 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.710 INFO:teuthology.orchestra.run.smithi063.stdout: "device_url": { 2024-09-21T06:39:09.710 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_url", 2024-09-21T06:39:09.710 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.710 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.710 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.710 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:39:09.711 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.711 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.711 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.711 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.711 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.711 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.711 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.711 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": { 2024-09-21T06:39:09.711 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enabled", 2024-09-21T06:39:09.711 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.711 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.711 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.712 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.712 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.712 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.712 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.712 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.712 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.712 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.712 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.712 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-21T06:39:09.712 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-21T06:39:09.712 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.712 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.712 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.713 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "24", 2024-09-21T06:39:09.713 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "8", 2024-09-21T06:39:09.713 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.713 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.713 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.713 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.713 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.713 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.713 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.713 INFO:teuthology.orchestra.run.smithi063.stdout: "last_opt_revision": { 2024-09-21T06:39:09.713 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "last_opt_revision", 2024-09-21T06:39:09.713 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.713 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.713 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.714 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "1", 2024-09-21T06:39:09.714 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.714 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.714 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.714 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.714 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.714 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.714 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.714 INFO:teuthology.orchestra.run.smithi063.stdout: "leaderboard": { 2024-09-21T06:39:09.714 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "leaderboard", 2024-09-21T06:39:09.714 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.715 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.715 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.715 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.715 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.715 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.715 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.715 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.715 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.715 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.716 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.716 INFO:teuthology.orchestra.run.smithi063.stdout: "leaderboard_description": { 2024-09-21T06:39:09.716 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "leaderboard_description", 2024-09-21T06:39:09.716 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.716 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.716 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.716 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.716 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.716 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.716 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.716 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.716 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.717 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.717 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.717 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.717 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.717 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.717 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.717 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.717 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.718 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.718 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.718 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.718 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.718 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.718 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.718 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.718 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.718 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.718 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.718 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.719 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.719 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.719 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.719 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.719 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.719 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.719 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.719 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.719 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.720 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.720 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.720 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.720 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.720 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.720 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.720 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.720 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.720 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.720 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.720 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.721 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.721 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.721 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.721 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.721 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.721 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.721 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.721 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.721 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.721 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.721 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.722 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.722 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.722 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.722 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.722 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.722 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.722 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.722 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.722 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.722 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.723 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.723 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.723 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.723 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.723 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.723 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.723 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.723 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.723 INFO:teuthology.orchestra.run.smithi063.stdout: "organization": { 2024-09-21T06:39:09.723 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "organization", 2024-09-21T06:39:09.724 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.724 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.724 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.724 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.724 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.724 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.724 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.724 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.724 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.724 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.725 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.725 INFO:teuthology.orchestra.run.smithi063.stdout: "proxy": { 2024-09-21T06:39:09.725 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "proxy", 2024-09-21T06:39:09.725 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.725 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.725 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.725 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.725 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.725 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.725 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.725 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.726 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.726 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.726 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.726 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.726 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.726 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.726 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.727 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.727 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.727 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.727 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.727 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.727 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.727 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.727 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.727 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.728 INFO:teuthology.orchestra.run.smithi063.stdout: "url": { 2024-09-21T06:39:09.728 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "url", 2024-09-21T06:39:09.728 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.728 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.728 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.728 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:39:09.728 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.728 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.728 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.728 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.728 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.728 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.728 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.728 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.729 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.729 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "test_orchestrator", 2024-09-21T06:39:09.729 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.729 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.729 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.729 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.729 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.729 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.729 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.729 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.730 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.730 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.730 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.730 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.730 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.730 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.730 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.730 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.730 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.730 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.730 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.730 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.730 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.731 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.731 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.731 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.731 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.731 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.731 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.731 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.731 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.731 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.731 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.732 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.732 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.732 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.732 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.732 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.732 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.732 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.732 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.732 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.732 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.732 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.732 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.733 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.733 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.733 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.733 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.733 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.733 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.733 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.733 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.733 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.733 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.733 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.733 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.733 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.734 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.734 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.734 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.734 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.734 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.734 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.734 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.734 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.734 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.734 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.734 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.735 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.735 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.735 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.735 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.735 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.735 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.735 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.735 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.735 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.735 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.735 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.736 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.736 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.736 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.736 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.736 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.736 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.736 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "volumes", 2024-09-21T06:39:09.736 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.736 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.736 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.736 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.736 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.737 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.737 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.737 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.737 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.737 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.737 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.737 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.737 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.737 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.737 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.737 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.737 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.737 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.737 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.737 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.738 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.738 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.738 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.738 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.738 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.738 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.738 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.738 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.738 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.738 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.738 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.738 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.739 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.739 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.739 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.739 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.739 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.739 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.739 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.739 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.739 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.739 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.739 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.739 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.740 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.740 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.740 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.740 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.740 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.740 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.740 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.740 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.740 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.740 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.740 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.740 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.740 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.740 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.741 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.741 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.741 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.741 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.741 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.741 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.741 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.741 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.741 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.741 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.741 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.741 INFO:teuthology.orchestra.run.smithi063.stdout: "max_concurrent_clones": { 2024-09-21T06:39:09.741 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_concurrent_clones", 2024-09-21T06:39:09.742 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.742 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.742 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.742 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "4", 2024-09-21T06:39:09.742 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.742 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.742 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.742 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:39:09.742 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.742 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.742 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.742 INFO:teuthology.orchestra.run.smithi063.stdout: "periodic_async_work": { 2024-09-21T06:39:09.742 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "periodic_async_work", 2024-09-21T06:39:09.743 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.743 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.743 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.743 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.743 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.743 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.743 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.743 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Periodically check for async work", 2024-09-21T06:39:09.743 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.743 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.743 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.743 INFO:teuthology.orchestra.run.smithi063.stdout: "snapshot_clone_delay": { 2024-09-21T06:39:09.744 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:39:09.744 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.744 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.744 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.744 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.744 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.744 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.744 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.744 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:39:09.744 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.744 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.744 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.744 INFO:teuthology.orchestra.run.smithi063.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:39:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:39:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:39:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.746 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.746 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.746 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.746 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.746 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.746 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.746 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.746 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.746 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.746 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.746 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.746 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.747 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.747 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.747 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.747 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix", 2024-09-21T06:39:09.747 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.747 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.747 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.747 INFO:teuthology.orchestra.run.smithi063.stdout: "discovery_interval": { 2024-09-21T06:39:09.747 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "discovery_interval", 2024-09-21T06:39:09.747 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-21T06:39:09.747 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.747 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.748 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "100", 2024-09-21T06:39:09.748 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.748 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.748 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.748 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.748 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.748 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.748 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.748 INFO:teuthology.orchestra.run.smithi063.stdout: "identifier": { 2024-09-21T06:39:09.748 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "identifier", 2024-09-21T06:39:09.748 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.748 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.748 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.749 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.749 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.749 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.749 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.749 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.749 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.749 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.749 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.749 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-21T06:39:09.749 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-21T06:39:09.749 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.750 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.750 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.750 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-21T06:39:09.750 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.750 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.750 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.750 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.750 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.750 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.750 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.751 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.751 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.751 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.751 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.751 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.751 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.751 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.751 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.751 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.751 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.752 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.752 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.752 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.752 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.752 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.752 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.752 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.752 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.752 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.752 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.752 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.752 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.752 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.753 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.753 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.753 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.753 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.753 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.753 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.753 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.753 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.753 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.754 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.754 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.754 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.754 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.754 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.754 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.754 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.754 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.754 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.754 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.754 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.754 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.755 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.755 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.755 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.755 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.755 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.755 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.755 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.755 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.755 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.756 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.756 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.756 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.756 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.756 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.756 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.756 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.756 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.756 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.756 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.756 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.756 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.757 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.757 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.757 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.757 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.757 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.757 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.757 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.757 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.757 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.758 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.758 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.758 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.758 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.758 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.758 INFO:teuthology.orchestra.run.smithi063.stdout: "zabbix_host": { 2024-09-21T06:39:09.758 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix_host", 2024-09-21T06:39:09.758 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.758 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.758 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.759 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.759 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.759 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.759 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.759 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.759 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.759 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.759 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.760 INFO:teuthology.orchestra.run.smithi063.stdout: "zabbix_port": { 2024-09-21T06:39:09.760 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix_port", 2024-09-21T06:39:09.760 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.760 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.760 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.760 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10051", 2024-09-21T06:39:09.760 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.760 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.761 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.761 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.761 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.761 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.761 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.761 INFO:teuthology.orchestra.run.smithi063.stdout: "zabbix_sender": { 2024-09-21T06:39:09.761 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix_sender", 2024-09-21T06:39:09.762 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.762 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.762 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.762 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:39:09.762 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.762 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.762 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.762 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.762 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.763 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.763 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.763 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.763 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.763 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.763 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-21T06:39:09.763 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.763 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.764 INFO:teuthology.orchestra.run.smithi063.stdout: "modules": [ 2024-09-21T06:39:09.764 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm", 2024-09-21T06:39:09.764 INFO:teuthology.orchestra.run.smithi063.stdout: "dashboard", 2024-09-21T06:39:09.764 INFO:teuthology.orchestra.run.smithi063.stdout: "iostat", 2024-09-21T06:39:09.764 INFO:teuthology.orchestra.run.smithi063.stdout: "nfs", 2024-09-21T06:39:09.764 INFO:teuthology.orchestra.run.smithi063.stdout: "restful", 2024-09-21T06:39:09.764 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_schedule" 2024-09-21T06:39:09.764 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.764 INFO:teuthology.orchestra.run.smithi063.stdout: "available_modules": [ 2024-09-21T06:39:09.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.764 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "alerts", 2024-09-21T06:39:09.765 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.765 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.765 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.765 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-21T06:39:09.765 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-21T06:39:09.765 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.765 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.765 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.765 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-21T06:39:09.765 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.765 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.765 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.766 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:39:09.766 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.766 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.766 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.766 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.766 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.766 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.766 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.766 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.766 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.767 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.767 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.767 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.767 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.767 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.767 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.767 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.767 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.767 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.767 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.767 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.767 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.768 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.768 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.768 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.768 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.768 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.768 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.768 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.768 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.768 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.768 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.768 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.768 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.769 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.769 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.769 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.769 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.769 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.769 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.769 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.769 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.769 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.769 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.769 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.769 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.769 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.770 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.770 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.770 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.770 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.770 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.770 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.770 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.770 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.770 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.770 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.770 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.770 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.770 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.771 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.771 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.771 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.771 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.771 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.771 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.771 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.771 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.771 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.771 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.771 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_destination": { 2024-09-21T06:39:09.771 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_destination", 2024-09-21T06:39:09.772 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.772 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.772 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.772 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.772 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.772 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.772 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.772 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:39:09.772 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.772 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.772 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.772 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_from_name": { 2024-09-21T06:39:09.772 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_from_name", 2024-09-21T06:39:09.773 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.773 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.773 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.773 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "Ceph", 2024-09-21T06:39:09.773 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.773 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.773 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.773 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Email From: name", 2024-09-21T06:39:09.773 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.773 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.773 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.773 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.773 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_host": { 2024-09-21T06:39:09.773 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_host", 2024-09-21T06:39:09.774 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.774 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.774 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.774 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.774 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.774 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.774 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.774 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SMTP server", 2024-09-21T06:39:09.774 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.774 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.774 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.774 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.774 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_password": { 2024-09-21T06:39:09.774 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_password", 2024-09-21T06:39:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Password to authenticate with", 2024-09-21T06:39:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_port": { 2024-09-21T06:39:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_port", 2024-09-21T06:39:09.775 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.776 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.776 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.776 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "465", 2024-09-21T06:39:09.776 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.776 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.776 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.776 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SMTP port", 2024-09-21T06:39:09.776 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.776 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.776 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.776 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_sender": { 2024-09-21T06:39:09.776 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_sender", 2024-09-21T06:39:09.776 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.777 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.777 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.777 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.777 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.777 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.777 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.777 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:39:09.777 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.777 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.777 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.777 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_ssl": { 2024-09-21T06:39:09.777 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_ssl", 2024-09-21T06:39:09.777 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.778 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.778 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.778 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.778 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.778 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.778 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.778 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:39:09.778 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.778 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.778 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.778 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.778 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_user": { 2024-09-21T06:39:09.778 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_user", 2024-09-21T06:39:09.778 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.779 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.779 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.779 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.779 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.779 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.779 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.779 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "User to authenticate as", 2024-09-21T06:39:09.779 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.779 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.779 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.779 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.779 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.779 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.779 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.780 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.780 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.780 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.780 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.780 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.780 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.780 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.780 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.780 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.780 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.780 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.780 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.780 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.781 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "balancer", 2024-09-21T06:39:09.781 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.781 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.781 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.781 INFO:teuthology.orchestra.run.smithi063.stdout: "active": { 2024-09-21T06:39:09.781 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "active", 2024-09-21T06:39:09.781 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.781 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.781 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.781 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.781 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.781 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.781 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.781 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:39:09.782 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.782 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.782 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.782 INFO:teuthology.orchestra.run.smithi063.stdout: "begin_time": { 2024-09-21T06:39:09.782 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "begin_time", 2024-09-21T06:39:09.782 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.782 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.782 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.782 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0000", 2024-09-21T06:39:09.782 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.782 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.782 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.783 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:39:09.783 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:39:09.783 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.783 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.783 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.783 INFO:teuthology.orchestra.run.smithi063.stdout: "begin_weekday": { 2024-09-21T06:39:09.783 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "begin_weekday", 2024-09-21T06:39:09.783 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-21T06:39:09.783 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.783 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.784 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.784 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "0", 2024-09-21T06:39:09.784 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "6", 2024-09-21T06:39:09.784 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.784 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:39:09.784 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:39:09.784 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.784 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.784 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.784 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_compat_max_iterations": { 2024-09-21T06:39:09.784 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:39:09.784 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-21T06:39:09.785 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.785 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.785 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "25", 2024-09-21T06:39:09.785 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-21T06:39:09.785 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "250", 2024-09-21T06:39:09.785 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.785 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:39:09.785 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.785 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.785 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.786 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_compat_metrics": { 2024-09-21T06:39:09.786 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crush_compat_metrics", 2024-09-21T06:39:09.786 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.786 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.786 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.786 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:39:09.786 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.786 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.786 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.786 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:39:09.787 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:39:09.787 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.787 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.787 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.787 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_compat_step": { 2024-09-21T06:39:09.787 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crush_compat_step", 2024-09-21T06:39:09.787 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:09.787 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.787 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.787 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0.5", 2024-09-21T06:39:09.787 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "0.001", 2024-09-21T06:39:09.787 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "0.999", 2024-09-21T06:39:09.788 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.788 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:39:09.788 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:39:09.788 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.788 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.788 INFO:teuthology.orchestra.run.smithi063.stdout: "end_time": { 2024-09-21T06:39:09.788 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "end_time", 2024-09-21T06:39:09.788 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.789 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.789 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.789 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "2359", 2024-09-21T06:39:09.789 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.789 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.789 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.789 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:39:09.789 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:39:09.789 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.789 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.790 INFO:teuthology.orchestra.run.smithi063.stdout: "end_weekday": { 2024-09-21T06:39:09.790 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "end_weekday", 2024-09-21T06:39:09.790 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-21T06:39:09.790 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.790 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.790 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.790 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "0", 2024-09-21T06:39:09.790 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "6", 2024-09-21T06:39:09.790 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.790 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:39:09.791 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:39:09.791 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.791 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.791 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.791 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.791 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.791 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.791 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.792 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.792 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.792 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.792 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.792 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.792 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.792 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.792 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.792 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.793 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.793 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.793 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.793 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.793 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.793 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.793 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.793 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.793 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.794 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.794 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.794 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.794 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.794 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.794 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.794 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.794 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.794 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.795 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.795 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.795 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.795 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.795 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.795 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.795 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.795 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.796 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.796 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.796 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.796 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.796 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.796 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.796 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.796 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.796 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.796 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.796 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.796 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.797 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.797 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.797 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.797 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.797 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.797 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.797 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.797 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.797 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.797 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.797 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.797 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.797 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: "min_score": { 2024-09-21T06:39:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "min_score", 2024-09-21T06:39:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:39:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.799 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.799 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": { 2024-09-21T06:39:09.799 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mode", 2024-09-21T06:39:09.799 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.799 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.799 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.799 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "upmap", 2024-09-21T06:39:09.799 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.799 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.799 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.799 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-compat", 2024-09-21T06:39:09.799 INFO:teuthology.orchestra.run.smithi063.stdout: "none", 2024-09-21T06:39:09.799 INFO:teuthology.orchestra.run.smithi063.stdout: "read", 2024-09-21T06:39:09.800 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap", 2024-09-21T06:39:09.800 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap-read" 2024-09-21T06:39:09.800 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.800 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Balancer mode", 2024-09-21T06:39:09.800 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.800 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.800 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.800 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ids": { 2024-09-21T06:39:09.800 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pool_ids", 2024-09-21T06:39:09.800 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.800 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.800 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.800 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.801 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.801 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.801 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.801 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:39:09.801 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.801 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.801 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.801 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-21T06:39:09.801 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-21T06:39:09.801 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.801 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.801 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.802 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-21T06:39:09.802 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.802 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.802 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.802 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:39:09.802 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.802 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.802 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.802 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.802 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.802 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.802 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.803 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.803 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.803 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.803 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.803 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.803 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.803 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.803 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.803 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.803 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap_max_deviation": { 2024-09-21T06:39:09.803 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "upmap_max_deviation", 2024-09-21T06:39:09.803 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.804 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.804 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.804 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-21T06:39:09.804 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-21T06:39:09.804 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.804 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.804 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:39:09.804 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:39:09.804 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.804 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.804 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap_max_optimizations": { 2024-09-21T06:39:09.804 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:39:09.804 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-21T06:39:09.805 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.805 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.805 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:09.805 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.805 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.805 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.805 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:39:09.805 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.805 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.805 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.805 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.805 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.806 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephadm", 2024-09-21T06:39:09.806 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.806 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.806 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.806 INFO:teuthology.orchestra.run.smithi063.stdout: "agent_down_multiplier": { 2024-09-21T06:39:09.806 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "agent_down_multiplier", 2024-09-21T06:39:09.806 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:09.806 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.806 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.806 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3.0", 2024-09-21T06:39:09.806 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.806 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.807 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.807 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:39:09.807 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.807 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.807 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.807 INFO:teuthology.orchestra.run.smithi063.stdout: "agent_refresh_rate": { 2024-09-21T06:39:09.807 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "agent_refresh_rate", 2024-09-21T06:39:09.807 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.807 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.807 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.807 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "20", 2024-09-21T06:39:09.807 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.807 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.808 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.808 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:39:09.808 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.808 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.808 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.808 INFO:teuthology.orchestra.run.smithi063.stdout: "agent_starting_port": { 2024-09-21T06:39:09.808 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "agent_starting_port", 2024-09-21T06:39:09.808 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.808 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.808 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.808 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "4721", 2024-09-21T06:39:09.808 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.808 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.809 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.809 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:39:09.809 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.809 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.809 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.809 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_ptrace": { 2024-09-21T06:39:09.809 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "allow_ptrace", 2024-09-21T06:39:09.809 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.809 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.809 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.809 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.809 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.809 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.810 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.810 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:39:09.810 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:39:09.810 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.810 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.810 INFO:teuthology.orchestra.run.smithi063.stdout: "autotune_interval": { 2024-09-21T06:39:09.810 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "autotune_interval", 2024-09-21T06:39:09.810 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.810 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.810 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.810 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-21T06:39:09.810 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.811 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.811 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.811 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:39:09.811 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.811 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.811 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.811 INFO:teuthology.orchestra.run.smithi063.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:39:09.811 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:39:09.811 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:09.811 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.811 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.812 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0.7", 2024-09-21T06:39:09.812 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.812 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.812 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.812 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:39:09.812 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.812 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.812 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.812 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm_log_destination": { 2024-09-21T06:39:09.812 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephadm_log_destination", 2024-09-21T06:39:09.812 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.812 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.812 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.813 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.813 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.813 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.813 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.813 INFO:teuthology.orchestra.run.smithi063.stdout: "file", 2024-09-21T06:39:09.813 INFO:teuthology.orchestra.run.smithi063.stdout: "file,syslog", 2024-09-21T06:39:09.813 INFO:teuthology.orchestra.run.smithi063.stdout: "syslog" 2024-09-21T06:39:09.813 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.813 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:39:09.813 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.813 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.813 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.813 INFO:teuthology.orchestra.run.smithi063.stdout: "cgroups_split": { 2024-09-21T06:39:09.814 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cgroups_split", 2024-09-21T06:39:09.814 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.814 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.814 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.814 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.814 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.814 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.814 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.814 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:39:09.814 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.814 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.814 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.814 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.815 INFO:teuthology.orchestra.run.smithi063.stdout: "config_checks_enabled": { 2024-09-21T06:39:09.815 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "config_checks_enabled", 2024-09-21T06:39:09.815 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.815 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.815 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.815 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.815 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.815 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.815 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.815 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:39:09.815 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.815 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.815 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.816 INFO:teuthology.orchestra.run.smithi063.stdout: "config_dashboard": { 2024-09-21T06:39:09.816 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "config_dashboard", 2024-09-21T06:39:09.816 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.816 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.816 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.816 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.816 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.816 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.817 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.817 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:39:09.817 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.817 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.817 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.817 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_alertmanager": { 2024-09-21T06:39:09.817 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_alertmanager", 2024-09-21T06:39:09.817 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.817 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.817 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.817 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:39:09.817 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.817 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.818 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.818 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-21T06:39:09.818 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.818 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.818 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.818 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_base": { 2024-09-21T06:39:09.818 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_base", 2024-09-21T06:39:09.818 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.818 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.819 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.819 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:39:09.819 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.819 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.819 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.819 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:39:09.819 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.819 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.819 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.819 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_elasticsearch": { 2024-09-21T06:39:09.819 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:39:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:39:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "elasticsearch container image", 2024-09-21T06:39:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_grafana": { 2024-09-21T06:39:09.820 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_grafana", 2024-09-21T06:39:09.821 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.821 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.821 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.821 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:39:09.821 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.821 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.821 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.821 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-21T06:39:09.821 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.821 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.821 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.821 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_haproxy": { 2024-09-21T06:39:09.821 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_haproxy", 2024-09-21T06:39:09.822 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.822 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.822 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.822 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:39:09.822 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.822 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.822 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.822 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "HAproxy container image", 2024-09-21T06:39:09.822 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.822 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.822 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.823 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_jaeger_agent": { 2024-09-21T06:39:09.823 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:39:09.823 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.823 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.823 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.823 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:39:09.823 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.823 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.823 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.824 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:39:09.824 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.824 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.824 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.824 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_jaeger_collector": { 2024-09-21T06:39:09.824 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:39:09.824 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.824 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.824 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.824 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:39:09.824 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.824 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.825 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.825 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:39:09.825 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.825 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.825 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.825 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_jaeger_query": { 2024-09-21T06:39:09.825 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:39:09.825 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.825 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.826 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.826 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:39:09.826 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.826 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.826 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.826 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Jaeger query container image", 2024-09-21T06:39:09.826 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.826 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.826 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.826 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_keepalived": { 2024-09-21T06:39:09.826 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_keepalived", 2024-09-21T06:39:09.827 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.827 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.827 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.827 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:39:09.827 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.827 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.827 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.827 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Keepalived container image", 2024-09-21T06:39:09.827 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.827 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.828 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.828 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_loki": { 2024-09-21T06:39:09.828 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_loki", 2024-09-21T06:39:09.828 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.828 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.828 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.828 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:39:09.828 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.828 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.829 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.829 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Loki container image", 2024-09-21T06:39:09.829 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.829 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.829 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.829 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_nginx": { 2024-09-21T06:39:09.829 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_nginx", 2024-09-21T06:39:09.830 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.830 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.830 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.830 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:39:09.830 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.830 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.830 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.830 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Nginx container image", 2024-09-21T06:39:09.830 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.830 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.831 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.831 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_node_exporter": { 2024-09-21T06:39:09.831 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_node_exporter", 2024-09-21T06:39:09.831 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.831 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.831 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.831 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:39:09.831 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.831 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.832 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.832 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-21T06:39:09.832 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.832 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.832 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.832 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_nvmeof": { 2024-09-21T06:39:09.832 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_nvmeof", 2024-09-21T06:39:09.832 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.832 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.832 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.832 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:39:09.832 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.832 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.833 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.833 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Nvme-of container image", 2024-09-21T06:39:09.833 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.833 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.833 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.833 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:39:09.833 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:39:09.833 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.833 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.834 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.834 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:39:09.834 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.834 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.834 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.834 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:39:09.834 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.834 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.834 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.834 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_prometheus": { 2024-09-21T06:39:09.834 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_prometheus", 2024-09-21T06:39:09.834 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.835 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.835 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.835 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:39:09.835 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.835 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.835 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.835 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-21T06:39:09.835 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.835 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.835 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.835 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_promtail": { 2024-09-21T06:39:09.835 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_promtail", 2024-09-21T06:39:09.836 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.836 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.836 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.836 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:39:09.836 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.836 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.836 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.836 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Promtail container image", 2024-09-21T06:39:09.836 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.836 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.836 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.836 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_samba": { 2024-09-21T06:39:09.837 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_samba", 2024-09-21T06:39:09.837 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.837 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.837 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.837 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:39:09.837 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.837 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.837 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.837 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:39:09.837 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.837 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.837 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.838 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_samba_metrics": { 2024-09-21T06:39:09.838 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:39:09.838 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.838 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.838 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.838 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:39:09.838 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.838 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.838 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.838 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:39:09.838 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.838 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.838 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.839 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_snmp_gateway": { 2024-09-21T06:39:09.839 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:39:09.839 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.839 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.839 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.839 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:39:09.839 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.839 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.839 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.839 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:39:09.839 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.839 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.839 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.840 INFO:teuthology.orchestra.run.smithi063.stdout: "container_init": { 2024-09-21T06:39:09.840 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_init", 2024-09-21T06:39:09.840 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.840 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.840 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.840 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.840 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.840 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.840 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.840 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:39:09.840 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.840 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.841 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.841 INFO:teuthology.orchestra.run.smithi063.stdout: "daemon_cache_timeout": { 2024-09-21T06:39:09.841 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:39:09.841 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.841 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.841 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.841 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-21T06:39:09.841 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.841 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.841 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.841 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:39:09.841 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.841 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.842 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.842 INFO:teuthology.orchestra.run.smithi063.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:39:09.842 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:39:09.842 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.842 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.842 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.842 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "900", 2024-09-21T06:39:09.842 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.842 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.842 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.842 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:39:09.842 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.843 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.843 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.843 INFO:teuthology.orchestra.run.smithi063.stdout: "default_registry": { 2024-09-21T06:39:09.843 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "default_registry", 2024-09-21T06:39:09.843 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.843 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.843 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.843 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io", 2024-09-21T06:39:09.843 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.843 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.843 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.843 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:39:09.843 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.844 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.844 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.844 INFO:teuthology.orchestra.run.smithi063.stdout: "device_cache_timeout": { 2024-09-21T06:39:09.844 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_cache_timeout", 2024-09-21T06:39:09.844 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.844 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.844 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.844 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "1800", 2024-09-21T06:39:09.844 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.844 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.844 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.844 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:39:09.845 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.845 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.845 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.845 INFO:teuthology.orchestra.run.smithi063.stdout: "device_enhanced_scan": { 2024-09-21T06:39:09.845 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_enhanced_scan", 2024-09-21T06:39:09.845 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.845 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.845 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.845 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.845 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.845 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.845 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.845 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:39:09.845 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.846 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.846 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.846 INFO:teuthology.orchestra.run.smithi063.stdout: "facts_cache_timeout": { 2024-09-21T06:39:09.846 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "facts_cache_timeout", 2024-09-21T06:39:09.846 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.846 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.846 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.846 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-21T06:39:09.846 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.846 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.846 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.846 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:39:09.847 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.847 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.847 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.847 INFO:teuthology.orchestra.run.smithi063.stdout: "grafana_dashboards_path": { 2024-09-21T06:39:09.847 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:39:09.847 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.847 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.847 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.847 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:39:09.847 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.847 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.847 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.847 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:39:09.847 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.848 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.848 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.848 INFO:teuthology.orchestra.run.smithi063.stdout: "host_check_interval": { 2024-09-21T06:39:09.848 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "host_check_interval", 2024-09-21T06:39:09.848 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.848 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.848 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.848 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-21T06:39:09.848 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.848 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.848 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.848 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:39:09.849 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.849 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.849 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.849 INFO:teuthology.orchestra.run.smithi063.stdout: "hw_monitoring": { 2024-09-21T06:39:09.849 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "hw_monitoring", 2024-09-21T06:39:09.849 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.849 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.849 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.849 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.849 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.849 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.849 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.850 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:39:09.850 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.850 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.850 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.850 INFO:teuthology.orchestra.run.smithi063.stdout: "inventory_list_all": { 2024-09-21T06:39:09.850 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "inventory_list_all", 2024-09-21T06:39:09.850 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.850 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.850 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.850 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.850 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.850 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.850 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.851 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:39:09.851 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.851 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.851 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.851 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.851 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.851 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.851 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.851 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.851 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.852 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.852 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.852 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.852 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.852 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.852 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.852 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.852 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.852 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.852 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.853 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.853 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.853 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.853 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.853 INFO:teuthology.orchestra.run.smithi063.stdout: "log_refresh_metadata": { 2024-09-21T06:39:09.853 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_refresh_metadata", 2024-09-21T06:39:09.853 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.853 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.853 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.853 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.853 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.853 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.853 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.854 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:39:09.854 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.854 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.854 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.854 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.854 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.854 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.854 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.855 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.855 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.855 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.855 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.855 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.855 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:39:09.855 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.855 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.855 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.855 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.856 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.856 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.856 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.856 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.856 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.856 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.856 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.856 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.856 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.856 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.856 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.857 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.857 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.857 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.857 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.857 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.857 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.857 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.857 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.857 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:39:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:39:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.860 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.860 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:39:09.860 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.860 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.860 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.860 INFO:teuthology.orchestra.run.smithi063.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:39:09.860 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:39:09.860 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.861 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.861 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.861 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "*", 2024-09-21T06:39:09.861 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.861 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.861 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.861 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:39:09.861 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.861 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.861 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.862 INFO:teuthology.orchestra.run.smithi063.stdout: "max_count_per_host": { 2024-09-21T06:39:09.862 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_count_per_host", 2024-09-21T06:39:09.862 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.862 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.862 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.862 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:09.862 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.862 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.862 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.862 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:39:09.863 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.863 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.863 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.863 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd_draining_count": { 2024-09-21T06:39:09.863 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_osd_draining_count", 2024-09-21T06:39:09.863 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.863 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.863 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.864 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:09.864 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.864 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.864 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.864 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:39:09.864 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.864 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.864 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.865 INFO:teuthology.orchestra.run.smithi063.stdout: "migration_current": { 2024-09-21T06:39:09.865 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "migration_current", 2024-09-21T06:39:09.865 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.865 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.865 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.865 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.865 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.865 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.865 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.865 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "internal - do not modify", 2024-09-21T06:39:09.865 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.865 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.865 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.866 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": { 2024-09-21T06:39:09.866 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mode", 2024-09-21T06:39:09.866 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.866 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.866 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.866 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "root", 2024-09-21T06:39:09.866 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.866 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.866 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.866 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm-package", 2024-09-21T06:39:09.866 INFO:teuthology.orchestra.run.smithi063.stdout: "root" 2024-09-21T06:39:09.866 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.867 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:39:09.867 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.867 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.867 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.867 INFO:teuthology.orchestra.run.smithi063.stdout: "oob_default_addr": { 2024-09-21T06:39:09.867 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "oob_default_addr", 2024-09-21T06:39:09.867 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.867 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.867 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.867 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "169.254.1.1", 2024-09-21T06:39:09.867 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.867 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.867 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.868 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:39:09.868 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.868 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.868 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.868 INFO:teuthology.orchestra.run.smithi063.stdout: "prometheus_alerts_path": { 2024-09-21T06:39:09.868 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:39:09.868 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.868 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.868 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.868 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:39:09.868 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.869 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.869 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.869 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:39:09.869 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.869 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.869 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.869 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_insecure": { 2024-09-21T06:39:09.869 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_insecure", 2024-09-21T06:39:09.869 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.869 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.869 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.870 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.870 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.870 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.870 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.870 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:39:09.870 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.870 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.870 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.870 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_password": { 2024-09-21T06:39:09.870 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_password", 2024-09-21T06:39:09.870 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.870 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:39:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_url": { 2024-09-21T06:39:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_url", 2024-09-21T06:39:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:39:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_username": { 2024-09-21T06:39:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_username", 2024-09-21T06:39:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:39:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: "secure_monitoring_stack": { 2024-09-21T06:39:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:39:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:39:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: "service_discovery_port": { 2024-09-21T06:39:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "service_discovery_port", 2024-09-21T06:39:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8765", 2024-09-21T06:39:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:39:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: "ssh_config_file": { 2024-09-21T06:39:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssh_config_file", 2024-09-21T06:39:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:39:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:39:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:39:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3", 2024-09-21T06:39:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:39:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: "ssh_keepalive_interval": { 2024-09-21T06:39:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:39:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "7", 2024-09-21T06:39:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:39:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: "use_agent": { 2024-09-21T06:39:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "use_agent", 2024-09-21T06:39:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:39:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: "use_repo_digest": { 2024-09-21T06:39:09.881 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "use_repo_digest", 2024-09-21T06:39:09.881 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.881 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.881 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.881 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.881 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.881 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.881 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.881 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:39:09.881 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.881 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.881 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.882 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_on_failed_host_check": { 2024-09-21T06:39:09.882 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:39:09.882 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.882 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.882 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.882 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.882 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.882 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.882 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.882 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:39:09.882 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.882 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.882 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.883 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_on_stray_daemons": { 2024-09-21T06:39:09.883 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:39:09.883 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.883 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.883 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.883 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.883 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.883 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.883 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.883 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:39:09.883 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.884 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.884 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.884 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_on_stray_hosts": { 2024-09-21T06:39:09.884 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:39:09.884 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.884 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.884 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.884 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.884 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.884 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.884 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.884 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:39:09.884 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.885 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.885 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.885 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.885 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.885 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crash", 2024-09-21T06:39:09.885 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.885 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.885 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.885 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.886 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.886 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.886 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.886 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.886 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.886 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.886 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.886 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.886 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.887 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.887 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.887 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.887 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.887 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.887 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.887 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.887 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.887 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.887 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.887 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.888 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.888 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.888 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.888 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.888 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.888 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.888 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.888 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.888 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.889 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.889 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.889 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.889 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.889 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.889 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.889 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.889 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.889 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.889 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.890 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.890 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.890 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.890 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.890 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.890 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.890 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.890 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.890 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.890 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.891 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.891 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.891 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.891 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.891 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.891 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.891 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.891 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.891 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.891 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.891 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.891 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.891 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.892 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.892 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.892 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.892 INFO:teuthology.orchestra.run.smithi063.stdout: "retain_interval": { 2024-09-21T06:39:09.892 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "retain_interval", 2024-09-21T06:39:09.892 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.892 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.892 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.892 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "31536000", 2024-09-21T06:39:09.892 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.892 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.892 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.893 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:39:09.893 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.893 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.893 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.893 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.893 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.893 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.893 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.893 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.893 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.893 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.893 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.894 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.894 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.894 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.894 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.894 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.894 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_recent_interval": { 2024-09-21T06:39:09.894 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_recent_interval", 2024-09-21T06:39:09.894 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.894 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.894 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.895 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "1209600", 2024-09-21T06:39:09.895 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.895 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.895 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.895 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:39:09.895 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.895 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.895 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.895 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.895 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.896 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "dashboard", 2024-09-21T06:39:09.896 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.896 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.896 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.896 INFO:teuthology.orchestra.run.smithi063.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:39:09.896 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:39:09.896 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.896 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.897 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.897 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:09.897 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.897 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.897 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.897 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.897 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.897 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.897 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.898 INFO:teuthology.orchestra.run.smithi063.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:39:09.898 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:39:09.898 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.898 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.898 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.898 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.898 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.898 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.898 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.899 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.899 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.899 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.899 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.899 INFO:teuthology.orchestra.run.smithi063.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:39:09.899 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:39:09.899 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.899 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.900 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.900 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.900 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.900 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.900 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.900 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.900 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.900 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.901 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.901 INFO:teuthology.orchestra.run.smithi063.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:39:09.901 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:39:09.901 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.901 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.901 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.901 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.901 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.901 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.901 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.901 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.901 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.902 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.902 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.902 INFO:teuthology.orchestra.run.smithi063.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:39:09.902 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:39:09.902 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.902 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.902 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.902 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.902 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.902 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.902 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.902 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.902 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.903 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.903 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.903 INFO:teuthology.orchestra.run.smithi063.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:39:09.903 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:39:09.903 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.903 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.903 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.903 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.903 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.903 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.903 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.903 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.903 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.904 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.904 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.904 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:39:09.904 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:39:09.904 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.904 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.904 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.904 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.904 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.904 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.905 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.905 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.905 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.905 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.905 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.905 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:39:09.905 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:39:09.905 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.905 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.905 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.905 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.905 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.906 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.906 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.906 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.906 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.906 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.906 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.906 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:39:09.906 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:39:09.906 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.906 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.906 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.906 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.907 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.907 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.907 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.907 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.907 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.907 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.907 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.907 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:39:09.907 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:39:09.907 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.907 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.907 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.908 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.908 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.908 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.908 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.908 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.908 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.908 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.908 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.908 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:39:09.908 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:39:09.908 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.908 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.909 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.909 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.909 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.909 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.909 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.909 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.909 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.909 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.909 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.909 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:39:09.909 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:39:09.910 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.910 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.910 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.910 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.910 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.910 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.910 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.910 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.910 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.910 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.910 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.910 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:39:09.911 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:39:09.911 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.911 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.911 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.911 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.911 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.911 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.911 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.911 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.911 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.911 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.911 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.912 INFO:teuthology.orchestra.run.smithi063.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:39:09.912 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:39:09.912 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.912 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.912 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.912 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.912 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.912 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.912 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.912 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.912 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.912 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.912 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.913 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:39:09.913 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:39:09.913 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.913 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.913 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.913 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "admin", 2024-09-21T06:39:09.913 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.913 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.913 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.913 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.913 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.913 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.913 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.914 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:39:09.914 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:39:09.914 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.914 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.914 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.914 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.914 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.914 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.914 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.914 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.914 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.914 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.914 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.915 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_URL": { 2024-09-21T06:39:09.915 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:39:09.915 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.915 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.915 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.915 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.915 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.915 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.915 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.915 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.915 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.915 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.915 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.916 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:39:09.916 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:39:09.916 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.916 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.916 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.916 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "admin", 2024-09-21T06:39:09.916 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.916 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.916 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.916 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.916 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.916 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.916 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.917 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:39:09.917 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:39:09.917 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.917 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.917 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.917 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.917 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.917 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.917 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.917 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.917 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.917 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.917 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.918 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:39:09.918 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:39:09.918 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.918 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.918 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.918 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.918 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.918 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.918 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.918 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.918 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.919 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.919 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.919 INFO:teuthology.orchestra.run.smithi063.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:39:09.919 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:39:09.919 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.919 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.919 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.919 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.919 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.919 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.919 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.919 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.919 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.920 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.920 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.920 INFO:teuthology.orchestra.run.smithi063.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:39:09.920 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:39:09.920 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.920 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.920 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.920 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.920 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.920 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.920 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.920 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.920 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.920 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.921 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.921 INFO:teuthology.orchestra.run.smithi063.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:39:09.921 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:39:09.921 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.921 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.921 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.921 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "[]", 2024-09-21T06:39:09.922 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.922 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.922 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.922 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.922 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.922 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.922 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.922 INFO:teuthology.orchestra.run.smithi063.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:39:09.922 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:39:09.922 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.923 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.923 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.923 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "{}", 2024-09-21T06:39:09.923 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.923 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.923 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.923 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.923 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.923 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.923 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.924 INFO:teuthology.orchestra.run.smithi063.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:39:09.924 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:39:09.924 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.924 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.924 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.924 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.924 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.924 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.924 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.925 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.925 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.925 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.925 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.925 INFO:teuthology.orchestra.run.smithi063.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:39:09.925 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:39:09.925 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.925 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.925 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.925 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.925 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.926 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.926 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.926 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.926 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.926 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.926 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.926 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:39:09.926 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:39:09.927 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.927 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.927 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.927 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.927 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.927 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.927 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.927 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.927 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.927 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.927 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.928 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:39:09.928 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:39:09.928 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.928 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.928 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.928 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.928 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.928 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.928 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.928 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.929 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.929 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.929 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.929 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:39:09.929 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:39:09.929 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.929 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.929 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.929 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.930 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.930 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.930 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.930 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.930 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.930 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.930 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.930 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:39:09.930 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:39:09.930 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.931 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.931 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.931 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.931 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.931 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.931 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.931 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.931 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.931 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.931 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.932 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:39:09.932 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:39:09.932 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.932 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.932 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.932 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.932 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.933 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.933 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.933 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.933 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.933 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.933 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.933 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:39:09.934 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:39:09.934 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.934 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.934 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.934 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.934 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.934 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.934 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.934 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.934 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.934 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.935 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.935 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:39:09.935 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:39:09.935 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.935 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.935 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.935 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.935 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.935 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.935 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.935 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.935 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.936 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.936 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.936 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:39:09.936 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:39:09.936 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.936 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.936 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.936 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.936 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.936 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.936 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.936 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.936 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.937 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.937 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.937 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:39:09.937 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:39:09.937 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.937 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.937 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.937 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:39:09.937 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.937 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.937 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.937 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.938 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.938 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.938 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.938 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:39:09.938 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:39:09.938 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.938 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.938 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.938 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:09.938 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.938 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.938 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.939 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.939 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.939 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.939 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.939 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:39:09.939 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:39:09.939 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.939 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.939 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.939 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8", 2024-09-21T06:39:09.939 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.939 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.939 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.940 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.940 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.940 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.940 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.940 INFO:teuthology.orchestra.run.smithi063.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:39:09.940 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:39:09.940 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.940 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.940 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.940 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "45", 2024-09-21T06:39:09.940 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.940 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.941 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.941 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.941 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.941 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.941 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.941 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:39:09.941 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:39:09.941 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.941 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.941 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.941 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.941 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.941 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.942 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.942 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.942 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.942 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.942 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.942 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:39:09.942 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:39:09.942 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.942 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.942 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.942 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "admin", 2024-09-21T06:39:09.942 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.943 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.943 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.943 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.943 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.943 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.943 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.943 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:39:09.943 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:39:09.943 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.943 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.943 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.943 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.944 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.944 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.944 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.944 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.944 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.944 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.944 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.944 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:39:09.944 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:39:09.944 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.944 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.944 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.945 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.945 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.945 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.945 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.945 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.945 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.945 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.945 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.945 INFO:teuthology.orchestra.run.smithi063.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:39:09.945 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:39:09.945 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.945 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.945 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.946 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.946 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.946 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.946 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.946 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.946 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.946 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.946 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.946 INFO:teuthology.orchestra.run.smithi063.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:39:09.946 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:39:09.946 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.946 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.946 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.947 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.947 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.947 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.947 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.947 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.947 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.947 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.947 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.947 INFO:teuthology.orchestra.run.smithi063.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:39:09.947 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:39:09.947 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.948 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.948 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.948 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:09.948 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.948 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.948 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.948 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.948 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.948 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.948 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.948 INFO:teuthology.orchestra.run.smithi063.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:39:09.948 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:39:09.948 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.949 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.949 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.949 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-21T06:39:09.949 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.949 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.949 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.949 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.949 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.949 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.949 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.949 INFO:teuthology.orchestra.run.smithi063.stdout: "cross_origin_url": { 2024-09-21T06:39:09.949 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cross_origin_url", 2024-09-21T06:39:09.950 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.950 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.950 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.950 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.950 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.950 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.950 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.950 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.950 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.950 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.950 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.950 INFO:teuthology.orchestra.run.smithi063.stdout: "crt_file": { 2024-09-21T06:39:09.951 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crt_file", 2024-09-21T06:39:09.951 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.951 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.951 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.951 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.951 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.951 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.951 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.951 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.951 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.951 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.951 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.951 INFO:teuthology.orchestra.run.smithi063.stdout: "debug": { 2024-09-21T06:39:09.951 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "debug", 2024-09-21T06:39:09.952 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.952 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.952 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.952 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.952 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.952 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.952 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.952 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:39:09.952 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.952 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.952 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.952 INFO:teuthology.orchestra.run.smithi063.stdout: "jwt_token_ttl": { 2024-09-21T06:39:09.953 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "jwt_token_ttl", 2024-09-21T06:39:09.953 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.953 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.953 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.953 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "28800", 2024-09-21T06:39:09.953 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.953 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.953 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.953 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.953 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.953 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.953 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.954 INFO:teuthology.orchestra.run.smithi063.stdout: "key_file": { 2024-09-21T06:39:09.954 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "key_file", 2024-09-21T06:39:09.954 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.954 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.954 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.954 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.954 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.954 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.954 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.954 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.954 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.954 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.955 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.955 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.955 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.955 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.955 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.955 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.955 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.956 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.956 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.956 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.956 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.956 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.956 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.956 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.956 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.956 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.956 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.956 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.956 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.956 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.957 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.957 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.957 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.957 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.957 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.957 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.957 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.957 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.957 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.958 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.958 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.958 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.958 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.958 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.958 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.958 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.958 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.958 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.958 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.958 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.959 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.959 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.959 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.959 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.959 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.959 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.959 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.959 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.959 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.959 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.960 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.960 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.960 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.960 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.960 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.960 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.960 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.960 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.960 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.960 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.960 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.961 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.961 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.961 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.961 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.961 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.961 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.961 INFO:teuthology.orchestra.run.smithi063.stdout: "motd": { 2024-09-21T06:39:09.961 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "motd", 2024-09-21T06:39:09.961 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.962 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.962 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.962 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.962 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.962 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.962 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.962 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "The message of the day", 2024-09-21T06:39:09.962 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.962 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.963 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.963 INFO:teuthology.orchestra.run.smithi063.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:39:09.963 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:39:09.963 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.963 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.963 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.963 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.963 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.963 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.963 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.963 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.964 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.964 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.964 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.964 INFO:teuthology.orchestra.run.smithi063.stdout: "server_addr": { 2024-09-21T06:39:09.964 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_addr", 2024-09-21T06:39:09.964 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.964 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.964 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.964 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "::", 2024-09-21T06:39:09.964 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.964 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.964 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.965 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.965 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.965 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.965 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.965 INFO:teuthology.orchestra.run.smithi063.stdout: "server_port": { 2024-09-21T06:39:09.965 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_port", 2024-09-21T06:39:09.965 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.965 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.965 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.965 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8080", 2024-09-21T06:39:09.965 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.966 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.966 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.966 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.966 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.966 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.966 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.966 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.966 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.967 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.967 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.967 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.967 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.967 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.967 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.967 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.967 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.968 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.968 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.968 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.968 INFO:teuthology.orchestra.run.smithi063.stdout: "ssl": { 2024-09-21T06:39:09.968 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssl", 2024-09-21T06:39:09.968 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.968 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.969 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.969 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.969 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.969 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.969 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.969 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.969 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.969 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.969 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.970 INFO:teuthology.orchestra.run.smithi063.stdout: "ssl_server_port": { 2024-09-21T06:39:09.970 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssl_server_port", 2024-09-21T06:39:09.970 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.970 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.970 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.970 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8443", 2024-09-21T06:39:09.970 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.970 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.970 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.970 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.970 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.970 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.970 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.971 INFO:teuthology.orchestra.run.smithi063.stdout: "sso_oauth2": { 2024-09-21T06:39:09.971 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sso_oauth2", 2024-09-21T06:39:09.971 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.971 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.971 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.971 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.971 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.971 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.971 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.971 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.971 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.971 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.972 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.972 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_behaviour": { 2024-09-21T06:39:09.972 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_behaviour", 2024-09-21T06:39:09.972 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.972 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.972 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.972 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "redirect", 2024-09-21T06:39:09.972 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.972 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.972 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.972 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.972 INFO:teuthology.orchestra.run.smithi063.stdout: "redirect" 2024-09-21T06:39:09.972 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.973 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.973 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.973 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.973 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.973 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_error_status_code": { 2024-09-21T06:39:09.973 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_error_status_code", 2024-09-21T06:39:09.973 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.973 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.973 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.973 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "500", 2024-09-21T06:39:09.973 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "400", 2024-09-21T06:39:09.973 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "599", 2024-09-21T06:39:09.974 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.974 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.974 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.974 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.974 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.974 INFO:teuthology.orchestra.run.smithi063.stdout: "url_prefix": { 2024-09-21T06:39:09.974 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "url_prefix", 2024-09-21T06:39:09.974 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.974 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.974 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.974 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.974 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.975 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.975 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.975 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.975 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.975 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.975 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.975 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.975 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.975 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "devicehealth", 2024-09-21T06:39:09.975 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.975 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.976 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.976 INFO:teuthology.orchestra.run.smithi063.stdout: "enable_monitoring": { 2024-09-21T06:39:09.976 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enable_monitoring", 2024-09-21T06:39:09.976 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.976 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.976 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.976 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.976 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.976 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.976 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.976 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "monitor device health metrics", 2024-09-21T06:39:09.976 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.976 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.977 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.977 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.977 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.977 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.977 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.977 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.977 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.977 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.977 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.977 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.977 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.977 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.977 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.978 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.978 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.978 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.978 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.978 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.978 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.978 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.978 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.978 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.978 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.978 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.978 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.979 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.979 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.979 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.979 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.979 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.979 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.979 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.979 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.979 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.979 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.979 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.979 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.980 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.980 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.980 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.980 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.980 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.980 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.980 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.980 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.980 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.980 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.980 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.980 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.980 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.981 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.981 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.981 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.981 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.981 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.981 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.981 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.981 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.981 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.981 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.981 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.981 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.982 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.982 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.982 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.982 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.982 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.982 INFO:teuthology.orchestra.run.smithi063.stdout: "mark_out_threshold": { 2024-09-21T06:39:09.982 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mark_out_threshold", 2024-09-21T06:39:09.982 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.982 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.982 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.982 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "2419200", 2024-09-21T06:39:09.982 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.983 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.983 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.983 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:39:09.983 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.983 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.983 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.983 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": { 2024-09-21T06:39:09.983 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pool_name", 2024-09-21T06:39:09.983 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.983 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.984 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.984 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "device_health_metrics", 2024-09-21T06:39:09.984 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.984 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.984 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.984 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:39:09.984 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.984 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.984 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.984 INFO:teuthology.orchestra.run.smithi063.stdout: "retention_period": { 2024-09-21T06:39:09.984 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "retention_period", 2024-09-21T06:39:09.984 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.984 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.984 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.985 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "15552000", 2024-09-21T06:39:09.985 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.985 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.985 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.985 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:39:09.985 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.985 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.985 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.985 INFO:teuthology.orchestra.run.smithi063.stdout: "scrape_frequency": { 2024-09-21T06:39:09.985 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "scrape_frequency", 2024-09-21T06:39:09.985 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.985 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.986 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.986 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "86400", 2024-09-21T06:39:09.986 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.986 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.986 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.986 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:39:09.986 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.986 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.986 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.986 INFO:teuthology.orchestra.run.smithi063.stdout: "self_heal": { 2024-09-21T06:39:09.986 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "self_heal", 2024-09-21T06:39:09.986 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.986 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.986 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.987 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:09.987 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.987 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.987 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.987 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:39:09.987 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.987 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.987 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.987 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-21T06:39:09.987 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-21T06:39:09.987 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.987 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.988 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.988 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-21T06:39:09.988 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.988 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.988 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.988 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:39:09.988 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.988 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.988 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.988 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:09.988 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:09.988 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:09.988 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:09.988 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.989 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:09.989 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.989 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.989 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.989 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.989 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.989 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.989 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.989 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_threshold": { 2024-09-21T06:39:09.989 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_threshold", 2024-09-21T06:39:09.990 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:09.990 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.990 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.990 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "7257600", 2024-09-21T06:39:09.990 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.990 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.990 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.990 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:39:09.990 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.990 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.991 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.991 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.991 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:09.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:09.991 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "diskprediction_local", 2024-09-21T06:39:09.991 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:09.991 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:09.991 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:09.991 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:09.991 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:09.991 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.991 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.991 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.992 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:09.992 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.992 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.992 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.992 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.992 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.992 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.992 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.992 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.992 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.993 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.993 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.993 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.993 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.993 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.993 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:09.993 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:09.993 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.993 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.993 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.993 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.994 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.994 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.994 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.994 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.994 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.994 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.994 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.994 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:09.994 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:09.995 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.995 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.995 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.995 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:09.995 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.995 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.995 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:09.995 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:09.995 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:09.995 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:09.995 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:09.995 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:09.996 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:09.996 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:09.996 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.996 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.996 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.996 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.996 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:09.996 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:09.996 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:09.997 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.997 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:09.997 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:09.997 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.997 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.997 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.997 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.997 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.997 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.997 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.998 INFO:teuthology.orchestra.run.smithi063.stdout: "predict_interval": { 2024-09-21T06:39:09.998 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "predict_interval", 2024-09-21T06:39:09.998 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.998 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.998 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:09.998 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "86400", 2024-09-21T06:39:09.998 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:09.998 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:09.998 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:09.999 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:09.999 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:09.999 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:09.999 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:09.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:09.999 INFO:teuthology.orchestra.run.smithi063.stdout: "predictor_model": { 2024-09-21T06:39:09.999 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "predictor_model", 2024-09-21T06:39:09.999 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:09.999 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:09.999 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.000 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "prophetstor", 2024-09-21T06:39:10.000 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.000 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.000 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.000 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.000 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.000 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.000 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.000 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-21T06:39:10.001 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-21T06:39:10.001 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.001 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.001 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.001 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-21T06:39:10.001 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.001 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.001 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.001 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.002 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.002 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.002 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.002 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.002 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.002 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.002 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.002 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.002 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.003 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.003 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.003 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.003 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.003 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.003 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.003 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.003 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.003 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.003 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "influx", 2024-09-21T06:39:10.003 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": false, 2024-09-21T06:39:10.004 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:39:10.004 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.004 INFO:teuthology.orchestra.run.smithi063.stdout: "batch_size": { 2024-09-21T06:39:10.004 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "batch_size", 2024-09-21T06:39:10.004 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.004 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.004 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.004 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5000", 2024-09-21T06:39:10.004 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.004 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.004 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.004 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:39:10.004 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.005 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.005 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.005 INFO:teuthology.orchestra.run.smithi063.stdout: "database": { 2024-09-21T06:39:10.005 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "database", 2024-09-21T06:39:10.005 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.005 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.005 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.005 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "ceph", 2024-09-21T06:39:10.005 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.005 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.005 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.005 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:39:10.006 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.006 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.006 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.006 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": { 2024-09-21T06:39:10.006 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "hostname", 2024-09-21T06:39:10.006 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.006 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.006 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.006 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.006 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.006 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.006 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.007 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:39:10.007 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.007 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.007 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.007 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-21T06:39:10.007 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-21T06:39:10.007 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:10.007 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.007 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.007 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "30", 2024-09-21T06:39:10.007 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "5", 2024-09-21T06:39:10.007 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.007 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.008 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:39:10.008 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.008 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.008 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.008 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.008 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.008 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.008 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.008 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.008 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.008 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.008 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.008 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.009 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.009 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.009 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.009 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.009 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.009 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.009 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.009 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.009 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.009 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.009 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.009 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.010 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.010 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.010 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.010 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.010 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.010 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.010 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.010 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.010 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.010 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.010 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.010 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.010 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.011 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.011 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.011 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.011 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.011 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.011 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.011 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.011 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.011 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.011 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.011 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.011 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.011 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.012 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.012 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.012 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.012 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.012 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.012 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.012 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.012 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.012 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.012 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.012 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.012 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.012 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.013 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.013 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.013 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.013 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.013 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.013 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.013 INFO:teuthology.orchestra.run.smithi063.stdout: "password": { 2024-09-21T06:39:10.013 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "password", 2024-09-21T06:39:10.013 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.013 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.013 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.013 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.013 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.014 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.014 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.014 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:39:10.014 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.014 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.014 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.014 INFO:teuthology.orchestra.run.smithi063.stdout: "port": { 2024-09-21T06:39:10.014 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "port", 2024-09-21T06:39:10.014 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.014 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.014 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.014 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8086", 2024-09-21T06:39:10.014 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.015 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.015 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.015 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "InfluxDB server port", 2024-09-21T06:39:10.015 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.015 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.015 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.015 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.015 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.015 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.015 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.015 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.015 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.015 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.016 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.016 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.016 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.016 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.016 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.016 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.016 INFO:teuthology.orchestra.run.smithi063.stdout: "ssl": { 2024-09-21T06:39:10.016 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssl", 2024-09-21T06:39:10.016 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.016 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.016 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.016 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "false", 2024-09-21T06:39:10.017 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.017 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.017 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.017 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:39:10.017 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.017 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.017 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.017 INFO:teuthology.orchestra.run.smithi063.stdout: "threads": { 2024-09-21T06:39:10.017 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "threads", 2024-09-21T06:39:10.017 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.017 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.017 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.017 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-21T06:39:10.018 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-21T06:39:10.018 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "32", 2024-09-21T06:39:10.018 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.018 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:39:10.018 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.018 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.018 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.018 INFO:teuthology.orchestra.run.smithi063.stdout: "username": { 2024-09-21T06:39:10.018 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "username", 2024-09-21T06:39:10.018 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.018 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.019 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.019 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.019 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.019 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.019 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.019 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:39:10.019 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.019 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.019 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.019 INFO:teuthology.orchestra.run.smithi063.stdout: "verify_ssl": { 2024-09-21T06:39:10.019 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "verify_ssl", 2024-09-21T06:39:10.019 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.019 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.020 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.020 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "true", 2024-09-21T06:39:10.020 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.020 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.020 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.020 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:39:10.020 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.020 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.020 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.020 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.020 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.020 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "insights", 2024-09-21T06:39:10.021 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.021 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.021 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.021 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.021 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.021 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.021 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.021 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.021 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.021 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.021 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.021 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.021 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.021 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.022 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.022 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.022 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.022 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.022 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.022 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.022 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.022 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.022 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.023 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.023 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.023 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.023 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.023 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.023 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.023 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.023 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.023 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.023 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.023 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.024 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.024 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.024 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.024 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.024 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.024 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.024 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.024 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.024 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.024 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.025 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.025 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.025 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.025 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.025 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.025 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.025 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.025 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.025 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.025 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.025 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.025 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.026 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.026 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.026 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.026 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.026 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.026 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.026 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.026 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.026 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.027 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.027 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.027 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.027 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.027 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.027 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.027 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.027 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.027 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.027 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.027 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.028 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.028 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.028 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.028 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.028 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.028 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.028 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.028 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.029 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "iostat", 2024-09-21T06:39:10.029 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.029 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.029 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.029 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.029 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.029 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.029 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.029 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.029 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.029 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.029 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.030 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.030 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.030 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.030 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.030 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.030 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.030 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.030 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.030 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.030 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.031 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.031 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.031 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.031 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.031 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.031 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.031 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.031 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.031 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.032 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.032 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.032 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.032 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.032 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.032 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.032 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.032 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.032 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.032 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.032 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.033 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.033 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.033 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.033 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.033 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.033 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.033 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.033 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.033 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.033 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.033 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.033 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.033 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.033 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.034 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.034 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.034 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.034 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.034 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.034 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.034 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.034 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.034 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.034 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.034 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.034 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.035 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.035 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.035 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.035 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.035 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.035 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.035 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.036 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.036 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.036 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.036 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.036 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.036 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.036 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.036 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.037 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.037 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.037 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "k8sevents", 2024-09-21T06:39:10.037 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.037 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.037 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.038 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_event_retention_days": { 2024-09-21T06:39:10.038 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:39:10.038 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.038 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.038 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.038 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "7", 2024-09-21T06:39:10.038 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.038 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.038 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.038 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:39:10.038 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.038 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.038 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.039 INFO:teuthology.orchestra.run.smithi063.stdout: "config_check_secs": { 2024-09-21T06:39:10.039 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "config_check_secs", 2024-09-21T06:39:10.039 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.039 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.039 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.039 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:10.039 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "10", 2024-09-21T06:39:10.039 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.039 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.039 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:39:10.039 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.040 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.040 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.040 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.040 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.040 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.040 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.040 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.040 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.040 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.040 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.040 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.040 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.040 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.041 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.041 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.041 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.041 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.041 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.041 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.041 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.041 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.041 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.041 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.041 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.041 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.041 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.042 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.042 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.042 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.042 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.042 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.042 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.042 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.042 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.042 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.042 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.042 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.042 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.042 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.043 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.043 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.043 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.043 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.043 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.043 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.043 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.043 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.043 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.043 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.043 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.043 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.043 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.043 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.044 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.044 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.044 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.044 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.044 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.044 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.044 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.044 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.044 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.044 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.044 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.044 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.044 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.045 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.045 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.045 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.045 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.045 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.045 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.045 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.045 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.045 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.045 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.045 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.045 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.045 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.046 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.046 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.046 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.046 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.046 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "localpool", 2024-09-21T06:39:10.046 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.046 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.046 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.046 INFO:teuthology.orchestra.run.smithi063.stdout: "failure_domain": { 2024-09-21T06:39:10.046 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "failure_domain", 2024-09-21T06:39:10.046 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.047 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.047 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.047 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "host", 2024-09-21T06:39:10.047 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.047 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.047 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.047 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:39:10.047 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:39:10.047 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.047 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.047 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.047 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.047 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.048 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.048 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.048 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.048 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.048 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.048 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.048 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.048 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.048 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.048 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.048 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.048 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.048 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.049 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.049 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.049 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.049 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.049 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.049 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.049 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.049 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.049 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.049 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.049 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.049 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.049 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.049 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.050 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.050 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.050 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.050 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.050 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.050 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.050 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.050 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.050 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.050 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.050 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.050 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.050 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.051 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.051 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.051 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.051 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.051 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.051 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.051 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.051 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.051 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.051 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.051 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.051 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.052 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.052 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.052 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.052 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.052 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.052 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.052 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.052 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.052 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.052 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.052 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.052 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": { 2024-09-21T06:39:10.053 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "min_size", 2024-09-21T06:39:10.053 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.053 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.053 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.053 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.053 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.053 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.053 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.053 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:39:10.053 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:39:10.053 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.053 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.053 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rep": { 2024-09-21T06:39:10.054 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "num_rep", 2024-09-21T06:39:10.054 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.054 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.054 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.054 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3", 2024-09-21T06:39:10.054 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.054 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.054 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.054 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:39:10.054 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.054 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.054 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.055 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": { 2024-09-21T06:39:10.055 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pg_num", 2024-09-21T06:39:10.055 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.055 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.055 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.055 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "128", 2024-09-21T06:39:10.055 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.055 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.055 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.055 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:39:10.055 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.055 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.056 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.056 INFO:teuthology.orchestra.run.smithi063.stdout: "prefix": { 2024-09-21T06:39:10.056 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "prefix", 2024-09-21T06:39:10.056 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.056 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.056 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.056 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.056 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.056 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.056 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.056 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:39:10.056 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.057 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.057 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.057 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.057 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.057 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.057 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.057 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.057 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.057 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.057 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.057 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.058 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.058 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.058 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.058 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.058 INFO:teuthology.orchestra.run.smithi063.stdout: "subtree": { 2024-09-21T06:39:10.058 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "subtree", 2024-09-21T06:39:10.058 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.058 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.059 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.059 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "rack", 2024-09-21T06:39:10.059 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.059 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.059 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.059 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:39:10.059 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:39:10.059 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.059 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.059 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.059 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.060 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mds_autoscaler", 2024-09-21T06:39:10.060 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.060 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.060 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.060 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.060 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.060 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.060 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.061 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.061 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.061 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.061 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.061 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.061 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.061 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.061 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.061 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.061 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.061 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.061 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.061 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.062 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.062 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.062 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.062 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.062 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.062 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.062 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.062 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.063 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.063 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.063 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.063 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.063 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.063 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.063 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.063 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.063 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.063 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.064 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.064 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.064 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.064 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.064 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.064 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.064 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.064 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.064 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.064 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.065 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.065 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.065 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.065 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.065 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.065 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.065 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.065 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.065 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.065 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.066 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.066 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.066 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.066 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.066 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.066 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.066 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.066 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.066 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.066 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.067 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.067 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.067 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.067 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.067 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.067 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.067 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.067 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.067 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.068 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.068 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.068 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.068 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.068 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.068 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.068 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.069 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mirroring", 2024-09-21T06:39:10.069 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.069 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.069 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.069 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.069 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.069 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.069 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.069 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.070 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.070 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.070 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.070 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.070 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.070 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.070 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.070 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.070 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.070 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.070 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.071 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.071 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.071 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.071 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.071 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.071 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.071 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.071 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.071 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.071 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.071 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.071 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.071 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.072 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.072 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.072 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.072 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.072 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.072 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.072 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.072 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.072 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.072 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.072 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.072 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.072 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.073 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.073 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.073 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.073 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.073 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.073 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.073 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.073 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.073 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.073 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.073 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.073 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.073 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.074 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.074 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.074 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.074 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.074 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.074 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.074 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.074 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.074 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.074 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.074 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.074 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.075 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.075 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.075 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.075 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.075 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.075 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.075 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.075 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.075 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.075 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.075 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.075 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.075 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.075 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.076 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "nfs", 2024-09-21T06:39:10.076 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.076 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.076 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.076 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.076 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.076 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.076 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.076 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.076 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.076 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.076 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.077 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.077 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.077 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.077 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.077 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.077 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.077 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.077 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.077 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.077 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.077 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.077 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.078 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.078 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.078 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.078 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.078 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.078 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.078 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.078 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.078 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.078 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.078 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.078 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.078 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.079 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.079 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.079 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.079 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.079 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.079 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.079 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.079 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.079 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.079 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.079 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.079 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.079 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.080 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.080 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.080 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.080 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.080 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.080 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.080 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.080 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.080 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.080 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.080 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.080 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.081 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.081 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.081 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.081 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.081 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.081 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.081 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.081 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.081 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.081 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.081 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.082 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.082 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.082 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.082 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.082 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.082 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.082 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.082 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.082 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.082 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.082 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.082 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.083 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "orchestrator", 2024-09-21T06:39:10.083 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.083 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.083 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.083 INFO:teuthology.orchestra.run.smithi063.stdout: "fail_fs": { 2024-09-21T06:39:10.083 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "fail_fs", 2024-09-21T06:39:10.083 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.083 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.083 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.083 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.083 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.083 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.083 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.084 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:39:10.084 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.084 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.084 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.084 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.084 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.084 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.084 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.084 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.084 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.084 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.084 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.084 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.085 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.085 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.085 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.085 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.085 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.085 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.085 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.085 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.085 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.085 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.085 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.085 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.086 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.086 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.086 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.086 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.086 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.086 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.086 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.086 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.086 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.086 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.086 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.086 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.086 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.087 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.087 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.087 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.087 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.087 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.087 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.087 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.087 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.087 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.087 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.087 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.087 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.087 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.087 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.088 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.088 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.088 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.088 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.088 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.088 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.088 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.088 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.088 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.088 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.088 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.088 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.089 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.089 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.089 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.089 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.089 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.089 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.089 INFO:teuthology.orchestra.run.smithi063.stdout: "orchestrator": { 2024-09-21T06:39:10.089 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "orchestrator", 2024-09-21T06:39:10.089 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.089 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.089 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.089 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.090 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.090 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.090 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.090 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm", 2024-09-21T06:39:10.090 INFO:teuthology.orchestra.run.smithi063.stdout: "rook", 2024-09-21T06:39:10.090 INFO:teuthology.orchestra.run.smithi063.stdout: "test_orchestrator" 2024-09-21T06:39:10.090 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.090 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Orchestrator backend", 2024-09-21T06:39:10.090 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.090 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.090 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.090 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.091 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.091 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.091 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.091 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.091 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.091 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.091 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.091 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.091 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.092 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.092 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.092 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.092 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.092 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.092 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "osd_perf_query", 2024-09-21T06:39:10.092 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.092 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.092 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.092 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.092 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.092 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.093 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.093 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.093 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.093 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.093 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.093 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.093 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.093 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.094 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.094 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.094 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.094 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.094 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.094 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.094 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.094 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.094 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.094 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.094 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.095 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.095 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.095 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.095 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.095 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.095 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.095 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.095 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.095 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.095 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.096 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.096 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.096 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.096 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.096 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.096 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.096 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.096 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.096 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.096 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.096 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.097 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.097 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.097 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.097 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.097 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.097 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.097 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.097 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.097 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.097 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.098 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.098 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.098 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.098 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.098 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.098 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.098 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.098 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.098 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.099 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.099 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.099 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.099 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.099 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.099 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.099 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.099 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.099 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.100 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.100 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.100 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.100 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.100 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.100 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.100 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.100 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.100 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.100 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.101 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "osd_support", 2024-09-21T06:39:10.101 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.101 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.101 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.101 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.101 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.101 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.101 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.102 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.102 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.102 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.102 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.102 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.102 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.102 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.102 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.102 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.102 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.103 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.103 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.103 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.103 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.103 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.103 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.103 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.103 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.103 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.103 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.103 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.104 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.104 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.104 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.104 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.104 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.104 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.104 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.104 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.104 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.104 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.104 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.105 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.105 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.105 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.105 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.105 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.105 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.105 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.105 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.105 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.106 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.106 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.106 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.106 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.106 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.106 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.106 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.106 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.106 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.106 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.106 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.106 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.106 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.107 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.107 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.107 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.107 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.107 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.107 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.107 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.107 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.107 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.107 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.107 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.107 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.108 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.108 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.108 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.108 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.108 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.108 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.108 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.108 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.108 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.108 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.108 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.108 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pg_autoscaler", 2024-09-21T06:39:10.108 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.109 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.109 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.109 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.109 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.109 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.109 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.109 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.109 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.109 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.109 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.109 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.109 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.109 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.109 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.110 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.110 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.110 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.110 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.110 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.110 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.110 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.110 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.110 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.110 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.110 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.110 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.111 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.111 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.111 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.111 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.111 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.111 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.111 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.111 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.111 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.111 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.111 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.111 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.111 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.112 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.112 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.112 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.112 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.112 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.112 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.112 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.112 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.112 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.112 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.112 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.112 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.112 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.112 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.113 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.113 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.113 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.113 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.113 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.113 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.113 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.113 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.113 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.113 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.113 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.113 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.113 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.114 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.114 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.114 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-21T06:39:10.114 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-21T06:39:10.114 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:10.114 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.114 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.114 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-21T06:39:10.114 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.114 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.114 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.115 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.115 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.115 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.115 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.115 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.115 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.115 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.115 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.115 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.115 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.115 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.115 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.115 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.116 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.116 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.116 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.116 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.116 INFO:teuthology.orchestra.run.smithi063.stdout: "threshold": { 2024-09-21T06:39:10.116 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "threshold", 2024-09-21T06:39:10.116 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:10.116 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.116 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.116 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3.0", 2024-09-21T06:39:10.116 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1.0", 2024-09-21T06:39:10.116 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.117 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.117 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "scaling threshold", 2024-09-21T06:39:10.117 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:39:10.117 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.117 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.117 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.117 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.117 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "progress", 2024-09-21T06:39:10.117 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.117 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.117 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.118 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_pg_recovery_event": { 2024-09-21T06:39:10.118 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:39:10.118 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.118 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.118 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.118 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.118 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.118 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.118 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.118 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:39:10.118 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.118 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.118 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.119 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": { 2024-09-21T06:39:10.119 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enabled", 2024-09-21T06:39:10.119 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.119 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.119 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.119 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:10.119 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.119 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.119 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.119 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.119 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.119 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.120 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.120 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.120 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.120 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.120 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.120 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.120 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.120 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.120 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.120 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.120 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.120 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.120 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.121 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.121 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.121 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.121 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.121 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.121 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.121 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.121 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.121 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.121 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.121 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.121 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.121 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.122 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.122 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.122 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.122 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.122 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.122 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.122 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.122 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.122 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.122 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.122 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.122 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.123 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.123 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.123 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.123 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.123 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.123 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.123 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.123 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.123 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.123 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.123 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.123 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.123 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.123 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.124 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.124 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.124 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.124 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.124 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.124 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.124 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.124 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.124 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.124 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.124 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.124 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.124 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.125 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.125 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.125 INFO:teuthology.orchestra.run.smithi063.stdout: "max_completed_events": { 2024-09-21T06:39:10.125 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_completed_events", 2024-09-21T06:39:10.125 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.125 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.125 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.125 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "50", 2024-09-21T06:39:10.125 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.125 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.125 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.125 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:39:10.126 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.126 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.126 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.126 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-21T06:39:10.126 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-21T06:39:10.126 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:10.126 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.126 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.127 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-21T06:39:10.127 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.127 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.127 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.127 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:39:10.127 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.127 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.127 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.127 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.127 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.127 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.127 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.128 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.128 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.128 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.128 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.128 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.128 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.128 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.128 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.129 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.129 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.129 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.129 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "prometheus", 2024-09-21T06:39:10.129 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.129 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.129 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.129 INFO:teuthology.orchestra.run.smithi063.stdout: "cache": { 2024-09-21T06:39:10.129 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cache", 2024-09-21T06:39:10.129 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.129 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.129 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.129 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:10.130 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.130 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.130 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.130 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.130 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.130 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.130 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.130 INFO:teuthology.orchestra.run.smithi063.stdout: "exclude_perf_counters": { 2024-09-21T06:39:10.131 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "exclude_perf_counters", 2024-09-21T06:39:10.131 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.131 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.131 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.131 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:10.131 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.131 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.131 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.131 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:39:10.131 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:39:10.131 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.131 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.132 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.132 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.132 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.132 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.132 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.132 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.132 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.132 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.133 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.133 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.133 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.133 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.133 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.133 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.133 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.133 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.133 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.133 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.133 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.134 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.134 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.134 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.134 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.134 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.134 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.134 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.135 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.135 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.135 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.135 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.135 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.135 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.135 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.135 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.135 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.136 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.136 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.136 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.136 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.136 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.136 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.136 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.136 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.136 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.136 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.137 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.137 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.137 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.137 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.137 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.137 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.137 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.137 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.138 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.138 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.138 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.138 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.138 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.138 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.138 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.138 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.138 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.138 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.139 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.139 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.139 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.139 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_stats_pools": { 2024-09-21T06:39:10.139 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd_stats_pools", 2024-09-21T06:39:10.139 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.139 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.139 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.139 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.139 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.139 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.139 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.139 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.140 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.140 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.140 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.140 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:39:10.140 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:39:10.140 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.140 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.140 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.140 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "300", 2024-09-21T06:39:10.140 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.140 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.140 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.141 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.141 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.141 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.141 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.141 INFO:teuthology.orchestra.run.smithi063.stdout: "scrape_interval": { 2024-09-21T06:39:10.141 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "scrape_interval", 2024-09-21T06:39:10.141 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:10.141 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.141 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.141 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "15.0", 2024-09-21T06:39:10.141 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.141 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.141 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.142 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.142 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.142 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.142 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.142 INFO:teuthology.orchestra.run.smithi063.stdout: "server_addr": { 2024-09-21T06:39:10.142 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_addr", 2024-09-21T06:39:10.142 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.142 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.142 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.142 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "::", 2024-09-21T06:39:10.142 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.142 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.143 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.143 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:39:10.143 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.143 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.143 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.143 INFO:teuthology.orchestra.run.smithi063.stdout: "server_port": { 2024-09-21T06:39:10.143 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_port", 2024-09-21T06:39:10.143 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.143 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.143 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.143 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "9283", 2024-09-21T06:39:10.143 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.144 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.144 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.144 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:39:10.144 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.144 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.144 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.144 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.144 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.144 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.144 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.144 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.144 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.144 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.145 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.145 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.145 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.145 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.145 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.145 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.145 INFO:teuthology.orchestra.run.smithi063.stdout: "stale_cache_strategy": { 2024-09-21T06:39:10.145 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "stale_cache_strategy", 2024-09-21T06:39:10.145 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.145 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.145 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.145 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "log", 2024-09-21T06:39:10.145 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.146 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.146 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.146 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.146 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.146 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.146 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.146 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_behaviour": { 2024-09-21T06:39:10.146 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_behaviour", 2024-09-21T06:39:10.146 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.146 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.146 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.146 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "default", 2024-09-21T06:39:10.147 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.147 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.147 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.147 INFO:teuthology.orchestra.run.smithi063.stdout: "default", 2024-09-21T06:39:10.147 INFO:teuthology.orchestra.run.smithi063.stdout: "error" 2024-09-21T06:39:10.147 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.147 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.147 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.147 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.147 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.147 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_error_status_code": { 2024-09-21T06:39:10.147 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_error_status_code", 2024-09-21T06:39:10.148 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.148 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.148 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.148 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "500", 2024-09-21T06:39:10.148 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "400", 2024-09-21T06:39:10.148 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "599", 2024-09-21T06:39:10.148 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.148 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.148 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.148 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.148 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.148 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.148 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.149 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd_support", 2024-09-21T06:39:10.149 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.149 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.149 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.149 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.149 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.149 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.149 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.149 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.149 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.149 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.149 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.150 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.150 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.150 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.150 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.150 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.150 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.150 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.150 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.150 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.150 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.150 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.150 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.151 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.151 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.151 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.151 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.151 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.151 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.151 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.151 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.151 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.151 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.151 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.151 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.152 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.152 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.152 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.152 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.152 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.152 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.152 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.152 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.152 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.153 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.153 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.153 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.153 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.153 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.153 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.153 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.153 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.153 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.153 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.153 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.153 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.153 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.154 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.154 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.154 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.154 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.154 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.154 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.154 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.154 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.154 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.154 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.154 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.154 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.155 INFO:teuthology.orchestra.run.smithi063.stdout: "max_concurrent_snap_create": { 2024-09-21T06:39:10.155 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:39:10.155 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.155 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.155 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.155 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-21T06:39:10.155 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.155 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.155 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.155 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.155 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.156 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.156 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.156 INFO:teuthology.orchestra.run.smithi063.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:39:10.156 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:39:10.156 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.156 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.156 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.156 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.156 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.156 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.156 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.156 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.156 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi063.stdout: "trash_purge_schedule": { 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "trash_purge_schedule", 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "restful", 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi063.stdout: "enable_auth": { 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enable_auth", 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi063.stdout: "key_file": { 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "key_file", 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.164 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.164 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.164 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.164 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.164 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.164 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.164 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.164 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.164 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.165 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.165 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.165 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.165 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.165 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.165 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.165 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.165 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.165 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.165 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.165 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.165 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.165 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.167 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.167 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.167 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.167 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.167 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.167 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.167 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.167 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.167 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.168 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.168 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.168 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.168 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.168 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.168 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.168 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.168 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.168 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.168 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.169 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.169 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.169 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.169 INFO:teuthology.orchestra.run.smithi063.stdout: "max_requests": { 2024-09-21T06:39:10.169 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_requests", 2024-09-21T06:39:10.169 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.169 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.169 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.169 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "500", 2024-09-21T06:39:10.170 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.170 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.170 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.170 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:39:10.170 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.170 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.170 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.170 INFO:teuthology.orchestra.run.smithi063.stdout: "server_addr": { 2024-09-21T06:39:10.170 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_addr", 2024-09-21T06:39:10.171 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.171 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.171 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.171 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.171 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.171 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.171 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.171 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.171 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.171 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.171 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.171 INFO:teuthology.orchestra.run.smithi063.stdout: "server_port": { 2024-09-21T06:39:10.172 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_port", 2024-09-21T06:39:10.172 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.172 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.172 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.172 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.172 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.172 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.172 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.172 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.172 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.172 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.172 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.173 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.173 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.173 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.173 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.173 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.173 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.173 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.173 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.173 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.173 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.173 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.173 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.173 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.174 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.174 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.174 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rgw", 2024-09-21T06:39:10.174 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.174 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.174 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.174 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.174 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.174 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.174 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.174 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.175 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.175 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.175 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.175 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.175 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.175 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.175 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.175 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.175 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.175 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.175 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.175 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.175 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.176 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.176 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.176 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.176 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.176 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.176 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.176 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.176 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.176 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.176 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.176 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.176 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.176 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.177 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.177 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.177 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.177 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.177 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.177 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.177 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.177 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.177 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.177 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.177 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.177 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.177 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi063.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:39:10.180 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.180 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.180 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.180 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-21T06:39:10.180 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.180 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.180 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.180 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:39:10.180 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.180 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.180 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.180 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.181 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.181 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.181 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.181 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.181 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.181 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.181 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.181 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.181 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.181 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.181 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.181 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.181 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.181 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.182 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rook", 2024-09-21T06:39:10.182 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.182 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.182 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.182 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.182 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.182 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.182 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.182 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.182 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.182 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.183 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.183 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.183 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.183 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.183 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.183 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.183 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.183 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.183 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.183 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.183 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.183 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.183 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi063.stdout: "storage_class": { 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "storage_class", 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "local", 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "selftest", 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.192 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.192 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.192 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.192 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.192 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.192 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.192 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.192 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.192 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.192 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.192 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.192 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.192 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.194 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.194 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.194 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.194 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.194 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.194 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.194 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.194 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.194 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.195 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.195 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.195 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.195 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.195 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.195 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.195 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.195 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.195 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.195 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.196 INFO:teuthology.orchestra.run.smithi063.stdout: "roption1": { 2024-09-21T06:39:10.196 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "roption1", 2024-09-21T06:39:10.196 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.196 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.196 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.196 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.196 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.196 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.196 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.196 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.197 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.197 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.197 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.197 INFO:teuthology.orchestra.run.smithi063.stdout: "roption2": { 2024-09-21T06:39:10.197 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "roption2", 2024-09-21T06:39:10.197 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.197 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.197 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.197 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "xyz", 2024-09-21T06:39:10.197 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.197 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.197 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.198 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.198 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.198 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.198 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.198 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption1": { 2024-09-21T06:39:10.198 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption1", 2024-09-21T06:39:10.198 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.198 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.199 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.199 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.199 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.199 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.199 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.199 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.199 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.199 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.199 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.199 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption2": { 2024-09-21T06:39:10.200 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption2", 2024-09-21T06:39:10.200 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.200 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.200 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.200 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.200 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.200 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.200 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.200 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.200 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.200 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.201 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.201 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption3": { 2024-09-21T06:39:10.201 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption3", 2024-09-21T06:39:10.201 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-21T06:39:10.201 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.201 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.201 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.201 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.201 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.201 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.202 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.202 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.202 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.202 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.202 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption4": { 2024-09-21T06:39:10.202 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption4", 2024-09-21T06:39:10.202 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.202 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.202 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.203 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.203 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.203 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.203 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.203 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.203 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.203 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.203 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.203 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption5": { 2024-09-21T06:39:10.204 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption5", 2024-09-21T06:39:10.204 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.204 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.204 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.204 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.204 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.204 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.204 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.205 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.205 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.205 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.205 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.205 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption6": { 2024-09-21T06:39:10.205 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption6", 2024-09-21T06:39:10.205 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.205 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.206 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.206 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:10.206 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.206 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.206 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.206 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.206 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.206 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.206 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.206 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption7": { 2024-09-21T06:39:10.206 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption7", 2024-09-21T06:39:10.207 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.207 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.207 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.207 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.207 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-21T06:39:10.207 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "42", 2024-09-21T06:39:10.207 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.207 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.207 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.207 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.207 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.207 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.207 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.208 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.208 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.208 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.208 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.208 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.208 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.208 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.208 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.208 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.208 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.208 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.208 INFO:teuthology.orchestra.run.smithi063.stdout: "testkey": { 2024-09-21T06:39:10.209 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "testkey", 2024-09-21T06:39:10.209 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.209 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.209 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.209 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.209 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.209 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.209 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.209 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.209 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.209 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.209 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.209 INFO:teuthology.orchestra.run.smithi063.stdout: "testlkey": { 2024-09-21T06:39:10.210 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "testlkey", 2024-09-21T06:39:10.210 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.210 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.210 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.210 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.210 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.210 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.210 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.210 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.210 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.210 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.210 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.211 INFO:teuthology.orchestra.run.smithi063.stdout: "testnewline": { 2024-09-21T06:39:10.211 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "testnewline", 2024-09-21T06:39:10.211 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.211 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.211 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.211 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.211 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.211 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.211 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.211 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.211 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.211 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.211 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.212 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.212 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.212 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smb", 2024-09-21T06:39:10.212 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.212 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.212 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.212 INFO:teuthology.orchestra.run.smithi063.stdout: "internal_store_backend": { 2024-09-21T06:39:10.212 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "internal_store_backend", 2024-09-21T06:39:10.212 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.212 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.213 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.213 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.213 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.213 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.213 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.213 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:39:10.213 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.213 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.213 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.213 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.213 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.213 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.213 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.214 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.214 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.214 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.214 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.214 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.214 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.214 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.214 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.214 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.214 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.214 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.214 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.214 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.215 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.215 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.215 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.215 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.215 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.215 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.215 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.215 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.215 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.215 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.215 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.215 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.216 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.216 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.216 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.216 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.216 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.216 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.216 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.216 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.216 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.216 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.216 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.216 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.217 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.217 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.217 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.217 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.217 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.217 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.217 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.217 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.217 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.217 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.217 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.217 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.218 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.218 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.218 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.218 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.218 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.218 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.218 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.218 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.218 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.218 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.218 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.218 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.218 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.219 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.219 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.219 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.219 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.219 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.219 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.219 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.219 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.219 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.219 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.219 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.219 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.219 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.220 INFO:teuthology.orchestra.run.smithi063.stdout: "update_orchestration": { 2024-09-21T06:39:10.220 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "update_orchestration", 2024-09-21T06:39:10.220 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.220 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.220 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.220 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:10.220 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.220 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.220 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.220 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:39:10.220 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.221 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.221 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.221 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.221 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.221 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "snap_schedule", 2024-09-21T06:39:10.221 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.221 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.221 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.221 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_m_granularity": { 2024-09-21T06:39:10.221 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "allow_m_granularity", 2024-09-21T06:39:10.221 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.222 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.222 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.222 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.222 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.222 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.222 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.222 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:39:10.222 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.222 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.222 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.222 INFO:teuthology.orchestra.run.smithi063.stdout: "dump_on_update": { 2024-09-21T06:39:10.222 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "dump_on_update", 2024-09-21T06:39:10.222 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.223 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.223 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.223 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.223 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.223 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.223 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.223 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:39:10.223 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.223 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.223 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.223 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.223 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.224 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.224 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.224 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.224 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.224 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.224 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.224 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.224 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.224 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.224 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.224 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.224 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.224 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.224 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.224 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.225 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.225 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.225 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.225 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.225 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.225 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.225 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.225 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.225 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.225 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.225 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.225 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.225 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.225 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.226 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.226 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.226 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.226 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.226 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.226 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.226 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.226 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.226 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.227 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.227 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.227 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.227 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.227 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.227 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.227 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.227 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.227 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.227 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.227 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.227 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.228 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.228 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.228 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.228 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.228 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.228 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.228 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.228 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.228 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.228 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.229 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.229 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.229 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.229 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.229 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.229 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.229 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.229 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.229 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.229 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.230 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.230 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.230 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.230 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.230 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.230 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.230 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.230 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.230 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.230 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "stats", 2024-09-21T06:39:10.231 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.231 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.231 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.231 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.231 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.231 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.231 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.231 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.231 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.231 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.231 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.232 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.232 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.232 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.232 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.232 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.232 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.232 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.232 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.232 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.232 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.233 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.233 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.233 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.233 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.233 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.233 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.233 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.233 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.233 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.233 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.233 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.233 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.234 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.234 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.234 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.234 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.234 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.234 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.234 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.234 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.234 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.235 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.235 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.235 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.235 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.235 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.235 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.235 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.235 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.235 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.235 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.235 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.235 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.236 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.236 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.236 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.236 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.236 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.236 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.236 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.236 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.237 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.237 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.237 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.237 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.237 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.237 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.237 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.238 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.238 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.238 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.238 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.238 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.238 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.238 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.238 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.239 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.239 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.239 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.239 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.239 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.239 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.239 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.239 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "status", 2024-09-21T06:39:10.239 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.239 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.240 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.240 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.240 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.240 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.240 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.240 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.240 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.240 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.240 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.240 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.240 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.240 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.240 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.240 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.241 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.241 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.241 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.241 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.241 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.241 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.241 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.241 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.241 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.241 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.241 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.242 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.242 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.242 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.242 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.242 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.242 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.242 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.242 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.242 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.242 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.242 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.242 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.243 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.243 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.243 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.243 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.243 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.243 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.243 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.243 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.243 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.243 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.243 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.243 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.243 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.243 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.244 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.244 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.244 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.244 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.244 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.244 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.244 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.244 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.244 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.244 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.244 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.244 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.245 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.245 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.245 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.245 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.245 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.245 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.245 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.245 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.245 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.245 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.245 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.245 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.245 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.246 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.246 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.246 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.246 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.246 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.246 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.246 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "telegraf", 2024-09-21T06:39:10.246 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.246 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.246 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.246 INFO:teuthology.orchestra.run.smithi063.stdout: "address": { 2024-09-21T06:39:10.247 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "address", 2024-09-21T06:39:10.247 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.247 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.247 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.247 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:39:10.247 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.247 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.247 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.247 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.247 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.247 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.247 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.247 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-21T06:39:10.248 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-21T06:39:10.248 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:10.248 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.248 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.248 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "15", 2024-09-21T06:39:10.248 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.248 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.248 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.248 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.248 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.248 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.248 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.249 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.249 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.249 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.249 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.249 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.249 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.249 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.249 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.249 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.249 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.249 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.249 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.249 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.250 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.250 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.250 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.250 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.250 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.250 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.250 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.250 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.250 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.250 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.250 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.250 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.251 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.251 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.251 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.251 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.251 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.251 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.251 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.251 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.251 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.251 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.251 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.251 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.251 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.252 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.252 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.252 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.252 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.252 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.252 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.252 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.252 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.252 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.252 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.252 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.252 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.252 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.253 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.253 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.253 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.253 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.253 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.253 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.253 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.253 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.253 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.253 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.253 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.253 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.253 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.254 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.254 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.254 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.254 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.254 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.254 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.254 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.254 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.254 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.254 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.254 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.254 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.255 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.255 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.255 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.255 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.255 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.255 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "telemetry", 2024-09-21T06:39:10.255 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.255 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.255 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.255 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_basic": { 2024-09-21T06:39:10.256 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_basic", 2024-09-21T06:39:10.256 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.256 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.256 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.256 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:10.256 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.256 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.256 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.256 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:39:10.256 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.256 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.256 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.257 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_crash": { 2024-09-21T06:39:10.257 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_crash", 2024-09-21T06:39:10.257 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.257 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.257 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.257 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:10.257 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.257 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.257 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.257 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:39:10.257 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.257 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.257 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.257 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_device": { 2024-09-21T06:39:10.258 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_device", 2024-09-21T06:39:10.258 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.258 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.258 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.258 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:10.258 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.258 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.258 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.258 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:39:10.258 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.258 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.258 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.259 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_ident": { 2024-09-21T06:39:10.259 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_ident", 2024-09-21T06:39:10.259 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.259 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.259 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.259 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.259 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.259 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.259 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.260 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:39:10.260 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.260 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.260 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.260 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_perf": { 2024-09-21T06:39:10.260 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_perf", 2024-09-21T06:39:10.260 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.260 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.260 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.260 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.260 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.260 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.260 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.261 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:39:10.261 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.261 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.261 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.261 INFO:teuthology.orchestra.run.smithi063.stdout: "contact": { 2024-09-21T06:39:10.261 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "contact", 2024-09-21T06:39:10.261 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.262 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.262 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.262 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.262 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.262 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.262 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.262 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.262 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.262 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.262 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.262 INFO:teuthology.orchestra.run.smithi063.stdout: "description": { 2024-09-21T06:39:10.262 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "description", 2024-09-21T06:39:10.262 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.263 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.263 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.263 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.263 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.263 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.263 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.263 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.263 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.263 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.263 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.263 INFO:teuthology.orchestra.run.smithi063.stdout: "device_url": { 2024-09-21T06:39:10.263 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_url", 2024-09-21T06:39:10.263 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.264 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.264 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.264 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:39:10.264 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.264 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.264 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.264 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.264 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.264 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.264 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.264 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": { 2024-09-21T06:39:10.265 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enabled", 2024-09-21T06:39:10.265 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.265 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.265 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.265 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.265 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.265 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.265 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.265 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.265 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.265 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.266 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.266 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-21T06:39:10.266 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-21T06:39:10.266 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.266 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.266 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.266 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "24", 2024-09-21T06:39:10.266 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "8", 2024-09-21T06:39:10.266 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.267 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.267 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.267 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.267 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.267 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.267 INFO:teuthology.orchestra.run.smithi063.stdout: "last_opt_revision": { 2024-09-21T06:39:10.267 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "last_opt_revision", 2024-09-21T06:39:10.267 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.267 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.267 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.267 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "1", 2024-09-21T06:39:10.268 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.268 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.268 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.268 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.268 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.268 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.268 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.268 INFO:teuthology.orchestra.run.smithi063.stdout: "leaderboard": { 2024-09-21T06:39:10.268 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "leaderboard", 2024-09-21T06:39:10.269 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.269 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.269 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.269 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.269 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.269 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.269 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.269 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.269 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.269 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.270 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.270 INFO:teuthology.orchestra.run.smithi063.stdout: "leaderboard_description": { 2024-09-21T06:39:10.270 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "leaderboard_description", 2024-09-21T06:39:10.270 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.270 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.270 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.270 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.271 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.271 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.271 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.271 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.271 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.271 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.271 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.272 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.272 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.272 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.272 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.272 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.272 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.272 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.272 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.273 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.273 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.273 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.273 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.273 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.273 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.273 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.273 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.274 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.274 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.274 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.274 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.274 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.274 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.274 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.274 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.274 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.274 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.274 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.275 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.275 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.275 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.275 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.275 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.275 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.275 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.275 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.275 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.275 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.275 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.275 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.276 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.276 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.276 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.276 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.276 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.276 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.276 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.276 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.276 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.276 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.276 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.276 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.276 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.277 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.277 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.277 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.277 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.277 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.277 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.277 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.277 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.277 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.277 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.277 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.277 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.278 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.278 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.278 INFO:teuthology.orchestra.run.smithi063.stdout: "organization": { 2024-09-21T06:39:10.278 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "organization", 2024-09-21T06:39:10.278 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.278 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.278 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.278 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.278 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.278 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.278 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.278 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.278 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.279 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.279 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.279 INFO:teuthology.orchestra.run.smithi063.stdout: "proxy": { 2024-09-21T06:39:10.279 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "proxy", 2024-09-21T06:39:10.279 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.279 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.279 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.279 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.279 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.279 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.279 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.279 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.280 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.280 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.280 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.280 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.280 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.280 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.280 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.280 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.280 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.280 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.280 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.280 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.281 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.281 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.281 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.281 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.281 INFO:teuthology.orchestra.run.smithi063.stdout: "url": { 2024-09-21T06:39:10.281 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "url", 2024-09-21T06:39:10.281 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.281 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.281 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.281 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:39:10.281 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.281 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.281 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.282 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.282 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.282 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.282 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.282 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.282 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.282 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "test_orchestrator", 2024-09-21T06:39:10.282 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.282 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.282 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.282 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.282 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.283 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.283 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.283 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.283 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.283 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.283 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.283 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.283 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.283 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.283 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.283 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.283 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.283 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.283 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.284 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.284 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.284 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.284 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.284 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.284 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.284 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.284 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.284 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.284 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.284 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.284 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.284 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.284 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.285 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.285 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.285 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.285 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.285 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.285 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.285 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.285 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.285 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.285 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.285 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.285 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.285 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.285 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.286 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.286 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.286 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.286 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.286 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.286 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.286 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.286 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.286 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.286 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.286 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.286 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.287 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.287 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.287 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.287 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.287 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.287 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.287 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.287 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.287 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.287 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.287 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.287 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.288 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.288 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.288 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.288 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.288 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.288 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.288 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.288 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.288 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.288 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.288 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.288 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.288 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.289 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "volumes", 2024-09-21T06:39:10.289 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.289 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.289 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.289 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.289 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.289 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.289 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.289 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.289 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.289 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.289 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.290 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.290 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.290 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.290 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.290 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.290 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.290 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.290 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.290 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.290 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.290 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.290 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.291 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.291 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.291 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.291 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.291 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.291 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.291 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.291 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.291 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.291 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.291 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.291 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.291 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.292 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.292 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.292 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.292 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.293 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.293 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.294 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.294 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.294 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.294 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.294 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.294 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.294 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.294 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.294 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.294 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.294 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.294 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.294 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.295 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.295 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.295 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.295 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.295 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.295 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.295 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.295 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.295 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.295 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.295 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.295 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.296 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.296 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.296 INFO:teuthology.orchestra.run.smithi063.stdout: "max_concurrent_clones": { 2024-09-21T06:39:10.296 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_concurrent_clones", 2024-09-21T06:39:10.296 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.296 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.296 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.296 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "4", 2024-09-21T06:39:10.297 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.297 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.297 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.297 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:39:10.297 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.297 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.297 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.297 INFO:teuthology.orchestra.run.smithi063.stdout: "periodic_async_work": { 2024-09-21T06:39:10.297 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "periodic_async_work", 2024-09-21T06:39:10.297 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.297 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.297 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.298 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.298 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.298 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.298 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.298 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Periodically check for async work", 2024-09-21T06:39:10.298 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.298 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.298 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.298 INFO:teuthology.orchestra.run.smithi063.stdout: "snapshot_clone_delay": { 2024-09-21T06:39:10.298 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:39:10.299 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.299 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.299 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.299 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.299 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.299 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.299 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.299 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:39:10.299 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.299 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.299 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.299 INFO:teuthology.orchestra.run.smithi063.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:39:10.300 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:39:10.300 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.300 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.300 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.300 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-21T06:39:10.300 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.300 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.300 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.300 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:39:10.300 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.300 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.301 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.301 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.301 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.301 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.301 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.301 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.301 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.301 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.301 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.301 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.301 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.302 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.302 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.302 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.302 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.302 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.302 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix", 2024-09-21T06:39:10.302 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-21T06:39:10.302 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-21T06:39:10.303 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-21T06:39:10.303 INFO:teuthology.orchestra.run.smithi063.stdout: "discovery_interval": { 2024-09-21T06:39:10.303 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "discovery_interval", 2024-09-21T06:39:10.303 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-21T06:39:10.303 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.303 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.303 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "100", 2024-09-21T06:39:10.303 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.303 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.303 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.303 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.303 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.303 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.304 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.304 INFO:teuthology.orchestra.run.smithi063.stdout: "identifier": { 2024-09-21T06:39:10.304 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "identifier", 2024-09-21T06:39:10.304 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.304 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.304 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.304 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.304 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.304 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.305 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.305 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.305 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.305 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.305 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.305 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-21T06:39:10.305 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-21T06:39:10.305 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-21T06:39:10.305 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.306 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.306 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-21T06:39:10.306 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.306 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.306 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.306 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.306 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.306 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.306 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.306 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-21T06:39:10.306 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-21T06:39:10.307 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.307 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.307 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.307 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.307 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.307 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.307 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.307 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.307 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.307 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.308 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.308 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.308 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.308 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.308 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.308 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.308 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.308 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.309 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-21T06:39:10.309 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-21T06:39:10.309 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.309 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.309 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.309 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.309 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.309 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.309 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.309 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.309 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.309 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.310 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.310 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-21T06:39:10.310 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-21T06:39:10.310 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.310 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.310 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.310 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-21T06:39:10.310 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.310 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.310 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-21T06:39:10.310 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-21T06:39:10.310 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-21T06:39:10.310 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-21T06:39:10.311 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-21T06:39:10.311 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-21T06:39:10.311 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-21T06:39:10.311 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.311 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.311 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.311 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.311 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.311 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-21T06:39:10.311 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-21T06:39:10.311 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-21T06:39:10.311 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.311 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.312 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-21T06:39:10.312 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.312 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.312 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.312 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.312 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.312 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.312 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.312 INFO:teuthology.orchestra.run.smithi063.stdout: "sqlite3_killpoint": { 2024-09-21T06:39:10.312 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:39:10.312 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.312 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "dev", 2024-09-21T06:39:10.312 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-21T06:39:10.313 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-21T06:39:10.313 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.313 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.313 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.313 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.313 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.313 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.313 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.313 INFO:teuthology.orchestra.run.smithi063.stdout: "zabbix_host": { 2024-09-21T06:39:10.313 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix_host", 2024-09-21T06:39:10.313 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.313 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.313 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.313 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-21T06:39:10.314 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.314 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.314 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.314 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.314 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.314 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.314 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.314 INFO:teuthology.orchestra.run.smithi063.stdout: "zabbix_port": { 2024-09-21T06:39:10.314 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix_port", 2024-09-21T06:39:10.314 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-21T06:39:10.314 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.314 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.315 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10051", 2024-09-21T06:39:10.315 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.315 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.315 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.315 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.315 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.315 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.315 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.315 INFO:teuthology.orchestra.run.smithi063.stdout: "zabbix_sender": { 2024-09-21T06:39:10.315 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix_sender", 2024-09-21T06:39:10.315 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-21T06:39:10.315 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-21T06:39:10.315 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-21T06:39:10.316 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:39:10.316 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-21T06:39:10.316 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-21T06:39:10.316 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-21T06:39:10.316 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-21T06:39:10.316 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-21T06:39:10.316 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-21T06:39:10.316 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-21T06:39:10.316 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.316 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.316 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.316 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.316 INFO:teuthology.orchestra.run.smithi063.stdout: "services": { 2024-09-21T06:39:10.316 INFO:teuthology.orchestra.run.smithi063.stdout: "dashboard": "https://172.21.15.63:8443/" 2024-09-21T06:39:10.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.317 INFO:teuthology.orchestra.run.smithi063.stdout: "always_on_modules": { 2024-09-21T06:39:10.317 INFO:teuthology.orchestra.run.smithi063.stdout: "octopus": [ 2024-09-21T06:39:10.317 INFO:teuthology.orchestra.run.smithi063.stdout: "balancer", 2024-09-21T06:39:10.317 INFO:teuthology.orchestra.run.smithi063.stdout: "crash", 2024-09-21T06:39:10.317 INFO:teuthology.orchestra.run.smithi063.stdout: "devicehealth", 2024-09-21T06:39:10.317 INFO:teuthology.orchestra.run.smithi063.stdout: "orchestrator", 2024-09-21T06:39:10.317 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscaler", 2024-09-21T06:39:10.317 INFO:teuthology.orchestra.run.smithi063.stdout: "progress", 2024-09-21T06:39:10.317 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_support", 2024-09-21T06:39:10.317 INFO:teuthology.orchestra.run.smithi063.stdout: "status", 2024-09-21T06:39:10.317 INFO:teuthology.orchestra.run.smithi063.stdout: "telemetry", 2024-09-21T06:39:10.317 INFO:teuthology.orchestra.run.smithi063.stdout: "volumes" 2024-09-21T06:39:10.317 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.317 INFO:teuthology.orchestra.run.smithi063.stdout: "pacific": [ 2024-09-21T06:39:10.318 INFO:teuthology.orchestra.run.smithi063.stdout: "balancer", 2024-09-21T06:39:10.318 INFO:teuthology.orchestra.run.smithi063.stdout: "crash", 2024-09-21T06:39:10.318 INFO:teuthology.orchestra.run.smithi063.stdout: "devicehealth", 2024-09-21T06:39:10.318 INFO:teuthology.orchestra.run.smithi063.stdout: "orchestrator", 2024-09-21T06:39:10.318 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscaler", 2024-09-21T06:39:10.318 INFO:teuthology.orchestra.run.smithi063.stdout: "progress", 2024-09-21T06:39:10.318 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_support", 2024-09-21T06:39:10.318 INFO:teuthology.orchestra.run.smithi063.stdout: "status", 2024-09-21T06:39:10.318 INFO:teuthology.orchestra.run.smithi063.stdout: "telemetry", 2024-09-21T06:39:10.318 INFO:teuthology.orchestra.run.smithi063.stdout: "volumes" 2024-09-21T06:39:10.318 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.318 INFO:teuthology.orchestra.run.smithi063.stdout: "quincy": [ 2024-09-21T06:39:10.318 INFO:teuthology.orchestra.run.smithi063.stdout: "balancer", 2024-09-21T06:39:10.318 INFO:teuthology.orchestra.run.smithi063.stdout: "crash", 2024-09-21T06:39:10.319 INFO:teuthology.orchestra.run.smithi063.stdout: "devicehealth", 2024-09-21T06:39:10.319 INFO:teuthology.orchestra.run.smithi063.stdout: "orchestrator", 2024-09-21T06:39:10.319 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscaler", 2024-09-21T06:39:10.319 INFO:teuthology.orchestra.run.smithi063.stdout: "progress", 2024-09-21T06:39:10.319 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_support", 2024-09-21T06:39:10.319 INFO:teuthology.orchestra.run.smithi063.stdout: "status", 2024-09-21T06:39:10.319 INFO:teuthology.orchestra.run.smithi063.stdout: "telemetry", 2024-09-21T06:39:10.319 INFO:teuthology.orchestra.run.smithi063.stdout: "volumes" 2024-09-21T06:39:10.319 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.319 INFO:teuthology.orchestra.run.smithi063.stdout: "reef": [ 2024-09-21T06:39:10.319 INFO:teuthology.orchestra.run.smithi063.stdout: "balancer", 2024-09-21T06:39:10.319 INFO:teuthology.orchestra.run.smithi063.stdout: "crash", 2024-09-21T06:39:10.319 INFO:teuthology.orchestra.run.smithi063.stdout: "devicehealth", 2024-09-21T06:39:10.319 INFO:teuthology.orchestra.run.smithi063.stdout: "orchestrator", 2024-09-21T06:39:10.319 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscaler", 2024-09-21T06:39:10.320 INFO:teuthology.orchestra.run.smithi063.stdout: "progress", 2024-09-21T06:39:10.320 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_support", 2024-09-21T06:39:10.320 INFO:teuthology.orchestra.run.smithi063.stdout: "status", 2024-09-21T06:39:10.320 INFO:teuthology.orchestra.run.smithi063.stdout: "telemetry", 2024-09-21T06:39:10.320 INFO:teuthology.orchestra.run.smithi063.stdout: "volumes" 2024-09-21T06:39:10.320 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-21T06:39:10.320 INFO:teuthology.orchestra.run.smithi063.stdout: "squid": [ 2024-09-21T06:39:10.320 INFO:teuthology.orchestra.run.smithi063.stdout: "balancer", 2024-09-21T06:39:10.320 INFO:teuthology.orchestra.run.smithi063.stdout: "crash", 2024-09-21T06:39:10.320 INFO:teuthology.orchestra.run.smithi063.stdout: "devicehealth", 2024-09-21T06:39:10.320 INFO:teuthology.orchestra.run.smithi063.stdout: "orchestrator", 2024-09-21T06:39:10.320 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscaler", 2024-09-21T06:39:10.320 INFO:teuthology.orchestra.run.smithi063.stdout: "progress", 2024-09-21T06:39:10.320 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_support", 2024-09-21T06:39:10.321 INFO:teuthology.orchestra.run.smithi063.stdout: "status", 2024-09-21T06:39:10.321 INFO:teuthology.orchestra.run.smithi063.stdout: "telemetry", 2024-09-21T06:39:10.321 INFO:teuthology.orchestra.run.smithi063.stdout: "volumes" 2024-09-21T06:39:10.321 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-21T06:39:10.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.321 INFO:teuthology.orchestra.run.smithi063.stdout: "last_failure_osd_epoch": 5, 2024-09-21T06:39:10.321 INFO:teuthology.orchestra.run.smithi063.stdout: "active_clients": [ 2024-09-21T06:39:10.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.321 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "devicehealth", 2024-09-21T06:39:10.321 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-21T06:39:10.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.321 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-21T06:39:10.321 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:0", 2024-09-21T06:39:10.321 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 737649430 2024-09-21T06:39:10.322 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.322 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-21T06:39:10.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.322 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "libcephsqlite", 2024-09-21T06:39:10.322 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-21T06:39:10.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.322 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-21T06:39:10.322 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:0", 2024-09-21T06:39:10.322 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1537358700 2024-09-21T06:39:10.322 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.322 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-21T06:39:10.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.323 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd_support", 2024-09-21T06:39:10.323 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-21T06:39:10.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.323 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-21T06:39:10.323 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:0", 2024-09-21T06:39:10.323 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3987488206 2024-09-21T06:39:10.323 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.323 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-21T06:39:10.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.323 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "snap_schedule", 2024-09-21T06:39:10.323 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-21T06:39:10.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.324 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-21T06:39:10.324 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:0", 2024-09-21T06:39:10.324 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 272484781 2024-09-21T06:39:10.324 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.324 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-21T06:39:10.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.324 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "snap_schedule", 2024-09-21T06:39:10.324 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-21T06:39:10.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.324 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-21T06:39:10.324 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:0", 2024-09-21T06:39:10.324 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 290672154 2024-09-21T06:39:10.325 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.325 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-21T06:39:10.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:10.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.325 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "volumes", 2024-09-21T06:39:10.325 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-21T06:39:10.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T06:39:10.325 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-21T06:39:10.325 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:0", 2024-09-21T06:39:10.325 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3330818744 2024-09-21T06:39:10.325 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.325 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-21T06:39:10.325 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:10.325 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-21T06:39:10.325 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:39:10.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.644+0000 7f957768b640 1 -- 172.21.15.63:0/447170572 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f955c0b6680 msgr2=0x7f955c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:10.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.644+0000 7f957768b640 1 --2- 172.21.15.63:0/447170572 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f955c0b6680 0x7f955c0b8b90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f956c009c20 tx=0x7f956c005f90 comp rx=0 tx=0).stop 2024-09-21T06:39:10.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.644+0000 7f957768b640 1 -- 172.21.15.63:0/447170572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95701082b0 msgr2=0x7f957019a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:10.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.644+0000 7f957768b640 1 --2- 172.21.15.63:0/447170572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95701082b0 0x7f957019a900 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f956000d950 tx=0x7f956000de10 comp rx=0 tx=0).stop 2024-09-21T06:39:10.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.644+0000 7f957768b640 1 -- 172.21.15.63:0/447170572 shutdown_connections 2024-09-21T06:39:10.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.644+0000 7f957768b640 1 --2- 172.21.15.63:0/447170572 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f955c0b6680 0x7f955c0b8b90 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.644+0000 7f957768b640 1 --2- 172.21.15.63:0/447170572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9570108c00 0x7f957019fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.644+0000 7f957768b640 1 --2- 172.21.15.63:0/447170572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95701082b0 0x7f957019a900 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.644+0000 7f957768b640 1 --2- 172.21.15.63:0/447170572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9570102980 0x7f957019a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.644+0000 7f957768b640 1 -- 172.21.15.63:0/447170572 >> 172.21.15.63:0/447170572 conn(0x7f95700fe380 msgr2=0x7f9570105800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:10.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.644+0000 7f957768b640 1 -- 172.21.15.63:0/447170572 shutdown_connections 2024-09-21T06:39:10.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:08.644+0000 7f957768b640 1 -- 172.21.15.63:0/447170572 wait complete. 2024-09-21T06:39:10.389 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T06:39:10.389 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T06:39:10.390 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:08 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2576991662' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:39:10.390 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:08 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3104378226' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:39:10.390 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:08 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/447170572' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:39:10.390 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:09 smithi063 ceph-mon[31150]: pgmap v659: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T06:39:10.390 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:09 smithi063 ceph-mon[31150]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T06:39:10.391 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:08 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2576991662' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:39:10.391 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:08 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3104378226' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:39:10.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:08 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/447170572' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:39:10.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:09 smithi175 ceph-mon[34510]: pgmap v659: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T06:39:10.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:09 smithi175 ceph-mon[34510]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T06:39:10.392 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:08 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2576991662' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:39:10.392 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:08 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3104378226' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:39:10.392 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:08 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/447170572' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:39:10.392 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:09 smithi071 ceph-mon[34844]: pgmap v659: 97 pgs: 97 active+clean; 244 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T06:39:10.392 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:09 smithi071 ceph-mon[34844]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T06:39:10.647 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:11.166 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:39:11.167 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:39:11.167 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 7184, 2024-09-21T06:39:11.167 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 12813, 2024-09-21T06:39:11.167 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 3283279, 2024-09-21T06:39:11.167 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 5103706, 2024-09-21T06:39:11.167 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 20, 2024-09-21T06:39:11.167 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 5, 2024-09-21T06:39:11.167 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.775963749, 2024-09-21T06:39:11.167 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.402360003, 2024-09-21T06:39:11.167 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.363079980, 2024-09-21T06:39:11.167 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.034142208, 2024-09-21T06:39:11.168 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:11.168 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 12805, 2024-09-21T06:39:11.168 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.483793751, 2024-09-21T06:39:11.168 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000037781 2024-09-21T06:39:11.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.168 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:11.168 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 17122, 2024-09-21T06:39:11.168 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.003628070, 2024-09-21T06:39:11.168 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000211 2024-09-21T06:39:11.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.168 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T06:39:11.168 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T06:39:11.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.168 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:39:11.169 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 4528, 2024-09-21T06:39:11.169 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 6801, 2024-09-21T06:39:11.169 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 2858768, 2024-09-21T06:39:11.169 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 5251898, 2024-09-21T06:39:11.169 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 13, 2024-09-21T06:39:11.169 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 7, 2024-09-21T06:39:11.169 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.640676729, 2024-09-21T06:39:11.169 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.429080862, 2024-09-21T06:39:11.169 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.206521165, 2024-09-21T06:39:11.169 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.031814820, 2024-09-21T06:39:11.169 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:11.169 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 6800, 2024-09-21T06:39:11.169 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.317391803, 2024-09-21T06:39:11.170 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000046675 2024-09-21T06:39:11.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.170 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:11.170 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 7145, 2024-09-21T06:39:11.170 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.001188082, 2024-09-21T06:39:11.170 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000166 2024-09-21T06:39:11.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.170 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 1103600, 2024-09-21T06:39:11.170 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 140768 2024-09-21T06:39:11.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.170 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:39:11.170 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 1308, 2024-09-21T06:39:11.170 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 1467, 2024-09-21T06:39:11.171 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 565940, 2024-09-21T06:39:11.171 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 5897915, 2024-09-21T06:39:11.171 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 29, 2024-09-21T06:39:11.171 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 8, 2024-09-21T06:39:11.171 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.150768468, 2024-09-21T06:39:11.171 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.071285223, 2024-09-21T06:39:11.171 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.036597745, 2024-09-21T06:39:11.171 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.033189542, 2024-09-21T06:39:11.171 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:11.171 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1465, 2024-09-21T06:39:11.171 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.090736579, 2024-09-21T06:39:11.172 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000061936 2024-09-21T06:39:11.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.172 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:11.172 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 125, 2024-09-21T06:39:11.172 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000024872, 2024-09-21T06:39:11.172 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000198 2024-09-21T06:39:11.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.172 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:39:11.172 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 368752 2024-09-21T06:39:11.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.172 INFO:teuthology.orchestra.run.smithi063.stdout: "cct": { 2024-09-21T06:39:11.172 INFO:teuthology.orchestra.run.smithi063.stdout: "total_workers": 1, 2024-09-21T06:39:11.173 INFO:teuthology.orchestra.run.smithi063.stdout: "unhealthy_workers": 0 2024-09-21T06:39:11.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.173 INFO:teuthology.orchestra.run.smithi063.stdout: "finisher-MDSRank": { 2024-09-21T06:39:11.173 INFO:teuthology.orchestra.run.smithi063.stdout: "queue_len": 0, 2024-09-21T06:39:11.173 INFO:teuthology.orchestra.run.smithi063.stdout: "complete_latency": { 2024-09-21T06:39:11.173 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 878, 2024-09-21T06:39:11.173 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 3.192297127, 2024-09-21T06:39:11.173 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.003635873 2024-09-21T06:39:11.173 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:11.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.173 INFO:teuthology.orchestra.run.smithi063.stdout: "finisher-PurgeQueue": { 2024-09-21T06:39:11.173 INFO:teuthology.orchestra.run.smithi063.stdout: "queue_len": 0, 2024-09-21T06:39:11.173 INFO:teuthology.orchestra.run.smithi063.stdout: "complete_latency": { 2024-09-21T06:39:11.173 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1590, 2024-09-21T06:39:11.174 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.252368968, 2024-09-21T06:39:11.174 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000158722 2024-09-21T06:39:11.174 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:11.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.174 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2024-09-21T06:39:11.174 INFO:teuthology.orchestra.run.smithi063.stdout: "request": 1828, 2024-09-21T06:39:11.174 INFO:teuthology.orchestra.run.smithi063.stdout: "reply": 1827, 2024-09-21T06:39:11.174 INFO:teuthology.orchestra.run.smithi063.stdout: "reply_latency": { 2024-09-21T06:39:11.174 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1827, 2024-09-21T06:39:11.174 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 2.112193106, 2024-09-21T06:39:11.174 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001156099 2024-09-21T06:39:11.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.175 INFO:teuthology.orchestra.run.smithi063.stdout: "slow_reply": 0, 2024-09-21T06:39:11.175 INFO:teuthology.orchestra.run.smithi063.stdout: "forward": 1, 2024-09-21T06:39:11.175 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_fetch_complete": 0, 2024-09-21T06:39:11.175 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_fetch_keys": 0, 2024-09-21T06:39:11.175 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_commit": 11, 2024-09-21T06:39:11.175 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_split": 0, 2024-09-21T06:39:11.175 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_merge": 0, 2024-09-21T06:39:11.175 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes": 17, 2024-09-21T06:39:11.175 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_top": 2, 2024-09-21T06:39:11.175 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_bottom": 1, 2024-09-21T06:39:11.175 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_pin_tail": 14, 2024-09-21T06:39:11.175 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_pinned": 14, 2024-09-21T06:39:11.175 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_expired": 2201, 2024-09-21T06:39:11.176 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_with_caps": 1, 2024-09-21T06:39:11.176 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": 1, 2024-09-21T06:39:11.176 INFO:teuthology.orchestra.run.smithi063.stdout: "subtrees": 3, 2024-09-21T06:39:11.176 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse": 5829, 2024-09-21T06:39:11.176 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_hit": 5294, 2024-09-21T06:39:11.176 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_forward": 0, 2024-09-21T06:39:11.176 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_discover": 8, 2024-09-21T06:39:11.176 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:39:11.176 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_remote_ino": 0, 2024-09-21T06:39:11.176 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_lock": 0, 2024-09-21T06:39:11.176 INFO:teuthology.orchestra.run.smithi063.stdout: "load_cent": 0, 2024-09-21T06:39:11.177 INFO:teuthology.orchestra.run.smithi063.stdout: "q": 0, 2024-09-21T06:39:11.177 INFO:teuthology.orchestra.run.smithi063.stdout: "exported": 38, 2024-09-21T06:39:11.177 INFO:teuthology.orchestra.run.smithi063.stdout: "exported_inodes": 2185, 2024-09-21T06:39:11.177 INFO:teuthology.orchestra.run.smithi063.stdout: "imported": 38, 2024-09-21T06:39:11.177 INFO:teuthology.orchestra.run.smithi063.stdout: "imported_inodes": 1335, 2024-09-21T06:39:11.177 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_dir_fetch": 0, 2024-09-21T06:39:11.177 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_backtrace_fetch": 2550, 2024-09-21T06:39:11.177 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_peer_discover": 0, 2024-09-21T06:39:11.177 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rfiles": 4, 2024-09-21T06:39:11.178 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rbytes": 234, 2024-09-21T06:39:11.178 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rsnaps": 6, 2024-09-21T06:39:11.178 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_backtrace_fetch": 2550, 2024-09-21T06:39:11.178 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_set_tag": 0, 2024-09-21T06:39:11.178 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:39:11.178 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:39:11.178 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:39:11.178 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:39:11.178 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:39:11.178 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_file_inodes": 2550, 2024-09-21T06:39:11.179 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:39:11.179 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_cap_op_revoke": 618, 2024-09-21T06:39:11.179 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_cap_op_grant": 884, 2024-09-21T06:39:11.179 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:39:11.179 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:39:11.179 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:39:11.179 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_caps": 652, 2024-09-21T06:39:11.179 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:39:11.179 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_cap_release": 15, 2024-09-21T06:39:11.179 INFO:teuthology.orchestra.run.smithi063.stdout: "process_request_cap_release": 1762 2024-09-21T06:39:11.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.180 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2024-09-21T06:39:11.180 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_update": 0, 2024-09-21T06:39:11.180 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_update_receipt": 3, 2024-09-21T06:39:11.180 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_try_discover": 2, 2024-09-21T06:39:11.180 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_send_discover": 9, 2024-09-21T06:39:11.180 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_handle_discover": 38, 2024-09-21T06:39:11.180 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays": 0, 2024-09-21T06:39:11.180 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_delayed": 0, 2024-09-21T06:39:11.180 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:39:11.180 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_created": 850, 2024-09-21T06:39:11.180 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 850, 2024-09-21T06:39:11.181 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_reintegrated": 0, 2024-09-21T06:39:11.181 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_migrated": 0, 2024-09-21T06:39:11.181 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_processing": 0, 2024-09-21T06:39:11.181 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:39:11.181 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:39:11.181 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_started": 0, 2024-09-21T06:39:11.181 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_completed": 0, 2024-09-21T06:39:11.181 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:39:11.181 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:39:11.181 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:39:11.181 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_exportdir": 38, 2024-09-21T06:39:11.182 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_flush": 0, 2024-09-21T06:39:11.182 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:39:11.182 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragstats": 0, 2024-09-21T06:39:11.182 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_inodestats": 0, 2024-09-21T06:39:11.182 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:39:11.182 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_succeeded": 0, 2024-09-21T06:39:11.182 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_write_failed": 0 2024-09-21T06:39:11.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.182 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log": { 2024-09-21T06:39:11.182 INFO:teuthology.orchestra.run.smithi063.stdout: "evlrg": 0, 2024-09-21T06:39:11.183 INFO:teuthology.orchestra.run.smithi063.stdout: "evadd": 1955, 2024-09-21T06:39:11.183 INFO:teuthology.orchestra.run.smithi063.stdout: "evex": 0, 2024-09-21T06:39:11.183 INFO:teuthology.orchestra.run.smithi063.stdout: "evtrm": 0, 2024-09-21T06:39:11.183 INFO:teuthology.orchestra.run.smithi063.stdout: "ev": 1955, 2024-09-21T06:39:11.183 INFO:teuthology.orchestra.run.smithi063.stdout: "evexg": 0, 2024-09-21T06:39:11.183 INFO:teuthology.orchestra.run.smithi063.stdout: "evexd": 0, 2024-09-21T06:39:11.183 INFO:teuthology.orchestra.run.smithi063.stdout: "segadd": 4, 2024-09-21T06:39:11.183 INFO:teuthology.orchestra.run.smithi063.stdout: "segex": 0, 2024-09-21T06:39:11.183 INFO:teuthology.orchestra.run.smithi063.stdout: "segtrm": 0, 2024-09-21T06:39:11.183 INFO:teuthology.orchestra.run.smithi063.stdout: "seg": 4, 2024-09-21T06:39:11.183 INFO:teuthology.orchestra.run.smithi063.stdout: "segmjr": 2, 2024-09-21T06:39:11.184 INFO:teuthology.orchestra.run.smithi063.stdout: "segexg": 0, 2024-09-21T06:39:11.184 INFO:teuthology.orchestra.run.smithi063.stdout: "segexd": 0, 2024-09-21T06:39:11.184 INFO:teuthology.orchestra.run.smithi063.stdout: "expos": 4194304, 2024-09-21T06:39:11.184 INFO:teuthology.orchestra.run.smithi063.stdout: "wrpos": 9663629, 2024-09-21T06:39:11.184 INFO:teuthology.orchestra.run.smithi063.stdout: "rdpos": 0, 2024-09-21T06:39:11.184 INFO:teuthology.orchestra.run.smithi063.stdout: "jlat": { 2024-09-21T06:39:11.184 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 127, 2024-09-21T06:39:11.184 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 1.740440230, 2024-09-21T06:39:11.184 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.013704253 2024-09-21T06:39:11.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.185 INFO:teuthology.orchestra.run.smithi063.stdout: "replayed": 0 2024-09-21T06:39:11.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.185 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_mem": { 2024-09-21T06:39:11.185 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 21, 2024-09-21T06:39:11.185 INFO:teuthology.orchestra.run.smithi063.stdout: "ino+": 2216, 2024-09-21T06:39:11.185 INFO:teuthology.orchestra.run.smithi063.stdout: "ino-": 2195, 2024-09-21T06:39:11.185 INFO:teuthology.orchestra.run.smithi063.stdout: "dir": 20, 2024-09-21T06:39:11.185 INFO:teuthology.orchestra.run.smithi063.stdout: "dir+": 64, 2024-09-21T06:39:11.185 INFO:teuthology.orchestra.run.smithi063.stdout: "dir-": 44, 2024-09-21T06:39:11.185 INFO:teuthology.orchestra.run.smithi063.stdout: "dn": 17, 2024-09-21T06:39:11.185 INFO:teuthology.orchestra.run.smithi063.stdout: "dn+": 3068, 2024-09-21T06:39:11.186 INFO:teuthology.orchestra.run.smithi063.stdout: "dn-": 3051, 2024-09-21T06:39:11.186 INFO:teuthology.orchestra.run.smithi063.stdout: "cap": 1, 2024-09-21T06:39:11.186 INFO:teuthology.orchestra.run.smithi063.stdout: "cap+": 1706, 2024-09-21T06:39:11.186 INFO:teuthology.orchestra.run.smithi063.stdout: "cap-": 1705, 2024-09-21T06:39:11.186 INFO:teuthology.orchestra.run.smithi063.stdout: "rss": 141036, 2024-09-21T06:39:11.186 INFO:teuthology.orchestra.run.smithi063.stdout: "heap": 357441536 2024-09-21T06:39:11.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.186 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_server": { 2024-09-21T06:39:11.186 INFO:teuthology.orchestra.run.smithi063.stdout: "dispatch_client_request": 3407, 2024-09-21T06:39:11.186 INFO:teuthology.orchestra.run.smithi063.stdout: "dispatch_server_request": 5, 2024-09-21T06:39:11.187 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_request": 1828, 2024-09-21T06:39:11.187 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_session": 9, 2024-09-21T06:39:11.187 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_peer_request": 14, 2024-09-21T06:39:11.187 INFO:teuthology.orchestra.run.smithi063.stdout: "req_create_latency": { 2024-09-21T06:39:11.187 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.187 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.187 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.188 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getattr_latency": { 2024-09-21T06:39:11.188 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 21, 2024-09-21T06:39:11.188 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.010131873, 2024-09-21T06:39:11.188 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000482470 2024-09-21T06:39:11.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.188 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getfilelock_latency": { 2024-09-21T06:39:11.188 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.188 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.188 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.189 INFO:teuthology.orchestra.run.smithi063.stdout: "req_link_latency": { 2024-09-21T06:39:11.189 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.189 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.189 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.189 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookup_latency": { 2024-09-21T06:39:11.189 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 891, 2024-09-21T06:39:11.189 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.306823654, 2024-09-21T06:39:11.189 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000344358 2024-09-21T06:39:11.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.189 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookuphash_latency": { 2024-09-21T06:39:11.189 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.189 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.189 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.190 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupino_latency": { 2024-09-21T06:39:11.190 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.190 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.190 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.190 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupname_latency": { 2024-09-21T06:39:11.190 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.190 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.190 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.190 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupparent_latency": { 2024-09-21T06:39:11.190 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.191 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.191 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.191 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupsnap_latency": { 2024-09-21T06:39:11.191 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.191 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.191 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.192 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lssnap_latency": { 2024-09-21T06:39:11.192 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.192 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.192 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.192 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mkdir_latency": { 2024-09-21T06:39:11.192 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.192 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.192 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.192 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mknod_latency": { 2024-09-21T06:39:11.192 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.193 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.193 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.193 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mksnap_latency": { 2024-09-21T06:39:11.193 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.193 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.193 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.193 INFO:teuthology.orchestra.run.smithi063.stdout: "req_open_latency": { 2024-09-21T06:39:11.193 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.193 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.193 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.193 INFO:teuthology.orchestra.run.smithi063.stdout: "req_readdir_latency": { 2024-09-21T06:39:11.194 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 65, 2024-09-21T06:39:11.194 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.074492369, 2024-09-21T06:39:11.194 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001146036 2024-09-21T06:39:11.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.194 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rename_latency": { 2024-09-21T06:39:11.194 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.194 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.194 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.194 INFO:teuthology.orchestra.run.smithi063.stdout: "req_renamesnap_latency": { 2024-09-21T06:39:11.194 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.194 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.195 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.195 INFO:teuthology.orchestra.run.smithi063.stdout: "req_snapdiff_latency": { 2024-09-21T06:39:11.195 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.195 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.195 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.195 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmdir_latency": { 2024-09-21T06:39:11.195 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.195 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.195 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.195 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmsnap_latency": { 2024-09-21T06:39:11.196 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.196 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.196 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.196 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmxattr_latency": { 2024-09-21T06:39:11.196 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.196 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.196 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.196 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setattr_latency": { 2024-09-21T06:39:11.196 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.196 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.197 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.197 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setdirlayout_latency": { 2024-09-21T06:39:11.197 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.197 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.197 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.197 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setfilelock_latency": { 2024-09-21T06:39:11.197 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.197 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.197 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.197 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setlayout_latency": { 2024-09-21T06:39:11.197 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.198 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.198 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.198 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setxattr_latency": { 2024-09-21T06:39:11.198 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.198 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.198 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.198 INFO:teuthology.orchestra.run.smithi063.stdout: "req_symlink_latency": { 2024-09-21T06:39:11.198 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.198 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.199 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.199 INFO:teuthology.orchestra.run.smithi063.stdout: "req_unlink_latency": { 2024-09-21T06:39:11.199 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 850, 2024-09-21T06:39:11.199 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 1.720745210, 2024-09-21T06:39:11.199 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.002024406 2024-09-21T06:39:11.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.199 INFO:teuthology.orchestra.run.smithi063.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:39:11.199 INFO:teuthology.orchestra.run.smithi063.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:39:11.199 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getvxattr_latency": { 2024-09-21T06:39:11.199 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.199 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.199 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.199 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:11.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.200 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_sessions": { 2024-09-21T06:39:11.200 INFO:teuthology.orchestra.run.smithi063.stdout: "session_count": 1, 2024-09-21T06:39:11.200 INFO:teuthology.orchestra.run.smithi063.stdout: "session_add": 1, 2024-09-21T06:39:11.200 INFO:teuthology.orchestra.run.smithi063.stdout: "session_remove": 0, 2024-09-21T06:39:11.200 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions_open": 1, 2024-09-21T06:39:11.200 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions_stale": 0, 2024-09-21T06:39:11.200 INFO:teuthology.orchestra.run.smithi063.stdout: "total_load": 1617, 2024-09-21T06:39:11.200 INFO:teuthology.orchestra.run.smithi063.stdout: "average_load": 1617, 2024-09-21T06:39:11.200 INFO:teuthology.orchestra.run.smithi063.stdout: "avg_session_uptime": 655, 2024-09-21T06:39:11.200 INFO:teuthology.orchestra.run.smithi063.stdout: "mdthresh_evicted": 0 2024-09-21T06:39:11.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.200 INFO:teuthology.orchestra.run.smithi063.stdout: "mempool": { 2024-09-21T06:39:11.201 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:39:11.201 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_items": 0, 2024-09-21T06:39:11.201 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:39:11.201 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:39:11.201 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:39:11.201 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:39:11.201 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:39:11.201 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:39:11.201 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:39:11.201 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:39:11.201 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:39:11.201 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:39:11.202 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:39:11.202 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:39:11.202 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:39:11.202 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_items": 0, 2024-09-21T06:39:11.202 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:39:11.202 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_blob_items": 0, 2024-09-21T06:39:11.202 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:39:11.202 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:39:11.202 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:39:11.202 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:39:11.202 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:39:11.202 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:39:11.202 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:39:11.203 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_items": 0, 2024-09-21T06:39:11.203 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:39:11.203 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:39:11.203 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:39:11.203 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_items": 0, 2024-09-21T06:39:11.203 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_bytes": 0, 2024-09-21T06:39:11.203 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_items": 0, 2024-09-21T06:39:11.203 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:39:11.204 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:39:11.204 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:39:11.204 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:39:11.204 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_bytes": 288963, 2024-09-21T06:39:11.204 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_items": 107, 2024-09-21T06:39:11.204 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:39:11.204 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_items": 0, 2024-09-21T06:39:11.204 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bytes": 0, 2024-09-21T06:39:11.204 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_items": 0, 2024-09-21T06:39:11.204 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:39:11.204 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_items": 0, 2024-09-21T06:39:11.205 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:39:11.205 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_items": 0, 2024-09-21T06:39:11.205 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_bytes": 8296, 2024-09-21T06:39:11.205 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_items": 183, 2024-09-21T06:39:11.205 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:39:11.205 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:39:11.205 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_bytes": 0, 2024-09-21T06:39:11.205 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_items": 0, 2024-09-21T06:39:11.205 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_bytes": 104113, 2024-09-21T06:39:11.205 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_items": 511, 2024-09-21T06:39:11.206 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_bytes": 0, 2024-09-21T06:39:11.206 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_items": 0, 2024-09-21T06:39:11.206 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_bytes": 0, 2024-09-21T06:39:11.206 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_items": 0 2024-09-21T06:39:11.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.206 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter": { 2024-09-21T06:39:11.206 INFO:teuthology.orchestra.run.smithi063.stdout: "op_active": 0, 2024-09-21T06:39:11.206 INFO:teuthology.orchestra.run.smithi063.stdout: "op_laggy": 0, 2024-09-21T06:39:11.206 INFO:teuthology.orchestra.run.smithi063.stdout: "op_send": 3647, 2024-09-21T06:39:11.206 INFO:teuthology.orchestra.run.smithi063.stdout: "op_send_bytes": 5614269, 2024-09-21T06:39:11.206 INFO:teuthology.orchestra.run.smithi063.stdout: "op_resend": 31, 2024-09-21T06:39:11.206 INFO:teuthology.orchestra.run.smithi063.stdout: "op_reply": 3647, 2024-09-21T06:39:11.207 INFO:teuthology.orchestra.run.smithi063.stdout: "op_latency": { 2024-09-21T06:39:11.207 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 3647, 2024-09-21T06:39:11.207 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 6.839932102, 2024-09-21T06:39:11.207 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.001875495 2024-09-21T06:39:11.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.207 INFO:teuthology.orchestra.run.smithi063.stdout: "op_inflight": 0, 2024-09-21T06:39:11.207 INFO:teuthology.orchestra.run.smithi063.stdout: "oplen_avg": { 2024-09-21T06:39:11.207 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 3647, 2024-09-21T06:39:11.207 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 3692 2024-09-21T06:39:11.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.207 INFO:teuthology.orchestra.run.smithi063.stdout: "op": 3647, 2024-09-21T06:39:11.207 INFO:teuthology.orchestra.run.smithi063.stdout: "op_r": 2571, 2024-09-21T06:39:11.207 INFO:teuthology.orchestra.run.smithi063.stdout: "op_w": 1076, 2024-09-21T06:39:11.208 INFO:teuthology.orchestra.run.smithi063.stdout: "op_rmw": 0, 2024-09-21T06:39:11.208 INFO:teuthology.orchestra.run.smithi063.stdout: "op_pg": 0, 2024-09-21T06:39:11.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_stat": 0, 2024-09-21T06:39:11.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_create": 10, 2024-09-21T06:39:11.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_read": 21, 2024-09-21T06:39:11.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_write": 148, 2024-09-21T06:39:11.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_writefull": 21, 2024-09-21T06:39:11.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_writesame": 0, 2024-09-21T06:39:11.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_append": 0, 2024-09-21T06:39:11.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_zero": 0, 2024-09-21T06:39:11.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_truncate": 0, 2024-09-21T06:39:11.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_delete": 863, 2024-09-21T06:39:11.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_mapext": 0, 2024-09-21T06:39:11.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_sparse_read": 0, 2024-09-21T06:39:11.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_clonerange": 0, 2024-09-21T06:39:11.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_getxattr": 2550, 2024-09-21T06:39:11.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_setxattr": 20, 2024-09-21T06:39:11.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:39:11.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_rmxattr": 0, 2024-09-21T06:39:11.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:39:11.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_call": 0, 2024-09-21T06:39:11.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_watch": 0, 2024-09-21T06:39:11.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_notify": 0, 2024-09-21T06:39:11.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:39:11.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_pgls": 0, 2024-09-21T06:39:11.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:39:11.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_other": 0, 2024-09-21T06:39:11.209 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_active": 0, 2024-09-21T06:39:11.210 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_send": 0, 2024-09-21T06:39:11.210 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_resend": 0, 2024-09-21T06:39:11.210 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_ping": 0, 2024-09-21T06:39:11.210 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_active": 0, 2024-09-21T06:39:11.210 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_send": 0, 2024-09-21T06:39:11.210 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_resend": 0, 2024-09-21T06:39:11.210 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_active": 0, 2024-09-21T06:39:11.210 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_send": 0, 2024-09-21T06:39:11.210 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_resend": 0, 2024-09-21T06:39:11.210 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_active": 0, 2024-09-21T06:39:11.210 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_send": 0, 2024-09-21T06:39:11.210 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_resend": 0, 2024-09-21T06:39:11.210 INFO:teuthology.orchestra.run.smithi063.stdout: "command_active": 0, 2024-09-21T06:39:11.210 INFO:teuthology.orchestra.run.smithi063.stdout: "command_send": 0, 2024-09-21T06:39:11.211 INFO:teuthology.orchestra.run.smithi063.stdout: "command_resend": 0, 2024-09-21T06:39:11.211 INFO:teuthology.orchestra.run.smithi063.stdout: "map_epoch": 87, 2024-09-21T06:39:11.211 INFO:teuthology.orchestra.run.smithi063.stdout: "map_full": 0, 2024-09-21T06:39:11.211 INFO:teuthology.orchestra.run.smithi063.stdout: "map_inc": 12, 2024-09-21T06:39:11.211 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_sessions": 12, 2024-09-21T06:39:11.211 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_session_open": 12, 2024-09-21T06:39:11.211 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_session_close": 0, 2024-09-21T06:39:11.211 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_laggy": 0, 2024-09-21T06:39:11.211 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_wr": 50, 2024-09-21T06:39:11.211 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_rd": 0, 2024-09-21T06:39:11.211 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_del": 9 2024-09-21T06:39:11.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.212 INFO:teuthology.orchestra.run.smithi063.stdout: "oft": { 2024-09-21T06:39:11.212 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_objs": 1, 2024-09-21T06:39:11.212 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:39:11.212 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_updates": 0, 2024-09-21T06:39:11.212 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_removes": 0 2024-09-21T06:39:11.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.212 INFO:teuthology.orchestra.run.smithi063.stdout: "purge_queue": { 2024-09-21T06:39:11.212 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops": 0, 2024-09-21T06:39:11.212 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops_high_water": 6, 2024-09-21T06:39:11.212 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing": 0, 2024-09-21T06:39:11.213 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_high_water": 6, 2024-09-21T06:39:11.213 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executed_ops": 850, 2024-09-21T06:39:11.213 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executed": 850, 2024-09-21T06:39:11.213 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_item_in_journal": 0 2024-09-21T06:39:11.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.213 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:39:11.213 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2024-09-21T06:39:11.213 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2024-09-21T06:39:11.213 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2024-09-21T06:39:11.213 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 13016, 2024-09-21T06:39:11.213 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 5518402, 2024-09-21T06:39:11.213 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:11.213 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 13016, 2024-09-21T06:39:11.214 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2024-09-21T06:39:11.214 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2024-09-21T06:39:11.214 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 13016, 2024-09-21T06:39:11.214 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 5518402, 2024-09-21T06:39:11.214 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2024-09-21T06:39:11.214 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.214 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.214 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.214 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:11.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.214 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-objecter_bytes": { 2024-09-21T06:39:11.215 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2024-09-21T06:39:11.215 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2024-09-21T06:39:11.215 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2024-09-21T06:39:11.215 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2024-09-21T06:39:11.215 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2024-09-21T06:39:11.215 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:11.215 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:11.215 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 3647, 2024-09-21T06:39:11.215 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 5723791, 2024-09-21T06:39:11.215 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 3647, 2024-09-21T06:39:11.216 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 5723791, 2024-09-21T06:39:11.216 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2024-09-21T06:39:11.216 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.216 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.216 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.216 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:11.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.216 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-objecter_ops": { 2024-09-21T06:39:11.216 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2024-09-21T06:39:11.216 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 1024, 2024-09-21T06:39:11.216 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2024-09-21T06:39:11.216 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2024-09-21T06:39:11.217 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2024-09-21T06:39:11.217 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:11.217 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:11.217 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 3647, 2024-09-21T06:39:11.217 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 3647, 2024-09-21T06:39:11.217 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 3647, 2024-09-21T06:39:11.217 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 3647, 2024-09-21T06:39:11.217 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2024-09-21T06:39:11.217 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.217 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.217 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.218 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:11.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.218 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:39:11.218 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2024-09-21T06:39:11.218 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 3758096384, 2024-09-21T06:39:11.218 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2024-09-21T06:39:11.218 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 850, 2024-09-21T06:39:11.218 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 109522, 2024-09-21T06:39:11.218 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:11.218 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 850, 2024-09-21T06:39:11.218 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2024-09-21T06:39:11.219 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2024-09-21T06:39:11.219 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 21, 2024-09-21T06:39:11.219 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 109522, 2024-09-21T06:39:11.219 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2024-09-21T06:39:11.219 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.219 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.219 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.219 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:11.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.219 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-write_buf_throttle-0x564183625450": { 2024-09-21T06:39:11.220 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2024-09-21T06:39:11.220 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 3758096384, 2024-09-21T06:39:11.220 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2024-09-21T06:39:11.220 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 1955, 2024-09-21T06:39:11.220 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 5469325, 2024-09-21T06:39:11.220 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:11.220 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 1955, 2024-09-21T06:39:11.220 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2024-09-21T06:39:11.220 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2024-09-21T06:39:11.220 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 127, 2024-09-21T06:39:11.220 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 5469325, 2024-09-21T06:39:11.221 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2024-09-21T06:39:11.221 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:11.221 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:11.221 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:11.221 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:11.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:11.221 INFO:teuthology.orchestra.run.smithi063.stdout: "trackedop": { 2024-09-21T06:39:11.221 INFO:teuthology.orchestra.run.smithi063.stdout: "slow_ops_count": 0 2024-09-21T06:39:11.221 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:11.221 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:39:12.007 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:11 smithi063 ceph-mon[31150]: pgmap v661: 97 pgs: 3 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 89 active+clean; 242 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:39:12.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:11 smithi071 ceph-mon[34844]: pgmap v661: 97 pgs: 3 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 89 active+clean; 242 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:39:12.037 INFO:tasks.check_counter:Daemon mds.a mds.exported=38 2024-09-21T06:39:12.037 INFO:tasks.check_counter:Daemon mds.a mds.imported=38 2024-09-21T06:39:12.037 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=6 2024-09-21T06:39:12.037 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:39:12.037 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:39:12.037 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2024-09-21T06:39:12.037 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T06:39:12.038 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T06:39:12.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:11 smithi175 ceph-mon[34510]: pgmap v661: 97 pgs: 3 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 89 active+clean; 242 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:39:12.296 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:12.970 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:39:12.971 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:39:12.971 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 222, 2024-09-21T06:39:12.971 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 217, 2024-09-21T06:39:12.971 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 838080, 2024-09-21T06:39:12.971 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 133184, 2024-09-21T06:39:12.971 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 4, 2024-09-21T06:39:12.971 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 0, 2024-09-21T06:39:12.971 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.037040573, 2024-09-21T06:39:12.971 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.017359344, 2024-09-21T06:39:12.971 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.025394860, 2024-09-21T06:39:12.971 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:39:12.971 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:12.971 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 216, 2024-09-21T06:39:12.972 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.010246250, 2024-09-21T06:39:12.972 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000047436 2024-09-21T06:39:12.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:12.972 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:12.972 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:12.972 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:12.972 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:12.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:12.972 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 838080, 2024-09-21T06:39:12.973 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 133184 2024-09-21T06:39:12.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:12.973 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:39:12.973 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 5, 2024-09-21T06:39:12.973 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 166, 2024-09-21T06:39:12.973 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 3104, 2024-09-21T06:39:12.973 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 109504, 2024-09-21T06:39:12.973 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 3, 2024-09-21T06:39:12.973 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 2, 2024-09-21T06:39:12.973 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.018141842, 2024-09-21T06:39:12.973 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.013229246, 2024-09-21T06:39:12.973 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.003311821, 2024-09-21T06:39:12.974 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:39:12.974 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:12.974 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 165, 2024-09-21T06:39:12.974 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.012288794, 2024-09-21T06:39:12.974 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000074477 2024-09-21T06:39:12.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:12.975 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:12.975 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:12.975 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:12.975 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:12.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:12.976 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T06:39:12.976 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 109504 2024-09-21T06:39:12.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:12.976 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:39:12.976 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 0, 2024-09-21T06:39:12.976 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 2, 2024-09-21T06:39:12.976 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:39:12.977 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 0, 2024-09-21T06:39:12.977 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 2, 2024-09-21T06:39:12.977 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 1, 2024-09-21T06:39:12.977 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.000408386, 2024-09-21T06:39:12.977 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:39:12.977 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.000332338, 2024-09-21T06:39:12.977 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:39:12.978 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:12.978 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:12.978 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:12.978 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:12.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:12.978 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:12.978 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:12.978 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:12.978 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:12.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:12.979 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:39:12.979 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:39:12.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:12.979 INFO:teuthology.orchestra.run.smithi063.stdout: "cct": { 2024-09-21T06:39:12.979 INFO:teuthology.orchestra.run.smithi063.stdout: "total_workers": 0, 2024-09-21T06:39:12.979 INFO:teuthology.orchestra.run.smithi063.stdout: "unhealthy_workers": 0 2024-09-21T06:39:12.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:12.980 INFO:teuthology.orchestra.run.smithi063.stdout: "mempool": { 2024-09-21T06:39:12.980 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:39:12.980 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_items": 0, 2024-09-21T06:39:12.980 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:39:12.980 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:39:12.980 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:39:12.980 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:39:12.980 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:39:12.980 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:39:12.980 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:39:12.980 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:39:12.980 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:39:12.980 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:39:12.981 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:39:12.981 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:39:12.981 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:39:12.981 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_items": 0, 2024-09-21T06:39:12.981 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:39:12.981 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_blob_items": 0, 2024-09-21T06:39:12.981 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:39:12.981 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:39:12.981 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:39:12.981 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:39:12.982 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:39:12.982 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:39:12.982 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:39:12.982 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_items": 0, 2024-09-21T06:39:12.982 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:39:12.982 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:39:12.982 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:39:12.982 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_items": 0, 2024-09-21T06:39:12.982 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_bytes": 0, 2024-09-21T06:39:12.982 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_items": 0, 2024-09-21T06:39:12.982 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:39:12.982 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:39:12.983 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:39:12.983 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:39:12.983 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_bytes": 148967, 2024-09-21T06:39:12.983 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_items": 29, 2024-09-21T06:39:12.983 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:39:12.983 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_items": 0, 2024-09-21T06:39:12.983 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bytes": 0, 2024-09-21T06:39:12.983 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_items": 0, 2024-09-21T06:39:12.983 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:39:12.983 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_items": 0, 2024-09-21T06:39:12.983 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:39:12.983 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_items": 0, 2024-09-21T06:39:12.983 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_bytes": 0, 2024-09-21T06:39:12.984 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_items": 0, 2024-09-21T06:39:12.984 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:39:12.984 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:39:12.984 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_bytes": 0, 2024-09-21T06:39:12.984 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_items": 0, 2024-09-21T06:39:12.984 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_bytes": 968, 2024-09-21T06:39:12.984 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_items": 2, 2024-09-21T06:39:12.984 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_bytes": 0, 2024-09-21T06:39:12.984 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_items": 0, 2024-09-21T06:39:12.984 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_bytes": 0, 2024-09-21T06:39:12.984 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_items": 0 2024-09-21T06:39:12.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:12.984 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:39:12.984 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2024-09-21T06:39:12.984 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2024-09-21T06:39:12.985 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2024-09-21T06:39:12.985 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 223, 2024-09-21T06:39:12.985 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 806696, 2024-09-21T06:39:12.985 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:12.985 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 223, 2024-09-21T06:39:12.985 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2024-09-21T06:39:12.985 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2024-09-21T06:39:12.985 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 223, 2024-09-21T06:39:12.985 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 806696, 2024-09-21T06:39:12.985 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2024-09-21T06:39:12.985 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:12.985 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:12.985 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:12.985 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:12.986 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:12.986 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:39:13.678 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-21T06:39:13.678 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-21T06:39:13.678 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-21T06:39:13.678 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-21T06:39:13.678 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-21T06:39:13.678 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-21T06:39:13.678 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T06:39:13.679 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T06:39:13.945 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:14.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:13 smithi071 ceph-mon[34844]: pgmap v662: 97 pgs: 3 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 89 active+clean; 175 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:39:14.066 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:13 smithi063 ceph-mon[31150]: pgmap v662: 97 pgs: 3 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 89 active+clean; 175 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:39:14.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:13 smithi175 ceph-mon[34510]: pgmap v662: 97 pgs: 3 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 89 active+clean; 175 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T06:39:14.456 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:39:14.456 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:39:14.456 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 1197, 2024-09-21T06:39:14.456 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 1196, 2024-09-21T06:39:14.456 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 4565721, 2024-09-21T06:39:14.456 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 379505, 2024-09-21T06:39:14.457 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 7, 2024-09-21T06:39:14.457 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 3, 2024-09-21T06:39:14.457 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.139760426, 2024-09-21T06:39:14.457 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.065932566, 2024-09-21T06:39:14.457 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.031965083, 2024-09-21T06:39:14.457 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.031099203, 2024-09-21T06:39:14.457 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:14.457 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1195, 2024-09-21T06:39:14.457 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.051763804, 2024-09-21T06:39:14.457 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000043316 2024-09-21T06:39:14.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.457 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:14.457 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.458 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.458 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.458 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T06:39:14.458 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T06:39:14.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.458 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:39:14.458 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 1290, 2024-09-21T06:39:14.458 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 1251, 2024-09-21T06:39:14.458 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 2618845, 2024-09-21T06:39:14.458 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 458461, 2024-09-21T06:39:14.458 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 4, 2024-09-21T06:39:14.458 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 3, 2024-09-21T06:39:14.458 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.123304708, 2024-09-21T06:39:14.459 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.050047355, 2024-09-21T06:39:14.459 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.051339379, 2024-09-21T06:39:14.459 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.027118075, 2024-09-21T06:39:14.459 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:14.459 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 1250, 2024-09-21T06:39:14.459 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.044491450, 2024-09-21T06:39:14.459 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000035593 2024-09-21T06:39:14.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.459 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:14.459 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.459 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.459 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.459 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 1085984, 2024-09-21T06:39:14.460 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 133408 2024-09-21T06:39:14.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.460 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:39:14.460 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 4, 2024-09-21T06:39:14.460 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 164, 2024-09-21T06:39:14.460 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 1508, 2024-09-21T06:39:14.460 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 371269, 2024-09-21T06:39:14.460 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 5, 2024-09-21T06:39:14.460 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 4, 2024-09-21T06:39:14.460 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.014713898, 2024-09-21T06:39:14.460 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.011277652, 2024-09-21T06:39:14.460 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.001993881, 2024-09-21T06:39:14.460 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000064828, 2024-09-21T06:39:14.460 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:14.461 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 162, 2024-09-21T06:39:14.461 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.007885554, 2024-09-21T06:39:14.461 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000048676 2024-09-21T06:39:14.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.461 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:14.461 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.461 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.461 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.461 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:39:14.461 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 370304 2024-09-21T06:39:14.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.461 INFO:teuthology.orchestra.run.smithi063.stdout: "cct": { 2024-09-21T06:39:14.461 INFO:teuthology.orchestra.run.smithi063.stdout: "total_workers": 1, 2024-09-21T06:39:14.462 INFO:teuthology.orchestra.run.smithi063.stdout: "unhealthy_workers": 0 2024-09-21T06:39:14.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.462 INFO:teuthology.orchestra.run.smithi063.stdout: "finisher-MDSRank": { 2024-09-21T06:39:14.462 INFO:teuthology.orchestra.run.smithi063.stdout: "queue_len": 0, 2024-09-21T06:39:14.462 INFO:teuthology.orchestra.run.smithi063.stdout: "complete_latency": { 2024-09-21T06:39:14.462 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 3654, 2024-09-21T06:39:14.462 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.102399156, 2024-09-21T06:39:14.462 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000028023 2024-09-21T06:39:14.462 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:14.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.462 INFO:teuthology.orchestra.run.smithi063.stdout: "finisher-PurgeQueue": { 2024-09-21T06:39:14.462 INFO:teuthology.orchestra.run.smithi063.stdout: "queue_len": 0, 2024-09-21T06:39:14.462 INFO:teuthology.orchestra.run.smithi063.stdout: "complete_latency": { 2024-09-21T06:39:14.462 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.463 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.463 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.463 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:14.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.463 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2024-09-21T06:39:14.463 INFO:teuthology.orchestra.run.smithi063.stdout: "request": 0, 2024-09-21T06:39:14.463 INFO:teuthology.orchestra.run.smithi063.stdout: "reply": 0, 2024-09-21T06:39:14.463 INFO:teuthology.orchestra.run.smithi063.stdout: "reply_latency": { 2024-09-21T06:39:14.463 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.463 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.463 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.463 INFO:teuthology.orchestra.run.smithi063.stdout: "slow_reply": 0, 2024-09-21T06:39:14.463 INFO:teuthology.orchestra.run.smithi063.stdout: "forward": 0, 2024-09-21T06:39:14.464 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_fetch_complete": 0, 2024-09-21T06:39:14.464 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_fetch_keys": 0, 2024-09-21T06:39:14.464 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_commit": 0, 2024-09-21T06:39:14.464 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_split": 0, 2024-09-21T06:39:14.464 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_merge": 0, 2024-09-21T06:39:14.464 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes": 853, 2024-09-21T06:39:14.464 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_top": 0, 2024-09-21T06:39:14.464 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_bottom": 853, 2024-09-21T06:39:14.464 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_pin_tail": 0, 2024-09-21T06:39:14.464 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_pinned": 853, 2024-09-21T06:39:14.464 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_expired": 0, 2024-09-21T06:39:14.464 INFO:teuthology.orchestra.run.smithi063.stdout: "inodes_with_caps": 0, 2024-09-21T06:39:14.464 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": 0, 2024-09-21T06:39:14.464 INFO:teuthology.orchestra.run.smithi063.stdout: "subtrees": 1, 2024-09-21T06:39:14.465 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse": 0, 2024-09-21T06:39:14.465 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_hit": 0, 2024-09-21T06:39:14.465 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_forward": 0, 2024-09-21T06:39:14.465 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_discover": 0, 2024-09-21T06:39:14.465 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:39:14.465 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_remote_ino": 0, 2024-09-21T06:39:14.465 INFO:teuthology.orchestra.run.smithi063.stdout: "traverse_lock": 0, 2024-09-21T06:39:14.465 INFO:teuthology.orchestra.run.smithi063.stdout: "load_cent": 0, 2024-09-21T06:39:14.465 INFO:teuthology.orchestra.run.smithi063.stdout: "q": 0, 2024-09-21T06:39:14.465 INFO:teuthology.orchestra.run.smithi063.stdout: "exported": 0, 2024-09-21T06:39:14.465 INFO:teuthology.orchestra.run.smithi063.stdout: "exported_inodes": 0, 2024-09-21T06:39:14.465 INFO:teuthology.orchestra.run.smithi063.stdout: "imported": 0, 2024-09-21T06:39:14.465 INFO:teuthology.orchestra.run.smithi063.stdout: "imported_inodes": 0, 2024-09-21T06:39:14.465 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_dir_fetch": 0, 2024-09-21T06:39:14.466 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:39:14.466 INFO:teuthology.orchestra.run.smithi063.stdout: "openino_peer_discover": 0, 2024-09-21T06:39:14.466 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rfiles": 0, 2024-09-21T06:39:14.466 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rbytes": 0, 2024-09-21T06:39:14.466 INFO:teuthology.orchestra.run.smithi063.stdout: "root_rsnaps": 0, 2024-09-21T06:39:14.466 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:39:14.466 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_set_tag": 0, 2024-09-21T06:39:14.466 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:39:14.466 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:39:14.466 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:39:14.466 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:39:14.466 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:39:14.466 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_file_inodes": 0, 2024-09-21T06:39:14.466 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:39:14.467 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:39:14.467 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:39:14.467 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:39:14.467 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:39:14.467 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:39:14.467 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_caps": 0, 2024-09-21T06:39:14.467 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:39:14.467 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_cap_release": 0, 2024-09-21T06:39:14.467 INFO:teuthology.orchestra.run.smithi063.stdout: "process_request_cap_release": 0 2024-09-21T06:39:14.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.467 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache": { 2024-09-21T06:39:14.467 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_update": 0, 2024-09-21T06:39:14.467 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_update_receipt": 0, 2024-09-21T06:39:14.467 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_try_discover": 0, 2024-09-21T06:39:14.468 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_send_discover": 0, 2024-09-21T06:39:14.468 INFO:teuthology.orchestra.run.smithi063.stdout: "dir_handle_discover": 0, 2024-09-21T06:39:14.468 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays": 0, 2024-09-21T06:39:14.468 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_delayed": 0, 2024-09-21T06:39:14.468 INFO:teuthology.orchestra.run.smithi063.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:39:14.468 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_created": 0, 2024-09-21T06:39:14.468 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_enqueued": 0, 2024-09-21T06:39:14.468 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_reintegrated": 0, 2024-09-21T06:39:14.468 INFO:teuthology.orchestra.run.smithi063.stdout: "strays_migrated": 0, 2024-09-21T06:39:14.468 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_processing": 0, 2024-09-21T06:39:14.468 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:39:14.468 INFO:teuthology.orchestra.run.smithi063.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:39:14.468 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_started": 0, 2024-09-21T06:39:14.468 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_completed": 0, 2024-09-21T06:39:14.468 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:39:14.469 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:39:14.469 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:39:14.469 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_exportdir": 0, 2024-09-21T06:39:14.469 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_flush": 0, 2024-09-21T06:39:14.469 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:39:14.469 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_fragstats": 0, 2024-09-21T06:39:14.469 INFO:teuthology.orchestra.run.smithi063.stdout: "ireq_inodestats": 0, 2024-09-21T06:39:14.469 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_started": 0, 2024-09-21T06:39:14.469 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_succeeded": 0, 2024-09-21T06:39:14.469 INFO:teuthology.orchestra.run.smithi063.stdout: "uninline_write_failed": 0 2024-09-21T06:39:14.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.469 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log": { 2024-09-21T06:39:14.469 INFO:teuthology.orchestra.run.smithi063.stdout: "evlrg": 0, 2024-09-21T06:39:14.469 INFO:teuthology.orchestra.run.smithi063.stdout: "evadd": 0, 2024-09-21T06:39:14.470 INFO:teuthology.orchestra.run.smithi063.stdout: "evex": 0, 2024-09-21T06:39:14.470 INFO:teuthology.orchestra.run.smithi063.stdout: "evtrm": 0, 2024-09-21T06:39:14.470 INFO:teuthology.orchestra.run.smithi063.stdout: "ev": 1955, 2024-09-21T06:39:14.470 INFO:teuthology.orchestra.run.smithi063.stdout: "evexg": 0, 2024-09-21T06:39:14.470 INFO:teuthology.orchestra.run.smithi063.stdout: "evexd": 0, 2024-09-21T06:39:14.470 INFO:teuthology.orchestra.run.smithi063.stdout: "segadd": 0, 2024-09-21T06:39:14.470 INFO:teuthology.orchestra.run.smithi063.stdout: "segex": 0, 2024-09-21T06:39:14.470 INFO:teuthology.orchestra.run.smithi063.stdout: "segtrm": 0, 2024-09-21T06:39:14.470 INFO:teuthology.orchestra.run.smithi063.stdout: "seg": 4, 2024-09-21T06:39:14.470 INFO:teuthology.orchestra.run.smithi063.stdout: "segmjr": 2, 2024-09-21T06:39:14.470 INFO:teuthology.orchestra.run.smithi063.stdout: "segexg": 0, 2024-09-21T06:39:14.470 INFO:teuthology.orchestra.run.smithi063.stdout: "segexd": 0, 2024-09-21T06:39:14.470 INFO:teuthology.orchestra.run.smithi063.stdout: "expos": 4194304, 2024-09-21T06:39:14.470 INFO:teuthology.orchestra.run.smithi063.stdout: "wrpos": 9663629, 2024-09-21T06:39:14.471 INFO:teuthology.orchestra.run.smithi063.stdout: "rdpos": 9662014, 2024-09-21T06:39:14.471 INFO:teuthology.orchestra.run.smithi063.stdout: "jlat": { 2024-09-21T06:39:14.471 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.471 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.471 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.471 INFO:teuthology.orchestra.run.smithi063.stdout: "replayed": 1955 2024-09-21T06:39:14.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.471 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_mem": { 2024-09-21T06:39:14.471 INFO:teuthology.orchestra.run.smithi063.stdout: "ino": 6, 2024-09-21T06:39:14.471 INFO:teuthology.orchestra.run.smithi063.stdout: "ino+": 2212, 2024-09-21T06:39:14.472 INFO:teuthology.orchestra.run.smithi063.stdout: "ino-": 2206, 2024-09-21T06:39:14.472 INFO:teuthology.orchestra.run.smithi063.stdout: "dir": 4, 2024-09-21T06:39:14.472 INFO:teuthology.orchestra.run.smithi063.stdout: "dir+": 59, 2024-09-21T06:39:14.472 INFO:teuthology.orchestra.run.smithi063.stdout: "dir-": 55, 2024-09-21T06:39:14.472 INFO:teuthology.orchestra.run.smithi063.stdout: "dn": 853, 2024-09-21T06:39:14.472 INFO:teuthology.orchestra.run.smithi063.stdout: "dn+": 3060, 2024-09-21T06:39:14.472 INFO:teuthology.orchestra.run.smithi063.stdout: "dn-": 2207, 2024-09-21T06:39:14.472 INFO:teuthology.orchestra.run.smithi063.stdout: "cap": 0, 2024-09-21T06:39:14.472 INFO:teuthology.orchestra.run.smithi063.stdout: "cap+": 0, 2024-09-21T06:39:14.472 INFO:teuthology.orchestra.run.smithi063.stdout: "cap-": 0, 2024-09-21T06:39:14.472 INFO:teuthology.orchestra.run.smithi063.stdout: "rss": 123240, 2024-09-21T06:39:14.472 INFO:teuthology.orchestra.run.smithi063.stdout: "heap": 326471680 2024-09-21T06:39:14.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.472 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_server": { 2024-09-21T06:39:14.473 INFO:teuthology.orchestra.run.smithi063.stdout: "dispatch_client_request": 0, 2024-09-21T06:39:14.473 INFO:teuthology.orchestra.run.smithi063.stdout: "dispatch_server_request": 0, 2024-09-21T06:39:14.473 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_request": 0, 2024-09-21T06:39:14.473 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_client_session": 0, 2024-09-21T06:39:14.473 INFO:teuthology.orchestra.run.smithi063.stdout: "handle_peer_request": 0, 2024-09-21T06:39:14.473 INFO:teuthology.orchestra.run.smithi063.stdout: "req_create_latency": { 2024-09-21T06:39:14.473 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.473 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.473 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.473 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getattr_latency": { 2024-09-21T06:39:14.473 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.473 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.473 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.474 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getfilelock_latency": { 2024-09-21T06:39:14.474 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.474 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.474 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.474 INFO:teuthology.orchestra.run.smithi063.stdout: "req_link_latency": { 2024-09-21T06:39:14.474 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.474 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.474 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.474 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookup_latency": { 2024-09-21T06:39:14.474 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.474 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.475 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.475 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookuphash_latency": { 2024-09-21T06:39:14.475 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.475 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.475 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.475 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupino_latency": { 2024-09-21T06:39:14.475 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.475 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.475 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.475 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupname_latency": { 2024-09-21T06:39:14.475 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.475 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.476 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.476 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupparent_latency": { 2024-09-21T06:39:14.476 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.476 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.476 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.476 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lookupsnap_latency": { 2024-09-21T06:39:14.476 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.476 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.476 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.476 INFO:teuthology.orchestra.run.smithi063.stdout: "req_lssnap_latency": { 2024-09-21T06:39:14.476 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.477 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.477 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.477 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mkdir_latency": { 2024-09-21T06:39:14.477 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.477 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.478 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.478 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mknod_latency": { 2024-09-21T06:39:14.478 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.478 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.478 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.478 INFO:teuthology.orchestra.run.smithi063.stdout: "req_mksnap_latency": { 2024-09-21T06:39:14.478 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.478 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.478 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.478 INFO:teuthology.orchestra.run.smithi063.stdout: "req_open_latency": { 2024-09-21T06:39:14.478 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.479 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.479 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.479 INFO:teuthology.orchestra.run.smithi063.stdout: "req_readdir_latency": { 2024-09-21T06:39:14.479 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.479 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.479 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.479 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rename_latency": { 2024-09-21T06:39:14.479 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.479 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.479 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.480 INFO:teuthology.orchestra.run.smithi063.stdout: "req_renamesnap_latency": { 2024-09-21T06:39:14.480 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.480 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.480 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.480 INFO:teuthology.orchestra.run.smithi063.stdout: "req_snapdiff_latency": { 2024-09-21T06:39:14.480 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.480 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.480 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.480 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmdir_latency": { 2024-09-21T06:39:14.480 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.480 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.480 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.481 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmsnap_latency": { 2024-09-21T06:39:14.481 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.481 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.481 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.481 INFO:teuthology.orchestra.run.smithi063.stdout: "req_rmxattr_latency": { 2024-09-21T06:39:14.481 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.481 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.481 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.481 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setattr_latency": { 2024-09-21T06:39:14.481 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.481 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.482 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.482 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setdirlayout_latency": { 2024-09-21T06:39:14.482 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.482 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.482 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.482 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setfilelock_latency": { 2024-09-21T06:39:14.482 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.482 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.482 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.482 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setlayout_latency": { 2024-09-21T06:39:14.482 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.483 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.483 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.483 INFO:teuthology.orchestra.run.smithi063.stdout: "req_setxattr_latency": { 2024-09-21T06:39:14.483 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.483 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.483 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.483 INFO:teuthology.orchestra.run.smithi063.stdout: "req_symlink_latency": { 2024-09-21T06:39:14.483 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.483 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.483 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.483 INFO:teuthology.orchestra.run.smithi063.stdout: "req_unlink_latency": { 2024-09-21T06:39:14.484 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.484 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.484 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.484 INFO:teuthology.orchestra.run.smithi063.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:39:14.484 INFO:teuthology.orchestra.run.smithi063.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:39:14.484 INFO:teuthology.orchestra.run.smithi063.stdout: "req_getvxattr_latency": { 2024-09-21T06:39:14.484 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.484 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.484 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.484 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:14.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.484 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_sessions": { 2024-09-21T06:39:14.484 INFO:teuthology.orchestra.run.smithi063.stdout: "session_count": 1, 2024-09-21T06:39:14.485 INFO:teuthology.orchestra.run.smithi063.stdout: "session_add": 1, 2024-09-21T06:39:14.485 INFO:teuthology.orchestra.run.smithi063.stdout: "session_remove": 0, 2024-09-21T06:39:14.485 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions_open": 1, 2024-09-21T06:39:14.485 INFO:teuthology.orchestra.run.smithi063.stdout: "sessions_stale": 0, 2024-09-21T06:39:14.485 INFO:teuthology.orchestra.run.smithi063.stdout: "total_load": 0, 2024-09-21T06:39:14.485 INFO:teuthology.orchestra.run.smithi063.stdout: "average_load": 0, 2024-09-21T06:39:14.485 INFO:teuthology.orchestra.run.smithi063.stdout: "avg_session_uptime": 1750, 2024-09-21T06:39:14.485 INFO:teuthology.orchestra.run.smithi063.stdout: "mdthresh_evicted": 0 2024-09-21T06:39:14.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.485 INFO:teuthology.orchestra.run.smithi063.stdout: "mempool": { 2024-09-21T06:39:14.485 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:39:14.485 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_items": 0, 2024-09-21T06:39:14.485 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:39:14.485 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:39:14.486 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:39:14.486 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:39:14.486 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:39:14.486 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:39:14.486 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:39:14.486 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:39:14.486 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:39:14.486 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:39:14.486 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:39:14.486 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:39:14.486 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:39:14.486 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_items": 0, 2024-09-21T06:39:14.486 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:39:14.486 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_blob_items": 0, 2024-09-21T06:39:14.487 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:39:14.487 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:39:14.487 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:39:14.487 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:39:14.487 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:39:14.487 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:39:14.487 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:39:14.487 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_items": 0, 2024-09-21T06:39:14.487 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:39:14.487 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:39:14.487 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:39:14.487 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_items": 0, 2024-09-21T06:39:14.487 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_bytes": 0, 2024-09-21T06:39:14.487 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_items": 0, 2024-09-21T06:39:14.488 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:39:14.488 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:39:14.488 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:39:14.488 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:39:14.488 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_bytes": 206574, 2024-09-21T06:39:14.488 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_items": 59, 2024-09-21T06:39:14.488 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:39:14.488 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_items": 0, 2024-09-21T06:39:14.488 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bytes": 0, 2024-09-21T06:39:14.488 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_items": 0, 2024-09-21T06:39:14.488 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:39:14.488 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_items": 0, 2024-09-21T06:39:14.488 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:39:14.488 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_items": 0, 2024-09-21T06:39:14.489 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_bytes": 8416, 2024-09-21T06:39:14.489 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_items": 186, 2024-09-21T06:39:14.489 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:39:14.489 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:39:14.489 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_bytes": 0, 2024-09-21T06:39:14.489 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_items": 0, 2024-09-21T06:39:14.489 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_bytes": 602904, 2024-09-21T06:39:14.489 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_items": 3471, 2024-09-21T06:39:14.489 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_bytes": 0, 2024-09-21T06:39:14.489 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_items": 0, 2024-09-21T06:39:14.489 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_bytes": 0, 2024-09-21T06:39:14.489 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_items": 0 2024-09-21T06:39:14.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.489 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter": { 2024-09-21T06:39:14.490 INFO:teuthology.orchestra.run.smithi063.stdout: "op_active": 0, 2024-09-21T06:39:14.490 INFO:teuthology.orchestra.run.smithi063.stdout: "op_laggy": 0, 2024-09-21T06:39:14.490 INFO:teuthology.orchestra.run.smithi063.stdout: "op_send": 2217, 2024-09-21T06:39:14.490 INFO:teuthology.orchestra.run.smithi063.stdout: "op_send_bytes": 21, 2024-09-21T06:39:14.490 INFO:teuthology.orchestra.run.smithi063.stdout: "op_resend": 3, 2024-09-21T06:39:14.490 INFO:teuthology.orchestra.run.smithi063.stdout: "op_reply": 2217, 2024-09-21T06:39:14.490 INFO:teuthology.orchestra.run.smithi063.stdout: "op_latency": { 2024-09-21T06:39:14.490 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 2217, 2024-09-21T06:39:14.490 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 1.497985216, 2024-09-21T06:39:14.490 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000675681 2024-09-21T06:39:14.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.490 INFO:teuthology.orchestra.run.smithi063.stdout: "op_inflight": 0, 2024-09-21T06:39:14.490 INFO:teuthology.orchestra.run.smithi063.stdout: "oplen_avg": { 2024-09-21T06:39:14.490 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 2217, 2024-09-21T06:39:14.491 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 2218 2024-09-21T06:39:14.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.491 INFO:teuthology.orchestra.run.smithi063.stdout: "op": 2217, 2024-09-21T06:39:14.491 INFO:teuthology.orchestra.run.smithi063.stdout: "op_r": 2217, 2024-09-21T06:39:14.491 INFO:teuthology.orchestra.run.smithi063.stdout: "op_w": 0, 2024-09-21T06:39:14.491 INFO:teuthology.orchestra.run.smithi063.stdout: "op_rmw": 0, 2024-09-21T06:39:14.491 INFO:teuthology.orchestra.run.smithi063.stdout: "op_pg": 0, 2024-09-21T06:39:14.491 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_stat": 1426, 2024-09-21T06:39:14.491 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_create": 0, 2024-09-21T06:39:14.491 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_read": 789, 2024-09-21T06:39:14.491 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_write": 0, 2024-09-21T06:39:14.491 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_writefull": 0, 2024-09-21T06:39:14.491 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_writesame": 0, 2024-09-21T06:39:14.491 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_append": 0, 2024-09-21T06:39:14.492 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_zero": 0, 2024-09-21T06:39:14.492 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_truncate": 0, 2024-09-21T06:39:14.492 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_delete": 0, 2024-09-21T06:39:14.492 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_mapext": 0, 2024-09-21T06:39:14.492 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_sparse_read": 0, 2024-09-21T06:39:14.492 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_clonerange": 0, 2024-09-21T06:39:14.492 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_getxattr": 1, 2024-09-21T06:39:14.492 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_setxattr": 0, 2024-09-21T06:39:14.492 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:39:14.492 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_rmxattr": 0, 2024-09-21T06:39:14.492 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:39:14.492 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_call": 0, 2024-09-21T06:39:14.492 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_watch": 0, 2024-09-21T06:39:14.492 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_notify": 0, 2024-09-21T06:39:14.492 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:39:14.493 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_pgls": 0, 2024-09-21T06:39:14.493 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:39:14.493 INFO:teuthology.orchestra.run.smithi063.stdout: "osdop_other": 0, 2024-09-21T06:39:14.493 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_active": 0, 2024-09-21T06:39:14.493 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_send": 0, 2024-09-21T06:39:14.493 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_resend": 0, 2024-09-21T06:39:14.493 INFO:teuthology.orchestra.run.smithi063.stdout: "linger_ping": 0, 2024-09-21T06:39:14.493 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_active": 0, 2024-09-21T06:39:14.493 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_send": 0, 2024-09-21T06:39:14.493 INFO:teuthology.orchestra.run.smithi063.stdout: "poolop_resend": 0, 2024-09-21T06:39:14.493 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_active": 0, 2024-09-21T06:39:14.493 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_send": 0, 2024-09-21T06:39:14.493 INFO:teuthology.orchestra.run.smithi063.stdout: "poolstat_resend": 0, 2024-09-21T06:39:14.494 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_active": 0, 2024-09-21T06:39:14.494 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_send": 0, 2024-09-21T06:39:14.494 INFO:teuthology.orchestra.run.smithi063.stdout: "statfs_resend": 0, 2024-09-21T06:39:14.494 INFO:teuthology.orchestra.run.smithi063.stdout: "command_active": 0, 2024-09-21T06:39:14.494 INFO:teuthology.orchestra.run.smithi063.stdout: "command_send": 0, 2024-09-21T06:39:14.494 INFO:teuthology.orchestra.run.smithi063.stdout: "command_resend": 0, 2024-09-21T06:39:14.494 INFO:teuthology.orchestra.run.smithi063.stdout: "map_epoch": 87, 2024-09-21T06:39:14.494 INFO:teuthology.orchestra.run.smithi063.stdout: "map_full": 0, 2024-09-21T06:39:14.494 INFO:teuthology.orchestra.run.smithi063.stdout: "map_inc": 12, 2024-09-21T06:39:14.494 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_sessions": 7, 2024-09-21T06:39:14.494 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_session_open": 7, 2024-09-21T06:39:14.494 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_session_close": 0, 2024-09-21T06:39:14.494 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_laggy": 0, 2024-09-21T06:39:14.494 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_wr": 0, 2024-09-21T06:39:14.495 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_rd": 2, 2024-09-21T06:39:14.495 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_del": 0 2024-09-21T06:39:14.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.495 INFO:teuthology.orchestra.run.smithi063.stdout: "oft": { 2024-09-21T06:39:14.495 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_objs": 0, 2024-09-21T06:39:14.495 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:39:14.495 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_updates": 0, 2024-09-21T06:39:14.495 INFO:teuthology.orchestra.run.smithi063.stdout: "omap_total_removes": 0 2024-09-21T06:39:14.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.495 INFO:teuthology.orchestra.run.smithi063.stdout: "purge_queue": { 2024-09-21T06:39:14.495 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops": 0, 2024-09-21T06:39:14.495 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:39:14.495 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing": 0, 2024-09-21T06:39:14.495 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executing_high_water": 0, 2024-09-21T06:39:14.495 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executed_ops": 0, 2024-09-21T06:39:14.496 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_executed": 0, 2024-09-21T06:39:14.496 INFO:teuthology.orchestra.run.smithi063.stdout: "pq_item_in_journal": 0 2024-09-21T06:39:14.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.496 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:39:14.496 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2024-09-21T06:39:14.496 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2024-09-21T06:39:14.496 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2024-09-21T06:39:14.496 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 2487, 2024-09-21T06:39:14.496 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 6945713, 2024-09-21T06:39:14.496 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:14.496 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 2487, 2024-09-21T06:39:14.496 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2024-09-21T06:39:14.496 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2024-09-21T06:39:14.496 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 2487, 2024-09-21T06:39:14.497 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 6945713, 2024-09-21T06:39:14.497 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2024-09-21T06:39:14.497 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.497 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.497 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.497 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:14.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.497 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-objecter_bytes": { 2024-09-21T06:39:14.497 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2024-09-21T06:39:14.497 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2024-09-21T06:39:14.497 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2024-09-21T06:39:14.497 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2024-09-21T06:39:14.497 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2024-09-21T06:39:14.497 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:14.498 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:14.498 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 2217, 2024-09-21T06:39:14.498 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 5469330, 2024-09-21T06:39:14.498 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 2217, 2024-09-21T06:39:14.498 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 5469330, 2024-09-21T06:39:14.498 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2024-09-21T06:39:14.498 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.498 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.498 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.498 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:14.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.498 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-objecter_ops": { 2024-09-21T06:39:14.498 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2024-09-21T06:39:14.498 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 1024, 2024-09-21T06:39:14.499 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2024-09-21T06:39:14.499 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2024-09-21T06:39:14.499 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2024-09-21T06:39:14.499 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:14.499 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:14.499 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 2217, 2024-09-21T06:39:14.499 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 2217, 2024-09-21T06:39:14.499 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 2217, 2024-09-21T06:39:14.499 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 2217, 2024-09-21T06:39:14.499 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2024-09-21T06:39:14.499 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.499 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.499 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.499 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:14.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.500 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:39:14.500 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2024-09-21T06:39:14.500 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 3758096384, 2024-09-21T06:39:14.500 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2024-09-21T06:39:14.500 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2024-09-21T06:39:14.500 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2024-09-21T06:39:14.500 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:14.500 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:14.500 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2024-09-21T06:39:14.500 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2024-09-21T06:39:14.500 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 0, 2024-09-21T06:39:14.500 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 0, 2024-09-21T06:39:14.500 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2024-09-21T06:39:14.500 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.501 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.501 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.501 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:14.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.501 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-write_buf_throttle-0x5654a0c87450": { 2024-09-21T06:39:14.501 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2024-09-21T06:39:14.501 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 3758096384, 2024-09-21T06:39:14.501 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2024-09-21T06:39:14.501 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 0, 2024-09-21T06:39:14.501 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 0, 2024-09-21T06:39:14.501 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:14.501 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:14.501 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2024-09-21T06:39:14.501 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2024-09-21T06:39:14.502 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 0, 2024-09-21T06:39:14.502 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 0, 2024-09-21T06:39:14.502 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2024-09-21T06:39:14.502 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:14.502 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:14.502 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:14.502 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:14.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:14.502 INFO:teuthology.orchestra.run.smithi063.stdout: "trackedop": { 2024-09-21T06:39:14.502 INFO:teuthology.orchestra.run.smithi063.stdout: "slow_ops_count": 0 2024-09-21T06:39:14.502 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:14.502 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:39:15.328 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-21T06:39:15.328 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-21T06:39:15.328 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-09-21T06:39:15.329 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:39:15.329 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:39:15.329 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2024-09-21T06:39:15.329 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T06:39:15.329 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T06:39:15.591 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:15.973 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:15 smithi063 ceph-mon[31150]: pgmap v663: 97 pgs: 2 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 92 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:39:16.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:15 smithi071 ceph-mon[34844]: pgmap v663: 97 pgs: 2 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 92 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:39:16.095 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T06:39:16.095 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:39:16.096 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 224, 2024-09-21T06:39:16.096 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 219, 2024-09-21T06:39:16.096 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 838624, 2024-09-21T06:39:16.096 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 134464, 2024-09-21T06:39:16.096 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 4, 2024-09-21T06:39:16.096 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 0, 2024-09-21T06:39:16.096 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.042757239, 2024-09-21T06:39:16.096 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.018965792, 2024-09-21T06:39:16.096 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.030272424, 2024-09-21T06:39:16.096 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:39:16.096 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:16.096 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 218, 2024-09-21T06:39:16.097 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.010670160, 2024-09-21T06:39:16.097 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000048945 2024-09-21T06:39:16.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:16.097 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:16.097 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:16.097 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:16.097 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:16.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:16.097 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 838624, 2024-09-21T06:39:16.097 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 134464 2024-09-21T06:39:16.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:16.097 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:39:16.097 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 5, 2024-09-21T06:39:16.097 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 168, 2024-09-21T06:39:16.098 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 3104, 2024-09-21T06:39:16.098 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 109856, 2024-09-21T06:39:16.098 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 3, 2024-09-21T06:39:16.098 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 2, 2024-09-21T06:39:16.098 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.018320193, 2024-09-21T06:39:16.098 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.013211977, 2024-09-21T06:39:16.098 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.003512071, 2024-09-21T06:39:16.098 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:39:16.098 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:16.098 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 167, 2024-09-21T06:39:16.098 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.011926026, 2024-09-21T06:39:16.098 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000071413 2024-09-21T06:39:16.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:16.098 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:16.099 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:16.099 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:16.099 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:16.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:16.099 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T06:39:16.099 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 109856 2024-09-21T06:39:16.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:16.099 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:39:16.099 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 0, 2024-09-21T06:39:16.099 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 2, 2024-09-21T06:39:16.099 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:39:16.099 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 0, 2024-09-21T06:39:16.099 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 2, 2024-09-21T06:39:16.099 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 1, 2024-09-21T06:39:16.100 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.000525087, 2024-09-21T06:39:16.100 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:39:16.100 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.000446755, 2024-09-21T06:39:16.100 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:39:16.100 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:16.100 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:16.100 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:16.100 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:16.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:16.100 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:16.100 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:16.100 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:16.100 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:16.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:16.101 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:39:16.101 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:39:16.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:16.101 INFO:teuthology.orchestra.run.smithi063.stdout: "cct": { 2024-09-21T06:39:16.101 INFO:teuthology.orchestra.run.smithi063.stdout: "total_workers": 0, 2024-09-21T06:39:16.101 INFO:teuthology.orchestra.run.smithi063.stdout: "unhealthy_workers": 0 2024-09-21T06:39:16.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:16.101 INFO:teuthology.orchestra.run.smithi063.stdout: "mempool": { 2024-09-21T06:39:16.101 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:39:16.101 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_items": 0, 2024-09-21T06:39:16.101 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:39:16.101 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:39:16.101 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:39:16.101 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:39:16.102 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:39:16.102 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:39:16.102 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:39:16.102 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:39:16.102 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:39:16.102 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:39:16.102 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:39:16.102 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:39:16.102 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:39:16.102 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_items": 0, 2024-09-21T06:39:16.102 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:39:16.102 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_blob_items": 0, 2024-09-21T06:39:16.102 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:39:16.103 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:39:16.103 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:39:16.103 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:39:16.103 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:39:16.103 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:39:16.103 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:39:16.103 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_items": 0, 2024-09-21T06:39:16.103 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:39:16.103 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:39:16.103 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:39:16.103 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_items": 0, 2024-09-21T06:39:16.103 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_bytes": 0, 2024-09-21T06:39:16.103 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_items": 0, 2024-09-21T06:39:16.103 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:39:16.104 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:39:16.104 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:39:16.104 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:39:16.104 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_bytes": 148967, 2024-09-21T06:39:16.104 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_items": 29, 2024-09-21T06:39:16.104 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:39:16.104 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_items": 0, 2024-09-21T06:39:16.104 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bytes": 0, 2024-09-21T06:39:16.104 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_items": 0, 2024-09-21T06:39:16.104 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:39:16.104 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_items": 0, 2024-09-21T06:39:16.104 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:39:16.104 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_items": 0, 2024-09-21T06:39:16.104 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_bytes": 0, 2024-09-21T06:39:16.105 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_items": 0, 2024-09-21T06:39:16.105 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:39:16.105 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:39:16.105 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_bytes": 0, 2024-09-21T06:39:16.105 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_items": 0, 2024-09-21T06:39:16.105 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_bytes": 968, 2024-09-21T06:39:16.105 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_items": 2, 2024-09-21T06:39:16.105 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_bytes": 0, 2024-09-21T06:39:16.105 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_items": 0, 2024-09-21T06:39:16.105 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_bytes": 0, 2024-09-21T06:39:16.105 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_items": 0 2024-09-21T06:39:16.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T06:39:16.105 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:39:16.106 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2024-09-21T06:39:16.106 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2024-09-21T06:39:16.106 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2024-09-21T06:39:16.106 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 225, 2024-09-21T06:39:16.106 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 806956, 2024-09-21T06:39:16.106 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:16.106 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 225, 2024-09-21T06:39:16.106 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2024-09-21T06:39:16.106 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2024-09-21T06:39:16.106 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 225, 2024-09-21T06:39:16.106 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 806956, 2024-09-21T06:39:16.106 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2024-09-21T06:39:16.106 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-21T06:39:16.106 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-21T06:39:16.107 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-21T06:39:16.107 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:16.107 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T06:39:16.107 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T06:39:16.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:15 smithi175 ceph-mon[34510]: pgmap v663: 97 pgs: 2 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 92 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:39:16.915 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T06:39:16.915 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T06:39:16.915 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-21T06:39:16.915 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-21T06:39:16.915 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-21T06:39:16.915 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-21T06:39:16.915 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T06:39:16.916 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T06:39:17.180 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:39:17.710 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-21T06:39:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:39:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 798, 2024-09-21T06:39:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 798, 2024-09-21T06:39:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 51943624, 2024-09-21T06:39:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 252950, 2024-09-21T06:39:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 11, 2024-09-21T06:39:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 3, 2024-09-21T06:39:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.112337598, 2024-09-21T06:39:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.042097921, 2024-09-21T06:39:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.042354401, 2024-09-21T06:39:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.018882182, 2024-09-21T06:39:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 797, 2024-09-21T06:39:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.041099702, 2024-09-21T06:39:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000051568 2024-09-21T06:39:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T06:39:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T06:39:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:39:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 1189, 2024-09-21T06:39:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 1166, 2024-09-21T06:39:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 51444569, 2024-09-21T06:39:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 412349, 2024-09-21T06:39:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 15, 2024-09-21T06:39:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 5, 2024-09-21T06:39:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.136523585, 2024-09-21T06:39:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.045035850, 2024-09-21T06:39:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.067398932, 2024-09-21T06:39:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.024201223, 2024-09-21T06:39:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1165, 2024-09-21T06:39:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.052460645, 2024-09-21T06:39:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000045030 2024-09-21T06:39:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.715 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 370192, 2024-09-21T06:39:17.715 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 92384 2024-09-21T06:39:17.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.715 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:39:17.715 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 145, 2024-09-21T06:39:17.715 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 256, 2024-09-21T06:39:17.715 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 21009300, 2024-09-21T06:39:17.715 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 333322, 2024-09-21T06:39:17.715 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 8, 2024-09-21T06:39:17.715 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 5, 2024-09-21T06:39:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.029649597, 2024-09-21T06:39:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.010057278, 2024-09-21T06:39:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.014862197, 2024-09-21T06:39:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.002820475, 2024-09-21T06:39:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 254, 2024-09-21T06:39:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.011602973, 2024-09-21T06:39:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000045680 2024-09-21T06:39:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:39:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 287520 2024-09-21T06:39:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-09-21T06:39:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 1, 2024-09-21T06:39:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-09-21T06:39:17.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.718 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-MDSRank": { 2024-09-21T06:39:17.718 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-21T06:39:17.718 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-21T06:39:17.718 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 3205, 2024-09-21T06:39:17.718 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.072914738, 2024-09-21T06:39:17.718 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000022750 2024-09-21T06:39:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-PurgeQueue": { 2024-09-21T06:39:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-21T06:39:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-21T06:39:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-21T06:39:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: "request": 0, 2024-09-21T06:39:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: "reply": 0, 2024-09-21T06:39:17.720 INFO:teuthology.orchestra.run.smithi071.stdout: "reply_latency": { 2024-09-21T06:39:17.720 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.720 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.720 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.720 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_reply": 0, 2024-09-21T06:39:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "forward": 0, 2024-09-21T06:39:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_complete": 0, 2024-09-21T06:39:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_keys": 0, 2024-09-21T06:39:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_commit": 0, 2024-09-21T06:39:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_split": 0, 2024-09-21T06:39:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_merge": 0, 2024-09-21T06:39:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes": 2171, 2024-09-21T06:39:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_top": 0, 2024-09-21T06:39:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_bottom": 2171, 2024-09-21T06:39:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pin_tail": 0, 2024-09-21T06:39:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pinned": 2171, 2024-09-21T06:39:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_expired": 0, 2024-09-21T06:39:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_with_caps": 0, 2024-09-21T06:39:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": 0, 2024-09-21T06:39:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: "subtrees": 3, 2024-09-21T06:39:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse": 0, 2024-09-21T06:39:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_hit": 0, 2024-09-21T06:39:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_forward": 0, 2024-09-21T06:39:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_discover": 0, 2024-09-21T06:39:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:39:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_remote_ino": 0, 2024-09-21T06:39:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_lock": 0, 2024-09-21T06:39:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: "load_cent": 0, 2024-09-21T06:39:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: "q": 0, 2024-09-21T06:39:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "exported": 0, 2024-09-21T06:39:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "exported_inodes": 0, 2024-09-21T06:39:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "imported": 0, 2024-09-21T06:39:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "imported_inodes": 0, 2024-09-21T06:39:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_dir_fetch": 0, 2024-09-21T06:39:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:39:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_peer_discover": 0, 2024-09-21T06:39:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rfiles": 4, 2024-09-21T06:39:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rbytes": 234, 2024-09-21T06:39:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rsnaps": 6, 2024-09-21T06:39:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:39:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_set_tag": 0, 2024-09-21T06:39:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:39:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:39:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:39:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:39:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:39:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_file_inodes": 0, 2024-09-21T06:39:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:39:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:39:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:39:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:39:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:39:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:39:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps": 0, 2024-09-21T06:39:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:39:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_cap_release": 0, 2024-09-21T06:39:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: "process_request_cap_release": 0 2024-09-21T06:39:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache": { 2024-09-21T06:39:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update": 0, 2024-09-21T06:39:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update_receipt": 0, 2024-09-21T06:39:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_try_discover": 0, 2024-09-21T06:39:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_send_discover": 0, 2024-09-21T06:39:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_handle_discover": 0, 2024-09-21T06:39:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays": 0, 2024-09-21T06:39:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_delayed": 0, 2024-09-21T06:39:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:39:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_created": 0, 2024-09-21T06:39:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_enqueued": 0, 2024-09-21T06:39:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_reintegrated": 0, 2024-09-21T06:39:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_migrated": 0, 2024-09-21T06:39:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_processing": 0, 2024-09-21T06:39:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:39:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:39:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_started": 0, 2024-09-21T06:39:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_completed": 0, 2024-09-21T06:39:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:39:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:39:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:39:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_exportdir": 0, 2024-09-21T06:39:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_flush": 0, 2024-09-21T06:39:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:39:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragstats": 0, 2024-09-21T06:39:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_inodestats": 0, 2024-09-21T06:39:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_started": 0, 2024-09-21T06:39:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_succeeded": 0, 2024-09-21T06:39:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_write_failed": 0 2024-09-21T06:39:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log": { 2024-09-21T06:39:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: "evlrg": 0, 2024-09-21T06:39:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: "evadd": 0, 2024-09-21T06:39:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: "evex": 0, 2024-09-21T06:39:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: "evtrm": 0, 2024-09-21T06:39:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: "ev": 38273, 2024-09-21T06:39:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: "evexg": 0, 2024-09-21T06:39:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: "evexd": 0, 2024-09-21T06:39:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: "segadd": 0, 2024-09-21T06:39:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: "segex": 0, 2024-09-21T06:39:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "segtrm": 0, 2024-09-21T06:39:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "seg": 60, 2024-09-21T06:39:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "segmjr": 4, 2024-09-21T06:39:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "segexg": 0, 2024-09-21T06:39:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "segexd": 0, 2024-09-21T06:39:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "expos": 23804643, 2024-09-21T06:39:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "wrpos": 147279780, 2024-09-21T06:39:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "rdpos": 147279668, 2024-09-21T06:39:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "jlat": { 2024-09-21T06:39:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "replayed": 38273 2024-09-21T06:39:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mem": { 2024-09-21T06:39:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 78, 2024-09-21T06:39:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "ino+": 6488, 2024-09-21T06:39:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "ino-": 6410, 2024-09-21T06:39:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "dir": 20, 2024-09-21T06:39:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "dir+": 314, 2024-09-21T06:39:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "dir-": 294, 2024-09-21T06:39:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "dn": 2171, 2024-09-21T06:39:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "dn+": 6657, 2024-09-21T06:39:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "dn-": 4486, 2024-09-21T06:39:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "cap": 0, 2024-09-21T06:39:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "cap+": 0, 2024-09-21T06:39:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "cap-": 0, 2024-09-21T06:39:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "rss": 134372, 2024-09-21T06:39:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: "heap": 340332544 2024-09-21T06:39:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server": { 2024-09-21T06:39:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_client_request": 0, 2024-09-21T06:39:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_server_request": 0, 2024-09-21T06:39:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_request": 0, 2024-09-21T06:39:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_session": 0, 2024-09-21T06:39:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_peer_request": 0, 2024-09-21T06:39:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: "req_create_latency": { 2024-09-21T06:39:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getattr_latency": { 2024-09-21T06:39:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getfilelock_latency": { 2024-09-21T06:39:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: "req_link_latency": { 2024-09-21T06:39:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookup_latency": { 2024-09-21T06:39:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookuphash_latency": { 2024-09-21T06:39:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupino_latency": { 2024-09-21T06:39:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupname_latency": { 2024-09-21T06:39:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupparent_latency": { 2024-09-21T06:39:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupsnap_latency": { 2024-09-21T06:39:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lssnap_latency": { 2024-09-21T06:39:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mkdir_latency": { 2024-09-21T06:39:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mknod_latency": { 2024-09-21T06:39:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mksnap_latency": { 2024-09-21T06:39:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: "req_open_latency": { 2024-09-21T06:39:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: "req_readdir_latency": { 2024-09-21T06:39:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rename_latency": { 2024-09-21T06:39:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: "req_renamesnap_latency": { 2024-09-21T06:39:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: "req_snapdiff_latency": { 2024-09-21T06:39:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmdir_latency": { 2024-09-21T06:39:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmsnap_latency": { 2024-09-21T06:39:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmxattr_latency": { 2024-09-21T06:39:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setattr_latency": { 2024-09-21T06:39:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setdirlayout_latency": { 2024-09-21T06:39:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setfilelock_latency": { 2024-09-21T06:39:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setlayout_latency": { 2024-09-21T06:39:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setxattr_latency": { 2024-09-21T06:39:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: "req_symlink_latency": { 2024-09-21T06:39:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: "req_unlink_latency": { 2024-09-21T06:39:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:39:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:39:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getvxattr_latency": { 2024-09-21T06:39:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessions": { 2024-09-21T06:39:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: "session_count": 2, 2024-09-21T06:39:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: "session_add": 2, 2024-09-21T06:39:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: "session_remove": 0, 2024-09-21T06:39:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_open": 0, 2024-09-21T06:39:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_stale": 0, 2024-09-21T06:39:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: "total_load": 0, 2024-09-21T06:39:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: "average_load": 0, 2024-09-21T06:39:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: "avg_session_uptime": 1990, 2024-09-21T06:39:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: "mdthresh_evicted": 0 2024-09-21T06:39:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-09-21T06:39:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:39:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-09-21T06:39:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:39:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:39:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:39:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:39:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:39:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:39:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:39:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:39:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:39:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:39:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:39:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:39:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:39:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-09-21T06:39:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:39:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-09-21T06:39:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:39:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:39:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:39:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:39:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:39:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:39:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:39:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-09-21T06:39:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:39:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:39:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:39:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-09-21T06:39:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-09-21T06:39:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-09-21T06:39:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:39:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:39:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:39:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:39:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 241518, 2024-09-21T06:39:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 149, 2024-09-21T06:39:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:39:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 0, 2024-09-21T06:39:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-09-21T06:39:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-09-21T06:39:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:39:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-09-21T06:39:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:39:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-09-21T06:39:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 8416, 2024-09-21T06:39:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 186, 2024-09-21T06:39:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:39:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:39:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-09-21T06:39:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-09-21T06:39:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 1731308, 2024-09-21T06:39:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 11000, 2024-09-21T06:39:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-09-21T06:39:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-09-21T06:39:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-09-21T06:39:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-09-21T06:39:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter": { 2024-09-21T06:39:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "op_active": 0, 2024-09-21T06:39:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "op_laggy": 0, 2024-09-21T06:39:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send": 1944, 2024-09-21T06:39:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send_bytes": 26, 2024-09-21T06:39:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "op_resend": 0, 2024-09-21T06:39:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "op_reply": 1944, 2024-09-21T06:39:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "op_latency": { 2024-09-21T06:39:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1944, 2024-09-21T06:39:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 1.363976690, 2024-09-21T06:39:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000701634 2024-09-21T06:39:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "op_inflight": 0, 2024-09-21T06:39:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "oplen_avg": { 2024-09-21T06:39:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1944, 2024-09-21T06:39:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 1945 2024-09-21T06:39:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "op": 1944, 2024-09-21T06:39:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "op_r": 1944, 2024-09-21T06:39:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "op_w": 0, 2024-09-21T06:39:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "op_rmw": 0, 2024-09-21T06:39:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "op_pg": 0, 2024-09-21T06:39:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_stat": 1172, 2024-09-21T06:39:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_create": 0, 2024-09-21T06:39:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_read": 769, 2024-09-21T06:39:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_write": 0, 2024-09-21T06:39:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writefull": 0, 2024-09-21T06:39:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writesame": 0, 2024-09-21T06:39:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_append": 0, 2024-09-21T06:39:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_zero": 0, 2024-09-21T06:39:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_truncate": 0, 2024-09-21T06:39:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_delete": 0, 2024-09-21T06:39:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_mapext": 0, 2024-09-21T06:39:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_sparse_read": 0, 2024-09-21T06:39:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_clonerange": 0, 2024-09-21T06:39:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_getxattr": 2, 2024-09-21T06:39:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_setxattr": 0, 2024-09-21T06:39:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:39:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_rmxattr": 0, 2024-09-21T06:39:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:39:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_call": 0, 2024-09-21T06:39:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_watch": 0, 2024-09-21T06:39:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_notify": 0, 2024-09-21T06:39:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:39:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls": 0, 2024-09-21T06:39:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:39:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_other": 0, 2024-09-21T06:39:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_active": 0, 2024-09-21T06:39:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_send": 0, 2024-09-21T06:39:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_resend": 0, 2024-09-21T06:39:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_ping": 0, 2024-09-21T06:39:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_active": 0, 2024-09-21T06:39:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_send": 0, 2024-09-21T06:39:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_resend": 0, 2024-09-21T06:39:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_active": 0, 2024-09-21T06:39:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_send": 0, 2024-09-21T06:39:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_resend": 0, 2024-09-21T06:39:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_active": 0, 2024-09-21T06:39:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_send": 0, 2024-09-21T06:39:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_resend": 0, 2024-09-21T06:39:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "command_active": 0, 2024-09-21T06:39:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "command_send": 0, 2024-09-21T06:39:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "command_resend": 0, 2024-09-21T06:39:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "map_epoch": 87, 2024-09-21T06:39:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "map_full": 0, 2024-09-21T06:39:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "map_inc": 9, 2024-09-21T06:39:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_sessions": 11, 2024-09-21T06:39:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_open": 11, 2024-09-21T06:39:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_close": 0, 2024-09-21T06:39:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_laggy": 0, 2024-09-21T06:39:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_wr": 0, 2024-09-21T06:39:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_rd": 2, 2024-09-21T06:39:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_del": 0 2024-09-21T06:39:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "oft": { 2024-09-21T06:39:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_objs": 0, 2024-09-21T06:39:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:39:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_updates": 0, 2024-09-21T06:39:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_removes": 0 2024-09-21T06:39:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: "purge_queue": { 2024-09-21T06:39:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops": 0, 2024-09-21T06:39:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:39:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing": 0, 2024-09-21T06:39:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_high_water": 0, 2024-09-21T06:39:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed_ops": 0, 2024-09-21T06:39:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed": 0, 2024-09-21T06:39:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_item_in_journal": 0 2024-09-21T06:39:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:39:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-21T06:39:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-21T06:39:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-21T06:39:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 2128, 2024-09-21T06:39:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 124193725, 2024-09-21T06:39:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 2128, 2024-09-21T06:39:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-21T06:39:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-21T06:39:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 2128, 2024-09-21T06:39:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 124193725, 2024-09-21T06:39:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-21T06:39:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_bytes": { 2024-09-21T06:39:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-21T06:39:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-21T06:39:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-21T06:39:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-21T06:39:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-21T06:39:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 1944, 2024-09-21T06:39:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 123482131, 2024-09-21T06:39:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 1944, 2024-09-21T06:39:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 123482131, 2024-09-21T06:39:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-21T06:39:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_ops": { 2024-09-21T06:39:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-21T06:39:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 1024, 2024-09-21T06:39:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-21T06:39:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-21T06:39:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-21T06:39:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 1944, 2024-09-21T06:39:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 1944, 2024-09-21T06:39:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 1944, 2024-09-21T06:39:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 1944, 2024-09-21T06:39:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-21T06:39:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:39:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-21T06:39:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-21T06:39:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-21T06:39:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-21T06:39:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-21T06:39:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-21T06:39:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-21T06:39:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-21T06:39:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-21T06:39:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-21T06:39:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle-0x559847d395f0": { 2024-09-21T06:39:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-21T06:39:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-21T06:39:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-21T06:39:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-21T06:39:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-21T06:39:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-21T06:39:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-21T06:39:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-21T06:39:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-21T06:39:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-21T06:39:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: "trackedop": { 2024-09-21T06:39:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_ops_count": 0 2024-09-21T06:39:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:17.761 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-21T06:39:17.871 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:17 smithi071 ceph-mon[34844]: pgmap v664: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:39:18.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:17 smithi063 ceph-mon[31150]: pgmap v664: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:39:18.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:17 smithi175 ceph-mon[34510]: pgmap v664: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:39:18.485 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-21T06:39:18.485 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-21T06:39:18.485 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-21T06:39:18.485 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:39:18.485 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:39:18.485 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=0 2024-09-21T06:39:18.485 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T06:39:18.486 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T06:39:18.738 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:39:19.288 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-21T06:39:19.288 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:39:19.288 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 1398, 2024-09-21T06:39:19.288 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 1354, 2024-09-21T06:39:19.288 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 1452568, 2024-09-21T06:39:19.288 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 492438, 2024-09-21T06:39:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 5, 2024-09-21T06:39:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 1, 2024-09-21T06:39:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.182370028, 2024-09-21T06:39:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.084931881, 2024-09-21T06:39:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.063240971, 2024-09-21T06:39:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.035033467, 2024-09-21T06:39:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1354, 2024-09-21T06:39:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.060457606, 2024-09-21T06:39:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000044651 2024-09-21T06:39:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 1108576, 2024-09-21T06:39:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 137232 2024-09-21T06:39:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:39:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 481, 2024-09-21T06:39:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 645, 2024-09-21T06:39:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 5751977, 2024-09-21T06:39:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 525358, 2024-09-21T06:39:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 5, 2024-09-21T06:39:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 4, 2024-09-21T06:39:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.062791030, 2024-09-21T06:39:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.031555612, 2024-09-21T06:39:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.014260084, 2024-09-21T06:39:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.011951278, 2024-09-21T06:39:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 643, 2024-09-21T06:39:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.024098569, 2024-09-21T06:39:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000037478 2024-09-21T06:39:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:39:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 372656 2024-09-21T06:39:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:39:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 641, 2024-09-21T06:39:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 643, 2024-09-21T06:39:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 21140189, 2024-09-21T06:39:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 203845, 2024-09-21T06:39:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 5, 2024-09-21T06:39:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 4, 2024-09-21T06:39:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.065650493, 2024-09-21T06:39:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.021091491, 2024-09-21T06:39:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.025939645, 2024-09-21T06:39:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.015170353, 2024-09-21T06:39:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 641, 2024-09-21T06:39:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.021227744, 2024-09-21T06:39:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000033116 2024-09-21T06:39:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:39:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:39:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-09-21T06:39:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 1, 2024-09-21T06:39:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-09-21T06:39:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-MDSRank": { 2024-09-21T06:39:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-21T06:39:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-21T06:39:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 3792, 2024-09-21T06:39:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.100448959, 2024-09-21T06:39:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000026489 2024-09-21T06:39:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-PurgeQueue": { 2024-09-21T06:39:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-21T06:39:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-21T06:39:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-21T06:39:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: "request": 0, 2024-09-21T06:39:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: "reply": 0, 2024-09-21T06:39:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: "reply_latency": { 2024-09-21T06:39:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_reply": 0, 2024-09-21T06:39:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "forward": 0, 2024-09-21T06:39:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_complete": 0, 2024-09-21T06:39:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_keys": 0, 2024-09-21T06:39:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_commit": 0, 2024-09-21T06:39:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_split": 0, 2024-09-21T06:39:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_merge": 0, 2024-09-21T06:39:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes": 14230, 2024-09-21T06:39:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_top": 3, 2024-09-21T06:39:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_bottom": 14227, 2024-09-21T06:39:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pin_tail": 0, 2024-09-21T06:39:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pinned": 14225, 2024-09-21T06:39:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_expired": 0, 2024-09-21T06:39:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_with_caps": 0, 2024-09-21T06:39:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": 0, 2024-09-21T06:39:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: "subtrees": 3, 2024-09-21T06:39:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse": 0, 2024-09-21T06:39:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_hit": 0, 2024-09-21T06:39:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_forward": 0, 2024-09-21T06:39:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_discover": 0, 2024-09-21T06:39:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:39:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_remote_ino": 0, 2024-09-21T06:39:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_lock": 0, 2024-09-21T06:39:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: "load_cent": 0, 2024-09-21T06:39:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: "q": 0, 2024-09-21T06:39:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: "exported": 0, 2024-09-21T06:39:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: "exported_inodes": 0, 2024-09-21T06:39:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "imported": 0, 2024-09-21T06:39:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "imported_inodes": 0, 2024-09-21T06:39:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_dir_fetch": 0, 2024-09-21T06:39:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:39:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_peer_discover": 0, 2024-09-21T06:39:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rfiles": 0, 2024-09-21T06:39:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rbytes": 0, 2024-09-21T06:39:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rsnaps": 0, 2024-09-21T06:39:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:39:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_set_tag": 0, 2024-09-21T06:39:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:39:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:39:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:39:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:39:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:39:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_file_inodes": 0, 2024-09-21T06:39:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:39:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:39:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:39:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:39:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:39:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:39:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps": 0, 2024-09-21T06:39:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:39:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_cap_release": 0, 2024-09-21T06:39:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "process_request_cap_release": 0 2024-09-21T06:39:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache": { 2024-09-21T06:39:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update": 0, 2024-09-21T06:39:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update_receipt": 0, 2024-09-21T06:39:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_try_discover": 0, 2024-09-21T06:39:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_send_discover": 0, 2024-09-21T06:39:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_handle_discover": 0, 2024-09-21T06:39:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays": 0, 2024-09-21T06:39:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_delayed": 0, 2024-09-21T06:39:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:39:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_created": 0, 2024-09-21T06:39:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_enqueued": 0, 2024-09-21T06:39:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_reintegrated": 0, 2024-09-21T06:39:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_migrated": 0, 2024-09-21T06:39:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_processing": 0, 2024-09-21T06:39:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:39:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:39:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_started": 0, 2024-09-21T06:39:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_completed": 0, 2024-09-21T06:39:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:39:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:39:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:39:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_exportdir": 0, 2024-09-21T06:39:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_flush": 0, 2024-09-21T06:39:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:39:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragstats": 0, 2024-09-21T06:39:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_inodestats": 0, 2024-09-21T06:39:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_started": 0, 2024-09-21T06:39:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_succeeded": 0, 2024-09-21T06:39:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_write_failed": 0 2024-09-21T06:39:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log": { 2024-09-21T06:39:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "evlrg": 0, 2024-09-21T06:39:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "evadd": 0, 2024-09-21T06:39:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "evex": 0, 2024-09-21T06:39:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "evtrm": 0, 2024-09-21T06:39:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "ev": 8639, 2024-09-21T06:39:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "evexg": 0, 2024-09-21T06:39:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "evexd": 0, 2024-09-21T06:39:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "segadd": 0, 2024-09-21T06:39:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "segex": 0, 2024-09-21T06:39:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: "segtrm": 0, 2024-09-21T06:39:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: "seg": 12, 2024-09-21T06:39:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: "segmjr": 2, 2024-09-21T06:39:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: "segexg": 0, 2024-09-21T06:39:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: "segexd": 0, 2024-09-21T06:39:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: "expos": 4194304, 2024-09-21T06:39:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: "wrpos": 30793705, 2024-09-21T06:39:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: "rdpos": 30790154, 2024-09-21T06:39:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: "jlat": { 2024-09-21T06:39:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: "replayed": 8639 2024-09-21T06:39:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mem": { 2024-09-21T06:39:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 7177, 2024-09-21T06:39:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "ino+": 9679, 2024-09-21T06:39:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "ino-": 2502, 2024-09-21T06:39:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "dir": 266, 2024-09-21T06:39:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "dir+": 281, 2024-09-21T06:39:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "dir-": 15, 2024-09-21T06:39:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "dn": 14230, 2024-09-21T06:39:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "dn+": 14367, 2024-09-21T06:39:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "dn-": 137, 2024-09-21T06:39:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "cap": 0, 2024-09-21T06:39:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "cap+": 0, 2024-09-21T06:39:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "cap-": 0, 2024-09-21T06:39:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "rss": 153940, 2024-09-21T06:39:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "heap": 353497088 2024-09-21T06:39:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server": { 2024-09-21T06:39:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_client_request": 0, 2024-09-21T06:39:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_server_request": 0, 2024-09-21T06:39:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_request": 0, 2024-09-21T06:39:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_session": 0, 2024-09-21T06:39:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_peer_request": 0, 2024-09-21T06:39:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "req_create_latency": { 2024-09-21T06:39:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getattr_latency": { 2024-09-21T06:39:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getfilelock_latency": { 2024-09-21T06:39:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: "req_link_latency": { 2024-09-21T06:39:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookup_latency": { 2024-09-21T06:39:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookuphash_latency": { 2024-09-21T06:39:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupino_latency": { 2024-09-21T06:39:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupname_latency": { 2024-09-21T06:39:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupparent_latency": { 2024-09-21T06:39:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupsnap_latency": { 2024-09-21T06:39:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.309 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.309 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lssnap_latency": { 2024-09-21T06:39:19.309 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.309 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mkdir_latency": { 2024-09-21T06:39:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mknod_latency": { 2024-09-21T06:39:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mksnap_latency": { 2024-09-21T06:39:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: "req_open_latency": { 2024-09-21T06:39:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: "req_readdir_latency": { 2024-09-21T06:39:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rename_latency": { 2024-09-21T06:39:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: "req_renamesnap_latency": { 2024-09-21T06:39:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: "req_snapdiff_latency": { 2024-09-21T06:39:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmdir_latency": { 2024-09-21T06:39:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmsnap_latency": { 2024-09-21T06:39:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmxattr_latency": { 2024-09-21T06:39:19.314 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.314 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.314 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.314 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setattr_latency": { 2024-09-21T06:39:19.314 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.314 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.314 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.314 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setdirlayout_latency": { 2024-09-21T06:39:19.314 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.314 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.314 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.315 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setfilelock_latency": { 2024-09-21T06:39:19.315 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.315 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.315 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.315 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setlayout_latency": { 2024-09-21T06:39:19.315 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.315 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.315 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.315 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setxattr_latency": { 2024-09-21T06:39:19.315 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.315 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.316 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.316 INFO:teuthology.orchestra.run.smithi071.stdout: "req_symlink_latency": { 2024-09-21T06:39:19.316 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.316 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.316 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.316 INFO:teuthology.orchestra.run.smithi071.stdout: "req_unlink_latency": { 2024-09-21T06:39:19.316 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.316 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.316 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.316 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:39:19.317 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:39:19.317 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getvxattr_latency": { 2024-09-21T06:39:19.317 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.317 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.317 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.317 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:19.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.317 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessions": { 2024-09-21T06:39:19.317 INFO:teuthology.orchestra.run.smithi071.stdout: "session_count": 2, 2024-09-21T06:39:19.317 INFO:teuthology.orchestra.run.smithi071.stdout: "session_add": 2, 2024-09-21T06:39:19.317 INFO:teuthology.orchestra.run.smithi071.stdout: "session_remove": 0, 2024-09-21T06:39:19.317 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_open": 2, 2024-09-21T06:39:19.317 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_stale": 0, 2024-09-21T06:39:19.317 INFO:teuthology.orchestra.run.smithi071.stdout: "total_load": 0, 2024-09-21T06:39:19.318 INFO:teuthology.orchestra.run.smithi071.stdout: "average_load": 0, 2024-09-21T06:39:19.318 INFO:teuthology.orchestra.run.smithi071.stdout: "avg_session_uptime": 1989, 2024-09-21T06:39:19.318 INFO:teuthology.orchestra.run.smithi071.stdout: "mdthresh_evicted": 0 2024-09-21T06:39:19.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.318 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-09-21T06:39:19.318 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:39:19.318 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-09-21T06:39:19.318 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:39:19.318 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:39:19.318 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:39:19.318 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:39:19.318 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:39:19.318 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:39:19.319 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:39:19.319 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:39:19.319 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:39:19.319 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:39:19.319 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:39:19.319 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:39:19.319 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:39:19.319 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-09-21T06:39:19.319 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:39:19.319 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-09-21T06:39:19.319 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:39:19.319 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:39:19.319 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:39:19.320 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:39:19.320 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:39:19.320 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:39:19.320 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:39:19.320 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-09-21T06:39:19.320 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:39:19.320 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:39:19.320 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:39:19.320 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-09-21T06:39:19.320 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-09-21T06:39:19.320 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-09-21T06:39:19.320 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:39:19.320 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:39:19.320 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:39:19.320 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:39:19.321 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 467475, 2024-09-21T06:39:19.321 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 7314, 2024-09-21T06:39:19.321 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:39:19.321 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 0, 2024-09-21T06:39:19.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-09-21T06:39:19.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-09-21T06:39:19.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:39:19.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-09-21T06:39:19.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:39:19.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-09-21T06:39:19.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 8416, 2024-09-21T06:39:19.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 186, 2024-09-21T06:39:19.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:39:19.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:39:19.322 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-09-21T06:39:19.322 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-09-21T06:39:19.322 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 26749454, 2024-09-21T06:39:19.322 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 227317, 2024-09-21T06:39:19.322 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-09-21T06:39:19.322 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-09-21T06:39:19.322 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-09-21T06:39:19.322 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-09-21T06:39:19.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.322 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter": { 2024-09-21T06:39:19.322 INFO:teuthology.orchestra.run.smithi071.stdout: "op_active": 0, 2024-09-21T06:39:19.322 INFO:teuthology.orchestra.run.smithi071.stdout: "op_laggy": 0, 2024-09-21T06:39:19.322 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send": 2238, 2024-09-21T06:39:19.322 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send_bytes": 21, 2024-09-21T06:39:19.323 INFO:teuthology.orchestra.run.smithi071.stdout: "op_resend": 3, 2024-09-21T06:39:19.323 INFO:teuthology.orchestra.run.smithi071.stdout: "op_reply": 2238, 2024-09-21T06:39:19.323 INFO:teuthology.orchestra.run.smithi071.stdout: "op_latency": { 2024-09-21T06:39:19.323 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2238, 2024-09-21T06:39:19.323 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 1.152980278, 2024-09-21T06:39:19.323 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000515183 2024-09-21T06:39:19.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.323 INFO:teuthology.orchestra.run.smithi071.stdout: "op_inflight": 0, 2024-09-21T06:39:19.323 INFO:teuthology.orchestra.run.smithi071.stdout: "oplen_avg": { 2024-09-21T06:39:19.323 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2238, 2024-09-21T06:39:19.323 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 2239 2024-09-21T06:39:19.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.323 INFO:teuthology.orchestra.run.smithi071.stdout: "op": 2238, 2024-09-21T06:39:19.324 INFO:teuthology.orchestra.run.smithi071.stdout: "op_r": 2238, 2024-09-21T06:39:19.324 INFO:teuthology.orchestra.run.smithi071.stdout: "op_w": 0, 2024-09-21T06:39:19.324 INFO:teuthology.orchestra.run.smithi071.stdout: "op_rmw": 0, 2024-09-21T06:39:19.324 INFO:teuthology.orchestra.run.smithi071.stdout: "op_pg": 0, 2024-09-21T06:39:19.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_stat": 1402, 2024-09-21T06:39:19.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_create": 0, 2024-09-21T06:39:19.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_read": 834, 2024-09-21T06:39:19.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_write": 0, 2024-09-21T06:39:19.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writefull": 0, 2024-09-21T06:39:19.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writesame": 0, 2024-09-21T06:39:19.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_append": 0, 2024-09-21T06:39:19.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_zero": 0, 2024-09-21T06:39:19.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_truncate": 0, 2024-09-21T06:39:19.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_delete": 0, 2024-09-21T06:39:19.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_mapext": 0, 2024-09-21T06:39:19.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_sparse_read": 0, 2024-09-21T06:39:19.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_clonerange": 0, 2024-09-21T06:39:19.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_getxattr": 1, 2024-09-21T06:39:19.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_setxattr": 0, 2024-09-21T06:39:19.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:39:19.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_rmxattr": 0, 2024-09-21T06:39:19.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:39:19.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_call": 0, 2024-09-21T06:39:19.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_watch": 0, 2024-09-21T06:39:19.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_notify": 0, 2024-09-21T06:39:19.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:39:19.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls": 0, 2024-09-21T06:39:19.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:39:19.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_other": 0, 2024-09-21T06:39:19.326 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_active": 0, 2024-09-21T06:39:19.326 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_send": 0, 2024-09-21T06:39:19.326 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_resend": 0, 2024-09-21T06:39:19.326 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_ping": 0, 2024-09-21T06:39:19.326 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_active": 0, 2024-09-21T06:39:19.326 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_send": 0, 2024-09-21T06:39:19.326 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_resend": 0, 2024-09-21T06:39:19.326 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_active": 0, 2024-09-21T06:39:19.326 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_send": 0, 2024-09-21T06:39:19.326 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_resend": 0, 2024-09-21T06:39:19.326 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_active": 0, 2024-09-21T06:39:19.326 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_send": 0, 2024-09-21T06:39:19.326 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_resend": 0, 2024-09-21T06:39:19.326 INFO:teuthology.orchestra.run.smithi071.stdout: "command_active": 0, 2024-09-21T06:39:19.327 INFO:teuthology.orchestra.run.smithi071.stdout: "command_send": 0, 2024-09-21T06:39:19.327 INFO:teuthology.orchestra.run.smithi071.stdout: "command_resend": 0, 2024-09-21T06:39:19.327 INFO:teuthology.orchestra.run.smithi071.stdout: "map_epoch": 88, 2024-09-21T06:39:19.327 INFO:teuthology.orchestra.run.smithi071.stdout: "map_full": 0, 2024-09-21T06:39:19.327 INFO:teuthology.orchestra.run.smithi071.stdout: "map_inc": 13, 2024-09-21T06:39:19.327 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_sessions": 6, 2024-09-21T06:39:19.327 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_open": 6, 2024-09-21T06:39:19.327 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_close": 0, 2024-09-21T06:39:19.327 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_laggy": 0, 2024-09-21T06:39:19.327 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_wr": 0, 2024-09-21T06:39:19.327 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_rd": 2, 2024-09-21T06:39:19.327 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_del": 0 2024-09-21T06:39:19.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.327 INFO:teuthology.orchestra.run.smithi071.stdout: "oft": { 2024-09-21T06:39:19.328 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_objs": 0, 2024-09-21T06:39:19.328 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:39:19.328 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_updates": 0, 2024-09-21T06:39:19.328 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_removes": 0 2024-09-21T06:39:19.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.328 INFO:teuthology.orchestra.run.smithi071.stdout: "purge_queue": { 2024-09-21T06:39:19.328 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops": 0, 2024-09-21T06:39:19.328 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:39:19.328 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing": 0, 2024-09-21T06:39:19.328 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_high_water": 0, 2024-09-21T06:39:19.328 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed_ops": 0, 2024-09-21T06:39:19.328 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed": 0, 2024-09-21T06:39:19.328 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_item_in_journal": 0 2024-09-21T06:39:19.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.329 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:39:19.329 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-21T06:39:19.329 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-21T06:39:19.329 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-21T06:39:19.329 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 2516, 2024-09-21T06:39:19.329 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 28101334, 2024-09-21T06:39:19.329 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:19.329 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 2516, 2024-09-21T06:39:19.329 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-21T06:39:19.329 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-21T06:39:19.329 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 2516, 2024-09-21T06:39:19.329 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 28101334, 2024-09-21T06:39:19.329 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-21T06:39:19.329 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.329 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.330 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.330 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:19.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.330 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_bytes": { 2024-09-21T06:39:19.330 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-21T06:39:19.330 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-21T06:39:19.330 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-21T06:39:19.330 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-21T06:39:19.330 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-21T06:39:19.330 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:19.330 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:19.330 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 2238, 2024-09-21T06:39:19.330 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 26602400, 2024-09-21T06:39:19.330 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 2238, 2024-09-21T06:39:19.331 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 26602400, 2024-09-21T06:39:19.331 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-21T06:39:19.331 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.331 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.331 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:19.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.331 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_ops": { 2024-09-21T06:39:19.331 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-21T06:39:19.331 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 1024, 2024-09-21T06:39:19.331 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-21T06:39:19.331 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-21T06:39:19.331 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-21T06:39:19.331 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:19.332 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:19.332 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 2238, 2024-09-21T06:39:19.332 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 2238, 2024-09-21T06:39:19.332 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 2238, 2024-09-21T06:39:19.332 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 2238, 2024-09-21T06:39:19.332 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-21T06:39:19.332 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.332 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.332 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.332 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:19.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.332 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:39:19.332 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-21T06:39:19.332 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-21T06:39:19.332 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-21T06:39:19.333 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-21T06:39:19.333 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-21T06:39:19.333 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:19.333 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:19.333 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-21T06:39:19.333 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-21T06:39:19.333 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-21T06:39:19.333 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-21T06:39:19.333 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-21T06:39:19.333 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.333 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.333 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.333 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:19.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.334 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle-0x55972f381520": { 2024-09-21T06:39:19.334 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-21T06:39:19.334 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-21T06:39:19.334 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-21T06:39:19.334 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-21T06:39:19.334 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-21T06:39:19.334 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:19.334 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:19.334 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-21T06:39:19.334 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-21T06:39:19.334 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-21T06:39:19.334 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-21T06:39:19.334 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-21T06:39:19.334 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:19.335 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:19.335 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:19.335 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:19.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:19.335 INFO:teuthology.orchestra.run.smithi071.stdout: "trackedop": { 2024-09-21T06:39:19.335 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_ops_count": 0 2024-09-21T06:39:19.335 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:19.335 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-21T06:39:20.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:19 smithi071 ceph-mon[34844]: pgmap v665: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:39:20.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:19 smithi071 ceph-mon[34844]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T06:39:20.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:19 smithi063 ceph-mon[31150]: pgmap v665: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:39:20.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:19 smithi063 ceph-mon[31150]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T06:39:20.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:19 smithi175 ceph-mon[34510]: pgmap v665: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:39:20.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:19 smithi175 ceph-mon[34510]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T06:39:20.145 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-21T06:39:20.145 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-21T06:39:20.145 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-09-21T06:39:20.145 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:39:20.145 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:39:20.145 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-21T06:39:20.145 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T06:39:20.145 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T06:39:20.391 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:39:20.992 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-21T06:39:20.992 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:39:20.992 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 46873, 2024-09-21T06:39:20.992 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 34632, 2024-09-21T06:39:20.992 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 25468142, 2024-09-21T06:39:20.992 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 49618299, 2024-09-21T06:39:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 102, 2024-09-21T06:39:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 9, 2024-09-21T06:39:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 2.582133799, 2024-09-21T06:39:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 1.139418940, 2024-09-21T06:39:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 1.069013431, 2024-09-21T06:39:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.463597959, 2024-09-21T06:39:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 34630, 2024-09-21T06:39:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.747208386, 2024-09-21T06:39:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000021576 2024-09-21T06:39:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 36346, 2024-09-21T06:39:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.004508170, 2024-09-21T06:39:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000124 2024-09-21T06:39:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:39:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:39:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:39:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 32948, 2024-09-21T06:39:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 30891, 2024-09-21T06:39:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 19163748, 2024-09-21T06:39:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 61271183, 2024-09-21T06:39:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 8, 2024-09-21T06:39:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 7, 2024-09-21T06:39:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 2.408956565, 2024-09-21T06:39:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 1.064363354, 2024-09-21T06:39:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.668839887, 2024-09-21T06:39:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.613976076, 2024-09-21T06:39:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 30891, 2024-09-21T06:39:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.842047946, 2024-09-21T06:39:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000027258 2024-09-21T06:39:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 6753, 2024-09-21T06:39:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.001188519, 2024-09-21T06:39:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000175 2024-09-21T06:39:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 1400320, 2024-09-21T06:39:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 243792 2024-09-21T06:39:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:39:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 63199, 2024-09-21T06:39:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 100832, 2024-09-21T06:39:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 29416224, 2024-09-21T06:39:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 69713986, 2024-09-21T06:39:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 9, 2024-09-21T06:39:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 7, 2024-09-21T06:39:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 5.037442138, 2024-09-21T06:39:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 2.782511818, 2024-09-21T06:39:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 2.572600456, 2024-09-21T06:39:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.391558137, 2024-09-21T06:39:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 100830, 2024-09-21T06:39:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 1.975636996, 2024-09-21T06:39:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000019593 2024-09-21T06:39:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 104930, 2024-09-21T06:39:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.018272034, 2024-09-21T06:39:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000174 2024-09-21T06:39:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:39:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 375280 2024-09-21T06:39:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-09-21T06:39:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 1, 2024-09-21T06:39:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-09-21T06:39:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-MDSRank": { 2024-09-21T06:39:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-21T06:39:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-21T06:39:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 90384, 2024-09-21T06:39:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 22.164556689, 2024-09-21T06:39:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000245226 2024-09-21T06:39:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-PurgeQueue": { 2024-09-21T06:39:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-21T06:39:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-21T06:39:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 3685, 2024-09-21T06:39:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.602398984, 2024-09-21T06:39:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000163473 2024-09-21T06:39:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-21T06:39:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: "request": 15607, 2024-09-21T06:39:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: "reply": 15310, 2024-09-21T06:39:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: "reply_latency": { 2024-09-21T06:39:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 15310, 2024-09-21T06:39:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 50.461939724, 2024-09-21T06:39:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.003296011 2024-09-21T06:39:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_reply": 0, 2024-09-21T06:39:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "forward": 296, 2024-09-21T06:39:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_complete": 99, 2024-09-21T06:39:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_keys": 9, 2024-09-21T06:39:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_commit": 11, 2024-09-21T06:39:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_split": 1, 2024-09-21T06:39:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_merge": 2, 2024-09-21T06:39:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes": 474, 2024-09-21T06:39:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_top": 186, 2024-09-21T06:39:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_bottom": 248, 2024-09-21T06:39:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pin_tail": 40, 2024-09-21T06:39:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pinned": 207, 2024-09-21T06:39:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_expired": 7590, 2024-09-21T06:39:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_with_caps": 3, 2024-09-21T06:39:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": 3, 2024-09-21T06:39:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "subtrees": 7, 2024-09-21T06:39:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse": 20879, 2024-09-21T06:39:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_hit": 20414, 2024-09-21T06:39:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_forward": 173, 2024-09-21T06:39:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_discover": 0, 2024-09-21T06:39:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_dir_fetch": 1, 2024-09-21T06:39:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_remote_ino": 0, 2024-09-21T06:39:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_lock": 0, 2024-09-21T06:39:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "load_cent": 0, 2024-09-21T06:39:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "q": 0, 2024-09-21T06:39:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "exported": 110, 2024-09-21T06:39:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: "exported_inodes": 5192, 2024-09-21T06:39:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: "imported": 1, 2024-09-21T06:39:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: "imported_inodes": 130, 2024-09-21T06:39:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_dir_fetch": 0, 2024-09-21T06:39:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_backtrace_fetch": 2655, 2024-09-21T06:39:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_peer_discover": 27, 2024-09-21T06:39:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rfiles": 4, 2024-09-21T06:39:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rbytes": 234, 2024-09-21T06:39:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rsnaps": 6, 2024-09-21T06:39:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_fetch": 2655, 2024-09-21T06:39:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_set_tag": 0, 2024-09-21T06:39:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:39:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:39:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_inodes": 133, 2024-09-21T06:39:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_base_inodes": 11, 2024-09-21T06:39:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dirfrag_rstats": 122, 2024-09-21T06:39:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_file_inodes": 2522, 2024-09-21T06:39:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_inode_file_caps": 11, 2024-09-21T06:39:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_revoke": 12345, 2024-09-21T06:39:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_grant": 12947, 2024-09-21T06:39:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_trunc": 7863, 2024-09-21T06:39:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:39:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:39:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps": 14938, 2024-09-21T06:39:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps_dirty": 10219, 2024-09-21T06:39:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_cap_release": 433, 2024-09-21T06:39:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "process_request_cap_release": 12518 2024-09-21T06:39:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache": { 2024-09-21T06:39:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update": 1, 2024-09-21T06:39:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update_receipt": 0, 2024-09-21T06:39:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_try_discover": 0, 2024-09-21T06:39:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_send_discover": 0, 2024-09-21T06:39:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_handle_discover": 145, 2024-09-21T06:39:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays": 3, 2024-09-21T06:39:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_delayed": 0, 2024-09-21T06:39:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:39:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_created": 1798, 2024-09-21T06:39:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_enqueued": 1980, 2024-09-21T06:39:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_reintegrated": 0, 2024-09-21T06:39:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_migrated": 0, 2024-09-21T06:39:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_processing": 0, 2024-09-21T06:39:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:39:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:39:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_started": 136, 2024-09-21T06:39:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_completed": 136, 2024-09-21T06:39:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:39:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:39:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_enqueue_scrub": 11, 2024-09-21T06:39:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_exportdir": 110, 2024-09-21T06:39:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_flush": 0, 2024-09-21T06:39:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragmentdir": 3, 2024-09-21T06:39:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragstats": 0, 2024-09-21T06:39:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_inodestats": 0, 2024-09-21T06:39:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_started": 0, 2024-09-21T06:39:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_succeeded": 0, 2024-09-21T06:39:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_write_failed": 0 2024-09-21T06:39:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log": { 2024-09-21T06:39:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: "evlrg": 0, 2024-09-21T06:39:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: "evadd": 36128, 2024-09-21T06:39:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: "evex": 0, 2024-09-21T06:39:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: "evtrm": 0, 2024-09-21T06:39:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: "ev": 46875, 2024-09-21T06:39:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: "evexg": 0, 2024-09-21T06:39:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: "evexd": 0, 2024-09-21T06:39:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: "segadd": 57, 2024-09-21T06:39:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "segex": 0, 2024-09-21T06:39:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "segtrm": 0, 2024-09-21T06:39:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "seg": 60, 2024-09-21T06:39:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "segmjr": 12, 2024-09-21T06:39:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "segexg": 0, 2024-09-21T06:39:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "segexd": 0, 2024-09-21T06:39:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "expos": 23804643, 2024-09-21T06:39:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "wrpos": 147279780, 2024-09-21T06:39:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "rdpos": 29259327, 2024-09-21T06:39:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "jlat": { 2024-09-21T06:39:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 26049, 2024-09-21T06:39:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 103.983088762, 2024-09-21T06:39:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.003991826 2024-09-21T06:39:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: "replayed": 10747 2024-09-21T06:39:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mem": { 2024-09-21T06:39:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 100, 2024-09-21T06:39:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: "ino+": 8962, 2024-09-21T06:39:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: "ino-": 8862, 2024-09-21T06:39:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: "dir": 39, 2024-09-21T06:39:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: "dir+": 372, 2024-09-21T06:39:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: "dir-": 333, 2024-09-21T06:39:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: "dn": 474, 2024-09-21T06:39:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: "dn+": 11055, 2024-09-21T06:39:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: "dn-": 10581, 2024-09-21T06:39:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: "cap": 3, 2024-09-21T06:39:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "cap+": 5415, 2024-09-21T06:39:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "cap-": 5412, 2024-09-21T06:39:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "rss": 160996, 2024-09-21T06:39:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "heap": 412803072 2024-09-21T06:39:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server": { 2024-09-21T06:39:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_client_request": 33476, 2024-09-21T06:39:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_server_request": 23, 2024-09-21T06:39:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_request": 15607, 2024-09-21T06:39:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_session": 122, 2024-09-21T06:39:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_peer_request": 49, 2024-09-21T06:39:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "req_create_latency": { 2024-09-21T06:39:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2040, 2024-09-21T06:39:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 5.722009896, 2024-09-21T06:39:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.002804906 2024-09-21T06:39:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getattr_latency": { 2024-09-21T06:39:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 218, 2024-09-21T06:39:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 1.995351048, 2024-09-21T06:39:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.009152986 2024-09-21T06:39:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getfilelock_latency": { 2024-09-21T06:39:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: "req_link_latency": { 2024-09-21T06:39:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookup_latency": { 2024-09-21T06:39:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1817, 2024-09-21T06:39:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.753763029, 2024-09-21T06:39:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000414839 2024-09-21T06:39:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookuphash_latency": { 2024-09-21T06:39:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupino_latency": { 2024-09-21T06:39:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupname_latency": { 2024-09-21T06:39:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupparent_latency": { 2024-09-21T06:39:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:21.013 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:21.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.013 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupsnap_latency": { 2024-09-21T06:39:21.013 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:21.013 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lssnap_latency": { 2024-09-21T06:39:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 9, 2024-09-21T06:39:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.001486440, 2024-09-21T06:39:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000165160 2024-09-21T06:39:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mkdir_latency": { 2024-09-21T06:39:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 14, 2024-09-21T06:39:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.014202077, 2024-09-21T06:39:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001014434 2024-09-21T06:39:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mknod_latency": { 2024-09-21T06:39:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mksnap_latency": { 2024-09-21T06:39:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 9, 2024-09-21T06:39:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.050428523, 2024-09-21T06:39:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.005603169 2024-09-21T06:39:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: "req_open_latency": { 2024-09-21T06:39:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 125, 2024-09-21T06:39:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 1.787193156, 2024-09-21T06:39:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.014297545 2024-09-21T06:39:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: "req_readdir_latency": { 2024-09-21T06:39:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 227, 2024-09-21T06:39:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 4.401681275, 2024-09-21T06:39:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.019390666 2024-09-21T06:39:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rename_latency": { 2024-09-21T06:39:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 73, 2024-09-21T06:39:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.132308283, 2024-09-21T06:39:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001812442 2024-09-21T06:39:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: "req_renamesnap_latency": { 2024-09-21T06:39:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: "req_snapdiff_latency": { 2024-09-21T06:39:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmdir_latency": { 2024-09-21T06:39:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 9, 2024-09-21T06:39:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.062771794, 2024-09-21T06:39:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.006974643 2024-09-21T06:39:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmsnap_latency": { 2024-09-21T06:39:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 5, 2024-09-21T06:39:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.023421462, 2024-09-21T06:39:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.004684292 2024-09-21T06:39:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmxattr_latency": { 2024-09-21T06:39:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setattr_latency": { 2024-09-21T06:39:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 9014, 2024-09-21T06:39:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 31.793004605, 2024-09-21T06:39:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.003527069 2024-09-21T06:39:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setdirlayout_latency": { 2024-09-21T06:39:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setfilelock_latency": { 2024-09-21T06:39:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 8, 2024-09-21T06:39:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.002985271, 2024-09-21T06:39:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000373158 2024-09-21T06:39:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setlayout_latency": { 2024-09-21T06:39:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setxattr_latency": { 2024-09-21T06:39:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: "req_symlink_latency": { 2024-09-21T06:39:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 5, 2024-09-21T06:39:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.003644277, 2024-09-21T06:39:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000728855 2024-09-21T06:39:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: "req_unlink_latency": { 2024-09-21T06:39:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1737, 2024-09-21T06:39:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 3.717688588, 2024-09-21T06:39:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.002140292 2024-09-21T06:39:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:39:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:39:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getvxattr_latency": { 2024-09-21T06:39:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessions": { 2024-09-21T06:39:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: "session_count": 2, 2024-09-21T06:39:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: "session_add": 3, 2024-09-21T06:39:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "session_remove": 1, 2024-09-21T06:39:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_open": 2, 2024-09-21T06:39:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_stale": 0, 2024-09-21T06:39:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "total_load": 120, 2024-09-21T06:39:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "average_load": 60, 2024-09-21T06:39:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "avg_session_uptime": 1992, 2024-09-21T06:39:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "mdthresh_evicted": 0 2024-09-21T06:39:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-09-21T06:39:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:39:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-09-21T06:39:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:39:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:39:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:39:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:39:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:39:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:39:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:39:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:39:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:39:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:39:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:39:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:39:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:39:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-09-21T06:39:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:39:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-09-21T06:39:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:39:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:39:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:39:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:39:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:39:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:39:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:39:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-09-21T06:39:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:39:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:39:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:39:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-09-21T06:39:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-09-21T06:39:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-09-21T06:39:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:39:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:39:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:39:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:39:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 365211, 2024-09-21T06:39:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 207, 2024-09-21T06:39:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 880, 2024-09-21T06:39:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 10, 2024-09-21T06:39:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-09-21T06:39:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-09-21T06:39:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:39:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-09-21T06:39:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:39:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-09-21T06:39:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 8416, 2024-09-21T06:39:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 186, 2024-09-21T06:39:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:39:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:39:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-09-21T06:39:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-09-21T06:39:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 691628, 2024-09-21T06:39:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 6641, 2024-09-21T06:39:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-09-21T06:39:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-09-21T06:39:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-09-21T06:39:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-09-21T06:39:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter": { 2024-09-21T06:39:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: "op_active": 0, 2024-09-21T06:39:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: "op_laggy": 0, 2024-09-21T06:39:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send": 69000, 2024-09-21T06:39:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send_bytes": 118865466, 2024-09-21T06:39:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: "op_resend": 4, 2024-09-21T06:39:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: "op_reply": 69000, 2024-09-21T06:39:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: "op_latency": { 2024-09-21T06:39:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 69000, 2024-09-21T06:39:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 206.988432012, 2024-09-21T06:39:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.002999832 2024-09-21T06:39:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: "op_inflight": 0, 2024-09-21T06:39:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "oplen_avg": { 2024-09-21T06:39:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 69000, 2024-09-21T06:39:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 69259 2024-09-21T06:39:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "op": 69000, 2024-09-21T06:39:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "op_r": 3955, 2024-09-21T06:39:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "op_w": 65045, 2024-09-21T06:39:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "op_rmw": 0, 2024-09-21T06:39:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "op_pg": 0, 2024-09-21T06:39:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_stat": 594, 2024-09-21T06:39:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_create": 0, 2024-09-21T06:39:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_read": 351, 2024-09-21T06:39:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_write": 26108, 2024-09-21T06:39:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writefull": 47, 2024-09-21T06:39:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writesame": 0, 2024-09-21T06:39:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_append": 0, 2024-09-21T06:39:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_zero": 2, 2024-09-21T06:39:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_truncate": 1, 2024-09-21T06:39:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_delete": 2065, 2024-09-21T06:39:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_mapext": 0, 2024-09-21T06:39:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_sparse_read": 0, 2024-09-21T06:39:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_clonerange": 0, 2024-09-21T06:39:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_getxattr": 2718, 2024-09-21T06:39:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_setxattr": 0, 2024-09-21T06:39:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:39:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_rmxattr": 0, 2024-09-21T06:39:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:39:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_call": 0, 2024-09-21T06:39:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_watch": 0, 2024-09-21T06:39:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_notify": 0, 2024-09-21T06:39:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:39:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls": 0, 2024-09-21T06:39:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:39:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_other": 36717, 2024-09-21T06:39:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_active": 0, 2024-09-21T06:39:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_send": 0, 2024-09-21T06:39:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_resend": 0, 2024-09-21T06:39:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_ping": 0, 2024-09-21T06:39:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_active": 0, 2024-09-21T06:39:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_send": 0, 2024-09-21T06:39:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_resend": 0, 2024-09-21T06:39:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_active": 0, 2024-09-21T06:39:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_send": 0, 2024-09-21T06:39:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_resend": 0, 2024-09-21T06:39:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_active": 0, 2024-09-21T06:39:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_send": 0, 2024-09-21T06:39:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_resend": 0, 2024-09-21T06:39:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "command_active": 0, 2024-09-21T06:39:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "command_send": 0, 2024-09-21T06:39:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "command_resend": 0, 2024-09-21T06:39:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "map_epoch": 88, 2024-09-21T06:39:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "map_full": 0, 2024-09-21T06:39:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "map_inc": 13, 2024-09-21T06:39:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_sessions": 12, 2024-09-21T06:39:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_open": 12, 2024-09-21T06:39:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_close": 0, 2024-09-21T06:39:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_laggy": 0, 2024-09-21T06:39:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_wr": 162, 2024-09-21T06:39:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_rd": 452, 2024-09-21T06:39:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_del": 42 2024-09-21T06:39:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: "oft": { 2024-09-21T06:39:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_objs": 0, 2024-09-21T06:39:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:39:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_updates": 0, 2024-09-21T06:39:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_removes": 0 2024-09-21T06:39:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: "purge_queue": { 2024-09-21T06:39:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops": 0, 2024-09-21T06:39:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops_high_water": 27, 2024-09-21T06:39:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing": 0, 2024-09-21T06:39:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_high_water": 6, 2024-09-21T06:39:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed_ops": 2007, 2024-09-21T06:39:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed": 1980, 2024-09-21T06:39:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_item_in_journal": 0 2024-09-21T06:39:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:39:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-21T06:39:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-21T06:39:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-21T06:39:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 143016, 2024-09-21T06:39:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 61128361, 2024-09-21T06:39:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 143016, 2024-09-21T06:39:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-21T06:39:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-21T06:39:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 143016, 2024-09-21T06:39:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 61128361, 2024-09-21T06:39:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-21T06:39:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_bytes": { 2024-09-21T06:39:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-21T06:39:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-21T06:39:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-21T06:39:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-21T06:39:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-21T06:39:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 69000, 2024-09-21T06:39:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 144150500, 2024-09-21T06:39:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 69000, 2024-09-21T06:39:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 144150500, 2024-09-21T06:39:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-21T06:39:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_ops": { 2024-09-21T06:39:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-21T06:39:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 1024, 2024-09-21T06:39:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-21T06:39:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-21T06:39:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-21T06:39:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 69000, 2024-09-21T06:39:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 69000, 2024-09-21T06:39:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 69000, 2024-09-21T06:39:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 69000, 2024-09-21T06:39:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-21T06:39:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:39:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-21T06:39:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-21T06:39:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-21T06:39:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 1980, 2024-09-21T06:39:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 210260, 2024-09-21T06:39:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 1980, 2024-09-21T06:39:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-21T06:39:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-21T06:39:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 59, 2024-09-21T06:39:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 210260, 2024-09-21T06:39:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-21T06:39:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle-0x55efb76812b0": { 2024-09-21T06:39:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-21T06:39:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-21T06:39:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-21T06:39:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 36128, 2024-09-21T06:39:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 118004746, 2024-09-21T06:39:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 36128, 2024-09-21T06:39:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-21T06:39:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-21T06:39:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 26049, 2024-09-21T06:39:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 118004746, 2024-09-21T06:39:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-21T06:39:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: "trackedop": { 2024-09-21T06:39:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_ops_count": 0 2024-09-21T06:39:21.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:21.040 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-21T06:39:21.758 INFO:tasks.check_counter:Daemon mds.h mds.exported=110 2024-09-21T06:39:21.758 INFO:tasks.check_counter:Daemon mds.h mds.imported=1 2024-09-21T06:39:21.759 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-21T06:39:21.759 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=9 2024-09-21T06:39:21.759 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=5 2024-09-21T06:39:21.759 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=1 2024-09-21T06:39:21.759 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T06:39:21.759 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T06:39:22.003 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:39:22.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:21 smithi071 ceph-mon[34844]: pgmap v667: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:39:22.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:21 smithi063 ceph-mon[31150]: pgmap v667: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:39:22.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:21 smithi175 ceph-mon[34510]: pgmap v667: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T06:39:22.534 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-21T06:39:22.535 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:39:22.535 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 1225, 2024-09-21T06:39:22.535 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 1225, 2024-09-21T06:39:22.535 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 4574003, 2024-09-21T06:39:22.535 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 388727, 2024-09-21T06:39:22.535 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 6, 2024-09-21T06:39:22.535 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 2, 2024-09-21T06:39:22.535 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.145521419, 2024-09-21T06:39:22.535 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.069512525, 2024-09-21T06:39:22.535 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.032586498, 2024-09-21T06:39:22.535 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.032343501, 2024-09-21T06:39:22.535 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:22.536 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1224, 2024-09-21T06:39:22.536 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.054723947, 2024-09-21T06:39:22.536 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000044709 2024-09-21T06:39:22.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.536 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:22.536 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.536 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.536 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.536 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T06:39:22.536 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T06:39:22.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.536 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:39:22.537 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 681, 2024-09-21T06:39:22.537 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 847, 2024-09-21T06:39:22.537 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 1249264, 2024-09-21T06:39:22.537 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 590838, 2024-09-21T06:39:22.537 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 5, 2024-09-21T06:39:22.537 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 4, 2024-09-21T06:39:22.537 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.082348159, 2024-09-21T06:39:22.537 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.037139299, 2024-09-21T06:39:22.537 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.017242861, 2024-09-21T06:39:22.537 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.020998075, 2024-09-21T06:39:22.537 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:22.537 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 845, 2024-09-21T06:39:22.537 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.033177905, 2024-09-21T06:39:22.538 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000039263 2024-09-21T06:39:22.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.538 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:22.538 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.538 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.538 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.538 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:39:22.539 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 374848 2024-09-21T06:39:22.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.539 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:39:22.539 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 631, 2024-09-21T06:39:22.539 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 589, 2024-09-21T06:39:22.539 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 1192906, 2024-09-21T06:39:22.539 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 250164, 2024-09-21T06:39:22.539 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 4, 2024-09-21T06:39:22.539 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 3, 2024-09-21T06:39:22.539 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.084340105, 2024-09-21T06:39:22.539 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.033760830, 2024-09-21T06:39:22.540 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.047287069, 2024-09-21T06:39:22.540 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.012628026, 2024-09-21T06:39:22.540 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:22.540 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 588, 2024-09-21T06:39:22.540 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.024799173, 2024-09-21T06:39:22.540 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000042175 2024-09-21T06:39:22.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.540 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:22.540 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.540 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.540 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.540 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 1106784, 2024-09-21T06:39:22.540 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 138864 2024-09-21T06:39:22.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.541 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-09-21T06:39:22.541 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 1, 2024-09-21T06:39:22.541 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-09-21T06:39:22.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.541 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-MDSRank": { 2024-09-21T06:39:22.541 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-21T06:39:22.541 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-21T06:39:22.541 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 3725, 2024-09-21T06:39:22.541 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.102264361, 2024-09-21T06:39:22.541 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000027453 2024-09-21T06:39:22.541 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:22.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.542 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-PurgeQueue": { 2024-09-21T06:39:22.542 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-21T06:39:22.542 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-21T06:39:22.542 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.542 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.542 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.542 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:22.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.542 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-21T06:39:22.542 INFO:teuthology.orchestra.run.smithi071.stdout: "request": 0, 2024-09-21T06:39:22.542 INFO:teuthology.orchestra.run.smithi071.stdout: "reply": 0, 2024-09-21T06:39:22.542 INFO:teuthology.orchestra.run.smithi071.stdout: "reply_latency": { 2024-09-21T06:39:22.543 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.543 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.543 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.543 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_reply": 0, 2024-09-21T06:39:22.543 INFO:teuthology.orchestra.run.smithi071.stdout: "forward": 0, 2024-09-21T06:39:22.543 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_complete": 0, 2024-09-21T06:39:22.543 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_keys": 0, 2024-09-21T06:39:22.543 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_commit": 0, 2024-09-21T06:39:22.543 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_split": 0, 2024-09-21T06:39:22.543 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_merge": 0, 2024-09-21T06:39:22.543 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes": 733, 2024-09-21T06:39:22.543 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_top": 0, 2024-09-21T06:39:22.543 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_bottom": 733, 2024-09-21T06:39:22.544 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pin_tail": 0, 2024-09-21T06:39:22.544 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pinned": 733, 2024-09-21T06:39:22.544 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_expired": 0, 2024-09-21T06:39:22.544 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_with_caps": 0, 2024-09-21T06:39:22.544 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": 0, 2024-09-21T06:39:22.544 INFO:teuthology.orchestra.run.smithi071.stdout: "subtrees": 1, 2024-09-21T06:39:22.544 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse": 0, 2024-09-21T06:39:22.544 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_hit": 0, 2024-09-21T06:39:22.544 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_forward": 0, 2024-09-21T06:39:22.544 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_discover": 0, 2024-09-21T06:39:22.544 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:39:22.544 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_remote_ino": 0, 2024-09-21T06:39:22.544 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_lock": 0, 2024-09-21T06:39:22.544 INFO:teuthology.orchestra.run.smithi071.stdout: "load_cent": 0, 2024-09-21T06:39:22.544 INFO:teuthology.orchestra.run.smithi071.stdout: "q": 0, 2024-09-21T06:39:22.545 INFO:teuthology.orchestra.run.smithi071.stdout: "exported": 0, 2024-09-21T06:39:22.545 INFO:teuthology.orchestra.run.smithi071.stdout: "exported_inodes": 0, 2024-09-21T06:39:22.545 INFO:teuthology.orchestra.run.smithi071.stdout: "imported": 0, 2024-09-21T06:39:22.545 INFO:teuthology.orchestra.run.smithi071.stdout: "imported_inodes": 0, 2024-09-21T06:39:22.545 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_dir_fetch": 0, 2024-09-21T06:39:22.545 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:39:22.545 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_peer_discover": 0, 2024-09-21T06:39:22.545 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rfiles": 0, 2024-09-21T06:39:22.545 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rbytes": 0, 2024-09-21T06:39:22.545 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rsnaps": 0, 2024-09-21T06:39:22.545 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:39:22.545 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_set_tag": 0, 2024-09-21T06:39:22.545 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:39:22.545 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:39:22.546 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:39:22.546 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:39:22.546 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:39:22.546 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_file_inodes": 0, 2024-09-21T06:39:22.546 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:39:22.546 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:39:22.546 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:39:22.546 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:39:22.546 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:39:22.546 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:39:22.546 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps": 0, 2024-09-21T06:39:22.546 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:39:22.547 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_cap_release": 0, 2024-09-21T06:39:22.547 INFO:teuthology.orchestra.run.smithi071.stdout: "process_request_cap_release": 0 2024-09-21T06:39:22.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.547 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache": { 2024-09-21T06:39:22.547 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update": 0, 2024-09-21T06:39:22.547 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update_receipt": 0, 2024-09-21T06:39:22.547 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_try_discover": 0, 2024-09-21T06:39:22.547 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_send_discover": 0, 2024-09-21T06:39:22.547 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_handle_discover": 0, 2024-09-21T06:39:22.547 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays": 0, 2024-09-21T06:39:22.547 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_delayed": 0, 2024-09-21T06:39:22.547 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:39:22.547 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_created": 0, 2024-09-21T06:39:22.547 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_enqueued": 0, 2024-09-21T06:39:22.548 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_reintegrated": 0, 2024-09-21T06:39:22.548 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_migrated": 0, 2024-09-21T06:39:22.548 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_processing": 0, 2024-09-21T06:39:22.548 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:39:22.548 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:39:22.548 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_started": 0, 2024-09-21T06:39:22.548 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_completed": 0, 2024-09-21T06:39:22.548 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:39:22.548 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:39:22.548 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:39:22.548 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_exportdir": 0, 2024-09-21T06:39:22.548 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_flush": 0, 2024-09-21T06:39:22.548 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:39:22.548 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragstats": 0, 2024-09-21T06:39:22.549 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_inodestats": 0, 2024-09-21T06:39:22.549 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_started": 0, 2024-09-21T06:39:22.549 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_succeeded": 0, 2024-09-21T06:39:22.549 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_write_failed": 0 2024-09-21T06:39:22.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.549 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log": { 2024-09-21T06:39:22.549 INFO:teuthology.orchestra.run.smithi071.stdout: "evlrg": 0, 2024-09-21T06:39:22.549 INFO:teuthology.orchestra.run.smithi071.stdout: "evadd": 0, 2024-09-21T06:39:22.549 INFO:teuthology.orchestra.run.smithi071.stdout: "evex": 0, 2024-09-21T06:39:22.549 INFO:teuthology.orchestra.run.smithi071.stdout: "evtrm": 0, 2024-09-21T06:39:22.549 INFO:teuthology.orchestra.run.smithi071.stdout: "ev": 2165, 2024-09-21T06:39:22.549 INFO:teuthology.orchestra.run.smithi071.stdout: "evexg": 0, 2024-09-21T06:39:22.549 INFO:teuthology.orchestra.run.smithi071.stdout: "evexd": 0, 2024-09-21T06:39:22.549 INFO:teuthology.orchestra.run.smithi071.stdout: "segadd": 0, 2024-09-21T06:39:22.549 INFO:teuthology.orchestra.run.smithi071.stdout: "segex": 0, 2024-09-21T06:39:22.550 INFO:teuthology.orchestra.run.smithi071.stdout: "segtrm": 0, 2024-09-21T06:39:22.550 INFO:teuthology.orchestra.run.smithi071.stdout: "seg": 4, 2024-09-21T06:39:22.550 INFO:teuthology.orchestra.run.smithi071.stdout: "segmjr": 2, 2024-09-21T06:39:22.550 INFO:teuthology.orchestra.run.smithi071.stdout: "segexg": 0, 2024-09-21T06:39:22.550 INFO:teuthology.orchestra.run.smithi071.stdout: "segexd": 0, 2024-09-21T06:39:22.550 INFO:teuthology.orchestra.run.smithi071.stdout: "expos": 4194304, 2024-09-21T06:39:22.550 INFO:teuthology.orchestra.run.smithi071.stdout: "wrpos": 9463469, 2024-09-21T06:39:22.550 INFO:teuthology.orchestra.run.smithi071.stdout: "rdpos": 9461381, 2024-09-21T06:39:22.550 INFO:teuthology.orchestra.run.smithi071.stdout: "jlat": { 2024-09-21T06:39:22.550 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.550 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.550 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.550 INFO:teuthology.orchestra.run.smithi071.stdout: "replayed": 2165 2024-09-21T06:39:22.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.551 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mem": { 2024-09-21T06:39:22.551 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 6, 2024-09-21T06:39:22.551 INFO:teuthology.orchestra.run.smithi071.stdout: "ino+": 1953, 2024-09-21T06:39:22.551 INFO:teuthology.orchestra.run.smithi071.stdout: "ino-": 1947, 2024-09-21T06:39:22.551 INFO:teuthology.orchestra.run.smithi071.stdout: "dir": 4, 2024-09-21T06:39:22.551 INFO:teuthology.orchestra.run.smithi071.stdout: "dir+": 49, 2024-09-21T06:39:22.551 INFO:teuthology.orchestra.run.smithi071.stdout: "dir-": 45, 2024-09-21T06:39:22.551 INFO:teuthology.orchestra.run.smithi071.stdout: "dn": 733, 2024-09-21T06:39:22.551 INFO:teuthology.orchestra.run.smithi071.stdout: "dn+": 2661, 2024-09-21T06:39:22.551 INFO:teuthology.orchestra.run.smithi071.stdout: "dn-": 1928, 2024-09-21T06:39:22.551 INFO:teuthology.orchestra.run.smithi071.stdout: "cap": 0, 2024-09-21T06:39:22.551 INFO:teuthology.orchestra.run.smithi071.stdout: "cap+": 0, 2024-09-21T06:39:22.551 INFO:teuthology.orchestra.run.smithi071.stdout: "cap-": 0, 2024-09-21T06:39:22.552 INFO:teuthology.orchestra.run.smithi071.stdout: "rss": 125632, 2024-09-21T06:39:22.552 INFO:teuthology.orchestra.run.smithi071.stdout: "heap": 323764224 2024-09-21T06:39:22.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.552 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server": { 2024-09-21T06:39:22.552 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_client_request": 0, 2024-09-21T06:39:22.552 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_server_request": 0, 2024-09-21T06:39:22.552 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_request": 0, 2024-09-21T06:39:22.552 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_session": 0, 2024-09-21T06:39:22.552 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_peer_request": 0, 2024-09-21T06:39:22.552 INFO:teuthology.orchestra.run.smithi071.stdout: "req_create_latency": { 2024-09-21T06:39:22.552 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.552 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.552 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.553 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getattr_latency": { 2024-09-21T06:39:22.553 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.553 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.553 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.553 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getfilelock_latency": { 2024-09-21T06:39:22.553 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.553 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.553 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.553 INFO:teuthology.orchestra.run.smithi071.stdout: "req_link_latency": { 2024-09-21T06:39:22.553 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.553 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.553 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.554 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookup_latency": { 2024-09-21T06:39:22.554 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.554 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.554 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.554 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookuphash_latency": { 2024-09-21T06:39:22.554 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.554 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.554 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.554 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupino_latency": { 2024-09-21T06:39:22.554 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.554 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.554 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.555 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupname_latency": { 2024-09-21T06:39:22.555 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.555 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.555 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.555 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupparent_latency": { 2024-09-21T06:39:22.555 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.555 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.555 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.555 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupsnap_latency": { 2024-09-21T06:39:22.555 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.555 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.556 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.556 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lssnap_latency": { 2024-09-21T06:39:22.556 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.556 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.556 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.556 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mkdir_latency": { 2024-09-21T06:39:22.557 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.557 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.557 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.557 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mknod_latency": { 2024-09-21T06:39:22.557 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.557 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.557 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.557 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mksnap_latency": { 2024-09-21T06:39:22.557 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.557 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.558 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.558 INFO:teuthology.orchestra.run.smithi071.stdout: "req_open_latency": { 2024-09-21T06:39:22.558 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.558 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.558 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.558 INFO:teuthology.orchestra.run.smithi071.stdout: "req_readdir_latency": { 2024-09-21T06:39:22.558 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.559 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.559 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.559 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rename_latency": { 2024-09-21T06:39:22.559 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.559 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.559 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.559 INFO:teuthology.orchestra.run.smithi071.stdout: "req_renamesnap_latency": { 2024-09-21T06:39:22.559 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.559 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.559 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.560 INFO:teuthology.orchestra.run.smithi071.stdout: "req_snapdiff_latency": { 2024-09-21T06:39:22.560 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.560 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.560 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.560 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmdir_latency": { 2024-09-21T06:39:22.560 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.560 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.561 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.561 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmsnap_latency": { 2024-09-21T06:39:22.561 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.561 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.561 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.561 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmxattr_latency": { 2024-09-21T06:39:22.561 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.561 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.561 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.561 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setattr_latency": { 2024-09-21T06:39:22.562 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.562 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.562 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.562 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setdirlayout_latency": { 2024-09-21T06:39:22.562 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.562 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.562 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.562 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setfilelock_latency": { 2024-09-21T06:39:22.563 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.563 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.563 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.563 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setlayout_latency": { 2024-09-21T06:39:22.563 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.563 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.563 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.563 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setxattr_latency": { 2024-09-21T06:39:22.563 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.563 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.564 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.564 INFO:teuthology.orchestra.run.smithi071.stdout: "req_symlink_latency": { 2024-09-21T06:39:22.564 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.564 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.564 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.564 INFO:teuthology.orchestra.run.smithi071.stdout: "req_unlink_latency": { 2024-09-21T06:39:22.564 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.564 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.565 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.565 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:39:22.565 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:39:22.565 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getvxattr_latency": { 2024-09-21T06:39:22.565 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.565 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.565 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.565 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:22.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.565 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessions": { 2024-09-21T06:39:22.565 INFO:teuthology.orchestra.run.smithi071.stdout: "session_count": 1, 2024-09-21T06:39:22.566 INFO:teuthology.orchestra.run.smithi071.stdout: "session_add": 2, 2024-09-21T06:39:22.566 INFO:teuthology.orchestra.run.smithi071.stdout: "session_remove": 1, 2024-09-21T06:39:22.566 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_open": 1, 2024-09-21T06:39:22.566 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_stale": 0, 2024-09-21T06:39:22.566 INFO:teuthology.orchestra.run.smithi071.stdout: "total_load": 0, 2024-09-21T06:39:22.566 INFO:teuthology.orchestra.run.smithi071.stdout: "average_load": 0, 2024-09-21T06:39:22.566 INFO:teuthology.orchestra.run.smithi071.stdout: "avg_session_uptime": 1995, 2024-09-21T06:39:22.566 INFO:teuthology.orchestra.run.smithi071.stdout: "mdthresh_evicted": 0 2024-09-21T06:39:22.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.566 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-09-21T06:39:22.566 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:39:22.567 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-09-21T06:39:22.567 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:39:22.567 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:39:22.567 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:39:22.567 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:39:22.567 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:39:22.567 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:39:22.567 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:39:22.567 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:39:22.567 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:39:22.567 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:39:22.567 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:39:22.568 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:39:22.568 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:39:22.568 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-09-21T06:39:22.568 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:39:22.568 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-09-21T06:39:22.568 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:39:22.568 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:39:22.568 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:39:22.568 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:39:22.568 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:39:22.568 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:39:22.568 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:39:22.568 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-09-21T06:39:22.569 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:39:22.569 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:39:22.569 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:39:22.569 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-09-21T06:39:22.569 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-09-21T06:39:22.569 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-09-21T06:39:22.569 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:39:22.569 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:39:22.570 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:39:22.570 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:39:22.570 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 198247, 2024-09-21T06:39:22.570 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 56, 2024-09-21T06:39:22.570 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:39:22.570 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 0, 2024-09-21T06:39:22.570 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-09-21T06:39:22.570 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-09-21T06:39:22.570 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:39:22.571 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-09-21T06:39:22.571 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:39:22.571 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-09-21T06:39:22.571 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 8296, 2024-09-21T06:39:22.571 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 183, 2024-09-21T06:39:22.571 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:39:22.571 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:39:22.571 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-09-21T06:39:22.571 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-09-21T06:39:22.572 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 522872, 2024-09-21T06:39:22.572 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 2993, 2024-09-21T06:39:22.572 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-09-21T06:39:22.572 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-09-21T06:39:22.572 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-09-21T06:39:22.572 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-09-21T06:39:22.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.572 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter": { 2024-09-21T06:39:22.572 INFO:teuthology.orchestra.run.smithi071.stdout: "op_active": 0, 2024-09-21T06:39:22.572 INFO:teuthology.orchestra.run.smithi071.stdout: "op_laggy": 0, 2024-09-21T06:39:22.573 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send": 2250, 2024-09-21T06:39:22.573 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send_bytes": 21, 2024-09-21T06:39:22.573 INFO:teuthology.orchestra.run.smithi071.stdout: "op_resend": 3, 2024-09-21T06:39:22.573 INFO:teuthology.orchestra.run.smithi071.stdout: "op_reply": 2250, 2024-09-21T06:39:22.573 INFO:teuthology.orchestra.run.smithi071.stdout: "op_latency": { 2024-09-21T06:39:22.573 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2250, 2024-09-21T06:39:22.573 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 1.290977984, 2024-09-21T06:39:22.573 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000573767 2024-09-21T06:39:22.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.574 INFO:teuthology.orchestra.run.smithi071.stdout: "op_inflight": 0, 2024-09-21T06:39:22.574 INFO:teuthology.orchestra.run.smithi071.stdout: "oplen_avg": { 2024-09-21T06:39:22.574 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2250, 2024-09-21T06:39:22.574 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 2251 2024-09-21T06:39:22.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.574 INFO:teuthology.orchestra.run.smithi071.stdout: "op": 2250, 2024-09-21T06:39:22.574 INFO:teuthology.orchestra.run.smithi071.stdout: "op_r": 2250, 2024-09-21T06:39:22.574 INFO:teuthology.orchestra.run.smithi071.stdout: "op_w": 0, 2024-09-21T06:39:22.574 INFO:teuthology.orchestra.run.smithi071.stdout: "op_rmw": 0, 2024-09-21T06:39:22.574 INFO:teuthology.orchestra.run.smithi071.stdout: "op_pg": 0, 2024-09-21T06:39:22.574 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_stat": 1446, 2024-09-21T06:39:22.574 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_create": 0, 2024-09-21T06:39:22.575 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_read": 802, 2024-09-21T06:39:22.575 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_write": 0, 2024-09-21T06:39:22.575 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writefull": 0, 2024-09-21T06:39:22.575 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writesame": 0, 2024-09-21T06:39:22.575 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_append": 0, 2024-09-21T06:39:22.575 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_zero": 0, 2024-09-21T06:39:22.575 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_truncate": 0, 2024-09-21T06:39:22.575 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_delete": 0, 2024-09-21T06:39:22.575 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_mapext": 0, 2024-09-21T06:39:22.575 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_sparse_read": 0, 2024-09-21T06:39:22.575 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_clonerange": 0, 2024-09-21T06:39:22.575 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_getxattr": 1, 2024-09-21T06:39:22.575 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_setxattr": 0, 2024-09-21T06:39:22.575 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:39:22.576 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_rmxattr": 0, 2024-09-21T06:39:22.576 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:39:22.576 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_call": 0, 2024-09-21T06:39:22.576 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_watch": 0, 2024-09-21T06:39:22.576 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_notify": 0, 2024-09-21T06:39:22.577 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:39:22.577 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls": 0, 2024-09-21T06:39:22.577 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:39:22.577 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_other": 0, 2024-09-21T06:39:22.577 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_active": 0, 2024-09-21T06:39:22.578 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_send": 0, 2024-09-21T06:39:22.578 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_resend": 0, 2024-09-21T06:39:22.578 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_ping": 0, 2024-09-21T06:39:22.578 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_active": 0, 2024-09-21T06:39:22.578 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_send": 0, 2024-09-21T06:39:22.578 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_resend": 0, 2024-09-21T06:39:22.578 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_active": 0, 2024-09-21T06:39:22.578 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_send": 0, 2024-09-21T06:39:22.579 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_resend": 0, 2024-09-21T06:39:22.579 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_active": 0, 2024-09-21T06:39:22.579 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_send": 0, 2024-09-21T06:39:22.579 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_resend": 0, 2024-09-21T06:39:22.579 INFO:teuthology.orchestra.run.smithi071.stdout: "command_active": 0, 2024-09-21T06:39:22.579 INFO:teuthology.orchestra.run.smithi071.stdout: "command_send": 0, 2024-09-21T06:39:22.579 INFO:teuthology.orchestra.run.smithi071.stdout: "command_resend": 0, 2024-09-21T06:39:22.579 INFO:teuthology.orchestra.run.smithi071.stdout: "map_epoch": 88, 2024-09-21T06:39:22.579 INFO:teuthology.orchestra.run.smithi071.stdout: "map_full": 0, 2024-09-21T06:39:22.579 INFO:teuthology.orchestra.run.smithi071.stdout: "map_inc": 13, 2024-09-21T06:39:22.579 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_sessions": 6, 2024-09-21T06:39:22.579 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_open": 6, 2024-09-21T06:39:22.579 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_close": 0, 2024-09-21T06:39:22.580 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_laggy": 0, 2024-09-21T06:39:22.580 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_wr": 0, 2024-09-21T06:39:22.580 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_rd": 2, 2024-09-21T06:39:22.580 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_del": 0 2024-09-21T06:39:22.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.580 INFO:teuthology.orchestra.run.smithi071.stdout: "oft": { 2024-09-21T06:39:22.580 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_objs": 0, 2024-09-21T06:39:22.580 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:39:22.580 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_updates": 0, 2024-09-21T06:39:22.580 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_removes": 0 2024-09-21T06:39:22.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.581 INFO:teuthology.orchestra.run.smithi071.stdout: "purge_queue": { 2024-09-21T06:39:22.581 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops": 0, 2024-09-21T06:39:22.581 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:39:22.581 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing": 0, 2024-09-21T06:39:22.581 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_high_water": 0, 2024-09-21T06:39:22.581 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed_ops": 0, 2024-09-21T06:39:22.581 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed": 0, 2024-09-21T06:39:22.581 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_item_in_journal": 0 2024-09-21T06:39:22.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.581 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:39:22.581 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-21T06:39:22.582 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-21T06:39:22.582 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-21T06:39:22.582 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 2533, 2024-09-21T06:39:22.582 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 6771035, 2024-09-21T06:39:22.582 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:22.582 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 2533, 2024-09-21T06:39:22.582 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-21T06:39:22.582 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-21T06:39:22.582 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 2533, 2024-09-21T06:39:22.582 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 6771035, 2024-09-21T06:39:22.582 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-21T06:39:22.582 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.582 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.582 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.583 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:22.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.583 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_bytes": { 2024-09-21T06:39:22.583 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-21T06:39:22.583 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-21T06:39:22.583 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-21T06:39:22.583 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-21T06:39:22.583 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-21T06:39:22.583 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:22.583 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:22.583 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 2250, 2024-09-21T06:39:22.583 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 5269170, 2024-09-21T06:39:22.583 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 2250, 2024-09-21T06:39:22.583 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 5269170, 2024-09-21T06:39:22.584 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-21T06:39:22.584 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.584 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.584 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.584 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:22.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.584 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_ops": { 2024-09-21T06:39:22.584 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-21T06:39:22.584 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 1024, 2024-09-21T06:39:22.584 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-21T06:39:22.584 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-21T06:39:22.584 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-21T06:39:22.584 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:22.584 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:22.585 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 2250, 2024-09-21T06:39:22.585 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 2250, 2024-09-21T06:39:22.585 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 2250, 2024-09-21T06:39:22.585 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 2250, 2024-09-21T06:39:22.585 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-21T06:39:22.585 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.585 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.585 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.585 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:22.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.585 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:39:22.585 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-21T06:39:22.585 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-21T06:39:22.585 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-21T06:39:22.585 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-21T06:39:22.586 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-21T06:39:22.586 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:22.586 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:22.586 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-21T06:39:22.586 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-21T06:39:22.586 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-21T06:39:22.586 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-21T06:39:22.586 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-21T06:39:22.586 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.586 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.586 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.586 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:22.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.586 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle-0x55e4f6f6d450": { 2024-09-21T06:39:22.587 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-21T06:39:22.587 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-21T06:39:22.587 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-21T06:39:22.587 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-21T06:39:22.587 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-21T06:39:22.587 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:22.587 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:22.587 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-21T06:39:22.587 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-21T06:39:22.587 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-21T06:39:22.587 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-21T06:39:22.587 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-21T06:39:22.587 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-21T06:39:22.587 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-21T06:39:22.587 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-21T06:39:22.588 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:22.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-21T06:39:22.588 INFO:teuthology.orchestra.run.smithi071.stdout: "trackedop": { 2024-09-21T06:39:22.588 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_ops_count": 0 2024-09-21T06:39:22.588 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-21T06:39:22.588 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-21T06:39:23.342 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-21T06:39:23.342 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-21T06:39:23.342 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-09-21T06:39:23.342 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:39:23.342 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:39:23.342 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-09-21T06:39:23.343 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T06:39:23.343 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T06:39:23.602 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:39:23.989 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:23 smithi175 ceph-mon[34510]: pgmap v668: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:39:24.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:23 smithi063 ceph-mon[31150]: pgmap v668: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:39:24.149 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-21T06:39:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:39:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 8768, 2024-09-21T06:39:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 12958, 2024-09-21T06:39:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 3245381, 2024-09-21T06:39:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 11503541, 2024-09-21T06:39:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 40, 2024-09-21T06:39:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 9, 2024-09-21T06:39:24.149 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.800002557, 2024-09-21T06:39:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.437839929, 2024-09-21T06:39:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.337738379, 2024-09-21T06:39:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.056186703, 2024-09-21T06:39:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 12957, 2024-09-21T06:39:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.737717294, 2024-09-21T06:39:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000056935 2024-09-21T06:39:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 14353, 2024-09-21T06:39:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.002740404, 2024-09-21T06:39:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000190 2024-09-21T06:39:24.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 4528, 2024-09-21T06:39:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 1888 2024-09-21T06:39:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:39:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 2514, 2024-09-21T06:39:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 2492, 2024-09-21T06:39:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1959922, 2024-09-21T06:39:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 3202995, 2024-09-21T06:39:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 14, 2024-09-21T06:39:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 8, 2024-09-21T06:39:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.315424375, 2024-09-21T06:39:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.165374997, 2024-09-21T06:39:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.089294111, 2024-09-21T06:39:24.151 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.059514415, 2024-09-21T06:39:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2489, 2024-09-21T06:39:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.396703896, 2024-09-21T06:39:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000159382 2024-09-21T06:39:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 38, 2024-09-21T06:39:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000020622, 2024-09-21T06:39:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000542 2024-09-21T06:39:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1122960, 2024-09-21T06:39:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 185552 2024-09-21T06:39:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.152 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:39:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 4632, 2024-09-21T06:39:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 7018, 2024-09-21T06:39:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 3164411, 2024-09-21T06:39:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 3727505, 2024-09-21T06:39:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 10, 2024-09-21T06:39:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 6, 2024-09-21T06:39:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.508651637, 2024-09-21T06:39:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.258485958, 2024-09-21T06:39:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.215553244, 2024-09-21T06:39:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.047454734, 2024-09-21T06:39:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 7002, 2024-09-21T06:39:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.505843407, 2024-09-21T06:39:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000072242 2024-09-21T06:39:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 7805, 2024-09-21T06:39:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.002005872, 2024-09-21T06:39:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000256 2024-09-21T06:39:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:39:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 374928 2024-09-21T06:39:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-09-21T06:39:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-09-21T06:39:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-09-21T06:39:24.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-09-21T06:39:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-21T06:39:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-21T06:39:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1699, 2024-09-21T06:39:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 5.458992112, 2024-09-21T06:39:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.003213061 2024-09-21T06:39:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-09-21T06:39:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-21T06:39:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-21T06:39:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2141, 2024-09-21T06:39:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.316079515, 2024-09-21T06:39:24.155 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000147631 2024-09-21T06:39:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-09-21T06:39:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 3165, 2024-09-21T06:39:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 3155, 2024-09-21T06:39:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-09-21T06:39:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3155, 2024-09-21T06:39:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 2.729655398, 2024-09-21T06:39:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000865183 2024-09-21T06:39:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-09-21T06:39:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 10, 2024-09-21T06:39:24.156 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 6, 2024-09-21T06:39:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-09-21T06:39:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 11, 2024-09-21T06:39:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-09-21T06:39:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-09-21T06:39:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 153, 2024-09-21T06:39:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 4, 2024-09-21T06:39:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 2, 2024-09-21T06:39:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 147, 2024-09-21T06:39:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 147, 2024-09-21T06:39:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 2348, 2024-09-21T06:39:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 0, 2024-09-21T06:39:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 0, 2024-09-21T06:39:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 4, 2024-09-21T06:39:24.157 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 8533, 2024-09-21T06:39:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 8349, 2024-09-21T06:39:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 9, 2024-09-21T06:39:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 10, 2024-09-21T06:39:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:39:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-09-21T06:39:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-09-21T06:39:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-09-21T06:39:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-09-21T06:39:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 37, 2024-09-21T06:39:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 2292, 2024-09-21T06:39:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 37, 2024-09-21T06:39:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 1160, 2024-09-21T06:39:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-09-21T06:39:24.158 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 3655, 2024-09-21T06:39:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-09-21T06:39:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 4, 2024-09-21T06:39:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 234, 2024-09-21T06:39:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 6, 2024-09-21T06:39:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 3655, 2024-09-21T06:39:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-09-21T06:39:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:39:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:39:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 51, 2024-09-21T06:39:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:39:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 51, 2024-09-21T06:39:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 3604, 2024-09-21T06:39:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:39:24.159 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 2485, 2024-09-21T06:39:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 1517, 2024-09-21T06:39:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:39:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:39:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:39:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 2697, 2024-09-21T06:39:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 639, 2024-09-21T06:39:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 29, 2024-09-21T06:39:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 2445 2024-09-21T06:39:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-09-21T06:39:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-09-21T06:39:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 0, 2024-09-21T06:39:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 0, 2024-09-21T06:39:24.160 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 10, 2024-09-21T06:39:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 37, 2024-09-21T06:39:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 17, 2024-09-21T06:39:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-09-21T06:39:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:39:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 1186, 2024-09-21T06:39:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 1169, 2024-09-21T06:39:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-09-21T06:39:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-09-21T06:39:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-09-21T06:39:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:39:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:39:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-09-21T06:39:24.161 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-09-21T06:39:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:39:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:39:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:39:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 37, 2024-09-21T06:39:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-09-21T06:39:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:39:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-09-21T06:39:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0, 2024-09-21T06:39:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_started": 0, 2024-09-21T06:39:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_succeeded": 0, 2024-09-21T06:39:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_write_failed": 0 2024-09-21T06:39:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.162 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-09-21T06:39:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-09-21T06:39:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 4267, 2024-09-21T06:39:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-09-21T06:39:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-09-21T06:39:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 4267, 2024-09-21T06:39:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-09-21T06:39:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-09-21T06:39:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 8, 2024-09-21T06:39:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-09-21T06:39:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-09-21T06:39:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 8, 2024-09-21T06:39:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-09-21T06:39:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-09-21T06:39:24.163 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-09-21T06:39:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-09-21T06:39:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 13017598, 2024-09-21T06:39:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2024-09-21T06:39:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-09-21T06:39:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 638, 2024-09-21T06:39:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 5.656886272, 2024-09-21T06:39:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.008866592 2024-09-21T06:39:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2024-09-21T06:39:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-09-21T06:39:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 98, 2024-09-21T06:39:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 2687, 2024-09-21T06:39:24.164 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 2589, 2024-09-21T06:39:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 40, 2024-09-21T06:39:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 85, 2024-09-21T06:39:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 45, 2024-09-21T06:39:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 153, 2024-09-21T06:39:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 3673, 2024-09-21T06:39:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 3520, 2024-09-21T06:39:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 0, 2024-09-21T06:39:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 2574, 2024-09-21T06:39:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 2574, 2024-09-21T06:39:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 138116, 2024-09-21T06:39:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 351088640 2024-09-21T06:39:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.165 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-09-21T06:39:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 3571, 2024-09-21T06:39:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 8, 2024-09-21T06:39:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 3165, 2024-09-21T06:39:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 21, 2024-09-21T06:39:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 61, 2024-09-21T06:39:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-09-21T06:39:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 268, 2024-09-21T06:39:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.195433880, 2024-09-21T06:39:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000729230 2024-09-21T06:39:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-09-21T06:39:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 246, 2024-09-21T06:39:24.166 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.129694408, 2024-09-21T06:39:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000527213 2024-09-21T06:39:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-09-21T06:39:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-09-21T06:39:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-09-21T06:39:24.167 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1352, 2024-09-21T06:39:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.482992618, 2024-09-21T06:39:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000357243 2024-09-21T06:39:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-09-21T06:39:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-09-21T06:39:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.168 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-09-21T06:39:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-09-21T06:39:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-09-21T06:39:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.169 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-09-21T06:39:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-09-21T06:39:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-09-21T06:39:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-09-21T06:39:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-09-21T06:39:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-09-21T06:39:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 103, 2024-09-21T06:39:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.275849754, 2024-09-21T06:39:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002678152 2024-09-21T06:39:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-09-21T06:39:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.172 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-09-21T06:39:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-09-21T06:39:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-09-21T06:39:24.173 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 17, 2024-09-21T06:39:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.133803907, 2024-09-21T06:39:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.007870818 2024-09-21T06:39:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-09-21T06:39:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-09-21T06:39:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.174 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-09-21T06:39:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-09-21T06:39:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-09-21T06:39:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-09-21T06:39:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-09-21T06:39:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-09-21T06:39:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-09-21T06:39:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1169, 2024-09-21T06:39:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.511880831, 2024-09-21T06:39:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001293311 2024-09-21T06:39:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:39:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:39:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-09-21T06:39:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.177 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-09-21T06:39:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 2, 2024-09-21T06:39:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 3, 2024-09-21T06:39:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 1, 2024-09-21T06:39:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 2, 2024-09-21T06:39:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-09-21T06:39:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 1885, 2024-09-21T06:39:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 942, 2024-09-21T06:39:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 619, 2024-09-21T06:39:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-09-21T06:39:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-09-21T06:39:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:39:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-09-21T06:39:24.178 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:39:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:39:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:39:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:39:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:39:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:39:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:39:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:39:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:39:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:39:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:39:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:39:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:39:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-09-21T06:39:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:39:24.179 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-09-21T06:39:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:39:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:39:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:39:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:39:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:39:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:39:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:39:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-09-21T06:39:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:39:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:39:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:39:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-09-21T06:39:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-09-21T06:39:24.180 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-09-21T06:39:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:39:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:39:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:39:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:39:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 439274, 2024-09-21T06:39:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 244, 2024-09-21T06:39:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 704, 2024-09-21T06:39:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 8, 2024-09-21T06:39:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-09-21T06:39:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-09-21T06:39:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:39:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-09-21T06:39:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:39:24.181 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-09-21T06:39:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 8296, 2024-09-21T06:39:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 183, 2024-09-21T06:39:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:39:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:39:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-09-21T06:39:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-09-21T06:39:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 452879, 2024-09-21T06:39:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 6800, 2024-09-21T06:39:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-09-21T06:39:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-09-21T06:39:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-09-21T06:39:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-09-21T06:39:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-09-21T06:39:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-09-21T06:39:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-09-21T06:39:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 5644, 2024-09-21T06:39:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 9070402, 2024-09-21T06:39:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 33, 2024-09-21T06:39:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 5644, 2024-09-21T06:39:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-09-21T06:39:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 5644, 2024-09-21T06:39:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 11.799808887, 2024-09-21T06:39:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002090681 2024-09-21T06:39:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-09-21T06:39:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-09-21T06:39:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 5644, 2024-09-21T06:39:24.183 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 5729 2024-09-21T06:39:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 5644, 2024-09-21T06:39:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 3694, 2024-09-21T06:39:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 1950, 2024-09-21T06:39:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-09-21T06:39:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-09-21T06:39:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 0, 2024-09-21T06:39:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 10, 2024-09-21T06:39:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 29, 2024-09-21T06:39:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 667, 2024-09-21T06:39:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 29, 2024-09-21T06:39:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-09-21T06:39:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-09-21T06:39:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-09-21T06:39:24.184 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-09-21T06:39:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 1186, 2024-09-21T06:39:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-09-21T06:39:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-09-21T06:39:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-09-21T06:39:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 3661, 2024-09-21T06:39:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 20, 2024-09-21T06:39:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:39:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-09-21T06:39:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:39:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-09-21T06:39:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-09-21T06:39:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-09-21T06:39:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:39:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-09-21T06:39:24.185 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:39:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-09-21T06:39:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-09-21T06:39:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-09-21T06:39:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-09-21T06:39:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-09-21T06:39:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-09-21T06:39:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-09-21T06:39:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-09-21T06:39:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-09-21T06:39:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-09-21T06:39:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-09-21T06:39:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-09-21T06:39:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-09-21T06:39:24.186 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-09-21T06:39:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-09-21T06:39:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-09-21T06:39:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-09-21T06:39:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 88, 2024-09-21T06:39:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-09-21T06:39:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 13, 2024-09-21T06:39:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 12, 2024-09-21T06:39:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 12, 2024-09-21T06:39:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-09-21T06:39:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-09-21T06:39:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 87, 2024-09-21T06:39:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 16, 2024-09-21T06:39:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 24 2024-09-21T06:39:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.187 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-09-21T06:39:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2024-09-21T06:39:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:39:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-09-21T06:39:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-09-21T06:39:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-09-21T06:39:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-09-21T06:39:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 9, 2024-09-21T06:39:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-09-21T06:39:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 6, 2024-09-21T06:39:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 1172, 2024-09-21T06:39:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 1169, 2024-09-21T06:39:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-09-21T06:39:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.188 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:39:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T06:39:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-21T06:39:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T06:39:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 15910, 2024-09-21T06:39:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 6918066, 2024-09-21T06:39:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 15910, 2024-09-21T06:39:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T06:39:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T06:39:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 15910, 2024-09-21T06:39:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 6918066, 2024-09-21T06:39:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T06:39:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.189 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-09-21T06:39:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T06:39:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-21T06:39:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T06:39:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T06:39:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T06:39:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 5644, 2024-09-21T06:39:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 9215968, 2024-09-21T06:39:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 5644, 2024-09-21T06:39:24.190 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 9215968, 2024-09-21T06:39:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T06:39:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-09-21T06:39:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T06:39:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-09-21T06:39:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T06:39:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T06:39:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T06:39:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 5644, 2024-09-21T06:39:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 5644, 2024-09-21T06:39:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 5644, 2024-09-21T06:39:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 5644, 2024-09-21T06:39:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T06:39:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:39:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T06:39:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-21T06:39:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T06:39:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 1169, 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 145789, 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 1169, 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 29, 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 145789, 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x562d993f5450": { 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 4267, 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 8823294, 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 4267, 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 638, 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 8823294, 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "trackedop": { 2024-09-21T06:39:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2024-09-21T06:39:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:24.195 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-21T06:39:24.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:23 smithi071 ceph-mon[34844]: pgmap v668: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:39:24.991 INFO:tasks.check_counter:Daemon mds.c mds.exported=37 2024-09-21T06:39:24.992 INFO:tasks.check_counter:Daemon mds.c mds.imported=37 2024-09-21T06:39:24.992 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-21T06:39:24.992 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:39:24.992 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:39:24.992 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-09-21T06:39:24.992 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T06:39:24.992 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T06:39:25.239 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:39:25.797 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-21T06:39:25.797 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:39:25.797 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 4622, 2024-09-21T06:39:25.797 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 6943, 2024-09-21T06:39:25.797 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1921997, 2024-09-21T06:39:25.797 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 9066953, 2024-09-21T06:39:25.797 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 13, 2024-09-21T06:39:25.798 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 5, 2024-09-21T06:39:25.798 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.509604646, 2024-09-21T06:39:25.798 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.289193591, 2024-09-21T06:39:25.798 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.227920426, 2024-09-21T06:39:25.798 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.041914406, 2024-09-21T06:39:25.798 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:25.798 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 6942, 2024-09-21T06:39:25.798 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.528735389, 2024-09-21T06:39:25.798 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000076164 2024-09-21T06:39:25.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.798 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:25.798 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 7183, 2024-09-21T06:39:25.799 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.001213063, 2024-09-21T06:39:25.799 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000168 2024-09-21T06:39:25.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.799 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 3872, 2024-09-21T06:39:25.799 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 1184 2024-09-21T06:39:25.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.799 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:39:25.799 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 1719, 2024-09-21T06:39:25.799 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 1678, 2024-09-21T06:39:25.799 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1748288, 2024-09-21T06:39:25.799 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 1890713, 2024-09-21T06:39:25.799 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 17, 2024-09-21T06:39:25.799 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 7, 2024-09-21T06:39:25.799 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.195852737, 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.087845947, 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.073076967, 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.037719218, 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1677, 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.189372900, 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000112923 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 126, 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000027261, 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000216 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1115824, 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 149392 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 7233, 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 13733, 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 3093877, 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 6328044, 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 34, 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 10, 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.821917759, 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.445054547, 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.394122753, 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.029033850, 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 13720, 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.056074889, 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000076973 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 17833, 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.004087681, 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000229 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 375120 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 868, 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 3.846038770, 2024-09-21T06:39:25.804 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.004430920 2024-09-21T06:39:25.804 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:25.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.804 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-09-21T06:39:25.804 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-21T06:39:25.804 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-21T06:39:25.804 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1320, 2024-09-21T06:39:25.804 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.187425501, 2024-09-21T06:39:25.804 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000141989 2024-09-21T06:39:25.804 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:25.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.804 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-09-21T06:39:25.804 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 1776, 2024-09-21T06:39:25.804 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 1637, 2024-09-21T06:39:25.805 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-09-21T06:39:25.805 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1637, 2024-09-21T06:39:25.805 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.786501840, 2024-09-21T06:39:25.805 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001091326 2024-09-21T06:39:25.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.805 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-09-21T06:39:25.805 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 139, 2024-09-21T06:39:25.805 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-09-21T06:39:25.805 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-09-21T06:39:25.805 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 11, 2024-09-21T06:39:25.805 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-09-21T06:39:25.805 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-09-21T06:39:25.805 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 12, 2024-09-21T06:39:25.806 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 1, 2024-09-21T06:39:25.806 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 1, 2024-09-21T06:39:25.806 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 10, 2024-09-21T06:39:25.806 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 10, 2024-09-21T06:39:25.806 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 1917, 2024-09-21T06:39:25.806 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 1, 2024-09-21T06:39:25.806 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 1, 2024-09-21T06:39:25.806 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 3, 2024-09-21T06:39:25.806 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 5576, 2024-09-21T06:39:25.806 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 4917, 2024-09-21T06:39:25.806 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 139, 2024-09-21T06:39:25.806 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 18, 2024-09-21T06:39:25.806 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:39:25.806 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-09-21T06:39:25.807 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-09-21T06:39:25.807 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-09-21T06:39:25.807 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-09-21T06:39:25.807 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 32, 2024-09-21T06:39:25.807 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 1905, 2024-09-21T06:39:25.807 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 32, 2024-09-21T06:39:25.807 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 1176, 2024-09-21T06:39:25.807 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-09-21T06:39:25.807 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 2449, 2024-09-21T06:39:25.807 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-09-21T06:39:25.807 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 4, 2024-09-21T06:39:25.807 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 234, 2024-09-21T06:39:25.807 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 6, 2024-09-21T06:39:25.807 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 2449, 2024-09-21T06:39:25.807 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-09-21T06:39:25.808 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:39:25.808 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:39:25.808 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:39:25.808 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:39:25.808 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:39:25.808 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 2449, 2024-09-21T06:39:25.808 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:39:25.808 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 988, 2024-09-21T06:39:25.808 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 859, 2024-09-21T06:39:25.808 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:39:25.808 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:39:25.808 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:39:25.808 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 1137, 2024-09-21T06:39:25.808 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 235, 2024-09-21T06:39:25.809 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 14, 2024-09-21T06:39:25.809 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 1507 2024-09-21T06:39:25.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.809 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-09-21T06:39:25.809 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-09-21T06:39:25.809 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 0, 2024-09-21T06:39:25.809 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 0, 2024-09-21T06:39:25.809 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 18, 2024-09-21T06:39:25.809 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 41, 2024-09-21T06:39:25.809 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-09-21T06:39:25.809 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-09-21T06:39:25.809 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:39:25.809 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 730, 2024-09-21T06:39:25.809 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 730, 2024-09-21T06:39:25.810 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-09-21T06:39:25.810 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-09-21T06:39:25.810 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-09-21T06:39:25.810 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:39:25.810 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:39:25.810 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-09-21T06:39:25.810 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-09-21T06:39:25.810 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:39:25.810 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:39:25.810 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:39:25.810 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 32, 2024-09-21T06:39:25.810 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-09-21T06:39:25.810 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:39:25.810 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0, 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_started": 0, 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_succeeded": 0, 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_write_failed": 0 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 2165, 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 2165, 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 4, 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 4, 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 9463469, 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 292, 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 3.339363253, 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.011436175 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.813 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2024-09-21T06:39:25.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.813 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-09-21T06:39:25.813 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 16, 2024-09-21T06:39:25.813 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 1959, 2024-09-21T06:39:25.813 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 1943, 2024-09-21T06:39:25.813 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 15, 2024-09-21T06:39:25.813 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 80, 2024-09-21T06:39:25.813 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 65, 2024-09-21T06:39:25.813 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 12, 2024-09-21T06:39:25.813 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 2668, 2024-09-21T06:39:25.813 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 2656, 2024-09-21T06:39:25.813 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 1, 2024-09-21T06:39:25.813 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 1473, 2024-09-21T06:39:25.813 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 1472, 2024-09-21T06:39:25.814 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 136140, 2024-09-21T06:39:25.814 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 346955776 2024-09-21T06:39:25.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.814 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-09-21T06:39:25.814 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 3286, 2024-09-21T06:39:25.814 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 2, 2024-09-21T06:39:25.814 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 1776, 2024-09-21T06:39:25.814 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 13, 2024-09-21T06:39:25.814 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 20, 2024-09-21T06:39:25.814 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-09-21T06:39:25.814 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 28, 2024-09-21T06:39:25.814 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.018328873, 2024-09-21T06:39:25.814 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000654602 2024-09-21T06:39:25.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.815 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-09-21T06:39:25.815 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 100, 2024-09-21T06:39:25.815 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.071655735, 2024-09-21T06:39:25.815 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000716557 2024-09-21T06:39:25.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.815 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-09-21T06:39:25.815 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.815 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.815 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.815 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-09-21T06:39:25.815 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.815 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.815 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 730, 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.227319746, 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000311396 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1, 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000139064, 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000139064 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.818 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.818 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-09-21T06:39:25.818 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 48, 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.036415635, 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000758659 2024-09-21T06:39:25.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.821 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-09-21T06:39:25.821 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.821 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.821 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.821 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-09-21T06:39:25.821 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.821 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.821 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.823 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.823 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-09-21T06:39:25.823 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.823 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.823 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.823 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-09-21T06:39:25.823 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.823 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.823 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.823 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-09-21T06:39:25.823 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.824 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.824 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.824 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-09-21T06:39:25.824 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.824 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.824 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.824 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-09-21T06:39:25.824 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.824 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.824 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.824 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-09-21T06:39:25.825 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.825 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.825 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.825 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-09-21T06:39:25.825 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.825 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.825 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.825 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-09-21T06:39:25.825 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 730, 2024-09-21T06:39:25.825 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.432642787, 2024-09-21T06:39:25.825 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001962524 2024-09-21T06:39:25.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.825 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:39:25.826 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:39:25.826 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-09-21T06:39:25.826 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.826 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.826 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.826 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:25.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.826 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-09-21T06:39:25.826 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 1, 2024-09-21T06:39:25.826 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 2, 2024-09-21T06:39:25.826 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 1, 2024-09-21T06:39:25.826 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 1, 2024-09-21T06:39:25.826 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-09-21T06:39:25.827 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 1410, 2024-09-21T06:39:25.827 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 1410, 2024-09-21T06:39:25.827 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 659, 2024-09-21T06:39:25.827 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-09-21T06:39:25.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.827 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-09-21T06:39:25.827 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:39:25.827 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-09-21T06:39:25.827 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:39:25.827 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:39:25.827 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:39:25.827 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:39:25.827 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:39:25.827 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:39:25.828 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:39:25.828 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:39:25.828 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:39:25.828 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:39:25.828 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:39:25.828 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:39:25.828 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:39:25.828 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-09-21T06:39:25.828 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:39:25.828 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-09-21T06:39:25.828 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:39:25.828 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:39:25.828 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:39:25.828 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:39:25.829 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:39:25.829 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:39:25.829 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:39:25.829 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-09-21T06:39:25.829 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:39:25.829 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:39:25.829 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:39:25.829 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-09-21T06:39:25.829 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-09-21T06:39:25.829 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-09-21T06:39:25.829 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:39:25.829 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:39:25.829 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:39:25.829 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:39:25.830 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 295863, 2024-09-21T06:39:25.830 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 111, 2024-09-21T06:39:25.830 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:39:25.830 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-09-21T06:39:25.830 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-09-21T06:39:25.830 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-09-21T06:39:25.830 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:39:25.830 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-09-21T06:39:25.830 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:39:25.830 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-09-21T06:39:25.830 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 8296, 2024-09-21T06:39:25.830 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 183, 2024-09-21T06:39:25.830 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:39:25.830 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:39:25.831 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-09-21T06:39:25.831 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-09-21T06:39:25.831 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 75752, 2024-09-21T06:39:25.831 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 307, 2024-09-21T06:39:25.831 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-09-21T06:39:25.831 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-09-21T06:39:25.831 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-09-21T06:39:25.831 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-09-21T06:39:25.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.831 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-09-21T06:39:25.831 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-09-21T06:39:25.831 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-09-21T06:39:25.831 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 3578, 2024-09-21T06:39:25.831 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 5417835, 2024-09-21T06:39:25.832 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 33, 2024-09-21T06:39:25.832 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 3578, 2024-09-21T06:39:25.832 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-09-21T06:39:25.832 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3578, 2024-09-21T06:39:25.832 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 8.299865638, 2024-09-21T06:39:25.832 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002319694 2024-09-21T06:39:25.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.832 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-09-21T06:39:25.832 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-09-21T06:39:25.832 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3578, 2024-09-21T06:39:25.832 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 3625 2024-09-21T06:39:25.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.832 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 3578, 2024-09-21T06:39:25.832 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 2464, 2024-09-21T06:39:25.833 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 1114, 2024-09-21T06:39:25.833 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-09-21T06:39:25.833 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-09-21T06:39:25.833 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 0, 2024-09-21T06:39:25.833 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 10, 2024-09-21T06:39:25.833 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 15, 2024-09-21T06:39:25.833 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 307, 2024-09-21T06:39:25.833 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 19, 2024-09-21T06:39:25.833 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-09-21T06:39:25.833 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-09-21T06:39:25.833 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-09-21T06:39:25.833 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-09-21T06:39:25.833 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 743, 2024-09-21T06:39:25.833 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-09-21T06:39:25.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-09-21T06:39:25.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-09-21T06:39:25.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 2449, 2024-09-21T06:39:25.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 20, 2024-09-21T06:39:25.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:39:25.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-09-21T06:39:25.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:39:25.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-09-21T06:39:25.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-09-21T06:39:25.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-09-21T06:39:25.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:39:25.835 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-09-21T06:39:25.835 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:39:25.835 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-09-21T06:39:25.835 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-09-21T06:39:25.835 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-09-21T06:39:25.835 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-09-21T06:39:25.835 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-09-21T06:39:25.835 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-09-21T06:39:25.835 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-09-21T06:39:25.835 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-09-21T06:39:25.835 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-09-21T06:39:25.835 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-09-21T06:39:25.835 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-09-21T06:39:25.835 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-09-21T06:39:25.836 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-09-21T06:39:25.836 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-09-21T06:39:25.836 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-09-21T06:39:25.836 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-09-21T06:39:25.836 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-09-21T06:39:25.836 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 88, 2024-09-21T06:39:25.836 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-09-21T06:39:25.836 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 13, 2024-09-21T06:39:25.836 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 12, 2024-09-21T06:39:25.836 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 12, 2024-09-21T06:39:25.836 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-09-21T06:39:25.836 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-09-21T06:39:25.836 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 51, 2024-09-21T06:39:25.836 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 0, 2024-09-21T06:39:25.837 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 11 2024-09-21T06:39:25.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.837 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-09-21T06:39:25.837 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2024-09-21T06:39:25.837 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:39:25.837 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-09-21T06:39:25.837 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-09-21T06:39:25.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.837 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-09-21T06:39:25.837 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-09-21T06:39:25.837 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 6, 2024-09-21T06:39:25.837 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-09-21T06:39:25.837 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 6, 2024-09-21T06:39:25.837 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 730, 2024-09-21T06:39:25.838 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 730, 2024-09-21T06:39:25.838 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-09-21T06:39:25.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.838 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:39:25.838 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T06:39:25.838 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-21T06:39:25.838 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T06:39:25.838 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 13570, 2024-09-21T06:39:25.838 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 5523755, 2024-09-21T06:39:25.838 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:25.838 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 13570, 2024-09-21T06:39:25.838 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T06:39:25.838 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T06:39:25.839 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 13570, 2024-09-21T06:39:25.839 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 5523755, 2024-09-21T06:39:25.839 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T06:39:25.839 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.839 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.839 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.839 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:25.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.839 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-09-21T06:39:25.839 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T06:39:25.839 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-21T06:39:25.839 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T06:39:25.839 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T06:39:25.839 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T06:39:25.839 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:25.840 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:25.840 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 3578, 2024-09-21T06:39:25.840 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 5511325, 2024-09-21T06:39:25.840 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 3578, 2024-09-21T06:39:25.840 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 5511325, 2024-09-21T06:39:25.840 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T06:39:25.840 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.840 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.840 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.840 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:25.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.840 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-09-21T06:39:25.840 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T06:39:25.840 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-09-21T06:39:25.841 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T06:39:25.841 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T06:39:25.841 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T06:39:25.841 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:25.841 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:25.841 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 3578, 2024-09-21T06:39:25.841 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 3578, 2024-09-21T06:39:25.841 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 3578, 2024-09-21T06:39:25.841 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 3578, 2024-09-21T06:39:25.841 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T06:39:25.841 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.841 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.842 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.842 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:25.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.842 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:39:25.842 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T06:39:25.842 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-21T06:39:25.842 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T06:39:25.842 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 730, 2024-09-21T06:39:25.842 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 93490, 2024-09-21T06:39:25.842 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:25.842 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 730, 2024-09-21T06:39:25.842 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T06:39:25.842 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T06:39:25.842 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 15, 2024-09-21T06:39:25.843 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 93490, 2024-09-21T06:39:25.843 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T06:39:25.843 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.843 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.843 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.843 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:25.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.843 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x55dbb4241450": { 2024-09-21T06:39:25.843 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T06:39:25.843 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-21T06:39:25.843 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T06:39:25.844 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 2165, 2024-09-21T06:39:25.844 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 5269165, 2024-09-21T06:39:25.844 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:25.844 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 2165, 2024-09-21T06:39:25.844 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T06:39:25.844 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T06:39:25.844 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 292, 2024-09-21T06:39:25.844 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 5269165, 2024-09-21T06:39:25.844 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T06:39:25.844 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:25.844 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:25.844 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:25.844 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:25.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:25.844 INFO:teuthology.orchestra.run.smithi175.stdout: "trackedop": { 2024-09-21T06:39:25.845 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 5 2024-09-21T06:39:25.845 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:25.845 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-21T06:39:26.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:25 smithi063 ceph-mon[31150]: pgmap v669: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:39:26.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:25 smithi175 ceph-mon[34510]: pgmap v669: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:39:26.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:25 smithi071 ceph-mon[34844]: pgmap v669: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:39:26.686 INFO:tasks.check_counter:Daemon mds.f mds.exported=32 2024-09-21T06:39:26.687 INFO:tasks.check_counter:Daemon mds.f mds.imported=32 2024-09-21T06:39:26.687 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-09-21T06:39:26.687 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:39:26.687 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:39:26.687 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-09-21T06:39:26.687 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T06:39:26.687 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T06:39:26.933 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:39:27.488 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-21T06:39:27.488 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:39:27.489 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 5659, 2024-09-21T06:39:27.489 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 5665, 2024-09-21T06:39:27.489 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 4909231, 2024-09-21T06:39:27.489 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 19865241, 2024-09-21T06:39:27.489 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 40, 2024-09-21T06:39:27.489 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 9, 2024-09-21T06:39:27.489 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.586791256, 2024-09-21T06:39:27.489 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.303559176, 2024-09-21T06:39:27.489 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.155019458, 2024-09-21T06:39:27.489 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.110521968, 2024-09-21T06:39:27.489 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:27.489 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 5663, 2024-09-21T06:39:27.489 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.412416287, 2024-09-21T06:39:27.489 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000072826 2024-09-21T06:39:27.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.490 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:27.490 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2143, 2024-09-21T06:39:27.490 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000531580, 2024-09-21T06:39:27.490 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000248 2024-09-21T06:39:27.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.490 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:39:27.490 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:39:27.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.490 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:39:27.490 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 11195, 2024-09-21T06:39:27.490 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 17765, 2024-09-21T06:39:27.490 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 8253428, 2024-09-21T06:39:27.490 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 11518266, 2024-09-21T06:39:27.491 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 9, 2024-09-21T06:39:27.491 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 6, 2024-09-21T06:39:27.491 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 1.109494535, 2024-09-21T06:39:27.491 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.565848492, 2024-09-21T06:39:27.491 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.489704405, 2024-09-21T06:39:27.491 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.099105341, 2024-09-21T06:39:27.491 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:27.491 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 17760, 2024-09-21T06:39:27.491 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.137856440, 2024-09-21T06:39:27.491 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000064068 2024-09-21T06:39:27.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.492 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:27.492 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 20425, 2024-09-21T06:39:27.492 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.005932199, 2024-09-21T06:39:27.492 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000290 2024-09-21T06:39:27.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.492 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1130224, 2024-09-21T06:39:27.492 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 154032 2024-09-21T06:39:27.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.492 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:39:27.492 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 18712, 2024-09-21T06:39:27.492 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 26578, 2024-09-21T06:39:27.492 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 6674962, 2024-09-21T06:39:27.492 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 18379158, 2024-09-21T06:39:27.492 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 15, 2024-09-21T06:39:27.493 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 8, 2024-09-21T06:39:27.493 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 1.497275495, 2024-09-21T06:39:27.493 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.826221779, 2024-09-21T06:39:27.493 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.639317299, 2024-09-21T06:39:27.493 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.122175863, 2024-09-21T06:39:27.493 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:27.493 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 26574, 2024-09-21T06:39:27.493 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.992578262, 2024-09-21T06:39:27.493 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000037351 2024-09-21T06:39:27.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.493 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:27.493 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 29896, 2024-09-21T06:39:27.493 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.005069762, 2024-09-21T06:39:27.493 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000169 2024-09-21T06:39:27.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.494 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 3456, 2024-09-21T06:39:27.494 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 389056 2024-09-21T06:39:27.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.494 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-09-21T06:39:27.494 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-09-21T06:39:27.494 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-09-21T06:39:27.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.494 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-09-21T06:39:27.494 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-21T06:39:27.494 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-21T06:39:27.494 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2927, 2024-09-21T06:39:27.495 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 10.577269498, 2024-09-21T06:39:27.495 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.003613689 2024-09-21T06:39:27.495 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:27.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.495 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-09-21T06:39:27.495 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-21T06:39:27.495 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-21T06:39:27.495 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4513, 2024-09-21T06:39:27.495 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.681748964, 2024-09-21T06:39:27.495 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000151063 2024-09-21T06:39:27.496 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:27.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.496 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-09-21T06:39:27.496 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 6726, 2024-09-21T06:39:27.496 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 6686, 2024-09-21T06:39:27.496 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-09-21T06:39:27.496 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 6686, 2024-09-21T06:39:27.496 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 10.147739818, 2024-09-21T06:39:27.496 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001517759 2024-09-21T06:39:27.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.496 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-09-21T06:39:27.496 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 40, 2024-09-21T06:39:27.496 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 5, 2024-09-21T06:39:27.497 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-09-21T06:39:27.497 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 75, 2024-09-21T06:39:27.497 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 8, 2024-09-21T06:39:27.497 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-09-21T06:39:27.497 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 11691, 2024-09-21T06:39:27.497 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 194, 2024-09-21T06:39:27.497 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 11446, 2024-09-21T06:39:27.497 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 51, 2024-09-21T06:39:27.497 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 11412, 2024-09-21T06:39:27.497 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 212, 2024-09-21T06:39:27.497 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 1, 2024-09-21T06:39:27.497 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 1, 2024-09-21T06:39:27.497 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 4, 2024-09-21T06:39:27.497 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 18714, 2024-09-21T06:39:27.498 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 18059, 2024-09-21T06:39:27.498 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 6, 2024-09-21T06:39:27.498 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 11, 2024-09-21T06:39:27.498 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:39:27.498 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-09-21T06:39:27.498 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-09-21T06:39:27.498 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-09-21T06:39:27.498 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-09-21T06:39:27.498 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 1, 2024-09-21T06:39:27.498 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 130, 2024-09-21T06:39:27.498 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 144, 2024-09-21T06:39:27.498 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 9180, 2024-09-21T06:39:27.498 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-09-21T06:39:27.499 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 7858, 2024-09-21T06:39:27.499 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-09-21T06:39:27.499 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 4, 2024-09-21T06:39:27.499 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 234, 2024-09-21T06:39:27.499 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 6, 2024-09-21T06:39:27.499 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 7858, 2024-09-21T06:39:27.499 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-09-21T06:39:27.499 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:39:27.499 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:39:27.499 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 132, 2024-09-21T06:39:27.499 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:39:27.499 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 132, 2024-09-21T06:39:27.499 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 7726, 2024-09-21T06:39:27.499 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 21, 2024-09-21T06:39:27.500 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 6266, 2024-09-21T06:39:27.500 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 3319, 2024-09-21T06:39:27.500 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:39:27.500 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:39:27.500 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:39:27.500 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 7421, 2024-09-21T06:39:27.500 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 1766, 2024-09-21T06:39:27.500 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 609, 2024-09-21T06:39:27.500 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 4093 2024-09-21T06:39:27.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.500 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-09-21T06:39:27.500 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-09-21T06:39:27.500 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 0, 2024-09-21T06:39:27.500 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 0, 2024-09-21T06:39:27.501 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 225, 2024-09-21T06:39:27.501 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 0, 2024-09-21T06:39:27.501 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 41, 2024-09-21T06:39:27.501 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-09-21T06:39:27.501 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:39:27.501 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 2497, 2024-09-21T06:39:27.501 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 2456, 2024-09-21T06:39:27.501 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-09-21T06:39:27.501 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-09-21T06:39:27.501 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-09-21T06:39:27.501 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:39:27.501 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:39:27.501 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-09-21T06:39:27.502 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-09-21T06:39:27.502 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:39:27.502 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:39:27.502 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:39:27.502 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 1, 2024-09-21T06:39:27.502 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-09-21T06:39:27.502 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 8, 2024-09-21T06:39:27.502 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-09-21T06:39:27.502 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0, 2024-09-21T06:39:27.502 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_started": 0, 2024-09-21T06:39:27.502 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_succeeded": 0, 2024-09-21T06:39:27.502 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_write_failed": 0 2024-09-21T06:39:27.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.503 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-09-21T06:39:27.503 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 1, 2024-09-21T06:39:27.503 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 8639, 2024-09-21T06:39:27.503 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-09-21T06:39:27.503 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-09-21T06:39:27.503 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 8639, 2024-09-21T06:39:27.503 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-09-21T06:39:27.503 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-09-21T06:39:27.503 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 12, 2024-09-21T06:39:27.503 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-09-21T06:39:27.503 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-09-21T06:39:27.503 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 12, 2024-09-21T06:39:27.503 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-09-21T06:39:27.503 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-09-21T06:39:27.504 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-09-21T06:39:27.504 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-09-21T06:39:27.504 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 30793705, 2024-09-21T06:39:27.504 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2024-09-21T06:39:27.504 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-09-21T06:39:27.504 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 730, 2024-09-21T06:39:27.504 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 11.866327606, 2024-09-21T06:39:27.504 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.016255243 2024-09-21T06:39:27.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.504 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2024-09-21T06:39:27.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.504 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-09-21T06:39:27.504 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 7106, 2024-09-21T06:39:27.504 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 9680, 2024-09-21T06:39:27.505 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 2574, 2024-09-21T06:39:27.505 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 271, 2024-09-21T06:39:27.505 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 283, 2024-09-21T06:39:27.505 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 12, 2024-09-21T06:39:27.505 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 11691, 2024-09-21T06:39:27.505 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 14373, 2024-09-21T06:39:27.505 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 2682, 2024-09-21T06:39:27.505 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 1, 2024-09-21T06:39:27.505 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 5111, 2024-09-21T06:39:27.505 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 5110, 2024-09-21T06:39:27.505 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 170960, 2024-09-21T06:39:27.505 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 382619648 2024-09-21T06:39:27.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.505 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-09-21T06:39:27.506 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 8708, 2024-09-21T06:39:27.506 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 63, 2024-09-21T06:39:27.506 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 6726, 2024-09-21T06:39:27.506 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 17, 2024-09-21T06:39:27.506 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 185, 2024-09-21T06:39:27.506 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-09-21T06:39:27.506 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 354, 2024-09-21T06:39:27.506 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.006608359, 2024-09-21T06:39:27.506 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002843526 2024-09-21T06:39:27.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.506 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-09-21T06:39:27.506 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 555, 2024-09-21T06:39:27.506 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.245685250, 2024-09-21T06:39:27.507 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000442676 2024-09-21T06:39:27.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.507 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-09-21T06:39:27.507 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.507 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.507 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.507 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-09-21T06:39:27.507 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.507 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.507 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.507 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-09-21T06:39:27.508 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3066, 2024-09-21T06:39:27.508 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.426438510, 2024-09-21T06:39:27.508 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000465244 2024-09-21T06:39:27.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.508 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-09-21T06:39:27.508 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.508 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.508 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.508 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-09-21T06:39:27.508 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.508 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.508 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.509 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-09-21T06:39:27.509 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.509 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.509 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.509 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-09-21T06:39:27.509 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.509 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.509 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.509 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-09-21T06:39:27.509 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.510 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.510 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.510 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-09-21T06:39:27.510 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.510 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.510 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.510 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-09-21T06:39:27.510 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.511 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.511 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.511 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-09-21T06:39:27.511 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.511 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.511 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.511 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-09-21T06:39:27.511 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.511 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.511 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.511 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-09-21T06:39:27.512 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1, 2024-09-21T06:39:27.512 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000174881, 2024-09-21T06:39:27.512 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000174881 2024-09-21T06:39:27.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.512 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-09-21T06:39:27.512 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 213, 2024-09-21T06:39:27.512 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.576057285, 2024-09-21T06:39:27.512 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002704494 2024-09-21T06:39:27.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.512 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-09-21T06:39:27.512 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.512 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.512 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.513 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-09-21T06:39:27.513 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.513 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.513 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.513 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-09-21T06:39:27.513 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.513 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.513 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.513 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-09-21T06:39:27.513 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 41, 2024-09-21T06:39:27.513 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 2.035913498, 2024-09-21T06:39:27.513 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.049656426 2024-09-21T06:39:27.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.514 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-09-21T06:39:27.514 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.514 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.514 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.514 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-09-21T06:39:27.514 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.514 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.514 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.514 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-09-21T06:39:27.514 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.517 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.517 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-09-21T06:39:27.517 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2456, 2024-09-21T06:39:27.517 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 4.856862035, 2024-09-21T06:39:27.517 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001977549 2024-09-21T06:39:27.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.517 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:39:27.517 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:39:27.517 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-09-21T06:39:27.517 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.517 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.517 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.517 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:27.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.518 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-09-21T06:39:27.518 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 2, 2024-09-21T06:39:27.518 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 2, 2024-09-21T06:39:27.518 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 0, 2024-09-21T06:39:27.518 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 2, 2024-09-21T06:39:27.518 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-09-21T06:39:27.518 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 4266, 2024-09-21T06:39:27.518 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 2133, 2024-09-21T06:39:27.518 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 624, 2024-09-21T06:39:27.519 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-09-21T06:39:27.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.519 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-09-21T06:39:27.519 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:39:27.519 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-09-21T06:39:27.519 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:39:27.519 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:39:27.519 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:39:27.519 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:39:27.519 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:39:27.519 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:39:27.519 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:39:27.519 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:39:27.520 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:39:27.520 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:39:27.520 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:39:27.520 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:39:27.520 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:39:27.520 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-09-21T06:39:27.520 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:39:27.520 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-09-21T06:39:27.520 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:39:27.520 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:39:27.520 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:39:27.521 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:39:27.521 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:39:27.521 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:39:27.521 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:39:27.521 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-09-21T06:39:27.521 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:39:27.521 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:39:27.521 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:39:27.521 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-09-21T06:39:27.521 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-09-21T06:39:27.521 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-09-21T06:39:27.521 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:39:27.521 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:39:27.522 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:39:27.522 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:39:27.522 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 890410, 2024-09-21T06:39:27.522 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 6883, 2024-09-21T06:39:27.522 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:39:27.522 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-09-21T06:39:27.522 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-09-21T06:39:27.522 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-09-21T06:39:27.522 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:39:27.522 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-09-21T06:39:27.522 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:39:27.522 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-09-21T06:39:27.522 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 8296, 2024-09-21T06:39:27.523 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 183, 2024-09-21T06:39:27.523 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:39:27.523 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:39:27.523 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-09-21T06:39:27.523 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-09-21T06:39:27.523 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 25059251, 2024-09-21T06:39:27.523 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 241015, 2024-09-21T06:39:27.523 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-09-21T06:39:27.523 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-09-21T06:39:27.523 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-09-21T06:39:27.524 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-09-21T06:39:27.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.524 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-09-21T06:39:27.524 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-09-21T06:39:27.524 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-09-21T06:39:27.524 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 11341, 2024-09-21T06:39:27.524 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 27708981, 2024-09-21T06:39:27.524 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 32, 2024-09-21T06:39:27.524 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 11341, 2024-09-21T06:39:27.524 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-09-21T06:39:27.524 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 11341, 2024-09-21T06:39:27.524 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 17.519716412, 2024-09-21T06:39:27.524 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001544812 2024-09-21T06:39:27.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.525 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-09-21T06:39:27.525 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-09-21T06:39:27.525 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 11341, 2024-09-21T06:39:27.525 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 11505 2024-09-21T06:39:27.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.525 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 11341, 2024-09-21T06:39:27.525 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 7909, 2024-09-21T06:39:27.525 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 3432, 2024-09-21T06:39:27.525 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-09-21T06:39:27.525 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-09-21T06:39:27.525 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 0, 2024-09-21T06:39:27.525 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 10, 2024-09-21T06:39:27.525 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 46, 2024-09-21T06:39:27.526 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 776, 2024-09-21T06:39:27.526 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 35, 2024-09-21T06:39:27.526 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-09-21T06:39:27.526 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-09-21T06:39:27.526 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-09-21T06:39:27.526 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-09-21T06:39:27.526 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 2482, 2024-09-21T06:39:27.526 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-09-21T06:39:27.526 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-09-21T06:39:27.526 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-09-21T06:39:27.526 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 7863, 2024-09-21T06:39:27.527 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 20, 2024-09-21T06:39:27.527 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:39:27.527 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-09-21T06:39:27.527 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:39:27.527 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-09-21T06:39:27.527 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-09-21T06:39:27.527 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-09-21T06:39:27.527 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:39:27.527 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-09-21T06:39:27.527 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:39:27.527 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-09-21T06:39:27.527 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-09-21T06:39:27.528 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-09-21T06:39:27.528 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-09-21T06:39:27.528 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-09-21T06:39:27.528 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-09-21T06:39:27.528 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-09-21T06:39:27.528 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-09-21T06:39:27.528 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-09-21T06:39:27.528 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-09-21T06:39:27.528 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-09-21T06:39:27.528 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-09-21T06:39:27.528 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-09-21T06:39:27.528 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-09-21T06:39:27.528 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-09-21T06:39:27.529 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-09-21T06:39:27.529 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-09-21T06:39:27.529 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 88, 2024-09-21T06:39:27.529 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-09-21T06:39:27.529 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 13, 2024-09-21T06:39:27.529 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 12, 2024-09-21T06:39:27.529 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 12, 2024-09-21T06:39:27.529 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-09-21T06:39:27.529 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-09-21T06:39:27.529 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 229, 2024-09-21T06:39:27.529 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 10, 2024-09-21T06:39:27.529 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 34 2024-09-21T06:39:27.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.530 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-09-21T06:39:27.530 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2024-09-21T06:39:27.530 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:39:27.530 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-09-21T06:39:27.530 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-09-21T06:39:27.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.530 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-09-21T06:39:27.530 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-09-21T06:39:27.530 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 6, 2024-09-21T06:39:27.530 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-09-21T06:39:27.530 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 6, 2024-09-21T06:39:27.530 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 2456, 2024-09-21T06:39:27.530 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 2456, 2024-09-21T06:39:27.531 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-09-21T06:39:27.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.531 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:39:27.531 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T06:39:27.531 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-21T06:39:27.531 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T06:39:27.531 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 35562, 2024-09-21T06:39:27.531 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 16616688, 2024-09-21T06:39:27.531 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:27.531 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 35562, 2024-09-21T06:39:27.531 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T06:39:27.531 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T06:39:27.532 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 35562, 2024-09-21T06:39:27.532 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 16616688, 2024-09-21T06:39:27.532 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T06:39:27.532 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.532 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.532 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.532 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:27.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.532 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-09-21T06:39:27.532 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T06:39:27.532 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-21T06:39:27.532 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T06:39:27.532 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T06:39:27.533 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T06:39:27.533 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:27.533 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:27.533 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 11341, 2024-09-21T06:39:27.533 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 28019381, 2024-09-21T06:39:27.533 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 11341, 2024-09-21T06:39:27.533 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 28019381, 2024-09-21T06:39:27.533 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T06:39:27.533 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.533 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.533 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.533 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:27.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.534 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-09-21T06:39:27.534 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T06:39:27.534 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-09-21T06:39:27.534 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T06:39:27.534 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T06:39:27.534 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T06:39:27.534 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:27.534 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:27.534 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 11341, 2024-09-21T06:39:27.534 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 11341, 2024-09-21T06:39:27.534 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 11341, 2024-09-21T06:39:27.534 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 11341, 2024-09-21T06:39:27.535 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T06:39:27.535 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.535 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.535 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.535 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:27.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.535 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:39:27.535 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T06:39:27.535 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-21T06:39:27.535 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T06:39:27.535 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 2456, 2024-09-21T06:39:27.535 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 310480, 2024-09-21T06:39:27.536 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:27.536 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 2456, 2024-09-21T06:39:27.536 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T06:39:27.536 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T06:39:27.536 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 46, 2024-09-21T06:39:27.536 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 310480, 2024-09-21T06:39:27.536 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T06:39:27.536 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.536 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.536 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.536 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:27.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.536 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x564a7b505450": { 2024-09-21T06:39:27.536 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T06:39:27.537 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-21T06:39:27.537 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T06:39:27.537 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 8639, 2024-09-21T06:39:27.537 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 26599401, 2024-09-21T06:39:27.537 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:27.537 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 8639, 2024-09-21T06:39:27.537 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T06:39:27.537 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T06:39:27.537 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 730, 2024-09-21T06:39:27.537 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 26599401, 2024-09-21T06:39:27.537 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T06:39:27.537 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:27.537 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:27.537 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:27.538 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:27.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:27.538 INFO:teuthology.orchestra.run.smithi175.stdout: "trackedop": { 2024-09-21T06:39:27.538 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2024-09-21T06:39:27.538 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:27.538 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-21T06:39:28.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:27 smithi063 ceph-mon[31150]: pgmap v670: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:39:28.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:27 smithi175 ceph-mon[34510]: pgmap v670: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:39:28.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:27 smithi071 ceph-mon[34844]: pgmap v670: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T06:39:28.287 INFO:tasks.check_counter:Daemon mds.i mds.exported=1 2024-09-21T06:39:28.287 INFO:tasks.check_counter:Daemon mds.i mds.imported=144 2024-09-21T06:39:28.287 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-21T06:39:28.287 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:39:28.287 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:39:28.288 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=8 2024-09-21T06:39:28.288 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T06:39:28.288 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T06:39:28.532 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:39:29.058 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-21T06:39:29.059 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:39:29.059 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 303, 2024-09-21T06:39:29.059 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 305, 2024-09-21T06:39:29.059 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 4273945, 2024-09-21T06:39:29.059 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 96418, 2024-09-21T06:39:29.059 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 6, 2024-09-21T06:39:29.059 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 2, 2024-09-21T06:39:29.059 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.037605578, 2024-09-21T06:39:29.059 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.014947590, 2024-09-21T06:39:29.059 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.011147264, 2024-09-21T06:39:29.059 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.007988205, 2024-09-21T06:39:29.059 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:29.060 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 303, 2024-09-21T06:39:29.060 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.014476303, 2024-09-21T06:39:29.060 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000047776 2024-09-21T06:39:29.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.060 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:29.060 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.060 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.060 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.060 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:39:29.060 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:39:29.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.060 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:39:29.060 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 695, 2024-09-21T06:39:29.061 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 864, 2024-09-21T06:39:29.061 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 4370850, 2024-09-21T06:39:29.061 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 597545, 2024-09-21T06:39:29.061 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 5, 2024-09-21T06:39:29.061 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 4, 2024-09-21T06:39:29.061 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.093851437, 2024-09-21T06:39:29.061 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.044206798, 2024-09-21T06:39:29.061 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.019599853, 2024-09-21T06:39:29.061 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.022253698, 2024-09-21T06:39:29.061 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:29.061 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 862, 2024-09-21T06:39:29.061 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.036618362, 2024-09-21T06:39:29.061 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000042480 2024-09-21T06:39:29.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.062 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:29.062 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.062 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.062 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.062 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:39:29.062 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 376848 2024-09-21T06:39:29.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.062 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:39:29.062 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 1573, 2024-09-21T06:39:29.062 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 1529, 2024-09-21T06:39:29.062 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1937184, 2024-09-21T06:39:29.062 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 549540, 2024-09-21T06:39:29.062 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 4, 2024-09-21T06:39:29.063 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 3, 2024-09-21T06:39:29.063 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.219042425, 2024-09-21T06:39:29.063 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.097260341, 2024-09-21T06:39:29.063 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.077112396, 2024-09-21T06:39:29.063 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.045186149, 2024-09-21T06:39:29.063 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:39:29.063 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1529, 2024-09-21T06:39:29.063 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.074635739, 2024-09-21T06:39:29.063 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000048813 2024-09-21T06:39:29.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.063 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:39:29.063 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.063 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.064 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.064 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1110272, 2024-09-21T06:39:29.064 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 140592 2024-09-21T06:39:29.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.064 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-09-21T06:39:29.064 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-09-21T06:39:29.064 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-09-21T06:39:29.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.064 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-09-21T06:39:29.064 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-21T06:39:29.064 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-21T06:39:29.064 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3816, 2024-09-21T06:39:29.064 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.122926953, 2024-09-21T06:39:29.065 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000032213 2024-09-21T06:39:29.065 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:29.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.065 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-09-21T06:39:29.065 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-21T06:39:29.065 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-21T06:39:29.065 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.065 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.065 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.065 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:29.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.065 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-09-21T06:39:29.065 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 0, 2024-09-21T06:39:29.065 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 0, 2024-09-21T06:39:29.066 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-09-21T06:39:29.066 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.066 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.066 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.066 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-09-21T06:39:29.066 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 0, 2024-09-21T06:39:29.066 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-09-21T06:39:29.066 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-09-21T06:39:29.066 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 0, 2024-09-21T06:39:29.066 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-09-21T06:39:29.066 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-09-21T06:39:29.066 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 1308, 2024-09-21T06:39:29.066 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 0, 2024-09-21T06:39:29.067 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 1308, 2024-09-21T06:39:29.067 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 0, 2024-09-21T06:39:29.067 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 1308, 2024-09-21T06:39:29.067 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 0, 2024-09-21T06:39:29.067 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 0, 2024-09-21T06:39:29.067 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 0, 2024-09-21T06:39:29.067 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 1, 2024-09-21T06:39:29.067 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 0, 2024-09-21T06:39:29.067 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 0, 2024-09-21T06:39:29.067 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 0, 2024-09-21T06:39:29.067 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 0, 2024-09-21T06:39:29.067 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:39:29.067 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-09-21T06:39:29.067 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-09-21T06:39:29.068 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-09-21T06:39:29.068 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-09-21T06:39:29.068 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 0, 2024-09-21T06:39:29.068 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 0, 2024-09-21T06:39:29.068 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 0, 2024-09-21T06:39:29.068 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 0, 2024-09-21T06:39:29.068 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-09-21T06:39:29.068 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:39:29.068 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-09-21T06:39:29.068 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 0, 2024-09-21T06:39:29.068 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 0, 2024-09-21T06:39:29.068 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 0, 2024-09-21T06:39:29.068 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:39:29.068 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-09-21T06:39:29.069 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:39:29.069 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:39:29.069 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:39:29.069 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:39:29.069 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:39:29.069 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 0, 2024-09-21T06:39:29.069 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:39:29.069 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:39:29.069 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:39:29.069 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:39:29.069 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:39:29.069 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:39:29.069 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 0, 2024-09-21T06:39:29.069 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:39:29.070 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 0, 2024-09-21T06:39:29.070 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 0 2024-09-21T06:39:29.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.070 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-09-21T06:39:29.070 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-09-21T06:39:29.070 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 0, 2024-09-21T06:39:29.070 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 0, 2024-09-21T06:39:29.070 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 0, 2024-09-21T06:39:29.070 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 0, 2024-09-21T06:39:29.070 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-09-21T06:39:29.070 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-09-21T06:39:29.070 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:39:29.070 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 0, 2024-09-21T06:39:29.071 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 0, 2024-09-21T06:39:29.071 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-09-21T06:39:29.071 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-09-21T06:39:29.071 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-09-21T06:39:29.071 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:39:29.071 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:39:29.071 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-09-21T06:39:29.071 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-09-21T06:39:29.071 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:39:29.071 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:39:29.071 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:39:29.071 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 0, 2024-09-21T06:39:29.071 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-09-21T06:39:29.071 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:39:29.071 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-09-21T06:39:29.072 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0, 2024-09-21T06:39:29.072 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_started": 0, 2024-09-21T06:39:29.072 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_succeeded": 0, 2024-09-21T06:39:29.072 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_write_failed": 0 2024-09-21T06:39:29.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.072 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-09-21T06:39:29.072 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-09-21T06:39:29.072 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 0, 2024-09-21T06:39:29.072 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-09-21T06:39:29.072 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-09-21T06:39:29.072 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 4267, 2024-09-21T06:39:29.072 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-09-21T06:39:29.072 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-09-21T06:39:29.072 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 0, 2024-09-21T06:39:29.073 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-09-21T06:39:29.073 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-09-21T06:39:29.073 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 8, 2024-09-21T06:39:29.073 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-09-21T06:39:29.073 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-09-21T06:39:29.073 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-09-21T06:39:29.073 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-09-21T06:39:29.073 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 13017598, 2024-09-21T06:39:29.073 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 13015510, 2024-09-21T06:39:29.073 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-09-21T06:39:29.073 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.073 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.073 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.074 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 4267 2024-09-21T06:39:29.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.074 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-09-21T06:39:29.074 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 82, 2024-09-21T06:39:29.074 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 2650, 2024-09-21T06:39:29.074 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 2568, 2024-09-21T06:39:29.074 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 23, 2024-09-21T06:39:29.074 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 76, 2024-09-21T06:39:29.074 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 53, 2024-09-21T06:39:29.074 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 1308, 2024-09-21T06:39:29.074 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 3629, 2024-09-21T06:39:29.074 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 2321, 2024-09-21T06:39:29.074 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 0, 2024-09-21T06:39:29.074 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 0, 2024-09-21T06:39:29.075 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 0, 2024-09-21T06:39:29.075 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 125248, 2024-09-21T06:39:29.075 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 326266880 2024-09-21T06:39:29.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.075 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-09-21T06:39:29.075 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 0, 2024-09-21T06:39:29.075 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 0, 2024-09-21T06:39:29.075 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 0, 2024-09-21T06:39:29.075 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 0, 2024-09-21T06:39:29.075 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 0, 2024-09-21T06:39:29.075 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-09-21T06:39:29.075 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.075 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.075 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.076 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-09-21T06:39:29.076 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.076 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.076 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.076 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-09-21T06:39:29.076 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.076 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.076 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.076 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-09-21T06:39:29.076 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.076 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.077 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.077 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-09-21T06:39:29.077 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.077 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.077 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.077 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-09-21T06:39:29.077 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.077 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.077 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.078 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-09-21T06:39:29.078 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.078 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.078 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.078 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-09-21T06:39:29.078 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.078 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.078 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.078 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-09-21T06:39:29.078 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.078 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.078 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.079 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-09-21T06:39:29.079 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.079 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.079 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.079 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-09-21T06:39:29.079 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.080 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.080 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.080 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-09-21T06:39:29.080 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.080 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.080 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.080 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-09-21T06:39:29.080 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.080 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.081 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.081 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-09-21T06:39:29.081 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.081 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.081 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.081 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-09-21T06:39:29.081 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.081 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.081 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.081 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-09-21T06:39:29.081 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.082 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.082 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.082 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-09-21T06:39:29.082 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.082 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.082 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.082 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-09-21T06:39:29.082 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.082 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.082 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.083 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-09-21T06:39:29.083 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.083 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.083 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.083 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-09-21T06:39:29.083 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.083 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.083 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.083 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-09-21T06:39:29.083 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.083 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.084 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.084 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-09-21T06:39:29.084 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.084 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.084 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.084 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-09-21T06:39:29.084 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.084 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.084 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.084 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-09-21T06:39:29.084 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.084 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.085 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.085 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-09-21T06:39:29.085 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.085 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.085 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.085 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-09-21T06:39:29.085 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.085 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.085 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.085 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-09-21T06:39:29.085 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.086 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.086 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.086 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-09-21T06:39:29.086 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.086 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.086 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.086 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-09-21T06:39:29.086 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.086 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.086 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.086 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:39:29.087 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:39:29.087 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-09-21T06:39:29.087 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.087 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.087 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.087 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:29.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.087 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-09-21T06:39:29.087 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 2, 2024-09-21T06:39:29.087 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 3, 2024-09-21T06:39:29.087 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 1, 2024-09-21T06:39:29.087 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 2, 2024-09-21T06:39:29.087 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-09-21T06:39:29.088 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 0, 2024-09-21T06:39:29.088 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 0, 2024-09-21T06:39:29.088 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 2000, 2024-09-21T06:39:29.088 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-09-21T06:39:29.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.088 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-09-21T06:39:29.088 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:39:29.088 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-09-21T06:39:29.088 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:39:29.088 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:39:29.088 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:39:29.088 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:39:29.088 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:39:29.089 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:39:29.089 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:39:29.089 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:39:29.089 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:39:29.089 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:39:29.089 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:39:29.089 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:39:29.089 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:39:29.089 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-09-21T06:39:29.089 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:39:29.089 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-09-21T06:39:29.089 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:39:29.089 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:39:29.089 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:39:29.090 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:39:29.090 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:39:29.090 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:39:29.090 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:39:29.090 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-09-21T06:39:29.090 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:39:29.090 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:39:29.090 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:39:29.090 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-09-21T06:39:29.090 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-09-21T06:39:29.090 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-09-21T06:39:29.090 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:39:29.090 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:39:29.090 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:39:29.091 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:39:29.091 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 202258, 2024-09-21T06:39:29.091 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 165, 2024-09-21T06:39:29.091 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:39:29.091 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-09-21T06:39:29.091 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-09-21T06:39:29.091 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-09-21T06:39:29.091 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:39:29.091 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-09-21T06:39:29.091 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:39:29.091 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-09-21T06:39:29.091 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 8296, 2024-09-21T06:39:29.091 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 183, 2024-09-21T06:39:29.091 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:39:29.091 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:39:29.092 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-09-21T06:39:29.092 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-09-21T06:39:29.092 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 1153721, 2024-09-21T06:39:29.092 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 10592, 2024-09-21T06:39:29.092 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-09-21T06:39:29.092 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-09-21T06:39:29.092 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-09-21T06:39:29.092 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-09-21T06:39:29.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.092 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-09-21T06:39:29.092 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-09-21T06:39:29.092 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-09-21T06:39:29.092 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 2283, 2024-09-21T06:39:29.093 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 21, 2024-09-21T06:39:29.093 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 3, 2024-09-21T06:39:29.093 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 2283, 2024-09-21T06:39:29.093 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-09-21T06:39:29.093 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2283, 2024-09-21T06:39:29.093 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.224980341, 2024-09-21T06:39:29.093 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000536566 2024-09-21T06:39:29.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.093 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-09-21T06:39:29.093 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-09-21T06:39:29.093 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2283, 2024-09-21T06:39:29.093 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 2284 2024-09-21T06:39:29.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.093 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 2283, 2024-09-21T06:39:29.094 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 2283, 2024-09-21T06:39:29.094 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 0, 2024-09-21T06:39:29.094 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-09-21T06:39:29.094 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-09-21T06:39:29.094 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 1458, 2024-09-21T06:39:29.094 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 0, 2024-09-21T06:39:29.094 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 823, 2024-09-21T06:39:29.094 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 0, 2024-09-21T06:39:29.094 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 0, 2024-09-21T06:39:29.094 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-09-21T06:39:29.094 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-09-21T06:39:29.094 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-09-21T06:39:29.094 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-09-21T06:39:29.094 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 0, 2024-09-21T06:39:29.095 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-09-21T06:39:29.095 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-09-21T06:39:29.095 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-09-21T06:39:29.095 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 1, 2024-09-21T06:39:29.095 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 0, 2024-09-21T06:39:29.095 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:39:29.095 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-09-21T06:39:29.095 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:39:29.095 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-09-21T06:39:29.095 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-09-21T06:39:29.095 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-09-21T06:39:29.095 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:39:29.095 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-09-21T06:39:29.095 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:39:29.095 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-09-21T06:39:29.096 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-09-21T06:39:29.096 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-09-21T06:39:29.096 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-09-21T06:39:29.096 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-09-21T06:39:29.096 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-09-21T06:39:29.096 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-09-21T06:39:29.096 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-09-21T06:39:29.096 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-09-21T06:39:29.096 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-09-21T06:39:29.096 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-09-21T06:39:29.096 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-09-21T06:39:29.096 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-09-21T06:39:29.096 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-09-21T06:39:29.096 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-09-21T06:39:29.097 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-09-21T06:39:29.097 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-09-21T06:39:29.097 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 88, 2024-09-21T06:39:29.097 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-09-21T06:39:29.097 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 13, 2024-09-21T06:39:29.097 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 6, 2024-09-21T06:39:29.097 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 6, 2024-09-21T06:39:29.097 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-09-21T06:39:29.097 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-09-21T06:39:29.097 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 0, 2024-09-21T06:39:29.097 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 2, 2024-09-21T06:39:29.097 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 0 2024-09-21T06:39:29.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.097 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-09-21T06:39:29.098 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 0, 2024-09-21T06:39:29.098 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:39:29.098 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-09-21T06:39:29.098 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-09-21T06:39:29.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.098 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-09-21T06:39:29.098 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-09-21T06:39:29.098 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:39:29.098 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-09-21T06:39:29.098 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 0, 2024-09-21T06:39:29.098 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 0, 2024-09-21T06:39:29.098 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 0, 2024-09-21T06:39:29.098 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-09-21T06:39:29.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.099 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:39:29.099 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T06:39:29.099 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-21T06:39:29.099 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T06:39:29.099 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 2567, 2024-09-21T06:39:29.099 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 10333677, 2024-09-21T06:39:29.099 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:29.099 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 2567, 2024-09-21T06:39:29.099 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T06:39:29.099 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T06:39:29.099 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2567, 2024-09-21T06:39:29.099 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 10333677, 2024-09-21T06:39:29.099 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T06:39:29.100 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.100 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.100 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.100 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:29.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.100 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-09-21T06:39:29.100 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T06:39:29.100 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-21T06:39:29.100 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T06:39:29.100 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T06:39:29.100 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T06:39:29.100 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:29.100 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:29.100 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 2283, 2024-09-21T06:39:29.101 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 8826587, 2024-09-21T06:39:29.101 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2283, 2024-09-21T06:39:29.101 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 8826587, 2024-09-21T06:39:29.101 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T06:39:29.101 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.101 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.101 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.101 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:29.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.101 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-09-21T06:39:29.101 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T06:39:29.101 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-09-21T06:39:29.101 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T06:39:29.101 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T06:39:29.101 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T06:39:29.102 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:29.102 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:29.102 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 2283, 2024-09-21T06:39:29.102 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 2283, 2024-09-21T06:39:29.102 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2283, 2024-09-21T06:39:29.102 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 2283, 2024-09-21T06:39:29.102 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T06:39:29.102 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.102 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.102 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.102 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:29.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.102 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:39:29.102 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T06:39:29.103 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-21T06:39:29.103 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T06:39:29.103 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T06:39:29.103 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T06:39:29.103 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:29.103 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:29.103 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T06:39:29.103 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T06:39:29.103 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-09-21T06:39:29.103 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-09-21T06:39:29.103 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T06:39:29.103 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.103 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.103 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.103 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:29.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.104 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x562d5fc51380": { 2024-09-21T06:39:29.104 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T06:39:29.104 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-21T06:39:29.104 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T06:39:29.104 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T06:39:29.104 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T06:39:29.104 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T06:39:29.104 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T06:39:29.104 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T06:39:29.104 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T06:39:29.104 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-09-21T06:39:29.104 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-09-21T06:39:29.104 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T06:39:29.104 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T06:39:29.105 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T06:39:29.105 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T06:39:29.105 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:29.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T06:39:29.105 INFO:teuthology.orchestra.run.smithi175.stdout: "trackedop": { 2024-09-21T06:39:29.105 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2024-09-21T06:39:29.105 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T06:39:29.105 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-21T06:39:29.940 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:29 smithi175 ceph-mon[34510]: pgmap v671: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T06:39:29.964 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-21T06:39:29.964 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-21T06:39:29.965 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-09-21T06:39:29.965 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:39:29.965 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:39:29.965 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-09-21T06:39:29.965 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T06:39:29.978 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T06:39:29.979 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:39:29.979 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:39:30.001 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:39:30.001 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:39:30.060 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T06:39:30.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:29 smithi063 ceph-mon[31150]: pgmap v671: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T06:39:30.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:29 smithi071 ceph-mon[34844]: pgmap v671: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T06:39:30.351 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:30.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.840+0000 7f5135534640 1 -- 172.21.15.63:0/614413437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130108db0 msgr2=0x7f513010f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.840+0000 7f5135534640 1 --2- 172.21.15.63:0/614413437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130108db0 0x7f513010f5e0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5128009ca0 tx=0x7f512802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.840+0000 7f5135534640 1 -- 172.21.15.63:0/614413437 shutdown_connections 2024-09-21T06:39:30.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.840+0000 7f5135534640 1 --2- 172.21.15.63:0/614413437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130108db0 0x7f513010f5e0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.840+0000 7f5135534640 1 --2- 172.21.15.63:0/614413437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5130108460 0x7f5130108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.840+0000 7f5135534640 1 --2- 172.21.15.63:0/614413437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51301031f0 0x7f5130103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.840+0000 7f5135534640 1 -- 172.21.15.63:0/614413437 >> 172.21.15.63:0/614413437 conn(0x7f5130079ec0 msgr2=0x7f513007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.840+0000 7f5135534640 1 -- 172.21.15.63:0/614413437 shutdown_connections 2024-09-21T06:39:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.841+0000 7f5135534640 1 -- 172.21.15.63:0/614413437 wait complete. 2024-09-21T06:39:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.841+0000 7f5135534640 1 Processor -- start 2024-09-21T06:39:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.842+0000 7f5135534640 1 -- start start 2024-09-21T06:39:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.842+0000 7f5135534640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51301031f0 0x7f51300feef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.842+0000 7f5135534640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130108460 0x7f51300ff430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.842+0000 7f5135534640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5130108db0 0x7f51300ff970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.842+0000 7f5135534640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5130112a70 con 0x7f5130108460 2024-09-21T06:39:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.842+0000 7f5135534640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f51301128f0 con 0x7f51301031f0 2024-09-21T06:39:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.842+0000 7f5135534640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5130112bf0 con 0x7f5130108db0 2024-09-21T06:39:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.842+0000 7f51267fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130108460 0x7f51300ff430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.842+0000 7f51267fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130108460 0x7f51300ff430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46456/0 (socket says 172.21.15.63:46456) 2024-09-21T06:39:30.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.842+0000 7f51267fc640 1 -- 172.21.15.63:0/434808662 learned_addr learned my addr 172.21.15.63:0/434808662 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.842+0000 7f512effd640 1 --2- 172.21.15.63:0/434808662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51301031f0 0x7f51300feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.842+0000 7f512f7fe640 1 --2- 172.21.15.63:0/434808662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5130108db0 0x7f51300ff970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.842+0000 7f51267fc640 1 -- 172.21.15.63:0/434808662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5130108db0 msgr2=0x7f51300ff970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.842+0000 7f51267fc640 1 --2- 172.21.15.63:0/434808662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5130108db0 0x7f51300ff970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.842+0000 7f51267fc640 1 -- 172.21.15.63:0/434808662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51301031f0 msgr2=0x7f51300feef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.842+0000 7f51267fc640 1 --2- 172.21.15.63:0/434808662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51301031f0 0x7f51300feef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.842+0000 7f51267fc640 1 -- 172.21.15.63:0/434808662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51301a8720 con 0x7f5130108460 2024-09-21T06:39:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.842+0000 7f512f7fe640 1 --2- 172.21.15.63:0/434808662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5130108db0 0x7f51300ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:39:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.843+0000 7f51267fc640 1 --2- 172.21.15.63:0/434808662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130108460 0x7f51300ff430 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f511800c8c0 tx=0x7f511800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.843+0000 7f512cff9640 1 -- 172.21.15.63:0/434808662 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5118007bb0 con 0x7f5130108460 2024-09-21T06:39:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.843+0000 7f5135534640 1 -- 172.21.15.63:0/434808662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51301a8a10 con 0x7f5130108460 2024-09-21T06:39:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.843+0000 7f512cff9640 1 -- 172.21.15.63:0/434808662 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5118007d50 con 0x7f5130108460 2024-09-21T06:39:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.843+0000 7f512cff9640 1 -- 172.21.15.63:0/434808662 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51180187c0 con 0x7f5130108460 2024-09-21T06:39:30.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.843+0000 7f5135534640 1 -- 172.21.15.63:0/434808662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51301a8f50 con 0x7f5130108460 2024-09-21T06:39:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.844+0000 7f5135534640 1 -- 172.21.15.63:0/434808662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5130103600 con 0x7f5130108460 2024-09-21T06:39:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.845+0000 7f512cff9640 1 -- 172.21.15.63:0/434808662 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f511800fa20 con 0x7f5130108460 2024-09-21T06:39:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.846+0000 7f512cff9640 1 --2- 172.21.15.63:0/434808662 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f511c0b6680 0x7f511c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.846+0000 7f512effd640 1 --2- 172.21.15.63:0/434808662 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f511c0b6680 0x7f511c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.846+0000 7f512cff9640 1 -- 172.21.15.63:0/434808662 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8593+0+0 (secure 0 0 0) 0x7f51180e7ac0 con 0x7f5130108460 2024-09-21T06:39:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.847+0000 7f512effd640 1 --2- 172.21.15.63:0/434808662 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f511c0b6680 0x7f511c0b8b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5130100940 tx=0x7f512000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:30.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:30.850+0000 7f512cff9640 1 -- 172.21.15.63:0/434808662 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5118014030 con 0x7f5130108460 2024-09-21T06:39:31.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:31.052+0000 7f5135534640 1 -- 172.21.15.63:0/434808662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f51301001f0 con 0x7f5130108460 2024-09-21T06:39:31.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:31.052+0000 7f512cff9640 1 -- 172.21.15.63:0/434808662 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v88) ==== 81+0+1000 (secure 0 0 0) 0x7f51180ae050 con 0x7f5130108460 2024-09-21T06:39:31.054 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.71:6839/3472481253 2024-09-22T06:30:16.107900+0000 2024-09-21T06:39:31.054 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.71:6838/3472481253 2024-09-22T06:30:16.107900+0000 2024-09-21T06:39:31.055 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1652196301 2024-09-22T06:19:37.776447+0000 2024-09-21T06:39:31.055 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/1479125434 2024-09-22T06:19:37.776447+0000 2024-09-21T06:39:31.055 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/2740830999 2024-09-22T06:18:10.293119+0000 2024-09-21T06:39:31.055 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/63967018 2024-09-22T06:18:10.293119+0000 2024-09-21T06:39:31.055 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/152956176 2024-09-22T06:18:36.864948+0000 2024-09-21T06:39:31.055 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/63967018 2024-09-22T06:18:10.293119+0000 2024-09-21T06:39:31.055 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/2958589237 2024-09-22T06:18:36.864948+0000 2024-09-21T06:39:31.055 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1398493582 2024-09-22T06:18:36.864948+0000 2024-09-21T06:39:31.055 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/3529491525 2024-09-22T06:18:10.293119+0000 2024-09-21T06:39:31.055 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/363262068 2024-09-22T06:18:10.293119+0000 2024-09-21T06:39:31.055 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/152956176 2024-09-22T06:18:36.864948+0000 2024-09-21T06:39:31.055 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/1479125434 2024-09-22T06:19:37.776447+0000 2024-09-21T06:39:31.055 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/3928056461 2024-09-22T06:18:36.864948+0000 2024-09-21T06:39:31.055 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/128321401 2024-09-22T06:19:37.776447+0000 2024-09-21T06:39:31.056 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/39222803 2024-09-22T06:19:37.776447+0000 2024-09-21T06:39:31.056 INFO:teuthology.orchestra.run.smithi063.stderr:listed 17 entries 2024-09-21T06:39:31.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:31.055+0000 7f5135534640 1 -- 172.21.15.63:0/434808662 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f511c0b6680 msgr2=0x7f511c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:31.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:31.055+0000 7f5135534640 1 --2- 172.21.15.63:0/434808662 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f511c0b6680 0x7f511c0b8b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5130100940 tx=0x7f512000b390 comp rx=0 tx=0).stop 2024-09-21T06:39:31.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:31.055+0000 7f5135534640 1 -- 172.21.15.63:0/434808662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130108460 msgr2=0x7f51300ff430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:31.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:31.055+0000 7f5135534640 1 --2- 172.21.15.63:0/434808662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130108460 0x7f51300ff430 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f511800c8c0 tx=0x7f511800cd80 comp rx=0 tx=0).stop 2024-09-21T06:39:31.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:31.055+0000 7f5135534640 1 -- 172.21.15.63:0/434808662 shutdown_connections 2024-09-21T06:39:31.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:31.055+0000 7f5135534640 1 --2- 172.21.15.63:0/434808662 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f511c0b6680 0x7f511c0b8b90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:31.055+0000 7f5135534640 1 --2- 172.21.15.63:0/434808662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5130108db0 0x7f51300ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:31.055+0000 7f5135534640 1 --2- 172.21.15.63:0/434808662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5130108460 0x7f51300ff430 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:31.055+0000 7f5135534640 1 --2- 172.21.15.63:0/434808662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51301031f0 0x7f51300feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:31.055+0000 7f5135534640 1 -- 172.21.15.63:0/434808662 >> 172.21.15.63:0/434808662 conn(0x7f5130079ec0 msgr2=0x7f5130101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:31.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:31.055+0000 7f5135534640 1 -- 172.21.15.63:0/434808662 shutdown_connections 2024-09-21T06:39:31.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:31.055+0000 7f5135534640 1 -- 172.21.15.63:0/434808662 wait complete. 2024-09-21T06:39:31.786 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:39:31.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:39:31.786 DEBUG:teuthology.orchestra.run.smithi063:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:39:31.850 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T06:39:31.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:39:31.850 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:39:31.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:39:31.899 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-21T06:39:31.947 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:39:31.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:39:31.947 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:39:32.007 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:31 smithi063 ceph-mon[31150]: pgmap v672: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:39:32.007 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:31 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/434808662' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:39:32.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:39:32.009 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-09-21T06:39:32.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:31 smithi175 ceph-mon[34510]: pgmap v672: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:39:32.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:31 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/434808662' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:39:32.108 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T06:39:32.122 INFO:tasks.cephadm:Teardown begin 2024-09-21T06:39:32.123 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:39:32.123 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:39:32.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:31 smithi071 ceph-mon[34844]: pgmap v672: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T06:39:32.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:31 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/434808662' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:39:32.459 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:32.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.949+0000 7f3e4ad46640 1 -- 172.21.15.63:0/2524904601 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e44105380 msgr2=0x7f3e4410d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:32.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.949+0000 7f3e4ad46640 1 --2- 172.21.15.63:0/2524904601 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e44105380 0x7f3e4410d8d0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f3e30009900 tx=0x7f3e3002a410 comp rx=0 tx=0).stop 2024-09-21T06:39:32.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.949+0000 7f3e4ad46640 1 -- 172.21.15.63:0/2524904601 shutdown_connections 2024-09-21T06:39:32.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.949+0000 7f3e4ad46640 1 --2- 172.21.15.63:0/2524904601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e4410de60 0x7f3e44110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.949+0000 7f3e4ad46640 1 --2- 172.21.15.63:0/2524904601 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e44105380 0x7f3e4410d8d0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.949+0000 7f3e4ad46640 1 --2- 172.21.15.63:0/2524904601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e44104a30 0x7f3e44104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.949+0000 7f3e4ad46640 1 -- 172.21.15.63:0/2524904601 >> 172.21.15.63:0/2524904601 conn(0x7f3e44079760 msgr2=0x7f3e44079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:32.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.949+0000 7f3e4ad46640 1 -- 172.21.15.63:0/2524904601 shutdown_connections 2024-09-21T06:39:32.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.949+0000 7f3e4ad46640 1 -- 172.21.15.63:0/2524904601 wait complete. 2024-09-21T06:39:32.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.949+0000 7f3e4ad46640 1 Processor -- start 2024-09-21T06:39:32.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.950+0000 7f3e4ad46640 1 -- start start 2024-09-21T06:39:32.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.950+0000 7f3e4ad46640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e44104a30 0x7f3e4419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.950+0000 7f3e4ad46640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e44105380 0x7f3e4419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.950+0000 7f3e4ad46640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e4410de60 0x7f3e4419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.950+0000 7f3e4ad46640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3e44113aa0 con 0x7f3e44105380 2024-09-21T06:39:32.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.950+0000 7f3e4ad46640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3e44113920 con 0x7f3e44104a30 2024-09-21T06:39:32.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.950+0000 7f3e4ad46640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3e44113c20 con 0x7f3e4410de60 2024-09-21T06:39:32.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.950+0000 7f3e43fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e44105380 0x7f3e4419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.950+0000 7f3e43fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e44105380 0x7f3e4419aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46474/0 (socket says 172.21.15.63:46474) 2024-09-21T06:39:32.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.950+0000 7f3e43fff640 1 -- 172.21.15.63:0/35851987 learned_addr learned my addr 172.21.15.63:0/35851987 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:32.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.950+0000 7f3e48ae2640 1 --2- 172.21.15.63:0/35851987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e44104a30 0x7f3e4419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.950+0000 7f3e492e3640 1 --2- 172.21.15.63:0/35851987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e4410de60 0x7f3e4419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.950+0000 7f3e43fff640 1 -- 172.21.15.63:0/35851987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e4410de60 msgr2=0x7f3e4419fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:32.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.950+0000 7f3e43fff640 1 --2- 172.21.15.63:0/35851987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e4410de60 0x7f3e4419fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.950+0000 7f3e43fff640 1 -- 172.21.15.63:0/35851987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e44104a30 msgr2=0x7f3e4419a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:32.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.950+0000 7f3e43fff640 1 --2- 172.21.15.63:0/35851987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e44104a30 0x7f3e4419a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.950+0000 7f3e43fff640 1 -- 172.21.15.63:0/35851987 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e441a0360 con 0x7f3e44105380 2024-09-21T06:39:32.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.950+0000 7f3e48ae2640 1 --2- 172.21.15.63:0/35851987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e44104a30 0x7f3e4419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:32.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.951+0000 7f3e43fff640 1 --2- 172.21.15.63:0/35851987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e44105380 0x7f3e4419aa50 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f3e30006010 tx=0x7f3e30004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:32.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.951+0000 7f3e41ffb640 1 -- 172.21.15.63:0/35851987 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3003f030 con 0x7f3e44105380 2024-09-21T06:39:32.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.951+0000 7f3e41ffb640 1 -- 172.21.15.63:0/35851987 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e30004460 con 0x7f3e44105380 2024-09-21T06:39:32.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.951+0000 7f3e4ad46640 1 -- 172.21.15.63:0/35851987 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e441a05f0 con 0x7f3e44105380 2024-09-21T06:39:32.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.951+0000 7f3e41ffb640 1 -- 172.21.15.63:0/35851987 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e30035070 con 0x7f3e44105380 2024-09-21T06:39:32.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.951+0000 7f3e4ad46640 1 -- 172.21.15.63:0/35851987 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e441a0ad0 con 0x7f3e44105380 2024-09-21T06:39:32.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.952+0000 7f3e4ad46640 1 -- 172.21.15.63:0/35851987 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e4406c1f0 con 0x7f3e44105380 2024-09-21T06:39:32.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.954+0000 7f3e41ffb640 1 -- 172.21.15.63:0/35851987 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f3e30042030 con 0x7f3e44105380 2024-09-21T06:39:32.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.954+0000 7f3e41ffb640 1 --2- 172.21.15.63:0/35851987 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3e340b6730 0x7f3e340b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.955+0000 7f3e48ae2640 1 --2- 172.21.15.63:0/35851987 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3e340b6730 0x7f3e340b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.955+0000 7f3e41ffb640 1 -- 172.21.15.63:0/35851987 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8593+0+0 (secure 0 0 0) 0x7f3e30107b20 con 0x7f3e44105380 2024-09-21T06:39:32.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.955+0000 7f3e48ae2640 1 --2- 172.21.15.63:0/35851987 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3e340b6730 0x7f3e340b8c40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3e4406c8f0 tx=0x7f3e3800a5e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:32.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:32.959+0000 7f3e41ffb640 1 -- 172.21.15.63:0/35851987 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3e300ce020 con 0x7f3e44105380 2024-09-21T06:39:33.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:33.186+0000 7f3e4ad46640 1 -- 172.21.15.63:0/35851987 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e4419b5e0 con 0x7f3e44105380 2024-09-21T06:39:33.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:33.187+0000 7f3e41ffb640 1 -- 172.21.15.63:0/35851987 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+11971 (secure 0 0 0) 0x7f3e300d2400 con 0x7f3e44105380 2024-09-21T06:39:33.189 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:39:33.189 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":61,"btime":"2024-09-21T06:36:33:430596+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":61,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:36:32.513212+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24659,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":34,"state":"up:active","state_seq":69,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25637":{"gid":25637,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3354670524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3354670524},{"type":"v1","addr":"172.21.15.71:6839","nonce":3354670524}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24659,"qdb_cluster":[24694,24670,24659,24676,14835]},"id":1}]} 2024-09-21T06:39:33.189 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 61 2024-09-21T06:39:33.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:33.189+0000 7f3e4ad46640 1 -- 172.21.15.63:0/35851987 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3e340b6730 msgr2=0x7f3e340b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:33.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:33.189+0000 7f3e4ad46640 1 --2- 172.21.15.63:0/35851987 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3e340b6730 0x7f3e340b8c40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3e4406c8f0 tx=0x7f3e3800a5e0 comp rx=0 tx=0).stop 2024-09-21T06:39:33.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:33.189+0000 7f3e4ad46640 1 -- 172.21.15.63:0/35851987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e44105380 msgr2=0x7f3e4419aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:33.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:33.189+0000 7f3e4ad46640 1 --2- 172.21.15.63:0/35851987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e44105380 0x7f3e4419aa50 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f3e30006010 tx=0x7f3e30004060 comp rx=0 tx=0).stop 2024-09-21T06:39:33.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:33.189+0000 7f3e4ad46640 1 -- 172.21.15.63:0/35851987 shutdown_connections 2024-09-21T06:39:33.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:33.189+0000 7f3e4ad46640 1 --2- 172.21.15.63:0/35851987 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3e340b6730 0x7f3e340b8c40 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:33.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:33.189+0000 7f3e4ad46640 1 --2- 172.21.15.63:0/35851987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e4410de60 0x7f3e4419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:33.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:33.189+0000 7f3e4ad46640 1 --2- 172.21.15.63:0/35851987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e44105380 0x7f3e4419aa50 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:33.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:33.189+0000 7f3e4ad46640 1 --2- 172.21.15.63:0/35851987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e44104a30 0x7f3e4419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:33.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:33.189+0000 7f3e4ad46640 1 -- 172.21.15.63:0/35851987 >> 172.21.15.63:0/35851987 conn(0x7f3e44079760 msgr2=0x7f3e441009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:33.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:33.189+0000 7f3e4ad46640 1 -- 172.21.15.63:0/35851987 shutdown_connections 2024-09-21T06:39:33.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:33.189+0000 7f3e4ad46640 1 -- 172.21.15.63:0/35851987 wait complete. 2024-09-21T06:39:34.051 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:33 smithi063 ceph-mon[31150]: pgmap v673: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:39:34.051 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:33 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/35851987' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:39:34.086 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:39:34.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:33 smithi175 ceph-mon[34510]: pgmap v673: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:39:34.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:33 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/35851987' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:39:34.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:33 smithi071 ceph-mon[34844]: pgmap v673: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T06:39:34.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:33 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/35851987' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:39:34.351 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:34.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.855+0000 7f3ce47f6640 1 -- 172.21.15.63:0/246961503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc1094f0 msgr2=0x7f3cdc109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:34.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.855+0000 7f3ce47f6640 1 --2- 172.21.15.63:0/246961503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc1094f0 0x7f3cdc109900 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009900 tx=0x7f3cd002a410 comp rx=0 tx=0).stop 2024-09-21T06:39:34.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.855+0000 7f3ce47f6640 1 -- 172.21.15.63:0/246961503 shutdown_connections 2024-09-21T06:39:34.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.855+0000 7f3ce47f6640 1 --2- 172.21.15.63:0/246961503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cdc109e40 0x7f3cdc110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.855+0000 7f3ce47f6640 1 --2- 172.21.15.63:0/246961503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc1094f0 0x7f3cdc109900 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.855+0000 7f3ce47f6640 1 --2- 172.21.15.63:0/246961503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cdc103bb0 0x7f3cdc103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.855+0000 7f3ce47f6640 1 -- 172.21.15.63:0/246961503 >> 172.21.15.63:0/246961503 conn(0x7f3cdc0ff600 msgr2=0x7f3cdc101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:34.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.855+0000 7f3ce47f6640 1 -- 172.21.15.63:0/246961503 shutdown_connections 2024-09-21T06:39:34.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.855+0000 7f3ce47f6640 1 -- 172.21.15.63:0/246961503 wait complete. 2024-09-21T06:39:34.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.856+0000 7f3ce47f6640 1 Processor -- start 2024-09-21T06:39:34.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.856+0000 7f3ce47f6640 1 -- start start 2024-09-21T06:39:34.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.856+0000 7f3ce47f6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cdc103bb0 0x7f3cdc19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.856+0000 7f3ce47f6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc1094f0 0x7f3cdc19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.856+0000 7f3ce47f6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cdc109e40 0x7f3cdc19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.856+0000 7f3ce47f6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc113b50 con 0x7f3cdc1094f0 2024-09-21T06:39:34.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.856+0000 7f3ce47f6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc1139d0 con 0x7f3cdc109e40 2024-09-21T06:39:34.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.856+0000 7f3ce47f6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc113cd0 con 0x7f3cdc103bb0 2024-09-21T06:39:34.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.856+0000 7f3ce1d91640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc1094f0 0x7f3cdc19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.856+0000 7f3ce1d91640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc1094f0 0x7f3cdc19aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46486/0 (socket says 172.21.15.63:46486) 2024-09-21T06:39:34.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.856+0000 7f3ce1d91640 1 -- 172.21.15.63:0/3243672556 learned_addr learned my addr 172.21.15.63:0/3243672556 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:34.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.856+0000 7f3ce2d93640 1 --2- 172.21.15.63:0/3243672556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cdc109e40 0x7f3cdc19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.857+0000 7f3ce2592640 1 --2- 172.21.15.63:0/3243672556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cdc103bb0 0x7f3cdc19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.857+0000 7f3ce1d91640 1 -- 172.21.15.63:0/3243672556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cdc103bb0 msgr2=0x7f3cdc19a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:34.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.857+0000 7f3ce1d91640 1 --2- 172.21.15.63:0/3243672556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cdc103bb0 0x7f3cdc19a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.857+0000 7f3ce1d91640 1 -- 172.21.15.63:0/3243672556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cdc109e40 msgr2=0x7f3cdc19fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:34.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.857+0000 7f3ce1d91640 1 --2- 172.21.15.63:0/3243672556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cdc109e40 0x7f3cdc19fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.857+0000 7f3ce1d91640 1 -- 172.21.15.63:0/3243672556 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cdc1a03b0 con 0x7f3cdc1094f0 2024-09-21T06:39:34.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.857+0000 7f3ce1d91640 1 --2- 172.21.15.63:0/3243672556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc1094f0 0x7f3cdc19aaa0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0005ab0 tx=0x7f3cd0003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:34.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.857+0000 7f3cdb7fe640 1 -- 172.21.15.63:0/3243672556 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd003f070 con 0x7f3cdc1094f0 2024-09-21T06:39:34.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.857+0000 7f3ce47f6640 1 -- 172.21.15.63:0/3243672556 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cdc1a0640 con 0x7f3cdc1094f0 2024-09-21T06:39:34.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.857+0000 7f3cdb7fe640 1 -- 172.21.15.63:0/3243672556 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cd0031d60 con 0x7f3cdc1094f0 2024-09-21T06:39:34.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.857+0000 7f3cdb7fe640 1 -- 172.21.15.63:0/3243672556 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0035030 con 0x7f3cdc1094f0 2024-09-21T06:39:34.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.857+0000 7f3ce47f6640 1 -- 172.21.15.63:0/3243672556 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cdc1a0b70 con 0x7f3cdc1094f0 2024-09-21T06:39:34.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.858+0000 7f3ce47f6640 1 -- 172.21.15.63:0/3243672556 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cdc103fc0 con 0x7f3cdc1094f0 2024-09-21T06:39:34.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.860+0000 7f3cdb7fe640 1 -- 172.21.15.63:0/3243672556 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f3cd0042070 con 0x7f3cdc1094f0 2024-09-21T06:39:34.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.861+0000 7f3cdb7fe640 1 --2- 172.21.15.63:0/3243672556 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3cc40b66b0 0x7f3cc40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.861+0000 7f3ce2592640 1 --2- 172.21.15.63:0/3243672556 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3cc40b66b0 0x7f3cc40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.861+0000 7f3cdb7fe640 1 -- 172.21.15.63:0/3243672556 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8593+0+0 (secure 0 0 0) 0x7f3cd0107ea0 con 0x7f3cdc1094f0 2024-09-21T06:39:34.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.861+0000 7f3ce2592640 1 --2- 172.21.15.63:0/3243672556 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3cc40b66b0 0x7f3cc40b8bc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc005fd0 tx=0x7f3ccc009760 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:34.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:34.865+0000 7f3cdb7fe640 1 -- 172.21.15.63:0/3243672556 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3cdc1a0b70 con 0x7f3cdc1094f0 2024-09-21T06:39:35.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:35.091+0000 7f3ce47f6640 1 -- 172.21.15.63:0/3243672556 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3cdc19b630 con 0x7f3cdc1094f0 2024-09-21T06:39:35.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:35.092+0000 7f3cdb7fe640 1 -- 172.21.15.63:0/3243672556 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+11971 (secure 0 0 0) 0x7f3cd00d2780 con 0x7f3cdc1094f0 2024-09-21T06:39:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:39:35.094 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":61,"btime":"2024-09-21T06:36:33:430596+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/4115433943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":4115433943},{"type":"v1","addr":"172.21.15.63:6835","nonce":4115433943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3545415905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":3545415905},{"type":"v1","addr":"172.21.15.63:6837","nonce":3545415905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":61,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:26:18.960208+0000","modified":"2024-09-21T06:36:32.513212+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24659,"mds_1":24694,"mds_2":24676,"mds_3":24670,"mds_4":14835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14823":{"gid":14823,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.63:6839/2446248912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":2446248912},{"type":"v1","addr":"172.21.15.63:6839","nonce":2446248912}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14835":{"gid":14835,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.63:6841/1426680017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1426680017},{"type":"v1","addr":"172.21.15.63:6841","nonce":1426680017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3879125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3879125360},{"type":"v1","addr":"172.21.15.71:6833","nonce":3879125360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24622":{"gid":24622,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/825731342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":825731342},{"type":"v1","addr":"172.21.15.175:6833","nonce":825731342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/946121091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":946121091},{"type":"v1","addr":"172.21.15.71:6835","nonce":946121091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":34,"state":"up:active","state_seq":69,"addr":"172.21.15.71:6837/1168849842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1168849842},{"type":"v1","addr":"172.21.15.71:6837","nonce":1168849842}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24670":{"gid":24670,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/3140987446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3140987446},{"type":"v1","addr":"172.21.15.175:6835","nonce":3140987446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6837/2825611591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2825611591},{"type":"v1","addr":"172.21.15.175:6837","nonce":2825611591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24694":{"gid":24694,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3302221763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3302221763},{"type":"v1","addr":"172.21.15.175:6839","nonce":3302221763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25637":{"gid":25637,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6839/3354670524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3354670524},{"type":"v1","addr":"172.21.15.71:6839","nonce":3354670524}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24659,"qdb_cluster":[24694,24670,24659,24676,14835]},"id":1}]} 2024-09-21T06:39:35.094 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 61 2024-09-21T06:39:35.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:35.094+0000 7f3ce47f6640 1 -- 172.21.15.63:0/3243672556 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3cc40b66b0 msgr2=0x7f3cc40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:35.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:35.094+0000 7f3ce47f6640 1 --2- 172.21.15.63:0/3243672556 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3cc40b66b0 0x7f3cc40b8bc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc005fd0 tx=0x7f3ccc009760 comp rx=0 tx=0).stop 2024-09-21T06:39:35.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:35.094+0000 7f3ce47f6640 1 -- 172.21.15.63:0/3243672556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc1094f0 msgr2=0x7f3cdc19aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:35.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:35.094+0000 7f3ce47f6640 1 --2- 172.21.15.63:0/3243672556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc1094f0 0x7f3cdc19aaa0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0005ab0 tx=0x7f3cd0003cd0 comp rx=0 tx=0).stop 2024-09-21T06:39:35.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:35.094+0000 7f3ce47f6640 1 -- 172.21.15.63:0/3243672556 shutdown_connections 2024-09-21T06:39:35.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:35.094+0000 7f3ce47f6640 1 --2- 172.21.15.63:0/3243672556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cdc109e40 0x7f3cdc19fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:35.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:35.094+0000 7f3ce47f6640 1 --2- 172.21.15.63:0/3243672556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc1094f0 0x7f3cdc19aaa0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:35.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:35.094+0000 7f3ce47f6640 1 --2- 172.21.15.63:0/3243672556 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f3cc40b66b0 0x7f3cc40b8bc0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:35.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:35.094+0000 7f3ce47f6640 1 --2- 172.21.15.63:0/3243672556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cdc103bb0 0x7f3cdc19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:35.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:35.094+0000 7f3ce47f6640 1 -- 172.21.15.63:0/3243672556 >> 172.21.15.63:0/3243672556 conn(0x7f3cdc0ff600 msgr2=0x7f3cdc101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:35.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:35.094+0000 7f3ce47f6640 1 -- 172.21.15.63:0/3243672556 shutdown_connections 2024-09-21T06:39:35.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:35.094+0000 7f3ce47f6640 1 -- 172.21.15.63:0/3243672556 wait complete. 2024-09-21T06:39:35.985 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:39:36.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:35 smithi063 ceph-mon[31150]: pgmap v674: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T06:39:36.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:35 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3243672556' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:39:36.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:35 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:39:36.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:35 smithi175 ceph-mon[34510]: pgmap v674: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T06:39:36.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:35 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3243672556' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:39:36.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:35 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:39:36.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:35 smithi071 ceph-mon[34844]: pgmap v674: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T06:39:36.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:35 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3243672556' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:39:36.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:35 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:39:36.275 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:36.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.740+0000 7f33520c3640 1 -- 172.21.15.63:0/3183223916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334c109df0 msgr2=0x7f334c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:36.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.740+0000 7f33520c3640 1 --2- 172.21.15.63:0/3183223916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334c109df0 0x7f334c110620 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f3344009ca0 tx=0x7f334402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.740+0000 7f33520c3640 1 -- 172.21.15.63:0/3183223916 shutdown_connections 2024-09-21T06:39:36.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.740+0000 7f33520c3640 1 --2- 172.21.15.63:0/3183223916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334c109df0 0x7f334c110620 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.740+0000 7f33520c3640 1 --2- 172.21.15.63:0/3183223916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f334c1094a0 0x7f334c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.740+0000 7f33520c3640 1 --2- 172.21.15.63:0/3183223916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f334c103b60 0x7f334c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.740+0000 7f33520c3640 1 -- 172.21.15.63:0/3183223916 >> 172.21.15.63:0/3183223916 conn(0x7f334c07b850 msgr2=0x7f334c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:36.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.740+0000 7f33520c3640 1 -- 172.21.15.63:0/3183223916 shutdown_connections 2024-09-21T06:39:36.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.740+0000 7f33520c3640 1 -- 172.21.15.63:0/3183223916 wait complete. 2024-09-21T06:39:36.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.741+0000 7f33520c3640 1 Processor -- start 2024-09-21T06:39:36.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.741+0000 7f33520c3640 1 -- start start 2024-09-21T06:39:36.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.741+0000 7f33520c3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f334c103b60 0x7f334c19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.741+0000 7f33520c3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334c1094a0 0x7f334c19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.741+0000 7f33520c3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f334c109df0 0x7f334c19fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.741+0000 7f33520c3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f334c113ab0 con 0x7f334c1094a0 2024-09-21T06:39:36.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.741+0000 7f33520c3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f334c113930 con 0x7f334c109df0 2024-09-21T06:39:36.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.741+0000 7f33520c3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f334c113c30 con 0x7f334c103b60 2024-09-21T06:39:36.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.742+0000 7f334affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334c1094a0 0x7f334c19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.742+0000 7f334b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f334c103b60 0x7f334c19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.742+0000 7f334b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f334c103b60 0x7f334c19a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.63:39642/0 (socket says 172.21.15.63:39642) 2024-09-21T06:39:36.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.742+0000 7f334affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334c1094a0 0x7f334c19a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44716/0 (socket says 172.21.15.63:44716) 2024-09-21T06:39:36.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.742+0000 7f334b7fe640 1 -- 172.21.15.63:0/861783949 learned_addr learned my addr 172.21.15.63:0/861783949 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:36.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.742+0000 7f334bfff640 1 --2- 172.21.15.63:0/861783949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f334c109df0 0x7f334c19fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.742+0000 7f334affd640 1 -- 172.21.15.63:0/861783949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f334c103b60 msgr2=0x7f334c19a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:36.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.742+0000 7f334affd640 1 --2- 172.21.15.63:0/861783949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f334c103b60 0x7f334c19a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.742+0000 7f334affd640 1 -- 172.21.15.63:0/861783949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f334c109df0 msgr2=0x7f334c19fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:36.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.742+0000 7f334affd640 1 --2- 172.21.15.63:0/861783949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f334c109df0 0x7f334c19fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.742+0000 7f334affd640 1 -- 172.21.15.63:0/861783949 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334c1a03b0 con 0x7f334c1094a0 2024-09-21T06:39:36.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.742+0000 7f334b7fe640 1 --2- 172.21.15.63:0/861783949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f334c103b60 0x7f334c19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:36.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.742+0000 7f334bfff640 1 --2- 172.21.15.63:0/861783949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f334c109df0 0x7f334c19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:36.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.742+0000 7f334affd640 1 --2- 172.21.15.63:0/861783949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334c1094a0 0x7f334c19a9e0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f3340005fd0 tx=0x7f334000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:36.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.742+0000 7f3348ff9640 1 -- 172.21.15.63:0/861783949 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3340009c00 con 0x7f334c1094a0 2024-09-21T06:39:36.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.742+0000 7f33520c3640 1 -- 172.21.15.63:0/861783949 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f334c1a06a0 con 0x7f334c1094a0 2024-09-21T06:39:36.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.742+0000 7f3348ff9640 1 -- 172.21.15.63:0/861783949 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3340009da0 con 0x7f334c1094a0 2024-09-21T06:39:36.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.742+0000 7f3348ff9640 1 -- 172.21.15.63:0/861783949 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3340003db0 con 0x7f334c1094a0 2024-09-21T06:39:36.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.742+0000 7f33520c3640 1 -- 172.21.15.63:0/861783949 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f334c1a6e00 con 0x7f334c1094a0 2024-09-21T06:39:36.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.743+0000 7f33520c3640 1 -- 172.21.15.63:0/861783949 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f334c103f70 con 0x7f334c1094a0 2024-09-21T06:39:36.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.745+0000 7f3348ff9640 1 -- 172.21.15.63:0/861783949 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f3340003f50 con 0x7f334c1094a0 2024-09-21T06:39:36.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.746+0000 7f3348ff9640 1 --2- 172.21.15.63:0/861783949 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f33340b6680 0x7f33340b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.746+0000 7f334b7fe640 1 --2- 172.21.15.63:0/861783949 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f33340b6680 0x7f33340b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.746+0000 7f3348ff9640 1 -- 172.21.15.63:0/861783949 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8593+0+0 (secure 0 0 0) 0x7f33400e7150 con 0x7f334c1094a0 2024-09-21T06:39:36.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.746+0000 7f334b7fe640 1 --2- 172.21.15.63:0/861783949 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f33340b6680 0x7f33340b8b90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f333c011550 tx=0x7f333c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:36.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.749+0000 7f3348ff9640 1 -- 172.21.15.63:0/861783949 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3340017020 con 0x7f334c1094a0 2024-09-21T06:39:36.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.938+0000 7f33520c3640 1 -- 172.21.15.63:0/861783949 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f334c19b570 con 0x7f334c1094a0 2024-09-21T06:39:36.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.939+0000 7f3348ff9640 1 -- 172.21.15.63:0/861783949 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+23269 (secure 0 0 0) 0x7f334c19b570 con 0x7f334c1094a0 2024-09-21T06:39:36.941 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:39:36.942 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":88,"fsid":"140899c8-77e1-11ef-baf5-efdc52797490","created":"2024-09-21T06:17:48.089366+0000","modified":"2024-09-21T06:39:18.947234+0000","last_up_change":"2024-09-21T06:25:29.072128+0000","last_in_change":"2024-09-21T06:25:06.097647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:21:36.236868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:26:15.016085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:26:17.072883+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":87,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df4162c1-dd66-4d11-99bc-0ae36ea130f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6803","nonce":2090653772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6805","nonce":2090653772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6809","nonce":2090653772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2090653772},{"type":"v1","addr":"172.21.15.63:6807","nonce":2090653772}]},"public_addr":"172.21.15.63:6803/2090653772","cluster_addr":"172.21.15.63:6805/2090653772","heartbeat_back_addr":"172.21.15.63:6809/2090653772","heartbeat_front_addr":"172.21.15.63:6807/2090653772","state":["exists","up"]},{"osd":1,"uuid":"65a12def-9f66-4153-8f1a-2ebfbbfeba99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6801","nonce":1676297548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6803","nonce":1676297548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6807","nonce":1676297548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1676297548},{"type":"v1","addr":"172.21.15.71:6805","nonce":1676297548}]},"public_addr":"172.21.15.71:6801/1676297548","cluster_addr":"172.21.15.71:6803/1676297548","heartbeat_back_addr":"172.21.15.71:6807/1676297548","heartbeat_front_addr":"172.21.15.71:6805/1676297548","state":["exists","up"]},{"osd":2,"uuid":"031daa9e-9d4a-4901-95e8-695db5671fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6801","nonce":2356865390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6803","nonce":2356865390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6807","nonce":2356865390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2356865390},{"type":"v1","addr":"172.21.15.175:6805","nonce":2356865390}]},"public_addr":"172.21.15.175:6801/2356865390","cluster_addr":"172.21.15.175:6803/2356865390","heartbeat_back_addr":"172.21.15.175:6807/2356865390","heartbeat_front_addr":"172.21.15.175:6805/2356865390","state":["exists","up"]},{"osd":3,"uuid":"75d23a7a-c560-4b26-84a4-74d6772a37ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6811","nonce":31683339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6813","nonce":31683339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6817","nonce":31683339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":31683339},{"type":"v1","addr":"172.21.15.63:6815","nonce":31683339}]},"public_addr":"172.21.15.63:6811/31683339","cluster_addr":"172.21.15.63:6813/31683339","heartbeat_back_addr":"172.21.15.63:6817/31683339","heartbeat_front_addr":"172.21.15.63:6815/31683339","state":["exists","up"]},{"osd":4,"uuid":"6aaefd09-93dd-4f21-9b3c-701a7ff97f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6809","nonce":829449898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6811","nonce":829449898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6815","nonce":829449898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":829449898},{"type":"v1","addr":"172.21.15.71:6813","nonce":829449898}]},"public_addr":"172.21.15.71:6809/829449898","cluster_addr":"172.21.15.71:6811/829449898","heartbeat_back_addr":"172.21.15.71:6815/829449898","heartbeat_front_addr":"172.21.15.71:6813/829449898","state":["exists","up"]},{"osd":5,"uuid":"91f28121-c94e-4012-b74c-dd4597545e3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6809","nonce":3005600597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6811","nonce":3005600597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6815","nonce":3005600597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3005600597},{"type":"v1","addr":"172.21.15.175:6813","nonce":3005600597}]},"public_addr":"172.21.15.175:6809/3005600597","cluster_addr":"172.21.15.175:6811/3005600597","heartbeat_back_addr":"172.21.15.175:6815/3005600597","heartbeat_front_addr":"172.21.15.175:6813/3005600597","state":["exists","up"]},{"osd":6,"uuid":"bda28014-4dca-40f1-bb23-3ef61605c1ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6819","nonce":4044730408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6821","nonce":4044730408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6825","nonce":4044730408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4044730408},{"type":"v1","addr":"172.21.15.63:6823","nonce":4044730408}]},"public_addr":"172.21.15.63:6819/4044730408","cluster_addr":"172.21.15.63:6821/4044730408","heartbeat_back_addr":"172.21.15.63:6825/4044730408","heartbeat_front_addr":"172.21.15.63:6823/4044730408","state":["exists","up"]},{"osd":7,"uuid":"a9026588-ccdc-4e6c-b628-1ac8a7dbfa64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6817","nonce":2913027708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6819","nonce":2913027708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6823","nonce":2913027708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2913027708},{"type":"v1","addr":"172.21.15.71:6821","nonce":2913027708}]},"public_addr":"172.21.15.71:6817/2913027708","cluster_addr":"172.21.15.71:6819/2913027708","heartbeat_back_addr":"172.21.15.71:6823/2913027708","heartbeat_front_addr":"172.21.15.71:6821/2913027708","state":["exists","up"]},{"osd":8,"uuid":"2e1dacea-483c-4587-8d19-5c77a7b98667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6817","nonce":2058692148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6819","nonce":2058692148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6823","nonce":2058692148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2058692148},{"type":"v1","addr":"172.21.15.175:6821","nonce":2058692148}]},"public_addr":"172.21.15.175:6817/2058692148","cluster_addr":"172.21.15.175:6819/2058692148","heartbeat_back_addr":"172.21.15.175:6823/2058692148","heartbeat_front_addr":"172.21.15.175:6821/2058692148","state":["exists","up"]},{"osd":9,"uuid":"7077ba4d-1fce-4197-a556-8b6a859c6f82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6827","nonce":3278012285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6829","nonce":3278012285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6833","nonce":3278012285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3278012285},{"type":"v1","addr":"172.21.15.63:6831","nonce":3278012285}]},"public_addr":"172.21.15.63:6827/3278012285","cluster_addr":"172.21.15.63:6829/3278012285","heartbeat_back_addr":"172.21.15.63:6833/3278012285","heartbeat_front_addr":"172.21.15.63:6831/3278012285","state":["exists","up"]},{"osd":10,"uuid":"99965496-91ee-4eef-9f2e-8f9c8dc54f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6825","nonce":3297929438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6827","nonce":3297929438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6831","nonce":3297929438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3297929438},{"type":"v1","addr":"172.21.15.71:6829","nonce":3297929438}]},"public_addr":"172.21.15.71:6825/3297929438","cluster_addr":"172.21.15.71:6827/3297929438","heartbeat_back_addr":"172.21.15.71:6831/3297929438","heartbeat_front_addr":"172.21.15.71:6829/3297929438","state":["exists","up"]},{"osd":11,"uuid":"1b26d1a8-91a4-4877-ad1c-18160a1b3b6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6825","nonce":1970094291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6827","nonce":1970094291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6831","nonce":1970094291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1970094291},{"type":"v1","addr":"172.21.15.175:6829","nonce":1970094291}]},"public_addr":"172.21.15.175:6825/1970094291","cluster_addr":"172.21.15.175:6827/1970094291","heartbeat_back_addr":"172.21.15.175:6831/1970094291","heartbeat_front_addr":"172.21.15.175:6829/1970094291","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:20:43.732676+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:08.957775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:21:34.157788+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:00.134410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:25.502998+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:22:51.739501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:18.325642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:23:44.430626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:10.776017+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:24:36.482831+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:01.898216+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:25:27.644941+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:6839/3472481253":"2024-09-22T06:30:16.107900+0000","172.21.15.71:6838/3472481253":"2024-09-22T06:30:16.107900+0000","172.21.15.63:0/1652196301":"2024-09-22T06:19:37.776447+0000","172.21.15.63:6801/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/2740830999":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6801/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6801/63967018":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/2958589237":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/1398493582":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/3529491525":"2024-09-22T06:18:10.293119+0000","172.21.15.63:0/363262068":"2024-09-22T06:18:10.293119+0000","172.21.15.63:6800/152956176":"2024-09-22T06:18:36.864948+0000","172.21.15.63:6800/1479125434":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/3928056461":"2024-09-22T06:18:36.864948+0000","172.21.15.63:0/128321401":"2024-09-22T06:19:37.776447+0000","172.21.15.63:0/39222803":"2024-09-22T06:19:37.776447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:39:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.942+0000 7f33520c3640 1 -- 172.21.15.63:0/861783949 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f33340b6680 msgr2=0x7f33340b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.942+0000 7f33520c3640 1 --2- 172.21.15.63:0/861783949 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f33340b6680 0x7f33340b8b90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f333c011550 tx=0x7f333c005f90 comp rx=0 tx=0).stop 2024-09-21T06:39:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.942+0000 7f33520c3640 1 -- 172.21.15.63:0/861783949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334c1094a0 msgr2=0x7f334c19a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.942+0000 7f33520c3640 1 --2- 172.21.15.63:0/861783949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334c1094a0 0x7f334c19a9e0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f3340005fd0 tx=0x7f334000dde0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.942+0000 7f33520c3640 1 -- 172.21.15.63:0/861783949 shutdown_connections 2024-09-21T06:39:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.942+0000 7f33520c3640 1 --2- 172.21.15.63:0/861783949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f334c109df0 0x7f334c19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.942+0000 7f33520c3640 1 --2- 172.21.15.63:0/861783949 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334c1094a0 0x7f334c19a9e0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.942+0000 7f33520c3640 1 --2- 172.21.15.63:0/861783949 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f33340b6680 0x7f33340b8b90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.942+0000 7f33520c3640 1 --2- 172.21.15.63:0/861783949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f334c103b60 0x7f334c19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.942+0000 7f33520c3640 1 -- 172.21.15.63:0/861783949 >> 172.21.15.63:0/861783949 conn(0x7f334c07b850 msgr2=0x7f334c105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.942+0000 7f33520c3640 1 -- 172.21.15.63:0/861783949 shutdown_connections 2024-09-21T06:39:36.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:36.942+0000 7f33520c3640 1 -- 172.21.15.63:0/861783949 wait complete. 2024-09-21T06:39:37.268 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.269 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.270 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:37 smithi071 ceph-mon[34844]: pgmap v675: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-21T06:39:37.270 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:39:37.270 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:39:37.270 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:37 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.270 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:37 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/861783949' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:39:37.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.332 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:37 smithi063 ceph-mon[31150]: pgmap v675: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-21T06:39:37.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:39:37.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:39:37.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:37 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:37 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/861783949' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:39:37.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.350 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:37 smithi175 ceph-mon[34510]: pgmap v675: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-21T06:39:37.351 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:39:37.351 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:39:37.351 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:37 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' 2024-09-21T06:39:37.351 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:37 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/861783949' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:39:37.689 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T06:39:37.948 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:38.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.436+0000 7fbb64188640 1 -- 172.21.15.63:0/1448419409 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb5c109df0 msgr2=0x7fbb5c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:38.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.436+0000 7fbb64188640 1 --2- 172.21.15.63:0/1448419409 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb5c109df0 0x7fbb5c110620 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009ca0 tx=0x7fbb5402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:39:38.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.436+0000 7fbb64188640 1 -- 172.21.15.63:0/1448419409 shutdown_connections 2024-09-21T06:39:38.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.436+0000 7fbb64188640 1 --2- 172.21.15.63:0/1448419409 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb5c109df0 0x7fbb5c110620 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:38.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.436+0000 7fbb64188640 1 --2- 172.21.15.63:0/1448419409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb5c1094a0 0x7fbb5c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:38.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.436+0000 7fbb64188640 1 --2- 172.21.15.63:0/1448419409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb5c103b60 0x7fbb5c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:38.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.436+0000 7fbb64188640 1 -- 172.21.15.63:0/1448419409 >> 172.21.15.63:0/1448419409 conn(0x7fbb5c07b850 msgr2=0x7fbb5c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:38.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.436+0000 7fbb64188640 1 -- 172.21.15.63:0/1448419409 shutdown_connections 2024-09-21T06:39:38.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.436+0000 7fbb64188640 1 -- 172.21.15.63:0/1448419409 wait complete. 2024-09-21T06:39:38.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.436+0000 7fbb64188640 1 Processor -- start 2024-09-21T06:39:38.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.437+0000 7fbb64188640 1 -- start start 2024-09-21T06:39:38.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.437+0000 7fbb64188640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb5c103b60 0x7fbb5c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:38.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.437+0000 7fbb64188640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb5c1094a0 0x7fbb5c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:38.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.437+0000 7fbb64188640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb5c109df0 0x7fbb5c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:38.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.437+0000 7fbb64188640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c113ab0 con 0x7fbb5c1094a0 2024-09-21T06:39:38.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.437+0000 7fbb64188640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c113930 con 0x7fbb5c103b60 2024-09-21T06:39:38.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.437+0000 7fbb64188640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c113c30 con 0x7fbb5c109df0 2024-09-21T06:39:38.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.437+0000 7fbb61723640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb5c1094a0 0x7fbb5c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:38.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.437+0000 7fbb61723640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb5c1094a0 0x7fbb5c075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44730/0 (socket says 172.21.15.63:44730) 2024-09-21T06:39:38.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.437+0000 7fbb61723640 1 -- 172.21.15.63:0/3125403230 learned_addr learned my addr 172.21.15.63:0/3125403230 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:38.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.437+0000 7fbb61f24640 1 --2- 172.21.15.63:0/3125403230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb5c103b60 0x7fbb5c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:38.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.437+0000 7fbb62725640 1 --2- 172.21.15.63:0/3125403230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb5c109df0 0x7fbb5c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:38.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.437+0000 7fbb61723640 1 -- 172.21.15.63:0/3125403230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb5c109df0 msgr2=0x7fbb5c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:38.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.437+0000 7fbb61723640 1 --2- 172.21.15.63:0/3125403230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb5c109df0 0x7fbb5c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:38.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.437+0000 7fbb61723640 1 -- 172.21.15.63:0/3125403230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb5c103b60 msgr2=0x7fbb5c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:38.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.437+0000 7fbb61723640 1 --2- 172.21.15.63:0/3125403230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb5c103b60 0x7fbb5c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:38.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.437+0000 7fbb61723640 1 -- 172.21.15.63:0/3125403230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5c1a86e0 con 0x7fbb5c1094a0 2024-09-21T06:39:38.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.438+0000 7fbb61723640 1 --2- 172.21.15.63:0/3125403230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb5c1094a0 0x7fbb5c075c50 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00d740 tx=0x7fbb4c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:38.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.438+0000 7fbb52ffd640 1 -- 172.21.15.63:0/3125403230 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c017070 con 0x7fbb5c1094a0 2024-09-21T06:39:38.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.438+0000 7fbb52ffd640 1 -- 172.21.15.63:0/3125403230 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb4c00de50 con 0x7fbb5c1094a0 2024-09-21T06:39:38.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.438+0000 7fbb52ffd640 1 -- 172.21.15.63:0/3125403230 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c00f620 con 0x7fbb5c1094a0 2024-09-21T06:39:38.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.438+0000 7fbb64188640 1 -- 172.21.15.63:0/3125403230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb5c1a89d0 con 0x7fbb5c1094a0 2024-09-21T06:39:38.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.438+0000 7fbb64188640 1 -- 172.21.15.63:0/3125403230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb5c1a8ec0 con 0x7fbb5c1094a0 2024-09-21T06:39:38.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.439+0000 7fbb64188640 1 -- 172.21.15.63:0/3125403230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb5c103f70 con 0x7fbb5c1094a0 2024-09-21T06:39:38.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.441+0000 7fbb52ffd640 1 -- 172.21.15.63:0/3125403230 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fbb4c01a070 con 0x7fbb5c1094a0 2024-09-21T06:39:38.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.441+0000 7fbb52ffd640 1 --2- 172.21.15.63:0/3125403230 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbb480b6700 0x7fbb480b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:38.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.441+0000 7fbb61f24640 1 --2- 172.21.15.63:0/3125403230 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbb480b6700 0x7fbb480b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:38.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.441+0000 7fbb52ffd640 1 -- 172.21.15.63:0/3125403230 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8593+0+0 (secure 0 0 0) 0x7fbb4c0e7050 con 0x7fbb5c1094a0 2024-09-21T06:39:38.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.442+0000 7fbb61f24640 1 --2- 172.21.15.63:0/3125403230 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbb480b6700 0x7fbb480b8c10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c077160 tx=0x7fbb58005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:38.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.445+0000 7fbb52ffd640 1 -- 172.21.15.63:0/3125403230 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbb4c0b19b0 con 0x7fbb5c1094a0 2024-09-21T06:39:38.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.671+0000 7fbb64188640 1 -- 172.21.15.63:0/3125403230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fbb5c02e640 con 0x7fbb5c1094a0 2024-09-21T06:39:38.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.674+0000 7fbb52ffd640 1 -- 172.21.15.63:0/3125403230 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v62) ==== 161+0+0 (secure 0 0 0) 0x7fbb4c0b68f0 con 0x7fbb5c1094a0 2024-09-21T06:39:38.675 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:39:38.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.677+0000 7fbb64188640 1 -- 172.21.15.63:0/3125403230 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbb480b6700 msgr2=0x7fbb480b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:38.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.677+0000 7fbb64188640 1 --2- 172.21.15.63:0/3125403230 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbb480b6700 0x7fbb480b8c10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c077160 tx=0x7fbb58005f90 comp rx=0 tx=0).stop 2024-09-21T06:39:38.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.677+0000 7fbb64188640 1 -- 172.21.15.63:0/3125403230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb5c1094a0 msgr2=0x7fbb5c075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:38.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.677+0000 7fbb64188640 1 --2- 172.21.15.63:0/3125403230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb5c1094a0 0x7fbb5c075c50 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00d740 tx=0x7fbb4c00dc00 comp rx=0 tx=0).stop 2024-09-21T06:39:38.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.678+0000 7fbb64188640 1 -- 172.21.15.63:0/3125403230 shutdown_connections 2024-09-21T06:39:38.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.678+0000 7fbb64188640 1 --2- 172.21.15.63:0/3125403230 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fbb480b6700 0x7fbb480b8c10 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:38.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.678+0000 7fbb64188640 1 --2- 172.21.15.63:0/3125403230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb5c109df0 0x7fbb5c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:38.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.678+0000 7fbb64188640 1 --2- 172.21.15.63:0/3125403230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb5c1094a0 0x7fbb5c075c50 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:38.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.678+0000 7fbb64188640 1 --2- 172.21.15.63:0/3125403230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb5c103b60 0x7fbb5c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:38.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.678+0000 7fbb64188640 1 -- 172.21.15.63:0/3125403230 >> 172.21.15.63:0/3125403230 conn(0x7fbb5c07b850 msgr2=0x7fbb5c105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:38.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.678+0000 7fbb64188640 1 -- 172.21.15.63:0/3125403230 shutdown_connections 2024-09-21T06:39:38.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:38.678+0000 7fbb64188640 1 -- 172.21.15.63:0/3125403230 wait complete. 2024-09-21T06:39:38.999 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 21 06:39:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-g[72896]: ignoring --setuser ceph since I am not root 2024-09-21T06:39:38.999 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 21 06:39:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-g[72896]: ignoring --setgroup ceph since I am not root 2024-09-21T06:39:38.999 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 21 06:39:38 smithi063 ceph-mds[72905]: -- 172.21.15.63:0/2374123938 <== mon.0 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a4ef4ab860 con 0x55a4f3653600 2024-09-21T06:39:38.999 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 21 06:39:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-g[72896]: starting mds.g at 2024-09-21T06:39:38.999 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-a[31146]: 2024-09-21T06:39:38.672+0000 7f97f16ac640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:39:39.000 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 21 06:39:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-a[73284]: ignoring --setuser ceph since I am not root 2024-09-21T06:39:39.000 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 21 06:39:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-a[73284]: ignoring --setgroup ceph since I am not root 2024-09-21T06:39:39.000 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 21 06:39:38 smithi063 ceph-mds[73288]: -- 172.21.15.63:0/3692550573 <== mon.0 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556ad4fddc20 con 0x556ad9185a80 2024-09-21T06:39:39.000 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 21 06:39:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-a[73284]: starting mds.a at 2024-09-21T06:39:39.018 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 21 06:39:38 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-k[63150]: ignoring --setuser ceph since I am not root 2024-09-21T06:39:39.018 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 21 06:39:38 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-k[63150]: ignoring --setgroup ceph since I am not root 2024-09-21T06:39:39.018 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 21 06:39:38 smithi071 ceph-mds[63154]: -- 172.21.15.71:0/2943977406 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e449c7b860 con 0x55e44de23600 2024-09-21T06:39:39.018 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 21 06:39:38 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-k[63150]: starting mds.k at 2024-09-21T06:39:39.019 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 21 06:39:38 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-e[63430]: ignoring --setuser ceph since I am not root 2024-09-21T06:39:39.019 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 21 06:39:38 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-e[63430]: ignoring --setgroup ceph since I am not root 2024-09-21T06:39:39.019 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 21 06:39:38 smithi071 ceph-mds[63434]: -- 172.21.15.71:0/3443743818 <== mon.2 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56256f6cfc20 con 0x562573877600 2024-09-21T06:39:39.019 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 21 06:39:38 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-e[63430]: starting mds.e at 2024-09-21T06:39:39.019 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:39:38 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[65774]: ignoring --setuser ceph since I am not root 2024-09-21T06:39:39.019 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:39:38 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[65774]: ignoring --setgroup ceph since I am not root 2024-09-21T06:39:39.019 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:39:38 smithi071 ceph-mds[65778]: -- 172.21.15.71:0/2310419867 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5593f7799c20 con 0x5593fb941600 2024-09-21T06:39:39.019 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:39:38 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[65774]: starting mds.b at 2024-09-21T06:39:39.020 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 21 06:39:38 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-h[63701]: ignoring --setuser ceph since I am not root 2024-09-21T06:39:39.020 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 21 06:39:38 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-h[63701]: ignoring --setgroup ceph since I am not root 2024-09-21T06:39:39.020 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 21 06:39:38 smithi071 ceph-mds[63705]: -- 172.21.15.71:0/2984403300 <== mon.0 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5637b032b860 con 0x5637b44d3180 2024-09-21T06:39:39.020 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 21 06:39:38 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-h[63701]: starting mds.h at 2024-09-21T06:39:39.099 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 06:39:38 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-c[63536]: ignoring --setuser ceph since I am not root 2024-09-21T06:39:39.099 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 06:39:38 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-c[63536]: ignoring --setgroup ceph since I am not root 2024-09-21T06:39:39.099 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 06:39:38 smithi175 ceph-mds[63540]: -- 172.21.15.175:0/2860568348 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558cad703c20 con 0x558cb18ab600 2024-09-21T06:39:39.099 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 06:39:38 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-c[63536]: starting mds.c at 2024-09-21T06:39:39.100 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 06:39:38 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-f[63268]: ignoring --setuser ceph since I am not root 2024-09-21T06:39:39.100 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 06:39:38 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-f[63268]: ignoring --setgroup ceph since I am not root 2024-09-21T06:39:39.100 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 06:39:38 smithi175 ceph-mds[63272]: -- 172.21.15.175:0/3333858561 <== mon.2 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559eb2c9f860 con 0x559eb6e47a80 2024-09-21T06:39:39.100 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 06:39:38 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-f[63268]: starting mds.f at 2024-09-21T06:39:39.100 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 06:39:38 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-i[63803]: ignoring --setuser ceph since I am not root 2024-09-21T06:39:39.100 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 06:39:38 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-i[63803]: ignoring --setgroup ceph since I am not root 2024-09-21T06:39:39.101 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 06:39:38 smithi175 ceph-mds[63807]: -- 172.21.15.175:0/3659699749 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556f19d35860 con 0x556f1dedd600 2024-09-21T06:39:39.101 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 06:39:38 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-i[63803]: starting mds.i at 2024-09-21T06:39:39.101 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 06:39:38 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-l[62986]: ignoring --setuser ceph since I am not root 2024-09-21T06:39:39.101 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 06:39:38 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-l[62986]: ignoring --setgroup ceph since I am not root 2024-09-21T06:39:39.101 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 06:39:38 smithi175 ceph-mds[62990]: -- 172.21.15.175:0/2793416681 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560d40c0bc20 con 0x560d44db3600 2024-09-21T06:39:39.101 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 06:39:38 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-l[62986]: starting mds.l at 2024-09-21T06:39:39.308 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:39 smithi063 ceph-mon[31150]: pgmap v676: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T06:39:39.308 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:39 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3125403230' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:39:39.308 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:39 smithi063 ceph-mon[31150]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:39:39.308 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:39 smithi063 ceph-mon[31150]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:39:39.308 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:39 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3125403230' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:39:39.308 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:39 smithi063 ceph-mon[31150]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T06:39:39.308 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:39 smithi063 ceph-mon[31150]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T06:39:39.337 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:39:39.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:39 smithi071 ceph-mon[34844]: pgmap v676: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T06:39:39.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:39 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3125403230' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:39:39.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:39 smithi071 ceph-mon[34844]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:39:39.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:39 smithi071 ceph-mon[34844]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:39:39.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:39 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3125403230' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:39:39.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:39 smithi071 ceph-mon[34844]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T06:39:39.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:39 smithi071 ceph-mon[34844]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T06:39:39.597 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:39.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:39 smithi175 ceph-mon[34510]: pgmap v676: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T06:39:39.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:39 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3125403230' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:39:39.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:39 smithi175 ceph-mon[34510]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:39:39.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:39 smithi175 ceph-mon[34510]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:39:39.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:39 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3125403230' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:39:39.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:39 smithi175 ceph-mon[34510]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T06:39:39.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:39 smithi175 ceph-mon[34510]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T06:39:40.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.062+0000 7fc01ea5d640 1 -- 172.21.15.63:0/3162307676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc018103b90 msgr2=0x7fc018103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:40.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.062+0000 7fc01ea5d640 1 --2- 172.21.15.63:0/3162307676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc018103b90 0x7fc018103fa0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fc008009900 tx=0x7fc00802a410 comp rx=0 tx=0).stop 2024-09-21T06:39:40.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.062+0000 7fc01ea5d640 1 -- 172.21.15.63:0/3162307676 shutdown_connections 2024-09-21T06:39:40.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.062+0000 7fc01ea5d640 1 --2- 172.21.15.63:0/3162307676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc018109e20 0x7fc018110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:40.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.062+0000 7fc01ea5d640 1 --2- 172.21.15.63:0/3162307676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0181094d0 0x7fc0181098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:40.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.062+0000 7fc01ea5d640 1 --2- 172.21.15.63:0/3162307676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc018103b90 0x7fc018103fa0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:40.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.062+0000 7fc01ea5d640 1 -- 172.21.15.63:0/3162307676 >> 172.21.15.63:0/3162307676 conn(0x7fc0180ff600 msgr2=0x7fc018101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:40.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.062+0000 7fc01ea5d640 1 -- 172.21.15.63:0/3162307676 shutdown_connections 2024-09-21T06:39:40.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.062+0000 7fc01ea5d640 1 -- 172.21.15.63:0/3162307676 wait complete. 2024-09-21T06:39:40.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.063+0000 7fc01ea5d640 1 Processor -- start 2024-09-21T06:39:40.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.063+0000 7fc01ea5d640 1 -- start start 2024-09-21T06:39:40.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.063+0000 7fc01ea5d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc018103b90 0x7fc01819c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:40.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.063+0000 7fc01ea5d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0181094d0 0x7fc01819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:40.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.063+0000 7fc01ea5d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc018109e20 0x7fc0181a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:40.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.063+0000 7fc01ea5d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc018113ae0 con 0x7fc018103b90 2024-09-21T06:39:40.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.063+0000 7fc01ea5d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc018113960 con 0x7fc0181094d0 2024-09-21T06:39:40.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.063+0000 7fc01ea5d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc018113c60 con 0x7fc018109e20 2024-09-21T06:39:40.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.064+0000 7fc017fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc018103b90 0x7fc01819c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:40.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.064+0000 7fc017fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc018103b90 0x7fc01819c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44806/0 (socket says 172.21.15.63:44806) 2024-09-21T06:39:40.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.064+0000 7fc017fff640 1 -- 172.21.15.63:0/2441669102 learned_addr learned my addr 172.21.15.63:0/2441669102 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:40.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.064+0000 7fc00ffff640 1 --2- 172.21.15.63:0/2441669102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0181094d0 0x7fc01819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:40.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.064+0000 7fc01cffa640 1 --2- 172.21.15.63:0/2441669102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc018109e20 0x7fc0181a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:40.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.064+0000 7fc017fff640 1 -- 172.21.15.63:0/2441669102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc018109e20 msgr2=0x7fc0181a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:40.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.064+0000 7fc017fff640 1 --2- 172.21.15.63:0/2441669102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc018109e20 0x7fc0181a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:40.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.064+0000 7fc017fff640 1 -- 172.21.15.63:0/2441669102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0181094d0 msgr2=0x7fc01819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:40.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.064+0000 7fc017fff640 1 --2- 172.21.15.63:0/2441669102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0181094d0 0x7fc01819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:40.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.064+0000 7fc017fff640 1 -- 172.21.15.63:0/2441669102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0181a2640 con 0x7fc018103b90 2024-09-21T06:39:40.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.064+0000 7fc01cffa640 1 --2- 172.21.15.63:0/2441669102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc018109e20 0x7fc0181a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:40.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.064+0000 7fc00ffff640 1 --2- 172.21.15.63:0/2441669102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0181094d0 0x7fc01819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:40.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.064+0000 7fc017fff640 1 --2- 172.21.15.63:0/2441669102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc018103b90 0x7fc01819c6d0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fc008005940 tx=0x7fc0080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:40.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.064+0000 7fc015ffb640 1 -- 172.21.15.63:0/2441669102 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00803f030 con 0x7fc018103b90 2024-09-21T06:39:40.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.064+0000 7fc015ffb640 1 -- 172.21.15.63:0/2441669102 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc008003cb0 con 0x7fc018103b90 2024-09-21T06:39:40.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.064+0000 7fc015ffb640 1 -- 172.21.15.63:0/2441669102 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc008035070 con 0x7fc018103b90 2024-09-21T06:39:40.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.064+0000 7fc01ea5d640 1 -- 172.21.15.63:0/2441669102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0181a28d0 con 0x7fc018103b90 2024-09-21T06:39:40.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.065+0000 7fc01ea5d640 1 -- 172.21.15.63:0/2441669102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0181a9090 con 0x7fc018103b90 2024-09-21T06:39:40.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.066+0000 7fc01ea5d640 1 -- 172.21.15.63:0/2441669102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc018104e10 con 0x7fc018103b90 2024-09-21T06:39:40.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.067+0000 7fc015ffb640 1 -- 172.21.15.63:0/2441669102 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fc008042030 con 0x7fc018103b90 2024-09-21T06:39:40.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.068+0000 7fc015ffb640 1 --2- 172.21.15.63:0/2441669102 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc0040b6680 0x7fc0040b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:40.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.068+0000 7fc00ffff640 1 --2- 172.21.15.63:0/2441669102 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc0040b6680 0x7fc0040b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:40.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.068+0000 7fc015ffb640 1 -- 172.21.15.63:0/2441669102 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8979+0+0 (secure 0 0 0) 0x7fc0081084e0 con 0x7fc018103b90 2024-09-21T06:39:40.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.068+0000 7fc00ffff640 1 --2- 172.21.15.63:0/2441669102 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc0040b6680 0x7fc0040b8b90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc000005d00 tx=0x7fc000005c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:40.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.072+0000 7fc015ffb640 1 -- 172.21.15.63:0/2441669102 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc0080ce860 con 0x7fc018103b90 2024-09-21T06:39:40.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.300+0000 7fc01ea5d640 1 -- 172.21.15.63:0/2441669102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc0181a92c0 con 0x7fc018103b90 2024-09-21T06:39:40.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.681+0000 7fc015ffb640 1 -- 172.21.15.63:0/2441669102 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) ==== 104+0+0 (secure 0 0 0) 0x7fc0080d2c40 con 0x7fc018103b90 2024-09-21T06:39:40.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.684+0000 7fc01ea5d640 1 -- 172.21.15.63:0/2441669102 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc0040b6680 msgr2=0x7fc0040b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:40.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.684+0000 7fc01ea5d640 1 --2- 172.21.15.63:0/2441669102 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc0040b6680 0x7fc0040b8b90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc000005d00 tx=0x7fc000005c70 comp rx=0 tx=0).stop 2024-09-21T06:39:40.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.684+0000 7fc01ea5d640 1 -- 172.21.15.63:0/2441669102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc018103b90 msgr2=0x7fc01819c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:40.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.684+0000 7fc01ea5d640 1 --2- 172.21.15.63:0/2441669102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc018103b90 0x7fc01819c6d0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fc008005940 tx=0x7fc0080042f0 comp rx=0 tx=0).stop 2024-09-21T06:39:40.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.684+0000 7fc01ea5d640 1 -- 172.21.15.63:0/2441669102 shutdown_connections 2024-09-21T06:39:40.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.684+0000 7fc01ea5d640 1 --2- 172.21.15.63:0/2441669102 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7fc0040b6680 0x7fc0040b8b90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:40.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.684+0000 7fc01ea5d640 1 --2- 172.21.15.63:0/2441669102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc018109e20 0x7fc0181a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:40.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.684+0000 7fc01ea5d640 1 --2- 172.21.15.63:0/2441669102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0181094d0 0x7fc01819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:40.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.684+0000 7fc01ea5d640 1 --2- 172.21.15.63:0/2441669102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc018103b90 0x7fc01819c6d0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:40.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.684+0000 7fc01ea5d640 1 -- 172.21.15.63:0/2441669102 >> 172.21.15.63:0/2441669102 conn(0x7fc0180ff600 msgr2=0x7fc018108bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:40.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.684+0000 7fc01ea5d640 1 -- 172.21.15.63:0/2441669102 shutdown_connections 2024-09-21T06:39:40.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:40.684+0000 7fc01ea5d640 1 -- 172.21.15.63:0/2441669102 wait complete. 2024-09-21T06:39:41.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.63:6838/3799652893,v1:172.21.15.63:6840/3799652893] up:boot 2024-09-21T06:39:41.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.175:6832/4257919118,v1:172.21.15.175:6833/4257919118] up:boot 2024-09-21T06:39:41.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.63:6839/1979784324,v1:172.21.15.63:6841/1979784324] up:boot 2024-09-21T06:39:41.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.71:6832/3732856936,v1:172.21.15.71:6833/3732856936] up:boot 2024-09-21T06:39:41.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.71:6834/1911749867,v1:172.21.15.71:6835/1911749867] up:boot 2024-09-21T06:39:41.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.175:6834/2114493936,v1:172.21.15.175:6835/2114493936] up:boot 2024-09-21T06:39:41.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.175:6836/1960573901,v1:172.21.15.175:6837/1960573901] up:boot 2024-09-21T06:39:41.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.71:6836/1695662626,v1:172.21.15.71:6837/1695662626] up:boot 2024-09-21T06:39:41.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.71:6838/1754609326,v1:172.21.15.71:6839/1754609326] up:boot 2024-09-21T06:39:41.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: mds.? [v2:172.21.15.175:6838/1302320483,v1:172.21.15.175:6839/1302320483] up:boot 2024-09-21T06:39:41.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T06:39:41.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T06:39:41.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:39:41.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:39:41.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:39:41.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:39:41.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:39:41.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T06:39:41.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:39:41.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:39:41.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:39:41.020 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:40 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2441669102' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:39:41.050 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.63:6838/3799652893,v1:172.21.15.63:6840/3799652893] up:boot 2024-09-21T06:39:41.050 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.175:6832/4257919118,v1:172.21.15.175:6833/4257919118] up:boot 2024-09-21T06:39:41.050 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.63:6839/1979784324,v1:172.21.15.63:6841/1979784324] up:boot 2024-09-21T06:39:41.051 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.71:6832/3732856936,v1:172.21.15.71:6833/3732856936] up:boot 2024-09-21T06:39:41.051 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.71:6834/1911749867,v1:172.21.15.71:6835/1911749867] up:boot 2024-09-21T06:39:41.051 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.175:6834/2114493936,v1:172.21.15.175:6835/2114493936] up:boot 2024-09-21T06:39:41.051 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.175:6836/1960573901,v1:172.21.15.175:6837/1960573901] up:boot 2024-09-21T06:39:41.051 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.71:6836/1695662626,v1:172.21.15.71:6837/1695662626] up:boot 2024-09-21T06:39:41.051 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.71:6838/1754609326,v1:172.21.15.71:6839/1754609326] up:boot 2024-09-21T06:39:41.051 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: mds.? [v2:172.21.15.175:6838/1302320483,v1:172.21.15.175:6839/1302320483] up:boot 2024-09-21T06:39:41.051 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T06:39:41.051 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T06:39:41.051 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:39:41.051 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:39:41.051 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:39:41.051 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:39:41.052 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:39:41.052 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T06:39:41.052 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:39:41.052 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:39:41.052 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:39:41.052 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:40 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2441669102' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:39:41.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.63:6838/3799652893,v1:172.21.15.63:6840/3799652893] up:boot 2024-09-21T06:39:41.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.175:6832/4257919118,v1:172.21.15.175:6833/4257919118] up:boot 2024-09-21T06:39:41.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.63:6839/1979784324,v1:172.21.15.63:6841/1979784324] up:boot 2024-09-21T06:39:41.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.71:6832/3732856936,v1:172.21.15.71:6833/3732856936] up:boot 2024-09-21T06:39:41.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.71:6834/1911749867,v1:172.21.15.71:6835/1911749867] up:boot 2024-09-21T06:39:41.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.175:6834/2114493936,v1:172.21.15.175:6835/2114493936] up:boot 2024-09-21T06:39:41.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.175:6836/1960573901,v1:172.21.15.175:6837/1960573901] up:boot 2024-09-21T06:39:41.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.71:6836/1695662626,v1:172.21.15.71:6837/1695662626] up:boot 2024-09-21T06:39:41.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.71:6838/1754609326,v1:172.21.15.71:6839/1754609326] up:boot 2024-09-21T06:39:41.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: mds.? [v2:172.21.15.175:6838/1302320483,v1:172.21.15.175:6839/1302320483] up:boot 2024-09-21T06:39:41.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T06:39:41.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T06:39:41.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:39:41.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:39:41.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:39:41.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:39:41.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:39:41.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T06:39:41.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:39:41.100 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:39:41.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: from='mgr.14223 172.21.15.63:0/86502482' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:39:41.101 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:40 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2441669102' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:39:41.427 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:39:41.689 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:42.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:41 smithi071 ceph-mon[34844]: pgmap v678: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T06:39:42.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:41 smithi071 ceph-mon[34844]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:39:42.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:41 smithi071 ceph-mon[34844]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:39:42.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:41 smithi071 ceph-mon[34844]: Cluster is now healthy 2024-09-21T06:39:42.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:41 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/2441669102' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:39:42.019 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:41 smithi071 ceph-mon[34844]: fsmap 12 up:standby 2024-09-21T06:39:42.069 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:41 smithi063 ceph-mon[31150]: pgmap v678: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T06:39:42.069 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:41 smithi063 ceph-mon[31150]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:39:42.069 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:41 smithi063 ceph-mon[31150]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:39:42.069 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:41 smithi063 ceph-mon[31150]: Cluster is now healthy 2024-09-21T06:39:42.069 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:41 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/2441669102' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:39:42.069 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:41 smithi063 ceph-mon[31150]: fsmap 12 up:standby 2024-09-21T06:39:42.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:41 smithi175 ceph-mon[34510]: pgmap v678: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T06:39:42.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:41 smithi175 ceph-mon[34510]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:39:42.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:41 smithi175 ceph-mon[34510]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:39:42.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:41 smithi175 ceph-mon[34510]: Cluster is now healthy 2024-09-21T06:39:42.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:41 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/2441669102' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:39:42.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:41 smithi175 ceph-mon[34510]: fsmap 12 up:standby 2024-09-21T06:39:42.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.300+0000 7f6f4bfbc640 1 -- 172.21.15.63:0/3149263321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f44110200 msgr2=0x7f6f44112620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:42.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.300+0000 7f6f4bfbc640 1 --2- 172.21.15.63:0/3149263321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f44110200 0x7f6f44112620 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009ca0 tx=0x7f6f3c02a950 comp rx=0 tx=0).stop 2024-09-21T06:39:42.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.300+0000 7f6f4bfbc640 1 -- 172.21.15.63:0/3149263321 shutdown_connections 2024-09-21T06:39:42.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.300+0000 7f6f4bfbc640 1 --2- 172.21.15.63:0/3149263321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f44110200 0x7f6f44112620 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.300+0000 7f6f4bfbc640 1 --2- 172.21.15.63:0/3149263321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f44102fa0 0x7f6f4410fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.300+0000 7f6f4bfbc640 1 --2- 172.21.15.63:0/3149263321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f44102650 0x7f6f44102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.300+0000 7f6f4bfbc640 1 -- 172.21.15.63:0/3149263321 >> 172.21.15.63:0/3149263321 conn(0x7f6f44079760 msgr2=0x7f6f44079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:42.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.300+0000 7f6f4bfbc640 1 -- 172.21.15.63:0/3149263321 shutdown_connections 2024-09-21T06:39:42.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.300+0000 7f6f4bfbc640 1 -- 172.21.15.63:0/3149263321 wait complete. 2024-09-21T06:39:42.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.301+0000 7f6f4bfbc640 1 Processor -- start 2024-09-21T06:39:42.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.301+0000 7f6f4bfbc640 1 -- start start 2024-09-21T06:39:42.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.301+0000 7f6f4bfbc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f44102650 0x7f6f4419c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:42.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.301+0000 7f6f4bfbc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f44102fa0 0x7f6f4419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:42.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.301+0000 7f6f4bfbc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f44110200 0x7f6f441a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:42.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.301+0000 7f6f4bfbc640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6f44115ca0 con 0x7f6f44102fa0 2024-09-21T06:39:42.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.301+0000 7f6f4bfbc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6f44115b20 con 0x7f6f44110200 2024-09-21T06:39:42.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.301+0000 7f6f4bfbc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6f44115e20 con 0x7f6f44102650 2024-09-21T06:39:42.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.301+0000 7f6f49557640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f44102fa0 0x7f6f4419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:42.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.301+0000 7f6f49557640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f44102fa0 0x7f6f4419cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44828/0 (socket says 172.21.15.63:44828) 2024-09-21T06:39:42.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.301+0000 7f6f49557640 1 -- 172.21.15.63:0/3785435660 learned_addr learned my addr 172.21.15.63:0/3785435660 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:42.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.301+0000 7f6f4a559640 1 --2- 172.21.15.63:0/3785435660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f44110200 0x7f6f441a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:42.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.301+0000 7f6f49d58640 1 --2- 172.21.15.63:0/3785435660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f44102650 0x7f6f4419c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:42.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.301+0000 7f6f49557640 1 -- 172.21.15.63:0/3785435660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f44102650 msgr2=0x7f6f4419c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:42.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.301+0000 7f6f49557640 1 --2- 172.21.15.63:0/3785435660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f44102650 0x7f6f4419c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.301+0000 7f6f49557640 1 -- 172.21.15.63:0/3785435660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f44110200 msgr2=0x7f6f441a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:42.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.301+0000 7f6f49557640 1 --2- 172.21.15.63:0/3785435660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f44110200 0x7f6f441a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.301+0000 7f6f49557640 1 -- 172.21.15.63:0/3785435660 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f441a2550 con 0x7f6f44102fa0 2024-09-21T06:39:42.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.301+0000 7f6f4a559640 1 --2- 172.21.15.63:0/3785435660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f44110200 0x7f6f441a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:42.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.302+0000 7f6f49557640 1 --2- 172.21.15.63:0/3785435660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f44102fa0 0x7f6f4419cb80 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400d950 tx=0x7f6f3400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:42.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.302+0000 7f6f3affd640 1 -- 172.21.15.63:0/3785435660 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f34017070 con 0x7f6f44102fa0 2024-09-21T06:39:42.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.302+0000 7f6f4bfbc640 1 -- 172.21.15.63:0/3785435660 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f441a2840 con 0x7f6f44102fa0 2024-09-21T06:39:42.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.302+0000 7f6f3affd640 1 -- 172.21.15.63:0/3785435660 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f34009c30 con 0x7f6f44102fa0 2024-09-21T06:39:42.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.302+0000 7f6f3affd640 1 -- 172.21.15.63:0/3785435660 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3400f620 con 0x7f6f44102fa0 2024-09-21T06:39:42.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.302+0000 7f6f4bfbc640 1 -- 172.21.15.63:0/3785435660 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f441a8fa0 con 0x7f6f44102fa0 2024-09-21T06:39:42.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.303+0000 7f6f4bfbc640 1 -- 172.21.15.63:0/3785435660 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f4406c1f0 con 0x7f6f44102fa0 2024-09-21T06:39:42.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.304+0000 7f6f3affd640 1 -- 172.21.15.63:0/3785435660 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f6f34010460 con 0x7f6f44102fa0 2024-09-21T06:39:42.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.306+0000 7f6f3affd640 1 --2- 172.21.15.63:0/3785435660 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6f300b6680 0x7f6f300b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:42.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.306+0000 7f6f49d58640 1 --2- 172.21.15.63:0/3785435660 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6f300b6680 0x7f6f300b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:42.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.306+0000 7f6f3affd640 1 -- 172.21.15.63:0/3785435660 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8979+0+0 (secure 0 0 0) 0x7f6f340e7610 con 0x7f6f44102fa0 2024-09-21T06:39:42.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.306+0000 7f6f49d58640 1 --2- 172.21.15.63:0/3785435660 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6f300b6680 0x7f6f300b8b90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6f40005fd0 tx=0x7f6f40005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:42.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.310+0000 7f6f3affd640 1 -- 172.21.15.63:0/3785435660 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6f340ad990 con 0x7f6f44102fa0 2024-09-21T06:39:42.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.501+0000 7f6f4bfbc640 1 -- 172.21.15.63:0/3785435660 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6f441a9250 con 0x7f6f44102fa0 2024-09-21T06:39:42.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.690+0000 7f6f3affd640 1 -- 172.21.15.63:0/3785435660 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) ==== 181+0+0 (secure 0 0 0) 0x7f6f34009de0 con 0x7f6f44102fa0 2024-09-21T06:39:42.692 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:39:42.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.693+0000 7f6f4bfbc640 1 -- 172.21.15.63:0/3785435660 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6f300b6680 msgr2=0x7f6f300b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:42.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.693+0000 7f6f4bfbc640 1 --2- 172.21.15.63:0/3785435660 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6f300b6680 0x7f6f300b8b90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6f40005fd0 tx=0x7f6f40005850 comp rx=0 tx=0).stop 2024-09-21T06:39:42.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.693+0000 7f6f4bfbc640 1 -- 172.21.15.63:0/3785435660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f44102fa0 msgr2=0x7f6f4419cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:42.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.693+0000 7f6f4bfbc640 1 --2- 172.21.15.63:0/3785435660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f44102fa0 0x7f6f4419cb80 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400d950 tx=0x7f6f3400de10 comp rx=0 tx=0).stop 2024-09-21T06:39:42.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.694+0000 7f6f4bfbc640 1 -- 172.21.15.63:0/3785435660 shutdown_connections 2024-09-21T06:39:42.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.694+0000 7f6f4bfbc640 1 --2- 172.21.15.63:0/3785435660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f44110200 0x7f6f441a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.694+0000 7f6f4bfbc640 1 --2- 172.21.15.63:0/3785435660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f44102fa0 0x7f6f4419cb80 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.694+0000 7f6f4bfbc640 1 --2- 172.21.15.63:0/3785435660 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f6f300b6680 0x7f6f300b8b90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.694+0000 7f6f4bfbc640 1 --2- 172.21.15.63:0/3785435660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f44102650 0x7f6f4419c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.694+0000 7f6f4bfbc640 1 -- 172.21.15.63:0/3785435660 >> 172.21.15.63:0/3785435660 conn(0x7f6f44079760 msgr2=0x7f6f44109d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:42.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.695+0000 7f6f4bfbc640 1 -- 172.21.15.63:0/3785435660 shutdown_connections 2024-09-21T06:39:42.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:42.695+0000 7f6f4bfbc640 1 -- 172.21.15.63:0/3785435660 wait complete. 2024-09-21T06:39:42.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:42 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3785435660' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:39:43.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:42 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3785435660' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:39:43.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:42 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3785435660' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:39:43.382 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 140899c8-77e1-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:39:43.643 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:44.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:43 smithi071 ceph-mon[34844]: pgmap v679: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T06:39:44.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:43 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3785435660' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:39:44.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:43 smithi071 ceph-mon[34844]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T06:39:44.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:43 smithi063 ceph-mon[31150]: pgmap v679: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T06:39:44.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:43 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3785435660' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:39:44.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:43 smithi063 ceph-mon[31150]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T06:39:44.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:43 smithi175 ceph-mon[34510]: pgmap v679: 97 pgs: 97 active+clean; 167 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T06:39:44.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:43 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3785435660' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:39:44.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:43 smithi175 ceph-mon[34510]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T06:39:44.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.279+0000 7f26c47c1640 1 -- 172.21.15.63:0/880056643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26bc108740 msgr2=0x7f26bc108b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:44.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.279+0000 7f26c47c1640 1 --2- 172.21.15.63:0/880056643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26bc108740 0x7f26bc108b50 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f26b8009900 tx=0x7f26b802a410 comp rx=0 tx=0).stop 2024-09-21T06:39:44.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.279+0000 7f26c47c1640 1 -- 172.21.15.63:0/880056643 shutdown_connections 2024-09-21T06:39:44.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.279+0000 7f26c47c1640 1 --2- 172.21.15.63:0/880056643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26bc102780 0x7f26bc1105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:44.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.279+0000 7f26c47c1640 1 --2- 172.21.15.63:0/880056643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26bc101e30 0x7f26bc102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:44.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.279+0000 7f26c47c1640 1 --2- 172.21.15.63:0/880056643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26bc108740 0x7f26bc108b50 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:44.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.279+0000 7f26c47c1640 1 -- 172.21.15.63:0/880056643 >> 172.21.15.63:0/880056643 conn(0x7f26bc079f90 msgr2=0x7f26bc07a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:44.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.279+0000 7f26c47c1640 1 -- 172.21.15.63:0/880056643 shutdown_connections 2024-09-21T06:39:44.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.279+0000 7f26c47c1640 1 -- 172.21.15.63:0/880056643 wait complete. 2024-09-21T06:39:44.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.279+0000 7f26c47c1640 1 Processor -- start 2024-09-21T06:39:44.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.279+0000 7f26c47c1640 1 -- start start 2024-09-21T06:39:44.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.280+0000 7f26c47c1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26bc101e30 0x7f26bc103060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:44.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.280+0000 7f26c47c1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26bc102780 0x7f26bc1035a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:44.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.280+0000 7f26c47c1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26bc108740 0x7f26bc103ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:44.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.280+0000 7f26c47c1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc113b50 con 0x7f26bc102780 2024-09-21T06:39:44.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.280+0000 7f26c47c1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc1139d0 con 0x7f26bc108740 2024-09-21T06:39:44.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.280+0000 7f26c47c1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc113cd0 con 0x7f26bc101e30 2024-09-21T06:39:44.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.280+0000 7f26c1d5c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26bc102780 0x7f26bc1035a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:44.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.280+0000 7f26c1d5c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26bc102780 0x7f26bc1035a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44842/0 (socket says 172.21.15.63:44842) 2024-09-21T06:39:44.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.280+0000 7f26c1d5c640 1 -- 172.21.15.63:0/3806809243 learned_addr learned my addr 172.21.15.63:0/3806809243 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:39:44.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.280+0000 7f26c2d5e640 1 --2- 172.21.15.63:0/3806809243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26bc108740 0x7f26bc103ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:44.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.280+0000 7f26c255d640 1 --2- 172.21.15.63:0/3806809243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26bc101e30 0x7f26bc103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:44.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.280+0000 7f26c1d5c640 1 -- 172.21.15.63:0/3806809243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26bc101e30 msgr2=0x7f26bc103060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:44.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.280+0000 7f26c1d5c640 1 --2- 172.21.15.63:0/3806809243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26bc101e30 0x7f26bc103060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:44.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.280+0000 7f26c1d5c640 1 -- 172.21.15.63:0/3806809243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26bc108740 msgr2=0x7f26bc103ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:44.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.280+0000 7f26c1d5c640 1 --2- 172.21.15.63:0/3806809243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26bc108740 0x7f26bc103ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:44.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.280+0000 7f26c1d5c640 1 -- 172.21.15.63:0/3806809243 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26bc1a87a0 con 0x7f26bc102780 2024-09-21T06:39:44.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.281+0000 7f26c1d5c640 1 --2- 172.21.15.63:0/3806809243 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26bc102780 0x7f26bc1035a0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00d740 tx=0x7f26ac00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:44.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.281+0000 7f26b37fe640 1 -- 172.21.15.63:0/3806809243 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac017070 con 0x7f26bc102780 2024-09-21T06:39:44.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.281+0000 7f26b37fe640 1 -- 172.21.15.63:0/3806809243 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26ac00de50 con 0x7f26bc102780 2024-09-21T06:39:44.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.281+0000 7f26c47c1640 1 -- 172.21.15.63:0/3806809243 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26bc1a8a90 con 0x7f26bc102780 2024-09-21T06:39:44.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.282+0000 7f26b37fe640 1 -- 172.21.15.63:0/3806809243 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac003c20 con 0x7f26bc102780 2024-09-21T06:39:44.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.282+0000 7f26c47c1640 1 -- 172.21.15.63:0/3806809243 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26bc1a9020 con 0x7f26bc102780 2024-09-21T06:39:44.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.283+0000 7f26c47c1640 1 -- 172.21.15.63:0/3806809243 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26bc102240 con 0x7f26bc102780 2024-09-21T06:39:44.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.284+0000 7f26b37fe640 1 -- 172.21.15.63:0/3806809243 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f26ac003dc0 con 0x7f26bc102780 2024-09-21T06:39:44.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.285+0000 7f26b37fe640 1 --2- 172.21.15.63:0/3806809243 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f26a80b6700 0x7f26a80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:44.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.285+0000 7f26c255d640 1 --2- 172.21.15.63:0/3806809243 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f26a80b6700 0x7f26a80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:44.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.285+0000 7f26b37fe640 1 -- 172.21.15.63:0/3806809243 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8396+0+0 (secure 0 0 0) 0x7f26ac0e7490 con 0x7f26bc102780 2024-09-21T06:39:44.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.286+0000 7f26c255d640 1 --2- 172.21.15.63:0/3806809243 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f26a80b6700 0x7f26a80b8c10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f26b8000c00 tx=0x7f26b8031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:44.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.289+0000 7f26b37fe640 1 -- 172.21.15.63:0/3806809243 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26ac0adae0 con 0x7f26bc102780 2024-09-21T06:39:44.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.481+0000 7f26c47c1640 1 -- 172.21.15.63:0/3806809243 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f26bc104360 con 0x7f26bc102780 2024-09-21T06:39:44.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.698+0000 7f26b37fe640 1 -- 172.21.15.63:0/3806809243 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) ==== 169+0+0 (secure 0 0 0) 0x7f26bc104360 con 0x7f26bc102780 2024-09-21T06:39:44.700 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2024-09-21T06:39:44.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.703+0000 7f26c47c1640 1 -- 172.21.15.63:0/3806809243 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f26a80b6700 msgr2=0x7f26a80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:44.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.703+0000 7f26c47c1640 1 --2- 172.21.15.63:0/3806809243 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f26a80b6700 0x7f26a80b8c10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f26b8000c00 tx=0x7f26b8031400 comp rx=0 tx=0).stop 2024-09-21T06:39:44.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.703+0000 7f26c47c1640 1 -- 172.21.15.63:0/3806809243 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26bc102780 msgr2=0x7f26bc1035a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:44.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.703+0000 7f26c47c1640 1 --2- 172.21.15.63:0/3806809243 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26bc102780 0x7f26bc1035a0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00d740 tx=0x7f26ac00dc00 comp rx=0 tx=0).stop 2024-09-21T06:39:44.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.705+0000 7f26c47c1640 1 -- 172.21.15.63:0/3806809243 shutdown_connections 2024-09-21T06:39:44.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.705+0000 7f26c47c1640 1 --2- 172.21.15.63:0/3806809243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26bc108740 0x7f26bc103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:44.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.705+0000 7f26c47c1640 1 --2- 172.21.15.63:0/3806809243 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26bc102780 0x7f26bc1035a0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:44.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.705+0000 7f26c47c1640 1 --2- 172.21.15.63:0/3806809243 >> [v2:172.21.15.63:6800/651259686,v1:172.21.15.63:6801/651259686] conn(0x7f26a80b6700 0x7f26a80b8c10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:44.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.705+0000 7f26c47c1640 1 --2- 172.21.15.63:0/3806809243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26bc101e30 0x7f26bc103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:44.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.705+0000 7f26c47c1640 1 -- 172.21.15.63:0/3806809243 >> 172.21.15.63:0/3806809243 conn(0x7f26bc079f90 msgr2=0x7f26bc107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:44.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.706+0000 7f26c47c1640 1 -- 172.21.15.63:0/3806809243 shutdown_connections 2024-09-21T06:39:44.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:39:44.706+0000 7f26c47c1640 1 -- 172.21.15.63:0/3806809243 wait complete. 2024-09-21T06:39:44.832 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:44 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3806809243' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:39:45.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:44 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3806809243' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:39:45.099 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:44 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3806809243' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:39:45.436 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:39:45.465 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:39:45.492 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:39:45.522 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T06:39:45.523 DEBUG:teuthology.orchestra.run.smithi063:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:39:45.540 DEBUG:teuthology.orchestra.run.smithi071:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:39:45.556 DEBUG:teuthology.orchestra.run.smithi175:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:39:45.579 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T06:39:45.579 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T06:39:45.579 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@mon.a 2024-09-21T06:39:45.701 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:45 smithi063 systemd[1]: Stopping Ceph mon.a for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:39:45.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:45 smithi071 ceph-mon[34844]: pgmap v681: 65 pgs: 65 active+clean; 577 KiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:39:45.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:45 smithi071 ceph-mon[34844]: from='client.? 172.21.15.63:0/3806809243' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:39:45.768 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:45 smithi071 ceph-mon[34844]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T06:39:45.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:45 smithi175 ceph-mon[34510]: pgmap v681: 65 pgs: 65 active+clean; 577 KiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:39:45.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:45 smithi175 ceph-mon[34510]: from='client.? 172.21.15.63:0/3806809243' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:39:45.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:45 smithi175 ceph-mon[34510]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T06:39:46.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:45 smithi063 ceph-mon[31150]: pgmap v681: 65 pgs: 65 active+clean; 577 KiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:39:46.082 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:45 smithi063 ceph-mon[31150]: from='client.? 172.21.15.63:0/3806809243' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:39:46.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:45 smithi063 ceph-mon[31150]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T06:39:46.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:45 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-a[31146]: 2024-09-21T06:39:45.899+0000 7f97f6eb7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:39:46.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:45 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-a[31146]: 2024-09-21T06:39:45.899+0000 7f97f6eb7640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T06:39:46.083 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:45 smithi063 podman[125006]: 2024-09-21 06:39:45.931106626 +0000 UTC m=+0.155445524 container died 13f6aeac32a8fd76aa761015ae596974397ec340d9150b813fd1c3a7dd5cf185 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T06:39:46.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:46 smithi063 podman[125006]: 2024-09-21 06:39:46.341579278 +0000 UTC m=+0.565918168 container cleanup 13f6aeac32a8fd76aa761015ae596974397ec340d9150b813fd1c3a7dd5cf185 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T06:39:46.582 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:46 smithi063 bash[125006]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-a 2024-09-21T06:39:46.867 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 21 06:39:46 smithi063 podman[125017]: 2024-09-21 06:39:46.585319301 +0000 UTC m=+0.653262818 container remove 13f6aeac32a8fd76aa761015ae596974397ec340d9150b813fd1c3a7dd5cf185 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T06:39:46.886 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T06:39:46.935 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:39:46.936 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T06:39:46.936 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T06:39:46.936 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@mon.b 2024-09-21T06:39:47.267 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:46 smithi071 systemd[1]: Stopping Ceph mon.b for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:39:47.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:47 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-b[34840]: 2024-09-21T06:39:47.264+0000 7f334d52a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:39:47.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:47 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-b[34840]: 2024-09-21T06:39:47.264+0000 7f334d52a640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T06:39:47.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:47 smithi071 podman[67840]: 2024-09-21 06:39:47.377486249 +0000 UTC m=+0.243189111 container died 8bebf6bf5b3930823e97162d51dd4f8afaf6c534e7516107cba901e500175e22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-b, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T06:39:48.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:47 smithi071 podman[67840]: 2024-09-21 06:39:47.799313033 +0000 UTC m=+0.665015903 container cleanup 8bebf6bf5b3930823e97162d51dd4f8afaf6c534e7516107cba901e500175e22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-b, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T06:39:48.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:47 smithi071 bash[67840]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-b 2024-09-21T06:39:48.285 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T06:39:48.307 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:48 smithi071 podman[67852]: 2024-09-21 06:39:48.042423654 +0000 UTC m=+0.669281092 container remove 8bebf6bf5b3930823e97162d51dd4f8afaf6c534e7516107cba901e500175e22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T06:39:48.308 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:48 smithi071 systemd[1]: ceph-140899c8-77e1-11ef-baf5-efdc52797490@mon.b.service: Deactivated successfully. 2024-09-21T06:39:48.308 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:48 smithi071 systemd[1]: Stopped Ceph mon.b for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:39:48.308 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 21 06:39:48 smithi071 systemd[1]: ceph-140899c8-77e1-11ef-baf5-efdc52797490@mon.b.service: Consumed 13.698s CPU time. 2024-09-21T06:39:48.336 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:39:48.337 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T06:39:48.337 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T06:39:48.337 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@mon.c 2024-09-21T06:39:48.658 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:48 smithi175 systemd[1]: Stopping Ceph mon.c for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:39:49.068 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:48 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-c[34506]: 2024-09-21T06:39:48.656+0000 7f1bd6e5e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:39:49.068 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:48 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-c[34506]: 2024-09-21T06:39:48.656+0000 7f1bd6e5e640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T06:39:49.068 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:48 smithi175 podman[67237]: 2024-09-21 06:39:48.758837837 +0000 UTC m=+0.226549894 container died b6be838a86a3efe9d4a5893d930d22eb149fdc710cdf44aeff26be45bb257367 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-c, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:39:49.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:49 smithi175 podman[67237]: 2024-09-21 06:39:49.165566456 +0000 UTC m=+0.633278511 container cleanup b6be838a86a3efe9d4a5893d930d22eb149fdc710cdf44aeff26be45bb257367 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-c, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2) 2024-09-21T06:39:49.349 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 06:39:49 smithi175 bash[67237]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-mon-c 2024-09-21T06:39:49.586 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T06:39:49.659 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:39:49.659 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T06:39:49.659 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T06:39:49.660 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@mgr.x 2024-09-21T06:39:49.990 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:39:49 smithi063 systemd[1]: Stopping Ceph mgr.x for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:39:50.332 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:39:49 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: 2024-09-21T06:39:49.988+0000 7f4d3a15c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:39:50.332 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:39:49 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x[31377]: 2024-09-21T06:39:49.988+0000 7f4d3a15c640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-21T06:39:50.332 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:39:50 smithi063 podman[125127]: 2024-09-21 06:39:50.029690296 +0000 UTC m=+0.163227944 container died 28d97f2ee4b571056bf079edc48675b6b1f6cc84e171d40f46bc1d9a37ac8451 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T06:39:50.684 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:39:50 smithi063 podman[125127]: 2024-09-21 06:39:50.431256415 +0000 UTC m=+0.564794061 container cleanup 28d97f2ee4b571056bf079edc48675b6b1f6cc84e171d40f46bc1d9a37ac8451 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T06:39:50.684 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 21 06:39:50 smithi063 bash[125127]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-x 2024-09-21T06:39:50.863 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T06:39:50.899 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:39:50.899 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T06:39:50.899 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T06:39:50.899 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@mgr.y 2024-09-21T06:39:51.234 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 21 06:39:50 smithi071 systemd[1]: Stopping Ceph mgr.y for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:39:51.518 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 21 06:39:51 smithi071 podman[67964]: 2024-09-21 06:39:51.233157748 +0000 UTC m=+0.138990080 container died c0bb7be67ac61ea3fc9593e7ce4264105ad56bdd68ca26109f7a4702736f011a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-y, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T06:39:51.907 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 21 06:39:51 smithi071 podman[67964]: 2024-09-21 06:39:51.638159741 +0000 UTC m=+0.543992071 container cleanup c0bb7be67ac61ea3fc9593e7ce4264105ad56bdd68ca26109f7a4702736f011a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-y, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T06:39:51.907 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 21 06:39:51 smithi071 bash[67964]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-y 2024-09-21T06:39:52.064 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T06:39:52.097 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:39:52.098 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T06:39:52.098 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T06:39:52.098 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@mgr.z 2024-09-21T06:39:52.434 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 06:39:52 smithi175 systemd[1]: Stopping Ceph mgr.z for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:39:52.739 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 06:39:52 smithi175 podman[67359]: 2024-09-21 06:39:52.433034698 +0000 UTC m=+0.145688003 container died b37aec2f18e0fbf2cbe38b21b6def672b593e5df184264071b0b815d91795c5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-z, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T06:39:53.100 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 06:39:52 smithi175 podman[67359]: 2024-09-21 06:39:52.838211745 +0000 UTC m=+0.550865044 container cleanup b37aec2f18e0fbf2cbe38b21b6def672b593e5df184264071b0b815d91795c5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T06:39:53.100 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 06:39:52 smithi175 bash[67359]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-mgr-z 2024-09-21T06:39:53.235 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T06:39:53.269 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:39:53.269 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T06:39:53.269 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T06:39:53.270 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.0 2024-09-21T06:39:53.582 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:39:53 smithi063 systemd[1]: Stopping Ceph osd.0 for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:39:54.082 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:39:53 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-0[47840]: 2024-09-21T06:39:53.594+0000 7feb813b0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:39:54.082 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:39:53 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-0[47840]: 2024-09-21T06:39:53.594+0000 7feb813b0640 -1 osd.0 91 *** Got signal Terminated *** 2024-09-21T06:39:54.082 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:39:53 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-0[47840]: 2024-09-21T06:39:53.594+0000 7feb813b0640 -1 osd.0 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:39:59.316 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:39:59 smithi063 podman[125249]: 2024-09-21 06:39:59.020986015 +0000 UTC m=+5.545445544 container died 920b95280bc187e10ab6b8122b5b3a30aa92461abcdc9af13b19b8526db4dc3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T06:39:59.582 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:39:59 smithi063 podman[125249]: 2024-09-21 06:39:59.413986284 +0000 UTC m=+5.938445813 container cleanup 920b95280bc187e10ab6b8122b5b3a30aa92461abcdc9af13b19b8526db4dc3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T06:39:59.582 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:39:59 smithi063 bash[125249]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-0 2024-09-21T06:40:00.082 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:39:59 smithi063 podman[125264]: 2024-09-21 06:39:59.649009151 +0000 UTC m=+0.625836678 container remove 920b95280bc187e10ab6b8122b5b3a30aa92461abcdc9af13b19b8526db4dc3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:40:00.362 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:40:00 smithi063 podman[125351]: 2024-09-21 06:39:59.995755713 +0000 UTC m=+0.016515598 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:40:00.362 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:40:00 smithi063 podman[125351]: 2024-09-21 06:40:00.124788295 +0000 UTC m=+0.145548167 container create 36ea8ac77e7e62be3080a887b4e325c6ad0b194a37e7cf2bf5e9147814be7de3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T06:40:00.363 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:40:00 smithi063 podman[125351]: 2024-09-21 06:40:00.36092697 +0000 UTC m=+0.381686851 container init 36ea8ac77e7e62be3080a887b4e325c6ad0b194a37e7cf2bf5e9147814be7de3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T06:40:00.832 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:40:00 smithi063 podman[125351]: 2024-09-21 06:40:00.365006825 +0000 UTC m=+0.385766708 container start 36ea8ac77e7e62be3080a887b4e325c6ad0b194a37e7cf2bf5e9147814be7de3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T06:40:00.832 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:40:00 smithi063 podman[125351]: 2024-09-21 06:40:00.46074921 +0000 UTC m=+0.481509101 container attach 36ea8ac77e7e62be3080a887b4e325c6ad0b194a37e7cf2bf5e9147814be7de3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-0-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T06:40:00.832 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 21 06:40:00 smithi063 podman[125351]: 2024-09-21 06:40:00.564418068 +0000 UTC m=+0.585177952 container died 36ea8ac77e7e62be3080a887b4e325c6ad0b194a37e7cf2bf5e9147814be7de3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T06:40:01.244 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T06:40:01.288 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:40:01.288 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T06:40:01.289 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T06:40:01.289 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.1 2024-09-21T06:40:01.654 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:40:01 smithi071 systemd[1]: Stopping Ceph osd.1 for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:40:02.018 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:40:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-1[39554]: 2024-09-21T06:40:01.816+0000 7f2092ce3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:40:02.018 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:40:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-1[39554]: 2024-09-21T06:40:01.816+0000 7f2092ce3640 -1 osd.1 91 *** Got signal Terminated *** 2024-09-21T06:40:02.018 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:40:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-1[39554]: 2024-09-21T06:40:01.816+0000 7f2092ce3640 -1 osd.1 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:40:07.644 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:40:07 smithi071 podman[68099]: 2024-09-21 06:40:07.329730648 +0000 UTC m=+5.797729594 container died 206727bf0f4789818286d158c7397bb0f0220a3d98870bd618c82cfe219131c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T06:40:07.986 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:40:07 smithi071 podman[68099]: 2024-09-21 06:40:07.750143347 +0000 UTC m=+6.218142296 container cleanup 206727bf0f4789818286d158c7397bb0f0220a3d98870bd618c82cfe219131c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T06:40:07.986 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:40:07 smithi071 bash[68099]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-1 2024-09-21T06:40:08.268 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:40:07 smithi071 podman[68117]: 2024-09-21 06:40:07.985209636 +0000 UTC m=+0.654437811 container remove 206727bf0f4789818286d158c7397bb0f0220a3d98870bd618c82cfe219131c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:40:08.714 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:40:08 smithi071 podman[68203]: 2024-09-21 06:40:08.323073371 +0000 UTC m=+0.015881711 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:40:08.719 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:40:08 smithi071 podman[68203]: 2024-09-21 06:40:08.460942613 +0000 UTC m=+0.153750954 container create 0900dfe13de4aea78c8da48fda3b69632fe21ade8638ea64642a898a87ddfaf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T06:40:09.018 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:40:08 smithi071 podman[68203]: 2024-09-21 06:40:08.713548987 +0000 UTC m=+0.406357336 container init 0900dfe13de4aea78c8da48fda3b69632fe21ade8638ea64642a898a87ddfaf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-1-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:40:09.019 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:40:08 smithi071 podman[68203]: 2024-09-21 06:40:08.716995718 +0000 UTC m=+0.409804067 container start 0900dfe13de4aea78c8da48fda3b69632fe21ade8638ea64642a898a87ddfaf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-1-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T06:40:09.019 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:40:08 smithi071 podman[68203]: 2024-09-21 06:40:08.813720427 +0000 UTC m=+0.506528776 container attach 0900dfe13de4aea78c8da48fda3b69632fe21ade8638ea64642a898a87ddfaf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T06:40:09.019 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 21 06:40:08 smithi071 podman[68203]: 2024-09-21 06:40:08.909542711 +0000 UTC m=+0.602351052 container died 0900dfe13de4aea78c8da48fda3b69632fe21ade8638ea64642a898a87ddfaf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T06:40:09.599 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T06:40:09.638 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:40:09.638 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T06:40:09.639 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T06:40:09.639 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.2 2024-09-21T06:40:09.952 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:40:09 smithi175 systemd[1]: Stopping Ceph osd.2 for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:40:10.349 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:40:09 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-2[39605]: 2024-09-21T06:40:09.949+0000 7f0a93877640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:40:10.349 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:40:09 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-2[39605]: 2024-09-21T06:40:09.949+0000 7f0a93877640 -1 osd.2 91 *** Got signal Terminated *** 2024-09-21T06:40:10.349 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:40:09 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-2[39605]: 2024-09-21T06:40:09.949+0000 7f0a93877640 -1 osd.2 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:40:15.711 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:40:15 smithi175 podman[67497]: 2024-09-21 06:40:15.411142046 +0000 UTC m=+5.578013486 container died 650196df463165d2d10defcfe946100afe93f5dddba49ec55be2ebb24422d6f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T06:40:16.053 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:40:15 smithi175 podman[67497]: 2024-09-21 06:40:15.809303845 +0000 UTC m=+5.976175269 container cleanup 650196df463165d2d10defcfe946100afe93f5dddba49ec55be2ebb24422d6f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T06:40:16.053 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:40:15 smithi175 bash[67497]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-2 2024-09-21T06:40:16.349 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:40:16 smithi175 podman[67514]: 2024-09-21 06:40:16.052400273 +0000 UTC m=+0.637705637 container remove 650196df463165d2d10defcfe946100afe93f5dddba49ec55be2ebb24422d6f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T06:40:16.665 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:40:16 smithi175 podman[67604]: 2024-09-21 06:40:16.272678563 +0000 UTC m=+0.015715116 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:40:16.665 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:40:16 smithi175 podman[67604]: 2024-09-21 06:40:16.395064191 +0000 UTC m=+0.138100732 container create 63ef95f6fa43d6d003596f1c1ff6b6e4cf7488b1041d351ea4b824e7398b1a79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-2-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T06:40:17.099 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:40:16 smithi175 podman[67604]: 2024-09-21 06:40:16.664562714 +0000 UTC m=+0.407599265 container init 63ef95f6fa43d6d003596f1c1ff6b6e4cf7488b1041d351ea4b824e7398b1a79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-2-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:40:17.099 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:40:16 smithi175 podman[67604]: 2024-09-21 06:40:16.667949242 +0000 UTC m=+0.410985789 container start 63ef95f6fa43d6d003596f1c1ff6b6e4cf7488b1041d351ea4b824e7398b1a79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T06:40:17.100 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:40:16 smithi175 podman[67604]: 2024-09-21 06:40:16.764842903 +0000 UTC m=+0.507879444 container attach 63ef95f6fa43d6d003596f1c1ff6b6e4cf7488b1041d351ea4b824e7398b1a79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T06:40:17.100 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 06:40:16 smithi175 podman[67604]: 2024-09-21 06:40:16.851457723 +0000 UTC m=+0.594494266 container died 63ef95f6fa43d6d003596f1c1ff6b6e4cf7488b1041d351ea4b824e7398b1a79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-2-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:40:17.477 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T06:40:17.518 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:40:17.518 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T06:40:17.518 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T06:40:17.518 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.3 2024-09-21T06:40:17.833 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:40:17 smithi063 systemd[1]: Stopping Ceph osd.3 for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:40:18.332 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:40:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-3[53936]: 2024-09-21T06:40:17.834+0000 7f9fb23ed640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:40:18.332 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:40:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-3[53936]: 2024-09-21T06:40:17.834+0000 7f9fb23ed640 -1 osd.3 91 *** Got signal Terminated *** 2024-09-21T06:40:18.332 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:40:17 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-3[53936]: 2024-09-21T06:40:17.834+0000 7f9fb23ed640 -1 osd.3 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:40:20.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:19 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:19.602+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:20.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:20 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:20.232+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:20.850 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:20 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:20.568+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:21.082 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:40:20 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-3[53936]: 2024-09-21T06:40:20.716+0000 7f9faa9d0640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:56.368781+0000 front 2024-09-21T06:39:56.368594+0000 (oldest deadline 2024-09-21T06:40:20.468720+0000) 2024-09-21T06:40:21.083 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:20 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:20.796+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:21.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:21 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:21.222+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:21.849 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:21 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:21.807+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.125822+0000 front 2024-09-21T06:39:55.125727+0000 (oldest deadline 2024-09-21T06:40:21.526164+0000) 2024-09-21T06:40:21.849 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:21 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:21.586+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:22.082 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:40:21 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-3[53936]: 2024-09-21T06:40:21.736+0000 7f9faa9d0640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:56.368781+0000 front 2024-09-21T06:39:56.368594+0000 (oldest deadline 2024-09-21T06:40:20.468720+0000) 2024-09-21T06:40:22.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:21 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:21.768+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:22.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:22 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:22.195+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:23.082 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:40:22 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-3[53936]: 2024-09-21T06:40:22.703+0000 7f9faa9d0640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:56.368781+0000 front 2024-09-21T06:39:56.368594+0000 (oldest deadline 2024-09-21T06:40:20.468720+0000) 2024-09-21T06:40:23.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:22 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:22.814+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:23.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:22 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:22.795+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.125822+0000 front 2024-09-21T06:39:55.125727+0000 (oldest deadline 2024-09-21T06:40:21.526164+0000) 2024-09-21T06:40:23.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:22 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:22.631+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:23.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:23 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:23.214+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:23.711 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:23 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:23.334+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:23.711 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:40:23 smithi063 podman[125457]: 2024-09-21 06:40:23.383169363 +0000 UTC m=+5.662527875 container stop fb96de5f9c8d490ea4235ddf73e7baf7ad2e27dee4355b6f4403a9bfd11d85c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T06:40:23.711 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:40:23 smithi063 podman[125457]: 2024-09-21 06:40:23.413098564 +0000 UTC m=+5.692457087 container died fb96de5f9c8d490ea4235ddf73e7baf7ad2e27dee4355b6f4403a9bfd11d85c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:40:24.082 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:40:23 smithi063 podman[125457]: 2024-09-21 06:40:23.90118445 +0000 UTC m=+6.180542957 container cleanup fb96de5f9c8d490ea4235ddf73e7baf7ad2e27dee4355b6f4403a9bfd11d85c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-3, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T06:40:24.082 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:40:23 smithi063 bash[125457]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-3 2024-09-21T06:40:24.083 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:23 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:23.826+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:24.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:23 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:23.774+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.125822+0000 front 2024-09-21T06:39:55.125727+0000 (oldest deadline 2024-09-21T06:40:21.526164+0000) 2024-09-21T06:40:24.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:23 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:23.680+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:24.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:24 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:24.238+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:24.526 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:40:24 smithi063 podman[125476]: 2024-09-21 06:40:24.102998438 +0000 UTC m=+0.712809834 container remove fb96de5f9c8d490ea4235ddf73e7baf7ad2e27dee4355b6f4403a9bfd11d85c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T06:40:24.526 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:24 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:24.288+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:24.790 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:40:24 smithi063 podman[125560]: 2024-09-21 06:40:24.428337124 +0000 UTC m=+0.016654599 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:40:24.790 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:40:24 smithi063 podman[125560]: 2024-09-21 06:40:24.55356141 +0000 UTC m=+0.141878882 container create ab2afdce08ac614a7b992ebd6b2d0d28dd1386aba0c750cd36c541fedb10deeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-3-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:40:25.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:24 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:24.794+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:25.083 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:40:24 smithi063 podman[125560]: 2024-09-21 06:40:24.78942553 +0000 UTC m=+0.377743012 container init ab2afdce08ac614a7b992ebd6b2d0d28dd1386aba0c750cd36c541fedb10deeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:40:25.083 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:40:24 smithi063 podman[125560]: 2024-09-21 06:40:24.793010222 +0000 UTC m=+0.381327697 container start ab2afdce08ac614a7b992ebd6b2d0d28dd1386aba0c750cd36c541fedb10deeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:40:25.083 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:40:24 smithi063 podman[125560]: 2024-09-21 06:40:24.881199475 +0000 UTC m=+0.469516962 container attach ab2afdce08ac614a7b992ebd6b2d0d28dd1386aba0c750cd36c541fedb10deeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T06:40:25.083 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 21 06:40:24 smithi063 podman[125560]: 2024-09-21 06:40:24.990867378 +0000 UTC m=+0.579184853 container died ab2afdce08ac614a7b992ebd6b2d0d28dd1386aba0c750cd36c541fedb10deeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T06:40:25.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:24 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:24.779+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.125822+0000 front 2024-09-21T06:39:55.125727+0000 (oldest deadline 2024-09-21T06:40:21.526164+0000) 2024-09-21T06:40:25.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:24 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:24.702+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:25.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:25 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:25.223+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:25.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:25 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:25.304+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:25.756 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T06:40:25.803 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:40:25.803 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T06:40:25.803 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T06:40:25.804 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.4 2024-09-21T06:40:26.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:25 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:25.754+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:26.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:25 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:25.750+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.125822+0000 front 2024-09-21T06:39:55.125727+0000 (oldest deadline 2024-09-21T06:40:21.526164+0000) 2024-09-21T06:40:26.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:25 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:25.726+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:26.137 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 21 06:40:25 smithi071 systemd[1]: Stopping Ceph osd.4 for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:40:26.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:26 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:26.187+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:26.518 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 21 06:40:26 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-4[46093]: 2024-09-21T06:40:26.135+0000 7f7bb7cff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:40:26.518 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 21 06:40:26 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-4[46093]: 2024-09-21T06:40:26.135+0000 7f7bb7cff640 -1 osd.4 91 *** Got signal Terminated *** 2024-09-21T06:40:26.518 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 21 06:40:26 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-4[46093]: 2024-09-21T06:40:26.135+0000 7f7bb7cff640 -1 osd.4 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:40:26.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:26 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:26.329+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:27.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:26 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:26.765+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:27.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:26 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:26.739+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.125822+0000 front 2024-09-21T06:39:55.125727+0000 (oldest deadline 2024-09-21T06:40:21.526164+0000) 2024-09-21T06:40:27.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:26 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:26.694+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:27.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:27 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:27.153+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:27.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:27 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:27.314+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:28.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:27 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:27.763+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:28.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:27 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:27.722+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.125822+0000 front 2024-09-21T06:39:55.125727+0000 (oldest deadline 2024-09-21T06:40:21.526164+0000) 2024-09-21T06:40:28.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:27 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:27.650+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:28.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:28 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:28.108+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:28.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:28 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:28.318+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:29.018 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 21 06:40:28 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-4[46093]: 2024-09-21T06:40:28.739+0000 7f7bb42ea640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.666314+0000 front 2024-09-21T06:40:06.666210+0000 (oldest deadline 2024-09-21T06:40:27.766422+0000) 2024-09-21T06:40:29.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:28 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:28.796+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:29.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:28 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:28.796+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.097763+0000 front 2024-09-21T06:40:06.097552+0000 (oldest deadline 2024-09-21T06:40:28.397579+0000) 2024-09-21T06:40:29.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:28 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:28.708+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.125822+0000 front 2024-09-21T06:39:55.125727+0000 (oldest deadline 2024-09-21T06:40:21.526164+0000) 2024-09-21T06:40:29.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:28 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:28.636+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:29.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:28 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:28.636+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:29.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:29 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:29.086+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:29.522 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:29 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:29.086+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:29.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:29 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:29.299+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:29.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:29 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:29.299+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:30.018 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 21 06:40:29 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-4[46093]: 2024-09-21T06:40:29.723+0000 7f7bb42ea640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.666314+0000 front 2024-09-21T06:40:06.666210+0000 (oldest deadline 2024-09-21T06:40:27.766422+0000) 2024-09-21T06:40:30.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:29 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:29.661+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:30.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:29 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:29.661+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:30.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:29 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:29.676+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.125822+0000 front 2024-09-21T06:39:55.125727+0000 (oldest deadline 2024-09-21T06:40:21.526164+0000) 2024-09-21T06:40:30.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:29 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:29.676+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.628243+0000 front 2024-09-21T06:40:06.628116+0000 (oldest deadline 2024-09-21T06:40:28.928106+0000) 2024-09-21T06:40:30.332 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:29 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:29.840+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:30.332 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:29 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:29.840+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.097763+0000 front 2024-09-21T06:40:06.097552+0000 (oldest deadline 2024-09-21T06:40:28.397579+0000) 2024-09-21T06:40:30.450 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:30 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:30.093+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:30.450 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:30 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:30.093+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:30.768 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 21 06:40:30 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-4[46093]: 2024-09-21T06:40:30.692+0000 7f7bb42ea640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.666314+0000 front 2024-09-21T06:40:06.666210+0000 (oldest deadline 2024-09-21T06:40:27.766422+0000) 2024-09-21T06:40:30.768 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:30 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:30.447+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:30.832 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:30 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:30.341+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:30.832 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:30 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:30.341+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:31.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:30 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:30.644+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.125822+0000 front 2024-09-21T06:39:55.125727+0000 (oldest deadline 2024-09-21T06:40:21.526164+0000) 2024-09-21T06:40:31.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:30 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:30.644+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.628243+0000 front 2024-09-21T06:40:06.628116+0000 (oldest deadline 2024-09-21T06:40:28.928106+0000) 2024-09-21T06:40:31.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:30 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:30.671+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:31.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:30 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:30.671+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:31.320 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:30 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:30.874+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:31.320 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:30 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:30.874+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.097763+0000 front 2024-09-21T06:40:06.097552+0000 (oldest deadline 2024-09-21T06:40:28.397579+0000) 2024-09-21T06:40:31.457 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:31 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:31.130+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:31.457 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:31 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:31.130+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:31.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:31 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:31.319+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:31.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:31 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:31.319+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:31.768 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:31 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:31.454+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:31.768 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 21 06:40:31 smithi071 podman[68308]: 2024-09-21 06:40:31.513029895 +0000 UTC m=+5.509585905 container died 10d830f2ec45078fcf4698cbc372bcc2b0408a8251a1ec063e345b90ed7e9a28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-4, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T06:40:32.090 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 21 06:40:31 smithi071 podman[68308]: 2024-09-21 06:40:31.919386585 +0000 UTC m=+5.915942585 container cleanup 10d830f2ec45078fcf4698cbc372bcc2b0408a8251a1ec063e345b90ed7e9a28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T06:40:32.091 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 21 06:40:31 smithi071 bash[68308]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-4 2024-09-21T06:40:32.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:31 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:31.619+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.125822+0000 front 2024-09-21T06:39:55.125727+0000 (oldest deadline 2024-09-21T06:40:21.526164+0000) 2024-09-21T06:40:32.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:31 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:31.619+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.628243+0000 front 2024-09-21T06:40:06.628116+0000 (oldest deadline 2024-09-21T06:40:28.928106+0000) 2024-09-21T06:40:32.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:31 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:31.716+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:32.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:31 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:31.716+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:32.332 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:31 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:31.901+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:32.332 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:31 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:31.901+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.097763+0000 front 2024-09-21T06:40:06.097552+0000 (oldest deadline 2024-09-21T06:40:28.397579+0000) 2024-09-21T06:40:32.446 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 21 06:40:32 smithi071 podman[68326]: 2024-09-21 06:40:32.187646111 +0000 UTC m=+0.664071270 container remove 10d830f2ec45078fcf4698cbc372bcc2b0408a8251a1ec063e345b90ed7e9a28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:40:32.446 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:32 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:32.088+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:32.446 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:32 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:32.088+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:32.689 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:32 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:32.375+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:32.690 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:32 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:32.614+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.125822+0000 front 2024-09-21T06:39:55.125727+0000 (oldest deadline 2024-09-21T06:40:21.526164+0000) 2024-09-21T06:40:32.690 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:32 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:32.614+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.628243+0000 front 2024-09-21T06:40:06.628116+0000 (oldest deadline 2024-09-21T06:40:28.928106+0000) 2024-09-21T06:40:32.702 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:32 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:32.443+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:32.702 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 21 06:40:32 smithi071 podman[68415]: 2024-09-21 06:40:32.435247918 +0000 UTC m=+0.015763722 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:40:32.702 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 21 06:40:32 smithi071 podman[68415]: 2024-09-21 06:40:32.555113129 +0000 UTC m=+0.135628910 container create 16618b7fe1747777ca144a2174ff04c51880598fc289442baa6fb5bd41a8d601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T06:40:32.832 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:32 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:32.365+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:32.832 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:32 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:32.365+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:33.075 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 21 06:40:32 smithi071 podman[68415]: 2024-09-21 06:40:32.807816083 +0000 UTC m=+0.388331866 container init 16618b7fe1747777ca144a2174ff04c51880598fc289442baa6fb5bd41a8d601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-4-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T06:40:33.075 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 21 06:40:32 smithi071 podman[68415]: 2024-09-21 06:40:32.811181005 +0000 UTC m=+0.391696792 container start 16618b7fe1747777ca144a2174ff04c51880598fc289442baa6fb5bd41a8d601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True) 2024-09-21T06:40:33.075 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 21 06:40:32 smithi071 podman[68415]: 2024-09-21 06:40:32.907662132 +0000 UTC m=+0.488177929 container attach 16618b7fe1747777ca144a2174ff04c51880598fc289442baa6fb5bd41a8d601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T06:40:33.075 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 21 06:40:33 smithi071 podman[68415]: 2024-09-21 06:40:33.005120654 +0000 UTC m=+0.585636444 container died 16618b7fe1747777ca144a2174ff04c51880598fc289442baa6fb5bd41a8d601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:40:33.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:32 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:32.688+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:33.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:32 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:32.688+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:33.327 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:32 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:32.881+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:33.327 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:32 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:32.881+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.097763+0000 front 2024-09-21T06:40:06.097552+0000 (oldest deadline 2024-09-21T06:40:28.397579+0000) 2024-09-21T06:40:33.387 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:33 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:33.072+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:33.387 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:33 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:33.072+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:33.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:33 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:33.325+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:33.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:33 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:33.325+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:33.659 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:33 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:33.384+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:33.659 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:33 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:33.602+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.125822+0000 front 2024-09-21T06:39:55.125727+0000 (oldest deadline 2024-09-21T06:40:21.526164+0000) 2024-09-21T06:40:33.659 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:33 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:33.602+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.628243+0000 front 2024-09-21T06:40:06.628116+0000 (oldest deadline 2024-09-21T06:40:28.928106+0000) 2024-09-21T06:40:33.721 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:33 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:33.422+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:33.745 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T06:40:33.787 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:40:33.787 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T06:40:33.788 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T06:40:33.788 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.5 2024-09-21T06:40:34.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:33 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:33.866+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:34.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:33 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:33.866+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.097763+0000 front 2024-09-21T06:40:06.097552+0000 (oldest deadline 2024-09-21T06:40:28.397579+0000) 2024-09-21T06:40:34.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:33 smithi175 systemd[1]: Stopping Ceph osd.5 for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:40:34.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:33 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:33.657+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:34.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:33 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:33.657+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:34.358 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:34 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:34.105+0000 7faaab598640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:40:34.359 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:34 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:34.105+0000 7faaab598640 -1 osd.5 91 *** Got signal Terminated *** 2024-09-21T06:40:34.359 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:34 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:34.105+0000 7faaab598640 -1 osd.5 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:40:34.391 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:34 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:34.057+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:34.391 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:34 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:34.057+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:34.625 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:34 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:34.335+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:34.625 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:34 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:34.335+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:34.627 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:34 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:34.357+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:34.768 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:34 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:34.389+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:35.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:34 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:34.867+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:35.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:34 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:34.867+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.097763+0000 front 2024-09-21T06:40:06.097552+0000 (oldest deadline 2024-09-21T06:40:28.397579+0000) 2024-09-21T06:40:35.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:34 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:34.626+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.125822+0000 front 2024-09-21T06:39:55.125727+0000 (oldest deadline 2024-09-21T06:40:21.526164+0000) 2024-09-21T06:40:35.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:34 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:34.626+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.628243+0000 front 2024-09-21T06:40:06.628116+0000 (oldest deadline 2024-09-21T06:40:28.928106+0000) 2024-09-21T06:40:35.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:34 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:34.697+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:35.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:34 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:34.697+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:35.411 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:35 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:35.079+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:35.411 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:35 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:35.079+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:35.723 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:35 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:35.375+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:35.724 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:35 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:35.591+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.125822+0000 front 2024-09-21T06:39:55.125727+0000 (oldest deadline 2024-09-21T06:40:21.526164+0000) 2024-09-21T06:40:35.724 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:35 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:35.591+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.628243+0000 front 2024-09-21T06:40:06.628116+0000 (oldest deadline 2024-09-21T06:40:28.928106+0000) 2024-09-21T06:40:35.768 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:35 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:35.409+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:35.832 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:35 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:35.338+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:35.832 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:35 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:35.338+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:36.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:35 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:35.722+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:36.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:35 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:35.722+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:36.332 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:35 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:35.892+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:36.332 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:35 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:35.892+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.097763+0000 front 2024-09-21T06:40:06.097552+0000 (oldest deadline 2024-09-21T06:40:28.397579+0000) 2024-09-21T06:40:36.374 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:36 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:36.089+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:36.374 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:36 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:36.089+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:36.753 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:36 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:36.629+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.125822+0000 front 2024-09-21T06:39:55.125727+0000 (oldest deadline 2024-09-21T06:40:21.526164+0000) 2024-09-21T06:40:36.753 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:36 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:36.629+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.628243+0000 front 2024-09-21T06:40:06.628116+0000 (oldest deadline 2024-09-21T06:40:28.928106+0000) 2024-09-21T06:40:36.753 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:36 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:36.410+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:36.753 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:36 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:36.410+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:36.768 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:36 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:36.372+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:36.768 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:36 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:36.372+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:10.427120+0000 front 2024-09-21T06:40:10.427298+0000 (oldest deadline 2024-09-21T06:40:35.726978+0000) 2024-09-21T06:40:36.832 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:36 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:36.351+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:36.832 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:36 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:36.351+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:37.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:36 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:36.751+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:37.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:36 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:36.751+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:37.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:36 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:36.751+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:37.331 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:36 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:36.848+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:37.332 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:36 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:36.848+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.097763+0000 front 2024-09-21T06:40:06.097552+0000 (oldest deadline 2024-09-21T06:40:28.397579+0000) 2024-09-21T06:40:37.332 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:36 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:36.848+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.499903+0000 front 2024-09-21T06:40:13.499978+0000 (oldest deadline 2024-09-21T06:40:36.399736+0000) 2024-09-21T06:40:37.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:37 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:37.384+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:37.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:37 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:37.384+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:10.427120+0000 front 2024-09-21T06:40:10.427298+0000 (oldest deadline 2024-09-21T06:40:35.726978+0000) 2024-09-21T06:40:37.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:37 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:37.135+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:37.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:37 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:37.135+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:37.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:37 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:37.329+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:37.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:37 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:37.329+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:37.677 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:37 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:37.364+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:37.678 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:37 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:37.364+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:38.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:37 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:37.676+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.125822+0000 front 2024-09-21T06:39:55.125727+0000 (oldest deadline 2024-09-21T06:40:21.526164+0000) 2024-09-21T06:40:38.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:37 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:37.676+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.628243+0000 front 2024-09-21T06:40:06.628116+0000 (oldest deadline 2024-09-21T06:40:28.928106+0000) 2024-09-21T06:40:38.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:37 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:37.735+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:38.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:37 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:37.735+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:38.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:37 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:37.735+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:38.313 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:37 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:37.875+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:38.313 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:37 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:37.875+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.097763+0000 front 2024-09-21T06:40:06.097552+0000 (oldest deadline 2024-09-21T06:40:28.397579+0000) 2024-09-21T06:40:38.313 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:37 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:37.875+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.499903+0000 front 2024-09-21T06:40:13.499978+0000 (oldest deadline 2024-09-21T06:40:36.399736+0000) 2024-09-21T06:40:38.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:38 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:38.345+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:38.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:38 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:38.345+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:10.427120+0000 front 2024-09-21T06:40:10.427298+0000 (oldest deadline 2024-09-21T06:40:35.726978+0000) 2024-09-21T06:40:38.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:38 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:38.181+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:38.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:38 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:38.181+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:38.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:38 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:38.181+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:38.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:38.311+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:38.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:38.311+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:38.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:38 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:38.325+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:38.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:38 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:38.325+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:39.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:38 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:38.725+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.125822+0000 front 2024-09-21T06:39:55.125727+0000 (oldest deadline 2024-09-21T06:40:21.526164+0000) 2024-09-21T06:40:39.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:38 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:38.725+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.628243+0000 front 2024-09-21T06:40:06.628116+0000 (oldest deadline 2024-09-21T06:40:28.928106+0000) 2024-09-21T06:40:39.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:38 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5[45881]: 2024-09-21T06:40:38.725+0000 7faaa3b7b640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.629050+0000 front 2024-09-21T06:40:13.629129+0000 (oldest deadline 2024-09-21T06:40:38.229955+0000) 2024-09-21T06:40:39.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:38 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:38.737+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:39.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:38 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:38.737+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:39.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:38 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:38.737+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:39.332 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:38.832+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:39.332 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:38.832+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.097763+0000 front 2024-09-21T06:40:06.097552+0000 (oldest deadline 2024-09-21T06:40:28.397579+0000) 2024-09-21T06:40:39.332 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:38 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:38.832+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.499903+0000 front 2024-09-21T06:40:13.499978+0000 (oldest deadline 2024-09-21T06:40:36.399736+0000) 2024-09-21T06:40:39.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:39 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:39.349+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:39.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:39 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:39.349+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:10.427120+0000 front 2024-09-21T06:40:10.427298+0000 (oldest deadline 2024-09-21T06:40:35.726978+0000) 2024-09-21T06:40:39.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:39 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:39.154+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:39.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:39 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:39.154+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:39.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:39 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:39.154+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:39.741 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:39 smithi175 podman[67718]: 2024-09-21 06:40:39.556120055 +0000 UTC m=+5.572689491 container died 1757b98025ec991c066a12f0ea223d2954c1dce646ac31d945d3ec84dc29c47e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T06:40:39.741 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:39 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:39.356+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:39.741 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:39 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:39.356+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:39.832 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:39.343+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:39.832 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:39.343+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:40.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:39 smithi175 podman[67718]: 2024-09-21 06:40:39.921637341 +0000 UTC m=+5.938206787 container cleanup 1757b98025ec991c066a12f0ea223d2954c1dce646ac31d945d3ec84dc29c47e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:40:40.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:39 smithi175 bash[67718]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5 2024-09-21T06:40:40.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:39 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:39.738+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:40.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:39 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:39.738+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:40.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:39 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:39.738+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:40.309 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:39.860+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:40.309 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:39.860+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.097763+0000 front 2024-09-21T06:40:06.097552+0000 (oldest deadline 2024-09-21T06:40:28.397579+0000) 2024-09-21T06:40:40.309 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:39.860+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.499903+0000 front 2024-09-21T06:40:13.499978+0000 (oldest deadline 2024-09-21T06:40:36.399736+0000) 2024-09-21T06:40:40.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:40 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:40.346+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:40.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:40 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:40.346+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:10.427120+0000 front 2024-09-21T06:40:10.427298+0000 (oldest deadline 2024-09-21T06:40:35.726978+0000) 2024-09-21T06:40:40.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:40 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:40.157+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:40.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:40 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:40.157+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:40.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:40 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:40.157+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:40.537 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:40 smithi175 podman[67734]: 2024-09-21 06:40:40.21473085 +0000 UTC m=+0.650686569 container remove 1757b98025ec991c066a12f0ea223d2954c1dce646ac31d945d3ec84dc29c47e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T06:40:40.538 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:40 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:40.312+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:40.538 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:40 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:40.312+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:40.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:40 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:40.307+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:40.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:40 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:40.307+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:40.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:40 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:40.307+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:40:40.828 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:40 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:40.774+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:40.828 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:40 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:40.774+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:40.828 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:40 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:40.774+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:40.828 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:40 smithi175 podman[67826]: 2024-09-21 06:40:40.439469896 +0000 UTC m=+0.015717881 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:40:40.829 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:40 smithi175 podman[67826]: 2024-09-21 06:40:40.590711294 +0000 UTC m=+0.166959310 container create 190c928e9926675b5f868a06c09db5336b81bd80e39bcc4dbed0e3ba4d7f51f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T06:40:40.829 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:40 smithi175 podman[67826]: 2024-09-21 06:40:40.827258789 +0000 UTC m=+0.403506770 container init 190c928e9926675b5f868a06c09db5336b81bd80e39bcc4dbed0e3ba4d7f51f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T06:40:41.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:40 smithi175 podman[67826]: 2024-09-21 06:40:40.830717597 +0000 UTC m=+0.406965570 container start 190c928e9926675b5f868a06c09db5336b81bd80e39bcc4dbed0e3ba4d7f51f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5-deactivate, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:40:41.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:40 smithi175 podman[67826]: 2024-09-21 06:40:40.926684489 +0000 UTC m=+0.502932463 container attach 190c928e9926675b5f868a06c09db5336b81bd80e39bcc4dbed0e3ba4d7f51f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:40:41.099 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 06:40:41 smithi175 podman[67826]: 2024-09-21 06:40:41.018893063 +0000 UTC m=+0.595141036 container died 190c928e9926675b5f868a06c09db5336b81bd80e39bcc4dbed0e3ba4d7f51f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T06:40:41.332 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:40 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:40.886+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:41.332 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:40 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:40.886+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.097763+0000 front 2024-09-21T06:40:06.097552+0000 (oldest deadline 2024-09-21T06:40:28.397579+0000) 2024-09-21T06:40:41.332 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:40 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:40.886+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.499903+0000 front 2024-09-21T06:40:13.499978+0000 (oldest deadline 2024-09-21T06:40:36.399736+0000) 2024-09-21T06:40:41.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:41 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:41.352+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:41.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:41 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:41.352+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:10.427120+0000 front 2024-09-21T06:40:10.427298+0000 (oldest deadline 2024-09-21T06:40:35.726978+0000) 2024-09-21T06:40:41.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:41 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:41.199+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:41.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:41 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:41.199+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:41.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:41 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:41.199+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:41.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:41 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:41.308+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:41.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:41 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:41.308+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:41.739 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T06:40:41.779 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:40:41.779 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T06:40:41.779 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T06:40:41.779 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.6 2024-09-21T06:40:41.808 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:41 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:41.347+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:41.808 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:41 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:41.347+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:41.808 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:41 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:41.347+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:40:42.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:41 smithi063 systemd[1]: Stopping Ceph osd.6 for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:40:42.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:41 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:41.842+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:42.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:41 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:41.842+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.097763+0000 front 2024-09-21T06:40:06.097552+0000 (oldest deadline 2024-09-21T06:40:28.397579+0000) 2024-09-21T06:40:42.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:41 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:41.842+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.499903+0000 front 2024-09-21T06:40:13.499978+0000 (oldest deadline 2024-09-21T06:40:36.399736+0000) 2024-09-21T06:40:42.098 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:41 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:41.732+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:42.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:41 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:41.732+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:42.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:41 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:41.732+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:42.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:42 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:42.376+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:42.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:42 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:42.376+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:10.427120+0000 front 2024-09-21T06:40:10.427298+0000 (oldest deadline 2024-09-21T06:40:35.726978+0000) 2024-09-21T06:40:42.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:42 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:42.233+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:42.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:42 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:42.233+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:42.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:42 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:42.233+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:42.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:42 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:42.323+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:42.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:42 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:42.323+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:42.583 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:42 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:42.323+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:40:42.583 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:42 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:42.087+0000 7f23a9352640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:40:42.583 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:42 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:42.087+0000 7f23a9352640 -1 osd.6 91 *** Got signal Terminated *** 2024-09-21T06:40:42.583 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:42 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:42.087+0000 7f23a9352640 -1 osd.6 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:40:42.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:42 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:42.260+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:42.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:42 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:42.260+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:43.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:42 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:42.727+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:43.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:42 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:42.727+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:43.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:42 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:42.727+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:43.332 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:42 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:42.844+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:43.332 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:42 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:42.844+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.097763+0000 front 2024-09-21T06:40:06.097552+0000 (oldest deadline 2024-09-21T06:40:28.397579+0000) 2024-09-21T06:40:43.332 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:42 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:42.844+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.499903+0000 front 2024-09-21T06:40:13.499978+0000 (oldest deadline 2024-09-21T06:40:36.399736+0000) 2024-09-21T06:40:43.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:43 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:43.350+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:43.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:43 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:43.350+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:10.427120+0000 front 2024-09-21T06:40:10.427298+0000 (oldest deadline 2024-09-21T06:40:35.726978+0000) 2024-09-21T06:40:43.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:43 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:43.260+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:43.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:43 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:43.260+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:43.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:43 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:43.260+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:43.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:43 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:43.291+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:43.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:43 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:43.291+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:43.832 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:43 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:43.337+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:43.832 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:43 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:43.337+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:43.832 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:43 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:43.337+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:40:44.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:43 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:43.728+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:44.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:43 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:43.728+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:44.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:43 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:43.728+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:44.124 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:43 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:43.841+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:44.124 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:43 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:43.841+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.097763+0000 front 2024-09-21T06:40:06.097552+0000 (oldest deadline 2024-09-21T06:40:28.397579+0000) 2024-09-21T06:40:44.124 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:43 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:43.841+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.499903+0000 front 2024-09-21T06:40:13.499978+0000 (oldest deadline 2024-09-21T06:40:36.399736+0000) 2024-09-21T06:40:44.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:44 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:44.316+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:44.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:44 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:44.316+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:10.427120+0000 front 2024-09-21T06:40:10.427298+0000 (oldest deadline 2024-09-21T06:40:35.726978+0000) 2024-09-21T06:40:44.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:44 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:44.316+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:19.828200+0000 front 2024-09-21T06:40:19.828097+0000 (oldest deadline 2024-09-21T06:40:43.928008+0000) 2024-09-21T06:40:44.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:44 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:44.240+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:44.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:44 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:44.240+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:44.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:44 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:44.240+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:44.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:44 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:44.330+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:44.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:44 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:44.330+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:44.705 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:44 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:44.375+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:44.705 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:44 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:44.375+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:44.705 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:44 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:44.375+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:40:45.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:44 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:44.824+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:45.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:44 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:44.824+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.097763+0000 front 2024-09-21T06:40:06.097552+0000 (oldest deadline 2024-09-21T06:40:28.397579+0000) 2024-09-21T06:40:45.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:44 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:44.824+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.499903+0000 front 2024-09-21T06:40:13.499978+0000 (oldest deadline 2024-09-21T06:40:36.399736+0000) 2024-09-21T06:40:45.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:44 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:44.774+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:45.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:44 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:44.774+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:45.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:44 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:44.774+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:45.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:45 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:45.328+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:45.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:45 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:45.328+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:45.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:45 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:45.328+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:40:45.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:45 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:45.328+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:40:45.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:45 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:45.325+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:45.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:45 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:45.325+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:45.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:45 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:45.325+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:22.142473+0000 front 2024-09-21T06:40:22.142614+0000 (oldest deadline 2024-09-21T06:40:44.442495+0000) 2024-09-21T06:40:45.768 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:45 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:45.307+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:45.768 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:45 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:45.307+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:10.427120+0000 front 2024-09-21T06:40:10.427298+0000 (oldest deadline 2024-09-21T06:40:35.726978+0000) 2024-09-21T06:40:45.768 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:45 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:45.307+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:19.828200+0000 front 2024-09-21T06:40:19.828097+0000 (oldest deadline 2024-09-21T06:40:43.928008+0000) 2024-09-21T06:40:45.769 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:45 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:45.288+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:45.769 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:45 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:45.288+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:45.769 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:45 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:45.288+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:46.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:45 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:45.784+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:46.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:45 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:45.784+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:46.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:45 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:45.784+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:46.287 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:45 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:45.855+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:46.287 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:45 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:45.855+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.097763+0000 front 2024-09-21T06:40:06.097552+0000 (oldest deadline 2024-09-21T06:40:28.397579+0000) 2024-09-21T06:40:46.287 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:45 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:45.855+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.499903+0000 front 2024-09-21T06:40:13.499978+0000 (oldest deadline 2024-09-21T06:40:36.399736+0000) 2024-09-21T06:40:46.287 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:45 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:45.855+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:19.300497+0000 front 2024-09-21T06:40:19.300548+0000 (oldest deadline 2024-09-21T06:40:45.200599+0000) 2024-09-21T06:40:46.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:46 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:46.252+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:46.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:46 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:46.252+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:46.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:46 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:46.252+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:46.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:46 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:46.252+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:40:46.519 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:46 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:46.262+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:46.519 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:46 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:46.262+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:10.427120+0000 front 2024-09-21T06:40:10.427298+0000 (oldest deadline 2024-09-21T06:40:35.726978+0000) 2024-09-21T06:40:46.519 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:46 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:46.262+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:19.828200+0000 front 2024-09-21T06:40:19.828097+0000 (oldest deadline 2024-09-21T06:40:43.928008+0000) 2024-09-21T06:40:46.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:46 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:46.285+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:46.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:46 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:46.285+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:46.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:46 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:46.285+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:40:46.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:46 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:46.285+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:40:46.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:46 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:46.317+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:46.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:46 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:46.317+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:46.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:46 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:46.317+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:22.142473+0000 front 2024-09-21T06:40:22.142614+0000 (oldest deadline 2024-09-21T06:40:44.442495+0000) 2024-09-21T06:40:47.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:46 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:46.828+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:57.896254+0000 front 2024-09-21T06:39:57.896130+0000 (oldest deadline 2024-09-21T06:40:20.796305+0000) 2024-09-21T06:40:47.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:46 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:46.828+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:06.097763+0000 front 2024-09-21T06:40:06.097552+0000 (oldest deadline 2024-09-21T06:40:28.397579+0000) 2024-09-21T06:40:47.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:46 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:46.828+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.499903+0000 front 2024-09-21T06:40:13.499978+0000 (oldest deadline 2024-09-21T06:40:36.399736+0000) 2024-09-21T06:40:47.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:46 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6[60096]: 2024-09-21T06:40:46.828+0000 7f23a593d640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:19.300497+0000 front 2024-09-21T06:40:19.300548+0000 (oldest deadline 2024-09-21T06:40:45.200599+0000) 2024-09-21T06:40:47.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:46 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:46.814+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:47.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:46 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:46.814+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:47.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:46 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:46.814+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:47.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:47 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:47.218+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:47.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:47 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:47.218+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:10.427120+0000 front 2024-09-21T06:40:10.427298+0000 (oldest deadline 2024-09-21T06:40:35.726978+0000) 2024-09-21T06:40:47.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:47 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:47.218+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:19.828200+0000 front 2024-09-21T06:40:19.828097+0000 (oldest deadline 2024-09-21T06:40:43.928008+0000) 2024-09-21T06:40:47.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:47 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:47.268+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:47.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:47 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:47.268+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:47.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:47 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:47.268+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:47.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:47 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:47.268+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:40:47.582 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:47 smithi063 podman[125674]: 2024-09-21 06:40:47.472008583 +0000 UTC m=+5.486339441 container died f50a0927cc154ef01fe0ebae7e7bfff6e15cae24547e65226500008d9aed00dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:40:47.583 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:47 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:47.269+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:47.583 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:47 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:47.269+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:47.583 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:47 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:47.269+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:40:47.583 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:47 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:47.269+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:40:47.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:47 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:47.298+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:47.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:47 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:47.298+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:47.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:47 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:47.298+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:22.142473+0000 front 2024-09-21T06:40:22.142614+0000 (oldest deadline 2024-09-21T06:40:44.442495+0000) 2024-09-21T06:40:48.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:47 smithi063 podman[125674]: 2024-09-21 06:40:47.83007132 +0000 UTC m=+5.844402167 container cleanup f50a0927cc154ef01fe0ebae7e7bfff6e15cae24547e65226500008d9aed00dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True) 2024-09-21T06:40:48.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:47 smithi063 bash[125674]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6 2024-09-21T06:40:48.333 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:47 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:47.858+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:48.334 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:47 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:47.858+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:48.334 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:47 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:47.858+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:48.470 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:48 smithi063 podman[125689]: 2024-09-21 06:40:48.123217626 +0000 UTC m=+0.650399540 container remove f50a0927cc154ef01fe0ebae7e7bfff6e15cae24547e65226500008d9aed00dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T06:40:48.471 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:48 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:48.232+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:48.471 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:48 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:48.232+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:48.471 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:48 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:48.232+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:40:48.471 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:48 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:48.232+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:40:48.519 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:48 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:48.204+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:48.519 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:48 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:48.204+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:10.427120+0000 front 2024-09-21T06:40:10.427298+0000 (oldest deadline 2024-09-21T06:40:35.726978+0000) 2024-09-21T06:40:48.519 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:48 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:48.204+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:19.828200+0000 front 2024-09-21T06:40:19.828097+0000 (oldest deadline 2024-09-21T06:40:43.928008+0000) 2024-09-21T06:40:48.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:48 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:48.249+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:48.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:48 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:48.249+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:48.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:48 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:48.249+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:48.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:48 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:48.249+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:40:48.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:48 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:48.332+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:48.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:48 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:48.332+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:48.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:48 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:48.332+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:22.142473+0000 front 2024-09-21T06:40:22.142614+0000 (oldest deadline 2024-09-21T06:40:44.442495+0000) 2024-09-21T06:40:48.735 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:48 smithi063 podman[125777]: 2024-09-21 06:40:48.37212149 +0000 UTC m=+0.016529521 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:40:48.736 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:48 smithi063 podman[125777]: 2024-09-21 06:40:48.473896419 +0000 UTC m=+0.118304439 container create 17c85c52de97fc30469890e88b39d04d02489d60c7740c95fb2d125696acdfe4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:40:48.736 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:48 smithi063 podman[125777]: 2024-09-21 06:40:48.734841995 +0000 UTC m=+0.379250036 container init 17c85c52de97fc30469890e88b39d04d02489d60c7740c95fb2d125696acdfe4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T06:40:49.082 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:48 smithi063 podman[125777]: 2024-09-21 06:40:48.738411845 +0000 UTC m=+0.382819865 container start 17c85c52de97fc30469890e88b39d04d02489d60c7740c95fb2d125696acdfe4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T06:40:49.083 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:48 smithi063 podman[125777]: 2024-09-21 06:40:48.85151421 +0000 UTC m=+0.495922249 container attach 17c85c52de97fc30469890e88b39d04d02489d60c7740c95fb2d125696acdfe4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T06:40:49.083 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 21 06:40:48 smithi063 podman[125777]: 2024-09-21 06:40:48.935724086 +0000 UTC m=+0.580132115 container died 17c85c52de97fc30469890e88b39d04d02489d60c7740c95fb2d125696acdfe4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T06:40:49.331 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:48 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:48.877+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:49.331 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:48 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:48.877+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:49.331 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:48 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:48.877+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:49.439 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:49 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:49.224+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:49.439 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:49 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:49.224+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:49.439 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:49 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:49.224+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:40:49.439 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:49 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:49.224+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:40:49.453 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T06:40:49.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:49 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:49.238+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:49.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:49 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:49.238+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:10.427120+0000 front 2024-09-21T06:40:10.427298+0000 (oldest deadline 2024-09-21T06:40:35.726978+0000) 2024-09-21T06:40:49.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:49 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:49.238+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:19.828200+0000 front 2024-09-21T06:40:19.828097+0000 (oldest deadline 2024-09-21T06:40:43.928008+0000) 2024-09-21T06:40:49.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:49 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:49.290+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:49.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:49 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:49.290+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:49.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:49 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:49.290+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:49.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:49 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:49.290+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:40:49.534 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:40:49.535 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T06:40:49.535 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T06:40:49.535 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.7 2024-09-21T06:40:49.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:49 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:49.330+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:49.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:49 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:49.330+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:49.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:49 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:49.330+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:22.142473+0000 front 2024-09-21T06:40:22.142614+0000 (oldest deadline 2024-09-21T06:40:44.442495+0000) 2024-09-21T06:40:49.856 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:49 smithi071 systemd[1]: Stopping Ceph osd.7 for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:40:50.222 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:49 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:49.854+0000 7f3708a4d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:40:50.222 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:49 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:49.854+0000 7f3708a4d640 -1 osd.7 91 *** Got signal Terminated *** 2024-09-21T06:40:50.222 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:49 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:49.854+0000 7f3708a4d640 -1 osd.7 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:40:50.222 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:50 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:50.219+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:50.222 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:50 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:50.219+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:10.427120+0000 front 2024-09-21T06:40:10.427298+0000 (oldest deadline 2024-09-21T06:40:35.726978+0000) 2024-09-21T06:40:50.222 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:50 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:50.219+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:19.828200+0000 front 2024-09-21T06:40:19.828097+0000 (oldest deadline 2024-09-21T06:40:43.928008+0000) 2024-09-21T06:40:50.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:49 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:49.891+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:50.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:49 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:49.891+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:50.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:49 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:49.891+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:50.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:50 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:50.258+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:50.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:50 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:50.258+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:50.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:50 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:50.258+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:50.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:50 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:50.258+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:40:50.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:50 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:50.183+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:50.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:50 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:50.183+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:50.583 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:50 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:50.183+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:40:50.583 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:50 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:50.183+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:40:50.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:50 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:50.371+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:50.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:50 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:50.371+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:50.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:50 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:50.371+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:22.142473+0000 front 2024-09-21T06:40:22.142614+0000 (oldest deadline 2024-09-21T06:40:44.442495+0000) 2024-09-21T06:40:51.326 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:50 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:50.937+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:51.326 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:50 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:50.937+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:51.327 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:50 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:50.937+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:51.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:51 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:51.240+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:51.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:51 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:51.240+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:10.427120+0000 front 2024-09-21T06:40:10.427298+0000 (oldest deadline 2024-09-21T06:40:35.726978+0000) 2024-09-21T06:40:51.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:51 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:51.240+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:19.828200+0000 front 2024-09-21T06:40:19.828097+0000 (oldest deadline 2024-09-21T06:40:43.928008+0000) 2024-09-21T06:40:51.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:51 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:51.274+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:51.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:51 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:51.274+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:51.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:51 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:51.274+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:51.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:51 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:51.274+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:40:51.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:51 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:51.177+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:51.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:51 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:51.177+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:51.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:51 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:51.177+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:40:51.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:51 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:51.177+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:40:51.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:51 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:51.325+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:51.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:51 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:51.325+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:51.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:51 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:51.325+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:22.142473+0000 front 2024-09-21T06:40:22.142614+0000 (oldest deadline 2024-09-21T06:40:44.442495+0000) 2024-09-21T06:40:52.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:51 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:51.907+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:52.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:51 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:51.907+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:52.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:51 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:51.907+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:52.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:51 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:51.907+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:40:52.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:52 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:52.227+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:52.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:52 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:52.227+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:10.427120+0000 front 2024-09-21T06:40:10.427298+0000 (oldest deadline 2024-09-21T06:40:35.726978+0000) 2024-09-21T06:40:52.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:52 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:52.227+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:19.828200+0000 front 2024-09-21T06:40:19.828097+0000 (oldest deadline 2024-09-21T06:40:43.928008+0000) 2024-09-21T06:40:52.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:52 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:52.280+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:52.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:52 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:52.280+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:52.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:52 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:52.280+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:52.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:52 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:52.280+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:40:52.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:52 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:52.206+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:52.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:52 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:52.206+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:52.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:52 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:52.206+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:40:52.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:52 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:52.206+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:40:52.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:52 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:52.370+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:52.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:52 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:52.370+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:52.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:52 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:52.370+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:22.142473+0000 front 2024-09-21T06:40:22.142614+0000 (oldest deadline 2024-09-21T06:40:44.442495+0000) 2024-09-21T06:40:53.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:52 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:52.887+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:53.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:52 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:52.887+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:53.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:52 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:52.887+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:53.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:52 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:52.887+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:40:53.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:53 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:53.250+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:53.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:53 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:53.250+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:10.427120+0000 front 2024-09-21T06:40:10.427298+0000 (oldest deadline 2024-09-21T06:40:35.726978+0000) 2024-09-21T06:40:53.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:53 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:53.250+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:19.828200+0000 front 2024-09-21T06:40:19.828097+0000 (oldest deadline 2024-09-21T06:40:43.928008+0000) 2024-09-21T06:40:53.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:53 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:53.285+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:53.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:53 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:53.285+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:53.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:53 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:53.285+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:53.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:53 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:53.285+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:40:53.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:53 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:53.221+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:53.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:53 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:53.221+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:53.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:53 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:53.221+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:40:53.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:53 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:53.221+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:40:53.612 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:53 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:53.406+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:53.612 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:53 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:53.406+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:53.612 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:53 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:53.406+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:22.142473+0000 front 2024-09-21T06:40:22.142614+0000 (oldest deadline 2024-09-21T06:40:44.442495+0000) 2024-09-21T06:40:53.612 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:53 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:53.406+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:30.244048+0000 front 2024-09-21T06:40:30.243916+0000 (oldest deadline 2024-09-21T06:40:53.143837+0000) 2024-09-21T06:40:54.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:53 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:53.884+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:54.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:53 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:53.884+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:54.350 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:53 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:53.884+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:54.350 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:53 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:53.884+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:40:54.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:54 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:54.250+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.726291+0000 front 2024-09-21T06:40:05.726518+0000 (oldest deadline 2024-09-21T06:40:30.426464+0000) 2024-09-21T06:40:54.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:54 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:54.250+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:10.427120+0000 front 2024-09-21T06:40:10.427298+0000 (oldest deadline 2024-09-21T06:40:35.726978+0000) 2024-09-21T06:40:54.518 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:54 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7[52717]: 2024-09-21T06:40:54.250+0000 7f3705038640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:19.828200+0000 front 2024-09-21T06:40:19.828097+0000 (oldest deadline 2024-09-21T06:40:43.928008+0000) 2024-09-21T06:40:54.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:54 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:54.258+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:54.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:54 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:54.258+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:54.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:54 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:54.258+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:54.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:54 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:54.258+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:40:54.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:54 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:54.258+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:40:54.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:54 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:54.260+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:54.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:54 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:54.260+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:54.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:54 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:54.260+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:40:54.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:54 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:54.260+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:40:54.583 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:54 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:54.260+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.257895+0000 front 2024-09-21T06:40:29.257766+0000 (oldest deadline 2024-09-21T06:40:53.957705+0000) 2024-09-21T06:40:54.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:54 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:54.439+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:54.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:54 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:54.439+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:54.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:54 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:54.439+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:22.142473+0000 front 2024-09-21T06:40:22.142614+0000 (oldest deadline 2024-09-21T06:40:44.442495+0000) 2024-09-21T06:40:54.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:54 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:54.439+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:30.244048+0000 front 2024-09-21T06:40:30.243916+0000 (oldest deadline 2024-09-21T06:40:53.143837+0000) 2024-09-21T06:40:55.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:54 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:54.928+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:55.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:54 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:54.928+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:55.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:54 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:54.928+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:55.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:54 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:54.928+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:40:55.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:55 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:55.216+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:55.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:55 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:55.216+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:55.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:55 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:55.216+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:40:55.583 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:55 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:55.216+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:40:55.583 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:55 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:55.216+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.257895+0000 front 2024-09-21T06:40:29.257766+0000 (oldest deadline 2024-09-21T06:40:53.957705+0000) 2024-09-21T06:40:55.648 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:55 smithi071 podman[68516]: 2024-09-21 06:40:55.366505994 +0000 UTC m=+5.634987630 container died 2617a90ed8f9103e654b7e3e27d274ce9b0cf21137aaafa91d1e68e6b87028f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:40:55.648 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:55 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:55.295+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:55.648 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:55 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:55.295+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:55.648 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:55 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:55.295+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:55.648 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:55 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:55.295+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:40:55.648 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:55 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:55.295+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:40:55.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:55 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:55.398+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:55.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:55 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:55.398+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:55.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:55 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:55.398+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:22.142473+0000 front 2024-09-21T06:40:22.142614+0000 (oldest deadline 2024-09-21T06:40:44.442495+0000) 2024-09-21T06:40:55.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:55 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:55.398+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:30.244048+0000 front 2024-09-21T06:40:30.243916+0000 (oldest deadline 2024-09-21T06:40:53.143837+0000) 2024-09-21T06:40:56.006 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:55 smithi071 podman[68516]: 2024-09-21 06:40:55.74554127 +0000 UTC m=+6.014022904 container cleanup 2617a90ed8f9103e654b7e3e27d274ce9b0cf21137aaafa91d1e68e6b87028f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T06:40:56.006 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:55 smithi071 bash[68516]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7 2024-09-21T06:40:56.268 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:56 smithi071 podman[68531]: 2024-09-21 06:40:56.005428532 +0000 UTC m=+0.635938928 container remove 2617a90ed8f9103e654b7e3e27d274ce9b0cf21137aaafa91d1e68e6b87028f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T06:40:56.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:55 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:55.953+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:56.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:55 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:55.953+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:56.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:55 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:55.953+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:56.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:55 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:55.953+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:40:56.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:56 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:56.194+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:56.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:56 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:56.194+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:56.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:56 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:56.194+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:40:56.583 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:56 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:56.194+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:40:56.583 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:56 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:56.194+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.257895+0000 front 2024-09-21T06:40:29.257766+0000 (oldest deadline 2024-09-21T06:40:53.957705+0000) 2024-09-21T06:40:56.643 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:56 smithi071 podman[68621]: 2024-09-21 06:40:56.256170856 +0000 UTC m=+0.015965260 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:40:56.643 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:56 smithi071 podman[68621]: 2024-09-21 06:40:56.389635064 +0000 UTC m=+0.149429499 container create 8b7a378c44ca44b62873f1f9713a41d8c0e5aa9ae1bd61f2ecf61f9d52a12843 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T06:40:56.643 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:56 smithi071 podman[68621]: 2024-09-21 06:40:56.642432217 +0000 UTC m=+0.402226615 container init 8b7a378c44ca44b62873f1f9713a41d8c0e5aa9ae1bd61f2ecf61f9d52a12843 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T06:40:56.643 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:56 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:56.345+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:56.644 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:56 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:56.345+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:56.644 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:56 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:56.345+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:56.644 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:56 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:56.345+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:40:56.644 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:56 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:56.345+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:40:56.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:56 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:56.379+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:56.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:56 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:56.379+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:56.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:56 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:56.379+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:22.142473+0000 front 2024-09-21T06:40:22.142614+0000 (oldest deadline 2024-09-21T06:40:44.442495+0000) 2024-09-21T06:40:56.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:56 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:56.379+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:30.244048+0000 front 2024-09-21T06:40:30.243916+0000 (oldest deadline 2024-09-21T06:40:53.143837+0000) 2024-09-21T06:40:57.018 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:56 smithi071 podman[68621]: 2024-09-21 06:40:56.646330938 +0000 UTC m=+0.406125327 container start 8b7a378c44ca44b62873f1f9713a41d8c0e5aa9ae1bd61f2ecf61f9d52a12843 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-21T06:40:57.019 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:56 smithi071 podman[68621]: 2024-09-21 06:40:56.750637806 +0000 UTC m=+0.510432209 container attach 8b7a378c44ca44b62873f1f9713a41d8c0e5aa9ae1bd61f2ecf61f9d52a12843 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:40:57.019 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 21 06:40:56 smithi071 podman[68621]: 2024-09-21 06:40:56.836427833 +0000 UTC m=+0.596222226 container died 8b7a378c44ca44b62873f1f9713a41d8c0e5aa9ae1bd61f2ecf61f9d52a12843 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-7-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T06:40:57.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:56 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:56.963+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:57.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:56 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:56.963+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:57.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:56 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:56.963+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:57.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:56 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:56.963+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:40:57.505 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:57 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:57.346+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:57.505 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:57 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:57.346+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:57.505 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:57 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:57.346+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:57.505 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:57 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:57.346+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:40:57.505 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:57 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:57.346+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:40:57.527 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T06:40:57.566 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:40:57.566 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T06:40:57.566 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T06:40:57.566 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.8 2024-09-21T06:40:57.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:57 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:57.147+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:57.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:57 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:57.147+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:57.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:57 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:57.147+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:40:57.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:57 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:57.147+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:40:57.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:57 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:57.147+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.257895+0000 front 2024-09-21T06:40:29.257766+0000 (oldest deadline 2024-09-21T06:40:53.957705+0000) 2024-09-21T06:40:57.850 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:57 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:57.390+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:57.850 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:57 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:57.390+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:57.850 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:57 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:57.390+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:22.142473+0000 front 2024-09-21T06:40:22.142614+0000 (oldest deadline 2024-09-21T06:40:44.442495+0000) 2024-09-21T06:40:57.850 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:57 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:57.390+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:30.244048+0000 front 2024-09-21T06:40:30.243916+0000 (oldest deadline 2024-09-21T06:40:53.143837+0000) 2024-09-21T06:40:57.850 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:57 smithi175 systemd[1]: Stopping Ceph osd.8 for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:40:58.349 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:57 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:57.890+0000 7f04ea4bd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:40:58.349 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:57 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:57.890+0000 7f04ea4bd640 -1 osd.8 91 *** Got signal Terminated *** 2024-09-21T06:40:58.349 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:57 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:57.890+0000 7f04ea4bd640 -1 osd.8 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:40:58.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:57 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:57.965+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:58.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:57 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:57.965+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:58.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:57 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:57.965+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:58.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:57 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:57.965+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:40:58.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:58 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:58.164+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:58.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:58 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:58.164+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:58.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:58 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:58.164+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:40:58.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:58 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:58.164+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:40:58.583 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:58 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:58.164+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.257895+0000 front 2024-09-21T06:40:29.257766+0000 (oldest deadline 2024-09-21T06:40:53.957705+0000) 2024-09-21T06:40:58.727 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:58 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:58.327+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:58.727 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:58 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:58.327+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:58.727 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:58 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:58.327+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:58.727 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:58 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:58.327+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:40:58.728 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:58 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:58.327+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:40:58.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:58 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:58.366+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:58.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:58 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:58.366+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:58.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:58 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:58.366+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:22.142473+0000 front 2024-09-21T06:40:22.142614+0000 (oldest deadline 2024-09-21T06:40:44.442495+0000) 2024-09-21T06:40:58.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:58 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:58.366+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:30.244048+0000 front 2024-09-21T06:40:30.243916+0000 (oldest deadline 2024-09-21T06:40:53.143837+0000) 2024-09-21T06:40:59.346 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:58 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:58.959+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:40:59.346 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:58 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:58.959+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:40:59.346 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:58 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:58.959+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:40:59.346 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:58 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:58.959+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:40:59.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:59 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:59.155+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:40:59.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:59 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:59.155+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:40:59.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:59 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:59.155+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:40:59.583 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:59 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:59.155+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:40:59.583 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:40:59 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:40:59.155+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.257895+0000 front 2024-09-21T06:40:29.257766+0000 (oldest deadline 2024-09-21T06:40:53.957705+0000) 2024-09-21T06:40:59.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:59 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:59.343+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:40:59.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:59 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:59.343+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:40:59.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:59 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:59.343+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:22.142473+0000 front 2024-09-21T06:40:22.142614+0000 (oldest deadline 2024-09-21T06:40:44.442495+0000) 2024-09-21T06:40:59.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:40:59 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:40:59.343+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:30.244048+0000 front 2024-09-21T06:40:30.243916+0000 (oldest deadline 2024-09-21T06:40:53.143837+0000) 2024-09-21T06:40:59.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:59 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:59.365+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:40:59.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:59 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:59.365+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:40:59.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:59 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:59.365+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:40:59.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:59 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:59.365+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:40:59.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:40:59 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:40:59.365+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:41:00.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:59 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:59.988+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:00.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:59 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:59.988+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:00.350 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:59 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:59.988+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:00.350 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:59 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:59.988+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:00.350 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:40:59 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:40:59.988+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:00.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:00 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:00.181+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:41:00.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:00 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:00.181+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:41:00.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:00 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:00.181+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:41:00.583 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:00 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:00.181+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:41:00.583 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:00 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:00.181+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.257895+0000 front 2024-09-21T06:40:29.257766+0000 (oldest deadline 2024-09-21T06:40:53.957705+0000) 2024-09-21T06:41:00.670 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:00 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:00.361+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:41:00.670 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:00 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:00.361+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:41:00.670 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:00 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:00.361+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:41:00.670 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:00 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:00.361+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:41:00.670 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:00 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:00.361+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:41:00.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:00 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:41:00.366+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:41:00.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:00 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:41:00.366+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:41:00.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:00 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:41:00.366+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:22.142473+0000 front 2024-09-21T06:40:22.142614+0000 (oldest deadline 2024-09-21T06:40:44.442495+0000) 2024-09-21T06:41:00.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:00 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:41:00.366+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:30.244048+0000 front 2024-09-21T06:40:30.243916+0000 (oldest deadline 2024-09-21T06:40:53.143837+0000) 2024-09-21T06:41:01.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:00 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:00.973+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:01.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:00 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:00.973+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:01.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:00 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:00.973+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:01.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:00 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:00.973+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:01.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:00 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:00.973+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:01.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:01 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:01.220+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:41:01.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:01 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:01.220+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:41:01.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:01 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:01.220+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:41:01.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:01 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:01.220+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:41:01.583 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:01 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:01.220+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.257895+0000 front 2024-09-21T06:40:29.257766+0000 (oldest deadline 2024-09-21T06:40:53.957705+0000) 2024-09-21T06:41:01.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:01.396+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:41:01.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:01.396+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:41:01.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:01.396+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:41:01.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:01.396+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:41:01.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:01 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:01.396+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:41:01.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:01 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:41:01.390+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:41:01.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:01 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:41:01.390+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:41:01.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:01 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:41:01.390+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:22.142473+0000 front 2024-09-21T06:40:22.142614+0000 (oldest deadline 2024-09-21T06:40:44.442495+0000) 2024-09-21T06:41:01.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:01 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:41:01.390+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:30.244048+0000 front 2024-09-21T06:40:30.243916+0000 (oldest deadline 2024-09-21T06:40:53.143837+0000) 2024-09-21T06:41:01.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:01 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:41:01.390+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.945486+0000 front 2024-09-21T06:40:38.945661+0000 (oldest deadline 2024-09-21T06:41:00.545955+0000) 2024-09-21T06:41:02.343 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:01 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:01.966+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:02.344 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:01 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:01.966+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:02.344 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:01 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:01.966+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:02.344 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:01 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:01.966+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:02.344 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:01 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:01.966+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:02.484 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:02 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:02.175+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:41:02.484 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:02 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:02.175+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:41:02.484 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:02 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:02.175+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:41:02.484 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:02 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:02.175+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:41:02.484 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:02 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:02.175+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.257895+0000 front 2024-09-21T06:40:29.257766+0000 (oldest deadline 2024-09-21T06:40:53.957705+0000) 2024-09-21T06:41:02.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:02 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:41:02.341+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.438862+0000 front 2024-09-21T06:40:05.438712+0000 (oldest deadline 2024-09-21T06:40:31.839434+0000) 2024-09-21T06:41:02.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:02 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:41:02.341+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.040944+0000 front 2024-09-21T06:40:14.040987+0000 (oldest deadline 2024-09-21T06:40:35.741110+0000) 2024-09-21T06:41:02.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:02 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:41:02.341+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:22.142473+0000 front 2024-09-21T06:40:22.142614+0000 (oldest deadline 2024-09-21T06:40:44.442495+0000) 2024-09-21T06:41:02.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:02 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:41:02.341+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:30.244048+0000 front 2024-09-21T06:40:30.243916+0000 (oldest deadline 2024-09-21T06:40:53.143837+0000) 2024-09-21T06:41:02.599 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:02 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8[52066]: 2024-09-21T06:41:02.341+0000 7f04e2aa0640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.945486+0000 front 2024-09-21T06:40:38.945661+0000 (oldest deadline 2024-09-21T06:41:00.545955+0000) 2024-09-21T06:41:02.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:02 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:02.404+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:41:02.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:02 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:02.404+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:41:02.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:02 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:02.404+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:41:02.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:02 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:02.404+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:41:02.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:02 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:02.404+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:41:03.306 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:03 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:03.006+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:03.307 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:03 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:03.006+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:03.307 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:03 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:03.006+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:03.307 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:03 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:03.006+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:03.307 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:03 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:03.006+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:03.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:03 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:03.150+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:41:03.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:03 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:03.150+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:41:03.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:03 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:03.150+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:41:03.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:03 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:03.150+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:41:03.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:03 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:03.150+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.257895+0000 front 2024-09-21T06:40:29.257766+0000 (oldest deadline 2024-09-21T06:40:53.957705+0000) 2024-09-21T06:41:03.585 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:03 smithi175 podman[67940]: 2024-09-21 06:41:03.305498389 +0000 UTC m=+5.542027455 container died 64f817ea9af32e129c4b36f4ff69c116eb658bc7ff8a9b3769444364024c500f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T06:41:03.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:03 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:03.429+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:41:03.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:03 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:03.429+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:41:03.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:03 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:03.429+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:41:03.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:03 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:03.429+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:41:03.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:03 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:03.429+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:41:03.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:03 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:03.429+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.218725+0000 front 2024-09-21T06:40:38.218699+0000 (oldest deadline 2024-09-21T06:41:02.918576+0000) 2024-09-21T06:41:03.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:03 smithi175 podman[67940]: 2024-09-21 06:41:03.691561939 +0000 UTC m=+5.928091001 container cleanup 64f817ea9af32e129c4b36f4ff69c116eb658bc7ff8a9b3769444364024c500f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True) 2024-09-21T06:41:03.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:03 smithi175 bash[67940]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8 2024-09-21T06:41:04.302 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:03 smithi175 podman[67955]: 2024-09-21 06:41:03.942877201 +0000 UTC m=+0.636029109 container remove 64f817ea9af32e129c4b36f4ff69c116eb658bc7ff8a9b3769444364024c500f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:41:04.303 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:03 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:03.983+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:04.303 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:03 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:03.983+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:04.303 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:03 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:03.983+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:04.303 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:03 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:03.983+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:04.304 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:03 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:03.983+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:04.555 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:04 smithi175 podman[68044]: 2024-09-21 06:41:04.204207687 +0000 UTC m=+0.015846610 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:41:04.555 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:04 smithi175 podman[68044]: 2024-09-21 06:41:04.301776801 +0000 UTC m=+0.113415718 container create 84d1f4bde87f5d65b4b2dc3b79ab634870729030870f2cc4d5fa4cfb1dfe85eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T06:41:04.555 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:04 smithi175 podman[68044]: 2024-09-21 06:41:04.554413836 +0000 UTC m=+0.366052752 container init 84d1f4bde87f5d65b4b2dc3b79ab634870729030870f2cc4d5fa4cfb1dfe85eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:41:04.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:04 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:04.140+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:41:04.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:04 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:04.140+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:41:04.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:04 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:04.140+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:41:04.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:04 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:04.140+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:41:04.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:04 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:04.140+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.257895+0000 front 2024-09-21T06:40:29.257766+0000 (oldest deadline 2024-09-21T06:40:53.957705+0000) 2024-09-21T06:41:04.582 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:04 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:04.140+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.559257+0000 front 2024-09-21T06:40:38.559116+0000 (oldest deadline 2024-09-21T06:41:03.858998+0000) 2024-09-21T06:41:04.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:04 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:04.414+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:41:04.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:04 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:04.414+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:41:04.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:04 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:04.414+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:41:04.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:04 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:04.414+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:41:04.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:04 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:04.414+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:41:04.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:04 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:04.414+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.218725+0000 front 2024-09-21T06:40:38.218699+0000 (oldest deadline 2024-09-21T06:41:02.918576+0000) 2024-09-21T06:41:04.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:04 smithi175 podman[68044]: 2024-09-21 06:41:04.55770398 +0000 UTC m=+0.369342900 container start 84d1f4bde87f5d65b4b2dc3b79ab634870729030870f2cc4d5fa4cfb1dfe85eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T06:41:04.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:04 smithi175 podman[68044]: 2024-09-21 06:41:04.663204112 +0000 UTC m=+0.474843047 container attach 84d1f4bde87f5d65b4b2dc3b79ab634870729030870f2cc4d5fa4cfb1dfe85eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:41:04.849 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 06:41:04 smithi175 podman[68044]: 2024-09-21 06:41:04.761229897 +0000 UTC m=+0.572868823 container died 84d1f4bde87f5d65b4b2dc3b79ab634870729030870f2cc4d5fa4cfb1dfe85eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T06:41:05.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:04 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:04.992+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:05.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:04 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:04.993+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:05.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:04 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:04.993+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:05.350 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:04 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:04.993+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:05.350 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:04 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:04.993+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:05.440 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T06:41:05.485 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:41:05.485 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T06:41:05.486 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T06:41:05.486 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.9 2024-09-21T06:41:05.525 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:05 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:05.109+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:41:05.526 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:05 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:05.109+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:41:05.526 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:05 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:05.109+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:41:05.526 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:05 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:05.109+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:41:05.526 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:05 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:05.109+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.257895+0000 front 2024-09-21T06:40:29.257766+0000 (oldest deadline 2024-09-21T06:40:53.957705+0000) 2024-09-21T06:41:05.526 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:05 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:05.109+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.559257+0000 front 2024-09-21T06:40:38.559116+0000 (oldest deadline 2024-09-21T06:41:03.858998+0000) 2024-09-21T06:41:05.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:05 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:05.427+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:41:05.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:05 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:05.427+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:41:05.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:05 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:05.427+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:41:05.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:05 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:05.427+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:41:05.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:05 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:05.427+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:41:05.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:05 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:05.427+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.218725+0000 front 2024-09-21T06:40:38.218699+0000 (oldest deadline 2024-09-21T06:41:02.918576+0000) 2024-09-21T06:41:05.832 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:05 smithi063 systemd[1]: Stopping Ceph osd.9 for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:41:06.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:05 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:05.949+0000 7fcf3d8c2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:41:06.333 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:05 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:05.949+0000 7fcf3d8c2640 -1 osd.9 91 *** Got signal Terminated *** 2024-09-21T06:41:06.333 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:05 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:05.949+0000 7fcf3d8c2640 -1 osd.9 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:41:06.333 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:06 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:06.068+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:41:06.333 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:06 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:06.068+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:41:06.333 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:06 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:06.068+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:41:06.333 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:06 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:06.068+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:41:06.333 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:06 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:06.068+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.257895+0000 front 2024-09-21T06:40:29.257766+0000 (oldest deadline 2024-09-21T06:40:53.957705+0000) 2024-09-21T06:41:06.333 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:06 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:06.068+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.559257+0000 front 2024-09-21T06:40:38.559116+0000 (oldest deadline 2024-09-21T06:41:03.858998+0000) 2024-09-21T06:41:06.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:05 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:05.989+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:06.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:05 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:05.989+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:06.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:05 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:05.989+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:06.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:05 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:05.989+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:06.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:05 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:05.989+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:06.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:06 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:06.464+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:41:06.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:06 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:06.464+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:41:06.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:06 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:06.464+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:41:06.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:06 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:06.464+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:41:06.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:06 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:06.464+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:41:06.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:06 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:06.464+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.218725+0000 front 2024-09-21T06:40:38.218699+0000 (oldest deadline 2024-09-21T06:41:02.918576+0000) 2024-09-21T06:41:07.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:07 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:07.027+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:41:07.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:07 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:07.027+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:41:07.333 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:07 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:07.027+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:41:07.333 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:07 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:07.027+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:41:07.333 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:07 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:07.027+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.257895+0000 front 2024-09-21T06:40:29.257766+0000 (oldest deadline 2024-09-21T06:40:53.957705+0000) 2024-09-21T06:41:07.333 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:07 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:07.027+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.559257+0000 front 2024-09-21T06:40:38.559116+0000 (oldest deadline 2024-09-21T06:41:03.858998+0000) 2024-09-21T06:41:07.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:06 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:06.963+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:07.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:06 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:06.963+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:07.350 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:06 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:06.963+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:07.350 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:06 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:06.963+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:07.350 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:06 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:06.963+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:07.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:07 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:07.435+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:41:07.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:07 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:07.435+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:41:07.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:07 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:07.435+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:41:07.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:07 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:07.435+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:41:07.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:07 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:07.435+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:41:07.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:07 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:07.435+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.218725+0000 front 2024-09-21T06:40:38.218699+0000 (oldest deadline 2024-09-21T06:41:02.918576+0000) 2024-09-21T06:41:08.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:08 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:08.015+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:41:08.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:08 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:08.015+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:41:08.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:08 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:08.015+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:41:08.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:08 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:08.015+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:41:08.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:08 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:08.015+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.257895+0000 front 2024-09-21T06:40:29.257766+0000 (oldest deadline 2024-09-21T06:40:53.957705+0000) 2024-09-21T06:41:08.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:08 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:08.015+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.559257+0000 front 2024-09-21T06:40:38.559116+0000 (oldest deadline 2024-09-21T06:41:03.858998+0000) 2024-09-21T06:41:08.333 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:08 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:08.015+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:43.859401+0000 front 2024-09-21T06:40:43.859423+0000 (oldest deadline 2024-09-21T06:41:07.959378+0000) 2024-09-21T06:41:08.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:07 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:07.949+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:08.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:07 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:07.949+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:08.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:07 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:07.949+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:08.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:07 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:07.949+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:08.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:07 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:07.949+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:08.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:08 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:08.386+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:41:08.518 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:08 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:08.386+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:41:08.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:08 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:08.386+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:41:08.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:08 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:08.386+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:41:08.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:08 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:08.386+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:41:08.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:08 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:08.386+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.218725+0000 front 2024-09-21T06:40:38.218699+0000 (oldest deadline 2024-09-21T06:41:02.918576+0000) 2024-09-21T06:41:08.519 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:08 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:08.386+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:45.819639+0000 front 2024-09-21T06:40:45.819589+0000 (oldest deadline 2024-09-21T06:41:07.519579+0000) 2024-09-21T06:41:09.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:08 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:08.992+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:41:09.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:08 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:08.992+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:41:09.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:08 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:08.992+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:41:09.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:08 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:08.992+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:41:09.333 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:08 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:08.992+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.257895+0000 front 2024-09-21T06:40:29.257766+0000 (oldest deadline 2024-09-21T06:40:53.957705+0000) 2024-09-21T06:41:09.333 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:08 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:08.992+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.559257+0000 front 2024-09-21T06:40:38.559116+0000 (oldest deadline 2024-09-21T06:41:03.858998+0000) 2024-09-21T06:41:09.333 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:08 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:08.992+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:43.859401+0000 front 2024-09-21T06:40:43.859423+0000 (oldest deadline 2024-09-21T06:41:07.959378+0000) 2024-09-21T06:41:09.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:08 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:08.983+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:09.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:08 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:08.983+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:09.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:08 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:08.983+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:09.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:08 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:08.983+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:09.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:08 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:08.983+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:09.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:09 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:09.354+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:41:09.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:09 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:09.354+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:41:09.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:09 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:09.354+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:41:09.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:09 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:09.354+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:41:09.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:09 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:09.354+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:41:09.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:09 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:09.354+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.218725+0000 front 2024-09-21T06:40:38.218699+0000 (oldest deadline 2024-09-21T06:41:02.918576+0000) 2024-09-21T06:41:09.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:09 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:09.354+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:45.819639+0000 front 2024-09-21T06:40:45.819589+0000 (oldest deadline 2024-09-21T06:41:07.519579+0000) 2024-09-21T06:41:10.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:09 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:09.963+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:41:10.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:09 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:09.963+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:41:10.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:09 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:09.963+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:41:10.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:09 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:09.963+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:41:10.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:09 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:09.963+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.257895+0000 front 2024-09-21T06:40:29.257766+0000 (oldest deadline 2024-09-21T06:40:53.957705+0000) 2024-09-21T06:41:10.333 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:09 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:09.963+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.559257+0000 front 2024-09-21T06:40:38.559116+0000 (oldest deadline 2024-09-21T06:41:03.858998+0000) 2024-09-21T06:41:10.333 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:09 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:09.963+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:43.859401+0000 front 2024-09-21T06:40:43.859423+0000 (oldest deadline 2024-09-21T06:41:07.959378+0000) 2024-09-21T06:41:10.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:09 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:09.941+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:10.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:09 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:09.941+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:10.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:09 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:09.941+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:10.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:09 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:09.941+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:10.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:09 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:09.941+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:10.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:10 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:10.374+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:41:10.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:10 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:10.374+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:41:10.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:10 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:10.374+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:41:10.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:10 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:10.374+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:41:10.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:10 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:10.374+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:41:10.769 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:10 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:10.374+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.218725+0000 front 2024-09-21T06:40:38.218699+0000 (oldest deadline 2024-09-21T06:41:02.918576+0000) 2024-09-21T06:41:10.769 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:10 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:10.374+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:45.819639+0000 front 2024-09-21T06:40:45.819589+0000 (oldest deadline 2024-09-21T06:41:07.519579+0000) 2024-09-21T06:41:11.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:10 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:10.928+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:58.451900+0000 front 2024-09-21T06:39:58.452132+0000 (oldest deadline 2024-09-21T06:40:22.552089+0000) 2024-09-21T06:41:11.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:10 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:10.928+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:02.552981+0000 front 2024-09-21T06:40:02.552769+0000 (oldest deadline 2024-09-21T06:40:28.452784+0000) 2024-09-21T06:41:11.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:10 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:10.928+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:14.755211+0000 front 2024-09-21T06:40:14.755080+0000 (oldest deadline 2024-09-21T06:40:40.055013+0000) 2024-09-21T06:41:11.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:10 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:10.928+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:21.656644+0000 front 2024-09-21T06:40:21.656463+0000 (oldest deadline 2024-09-21T06:40:44.556488+0000) 2024-09-21T06:41:11.332 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:10 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:10.928+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.257895+0000 front 2024-09-21T06:40:29.257766+0000 (oldest deadline 2024-09-21T06:40:53.957705+0000) 2024-09-21T06:41:11.333 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:10 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:10.928+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.559257+0000 front 2024-09-21T06:40:38.559116+0000 (oldest deadline 2024-09-21T06:41:03.858998+0000) 2024-09-21T06:41:11.333 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:10 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9[66469]: 2024-09-21T06:41:10.928+0000 7fcf35ea5640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:43.859401+0000 front 2024-09-21T06:40:43.859423+0000 (oldest deadline 2024-09-21T06:41:07.959378+0000) 2024-09-21T06:41:11.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:10 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:10.961+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:11.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:10 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:10.961+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:11.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:10 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:10.961+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:11.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:10 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:10.961+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:11.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:10 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:10.961+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:11.743 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:11 smithi063 podman[125893]: 2024-09-21 06:41:11.340562565 +0000 UTC m=+5.645822685 container died dde69757cb0b0a8d67b2825a54f172eb3f70ce9306f1bf40b5d4bddbf3d66ebf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T06:41:11.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:11 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:11.402+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:41:11.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:11 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:11.402+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:41:11.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:11 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:11.402+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:41:11.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:11 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:11.402+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:41:11.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:11 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:11.402+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:41:11.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:11 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:11.402+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.218725+0000 front 2024-09-21T06:40:38.218699+0000 (oldest deadline 2024-09-21T06:41:02.918576+0000) 2024-09-21T06:41:11.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:11 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:11.402+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:45.819639+0000 front 2024-09-21T06:40:45.819589+0000 (oldest deadline 2024-09-21T06:41:07.519579+0000) 2024-09-21T06:41:12.082 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:11 smithi063 podman[125893]: 2024-09-21 06:41:11.907782288 +0000 UTC m=+6.213042407 container cleanup dde69757cb0b0a8d67b2825a54f172eb3f70ce9306f1bf40b5d4bddbf3d66ebf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:41:12.082 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:11 smithi063 bash[125893]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9 2024-09-21T06:41:12.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:11 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:11.950+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:12.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:11 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:11.950+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:12.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:11 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:11.950+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:12.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:11 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:11.950+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:12.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:11 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:11.950+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:12.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:11 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:11.950+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:46.924640+0000 front 2024-09-21T06:40:46.924521+0000 (oldest deadline 2024-09-21T06:41:11.624425+0000) 2024-09-21T06:41:12.542 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:12 smithi063 podman[125908]: 2024-09-21 06:41:12.175817514 +0000 UTC m=+0.829060435 container remove dde69757cb0b0a8d67b2825a54f172eb3f70ce9306f1bf40b5d4bddbf3d66ebf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:41:12.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:12 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:12.446+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:41:12.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:12 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:12.446+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:41:12.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:12 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:12.446+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:41:12.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:12 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:12.446+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:41:12.769 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:12 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:12.446+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:41:12.769 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:12 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:12.446+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.218725+0000 front 2024-09-21T06:40:38.218699+0000 (oldest deadline 2024-09-21T06:41:02.918576+0000) 2024-09-21T06:41:12.769 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:12 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:12.446+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:45.819639+0000 front 2024-09-21T06:40:45.819589+0000 (oldest deadline 2024-09-21T06:41:07.519579+0000) 2024-09-21T06:41:12.832 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:12 smithi063 podman[125996]: 2024-09-21 06:41:12.443748706 +0000 UTC m=+0.016308058 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:41:12.832 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:12 smithi063 podman[125996]: 2024-09-21 06:41:12.543086253 +0000 UTC m=+0.115645604 container create 971408eb0177e2690f3ba801558ea41b7d7f3b366d519e1465618012498c3559 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:41:12.832 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:12 smithi063 podman[125996]: 2024-09-21 06:41:12.762212251 +0000 UTC m=+0.334771612 container init 971408eb0177e2690f3ba801558ea41b7d7f3b366d519e1465618012498c3559 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T06:41:12.832 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:12 smithi063 podman[125996]: 2024-09-21 06:41:12.765624334 +0000 UTC m=+0.338183686 container start 971408eb0177e2690f3ba801558ea41b7d7f3b366d519e1465618012498c3559 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:41:13.263 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:12 smithi063 podman[125996]: 2024-09-21 06:41:12.837162875 +0000 UTC m=+0.409722226 container attach 971408eb0177e2690f3ba801558ea41b7d7f3b366d519e1465618012498c3559 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T06:41:13.263 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 21 06:41:12 smithi063 podman[125996]: 2024-09-21 06:41:12.961347502 +0000 UTC m=+0.533906859 container died 971408eb0177e2690f3ba801558ea41b7d7f3b366d519e1465618012498c3559 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-9-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T06:41:13.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:12 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:12.932+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:13.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:12 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:12.932+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:13.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:12 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:12.932+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:13.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:12 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:12.932+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:13.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:12 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:12.932+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:13.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:12 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:12.932+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:46.924640+0000 front 2024-09-21T06:40:46.924521+0000 (oldest deadline 2024-09-21T06:41:11.624425+0000) 2024-09-21T06:41:13.643 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T06:41:13.726 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:41:13.726 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T06:41:13.727 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T06:41:13.727 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.10 2024-09-21T06:41:13.753 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:13 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:13.424+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:41:13.753 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:13 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:13.424+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:41:13.753 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:13 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:13.424+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:41:13.754 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:13 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:13.424+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:41:13.754 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:13 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:13.424+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:41:13.754 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:13 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:13.424+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.218725+0000 front 2024-09-21T06:40:38.218699+0000 (oldest deadline 2024-09-21T06:41:02.918576+0000) 2024-09-21T06:41:13.754 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:13 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:13.424+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:45.819639+0000 front 2024-09-21T06:40:45.819589+0000 (oldest deadline 2024-09-21T06:41:07.519579+0000) 2024-09-21T06:41:14.018 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:13 smithi071 systemd[1]: Stopping Ceph osd.10 for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:41:14.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:13 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:13.929+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:14.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:13 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:13.929+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:14.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:13 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:13.929+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:14.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:13 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:13.929+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:14.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:13 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:13.929+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:14.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:13 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:13.929+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:46.924640+0000 front 2024-09-21T06:40:46.924521+0000 (oldest deadline 2024-09-21T06:41:11.624425+0000) 2024-09-21T06:41:14.447 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:14 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:14.047+0000 7fed549f5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:41:14.448 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:14 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:14.047+0000 7fed549f5640 -1 osd.10 91 *** Got signal Terminated *** 2024-09-21T06:41:14.448 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:14 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:14.047+0000 7fed549f5640 -1 osd.10 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:41:14.448 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:14 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:14.446+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:41:14.448 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:14 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:14.446+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:41:14.448 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:14 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:14.446+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:41:14.448 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:14 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:14.446+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:41:14.448 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:14 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:14.446+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:41:14.448 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:14 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:14.446+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.218725+0000 front 2024-09-21T06:40:38.218699+0000 (oldest deadline 2024-09-21T06:41:02.918576+0000) 2024-09-21T06:41:14.448 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:14 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:14.446+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:45.819639+0000 front 2024-09-21T06:40:45.819589+0000 (oldest deadline 2024-09-21T06:41:07.519579+0000) 2024-09-21T06:41:15.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:14 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:14.883+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:15.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:14 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:14.883+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:15.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:14 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:14.883+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:15.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:14 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:14.883+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:15.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:14 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:14.883+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:15.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:14 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:14.883+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:46.924640+0000 front 2024-09-21T06:40:46.924521+0000 (oldest deadline 2024-09-21T06:41:11.624425+0000) 2024-09-21T06:41:15.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:15 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:15.437+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:41:15.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:15 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:15.437+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:41:15.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:15 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:15.437+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:41:15.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:15 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:15.437+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:41:15.769 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:15 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:15.437+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:41:15.769 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:15 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:15.437+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.218725+0000 front 2024-09-21T06:40:38.218699+0000 (oldest deadline 2024-09-21T06:41:02.918576+0000) 2024-09-21T06:41:15.769 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:15 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:15.437+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:45.819639+0000 front 2024-09-21T06:40:45.819589+0000 (oldest deadline 2024-09-21T06:41:07.519579+0000) 2024-09-21T06:41:16.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:15 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:15.844+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:16.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:15 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:15.844+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:16.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:15 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:15.844+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:16.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:15 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:15.844+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:16.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:15 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:15.844+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:16.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:15 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:15.844+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:46.924640+0000 front 2024-09-21T06:40:46.924521+0000 (oldest deadline 2024-09-21T06:41:11.624425+0000) 2024-09-21T06:41:16.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:16 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:16.437+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:41:16.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:16 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:16.437+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:41:16.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:16 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:16.437+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:41:16.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:16 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:16.437+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:41:16.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:16 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:16.437+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:41:16.769 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:16 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:16.437+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.218725+0000 front 2024-09-21T06:40:38.218699+0000 (oldest deadline 2024-09-21T06:41:02.918576+0000) 2024-09-21T06:41:16.769 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:16 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:16.437+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:45.819639+0000 front 2024-09-21T06:40:45.819589+0000 (oldest deadline 2024-09-21T06:41:07.519579+0000) 2024-09-21T06:41:17.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:16 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:16.837+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:17.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:16 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:16.837+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:17.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:16 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:16.837+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:17.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:16 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:16.837+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:17.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:16 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:16.837+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:17.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:16 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:16.837+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:46.924640+0000 front 2024-09-21T06:40:46.924521+0000 (oldest deadline 2024-09-21T06:41:11.624425+0000) 2024-09-21T06:41:17.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:17 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:17.440+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:41:17.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:17 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:17.440+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:41:17.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:17 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:17.440+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:41:17.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:17 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:17.440+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:41:17.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:17 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:17.440+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:41:17.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:17 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:17.440+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.218725+0000 front 2024-09-21T06:40:38.218699+0000 (oldest deadline 2024-09-21T06:41:02.918576+0000) 2024-09-21T06:41:17.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:17 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:17.440+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:45.819639+0000 front 2024-09-21T06:40:45.819589+0000 (oldest deadline 2024-09-21T06:41:07.519579+0000) 2024-09-21T06:41:18.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:17 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:17.787+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:18.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:17 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:17.787+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:18.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:17 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:17.787+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:18.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:17 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:17.787+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:18.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:17 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:17.787+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:18.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:17 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:17.787+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:46.924640+0000 front 2024-09-21T06:40:46.924521+0000 (oldest deadline 2024-09-21T06:41:11.624425+0000) 2024-09-21T06:41:18.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:17 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:17.787+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-21T06:40:52.125465+0000 front 2024-09-21T06:40:52.125488+0000 (oldest deadline 2024-09-21T06:41:17.425362+0000) 2024-09-21T06:41:18.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:18 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:18.463+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:54.512738+0000 front 2024-09-21T06:39:54.512555+0000 (oldest deadline 2024-09-21T06:40:19.812629+0000) 2024-09-21T06:41:18.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:18 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:18.463+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:05.713451+0000 front 2024-09-21T06:40:05.713493+0000 (oldest deadline 2024-09-21T06:40:28.613545+0000) 2024-09-21T06:41:18.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:18 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:18.463+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:12.615246+0000 front 2024-09-21T06:40:12.615086+0000 (oldest deadline 2024-09-21T06:40:37.314879+0000) 2024-09-21T06:41:18.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:18 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:18.463+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-21T06:40:20.215822+0000 front 2024-09-21T06:40:20.216017+0000 (oldest deadline 2024-09-21T06:40:45.515717+0000) 2024-09-21T06:41:18.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:18 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:18.463+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.516974+0000 front 2024-09-21T06:40:29.517009+0000 (oldest deadline 2024-09-21T06:40:53.617026+0000) 2024-09-21T06:41:18.768 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:18 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:18.463+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:38.218725+0000 front 2024-09-21T06:40:38.218699+0000 (oldest deadline 2024-09-21T06:41:02.918576+0000) 2024-09-21T06:41:18.769 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:18 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10[59092]: 2024-09-21T06:41:18.463+0000 7fed4cfd8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:45.819639+0000 front 2024-09-21T06:40:45.819589+0000 (oldest deadline 2024-09-21T06:41:07.519579+0000) 2024-09-21T06:41:19.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:18 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:18.740+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:19.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:18 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:18.740+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:19.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:18 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:18.740+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:19.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:18 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:18.740+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:19.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:18 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:18.740+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:19.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:18 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:18.740+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:46.924640+0000 front 2024-09-21T06:40:46.924521+0000 (oldest deadline 2024-09-21T06:41:11.624425+0000) 2024-09-21T06:41:19.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:18 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:18.740+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-21T06:40:52.125465+0000 front 2024-09-21T06:40:52.125488+0000 (oldest deadline 2024-09-21T06:41:17.425362+0000) 2024-09-21T06:41:19.789 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:19 smithi071 podman[68734]: 2024-09-21 06:41:19.525225726 +0000 UTC m=+5.601752303 container died f386418cbbed6bd877912a7594e92fea18dfc58117b6aa8d13f608a8f140e5de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T06:41:20.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:19 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:19.782+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:20.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:19 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:19.782+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:20.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:19 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:19.782+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:20.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:19 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:19.782+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:20.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:19 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:19.782+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:20.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:19 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:19.782+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:46.924640+0000 front 2024-09-21T06:40:46.924521+0000 (oldest deadline 2024-09-21T06:41:11.624425+0000) 2024-09-21T06:41:20.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:19 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:19.782+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-21T06:40:52.125465+0000 front 2024-09-21T06:40:52.125488+0000 (oldest deadline 2024-09-21T06:41:17.425362+0000) 2024-09-21T06:41:20.164 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:19 smithi071 podman[68734]: 2024-09-21 06:41:19.887464503 +0000 UTC m=+5.963991080 container cleanup f386418cbbed6bd877912a7594e92fea18dfc58117b6aa8d13f608a8f140e5de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T06:41:20.164 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:19 smithi071 bash[68734]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10 2024-09-21T06:41:20.492 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:20 smithi071 podman[68751]: 2024-09-21 06:41:20.163624533 +0000 UTC m=+0.634808598 container remove f386418cbbed6bd877912a7594e92fea18dfc58117b6aa8d13f608a8f140e5de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:41:20.750 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:20 smithi071 podman[68836]: 2024-09-21 06:41:20.393433374 +0000 UTC m=+0.015423758 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:41:20.751 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:20 smithi071 podman[68836]: 2024-09-21 06:41:20.506086849 +0000 UTC m=+0.128077268 container create 08cda5b2866889fc5ed5c3345d3963c804df6dc1144bb6c1381eb4078c369197 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:41:20.751 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:20 smithi071 podman[68836]: 2024-09-21 06:41:20.749900122 +0000 UTC m=+0.371890502 container init 08cda5b2866889fc5ed5c3345d3963c804df6dc1144bb6c1381eb4078c369197 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T06:41:21.018 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:20 smithi071 podman[68836]: 2024-09-21 06:41:20.753280006 +0000 UTC m=+0.375270381 container start 08cda5b2866889fc5ed5c3345d3963c804df6dc1144bb6c1381eb4078c369197 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10-deactivate, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:41:21.018 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:20 smithi071 podman[68836]: 2024-09-21 06:41:20.841826974 +0000 UTC m=+0.463817354 container attach 08cda5b2866889fc5ed5c3345d3963c804df6dc1144bb6c1381eb4078c369197 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:41:21.018 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 21 06:41:20 smithi071 podman[68836]: 2024-09-21 06:41:20.943670189 +0000 UTC m=+0.565660571 container died 08cda5b2866889fc5ed5c3345d3963c804df6dc1144bb6c1381eb4078c369197 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T06:41:21.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:20 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:20.802+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:21.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:20 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:20.802+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:21.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:20 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:20.802+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:21.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:20 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:20.802+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:21.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:20 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:20.802+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:21.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:20 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:20.802+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:46.924640+0000 front 2024-09-21T06:40:46.924521+0000 (oldest deadline 2024-09-21T06:41:11.624425+0000) 2024-09-21T06:41:21.100 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:20 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:20.802+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-21T06:40:52.125465+0000 front 2024-09-21T06:40:52.125488+0000 (oldest deadline 2024-09-21T06:41:17.425362+0000) 2024-09-21T06:41:21.510 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T06:41:21.589 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:41:21.589 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T06:41:21.589 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T06:41:21.589 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.11 2024-09-21T06:41:22.071 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:21 smithi175 systemd[1]: Stopping Ceph osd.11 for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:41:22.071 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:21 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:21.786+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:22.071 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:21 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:21.786+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:22.071 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:21 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:21.786+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:22.071 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:21 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:21.786+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:22.071 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:21 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:21.786+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:22.071 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:21 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:21.786+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:46.924640+0000 front 2024-09-21T06:40:46.924521+0000 (oldest deadline 2024-09-21T06:41:11.624425+0000) 2024-09-21T06:41:22.071 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:21 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:21.786+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-21T06:40:52.125465+0000 front 2024-09-21T06:40:52.125488+0000 (oldest deadline 2024-09-21T06:41:17.425362+0000) 2024-09-21T06:41:22.071 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:22 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:22.069+0000 7f4143771640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:41:22.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:22 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:22.069+0000 7f4143771640 -1 osd.11 91 *** Got signal Terminated *** 2024-09-21T06:41:22.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:22 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:22.069+0000 7f4143771640 -1 osd.11 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:41:23.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:22 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:22.824+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:23.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:22 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:22.824+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:23.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:22 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:22.824+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:23.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:22 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:22.824+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:23.100 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:22 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:22.824+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:23.100 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:22 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:22.824+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:46.924640+0000 front 2024-09-21T06:40:46.924521+0000 (oldest deadline 2024-09-21T06:41:11.624425+0000) 2024-09-21T06:41:23.100 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:22 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:22.824+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-21T06:40:52.125465+0000 front 2024-09-21T06:40:52.125488+0000 (oldest deadline 2024-09-21T06:41:17.425362+0000) 2024-09-21T06:41:24.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:23 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:23.775+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:24.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:23 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:23.775+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:24.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:23 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:23.775+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:24.100 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:23 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:23.775+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:24.100 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:23 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:23.775+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:24.100 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:23 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:23.775+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:46.924640+0000 front 2024-09-21T06:40:46.924521+0000 (oldest deadline 2024-09-21T06:41:11.624425+0000) 2024-09-21T06:41:24.100 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:23 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:23.775+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-21T06:40:52.125465+0000 front 2024-09-21T06:40:52.125488+0000 (oldest deadline 2024-09-21T06:41:17.425362+0000) 2024-09-21T06:41:24.100 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:23 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:23.775+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6820 osd.8 since back 2024-09-21T06:40:59.626641+0000 front 2024-09-21T06:40:59.626658+0000 (oldest deadline 2024-09-21T06:41:23.726637+0000) 2024-09-21T06:41:25.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:24 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:24.763+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:25.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:24 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:24.763+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:25.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:24 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:24.763+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:25.100 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:24 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:24.763+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:25.100 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:24 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:24.763+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:25.100 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:24 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:24.763+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:46.924640+0000 front 2024-09-21T06:40:46.924521+0000 (oldest deadline 2024-09-21T06:41:11.624425+0000) 2024-09-21T06:41:25.100 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:24 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:24.763+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-21T06:40:52.125465+0000 front 2024-09-21T06:40:52.125488+0000 (oldest deadline 2024-09-21T06:41:17.425362+0000) 2024-09-21T06:41:25.100 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:24 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:24.763+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6820 osd.8 since back 2024-09-21T06:40:59.626641+0000 front 2024-09-21T06:40:59.626658+0000 (oldest deadline 2024-09-21T06:41:23.726637+0000) 2024-09-21T06:41:26.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:25 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:25.758+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:26.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:25 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:25.758+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:26.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:25 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:25.758+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:26.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:25 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:25.758+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:26.100 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:25 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:25.758+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:26.100 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:25 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:25.758+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:46.924640+0000 front 2024-09-21T06:40:46.924521+0000 (oldest deadline 2024-09-21T06:41:11.624425+0000) 2024-09-21T06:41:26.100 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:25 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:25.758+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-21T06:40:52.125465+0000 front 2024-09-21T06:40:52.125488+0000 (oldest deadline 2024-09-21T06:41:17.425362+0000) 2024-09-21T06:41:26.100 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:25 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:25.758+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6820 osd.8 since back 2024-09-21T06:40:59.626641+0000 front 2024-09-21T06:40:59.626658+0000 (oldest deadline 2024-09-21T06:41:23.726637+0000) 2024-09-21T06:41:27.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:26 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:26.750+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-21T06:39:55.215708+0000 front 2024-09-21T06:39:55.215656+0000 (oldest deadline 2024-09-21T06:40:19.216187+0000) 2024-09-21T06:41:27.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:26 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:26.750+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-21T06:40:03.317409+0000 front 2024-09-21T06:40:03.317430+0000 (oldest deadline 2024-09-21T06:40:28.617392+0000) 2024-09-21T06:41:27.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:26 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:26.750+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T06:40:13.719342+0000 front 2024-09-21T06:40:13.719201+0000 (oldest deadline 2024-09-21T06:40:36.619286+0000) 2024-09-21T06:41:27.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:26 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:26.750+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-21T06:40:29.421730+0000 front 2024-09-21T06:40:29.421763+0000 (oldest deadline 2024-09-21T06:40:51.721791+0000) 2024-09-21T06:41:27.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:26 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:26.750+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T06:40:35.222828+0000 front 2024-09-21T06:40:35.222861+0000 (oldest deadline 2024-09-21T06:40:59.922893+0000) 2024-09-21T06:41:27.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:26 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:26.750+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-21T06:40:46.924640+0000 front 2024-09-21T06:40:46.924521+0000 (oldest deadline 2024-09-21T06:41:11.624425+0000) 2024-09-21T06:41:27.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:26 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:26.750+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-21T06:40:52.125465+0000 front 2024-09-21T06:40:52.125488+0000 (oldest deadline 2024-09-21T06:41:17.425362+0000) 2024-09-21T06:41:27.100 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:26 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11[58411]: 2024-09-21T06:41:26.750+0000 7f413fd5c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.175:6820 osd.8 since back 2024-09-21T06:40:59.626641+0000 front 2024-09-21T06:40:59.626658+0000 (oldest deadline 2024-09-21T06:41:23.726637+0000) 2024-09-21T06:41:27.738 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:27 smithi175 podman[68158]: 2024-09-21 06:41:27.463483422 +0000 UTC m=+5.671574829 container died 0760c66bb064a75d0bab1025e1b6c2273332fbc8b4faf84e6e1c167b7e29986f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T06:41:28.095 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:27 smithi175 podman[68158]: 2024-09-21 06:41:27.851630015 +0000 UTC m=+6.059721432 container cleanup 0760c66bb064a75d0bab1025e1b6c2273332fbc8b4faf84e6e1c167b7e29986f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:41:28.095 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:27 smithi175 bash[68158]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11 2024-09-21T06:41:28.349 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:28 smithi175 podman[68185]: 2024-09-21 06:41:28.094286921 +0000 UTC m=+0.627943746 container remove 0760c66bb064a75d0bab1025e1b6c2273332fbc8b4faf84e6e1c167b7e29986f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:41:28.724 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:28 smithi175 podman[68278]: 2024-09-21 06:41:28.412225631 +0000 UTC m=+0.107720774 container create fae05b1041dce69c06d591a9b578f813883d9663c0e0e0eb4f7856a0033d05a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:41:28.724 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:28 smithi175 podman[68278]: 2024-09-21 06:41:28.320035402 +0000 UTC m=+0.015530476 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:41:28.724 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:28 smithi175 podman[68278]: 2024-09-21 06:41:28.63951068 +0000 UTC m=+0.335005754 container init fae05b1041dce69c06d591a9b578f813883d9663c0e0e0eb4f7856a0033d05a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:41:28.724 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:28 smithi175 podman[68278]: 2024-09-21 06:41:28.64274216 +0000 UTC m=+0.338237237 container start fae05b1041dce69c06d591a9b578f813883d9663c0e0e0eb4f7856a0033d05a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:41:28.724 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:28 smithi175 podman[68278]: 2024-09-21 06:41:28.722706217 +0000 UTC m=+0.418201311 container attach fae05b1041dce69c06d591a9b578f813883d9663c0e0e0eb4f7856a0033d05a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T06:41:29.099 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 06:41:28 smithi175 podman[68278]: 2024-09-21 06:41:28.834722067 +0000 UTC m=+0.530217145 container died fae05b1041dce69c06d591a9b578f813883d9663c0e0e0eb4f7856a0033d05a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T06:41:29.413 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T06:41:29.451 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:41:29.452 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T06:41:29.452 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T06:41:29.452 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.a 2024-09-21T06:41:29.760 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 21 06:41:29 smithi063 systemd[1]: Stopping Ceph mds.a for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:41:30.082 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 21 06:41:29 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-a[73284]: 2024-09-21T06:41:29.758+0000 7f8e25dc4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:41:30.082 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 21 06:41:29 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-a[73284]: 2024-09-21T06:41:29.758+0000 7f8e25dc4640 -1 mds.a *** got signal Terminated *** 2024-09-21T06:41:31.044 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 21 06:41:30 smithi063 podman[126099]: 2024-09-21 06:41:30.772693984 +0000 UTC m=+1.108996989 container died e1f8a16f1e1ecd98d450addc1afe0d0cd79f28137a1da184edaddc6a50d9f360 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T06:41:31.332 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 21 06:41:31 smithi063 podman[126099]: 2024-09-21 06:41:31.11694684 +0000 UTC m=+1.453249839 container cleanup e1f8a16f1e1ecd98d450addc1afe0d0cd79f28137a1da184edaddc6a50d9f360 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T06:41:31.332 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 21 06:41:31 smithi063 bash[126099]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-a 2024-09-21T06:41:31.332 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 21 06:41:31 smithi063 podman[126111]: 2024-09-21 06:41:31.285204475 +0000 UTC m=+0.507500008 container remove e1f8a16f1e1ecd98d450addc1afe0d0cd79f28137a1da184edaddc6a50d9f360 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2) 2024-09-21T06:41:31.509 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T06:41:31.543 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:41:31.544 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T06:41:31.544 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T06:41:31.544 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.d 2024-09-21T06:41:31.832 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 21 06:41:31 smithi063 systemd[1]: Stopping Ceph mds.d for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:41:32.332 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 21 06:41:31 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-d[72057]: 2024-09-21T06:41:31.879+0000 7f56d4033640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:41:32.332 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 21 06:41:31 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-d[72057]: 2024-09-21T06:41:31.879+0000 7f56d4033640 -1 mds.d *** got signal Terminated *** 2024-09-21T06:41:35.665 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 21 06:41:35 smithi063 podman[126221]: 2024-09-21 06:41:35.372996253 +0000 UTC m=+3.597419839 container died c5701a61e3e7c5ef1ef7cea843c2a5d2b42fcc83d32396e85260cff6ed78aec7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:41:35.974 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 21 06:41:35 smithi063 podman[126221]: 2024-09-21 06:41:35.754421155 +0000 UTC m=+3.978844731 container cleanup c5701a61e3e7c5ef1ef7cea843c2a5d2b42fcc83d32396e85260cff6ed78aec7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-d, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T06:41:35.974 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 21 06:41:35 smithi063 bash[126221]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-d 2024-09-21T06:41:36.136 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T06:41:36.172 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:41:36.172 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T06:41:36.172 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T06:41:36.172 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.g 2024-09-21T06:41:36.493 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 21 06:41:36 smithi063 systemd[1]: Stopping Ceph mds.g for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:41:36.832 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 21 06:41:36 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-g[72896]: 2024-09-21T06:41:36.491+0000 7fba3e234640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:41:36.832 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 21 06:41:36 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-g[72896]: 2024-09-21T06:41:36.491+0000 7fba3e234640 -1 mds.g *** got signal Terminated *** 2024-09-21T06:41:39.043 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 21 06:41:38 smithi063 podman[126350]: 2024-09-21 06:41:38.769189596 +0000 UTC m=+2.374505482 container died 6b8372c01d429f3810f265a0428b6f0954e684ec113d68c3e5c368d519dc9a07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-g, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:41:39.332 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 21 06:41:39 smithi063 podman[126350]: 2024-09-21 06:41:39.141181285 +0000 UTC m=+2.746497170 container cleanup 6b8372c01d429f3810f265a0428b6f0954e684ec113d68c3e5c368d519dc9a07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-g, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T06:41:39.332 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 21 06:41:39 smithi063 bash[126350]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-g 2024-09-21T06:41:39.578 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T06:41:39.612 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:41:39.612 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T06:41:39.613 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T06:41:39.613 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.j 2024-09-21T06:41:39.938 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 21 06:41:39 smithi063 systemd[1]: Stopping Ceph mds.j for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:41:40.332 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 21 06:41:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-j[71696]: 2024-09-21T06:41:39.936+0000 7f9ece02d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:41:40.332 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 21 06:41:39 smithi063 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-j[71696]: 2024-09-21T06:41:39.936+0000 7f9ece02d640 -1 mds.j *** got signal Terminated *** 2024-09-21T06:41:44.022 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 21 06:41:43 smithi063 podman[126471]: 2024-09-21 06:41:43.745097386 +0000 UTC m=+3.901511592 container died 251f166d66e0294ac62ed7df3ccdc6efb98cddb4e9214181857f5d2ecd376fce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-j, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:41:44.332 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 21 06:41:44 smithi063 podman[126471]: 2024-09-21 06:41:44.187267315 +0000 UTC m=+4.343681521 container cleanup 251f166d66e0294ac62ed7df3ccdc6efb98cddb4e9214181857f5d2ecd376fce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-j, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T06:41:44.332 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 21 06:41:44 smithi063 bash[126471]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-j 2024-09-21T06:41:44.611 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T06:41:44.634 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 21 06:41:44 smithi063 podman[126484]: 2024-09-21 06:41:44.363395556 +0000 UTC m=+0.608777349 container remove 251f166d66e0294ac62ed7df3ccdc6efb98cddb4e9214181857f5d2ecd376fce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-j, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T06:41:44.634 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 21 06:41:44 smithi063 systemd[1]: ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.j.service: Deactivated successfully. 2024-09-21T06:41:44.634 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 21 06:41:44 smithi063 systemd[1]: Stopped Ceph mds.j for 140899c8-77e1-11ef-baf5-efdc52797490. 2024-09-21T06:41:44.634 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 21 06:41:44 smithi063 systemd[1]: ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.j.service: Consumed 1.082s CPU time. 2024-09-21T06:41:44.647 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:41:44.647 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T06:41:44.647 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T06:41:44.647 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.b 2024-09-21T06:41:44.945 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:41:44 smithi071 systemd[1]: Stopping Ceph mds.b for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:41:45.204 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:41:44 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[65774]: 2024-09-21T06:41:44.943+0000 7f086f815640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:41:45.204 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:41:44 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b[65774]: 2024-09-21T06:41:44.943+0000 7f086f815640 -1 mds.b *** got signal Terminated *** 2024-09-21T06:41:47.138 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:41:46 smithi071 podman[68939]: 2024-09-21 06:41:46.773476904 +0000 UTC m=+1.934416883 container died a851cf22920a40afcc65d46de0d0061adf5be20a053065543b61e0010fcf0db7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T06:41:47.512 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:41:47 smithi071 podman[68939]: 2024-09-21 06:41:47.234909416 +0000 UTC m=+2.395849394 container cleanup a851cf22920a40afcc65d46de0d0061adf5be20a053065543b61e0010fcf0db7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:41:47.512 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 21 06:41:47 smithi071 bash[68939]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-b 2024-09-21T06:41:47.682 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T06:41:47.717 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:41:47.718 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T06:41:47.718 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T06:41:47.718 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.e 2024-09-21T06:41:48.040 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 21 06:41:47 smithi071 systemd[1]: Stopping Ceph mds.e for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:41:48.518 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 21 06:41:48 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-e[63430]: 2024-09-21T06:41:48.038+0000 7f008f30a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:41:48.518 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 21 06:41:48 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-e[63430]: 2024-09-21T06:41:48.038+0000 7f008f30a640 -1 mds.e *** got signal Terminated *** 2024-09-21T06:41:51.073 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 21 06:41:50 smithi071 podman[69072]: 2024-09-21 06:41:50.781799827 +0000 UTC m=+2.844511912 container died a387471fdfc80cef85ed86b24105af2b58b8d5a1340abfa291ecd560ac24d8f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-e, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:41:51.407 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 21 06:41:51 smithi071 podman[69072]: 2024-09-21 06:41:51.171719726 +0000 UTC m=+3.234431809 container cleanup a387471fdfc80cef85ed86b24105af2b58b8d5a1340abfa291ecd560ac24d8f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T06:41:51.407 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 21 06:41:51 smithi071 bash[69072]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-e 2024-09-21T06:41:51.658 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 21 06:41:51 smithi071 podman[69083]: 2024-09-21 06:41:51.406221355 +0000 UTC m=+0.623994196 container remove a387471fdfc80cef85ed86b24105af2b58b8d5a1340abfa291ecd560ac24d8f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T06:41:51.662 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T06:41:51.694 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:41:51.695 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T06:41:51.695 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T06:41:51.695 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.h 2024-09-21T06:41:52.018 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 21 06:41:51 smithi071 systemd[1]: Stopping Ceph mds.h for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:41:52.518 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 21 06:41:52 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-h[63701]: 2024-09-21T06:41:52.016+0000 7f6d7c170640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:41:52.518 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 21 06:41:52 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-h[63701]: 2024-09-21T06:41:52.016+0000 7f6d7c170640 -1 mds.h *** got signal Terminated *** 2024-09-21T06:41:55.076 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 21 06:41:54 smithi071 podman[69192]: 2024-09-21 06:41:54.791915115 +0000 UTC m=+2.875444552 container died 04dce2dea4f01a33ea6dcb864389b9e535a9df40faa133ec540d8d4b16cde70d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-h, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T06:41:55.435 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 21 06:41:55 smithi071 podman[69192]: 2024-09-21 06:41:55.175196515 +0000 UTC m=+3.258725944 container cleanup 04dce2dea4f01a33ea6dcb864389b9e535a9df40faa133ec540d8d4b16cde70d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-h, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:41:55.435 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 21 06:41:55 smithi071 bash[69192]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-h 2024-09-21T06:41:55.565 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T06:41:55.598 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:41:55.598 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T06:41:55.598 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T06:41:55.598 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.k 2024-09-21T06:41:55.768 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 21 06:41:55 smithi071 systemd[1]: Stopping Ceph mds.k for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:41:56.218 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 21 06:41:55 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-k[63150]: 2024-09-21T06:41:55.928+0000 7f0cdc1b1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:41:56.218 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 21 06:41:55 smithi071 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-k[63150]: 2024-09-21T06:41:55.928+0000 7f0cdc1b1640 -1 mds.k *** got signal Terminated *** 2024-09-21T06:41:59.063 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 21 06:41:58 smithi071 podman[69314]: 2024-09-21 06:41:58.802607872 +0000 UTC m=+2.984527462 container died eaccc093baabc54caf882a229023a5059e1d5cd96da8475bc1bae4d84dd9d743 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-k, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T06:41:59.447 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 21 06:41:59 smithi071 podman[69314]: 2024-09-21 06:41:59.1618455 +0000 UTC m=+3.343765089 container cleanup eaccc093baabc54caf882a229023a5059e1d5cd96da8475bc1bae4d84dd9d743 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-k, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T06:41:59.447 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 21 06:41:59 smithi071 bash[69314]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-k 2024-09-21T06:41:59.585 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T06:41:59.617 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:41:59.617 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T06:41:59.617 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T06:41:59.617 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.c 2024-09-21T06:41:59.918 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 06:41:59 smithi175 systemd[1]: Stopping Ceph mds.c for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:42:00.172 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 06:41:59 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-c[63536]: 2024-09-21T06:41:59.915+0000 7f74fc1d7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:42:00.172 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 06:41:59 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-c[63536]: 2024-09-21T06:41:59.915+0000 7f74fc1d7640 -1 mds.c *** got signal Terminated *** 2024-09-21T06:42:03.076 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 06:42:02 smithi175 podman[68381]: 2024-09-21 06:42:02.782828285 +0000 UTC m=+2.972369159 container died 553dd633b676f34edae2d12d455fdc05349d2f0d7f854903c774d744529311f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-c, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:42:03.349 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 06:42:03 smithi175 podman[68381]: 2024-09-21 06:42:03.174648897 +0000 UTC m=+3.364189752 container cleanup 553dd633b676f34edae2d12d455fdc05349d2f0d7f854903c774d744529311f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T06:42:03.349 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 06:42:03 smithi175 bash[68381]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-c 2024-09-21T06:42:03.586 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T06:42:03.622 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:42:03.622 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T06:42:03.622 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T06:42:03.623 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.f 2024-09-21T06:42:03.849 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 06:42:03 smithi175 systemd[1]: Stopping Ceph mds.f for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:42:04.349 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 06:42:03 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-f[63268]: 2024-09-21T06:42:03.944+0000 7f0d05f78640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:42:04.349 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 06:42:03 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-f[63268]: 2024-09-21T06:42:03.944+0000 7f0d05f78640 -1 mds.f *** got signal Terminated *** 2024-09-21T06:42:07.081 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 06:42:06 smithi175 podman[68514]: 2024-09-21 06:42:06.792419702 +0000 UTC m=+2.950347596 container stop 86ddb3c90101ce6f8d57e4dbbbf82350f8b42ed47c7787cffccf4e409d763f24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T06:42:07.081 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 06:42:06 smithi175 podman[68514]: 2024-09-21 06:42:06.818146597 +0000 UTC m=+2.976074511 container died 86ddb3c90101ce6f8d57e4dbbbf82350f8b42ed47c7787cffccf4e409d763f24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T06:42:07.349 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 06:42:07 smithi175 podman[68514]: 2024-09-21 06:42:07.161580947 +0000 UTC m=+3.319508831 container cleanup 86ddb3c90101ce6f8d57e4dbbbf82350f8b42ed47c7787cffccf4e409d763f24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-f, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T06:42:07.349 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 06:42:07 smithi175 bash[68514]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-f 2024-09-21T06:42:07.581 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T06:42:07.614 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:42:07.614 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T06:42:07.614 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T06:42:07.614 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.i 2024-09-21T06:42:07.925 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 06:42:07 smithi175 systemd[1]: Stopping Ceph mds.i for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:42:08.349 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 06:42:07 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-i[63803]: 2024-09-21T06:42:07.922+0000 7f1c238a6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:42:08.349 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 06:42:07 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-i[63803]: 2024-09-21T06:42:07.922+0000 7f1c238a6640 -1 mds.i *** got signal Terminated *** 2024-09-21T06:42:11.067 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 06:42:10 smithi175 podman[68636]: 2024-09-21 06:42:10.790033895 +0000 UTC m=+2.965675335 container died 088fde11642f1a12916ec26f25acd5664f34630cfc10e168edf7c500528b86da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T06:42:11.349 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 06:42:11 smithi175 podman[68636]: 2024-09-21 06:42:11.148468305 +0000 UTC m=+3.324109748 container cleanup 088fde11642f1a12916ec26f25acd5664f34630cfc10e168edf7c500528b86da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-i, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T06:42:11.349 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 06:42:11 smithi175 bash[68636]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-i 2024-09-21T06:42:11.579 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T06:42:11.612 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:42:11.612 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T06:42:11.612 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T06:42:11.612 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.l 2024-09-21T06:42:11.849 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 06:42:11 smithi175 systemd[1]: Stopping Ceph mds.l for 140899c8-77e1-11ef-baf5-efdc52797490... 2024-09-21T06:42:12.349 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 06:42:11 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-l[62986]: 2024-09-21T06:42:11.951+0000 7ff7e06c2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:42:12.349 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 06:42:11 smithi175 ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-l[62986]: 2024-09-21T06:42:11.951+0000 7ff7e06c2640 -1 mds.l *** got signal Terminated *** 2024-09-21T06:42:15.046 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 06:42:14 smithi175 podman[68758]: 2024-09-21 06:42:14.770708031 +0000 UTC m=+2.946159813 container died bd5a6049237d068677370e9d9ca862a3f2154c2c768fe141187a4429c72686f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-l, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T06:42:15.349 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 06:42:15 smithi175 podman[68758]: 2024-09-21 06:42:15.14417873 +0000 UTC m=+3.319630514 container cleanup bd5a6049237d068677370e9d9ca862a3f2154c2c768fe141187a4429c72686f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T06:42:15.349 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 06:42:15 smithi175 bash[68758]: ceph-140899c8-77e1-11ef-baf5-efdc52797490-mds-l 2024-09-21T06:42:15.570 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-140899c8-77e1-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T06:42:15.602 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:42:15.602 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T06:42:15.602 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 140899c8-77e1-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:42:15.817 INFO:teuthology.orchestra.run.smithi063.stdout:Deleting cluster with fsid: 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:42:18.434 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 140899c8-77e1-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:42:18.632 INFO:teuthology.orchestra.run.smithi071.stdout:Deleting cluster with fsid: 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:42:21.122 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 140899c8-77e1-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:42:21.326 INFO:teuthology.orchestra.run.smithi175.stdout:Deleting cluster with fsid: 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:42:23.708 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:42:23.743 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:42:23.776 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:42:23.803 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T06:42:23.805 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913538/remote/smithi063/crash 2024-09-21T06:42:23.806 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:42:23.849 INFO:teuthology.orchestra.run.smithi063.stderr:tar: /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:42:23.849 INFO:teuthology.orchestra.run.smithi063.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:42:23.851 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913538/remote/smithi071/crash 2024-09-21T06:42:23.852 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:42:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:tar: /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:42:23.897 INFO:teuthology.orchestra.run.smithi071.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:42:23.899 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913538/remote/smithi175/crash 2024-09-21T06:42:23.899 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:42:23.938 INFO:teuthology.orchestra.run.smithi175.stderr:tar: /var/lib/ceph/140899c8-77e1-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:42:23.938 INFO:teuthology.orchestra.run.smithi175.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:42:23.939 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T06:42:23.939 DEBUG:teuthology.orchestra.run.smithi063:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-21T06:42:23.983 INFO:tasks.cephadm:Compressing logs... 2024-09-21T06:42:23.983 DEBUG:teuthology.orchestra.run.smithi063:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:42:23.985 DEBUG:teuthology.orchestra.run.smithi071:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:42:23.988 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:42:24.010 INFO:teuthology.orchestra.run.smithi063.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T06:42:24.011 INFO:teuthology.orchestra.run.smithi063.stderr:: No such file or directory 2024-09-21T06:42:24.011 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T06:42:24.012 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:42:24.012 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:42:24.012 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T06:42:24.013 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:42:24.013 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.audit.log: /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T06:42:24.015 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T06:42:24.015 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mon.a.log: 84.3% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:42:24.015 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T06:42:24.015 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:42:24.017 INFO:teuthology.orchestra.run.smithi175.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:42:24.017 INFO:teuthology.orchestra.run.smithi175.stderr:: No such file or directory 2024-09-21T06:42:24.017 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:42:24.017 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T06:42:24.018 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-volume.log: /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T06:42:24.018 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:42:24.018 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T06:42:24.018 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mon.c.log: /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T06:42:24.018 INFO:teuthology.orchestra.run.smithi175.stderr: 81.6% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:42:24.018 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T06:42:24.018 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:42:24.018 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T06:42:24.018 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.log: 90.3% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:42:24.022 INFO:teuthology.orchestra.run.smithi175.stderr: 87.4% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:42:24.022 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T06:42:24.022 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T06:42:24.022 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.g.log: /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.6.log: 90.1% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:42:24.023 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T06:42:24.023 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.log: 87.4% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:42:24.023 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T06:42:24.025 INFO:teuthology.orchestra.run.smithi071.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T06:42:24.025 INFO:teuthology.orchestra.run.smithi071.stderr:: No such file or directory 2024-09-21T06:42:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T06:42:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T06:42:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.10.log: /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:42:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T06:42:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T06:42:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T06:42:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:42:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:42:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.audit.log: 90.2% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:42:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T06:42:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.cephadm.log: 81.6% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:42:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:42:24.027 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.8.log: 90.9% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:42:24.027 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T06:42:24.029 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.d.log: 91.1% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:42:24.029 INFO:teuthology.orchestra.run.smithi063.stderr: 95.1% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T06:42:24.029 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T06:42:24.029 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T06:42:24.029 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mgr.y.log: 91.0% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:42:24.030 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T06:42:24.031 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.log: 92.6% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T06:42:24.031 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T06:42:24.033 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.h.log: 87.4% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:42:24.035 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mgr.z.log: 92.6% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T06:42:24.035 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T06:42:24.036 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.j.log: 95.1% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T06:42:24.036 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:42:24.045 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T06:42:24.048 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:42:24.055 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:42:24.068 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:42:24.070 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:42:24.071 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:42:24.328 INFO:teuthology.orchestra.run.smithi071.stderr: 94.4% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T06:42:24.362 INFO:teuthology.orchestra.run.smithi063.stderr: 94.2% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T06:42:24.406 INFO:teuthology.orchestra.run.smithi063.stderr: 90.3% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T06:42:24.479 INFO:teuthology.orchestra.run.smithi175.stderr: 94.6% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T06:42:24.537 INFO:teuthology.orchestra.run.smithi071.stderr: 91.8% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T06:42:24.667 INFO:teuthology.orchestra.run.smithi175.stderr: 91.8% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T06:42:25.123 INFO:teuthology.orchestra.run.smithi071.stderr: 94.9% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T06:42:25.337 INFO:teuthology.orchestra.run.smithi063.stderr: 90.3% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T06:42:27.660 INFO:teuthology.orchestra.run.smithi063.stderr: 93.4% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T06:42:29.228 INFO:teuthology.orchestra.run.smithi175.stderr: 93.6% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T06:42:29.517 INFO:teuthology.orchestra.run.smithi071.stderr: 92.2% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T06:42:30.760 INFO:teuthology.orchestra.run.smithi175.stderr: 93.5% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T06:42:34.691 INFO:teuthology.orchestra.run.smithi063.stderr: 91.6% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T06:42:34.734 INFO:teuthology.orchestra.run.smithi063.stderr: 91.9% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T06:42:35.483 INFO:teuthology.orchestra.run.smithi175.stderr: 93.5% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T06:42:35.595 INFO:teuthology.orchestra.run.smithi063.stderr: 91.7% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T06:42:35.764 INFO:teuthology.orchestra.run.smithi175.stderr: 91.9% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T06:42:35.945 INFO:teuthology.orchestra.run.smithi063.stderr: 91.6% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T06:42:35.947 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-21T06:42:35.947 INFO:teuthology.orchestra.run.smithi063.stderr:real 0m11.948s 2024-09-21T06:42:35.948 INFO:teuthology.orchestra.run.smithi063.stderr:user 0m49.077s 2024-09-21T06:42:35.948 INFO:teuthology.orchestra.run.smithi063.stderr:sys 0m1.476s 2024-09-21T06:42:36.412 INFO:teuthology.orchestra.run.smithi175.stderr: 91.5% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T06:42:36.678 INFO:teuthology.orchestra.run.smithi175.stderr: 91.6% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T06:42:36.696 INFO:teuthology.orchestra.run.smithi071.stderr: 91.7% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T06:42:39.629 INFO:teuthology.orchestra.run.smithi071.stderr: 91.9% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T06:42:39.674 INFO:teuthology.orchestra.run.smithi071.stderr: 93.8% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T06:42:39.818 INFO:teuthology.orchestra.run.smithi071.stderr: 91.5% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T06:42:40.974 INFO:teuthology.orchestra.run.smithi175.stderr: 91.2% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T06:42:40.974 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-09-21T06:42:40.974 INFO:teuthology.orchestra.run.smithi175.stderr:real 0m16.972s 2024-09-21T06:42:40.974 INFO:teuthology.orchestra.run.smithi175.stderr:user 1m15.550s 2024-09-21T06:42:40.975 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m2.164s 2024-09-21T06:42:49.313 INFO:teuthology.orchestra.run.smithi071.stderr: 93.4% -- replaced with /var/log/ceph/140899c8-77e1-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T06:42:49.315 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-21T06:42:49.315 INFO:teuthology.orchestra.run.smithi071.stderr:real 0m25.312s 2024-09-21T06:42:49.315 INFO:teuthology.orchestra.run.smithi071.stderr:user 1m29.351s 2024-09-21T06:42:49.315 INFO:teuthology.orchestra.run.smithi071.stderr:sys 0m2.661s 2024-09-21T06:42:49.315 INFO:tasks.cephadm:Archiving logs... 2024-09-21T06:42:49.316 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913538/remote/smithi063/log 2024-09-21T06:42:49.317 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:42:56.190 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913538/remote/smithi071/log 2024-09-21T06:42:56.191 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:43:07.593 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913538/remote/smithi175/log 2024-09-21T06:43:07.594 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:43:16.808 INFO:tasks.cephadm:Removing cluster... 2024-09-21T06:43:16.808 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 140899c8-77e1-11ef-baf5-efdc52797490 --force 2024-09-21T06:43:17.023 INFO:teuthology.orchestra.run.smithi063.stdout:Deleting cluster with fsid: 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:43:17.366 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 140899c8-77e1-11ef-baf5-efdc52797490 --force 2024-09-21T06:43:17.569 INFO:teuthology.orchestra.run.smithi071.stdout:Deleting cluster with fsid: 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:43:17.931 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 140899c8-77e1-11ef-baf5-efdc52797490 --force 2024-09-21T06:43:18.133 INFO:teuthology.orchestra.run.smithi175.stdout:Deleting cluster with fsid: 140899c8-77e1-11ef-baf5-efdc52797490 2024-09-21T06:43:18.482 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T06:43:18.482 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:43:18.503 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:43:18.519 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:43:18.535 INFO:tasks.cephadm:Teardown complete 2024-09-21T06:43:18.535 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T06:43:18.547 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T06:43:18.547 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:43:18.549 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:43:18.562 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:43:18.663 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T06:43:18.673 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T06:43:18.673 DEBUG:teuthology.orchestra.run.smithi063:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:43:18.676 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:43:18.678 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:43:18.690 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:43:18.690 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:43:18.692 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:43:18.695 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:43:18.695 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-21T06:43:18.695 INFO:teuthology.orchestra.run.smithi071.stdout:^* hv01.front.sepia.ceph.com 3 6 377 43 -97us[ -76us] +/- 59ms 2024-09-21T06:43:18.695 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 +100us[ +120us] +/- 58ms 2024-09-21T06:43:18.695 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 -1123ns[-1123ns] +/- 59ms 2024-09-21T06:43:18.696 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:43:18.697 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:43:18.697 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-09-21T06:43:18.697 INFO:teuthology.orchestra.run.smithi063.stdout:^* hv01.front.sepia.ceph.com 3 6 377 45 -93us[ -69us] +/- 59ms 2024-09-21T06:43:18.697 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 +108us[ +108us] +/- 59ms 2024-09-21T06:43:18.697 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 +20us[ +20us] +/- 59ms 2024-09-21T06:43:18.697 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:43:18.698 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:43:18.698 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-09-21T06:43:18.698 INFO:teuthology.orchestra.run.smithi175.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 -105us[ -97us] +/- 59ms 2024-09-21T06:43:18.698 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 43 +95us[ +103us] +/- 58ms 2024-09-21T06:43:18.698 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 +14us[ +22us] +/- 59ms 2024-09-21T06:43:18.698 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:43:18.699 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T06:43:18.708 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T06:43:18.709 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T06:43:18.738 DEBUG:teuthology.orchestra.run.smithi063:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:43:18.826 DEBUG:teuthology.orchestra.run.smithi071:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:43:18.890 DEBUG:teuthology.orchestra.run.smithi175:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:43:18.955 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:43:18.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:43:18.986 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:43:19.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:43:19.014 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:43:19.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:43:19.041 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T06:43:19.059 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T06:43:19.165 INFO:teuthology.task.internal:Duration was 1969.266360 seconds 2024-09-21T06:43:19.165 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T06:43:19.197 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T06:43:19.197 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:43:19.200 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:43:19.203 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:43:19.241 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:43:19.242 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:43:19.244 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:43:19.638 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T06:43:19.639 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T06:43:19.639 DEBUG:teuthology.orchestra.run.smithi063:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:43:19.660 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2024-09-21T06:43:19.660 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:43:19.699 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2024-09-21T06:43:19.699 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:43:19.723 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T06:43:19.723 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:43:19.725 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:43:19.742 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:43:19.789 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T06:43:19.789 DEBUG:teuthology.orchestra.run.smithi063:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:43:19.794 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:43:19.809 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:43:21.093 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T06:43:21.104 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T06:43:21.105 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:43:21.130 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:43:21.157 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:43:21.187 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T06:43:21.198 DEBUG:teuthology.orchestra.run.smithi063:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:43:21.200 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:43:21.203 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:43:21.222 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = core 2024-09-21T06:43:21.226 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2024-09-21T06:43:21.255 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2024-09-21T06:43:21.282 DEBUG:teuthology.orchestra.run.smithi063:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:43:21.297 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:43:21.297 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:43:21.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:43:21.332 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:43:21.347 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:43:21.348 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T06:43:21.359 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T06:43:21.360 DEBUG:teuthology.misc:Transferring archived files from smithi063:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913538/remote/smithi063 2024-09-21T06:43:21.360 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:43:21.418 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913538/remote/smithi071 2024-09-21T06:43:21.418 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:43:21.454 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913538/remote/smithi175 2024-09-21T06:43:21.455 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:43:21.494 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T06:43:21.494 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:43:21.496 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:43:21.498 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:43:21.545 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T06:43:21.558 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T06:43:21.558 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T06:43:21.582 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T06:43:21.582 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:43:21.584 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:43:21.587 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:43:21.597 INFO:teuthology.orchestra.run.smithi063.stdout: 265811 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:43 /home/ubuntu/cephtest 2024-09-21T06:43:21.599 INFO:teuthology.orchestra.run.smithi071.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:43 /home/ubuntu/cephtest 2024-09-21T06:43:21.603 INFO:teuthology.orchestra.run.smithi175.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:43 /home/ubuntu/cephtest 2024-09-21T06:43:21.604 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T06:43:21.614 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T06:43:21.685 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/fsx}} duration: 1969.266360282898 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T06:43:21.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T06:43:21.797 INFO:teuthology.run:pass